PuckWorld

In PuckWorld the agent, a blue circle, must navigate towards the green dot while avoiding the larger red puck.

The green dot randomly moves around the screen while the red puck slowly follows the agent.

Valid Actions

Up, down, left and right apply thrusters to the agent. It adds velocity to the agent which decays over time.

Terminal states (game_over)

None. This is a continuous game.

Rewards

The agent is rewarded based on its distance to the green dot, where lower values are good. If the agent is within the large red radius it receives a negative reward. The negative reward is proportional to the agents distance from the pucks center.

class ple.games.puckworld.PuckWorld(width=64, height=64)

Based Karpthy’s PuckWorld in REINFORCEjs.

Parameters:

width : int

Screen width.

height : int

Screen height, recommended to be same dimension as width.

getGameState()

Gets a non-visual state representation of the game.

Returns:

dict

• player x position.
• player y position.
• players x velocity.
• players y velocity.
• good creep x position.
• good creep y position.
• bad creep x position.
• bad creep y position.

See code for structure.