Movement Tasks
Tune the hyperparameters to steer the moving thing. Can you reach the goal?
Drive the Rover to the Flag
The rover drives in a straight line by default — and sails right past the flag. Pause, tune the steering weights, then run again. Hazard rings reset the rover to the start, and the target shifts a little every run.
🎯 Goal: Change at least one knob, then reach the flag within 320 steps without hitting a hazard ring.
steps: 0 / 320change a knob to unlock a win
Hyperparameters
Balance the Ball on the Beam
The beam pushes the ball away from the middle and a slow drift makes it wander. Tune the controller weights (and the learning-rate gain) until the ball stays in the green zone — without correct tuning it slides off within a few seconds.
🎯 Goal: Change at least one knob, then hold the ball inside the green zone for 3 seconds.
steps: 0held: 0.0s / 3schange a knob to unlock a win
Hyperparameters