I built a multi-agent asteroid racing environment in Godot 4.6 and trained the pilots with RL

Hey, this is the second episode in a small series where I’m experimenting with reinforcement learning in Godot 4.6, hoping to build a game using it once I am confident enough.

In this one I took the navigation setup from the first episode and turned it into a racing environment: 25 ships, checkpoints, asteroid fields, a timeout system, and elimination on collision.

The agents don’t use scripted steering, racing lines, or hand-authored behavior. They only get observations, raw thrust/rotation actions, and a reward system, then learn through reinforcement learning inside Godot using RL Agents.

The whole environment was built in Godot 4.6, and the models were made in Blender.

I also put together a small playable build for testing different checkpoints, you can find it in the video description.

Any feedback or questions are welcome.