Looking for the best resources to learn Reinforcement Learning (Gymnasium + 3D simulation focus)

I’m a CS student currently learning Reinforcement Learning and working with Gymnasium for building environments and training agents.

The aim is to move past simple 2D examples (such as CartPole) and create a bespoke 3D simulation environment, such as an F1-themed autonomous vehicle project where an agent learns to control a 3D environment with obstacles, physics, and realistic controls.

What roadmap would you use if you were starting again today?

Share links, tips, war stories, or hard truths – all are welcome 🙏

Thanks in advance!