How To Setup MuJoCo, Gymnasium, PyTorch, SB3 and TensorBoard on Windows

In this tutorial you will find the steps to create a complete working environment for Reinforcement Learning (RL) and how to run your first training and demo.

The training and demo environment includes:

• Multi-Joint dynamics with Contact (MuJoCo): a physics engine that can be used for robotics, biomechanics and machine learning;
• OpenAI Gymnasium: the open source Python library for developing and comparing reinforcement learning algorithms;
• Stable Baselines3 (SB3): a set of implementations of reinforcement learning algorithms in PyTorch;
• PyTorch: the open-source deep learning library;
• TensorBoard: for viewing the RL training;
• Conda: the open-source and cross-platform package manager and environment management system;

Link here: How To Setup MuJoCo, Gymnasium, PyTorch, SB3 and TensorBoard on Windows