I upgraded LunarLander so it would look good in demos. Added it to GitHub.

Get it as part of HelloRL, my modular RL framework:

https://github.com/i10e-lab/helloRL

import helloRL gym.make('LunarLanderUpgraded-v1')