JAX rewrite: 5k FPS → 1.4M FPS (280x speedup on Generals.io RL) ⚡
Six months ago I implemented a NumPy environment for generals.io and trained an agent that hit top 20 on human leaderboards. I reached 5k fps with that setup. In the last couple of days I rewrote everything in JAX with help from opus4.5 (here we go again) and got 1.4M FPS on single H200, which is a 300x speedup! I’m confident that with so much more fps going super-human is much more attainable! For those interested in coding […]