How to bridge the gap between Torch and JAX performance?
Hi, I am working on an RL project for my studies that uses a variant of SAC. The algorithm benefits greatly from being written in JAX, but for this project I have to use PyTorch because we wanted to try a simulation engine Genesis-World that provides Torch tensors. The problem is that the PyTorch reimplementation is about 5× slower (even with torch.compile and after avoiding common performance mistakes). Without torch.compile, it is around 15× slower. The reason seems […]