How do I parallelize PPO?

I’m training PPO over Hopper environments, I am also randomizing masses for an ablation study and I want to parallelize the different environments to get results faster, but it tells me that running PPO on a GPU is actually worse, so how do I do it? I’m using stable baseline and gymnasium hopper

submitted by /u/Santo_Games
[link] [comments]

Liked Liked