Reward function / model is stagnant

Hi, i need some help in the form of ideas. Im trying to train a ppo but the model ends up just not playing, i’ve tried penalty for doing nothing but does not work.