How often do you update the weights of your actor network?

I’m looking for a rational but everything seems to be trial and error: help!

Currently I update the weights every 100 steps to learn 10 step tasks. I thought this would be more computationally efficient as I can parallelize environments and have more diverse experience rather than updating after every step which also pressures the GPU.

Tips are welcome!

submitted by /u/Markovvy
[link] [comments]

Liked Liked