What’s the go to stack for RLVR ?

I’ve been trying to RLVR fine tune a LLM with GRPO, the issue is there doesn’t seem to be one go to library that u can use.

TRL works and is the most stable with best documentation but it’s limited in terms of async rollouts, environments, etc..

Stuff like skyrl, agent gym rl, agent lightning have steep learning curves and expect you to have really powerful infra.

What I’m looking to is build a custom environment, multi turn RLVR pipeline without having to read the entire repo to understand how to.