Confused on where to start with Sim2Real / VLA / RL pipelines—Can you share open-source GitHub repos or blueprints to study?
Hey everyone,
I am preparing myself for a robotics role that focuses heavily on the intersection of simulation data generation and generative AI. The job description explicitly calls out:
- Sim Env Design & Synthetic Data: Building diverse, randomized scenes in MuJoCo, Isaac Sim, or ManiSkill to generate large-scale, “human-like” demonstration data.
- RL Core: Training control policies using PPO, GRPO, or model-based RL.
- World Models & VLA: Training/fine-tuning Vision-Language-Action models (like OpenVLA) and implementing predictive world models.
- Behavior Alignment: Applying SFT and DPO (Direct Preference Optimization) to make robotic trajectories reliable.
Honestly, looking at this massive stack all at once is incredibly overwhelming. I want to build a clean, comprehensive portfolio project that ties these elements together, but I am confused about how to structure the pipeline without getting bogged down by buggy physics.
Could anyone share GitHub repositories, open-source codebases, or personal project links that handle these components cleanly?
Thanks a ton!
submitted by /u/laxuu
[link] [comments]
Like
0
Liked
Liked