SkyRL Frictions

[tyler-griggs]

Use this thread to report any friction you hit with SkyRL while installing, configuring, or running the framework

The frictions can be anything from small hiccups to full blockers; either way, we'd like to improve on them! For larger issues, we will create a separate dedicated Issues, but this thread will serve as a central place to quickly report friction points.

Thanks for helping us make SkyRL smoother for everyone!

[pbokc]

It's hard to run the Megatron backend on modal (dependencies). An example script similar to skyrl-train/examples/gsm8k/run_gsm8k_modal.sh would be helpful.

[SumanthRH]

Adding an issue I've faced: #693

[srrk-GreenMan]

Adding an issue with SQL example. #639 #683

[SumanthRH]

Adding another issue: #748