Enable more Ruff lints & fix issues

[akx]

What does this PR do?

Follows up on #2400.
Sibling of huggingface/trl#1300 and huggingface/peft#1421

I didn't enable the full B family yet, because there's still about 90 errors left if I do, and best keep these PRs somewhat reviewable...

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Did you read the contributor guideline, Pull Request section?
• Was this discussed/approved via a Github issue or the forum? Please add a link
  to it if that's the case.
• Did you make sure to update the documentation with your changes? Here are the
  documentation guidelines, and
  here are tips on formatting docstrings.
• Did you write any new necessary tests?

Who can review?

cc @muellerzr

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[BenjaminBossan]

Thanks for extending the use of ruff in this repo. The changes look good, I just found one instance which I think is better fixed manually. Please take a look.

[akx]

Gentle ping @BenjaminBossan :)

[BenjaminBossan]

Thanks for the adjustments, LGTM. Leaving it up to @muellerzr to merge.

And please always ping when the PR is ready for the next review round.

[muellerzr]

Thanks for bringing us to 2.x.x for ruff! Can you run make style; make quality once more? This should fix the last failure case on quality (in megatron)

[akx]

Can you run make style; make quality once more?

Rebased (and fixed the couple new UP complaints that popped up from pippy examples), done.

[BenjaminBossan]

I did a re-check after the latest changes, still LGTM.