Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adds the Hydra configuration system for RL training #700

Merged
merged 35 commits into from
Aug 17, 2024

Conversation

Dhoeller19
Copy link
Contributor

@Dhoeller19 Dhoeller19 commented Jul 18, 2024

Description

This MR adds utilities to enable the hydra configuration system.
Using the train.py scripts, the user can now change any parameter in the environment or agent configs from command line inputs, for example:

python source/standalone/workflows/rsl_rl/train.py --task Isaac-Cartpole-v0 --headless env.actions.joint_effort.scale=10.0

Type of change

  • New feature (non-breaking change which adds functionality)

Checklist

  • I have run the pre-commit checks with ./isaaclab.sh --format
  • I have made corresponding changes to the documentation
  • My changes generate no new warnings
  • I have added tests that prove my fix is effective or that my feature works
  • I have updated the changelog and the corresponding version in the extension's config/extension.toml file
  • I have added my name to the CONTRIBUTORS.md or my name already exists there

@Mayankm96 Mayankm96 changed the title Adds the Hydra configuration system Adds the Hydra configuration system for RL training Jul 28, 2024
Copy link
Contributor

@romesco romesco left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some high-level comments, but I will follow up with some snippets.

Also general note: Currently, this PR leaves a lot on the table w.r.t the benefits of typing and config groups, but I understand that the minimum viable integration is important to get shipped first!

@kellyguo11
Copy link
Contributor

Thanks for the review and recommendations @romesco! I'll get this one merged in first as the initial integration, please feel free to create follow up pull requests.

@kellyguo11 kellyguo11 merged commit bf068c8 into main Aug 17, 2024
2 of 3 checks passed
@kellyguo11 kellyguo11 deleted the feature/hydra-configuration branch August 17, 2024 02:41
Holiclife-KTH added a commit to IROL-SSU/IsaacLab_Old that referenced this pull request Aug 20, 2024
kemjensak added a commit to IROL-SSU/IsaacLab_Old that referenced this pull request Aug 30, 2024
iamdrfly pushed a commit to iamdrfly/IsaacLab that referenced this pull request Nov 21, 2024
# Description

This MR adds utilities to enable the hydra configuration system.
Using the `train.py` scripts, the user can now change any parameter in
the environment or agent configs from command line inputs, for example:
``` 
python source/standalone/workflows/rsl_rl/train.py --task Isaac-Cartpole-v0 --headless env.actions.joint_effort.scale=10.0
```

## Type of change

- New feature (non-breaking change which adds functionality)

## Checklist

- [ ] I have run the [`pre-commit` checks](https://pre-commit.com/) with
`./isaaclab.sh --format`
- [ ] I have made corresponding changes to the documentation
- [ ] My changes generate no new warnings
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [ ] I have updated the changelog and the corresponding version in the
extension's `config/extension.toml` file
- [ ] I have added my name to the `CONTRIBUTORS.md` or my name already
exists there

---------

Signed-off-by: David Hoeller <dhoeller@nvidia.com>
Co-authored-by: Mayank Mittal <12863862+Mayankm96@users.noreply.github.com>
Co-authored-by: Kelly Guo <kellyg@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants