Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allows having hybrid dimensional terms inside an observation group #772

Merged
merged 13 commits into from
Aug 3, 2024

Conversation

Mayankm96
Copy link
Contributor

@Mayankm96 Mayankm96 commented Aug 1, 2024

Description

Previously, the observation manager rigidly tried concatenating all the terms along the last dimension at construction. However, when one has hybrid-dimensional terms inside the observation group, this operation would fail, leading to an error. In principle, the concatenation should only happen when users set the attribute concatenate_terms to True inside the group settings.

This MR lifts the above operation and adds a proper error when users try to concatenate observation terms of different shapes. They must set the concatenation flag to False if they want a "hybrid" observation group.

Fixes #768

Type of change

  • New feature (non-breaking change which adds functionality)

Checklist

  • I have run the pre-commit checks with ./isaaclab.sh --format
  • I have made corresponding changes to the documentation
  • My changes generate no new warnings
  • I have added tests that prove my fix is effective or that my feature works
  • I have updated the changelog and the corresponding version in the extension's config/extension.toml file
  • I have added my name to the CONTRIBUTORS.md or my name already exists there

@Mayankm96 Mayankm96 self-assigned this Aug 1, 2024
@Mayankm96 Mayankm96 added the enhancement New feature or request label Aug 1, 2024
Mayankm96 and others added 8 commits August 2, 2024 10:57
Co-authored-by: David Hoeller <dhoeller@nvidia.com>
Signed-off-by: Mayank Mittal <12863862+Mayankm96@users.noreply.github.com>
Signed-off-by: Mayank Mittal <12863862+Mayankm96@users.noreply.github.com>
Signed-off-by: Mayank Mittal <12863862+Mayankm96@users.noreply.github.com>
Copy link
Collaborator

@jsmith-bdai jsmith-bdai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, just a minor comment on describing the return for properties!

@Mayankm96 Mayankm96 merged commit 4cb968a into main Aug 3, 2024
2 of 3 checks passed
@Mayankm96 Mayankm96 deleted the fix/hybrid-obs-man branch August 3, 2024 06:08
iamdrfly pushed a commit to iamdrfly/IsaacLab that referenced this pull request Nov 21, 2024
…saac-sim#772)

# Description

Previously, the observation manager rigidly tried concatenating all the
terms along the last dimension at construction. However, when one has
hybrid-dimensional terms inside the observation group, this operation
would fail, leading to an error. In principle, the concatenation should
only happen when users set the attribute `concatenate_terms` to True
inside the group settings.

This MR lifts the above operation and adds a proper error when users try
to concatenate observation terms of different shapes. They must set the
concatenation flag to False if they want a "hybrid" observation group.

Fixes isaac-sim#768

## Type of change

- New feature (non-breaking change which adds functionality)

## Checklist

- [x] I have run the [`pre-commit` checks](https://pre-commit.com/) with
`./isaaclab.sh --format`
- [x] I have made corresponding changes to the documentation
- [x] My changes generate no new warnings
- [x] I have added tests that prove my fix is effective or that my
feature works
- [x] I have updated the changelog and the corresponding version in the
extension's `config/extension.toml` file
- [x] I have added my name to the `CONTRIBUTORS.md` or my name already
exists there
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Question] Reinforcement learning with camera image & robot state
3 participants