Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[gym_jiminy/rllib] Full refactoring to support ray-rllib 2.38. #832

Merged
merged 16 commits into from
Nov 18, 2024
Merged

[gym_jiminy/rllib] Full refactoring to support ray-rllib 2.38. #832

merged 16 commits into from
Nov 18, 2024

Conversation

duburcqa
Copy link
Owner

@duburcqa duburcqa commented Nov 13, 2024 •
edited
Loading

  • [python/viewer] Use firefox instead of chromium for offscreen rendering with meshcat to fix rendering on MacOS VM.
  • [gym_jiminy/common] Do not permanently alter original simulation options with enabling debug and/or evaluation modes.
  • [gym_jiminy/common] Disallow switch between evaluation and training mode when a simulation is running.
  • [gym_jiminy/common] Rewrite binary log file automatically when calling 'BaseJiminyEnv.stop' in debug or evaluation mode.
  • [gym_jiminy/common] Fix replay if no simulation is running.
  • [gym_jiminy/common] Add previous action as input argument for evaluation policy callback.
  • [gym_jiminy/common] Automatic environment pipeline update.
  • [gym_jiminy/common] Fix composed reward computation.
  • [gym_jiminy/common] Use metaclass instead of inheritence for abstract classes.
  • [gym_jiminy/common] Enable typing of the obs and action spaces for 'gym.Env'.
  • [gym_jiminy/common] Fix nested gym space helpers.
  • [gym_jiminy/common] Update documentation.
  • [gym_jiminy/toolbox] Add support of arbitrarily nested task-settable env.
  • [gym_jiminy/envs] Add mirror mat to obs/action spaces.
  • [gym_jiminy/rllib] Full refactoring to support ray-rllib 2.38.
  • [misc] Move to macos-14 on Github Action (forcing panda3d tinydisplay driver).

@duburcqa duburcqa force-pushed the rllib_update branch 11 times, most recently from 4d53968 to 188e48a Compare November 16, 2024 10:50
@duburcqa
[python/viewer] Use firefox instead of chromimum for offscreen render…
0987e55 
…ing with meshcat to fix rendering on MacOS VM.
@duburcqa
[gym_jiminy/common] Do not permanently alter original simulation opti…
194e108 
…ons with enabling debug and/or evaluation modes.
@duburcqa
[gym_jiminy/common] Disallow switch between evaluation and training m…
dda233f 
…ode when a simulation is running.
@duburcqa
[gym_jiminy/common] Rewrite binary log file automatically when callin…
89e8fd2 
…g 'BaseJiminyEnv.stop' in debug or evaluation mode.
@duburcqa
[gym_jiminy/common] Fix replay if no simulation is running.
7e60bd0
@duburcqa
[gym_jiminy/common] Add previous action as input argument for evaluat…
f2a74d6 
…ion policy callback.
@duburcqa
[gym_jiminy/common] Automatic environment pipeline update.
3cdc4b7
@duburcqa
[gym_jiminy/common] Fix composed reward computation.
cb7a18d
@duburcqa
[gym_jiminy/common] Use metaclass instead of inheritence for abstract…
5dd635d 
… classes.
@duburcqa duburcqa force-pushed the rllib_update branch 3 times, most recently from 2368ead to 6df85f3 Compare November 17, 2024 18:13
@duburcqa duburcqa enabled auto-merge (squash) November 17, 2024 22:11
@duburcqa duburcqa merged commit e5c4897 into dev Nov 18, 2024
22 checks passed
@duburcqa duburcqa deleted the rllib_update branch November 18, 2024 10:08
@duburcqa duburcqa mentioned this pull request Dec 2, 2024
Merged
duburcqa added a commit that referenced this pull request Dec 2, 2024
@duburcqa
Jiminy release 1.8.9 (#843)
9d0f5aa 
* [core] Fix symbol visibility issues for some classes on windows. (#836)
* [core] Fix bindings and serialization of convex geometry meshes. (#836)
* [core] Fix 'array_copyto' helper. (#841)
* [python/viewer] Fix 'add_camera'. (#831)
* [python/viewer] Use firefox instead of chromium for offscreen rendering with meshcat to fix rendering on MacOS VM. (#832)
* [python/viewer] Fix support of '-' in robot name. (#834)
* [python/viewer] Fix conversion of 'hppfcl.Convex' to Panda3D. (#836)
* [python/dynamics] Take into account stride offset when trajectory time is wrapping. (#838)
* [python|gym_jiminy] More natural figure layout to improve readability. (#837)
* [gym_jiminy/common] Do not permanently alter original simulation options with enabling debug and/or evaluation modes. (#832)
* [gym_jiminy/common] Disallow switch between evaluation and training mode when a simulation is running. (#832)
* [gym_jiminy/common] Rewrite binary log file automatically when calling 'BaseJiminyEnv.stop' in debug or evaluation mode. (#832)
* [gym_jiminy/common] Fix replay if no simulation is running. (#832)
* [gym_jiminy/common] Add previous action as input argument for evaluation policy callback. (#832)
* [gym_jiminy/common] Automatic environment pipeline update. (#832)
* [gym_jiminy/common] Fix composed reward computation. (#832)
* [gym_jiminy/common] Use metaclass instead of inheritence for abstract classes. (#832)
* [gym_jiminy/common] Enable typing of the obs and action spaces for 'gym.Env'. (#832)
* [gym_jiminy/common] Fix nested gym space helpers. (#832)
* [gym_jiminy/common] Update documentation. (#832)
* [gym_jiminy/common] Fix missing final state when writing eval/debug log. (#834)
* [gym_jiminy/common] Improve numerical stability and speed of 'swing_from_vector'. (#834)
* [gym_jiminy/common] Fix 'quat_multiply' to support in-place operation. (#834)
* [gym_jiminy/common] Fix mahony filter leaky integration for very small time constant. (#834)
* [gym_jiminy/common] Add twist estimate in internal mahony state if estimated. (#834)
* [gym_jiminy/common] Check IMU and flex frames not empty when adding Mahony filter. (#834)
* [gym_jiminy/common] Fix base 'BaseJiminyEnv.stop' not called in pipeline. (#834)
* [gym_jiminy/common] Support pipelines without any layer. (#834)
* [gym_jiminy/common] Add support of 'none' in pipeline config files. (#834)
* [gym_jiminy/common] Add 'ignore_unbounded' optional argument to flatten obs/act wrappers. (#834)
* [gym_jiminy/common] Add 'AdaptLayoutObservation' that generalizes 'FilterObservation'. (#835)
* [gym_jiminy/common] Make sure that the initial pd state is within bounds. (#835)
* [gym_jiminy/common] Add 'compute_rpy' optional argument to mahony observer. (#837)
* [gym_jiminy/common] Add 'compute_rpy' optional argument to deformation estimator. (#837)
* [gym_jiminy/common] Fix trajectory file never closed if loading fails. (#838)
* [gym_jiminy/common] Add locking mechanism to trajectory databaset. (#838)
* [gym_jiminy/common] More robust pipeline registration mechanism. (#838)
* [gym_jiminy/common] Add composition wrapper before observer-controller blocks. (#838)
* [gym_jiminy/common] Enable env composition to augment the observation space with trajectory reference. (#838)
* [gym_jiminy/common] Add 'QuantityObserver' block. (#838)
* [gym_jiminy/common] Fix 'AdditiveMixtureReward' for 'order=inf'. (#838)
* [gym_jiminy/common] Support string representation of enums in pipeline config. (#838)
* [gym_jiminy/common] Fix partially broken 'spaces.build_reduce'. (#839)
* [gym_jiminy/common] Add 'ScaleObservation', 'ScaleAction' env pipeline wrapper blocks. (#839)
* [gym_jiminy/common] Faster env pipeline. (#841) (#842)
* [gym_jiminy/toolbox] Add support of arbitrarily nested task-settable env. (#832)
* [gym_jiminy/envs] Add mirror mat to obs/action spaces. (#832)
* [gym_jiminy/rllib] Full refactoring to support ray-rllib 2.38. (#832)
* [misc] Update core dependencies. (#831)
* [misc] Use unique numpy C API symbols for jiminy. (#831)
* [misc] Drop support of Python<3.10. (#831)
* [misc] Use 4 cores to build from source. (#831)
* [misc] Move to macos-14 on Github Action (forcing panda3d tinydisplay driver). (#832)
* [misc] Cleanup MacOS CI workflow. (#833)
* [misc] Move from 'toml' to 'tomlkit' to fix heterogeneous array support. (#835)
* [misc] Fix acrobot example eval max horizon. (#837)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@duburcqa