Code

Refactor and Upgrade to Gymnasium#75

Code

Merged

D-o-d-o-x merged 201 commits intoALRhub:masterALRhub/fancy_gym:masterfrom D-o-d-o-x:great_refactorCopy head branch name to clipboardOct 11, 2023

+3,093-2,740

Commits

Commits on Oct 20, 2022

• first updats to reacher and env creation

  

  Fabian

  committed
  0c7ac83

Commits on Jan 12, 2023

• updated examples to new api,

  

  Fabian

  committed
  fbe3ef4

• updated custom tasks to new api

  

  Fabian

  committed
  ed72404

• updated dm_control envs to use shimmy

  

  Fabian

  committed
  9ebc021

• updated tests for dm_control

  

  Fabian

  committed
  ec2063a

Commits on Jan 17, 2023

• updated to new API, so tests still failing

  

  Fabian

  committed
  c53924d

Commits on May 15, 2023

• num_basis is not implemented; tests are expected to fail

  

  Dominik Roth

  committed
  b695239

• Updating gym(nasium) and metaworld; sticter versions

  

  Dominik Roth

  committed
  9de1257

• Added box2d as a dependency

  

  Dominik Roth

  committed
  2cbfff7

• Optional Dependency: PyTest

  

  Dominik Roth

  committed
  1c092d0

• Update URL for Metaworld (rlworkgroup -> Farama)

  

  Dominik Roth

  committed
  826f22b

• Merge branch '47-update-to-new-gym-api' into gym_upgrade

  

  Dominik Roth

  committed
  228e343

Commits on May 18, 2023

• Adapted test to new gym interface

  Show description for a559f92
  

  Dominik Roth

  committed
  a559f92

• Use shimmy as a binding for dmc, also 'testing' seperate from 'all'

  Show description for 1e62da0
  

  Dominik Roth

  committed
  1e62da0

• Buf Fix: PyTests still used binding to old gym

  

  Dominik Roth

  committed
  d4a8306

• Fixed Bug: env_id was broken, when prefix is handled by other library

  Show description for 0dfd8e1
  

  Dominik Roth

  committed
  0dfd8e1

• Fixed Bug: ToyEnv did not follow new gym spec

  

  Dominik Roth

  committed
  21d5ebb

• Allow dmc envs to be accessed via dmc:... (for backwards compatibility)

  

  Dominik Roth

  committed
  07de655

Commits on May 19, 2023

• Fix: TimeAwareObservation did not support float64 and tried to forbidden access private attribute.

  

  Dominik Roth

  committed
  bf3ed8a

• Ported box_pushing to new mujoco bindings

  

  Dominik Roth

  committed
  e75ab89

• Fixed: Typos

  

  Dominik Roth

  committed
  e70a56a

• Fixed: test_black_box.py still used old gym specs in two places

  

  Dominik Roth

  committed
  3bbf101

• More verbose errors for run_env_determinism

  

  Dominik Roth

  committed
  bc9d4cf

• Warning no longer applicable

  

  Dominik Roth

  committed
  1c002a2

• Adapted Mujoco Envs to new gymnasium spec

  Show description for dabfc7c
  

  Dominik Roth

  committed
  dabfc7c

Commits on May 27, 2023

• Auto convert output spaces.Dict to Box for BB-Envs

  

  Dominik Roth

  committed
  d6df677

• Merge branch 'master' into gym_upgrade

  

  Dominik Roth

  committed
  35680ab

• Fix: NameError: name 'd' is not defined

  

  Dominik Roth

  committed
  a8a6760

• Fix: hopper_jump_on_box still used unpatched HopperEnv

  

  Dominik Roth

  committed
  29b458c

• Also support old gym Box as observation_space (backwards compat)

  

  Dominik Roth

  committed
  dbd7c37

• Fix: MujocoEnv no longer supports manual assignment of mujoco_bindings

  

  Dominik Roth

  committed
  110a8a9

• Forgot to make it derive from Walker2dEnvCustomXML instead of original Walker2dEnv

  

  Dominik Roth

  committed
  1fddeb8

Commits on Jun 10, 2023

• Converted mujoco env 'hopper_jump' to new coordinate convention

  Show description for 38cb5e1
  

  Dominik Roth

  committed
  38cb5e1

• Converted mujoco env 'hopper_throw' to new coordinate convention

  Show description for c06fbee
  

  Dominik Roth

  committed
  c06fbee

• Converted mujoco env 'walker2d' to new coordinate convention

  Show description for ff382a2
  

  Dominik Roth

  committed
  ff382a2

• Fixed Bug: walker_2d_jump was missing obsvation_space attribute

  

  Dominik Roth

  committed
  5e7f027

• Fixed: hopper_jump returned observations bigger then observation_space

  

  Dominik Roth

  committed
  ddf6fd7

• Allow custom XML-files for ant_env

  

  Dominik Roth

  committed
  42003a3

• Fixed: ant_jump returned observations bigger then observation_space

  

  Dominik Roth

  committed
  40d2409

• Made some assertions more verbose for easier debugging

  

  Dominik Roth

  committed
  f07b8a2

Commits on Jun 11, 2023

• Adding/fixing obs space definitions and metadata for various envs

  

  Dominik Roth

  committed
  ef64b0c

• Adding required render_fps metadata to custom envs

  

  Dominik Roth

  committed
  6f1a36d

• Fix: Return for invalid trajectories did not follow new gym spec

  

  Dominik Roth

  committed
  80de15f

• Fix: Some envs had wrong obs space shapes and did not follow new gym spec

  

  Dominik Roth

  committed
  4921cc4

• Fix: Version specification now requirted for dmc envs

  

  Dominik Roth

  committed
  e44b0ed

• Fix: Minor bugs in time aware obs wrapper

  

  Dominik Roth

  committed
  2ad42f4

• Little hack to make envs work, that don't expose the max_episode_steps in their spec

  

  Dominik Roth

  committed
  abeb963

• Implement support for Dict spaces for time_aware_observation-wrapper

  

  Dominik Roth

  committed
  a23b447

• Upgrading metaworld (fixed bug that affected us)

  

  Dominik Roth

  committed
  c9467c0

• Fix: Test for dmc still referenced lib directly (not via shimmy)

  

  Dominik Roth

  committed
  9605f2e

Commits on Jun 18, 2023

• Fix: Need to supply seed to reset in tests

  

  Dominik Roth

  committed
  fbba129

• Fix: Allow observation space dict in test_replanning

  

  Dominik Roth

  committed
  f44f01b

• Fix: Don't throw errors for envs, that do not expose a max_episode_steps.

  

  Dominik Roth

  committed
  49ac9c3

• Fix: Some envs used no longer existing binding to mujoco

  

  Dominik Roth

  committed
  60a4cf1

• Better handling of envs without defined max_steps

  

  Dominik Roth

  committed
  b032dec

• Fix: Make wrappers work with BB and Dict-Space

  

  Dominik Roth

  committed
  9ade0dc

• Remove old file

  

  Dominik Roth

  committed
  f8ad65b

• ugly_hack_to_mitigate_metaworld_bug

  

  Dominik Roth

  committed
  b6089c4

• Bug mitigation for metaworld refactored and extended

  

  Dominik Roth

  committed
  7354257

Commits on Jun 24, 2023

• Version bump (made very breaking changes)

  

  Dominik Roth

  committed
  9af4211

• Stricter dependency versions

  

  Dominik Roth

  committed
  0fe56c4

• Fix: PyPi had troubles finding a compatible version for dm-control

  

  Dominik Roth

  committed
  55c6cff

• Fixed: Tried importing old dependency

  

  Dominik Roth

  committed
  bc0dcb7

• Updating some dependencies

  

  Dominik Roth

  committed
  e811979

• Fix: A missing ',' caused very weird bugs...

  

  Dominik Roth

  committed
  ad7ddd3

Commits on Jun 27, 2023

• A fancy icon for fancy gym

  

  Dominik Roth

  committed
  55f84da

• Added attribution for the icon.

  

  Dominik Roth

  committed
  1601a87

Commits on Jun 28, 2023

• Down to 20 failing tests (more mitigations of metaworld bug)

  

  Dominik Roth

  committed
  de118a3

• Fix Test: Delay was not supplied to mp-generator

  

  Dominik Roth

  committed
  eb1d145

• Make Icon Attribution h2

  

  Dominik Roth

  committed
  bf1eb49

Commits on Jul 7, 2023

• Downgrading mujoco 2.3.6 -> 2.3.3

  

  Dominik Roth

  committed
  cdabd3f

• Fixed Typo in README

  

  Dominik Roth

  committed
  14a95eb

• Remove dependence of wrapper on old gym

  

  Dominik Roth

  committed
  27f8335

• Weaker version requirement for dm-control

  

  Dominik Roth

  committed
  67a5d19

Commits on Jul 14, 2023

• Started implementing new fancy registry

  

  Dominik Roth

  committed
  ffbada2

• Getting rid of some old code

  

  Dominik Roth

  committed
  6c90f8a

• Ported classic_control envs to fancy registry

  

  Dominik Roth

  committed
  f375a6e

• Allow skipping merge with default bb config

  

  Dominik Roth

  committed
  30bafd7

Commits on Jul 20, 2023

• minor refactoring

  

  Dominik Roth

  committed
  9fa932d

• metadata.mp_config now expected in MP_wrapper (implementing Fabian's feedback)

  

  Dominik Roth

  committed
  f6e1718

• Move mp_config out of metadata and onto MPWrappers

  

  Dominik Roth

  committed
  9d03542

• Allow overriding mp_config during register and make (also better errors

  Show description for 17d370e
  

  Dominik Roth

  committed
  17d370e

• ported mp_config for mujoco/box_pushing

  

  Dominik Roth

  committed
  8d26ccc

• ported mp_config for mujoco/box_pushing

  

  Dominik Roth

  committed
  1b061b2

• refactoring env registration wip

  

  Dominik Roth

  committed
  dbf2be1

• removed deprecated envs

  

  Dominik Roth

  committed
  83d5d39

Commits on Jul 23, 2023

• ported mp_config for mujoco/beerpong

  

  Dominik Roth

  committed
  64e6ac5

• ported mp_config for mujoco/table_tennis

  

  Dominik Roth

  committed
  9ba3fa9

• Removed old manual registration of mp-envs (port to fancy registry)

  

  Dominik Roth

  committed
  a069aaa

• No longer export old custom make

  

  Dominik Roth

  committed
  ce34df1

• Fixed Bug leading to infinite recusrion when making mp envs

  

  Dominik Roth

  committed
  21a9c0f

• test/utils.py must use gym.make now (was fancy_gym.make)

  

  Dominik Roth

  committed
  b0f7dc6

• test_black_box.py should use vanilla env.make

  

  Dominik Roth

  committed
  eb9b6e1

• Added tests for new fancy registry

  

  Dominik Roth

  committed
  3e586a1

• Started work on new adapter & mp_config port for metaworld

  

  Dominik Roth

  committed
  99a02b8

• Fixed missing import in metaworld_adapter

  

  Dominik Roth

  committed
  6787b02

• Fix: Many tests still tried to seed during make

  

  Dominik Roth

  committed
  0fb0506

• Fix: Cannot use .get for object attributes

  

  Dominik Roth

  committed
  e2ff915

• Allow envs to already be wrapped with a RawInterfaceWrapper

  

  Dominik Roth

  committed
  fc4b98e

• Fixed typo

  

  Dominik Roth

  committed
  95b2c25

• Move into our own namespace ('fancy')

  

  Dominik Roth

  committed
  127d355

• Fix: Env in new namespace

  

  Dominik Roth

  committed
  58bb8c0

• removed file deprecated

  

  Dominik Roth

  committed
  3a9143f

• Consistent quotation marks

  

  Dominik Roth

  committed
  edd8c75

Commits on Jul 24, 2023

• entry_point does not have to be given, when skipping registration of step-based

  

  Dominik Roth

  committed
  bb20bb5

• fancy_gym.upgrade allows adding mp-versions for already registered envs

  

  Dominik Roth

  committed
  2fc4466

Commits on Jul 29, 2023

• Remember mp-envs for each ns seperately (replicate legacy functionality)

  

  Dominik Roth

  committed
  ae1033a

• Fix: fancy_gym.upgrade ignored mp_config_override-arg

  

  Dominik Roth

  committed
  6b07705

• Print warning when trying to register already registered step-based env

  

  Dominik Roth

  committed
  d488363

Commits on Jul 30, 2023

• Ported dmc envs to mp-config

  

  Dominik Roth

  committed
  e743663

• Ported metaworld to mp-config

  

  Dominik Roth

  committed
  e63a0a5

• weight_scale -> weights_scale

  

  Dominik Roth

  committed
  bc3f540

• Replicate legacy behavior in exporting lists off all mp envs

  

  Dominik Roth

  committed
  20d0be3

• Fix: ALL_FANCY_MOVEMENT_PRIMITIVE_ENVIRONMENTS no longer exists in fancy

  Show description for b4793c8
  

  Dominik Roth

  committed
  b4793c8

• Fix: Wrong name for ns: dmc -> dm_controll

  

  Dominik Roth

  committed
  5519fd5

• Removed old code samples from meta mp docs

  

  Dominik Roth

  committed
  e30b6c0

• Extended Tests: Ensure no known namespace is empty

  

  Dominik Roth

  committed
  9c6d795

• Fix: test/test_replanning_sequencing.py still referenced old fancy_gym.make

  Show description for 9020eb9
  

  Dominik Roth

  committed
  9020eb9

• Don't use defaultdicts for MOVEMENT_PRIMITIVE_ENVIRONMENTS_FOR_NS

  Show description for fb8f81a
  

  Dominik Roth

  committed
  fb8f81a

• Fixed Typo dm_controll -> dm_control

  

  Dominik Roth

  committed
  caf483a

• Fix: Some tests omitted new ns 'fancy' when trying to access our envs

  

  Dominik Roth

  committed
  221e3fe

• Fix: Controllers not getting kwargs

  

  Dominik Roth

  committed
  14223c5

Commits on Aug 14, 2023

• Use new namespace convention for mp-versions of envs

  

  Dominik Roth

  committed
  fb1282f

• tiny fix to env references in test

  

  Dominik Roth

  committed
  eefcbcb

• Fixed: Name generation wrong for mp envs

  

  Dominik Roth

  committed
  14d545a

• Fix: Multiple issues in test/test_fancy_registry.py

  

  Dominik Roth

  committed
  1fb5368

• Cleaning up test/test_dmc_envs.py

  

  Dominik Roth

  committed
  f3ffa71

• Moving the ugly_mitigation_for_metaworld_bug into the metaworld env wrapper

  

  Dominik Roth

  committed
  5b99227

• Various fixed to tests

  

  Dominik Roth

  committed
  78823d9

Commits on Aug 21, 2023

• Fixed incorrect ns seperator for metaworld tests

  

  Dominik Roth

  committed
  94c4397

• Simplified metaworld adapter

  

  Dominik Roth

  committed
  6d80201

Commits on Aug 28, 2023

• Mitigation: Allow seeding Metaworld on reset

  

  Dominik Roth

  committed
  15e1bdc

• Fix: Incorrect Controller Type in mp_config for dmc reach_site

  

  Dominik Roth

  committed
  a4e2883

• Fix Typo: weights_scale should apply to traj_gen, not controller

  

  Dominik Roth

  committed
  8b3d05a

• Quickfix for mp_config merging and allow defining different base_id for

  Show description for 20b1b0c
  

  Dominik Roth

  committed
  20b1b0c

• Fix Typo: alpha_phase belongs to phase_gen not basis_gen

  

  Dominik Roth

  committed
  2c0c4e5

• Fix: Seeding of act-space is not guaranteed, seed it manually since we

  Show description for 22a72fe
  

  Dominik Roth

  committed
  22a72fe

• Mitigation: Metaworld .reset ignores seeds; we must manually seed on reset.

  

  Dominik Roth

  committed
  5921e00

• Fix: Some fancy envs failed determinism test because they sampled during reset before the random gen was seeded

  

  Dominik Roth

  committed
  07aeb77

• Fix: Some simple_reacher did not seed correctly

  

  Dominik Roth

  committed
  820e781

• Fix: SimpleReacher and ViaPointReacher did not seed correctly

  

  Dominik Roth

  committed
  1558072

Commits on Sep 10, 2023

• Added message about discontinuation of fancy_gym.make

  

  Dominik Roth

  committed
  315e135

Commits on Sep 17, 2023

• Fixed typo in env registration

  

  Dominik Roth

  committed
  7f95923

• Ensure mp_config defined for all envs, even if just using defaults.

  

  Dominik Roth

  committed
  0629d12

• Fix: mp_config missing for BoxPushing ProDMP

  

  Dominik Roth

  committed
  da34db2

• Better README

  

  Dominik Roth

  committed
  8749fc5

• Fixed all examples

  

  Dominik Roth

  committed
  7f58093

• Forgot to port gym_Reacher over

  

  Dominik Roth

  committed
  a76967a

• mp_config for vanilla gym Reacher

  

  Dominik Roth

  committed
  89bd678

• Upgrading metaworld

  

  Dominik Roth

  committed
  38358c1

Commits on Sep 18, 2023

• More README improvements

  

  Dominik Roth

  committed
  c933a75

• Fix: README code imported gym instead of gymnasium

  

  Dominik Roth

  committed
  4c8dda3

• Fix: Deprecated beerpong env still referenced old mujoco binding

  

  Dominik Roth

  committed
  513bf23

• Future proofing: Accesing attributes of other wrappers needs to be

  Show description for 592f097
  

  Dominik Roth

  committed
  592f097

• Ported MetaWorld wrapper to new mujoco binding

  

  Dominik Roth

  committed
  20510d8

• Porting Metaworld Bug Mitigations

  

  Dominik Roth

  committed
  9ce040d

• Skip Tests: Metaworld does currently not correclty implement seeding

  

  Dominik Roth

  committed
  ddd11c1

• Print warning on seeded metaworld reset

  

  Dominik Roth

  committed
  54e8ec4

• Merge remote-tracking branch 'original/master' into great_refactor

  

  Dominik Roth

  committed
  60a8204

• Fixed merge error

  

  Dominik Roth

  committed
  5488ca6

• Fixed wrong env name (still contained mp info)

  

  Dominik Roth

  committed
  725e6c8

• Removed old files

  

  Dominik Roth

  committed
  659a717

• New optional dependency: jax

  Show description for cf886b2
  

  Dominik Roth

  committed
  cf886b2

• Fixed typo in README

  

  Dominik Roth

  committed
  c5b051d

• Another typo gone from the README

  

  Dominik Roth

  committed
  57c4a94

• README: reset will return (obs, info)

  

  Dominik Roth

  committed
  59ee559

Commits on Sep 19, 2023

• Added mujoco-legacy (mujoco-py) as an optional dependency

  Show description for 842ab3f
  

  Dominik Roth

  committed
  842ab3f

• Updated README

  

  Dominik Roth

  committed
  e077a8f

• Fixed typo in NS

  

  Dominik Roth

  committed
  d8315c8

• Extended README

  

  Dominik Roth

  committed
  4965851

• Fixed minor issues

  

  Dominik Roth

  committed
  79c2eda

• Fix: Typo in README

  

  Dominik Roth

  committed
  310719e

• README: Added link to changelog of refactor

  

  Dominik Roth

  committed
  740d1d7

• typo

  

  Dominik Roth

  committed
  6d0e96c

Commits on Sep 20, 2023

• minor changes to README

  

  Dominik Roth

  committed
  d6ecc0d

Commits on Sep 29, 2023

• Better doumentation of fancy registry fucntions (register & upgrade)

  

  Dominik Roth

  committed
  56c1c65

• Updated dmc README

  

  Dominik Roth

  committed
  8bba78b

• Improved and Updated README for custom mujoco envs

  

  Dominik Roth

  committed
  e55905a

• Improved README for classical controll envs

  

  Dominik Roth

  committed
  e305556

Commits on Sep 30, 2023

• Slighly better docs for OpenAI envs

  

  Dominik Roth

  committed
  a803d92

• Fixed open_ai README

  

  Dominik Roth

  committed
  e633b1e

• Expanded README for Metaworld

  Show description for b3de71e
  

  Dominik Roth

  committed
  b3de71e

• Tiny update to Metaworld README

  

  Dominik Roth

  committed
  27f3a82

• README: Justify text about MP envs (looks way better)

  

  Dominik Roth

  committed
  1eeccff

• README: Better Justifycation of text

  

  Dominik Roth

  committed
  0ae8708

Commits on Oct 11, 2023

• Fix: Typo in setup.py

  

  Dominik Roth

  committed
  9fee527

• Added docstring to deprecated 'fancy_gym.make'

  

  Dominik Roth

  committed
  3180154

• Added Hongyi & Hongyi as authors to setup.py

  

  Dominik Roth

  committed
  fcc79cd

• Added bibtex for citations to README

  

  Dominik Roth

  committed
  5f3c28e

• Fix: Bibtex in README mixed between tabs & spaces

  

  Dominik Roth

  committed
  bc150f5

• Documnenting merging behavior for mp_configs (and remove TODOs)

  

  Dominik Roth

  committed
  757072c

• README: @ is not a legal symbol in BibTex attribs

  

  Dominik Roth

  committed
  3317ffb

• Development status alpha -> beta; version to 1.0 (for pub release)

  

  Dominik Roth

  committed
  db5e032

• Add docstring to DefaultMPWrapper

  

  Dominik Roth

  committed
  980bb0d

• Fix: Wrong horizon for Metaworld tasks

  

  Dominik Roth

  committed
  877a7ea

• Dont run determinism tests on arbitrary external envs added by other

  Show description for 600575c
  

  Dominik Roth

  committed
  600575c

• README: Minor cosmetic changes

  

  Dominik Roth

  committed
  fc73824

• READE: Minor cosmetic changes pt.2

  

  Dominik Roth

  committed
  4f53477

• READE: Minor cosmetic changes pt.3

  

  Dominik Roth

  committed
  614d2a4

• Fix: Did not define MP_Wrapper for new RandomInit version of BoxPushing

  

  Dominik Roth

  committed
  f8dcf5b

• Link legacy branch in README

  

  Dominik Roth

  committed
  a04a4b6