Code

CNN scripts#563

Code

Draft

dfilan wants to merge 53 commits intomasterHumanCompatibleAI/imitation:masterfrom cnn_scriptsHumanCompatibleAI/imitation:cnn_scriptsCopy head branch name to clipboard

+535-33

Commits

Commits on Sep 13, 2022

• Add post_wrappers entry in common config

  dfilan

  committed
  a62f5f2

  Copy full SHA for a62f5f2

• Add config to train on atari, use post_wrappers

  dfilan

  committed
  ec3755b

  Copy full SHA for ec3755b

• Add config option for CNN reward net

  dfilan

  committed
  2ad0864

  Copy full SHA for 2ad0864

• Add config to train preference comparisons on Asteroids

  dfilan

  committed
  70f17e5

  Copy full SHA for 70f17e5

• Quell flake8 complaint

  dfilan

  committed
  262a35a

  Copy full SHA for 262a35a

• Add short-episode asteroids config

  dfilan

  committed
  74fb856

  Copy full SHA for 74fb856

• Add config to train CNN policies

  dfilan

  committed
  ea508ba

  Copy full SHA for ea508ba

• Fix line length

  dfilan

  committed
  8ac9ae5

  Copy full SHA for 8ac9ae5

• Make names of short-episode asteroids configs consistent

  dfilan

  committed
  a9d24ae

  Copy full SHA for a9d24ae

• Add docstring for common config

  dfilan

  committed
  ad61105

  Copy full SHA for ad61105

• Add tests for training RL + pref comp on image envs

  dfilan

  committed
  d90d734

  Copy full SHA for d90d734

Commits on Sep 16, 2022

• First draft of training CNNs with DAgger - with backup CNN implementation visible in comments

  dfilan

  committed
  d92581c

  Copy full SHA for d92581c

• Delete commented-out alternate implementation of CnnPolicy

  dfilan

  committed
  8f0c7c0

  Copy full SHA for 8f0c7c0

• Fix notebook bug I introduced

  dfilan

  committed
  e5be4ca

  Copy full SHA for e5be4ca

• Fix problem where transpose_obs had to be specified

  dfilan

  committed
  39c94ea

  Copy full SHA for 39c94ea

• Fix check for transposition in CnnPolicy

  dfilan

  committed
  209c61a

  Copy full SHA for 209c61a

• Reorder asteroids envs

  dfilan

  committed
  e51eaa9

  Copy full SHA for e51eaa9

Commits on Sep 17, 2022

• Try to get AIRL/GAIL working for image envs

  dfilan

  committed
  c91caf2

  Copy full SHA for c91caf2

• Improve documentation of transpose_obs arg

  dfilan

  committed
  aae2711

  Copy full SHA for aae2711

Commits on Oct 5, 2022

• Get procgen RL training working

  dfilan

  committed
  b3c9e3e

  Copy full SHA for b3c9e3e

• Add right version of gym3 to get procgen working

  dfilan

  committed
  6214805

  Copy full SHA for 6214805

Commits on Oct 6, 2022

• Add all procgen environments

  dfilan

  committed
  ff17412

  Copy full SHA for ff17412

• Remove awscli dependency

  dfilan

  committed
  97f16de

  Copy full SHA for 97f16de

Commits on Oct 10, 2022

• Modify scripts to not deal with awscli

  dfilan

  committed
  6db67fe

  Copy full SHA for 6db67fe

• No longer test deleted experiment

  dfilan

  committed
  bc422c6

  Copy full SHA for bc422c6

• Improve wording

  dfilan

  committed
  387783e

  Copy full SHA for 387783e

• Oops huggingface models were auto-loaded

  dfilan

  committed
  8654008

  Copy full SHA for 8654008

• Make imit_benchmark_config match with rollouts_from_policies config

  dfilan

  committed
  dbcb836

  Copy full SHA for dbcb836

• Make script save things where it says it will save them

  dfilan

  committed
  2b09223

  Copy full SHA for 2b09223

• Add seals/HalfCheetah-v0 config to eval_policy

  dfilan

  committed
  3600703

  Copy full SHA for 3600703

• Merge branch 'master' into remove-awscli

  dfilan

  committed
  cc248fd

  Copy full SHA for cc248fd

• Fix merge conflict

  dfilan

  committed
  593a29b

  Copy full SHA for 593a29b

• Fix install stuff

  dfilan

  committed
  b59e3a3

  Copy full SHA for b59e3a3

• Fix merge error

  dfilan

  committed
  bcd3f6a

  Copy full SHA for bcd3f6a

Commits on Oct 12, 2022

• Merge in master

  dfilan

  committed
  801c4d9

  Copy full SHA for 801c4d9

• Fix merge problem

  dfilan

  committed
  de5207b

  Copy full SHA for de5207b

• Fix merge conflict

  dfilan

  committed
  c319744

  Copy full SHA for c319744

Commits on Oct 13, 2022

• Fix formatting, types

  dfilan

  committed
  2275b62

  Copy full SHA for 2275b62

Commits on Oct 17, 2022

• Add procgen configs for eval_policy

  dfilan

  committed
  a0682f6

  Copy full SHA for a0682f6

• Merge branch 'cnn_scripts' of github.com:HumanCompatibleAI/imitation into cnn_scripts

  dfilan

  committed
  051426d

  Copy full SHA for 051426d

Commits on Oct 18, 2022

• Merge in master

  dfilan

  committed
  be9391d

  Copy full SHA for be9391d

• Optionally add exploration wrapper before rolling out

  dfilan

  committed
  4dfade3

  Copy full SHA for 4dfade3

• Merge branch 'wrap_for_rollouts' into cnn_scripts

  dfilan

  committed
  1151f48

  Copy full SHA for 1151f48

• Fix eval_policies config

  dfilan

  committed
  8ed4722

  Copy full SHA for 8ed4722

• Add epsilon-greedy exploration named config

  dfilan

  committed
  6140879

  Copy full SHA for 6140879

• Merge new explore_kwarg config from wrap_for_rollouts

  dfilan

  committed
  65bef2c

  Copy full SHA for 65bef2c

• Fix exploration wrapper

  dfilan

  committed
  6205c08

  Copy full SHA for 6205c08

• Fix implementation of wrapping rollouts in exploration wrapper

  dfilan

  committed
  548dc2d

  Copy full SHA for 548dc2d

• [EMPTY] run pre-commit hooks

  dfilan

  committed
  4fc8d86

  Copy full SHA for 4fc8d86

• Merge branch 'wrap_for_rollouts' into cnn_scripts

  dfilan

  committed
  2bc4355

  Copy full SHA for 2bc4355

Commits on Oct 27, 2022

• Merge branch 'master' into cnn_scripts

  dfilan

  committed
  12f2b39

  Copy full SHA for 12f2b39

Commits on Nov 29, 2022

• Merge branch 'master' into cnn_scripts

  dfilan

  committed
  daaac0c

  Copy full SHA for daaac0c

• Remove extraneous CNN policy config

  dfilan

  committed
  8f1d6e5

  Copy full SHA for 8f1d6e5