Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix term trunc #336

Merged
merged 4 commits into from
May 3, 2023
Merged

Fix term trunc #336

merged 4 commits into from
May 3, 2023

Conversation

dapatil211
Copy link
Collaborator

No description provided.

Copy link

@MHashemzadeh MHashemzadeh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Collaborator

@alirahkay alirahkay left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@dapatil211 dapatil211 merged commit e4927bc into dev May 3, 2023
@dapatil211 dapatil211 deleted the fix_term_trunc branch May 3, 2023 16:23
kshitijkg added a commit that referenced this pull request May 17, 2023
* Fixed issues with moving from done to terminated, truncated

* Undo change to logging' scales

* Revert changes to this file, SAC agents don't exist yet

* Clean up test file

Co-authored-by: Darshan Patil <dapatil211@gmail.com>
dapatil211 added a commit that referenced this pull request May 19, 2023
* Added option to initialize separate components differently

* Made minor fixes

* Fixed init and registraion

* Fix term trunc (#336) (#341)

* Fixed issues with moving from done to terminated, truncated

* Undo change to logging' scales

* Revert changes to this file, SAC agents don't exist yet

* Clean up test file

Co-authored-by: Darshan Patil <dapatil211@gmail.com>

---------

Co-authored-by: Darshan Patil <dapatil211@gmail.com>
dapatil211 added a commit that referenced this pull request Jun 1, 2023
* restore hidden states added

* burn in frames feature added

* a more general recurrent agent

* stateless drqn agent

* Remove AtariEnv (#334)

* first version. testing.

* pylint

* pylint

* pylint

* pylint

* pylint

* test fix

* pylint

* pylint

* resolve discussion

---------

Co-authored-by: artem.zholus <artem.zholus@login-3.server.mila.quebec>
Co-authored-by: Darshan Patil <dapatil211@gmail.com>

* Update pull_request_ci.yml (#342)

* Add initialisation (#340)

* Added option to initialize separate components differently

* Made minor fixes

* Fixed init and registraion

* Fix term trunc (#336) (#341)

* Fixed issues with moving from done to terminated, truncated

* Undo change to logging' scales

* Revert changes to this file, SAC agents don't exist yet

* Clean up test file

Co-authored-by: Darshan Patil <dapatil211@gmail.com>

---------

Co-authored-by: Darshan Patil <dapatil211@gmail.com>

* new sequence model version

* restore hidden states added

* burn in frames feature added

* a more general recurrent agent

* stateless drqn agent

* new sequence model version

* Update Sequence model to remove coupling with LSTM/GRU

* Fix issue with agent_traj_state vs hidden_state

* Update config to match new atari env

* Fixed issue with storing hidden states in replay buffer

---------

Co-authored-by: Artem Zholus <artem.zholus@gmail.com>
Co-authored-by: artem.zholus <artem.zholus@login-3.server.mila.quebec>
Co-authored-by: Darshan Patil <dapatil211@gmail.com>
Co-authored-by: Kshitij Gupta <kshitijkg01@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants