Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

example_1 DQN won't learn Pong #204

Open
TheExGenesis opened this issue Apr 7, 2021 · 0 comments
Open

example_1 DQN won't learn Pong #204

TheExGenesis opened this issue Apr 7, 2021 · 0 comments

Comments

@TheExGenesis
Copy link

I'm trying to run the examples as a sanity check but they don't seem to be learning. I tried examples 1 and 3.

The only change I made to example 1 was a smaller replay buffer so it'd fit in memory:

algo = DQN(min_steps_learn=1e3, replay_size=int(3e5)) # Run with defaults.

image
image

I also ran example_3 using the serial sampler for over 100k iterations without any apparent improvement

image

image

Hope you might be able to point out what's wrong, or maybe the examples broke for some reason?
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@TheExGenesis