Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Prioritized experience replay #1622

Open
wants to merge 31 commits into
base: master
Choose a base branch
from
Open

Prioritized experience replay #1622

wants to merge 31 commits into from
+304 −9

Commits on Jul 22, 2023

  1. Started PER 

    - Created SumTree (to be ultimated)
- Started PrioritizedReplayBuffer
  - constructor and 'sample' method
  - to be tested
    @AlexPasqua
    AlexPasqua committed Jul 22, 2023
    Configuration menu
    Copy the full SHA
    c607585 View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2023

  1. Added "add" method + other improvements

    @AlexPasqua
    AlexPasqua committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    57f1192 View commit details
    Browse the repository at this point in the history

  2. Docstrings, type hints, doc

    @AlexPasqua
    AlexPasqua committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    2b9df33 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into prioritized-experience-replay

    @AlexPasqua
    AlexPasqua authored Jul 23, 2023
    Configuration menu
    Copy the full SHA
    31dc46c View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2023

  1. Merge branch 'master' into prioritized-experience-replay

    @araffin
    araffin authored Jul 24, 2023
    Configuration menu
    Copy the full SHA
    1a32377 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2023

  1. Merge branch 'master' into prioritized-experience-replay

    @AlexPasqua
    AlexPasqua committed Aug 6, 2023
    Configuration menu
    Copy the full SHA
    ccf7dc3 View commit details
    Browse the repository at this point in the history

  2. FIxed for pytype checks (partially)

    @AlexPasqua
    AlexPasqua committed Aug 6, 2023
    Configuration menu
    Copy the full SHA
    aee1d30 View commit details
    Browse the repository at this point in the history

  3. make format

    @AlexPasqua
    AlexPasqua committed Aug 6, 2023
    Configuration menu
    Copy the full SHA
    c51b173 View commit details
    Browse the repository at this point in the history

  4. Made pytype ignore type on PER's sample method

    @AlexPasqua
    AlexPasqua committed Aug 6, 2023
    Configuration menu
    Copy the full SHA
    18c9d28 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2023

  1. Merge branch 'master' into prioritized-experience-replay

    @araffin
    araffin authored Aug 30, 2023
    Configuration menu
    Copy the full SHA
    840dde2 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2023

  1. Merge branch 'master' into prioritized-experience-replay

    @araffin
    araffin committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    dcfbf88 View commit details
    Browse the repository at this point in the history

  2. Switch to numpy for the backend

    @araffin
    araffin committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    fb33732 View commit details
    Browse the repository at this point in the history

  3. Move to common and add tests

    @araffin
    araffin committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    f984e5c View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2023

  1. Updated DQN docs 

    Added list of rainbow extensions, specifying which ones are currently implemented in the library
    @AlexPasqua
    AlexPasqua committed Sep 30, 2023
    Configuration menu
    Copy the full SHA
    5edf8bf View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2023

  1. Update doc

    @araffin
    araffin committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    2f76038 View commit details
    Browse the repository at this point in the history

  2. Rename things to be consistent with buffers.py

    @araffin
    araffin committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    42f2f4a View commit details
    Browse the repository at this point in the history

  3. Rename variables and add priority update

    @araffin
    araffin committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    007105f View commit details
    Browse the repository at this point in the history

  4. Ignore mypy

    @araffin
    araffin committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    cc37cba View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2023

  1. Add beta schedule

    @araffin
    araffin committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    b60ef03 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2023

  1. Merge branch 'master' into prioritized-experience-replay

    @araffin
    araffin committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    ec272b9 View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2023

  1. Merge branch 'master' into prioritized-experience-replay

    @araffin
    araffin authored Nov 22, 2023
    Configuration menu
    Copy the full SHA
    a043cfd View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2024

  1. Merge branch 'master' into prioritized-experience-replay

    @araffin
    araffin authored Jan 30, 2024
    Configuration menu
    Copy the full SHA
    f6accf9 View commit details
    Browse the repository at this point in the history

Commits on May 6, 2024

  1. Merge branch 'master' into prioritized-experience-replay

    @araffin
    araffin authored May 6, 2024
    Configuration menu
    Copy the full SHA
    b21ef33 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. Merge branch 'master' into prioritized-experience-replay

    @araffin
    araffin authored May 24, 2024
    Configuration menu
    Copy the full SHA
    f57444a View commit details
    Browse the repository at this point in the history

  2. Minor fix in PER

    @AlexPasqua
    AlexPasqua committed May 24, 2024
    Configuration menu
    Copy the full SHA
    be00231 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. Merge branch 'master' into prioritized-experience-replay

    @araffin
    araffin authored Jun 7, 2024
    Configuration menu
    Copy the full SHA
    4390ec7 View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2024

  1. Merge branch 'master' into prioritized-experience-replay

    @araffin
    araffin authored Jul 7, 2024
    Configuration menu
    Copy the full SHA
    bee9cbe View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2024

  1. Only convert to numpy if needed

    @araffin
    araffin committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    fb1a9f7 View commit details
    Browse the repository at this point in the history

  2. Increase min priority to avoid division by zero

    @araffin
    araffin committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    150b09a View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2024

  1. Merge branch 'master' into prioritized-experience-replay

    @araffin
    araffin authored Jul 17, 2024
    Configuration menu
    Copy the full SHA
    5c0c79d View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2024

  1. Merge branch 'master' into prioritized-experience-replay

    @araffin
    araffin authored Nov 5, 2024
    Configuration menu
    Copy the full SHA
    148e4aa View commit details
    Browse the repository at this point in the history