Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove <unk> token and index from experimental Vocab #1027

Open
wants to merge 50 commits into
base: main
Choose a base branch
from

Commits on Oct 9, 2020

  1. checkpoint

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    e46e2f8 View commit details
    Browse the repository at this point in the history
  2. checkpoint

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    3129036 View commit details
    Browse the repository at this point in the history
  3. checkpoint

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    441f392 View commit details
    Browse the repository at this point in the history
  4. checkpoint

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    bc87fb0 View commit details
    Browse the repository at this point in the history
  5. checkpoint

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    8ba6b21 View commit details
    Browse the repository at this point in the history
  6. update tests

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    6b9f015 View commit details
    Browse the repository at this point in the history
  7. clang

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    3d21a18 View commit details
    Browse the repository at this point in the history
  8. flake8

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    0efe7b2 View commit details
    Browse the repository at this point in the history
  9. checkpoint

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    dce7080 View commit details
    Browse the repository at this point in the history
  10. checkpoint

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    660e051 View commit details
    Browse the repository at this point in the history
  11. CI

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    6b9368b View commit details
    Browse the repository at this point in the history
  12. checkpoint

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    ffeb7ab View commit details
    Browse the repository at this point in the history
  13. checkpoint

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    ca1dbbb View commit details
    Browse the repository at this point in the history
  14. checkpoint

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    40d6c06 View commit details
    Browse the repository at this point in the history
  15. checkpoint

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    4246ba2 View commit details
    Browse the repository at this point in the history
  16. update save/load in vocab

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    6f6cfad View commit details
    Browse the repository at this point in the history
  17. checkpooint

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    a0d5fc2 View commit details
    Browse the repository at this point in the history
  18. checkpoint

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    a49c10d View commit details
    Browse the repository at this point in the history
  19. checkpoint

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    f76d9b1 View commit details
    Browse the repository at this point in the history
  20. skip test for windows

    Guanheng Zhang committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    7bec937 View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2020

  1. update unk_index with insert_token

    Guanheng Zhang committed Oct 12, 2020
    Configuration menu
    Copy the full SHA
    ba7e561 View commit details
    Browse the repository at this point in the history
  2. checkpoint

    Guanheng Zhang committed Oct 12, 2020
    Configuration menu
    Copy the full SHA
    ed7be7d View commit details
    Browse the repository at this point in the history
  3. Merge branch 'master' into remove_unk

    Guanheng Zhang committed Oct 12, 2020
    Configuration menu
    Copy the full SHA
    e25660d View commit details
    Browse the repository at this point in the history
  4. Merge branch 'master' into remove_unk

    Guanheng Zhang committed Oct 12, 2020
    Configuration menu
    Copy the full SHA
    6627847 View commit details
    Browse the repository at this point in the history
  5. change unk_index to fallback_index

    Guanheng Zhang committed Oct 12, 2020
    Configuration menu
    Copy the full SHA
    e4e1e05 View commit details
    Browse the repository at this point in the history
  6. checkpoint

    Guanheng Zhang committed Oct 12, 2020
    Configuration menu
    Copy the full SHA
    279ba95 View commit details
    Browse the repository at this point in the history
  7. checkpoint

    Guanheng Zhang committed Oct 12, 2020
    Configuration menu
    Copy the full SHA
    1cdb82e View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2020

  1. Merge branch 'master' into remove_unk

    Guanheng Zhang committed Oct 13, 2020
    Configuration menu
    Copy the full SHA
    6f339c0 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2020

  1. switch to default

    Guanheng Zhang committed Oct 18, 2020
    Configuration menu
    Copy the full SHA
    ccd3166 View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2020

  1. Configuration menu
    Copy the full SHA
    98c508b View commit details
    Browse the repository at this point in the history
  2. checkpoint

    Guanheng Zhang committed Oct 19, 2020
    Configuration menu
    Copy the full SHA
    c61c127 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    3549c23 View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2020

  1. update test

    Guanheng Zhang committed Oct 20, 2020
    Configuration menu
    Copy the full SHA
    6b7e5ad View commit details
    Browse the repository at this point in the history
  2. add one more test for inserting existing token

    Guanheng Zhang committed Oct 20, 2020
    Configuration menu
    Copy the full SHA
    6858227 View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2020

  1. use c10::optional for default index

    Guanheng Zhang committed Oct 22, 2020
    Configuration menu
    Copy the full SHA
    b40d8dd View commit details
    Browse the repository at this point in the history
  2. checkpoint

    Guanheng Zhang committed Oct 22, 2020
    Configuration menu
    Copy the full SHA
    4ec66e6 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2020

  1. sync with master branch

    Guanheng Zhang committed Oct 27, 2020
    Configuration menu
    Copy the full SHA
    1556074 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2020

  1. Update docs

    Guanheng Zhang committed Nov 2, 2020
    Configuration menu
    Copy the full SHA
    c5e3773 View commit details
    Browse the repository at this point in the history
  2. checkpoint

    Guanheng Zhang committed Nov 2, 2020
    Configuration menu
    Copy the full SHA
    f3ed767 View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2020

  1. set_default_index if the saved vocab has a default index

    Guanheng Zhang committed Nov 3, 2020
    Configuration menu
    Copy the full SHA
    a9b27de View commit details
    Browse the repository at this point in the history
  2. checkpoint

    Guanheng Zhang committed Nov 3, 2020
    Configuration menu
    Copy the full SHA
    53a353f View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2020

  1. Merge branch 'master' into remove_unk

    Guanheng Zhang committed Nov 7, 2020
    Configuration menu
    Copy the full SHA
    7631d72 View commit details
    Browse the repository at this point in the history
  2. sync with master

    Guanheng Zhang committed Nov 7, 2020
    Configuration menu
    Copy the full SHA
    2cab04b View commit details
    Browse the repository at this point in the history

Commits on Dec 23, 2020

  1. sync with master

    Guanheng Zhang committed Dec 23, 2020
    Configuration menu
    Copy the full SHA
    a1cfea9 View commit details
    Browse the repository at this point in the history
  2. checkpoint

    Guanheng Zhang committed Dec 23, 2020
    Configuration menu
    Copy the full SHA
    aeb9995 View commit details
    Browse the repository at this point in the history
  3. checkpoint

    Guanheng Zhang committed Dec 23, 2020
    Configuration menu
    Copy the full SHA
    588cce4 View commit details
    Browse the repository at this point in the history
  4. checkpoint

    Guanheng Zhang committed Dec 23, 2020
    Configuration menu
    Copy the full SHA
    67ec466 View commit details
    Browse the repository at this point in the history

Commits on Jan 5, 2021

  1. Merge branch 'master' into remove_unk

    Guanheng Zhang committed Jan 5, 2021
    Configuration menu
    Copy the full SHA
    dd78169 View commit details
    Browse the repository at this point in the history

Commits on Feb 12, 2021

  1. sync with master branch

    Guanheng Zhang committed Feb 12, 2021
    Configuration menu
    Copy the full SHA
    909c188 View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2021

  1. add have_default_index

    Guanheng Zhang committed Feb 15, 2021
    Configuration menu
    Copy the full SHA
    7576775 View commit details
    Browse the repository at this point in the history