Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FunnelBlock + FunnelEncoder #1

Merged
merged 22 commits into from
Oct 27, 2020
Merged

FunnelBlock + FunnelEncoder #1

merged 22 commits into from
Oct 27, 2020

Commits on Oct 23, 2020

  1. encoder downsampling

    @mtyrolski
    mtyrolski committed Oct 23, 2020
    Configuration menu
    Copy the full SHA
    5c27c14 View commit details
    Browse the repository at this point in the history

  2. comments, todos

    @mtyrolski
    mtyrolski committed Oct 23, 2020
    Configuration menu
    Copy the full SHA
    6710bea View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2020

  1. more explanations in comment

    @mtyrolski
    mtyrolski committed Oct 25, 2020
    Configuration menu
    Copy the full SHA
    16c7e4e View commit details
    Browse the repository at this point in the history

  2. work checkpoint

    @mtyrolski
    mtyrolski committed Oct 25, 2020
    Configuration menu
    Copy the full SHA
    5783a4b View commit details
    Browse the repository at this point in the history

  3. first version of funnel block

    @mtyrolski
    mtyrolski committed Oct 25, 2020
    Configuration menu
    Copy the full SHA
    5e79eb5 View commit details
    Browse the repository at this point in the history

  4. Typo

    @mtyrolski
    mtyrolski committed Oct 25, 2020
    Configuration menu
    Copy the full SHA
    7a8c0fd View commit details
    Browse the repository at this point in the history

  5. removed funnel block from transformers

    @mtyrolski
    mtyrolski committed Oct 25, 2020
    Configuration menu
    Copy the full SHA
    b3b206d View commit details
    Browse the repository at this point in the history

  6. default params

    @mtyrolski
    mtyrolski committed Oct 25, 2020
    Configuration menu
    Copy the full SHA
    e19bcd2 View commit details
    Browse the repository at this point in the history

  7. QKV fix

    @mtyrolski
    mtyrolski committed Oct 25, 2020
    Configuration menu
    Copy the full SHA
    28e453b View commit details
    Browse the repository at this point in the history

  8. funnel #2

    @mtyrolski
    mtyrolski committed Oct 25, 2020
    Configuration menu
    Copy the full SHA
    cbe9198 View commit details
    Browse the repository at this point in the history

  9. trax #3

    @mtyrolski
    mtyrolski committed Oct 25, 2020
    Configuration menu
    Copy the full SHA
    3bd7c17 View commit details
    Browse the repository at this point in the history

  10. funnel finished

    @mtyrolski
    mtyrolski committed Oct 25, 2020
    Configuration menu
    Copy the full SHA
    455bb9d View commit details
    Browse the repository at this point in the history

  11. funnel docs

    @mtyrolski
    mtyrolski committed Oct 25, 2020
    Configuration menu
    Copy the full SHA
    5174427 View commit details
    Browse the repository at this point in the history

  12. Dup without branch()

    @mtyrolski
    mtyrolski committed Oct 25, 2020
    Configuration menu
    Copy the full SHA
    adab919 View commit details
    Browse the repository at this point in the history

  13. funnel encoder

    @mtyrolski
    mtyrolski committed Oct 25, 2020
    Configuration menu
    Copy the full SHA
    8e400ca View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2020

  1. Encoder segment lenghts

    @mtyrolski
    mtyrolski committed Oct 26, 2020
    Configuration menu
    Copy the full SHA
    c1e4b6b View commit details
    Browse the repository at this point in the history

  2. Changed layers in FunnelEncoder

    @mtyrolski
    mtyrolski committed Oct 26, 2020
    Configuration menu
    Copy the full SHA
    2b0ffcb View commit details
    Browse the repository at this point in the history

  3. removed generator

    @mtyrolski
    mtyrolski committed Oct 26, 2020
    Configuration menu
    Copy the full SHA
    d4c5c94 View commit details
    Browse the repository at this point in the history

  4. custom max pool

    @mtyrolski
    mtyrolski committed Oct 26, 2020
    Configuration menu
    Copy the full SHA
    c4c3034 View commit details
    Browse the repository at this point in the history

  5. mask pooling

    @mtyrolski
    mtyrolski committed Oct 26, 2020
    Configuration menu
    Copy the full SHA
    ba39345 View commit details
    Browse the repository at this point in the history

  6. add feed forward

    @mtyrolski
    mtyrolski committed Oct 26, 2020
    Configuration menu
    Copy the full SHA
    157b0a4 View commit details
    Browse the repository at this point in the history

  7. init updated

    @mtyrolski
    mtyrolski committed Oct 26, 2020
    Configuration menu
    Copy the full SHA
    08fd698 View commit details
    Browse the repository at this point in the history