Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add dimensionality of heads argument to SABlock #7664

Merged
merged 13 commits into from
May 8, 2024

Commits on Apr 18, 2024

  1. Configuration menu
    Copy the full SHA
    139182e View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. Configuration menu
    Copy the full SHA
    36c0c60 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2024

  1. Configuration menu
    Copy the full SHA
    86a5b5e View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f1fd5c8 View commit details
    Browse the repository at this point in the history
  3. Add splitting embedding dim across head as default

    Signed-off-by: NabJa <nabil.jabareen@gmail.com>
    
    DCO Remediation Commit for NabJa <nabil.jabareen@gmail.com>
    
    I, NabJa <nabil.jabareen@gmail.com>, hereby add my Signed-off-by to this commit: 139182e
    
    Signed-off-by: NabJa <nabil.jabareen@gmail.com>
    NabJa committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    1ccb5de View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    9758317 View commit details
    Browse the repository at this point in the history
  5. Compute scale based on updated dim_head

    Signed-off-by: NabJa <nabil.jabareen@gmail.com>
    NabJa committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    71a55b3 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2024

  1. Configuration menu
    Copy the full SHA
    05f86a9 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2024

  1. Add tests for SABlock number of parameters

    Signed-off-by: NabJa <nabil.jabareen@gmail.com>
    NabJa committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    55d0cdc View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3d0b7fc View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    fad3ea1 View commit details
    Browse the repository at this point in the history
  4. Refactor test_selfattention for better readability

    Signed-off-by: NabJa <nabil.jabareen@gmail.com>
    NabJa committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    36fa810 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. Configuration menu
    Copy the full SHA
    9041992 View commit details
    Browse the repository at this point in the history