Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upgrade Transformers to v4.43.x #727

Merged
merged 8 commits into from
Aug 4, 2024
Merged

Upgrade Transformers to v4.43.x #727

merged 8 commits into from
Aug 4, 2024

Commits on Jul 27, 2024

  1. Upgrade Transformers to v4.43.x

    @calpt
    calpt committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    3399003 View commit details
    Browse the repository at this point in the history

  2. Re-copy Llama & Beit

    @calpt
    calpt committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    e9e3848 View commit details
    Browse the repository at this point in the history

  3. Add Clip Sdp/ flash attn

    @calpt
    calpt committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    e8b03aa View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2024

  1. Fix our tie_weights method.

    @lenglaender
    lenglaender committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    7942eb2 View commit details
    Browse the repository at this point in the history

  2. increase minimum pytorch version to have & torch.nn.attention and sup… 

    …port FlashAttention2

- overall speedup
- fixing failing test: Hugging Face needs to have has this import that resulted prior to this fix in an error: `from torch.nn.attention import SDPBackend, sdpa_kernel`
    @lenglaender
    lenglaender committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    34c1d54 View commit details
    Browse the repository at this point in the history

  3. increasing pytorch version in github action

    @lenglaender
    lenglaender committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    7b073ca View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2024

  1. Test precision

    @calpt
    calpt committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    3afdbc5 View commit details
    Browse the repository at this point in the history

  2. unpin torch

    @calpt
    calpt committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    632b786 View commit details
    Browse the repository at this point in the history