Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FEAT: Support quantization for VeRA using bitsandbytes (#2070) #2076

Merged
merged 29 commits into from
Oct 7, 2024
Merged

FEAT: Support quantization for VeRA using bitsandbytes (#2070) #2076

merged 29 commits into from
Oct 7, 2024

Commits on Sep 18, 2024

  1. Add 8-bit quantization support to VeraConfig

    @ZiadHelal
    ZiadHelal committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    322382c View commit details
    Browse the repository at this point in the history

  2. Update imports and __all__ for 8-bit quantization support in VeRA

    @ZiadHelal
    ZiadHelal committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    e272609 View commit details
    Browse the repository at this point in the history

  3. Implement 8-bit quantization support for VeRA using bitsandbytes

    @ZiadHelal
    ZiadHelal committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    0fe4a85 View commit details
    Browse the repository at this point in the history

  4. Integrate 8-bit quantization support in VeraModel

    @ZiadHelal
    ZiadHelal committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    ec2d228 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'huggingface:main' into feature/vera-quantization-support

    @ZiadHelal
    ZiadHelal authored Sep 18, 2024
    Configuration menu
    Copy the full SHA
    c9e2053 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2024

  1. Update imports 4-bit quantization support in VeRA

    @ZiadHelal
    ZiadHelal committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    6b2cec5 View commit details
    Browse the repository at this point in the history

  2. Implement 4-bit quantization support for VeRA using bitsandbytes (sti… 

    …ll draft)
    @ZiadHelal
    ZiadHelal committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    d222da9 View commit details
    Browse the repository at this point in the history

  3. Remove un-needed configurations

    @ZiadHelal
    ZiadHelal committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    f3f6026 View commit details
    Browse the repository at this point in the history

  4. Integrate 4-bit & 8-bit quantization support in VeraModel

    @ZiadHelal
    ZiadHelal committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    f558f48 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'huggingface:main' into feature/vera-quantization-support

    @ZiadHelal
    ZiadHelal authored Sep 22, 2024
    Configuration menu
    Copy the full SHA
    84c03de View commit details
    Browse the repository at this point in the history

  6. Add unit tests for VeRA quantization with 4-bit and 8-bit configurations

    @ZiadHelal
    ZiadHelal committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    84a3418 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. Merge branch 'huggingface:main' into feature/vera-quantization-support

    @ZiadHelal
    ZiadHelal authored Sep 23, 2024
    Configuration menu
    Copy the full SHA
    fd40773 View commit details
    Browse the repository at this point in the history

  2. Refactor _find_dim to explicitly handle input and output dimensions f… 

    …or nn.Linear and Conv1D layers
    @ZiadHelal
    ZiadHelal committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    eed91d2 View commit details
    Browse the repository at this point in the history

  3. Revert 4-bit quantization forward method to original code

    @ZiadHelal
    ZiadHelal committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    90ad93a View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. Merge branch 'huggingface:main' into feature/vera-quantization-support

    @ZiadHelal
    ZiadHelal authored Sep 25, 2024
    Configuration menu
    Copy the full SHA
    13e8d8a View commit details
    Browse the repository at this point in the history

  2. Fix style to make the linter happy

    @ZiadHelal
    ZiadHelal committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    762485a View commit details
    Browse the repository at this point in the history

  3. Added more bnb test examples for VeRA

    @ZiadHelal
    ZiadHelal committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    c87e4b8 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'huggingface:main' into feature/vera-quantization-support

    @ZiadHelal
    ZiadHelal authored Sep 25, 2024
    Configuration menu
    Copy the full SHA
    5ab1f1d View commit details
    Browse the repository at this point in the history

  5. Fixing style using make style

    @ZiadHelal
    ZiadHelal committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    5beff4f View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. Fixing linear layers dimensions

    @ZiadHelal
    ZiadHelal committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    a88d6c2 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'huggingface:main' into feature/vera-quantization-support

    @ZiadHelal
    ZiadHelal authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    14d78ed View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. Merge branch 'huggingface:main' into feature/vera-quantization-support

    @ZiadHelal
    ZiadHelal authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    e584ebd View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2024

  1. Merge branch 'huggingface:main' into feature/vera-quantization-support

    @ZiadHelal
    ZiadHelal authored Oct 3, 2024
    Configuration menu
    Copy the full SHA
    62a91bd View commit details
    Browse the repository at this point in the history

  2. Updating the date

    @ZiadHelal
    ZiadHelal authored Oct 3, 2024
    Configuration menu
    Copy the full SHA
    0752ff1 View commit details
    Browse the repository at this point in the history

  3. updating docs to reflect new changes

    zhelal committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    3b2c017 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2024

  1. Merge branch 'huggingface:main' into feature/vera-quantization-support

    @ZiadHelal
    ZiadHelal authored Oct 4, 2024
    Configuration menu
    Copy the full SHA
    640874f View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. Merge branch 'huggingface:main' into feature/vera-quantization-support

    @ZiadHelal
    ZiadHelal authored Oct 7, 2024
    Configuration menu
    Copy the full SHA
    de62838 View commit details
    Browse the repository at this point in the history

  2. updating docs

    @ZiadHelal
    ZiadHelal committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    aed4685 View commit details
    Browse the repository at this point in the history

  3. updating docs

    @ZiadHelal
    ZiadHelal committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    ebced3e View commit details
    Browse the repository at this point in the history