Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding FP8 weight export #907

Merged
merged 46 commits into from
May 29, 2024
Merged

Adding FP8 weight export #907

merged 46 commits into from
May 29, 2024

Commits on May 14, 2024

  1. placeholder version

    @costigt-dev @Giuseppe5
    costigt-dev authored and Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    5b168c5 View commit details
    Browse the repository at this point in the history

  2. checkpoint commit

    @costigt-dev @Giuseppe5
    costigt-dev authored and Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    d2b7d2d View commit details
    Browse the repository at this point in the history

  3. first working flow end to end

    @costigt-dev @Giuseppe5
    costigt-dev authored and Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    e10e630 View commit details
    Browse the repository at this point in the history

  4. formatting

    @costigt-dev @Giuseppe5
    costigt-dev authored and Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    84e70f7 View commit details
    Browse the repository at this point in the history

  5. changes to tests

    @costigt-dev @Giuseppe5
    costigt-dev authored and Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    ef4c737 View commit details
    Browse the repository at this point in the history

  6. added version check for test

    @costigt-dev @Giuseppe5
    costigt-dev authored and Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    4aa4b21 View commit details
    Browse the repository at this point in the history

  7. using existing functionality over homespun

    @costigt-dev @Giuseppe5
    costigt-dev authored and Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    3b05883 View commit details
    Browse the repository at this point in the history

  8. corrected mistake in copying and restored FloatClipMixin

    @costigt-dev @Giuseppe5
    costigt-dev authored and Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    cad5802 View commit details
    Browse the repository at this point in the history

  9. fixed mistake

    @costigt-dev @Giuseppe5
    costigt-dev authored and Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    4848248 View commit details
    Browse the repository at this point in the history

  10. first pass activation fp8 export

    @costigt-dev @Giuseppe5
    costigt-dev authored and Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    5188aa6 View commit details
    Browse the repository at this point in the history

  11. beginnings of activation fp8 export and change name of QCDQCastFloatW… 

    …eightQuantProxyHandlerMixin to be more consistent
    @costigt-dev @Giuseppe5
    costigt-dev authored and Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    29cb952 View commit details
    Browse the repository at this point in the history

  12. more changes to make naming scheme more consistent

    @costigt-dev @Giuseppe5
    costigt-dev authored and Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    9bf9240 View commit details
    Browse the repository at this point in the history

  13. added FloatFusedActivationQuantProxy

    @costigt-dev @Giuseppe5
    costigt-dev authored and Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    f9406f1 View commit details
    Browse the repository at this point in the history

  14. replaced zero_point workaround with placeholder implementation of fp8… 

    … equal_cpu
    @costigt-dev @Giuseppe5
    costigt-dev authored and Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    991ddb7 View commit details
    Browse the repository at this point in the history

  15. removed verbose flag

    @costigt-dev @Giuseppe5
    costigt-dev authored and Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    520db85 View commit details
    Browse the repository at this point in the history

  16. created context manager for fp8 workaround

    @costigt-dev @Giuseppe5
    costigt-dev authored and Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    2bb2895 View commit details
    Browse the repository at this point in the history

  17. added check that objects being compared are tensors in the fp8 workar… 

    …ound
    @costigt-dev @Giuseppe5
    costigt-dev authored and Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    8ffce48 View commit details
    Browse the repository at this point in the history

  18. General equal implementation

    @Giuseppe5
    Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    7edf5bd View commit details
    Browse the repository at this point in the history

  19. fallback to fp32 if fp8

    @Giuseppe5
    Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    bbd5362 View commit details
    Browse the repository at this point in the history

  20. Fix for PT < 2.1

    @Giuseppe5
    Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    4bc126d View commit details
    Browse the repository at this point in the history

  21. Remove non existent destroy

    @Giuseppe5
    Giuseppe5 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    a55dcd0 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. Merge branch 'dev' into feat/export_fp8

    @Giuseppe5
    Giuseppe5 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    cd6cad6 View commit details
    Browse the repository at this point in the history

  2. Remove import

    @Giuseppe5
    Giuseppe5 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    fabc8ae View commit details
    Browse the repository at this point in the history

  3. Fixed imports

    @Giuseppe5
    Giuseppe5 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    74b65a9 View commit details
    Browse the repository at this point in the history

  4. Fixed imports

    @Giuseppe5
    Giuseppe5 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    cf1ea02 View commit details
    Browse the repository at this point in the history

  5. Fix export

    @Giuseppe5
    Giuseppe5 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    cda7f1f View commit details
    Browse the repository at this point in the history

  6. more testing

    @Giuseppe5
    Giuseppe5 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    8349391 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. Fix

    @Giuseppe5
    Giuseppe5 committed May 24, 2024
    Configuration menu
    Copy the full SHA
    11387d3 View commit details
    Browse the repository at this point in the history

  2. Fix

    @Giuseppe5
    Giuseppe5 committed May 24, 2024
    Configuration menu
    Copy the full SHA
    592ccd3 View commit details
    Browse the repository at this point in the history

Commits on May 25, 2024

  1. fix

    @Giuseppe5
    Giuseppe5 committed May 25, 2024
    Configuration menu
    Copy the full SHA
    1fc5642 View commit details
    Browse the repository at this point in the history

  2. Fix minifloat check

    @Giuseppe5
    Giuseppe5 committed May 25, 2024
    Configuration menu
    Copy the full SHA
    58f46bc View commit details
    Browse the repository at this point in the history

  3. Last fix

    @Giuseppe5
    Giuseppe5 committed May 25, 2024
    Configuration menu
    Copy the full SHA
    bd657b8 View commit details
    Browse the repository at this point in the history

Commits on May 27, 2024

  1. Fix minifloat

    @Giuseppe5
    Giuseppe5 committed May 27, 2024
    Configuration menu
    Copy the full SHA
    630a3e3 View commit details
    Browse the repository at this point in the history

Commits on May 28, 2024

  1. Review

    @Giuseppe5
    Giuseppe5 committed May 28, 2024
    Configuration menu
    Copy the full SHA
    38a37fb View commit details
    Browse the repository at this point in the history

  2. Review 2

    @Giuseppe5
    Giuseppe5 committed May 28, 2024
    Configuration menu
    Copy the full SHA
    76b3193 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'dev' into feat/export_fp8

    @Giuseppe5
    Giuseppe5 committed May 28, 2024
    Configuration menu
    Copy the full SHA
    529470f View commit details
    Browse the repository at this point in the history

  4. fix

    @Giuseppe5
    Giuseppe5 committed May 28, 2024
    Configuration menu
    Copy the full SHA
    f2f8969 View commit details
    Browse the repository at this point in the history

  5. Typo

    @Giuseppe5
    Giuseppe5 committed May 28, 2024
    Configuration menu
    Copy the full SHA
    44579f8 View commit details
    Browse the repository at this point in the history

  6. fix tests

    @Giuseppe5
    Giuseppe5 committed May 28, 2024
    Configuration menu
    Copy the full SHA
    038cba9 View commit details
    Browse the repository at this point in the history

  7. Typo

    @Giuseppe5
    Giuseppe5 committed May 28, 2024
    Configuration menu
    Copy the full SHA
    198c5af View commit details
    Browse the repository at this point in the history

  8. fix

    @Giuseppe5
    Giuseppe5 committed May 28, 2024
    Configuration menu
    Copy the full SHA
    c3d7d3c View commit details
    Browse the repository at this point in the history

  9. last fix

    @Giuseppe5
    Giuseppe5 committed May 28, 2024
    Configuration menu
    Copy the full SHA
    fef531d View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. Fix JIT

    @Giuseppe5
    Giuseppe5 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    6431882 View commit details
    Browse the repository at this point in the history

  2. Fix import

    @Giuseppe5
    Giuseppe5 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    4b78543 View commit details
    Browse the repository at this point in the history

  3. Last fix

    @Giuseppe5
    Giuseppe5 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    d762c99 View commit details
    Browse the repository at this point in the history

  4. correct skip

    @Giuseppe5
    Giuseppe5 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    ac5e58c View commit details
    Browse the repository at this point in the history