Layer by Layer Sequential GPTQ Updates#47

Merged

Satrat merged 22 commits intomainfrom sequential_gptq_updates

Aug 12, 2024

Commits on Aug 1, 2024

WIP
Sara Adkins
committed
cleanup, disable cache
Sara Adkins
committed
docstrings
Sara Adkins
committed
move to layer compressor
Sara Adkins
committed
small fixes
Sara Adkins
committed
docstrings
Sara Adkins
committed
fix offloading
Sara Adkins
committed
remove example debugging
Sara Adkins
committed
fix structure check
Sara Adkins
committed

Commits on Aug 2, 2024

update example back to 70b
Sara Adkins
committed
remove debugging code
Sara Adkins
committed
remove debug code
Sara Adkins
committed
fix unit tests
Sara Adkins
committed
update example
Sara Adkins
committed
Merge branch 'sequential_gptq_updates' of github.com:vllm-project/llm-compressor into sequential_gptq_updates
Sara Adkins
committed
update example
Sara Adkins
committed
reert test change
Sara Adkins
committed

Commits on Aug 5, 2024

Merge branch 'main' into sequential_gptq_updates
Sara Adkins
committed
example tweak
Sara Adkins
committed
Merge branch 'sequential_gptq_updates' of github.com:vllm-project/llm-compressor into sequential_gptq_updates
Sara Adkins
committed

Commits on Aug 6, 2024

Merge branch 'main' into sequential_gptq_updates
Sara Adkins
committed

Commits on Aug 12, 2024

Merge branch 'main' into sequential_gptq_updates
Sara Adkins
committed