Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

VLM Support via GPTQ Hooks and Sequential Data Pipeline #914

Draft
wants to merge 267 commits into
base: main
Choose a base branch
from
Draft

VLM Support via GPTQ Hooks and Sequential Data Pipeline #914

wants to merge 267 commits into from

Conversation

kylesayrs
Copy link
Collaborator

@kylesayrs kylesayrs commented Nov 13, 2024 •
edited
Loading

@kylesayrs
wip
83a5762
@kylesayrs
runnable
7f49ab4
@kylesayrs
add ability to pass model class to support non-traditional (vision) m…
4539052 
…odels
@kylesayrs
Merge remote-tracking branch 'origin' into kylesayrs/calculate_offloa…
483744c 
…d_default_gpus
@kylesayrs
update docstring
9ae998b
@kylesayrs
batching
ac0d926
@kylesayrs
calibration forward context
6304973
@kylesayrs
fix stuff
868a480
@kylesayrs
wip
86c8a06
@kylesayrs
use hooks list
1305173
@kylesayrs
layer compressor
e6adc5a
@kylesayrs
style
f65f832
@kylesayrs
use layer compressor
1e22569
@kylesayrs
replicate dtypes
9324695
@kylesayrs
write weight changes
eef4fb6
@kylesayrs
revert example
485813a
@kylesayrs
organization
6006155
@kylesayrs
add create_single_batch_dataloader
c10d2ee
@kylesayrs
add back empty_cache until I can justify removing it
6371193
@kylesayrs
better type hinting, faster mask applying
92315a5
@kylesayrs
Merge remote-tracking branch 'origin' into kylesayrs/gptq-hooks
8903fbf
@kylesayrs
remove breakpoint
8a25c68
@kylesayrs
apply style, add true_sequential docstring
6cd0d6c
@kylesayrs
update docstring
0e0c586
@kylesayrs
use private attrs
d23aabb
@kylesayrs
more docstring
355074b
@kylesayrs
docstrings
bf2184d
@kylesayrs
docstrings
0b418c7
@kylesayrs
docstrings
56cceea
@kylesayrs
move hooksmixin to separate file
7c7e3bc
@kylesayrs
Copy link
Collaborator Author

https://github.com/neuralmagic/llm-compressor-testing/actions/runs/12359686271

@kylesayrs
Copy link
Collaborator Author

No new nightly failures: https://github.com/neuralmagic/llm-compressor-testing/actions/runs/12398026591/job/34609853074

@kylesayrs
update docstring
9b61145
@kylesayrs
remove unused util
2f65d01 
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
@kylesayrs
remove debug
338d1cb
@kylesayrs
more tests
f4fa9c3 
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
@kylesayrs
Merge remote-tracking branch 'origin' into kylesayrs/cleanup-custom-d…
6bd1721 
…ataset
@kylesayrs
remove duplicate file
e757e61 
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
@kylesayrs
better help texts
bdfa3d4 
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
@kylesayrs
Merge branch 'kylesayrs/cleanup-custom-dataset' into kylesayrs/gptq-p…
cd9dd21 
…artition
@kylesayrs
Merge branch 'kylesayrs/calculate_offload_default_gpus' into kylesayr…
f674579 
…s/gptq-partition
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Gptj use gptq quant bug Layers not skipped with ignore=[ "re:.*"]
1 participant
@kylesayrs