Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update 2:4 Examples #161

Merged
merged 2 commits into from
Sep 10, 2024
Merged

Update 2:4 Examples #161

merged 2 commits into from
Sep 10, 2024

Conversation

dsikka
Copy link
Collaborator

@dsikka dsikka commented Sep 10, 2024

SUMMARY:

  • Update to skip the lm_head
  • Update to use group/group_size for the -128 recipe
  • Use sequential updates in the gptq modifier
  • Run finetune for less time

Copy link

👋 Hi! Thank you for contributing to llm-compressor. Please add the ready label when the PR is ready for review.

@dsikka dsikka requested a review from Satrat September 10, 2024 21:35
@dsikka dsikka added the ready When a PR is ready for review label Sep 10, 2024
@dsikka dsikka merged commit f8e0ef6 into main Sep 10, 2024
6 of 7 checks passed
@dsikka dsikka deleted the fix_24_examples branch September 10, 2024 21:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ready When a PR is ready for review
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants