Skip to content

Navigation Menu

Explore
By company size
By use case
By industry
View all solutions
Topics
- AI
- DevOps
- Security
- Software Development
- View all
Explore
- GitHub Sponsors
  Fund open source developers
- The ReadME Project
  GitHub community articles
Repositories
- Enterprise platform
  AI-powered developer platform
Available add-ons
Pricing

Search code, repositories, users, issues, pull requests...

Search

Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Saved searches

Use saved searches to filter your results more quickly

Name

Query

To see all available qualifiers, see our documentation.

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

vllm-project / llm-compressor Public

Notifications You must be signed in to change notification settings
Fork 69
Star 820

Code
Issues 22
Pull requests 35
Actions
Projects
Wiki
Security
Insights

Additional navigation options

Code
Issues
Pull requests
Actions
Projects
Wiki
Security
Insights

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ Examples ] E2E Examples #5

Merged

robertgshaw2-neuralmagic merged 30 commits into main from rs/examples

Jul 2, 2024

Conversation 22 Commits 30 Checks 12 Files changed

Merged

[ Examples ] E2E Examples #5

Show file tree

Hide file tree

Changes from 28 commits

Commits

Show all changes

Select commit Hold shift + click to select a range

robertgshaw2-neuralmagic Jun 24, 2024

updated examples

robertgshaw2-neuralmagic Jun 24, 2024

set to 32 samples for testing

robertgshaw2-neuralmagic Jun 24, 2024

robertgshaw2-neuralmagic Jun 25, 2024

Update llama7b_quantize_sparse_cnn.py

robertgshaw2-neuralmagic Jun 25, 2024

Merge branch 'main' into rs/examples

robertgshaw2-neuralmagic Jun 25, 2024

robertgshaw2-neuralmagic Jun 25, 2024

robertgshaw2-neuralmagic Jun 26, 2024

robertgshaw2-neuralmagic Jun 27, 2024

tweak fp8 example

update examples to use tokenized data

Merge branch 'main' into rs/examples

robertgshaw2-neuralmagic Jul 2, 2024

fp8 example end to end

robertgshaw2-neuralmagic Jul 2, 2024

robertgshaw2-neuralmagic Jul 2, 2024

robertgshaw2-neuralmagic Jul 2, 2024

robertgshaw2-neuralmagic Jul 2, 2024

finished example

robertgshaw2-neuralmagic Jul 2, 2024

refactored directory structure

robertgshaw2-neuralmagic Jul 2, 2024

robertgshaw2-neuralmagic Jul 2, 2024

restructure w4a16

robertgshaw2-neuralmagic Jul 2, 2024

robertgshaw2-neuralmagic Jul 2, 2024

added w8a8-int8 example

robertgshaw2-neuralmagic Jul 2, 2024

finalized example

robertgshaw2-neuralmagic Jul 2, 2024

added back example

robertgshaw2-neuralmagic Jul 2, 2024

robertgshaw2-neuralmagic Jul 2, 2024

robertgshaw2-neuralmagic Jul 2, 2024

Update examples/quantization_w4a16/README.md

robertgshaw2-neuralmagic Jul 2, 2024

File filter

Filter by extension

Filter by extension .ipynb (1) .md (5) .py (8) .yaml (3) All 4 file types selected

Deleted files Viewed files

Conversations

Failed to load comments.

Loading

Jump to

Jump to file

Failed to load files.

Loading

Diff view

Unified

Split

Hide whitespace

Diff view

Unified

Split

Hide whitespace

There are no files selected for viewing

38 changes: 0 additions & 38 deletions 38 examples/quantization/llama7b_fp8_quantization.py

Show comments

View file

Open in desktop

This file was deleted.

Oops, something went wrong.

50 changes: 0 additions & 50 deletions 50 examples/quantization/llama7b_one_shot_quantization.md

Show comments

View file

Open in desktop

This file was deleted.

Oops, something went wrong.

70 changes: 0 additions & 70 deletions 70 examples/quantization/llama7b_quantize_sparse_cnn.py

Show comments

View file

Open in desktop

This file was deleted.

Oops, something went wrong.

233 changes: 0 additions & 233 deletions 233 examples/quantization/llama7b_w4a16_quantization.ipynb

Show comments

View file

Open in desktop

This file was deleted.

Oops, something went wrong.

Loading

Oops, something went wrong.

Loading

Oops, something went wrong.

Add this suggestion to a batch that can be applied as a single commit. This suggestion is invalid because no changes were made to the code. Suggestions cannot be applied while the pull request is closed. Suggestions cannot be applied while viewing a subset of changes. Only one suggestion per line can be applied in a batch. Add this suggestion to a batch that can be applied as a single commit. Applying suggestions on deleted lines is not supported. You must change the existing code in this line in order to create a valid suggestion. Outdated suggestions cannot be applied. This suggestion has been applied or marked resolved. Suggestions cannot be applied from pending reviews. Suggestions cannot be applied on multi-line comments. Suggestions cannot be applied while the pull request is queued to merge. Suggestion cannot be applied right now. Please check back later.

Footer

© 2024 GitHub, Inc.

Footer navigation

Terms
Privacy
Security
Status
Docs
Contact

You can’t perform that action at this time.