Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Init quantization algorithm #91

Closed
wants to merge 95 commits into from
Closed

Init quantization algorithm #91

wants to merge 95 commits into from

Conversation

YangWang92
Copy link
Contributor

Init quantization algorithm

YangWang92 and others added 30 commits September 20, 2024 16:32
@YangWang92
Merge pull request #14 from YangWang92/main
489f188 
add Acknowledgement
@wejoncy
support streaming
31b3948
@wejoncy
gradio app (#16)
ddb0b60
@YangWang92
Update README.md (#18)
2cc222d 
add bibtex
@wejoncy
publish ci (#17)
697e6b2
@wejoncy @YangWang92
Bias (#19)
97a9c86 
Co-authored-by: Yang Wang <wyatuestc@gmail.com>
@wejoncy
fix out of bound error (#20)
faec9ec
add res index 15 bit
23292fc
add res index 15 bit
b959c87
@OpenSourceRonin
Add open source community (#21)
ca1e820 
Add open source community
@wejoncy
memory and bf16 (#23)
8822e81 
- shrink memory
- support bf16
@YangWang92
Update README.md (#22)
dd96c8b 
add arXiv link
@YangWang92
Merge remote-tracking branch 'upstream/main' into main
79f29ab
@YangWang92
Merge remote-tracking branch 'upstream/main' into main
38da1e4
@YangWang92
fix useage
26944f2
@YangWang92
fix useage
b3f4bfb
@YangWang92
Update model_base.py
1db2150
@YangWang92
Update model_base.py
1e62ab8
@YangWang92
fix pep
0472fcf
@YangWang92
fix pep
fe2064c
@YangWang92
Update model_base.py
d304801
@YangWang92
Update model_base.py
f1f79ca
@YangWang92
Update app_utils.py
9247b02
@YangWang92
Update app_utils.py
6aefa33
@YangWang92
Update README.md
9bf60e1
@YangWang92
Update README.md
2496915
@YangWang92
Update app_utils.py
4b32182
@YangWang92
Update app_utils.py
de5daff
@YangWang92
Update app_utils.py
e8d2f47
@YangWang92
Update app_utils.py
829f2e7
YangWang92 and others added 28 commits October 14, 2024 01:46
@YangWang92
update settings
f72d847
@YangWang92
update settings
4a417f1
@wejoncy
rocm fix (#65)
594b0e2
@YangWang92
improve web app demo
06e7624
@YangWang92
improve web app demo
d674ffd
@YangWang92
Merge pull request #3 from VPTQ/wy/demo
f82e628 
optimize web app example
@YangWang92
Merge pull request #3 from VPTQ/wy/demo
c3f4f24 
optimize web app example
@YangWang92
improve web app demo (#66)
7a877f7 
improve web app demo
@YangWang92
Update setup.py (#68)
0ad47c1 
revert back device setting
@YangWang92
refine online demo (#69)
2eaa00c 
refine online demo
@OpenSourceRonin
Update README.md (#70)
3641ad5
@YangWang92
Update setup.py (#72)
519550c 
fix setup, device setting
@YangWang92
update device map (#74)
0eff787 
update device map, handle naive mutiple-GPU by accelerator's device_map.
@OpenSourceRonin
Update README.md (#80)
541b18a
@OpenSourceRonin
Update README.md (#81)
d152196
@OpenSourceRonin
Update README.md (#82)
e257e23
@OpenSourceRonin
Update README.md (#83)
aedc6fb
@YangWang92
add math example (#84)
1f92bf5 
add math example
@YangWang92
add acknowledgement and disclaimer (#85)
1672e20 
add acknowledgement and disclaimer
@YangWang92
Merge remote-tracking branch 'vptq/main' into main
d7a8310
@YangWang92
Merge remote-tracking branch 'vptq/main' into main
0db471f
@YangWang92
Merge branch 'wy/algo' into main
b40a5e3
@YangWang92
Merge branch 'wy/algo' into main
31f1ab4
@YangWang92
Merge pull request #4 from VPTQ/main
530270d 
Main
@YangWang92
Merge pull request #4 from VPTQ/main
788b98b 
Main
@YangWang92
add data
fe5b65f 
add llama

add reshape

add more files

del unused pararmeters

fix eval

fix  bugs

fix pack bug

save tokenizer

fix bug

fix model name

add qwen

fix bias
@YangWang92
add data
14c8c00 
add llama

add reshape

add more files

del unused pararmeters

fix eval

fix  bugs

fix pack bug

save tokenizer

fix bug

fix model name

add qwen

fix bias
@YangWang92
Merge branch 'wy/algo' of https://github.com/VPTQ/VPTQ into wy/algo
66715c7
@YangWang92 YangWang92 closed this Oct 28, 2024
@YangWang92 YangWang92 deleted the algorithm branch October 28, 2024 05:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@YangWang92 @wejoncy @OpenSourceRonin @eltociear @TITC