Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Blog post on bitsandbytes integration on Hugging Face #463

Merged
merged 60 commits into from
Aug 17, 2022
Merged
Show file tree
Hide file tree
Changes from 3 commits
Commits
Show all changes
60 commits
Select commit Hold shift + click to select a range
e13bf39
first commit
younesbelkada Aug 11, 2022
fc8fb59
add new thumbnails
younesbelkada Aug 12, 2022
7cd183c
add more content
younesbelkada Aug 12, 2022
7f3e653
add new gif
younesbelkada Aug 12, 2022
7471a28
Update _blog.yml
younesbelkada Aug 12, 2022
9cab34a
Merge branch 'main' into add_bnb_inference
younesbelkada Aug 12, 2022
b4ba73b
Merge branch 'main' into add_bnb_inference
younesbelkada Aug 12, 2022
4cc7cbf
rename files
younesbelkada Aug 12, 2022
df2fcb6
Merge branch 'add_bnb_inference' of https://github.com/younesbelkada/…
younesbelkada Aug 12, 2022
9ed399b
Apply suggestions from code review
younesbelkada Aug 12, 2022
e598e7b
Apply suggestions from code review
younesbelkada Aug 12, 2022
a4f548e
change content a bit
younesbelkada Aug 12, 2022
e4e9b2a
re-write text: part 1
stas00 Aug 13, 2022
d36520a
few modifs
younesbelkada Aug 13, 2022
c37de76
modify a bit
younesbelkada Aug 13, 2022
2d7f6ef
add more content
younesbelkada Aug 13, 2022
62a1c96
add image
younesbelkada Aug 13, 2022
768fdd7
paraphrase a bit
younesbelkada Aug 13, 2022
94e88ee
add more content
younesbelkada Aug 13, 2022
907b496
add more content
younesbelkada Aug 13, 2022
4b2f33d
some improvements
younesbelkada Aug 13, 2022
7850a1a
add thumbnail
younesbelkada Aug 13, 2022
b093193
add more text + fix table
younesbelkada Aug 13, 2022
7f66c85
fix table
younesbelkada Aug 13, 2022
c3b3c16
fix tables
younesbelkada Aug 13, 2022
e9c5ecc
add stas as author
younesbelkada Aug 13, 2022
7042366
add a last sentence
younesbelkada Aug 13, 2022
a18447d
edit some more
stas00 Aug 14, 2022
c713148
few modifs
younesbelkada Aug 14, 2022
0815b10
modify thumbail
younesbelkada Aug 14, 2022
f8ea5ed
add thumbnail
younesbelkada Aug 14, 2022
a51c607
add removed comment
younesbelkada Aug 14, 2022
d509d06
add photos
younesbelkada Aug 15, 2022
884b7a4
add more infos
younesbelkada Aug 15, 2022
20f0179
Apply suggestions from code review
younesbelkada Aug 15, 2022
93301b8
Apply suggestions from code review
younesbelkada Aug 15, 2022
1895282
Add files via upload
younesbelkada Aug 15, 2022
ccea0ef
add steven to the credits!
younesbelkada Aug 15, 2022
a606303
edits
stas00 Aug 15, 2022
362363f
edits
stas00 Aug 15, 2022
e6adfa7
edits
stas00 Aug 15, 2022
84fe2cb
edits
younesbelkada Aug 15, 2022
a5826d5
add script
younesbelkada Aug 15, 2022
c71e04f
change to std err
younesbelkada Aug 15, 2022
c9b1071
refactor a bit the tables
younesbelkada Aug 15, 2022
6542f67
add Tim's comments
younesbelkada Aug 15, 2022
96898cf
remove separators
younesbelkada Aug 15, 2022
c749578
explain why it is slow
younesbelkada Aug 15, 2022
35c31c1
Update hf-bitsandbytes-integration.md
younesbelkada Aug 16, 2022
c6a39d7
Add links to paper
younesbelkada Aug 16, 2022
92517be
delete dummy file
younesbelkada Aug 16, 2022
f8fa134
add correct link to paper
younesbelkada Aug 16, 2022
728ffa8
add more explanation on speed
younesbelkada Aug 16, 2022
d2ff94a
update figure
younesbelkada Aug 16, 2022
e83dee8
replace authors by we
younesbelkada Aug 16, 2022
3789ca0
add freezed image
younesbelkada Aug 16, 2022
88075aa
remove old table
younesbelkada Aug 16, 2022
060313f
Update hf-bitsandbytes-integration.md
TimDettmers Aug 16, 2022
4ff602f
Apply suggestions from code review
younesbelkada Aug 17, 2022
487c428
Apply suggestions from code review
younesbelkada Aug 17, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 10 additions & 0 deletions _blog.yml
Original file line number Diff line number Diff line change
Expand Up @@ -1105,3 +1105,13 @@
tags:
- guide
- cv

- local: hf-bitsandbytes-integration
title: "A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes"
author: ybelkada
thumbnail: /blog/assets/96_hf_bitsandbytes_integration/thumbnail.png
younesbelkada marked this conversation as resolved.
Show resolved Hide resolved
date: August 12, 2022
younesbelkada marked this conversation as resolved.
Show resolved Hide resolved
tags:
- nlp
- llm
- quantization
Binary file added assets/96_hf_bitsandbytes_integration/LLM.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added assets/96_hf_bitsandbytes_integration/byte.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
199 changes: 199 additions & 0 deletions hf-bitsandbytes-integration.md

Large diffs are not rendered by default.