Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Accelerate Utilities #193

Merged
merged 32 commits into from
Dec 20, 2024
Merged
Changes from 1 commit
Commits
Show all changes
32 commits
Select commit Hold shift + click to select a range
bddc83c
wip
kylesayrs Oct 21, 2024
94d8c56
add modify_offload_module
kylesayrs Oct 23, 2024
f939e98
update docs
kylesayrs Oct 23, 2024
167e741
WIP
kylesayrs Oct 31, 2024
cb6edb1
cleanup functions, begin depreciation
kylesayrs Nov 18, 2024
cb70047
remove extra space
kylesayrs Nov 18, 2024
98a2889
revert get_offloaded_device
kylesayrs Nov 18, 2024
8cd69ef
update to align_module_device
kylesayrs Nov 19, 2024
0d23183
add requires skip for accelerate
kylesayrs Nov 19, 2024
82235b3
Merge remote-tracking branch 'origin' into kylesayrs/upstream-candidates
kylesayrs Nov 19, 2024
0b0d8b6
fix per token initialization
kylesayrs Nov 19, 2024
95e5907
remove align_module_device
kylesayrs Nov 19, 2024
a6a3198
Merge remote-tracking branch 'origin' into kylesayrs/upstream-candidates
kylesayrs Dec 2, 2024
e3c3f95
Merge remote-tracking branch 'origin' into kylesayrs/upstream-candidates
kylesayrs Dec 2, 2024
81a1eab
respond to nits
kylesayrs Dec 6, 2024
e7e1d81
Accelerate Utilities Follow-up (#224)
kylesayrs Dec 6, 2024
9af736f
rename
kylesayrs Dec 6, 2024
35fa1cd
implement recursive case
kylesayrs Dec 6, 2024
38765bd
remove print
kylesayrs Dec 6, 2024
64f4d98
support OffloadedWeightsLoader
kylesayrs Dec 6, 2024
b8ae387
add lifecycle docstring
kylesayrs Dec 10, 2024
870095e
implement offload_to_weights_map with recursive definition
kylesayrs Dec 16, 2024
77411ca
add docstring
kylesayrs Dec 16, 2024
a5b1792
fix type hint
kylesayrs Dec 16, 2024
ed9ee4e
add check_accelerate guard
kylesayrs Dec 16, 2024
1632cc3
make device used by clearer
kylesayrs Dec 16, 2024
1c55a10
update update_prefix_dict
kylesayrs Dec 17, 2024
9177650
reuse fixture
kylesayrs Dec 17, 2024
38d7dbf
Merge remote-tracking branch 'origin' into kylesayrs/upstream-candidates
kylesayrs Dec 19, 2024
df3e186
use apply rather than recursion
kylesayrs Dec 19, 2024
665c987
clearer delete_from_weights_map
kylesayrs Dec 19, 2024
0f4760a
add offload_device argument (#228)
kylesayrs Dec 19, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
remove extra space
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
kylesayrs committed Nov 18, 2024

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
commit cb70047efe4ab266ca73a652a5cb69d5693194d2
1 change: 0 additions & 1 deletion src/compressed_tensors/utils/helpers.py
Original file line number Diff line number Diff line change
@@ -131,7 +131,6 @@ def getattr_chain(obj: Any, chain_str: str, *args, **kwargs) -> Any:
:param obj: base object whose attributes are being retrieved
:param chain_str: attribute names separated by `.`
:param default: default value, throw error otherwise

"""
if len(args) >= 1:
has_default = True