Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix Bug on Peft Config Check in AutoGPTQ Plugin #82

Merged
merged 2 commits into from
Sep 6, 2024
Merged

Fix Bug on Peft Config Check in AutoGPTQ Plugin #82

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
c189b9e
bug fix to assertion on target modules
achew010 Sep 6, 2024
a084549
remove version bump
achew010 Sep 6, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion plugins/accelerated-peft/pyproject.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ build-backend = "hatchling.build"

[project]
name = "fms-acceleration-peft"
version = '0.2.0.dev'
version = '0.2.1'
fabianlim marked this conversation as resolved.
Show resolved Hide resolved
description = "FMS Acceleration for PeFT"
authors = [
{name = "Fabian Lim", email = "flim@sg.ibm.com"},
Expand Down
6 changes: 4 additions & 2 deletions plugins/accelerated-peft/src/fms_acceleration_peft/autogptq_utils.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -37,8 +37,10 @@

def requires_installation_on_all_linears(peft_config):
tm = peft_config.target_modules
assert isinstance(tm, (list, str)), "target modules can only be list or string"
if isinstance(tm, list):
assert isinstance(
tm, (list, set, str)
), "target modules can only be list, set or string"
if isinstance(tm, (list, set)):
if PEFT_ALL_LINEAR not in tm:
return False
assert len(tm) == 1, f"`{PEFT_ALL_LINEAR}` must exist alone in target modules"
Expand Down
Loading