Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Downgrading transformer #3

Open
wants to merge 7 commits into
base: main
Choose a base branch
from
Open

Downgrading transformer #3

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
01fb567
Downgrading transformers to resolve dependencies conflict
Filienko Aug 30, 2024
31c28a6
Downgrading tokenizers
Filienko Aug 30, 2024
232db23
Removing transformers specific dependencies
Filienko Aug 30, 2024
1c895ef
WIP: reverting typos
Filienko Aug 30, 2024
b63c7ff
Adding libraries, pinned versions, back
Filienko Aug 30, 2024
ba73bcc
Changing tokenizers version
Filienko Aug 30, 2024
4402a50
Pinning tokenizers
Filienko Aug 30, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions requirements.dev.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -148,7 +148,7 @@ six==1.16.0
# url-normalize
sympy==1.13.2
# via torch
tokenizers==0.19.1
tokenizers==0.15.2
# via transformers
tomli==2.0.1
# via pytest
Expand All @@ -158,7 +158,8 @@ tqdm==4.66.5
# via
# huggingface-hub
# transformers
transformers==4.44.1
# Pinned because of compatability issues, https://github.com/huggingface/transformers/issues/30965
transformers==4.37.0
# via ml_services (setup.cfg)
triton==3.0.0
# via torch
Expand Down
5 changes: 3 additions & 2 deletions requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -129,15 +129,16 @@ six==1.16.0
# url-normalize
sympy==1.13.2
# via torch
tokenizers==0.19.1
tokenizers==0.15.2
# via transformers
torch==2.4.0
# via ml_services (setup.cfg)
tqdm==4.66.5
# via
# huggingface-hub
# transformers
transformers==4.44.1
# Pinned because of compatability issues, https://github.com/huggingface/transformers/issues/30965
transformers==4.37.0
# via ml_services (setup.cfg)
triton==3.0.0
# via torch
Expand Down
7 changes: 6 additions & 1 deletion setup.cfg
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,15 +8,20 @@ url = https://github.com/uwcirg/isacc-ml
[options]
packages = ml_services
python_requires = >=3.9

# Pinned transformers because of compatability issues
# Pinned tokenizers to comply with transformers
# https://github.com/huggingface/transformers/issues/30965
install_requires =
transformers==4.37.0
tokenizers==0.15.2
flask
gunicorn
requests-cache
numpy
pandas
scipy
torch
transformers

[options.extras_require]
dev =
Expand Down