Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[setup] update/add setup targets #8076

Merged
merged 1 commit into from
Oct 27, 2020
Merged

Conversation

stas00
Copy link
Contributor

@stas00 stas00 commented Oct 27, 2020

updating pip targets

  • adds tokenizer
  • adds docs to dev, since we need to have the tools to run make docs
  • adds flax to dev, since we need to have the libs to run flax tests - except when on windows - it skips it then
  • brings all up-to-date

@sgugger

Copy link
Collaborator

@sgugger sgugger left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for humoring us Stas. This looks good to me!

extras["flax"] = ["jaxlib==0.1.55", "jax>=0.2.0", "flax==0.2.2"]
if os.name == "nt": # windows
extras["flax"] = [] # jax is not supported on windows
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we define extras["retrieval"] before this line with just "datasets" and append "faiss-cpu" here (it only works on Windows too).

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it only works on non-windows (linux + osx), but good comment nonetheless!

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes non-Windows, sorry ;-)

@sgugger sgugger requested a review from LysandreJik October 27, 2020 12:00
Copy link
Member

@LysandreJik LysandreJik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is great, thanks @stas00!

extras["flax"] = ["jaxlib==0.1.55", "jax>=0.2.0", "flax==0.2.2"]
if os.name == "nt": # windows
extras["flax"] = [] # jax is not supported on windows
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it only works on non-windows (linux + osx), but good comment nonetheless!

@stas00
Copy link
Contributor Author

stas00 commented Oct 27, 2020

Guys, since this is not code but a bunch of definitions please make direct suggestions that can be merged. Thank you.

I originally just wanted to add docs and flax to dev and had no idea about all the other needs.

@sgugger
Copy link
Collaborator

sgugger commented Oct 27, 2020

I can't make a suggestion that moves stuff around in the file. I can push a commit to your branch if you want, but that's the best I can do.

@stas00
Copy link
Contributor Author

stas00 commented Oct 27, 2020

I understand. I just don't know to work in this fashion. If you give me a spec I can work to implement it. Otherwise let's just merge this and subsequent PRs can do further improvements.

@sgugger sgugger merged commit edd3721 into huggingface:master Oct 27, 2020
@sgugger
Copy link
Collaborator

sgugger commented Oct 27, 2020

Sure, I'll add my comments in a separate PR. Thanks for doing this one!

@stas00 stas00 deleted the pip-targets-2 branch October 27, 2020 17:57
fabiocapsouza pushed a commit to fabiocapsouza/transformers that referenced this pull request Nov 15, 2020
fabiocapsouza added a commit to fabiocapsouza/transformers that referenced this pull request Nov 15, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants