Use the right version of tokenizers (huggingface#9550)

* Use the right version of tokenizers * Try another way * Try another way * Deps are installed from there... * Deps are installed from there... * Revert last * remove needless comment
guyrosin · Jan 15, 2021 · c023d87 · c023d87
1 parent 38c6154
commit c023d87
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/.github/workflows/github-torch-hub.yml b/.github/workflows/github-torch-hub.yml
@@ -33,7 +33,7 @@ jobs:
       run: |
         pip install --upgrade pip
         pip install torch
-        pip install numpy filelock protobuf requests tqdm regex sentencepiece sacremoses tokenizers packaging importlib_metadata
+        pip install numpy filelock protobuf requests tqdm regex sentencepiece sacremoses tokenizers==0.9.4 packaging importlib_metadata
 
     - name: Torch hub list
       run: |