Running with local models from the hugging face .cache

[piekvossen]

Running with local models does not work even though the models are in the hugging face .cache:

/Users/piek/.cache/huggingface/transformers

E.g. there is. json file with the following info:

{"url": "https://huggingface.co/CLTL/icf-domains/resolve/main/special_tokens_map.json", "etag": ""e97d1993365bb21c88f390e8703e4c1af564821f"”}%

docker run -v /Users/piek/Desktop/r-COVID-19-TM/CovidHerstelZorg-ZonMW/data -e TRANSFORMERS_OFFLINE=1 piekvossen/a-proof-icf-classifier --in_csv example/input.csv --text_col text

Error message is below:

Loading input csv file: example/input.csv
Input csv file (example/input.csv) is successfuly loaded!
Anonymizing the text in "text" column. This might take a while.
Splitting the text in "text" column to sentences. This might take a while.
Generating domains predictions. This might take a while.
CUDA device not available; running on a CPU!
Cannot find the requested files in the cached path and outgoing traffic has been disabled. To enable model look-ups and downloads online, set 'local_files_only' to False.
Downloading the model from https://huggingface.co/CLTL/icf-domains
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/transformers/configuration_utils.py", line 546, in get_config_dict
resolved_config_file = cached_path(
File "/usr/local/lib/python3.8/site-packages/transformers/file_utils.py", line 1402, in cached_path
output_path = get_from_cache(
File "/usr/local/lib/python3.8/site-packages/transformers/file_utils.py", line 1620, in get_from_cache
raise FileNotFoundError(
FileNotFoundError: Cannot find the requested files in the cached path and outgoing traffic has been disabled. To enable model look-ups and downloads online, set 'local_files_only' to False.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "./main.py", line 154, in
main(
File "./main.py", line 121, in main
sents['predictions'] = predict_domains(
File "/icfc/src/icf_classifiers.py", line 49, in predict_domains
model = MultiLabelClassificationModel(
File "/usr/local/lib/python3.8/site-packages/simpletransformers/classification/multi_label_classification_model.py", line 194, in init
self.config = config_class.from_pretrained(model_name, **self.args.config)
File "/usr/local/lib/python3.8/site-packages/transformers/configuration_utils.py", line 489, in from_pretrained
config_dict, kwargs = cls.get_config_dict(pretrained_model_name_or_path, **kwargs)
File "/usr/local/lib/python3.8/site-packages/transformers/configuration_utils.py", line 570, in get_config_dict
raise EnvironmentError(msg)
OSError: Can't load config for 'CLTL/icf-domains'. Make sure that:

• 'CLTL/icf-domains' is a correct model identifier listed on 'https://huggingface.co/models'

• or 'CLTL/icf-domains' is the correct path to a directory containing a config.json file

[sandertan]

Hi @piekvossen , if the above command is the one you executed, I think it's missing the -v parameter to mount your local cache directory to the container's cache dir. Could you try:

docker run \
  -v /Users/piek/.cache/huggingface/transformers:/root/.cache/huggingface/transformers/ \
  -e TRANSFORMERS_OFFLINE=1 \
  piekvossen/a-proof-icf-classifier --in_csv example/input.csv --text_col text

It's possible to mount multiple directories, so you can add a -v to also mount a custom data folder.

[piekvossen]

Hi Sander, Thanks for pointing out. This seems to solve some of the problems but I still got an error for one of the cached models. That would be weird as I did run it using the online models and also downloaded it in the data folder: (base) ***@***.*** aproof-icf-classifier % ls ~/Desktop/r-COVID-19-TM/CovidHerstelZorg-ZonMW/data [Spam] COVID data.eml icf-levels-adm icf-levels-ber icf-levels-etn icf-levels-ins icf-levels-stm icf-domains icf-levels-att icf-levels-enr icf-levels-fac icf-levels-mbw groetjes Piek (base) ***@***.*** aproof-icf-classifier % docker run \ -v /Users/piek/Desktop/r-COVID-19-TM/CovidHerstelZorg-ZonMW/data \ -v /Users/piek/.cache/huggingface/transformers:/root/.cache/huggingface/transformers/ \ -e TRANSFORMERS_OFFLINE=1 \ piekvossen/a-proof-icf-classifier --in_csv example/input.csv --text_col text Loading input csv file: example/input.csv Input csv file (example/input.csv) is successfuly loaded! Anonymizing the text in "text" column. This might take a while. Splitting the text in "text" column to sentences. This might take a while. Generating domains predictions. This might take a while. Downloading the model from https://huggingface.co/CLTL/icf-domains CUDA device not available; running on a CPU! 14%|█▍ | 1/7 [00:00<00:00, 13.65it/s] 100%|██████████| 1/1 [00:00<00:00, 2.74it/s]Processing domains predictions. Generating levels predictions for ADM. Downloading the model from https://huggingface.co/CLTL/icf-levels-adm CUDA device not available; running on a CPU! 50%|█████ | 1/2 [00:00<00:00, 8.68it/s] 100%|██████████| 1/1 [00:00<00:00, 6.92it/s]There are no sentences for which ATT was predicted. There are no sentences for which BER was predicted. Generating levels predictions for ENR. Downloading the model from https://huggingface.co/CLTL/icf-levels-enr Cannot find the requested files in the cached path and outgoing traffic has been disabled. To enable model look-ups and downloads online, set 'local_files_only' to False. Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/transformers/configuration_utils.py", line 546, in get_config_dict resolved_config_file = cached_path( File "/usr/local/lib/python3.8/site-packages/transformers/file_utils.py", line 1402, in cached_path output_path = get_from_cache( File "/usr/local/lib/python3.8/site-packages/transformers/file_utils.py", line 1620, in get_from_cache raise FileNotFoundError( FileNotFoundError: Cannot find the requested files in the cached path and outgoing traffic has been disabled. To enable model look-ups and downloads online, set 'local_files_only' to False. On 18 Oct 2021, at 13:29, Sander Tan ***@***.******@***.***>> wrote: Hi @piekvossen<https://github.com/piekvossen> , if the above command is the one you executed, I think it's missing the -v parameter to mount your local cache directory to the container's cache dir. Could you try: docker run \ -v /Users/piek/Desktop/r-COVID-19-TM/CovidHerstelZorg-ZonMW/data \ -v /Users/piek/.cache/huggingface/transformers:/root/.cache/huggingface/transformers/ \ -e TRANSFORMERS_OFFLINE=1 \ piekvossen/a-proof-icf-classifier --in_csv example/input.csv --text_col text — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub<#2 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AAUDKLAXMZTQEK3PUR27T3DUHQAKHANCNFSM5GF3CXBA>.