Any recent changes to torch?

[anuragkumar95]

Running into this error.

Environment: docker container python3.7
Command: genienlp train args...

root@5da4bac83a79:/var/app# Traceback (most recent call last):
  File "/usr/local/bin/genienlp", line 5, in <module>
    from genienlp.__main__ import main
  File "/usr/local/lib/python3.7/site-packages/genienlp/__main__.py", line 33, in <module>
    from . import arguments, train, predict, server, cache_embeddings, export
  File "/usr/local/lib/python3.7/site-packages/genienlp/arguments.py", line 39, in <module>
    from .paraphrase.transformers_utils import BART_MODEL_LIST, MBART_MODEL_LIST, MT5_MODEL_LIST
  File "/usr/local/lib/python3.7/site-packages/genienlp/paraphrase/transformers_utils.py", line 7, in <module>
    from transformers import LogitsProcessorList
  File "/usr/local/lib/python3.7/site-packages/transformers/__init__.py", line 626, in <module>
    from .trainer import Trainer
  File "/usr/local/lib/python3.7/site-packages/transformers/trainer.py", line 69, in <module>
    from .trainer_pt_utils import (
  File "/usr/local/lib/python3.7/site-packages/transformers/trainer_pt_utils.py", line 40, in <module>
    from torch.optim.lr_scheduler import SAVE_STATE_WARNING
ImportError: cannot import name 'SAVE_STATE_WARNING' from 'torch.optim.lr_scheduler' (/usr/local/lib/python3.7/site-packages/torch/optim/lr_scheduler.py)

[valkjsaaa]

I think you need to use PyTorch before 1.8.0: huggingface/transformers#8979

[s-jse]

Which version of pytorch and transformers do you have installed? We run genienlp tests with pytorch 1.7.1 and transformers 4.4.

[anuragkumar95]

As I build the container, I install genienlp using
pip install genienlp

Is the dependency not handled in the setup?

[s-jse]

If you install genienlp from pip, it will install genienlp v0.5, which had torch~=1.6 and transformers==4.0 in its requirements. I think if you install it now, it will install pytorch 1.8 and the old version of transformers (4.0) which are not compatible.
You can either install the new genienlp from source by cloning the code, or manually install the old pytorch (1.6) in your docker container after installing genienlp.

@gcampax are we planning to release genienlp v0.6 on PyPI?

[gcampax]

We need to switch to bootleg 1.* before we can release on pypi, because pypi will reject the git dependency otherwise

[Mehrad0711]

Fixed in latest release (0.6.0)