Update transformers requirement from <3.6,>=3.4 to >=3.4,<4.3

[dependabot]

Updates the requirements on transformers to permit the latest version.

Release notes

Sourced from transformers's releases.

v4.2.0: LED from AllenAI, Generation Scores, TensorFlow 2x speedup, faster import

v4.2.0: LED from AllenAI, encoder-decoder templates, fast imports

LED from AllenAI (@patrickvonplaten)

Four new models are released as part of the LED implementation: LEDModel, LEDForConditionalGeneration, LEDForSequenceClassification, LEDForQuestionAnswering, in PyTorch. The first two models have a TensorFlow version.

LED is the encoder-decoder variant of the Longformer model by allenai.

The LED model was proposed in Longformer: The Long-Document Transformer by Iz Beltagy, Matthew E. Peters, Arman Cohan.

Compatible checkpoints can be found on the Hub: https://huggingface.co/models?filter=led

Available notebooks:

• Evaluation: https://colab.research.google.com/drive/12INTTR6n64TzS4RrXZxMSXfrOd9Xzamo?usp=sharing
• Finetuning: https://colab.research.google.com/drive/12LjJazBl7Gam0XBPy_y0CTOJZeZ34c2v?usp=sharing

Contributions:

• LED #9278 (@patrickvonplaten)
• [LED Test] fix common inputs pt for flaky pt-tf led test #9459 (@SBrandeis, @patrickvonplaten)
• [TF Led] Fix flaky TF Led test #9513 (@patrickvonplaten)

Generation Scores & other outputs (@patrickvonplaten)

The PyTorch generation function now allows to return:

• scores - the logits generated at each step
• attentions - all attention weights at each generation step
• hidden_states - all hidden states at each generation step

by simply adding return_dict_in_generate to the config or as an input to .generate()

Tweet:

• https://twitter.com/SimonBrandeis/status/1346858472000937984

Notebooks for a better explanation:

• https://discuss.huggingface.co/t/announcement-generationoutputs-scores-attentions-and-hidden-states-now-available-as-outputs-to-generate/3094/2
• https://discuss.huggingface.co/t/generation-probabilities-how-to-compute-probabilities-of-output-scores-for-gpt2/3175

PR:

• Add flags to return scores, hidden states and / or attention weights in GenerationMixin #9150 (@SBrandeis)

TensorFlow improvements

TensorFlow BERT-like model improvements (@jplu)

The TensorFlow version of the BERT-like models have been updated and are now twice as fast as the previous versions.

• Improve BERT-like models performance with better self attention #9124 (@jplu)

... (truncated)

Commits

• 7d9a9d0 Release: v4.2.0
• c949516 Fix slow tests v4.2.0 (#9561)
• 04dc65e Fix data parallelism in Trainer (#9566)
• b2dfcc5 use correct deps for torchhub (#9552)
• eabad8f Update run_glue for do_predict with local test data (#9442) (#9486)
• 0c9f01a Speed up TopKLogitsWarper and TopPLogitsWarper (pytorch) (#9557)
• 27d0e01 Fix classification script: enable dynamic padding with truncation (#9554)
• 245cdb4 Fix barthez tokenizer (#9562)
• 247a7b2 Doc: Update pretrained_models wording (#9545)
• 69ed360 fix BlenderbotSmallTokenizer (#9538)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

[dependabot]

Superseded by #10.