Code

Try 1.6#1

Code

Open

zcain117 wants to merge 166 commits intomasterzcain117/transformers:masterfrom try-1.6zcain117/transformers:try-1.6Copy head branch name to clipboard

+16,418-6,859

Commits

Commits on Aug 12, 2020

• [s2s] add BartTranslationDistiller for distilling mBART (huggingface#6363)

  sshleifer

  authored
  f94a52c

• Get GKE logs via kubectl logs instead of gcloud logging read. (huggingface#6446)

  zcain117

  authored
  fd3de20

• [EncoderDecoder] Add encoder-decoder for roberta/ vanilla longformer (huggingface#6411)

  Show description for 0735def
  patrickvonplaten

  authored
  0735def

• add targets arg to fill-mask pipeline (huggingface#6239)

  Show description for bc82047
  joeddav

  authored
  bc82047

Commits on Aug 13, 2020

• cleanup tf unittests: part 2 (huggingface#6260)

  Show description for e983da0
  stas00

  authored
  e983da0

• Update README.md (huggingface#6435)

  Show description for 0ed7c00
  cedspam

  authored
  0ed7c00

• Fix docs and bad word tokens generation_utils.py (huggingface#6387)

  Show description for 9d94aec
  ZhuBaohe

  authored
  9d94aec

• typo fix (huggingface#6462)

  prajjwal1

  authored
  54c687e

• Test model outputs equivalence (huggingface#6445)

  Show description for f7cbc13
  LysandreJik

  authored
  f7cbc13

• add LongformerTokenizerFast in AutoTokenizer (huggingface#6463)

  patil-suraj

  authored
  a442f87

• add BartTokenizerFast in AutoTokenizer (huggingface#6464)

  Show description for f51161e
  

  patil-suraj

  and

  LysandreJik

  authored
  f51161e

• Add POS tagging and Phrase chunking token classification examples (huggingface#6457)

  Show description for eda07ef
  vblagoje

  authored
  eda07ef

• Mult rouge by 100: standard units (huggingface#6359)

  sshleifer

  authored
  e92efcf

• Clean directory after script testing (huggingface#6453)

  Show description for 7bc0056
  JetRunner

  authored
  7bc0056

• Fix typo (huggingface#6469)

  mrm8488

  authored
  05810cd

Commits on Aug 14, 2020

• MBartForConditionalGeneration (huggingface#6441)

  Show description for 680f133
  patil-suraj

  authored
  680f133

• Use hash to clean the test dirs (huggingface#6475)

  Show description for eb613b5
  JetRunner

  authored
  eb613b5

• [EncoderDecoder] Add Cross Attention for GPT2 (huggingface#6415)

  Show description for 1d6e71e
  

  patrickvonplaten

  and

  sgugger

  authored
  1d6e71e

• Sort unique_no_split_tokens to make it deterministic (huggingface#6461)

  Show description for 9a8c168
  lhoestq

  authored
  9a8c168

• Import accuracy_score (huggingface#6480)

  gijswijnholds

  authored
  b5ba758

• Generation doc (huggingface#6470)

  Show description for 895ed8f
  

  7 peopleauthored
  895ed8f

• Fix TPU Convergence bug introduced by PR#6151 (huggingface#6488)

  Show description for 24107c2
  jysohn23

  authored
  24107c2

Commits on Aug 16, 2020

• Add examples/bert-loses-patience who can help (huggingface#6499)

  JetRunner

  authored
  fe61c05

• Fixes paths with spaces in seq2seq example (huggingface#6493)

  KylePiira

  authored
  2060181

Commits on Aug 17, 2020

• [s2s] docs, document desired filenames nicely (huggingface#6525)

  sshleifer

  authored
  72add6c

• [lightning_base] fix s2s logging, only make train_loader once (huggingface#6404)

  sshleifer

  authored
  84c265f

• Update bert-base-portuguese-cased and bert-large-portuguese-cased model cards (huggingface#6527)

  Show description for 6d38ab1
  

  fabiocapsouza

  and

  Fabio Souza

  authored
  6d38ab1

• typos (huggingface#6505)

  stas00

  authored
  df15c7c

• Add Model Card for electra-base-german-uncased (huggingface#6496)

  Show description for 3c72f55
  

  PhilipMay

  and

  JetRunner

  authored
  3c72f55

• [doc] fix invalid env vars (huggingface#6504)

  Show description for 423eb5b
  stas00

  authored
  423eb5b

• Support additional dictionaries for BERT Japanese tokenizers (huggingface#6515)

  Show description for 48c6c61
  singletongue

  authored
  48c6c61

• Create model cards for indonesian models (huggingface#6522)

  Show description for 72911c8
  cahya-wirawan

  authored
  72911c8

• [doc] Summary of the models fixes (huggingface#6511)

  Show description for 49d8076
  stas00

  authored
  49d8076

• Remove deprecated assertEquals (huggingface#6532)

  Show description for 37709b5
  JetRunner

  authored
  37709b5

• fix pegasus doc (huggingface#6533)

  patrickvonplaten

  authored
  36010cb

• [testing] a new TestCasePlus subclass + get_auto_remove_tmp_dir() (huggingface#6494)

  Show description for 9dbe409
  stas00

  authored
  9dbe409

• [sched] polynomial_decay_schedule use default power=1.0 (huggingface#6473)

  stas00

  authored
  39c3b1d

• Fix flaky ONNX tests (huggingface#6531)

  mfuntowicz

  authored
  b41cc0b

• allow spaces in bash args with "$@" (huggingface#6521)

  sshleifer

  authored
  d2da2cb

• add custom datasets tutorial (huggingface#6466)

  Show description for d0c2389
  

  joeddav

  and

  sgugger

  authored
  d0c2389

• [doc] make the text more readable, fix some typos, add some disambiguation (huggingface#6508)

  Show description for 84d3331
  

  stas00

  and

  sgugger

  authored
  84d3331

• [BartTokenizer] add prepare s2s batch (huggingface#6212)

  Show description for 2a77813
  

  patil-suraj

  and

  sgugger

  authored
  2a77813

• [doc] multiple corrections to "Summary of the tasks" (huggingface#6509)

  Show description for b732e7e
  stas00

  authored
  b732e7e

• Fix CI

  sgugger

  committed
  7ca6ab6

• replace _ with __ rst links (huggingface#6541)

  stas00

  authored
  f68c873

• [Doc] add more MBart and other doc (huggingface#6490)

  Show description for c9564f5
  patil-suraj

  authored
  c9564f5

• [T5Tokenizer] add prepare_seq2seq_batch method (huggingface#6122)

  Show description for 407da12
  patil-suraj

  authored
  407da12

• [model_cards] Fix yaml for cedpsam/chatbot_fr

  julien-c

  committed
  07971d8

• [model_cards] Add a new model for Irish (huggingface#6544)

  jimregan

  authored
  3a30290

• [model_cards] Add model cards for Urduhack model (roberta-urdu-small) (huggingface#6536)

  Show description for 98ee802
  

  akkefa

  and

  julien-c

  authored
  98ee802

• Added first model card (huggingface#6530)

  Show description for 6314470
  

  onepointconsulting

  and

  julien-c

  authored
  6314470

• update with #s of sentences/tokens (huggingface#6546)

  jimregan

  authored
  fb7330b

Commits on Aug 18, 2020

• [marian] converter supports models from new Tatoeba project (huggingface#6342)

  sshleifer

  authored
  12d7624

• Fixed label datatype for STS-B (huggingface#6492)

  Show description for 5a81195
  amodaresi

  authored
  5a81195

• Small typo fixes for model card: electra-base-german-uncased (huggingface#6555)

  Show description for 1fdf372
  

  PhilipMay

  and

  julien-c

  authored
  1fdf372

• github: add @stefan-it to bug-report template for all token-classification related bugs (huggingface#6489)

  stefan-it

  authored
  cfa26d2

• fix incorrect codecov reports (huggingface#6553)

  Show description for 7659a8e
  stas00

  authored
  7659a8e

• [docs] Fix wrong newline in the middle of a paragraph (huggingface#6573)

  romainr

  authored
  5a5af22

• [docs] Fix number of 'ug' occurrences in tokenizer_summary (huggingface#6574)

  romainr

  authored
  7516bcf

• Create README.md (huggingface#6557)

  mrm8488

  authored
  1dfce0f

• Create README.md (huggingface#6556)

  mrm8488

  authored
  aaab9ab

• [Pegasus Doc] minor typo (huggingface#6579)

  Show description for fb6844a
  patil-suraj

  authored
  fb6844a

• update xnli-mt url (huggingface#6580)

  patil-suraj

  authored
  6f972e1

• [Model card] Bert2GPT2 EncoderDecoder model (huggingface#6569)

  Show description for 974bb4a
  patrickvonplaten

  authored
  974bb4a

• add BartConfig.force_bos_token_to_be_generated (huggingface#6526)

  Show description for 1529bf9
  

  sshleifer

  and

  sgugger

  authored
  1529bf9

Commits on Aug 19, 2020

• Fix bart base test (huggingface#6587)

  sshleifer

  authored
  ab42d74

• [EncoderDecoder] Add functionality to tie encoder decoder weights (huggingface#6538)

  Show description for fe0b85e
  

  patrickvonplaten

  and

  sgugger

  authored
  fe0b85e

• Feed forward chunking others (huggingface#6365)

  Show description for 2a7402c
  

  Pradhy729

  and

  patrickvonplaten

  authored
  2a7402c

• tf generation utils: remove unused kwargs (huggingface#6591)

  sshleifer

  authored
  9a86321

• fix model outputs test (huggingface#6593)

  patrickvonplaten

  authored
  8bcceac

• [BartTokenizerFast] add prepare_seq2seq_batch (huggingface#6543)

  patil-suraj

  authored
  7581884

• Fix huggingface#6575 (huggingface#6596)

  sgugger

  authored
  18ca0e9

Commits on Aug 20, 2020

• [cleanup] remove confusing newline (huggingface#6603)

  orena1

  authored
  93c5c9a

• Typo fix in 04-onnx-export (huggingface#6595)

  SidJain1412

  authored
  3c3c46f

• lighter 'make test' (huggingface#6512)

  stas00

  authored
  61b5ee1

• Docs copy button misses ... prefixed code (huggingface#6518)

  Show description for cabfdfa
  romainr

  authored
  cabfdfa

• removed redundant arg in prepare_inputs (huggingface#6614)

  Show description for 33bf426
  prajjwal1

  authored
  33bf426

• Fix CI

  sgugger

  committed
  b3e5469

• add intro to nlp lib & dataset links to custom datasets tutorial (huggingface#6583)

  Show description for 039d8d6
  joeddav

  authored
  039d8d6

• Add tests to Trainer (huggingface#6605)

  Show description for 573bdb0
  sgugger

  authored
  573bdb0

• TFTrainer dataset doc & fix evaluation bug (huggingface#6618)

  Show description for f9d280a
  joeddav

  authored
  f9d280a

• Add tests for Reformer tokenizer (huggingface#6485)

  D-Roberts

  authored
  c945450

• [Tests] fix attention masks in Tests (huggingface#6621)

  Show description for 505f2d7
  patrickvonplaten

  authored
  505f2d7

• XLNet Bug when training with apex 16-bit precision (huggingface#6567)

  Show description for 9539583
  

  johndolgov

  and

  JetRunner

  authored
  9539583

• Move threshold up for flaky test with Electra (huggingface#6622)

  Show description for e8af90c
  sgugger

  authored
  e8af90c

• One last threshold to raise

  sgugger

  committed
  86c07e6

• Regression test for pegasus bugfix (huggingface#6606)

  sshleifer

  authored
  5bf4465

• Trainer automatically drops unused columns in nlp datasets (huggingface#6449)

  Show description for e5f4522
  sgugger

  authored
  e5f4522

Commits on Aug 21, 2020

• Update ONNX doc to match the removal of --optimize argument.

  Show description for b105f2c
  mfuntowicz

  committed
  b105f2c

• model card for Spanish electra base (huggingface#6633)

  mrm8488

  authored
  efc7460

• Remove accidental comment (huggingface#6629)

  josephrocca

  authored
  bdf7e5d

• CamembertForCausalLM (huggingface#6577)

  Show description for d0e42a7
  patil-suraj

  authored
  d0e42a7

• [Docs model summaries] Add pegasus to docs (huggingface#6640)

  Show description for a4db4e3
  patrickvonplaten

  authored
  a4db4e3

• Add T5-11B disclaimer

  Show description for 9e8c494
  patrickvonplaten

  authored
  9e8c494

• [Doc model summary] add MBart model summary (huggingface#6649)

  patil-suraj

  authored
  cbda729

• Add model card for electricidad-base-generator (huggingface#6650)

  Show description for 0f94151
  mrm8488

  authored
  0f94151

Commits on Aug 22, 2020

• Correct bug in bert2bert-cnn_dailymail

  Show description for 97bb249
  patrickvonplaten

  authored
  97bb249

• added model_card for model codeswitch-hineng-lid-lince and codeswitch-spaeng-lid-lince (huggingface#6663)

  Show description for 068df74
  sagorbrur

  authored
  068df74

Commits on Aug 23, 2020

• Add Roberta2Roberta model card

  patrickvonplaten

  authored
  f235ee2

• new paper bibtex (huggingface#6656)

  sshleifer

  authored
  f230a64

• Add Roberta2Roberta shared

  patrickvonplaten

  authored
  16e3894

Commits on Aug 24, 2020

• added multiple model_cards for below models (huggingface#6666)

  Show description for a622705
  sagorbrur

  authored
  a622705

• Specify config filename (huggingface#6626)

  jarednielsen

  authored
  1a779ad

• Don't reset the dataset type + plug for rm unused columns (huggingface#6683)

  Show description for b30879f
  

  sgugger

  and

  TevenLeScao

  authored
  b30879f

• Missing commit

  sgugger

  committed
  0a850d2

• Fixed DataCollatorForLanguageModeling not accepting lists of lists (huggingface#6685)

  Show description for d329c9b
  TevenLeScao

  authored
  d329c9b

• Update repo to isort v5 (huggingface#6686)

  Show description for a573777
  sgugger

  authored
  a573777

• Fix PL token classification examples (huggingface#6682)

  vblagoje

  authored
  dd522da

• Add hyperparameter search to Trainer (huggingface#6576)

  Show description for 3a7fdd3
  

  3 peopleauthored
  3a7fdd3

• Lat fix for Ray HP search (huggingface#6691)

  sgugger

  authored
  8f98faf

• Create PULL_REQUEST_TEMPLATE.md (huggingface#6660)

  Show description for a8d6716
  

  stas00

  and

  JetRunner

  authored
  a8d6716

• remove BartForConditionalGeneration.generate (huggingface#6659)

  Show description for 912a21e
  stas00

  authored
  912a21e

• Move unused args to kwargs (huggingface#6694)

  sgugger

  authored
  6b4c617

• [fixdoc] Add import to pegasus usage doc (huggingface#6698)

  sshleifer

  authored
  0ebc969

Commits on Aug 25, 2020

• Fix hyperparameter_search doc (huggingface#6695)

  sgugger

  authored
  d20cbb8

• Add model card for singbert. (huggingface#6674)

  Show description for b6512d2
  

  zyuanlim

  and

  JetRunner

  authored
  b6512d2

• [s2s] round bleu, rouge to 4 digits (huggingface#6704)

  sshleifer

  authored
  0344428

• Remove hard-coded uses of float32 to fix mixed precision use (huggingface#6648)

  schmidek

  authored
  4fca874

• Add DPR to models summary (huggingface#6690)

  Show description for 0f16dd0
  

  lhoestq

  and

  sgugger

  authored
  0f16dd0

• Add typing.overload for convert_ids_tokens (huggingface#6637)

  Show description for 841f071
  tamuhey

  authored
  841f071

• Allow tests in examples to use cuda or fp16,if they are available (huggingface#5512)

  Show description for 4db2fa7
  Joel-hanson

  authored
  4db2fa7

• add new line to make examples run (huggingface#6706)

  sshleifer

  authored
  a99d09c

• Use generators tqdm progressbars (huggingface#6696)

  sgugger

  authored
  f5bad03

• More tests to Trainer (huggingface#6699)

  Show description for abc0202
  sgugger

  authored
  abc0202

• Add tokenizer to Trainer (huggingface#6689)

  sgugger

  authored
  124c3d6

• tensor.nonzero() is deprecated in PyTorch 1.6 (huggingface#6715)

  Show description for 625318f
  mfuntowicz

  authored
  625318f

• Selected typo fix (huggingface#6687)

  arnavsharma93

  authored
  a25c9fc

• add missing keys (huggingface#6719)

  patrickvonplaten

  authored
  d17cce2

• Create README.md (huggingface#6721)

  Show description for 0743403
  zyuanlim

  authored
  0743403

• Fix ONNX test_quantize unittest (huggingface#6716)

  mfuntowicz

  authored
  ac9702c

• [squad] make examples and dataset accessible from SquadDataset object (huggingface#6710)

  Show description for 7e6397a
  

  Tomo Lazovich

  authored
  7e6397a

• Fix pegasus-xsum integration test (huggingface#6726)

  sshleifer

  authored
  e11d923

• T5Tokenizer adds EOS token if not already added (huggingface#5866)

  Show description for 6244957
  

  sshleifer

  and

  sgugger

  authored
  6244957

• Install nlp for github actions test (huggingface#6728)

  sgugger

  authored
  64c7c2b

Commits on Aug 26, 2020

• fix torchscript docs (huggingface#6740)

  patrickvonplaten

  authored
  fa8ee8e

• Add "tie_word_embeddings" config param (huggingface#6692)

  Show description for 925f34b
  patrickvonplaten

  authored
  925f34b

• Fix tf boolean mask in graph mode (huggingface#6741)

  JayYip

  authored
  461ae86

• Centralize logging (huggingface#6434)

  Show description for 77abd1e
  

  LysandreJik

  and

  sgugger

  authored
  77abd1e

• Fix optimizer (huggingface#6717)

  jplu

  authored
  02e8cd5

• isort 5

  LysandreJik

  committed
  e78c110

• Black 20 release

  LysandreJik

  committed
  a75c64d

• [TF Longformer] Improve Speed for TF Longformer (huggingface#6447)

  Show description for 858b7d5
  patrickvonplaten

  authored
  858b7d5

• add xlm-roberta-large-xnli model card (huggingface#6723)

  Show description for 99407f9
  joeddav

  authored
  99407f9

• [model_cards] Fix tiny typos

  julien-c

  committed
  3242e4d

• Adding model cards for 5 models (huggingface#6703)

  Show description for baeba53
  

  AMontgomerie

  and

  julien-c

  authored
  baeba53

• Create model card for lordtt13/COVID-SciBERT (huggingface#6718)

  lordtt13

  authored
  e10fb9c

• added model card for codeswitch-spaeng-sentiment-analysis-lince (huggingface#6727)

  Show description for cc4ba79
  sagorbrur

  authored
  cc4ba79

• Model card for kuisailab/albert-base-arabic (huggingface#6729)

  Show description for 70c96a1
  alisafaya

  authored
  70c96a1

• Model card for kuisailab/albert-xlarge-arabic (huggingface#6731)

  Show description for 8e0d51e
  alisafaya

  authored
  8e0d51e

• Model card for kuisailab/albert-large-arabic (huggingface#6730)

  Show description for 61b9ed8
  alisafaya

  authored
  61b9ed8

• add __init__.py to utils (huggingface#6754)

  joeddav

  authored
  10a3450

• Model Card for Multilingual Passage Reranking BERT (huggingface#6755)

  iglimanaj

  authored
  434936f

• [s2s] run_eval.py QOL improvements and cleanup(huggingface#6746)

  sshleifer

  authored
  61518e2

Commits on Aug 27, 2020

• create ProtBert-BFD model card. (huggingface#6724)

  agemagician

  authored
  05e7150

• s2s distillation uses AutoModelForSeqToSeqLM (huggingface#6761)

  sshleifer

  authored
  4bd7be9

• Add AdaFactor optimizer from fairseq (huggingface#6722)

  Show description for 971d180
  

  3 peopleauthored
  971d180

• Adafactor docs (huggingface#6765)

  LysandreJik

  authored
  41aa2b4

• Fix the TF Trainer gradient accumulation and the TF NER example (huggingface#6713)

  Show description for 6f289dc
  jplu

  authored
  6f289dc

• Format

  LysandreJik

  committed
  0d2c111

• Fix it to work with BART (huggingface#6756)

  tomgrek

  authored
  c225e87

• add nlp install (huggingface#6767)

  sshleifer

  authored
  9d1b4db

• [testing] replace hardcoded paths to allow running tests from anywhere (huggingface#6523)

  Show description for e6b811f
  stas00

  authored
  e6b811f

• [test schedulers] adjust to test the first step's reading (huggingface#6429)

  Show description for dbfe34f
  stas00

  authored
  dbfe34f

• new Makefile target: docs (huggingface#6510)

  Show description for 70fccc5
  stas00

  authored
  70fccc5

• Format

  LysandreJik

  committed
  42fddac

• try running existing circleci

  zcain117

  committed
  fd8b1b3