Code

[s2s] distill t5-large -> t5-small#8376

Code

Merged

sshleifer merged 25 commits intohuggingface:masterhuggingface/transformers:masterfrom sbhaktha:add_student_base_modelsbhaktha/transformers:add_student_base_modelCopy head branch name to clipboardNov 11, 2020

+108-67

Commits

Commits on Oct 13, 2020

• Implement student model using different base model

  sbhaktha

  committed
  1ff83eb

• changes

  sbhaktha

  committed
  758883a

• Merge branch 'master' of https://github.com/huggingface/transformers into add_student_base_model

  sbhaktha

  committed
  0ccf184

Commits on Oct 14, 2020

• Merging changes from master

  sbhaktha

  committed
  ddf4d5d

• Use teacher encoder outputs while calling teacher decoder

  sbhaktha

  committed
  ee878fe

Commits on Oct 16, 2020

• Merge branch 'master' of https://github.com/huggingface/transformers into add_student_base_model

  sbhaktha

  committed
  58a9a6e

• Return 0 tensor when hidden loss is not applicable, rename student_base_model cmd line argument to student, get rid of print statements.

  sbhaktha

  committed
  cfbc357

Commits on Nov 7, 2020

• Merge branch 'master' of https://github.com/huggingface/transformers into add_student_base_model

  sbhaktha

  committed
  73c0a54

• Do not create student model in eval mode

  sbhaktha

  committed
  8bc75fd

• Remove debug print

  sbhaktha

  committed
  708e457

Commits on Nov 9, 2020

• Fix bugs causing failed tests

  sbhaktha

  committed
  7bc3baa

• Adding unit tests. Including code refactor per request on PR.

  sbhaktha

  committed
  02fa544

• Merge branch 'master' of https://github.com/huggingface/transformers into add_student_base_model

  sbhaktha

  committed
  fb7a6f0

• Formatting changes per make fixup

  sbhaktha

  committed
  9432e67

• style

  sshleifer

  committed
  65945d7

Commits on Nov 10, 2020

• Selectively unpack teacher encoder output and hidden states

  sbhaktha

  committed
  937082e

• Merge branch 'master' of https://github.com/huggingface/transformers into add_student_base_model

  sbhaktha

  committed
  9f3bc7c

• Merge branch 'add_student_base_model' of https://github.com/sbhaktha/transformers into add_student_base_model

  sbhaktha

  committed
  65fc338

Commits on Nov 11, 2020

• Merge branch 'master' into add_student_base_model

  sshleifer

  committed
  d42ccbe

• style

  sshleifer

  committed
  2157d4d

• fixup

  sshleifer

  committed
  fcb2de3

• fixed return_dict issue

  sshleifer

  committed
  f7495de

• Merge branch 'master' into add_student_base_model

  sshleifer

  committed
  f313883

• style

  sshleifer

  committed
  26b3b91

• use_cache=False

  sshleifer

  committed
  9858290