Code

Replace swish with silu#8166

Code

Merged

LysandreJik merged 11 commits intohuggingface:masterhuggingface/transformers:masterfrom TFUsers:masterTFUsers/transformers:masterCopy head branch name to clipboardOct 30, 2020

+56-37

Commits

Commits on Oct 30, 2020

• Replace swish with silu

  

  TFUsers

  authored and

  TFUsers

  committed
  1d7dacf

  Copy full SHA for 1d7dacf

• revert nn.silu to nn.swish due to older version

  TFUsers

  authored
  3822b99

  Copy full SHA for 3822b99

• simplify optimized silu conditional and fix format

  TFUsers

  authored
  f6f137c

  Copy full SHA for f6f137c

• Update activations.py

  TFUsers

  authored
  a39984a

  Copy full SHA for a39984a

• Update activations_tf.py

  TFUsers

  authored
  14f70c6

  Copy full SHA for 14f70c6

• Update modeling_flax_utils.py

  TFUsers

  authored
  b4ed202

  Copy full SHA for b4ed202

• Update modeling_openai.py

  TFUsers

  authored
  1727e2f

  Copy full SHA for 1727e2f

• add swish testcase

  TFUsers

  authored
  f25badb

  Copy full SHA for f25badb

• add pytorch swish testcase

  TFUsers

  authored
  003c9ee

  Copy full SHA for 003c9ee

• Add more robust python version check

  TFUsers

  authored
  6c3baad

  Copy full SHA for 6c3baad

• more formatting fixes

  TFUsers

  authored
  47af0a0

  Copy full SHA for 47af0a0