Code

Add SiLU activation function#915

Code

Draft

swfsql wants to merge 9 commits intocoreylowman:maincoreylowman/dfdx:mainfrom swfsql:siluswfsql/dfdx:siluCopy head branch name to clipboard

+202-54

Commits

Commits on Jan 26, 2024

• remove deprecated ftz intrinsics

  rainiwu

  committed
  5c532ec

  Copy full SHA for 5c532ec

• suppress spurious cargo clippy warning

  rainiwu

  committed
  fb91f13

  Copy full SHA for fb91f13

Commits on Feb 7, 2024

• Merge pull request #1 from rainiwu/remove-ftz

  Show description for 24a8593
  swfsql

  authored
  24a8593

  Copy full SHA for 24a8593

Commits on Feb 9, 2024

• avoid conv1d bound for cudnn

  swfsql

  committed
  4e3f7c7

  Copy full SHA for 4e3f7c7

• bump gemm

  swfsql

  committed
  a8bc54c

  Copy full SHA for a8bc54c

• clippy fix

  swfsql

  committed
  557687c

  Copy full SHA for 557687c

Commits on Mar 1, 2024

• Merge pull request #2 from swfsql/avoid-ci-errors

  Show description for 1175903
  swfsql

  authored
  1175903

  Copy full SHA for 1175903

• add SiLU activation function

  swfsql

  committed
  ff9cc12

  Copy full SHA for ff9cc12

• silu: fix cpu df

  swfsql

  committed
  bc569c7

  Copy full SHA for bc569c7