Code

Add FastSpeech2Conformer#23439

Code

Merged

ylacombe merged 56 commits intohuggingface:mainhuggingface/transformers:mainfrom connor-henderson:add-FastSpeech2Conformerconnor-henderson/transformers:add-FastSpeech2ConformerCopy head branch name to clipboardJan 3, 2024

+4,140-16

Commits

Commits on Jan 3, 2024

• start - docs, SpeechT5 copy and rename

  

  Connor Henderson

  committed
  9085cd1

  Copy full SHA for 9085cd1

• add relevant code from FastSpeech2 draft, have tests pass

  

  Connor Henderson

  committed
  f8dd82b

  Copy full SHA for f8dd82b

• make it an actual conformer, demo ex.

  

  Connor Henderson

  committed
  42b9207

  Copy full SHA for 42b9207

• matching inference with original repo, includes debug code

  

  Connor Henderson

  committed
  c504b7c

  Copy full SHA for c504b7c

• refactor nn.Sequentials, start more desc. var names

  

  Connor Henderson

  committed
  6cd5114

  Copy full SHA for 6cd5114

• more renaming

  

  Connor Henderson

  committed
  ecd73d4

  Copy full SHA for ecd73d4

• more renaming

  

  Connor Henderson

  committed
  228fb74

  Copy full SHA for 228fb74

• vocoder scratchwork

  

  Connor Henderson

  committed
  8e54eba

  Copy full SHA for 8e54eba

• matching vocoder outputs

  

  Connor Henderson

  committed
  b3506d9

  Copy full SHA for b3506d9

• hifigan vocoder conversion script

  

  Connor Henderson

  committed
  50757dc

  Copy full SHA for 50757dc

• convert model script, rename some config vars

  

  Connor Henderson

  committed
  67f5719

  Copy full SHA for 67f5719

• replace postnet with speecht5's implementation

  

  Connor Henderson

  committed
  98757ab

  Copy full SHA for 98757ab

• passing common tests, file cleanup

  

  Connor Henderson

  committed
  e5eb301

  Copy full SHA for e5eb301

• expand testing, add output hidden states and attention

  

  Connor Henderson

  committed
  c2a20cd

  Copy full SHA for c2a20cd

• tokenizer + passing tokenizer tests

  

  Connor Henderson

  committed
  6cd4bdd

  Copy full SHA for 6cd4bdd

• variety of updates and tests

  

  Connor Henderson

  committed
  666c89e

  Copy full SHA for 666c89e

• g2p_en pckg setup

  

  Connor Henderson

  committed
  388514e

  Copy full SHA for 388514e

• import structure edits

  

  Connor Henderson

  committed
  126cacc

  Copy full SHA for 126cacc

• docstrings and cleanup

  

  Connor Henderson

  committed
  5e4e5ec

  Copy full SHA for 5e4e5ec

• repo consistency

  

  Connor Henderson

  committed
  6723ad8

  Copy full SHA for 6723ad8

• deps

  

  Connor Henderson

  committed
  5e0310d

  Copy full SHA for 5e0310d

• small cleanup

  

  Connor Henderson

  committed
  66ec255

  Copy full SHA for 66ec255

• forward signature param order

  

  Connor Henderson

  committed
  1b694df

  Copy full SHA for 1b694df

• address comments except for masks and labels

  

  Connor Henderson

  committed
  380dc68

  Copy full SHA for 380dc68

• address comments on attention_mask and labels

  

  Connor Henderson

  committed
  8421963

  Copy full SHA for 8421963

• address second round of comments

  

  Connor Henderson

  committed
  3d2875c

  Copy full SHA for 3d2875c

• remove old unneeded line

  

  Connor Henderson

  committed
  f43eb6a

  Copy full SHA for f43eb6a

• address comments part 1

  

  Connor Henderson

  committed
  07b4d06

  Copy full SHA for 07b4d06

• address comments pt 2

  

  Connor Henderson

  committed
  bd1feb0

  Copy full SHA for bd1feb0

• rename auto mapping

  

  Connor Henderson

  committed
  e2cc85e

  Copy full SHA for e2cc85e

• fixes for failing tests

  

  Connor Henderson

  committed
  1475fca

  Copy full SHA for 1475fca

• address comments part 3 (bart-like, train loss)

  

  Connor Henderson

  committed
  c08f42d

  Copy full SHA for c08f42d

• make style

  

  Connor Henderson

  committed
  111f237

  Copy full SHA for 111f237

• pass config where possible

  

  Connor Henderson

  committed
  892d742

  Copy full SHA for 892d742

• add forward method + tests to WithHifiGan model

  

  Connor Henderson

  committed
  ae5df1c

  Copy full SHA for ae5df1c

• make style

  

  Connor Henderson

  committed
  5f255fc

  Copy full SHA for 5f255fc

• address arg passing and generate_speech comments

  

  Connor Henderson

  committed
  a8bad83

  Copy full SHA for a8bad83

• address Arthur comments

  

  Connor Henderson

  committed
  ec0f58f

  Copy full SHA for ec0f58f

• address Arthur comments pt2

  

  Connor Henderson

  committed
  8f52f85

  Copy full SHA for 8f52f85

• lint changes

  

  Connor Henderson

  committed
  4c7084b

  Copy full SHA for 4c7084b

• Sanchit comment

  

  Connor Henderson

  committed
  049b895

  Copy full SHA for 049b895

• add g2p-en to doctest deps

  

  Connor Henderson

  committed
  a7ac8c5

  Copy full SHA for a7ac8c5

• move up self.encoder

  

  Connor Henderson

  committed
  9bdbce7

  Copy full SHA for 9bdbce7

• onnx compatible tensor method

  

  Connor Henderson

  committed
  3938a6e

  Copy full SHA for 3938a6e

• fix is symbolic

  

  Connor Henderson

  committed
  e51ddac

  Copy full SHA for e51ddac

• fix paper url

  

  Connor Henderson

  committed
  be72e2d

  Copy full SHA for be72e2d

• move models to espnet org

  

  Connor Henderson

  committed
  30c0755

  Copy full SHA for 30c0755

• make style

  

  Connor Henderson

  committed
  ec8d670

  Copy full SHA for ec8d670

• make fix-copies

  

  Connor Henderson

  committed
  d4b4d20

  Copy full SHA for d4b4d20

• update docstring

  

  Connor Henderson

  committed
  e0aa017

  Copy full SHA for e0aa017

• Arthur comments

  

  Connor Henderson

  committed
  254aa60

  Copy full SHA for 254aa60

• update docstring w/ new updates

  

  Connor Henderson

  committed
  ff4e7ca

  Copy full SHA for ff4e7ca

• add model architecture images

  

  Connor Henderson

  committed
  4848d77

  Copy full SHA for 4848d77

• header size

  

  Connor Henderson

  committed
  efbdc71

  Copy full SHA for efbdc71

• md wording update

  

  Connor Henderson

  committed
  dd33c4b

  Copy full SHA for dd33c4b

• make style

  

  Connor Henderson

  committed
  91cf792

  Copy full SHA for 91cf792