-
Notifications
You must be signed in to change notification settings - Fork 2.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add stochastic depth to conformer and share results on LibriSpeech 960h #4142
Conversation
Full results are coming soon. (Some decoding jobs are still running) |
Codecov Report
@@ Coverage Diff @@
## master #4142 +/- ##
==========================================
+ Coverage 80.43% 80.46% +0.02%
==========================================
Files 442 442
Lines 38557 38562 +5
==========================================
+ Hits 31015 31027 +12
+ Misses 7542 7535 -7
Flags with carried forward coverage won't be shown. Click here to find out more.
Continue to review full report at Codecov.
|
How many parameters does the model have? |
I have updated the decoding results and also uploaded models to huggingface. Please review the changes. |
Hi, in this PR, I added stochastic depth to
conformer_encoder
so that layer dropout can be used. I am also sharing two configs (with and without layer dropout) and their results for LibriSpeech 960h. As mentioned previously, the results are better than the current ones.