Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SURT recipe for AMI and ICSI #1133

Merged
merged 48 commits into from
Jul 8, 2023
Merged

SURT recipe for AMI and ICSI #1133

merged 48 commits into from
Jul 8, 2023

Conversation

desh2608
Copy link
Collaborator

@desh2608 desh2608 commented Jun 15, 2023

This recipe has a dependency on #1126.

It trains a SURT model jointly on AMI and ICSI. We get the following results on utterance group based evaluation. SURT-base contains 26.7M params and SURT-large contains 37.9M params.

AMI

Model IHM-Mix SDM MDM
SURT-base 39.8 65.4 46.6
+ adapt 37.4 46.9 43.7
SURT-large 36.8 62.5 44.4
+ adapt 35.1 44.6 41.4

ICSI

Model IHM-Mix SDM
SURT-base 28.3 60.0
+ adapt 26.3 33.9
SURT-large 27.8 59.7
+ adapt 24.4 32.3

@desh2608 desh2608 changed the title [WIP] SURT recipe for AMI and ICSI SURT recipe for AMI and ICSI Jun 18, 2023
@desh2608 desh2608 added the ready label Jun 18, 2023
@desh2608
Copy link
Collaborator Author

desh2608 commented Jul 4, 2023

@yaozengwei Thanks for merging the LibriCSS recipe. This recipe follows the same idea, but it is for AMI and ICSI. Most files are symlinks of the ones in LibriCSS.

@yaozengwei
Copy link
Collaborator

@desh2608 Is it ready to merge?

@desh2608
Copy link
Collaborator Author

desh2608 commented Jul 8, 2023

@desh2608 Is it ready to merge?

Yes!

@yaozengwei yaozengwei merged commit 41b16d7 into k2-fsa:master Jul 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants