Skip to content
This repository has been archived by the owner on Oct 31, 2023. It is now read-only.

WER mismatch in EN ASR model #28

Open
ankitapasad opened this issue Aug 19, 2021 · 0 comments
Open

WER mismatch in EN ASR model #28

ankitapasad opened this issue Aug 19, 2021 · 0 comments

Comments

@ankitapasad
Copy link

I am using the fine-tuned ASR EN models provided in the repo. I have two questions:

  1. The dict.en_char.txt file the downloaded model folder does not have an apostrophe symbol, whereas from what I understand in the paper apostrophes are retained. The numeral "1" though in the dict.en_char looks out of place, is that a typo?
  2. When I evaluate the EN model on the EN dev set (no language model) I get a WER of 13.9, as opposed to the published result of 15.5. For this part I replaced the "1" in the dict.en_char to an apostrophe "`". (note: I preprocessed the data to remove all punctuations except apostrophe).

Any insights on these issues are appreciated!

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant