Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bugfix: Illogical "Avoid computing higher temperatures on no_speech" #625

Closed
wants to merge 3 commits into from
Closed

Conversation

Purfview
Copy link
Contributor

@Purfview Purfview commented Dec 21, 2023

Fixing: #621
Regression since PR: #225

The bug: It's "silence" when decoding has failed due to compression_ratio_threshold [+no_speech_threshold] in #225, when further down the code it's not "silence" anymore.

"Silence" should be only when decoding has failed due to log_prob_threshold [+no_speech_threshold].
As described there:

no_speech_threshold: If the no_speech probability is higher than this value AND
the average log probability over sampled tokens is below `log_prob_threshold`,
consider the segment as silent.

The bug opens the gates for the hallucination loops.

Fixing: #621
Regression since PR: #225

**The bug**: It's "silence" when decoding has failed due to `compression_ratio_threshold` [+no_speech_threshold] in #225, when further down the code it's not "silence" anymore.

"Silence" should be only when decoding has failed due to `log_prob_threshold`  [+no_speech_threshold].
@Purfview Purfview closed this by deleting the head repository Jan 23, 2024
@arabcoders
Copy link

@Purfview any reason you decided to close this issue? i am using your patch and it's improving the output result

@Purfview
Copy link
Contributor Author

@Purfview any reason you decided to close this issue? i am using your patch and it's improving the output result

Oh, I forgot about this PR and deleted it.
Here I created it again it -> #652

@nguyendc-systran
Copy link
Collaborator

Thanks @Purfview for the fix, this explanation makes sens for me.
I will merge it now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants