Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixed Beam Search Strategy and exposed whisper_pcm_to_mel_phase_vocoder #474

Merged
merged 1 commit into from
Feb 8, 2023

Conversation

sandrohanea
Copy link
Contributor

This commit addresses multiple issues.

  1. whisper_full_default_params is not returning the strategy defined in the parameter but the parameters are loaded for that one on line 2966.

  2. Encountered some index out of range during beam search on beam_candidates[cur_c] when all previous decoders have the same sum_logprobs_all. Fixed it with an additional check.

  3. whisper_pcm_to_mel_phase_vocoder is not exposed so it cannot be used to speed up auto-language detection in: Add lang auto-detection in a separate call. sandrohanea/whisper.net#1

@ggerganov
Copy link
Owner

Thanks for the fixes!
Pt. 2 needs to be fixes in a better way - I incorrectly assumed that the beam candidates are guaranteed to have different sum_logprobs_all. Will make a note to resolve this later

@ggerganov ggerganov merged commit 2bfe0eb into ggerganov:master Feb 8, 2023
rock3125 pushed a commit to rock3125/whisper.cpp that referenced this pull request Feb 21, 2023
…hase_vocoder (ggerganov#474)

Co-authored-by: Sandro Hanea <sandrohanea@microsoft.com>
anandijain pushed a commit to anandijain/whisper.cpp that referenced this pull request Apr 28, 2023
…hase_vocoder (ggerganov#474)

Co-authored-by: Sandro Hanea <sandrohanea@microsoft.com>
jacobwu-b pushed a commit to jacobwu-b/Transcriptify-by-whisper.cpp that referenced this pull request Oct 24, 2023
…hase_vocoder (ggerganov#474)

Co-authored-by: Sandro Hanea <sandrohanea@microsoft.com>
jacobwu-b pushed a commit to jacobwu-b/Transcriptify-by-whisper.cpp that referenced this pull request Oct 24, 2023
…hase_vocoder (ggerganov#474)

Co-authored-by: Sandro Hanea <sandrohanea@microsoft.com>
landtanin pushed a commit to landtanin/whisper.cpp that referenced this pull request Dec 16, 2023
…hase_vocoder (ggerganov#474)

Co-authored-by: Sandro Hanea <sandrohanea@microsoft.com>
iThalay pushed a commit to iThalay/whisper.cpp that referenced this pull request Sep 23, 2024
…hase_vocoder (ggerganov#474)

Co-authored-by: Sandro Hanea <sandrohanea@microsoft.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants