Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Runtime exception when using along whisper-rs #484

Open
thewh1teagle opened this issue Aug 30, 2024 · 2 comments
Open

Runtime exception when using along whisper-rs #484

thewh1teagle opened this issue Aug 30, 2024 · 2 comments
Labels
🐛 bug something is broken

Comments

@thewh1teagle
Copy link
Contributor

thewh1teagle commented Aug 30, 2024

I use whisper-rs crate along with llama-cpp-rs and the program crash on

ctx.decode(&mut batch).expect("llama_decode() failed");

When not using whisper-rs it works but when adding it to the same project and import it, it crash.

This line cause the usage example in this repo to crash. without it works

use whisper_rs::{
    FullParams, SamplingStrategy, WhisperContext, WhisperContextParameters, WhisperState,
};

It doesn't just crash, but the process keep running (although it looks like it stopped in the terminal) and the GPU remain on 100%. I have to reboot after it.
I suspect that it's some conflicts with GGML.

OS: macOS 14.5
Hardware: mac mini m1

@MarcusDunn
Copy link
Contributor

duplicate of #263, keeping this open as it's definitely an issue, just not one I think we can solve.

@MarcusDunn MarcusDunn added the 🐛 bug something is broken label Aug 30, 2024
@thewh1teagle
Copy link
Contributor Author

duplicate of #263, keeping this open as it's definitely an issue, just not one I think we can solve.

I changed the features of both libraries to be identical (with whisper I had also coreml) and now it works.
So it's definitely conflicts with GGML.

I guess I'm lucky and the versions of GGML are identical currently so it works now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🐛 bug something is broken
Projects
None yet
Development

No branches or pull requests

2 participants