Skip to content

Comments

feat(stt): add base_url and language support for local whisper servers#616

Merged
bug-ops merged 1 commit intomainfrom
feat/stt-local-whisper-server
Feb 19, 2026
Merged

feat(stt): add base_url and language support for local whisper servers#616
bug-ops merged 1 commit intomainfrom
feat/stt-local-whisper-server

Conversation

@bug-ops
Copy link
Owner

@bug-ops bug-ops commented Feb 19, 2026

Summary

  • Add base_url and language fields to [llm.stt] config, enabling OpenAI-compatible local whisper servers (e.g. whisper.cpp) without requiring an OpenAI API key
  • Pass language parameter in Whisper API transcription requests for accurate non-English speech recognition
  • Preserve voice message attachments through drain_channel buffering so audio arriving during warmup is not lost
  • Add configurable language support for the candle-whisper backend
  • Document whisper.cpp server setup with Metal acceleration on macOS

Test plan

  • cargo +nightly fmt --check passes
  • cargo clippy --workspace -- -D warnings passes
  • cargo nextest run --workspace --lib --bins passes (2011 tests)
  • Manual test: Telegram voice message -> whisper.cpp server -> transcribed text -> agent response
  • Verified language parameter produces correct non-English transcription

Add base_url and language fields to SttConfig, allowing the Whisper STT
provider to target OpenAI-compatible local servers (e.g. whisper.cpp)
without requiring an OpenAI API key. Pass language parameter in
transcription requests for accurate non-English speech recognition.

Preserve voice message attachments through drain_channel buffering and
add configurable language support for the candle-whisper backend.
@github-actions github-actions bot added enhancement New feature or request size/L documentation Improvements or additions to documentation llm LLM provider related rust core and removed enhancement New feature or request size/L labels Feb 19, 2026
@bug-ops bug-ops enabled auto-merge (squash) February 19, 2026 21:16
@bug-ops bug-ops merged commit 0ba52ce into main Feb 19, 2026
22 checks passed
@bug-ops bug-ops deleted the feat/stt-local-whisper-server branch February 19, 2026 21:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

core documentation Improvements or additions to documentation llm LLM provider related rust

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant