feat(stt): added Canary-1B STT model support and listing STT models

[mahimairaja]

What does this PR does?

This PR adds the #167

1. This pull request has added the capability to use NVIDIA's Canary 1B STT model. Canary supported (English, German, French, and Spanish). get_stt_model("canary/1b", lang="en" )
2. Also added a function list_stt_models which allows listing all available Speech-to-Text (STT) models in the FastRTC library.

Implementation

Use have to install canary as extra

$ uv add fastrtc"[stt-canary]"

Sample Code

from fastrtc import (ReplyOnPause, Stream, get_stt_model, get_tts_model, list_stt_models)
from groq import Groq

print(f"Available STT models: {list_stt_models()}")  
# Available STT models: ['moonshine/base', 'moonshine/tiny', 'canary/1b']

client = Groq()

stt_model = get_stt_model(
                        "canary/1b",
                        lang="en"  # Optional, defaults to "en"
                    )
tts_model = get_tts_model()

def echo(audio):
    prompt = stt_model.stt(audio)

    response = (
        client.chat.completions.create(
            model="llama-3.1-8b-instant",
            max_tokens=200,
            messages=[
                    {"role": "system", "content": "You are a helpful assistant."},
                    {"role": "user", "content": prompt}
                ]
        )
        .choices[0]
        .message.content
    )

    for audio_chunk in tts_model.stream_tts_sync(response):
        yield audio_chunk

stream = Stream(ReplyOnPause(echo), modality="audio", mode="send-receive")

stream.ui.launch()

[freddyaboulton]

Awesome! Can you publish as an independent package (maybe fastrtc-canary) and then we can add to a (to be created) Text-to-Speech gallery in the docs.

[freddyaboulton]

This is great work I just don't want to have to add a different optional dependency for each possible model.

[mahimairaja]

Sure! will make it

[mahimairaja]

@freddyaboulton So are we making a entirely new package, which is not in this repo?

Technically we will import from entirely new package?

from fastrtc_canary import get_stt_model

. . .

Is this what you mention?

[freddyaboulton]

Yes that is what I mean

[mahimairaja]

Okay!

[mahimairaja]

Will make a new repo for this package later part of this week

[freddyaboulton]

Awesome!

[mahimairaja]

Hi @freddyaboulton

Please have a look at this - https://pypi.org/project/fastrtc_canary/

https://github.com/mahimairaja/fastrtc-canary