Diarization endpoint

[benniekiss]

Is your feature request related to a problem? Please describe.

Currently, I dont believe there are any opensource API endpoints for a diarization pipeline. I think localAI adding one would fill a hole in the current offerings. The lack of such endpoints requires local use of AI models, disrupting an entirely remote, API driven workflow.

Describe the solution you'd like

Projects like NeMo, pyannote, and Diart offer diarization workflows that could be linked to an api endpoint to provide remote diarization.

Describe alternatives you've considered

Additional context

[mudler]

Really liking the idea, adding it to the roadmap 👍

[benniekiss]

I will try to implement this in the next few months. Pyannote now has an SDK for its cloud service, but I still have not found a local running API service.

My aim for the moment will be a /diarization endpoint to generate a diarization response (list of {speaker, start, stop} objects) and optionally a list of speaker embeddings. I may also try adding a /voiceprint endpoint to generate an embedding of an uploaded audio file.