Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Voice chat with AI #519

Closed
an-lee opened this issue Apr 12, 2024 · 0 comments · Fixed by #898
Closed

Voice chat with AI #519

an-lee opened this issue Apr 12, 2024 · 0 comments · Fixed by #898
Assignees
Labels
enhancement New feature or request WIP Working in progress

Comments

@an-lee
Copy link
Collaborator

an-lee commented Apr 12, 2024

The main workflow:

  1. create a voice conversation;
  2. Click to start talking (it'll be recorded, auto stop if silent);
  3. Use STT service to transcribe;
  4. (Optional) if not speaking in English, translate the transcription to English;
  5. Confirm transcription (may edit) and send it out;
  6. Make AI's reponse to audio using TTS;
  7. Reply with the AI voice;

A few other things to consider:

  1. User may click to display AI message in text;
  2. User speak Chinese -> Transcribe -> Translate -> ( User speak again in English -> Transcribe )-> Send
@an-lee an-lee added the enhancement New feature or request label Apr 12, 2024
@an-lee an-lee self-assigned this Apr 12, 2024
@an-lee an-lee added the WIP Working in progress label May 13, 2024
@an-lee an-lee linked a pull request May 13, 2024 that will close this issue
@an-lee an-lee linked a pull request Jul 5, 2024 that will close this issue
@an-lee an-lee removed a link to a pull request Jul 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request WIP Working in progress
Projects
None yet
1 participant