Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

v0.5.0 #45

Merged
merged 36 commits into from
May 18, 2024
Merged

v0.5.0 #45

merged 36 commits into from
May 18, 2024

Conversation

R3gm
Copy link
Owner

@R3gm R3gm commented May 18, 2024

  • Added option Overlap Reduction
  • OpenAI API Key Integration for Transcription, translation, and TTS
  • More output types: subtitles by speaker, separate audio sound, and video only with subtitles
  • Access to a better-performing version of Whisper for transcribing speech.
  • Support for ASS subtitles and batch processing with subtitles
  • Vocal enhancement before transcription
  • Added CPU mode with app_rvc.py --cpu_mode
  • TTS now supports up to 12 speakers
  • OpenVoiceV2 integration for voice imitation
  • PDF to videobook (displays images from the PDF)
  • GUI language translation in Persian and Afrikaans
  • New Language Support:
    • Complete support: Estonian, Macedonian, Malay, Swahili, Afrikaans, Bosnian, Latin, Myanmar Burmese, Norwegian, Traditional Chinese, Assamese, Basque, Hausa, Haitian Creole, Armenian, Lao, Malagasy, Mongolian, Maltese, Punjabi, Pashto, Slovenian, Shona, Somali, Tajik, Turkmen, Tatar, Uzbek, and Yoruba
    • Non-transcription: Aymara, Bambara, Cebuano, Chichewa, Divehi, Dogri, Ewe, Guarani, Iloko, Kinyarwanda, Krio, Kurdish, Kirghiz, Ganda, Maithili, Oriya, Oromo, Quechua, Samoan, Tigrinya, Tsonga, Akan, and Uighur

R3gm added 30 commits March 15, 2024 17:27
@R3gm
Valid text srt
4291583
@R3gm
If only an SRT file is available, disable diarization
36bd2ab
@R3gm
Audio extensions
c529ed0
@R3gm
windows install
086088b
@R3gm
fix environment variable in windows #26
66f6fb9
@R3gm
windows install piper-tts
c408535
@R3gm
fix inference piper
e556feb
@R3gm
fix error aling
4160a58
@R3gm
conda cudnn
54165cd
@R3gm
option overlap reduction #18
c9ff269
@R3gm
fix format edge tts, fix excessive pad with overlap reduction
5998ca0
@R3gm
Added languages 1/2
3fe3bab
@R3gm
Added languages 2/2 (unidirectional)
b9b4cc3
@R3gm
perf: Improve translation accuracy
ad96bd2
@R3gm
feat(translation): Added gpt's api openai translation #30
108d10f
@R3gm
docs(Windows): Set openai api key
51f41d0
@R3gm
feat: python bindings, which allow it to be used without an interface…
576b4b8 
…, mainly for test purposes
@R3gm
feat(output type): Subtitles can be obtained for each speaker
021efd8
@R3gm
feat: Text segmentation: sentence, word or character
4765174
@R3gm
feat(transcription): fine-tuned Whisper models and adjustment of more…
bd30289 
… parameters
@R3gm
feat: ass subtitles, custom voices with extra settings #7
f8eae9b
@R3gm
feat: enhance vocals before transcription. New output type. Batch sub…
741b788 
…titles
@R3gm
perf(preprocessor): No format conversion needed for H.264, H.265, VP9…
d916723 
…, MPEG-4, MPEG-2 and MJPEG video files
@R3gm
feat: Set parameter --cpu_mode to use the CPU mode #39
bf199f2
@R3gm
feat(transcription): audio transcription generated by the OpenAI API
53e5f81
@R3gm
feat(tts): Added openai tts
ee60f34
@R3gm
refactor: custom voices without env var
14d4c3e
@R3gm
feat(diarization): 12 speakers #42
e466fd0
@R3gm
Addefeat(voice imitation): d OpenVoiceV2
36450b6
@R3gm
fix(tts): xtts output list to numpy array #42
53e3043
@R3gm R3gm merged commit ebea8b1 into main May 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@R3gm @robadugna2