-
-
Notifications
You must be signed in to change notification settings - Fork 112
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Not able to generate Hindi audio using xtts - xttsv2_2.0.3 #348
Comments
Tried French and English, both working. Hindi Not working. Please help.
|
tried updating tokenizer.py (alltalk_tts\system\ft_tokenizer). I manually updated the changes instead of replacing the file. Referred to the following for above change Still same issue. |
Hi @nitinmukesh Are you specifically attempting to use "Streaming"? I cannot say if the Coqui engine ever supported streaming with Hindi. No reason it should but I dont know if it does. Nonetheless, I tried some Devanagari script and it passed through fine on my PC. I also tried yours "नमस्ते! आज आप कैसे हैं?" and that passed through fine. My system that I tested on is a fresh install (shown below) and has all the following package versions (you can run diagnostics.log contents as of 16th Sept 2024
Bar something not installing correctly on your system, I am not sure what would cause this issue. Though, perhaps there are some system locale type issues as those can cause issues with how letters are sometimes interpreted https://learn.microsoft.com/en-us/windows-hardware/customize/desktop/unattend/microsoft-windows-international-core-winpe-systemlocale I suppose its possible that your system locale could cause an issue, but I would be unable to diagnose that for you. I assume you have done a full fresh installation of AllTalk V2 and not just copied over a V1 installation? You may wish to re-try setting up the Python environment. Finally, I am not the maintainer of the Coqui TTS engine, that is done by idiap and I can see they are working on additional Hindi support idiap/coqui-ai-TTS@1920328 though that update is not yet available. Thanks |
@nitinmukesh Further to this, while writing further documentation for V2 of AllTalk, I was looking over the V1 help and there is here https://github.com/erew123/alltalk_tts?tab=readme-ov-file#startup-performance-and-compatibility-issues As such, you need to load the 2.0.3 model as API mode. |
Thank you @erew123 Currently using Google TTS for Hindi. I will try the api one as suggested by you. Appreciate your guidance |
@nitinmukesh As mentioned above, you CAN use Hindi, if you load the XTTS 2.0.3 model as apitts (API mode) |
I did understood it and mentioned the same in my earlier response.
I should have mentioned apitts. Appreciate your guidance in making this work. Thank you |
Describe the bug
Trying to generate Hindi audio but it is coming up with error. English audio is successfully generated.
To Reproduce
Launch the UI and enter Hindi text in Text Input. Select xtts - xttsv2_2.0.3. Under Advanced settings > Select Language as Hi. Click Generate TTS.
Screenshots
N.A.
Text/logs
Desktop (please complete the following information):
AllTalk was updated: [approx. date]: 15th August 2024 at 08:27
Custom Python environment: [yes/no give details if yes] No
Text-generation-webUI was updated: [approx. date] It's beta version and upto date
Additional context
The text was updated successfully, but these errors were encountered: