TTS errors on message return from chatgpt #134910
Comments
|
Hey there @balloob, @synesthesiam, mind taking a look at this issue as it has been labeled with an integration ( Code owner commandsCode owners of
(message by CodeOwnersMention) wyoming documentation |
|
please also check and provide the logs of the piper add-on |
The piper stack trace above is from the piper addon logs. It doesn't say much more than that though. |
|
On further testing the wav is generated as expected but the device gives up before the audio is sent back to it. If you get chatgpt to give you a long response and you're running on less powerful hardware, it takes a while for it all to process so I'm guessing it really needs to wait longer for a response. |
|
Hi folks, forgive me if this is not the correct way to comms this but I figured I'd add to this post as opposed start a new one. If there are Mods who want to move or delete this, please feel free. I have the same error as @Moltenkore and under similar circumstances: TTS works for shorter requests via ChatGPT api but fails for longer responses - via Voice PE. Info1: at time of below request, CPU usage via Proxmox at 20.3%. Here is the debug log from Piper showing a failed request (apologies for length): SummaryThe story opens on a plantation called Tara, where Scarlett lives a privileged life as the daughter of a wealthy plantation owner. She is initially infatuated with Ashley Wilkes, who is about to marry his cousin, Melanie Hamilton. Heartbroken but resolute, Scarlett vows to win Ashley's heart. As the Civil War breaks out, the lives of these characters become increasingly intertwined amid the chaos of war. Themes and Messaging
End I hope this is useful and thanks to those who spend their time troubleshooting this stuff for free and to benefit the community. I appreciate that a Piper implementation for those who want a swift response to turning on a light may well have different requirements compared to those who want their voice PE to load in a novel in a .wav, and having an implementation that serves both purposes may be impossible! |
The problem
I'm using nabu preview edition and If I ask something that requires a longer output from chatgpt like "how much does a pulsar weigh?". It doesn't give a response and errors out.
It misunderstands what I'm saying each time but there is a response from chatgpt in the logs just no TTS answer.
(I'm using local piper set to en_GB alba medium and whisper.)
What version of Home Assistant Core has the issue?
core-2025.1.0
What was the last working version of Home Assistant Core?
No response
What type of installation are you running?
Home Assistant OS
Integration causing the issue
No response
Link to integration documentation on our website
No response
Diagnostics information
No response
Example YAML snippet
No response
Anything in the logs that might be useful for us?
Debug log:
2025-01-06 17:28:09.093 DEBUG (MainThread) [homeassistant.components.openai_conversation] Prompt: [stripped because massive prompt, I can reattach if needed] 2025-01-06 17:28:09.093 DEBUG (MainThread) [homeassistant.components.openai_conversation] Tools: [stripped too] 2025-01-06 17:28:10.414 DEBUG (MainThread) [homeassistant.components.openai_conversation] Response ChatCompletion(id='chatcmpl-anidofwhichihavenoideaifthisneedsstrippingbutwillanyway', choices=[Choice(finish_reason='stop', index=0, logprobs=None, message=ChatCompletionMessage(content='It seems like your question is unclear. Are you asking about the distance to the North or South Pole, or something else? Please provide more details.', role='assistant', function_call=None, tool_calls=None, refusal=None))], created=1736184489, model='gpt-4o-mini-2024-07-18', object='chat.completion', service_tier=None, system_fingerprint='fp_0aa8d3e20b', usage=CompletionUsage(completion_tokens=32, prompt_tokens=2478, total_tokens=2510, prompt_tokens_details={'cached_tokens': 0, 'audio_tokens': 0}, completion_tokens_details={'reasoning_tokens': 0, 'audio_tokens': 0, 'accepted_prediction_tokens': 0, 'rejected_prediction_tokens': 0})) 2025-01-06 17:28:15.517 ERROR (MainThread) [homeassistant] Error doing job: Exception in callback SpeechManager._async_get_tts_audio.<locals>.handle_error() at /usr/src/homeassistant/homeassistant/components/tts/__init__.py:844 (None) Traceback (most recent call last): File "/usr/local/lib/python3.13/asyncio/events.py", line 89, in _run self._context.run(self._callback, *self._args) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/src/homeassistant/homeassistant/components/tts/__init__.py", line 846, in handle_error if audio_task.exception(): ~~~~~~~~~~~~~~~~~~~~^^ File "/usr/src/homeassistant/homeassistant/components/tts/__init__.py", line 786, in get_tts_data extension, data = await engine_instance.internal_async_get_tts_audio( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ message, language, options ^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/src/homeassistant/homeassistant/components/tts/__init__.py", line 492, in internal_async_get_tts_audio return await self.async_get_tts_audio( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ message=message, language=language, options=options ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/src/homeassistant/homeassistant/components/wyoming/tts.py", line 126, in async_get_tts_audio event = await client.read_event() ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.13/site-packages/wyoming/client.py", line 25, in read_event return await async_read_event(self._reader) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.13/site-packages/wyoming/event.py", line 79, in async_read_event json_line = await reader.readline() ^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.13/asyncio/streams.py", line 562, in readline line = await self.readuntil(sep) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.13/asyncio/streams.py", line 677, in readuntil await self._wait_for_data('readuntil') File "/usr/local/lib/python3.13/asyncio/streams.py", line 539, in _wait_for_data await self._waiter asyncio.exceptions.CancelledErrorPiper logs:
ERROR:asyncio:Task exception was never retrieved future: <Task finished name='wyoming event handler' coro=<AsyncEventHandler.run() done, defined at /usr/local/lib/python3.11/dist-packages/wyoming/server.py:31> exception=BrokenPipeError(32, 'Broken pipe')> Traceback (most recent call last): File "/usr/local/lib/python3.11/dist-packages/wyoming_piper/handler.py", line 48, in handle_event return await self._handle_event(event) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/wyoming_piper/handler.py", line 114, in _handle_event await self.write_event( File "/usr/local/lib/python3.11/dist-packages/wyoming/server.py", line 29, in write_event await async_write_event(event, self.writer) File "/usr/local/lib/python3.11/dist-packages/wyoming/event.py", line 131, in async_write_event await writer.drain() File "/usr/lib/python3.11/asyncio/streams.py", line 378, in drain await self._protocol._drain_helper() File "/usr/lib/python3.11/asyncio/streams.py", line 167, in _drain_helper raise ConnectionResetError('Connection lost') ConnectionResetError: Connection lost During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.11/dist-packages/wyoming/server.py", line 41, in run if not (await self.handle_event(event)): ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/wyoming_piper/handler.py", line 50, in handle_event await self.write_event( File "/usr/local/lib/python3.11/dist-packages/wyoming/server.py", line 29, in write_event await async_write_event(event, self.writer) File "/usr/local/lib/python3.11/dist-packages/wyoming/event.py", line 131, in async_write_event await writer.drain() File "/usr/lib/python3.11/asyncio/streams.py", line 366, in drain raise exc File "/usr/lib/python3.11/asyncio/selector_events.py", line 1057, in write n = self._sock.send(data) ^^^^^^^^^^^^^^^^^^^^^ BrokenPipeError: [Errno 32] Broken pipeAdditional information
No response
The text was updated successfully, but these errors were encountered: