TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'

[dpgh947]

I keep getting these errors which I think might be related to issue 436, I put a comment on that which I thought would re-open it, but it didn't... #436 (comment)

This error originated from a custom integration.

Logger: custom_components.wiser.coordinator
Source: custom_components/wiser/coordinator.py:198
integration: Drayton Wiser Integration for Home Assistant (documentation, issues)
First occurred: 16:12:54 (8 occurrences)
Last logged: 16:41:16

Unknown error fetching wiser (wiser-WiserHeat061012) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. Please report this error to the integration owner
Unknown error fetching wiser (wiser-WiserHeat061012) data. [Errno 104] Connection reset by peer. Please report this error to the integration owner

[asantaga]

ive checked my logs and I dont have this error. I think these errors occur when there is a comms issue, ie unable to connect to the hub.

How often is it happening?

I'll speak to Mark and look to trapping this error (TransderEncodingError) and then print out debug messages..

[dpgh947]

It's a strange one. I've seen them occasionally for a while. However, I swapped the hub yesterday, set the new one up from scratch to look (I thought) exactly like the old one, and I was getting this error every few minutes, sometimes on every poll by the integration (so every 30 secs), but other than seeing this in the log, everything in HA looked fine. Then this morning I updated the hot water schedule (just added a couple of extra "on" periods as we have guests staying this weekend), and the errors have stopped - for now anyway. Here is the end of my current log for example (it is now 10:36 as I type this, so no errors since 9:42)

2024-05-26 08:36:13.496 ERROR (MainThread) [custom_components.wiser.coordinator] Unknown error fetching wiser (wiser-WiserHeat061012) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. Please report this error to the integration owner
2024-05-26 08:36:50.502 ERROR (MainThread) [custom_components.wiser.coordinator] Unknown error fetching wiser (wiser-WiserHeat061012) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. Please report this error to the integration owner
2024-05-26 08:40:14.648 ERROR (MainThread) [custom_components.wiser.coordinator] Unknown error fetching wiser (wiser-WiserHeat061012) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. Please report this error to the integration owner
2024-05-26 08:44:18.349 ERROR (MainThread) [custom_components.wiser.coordinator] Unknown error fetching wiser (wiser-WiserHeat061012) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. Please report this error to the integration owner
2024-05-26 08:45:04.173 ERROR (MainThread) [custom_components.wiser.coordinator] Unknown error fetching wiser (wiser-WiserHeat061012) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. Please report this error to the integration owner
2024-05-26 08:48:54.491 ERROR (MainThread) [custom_components.wiser.coordinator] Unknown error fetching wiser (wiser-WiserHeat061012) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. Please report this error to the integration owner
2024-05-26 08:54:10.514 ERROR (MainThread) [custom_components.wiser.coordinator] Unknown error fetching wiser (wiser-WiserHeat061012) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. Please report this error to the integration owner
2024-05-26 08:55:19.537 ERROR (MainThread) [custom_components.wiser.coordinator] Unknown error fetching wiser (wiser-WiserHeat061012) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. ConnectionResetError(104, 'Connection reset by peer'). Please report this error to the integration owner
2024-05-26 08:55:58.700 ERROR (MainThread) [custom_components.wiser.coordinator] Unknown error fetching wiser (wiser-WiserHeat061012) data. [Errno 104] Connection reset by peer. Please report this error to the integration owner
2024-05-26 08:57:18.471 ERROR (MainThread) [custom_components.wiser.coordinator] Unknown error fetching wiser (wiser-WiserHeat061012) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. Please report this error to the integration owner
2024-05-26 09:11:17.842 ERROR (MainThread) [custom_components.wiser.coordinator] Unknown error fetching wiser (wiser-WiserHeat061012) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. ConnectionResetError(104, 'Connection reset by peer'). Please report this error to the integration owner
2024-05-26 09:20:27.418 ERROR (MainThread) [custom_components.wiser.coordinator] Unknown error fetching wiser (wiser-WiserHeat061012) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. Please report this error to the integration owner
2024-05-26 09:31:32.201 ERROR (MainThread) [custom_components.wiser.coordinator] Unknown error fetching wiser (wiser-WiserHeat061012) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. Please report this error to the integration owner
2024-05-26 09:33:15.319 ERROR (MainThread) [custom_components.wiser.coordinator] Unknown error fetching wiser (wiser-WiserHeat061012) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. Please report this error to the integration owner
2024-05-26 09:42:35.054 ERROR (MainThread) [custom_components.wiser.coordinator] Unknown error fetching wiser (wiser-WiserHeat061012) data. [Errno 104] Connection reset by peer. Please report this error to the integration owner

[dpgh947]

Ok ignore that, it has started again an hour later.

[dpgh947]

Here's another excerpt with a single error I had at 11:59 while debug was on. It seems to be retrieving all info despite the reported error...

2024-05-26 11:58:30.935 DEBUG (MainThread) [custom_components.wiser.switch] Wiser firestick Switch switch update requested
2024-05-26 11:58:30.935 DEBUG (MainThread) [custom_components.wiser.switch] Wiser firestick Away Mode Turns Off switch update requested
2024-05-26 11:58:30.935 DEBUG (MainThread) [custom_components.wiser.select] Wiser Hot Water Mode updating
2024-05-26 11:58:30.936 DEBUG (MainThread) [custom_components.wiser.select] Wiser laptop charger Mode updating
2024-05-26 11:58:30.936 DEBUG (MainThread) [custom_components.wiser.select] Wiser firestick Mode updating
2024-05-26 11:58:30.936 DEBUG (MainThread) [custom_components.wiser.number] Wiser Away Mode Target Temperature updating
2024-05-26 11:58:30.937 DEBUG (MainThread) [custom_components.wiser.climate] Wiser Dining room updating
2024-05-26 11:59:17.375 ERROR (MainThread) [custom_components.wiser.coordinator] Unknown error fetching wiser (wiser-WiserHeat061012) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>.  Please report this error to the integration owner
2024-05-26 11:59:17.377 DEBUG (MainThread) [custom_components.wiser.coordinator] Finished fetching wiser (wiser-WiserHeat061012) data in 17.053 seconds (success: True)
2024-05-26 11:59:17.377 DEBUG (MainThread) [custom_components.wiser.climate] Wiser Lounge updating
2024-05-26 11:59:17.381 DEBUG (MainThread) [custom_components.wiser.climate] Wiser Bedroom updating
2024-05-26 11:59:17.385 DEBUG (MainThread) [custom_components.wiser.climate] Wiser Guest bedroom updating
2024-05-26 11:59:17.388 DEBUG (MainThread) [custom_components.wiser.climate] Wiser Theo bedroom updating
2024-05-26 11:59:17.391 DEBUG (MainThread) [custom_components.wiser.climate] Wiser Noah bedroom updating
2024-05-26 11:59:17.392 DEBUG (MainThread) [custom_components.wiser.sensor] Wiser HeatHub Signal device update requested
2024-05-26 11:59:17.392 DEBUG (MainThread) [custom_components.wiser.sensor] Wiser HeatHub Signal device state requested

For info, this is what a similar piece of log without the error looks like:

2024-05-26 12:00:18.341 DEBUG (MainThread) [custom_components.wiser.switch] Wiser laptop charger Identify switch update requested
2024-05-26 12:00:18.341 DEBUG (MainThread) [custom_components.wiser.switch] Wiser firestick Identify switch update requested
2024-05-26 12:00:18.342 DEBUG (MainThread) [custom_components.wiser.switch] Wiser laptop charger Switch switch update requested
2024-05-26 12:00:18.342 DEBUG (MainThread) [custom_components.wiser.switch] Wiser laptop charger Away Mode Turns Off switch update requested
2024-05-26 12:00:18.342 DEBUG (MainThread) [custom_components.wiser.switch] Wiser firestick Switch switch update requested
2024-05-26 12:00:18.343 DEBUG (MainThread) [custom_components.wiser.switch] Wiser firestick Away Mode Turns Off switch update requested
2024-05-26 12:00:18.343 DEBUG (MainThread) [custom_components.wiser.select] Wiser Hot Water Mode updating
2024-05-26 12:00:18.343 DEBUG (MainThread) [custom_components.wiser.select] Wiser laptop charger Mode updating
2024-05-26 12:00:18.344 DEBUG (MainThread) [custom_components.wiser.select] Wiser firestick Mode updating
2024-05-26 12:00:18.344 DEBUG (MainThread) [custom_components.wiser.number] Wiser Away Mode Target Temperature updating
2024-05-26 12:00:18.345 DEBUG (MainThread) [custom_components.wiser.climate] Wiser Dining room updating
2024-05-26 12:00:48.881 INFO (MainThread) [custom_components.wiser.coordinator] Hub update completed for WiserHeat061012
2024-05-26 12:00:48.881 DEBUG (MainThread) [custom_components.wiser.coordinator] Finished fetching wiser (wiser-WiserHeat061012) data in 0.556 seconds (success: True)
2024-05-26 12:00:48.882 DEBUG (MainThread) [custom_components.wiser.climate] Wiser Lounge updating
2024-05-26 12:00:48.884 DEBUG (MainThread) [custom_components.wiser.climate] Wiser Bedroom updating
2024-05-26 12:00:48.887 DEBUG (MainThread) [custom_components.wiser.climate] Wiser Guest bedroom updating
2024-05-26 12:00:48.890 DEBUG (MainThread) [custom_components.wiser.climate] Wiser Theo bedroom updating
2024-05-26 12:00:48.892 DEBUG (MainThread) [custom_components.wiser.climate] Wiser Noah bedroom updating
2024-05-26 12:00:48.894 DEBUG (MainThread) [custom_components.wiser.sensor] Wiser HeatHub Signal device update requested

[asantaga]

Did a bit of research and the R&D indicates not a network problem but a async io conflict condition (Somethings already runnnig etc. ), I dont think its "breaking" as such, just missing data sync.. We'll work on it.. problem is reproducing it.... will ask @msp1974

[msp1974]

Can i just confirm versions of HA and integration? Thx

[dpgh947]

HA 2024.5.5, integration 3.4.7

[msp1974]

Ok thx. Let me have a look. I have an idea.

[dpgh947]

Just for info - I have, as mentioned, replaced my wiser hub this weekend. So I have seen this error on 2 different hubs, and on both of those with it connected to either my Deco mesh wifi, or direct to my Plusnet hub two router. So my feeling is this has been brought on by a recent HA update, but I cannot say when I started seeing these errors - last 2-3 weeks probably... I have completely reset my wiser account and the new hub and re-installed from scratch again today (for an unrelated problem) and I am again seeing these errors.

[msp1974]

Just to say, not ignoring this but have been following this issue which i think is the problem. So far, no solution.

aio-libs/aiohttp#4581

[dpgh947]

I have no idea why, but soon after my last update a couple of weeks ago, these errors just stopped, not even when I did any updates or rebooted etc. but just completely randomly at about 6:15 one evening it just stopped. Not had any since.

[asantaga]

@msp1974 Did u add anything to the last release?

[msp1974]

No, nothing done. Strange.

[dpgh947]

Well, after weeks of nothing, I had another of these errors at 2:25am this morning. Just one, nothing happens at that time, nothing else in the logs around then. There was another "connection reset by peer" error an hour earlier.

2024-07-02 01:26:15.344 ERROR (MainThread) [custom_components.wiser.coordinator] Unknown error fetching wiser (wiser-WiserHeat061012) data. [Errno 104] Connection reset by peer. Please report this error to the integration owner
2024-07-02 02:25:52.287 ERROR (MainThread) [custom_components.wiser.coordinator] Unknown error fetching wiser (wiser-WiserHeat061012) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. Please report this error to the integration owner

[rob1303-hub]

First - thank you for your integration, it is very much appreciated.

Not sure if this is the right place to come in. However I have been receiving these errors for quite a while (sorry didn't record when they started).
I get a lot of them (as you can see 620 in the last 24 hours).
The don't appear to impact the control of the system.
I normally just clear the logs each day. This is the current log:

Logger: custom_components.wiser.coordinator
Source: custom_components/wiser/coordinator.py:198
integration: Drayton Wiser Integration for Home Assistant (documentation, issues)
First occurred: July 8, 2024 at 21:39:18 (620 occurrences)
Last logged: 21:29:26

Unknown error fetching wiser (wiser-WiserHeat03DF38) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. Please report this error to the integration owner
Unknown error fetching wiser (wiser-WiserHeat03DF38) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. ConnectionResetError(104, 'Connection reset by peer'). Please report this error to the integration owner
Unknown error fetching wiser (wiser-WiserHeat03DF38) data. Server disconnected. Please report this error to the integration owner
Unknown error fetching wiser (wiser-WiserHeat03DF38) data. [Errno 104] Connection reset by peer. Please report this error to the integration owner

Happy to help chase down any information needed.

My install:
Integration version: 3.4.7
HA Core version: 2024.6.4
HA Supervisor: 2024.06.2
Operating System 12.4

[msp1974]

So, the issue i was tracking in aiohttp was closed a couple of weeks ago with the issue apparently fixed in 3.10.5 of aiohttp. This was updated in HA2024.8.3. Are you still seeing the errors after updating to this version or higher?

[dpgh947]

I was seeing these very seldom, and I haven't seen it for quite some time now, I couldn't say if it was since that level but sounds likely. Thanks for your efforts.

[BJarkowski]

I've updated my Home Assistant to version 2024.9.1 and I started to face these issues:
Unknown error fetching wiser (wiser-WiserHeat0477F3) data. [Errno 104] Connection reset by peer. Please report this error to the integration owner
Unknown error fetching wiser (wiser-WiserHeat0477F3) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. ConnectionResetError(104, 'Connection reset by peer'). Please report this error to the integration owner
Unknown error fetching wiser (wiser-WiserHeat0477F3) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. Please report this error to the integration owner
Unknown error fetching wiser (wiser-WiserHeat0477F3) data. Server disconnected. Please report this error to the integration owner

I also see in my logs this issue related to aiohttp:
Logger: aiohttp.server
Source: /usr/local/lib/python3.12/site-packages/aiohttp/web_protocol.py:433
First occurred: 12:04:59 (3 occurrences)
Last logged: 15:15:42

Error handling request
Traceback (most recent call last):
File "/usr/local/lib/python3.12/site-packages/aiohttp/web_protocol.py", line 362, in data_received
messages, upgraded, tail = self._request_parser.feed_data(data)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "aiohttp/_http_parser.pyx", line 563, in aiohttp._http_parser.HttpParser.feed_data
aiohttp.http_exceptions.BadStatusLine: 400, message:
Invalid method encountered:

b'\x16\x03\x01'
  ^

It doesn't look like anything functionality gets broken, just lots of messages in logs.
Thanks!

[rob1303-hub]

@msp1974 - thank you for continuing to work on this.

Sorry for delay in replying.

These issues are still occurring:
This error originated from a custom integration.

Source: custom_components/wiser/coordinator.py:198
integration: Drayton Wiser Integration for Home Assistant (documentation, issues)
First occurred: September 13, 2024 at 18:44:11 (15 occurrences)
Last logged: 10:55:21

Unknown error fetching wiser (wiser-WiserHeat03DF38) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. Please report this error to the integration owner
Unknown error fetching wiser (wiser-WiserHeat03DF38) data. Server disconnected. Please report this error to the integration owner
Unknown error fetching wiser (wiser-WiserHeat03DF38) data. [Errno 104] Connection reset by peer. Please report this error to the integration owner
Unknown error fetching wiser (wiser-WiserHeat03DF38) data. Response payload is not completed: <TransferEncodingError: 400, message='Not enough data for satisfy transfer length header.'>. ConnectionResetError(104, 'Connection reset by peer'). Please report this error to the integration owner```