CamHipro Wireless WiFi 5MP 240X ZOOM Camera cannot parse XML or respond to `GetCapabilities` with 2023.5.x and later #92308

criticallimit · 2023-04-30T20:15:27Z

The problem

next onvif problem here

What version of Home Assistant Core has the issue?

2023.5.0b5

What was the last working version of Home Assistant Core?

2023.4.4

What type of installation are you running?

Home Assistant OS

Integration causing the issue

onvif

Link to integration documentation on our website

No response

Diagnostics information

Logger: homeassistant.config_entries
Source: components/onvif/device.py:309
First occurred: 22:12:07 (1 occurrences)
Last logged: 22:12:07

Error setting up entry Cam Zoom 3 - C4:3C:B0:EA:72:5A for onvif
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/config_entries.py", line 387, in async_setup
    result = await component.async_setup_entry(hass, self)
  File "/usr/src/homeassistant/homeassistant/components/onvif/__init__.py", line 38, in async_setup_entry
    await device.async_setup()
  File "/usr/src/homeassistant/homeassistant/components/onvif/device.py", line 112, in async_setup
    self.profiles = await self.async_get_profiles()
  File "/usr/src/homeassistant/homeassistant/components/onvif/device.py", line 309, in async_get_profiles
    result = await media_service.GetProfiles()
  File "/usr/local/lib/python3.10/site-packages/zeep/proxy.py", line 64, in __call__
    return await self._proxy._binding.send_async(
  File "/usr/local/lib/python3.10/site-packages/zeep/wsdl/bindings/soap.py", line 156, in send_async
    response = await client.transport.post_xml(
  File "/usr/local/lib/python3.10/site-packages/zeep/transports.py", line 235, in post_xml
    response = await self.post(address, message, headers)
  File "/usr/local/lib/python3.10/site-packages/zeep/transports.py", line 220, in post
    response = await self.client.post(
  File "/usr/local/lib/python3.10/site-packages/httpx/_client.py", line 1845, in post
    return await self.request(
  File "/usr/local/lib/python3.10/site-packages/httpx/_client.py", line 1530, in request
    return await self.send(request, auth=auth, follow_redirects=follow_redirects)
  File "/usr/local/lib/python3.10/site-packages/httpx/_client.py", line 1617, in send
    response = await self._send_handling_auth(
  File "/usr/local/lib/python3.10/site-packages/httpx/_client.py", line 1645, in _send_handling_auth
    response = await self._send_handling_redirects(
  File "/usr/local/lib/python3.10/site-packages/httpx/_client.py", line 1682, in _send_handling_redirects
    response = await self._send_single_request(request)
  File "/usr/local/lib/python3.10/site-packages/httpx/_client.py", line 1719, in _send_single_request
    response = await transport.handle_async_request(request)
  File "/usr/local/lib/python3.10/site-packages/httpx/_transports/default.py", line 353, in handle_async_request
    resp = await self._pool.handle_async_request(req)
  File "/usr/local/lib/python3.10/site-packages/httpcore/_async/connection_pool.py", line 253, in handle_async_request
    raise exc
  File "/usr/local/lib/python3.10/site-packages/httpcore/_async/connection_pool.py", line 237, in handle_async_request
    response = await connection.handle_async_request(request)
  File "/usr/local/lib/python3.10/site-packages/httpcore/_async/connection.py", line 90, in handle_async_request
    return await self._connection.handle_async_request(request)
  File "/usr/local/lib/python3.10/site-packages/httpcore/_async/http11.py", line 116, in handle_async_request
    raise exc
  File "/usr/local/lib/python3.10/site-packages/httpcore/_async/http11.py", line 95, in handle_async_request
    ) = await self._receive_response_headers(**kwargs)
  File "/usr/local/lib/python3.10/site-packages/httpcore/_async/http11.py", line 159, in _receive_response_headers
    event = await self._receive_event(timeout=timeout)
  File "/usr/local/lib/python3.10/site-packages/httpcore/_async/http11.py", line 195, in _receive_event
    data = await self._network_stream.read(
  File "/usr/local/lib/python3.10/site-packages/httpcore/backends/asyncio.py", line 34, in read
    return await self._stream.receive(max_bytes=max_bytes)
  File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 1265, in receive
    await self._protocol.read_event.wait()
  File "/usr/local/lib/python3.10/asyncio/locks.py", line 214, in wait
    await fut
asyncio.exceptions.CancelledError

The text was updated successfully, but these errors were encountered:

home-assistant · 2023-04-30T20:36:31Z

Hey there @hunterjm, mind taking a look at this issue as it has been labeled with an integration (onvif) you are listed as a code owner for? Thanks!

Code owner commands

Code owners of onvif can trigger bot actions by commenting:

@home-assistant close Closes the issue.
@home-assistant rename Awesome new title Renames the issue.
@home-assistant reopen Reopen the issue.
@home-assistant unassign onvif Removes the current integration label and assignees on the issue, add the integration domain after the command.

_{^{(message by CodeOwnersMention)}}

onvif documentation
onvif source
_{^{(message by IssueLinks)}}

bdraco · 2023-04-30T21:02:36Z

Looks like the anyio bug that I had been biting us in other issues.

agronholm/anyio#374

There are no workarounds at this time

bdraco · 2023-04-30T21:08:50Z

If you reload the config entry a few times in the UI, can you eventually get it to setup?

bdraco · 2023-04-30T21:18:41Z

We can't resume on cancel as we have to raise to avoid blocking cancelation but we could retry the whole setup process by rasing ConfigEntryNotReady instead

fixes #92308

criticallimit · 2023-04-30T21:24:47Z

If you reload the config entry a few times in the UI, can you eventually get it to setup?

nope

bdraco · 2023-04-30T21:34:02Z

Can you post a link to the camera and where to purchase it ?

criticallimit · 2023-04-30T21:48:58Z

Can you post a link to the camera and where to purchase it ?

https://de.aliexpress.com/item/1005005235188578.html?spm=a2g0o.productlist.main.1.23cd6e0dk1D0Gx&algo_pvid=cd48c28f-5a26-4178-bf4f-efbd8eb32069&algo_exp_id=cd48c28f-5a26-4178-bf4f-efbd8eb32069-0&pdp_npi=3%40dis%21EUR%2166.78%2166.78%21%21%21%21%21%40211bf4c516828912728448794d07ad%2112000032310567857%21sea%21DE%214002977691&curPageLogUid=JWE30BzSq63t

It´s a cheap chinese, but working till 2023.4.4

bdraco · 2023-04-30T22:02:31Z

Great. I ordered that one.

I added retries for now. I'll see if I can improve compatibility when it shows up.

bdraco · 2023-04-30T22:04:42Z

I'm assuming it uses https://play.google.com/store/apps/details?id=com.hichip.campro&hl=en_US&gl=US as those firmwares have been particularly difficult to keep working as they are pretty finicky

criticallimit · 2023-04-30T22:10:10Z

thanx a lot!

criticallimit · 2023-04-30T22:27:19Z

CAMHI Camera http CGI manual (2022-04-15).pdf

maybe this cgi doc helps?

bdraco · 2023-04-30T22:29:40Z

Its usually something subtle with the camera's onvif implementation. I've seen one where it only failed when it it received more than 10 requests per minute but worked fine until the 9th request. Any small change can have unintended consequences with these brittle onvif implementations so its always a bit a trial and error to figure out how to get it to work which is why I just order the camera now.

bdraco · 2023-04-30T22:39:55Z

I have this one that I just got that I'm working through now https://www.amazon.com/dp/B092V7BW7C?psc=1&ref=ppx_yo2ov_dt_b_product_details. I'm pretty sure it uses similar firmware. It works fine with ethernet but fails on wifi. Unfortunately it doesn't look like the same issue

bdraco · 2023-04-30T22:40:10Z

Thats a thought. Do you have it connected via ethernet or wifi?

criticallimit · 2023-04-30T23:31:08Z

Thats a thought. Do you have it connected via ethernet or wifi?

On wifi
And it worked before on 2023.4.4

No matter if on Wi-Fi or Ethernet. Same behavior since 2023.5.betas

bdraco · 2023-04-30T23:34:59Z

I'll be sure to setup the test unit on wifi when it arrives. If you can test with ethernet in the mean that that would be a helpful datapoint

criticallimit · 2023-04-30T23:38:01Z

I'll be sure to setup the test unit on wifi when it arrives. If you can test with ethernet in the mean that that would be a helpful datapoint

Will check tomorrow with 5.0b5 again on ethernet

criticallimit · 2023-05-01T07:30:51Z

ok. Checked with cam connected via ethernet.
Same Faults in the log.

bdraco · 2023-05-01T13:07:30Z

Thanks for checking. I’ll report back when the test unit arrives

bdraco · 2023-05-06T21:12:48Z

We don't know if the camera has gone away or its just failing to respond because it does nothing when it gets a request with WSAs

pbvdven · 2023-05-06T21:19:11Z

i get it. is there maybe a option you can make one custom without the wsa's that i can use as a custom onvif integration? or can i use the last version from the onvif integration shipped with 2023.4 that one worked fine for all my 3 onvif devices the hikvision ds-hd1, dahua cube 4mp and my cheap ptz.

bdraco · 2023-05-06T21:20:20Z

I'm trying to work up an alternate solution. Give me ~30m

pbvdven · 2023-05-06T21:22:25Z

take all the time you need. thanks for looking in to it.

pbvdven · 2023-05-06T21:34:52Z

Idk if it could help but these onvif settings can be set in the camera.

NVC type has also the option uniview

bdraco · 2023-05-06T21:35:17Z

I pushed onvif-zeep-async==2.1.4

cd /config
curl -o- -sSL https://gist.githubusercontent.com/bdraco/43f8043cb04b9838383fd71353e99b18/raw/core_integration_pr | bash /dev/stdin -d onvif -p 92700
cat /config/custom_components/onvif/manifest.json

Verify that the version displayed above is "onvif-zeep-async==2.1.4" and NOT 2.1.1

Restart HA

Test

Delete /config/custom_components/onvif and restart after testing is completed to restore the core version

pbvdven · 2023-05-06T21:42:27Z

i do get other labels

pbvdven · 2023-05-06T21:45:06Z

same result new log in your mail

bdraco · 2023-05-06T21:52:52Z

no ReadError in the log so definitely making progress

bdraco · 2023-05-06T21:54:39Z

Can you try power cycling the device before setting it up again with the 2.1.4 version?

bdraco · 2023-05-06T21:55:33Z

Also the labels are missing because its a custom component and the translation files aren't there (this is normal)

pbvdven · 2023-05-06T22:05:39Z

now its added but still

also new log

bdraco · 2023-05-06T22:12:49Z

I didn't get a new log via email. Not sure if it got stuck going out ?

pbvdven · 2023-05-06T22:17:44Z

said send here but i send it again

my bad send it through icloud.com and your verification email got into spam

bdraco · 2023-05-06T22:22:26Z

got it.

Its getting a lot further.

2023-05-07 00:02:51.389 DEBUG (MainThread) [zeep.transports] HTTP Post to http://192.168.2.189:8080/onvif/device_service:
2023-05-07 00:02:51.400 DEBUG (MainThread) [httpx] HTTP Request: POST http://192.168.2.189:8080/onvif/device_service "HTTP/1.1 200 OK"
2023-05-07 00:02:51.401 DEBUG (MainThread) [zeep.transports] HTTP Response from http://192.168.2.189:8080/onvif/device_service (status: 200):
2023-05-07 00:02:51.403 DEBUG (MainThread) [zeep.transports] HTTP Post to http://192.168.2.189:8080/onvif/device_service:
2023-05-07 00:02:51.413 DEBUG (MainThread) [httpx] HTTP Request: POST http://192.168.2.189:8080/onvif/device_service "HTTP/1.1 200 OK"
2023-05-07 00:02:51.415 DEBUG (MainThread) [zeep.transports] HTTP Response from http://192.168.2.189:8080/onvif/device_service (status: 200):
2023-05-07 00:02:51.416 DEBUG (MainThread) [zeep.transports] HTTP Post to http://192.168.2.189:8080/onvif/device_service:
2023-05-07 00:02:51.425 DEBUG (MainThread) [httpx] HTTP Request: POST http://192.168.2.189:8080/onvif/device_service "HTTP/1.1 200 OK"
2023-05-07 00:02:51.426 DEBUG (MainThread) [zeep.transports] HTTP Response from http://192.168.2.189:8080/onvif/device_service (status: 200):
2023-05-07 00:02:51.427 DEBUG (MainThread) [onvif] Creating service ('media', None) with http://192.168.2.189:8080/onvif/media_service
2023-05-07 00:02:51.429 DEBUG (MainThread) [zeep.transports] HTTP Post to http://192.168.2.189:8080/onvif/media_service:
2023-05-07 00:02:51.434 DEBUG (MainThread) [httpx] HTTP Request: POST http://192.168.2.189:8080/onvif/media_service "HTTP/1.1 200 OK"
2023-05-07 00:02:51.435 DEBUG (MainThread) [zeep.transports] HTTP Response from http://192.168.2.189:8080/onvif/media_service (status: 200):
2023-05-07 00:02:51.436 DEBUG (MainThread) [onvif] Creating service ('imaging', None) with http://192.168.2.189:8080/onvif/image_service
2023-05-07 00:02:51.436 DEBUG (MainThread) [zeep.transports] HTTP Post to http://192.168.2.189:8080/onvif/media_service:
2023-05-07 00:02:51.473 DEBUG (MainThread) [httpx] HTTP Request: POST http://192.168.2.189:8080/onvif/media_service "HTTP/1.1 200 OK"
2023-05-07 00:02:51.475 DEBUG (MainThread) [zeep.transports] HTTP Response from http://192.168.2.189:8080/onvif/media_service (status: 200):
2023-05-07 00:02:51.479 DEBUG (MainThread) [onvif] Creating service ('ptz', None) with http://192.168.2.189:8080/onvif/ptz_service
2023-05-07 00:02:51.607 DEBUG (MainThread) [zeep.transports] HTTP Post to http://192.168.2.189:8080/onvif/ptz_service:
2023-05-07 00:02:51.624 DEBUG (MainThread) [httpx] HTTP Request: POST http://192.168.2.189:8080/onvif/ptz_service "HTTP/1.1 200 OK"
2023-05-07 00:02:51.631 DEBUG (MainThread) [zeep.transports] HTTP Response from http://192.168.2.189:8080/onvif/ptz_service (status: 200):
2023-05-07 00:02:51.679 DEBUG (MainThread) [zeep.transports] HTTP Post to http://192.168.2.189:8080/onvif/ptz_service:
2023-05-07 00:02:51.693 DEBUG (MainThread) [httpx] HTTP Request: POST http://192.168.2.189:8080/onvif/ptz_service "HTTP/1.1 200 OK"
2023-05-07 00:02:51.701 DEBUG (MainThread) [zeep.transports] HTTP Response from http://192.168.2.189:8080/onvif/ptz_service (status: 200):
2023-05-07 00:02:51.738 DEBUG (MainThread) [onvif] Creating service ('notification', None) with http://192.168.2.189:8080/onvif/event_service
2023-05-07 00:02:51.740 DEBUG (MainThread) [zeep.transports] HTTP Post to http://192.168.2.189:8080/onvif/event_service:
2023-05-07 00:03:26.249 DEBUG (MainThread) [zeep.transports] HTTP Post to http://192.168.2.189:8080/onvif/event_service:
2023-05-07 00:03:56.253 DEBUG (MainThread) [zeep.transports] HTTP Post to http://192.168.2.189:8080/onvif/media_service:
2023-05-07 00:04:26.258 WARNING (MainThread) [homeassistant.config_entries] Config entry 'PTZ - 00:0A:24:33:32:D2' for onvif integration not ready yet: Could not connect to camera 192.168.2.189:8080: ; Retrying in background

bdraco · 2023-05-06T22:29:16Z

Can you adjust the loggers so we can pick up the custom component and try again

# Example configuration.yaml entry
logger:
  default: info
  logs:
    homeassistant.components.onvif: debug
    custom_components.onvif: debug
    httpx: debug
    onvif: debug
    zeep: debug

bdraco · 2023-05-06T22:29:41Z

Also please power cycle the device before trying again as I think once it gets into a bad state it won't recover on its own

bdraco · 2023-05-06T22:51:43Z

The last one you just sent the camera didn't respond at all to the request. I'm not sure it was booted yet or was still in a the stuck state

pbvdven · 2023-05-06T22:57:17Z

new log now its added again.

bdraco · 2023-05-06T23:51:24Z

Thanks. Its back to completely not responding again. This could take a few days of iterations to figure out the root cause

bdraco · 2023-05-06T23:51:40Z

It might be better to wait until the test camera shows up

pbvdven · 2023-05-07T05:41:57Z

thanks for your time. Ive i can do anything else to help just let me know

bdraco · 2023-05-07T12:26:42Z

I’ll follow up when the hardware arrives

bdraco · 2023-05-07T23:50:23Z

Original camera I ordered shows in the US now so hopefully have it by next weekend

bdraco · 2023-05-14T17:50:00Z

Camera showed up. Turns out its likely the same issue as #91678

bdraco · 2023-05-14T20:18:42Z

Please try 2023.5.4 when it is released

pbvdven · 2023-05-24T06:15:40Z

Please try 2023.5.4 when it is released

Thanks with 2023.5.4 the 5mp ptz works again.

frenck added this to the 2023.5.0 milestone Apr 30, 2023

frenck changed the title ~~2023.5.0b5: ONVIF another problem~~ ONVIF another problem Apr 30, 2023

frenck added the integration: onvif label Apr 30, 2023

home-assistant bot assigned hunterjm Apr 30, 2023

bdraco changed the title ~~ONVIF another problem~~ ONVIF raises CancelledError during setup from anyio Apr 30, 2023

bdraco added a commit that referenced this issue Apr 30, 2023

Retry onvif setup when it is unexpectedly cancelled

1a92568

fixes #92308

bdraco mentioned this issue Apr 30, 2023

Retry onvif setup when it is unexpectedly cancelled #92313

Merged

20 tasks

bdraco added a commit that referenced this issue Apr 30, 2023

Retry onvif setup when it is unexpectedly cancelled

e0ae543

fixes #92308

balloob closed this as completed in 30dd8b9 May 1, 2023

bdraco reopened this May 1, 2023

bdraco changed the title ~~ONVIF raises CancelledError during setup from anyio~~ ONVIF raises CancelledError during setup from anyio with CamHipro Wireless WiFi 5MP 240X ZOOM Humanoid SONY IMX 335 IP Camera DV Recorder Support SD MIC Speaker May 1, 2023

bdraco mentioned this issue May 14, 2023

Fix onvif cameras that cannot parse relative time #92711

Merged

20 tasks

balloob closed this as completed in #92711 May 14, 2023

github-actions bot locked and limited conversation to collaborators Jun 23, 2023

CamHipro Wireless WiFi 5MP 240X ZOOM Camera cannot parse XML or respond to GetCapabilities with 2023.5.x and later #92308

CamHipro Wireless WiFi 5MP 240X ZOOM Camera cannot parse XML or respond to GetCapabilities with 2023.5.x and later #92308

Comments

criticallimit commented Apr 30, 2023 • edited by bdraco Loading

The problem

What version of Home Assistant Core has the issue?

What was the last working version of Home Assistant Core?

What type of installation are you running?

Integration causing the issue

Link to integration documentation on our website

Diagnostics information

home-assistant bot commented Apr 30, 2023

bdraco commented Apr 30, 2023

bdraco commented Apr 30, 2023

bdraco commented Apr 30, 2023

criticallimit commented Apr 30, 2023

bdraco commented Apr 30, 2023

criticallimit commented Apr 30, 2023

bdraco commented Apr 30, 2023

bdraco commented Apr 30, 2023

criticallimit commented Apr 30, 2023

criticallimit commented Apr 30, 2023

bdraco commented Apr 30, 2023 • edited Loading

bdraco commented Apr 30, 2023

bdraco commented Apr 30, 2023

criticallimit commented Apr 30, 2023 • edited Loading

bdraco commented Apr 30, 2023

criticallimit commented Apr 30, 2023

criticallimit commented May 1, 2023

bdraco commented May 1, 2023

bdraco commented May 6, 2023

pbvdven commented May 6, 2023

bdraco commented May 6, 2023

pbvdven commented May 6, 2023

pbvdven commented May 6, 2023

bdraco commented May 6, 2023

pbvdven commented May 6, 2023

pbvdven commented May 6, 2023

bdraco commented May 6, 2023

bdraco commented May 6, 2023

bdraco commented May 6, 2023

pbvdven commented May 6, 2023 • edited Loading

bdraco commented May 6, 2023

pbvdven commented May 6, 2023 • edited Loading

bdraco commented May 6, 2023

bdraco commented May 6, 2023

bdraco commented May 6, 2023

bdraco commented May 6, 2023

pbvdven commented May 6, 2023

bdraco commented May 6, 2023

bdraco commented May 6, 2023

pbvdven commented May 7, 2023

bdraco commented May 7, 2023

bdraco commented May 7, 2023

bdraco commented May 14, 2023

bdraco commented May 14, 2023

pbvdven commented May 24, 2023

CamHipro Wireless WiFi 5MP 240X ZOOM Camera cannot parse XML or respond to `GetCapabilities` with 2023.5.x and later #92308

CamHipro Wireless WiFi 5MP 240X ZOOM Camera cannot parse XML or respond to `GetCapabilities` with 2023.5.x and later #92308

criticallimit commented Apr 30, 2023 •

edited by bdraco

Loading

bdraco commented Apr 30, 2023 •

edited

Loading

criticallimit commented Apr 30, 2023 •

edited

Loading

pbvdven commented May 6, 2023 •

edited

Loading

pbvdven commented May 6, 2023 •

edited

Loading