scapy and no such file or directory: b'liblibc.a' (python 3.9 regression) #45918

70MM13 · 2021-02-03T19:29:10Z

The problem

Just updated to 2021.2.0 and it can't load the dhcp integration

What is version of Home Assistant Core has the issue?

2021.2.0

What was the last working version of Home Assistant Core?

2021.1.5

What type of installation are you running?

Home Assistant Core

Integration causing the issue

dhcp

Link to integration documentation on our website

https://rc.home-assistant.io/integrations/dhcp/

Example YAML snippet

# Put your YAML below this line

Anything in the logs that might be useful for us?

# Put your logs below this line
    from scapy.arch.bpf.core import get_if_raw_addr
  File "/home/tommie/homeassistant/lib/python3.9/site-packages/scapy/arch/bpf/core.py", line 30, in <module>
    LIBC = cdll.LoadLibrary(find_library("libc"))
  File "/usr/lib/python3.9/ctypes/util.py", line 330, in find_library
    _get_soname(_findLib_gcc(name)) or _get_soname(_findLib_ld(name))
  File "/usr/lib/python3.9/ctypes/util.py", line 147, in _findLib_gcc
    if not _is_elf(file):
  File "/usr/lib/python3.9/ctypes/util.py", line 99, in _is_elf
    with open(filename, 'br') as thefile:
FileNotFoundError: [Errno 2] No such file or directory: b'liblibc.a'

Probably related to this: secdev/scapy@46fa40f

The text was updated successfully, but these errors were encountered:

probot-home-assistant · 2021-02-03T19:29:16Z

dhcp documentation
dhcp source
_{^{(message by IssueLinks)}}

bdraco · 2021-02-04T21:41:20Z

We will bump to scapy 2.4.5 when it comes out.

https://bugs.python.org/issue42580 could solve it sooner with a new version of python.

nottledim · 2021-02-05T19:20:23Z

I get this when I add exclude entity_globs in configuration.yaml

Feb 05 19:07:30 mimas hass[238867]: 2021-02-05 19:07:30 ERROR (MainThread) [homeassistant.setup] Setup failed for dhcp: unknown error
Feb 05 19:07:30 mimas hass[238867]: Traceback (most recent call last):
Feb 05 19:07:30 mimas hass[238867]:   File "/usr/lib/python3.9/site-packages/homeassistant/setup.py", line 166, in _async_setup_component
Feb 05 19:07:30 mimas hass[238867]:     component = integration.get_component()
Feb 05 19:07:30 mimas hass[238867]:   File "/usr/lib/python3.9/site-packages/homeassistant/loader.py", line 467, in get_component
Feb 05 19:07:30 mimas hass[238867]:     cache[self.domain] = importlib.import_module(self.pkg_path)
Feb 05 19:07:30 mimas hass[238867]:   File "/usr/lib/python3.9/importlib/__init__.py", line 127, in import_module
Feb 05 19:07:30 mimas hass[238867]:     return _bootstrap._gcd_import(name[level:], package, level)
Feb 05 19:07:30 mimas hass[238867]:   File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
Feb 05 19:07:30 mimas hass[238867]:   File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
Feb 05 19:07:30 mimas hass[238867]:   File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
Feb 05 19:07:30 mimas hass[238867]:   File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
Feb 05 19:07:30 mimas hass[238867]:   File "<frozen importlib._bootstrap_external>", line 790, in exec_module
Feb 05 19:07:30 mimas hass[238867]:   File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
Feb 05 19:07:30 mimas hass[238867]:   File "/usr/lib/python3.9/site-packages/homeassistant/components/dhcp/__init__.py", line 10, in <module>
Feb 05 19:07:30 mimas hass[238867]:     from scapy.arch.common import compile_filter
Feb 05 19:07:30 mimas hass[238867]:   File "/var/lib/hass/deps/lib/python3.9/site-packages/scapy/arch/__init__.py", line 27, in <module>
Feb 05 19:07:30 mimas hass[238867]:     from scapy.arch.bpf.core import get_if_raw_addr
Feb 05 19:07:30 mimas hass[238867]:   File "/var/lib/hass/deps/lib/python3.9/site-packages/scapy/arch/bpf/core.py", line 30, in <module>
Feb 05 19:07:30 mimas hass[238867]:     LIBC = cdll.LoadLibrary(find_library("libc"))
Feb 05 19:07:30 mimas hass[238867]:   File "/usr/lib/python3.9/ctypes/util.py", line 330, in find_library
Feb 05 19:07:30 mimas hass[238867]:     _get_soname(_findLib_gcc(name)) or _get_soname(_findLib_ld(name))
Feb 05 19:07:30 mimas hass[238867]:   File "/usr/lib/python3.9/ctypes/util.py", line 147, in _findLib_gcc
Feb 05 19:07:30 mimas hass[238867]:     if not _is_elf(file):
Feb 05 19:07:30 mimas hass[238867]:   File "/usr/lib/python3.9/ctypes/util.py", line 99, in _is_elf
Feb 05 19:07:30 mimas hass[238867]:     with open(filename, 'br') as thefile:
Feb 05 19:07:30 mimas hass[238867]: FileNotFoundError: [Errno 2] No such file or directory: b'liblibc.a'

OnFreund · 2021-02-16T16:17:45Z

This is also preventing "Restart" (in Server Controls -> Server management) from working.

bdraco · 2021-02-16T17:07:05Z

This is also preventing "Restart" (in Server Controls -> Server management) from working.

@OnFreund

I haven't been able to replicate this.

Can you provide a py-spy dump of the threads when its stuck?

OnFreund · 2021-02-16T18:59:49Z

It's not stuck - it's just failing to shut down with the following log:

Error executing service: <ServiceCall homeassistant.restart (c:c02ac5bacb1a7ad9bab367beb0e19819)>
Traceback (most recent call last):
  File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/core.py", line 1471, in catch_exceptions
    await coro_or_task
  File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/core.py", line 1490, in _execute_service
    await handler.job.target(service_call)
  File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/helpers/service.py", line 665, in admin_handler
    await result
  File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/components/homeassistant/__init__.py", line 117, in async_handle_core_service
    errors = await conf_util.async_check_ha_config_file(hass)
  File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/config.py", line 877, in async_check_ha_config_file
    res = await check_config.async_check_ha_config_file(hass)
  File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/helpers/check_config.py", line 123, in async_check_ha_config_file
    component = integration.get_component()
  File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/loader.py", line 467, in get_component
    cache[self.domain] = importlib.import_module(self.pkg_path)
  File "/usr/lib/python3.9/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
  File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 790, in exec_module
  File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
  File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/components/dhcp/__init__.py", line 13, in <module>
    from scapy.layers.dhcp import DHCP
  File "/srv/homeassistant/lib/python3.9/site-packages/scapy/layers/dhcp.py", line 20, in <module>
    from scapy.ansmachine import AnsweringMachine
  File "/srv/homeassistant/lib/python3.9/site-packages/scapy/ansmachine.py", line 16, in <module>
    from scapy.sendrecv import send, sniff
  File "/srv/homeassistant/lib/python3.9/site-packages/scapy/sendrecv.py", line 35, in <module>
    import scapy.route  # noqa: F401
  File "/srv/homeassistant/lib/python3.9/site-packages/scapy/route.py", line 199, in <module>
    conf.route = Route()
  File "/srv/homeassistant/lib/python3.9/site-packages/scapy/route.py", line 27, in __init__
    self.resync()
  File "/srv/homeassistant/lib/python3.9/site-packages/scapy/route.py", line 33, in resync
    from scapy.arch import read_routes
  File "/srv/homeassistant/lib/python3.9/site-packages/scapy/arch/__init__.py", line 27, in <module>
    from scapy.arch.bpf.core import get_if_raw_addr
  File "/srv/homeassistant/lib/python3.9/site-packages/scapy/arch/bpf/core.py", line 30, in <module>
    LIBC = cdll.LoadLibrary(find_library("libc"))
  File "/usr/lib/python3.9/ctypes/util.py", line 341, in find_library
    _get_soname(_findLib_gcc(name)) or _get_soname(_findLib_ld(name))
  File "/usr/lib/python3.9/ctypes/util.py", line 147, in _findLib_gcc
    if not _is_elf(file):
  File "/usr/lib/python3.9/ctypes/util.py", line 99, in _is_elf
    with open(filename, 'br') as thefile:
FileNotFoundError: [Errno 2] No such file or directory: b'liblibc.a'

bdraco · 2021-02-16T19:50:45Z

Thanks for the trace. That seems like a more general issue with not catching lower level exceptions in the restart. I’ll see what I can work up that should solve it for other cases as well as I don’t think the underlying python bug is going to be fixed soon

bdraco · 2021-02-16T20:17:25Z

Looks like we try to validate the config is valid before restarting. File not found and import errors aren’t configuration problems though. So it’s a bit to broad

bdraco · 2021-02-16T21:45:54Z

I've opened an issue with scapy requesting as new release as monkey patching for https://bugs.python.org/issue42580 is likely very messy

secdev/scapy#3100

LittleFox94 · 2021-03-15T20:23:07Z

For now I symlinked my libc.a to /usr/local/lib/liblibc.a because I was annoyed by the "invalid config" notification x)

bdraco · 2021-04-09T00:47:55Z

secdev/scapy#3158

Vaear · 2021-04-13T14:17:54Z

The issue seems to persist even in 2.4.5rc1

File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/components/dhcp/init.py", line 20, in
from scapy.layers.dhcp import DHCP
File "/srv/homeassistant/lib/python3.9/site-packages/scapy/layers/dhcp.py", line 20, in
from scapy.ansmachine import AnsweringMachine
File "/srv/homeassistant/lib/python3.9/site-packages/scapy/ansmachine.py", line 16, in
from scapy.sendrecv import send, sniff
File "/srv/homeassistant/lib/python3.9/site-packages/scapy/sendrecv.py", line 35, in
import scapy.route # noqa: F401
File "/srv/homeassistant/lib/python3.9/site-packages/scapy/route.py", line 199, in
conf.route = Route()
File "/srv/homeassistant/lib/python3.9/site-packages/scapy/route.py", line 27, in init
self.resync()
File "/srv/homeassistant/lib/python3.9/site-packages/scapy/route.py", line 33, in resync
from scapy.arch import read_routes
File "/srv/homeassistant/lib/python3.9/site-packages/scapy/arch/init.py", line 27, in
from scapy.arch.bpf.core import get_if_raw_addr
File "/srv/homeassistant/lib/python3.9/site-packages/scapy/arch/bpf/core.py", line 30, in
LIBC = cdll.LoadLibrary(find_library("libc"))
File "/usr/lib/python3.9/ctypes/util.py", line 341, in find_library
_get_soname(_findLib_gcc(name)) or _get_soname(_findLib_ld(name))
File "/usr/lib/python3.9/ctypes/util.py", line 147, in _findLib_gcc
if not _is_elf(file):
File "/usr/lib/python3.9/ctypes/util.py", line 99, in _is_elf
with open(filename, 'br') as thefile:
FileNotFoundError: [Errno 2] No such file or directory: b'liblibc.a'

If i am not missing something else here.

bdraco · 2021-04-13T17:27:07Z

File "/srv/homeassistant/lib/python3.9/site-packages/scapy/arch/bpf/core.py", line 30, in
LIBC = cdll.LoadLibrary(find_library("libc"))

https://github.com/secdev/scapy/blob/v2.4.5rc1/scapy/arch/bpf/core.py#L35

It looks like you are still running 2.4.4. If you manually upgraded and didn't modify manifest.json, its pinned to 2.4.4 so it probably downgraded again.

Vaear · 2021-04-13T19:39:02Z

Any chance you know where this manifest.json is located? Is more than one? There is no manifest.json file under the scapy cataloge.

bdraco · 2021-04-13T21:29:21Z

https://github.com/home-assistant/core/blob/dev/homeassistant/components/dhcp/manifest.json

Vaear · 2021-04-14T13:20:55Z

Worked like a charm, thank you for taking the time :) And sorry for bothering you!

guedou · 2021-04-19T19:10:55Z

I just released Scapy v2.4.5! Enjoy.

bdraco · 2021-04-19T19:18:45Z

I just released Scapy v2.4.5! Enjoy.

Thank you!

fixes home-assistant#45918 fixes home-assistant#45846

bdraco · 2021-04-20T01:09:01Z

Unfortunately we have hit a small snag pylint-dev/pylint#4383

fixes home-assistant#45918 fixes home-assistant#45846

probot-home-assistant bot added the integration: dhcp label Feb 3, 2021

probot-home-assistant bot assigned bdraco Feb 3, 2021

cgarwood mentioned this issue Feb 4, 2021

FileNotFoundError: [Errno 2] No such file or directory: b'liblibc.a' #45933

Closed

bdraco changed the title ~~scapy and no such file or directory: b'liblibc.a'~~ scapy and no such file or directory: b'liblibc.a' (python 3.9 regression) Feb 4, 2021

bdraco mentioned this issue Feb 5, 2021

Setup failed for dhcp, due to wrong library loaded by scapy #46048

Closed

bdraco mentioned this issue Feb 16, 2021

Ensure HomeAssistant can still restart when a library file is missing #46664

Merged

21 tasks

bdraco added a commit to bdraco/home-assistant that referenced this issue Apr 19, 2021

Bump scapy to 2.4.5 for dhcp

07fcbc7

fixes home-assistant#45918 fixes home-assistant#45846

bdraco mentioned this issue Apr 19, 2021

Bump scapy to 2.4.5 for dhcp #49437

Merged

21 tasks

bdraco added a commit to bdraco/home-assistant that referenced this issue Apr 25, 2021

Bump scapy to 2.4.5 for dhcp

34d7a77

fixes home-assistant#45918 fixes home-assistant#45846

bdraco closed this as completed in #49437 Apr 25, 2021

github-actions bot locked and limited conversation to collaborators May 25, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

scapy and no such file or directory: b'liblibc.a' (python 3.9 regression) #45918

scapy and no such file or directory: b'liblibc.a' (python 3.9 regression) #45918

70MM13 commented Feb 3, 2021

probot-home-assistant bot commented Feb 3, 2021

bdraco commented Feb 4, 2021

nottledim commented Feb 5, 2021

OnFreund commented Feb 16, 2021

bdraco commented Feb 16, 2021

OnFreund commented Feb 16, 2021

bdraco commented Feb 16, 2021 •

edited

Loading

bdraco commented Feb 16, 2021

bdraco commented Feb 16, 2021

LittleFox94 commented Mar 15, 2021

bdraco commented Apr 9, 2021

Vaear commented Apr 13, 2021

bdraco commented Apr 13, 2021 •

edited

Loading

Vaear commented Apr 13, 2021

bdraco commented Apr 13, 2021

Vaear commented Apr 14, 2021

guedou commented Apr 19, 2021 •

edited

Loading

bdraco commented Apr 19, 2021

bdraco commented Apr 20, 2021 •

edited

Loading

scapy and no such file or directory: b'liblibc.a' (python 3.9 regression) #45918

scapy and no such file or directory: b'liblibc.a' (python 3.9 regression) #45918

Comments

70MM13 commented Feb 3, 2021

probot-home-assistant bot commented Feb 3, 2021

bdraco commented Feb 4, 2021

nottledim commented Feb 5, 2021

OnFreund commented Feb 16, 2021

bdraco commented Feb 16, 2021

OnFreund commented Feb 16, 2021

bdraco commented Feb 16, 2021 • edited Loading

bdraco commented Feb 16, 2021

bdraco commented Feb 16, 2021

LittleFox94 commented Mar 15, 2021

bdraco commented Apr 9, 2021

Vaear commented Apr 13, 2021

bdraco commented Apr 13, 2021 • edited Loading

Vaear commented Apr 13, 2021

bdraco commented Apr 13, 2021

Vaear commented Apr 14, 2021

guedou commented Apr 19, 2021 • edited Loading

bdraco commented Apr 19, 2021

bdraco commented Apr 20, 2021 • edited Loading

bdraco commented Feb 16, 2021 •

edited

Loading

bdraco commented Apr 13, 2021 •

edited

Loading

guedou commented Apr 19, 2021 •

edited

Loading

bdraco commented Apr 20, 2021 •

edited

Loading