Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

jemalloc thread creation error on older distro #6331

Closed
lnicola opened this issue Sep 8, 2022 · 3 comments
Closed

jemalloc thread creation error on older distro #6331

lnicola opened this issue Sep 8, 2022 · 3 comments

Comments

@lnicola
Copy link
Contributor

lnicola commented Sep 8, 2022

Expected behavior and actual behavior.

$ docker run --rm osgeo/gdal:latest gdalinfo --version
<jemalloc>: arena 0 background thread creation failed (1)
GDAL 3.6.0dev-e10d39568c6ab37077f4b6bc2ee3fb93e1e4d41e, released 2022/06/28

Not yet sure if this is just a cosmetic problem or if it causes other problems too.

Operating system

CentOS 7: can reproduce
Arch Linux: can't reproduce

@rouault
Copy link
Member

rouault commented Sep 8, 2022

I believe this might be related to the Parquet driver since libarrow/libparquet uses jemalloc. https://stackoverflow.com/questions/59495151/reading-pandas-from-disk-during-concurrent-process-pool has a similar error message.
Perhaps something too old with CentOS 7 Linux kernel or some additional parameter to pass to docker. May be try adding --privileged just after --rm ?

Looking at http://jemalloc.net/jemalloc.3.html#tuning, maybe you can also try adding -e MALLOC_CONF=background_thread:false just after --rm

@lnicola
Copy link
Contributor Author

lnicola commented Sep 8, 2022

MALLOC_CONF doesn't work, but --privileged does. I think this might be related to using an older version of Docker and https://bugzilla.redhat.com/show_bug.cgi?id=2011523.

Sorry for the noise, but at least it might provide some workaround to anyone else running into it.

@rouault
Copy link
Member

rouault commented Sep 8, 2022

cf #6332 for a troubleshooting section added to the Docker README.md

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants