Python Polars Import Fail on Aarch64 Linux

[valemanji]

Checks

• I have checked that this issue has not already been reported.
• I have confirmed this bug exists on the latest version of Polars.

Reproducible example

import polars

Log output

<jemalloc>: Unsupported system page size
<jemalloc>: Unsupported system page size
memory allocation of 8 bytes failed
Aborted

Issue description

Hi yall, I tried importing polars but it fails with a jemalloc unsupported page size issue. I also attempted using polars-lts-cpu in my requirements.txt but that failed too.

Expected behavior

import polars throws no errors

Installed versions

0.20.18

[valemanji]

I noticed that a past user has had jemalloc issues that were closed namely: #5654. But using a new version has not helped me. Based on other github pages, it appears there are a lot of discussions about jemalloc on aarch64. In case you all are not already familiar, here are some links: facebook/buck2#91 and swc-project/swc#5967)

[reswqa]

Maybe related: #15542.

[messense]

Looks like JEMALLOC_SYS_WITH_LG_PAGE=16 isn't working:

polars/.github/workflows/release-python.yml

Lines 166 to 180 in 42d3697

	- name: Set jemalloc for aarch64 Linux
	if: matrix.architecture == 'aarch64' && matrix.os == 'ubuntu-latest'
	run: |
	echo "JEMALLOC_SYS_WITH_LG_PAGE=16" >> $GITHUB_ENV
	- name: Build wheel
	uses: PyO3/maturin-action@v1
	with:
	command: build
	target: ${{ steps.target.outputs.target }}
	args: >
	--release
	--manifest-path py-polars/Cargo.toml
	--out dist
	manylinux: ${{ matrix.architecture == 'aarch64' && '2_24' || 'auto' }}

, need to pass it to maturin-action because of Docker, for working example, see

• https://github.com/astral-sh/ruff/blob/42d52ebbec275389ee0458a3bf373268278bd51a/.github/workflows/release.yaml#L243-L247
• https://github.com/astral-sh/ruff/blob/42d52ebbec275389ee0458a3bf373268278bd51a/.github/workflows/release.yaml#L275

[valemanji]

@messense thanks for the links. Is this change one that can only be made at build time or is there an os environ variable that can be used to update it in the mean time.

[uuip]

Looks like JEMALLOC_SYS_WITH_LG_PAGE=16 isn't working:

so I compile polars by myself.

[uuip]

@stinodego Excuse me, do
you have time verify this problem?

[messense]

need to pass it to maturin-action because of Docker

This is no longer required after PyO3/maturin-action@92c5bc6.

Can you try installing the latest polars release from PyPI?

[stinodego]

Thanks for the fix @messense !

I'll close this issue for now as I assume it has been resolved. If you're still running into issues with Polars 0.20.22-rc.1 or later, please let me know, and I can re-open this issue.

[valemanji]

@stinodego it works for me too. Thanks for the fix @messense

[shenquanle]

I encountered this problem too，my polars version is 0.18.4, and I solved this problem by upgrading the version of Polars to 0.20.31. hope my answer would help u.