0.21.0 wheels broken for older (<1.13) numpy version

[jorisvandenbossche]

xref #16715 (comment)

I can reproduce what was reported in the other issue: in a clean env, first installing python -m pip install numpy==1.11.2 and then python -m pip install pandas (0.21.0) results in a broken install, while in principle our wheels should be build against the oldest supported numpy version and this should thus work.

From a quick glance it however seems that the python 2.7 wheels are still build with numpy 1.7: https://github.com/MacPython/pandas-wheels/blob/master/.travis.yml

cc @TomAugspurger @jreback

[jorisvandenbossche]

My assumption is this: for all python 3 versions we specify a build numpy version of at least 1.19.3 (NP_BUILD_DEP=numpy==1.9.3), but for the python 2.7 build we do not specify this, so in practice the numpy version is there 1.7.1.
Since this version is no longer supported by pandas, during the wheel building a newer version of numpy will be installed, and the python 2.7 wheels are then actually build against latest numpy 1.13, hence those errors on older numpy versions.

[jreback]

note this just broke in the last day or 2

[jorisvandenbossche]

MacPython/pandas-wheels#19

[jreback]

I pushed some updates, lets see.

[jorisvandenbossche]

note this just broke in the last day or 2

Why would you say that?
There already have been reports two weeks ago in the other issues

[jreback]

no our builds just broke
the wheels themselves are a separate issue

[TomAugspurger]

It seems like uploading wheels to PyPI with the same name is a no-go. We would need to to bump the version somehow, perhaps with .post0, and then do another release with that. But, since we're close to a 0.21.1 release anyway, I'd say we put up with this for another few days.

Users who want the "fixed" wheels with NumPy < 1.13 can install directly from the rackspace CDN, when the builds for MacPython/pandas-wheels@ec160e0 finish:

pip install -f "https://7933911d6844c6c53a7d-47bd50c35cd79bd838daf386af554a83.ssl.cf2.rackcdn.com" pandas

[jorisvandenbossche]

pip install -f "https://7933911d6844c6c53a7d-47bd50c35cd79bd838daf386af554a83.ssl.cf2.rackcdn.com" pandas

This one doesn't seem to work (I also don't see any 0.21.0 packages on there, only dev builds and rc).
The link in the travis log is http://a365fff413fe338398b6-1c8a9b3114517dc5fe17b7c3f8c63a43.r19.cf2.rackcdn.com/. However installing from there with pip also does not work because it is not a trusted source.

I did download the wheel from there manually, and verified the wheel is not working properly though (you need to add --force-reinstall --upgrade --no-deps --no-cache to the pip install to update your broken version).

no our builds just broke
the wheels themselves are a separate issue

Sorry, I don't understand. We only have one version of the wheels uploaded for 0.21.0, and they were broken from the beginning, no?

[ogrisel]

There is a HTTPS link for the wheels container as well:

https://3f23b170c54c2533c070-1c8a9b3114517dc5fe17b7c3f8c63a43.ssl.cf2.rackcdn.com/

[jorisvandenbossche]

OK, so the full pip install command needed to install this version is:

python -m pip install pandas==0.21.0 --force-reinstall --upgrade --no-deps --no-cache --find-links https://3f23b170c54c2533c070-1c8a9b3114517dc5fe17b7c3f8c63a43.ssl.cf2.rackcdn.com/ --no-index

(note the --no-index in the end, as otherwise it will still download the pypi one)

[jreback]

no our builds just broke
the wheels themselves are a separate issue

the daily wheel generation has been working up until 3 or 4 days ago, its fixed now with the 2.7 numpy version pin.

The only wheel that is an issue is the 2.7 one. as @TomAugspurger and I discussed in person, its not feasible to update this inplace on PyPi. the 0.21.1 release will fix this. Note we should have a small note in 0.21.1 whatsnew to indicate the problem is resolved.