Skip to content
This repository was archived by the owner on Jun 12, 2023. It is now read-only.

Scripts for Windows host and update for new website #32

Merged
merged 12 commits into from
Jul 17, 2020
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 0 additions & 2 deletions Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -6,5 +6,3 @@ RUN apt-get update && \
RUN conda update conda -y \
&& conda install -y conda-build conda-verify gcc_linux-64 gxx_linux-64 \
&& conda clean --all

COPY pandas /pandas
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think not needed

14 changes: 0 additions & 14 deletions Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -15,14 +15,12 @@ SHELL := /bin/bash

init-repos:
git clone https://github.com/pandas-dev/pandas && git -C pandas remote rename origin upstream && git -C pandas remote add origin https://github.com/$(GH_USERNAME)/pandas
git clone https://github.com/pandas-dev/pandas-website && git -C pandas-website remote rename origin upstream && git -C pandas-website remote add origin https://github.com/$(GH_USERNAME)/pandas-website
git clone https://github.com/conda-forge/pandas-feedstock && git -C pandas-feedstock remote rename origin upstream && git -C pandas-feedstock remote add origin https://github.com/$(GH_USERNAME)/pandas-feedstock
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

didn't use this. I assume not now needed.

git clone --recursive https://github.com/MacPython/pandas-wheels && git -C pandas-wheels remote rename origin upstream && git -C pandas-wheels remote add origin https://github.com/$(GH_USERNAME)/pandas-wheels

update-repos:
git -C pandas checkout master && git -C pandas pull
git -C pandas-wheels checkout master && git -C pandas-wheels pull
git -C pandas-website checkout master && git -C pandas-website pull
git -C pandas-feedstock checkout master && git -C pandas-feedstock pull
pushd pandas-wheels && git submodule update --recursive --remote && popd

Expand Down Expand Up @@ -105,17 +103,6 @@ link-version:

push-doc: | upload-doc link-stable link-version

website:
pushd pandas/web && \
git checkout master && \
git pull && \
./pandas_web.py pandas && \
popd


push-website:
rsync -ravzI -e ssh pandas/web/build/* pandas.pydata.org:/usr/share/nginx/pandas/

push-tag:
pushd pandas && ../scripts/push-tag.py $(TAG) && popd

Expand All @@ -136,7 +123,6 @@ wheels:

download-wheels:
./scripts/download_wheels.py $(PANDAS_VERSION)
# TODO: Fetch from https://www.lfd.uci.edu/~gohlke/pythonlibs/


upload-pypi:
Expand Down
31 changes: 5 additions & 26 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,7 @@
Release automation for pandas.

**Windows users should follow the steps in `windows.md`**

## Steps to a release

- [ ] Manually update
Expand Down Expand Up @@ -73,17 +75,14 @@ Docs. You can cheat and re-tag / rebuild these if needed.
make doc
```

Once the binaries finish, you'll need to manually upload the
wheels to PyPI. Assuming the job which `make wheels` triggered on MacPython completed successfully (you may want to double check this)
you can download a copy of the wheels for Mac / Linux locally.
Once the binaries finish, you'll need to manually upload the wheels to PyPI.

Assuming the job which `make wheels` triggered on MacPython completed successfully (you may want to double check this https://anaconda.org/multibuild-wheels-staging/pandas/files) you can download a copy of the wheels locally.

```
make download-wheels
```

Christoph Gohlke builds the windows wheels. Fetch from from https://www.lfd.uci.edu/~gohlke/pythonlibs/ and download to the same `dist` directory.

Upload the wheels and sdist

```
Expand All @@ -94,41 +93,21 @@ Finalize the docs

```
make upload-doc
make website
```

You also need to make edits to the pandas-website to appropriately display items.
Ideally this could be done via `make push-website` as the rule exists but the
intermediary steps aren't fully automated yet.
To make sure /stable and the latest minor revision point to the new release run the following.

```sh
pushd pandas-website
mv latest.rst previous.rst
# Recreate latest.rst to match release notes from GH in earlier steps
# Update pre_release.json and releases.json
git commit -am "Your updates"
git push
make html
make upload
```

To make sure /stable and the latest minor revision point to the new release run the following from root

```sh
popd # should bring us back to root from pandas-website
make link-stable
make link-version
```

Now check pandas.pydata.org and ensure the sidebar and links are correct!

goto announce.



# Finalize

- [ ] Download Christoph's wheels and upload to PyPI
- [ ] Announce Mailing List
- [ ] Announce Twitter

Expand Down
23 changes: 23 additions & 0 deletions docker-files/windows/Dockerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
FROM continuumio/miniconda3:latest

RUN apt-get update && \
apt-get install -y make rsync && \
apt-get clean

RUN conda update conda -y

RUN git clone https://github.com/pandas-dev/pandas-release

RUN conda env update -n base --file=pandas-release/environment.yml

ARG GH_USERNAME

ENV GH_USERNAME=$GH_USERNAME

WORKDIR pandas-release

RUN make init-repos

RUN git config --global user.email "pandas-dev@python.org"

RUN git config --global user.name "Pandas Development Team"
2 changes: 1 addition & 1 deletion scripts/pip_test.sh
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
#!/usr/bin/env bash
set -e

# Cytyhon is *not* required here.
# Cython is *not* required here.
conda create -n pip-test -y python=3.7 numpy pytz python-dateutil pytest pytest-mock hypothesis nomkl

source activate pip-test
Expand Down
Loading