Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade build actions for release #1779

Merged
merged 15 commits into from
May 28, 2024
Merged
Show file tree
Hide file tree
Changes from 10 commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
177 changes: 101 additions & 76 deletions .github/workflows/build.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,15 @@
name: Build

on:
push:
paths:
- '.conda/meta.yaml'
- '.conda_mac/meta.yaml'
- '.github/workflows/build.yml'
branches:
# - develop
# - fakebranch
- elizabeth/upgrade-actions-for-release
release:
types:
- published
Expand All @@ -18,9 +27,11 @@ jobs:
include:
# Use this condarc as default
- condarc: .conda/condarc.yaml
- pyver: "3.7"
# Use special condarc if macos
- os: "macos-14"
condarc: .conda_mac/condarc.yaml
pyver: "3.9"
steps:
# Setup
- uses: actions/checkout@v2
Expand All @@ -32,20 +43,31 @@ jobs:
with:
path: ~/conda_pkgs_dir
key: ${{ runner.os }}-conda-${{ env.CACHE_NUMBER }}-${{ hashFiles('environment_build.yml', 'requirements.txt') }}

- name: Setup Miniconda
# https://github.com/conda-incubator/setup-miniconda
uses: conda-incubator/setup-miniconda@v2.0.1
uses: conda-incubator/setup-miniconda@v3.0.3
with:
python-version: 3.7
use-only-tar-bz2: true # IMPORTANT: This needs to be set for caching to work properly!
environment-file: environment_build.yml
miniforge-version: latest
condarc-file: ${{ matrix.condarc }}
python-version: ${{ matrix.pyver }}
environment-file: environment_build.yml
activate-environment: sleap_ci
conda-solver: "libmamba"
# `use-only-tar-bz2: true` is breaking the build across all platforms. The environment is not able to resolve. Turned off for now.
# Error message:
# """...
# File "/home/runner/miniconda3/envs/sleap_ci/lib/python3.7/site-packages/conda_build/environ.py", line 801, in get_install_actions
# raise DependencyNeedsBuildingError(exc, subdir=subdir)
# conda_build.exceptions.DependencyNeedsBuildingError: Unsatisfiable dependencies for platform linux-64: {'conda-forge::ndx-pose'}
# """"
# use-only-tar-bz2: true # IMPORTANT: This needs to be set for caching to work properly!

- name: Print environment info
shell: bash -l {0}
run: |
which python
conda info
conda list

# Build pip wheel (Ubuntu)
- name: Build pip wheel (Ubuntu)
Expand All @@ -69,20 +91,23 @@ jobs:
shell: bash -l {0}
run: |
conda build .conda --output-folder build
echo "BUILD_PATH=$(pwd)/build" >> "$GITHUB_ENV"

# Build conda package (Windows)
# Build conda package (Windows)
- name: Build conda package (Windows)
if: matrix.os == 'windows-2022'
shell: powershell
run: |
conda build .conda --output-folder build
echo "BUILD_PATH=\$(pwd)\build" >> "$env:GITHUB_ENV"

# Build conda package (Mac)
- name: Build conda package (Mac)
if: matrix.os == 'macos-14'
shell: bash -l {0}
run: |
conda build .conda_mac --output-folder build
echo "BUILD_PATH=$(pwd)/build" >> "$GITHUB_ENV"

# Test built conda package (Ubuntu and Windows)
- name: Test built conda package (Ubuntu and Windows)
Expand All @@ -91,7 +116,7 @@ jobs:
run: |
echo "Current build path: $BUILD_PATH"
conda deactivate

echo "Python executable before activating environment:"
which python
echo "Python version before activating environment:"
Expand All @@ -113,7 +138,7 @@ jobs:
conda list
echo "List of installed pip packages in the sleap_test environment:"
pip list

echo "Testing sleap package installation..."
sleap_version=$(python -c "import sleap; print(sleap.__version__)")
echo "Test completed using sleap version: $sleap_version"
Expand All @@ -125,18 +150,18 @@ jobs:
run: |
echo "Current build path: $BUILD_PATH"
conda deactivate

echo "Python executable before activating environment:"
which python
echo "Python version before activating environment:"
python --version
echo "Conda info before activating environment:"
conda info

echo "Creating and testing conda environment with sleap package..."
conda create -y -n sleap_test -c file://$BUILD_PATH -c conda-forge -c anaconda sleap
conda activate sleap_test

echo "Python executable after activating sleap_test environment:"
which python
echo "Python version after activating sleap_test environment:"
Expand All @@ -147,76 +172,76 @@ jobs:
conda list
echo "List of installed pip packages in the sleap_test environment:"
pip list

echo "Testing sleap package installation..."
sleap_version=$(python -c "import sleap; print(sleap.__version__)")
echo "Test completed using sleap version: $sleap_version"

# Login to conda (Ubuntu)
- name: Login to Anaconda (Ubuntu)
if: matrix.os == 'ubuntu-22.04'
env:
ANACONDA_LOGIN: ${{ secrets.ANACONDA_LOGIN }}
shell: bash -l {0}
run: |
yes 2>/dev/null | anaconda login --username sleap --password "$ANACONDA_LOGIN" || true

# Login to conda (Windows)
- name: Login to Anaconda (Windows)
if: matrix.os == 'windows-2019'
env:
ANACONDA_LOGIN: ${{ secrets.ANACONDA_LOGIN }}
shell: powershell
run: |
echo "yes" | anaconda login --username sleap --password "$env:ANACONDA_LOGIN"
# # Login to conda (Ubuntu)
# - name: Login to Anaconda (Ubuntu)
# if: matrix.os == 'ubuntu-22.04'
# env:
# ANACONDA_LOGIN: ${{ secrets.ANACONDA_LOGIN }}
# shell: bash -l {0}
# run: |
# yes 2>/dev/null | anaconda login --username sleap --password "$ANACONDA_LOGIN" || true

# # Login to conda (Windows)
# - name: Login to Anaconda (Windows)
# if: matrix.os == 'windows-2019'
# env:
# ANACONDA_LOGIN: ${{ secrets.ANACONDA_LOGIN }}
# shell: powershell
# run: |
# echo "yes" | anaconda login --username sleap --password "$env:ANACONDA_LOGIN"

# Login to conda (Mac)
- name: Login to Anaconda (Mac)
if: matrix.os == 'macos-14'
env:
ANACONDA_LOGIN: ${{ secrets.ANACONDA_LOGIN }}
shell: bash -l {0}
run: |
yes 2>/dev/null | anaconda login --username sleap --password "$ANACONDA_LOGIN" || true
# # Login to conda (Mac)
# - name: Login to Anaconda (Mac)
# if: matrix.os == 'macos-14'
# env:
# ANACONDA_LOGIN: ${{ secrets.ANACONDA_LOGIN }}
# shell: bash -l {0}
# run: |
# yes 2>/dev/null | anaconda login --username sleap --password "$ANACONDA_LOGIN" || true

# Upload conda package (Windows)
- name: Upload conda package (Windows/main)
if: matrix.os == 'windows-2019' && !github.event.release.prerelease
shell: powershell
run: |
anaconda -v upload "build\win-64\*.tar.bz2"
- name: Upload conda package (Windows/dev)
if: matrix.os == 'windows-2019' && github.event.release.prerelease
shell: powershell
run: |
anaconda -v upload "build\win-64\*.tar.bz2" --label dev

# Upload conda package (Ubuntu)
- name: Upload conda package (Ubuntu/main)
if: matrix.os == 'ubuntu-22.04' && !github.event.release.prerelease
shell: bash -l {0}
run: |
anaconda -v upload build/linux-64/*.tar.bz2
- name: Upload conda package (Ubuntu/dev)
if: matrix.os == 'ubuntu-22.04' && github.event.release.prerelease
shell: bash -l {0}
run: |
anaconda -v upload build/linux-64/*.tar.bz2 --label dev
# # Upload conda package (Windows)
# - name: Upload conda package (Windows/main)
# if: matrix.os == 'windows-2019' && !github.event.release.prerelease
# shell: powershell
# run: |
# anaconda -v upload "build\win-64\*.tar.bz2"
# - name: Upload conda package (Windows/dev)
# if: matrix.os == 'windows-2019' && github.event.release.prerelease
# shell: powershell
# run: |
# anaconda -v upload "build\win-64\*.tar.bz2" --label dev

# # Upload conda package (Ubuntu)
# - name: Upload conda package (Ubuntu/main)
# if: matrix.os == 'ubuntu-22.04' && !github.event.release.prerelease
# shell: bash -l {0}
# run: |
# anaconda -v upload build/linux-64/*.tar.bz2
# - name: Upload conda package (Ubuntu/dev)
# if: matrix.os == 'ubuntu-22.04' && github.event.release.prerelease
# shell: bash -l {0}
# run: |
# anaconda -v upload build/linux-64/*.tar.bz2 --label dev

# Upload conda package (Mac)
- name: Upload conda package (Mac/main)
if: matrix.os == 'macos-14' && !github.event.release.prerelease
shell: bash -l {0}
run: |
anaconda -v upload build/osx-arm64/*.tar.bz2 --label dev
- name: Upload conda package (Mac/dev)
if: matrix.os == 'macos-14' && github.event.release.prerelease
shell: bash -l {0}
run: |
anaconda -v upload build/osx-arm64/*.tar.bz2 --label dev
# # Upload conda package (Mac)
# - name: Upload conda package (Mac/main)
# if: matrix.os == 'macos-14' && !github.event.release.prerelease
# shell: bash -l {0}
# run: |
# anaconda -v upload build/osx-arm64/*.tar.bz2 --label dev
# - name: Upload conda package (Mac/dev)
# if: matrix.os == 'macos-14' && github.event.release.prerelease
# shell: bash -l {0}
# run: |
# anaconda -v upload build/osx-arm64/*.tar.bz2 --label dev

# Logout
- name: Logout from Anaconda
shell: bash -l {0}
run: |
anaconda logout
# # Logout
# - name: Logout from Anaconda
# shell: bash -l {0}
# run: |
# anaconda logout
2 changes: 1 addition & 1 deletion sleap/version.py
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@
"""


__version__ = "1.4.0a0"
__version__ = "1.4.0a1"


def versions():
Expand Down
Loading