Skip to content

Commit

Permalink
Update container for import action (#6883)
Browse files Browse the repository at this point in the history
* update container

Signed-off-by: ericharper <complex451@gmail.com>

* run import tests in parallel, isntall Cython

Signed-off-by: ericharper <complex451@gmail.com>

* fix typo

Signed-off-by: ericharper <complex451@gmail.com>

* remove redundant comment

Signed-off-by: ericharper <complex451@gmail.com>

* fix more typos

Signed-off-by: ericharper <complex451@gmail.com>

* upload and download wheel

Signed-off-by: ericharper <complex451@gmail.com>

* fix typos

Signed-off-by: ericharper <complex451@gmail.com>

* fix typos

Signed-off-by: ericharper <complex451@gmail.com>

* test order

Signed-off-by: ericharper <complex451@gmail.com>

* remove name

Signed-off-by: ericharper <complex451@gmail.com>

* fix indent

Signed-off-by: ericharper <complex451@gmail.com>

* add names back

Signed-off-by: ericharper <complex451@gmail.com>

* don't upload or download just build in parallel

Signed-off-by: ericharper <complex451@gmail.com>

---------

Signed-off-by: ericharper <complex451@gmail.com>
  • Loading branch information
ericharper authored Jun 20, 2023
1 parent e418f71 commit 63d9b2c
Showing 1 changed file with 53 additions and 9 deletions.
62 changes: 53 additions & 9 deletions .github/workflows/import-test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -6,25 +6,24 @@ on:
paths:
- "**"

# Check https://hub.docker.com/r/pytorch/pytorch/tags for latest tags
jobs:
ci-import-check:
runs-on: ubuntu-latest

# Check https://hub.docker.com/r/pytorch/pytorch/tags for latest tags
test-asr-imports:
runs-on: ubuntu-latest
container:
image: pytorch/pytorch:1.11.0-cuda11.3-cudnn8-runtime

image: pytorch/pytorch:2.0.1-cuda11.7-cudnn8-runtime
steps:
- uses: actions/checkout@v2

- name: Checkout repo
uses: actions/checkout@v2
- name: Update base dependencies
run: |
apt-get update && apt-get install -y build-essential
apt-get install -y libsndfile1 make
- name: Install nemo dependencies
id: nemo-wheel
run: |
pip install Cython
# install test requirements
pip install -r requirements/requirements_test.txt
# Build nemo as a wheel
Expand All @@ -33,7 +32,6 @@ jobs:
# Preserve wheel location
DIST_FILE=$(find ./dist -name "*.whl" | head -n 1)
echo "::set-output name=DIST_FILE::${DIST_FILE}"
- name: Test ASR Domain Imports
run: |
# Install NeMo Domain
Expand All @@ -43,6 +41,29 @@ jobs:
# Uninstall NeMo
pip uninstall -y nemo_toolkit
test-tts-imports:
runs-on: ubuntu-latest
container:
image: pytorch/pytorch:2.0.1-cuda11.7-cudnn8-runtime
steps:
- name: Checkout repo
uses: actions/checkout@v2
- name: Update base dependencies
run: |
apt-get update && apt-get install -y build-essential
apt-get install -y libsndfile1 make
- name: Install nemo dependencies
id: nemo-wheel
run: |
pip install Cython
# install test requirements
pip install -r requirements/requirements_test.txt
# Build nemo as a wheel
pip install build
python -m build --no-isolation --wheel
# Preserve wheel location
DIST_FILE=$(find ./dist -name "*.whl" | head -n 1)
echo "::set-output name=DIST_FILE::${DIST_FILE}"
- name: Test TTS Domain Imports
run: |
# Install NeMo Domain
Expand All @@ -52,6 +73,29 @@ jobs:
# Uninstall NeMo
pip uninstall -y nemo_toolkit
test-nlp-imports:
runs-on: ubuntu-latest
container:
image: pytorch/pytorch:2.0.1-cuda11.7-cudnn8-runtime
steps:
- name: Checkout repo
uses: actions/checkout@v2
- name: Update base dependencies
run: |
apt-get update && apt-get install -y build-essential
apt-get install -y libsndfile1 make
- name: Install nemo dependencies
id: nemo-wheel
run: |
pip install Cython
# install test requirements
pip install -r requirements/requirements_test.txt
# Build nemo as a wheel
pip install build
python -m build --no-isolation --wheel
# Preserve wheel location
DIST_FILE=$(find ./dist -name "*.whl" | head -n 1)
echo "::set-output name=DIST_FILE::${DIST_FILE}"
- name: Test NLP Domain Imports
run: |
# Install NeMo Domain
Expand Down

0 comments on commit 63d9b2c

Please sign in to comment.