Skip to content
Self-hosted runner (nightly-past-ci-caller)

Self-hosted runner (nightly-past-ci-caller) #341

Sign in to view logs

Self-hosted runner (nightly-past-ci-caller)

Self-hosted runner (nightly-past-ci-caller) #341

Triggered via schedule December 3, 2024 14:33
@qubvelqubvel
⁠ 2daf2c3
main
Status Failure
Total duration 1d 9h 10m 25s
Artifacts –

self-nightly-past-ci-caller.yml

on: schedule
Get number
0s
Get number
Matrix: PyTorch 1.11 / DeepSpeed CI / Setup
Waiting for pending jobs
Matrix: PyTorch 1.11 / Model CI / Setup
Waiting for pending jobs
Matrix: PyTorch 1.12 / DeepSpeed CI / Setup
Matrix: PyTorch 1.12 / Model CI / Setup
Matrix: PyTorch 1.13 / DeepSpeed CI / Setup
Waiting for pending jobs
Matrix: PyTorch 1.13 / Model CI / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.10 / DeepSpeed CI / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.10 / Model CI / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.11 / DeepSpeed CI / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.11 / Model CI / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.5 / DeepSpeed CI / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.5 / Model CI / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.6 / DeepSpeed CI / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.6 / Model CI / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.7 / DeepSpeed CI / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.7 / Model CI / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.8 / DeepSpeed CI / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.8 / Model CI / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.9 / DeepSpeed CI / Setup
Waiting for pending jobs
Matrix: TensorFlow 2.9 / Model CI / Setup
Waiting for pending jobs
Matrix: PyTorch 1.11 / DeepSpeed CI / Examples directory
Waiting for pending jobs
Matrix: PyTorch 1.11 / DeepSpeed CI / TensorFlow pipelines
Waiting for pending jobs
Matrix: PyTorch 1.11 / DeepSpeed CI / PyTorch pipelines
Waiting for pending jobs
Matrix: PyTorch 1.11 / DeepSpeed CI / Torch CUDA extension tests
Waiting for pending jobs
Matrix: PyTorch 1.11 / Model CI / Examples directory
Waiting for pending jobs
Matrix: PyTorch 1.11 / Model CI / TensorFlow pipelines
Waiting for pending jobs
Matrix: PyTorch 1.11 / Model CI / PyTorch pipelines
Waiting for pending jobs
Matrix: PyTorch 1.11 / Model CI / Torch CUDA extension tests
Waiting for pending jobs
Matrix: PyTorch 1.12 / DeepSpeed CI / Examples directory
Matrix: PyTorch 1.12 / DeepSpeed CI / TensorFlow pipelines
Matrix: PyTorch 1.12 / DeepSpeed CI / PyTorch pipelines
Matrix: PyTorch 1.12 / DeepSpeed CI / Torch CUDA extension tests
Matrix: PyTorch 1.12 / Model CI / Examples directory
Matrix: PyTorch 1.12 / Model CI / TensorFlow pipelines
Matrix: PyTorch 1.12 / Model CI / PyTorch pipelines
Matrix: PyTorch 1.12 / Model CI / Torch CUDA extension tests
Matrix: PyTorch 1.13 / DeepSpeed CI / Examples directory
Waiting for pending jobs
Matrix: PyTorch 1.13 / DeepSpeed CI / TensorFlow pipelines
Waiting for pending jobs
Matrix: PyTorch 1.13 / DeepSpeed CI / PyTorch pipelines
Waiting for pending jobs
Matrix: PyTorch 1.13 / DeepSpeed CI / Torch CUDA extension tests
Waiting for pending jobs
Matrix: PyTorch 1.13 / Model CI / Examples directory
Waiting for pending jobs
Matrix: PyTorch 1.13 / Model CI / TensorFlow pipelines
Waiting for pending jobs
Matrix: PyTorch 1.13 / Model CI / PyTorch pipelines
Waiting for pending jobs
Matrix: PyTorch 1.13 / Model CI / Torch CUDA extension tests
Waiting for pending jobs
Matrix: TensorFlow 2.10 / DeepSpeed CI / Examples directory
Waiting for pending jobs
Matrix: TensorFlow 2.10 / DeepSpeed CI / TensorFlow pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.10 / DeepSpeed CI / PyTorch pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.10 / DeepSpeed CI / Torch CUDA extension tests
Waiting for pending jobs
Matrix: TensorFlow 2.10 / Model CI / Examples directory
Waiting for pending jobs
Matrix: TensorFlow 2.10 / Model CI / TensorFlow pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.10 / Model CI / PyTorch pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.10 / Model CI / Torch CUDA extension tests
Waiting for pending jobs
Matrix: TensorFlow 2.11 / DeepSpeed CI / Examples directory
Waiting for pending jobs
Matrix: TensorFlow 2.11 / DeepSpeed CI / TensorFlow pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.11 / DeepSpeed CI / PyTorch pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.11 / DeepSpeed CI / Torch CUDA extension tests
Waiting for pending jobs
Matrix: TensorFlow 2.11 / Model CI / Examples directory
Waiting for pending jobs
Matrix: TensorFlow 2.11 / Model CI / TensorFlow pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.11 / Model CI / PyTorch pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.11 / Model CI / Torch CUDA extension tests
Waiting for pending jobs
Matrix: TensorFlow 2.5 / DeepSpeed CI / Examples directory
Waiting for pending jobs
Matrix: TensorFlow 2.5 / DeepSpeed CI / TensorFlow pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.5 / DeepSpeed CI / PyTorch pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.5 / DeepSpeed CI / Torch CUDA extension tests
Waiting for pending jobs
Matrix: TensorFlow 2.5 / Model CI / Examples directory
Waiting for pending jobs
Matrix: TensorFlow 2.5 / Model CI / TensorFlow pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.5 / Model CI / PyTorch pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.5 / Model CI / Torch CUDA extension tests
Waiting for pending jobs
Matrix: TensorFlow 2.6 / DeepSpeed CI / Examples directory
Waiting for pending jobs
Matrix: TensorFlow 2.6 / DeepSpeed CI / TensorFlow pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.6 / DeepSpeed CI / PyTorch pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.6 / DeepSpeed CI / Torch CUDA extension tests
Waiting for pending jobs
Matrix: TensorFlow 2.6 / Model CI / Examples directory
Waiting for pending jobs
Matrix: TensorFlow 2.6 / Model CI / TensorFlow pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.6 / Model CI / PyTorch pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.6 / Model CI / Torch CUDA extension tests
Waiting for pending jobs
Matrix: TensorFlow 2.7 / DeepSpeed CI / Examples directory
Waiting for pending jobs
Matrix: TensorFlow 2.7 / DeepSpeed CI / TensorFlow pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.7 / DeepSpeed CI / PyTorch pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.7 / DeepSpeed CI / Torch CUDA extension tests
Waiting for pending jobs
Matrix: TensorFlow 2.7 / Model CI / Examples directory
Waiting for pending jobs
Matrix: TensorFlow 2.7 / Model CI / TensorFlow pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.7 / Model CI / PyTorch pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.7 / Model CI / Torch CUDA extension tests
Waiting for pending jobs
Matrix: TensorFlow 2.8 / DeepSpeed CI / Examples directory
Waiting for pending jobs
Matrix: TensorFlow 2.8 / DeepSpeed CI / TensorFlow pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.8 / DeepSpeed CI / PyTorch pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.8 / DeepSpeed CI / Torch CUDA extension tests
Waiting for pending jobs
Matrix: TensorFlow 2.8 / Model CI / Examples directory
Waiting for pending jobs
Matrix: TensorFlow 2.8 / Model CI / TensorFlow pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.8 / Model CI / PyTorch pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.8 / Model CI / Torch CUDA extension tests
Waiting for pending jobs
Matrix: TensorFlow 2.9 / DeepSpeed CI / Examples directory
Waiting for pending jobs
Matrix: TensorFlow 2.9 / DeepSpeed CI / TensorFlow pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.9 / DeepSpeed CI / PyTorch pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.9 / DeepSpeed CI / Torch CUDA extension tests
Waiting for pending jobs
Matrix: TensorFlow 2.9 / Model CI / Examples directory
Waiting for pending jobs
Matrix: TensorFlow 2.9 / Model CI / TensorFlow pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.9 / Model CI / PyTorch pipelines
Waiting for pending jobs
Matrix: TensorFlow 2.9 / Model CI / Torch CUDA extension tests
Waiting for pending jobs
Matrix: PyTorch 1.11 / DeepSpeed CI /
Waiting for pending jobs
Matrix: PyTorch 1.11 / DeepSpeed CI /
Waiting for pending jobs
Matrix: PyTorch 1.11 / Model CI /
Waiting for pending jobs
Matrix: PyTorch 1.11 / Model CI /
Waiting for pending jobs
Matrix: PyTorch 1.12 / DeepSpeed CI /
Waiting for pending jobs
Matrix: PyTorch 1.12 / DeepSpeed CI /
Matrix: PyTorch 1.12 / Model CI /
Waiting for pending jobs
Matrix: PyTorch 1.12 / Model CI /
Matrix: PyTorch 1.13 / DeepSpeed CI /
Waiting for pending jobs
Matrix: PyTorch 1.13 / DeepSpeed CI /
Waiting for pending jobs
Matrix: PyTorch 1.13 / Model CI /
Waiting for pending jobs
Matrix: PyTorch 1.13 / Model CI /
Waiting for pending jobs
Matrix: TensorFlow 2.10 / DeepSpeed CI /
Waiting for pending jobs
Matrix: TensorFlow 2.10 / DeepSpeed CI /
Waiting for pending jobs
Matrix: TensorFlow 2.10 / Model CI /
Waiting for pending jobs
Matrix: TensorFlow 2.10 / Model CI /
Waiting for pending jobs
Matrix: TensorFlow 2.11 / DeepSpeed CI /
Waiting for pending jobs
Matrix: TensorFlow 2.11 / DeepSpeed CI /
Waiting for pending jobs
Matrix: TensorFlow 2.11 / Model CI /
Waiting for pending jobs
Matrix: TensorFlow 2.11 / Model CI /
Waiting for pending jobs
Matrix: TensorFlow 2.5 / DeepSpeed CI /
Waiting for pending jobs
Matrix: TensorFlow 2.5 / DeepSpeed CI /
Waiting for pending jobs
Matrix: TensorFlow 2.5 / Model CI /
Waiting for pending jobs
Matrix: TensorFlow 2.5 / Model CI /
Waiting for pending jobs
Matrix: TensorFlow 2.6 / DeepSpeed CI /
Waiting for pending jobs
Matrix: TensorFlow 2.6 / DeepSpeed CI /
Waiting for pending jobs
Matrix: TensorFlow 2.6 / Model CI /
Waiting for pending jobs
Matrix: TensorFlow 2.6 / Model CI /
Waiting for pending jobs
Matrix: TensorFlow 2.7 / DeepSpeed CI /
Waiting for pending jobs
Matrix: TensorFlow 2.7 / DeepSpeed CI /
Waiting for pending jobs
Matrix: TensorFlow 2.7 / Model CI /
Waiting for pending jobs
Matrix: TensorFlow 2.7 / Model CI /
Waiting for pending jobs
Matrix: TensorFlow 2.8 / DeepSpeed CI /
Waiting for pending jobs
Matrix: TensorFlow 2.8 / DeepSpeed CI /
Waiting for pending jobs
Matrix: TensorFlow 2.8 / Model CI /
Waiting for pending jobs
Matrix: TensorFlow 2.8 / Model CI /
Waiting for pending jobs
Matrix: TensorFlow 2.9 / DeepSpeed CI /
Waiting for pending jobs
Matrix: TensorFlow 2.9 / DeepSpeed CI /
Waiting for pending jobs
Matrix: TensorFlow 2.9 / Model CI /
Waiting for pending jobs
Matrix: TensorFlow 2.9 / Model CI /
Waiting for pending jobs
PyTorch 1.11  /  ...  /  Extract warnings in CI artifacts
PyTorch 1.11 / DeepSpeed CI / Extract warnings in CI artifacts
PyTorch 1.11  /  ...  /  Extract warnings in CI artifacts
PyTorch 1.11 / Model CI / Extract warnings in CI artifacts
PyTorch 1.12  /  ...  /  Extract warnings in CI artifacts
0s
PyTorch 1.12 / DeepSpeed CI / Extract warnings in CI artifacts
PyTorch 1.12  /  ...  /  Extract warnings in CI artifacts
22s
PyTorch 1.12 / Model CI / Extract warnings in CI artifacts
PyTorch 1.13  /  ...  /  Extract warnings in CI artifacts
PyTorch 1.13 / DeepSpeed CI / Extract warnings in CI artifacts
PyTorch 1.13  /  ...  /  Extract warnings in CI artifacts
PyTorch 1.13 / Model CI / Extract warnings in CI artifacts
TensorFlow 2.10  /  ...  /  Extract warnings in CI artifacts
TensorFlow 2.10 / DeepSpeed CI / Extract warnings in CI artifacts
TensorFlow 2.10  /  ...  /  Extract warnings in CI artifacts
TensorFlow 2.10 / Model CI / Extract warnings in CI artifacts
TensorFlow 2.11  /  ...  /  Extract warnings in CI artifacts
TensorFlow 2.11 / DeepSpeed CI / Extract warnings in CI artifacts
TensorFlow 2.11  /  ...  /  Extract warnings in CI artifacts
TensorFlow 2.11 / Model CI / Extract warnings in CI artifacts
TensorFlow 2.5  /  ...  /  Extract warnings in CI artifacts
TensorFlow 2.5 / DeepSpeed CI / Extract warnings in CI artifacts
TensorFlow 2.5  /  ...  /  Extract warnings in CI artifacts
TensorFlow 2.5 / Model CI / Extract warnings in CI artifacts
TensorFlow 2.6  /  ...  /  Extract warnings in CI artifacts
TensorFlow 2.6 / DeepSpeed CI / Extract warnings in CI artifacts
TensorFlow 2.6  /  ...  /  Extract warnings in CI artifacts
TensorFlow 2.6 / Model CI / Extract warnings in CI artifacts
TensorFlow 2.7  /  ...  /  Extract warnings in CI artifacts
TensorFlow 2.7 / DeepSpeed CI / Extract warnings in CI artifacts
TensorFlow 2.7  /  ...  /  Extract warnings in CI artifacts
TensorFlow 2.7 / Model CI / Extract warnings in CI artifacts
TensorFlow 2.8  /  ...  /  Extract warnings in CI artifacts
TensorFlow 2.8 / DeepSpeed CI / Extract warnings in CI artifacts
TensorFlow 2.8  /  ...  /  Extract warnings in CI artifacts
TensorFlow 2.8 / Model CI / Extract warnings in CI artifacts
TensorFlow 2.9  /  ...  /  Extract warnings in CI artifacts
TensorFlow 2.9 / DeepSpeed CI / Extract warnings in CI artifacts
TensorFlow 2.9  /  ...  /  Extract warnings in CI artifacts
TensorFlow 2.9 / Model CI / Extract warnings in CI artifacts
PyTorch 1.11  /  ...  /  Send results to webhook
PyTorch 1.11 / DeepSpeed CI / Slack Report / Send results to webhook
PyTorch 1.11  /  ...  /  Send results to webhook
PyTorch 1.11 / Model CI / Slack Report / Send results to webhook
PyTorch 1.12  /  ...  /  Send results to webhook
12s
PyTorch 1.12 / DeepSpeed CI / Slack Report / Send results to webhook
PyTorch 1.12  /  ...  /  Send results to webhook
12s
PyTorch 1.12 / Model CI / Slack Report / Send results to webhook
PyTorch 1.13  /  ...  /  Send results to webhook
PyTorch 1.13 / DeepSpeed CI / Slack Report / Send results to webhook
PyTorch 1.13  /  ...  /  Send results to webhook
PyTorch 1.13 / Model CI / Slack Report / Send results to webhook
TensorFlow 2.10  /  ...  /  Send results to webhook
TensorFlow 2.10 / DeepSpeed CI / Slack Report / Send results to webhook
TensorFlow 2.10  /  ...  /  Send results to webhook
TensorFlow 2.10 / Model CI / Slack Report / Send results to webhook
TensorFlow 2.11  /  ...  /  Send results to webhook
TensorFlow 2.11 / DeepSpeed CI / Slack Report / Send results to webhook
TensorFlow 2.11  /  ...  /  Send results to webhook
TensorFlow 2.11 / Model CI / Slack Report / Send results to webhook
TensorFlow 2.5  /  ...  /  Send results to webhook
TensorFlow 2.5 / DeepSpeed CI / Slack Report / Send results to webhook
TensorFlow 2.5  /  ...  /  Send results to webhook
TensorFlow 2.5 / Model CI / Slack Report / Send results to webhook
TensorFlow 2.6  /  ...  /  Send results to webhook
TensorFlow 2.6 / DeepSpeed CI / Slack Report / Send results to webhook
TensorFlow 2.6  /  ...  /  Send results to webhook
TensorFlow 2.6 / Model CI / Slack Report / Send results to webhook
TensorFlow 2.7  /  ...  /  Send results to webhook
TensorFlow 2.7 / DeepSpeed CI / Slack Report / Send results to webhook
TensorFlow 2.7  /  ...  /  Send results to webhook
TensorFlow 2.7 / Model CI / Slack Report / Send results to webhook
TensorFlow 2.8  /  ...  /  Send results to webhook
TensorFlow 2.8 / DeepSpeed CI / Slack Report / Send results to webhook
TensorFlow 2.8  /  ...  /  Send results to webhook
TensorFlow 2.8 / Model CI / Slack Report / Send results to webhook
TensorFlow 2.9  /  ...  /  Send results to webhook
TensorFlow 2.9 / DeepSpeed CI / Slack Report / Send results to webhook
TensorFlow 2.9  /  ...  /  Send results to webhook
TensorFlow 2.9 / Model CI / Slack Report / Send results to webhook
Fit to window
Zoom out
Zoom in

Annotations

7 errors and 1 warning
PyTorch 1.12 / DeepSpeed CI / Torch CUDA extension tests (multi-gpu)
This request was automatically failed because there were no enabled runners online to process the request for more than 1 days.
PyTorch 1.12 / DeepSpeed CI / Torch CUDA extension tests (single-gpu)
This request was automatically failed because there were no enabled runners online to process the request for more than 1 days.
PyTorch 1.12 / Model CI / Setup (multi-gpu)
This request was automatically failed because there were no enabled runners online to process the request for more than 1 days.
PyTorch 1.12 / Model CI / Setup (single-gpu)
This request was automatically failed because there were no enabled runners online to process the request for more than 1 days.
PyTorch 1.12 / DeepSpeed CI / Slack Report / Send results to webhook
Process completed with exit code 1.
PyTorch 1.12 / Model CI / Extract warnings in CI artifacts
Process completed with exit code 2.
PyTorch 1.12 / Model CI / Slack Report / Send results to webhook
Process completed with exit code 1.
PyTorch 1.12 / Model CI / Extract warnings in CI artifacts
No files were found with the provided path: warnings_in_ci/selected_warnings.json. No artifacts will be uploaded.