Parallel Tests

[msaroufim]

The PR allows for parallel test execution using pytest-xdist. However out of the box that extension does not ensure each test is running on its own GPU so we assign new tests to a free GPU using a pytest harness

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/511

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 6 New Failures

As of commit 4905f68 with merge base f7571cf ():

NEW FAILURES - The following jobs have failed:

• Run Regression Tests / test (CPU 2.2.2, linux.4xlarge, torch==2.2.2 --index-url https://download.pytorch.org/whl/cpu, cpu) / linux-job (gh)
  RuntimeError: Command docker exec -t 218670d5505d891c4d6c411dff736e040ddc7a248ce33bd2c61c40d8b7739304 /exec failed with exit code 1
• Run Regression Tests / test (CPU 2.3, linux.4xlarge, torch==2.3.0 --index-url https://download.pytorch.org/whl/cpu, cpu) / linux-job (gh)
  RuntimeError: Command docker exec -t c2a2e23a44bbc46c5572c93c9ee558c42b4e7ece1c830ed6d38602fa8fa7e9a9 /exec failed with exit code 1
• Run Regression Tests / test (CPU Nightly, linux.4xlarge, --pre torch==2.5.0.dev20240709+cpu --index-url https://download... / linux-job (gh)
  RuntimeError: Command docker exec -t 992ae8c9ef5e29d8300f89a0f9aac8e44d84a41d67909821520301722d8241e4 /exec failed with exit code 1
• Run Regression Tests / test (CUDA 2.2.2, linux.g5.12xlarge.nvidia.gpu, torch==2.2.2, cuda, 12.1) / linux-job (gh)
  test/prototype/test_low_bit_optim.py::TestQuantize::test_quantize_4bit_with_qmap_compile_device_cuda
• Run Regression Tests / test (CUDA 2.3, linux.g5.12xlarge.nvidia.gpu, torch==2.3.0, cuda, 12.1) / linux-job (gh)
  test/prototype/test_low_bit_optim.py::TestQuantize::test_quantize_4bit_with_qmap_compile_device_cuda
• Run Regression Tests / test (CUDA Nightly, linux.g5.12xlarge.nvidia.gpu, --pre torch==2.5.0.dev20240709+cu121 --index-ur... / linux-job (gh)
  RuntimeError: Command docker exec -t a9425befee0fae476182acb151bdcda6d9aa96a805800d2c62a6e2a28585efc8 /exec failed with exit code 1

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[msaroufim]

Replaced by #518