Switch to using the DAG executors from Merlin Core #1666
Conversation
karlhigley
requested review from
oliverholworthy,
jperez999 and
nv-alaiacano
Click to view CI ResultsGitHub pull request #1666 of commit 92d14de6fd5d0c4cfac5a9b160adeda081d9c792, no merge conflicts.
Running as SYSTEM
Setting status of 92d14de6fd5d0c4cfac5a9b160adeda081d9c792 to PENDING with url http://10.20.17.181:8080/job/nvtabular_tests/4668/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/pull/1666/*:refs/remotes/origin/pr/1666/* # timeout=10
> git rev-parse 92d14de6fd5d0c4cfac5a9b160adeda081d9c792^{commit} # timeout=10
Checking out Revision 92d14de6fd5d0c4cfac5a9b160adeda081d9c792 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 92d14de6fd5d0c4cfac5a9b160adeda081d9c792 # timeout=10
Commit message: "Switch to using the DAG executors from Merlin Core"
> git rev-list --no-walk 13e0d171d078a99aba2d07e6693af534226af58a # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins13308135930640318012.sh
ImportError while loading conftest '/var/jenkins_home/workspace/nvtabular_tests/nvtabular/tests/conftest.py'.
tests/conftest.py:58: in
import nvtabular
nvtabular/__init__.py:24: in
from nvtabular import workflow # noqa
nvtabular/workflow/__init__.py:19: in
from nvtabular.workflow.workflow import Workflow
nvtabular/workflow/workflow.py:33: in
from merlin.dag.executors import DaskExecutor
E ModuleNotFoundError: No module named 'merlin.dag.executors'
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins9093452816394381211.sh
|
Click to view CI ResultsGitHub pull request #1666 of commit 15f45d17d73c173a168fe178b330d57ec5c446f4, no merge conflicts.
Running as SYSTEM
Setting status of 15f45d17d73c173a168fe178b330d57ec5c446f4 to PENDING with url http://10.20.17.181:8080/job/nvtabular_tests/4670/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/pull/1666/*:refs/remotes/origin/pr/1666/* # timeout=10
> git rev-parse 15f45d17d73c173a168fe178b330d57ec5c446f4^{commit} # timeout=10
Checking out Revision 15f45d17d73c173a168fe178b330d57ec5c446f4 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 15f45d17d73c173a168fe178b330d57ec5c446f4 # timeout=10
Commit message: "Add `merlin-core` from `main` branch to test deps"
> git rev-list --no-walk ff60741e92ba790994b125d4a0c73b4198e5c330 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins3741329426095815675.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: pyproject.toml
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-3.0.0
collected 1430 items / 1 skipped
|
Click to view CI ResultsGitHub pull request #1666 of commit e70fc2731648a4c82d74617a6e32583a2da9e4d3, no merge conflicts.
Running as SYSTEM
Setting status of e70fc2731648a4c82d74617a6e32583a2da9e4d3 to PENDING with url http://10.20.17.181:8080/job/nvtabular_tests/4685/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/pull/1666/*:refs/remotes/origin/pr/1666/* # timeout=10
> git rev-parse e70fc2731648a4c82d74617a6e32583a2da9e4d3^{commit} # timeout=10
Checking out Revision e70fc2731648a4c82d74617a6e32583a2da9e4d3 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f e70fc2731648a4c82d74617a6e32583a2da9e4d3 # timeout=10
Commit message: "Merge branch 'main' into refactor/core-executors"
> git rev-list --no-walk 2b895c7f2c5c2a80fb8efb4ea80a547d910164dc # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins1826247516286441231.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: pyproject.toml
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-3.0.0
collected 1429 items / 1 skipped
|
Documentation preview |
* Switch to using the DAG executors from Merlin Core * Add `merlin-core` from `main` branch to test deps
No description provided.