Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix setuptools for ci #1459

Closed
wants to merge 15 commits into from
Closed

fix setuptools for ci #1459

wants to merge 15 commits into from

Conversation

jperez999
Copy link
Contributor

fixes ci that is broken on "unix user" setup tools issues. pypa/setuptools#2938

@jperez999
fixed lambdaop call
48e140b
@jperez999
Merge branch 'main' of https://github.com/NVIDIA-MERLIN/nvtabular
2e20d93
@jperez999
Merge branch 'main' of https://github.com/NVIDIA-MERLIN/nvtabular int…
5075cda 
…o main
@jperez999
Merge branch 'main' of https://github.com/NVIDIA-MERLIN/nvtabular int…
7cc777c 
…o main
@jperez999
Merge branch 'main' of https://github.com/NVIDIA-MERLIN/nvtabular
31f5b27
@jperez999
Merge branch 'main' of https://github.com/NVIDIA-MERLIN/nvtabular
01e9fb1
@jperez999
prop change of dtype kwarg in lambda to torch example
2c593ce
@jperez999
Merge branch 'main' of https://github.com/NVIDIA-MERLIN/nvtabular int…
e7ae37e 
…o main
@jperez999
Merge branch 'main' of https://github.com/NVIDIA-MERLIN/nvtabular
1993d25
@jperez999
Merge branch 'main' of https://github.com/NVIDIA-MERLIN/nvtabular
96f275f
@jperez999
Merge branch 'main' of https://github.com/NVIDIA-MERLIN/nvtabular
961316e
@jperez999
Merge branch 'main' of https://github.com/NVIDIA-MERLIN/nvtabular int…
c809779 
…o main
@jperez999
Merge branch 'main' of https://github.com/NVIDIA-MERLIN/nvtabular
e40e9cf
@jperez999
added index migration support for faiss
7d15afe
@jperez999
setuptools removal
f7e0e3f
@jperez999 jperez999 closed this Mar 16, 2022
@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #1459 of commit f7e0e3ffa3b1f6d89cbf585c4461c2c9646bfb83, no merge conflicts.
Running as SYSTEM
Setting status of f7e0e3ffa3b1f6d89cbf585c4461c2c9646bfb83 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/4323/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/pull/1459/*:refs/remotes/origin/pr/1459/* # timeout=10
 > git rev-parse f7e0e3ffa3b1f6d89cbf585c4461c2c9646bfb83^{commit} # timeout=10
Checking out Revision f7e0e3ffa3b1f6d89cbf585c4461c2c9646bfb83 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f f7e0e3ffa3b1f6d89cbf585c4461c2c9646bfb83 # timeout=10
Commit message: "setuptools removal"
 > git rev-list --no-walk 7c6574f7055e4f87dbbb7b31d0d3891bc319a2dc # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins3227343384683324664.sh
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: setuptools in /usr/local/lib/python3.8/dist-packages (60.10.0)
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (22.0.4)
Requirement already satisfied: setuptools in /usr/local/lib/python3.8/dist-packages (60.10.0)
Requirement already satisfied: wheel in /var/jenkins_home/.local/lib/python3.8/site-packages (0.37.1)
Requirement already satisfied: pybind11 in /var/jenkins_home/.local/lib/python3.8/site-packages (2.9.1)
Requirement already satisfied: numpy==1.20.3 in /var/jenkins_home/.local/lib/python3.8/site-packages (1.20.3)
Found existing installation: nvtabular 0.11.0+19.ge1f0d6e
Can't uninstall 'nvtabular'. No files were found to uninstall.
Found existing installation: merlin-core 0.1.1+10.gc2aaca5
Can't uninstall 'merlin-core'. No files were found to uninstall.
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git
  Cloning https://github.com/NVIDIA-Merlin/core.git to /tmp/pip-install-yy62j813/merlin-core_99d83212eaf142d5b7c626759f77cf46
  Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/core.git /tmp/pip-install-yy62j813/merlin-core_99d83212eaf142d5b7c626759f77cf46
  Resolved https://github.com/NVIDIA-Merlin/core.git to commit 53b1ffc0b135c1dddc7f89c6686da062cedf8dab
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: dask==2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (2021.11.2)
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (3.19.4)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (21.3)
Requirement already satisfied: pyarrow>=1.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (5.0.0)
Requirement already satisfied: distributed==2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (2021.11.2)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.2.5)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.7.0)
Requirement already satisfied: numba>=0.53.1 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (0.55.1)
Requirement already satisfied: pandas>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.4.1)
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (4.63.0)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask==2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.2.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask==2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (0.11.2)
Requirement already satisfied: pyyaml in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask==2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (5.4.1)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask==2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (2.0.0)
Requirement already satisfied: fsspec>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from dask==2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (2021.11.0)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (3.0.3)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed==2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (2.0.0)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed==2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (5.8.0)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed==2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.7.0)
Requirement already satisfied: setuptools in /usr/local/lib/python3.8/dist-packages (from distributed==2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (60.10.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (8.0.4)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.0.3)
Requirement already satisfied: tornado>=6.0.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg (from distributed==2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (6.1)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed==2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (2.4.0)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (0.4.2)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.2.0)
Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in /usr/local/lib/python3.8/dist-packages (from numba>=0.53.1->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (0.38.0)
Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.53.1->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.20.3)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (3.0.7)
Requirement already satisfied: pytz>=2020.1 in /usr/local/lib/python3.8/dist-packages (from pandas>=1.2.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (2021.3)
Requirement already satisfied: python-dateutil>=2.8.1 in /usr/local/lib/python3.8/dist-packages (from pandas>=1.2.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (2.8.2)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /var/jenkins_home/.local/lib/python3.8/site-packages/absl_py-0.12.0-py3.8.egg (from tensorflow-metadata>=1.2.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (0.12.0)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.55.0)
Requirement already satisfied: six in /var/jenkins_home/.local/lib/python3.8/site-packages (from absl-py<2.0.0,>=0.9->tensorflow-metadata>=1.2.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.15.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask==2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (0.2.1)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed==2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.0.1)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (4.1.0)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (6.0.2)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from jinja2->distributed==2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (2.1.0)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (4.0.0)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (6.0.1)
Building wheels for collected packages: merlin-core
  Building wheel for merlin-core (pyproject.toml): started
  Building wheel for merlin-core (pyproject.toml): finished with status 'done'
  Created wheel for merlin-core: filename=merlin_core-0.1.1+12.g53b1ffc-py3-none-any.whl size=128879 sha256=153e02b01c2910703023e83b63d7ee7677e2203f8511da0b1e0a5441d02bec60
  Stored in directory: /tmp/pip-ephem-wheel-cache-rbbi4d9n/wheels/c8/38/16/a6968787eafcec5fa772148af8408b089562f71af0752e8e84
Successfully built merlin-core
Installing collected packages: merlin-core
Successfully installed merlin-core-0.1.1+12.g53b1ffc
running develop
running egg_info
creating nvtabular.egg-info
writing nvtabular.egg-info/PKG-INFO
writing dependency_links to nvtabular.egg-info/dependency_links.txt
writing requirements to nvtabular.egg-info/requires.txt
writing top-level names to nvtabular.egg-info/top_level.txt
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
/usr/local/lib/python3.8/dist-packages/setuptools/command/easy_install.py:144: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools.
  warnings.warn(
/usr/local/lib/python3.8/dist-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
  warnings.warn(
package init file 'ci/__init__.py' not found (or not a regular file)
package init file 'images/__init__.py' not found (or not a regular file)
package init file 'docs/__init__.py' not found (or not a regular file)
package init file 'cpp/__init__.py' not found (or not a regular file)
package init file 'bench/__init__.py' not found (or not a regular file)
package init file 'merlin/__init__.py' not found (or not a regular file)
package init file 'examples/__init__.py' not found (or not a regular file)
package init file 'conda/__init__.py' not found (or not a regular file)
package init file 'docs/source/__init__.py' not found (or not a regular file)
package init file 'docs/source/_templates/__init__.py' not found (or not a regular file)
package init file 'docs/source/images/__init__.py' not found (or not a regular file)
package init file 'docs/source/training/__init__.py' not found (or not a regular file)
package init file 'docs/source/api/__init__.py' not found (or not a regular file)
package init file 'docs/source/examples/__init__.py' not found (or not a regular file)
package init file 'docs/source/resources/__init__.py' not found (or not a regular file)
package init file 'docs/source/api/ops/__init__.py' not found (or not a regular file)
package init file 'docs/source/api/workflow/__init__.py' not found (or not a regular file)
package init file 'docs/source/examples/getting-started-movielens/__init__.py' not found (or not a regular file)
package init file 'docs/source/examples/tabular-data-rossmann/__init__.py' not found (or not a regular file)
package init file 'docs/source/examples/advanced-ops-outbrain/__init__.py' not found (or not a regular file)
package init file 'docs/source/examples/scaling-criteo/__init__.py' not found (or not a regular file)
package init file 'docs/source/examples/winning-solution-recsys2020-twitter/__init__.py' not found (or not a regular file)
package init file 'docs/source/examples/scaling-criteo/imgs/__init__.py' not found (or not a regular file)
package init file 'cpp/nvtabular/__init__.py' not found (or not a regular file)
package init file 'cpp/nvtabular/inference/__init__.py' not found (or not a regular file)
package init file 'bench/datasets/__init__.py' not found (or not a regular file)
package init file 'bench/torch/__init__.py' not found (or not a regular file)
package init file 'bench/examples/__init__.py' not found (or not a regular file)
package init file 'bench/datasets/configs/__init__.py' not found (or not a regular file)
package init file 'bench/datasets/tools/__init__.py' not found (or not a regular file)
package init file 'bench/torch/criteo/__init__.py' not found (or not a regular file)
package init file 'merlin/systems/__init__.py' not found (or not a regular file)
package init file 'examples/tensorflow/__init__.py' not found (or not a regular file)
package init file 'examples/getting-started-movielens/__init__.py' not found (or not a regular file)
package init file 'examples/multi-gpu-toy-example/__init__.py' not found (or not a regular file)
package init file 'examples/tabular-data-rossmann/__init__.py' not found (or not a regular file)
package init file 'examples/advanced-ops-outbrain/__init__.py' not found (or not a regular file)
package init file 'examples/multi-gpu-movielens/__init__.py' not found (or not a regular file)
package init file 'examples/scaling-criteo/__init__.py' not found (or not a regular file)
package init file 'examples/winning-solution-recsys2020-twitter/__init__.py' not found (or not a regular file)
package init file 'examples/tensorflow/docker/__init__.py' not found (or not a regular file)
package init file 'examples/tensorflow/imgs/__init__.py' not found (or not a regular file)
package init file 'examples/getting-started-movielens/imgs/__init__.py' not found (or not a regular file)
package init file 'examples/scaling-criteo/imgs/__init__.py' not found (or not a regular file)
package init file 'tests/integration/__init__.py' not found (or not a regular file)
package init file 'tests/integration/common/__init__.py' not found (or not a regular file)
package init file 'tests/integration/common/parsers/__init__.py' not found (or not a regular file)
package init file 'tests/unit/loader/__init__.py' not found (or not a regular file)
package init file 'tests/unit/framework_utils/__init__.py' not found (or not a regular file)
package init file 'tests/unit/ops/__init__.py' not found (or not a regular file)
package init file 'tests/unit/workflow/__init__.py' not found (or not a regular file)
package init file 'conda/environments/__init__.py' not found (or not a regular file)
package init file 'conda/recipes/__init__.py' not found (or not a regular file)
reading manifest template 'MANIFEST.in'
warning: no files found matching '*.h' under directory 'cpp'
warning: no files found matching '*.cu' under directory 'cpp'
warning: no files found matching '*.cuh' under directory 'cpp'
adding license file 'LICENSE'
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
running build_ext
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -I/usr/include/python3.8 -c flagcheck.cpp -o flagcheck.o -std=c++17
building 'nvtabular_cpp' extension
creating build
creating build/temp.linux-x86_64-3.8
creating build/temp.linux-x86_64-3.8/cpp
creating build/temp.linux-x86_64-3.8/cpp/nvtabular
creating build/temp.linux-x86_64-3.8/cpp/nvtabular/inference
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -DVERSION_INFO=0.11.0+34.gf7e0e3f -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -DVERSION_INFO=0.11.0+34.gf7e0e3f -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -DVERSION_INFO=0.11.0+34.gf7e0e3f -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/categorify.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -DVERSION_INFO=0.11.0+34.gf7e0e3f -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/fill.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -std=c++17 -fvisibility=hidden -g0
creating build/lib.linux-x86_64-3.8
x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -L/usr/lib -o build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so
copying build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so -> 
Generating nvtabular/inference/triton/model_config_pb2.py from nvtabular/inference/triton/model_config.proto
Creating /var/jenkins_home/.local/lib/python3.8/site-packages/nvtabular.egg-link (link to .)
nvtabular 0.11.0+34.gf7e0e3f is already the active version in easy-install.pth

Installed /var/jenkins_home/workspace/nvtabular_tests/nvtabular

Running black --check

All done! ✨ 🍰 ✨

165 files would be left unchanged.

Running flake8

Running isort

Skipped 3 files

Running bandit

Running pylint

************* Module bench.datasets.tools.train_hugectr

bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)

bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)




Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)


Running flake8-nb

Building docs

make: Entering directory '/var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs'

/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.8) or chardet (3.0.4) doesn't match a supported version!

warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "

/usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document

warn("Container node skipped: type={0}".format(mdnode.t))

/usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document

warn("Container node skipped: type={0}".format(mdnode.t))

/usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document

warn("Container node skipped: type={0}".format(mdnode.t))

make: Leaving directory '/var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs'

============================= test session starts ==============================

platform linux -- Python 3.8.10, pytest-7.1.0, pluggy-1.0.0

rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: pyproject.toml

plugins: xdist-2.5.0, forked-1.4.0, cov-3.0.0

collected 1422 items / 1 skipped


tests/unit/test_dask_nvt.py ............................................ [  3%]

........................................................................ [  8%]

[  8%]

tests/unit/test_notebooks.py .F


=================================== FAILURES ===================================

___________________________ test_criteo_pyt_notebook ___________________________


tmpdir = local('/tmp/pytest-of-jenkins/pytest-1/test_criteo_pyt_notebook0')


def test_criteo_pyt_notebook(tmpdir):
    tor = pytest.importorskip("fastai")  # noqa
    # create a toy dataset in tmpdir, and point environment variables so the notebook
    # will read from it
    os.system("mkdir -p " + os.path.join(tmpdir, "converted/criteo"))
    for i in range(24):
        df = _get_random_criteo_data(1000)
        df.to_parquet(os.path.join(tmpdir, "converted/criteo", f"day_{i}.parquet"))
    os.environ["BASE_DIR"] = str(tmpdir)

    def _nb_modify(line):
        # Disable LocalCUDACluster
        line = line.replace("client.run(_rmm_pool)", "# client.run(_rmm_pool)")
        line = line.replace("if cluster is None:", "if False:")
        line = line.replace("client = Client(cluster)", "# client = Client(cluster)")
        line = line.replace(
            "workflow = nvt.Workflow(features, client=client)", "workflow = nvt.Workflow(features)"
        )
        line = line.replace("client", "# client")
        line = line.replace("NUM_GPUS = [0, 1, 2, 3, 4, 5, 6, 7]", "NUM_GPUS = [0]")
        line = line.replace("part_size = int(part_mem_frac * device_size)", "part_size = '128MB'")
        return line

    _run_notebook(
        tmpdir,
        os.path.join(
            dirname(TEST_PATH),
            "examples/scaling-criteo/",
            "02-ETL-with-NVTabular.ipynb",
        ),
        # disable rmm.reinitialize, seems to be causing issues
        transform=_nb_modify,
    )





  _run_notebook(





        tmpdir,
        os.path.join(
            dirname(TEST_PATH),
            "examples/scaling-criteo/",
            "03-Training-with-FastAI.ipynb",
        ),
    )



tests/unit/test_notebooks.py:125:




tests/unit/test_notebooks.py:307: in _run_notebook

subprocess.check_output([sys.executable, script_path])

/usr/lib/python3.8/subprocess.py:415: in check_output

return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,




input = None, capture_output = False, timeout = None, check = True

popenargs = (['/usr/bin/python3', '/tmp/pytest-of-jenkins/pytest-1/test_criteo_pyt_notebook0/notebook.py'],)

kwargs = {'stdout': -1}, process = <subprocess.Popen object at 0x7efadc2f0910>

stdout = b'', stderr = None, retcode = 1


def run(*popenargs,
        input=None, capture_output=False, timeout=None, check=False, **kwargs):
    """Run command with arguments and return a CompletedProcess instance.

    The returned instance will have attributes args, returncode, stdout and
    stderr. By default, stdout and stderr are not captured, and those attributes
    will be None. Pass stdout=PIPE and/or stderr=PIPE in order to capture them.

    If check is True and the exit code was non-zero, it raises a
    CalledProcessError. The CalledProcessError object will have the return code
    in the returncode attribute, and output & stderr attributes if those streams
    were captured.

    If timeout is given, and the process takes too long, a TimeoutExpired
    exception will be raised.

    There is an optional argument "input", allowing you to
    pass bytes or a string to the subprocess's stdin.  If you use this argument
    you may not also use the Popen constructor's "stdin" argument, as
    it will be used internally.

    By default, all communication is in bytes, and therefore any "input" should
    be bytes, and the stdout and stderr will be bytes. If in text mode, any
    "input" should be a string, and stdout and stderr will be strings decoded
    according to locale encoding, or by "encoding" if set. Text mode is
    triggered by setting any of text, encoding, errors or universal_newlines.

    The other arguments are the same as for the Popen constructor.
    """
    if input is not None:
        if kwargs.get('stdin') is not None:
            raise ValueError('stdin and input arguments may not both be used.')
        kwargs['stdin'] = PIPE

    if capture_output:
        if kwargs.get('stdout') is not None or kwargs.get('stderr') is not None:
            raise ValueError('stdout and stderr arguments may not be used '
                             'with capture_output.')
        kwargs['stdout'] = PIPE
        kwargs['stderr'] = PIPE

    with Popen(*popenargs, **kwargs) as process:
        try:
            stdout, stderr = process.communicate(input, timeout=timeout)
        except TimeoutExpired as exc:
            process.kill()
            if _mswindows:
                # Windows accumulates the output in a single blocking
                # read() call run on child threads, with the timeout
                # being done in a join() on those threads.  communicate()
                # _after_ kill() is required to collect that and add it
                # to the exception.
                exc.stdout, exc.stderr = process.communicate()
            else:
                # POSIX _communicate already populated the output so
                # far into the TimeoutExpired exception.
                process.wait()
            raise
        except:  # Including KeyboardInterrupt, communicate handled that.
            process.kill()
            # We don't call process.wait() as .__exit__ does that for us.
            raise
        retcode = process.poll()
        if check and retcode:





          raise CalledProcessError(retcode, process.args,





                                     output=stdout, stderr=stderr)



E               subprocess.CalledProcessError: Command '['/usr/bin/python3', '/tmp/pytest-of-jenkins/pytest-1/test_criteo_pyt_notebook0/notebook.py']' returned non-zero exit status 1.


/usr/lib/python3.8/subprocess.py:516: CalledProcessError

----------------------------- Captured stderr call -----------------------------

/usr/lib/python3.8/site-packages/cudf/core/dataframe.py:1253: UserWarning: The deep parameter is ignored and is only included for pandas compatibility.

warnings.warn(

/usr/lib/python3.8/site-packages/cudf/core/dataframe.py:1253: UserWarning: The deep parameter is ignored and is only included for pandas compatibility.

warnings.warn(

/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.8) or chardet (3.0.4) doesn't match a supported version!

warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "

/usr/lib/python3.8/site-packages/cudf/core/dataframe.py:1253: UserWarning: The deep parameter is ignored and is only included for pandas compatibility.

warnings.warn(

Traceback (most recent call last):

File "/tmp/pytest-of-jenkins/pytest-1/test_criteo_pyt_notebook0/notebook.py", line 172, in 

learn.fit(epochs, learning_rate)

File "/usr/local/lib/python3.8/dist-packages/fastai/learner.py", line 221, in fit

self._with_events(self._do_fit, 'fit', CancelFitException, self._end_cleanup)

File "/usr/local/lib/python3.8/dist-packages/fastai/learner.py", line 163, in with_events

try: self(f'before{event_type}');  f()

File "/usr/local/lib/python3.8/dist-packages/fastai/learner.py", line 212, in _do_fit

self._with_events(self._do_epoch, 'epoch', CancelEpochException)

File "/usr/local/lib/python3.8/dist-packages/fastai/learner.py", line 163, in with_events

try: self(f'before{event_type}');  f()

File "/usr/local/lib/python3.8/dist-packages/fastai/learner.py", line 206, in _do_epoch

self._do_epoch_train()

File "/usr/local/lib/python3.8/dist-packages/fastai/learner.py", line 198, in _do_epoch_train

self._with_events(self.all_batches, 'train', CancelTrainException)

File "/usr/local/lib/python3.8/dist-packages/fastai/learner.py", line 163, in with_events

try: self(f'before{event_type}');  f()

File "/usr/local/lib/python3.8/dist-packages/fastai/learner.py", line 169, in all_batches

for o in enumerate(self.dl): self.one_batch(*o)

File "/usr/local/lib/python3.8/dist-packages/fastai/learner.py", line 194, in one_batch

self._with_events(self._do_one_batch, 'batch', CancelBatchException)

File "/usr/local/lib/python3.8/dist-packages/fastai/learner.py", line 163, in with_events

try: self(f'before{event_type}');  f()

File "/usr/local/lib/python3.8/dist-packages/fastai/learner.py", line 180, in _do_one_batch

self.loss_grad.backward()

File "/usr/local/lib/python3.8/dist-packages/torch/_tensor.py", line 307, in backward

torch.autograd.backward(self, gradient, retain_graph, create_graph, inputs=inputs)

File "/usr/local/lib/python3.8/dist-packages/torch/autograd/init.py", line 154, in backward

Variable._execution_engine.run_backward(

RuntimeError: unique_by_key: failed on 2nd step: cudaErrorInvalidValue: invalid argument

=============================== warnings summary ===============================

../../../../../usr/local/lib/python3.8/dist-packages/fsspec/spec.py:92

../../../../../usr/local/lib/python3.8/dist-packages/fsspec/spec.py:92

/usr/local/lib/python3.8/dist-packages/fsspec/spec.py:92: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.

if pa_version and LooseVersion(pa_version) < LooseVersion("2.0"):


../../../../../usr/lib/python3.8/site-packages/dask_cudf/core.py:32

/usr/lib/python3.8/site-packages/dask_cudf/core.py:32: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.

DASK_VERSION = LooseVersion(dask.version)


../../../../../usr/local/lib/python3.8/dist-packages/setuptools/_distutils/version.py:351: 34 warnings

/usr/local/lib/python3.8/dist-packages/setuptools/_distutils/version.py:351: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.

other = LooseVersion(other)


../../../../../core/merlin/io/fsspec_utils.py:26

/core/merlin/io/fsspec_utils.py:26: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.

if LooseVersion(fsspec.version).version[:3] > [2021, 11, 0]:


tests/unit/test_dask_nvt.py::test_cats_and_groupby_stats[False-0.01]

tests/unit/test_dask_nvt.py::test_cats_and_groupby_stats[False-0.01]

/usr/lib/python3.8/site-packages/cudf/core/dataframe.py:1253: UserWarning: The deep parameter is ignored and is only included for pandas compatibility.

warnings.warn(


tests/unit/test_dask_nvt.py: 12 warnings

/core/merlin/io/dataset.py:863: UserWarning: Only created 2 files did not have enough partitions to create 8 files.

warnings.warn(


tests/unit/test_dask_nvt.py::test_merlin_core_execution_managers

/core/merlin/core/utils.py:433: UserWarning: Existing Dask-client object detected in the current context. New cuda cluster will not be deployed. Set force_new to True to ignore running clusters.

warnings.warn(


-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html


---------- coverage: platform linux, python 3.8.10-final-0 -----------

Name                                                           Stmts   Miss Branch BrPart  Cover   Missing


merlin/systems/dag/init.py                                     3      0      0      0   100%

merlin/systems/dag/ensemble.py                                    64     53     30      0    14%   32-35, 39-112, 116-125

merlin/systems/dag/node.py                                        30     20     12      0    29%   22, 28, 31-32, 35-36, 39-50, 57-62

merlin/systems/dag/op_runner.py                                   21     15      8      0    28%   22-34, 37-39, 42-43

merlin/systems/dag/ops/init.py                                 0      0      0      0   100%

merlin/systems/dag/ops/operator.py                                62     33     18      0    44%   20, 23-27, 30, 33-34, 46, 50, 53, 59, 77-125, 130-138

merlin/systems/dag/ops/session_filter.py                          43     28      8      0    33%   28-31, 35-38, 42, 51-76, 81, 84-88, 91-97

merlin/systems/dag/ops/softmax_sampling.py                        50     34      4      0    33%   13-18, 23-29, 35, 39-47, 56-67, 73, 78-108

merlin/systems/dag/ops/tensorflow.py                              73     55     24      0    21%   36-74, 78-94, 103, 108, 122-163

merlin/systems/dag/ops/workflow.py                                26     17      2      0    39%   35-44, 49, 53-63

merlin/systems/triton/init.py                                 36     23     14      0    26%   38-57, 61-64, 68, 72, 76-82

merlin/systems/triton/conversions.py                              87     73     58      0    10%   32-33, 52-84, 88-94, 98-105, 109-115, 119-136, 140-150

merlin/systems/triton/export.py                                  266    239     82      0     8%   72-111, 156-195, 239-287, 291-322, 347-367, 380-388, 404-461, 476-519, 547-587, 593-609, 613-680, 684-699, 707-732, 738-757, 763-787, 792-795

merlin/systems/triton/model_config_pb2.py                        299      0      2      0   100%

merlin/systems/workflow/init.py                               22     20     12      0     6%   35-65

nvtabular/init.py                                             19      2      0      0    89%   40-41

nvtabular/dispatch.py                                              1      0      0      0   100%

nvtabular/framework_utils/init.py                              0      0      0      0   100%

nvtabular/framework_utils/tensorflow/init.py                   1      0      0      0   100%

nvtabular/framework_utils/tensorflow/feature_column_utils.py     134    125     90      0     4%   28-32, 69-286

nvtabular/framework_utils/tensorflow/layers/init.py            4      0      0      0   100%

nvtabular/framework_utils/tensorflow/layers/embedding.py         153    130     89      0    11%   27, 31-32, 38-39, 48-75, 79-93, 103-115, 119-124, 173-185, 188-211, 214-228, 231-239, 242, 249-265, 307-311, 314-344, 347-360, 363-364, 367

nvtabular/framework_utils/tensorflow/layers/interaction.py        47     39     22      0    14%   48-52, 55-71, 74-103, 106-110, 113

nvtabular/framework_utils/tensorflow/layers/outer_product.py      30     24     12      0    19%   37-38, 41-60, 71-84, 87

nvtabular/framework_utils/tensorflow/tfrecords_to_parquet.py      58     58     30      0     0%   16-111

nvtabular/framework_utils/torch/init.py                        0      0      0      0   100%

nvtabular/framework_utils/torch/layers/init.py                 2      0      0      0   100%

nvtabular/framework_utils/torch/layers/embeddings.py              32     25     18      0    22%   37-46, 49-54, 74-82, 85-95

nvtabular/framework_utils/torch/models.py                         45     40     30      0     9%   52-82, 85-110

nvtabular/framework_utils/torch/utils.py                          75     66     34      0    12%   22, 25-33, 42-44, 47-55, 58-76, 106-140

nvtabular/graph.py                                                 1      0      0      0   100%

nvtabular/inference/init.py                                    0      0      0      0   100%

nvtabular/inference/triton/init.py                            36     23     14      0    26%   38-57, 61-64, 68, 72, 76-82

nvtabular/inference/triton/benchmarking_tools.py                  52     52     10      0     0%   2-103

nvtabular/inference/triton/data_conversions.py                    87     73     58      0    10%   32-33, 52-84, 88-94, 98-105, 109-115, 119-136, 140-150

nvtabular/inference/triton/ensemble.py                           266    239     82      0     8%   73-112, 157-196, 240-288, 292-323, 348-368, 381-389, 405-462, 477-520, 548-588, 594-610, 614-681, 685-700, 708-733, 739-758, 764-788, 793-796

nvtabular/inference/triton/model/init.py                       0      0      0      0   100%

nvtabular/inference/triton/model/model_pt.py                     101    101     42      0     0%   27-220

nvtabular/inference/triton/model_config_pb2.py                   299      0      2      0   100%

nvtabular/inference/triton/workflow_model.py                      52     52     22      0     0%   27-124

nvtabular/inference/workflow/init.py                           0      0      0      0   100%

nvtabular/inference/workflow/base.py                             113    113     62      0     0%   27-209

nvtabular/inference/workflow/hugectr.py                           37     37     16      0     0%   27-87

nvtabular/inference/workflow/pytorch.py                           10     10      6      0     0%   27-46

nvtabular/inference/workflow/tensorflow.py                        32     32     10      0     0%   26-68

nvtabular/io.py                                                    1      0      0      0   100%

nvtabular/loader/init.py                                       0      0      0      0   100%

nvtabular/loader/backend.py                                      371    302    154      0    14%   27-28, 44, 67-73, 76, 80, 84, 87, 91-98, 106-118, 122-147, 151-159, 163-167, 170, 174-181, 185, 211-252, 256-261, 265-268, 271-275, 278-281, 284-287, 291-293, 298-306, 310-319, 323-328, 331-348, 351, 354-357, 360-364, 379-406, 410-490, 498-501, 508-517, 548-554, 563-602, 606-633

nvtabular/loader/tensorflow.py                                   179    133     60      0    21%   38-39, 57-89, 93-115, 122-124, 258-286, 294-295, 303, 311-313, 325-329, 332, 339, 343, 347, 350-359, 362-364, 367-399, 408-418, 422, 426-434, 437-440, 443-447, 450-455, 463-464, 467-480

nvtabular/loader/tf_utils.py                                      57     27     22      6    46%   32->35, 35->37, 42->44, 46, 47->68, 53-54, 62-64, 70-74, 89-94, 104-117

nvtabular/loader/torch.py                                         87     56     26      0    33%   28-30, 33-39, 90, 110, 113-115, 118-120, 123-131, 134-136, 139, 142, 146, 150, 154-166, 169, 174-179, 182-187, 190-191, 202, 205

nvtabular/ops/init.py                                         26      0      0      0   100%

nvtabular/ops/add_metadata.py                                     38      7     14      0    87%   34, 38, 42, 59, 65, 71, 77

nvtabular/ops/bucketize.py                                        40     20     20      2    40%   52-54, 58->exit, 59-64, 71-88, 92, 96

nvtabular/ops/categorify.py                                      657    211    350     80    63%   251, 253, 271, 275, 279, 283, 287, 291, 293, 297, 305, 320, 323-328, 341-342, 371-375, 381-406, 425-426, 432, 446->449, 450, 455, 458, 481-482, 489-497, 559-564, 588-618, 623->625, 626, 627->629, 633, 635, 644, 723, 725->728, 731, 748, 757-762, 793, 799, 827, 858->861, 862-864, 871-872, 887-891, 892->856, 910, 918, 925-926, 943-944, 949, 952->955, 981, 1001-1019, 1035, 1057, 1059-1074, 1076->1079, 1084->1051, 1092-1099, 1100->1102, 1104-1107, 1119, 1123, 1127, 1134, 1139-1142, 1220, 1222, 1284, 1287, 1292->1315, 1298->1315, 1316-1321, 1325-1326, 1333-1334, 1339, 1343-1351, 1354, 1365-1373, 1378, 1379->1382, 1386->1391, 1390, 1396, 1399, 1404-1418, 1423-1435, 1439-1447

nvtabular/ops/clip.py                                             18      2      8      3    81%   44, 52->54, 55

nvtabular/ops/column_similarity.py                               121     86     38      0    23%   19-20, 29-30, 72-78, 81-88, 92-114, 125-126, 129-134, 138, 142, 168-197, 206-207, 216-218, 226-242, 251-276, 280-283, 287-288

nvtabular/ops/data_stats.py                                       56     40     24      0    22%   28-32, 35, 39-77, 80-99, 102

nvtabular/ops/difference_lag.py                                   43     21     14      1    44%   60->63, 70-81, 87, 90-95, 99, 103, 106

nvtabular/ops/drop_low_cardinality.py                             21     13      8      0    34%   30-32, 36, 39-47

nvtabular/ops/dropna.py                                            8      3      2      0    70%   39-41

nvtabular/ops/fill.py                                             76     35     30      3    47%   53-55, 63-67, 73, 79, 102-104, 108-115, 120-121, 125-128, 135, 138-142, 145-148

nvtabular/ops/filter.py                                           20      3      8      3    79%   49, 56, 60

nvtabular/ops/groupby.py                                         130     85     84      6    28%   72, 82-83, 92, 93->95, 95->84, 104-123, 130-134, 137-161, 164-182, 186, 191-196, 202-223, 230-233, 238-241, 247, 254, 260-267, 273-280

nvtabular/ops/hash_bucket.py                                      43     22     22      2    38%   69, 73, 82-95, 100-104, 107-118, 122, 126

nvtabular/ops/hashed_cross.py                                     38     22     17      1    35%   52, 58-68, 73-78, 82, 87-92

nvtabular/ops/join_external.py                                    96     74     34      0    18%   20-21, 101-119, 124-152, 155-159, 162-170, 181-182, 186-187, 190-199, 202-206, 209, 212, 216-227

nvtabular/ops/join_groupby.py                                    128     20     57      9    79%   111, 113, 120, 126-129, 136-139, 144-146, 177-180, 181->175, 230-231, 260-261

nvtabular/ops/lambdaop.py                                         62     40     22      0    29%   57-69, 73-82, 88, 93-108, 111-112, 115-122, 126, 130, 134, 138

nvtabular/ops/list_slice.py                                       89     60     42      3    26%   21-22, 67-68, 70->73, 74, 80-129, 132-133, 137, 146-160, 168-190

nvtabular/ops/logop.py                                            21      2      6      1    89%   48-51

nvtabular/ops/moments.py                                          69      1     24      1    98%   71

nvtabular/ops/normalize.py                                        93     27     22      3    67%   72, 77, 82, 89, 126-128, 134-142, 148, 155-159, 162-163, 167, 176, 180

nvtabular/ops/operator.py                                         11      1      2      0    92%   52

nvtabular/ops/reduce_dtype_size.py                                44     28     20      0    28%   36-39, 43, 46, 49-50, 54-56, 59-80

nvtabular/ops/rename.py                                           29     17     14      1    35%   45, 53-55, 60-78

nvtabular/ops/stat_operator.py                                     8      0      2      0   100%

nvtabular/ops/target_encoding.py                                 182    127     76      0    22%   166-207, 210-213, 217, 226-227, 230-243, 246-251, 254-257, 261, 265, 269-274, 277-280, 283-284, 287-288, 291-292, 296-377, 381-413, 423-432

nvtabular/ops/value_counts.py                                     34     20      6      0    40%   37-53, 56, 59, 62-64, 67

nvtabular/tools/init.py                                        0      0      0      0   100%

nvtabular/tools/data_gen.py                                      271    223     90      0    17%   26-27, 31-32, 53-55, 58, 63, 66-76, 79, 89-91, 98-107, 117-160, 163-176, 181-189, 192-199, 207-223, 232-262, 266-292, 296-314, 317-326, 330-336, 342-353, 356-359, 362-371, 379-381, 397-403, 423-433, 438-440, 480-494

nvtabular/tools/dataset_inspector.py                              52     40     24      0    21%   31-40, 50-51, 71-112

nvtabular/tools/inspector_script.py                               46     46      0      0     0%   17-168

nvtabular/utils.py                                                 1      0      0      0   100%

nvtabular/worker.py                                                1      0      0      0   100%

nvtabular/workflow/init.py                                     2      0      0      0   100%

nvtabular/workflow/node.py                                         7      1      4      1    82%   26

nvtabular/workflow/workflow.py                                   218     57     94     13    74%   28-29, 51, 84, 106-107, 111, 115, 133-134, 148->151, 167, 173->187, 200-202, 218, 268-296, 314-353, 357, 378, 455, 475, 485-491, 493-495, 508


TOTAL                                                           6263   3723   2363    139    35%

Coverage XML written to file coverage.xml


FAIL Required test coverage of 70% not reached. Total coverage: 35.37%

=========================== short test summary info ============================

SKIPPED [1] ../../../../../usr/lib/python3.8/site-packages/dask_cudf/io/tests/test_s3.py:16: could not import 's3fs': cannot import name 'ParamSpec' from 'typing_extensions' (/var/jenkins_home/.local/lib/python3.8/site-packages/typing_extensions.py)

!!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!!

====== 1 failed, 117 passed, 1 skipped, 53 warnings in 171.44s (0:02:51) =======

Build step 'Execute shell' marked build as failure

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[nvtabular_tests] $ /bin/bash /tmp/jenkins4593423541805315618.sh

@github-actions
Copy link

Documentation preview

https://nvidia-merlin.github.io/NVTabular/review/pr-1459

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@jperez999 @nvidia-merlin-bot