Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update for change of hugectr branch name #705

Merged

Conversation

EmmaQiaoCh
Copy link
Contributor

  • Update branch name in dockerfiles
  • Update some related links

* Update branch name in dockerfiles
* Update some related links
@review-notebook-app
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@github-actions
Copy link

Documentation preview

https://nvidia-merlin.github.io/Merlin/review/pr-705

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #705 of commit d9b0642b37b212e5074e1b79ad59d0747bdb06bd, no merge conflicts.
Running as SYSTEM
Setting status of d9b0642b37b212e5074e1b79ad59d0747bdb06bd to PENDING with url https://10.20.13.93:8080/job/merlin_merlin/527/console and message: 'Pending'
Using context: Jenkins
Building on master in workspace /var/jenkins_home/workspace/merlin_merlin
using credential systems-login
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Merlin # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Merlin
 > git --version # timeout=10
using GIT_ASKPASS to set credentials login for merlin-systems
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Merlin +refs/pull/705/*:refs/remotes/origin/pr/705/* # timeout=10
 > git rev-parse d9b0642b37b212e5074e1b79ad59d0747bdb06bd^{commit} # timeout=10
Checking out Revision d9b0642b37b212e5074e1b79ad59d0747bdb06bd (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f d9b0642b37b212e5074e1b79ad59d0747bdb06bd # timeout=10
Commit message: "Update for change of hugectr branch name:"
 > git rev-list --no-walk 4531aa4b9e2d70c93bd9c089c1b4e09f97d21b79 # timeout=10
[merlin_merlin] $ /bin/bash /tmp/jenkins17405038782038505104.sh
GLOB sdist-make: /var/jenkins_home/workspace/merlin_merlin/merlin/setup.py
test-gpu recreate: /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
test-gpu installdeps: pytest, pytest-cov
WARNING: Discarding $PYTHONPATH from environment, to override specify PYTHONPATH in 'passenv' in your configuration.
test-gpu inst: /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/.tmp/package/1/merlin-0.0.1.zip
WARNING: Discarding $PYTHONPATH from environment, to override specify PYTHONPATH in 'passenv' in your configuration.
test-gpu installed: absl-py==1.2.0,aiohttp==3.8.1,aiosignal==1.2.0,alabaster==0.7.12,anyio==3.6.1,argon2-cffi==21.3.0,argon2-cffi-bindings==21.2.0,astroid==2.5.6,asttokens==2.0.8,astunparse==1.6.3,asv==0.5.1,asvdb==0.4.2,async-timeout==4.0.2,attrs==22.1.0,awscli==1.25.95,Babel==2.10.3,backcall==0.2.0,beautifulsoup4==4.11.1,betterproto==1.2.5,black==22.6.0,bleach==5.0.1,boto3==1.24.75,botocore==1.27.94,Brotli==1.0.9,cachetools==5.2.0,certifi==2019.11.28,cffi==1.15.1,chardet==3.0.4,charset-normalizer==2.1.1,clang==5.0,click==8.1.3,cloudpickle==2.2.0,cmake==3.24.1.1,colorama==0.4.4,contourpy==1.0.5,coverage==6.5.0,cuda-python==11.7.1,cupy-cuda117==10.6.0,cycler==0.11.0,Cython==0.29.32,dask==2022.1.1,dbus-python==1.2.16,debugpy==1.6.3,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.5.1,distlib==0.3.6,distributed==2022.5.1,distro==1.7.0,dm-tree==0.1.6,docker-pycreds==0.4.0,docutils==0.16,emoji==1.7.0,entrypoints==0.4,execnet==1.9.0,executing==1.0.0,faiss==1.7.2,faiss-gpu==1.7.2,fastai==2.7.9,fastapi==0.85.0,fastavro==1.6.1,fastcore==1.5.27,fastdownload==0.0.7,fastjsonschema==2.16.1,fastprogress==1.0.3,fastrlock==0.8,feast==0.19.4,fiddle==0.2.2,filelock==3.8.0,flatbuffers==1.12,fonttools==4.37.3,frozenlist==1.3.1,fsspec==2022.5.0,gast==0.4.0,gevent==21.12.0,geventhttpclient==2.0.2,gitdb==4.0.9,GitPython==3.1.27,google==3.0.0,google-api-core==2.10.1,google-auth==2.11.1,google-auth-oauthlib==0.4.6,google-pasta==0.2.0,googleapis-common-protos==1.52.0,graphviz==0.20.1,greenlet==1.1.3,grpcio==1.41.0,grpcio-channelz==1.49.0,grpcio-reflection==1.48.1,grpclib==0.4.3,h11==0.13.0,h2==4.1.0,h5py==3.7.0,HeapDict==1.0.1,hpack==4.0.0,httptools==0.5.0,hugectr2onnx==0.0.0,huggingface-hub==0.9.1,hyperframe==6.0.1,idna==2.8,imagesize==1.4.1,implicit==0.6.1,importlib-metadata==4.12.0,importlib-resources==5.9.0,iniconfig==1.1.1,ipykernel==6.15.3,ipython==8.5.0,ipython-genutils==0.2.0,ipywidgets==7.7.0,jedi==0.18.1,Jinja2==3.1.2,jmespath==1.0.1,joblib==1.2.0,json5==0.9.10,jsonschema==4.16.0,jupyter-cache==0.4.3,jupyter-core==4.11.1,jupyter-server==1.18.1,jupyter-server-mathjax==0.2.5,jupyter-sphinx==0.3.2,jupyter_client==7.3.5,jupyterlab==3.4.7,jupyterlab-pygments==0.2.2,jupyterlab-widgets==1.1.0,jupyterlab_server==2.15.1,keras==2.9.0,Keras-Preprocessing==1.1.2,kiwisolver==1.4.4,lazy-object-proxy==1.7.1,libclang==14.0.6,libcst==0.4.7,lightfm==1.16,lightgbm==3.3.2,linkify-it-py==1.0.3,llvmlite==0.39.1,locket==1.0.0,lxml==4.9.1,Markdown==3.4.1,markdown-it-py==1.1.0,MarkupSafe==2.1.1,matplotlib==3.6.0,matplotlib-inline==0.1.6,mdit-py-plugins==0.2.8,merlin==0.0.1,merlin-core==0.6.0+1.g5926fcf,merlin-models==0.7.0+11.g280956aa4,merlin-systems==0.5.0+4.g15074ad,mistune==2.0.4,mmh3==3.0.0,mpi4py==3.1.3,msgpack==1.0.4,multidict==6.0.2,mypy-extensions==0.4.3,myst-nb==0.13.2,myst-parser==0.15.2,natsort==8.1.0,nbclassic==0.4.3,nbclient==0.6.8,nbconvert==7.0.0,nbdime==3.1.1,nbformat==5.5.0,nest-asyncio==1.5.5,ninja==1.10.2.3,notebook==6.4.12,notebook-shim==0.1.0,numba==0.56.2,numpy==1.22.4,nvidia-pyindex==1.0.9,# Editable install with no version control (nvtabular==1.4.0+8.g95e12d347),-e /usr/local/lib/python3.8/dist-packages,nvtx==0.2.5,oauthlib==3.2.1,oldest-supported-numpy==2022.8.16,onnx==1.12.0,onnxruntime==1.11.1,opt-einsum==3.3.0,packaging==21.3,pandas==1.3.5,pandavro==1.5.2,pandocfilters==1.5.0,parso==0.8.3,partd==1.3.0,pathtools==0.1.2,pexpect==4.8.0,pickleshare==0.7.5,Pillow==9.2.0,pkgutil_resolve_name==1.3.10,platformdirs==2.5.2,pluggy==1.0.0,prometheus-client==0.14.1,promise==2.3,prompt-toolkit==3.0.31,proto-plus==1.19.6,protobuf==3.19.5,psutil==5.9.2,ptyprocess==0.7.0,pure-eval==0.2.2,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pybind11==2.10.0,pycparser==2.21,pydantic==1.10.2,pydot==1.4.2,Pygments==2.13.0,PyGObject==3.36.0,pynvml==11.4.1,pyparsing==3.0.9,pyrsistent==0.18.1,pytest==7.1.3,pytest-cov==4.0.0,pytest-forked==1.4.0,pytest-xdist==2.5.0,python-apt==2.0.0+ubuntu0.20.4.8,python-dateutil==2.8.2,python-dotenv==0.21.0,python-rapidjson==1.8,pytz==2022.2.1,PyYAML==5.4.1,pyzmq==24.0.0,regex==2022.9.13,requests==2.22.0,requests-oauthlib==1.3.1,requests-unixsocket==0.2.0,rsa==4.7.2,s3fs==2022.2.0,s3transfer==0.6.0,sacremoses==0.0.53,scikit-build==0.15.0,scikit-learn==1.1.2,scipy==1.9.1,seedir==0.3.0,Send2Trash==1.8.0,sentry-sdk==1.9.8,setproctitle==1.3.2,setuptools-scm==7.0.5,shortuuid==1.0.9,six==1.15.0,sklearn==0.0,smmap==5.0.0,sniffio==1.3.0,snowballstemmer==2.2.0,sortedcontainers==2.4.0,soupsieve==2.3.2.post1,Sphinx==5.3.0,sphinx-multiversion==0.2.4,sphinx-togglebutton==0.3.1,sphinx_external_toc==0.3.0,sphinxcontrib-applehelp==1.0.2,sphinxcontrib-copydirs @ git+https://github.com/mikemckiernan/sphinxcontrib-copydirs.git@bd8c5d79b3f91cf5f1bb0d6995aeca3fe84b670e,sphinxcontrib-devhelp==1.0.2,sphinxcontrib-htmlhelp==2.0.0,sphinxcontrib-jsmath==1.0.1,sphinxcontrib-qthelp==1.0.3,sphinxcontrib-serializinghtml==1.1.5,SQLAlchemy==1.4.36,stack-data==0.5.0,starlette==0.20.4,stringcase==1.2.0,supervisor==4.1.0,tabulate==0.8.10,tblib==1.7.0,tdqm==0.0.1,tenacity==8.0.1,tensorboard==2.9.1,tensorboard-data-server==0.6.1,tensorboard-plugin-wit==1.8.1,tensorflow==2.6.2,tensorflow-estimator==2.9.0,tensorflow-gpu==2.9.2,tensorflow-io-gcs-filesystem==0.27.0,tensorflow-metadata==1.10.0,termcolor==2.0.1,terminado==0.15.0,testbook==0.4.2,threadpoolctl==3.1.0,tinycss2==1.1.1,tokenizers==0.10.3,toml==0.10.2,tomli==2.0.1,toolz==0.12.0,torch==1.12.1+cu113,torchmetrics==0.3.2,tornado==6.2,tox==3.26.0,tqdm==4.64.1,traitlets==5.4.0,transformers==4.12.0,transformers4rec==0.1.12+2.gbcc939255,treelite==2.3.0,treelite-runtime==2.3.0,tritonclient==2.25.0,typing-inspect==0.8.0,typing_extensions==4.3.0,uc-micro-py==1.0.1,urllib3==1.26.12,uvicorn==0.18.3,uvloop==0.17.0,versioneer==0.20,virtualenv==20.16.5,wandb==0.13.3,watchfiles==0.17.0,wcwidth==0.2.5,webencodings==0.5.1,websocket-client==1.4.1,websockets==10.3,Werkzeug==2.2.2,widgetsnbextension==3.6.0,wrapt==1.12.1,xgboost==1.6.2,yarl==1.8.1,zict==2.2.0,zipp==3.8.1,zope.event==4.5.0,zope.interface==5.4.0
test-gpu run-test-pre: PYTHONHASHSEED='3998399137'
test-gpu run-test: commands[0] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/systems.git
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/NVIDIA-Merlin/systems.git
  Cloning https://github.com/NVIDIA-Merlin/systems.git to /tmp/pip-req-build-m0hhh_ky
  Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/systems.git /tmp/pip-req-build-m0hhh_ky
  Resolved https://github.com/NVIDIA-Merlin/systems.git to commit 1fb8cabe689dd3a81ca5617ba777436687a80489
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: requests<3,>=2.10 in /usr/lib/python3/dist-packages (from merlin-systems==0.6.0+6.g1fb8cab) (2.22.0)
Requirement already satisfied: nvtabular>=1.0.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-systems==0.6.0+6.g1fb8cab) (1.1.1)
Requirement already satisfied: merlin-core>=0.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-systems==0.6.0+6.g1fb8cab) (0.3.0+12.g78ecddd)
Requirement already satisfied: dask>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (2022.3.0)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (21.3)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (1.10.0)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (7.0.0)
Requirement already satisfied: distributed>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (2022.3.0)
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (4.64.1)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (0.55.1)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (1.3.5)
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (3.19.5)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (1.2.5)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (1.2.0)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (0.4.3)
Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (5.4.1)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (1.2.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (2.2.0)
Requirement already satisfied: fsspec>=0.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (2022.5.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (0.12.0)
Requirement already satisfied: tornado>=6.0.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (6.1)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (1.7.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (8.1.3)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (2.0.0)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (3.1.2)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (5.8.0)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (1.0.4)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (2.4.0)
Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (1.20.3)
Requirement already satisfied: setuptools in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (65.3.0)
Collecting llvmlite<0.39,>=0.38.0rc1
  Downloading llvmlite-0.38.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 34.5/34.5 MB 48.8 MB/s eta 0:00:00
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (3.0.9)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (2022.2.1)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (2.8.2)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (1.52.0)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (1.2.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (0.2.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (1.15.0)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (1.0.1)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (4.1.0)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (6.0.2)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from jinja2->distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (2.1.1)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (6.0.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.6.0+6.g1fb8cab) (4.0.0)
Building wheels for collected packages: merlin-systems
  Building wheel for merlin-systems (pyproject.toml): started
  Building wheel for merlin-systems (pyproject.toml): finished with status 'done'
  Created wheel for merlin-systems: filename=merlin_systems-0.6.0+6.g1fb8cab-py3-none-any.whl size=83582 sha256=d969d9378eef078bbae0e8e9c474d99e139bcf687c3d69c468581cb3ae262738
  Stored in directory: /tmp/pip-ephem-wheel-cache-leblserb/wheels/d3/db/b8/99d510a979c278774eda4142f1c0643c93b7b2674aff321c16
Successfully built merlin-systems
Installing collected packages: llvmlite, merlin-systems
  Attempting uninstall: llvmlite
    Found existing installation: llvmlite 0.39.1
    Not uninstalling llvmlite at /usr/local/lib/python3.8/dist-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
    Can't uninstall 'llvmlite'. No files were found to uninstall.
  Attempting uninstall: merlin-systems
    Found existing installation: merlin-systems 0.5.0+4.g15074ad
    Not uninstalling merlin-systems at /usr/local/lib/python3.8/dist-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
    Can't uninstall 'merlin-systems'. No files were found to uninstall.
Successfully installed llvmlite-0.38.1 merlin-systems-0.6.0+6.g1fb8cab

[notice] A new release of pip available: 22.2.2 -> 22.3
[notice] To update, run: pip install --upgrade pip
test-gpu run-test: commands[1] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/models.git
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/NVIDIA-Merlin/models.git
Cloning https://github.com/NVIDIA-Merlin/models.git to /tmp/pip-req-build-wfrdy0gg
Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/models.git /tmp/pip-req-build-wfrdy0gg
Resolved https://github.com/NVIDIA-Merlin/models.git to commit f11d77adca7fb39efd94d71ec3a420f60a2dbd89
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: merlin-core>=0.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-models==0.8.0+26.gf11d77ad) (0.3.0+12.g78ecddd)
Requirement already satisfied: dask>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2022.3.0)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (21.3)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.10.0)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (7.0.0)
Requirement already satisfied: distributed>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2022.3.0)
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (4.64.1)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (0.55.1)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.3.5)
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (3.19.5)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.2.5)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.2.0)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (0.4.3)
Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (5.4.1)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.2.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2.2.0)
Requirement already satisfied: fsspec>=0.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2022.5.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (0.12.0)
Requirement already satisfied: tornado>=6.0.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (6.1)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.7.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (8.1.3)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2.0.0)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (3.1.2)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (5.8.0)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.0.4)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2.4.0)
Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.20.3)
Requirement already satisfied: setuptools in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (65.3.0)
Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (0.38.1)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (3.0.9)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2022.2.1)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2.8.2)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.52.0)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.2.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (0.2.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.15.0)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.0.1)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (4.1.0)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (6.0.2)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from jinja2->distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2.1.1)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (6.0.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (4.0.0)
Building wheels for collected packages: merlin-models
Building wheel for merlin-models (pyproject.toml): started
Building wheel for merlin-models (pyproject.toml): finished with status 'done'
Created wheel for merlin-models: filename=merlin_models-0.8.0+26.gf11d77ad-py3-none-any.whl size=349807 sha256=dbe0fb63d3c73d0b4ddd373847069aba9fda1475490fa2203c9a6fb37de728e7
Stored in directory: /tmp/pip-ephem-wheel-cache-tbf_phm4/wheels/5a/43/99/d50fe2c33b4f4686db73207ce3865e0d6be6609ffb03abade5
Successfully built merlin-models
Installing collected packages: merlin-models
Attempting uninstall: merlin-models
Found existing installation: merlin-models 0.7.0+11.g280956aa4
Not uninstalling merlin-models at /usr/local/lib/python3.8/dist-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
Can't uninstall 'merlin-models'. No files were found to uninstall.
Successfully installed merlin-models-0.8.0+26.gf11d77ad

[notice] A new release of pip available: 22.2.2 -> 22.3
[notice] To update, run: pip install --upgrade pip
test-gpu run-test: commands[2] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/NVTabular.git
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/NVIDIA-Merlin/NVTabular.git
Cloning https://github.com/NVIDIA-Merlin/NVTabular.git to /tmp/pip-req-build-n_y5qb47
Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/NVTabular.git /tmp/pip-req-build-n_y5qb47
Resolved https://github.com/NVIDIA-Merlin/NVTabular.git to commit 8f87c3471604d44937ea97363841b8faee70872c
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: scipy in /usr/local/lib/python3.8/dist-packages (from nvtabular==1.5.0+5.g8f87c347) (1.9.1)
Requirement already satisfied: merlin-core>=0.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==1.5.0+5.g8f87c347) (0.3.0+12.g78ecddd)
Requirement already satisfied: dask>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (2022.3.0)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (21.3)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (1.10.0)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (7.0.0)
Requirement already satisfied: distributed>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (2022.3.0)
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (4.64.1)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (0.55.1)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (1.3.5)
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (3.19.5)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (1.2.5)
Requirement already satisfied: numpy<1.25.0,>=1.18.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from scipy->nvtabular==1.5.0+5.g8f87c347) (1.20.3)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (1.2.0)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (0.4.3)
Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (5.4.1)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (1.2.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (2.2.0)
Requirement already satisfied: fsspec>=0.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (2022.5.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (0.12.0)
Requirement already satisfied: tornado>=6.0.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (6.1)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (1.7.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (8.1.3)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (2.0.0)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (3.1.2)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (5.8.0)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (1.0.4)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (2.4.0)
Requirement already satisfied: setuptools in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (65.3.0)
Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (0.38.1)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (3.0.9)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (2022.2.1)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (2.8.2)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (1.52.0)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (1.2.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (0.2.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (1.15.0)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (1.0.1)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (4.1.0)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (6.0.2)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from jinja2->distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (2.1.1)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (6.0.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.5.0+5.g8f87c347) (4.0.0)
Building wheels for collected packages: nvtabular
Building wheel for nvtabular (pyproject.toml): started
Building wheel for nvtabular (pyproject.toml): finished with status 'done'
Created wheel for nvtabular: filename=nvtabular-1.5.0+5.g8f87c347-cp38-cp38-linux_x86_64.whl size=266782 sha256=7fc13a779563e307531fcb8ff2d9d5c5389e2e0319349c1fe436445224f94cd0
Stored in directory: /tmp/pip-ephem-wheel-cache-aeqbwnmv/wheels/c2/16/76/39994bff39d812513de5b5572bff0903b9eb8f6c645b44cedc
Successfully built nvtabular
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 1.1.1
Not uninstalling nvtabular at /var/jenkins_home/.local/lib/python3.8/site-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
Can't uninstall 'nvtabular'. No files were found to uninstall.
Successfully installed nvtabular-1.5.0+5.g8f87c347

[notice] A new release of pip available: 22.2.2 -> 22.3
[notice] To update, run: pip install --upgrade pip
test-gpu run-test: commands[3] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/core.git
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/NVIDIA-Merlin/core.git
Cloning https://github.com/NVIDIA-Merlin/core.git to /tmp/pip-req-build-cgxvjdbh
Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/core.git /tmp/pip-req-build-cgxvjdbh
Resolved https://github.com/NVIDIA-Merlin/core.git to commit c405f4719782ee057b29ef2b069731fffb096a50
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: dask>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.7.0+11.gc405f47) (2022.3.0)
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.7.0+11.gc405f47) (3.19.5)
Requirement already satisfied: fsspec==2022.5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.7.0+11.gc405f47) (2022.5.0)
Requirement already satisfied: distributed>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.7.0+11.gc405f47) (2022.3.0)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.7.0+11.gc405f47) (21.3)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.7.0+11.gc405f47) (1.10.0)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.7.0+11.gc405f47) (7.0.0)
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.7.0+11.gc405f47) (4.64.1)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.7.0+11.gc405f47) (0.55.1)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.7.0+11.gc405f47) (1.3.5)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.7.0+11.gc405f47) (1.2.5)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.7.0+11.gc405f47) (1.2.0)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.7.0+11.gc405f47) (0.4.3)
Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2022.3.0->merlin-core==0.7.0+11.gc405f47) (5.4.1)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2022.3.0->merlin-core==0.7.0+11.gc405f47) (1.2.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.7.0+11.gc405f47) (2.2.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.7.0+11.gc405f47) (0.12.0)
Requirement already satisfied: tornado>=6.0.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core==0.7.0+11.gc405f47) (6.1)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.7.0+11.gc405f47) (1.7.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.7.0+11.gc405f47) (8.1.3)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.7.0+11.gc405f47) (2.0.0)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.7.0+11.gc405f47) (3.1.2)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core==0.7.0+11.gc405f47) (5.8.0)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.7.0+11.gc405f47) (1.0.4)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.7.0+11.gc405f47) (2.4.0)
Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.7.0+11.gc405f47) (1.20.3)
Requirement already satisfied: setuptools in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.7.0+11.gc405f47) (65.3.0)
Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.7.0+11.gc405f47) (0.38.1)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core==0.7.0+11.gc405f47) (3.0.9)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.7.0+11.gc405f47) (2022.2.1)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.7.0+11.gc405f47) (2.8.2)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.7.0+11.gc405f47) (1.52.0)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.7.0+11.gc405f47) (1.2.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2022.3.0->merlin-core==0.7.0+11.gc405f47) (0.2.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core==0.7.0+11.gc405f47) (1.15.0)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2022.3.0->merlin-core==0.7.0+11.gc405f47) (1.0.1)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.7.0+11.gc405f47) (4.1.0)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.7.0+11.gc405f47) (6.0.2)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from jinja2->distributed>=2022.3.0->merlin-core==0.7.0+11.gc405f47) (2.1.1)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.7.0+11.gc405f47) (6.0.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.7.0+11.gc405f47) (4.0.0)
Building wheels for collected packages: merlin-core
Building wheel for merlin-core (pyproject.toml): started
Building wheel for merlin-core (pyproject.toml): finished with status 'done'
Created wheel for merlin-core: filename=merlin_core-0.7.0+11.gc405f47-py3-none-any.whl size=118282 sha256=cc3b40566cac6d6df8700340a7295f8add159b9fdd859684657c3d5868a1a82d
Stored in directory: /tmp/pip-ephem-wheel-cache-32imtm1s/wheels/c8/38/16/a6968787eafcec5fa772148af8408b089562f71af0752e8e84
Successfully built merlin-core
Installing collected packages: merlin-core
Attempting uninstall: merlin-core
Found existing installation: merlin-core 0.3.0+12.g78ecddd
Not uninstalling merlin-core at /var/jenkins_home/.local/lib/python3.8/site-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
Can't uninstall 'merlin-core'. No files were found to uninstall.
Successfully installed merlin-core-0.7.0+11.gc405f47

[notice] A new release of pip available: 22.2.2 -> 22.3
[notice] To update, run: pip install --upgrade pip
test-gpu run-test: commands[4] | python -m pytest --cov-report term --cov merlin -rxs tests/unit
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
cachedir: .tox/test-gpu/.pytest_cache
rootdir: /var/jenkins_home/workspace/merlin_merlin/merlin
plugins: anyio-3.5.0, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 3 items

tests/unit/test_version.py . [ 33%]
tests/unit/examples/test_building_deploying_multi_stage_RecSys.py F [ 66%]
tests/unit/examples/test_scaling_criteo_merlin_models.py . [100%]

=================================== FAILURES ===================================
__________________________________ test_func ___________________________________

self = <testbook.client.TestbookNotebookClient object at 0x7fbc309bdc40>
cell = [55], kwargs = {}, cell_indexes = [55], executed_cells = [], idx = 55

def execute_cell(self, cell, **kwargs) -> Union[Dict, List[Dict]]:
    """
    Executes a cell or list of cells
    """
    if isinstance(cell, slice):
        start, stop = self._cell_index(cell.start), self._cell_index(cell.stop)
        if cell.step is not None:
            raise TestbookError('testbook does not support step argument')

        cell = range(start, stop + 1)
    elif isinstance(cell, str) or isinstance(cell, int):
        cell = [cell]

    cell_indexes = cell

    if all(isinstance(x, str) for x in cell):
        cell_indexes = [self._cell_index(tag) for tag in cell]

    executed_cells = []
    for idx in cell_indexes:
        try:
          cell = super().execute_cell(self.nb['cells'][idx], idx, **kwargs)

../../../.local/lib/python3.8/site-packages/testbook/client.py:133:


args = (<testbook.client.TestbookNotebookClient object at 0x7fbc309bdc40>, {'id': '094c69ef', 'cell_type': 'code', 'metadata'...[38;5;241m.\x1b[39mis_server_ready()\n', '\x1b[0;31mRuntimeError\x1b[0m: Tritonserver failed to start (ret=1)']}]}, 55)
kwargs = {}

def wrapped(*args, **kwargs):
  return just_run(coro(*args, **kwargs))

../../../.local/lib/python3.8/site-packages/nbclient/util.py:84:


coro = <coroutine object NotebookClient.async_execute_cell at 0x7fbc2f64af40>

def just_run(coro: Awaitable) -> Any:
    """Make the coroutine run, even if there is an event loop running (using nest_asyncio)"""
    # original from vaex/asyncio.py
    loop = asyncio._get_running_loop()
    if loop is None:
        had_running_loop = False
        try:
            loop = asyncio.get_event_loop()
        except RuntimeError:
            # we can still get 'There is no current event loop in ...'
            loop = asyncio.new_event_loop()
            asyncio.set_event_loop(loop)
    else:
        had_running_loop = True
    if had_running_loop:
        # if there is a running loop, we patch using nest_asyncio
        # to have reentrant event loops
        check_ipython()
        import nest_asyncio

        nest_asyncio.apply()
        check_patch_tornado()
  return loop.run_until_complete(coro)

../../../.local/lib/python3.8/site-packages/nbclient/util.py:62:


self = <_UnixSelectorEventLoop running=False closed=False debug=False>
future = <Task finished name='Task-377' coro=<NotebookClient.async_execute_cell() done, defined at /var/jenkins_home/.local/lib...0;31mRuntimeError\x1b[0m: Tritonserver failed to start (ret=1)\nRuntimeError: Tritonserver failed to start (ret=1)\n')>

def run_until_complete(self, future):
    """Run until the Future is done.

    If the argument is a coroutine, it is wrapped in a Task.

    WARNING: It would be disastrous to call run_until_complete()
    with the same coroutine twice -- it would wrap it in two
    different Tasks and that can't be good.

    Return the Future's result, or raise its exception.
    """
    self._check_closed()
    self._check_running()

    new_task = not futures.isfuture(future)
    future = tasks.ensure_future(future, loop=self)
    if new_task:
        # An exception is raised if the future didn't complete, so there
        # is no need to log the "destroy pending task" message
        future._log_destroy_pending = False

    future.add_done_callback(_run_until_complete_cb)
    try:
        self.run_forever()
    except:
        if new_task and future.done() and not future.cancelled():
            # The coroutine raised a BaseException. Consume the exception
            # to not log a warning, the caller doesn't have access to the
            # local task.
            future.exception()
        raise
    finally:
        future.remove_done_callback(_run_until_complete_cb)
    if not future.done():
        raise RuntimeError('Event loop stopped before Future completed.')
  return future.result()

/usr/lib/python3.8/asyncio/base_events.py:616:


self = <testbook.client.TestbookNotebookClient object at 0x7fbc309bdc40>
cell = {'id': '094c69ef', 'cell_type': 'code', 'metadata': {'execution': {'iopub.status.busy': '2022-10-21T08:43:05.140472Z',...t\x1b[38;5;241m.\x1b[39mis_server_ready()\n', '\x1b[0;31mRuntimeError\x1b[0m: Tritonserver failed to start (ret=1)']}]}
cell_index = 55, execution_count = None, store_history = True

async def async_execute_cell(
    self,
    cell: NotebookNode,
    cell_index: int,
    execution_count: t.Optional[int] = None,
    store_history: bool = True,
) -> NotebookNode:
    """
    Executes a single code cell.

    To execute all cells see :meth:`execute`.

    Parameters
    ----------
    cell : nbformat.NotebookNode
        The cell which is currently being processed.
    cell_index : int
        The position of the cell within the notebook object.
    execution_count : int
        The execution count to be assigned to the cell (default: Use kernel response)
    store_history : bool
        Determines if history should be stored in the kernel (default: False).
        Specific to ipython kernels, which can store command histories.

    Returns
    -------
    output : dict
        The execution output payload (or None for no output).

    Raises
    ------
    CellExecutionError
        If execution failed and should raise an exception, this will be raised
        with defaults about the failure.

    Returns
    -------
    cell : NotebookNode
        The cell which was just processed.
    """
    assert self.kc is not None

    await run_hook(self.on_cell_start, cell=cell, cell_index=cell_index)

    if cell.cell_type != 'code' or not cell.source.strip():
        self.log.debug("Skipping non-executing cell %s", cell_index)
        return cell

    if self.skip_cells_with_tag in cell.metadata.get("tags", []):
        self.log.debug("Skipping tagged cell %s", cell_index)
        return cell

    if self.record_timing:  # clear execution metadata prior to execution
        cell['metadata']['execution'] = {}

    self.log.debug("Executing cell:\n%s", cell.source)

    cell_allows_errors = (not self.force_raise_errors) and (
        self.allow_errors or "raises-exception" in cell.metadata.get("tags", [])
    )

    await run_hook(self.on_cell_execute, cell=cell, cell_index=cell_index)
    parent_msg_id = await ensure_async(
        self.kc.execute(
            cell.source, store_history=store_history, stop_on_error=not cell_allows_errors
        )
    )
    await run_hook(self.on_cell_complete, cell=cell, cell_index=cell_index)
    # We launched a code cell to execute
    self.code_cells_executed += 1
    exec_timeout = self._get_timeout(cell)

    cell.outputs = []
    self.clear_before_next_output = False

    task_poll_kernel_alive = asyncio.ensure_future(self._async_poll_kernel_alive())
    task_poll_output_msg = asyncio.ensure_future(
        self._async_poll_output_msg(parent_msg_id, cell, cell_index)
    )
    self.task_poll_for_reply = asyncio.ensure_future(
        self._async_poll_for_reply(
            parent_msg_id, cell, exec_timeout, task_poll_output_msg, task_poll_kernel_alive
        )
    )
    try:
        exec_reply = await self.task_poll_for_reply
    except asyncio.CancelledError:
        # can only be cancelled by task_poll_kernel_alive when the kernel is dead
        task_poll_output_msg.cancel()
        raise DeadKernelError("Kernel died")
    except Exception as e:
        # Best effort to cancel request if it hasn't been resolved
        try:
            # Check if the task_poll_output is doing the raising for us
            if not isinstance(e, CellControlSignal):
                task_poll_output_msg.cancel()
        finally:
            raise

    if execution_count:
        cell['execution_count'] = execution_count
  await self._check_raise_for_error(cell, cell_index, exec_reply)

../../../.local/lib/python3.8/site-packages/nbclient/client.py:965:


self = <testbook.client.TestbookNotebookClient object at 0x7fbc309bdc40>
cell = {'id': '094c69ef', 'cell_type': 'code', 'metadata': {'execution': {'iopub.status.busy': '2022-10-21T08:43:05.140472Z',...t\x1b[38;5;241m.\x1b[39mis_server_ready()\n', '\x1b[0;31mRuntimeError\x1b[0m: Tritonserver failed to start (ret=1)']}]}
cell_index = 55
exec_reply = {'buffers': [], 'content': {'ename': 'RuntimeError', 'engine_info': {'engine_id': -1, 'engine_uuid': '9679fc9c-df50-47...e, 'engine': '9679fc9c-df50-47e9-9249-1b296bc3da7f', 'started': '2022-10-21T08:43:05.140815Z', 'status': 'error'}, ...}

async def _check_raise_for_error(
    self, cell: NotebookNode, cell_index: int, exec_reply: t.Optional[t.Dict]
) -> None:

    if exec_reply is None:
        return None

    exec_reply_content = exec_reply['content']
    if exec_reply_content['status'] != 'error':
        return None

    cell_allows_errors = (not self.force_raise_errors) and (
        self.allow_errors
        or exec_reply_content.get('ename') in self.allow_error_names
        or "raises-exception" in cell.metadata.get("tags", [])
    )
    await run_hook(self.on_cell_error, cell=cell, cell_index=cell_index)
    if not cell_allows_errors:
      raise CellExecutionError.from_cell_and_msg(cell, exec_reply_content)

E nbclient.exceptions.CellExecutionError: An error occurred while executing the following cell:
E ------------------
E
E import shutil
E from merlin.core.dispatch import get_lib
E from merlin.models.loader.tf_utils import configure_tensorflow
E configure_tensorflow()
E df_lib = get_lib()
E batch = df_lib.read_parquet(
E os.path.join("/tmp/data/processed_nvt/", "train", "part_0.parquet"),
E num_rows=1,
E columns=["user_id_raw"],
E )
E from merlin.systems.triton.utils import run_ensemble_on_tritonserver
E response = run_ensemble_on_tritonserver(
E "/tmp/examples/poc_ensemble", ensemble.graph.input_schema, batch, outputs, "ensemble_model"
E )
E response = [x.tolist()[0] for x in response["ordered_ids"]]
E shutil.rmtree("/tmp/examples/", ignore_errors=True)
E
E ------------------
E
E �[0;31m---------------------------------------------------------------------------�[0m
E �[0;31mRuntimeError�[0m Traceback (most recent call last)
E Cell �[0;32mIn [32], line 12�[0m
E �[1;32m 6�[0m batch �[38;5;241m=�[39m df_lib�[38;5;241m.�[39mread_parquet(
E �[1;32m 7�[0m os�[38;5;241m.�[39mpath�[38;5;241m.�[39mjoin(�[38;5;124m"�[39m�[38;5;124m/tmp/data/processed_nvt/�[39m�[38;5;124m"�[39m, �[38;5;124m"�[39m�[38;5;124mtrain�[39m�[38;5;124m"�[39m, �[38;5;124m"�[39m�[38;5;124mpart_0.parquet�[39m�[38;5;124m"�[39m),
E �[1;32m 8�[0m num_rows�[38;5;241m=�[39m�[38;5;241m1�[39m,
E �[1;32m 9�[0m columns�[38;5;241m=�[39m[�[38;5;124m"�[39m�[38;5;124muser_id_raw�[39m�[38;5;124m"�[39m],
E �[1;32m 10�[0m )
E �[1;32m 11�[0m �[38;5;28;01mfrom�[39;00m �[38;5;21;01mmerlin�[39;00m�[38;5;21;01m.�[39;00m�[38;5;21;01msystems�[39;00m�[38;5;21;01m.�[39;00m�[38;5;21;01mtriton�[39;00m�[38;5;21;01m.�[39;00m�[38;5;21;01mutils�[39;00m �[38;5;28;01mimport�[39;00m run_ensemble_on_tritonserver
E �[0;32m---> 12�[0m response �[38;5;241m=�[39m �[43mrun_ensemble_on_tritonserver�[49m�[43m(�[49m
E �[1;32m 13�[0m �[43m �[49m�[38;5;124;43m"�[39;49m�[38;5;124;43m/tmp/examples/poc_ensemble�[39;49m�[38;5;124;43m"�[39;49m�[43m,�[49m�[43m �[49m�[43mensemble�[49m�[38;5;241;43m.�[39;49m�[43mgraph�[49m�[38;5;241;43m.�[39;49m�[43minput_schema�[49m�[43m,�[49m�[43m �[49m�[43mbatch�[49m�[43m,�[49m�[43m �[49m�[43moutputs�[49m�[43m,�[49m�[43m �[49m�[38;5;124;43m"�[39;49m�[38;5;124;43mensemble_model�[39;49m�[38;5;124;43m"�[39;49m
E �[1;32m 14�[0m �[43m)�[49m
E �[1;32m 15�[0m response �[38;5;241m=�[39m [x�[38;5;241m.�[39mtolist()[�[38;5;241m0�[39m] �[38;5;28;01mfor�[39;00m x �[38;5;129;01min�[39;00m response[�[38;5;124m"�[39m�[38;5;124mordered_ids�[39m�[38;5;124m"�[39m]]
E �[1;32m 16�[0m shutil�[38;5;241m.�[39mrmtree(�[38;5;124m"�[39m�[38;5;124m/tmp/examples/�[39m�[38;5;124m"�[39m, ignore_errors�[38;5;241m=�[39m�[38;5;28;01mTrue�[39;00m)
E
E File �[0;32m~/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/utils.py:138�[0m, in �[0;36mrun_ensemble_on_tritonserver�[0;34m(tmpdir, schema, df, output_columns, model_name)�[0m
E �[1;32m 115�[0m �[38;5;124;03m"""Starts up a Triton server instance, loads up the ensemble model,�[39;00m
E �[1;32m 116�[0m �[38;5;124;03mprepares the inference request and returns the unparsed inference�[39;00m
E �[1;32m 117�[0m �[38;5;124;03mresponse.�[39;00m
E �[0;32m (...)�[0m
E �[1;32m 135�[0m �[38;5;124;03m the results of the prediction, parsed by output column name.�[39;00m
E �[1;32m 136�[0m �[38;5;124;03m"""�[39;00m
E �[1;32m 137�[0m response �[38;5;241m=�[39m �[38;5;28;01mNone�[39;00m
E �[0;32m--> 138�[0m �[38;5;28;01mwith�[39;00m run_triton_server(tmpdir) �[38;5;28;01mas�[39;00m client:
E �[1;32m 139�[0m response �[38;5;241m=�[39m send_triton_request(
E �[1;32m 140�[0m schema, df, output_columns, client�[38;5;241m=�[39mclient, triton_model�[38;5;241m=�[39mmodel_name
E �[1;32m 141�[0m )
E �[1;32m 143�[0m �[38;5;28;01mreturn�[39;00m response
E
E File �[0;32m/usr/lib/python3.8/contextlib.py:113�[0m, in �[0;36m_GeneratorContextManager.__enter__�[0;34m(self)�[0m
E �[1;32m 111�[0m �[38;5;28;01mdel�[39;00m �[38;5;28mself�[39m�[38;5;241m.�[39margs, �[38;5;28mself�[39m�[38;5;241m.�[39mkwds, �[38;5;28mself�[39m�[38;5;241m.�[39mfunc
E �[1;32m 112�[0m �[38;5;28;01mtry�[39;00m:
E �[0;32m--> 113�[0m �[38;5;28;01mreturn�[39;00m �[38;5;28;43mnext�[39;49m�[43m(�[49m�[38;5;28;43mself�[39;49m�[38;5;241;43m.�[39;49m�[43mgen�[49m�[43m)�[49m
E �[1;32m 114�[0m �[38;5;28;01mexcept�[39;00m �[38;5;167;01mStopIteration�[39;00m:
E �[1;32m 115�[0m �[38;5;28;01mraise�[39;00m �[38;5;167;01mRuntimeError�[39;00m(�[38;5;124m"�[39m�[38;5;124mgenerator didn�[39m�[38;5;124m'�[39m�[38;5;124mt yield�[39m�[38;5;124m"�[39m) �[38;5;28;01mfrom�[39;00m �[38;5;28mNone�[39m
E
E File �[0;32m~/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/utils.py:81�[0m, in �[0;36mrun_triton_server�[0;34m(model_repository, grpc_host, grpc_port, backend_config)�[0m
E �[1;32m 79�[0m �[38;5;28;01mif�[39;00m process�[38;5;241m.�[39mpoll() �[38;5;129;01mis�[39;00m �[38;5;129;01mnot�[39;00m �[38;5;28;01mNone�[39;00m:
E �[1;32m 80�[0m retcode �[38;5;241m=�[39m process�[38;5;241m.�[39mreturncode
E �[0;32m---> 81�[0m �[38;5;28;01mraise�[39;00m �[38;5;167;01mRuntimeError�[39;00m(�[38;5;124mf�[39m�[38;5;124m"�[39m�[38;5;124mTritonserver failed to start (ret=�[39m�[38;5;132;01m{�[39;00mretcode�[38;5;132;01m}�[39;00m�[38;5;124m)�[39m�[38;5;124m"�[39m)
E �[1;32m 83�[0m �[38;5;28;01mtry�[39;00m:
E �[1;32m 84�[0m ready �[38;5;241m=�[39m client�[38;5;241m.�[39mis_server_ready()
E
E �[0;31mRuntimeError�[0m: Tritonserver failed to start (ret=1)
E RuntimeError: Tritonserver failed to start (ret=1)

../../../.local/lib/python3.8/site-packages/nbclient/client.py:862: CellExecutionError

During handling of the above exception, another exception occurred:

def test_func():
    with testbook(
        REPO_ROOT
        / "examples"
        / "Building-and-deploying-multi-stage-RecSys"
        / "01-Building-Recommender-Systems-with-Merlin.ipynb",
        execute=False,
    ) as tb1:
        tb1.inject(
            """
            import os
            os.environ["DATA_FOLDER"] = "/tmp/data/"
            os.environ["NUM_ROWS"] = "100000"
            os.system("mkdir -p /tmp/examples")
            os.environ["BASE_DIR"] = "/tmp/examples/"
            """
        )
        tb1.execute()
        assert os.path.isdir("/tmp/examples/dlrm")
        assert os.path.isdir("/tmp/examples/feature_repo")
        assert os.path.isdir("/tmp/examples/query_tower")
        assert os.path.isfile("/tmp/examples/item_embeddings.parquet")
        assert os.path.isfile("/tmp/examples/feature_repo/user_features.py")
        assert os.path.isfile("/tmp/examples/feature_repo/item_features.py")

    with testbook(
        REPO_ROOT
        / "examples"
        / "Building-and-deploying-multi-stage-RecSys"
        / "02-Deploying-multi-stage-RecSys-with-Merlin-Systems.ipynb",
        execute=False,
        timeout=120,
    ) as tb2:
        tb2.inject(
            """
            import os
            os.environ["DATA_FOLDER"] = "/tmp/data/"
            os.environ["BASE_DIR"] = "/tmp/examples/"
            os.environ["topk_retrieval"] = "20"
            """
        )
        NUM_OF_CELLS = len(tb2.cells)
        tb2.execute_cell(list(range(0, NUM_OF_CELLS - 3)))
        top_k = tb2.ref("top_k")
        outputs = tb2.ref("outputs")
        assert outputs[0] == "ordered_ids"
      tb2.inject(
            """
            import shutil
            from merlin.core.dispatch import get_lib
            from merlin.models.loader.tf_utils import configure_tensorflow
            configure_tensorflow()
            df_lib = get_lib()
            batch = df_lib.read_parquet(
                os.path.join("/tmp/data/processed_nvt/", "train", "part_0.parquet"),
                num_rows=1,
                columns=["user_id_raw"],
            )
            from merlin.systems.triton.utils import run_ensemble_on_tritonserver
            response = run_ensemble_on_tritonserver(
                "/tmp/examples/poc_ensemble", ensemble.graph.input_schema, batch, outputs,  "ensemble_model"
            )
            response = [x.tolist()[0] for x in response["ordered_ids"]]
            shutil.rmtree("/tmp/examples/", ignore_errors=True)
            """
        )

tests/unit/examples/test_building_deploying_multi_stage_RecSys.py:61:


../../../.local/lib/python3.8/site-packages/testbook/client.py:237: in inject
cell = TestbookNode(self.execute_cell(inject_idx)) if run else TestbookNode(code_cell)


self = <testbook.client.TestbookNotebookClient object at 0x7fbc309bdc40>
cell = [55], kwargs = {}, cell_indexes = [55], executed_cells = [], idx = 55

def execute_cell(self, cell, **kwargs) -> Union[Dict, List[Dict]]:
    """
    Executes a cell or list of cells
    """
    if isinstance(cell, slice):
        start, stop = self._cell_index(cell.start), self._cell_index(cell.stop)
        if cell.step is not None:
            raise TestbookError('testbook does not support step argument')

        cell = range(start, stop + 1)
    elif isinstance(cell, str) or isinstance(cell, int):
        cell = [cell]

    cell_indexes = cell

    if all(isinstance(x, str) for x in cell):
        cell_indexes = [self._cell_index(tag) for tag in cell]

    executed_cells = []
    for idx in cell_indexes:
        try:
            cell = super().execute_cell(self.nb['cells'][idx], idx, **kwargs)
        except CellExecutionError as ce:
          raise TestbookRuntimeError(ce.evalue, ce, self._get_error_class(ce.ename))

E testbook.exceptions.TestbookRuntimeError: An error occurred while executing the following cell:
E ------------------
E
E import shutil
E from merlin.core.dispatch import get_lib
E from merlin.models.loader.tf_utils import configure_tensorflow
E configure_tensorflow()
E df_lib = get_lib()
E batch = df_lib.read_parquet(
E os.path.join("/tmp/data/processed_nvt/", "train", "part_0.parquet"),
E num_rows=1,
E columns=["user_id_raw"],
E )
E from merlin.systems.triton.utils import run_ensemble_on_tritonserver
E response = run_ensemble_on_tritonserver(
E "/tmp/examples/poc_ensemble", ensemble.graph.input_schema, batch, outputs, "ensemble_model"
E )
E response = [x.tolist()[0] for x in response["ordered_ids"]]
E shutil.rmtree("/tmp/examples/", ignore_errors=True)
E
E ------------------
E
E �[0;31m---------------------------------------------------------------------------�[0m
E �[0;31mRuntimeError�[0m Traceback (most recent call last)
E Cell �[0;32mIn [32], line 12�[0m
E �[1;32m 6�[0m batch �[38;5;241m=�[39m df_lib�[38;5;241m.�[39mread_parquet(
E �[1;32m 7�[0m os�[38;5;241m.�[39mpath�[38;5;241m.�[39mjoin(�[38;5;124m"�[39m�[38;5;124m/tmp/data/processed_nvt/�[39m�[38;5;124m"�[39m, �[38;5;124m"�[39m�[38;5;124mtrain�[39m�[38;5;124m"�[39m, �[38;5;124m"�[39m�[38;5;124mpart_0.parquet�[39m�[38;5;124m"�[39m),
E �[1;32m 8�[0m num_rows�[38;5;241m=�[39m�[38;5;241m1�[39m,
E �[1;32m 9�[0m columns�[38;5;241m=�[39m[�[38;5;124m"�[39m�[38;5;124muser_id_raw�[39m�[38;5;124m"�[39m],
E �[1;32m 10�[0m )
E �[1;32m 11�[0m �[38;5;28;01mfrom�[39;00m �[38;5;21;01mmerlin�[39;00m�[38;5;21;01m.�[39;00m�[38;5;21;01msystems�[39;00m�[38;5;21;01m.�[39;00m�[38;5;21;01mtriton�[39;00m�[38;5;21;01m.�[39;00m�[38;5;21;01mutils�[39;00m �[38;5;28;01mimport�[39;00m run_ensemble_on_tritonserver
E �[0;32m---> 12�[0m response �[38;5;241m=�[39m �[43mrun_ensemble_on_tritonserver�[49m�[43m(�[49m
E �[1;32m 13�[0m �[43m �[49m�[38;5;124;43m"�[39;49m�[38;5;124;43m/tmp/examples/poc_ensemble�[39;49m�[38;5;124;43m"�[39;49m�[43m,�[49m�[43m �[49m�[43mensemble�[49m�[38;5;241;43m.�[39;49m�[43mgraph�[49m�[38;5;241;43m.�[39;49m�[43minput_schema�[49m�[43m,�[49m�[43m �[49m�[43mbatch�[49m�[43m,�[49m�[43m �[49m�[43moutputs�[49m�[43m,�[49m�[43m �[49m�[38;5;124;43m"�[39;49m�[38;5;124;43mensemble_model�[39;49m�[38;5;124;43m"�[39;49m
E �[1;32m 14�[0m �[43m)�[49m
E �[1;32m 15�[0m response �[38;5;241m=�[39m [x�[38;5;241m.�[39mtolist()[�[38;5;241m0�[39m] �[38;5;28;01mfor�[39;00m x �[38;5;129;01min�[39;00m response[�[38;5;124m"�[39m�[38;5;124mordered_ids�[39m�[38;5;124m"�[39m]]
E �[1;32m 16�[0m shutil�[38;5;241m.�[39mrmtree(�[38;5;124m"�[39m�[38;5;124m/tmp/examples/�[39m�[38;5;124m"�[39m, ignore_errors�[38;5;241m=�[39m�[38;5;28;01mTrue�[39;00m)
E
E File �[0;32m~/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/utils.py:138�[0m, in �[0;36mrun_ensemble_on_tritonserver�[0;34m(tmpdir, schema, df, output_columns, model_name)�[0m
E �[1;32m 115�[0m �[38;5;124;03m"""Starts up a Triton server instance, loads up the ensemble model,�[39;00m
E �[1;32m 116�[0m �[38;5;124;03mprepares the inference request and returns the unparsed inference�[39;00m
E �[1;32m 117�[0m �[38;5;124;03mresponse.�[39;00m
E �[0;32m (...)�[0m
E �[1;32m 135�[0m �[38;5;124;03m the results of the prediction, parsed by output column name.�[39;00m
E �[1;32m 136�[0m �[38;5;124;03m"""�[39;00m
E �[1;32m 137�[0m response �[38;5;241m=�[39m �[38;5;28;01mNone�[39;00m
E �[0;32m--> 138�[0m �[38;5;28;01mwith�[39;00m run_triton_server(tmpdir) �[38;5;28;01mas�[39;00m client:
E �[1;32m 139�[0m response �[38;5;241m=�[39m send_triton_request(
E �[1;32m 140�[0m schema, df, output_columns, client�[38;5;241m=�[39mclient, triton_model�[38;5;241m=�[39mmodel_name
E �[1;32m 141�[0m )
E �[1;32m 143�[0m �[38;5;28;01mreturn�[39;00m response
E
E File �[0;32m/usr/lib/python3.8/contextlib.py:113�[0m, in �[0;36m_GeneratorContextManager.__enter__�[0;34m(self)�[0m
E �[1;32m 111�[0m �[38;5;28;01mdel�[39;00m �[38;5;28mself�[39m�[38;5;241m.�[39margs, �[38;5;28mself�[39m�[38;5;241m.�[39mkwds, �[38;5;28mself�[39m�[38;5;241m.�[39mfunc
E �[1;32m 112�[0m �[38;5;28;01mtry�[39;00m:
E �[0;32m--> 113�[0m �[38;5;28;01mreturn�[39;00m �[38;5;28;43mnext�[39;49m�[43m(�[49m�[38;5;28;43mself�[39;49m�[38;5;241;43m.�[39;49m�[43mgen�[49m�[43m)�[49m
E �[1;32m 114�[0m �[38;5;28;01mexcept�[39;00m �[38;5;167;01mStopIteration�[39;00m:
E �[1;32m 115�[0m �[38;5;28;01mraise�[39;00m �[38;5;167;01mRuntimeError�[39;00m(�[38;5;124m"�[39m�[38;5;124mgenerator didn�[39m�[38;5;124m'�[39m�[38;5;124mt yield�[39m�[38;5;124m"�[39m) �[38;5;28;01mfrom�[39;00m �[38;5;28mNone�[39m
E
E File �[0;32m~/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/utils.py:81�[0m, in �[0;36mrun_triton_server�[0;34m(model_repository, grpc_host, grpc_port, backend_config)�[0m
E �[1;32m 79�[0m �[38;5;28;01mif�[39;00m process�[38;5;241m.�[39mpoll() �[38;5;129;01mis�[39;00m �[38;5;129;01mnot�[39;00m �[38;5;28;01mNone�[39;00m:
E �[1;32m 80�[0m retcode �[38;5;241m=�[39m process�[38;5;241m.�[39mreturncode
E �[0;32m---> 81�[0m �[38;5;28;01mraise�[39;00m �[38;5;167;01mRuntimeError�[39;00m(�[38;5;124mf�[39m�[38;5;124m"�[39m�[38;5;124mTritonserver failed to start (ret=�[39m�[38;5;132;01m{�[39;00mretcode�[38;5;132;01m}�[39;00m�[38;5;124m)�[39m�[38;5;124m"�[39m)
E �[1;32m 83�[0m �[38;5;28;01mtry�[39;00m:
E �[1;32m 84�[0m ready �[38;5;241m=�[39m client�[38;5;241m.�[39mis_server_ready()
E
E �[0;31mRuntimeError�[0m: Tritonserver failed to start (ret=1)
E RuntimeError: Tritonserver failed to start (ret=1)

../../../.local/lib/python3.8/site-packages/testbook/client.py:135: TestbookRuntimeError
----------------------------- Captured stderr call -----------------------------
2022-10-21 08:41:18.122325: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-10-21 08:41:22.139687: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 8139 MB memory: -> device: 0, name: Tesla P100-DGXS-16GB, pci bus id: 0000:07:00.0, compute capability: 6.0
2022-10-21 08:41:22.140463: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:1 with 15149 MB memory: -> device: 1, name: Tesla P100-DGXS-16GB, pci bus id: 0000:08:00.0, compute capability: 6.0
2022-10-21 08:41:22.141035: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:2 with 15149 MB memory: -> device: 2, name: Tesla P100-DGXS-16GB, pci bus id: 0000:0e:00.0, compute capability: 6.0
2022-10-21 08:41:22.141629: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:3 with 15149 MB memory: -> device: 3, name: Tesla P100-DGXS-16GB, pci bus id: 0000:0f:00.0, compute capability: 6.0
Error in atexit._run_exitfuncs:
Traceback (most recent call last):
File "/usr/lib/python3.8/logging/init.py", line 2127, in shutdown
h.close()
File "/usr/local/lib/python3.8/dist-packages/absl/logging/init.py", line 934, in close
self.stream.close()
File "/usr/local/lib/python3.8/dist-packages/ipykernel/iostream.py", line 438, in close
self.watch_fd_thread.join()
AttributeError: 'OutStream' object has no attribute 'watch_fd_thread'
WARNING clustering 455 points to 32 centroids: please provide at least 1248 training points
2022-10-21 08:42:58.702204: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-10-21 08:43:02.727779: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 8139 MB memory: -> device: 0, name: Tesla P100-DGXS-16GB, pci bus id: 0000:07:00.0, compute capability: 6.0
2022-10-21 08:43:02.728534: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:1 with 15149 MB memory: -> device: 1, name: Tesla P100-DGXS-16GB, pci bus id: 0000:08:00.0, compute capability: 6.0
2022-10-21 08:43:02.729221: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:2 with 15149 MB memory: -> device: 2, name: Tesla P100-DGXS-16GB, pci bus id: 0000:0e:00.0, compute capability: 6.0
2022-10-21 08:43:02.729802: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:3 with 15149 MB memory: -> device: 3, name: Tesla P100-DGXS-16GB, pci bus id: 0000:0f:00.0, compute capability: 6.0
I1021 08:43:05.461666 10492 pinned_memory_manager.cc:240] Pinned memory pool is created at '0x7f9016000000' with size 268435456
I1021 08:43:05.462392 10492 cuda_memory_manager.cc:105] CUDA memory pool is created on device 0 with size 67108864
I1021 08:43:05.471351 10492 model_lifecycle.cc:459] loading: 0_queryfeast:1
I1021 08:43:05.471416 10492 model_lifecycle.cc:459] loading: 1_predicttensorflow:1
I1021 08:43:05.471447 10492 model_lifecycle.cc:459] loading: 2_queryfaiss:1
I1021 08:43:05.471514 10492 model_lifecycle.cc:459] loading: 3_queryfeast:1
I1021 08:43:05.471562 10492 model_lifecycle.cc:459] loading: 4_unrollfeatures:1
I1021 08:43:05.471598 10492 model_lifecycle.cc:459] loading: 5_predicttensorflow:1
I1021 08:43:05.471654 10492 model_lifecycle.cc:459] loading: 6_softmaxsampling:1
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
I1021 08:43:14.484759 10492 tensorflow.cc:2536] TRITONBACKEND_Initialize: tensorflow
I1021 08:43:14.484808 10492 tensorflow.cc:2546] Triton TRITONBACKEND API version: 1.10
I1021 08:43:14.484815 10492 tensorflow.cc:2552] 'tensorflow' TRITONBACKEND API version: 1.10
I1021 08:43:14.484821 10492 tensorflow.cc:2576] backend configuration:
{"cmdline":{"auto-complete-config":"true","backend-directory":"/opt/tritonserver/backends","min-compute-capability":"6.000000","version":"2","default-max-batch-size":"4"}}
I1021 08:43:14.484871 10492 python_be.cc:1767] TRITONBACKEND_ModelInstanceInitialize: 2_queryfaiss (GPU device 0)
1021 08:43:17.858896 10614 pb_stub.cc:309] Failed to initialize Python stub: RuntimeError: Error in faiss::FileIOReader::FileIOReader(const char*) at /project/faiss/faiss/impl/io.cpp:68: Error: 'f' failed: could not open /tmp/examples/faiss_index/index.faiss/index.faiss for reading: Not a directory

At:
/usr/local/lib/python3.8/dist-packages/faiss/swigfaiss.py(9849): read_index
/var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/faiss.py(67): load_artifacts
/var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/faiss.py(94): from_config
/var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/op_runner.py(45): init
/tmp/examples/poc_ensemble/2_queryfaiss/1/model.py(61): initialize

/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
I1021 08:43:18.332685 10492 python_be.cc:1767] TRITONBACKEND_ModelInstanceInitialize: 0_queryfeast (GPU device 0)
E1021 08:43:18.343350 10492 model_lifecycle.cc:596] failed to load '2_queryfaiss' version 1: Internal: RuntimeError: Error in faiss::FileIOReader::FileIOReader(const char*) at /project/faiss/faiss/impl/io.cpp:68: Error: 'f' failed: could not open /tmp/examples/faiss_index/index.faiss/index.faiss for reading: Not a directory

At:
/usr/local/lib/python3.8/dist-packages/faiss/swigfaiss.py(9849): read_index
/var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/faiss.py(67): load_artifacts
/var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/faiss.py(94): from_config
/var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/op_runner.py(45): init
/tmp/examples/poc_ensemble/2_queryfaiss/1/model.py(61): initialize

I1021 08:43:21.633246 10492 tensorflow.cc:2642] TRITONBACKEND_ModelInitialize: 1_predicttensorflow (version 1)
I1021 08:43:21.633509 10492 model_lifecycle.cc:693] successfully loaded '0_queryfeast' version 1
2022-10-21 08:43:21.634509: I tensorflow/cc/saved_model/reader.cc:43] Reading SavedModel from: /tmp/examples/poc_ensemble/1_predicttensorflow/1/model.savedmodel
2022-10-21 08:43:21.644756: I tensorflow/cc/saved_model/reader.cc:81] Reading meta graph with tags { serve }
2022-10-21 08:43:21.644818: I tensorflow/cc/saved_model/reader.cc:122] Reading SavedModel debug info (if present) from: /tmp/examples/poc_ensemble/1_predicttensorflow/1/model.savedmodel
2022-10-21 08:43:21.645014: I tensorflow/core/platform/cpu_feature_guard.cc:194] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: SSE3 SSE4.1 SSE4.2 AVX
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-10-21 08:43:21.690269: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 6128 MB memory: -> device: 0, name: Tesla P100-DGXS-16GB, pci bus id: 0000:07:00.0, compute capability: 6.0
2022-10-21 08:43:21.729795: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:354] MLIR V1 optimization pass is not enabled
2022-10-21 08:43:21.731849: I tensorflow/cc/saved_model/loader.cc:230] Restoring SavedModel bundle.
2022-10-21 08:43:21.783440: I tensorflow/cc/saved_model/loader.cc:214] Running initialization op on SavedModel bundle at path: /tmp/examples/poc_ensemble/1_predicttensorflow/1/model.savedmodel
2022-10-21 08:43:21.810689: I tensorflow/cc/saved_model/loader.cc:321] SavedModel load for tags { serve }; Status: success: OK. Took 176206 microseconds.
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
I1021 08:43:34.949571 10492 tensorflow.cc:2642] TRITONBACKEND_ModelInitialize: 5_predicttensorflow (version 1)
2022-10-21 08:43:34.950911: I tensorflow/cc/saved_model/reader.cc:43] Reading SavedModel from: /tmp/examples/poc_ensemble/5_predicttensorflow/1/model.savedmodel
2022-10-21 08:43:34.969963: I tensorflow/cc/saved_model/reader.cc:81] Reading meta graph with tags { serve }
2022-10-21 08:43:34.970008: I tensorflow/cc/saved_model/reader.cc:122] Reading SavedModel debug info (if present) from: /tmp/examples/poc_ensemble/5_predicttensorflow/1/model.savedmodel
2022-10-21 08:43:34.972069: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 6128 MB memory: -> device: 0, name: Tesla P100-DGXS-16GB, pci bus id: 0000:07:00.0, compute capability: 6.0
2022-10-21 08:43:34.999803: I tensorflow/cc/saved_model/loader.cc:230] Restoring SavedModel bundle.
2022-10-21 08:43:35.134126: I tensorflow/cc/saved_model/loader.cc:214] Running initialization op on SavedModel bundle at path: /tmp/examples/poc_ensemble/5_predicttensorflow/1/model.savedmodel
2022-10-21 08:43:35.184095: I tensorflow/cc/saved_model/loader.cc:321] SavedModel load for tags { serve }; Status: success: OK. Took 233195 microseconds.
I1021 08:43:35.199106 10492 tensorflow.cc:2691] TRITONBACKEND_ModelInstanceInitialize: 1_predicttensorflow (GPU device 0)
2022-10-21 08:43:35.200192: I tensorflow/cc/saved_model/reader.cc:43] Reading SavedModel from: /tmp/examples/poc_ensemble/1_predicttensorflow/1/model.savedmodel
2022-10-21 08:43:35.210046: I tensorflow/cc/saved_model/reader.cc:81] Reading meta graph with tags { serve }
2022-10-21 08:43:35.210096: I tensorflow/cc/saved_model/reader.cc:122] Reading SavedModel debug info (if present) from: /tmp/examples/poc_ensemble/1_predicttensorflow/1/model.savedmodel
2022-10-21 08:43:35.213375: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 6128 MB memory: -> device: 0, name: Tesla P100-DGXS-16GB, pci bus id: 0000:07:00.0, compute capability: 6.0
2022-10-21 08:43:35.223507: I tensorflow/cc/saved_model/loader.cc:230] Restoring SavedModel bundle.
2022-10-21 08:43:35.276458: I tensorflow/cc/saved_model/loader.cc:214] Running initialization op on SavedModel bundle at path: /tmp/examples/poc_ensemble/1_predicttensorflow/1/model.savedmodel
2022-10-21 08:43:35.302255: I tensorflow/cc/saved_model/loader.cc:321] SavedModel load for tags { serve }; Status: success: OK. Took 102072 microseconds.
I1021 08:43:35.302412 10492 python_be.cc:1767] TRITONBACKEND_ModelInstanceInitialize: 3_queryfeast (GPU device 0)
I1021 08:43:35.302630 10492 model_lifecycle.cc:693] successfully loaded '1_predicttensorflow' version 1
I1021 08:43:38.593300 10492 python_be.cc:1767] TRITONBACKEND_ModelInstanceInitialize: 6_softmaxsampling (GPU device 0)
I1021 08:43:38.594040 10492 model_lifecycle.cc:693] successfully loaded '3_queryfeast' version 1
I1021 08:43:41.494289 10492 python_be.cc:1767] TRITONBACKEND_ModelInstanceInitialize: 4_unrollfeatures (GPU device 0)
I1021 08:43:41.494528 10492 model_lifecycle.cc:693] successfully loaded '6_softmaxsampling' version 1
I1021 08:43:44.376522 10492 tensorflow.cc:2691] TRITONBACKEND_ModelInstanceInitialize: 5_predicttensorflow (GPU device 0)
I1021 08:43:44.376862 10492 model_lifecycle.cc:693] successfully loaded '4_unrollfeatures' version 1
2022-10-21 08:43:44.378446: I tensorflow/cc/saved_model/reader.cc:43] Reading SavedModel from: /tmp/examples/poc_ensemble/5_predicttensorflow/1/model.savedmodel
2022-10-21 08:43:44.396192: I tensorflow/cc/saved_model/reader.cc:81] Reading meta graph with tags { serve }
2022-10-21 08:43:44.396231: I tensorflow/cc/saved_model/reader.cc:122] Reading SavedModel debug info (if present) from: /tmp/examples/poc_ensemble/5_predicttensorflow/1/model.savedmodel
2022-10-21 08:43:44.398315: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 6128 MB memory: -> device: 0, name: Tesla P100-DGXS-16GB, pci bus id: 0000:07:00.0, compute capability: 6.0
2022-10-21 08:43:44.421091: I tensorflow/cc/saved_model/loader.cc:230] Restoring SavedModel bundle.
2022-10-21 08:43:44.568965: I tensorflow/cc/saved_model/loader.cc:214] Running initialization op on SavedModel bundle at path: /tmp/examples/poc_ensemble/5_predicttensorflow/1/model.savedmodel
2022-10-21 08:43:44.617788: I tensorflow/cc/saved_model/loader.cc:321] SavedModel load for tags { serve }; Status: success: OK. Took 239353 microseconds.
I1021 08:43:44.618092 10492 model_lifecycle.cc:693] successfully loaded '5_predicttensorflow' version 1
E1021 08:43:44.618176 10492 model_repository_manager.cc:481] Invalid argument: ensemble 'ensemble_model' depends on '2_queryfaiss' which has no loaded version
I1021 08:43:44.618311 10492 server.cc:561]
+------------------+------+
| Repository Agent | Path |
+------------------+------+
+------------------+------+

I1021 08:43:44.618410 10492 server.cc:588]
+------------+-----------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Backend | Path | Config |
+------------+-----------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| python | /opt/tritonserver/backends/python/libtriton_python.so | {"cmdline":{"auto-complete-config":"true","min-compute-capability":"6.000000","backend-directory":"/opt/tritonserver/backends","default-max-batch-size":"4"}} |
| tensorflow | /opt/tritonserver/backends/tensorflow2/libtriton_tensorflow2.so | {"cmdline":{"auto-complete-config":"true","backend-directory":"/opt/tritonserver/backends","min-compute-capability":"6.000000","version":"2","default-max-batch-size":"4"}} |
+------------+-----------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

I1021 08:43:44.618671 10492 server.cc:631]
+---------------------+---------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Model | Version | Status |
+---------------------+---------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| 0_queryfeast | 1 | READY |
| 1_predicttensorflow | 1 | READY |
| 2_queryfaiss | 1 | UNAVAILABLE: Internal: RuntimeError: Error in faiss::FileIOReader::FileIOReader(const char*) at /project/faiss/faiss/impl/io.cpp:68: Error: 'f' failed: could not open /tmp/examples/faiss_index/index.faiss/index.faiss for reading: Not a directory |
| | | |
| | | At: |
| | | /usr/local/lib/python3.8/dist-packages/faiss/swigfaiss.py(9849): read_index |
| | | /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/faiss.py(67): load_artifacts |
| | | /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/faiss.py(94): from_config |
| | | /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/op_runner.py(45): init |
| | | /tmp/examples/poc_ensemble/2_queryfaiss/1/model.py(61): initialize |
| 3_queryfeast | 1 | READY |
| 4_unrollfeatures | 1 | READY |
| 5_predicttensorflow | 1 | READY |
| 6_softmaxsampling | 1 | READY |
+---------------------+---------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

I1021 08:43:44.684189 10492 metrics.cc:650] Collecting metrics for GPU 0: Tesla P100-DGXS-16GB
I1021 08:43:44.685029 10492 tritonserver.cc:2214]
+----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Option | Value |
+----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| server_id | triton |
| server_version | 2.25.0 |
| server_extensions | classification sequence model_repository model_repository(unload_dependents) schedule_policy model_configuration system_shared_memory cuda_shared_memory binary_tensor_data statistics trace |
| model_repository_path[0] | /tmp/examples/poc_ensemble |
| model_control_mode | MODE_NONE |
| strict_model_config | 0 |
| rate_limit | OFF |
| pinned_memory_pool_byte_size | 268435456 |
| cuda_memory_pool_byte_size{0} | 67108864 |
| response_cache_byte_size | 0 |
| min_supported_compute_capability | 6.0 |
| strict_readiness | 1 |
| exit_timeout | 30 |
+----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

I1021 08:43:44.685068 10492 server.cc:262] Waiting for in-flight requests to complete.
I1021 08:43:44.685082 10492 server.cc:278] Timeout 30: Found 0 model versions that have in-flight inferences
I1021 08:43:44.685249 10492 tensorflow.cc:2729] TRITONBACKEND_ModelInstanceFinalize: delete instance state
I1021 08:43:44.685260 10492 server.cc:293] All models are stopped, unloading models
I1021 08:43:44.685300 10492 server.cc:300] Timeout 30: Found 6 live models and 0 in-flight non-inference requests
I1021 08:43:44.685358 10492 tensorflow.cc:2729] TRITONBACKEND_ModelInstanceFinalize: delete instance state
I1021 08:43:44.685426 10492 tensorflow.cc:2668] TRITONBACKEND_ModelFinalize: delete model state
I1021 08:43:44.685783 10492 tensorflow.cc:2668] TRITONBACKEND_ModelFinalize: delete model state
I1021 08:43:44.701925 10492 model_lifecycle.cc:578] successfully unloaded '1_predicttensorflow' version 1
I1021 08:43:44.707766 10492 model_lifecycle.cc:578] successfully unloaded '5_predicttensorflow' version 1
I1021 08:43:45.685401 10492 server.cc:300] Timeout 29: Found 4 live models and 0 in-flight non-inference requests
W1021 08:43:45.706137 10492 metrics.cc:468] Unable to get energy consumption for GPU 0. Status:Success, value:0
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
I1021 08:43:46.227273 10492 model_lifecycle.cc:578] successfully unloaded '4_unrollfeatures' version 1
I1021 08:43:46.253672 10492 model_lifecycle.cc:578] successfully unloaded '0_queryfeast' version 1
I1021 08:43:46.312656 10492 model_lifecycle.cc:578] successfully unloaded '6_softmaxsampling' version 1
I1021 08:43:46.685558 10492 server.cc:300] Timeout 28: Found 1 live models and 0 in-flight non-inference requests
W1021 08:43:46.706352 10492 metrics.cc:468] Unable to get energy consumption for GPU 0. Status:Success, value:0
I1021 08:43:47.685693 10492 server.cc:300] Timeout 27: Found 1 live models and 0 in-flight non-inference requests
W1021 08:43:47.727867 10492 metrics.cc:468] Unable to get energy consumption for GPU 0. Status:Success, value:0
I1021 08:43:48.685826 10492 server.cc:300] Timeout 26: Found 1 live models and 0 in-flight non-inference requests
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
I1021 08:43:49.685963 10492 server.cc:300] Timeout 25: Found 1 live models and 0 in-flight non-inference requests
I1021 08:43:49.761481 10492 model_lifecycle.cc:578] successfully unloaded '3_queryfeast' version 1
I1021 08:43:50.686134 10492 server.cc:300] Timeout 24: Found 0 live models and 0 in-flight non-inference requests
error: creating server: Internal - failed to load all models

---------- coverage: platform linux, python 3.8.10-final-0 -----------
Name Stmts Miss Cover

.tox/test-gpu/lib/python3.8/site-packages/merlin/core/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/_version.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/compat.py 10 4 60%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/dispatch.py 355 212 40%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/protocols.py 100 45 55%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/utils.py 195 108 45%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/init.py 5 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/base_operator.py 122 15 88%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/dictarray.py 54 30 44%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/executors.py 120 21 82%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/graph.py 99 24 76%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/node.py 344 146 58%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/init.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/concat_columns.py 17 1 94%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/selection.py 20 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/subset_columns.py 12 4 67%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/subtraction.py 21 11 48%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/selector.py 101 27 73%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/init.py 3 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/aliccp/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/aliccp/dataset.py 141 102 28%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/dressipi/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/dressipi/dataset.py 45 37 18%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/synthetic.py 147 56 62%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/init.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/csv.py 57 38 33%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dask.py 181 97 46%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dataframe_engine.py 61 38 38%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dataframe_iter.py 21 2 90%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dataset.py 346 161 53%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dataset_engine.py 37 8 78%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/fsspec_utils.py 127 108 15%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/hugectr.py 45 35 22%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/parquet.py 603 344 43%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/shuffle.py 38 18 53%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/worker.py 80 29 64%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/writer.py 190 81 57%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/writer_factory.py 18 5 72%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/_version.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/config/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/config/schema.py 62 19 69%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/backend.py 379 113 70%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/dataframe_iter.py 21 17 19%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/tf_utils.py 57 27 53%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/utils.py 40 15 62%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/init.py 70 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/cross.py 44 28 36%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/dlrm.py 49 8 84%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/experts.py 99 75 24%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/interaction.py 108 55 49%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/mlp.py 114 55 52%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/optimizer.py 173 127 27%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/retrieval/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/retrieval/base.py 169 89 47%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/retrieval/matrix_factorization.py 35 19 46%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/retrieval/two_tower.py 30 4 87%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/base.py 29 7 76%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/cross_batch.py 46 31 33%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/in_batch.py 35 12 66%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/queue.py 115 99 14%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/aggregation.py 245 109 56%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/base.py 244 108 56%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/combinators.py 421 149 65%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/encoder.py 170 117 31%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/index.py 104 69 34%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/prediction.py 50 18 64%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/tabular.py 288 74 74%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/inputs/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/inputs/base.py 59 35 41%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/inputs/continuous.py 39 4 90%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/inputs/embedding.py 457 150 67%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/loader.py 243 125 49%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/losses/init.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/losses/base.py 9 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/losses/listwise.py 13 1 92%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/losses/pairwise.py 115 57 50%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/metrics/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/metrics/topk.py 196 81 59%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/base.py 688 304 56%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/benchmark.py 16 6 62%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/ranking.py 67 43 36%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/retrieval.py 32 9 72%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/utils.py 10 2 80%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/base.py 123 90 27%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/classification.py 91 51 44%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/contrastive.py 147 107 27%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/regression.py 9 2 78%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/sampling/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/sampling/base.py 78 41 47%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/sampling/in_batch.py 37 22 41%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/sampling/popularity.py 27 17 37%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/topk.py 90 56 38%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/base.py 207 108 48%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/classification.py 68 22 68%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/multi.py 7 1 86%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/next_item.py 59 33 44%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/regression.py 35 19 46%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/retrieval.py 73 31 58%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transformers/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transformers/block.py 97 50 48%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transformers/transforms.py 36 8 78%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/bias.py 107 74 31%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/features.py 422 334 21%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/noise.py 43 28 35%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/regularization.py 17 6 65%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/sequence.py 282 212 25%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/tensor.py 107 54 50%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/typing.py 7 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/batch_utils.py 85 12 86%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/repr_utils.py 69 48 30%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/search_utils.py 34 22 35%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/tf_utils.py 207 139 33%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/constants.py 3 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/dataset.py 38 18 53%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/dependencies.py 26 19 27%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/doc_utils.py 10 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/example_utils.py 31 10 68%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/misc_utils.py 118 90 24%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/nvt_utils.py 27 24 11%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/registry.py 101 31 69%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/schema_utils.py 90 42 53%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/io/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/io/proto_utils.py 20 4 80%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/io/schema_bp.py 306 7 98%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/io/tensorflow_metadata.py 191 36 81%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/schema.py 209 53 75%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/tags.py 82 6 93%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/init.py 6 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/_version.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/init.py 3 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ensemble.py 151 58 62%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/node.py 23 1 96%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/op_runner.py 26 7 73%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/init.py 9 4 56%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/compat.py 24 8 67%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/faiss.py 74 36 51%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/feast.py 126 71 44%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/operator.py 76 30 61%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/softmax_sampling.py 51 22 57%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/tensorflow.py 112 31 72%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/unroll_features.py 50 23 54%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/workflow.py 72 26 64%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/model_registry.py 16 8 50%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/init.py 47 12 74%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/conversions.py 87 51 41%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/export.py 266 210 21%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/utils.py 72 14 81%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/init.py 22 20 9%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/base.py 113 14 88%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/hugectr.py 37 29 22%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/pytorch.py 10 6 40%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/tensorflow.py 32 13 59%

TOTAL 14211 6689 53%

=================== 1 failed, 2 passed in 278.27s (0:04:38) ====================
/usr/local/lib/python3.8/dist-packages/coverage/inorout.py:519: CoverageWarning: Module merlin was never imported. (module-not-imported)
self.warn(f"Module {pkg} was never imported.", slug="module-not-imported")
/usr/local/lib/python3.8/dist-packages/coverage/control.py:801: CoverageWarning: No data was collected. (no-data-collected)
self._warn("No data was collected.", slug="no-data-collected")
ERROR: InvocationError for command /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/bin/python -m pytest --cov-report term --cov merlin -rxs tests/unit (exited with code 1)
___________________________________ summary ____________________________________
ERROR: test-gpu: commands failed
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Merlin/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[merlin_merlin] $ /bin/bash /tmp/jenkins14443911830812416743.sh

@jperez999 jperez999 assigned jperez999 and EmmaQiaoCh and unassigned jperez999 Oct 21, 2022
@jperez999 jperez999 added breaking Breaking change ci labels Oct 21, 2022
@jperez999
Copy link
Collaborator

rerun tests

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #705 of commit d9b0642b37b212e5074e1b79ad59d0747bdb06bd, no merge conflicts.
Running as SYSTEM
Setting status of d9b0642b37b212e5074e1b79ad59d0747bdb06bd to PENDING with url https://10.20.13.93:8080/job/merlin_merlin/528/console and message: 'Pending'
Using context: Jenkins
Building on master in workspace /var/jenkins_home/workspace/merlin_merlin
using credential systems-login
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Merlin # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Merlin
 > git --version # timeout=10
using GIT_ASKPASS to set credentials login for merlin-systems
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Merlin +refs/pull/705/*:refs/remotes/origin/pr/705/* # timeout=10
 > git rev-parse d9b0642b37b212e5074e1b79ad59d0747bdb06bd^{commit} # timeout=10
Checking out Revision d9b0642b37b212e5074e1b79ad59d0747bdb06bd (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f d9b0642b37b212e5074e1b79ad59d0747bdb06bd # timeout=10
Commit message: "Update for change of hugectr branch name:"
 > git rev-list --no-walk d9b0642b37b212e5074e1b79ad59d0747bdb06bd # timeout=10
[merlin_merlin] $ /bin/bash /tmp/jenkins17395235970113831454.sh
GLOB sdist-make: /var/jenkins_home/workspace/merlin_merlin/merlin/setup.py
test-gpu recreate: /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
test-gpu installdeps: pytest, pytest-cov
WARNING: Discarding $PYTHONPATH from environment, to override specify PYTHONPATH in 'passenv' in your configuration.
test-gpu inst: /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/.tmp/package/1/merlin-0.0.1.zip
WARNING: Discarding $PYTHONPATH from environment, to override specify PYTHONPATH in 'passenv' in your configuration.
test-gpu installed: absl-py==1.2.0,aiohttp==3.8.1,aiosignal==1.2.0,alabaster==0.7.12,anyio==3.6.1,argon2-cffi==21.3.0,argon2-cffi-bindings==21.2.0,astroid==2.5.6,asttokens==2.0.8,astunparse==1.6.3,asv==0.5.1,asvdb==0.4.2,async-timeout==4.0.2,attrs==22.1.0,awscli==1.25.96,Babel==2.10.3,backcall==0.2.0,beautifulsoup4==4.11.1,betterproto==1.2.5,black==22.6.0,bleach==5.0.1,boto3==1.24.75,botocore==1.27.95,Brotli==1.0.9,cachetools==5.2.0,certifi==2019.11.28,cffi==1.15.1,chardet==3.0.4,charset-normalizer==2.1.1,clang==5.0,click==8.1.3,cloudpickle==2.2.0,cmake==3.24.1.1,colorama==0.4.4,contourpy==1.0.5,coverage==6.5.0,cuda-python==11.7.1,cupy-cuda117==10.6.0,cycler==0.11.0,Cython==0.29.32,dask==2022.1.1,dbus-python==1.2.16,debugpy==1.6.3,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.5.1,distlib==0.3.6,distributed==2022.5.1,distro==1.7.0,dm-tree==0.1.6,docker-pycreds==0.4.0,docutils==0.16,emoji==1.7.0,entrypoints==0.4,execnet==1.9.0,executing==1.0.0,faiss==1.7.2,faiss-gpu==1.7.2,fastai==2.7.9,fastapi==0.85.0,fastavro==1.6.1,fastcore==1.5.27,fastdownload==0.0.7,fastjsonschema==2.16.1,fastprogress==1.0.3,fastrlock==0.8,feast==0.19.4,fiddle==0.2.2,filelock==3.8.0,flatbuffers==1.12,fonttools==4.37.3,frozenlist==1.3.1,fsspec==2022.5.0,gast==0.4.0,gevent==21.12.0,geventhttpclient==2.0.2,gitdb==4.0.9,GitPython==3.1.27,google==3.0.0,google-api-core==2.10.1,google-auth==2.11.1,google-auth-oauthlib==0.4.6,google-pasta==0.2.0,googleapis-common-protos==1.52.0,graphviz==0.20.1,greenlet==1.1.3,grpcio==1.41.0,grpcio-channelz==1.49.0,grpcio-reflection==1.48.1,grpclib==0.4.3,h11==0.13.0,h2==4.1.0,h5py==3.7.0,HeapDict==1.0.1,hpack==4.0.0,httptools==0.5.0,hugectr2onnx==0.0.0,huggingface-hub==0.9.1,hyperframe==6.0.1,idna==2.8,imagesize==1.4.1,implicit==0.6.1,importlib-metadata==4.12.0,importlib-resources==5.9.0,iniconfig==1.1.1,ipykernel==6.15.3,ipython==8.5.0,ipython-genutils==0.2.0,ipywidgets==7.7.0,jedi==0.18.1,Jinja2==3.1.2,jmespath==1.0.1,joblib==1.2.0,json5==0.9.10,jsonschema==4.16.0,jupyter-cache==0.4.3,jupyter-core==4.11.1,jupyter-server==1.18.1,jupyter-server-mathjax==0.2.5,jupyter-sphinx==0.3.2,jupyter_client==7.3.5,jupyterlab==3.4.7,jupyterlab-pygments==0.2.2,jupyterlab-widgets==1.1.0,jupyterlab_server==2.15.1,keras==2.9.0,Keras-Preprocessing==1.1.2,kiwisolver==1.4.4,lazy-object-proxy==1.7.1,libclang==14.0.6,libcst==0.4.7,lightfm==1.16,lightgbm==3.3.2,linkify-it-py==1.0.3,llvmlite==0.39.1,locket==1.0.0,lxml==4.9.1,Markdown==3.4.1,markdown-it-py==1.1.0,MarkupSafe==2.1.1,matplotlib==3.6.0,matplotlib-inline==0.1.6,mdit-py-plugins==0.2.8,merlin==0.0.1,merlin-core==0.6.0+1.g5926fcf,merlin-models==0.7.0+11.g280956aa4,merlin-systems==0.5.0+4.g15074ad,mistune==2.0.4,mmh3==3.0.0,mpi4py==3.1.3,msgpack==1.0.4,multidict==6.0.2,mypy-extensions==0.4.3,myst-nb==0.13.2,myst-parser==0.15.2,natsort==8.1.0,nbclassic==0.4.3,nbclient==0.6.8,nbconvert==7.0.0,nbdime==3.1.1,nbformat==5.5.0,nest-asyncio==1.5.5,ninja==1.10.2.3,notebook==6.4.12,notebook-shim==0.1.0,numba==0.56.2,numpy==1.22.4,nvidia-pyindex==1.0.9,# Editable install with no version control (nvtabular==1.4.0+8.g95e12d347),-e /usr/local/lib/python3.8/dist-packages,nvtx==0.2.5,oauthlib==3.2.1,oldest-supported-numpy==2022.8.16,onnx==1.12.0,onnxruntime==1.11.1,opt-einsum==3.3.0,packaging==21.3,pandas==1.3.5,pandavro==1.5.2,pandocfilters==1.5.0,parso==0.8.3,partd==1.3.0,pathtools==0.1.2,pexpect==4.8.0,pickleshare==0.7.5,Pillow==9.2.0,pkgutil_resolve_name==1.3.10,platformdirs==2.5.2,pluggy==1.0.0,prometheus-client==0.14.1,promise==2.3,prompt-toolkit==3.0.31,proto-plus==1.19.6,protobuf==3.19.5,psutil==5.9.2,ptyprocess==0.7.0,pure-eval==0.2.2,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pybind11==2.10.0,pycparser==2.21,pydantic==1.10.2,pydot==1.4.2,Pygments==2.13.0,PyGObject==3.36.0,pynvml==11.4.1,pyparsing==3.0.9,pyrsistent==0.18.1,pytest==7.1.3,pytest-cov==4.0.0,pytest-forked==1.4.0,pytest-xdist==2.5.0,python-apt==2.0.0+ubuntu0.20.4.8,python-dateutil==2.8.2,python-dotenv==0.21.0,python-rapidjson==1.8,pytz==2022.2.1,PyYAML==5.4.1,pyzmq==24.0.0,regex==2022.9.13,requests==2.22.0,requests-oauthlib==1.3.1,requests-unixsocket==0.2.0,rsa==4.7.2,s3fs==2022.2.0,s3transfer==0.6.0,sacremoses==0.0.53,scikit-build==0.15.0,scikit-learn==1.1.2,scipy==1.9.1,seedir==0.3.0,Send2Trash==1.8.0,sentry-sdk==1.9.8,setproctitle==1.3.2,setuptools-scm==7.0.5,shortuuid==1.0.9,six==1.15.0,sklearn==0.0,smmap==5.0.0,sniffio==1.3.0,snowballstemmer==2.2.0,sortedcontainers==2.4.0,soupsieve==2.3.2.post1,Sphinx==5.3.0,sphinx-multiversion==0.2.4,sphinx-togglebutton==0.3.1,sphinx_external_toc==0.3.0,sphinxcontrib-applehelp==1.0.2,sphinxcontrib-copydirs @ git+https://github.com/mikemckiernan/sphinxcontrib-copydirs.git@bd8c5d79b3f91cf5f1bb0d6995aeca3fe84b670e,sphinxcontrib-devhelp==1.0.2,sphinxcontrib-htmlhelp==2.0.0,sphinxcontrib-jsmath==1.0.1,sphinxcontrib-qthelp==1.0.3,sphinxcontrib-serializinghtml==1.1.5,SQLAlchemy==1.4.36,stack-data==0.5.0,starlette==0.20.4,stringcase==1.2.0,supervisor==4.1.0,tabulate==0.8.10,tblib==1.7.0,tdqm==0.0.1,tenacity==8.0.1,tensorboard==2.9.1,tensorboard-data-server==0.6.1,tensorboard-plugin-wit==1.8.1,tensorflow==2.6.2,tensorflow-estimator==2.9.0,tensorflow-gpu==2.9.2,tensorflow-io-gcs-filesystem==0.27.0,tensorflow-metadata==1.10.0,termcolor==2.0.1,terminado==0.15.0,testbook==0.4.2,threadpoolctl==3.1.0,tinycss2==1.1.1,tokenizers==0.10.3,toml==0.10.2,tomli==2.0.1,toolz==0.12.0,torch==1.12.1+cu113,torchmetrics==0.3.2,tornado==6.2,tox==3.26.0,tqdm==4.64.1,traitlets==5.4.0,transformers==4.12.0,transformers4rec==0.1.12+2.gbcc939255,treelite==2.3.0,treelite-runtime==2.3.0,tritonclient==2.25.0,typing-inspect==0.8.0,typing_extensions==4.3.0,uc-micro-py==1.0.1,urllib3==1.26.12,uvicorn==0.18.3,uvloop==0.17.0,versioneer==0.20,virtualenv==20.16.5,wandb==0.13.3,watchfiles==0.17.0,wcwidth==0.2.5,webencodings==0.5.1,websocket-client==1.4.1,websockets==10.3,Werkzeug==2.2.2,widgetsnbextension==3.6.0,wrapt==1.12.1,xgboost==1.6.2,yarl==1.8.1,zict==2.2.0,zipp==3.8.1,zope.event==4.5.0,zope.interface==5.4.0
test-gpu run-test-pre: PYTHONHASHSEED='3734722792'
test-gpu run-test: commands[0] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/systems.git
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/NVIDIA-Merlin/systems.git
  Cloning https://github.com/NVIDIA-Merlin/systems.git to /tmp/pip-req-build-6uvwz6vg
  Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/systems.git /tmp/pip-req-build-6uvwz6vg
  Resolved https://github.com/NVIDIA-Merlin/systems.git to commit e6516776e33d98387b697e637cadd201d04ab309
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: merlin-core>=0.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-systems==0.6.0+7.ge651677) (0.3.0+12.g78ecddd)
Requirement already satisfied: requests<3,>=2.10 in /usr/lib/python3/dist-packages (from merlin-systems==0.6.0+7.ge651677) (2.22.0)
Requirement already satisfied: nvtabular>=1.0.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-systems==0.6.0+7.ge651677) (1.1.1)
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (4.64.1)
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (3.19.5)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (1.3.5)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (0.55.1)
Requirement already satisfied: dask>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (2022.3.0)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (1.2.5)
Requirement already satisfied: distributed>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (2022.3.0)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (1.10.0)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (7.0.0)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (21.3)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (0.4.3)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (1.2.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (2.2.0)
Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (5.4.1)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (1.2.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (0.12.0)
Requirement already satisfied: fsspec>=0.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (2022.5.0)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (3.1.2)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (1.7.0)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (2.0.0)
Requirement already satisfied: tornado>=6.0.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (6.1)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (1.0.4)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (2.4.0)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (5.8.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (8.1.3)
Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (1.20.3)
Collecting llvmlite<0.39,>=0.38.0rc1
  Downloading llvmlite-0.38.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 34.5/34.5 MB 8.0 MB/s eta 0:00:00
Requirement already satisfied: setuptools in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (65.3.0)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (3.0.9)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (2.8.2)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (2022.2.1)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (1.52.0)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (1.2.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (0.2.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (1.15.0)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (1.0.1)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (6.0.2)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (4.1.0)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from jinja2->distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (2.1.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (4.0.0)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.6.0+7.ge651677) (6.0.1)
Building wheels for collected packages: merlin-systems
  Building wheel for merlin-systems (pyproject.toml): started
  Building wheel for merlin-systems (pyproject.toml): finished with status 'done'
  Created wheel for merlin-systems: filename=merlin_systems-0.6.0+7.ge651677-py3-none-any.whl size=83585 sha256=df8f1ec852f39158f5714d6fe2903c2df7182af4472f1a19bcd82de1617902d3
  Stored in directory: /tmp/pip-ephem-wheel-cache-y4ce2pjp/wheels/d3/db/b8/99d510a979c278774eda4142f1c0643c93b7b2674aff321c16
Successfully built merlin-systems
Installing collected packages: llvmlite, merlin-systems
  Attempting uninstall: llvmlite
    Found existing installation: llvmlite 0.39.1
    Not uninstalling llvmlite at /usr/local/lib/python3.8/dist-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
    Can't uninstall 'llvmlite'. No files were found to uninstall.
  Attempting uninstall: merlin-systems
    Found existing installation: merlin-systems 0.5.0+4.g15074ad
    Not uninstalling merlin-systems at /usr/local/lib/python3.8/dist-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
    Can't uninstall 'merlin-systems'. No files were found to uninstall.
Successfully installed llvmlite-0.38.1 merlin-systems-0.6.0+7.ge651677

[notice] A new release of pip available: 22.2.2 -> 22.3
[notice] To update, run: pip install --upgrade pip
test-gpu run-test: commands[1] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/models.git
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/NVIDIA-Merlin/models.git
Cloning https://github.com/NVIDIA-Merlin/models.git to /tmp/pip-req-build-ilqv_v0w
Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/models.git /tmp/pip-req-build-ilqv_v0w
Resolved https://github.com/NVIDIA-Merlin/models.git to commit f11d77adca7fb39efd94d71ec3a420f60a2dbd89
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: merlin-core>=0.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-models==0.8.0+26.gf11d77ad) (0.3.0+12.g78ecddd)
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (4.64.1)
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (3.19.5)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.3.5)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (0.55.1)
Requirement already satisfied: dask>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2022.3.0)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.2.5)
Requirement already satisfied: distributed>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2022.3.0)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.10.0)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (7.0.0)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (21.3)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (0.4.3)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.2.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2.2.0)
Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (5.4.1)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.2.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (0.12.0)
Requirement already satisfied: fsspec>=0.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2022.5.0)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (3.1.2)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.7.0)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2.0.0)
Requirement already satisfied: tornado>=6.0.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (6.1)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.0.4)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2.4.0)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (5.8.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (8.1.3)
Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.20.3)
Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (0.38.1)
Requirement already satisfied: setuptools in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (65.3.0)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (3.0.9)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2.8.2)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2022.2.1)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.52.0)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.2.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (0.2.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.15.0)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.0.1)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (6.0.2)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (4.1.0)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from jinja2->distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2.1.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (4.0.0)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (6.0.1)
Building wheels for collected packages: merlin-models
Building wheel for merlin-models (pyproject.toml): started
Building wheel for merlin-models (pyproject.toml): finished with status 'done'
Created wheel for merlin-models: filename=merlin_models-0.8.0+26.gf11d77ad-py3-none-any.whl size=349807 sha256=5914d59611c067d67f5dbcd61cd82d6f4b4ba94f8a0796b55032b64355fbe6db
Stored in directory: /tmp/pip-ephem-wheel-cache-boyutim2/wheels/5a/43/99/d50fe2c33b4f4686db73207ce3865e0d6be6609ffb03abade5
Successfully built merlin-models
Installing collected packages: merlin-models
Attempting uninstall: merlin-models
Found existing installation: merlin-models 0.7.0+11.g280956aa4
Not uninstalling merlin-models at /usr/local/lib/python3.8/dist-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
Can't uninstall 'merlin-models'. No files were found to uninstall.
Successfully installed merlin-models-0.8.0+26.gf11d77ad

[notice] A new release of pip available: 22.2.2 -> 22.3
[notice] To update, run: pip install --upgrade pip
test-gpu run-test: commands[2] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/NVTabular.git
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/NVIDIA-Merlin/NVTabular.git
Cloning https://github.com/NVIDIA-Merlin/NVTabular.git to /tmp/pip-req-build-0lt5zhcq
Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/NVTabular.git /tmp/pip-req-build-0lt5zhcq
Resolved https://github.com/NVIDIA-Merlin/NVTabular.git to commit c0636deadefebcf238935267239406bf7cc6803f
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: merlin-core>=0.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==1.5.0+6.gc0636dea) (0.3.0+12.g78ecddd)
Requirement already satisfied: scipy in /usr/local/lib/python3.8/dist-packages (from nvtabular==1.5.0+6.gc0636dea) (1.9.1)
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (4.64.1)
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (3.19.5)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.3.5)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (0.55.1)
Requirement already satisfied: dask>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (2022.3.0)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.2.5)
Requirement already satisfied: distributed>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (2022.3.0)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.10.0)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (7.0.0)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (21.3)
Requirement already satisfied: numpy<1.25.0,>=1.18.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from scipy->nvtabular==1.5.0+6.gc0636dea) (1.20.3)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (0.4.3)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.2.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (2.2.0)
Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (5.4.1)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.2.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (0.12.0)
Requirement already satisfied: fsspec>=0.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (2022.5.0)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (3.1.2)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.7.0)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (2.0.0)
Requirement already satisfied: tornado>=6.0.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (6.1)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.0.4)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (2.4.0)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (5.8.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (8.1.3)
Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (0.38.1)
Requirement already satisfied: setuptools in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (65.3.0)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (3.0.9)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (2.8.2)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (2022.2.1)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.52.0)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.2.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (0.2.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.15.0)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.0.1)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (6.0.2)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (4.1.0)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from jinja2->distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (2.1.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (4.0.0)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (6.0.1)
Building wheels for collected packages: nvtabular
Building wheel for nvtabular (pyproject.toml): started
Building wheel for nvtabular (pyproject.toml): finished with status 'done'
Created wheel for nvtabular: filename=nvtabular-1.5.0+6.gc0636dea-cp38-cp38-linux_x86_64.whl size=266742 sha256=6e38525ce013be63e8cd8f1cde04688de6158315b67ff0bcb580ae7ad0aeb13c
Stored in directory: /tmp/pip-ephem-wheel-cache-jlhuhm14/wheels/c2/16/76/39994bff39d812513de5b5572bff0903b9eb8f6c645b44cedc
Successfully built nvtabular
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 1.1.1
Not uninstalling nvtabular at /var/jenkins_home/.local/lib/python3.8/site-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
Can't uninstall 'nvtabular'. No files were found to uninstall.
Successfully installed nvtabular-1.5.0+6.gc0636dea

[notice] A new release of pip available: 22.2.2 -> 22.3
[notice] To update, run: pip install --upgrade pip
test-gpu run-test: commands[3] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/core.git
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/NVIDIA-Merlin/core.git
Cloning https://github.com/NVIDIA-Merlin/core.git to /tmp/pip-req-build-x75kj_c2
Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/core.git /tmp/pip-req-build-x75kj_c2
Resolved https://github.com/NVIDIA-Merlin/core.git to commit 2c621a26a2b1b7ed786c99bd7c2790b9fc675098
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.7.0+12.g2c621a2) (4.64.1)
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.7.0+12.g2c621a2) (3.19.5)
Requirement already satisfied: dask>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.7.0+12.g2c621a2) (2022.3.0)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.7.0+12.g2c621a2) (1.3.5)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.7.0+12.g2c621a2) (0.55.1)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.7.0+12.g2c621a2) (1.2.5)
Requirement already satisfied: distributed>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.7.0+12.g2c621a2) (2022.3.0)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.7.0+12.g2c621a2) (1.10.0)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.7.0+12.g2c621a2) (7.0.0)
Requirement already satisfied: fsspec==2022.5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.7.0+12.g2c621a2) (2022.5.0)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.7.0+12.g2c621a2) (21.3)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.7.0+12.g2c621a2) (0.4.3)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.7.0+12.g2c621a2) (1.2.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (2.2.0)
Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (5.4.1)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (1.2.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (0.12.0)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (3.1.2)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (1.7.0)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (2.0.0)
Requirement already satisfied: tornado>=6.0.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (6.1)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (1.0.4)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (2.4.0)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (5.8.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (8.1.3)
Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.7.0+12.g2c621a2) (1.20.3)
Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.7.0+12.g2c621a2) (0.38.1)
Requirement already satisfied: setuptools in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.7.0+12.g2c621a2) (65.3.0)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core==0.7.0+12.g2c621a2) (3.0.9)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.7.0+12.g2c621a2) (2.8.2)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.7.0+12.g2c621a2) (2022.2.1)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.7.0+12.g2c621a2) (1.52.0)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.7.0+12.g2c621a2) (1.2.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (0.2.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core==0.7.0+12.g2c621a2) (1.15.0)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (1.0.1)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.7.0+12.g2c621a2) (6.0.2)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.7.0+12.g2c621a2) (4.1.0)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from jinja2->distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (2.1.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.7.0+12.g2c621a2) (4.0.0)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.7.0+12.g2c621a2) (6.0.1)
Building wheels for collected packages: merlin-core
Building wheel for merlin-core (pyproject.toml): started
Building wheel for merlin-core (pyproject.toml): finished with status 'done'
Created wheel for merlin-core: filename=merlin_core-0.7.0+12.g2c621a2-py3-none-any.whl size=118267 sha256=51ac47a92c2a1eabe0bcca00744730fdb31aa41c11031215c4fdbef19d5cf7e2
Stored in directory: /tmp/pip-ephem-wheel-cache-qm070mwd/wheels/c8/38/16/a6968787eafcec5fa772148af8408b089562f71af0752e8e84
Successfully built merlin-core
Installing collected packages: merlin-core
Attempting uninstall: merlin-core
Found existing installation: merlin-core 0.3.0+12.g78ecddd
Not uninstalling merlin-core at /var/jenkins_home/.local/lib/python3.8/site-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
Can't uninstall 'merlin-core'. No files were found to uninstall.
Successfully installed merlin-core-0.7.0+12.g2c621a2

[notice] A new release of pip available: 22.2.2 -> 22.3
[notice] To update, run: pip install --upgrade pip
test-gpu run-test: commands[4] | python -m pytest --cov-report term --cov merlin -rxs tests/unit
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
cachedir: .tox/test-gpu/.pytest_cache
rootdir: /var/jenkins_home/workspace/merlin_merlin/merlin
plugins: anyio-3.5.0, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 3 items

tests/unit/test_version.py . [ 33%]
tests/unit/examples/test_building_deploying_multi_stage_RecSys.py F [ 66%]
tests/unit/examples/test_scaling_criteo_merlin_models.py . [100%]

=================================== FAILURES ===================================
__________________________________ test_func ___________________________________

self = <testbook.client.TestbookNotebookClient object at 0x7fce9f489c10>
cell = [55], kwargs = {}, cell_indexes = [55], executed_cells = [], idx = 55

def execute_cell(self, cell, **kwargs) -> Union[Dict, List[Dict]]:
    """
    Executes a cell or list of cells
    """
    if isinstance(cell, slice):
        start, stop = self._cell_index(cell.start), self._cell_index(cell.stop)
        if cell.step is not None:
            raise TestbookError('testbook does not support step argument')

        cell = range(start, stop + 1)
    elif isinstance(cell, str) or isinstance(cell, int):
        cell = [cell]

    cell_indexes = cell

    if all(isinstance(x, str) for x in cell):
        cell_indexes = [self._cell_index(tag) for tag in cell]

    executed_cells = []
    for idx in cell_indexes:
        try:
          cell = super().execute_cell(self.nb['cells'][idx], idx, **kwargs)

../../../.local/lib/python3.8/site-packages/testbook/client.py:133:


args = (<testbook.client.TestbookNotebookClient object at 0x7fce9f489c10>, {'id': 'f418ff8c', 'cell_type': 'code', 'metadata'...[38;5;241m.\x1b[39mis_server_ready()\n', '\x1b[0;31mRuntimeError\x1b[0m: Tritonserver failed to start (ret=1)']}]}, 55)
kwargs = {}

def wrapped(*args, **kwargs):
  return just_run(coro(*args, **kwargs))

../../../.local/lib/python3.8/site-packages/nbclient/util.py:84:


coro = <coroutine object NotebookClient.async_execute_cell at 0x7fce9e117f40>

def just_run(coro: Awaitable) -> Any:
    """Make the coroutine run, even if there is an event loop running (using nest_asyncio)"""
    # original from vaex/asyncio.py
    loop = asyncio._get_running_loop()
    if loop is None:
        had_running_loop = False
        try:
            loop = asyncio.get_event_loop()
        except RuntimeError:
            # we can still get 'There is no current event loop in ...'
            loop = asyncio.new_event_loop()
            asyncio.set_event_loop(loop)
    else:
        had_running_loop = True
    if had_running_loop:
        # if there is a running loop, we patch using nest_asyncio
        # to have reentrant event loops
        check_ipython()
        import nest_asyncio

        nest_asyncio.apply()
        check_patch_tornado()
  return loop.run_until_complete(coro)

../../../.local/lib/python3.8/site-packages/nbclient/util.py:62:


self = <_UnixSelectorEventLoop running=False closed=False debug=False>
future = <Task finished name='Task-377' coro=<NotebookClient.async_execute_cell() done, defined at /var/jenkins_home/.local/lib...0;31mRuntimeError\x1b[0m: Tritonserver failed to start (ret=1)\nRuntimeError: Tritonserver failed to start (ret=1)\n')>

def run_until_complete(self, future):
    """Run until the Future is done.

    If the argument is a coroutine, it is wrapped in a Task.

    WARNING: It would be disastrous to call run_until_complete()
    with the same coroutine twice -- it would wrap it in two
    different Tasks and that can't be good.

    Return the Future's result, or raise its exception.
    """
    self._check_closed()
    self._check_running()

    new_task = not futures.isfuture(future)
    future = tasks.ensure_future(future, loop=self)
    if new_task:
        # An exception is raised if the future didn't complete, so there
        # is no need to log the "destroy pending task" message
        future._log_destroy_pending = False

    future.add_done_callback(_run_until_complete_cb)
    try:
        self.run_forever()
    except:
        if new_task and future.done() and not future.cancelled():
            # The coroutine raised a BaseException. Consume the exception
            # to not log a warning, the caller doesn't have access to the
            # local task.
            future.exception()
        raise
    finally:
        future.remove_done_callback(_run_until_complete_cb)
    if not future.done():
        raise RuntimeError('Event loop stopped before Future completed.')
  return future.result()

/usr/lib/python3.8/asyncio/base_events.py:616:


self = <testbook.client.TestbookNotebookClient object at 0x7fce9f489c10>
cell = {'id': 'f418ff8c', 'cell_type': 'code', 'metadata': {'execution': {'iopub.status.busy': '2022-10-21T16:12:23.199554Z',...t\x1b[38;5;241m.\x1b[39mis_server_ready()\n', '\x1b[0;31mRuntimeError\x1b[0m: Tritonserver failed to start (ret=1)']}]}
cell_index = 55, execution_count = None, store_history = True

async def async_execute_cell(
    self,
    cell: NotebookNode,
    cell_index: int,
    execution_count: t.Optional[int] = None,
    store_history: bool = True,
) -> NotebookNode:
    """
    Executes a single code cell.

    To execute all cells see :meth:`execute`.

    Parameters
    ----------
    cell : nbformat.NotebookNode
        The cell which is currently being processed.
    cell_index : int
        The position of the cell within the notebook object.
    execution_count : int
        The execution count to be assigned to the cell (default: Use kernel response)
    store_history : bool
        Determines if history should be stored in the kernel (default: False).
        Specific to ipython kernels, which can store command histories.

    Returns
    -------
    output : dict
        The execution output payload (or None for no output).

    Raises
    ------
    CellExecutionError
        If execution failed and should raise an exception, this will be raised
        with defaults about the failure.

    Returns
    -------
    cell : NotebookNode
        The cell which was just processed.
    """
    assert self.kc is not None

    await run_hook(self.on_cell_start, cell=cell, cell_index=cell_index)

    if cell.cell_type != 'code' or not cell.source.strip():
        self.log.debug("Skipping non-executing cell %s", cell_index)
        return cell

    if self.skip_cells_with_tag in cell.metadata.get("tags", []):
        self.log.debug("Skipping tagged cell %s", cell_index)
        return cell

    if self.record_timing:  # clear execution metadata prior to execution
        cell['metadata']['execution'] = {}

    self.log.debug("Executing cell:\n%s", cell.source)

    cell_allows_errors = (not self.force_raise_errors) and (
        self.allow_errors or "raises-exception" in cell.metadata.get("tags", [])
    )

    await run_hook(self.on_cell_execute, cell=cell, cell_index=cell_index)
    parent_msg_id = await ensure_async(
        self.kc.execute(
            cell.source, store_history=store_history, stop_on_error=not cell_allows_errors
        )
    )
    await run_hook(self.on_cell_complete, cell=cell, cell_index=cell_index)
    # We launched a code cell to execute
    self.code_cells_executed += 1
    exec_timeout = self._get_timeout(cell)

    cell.outputs = []
    self.clear_before_next_output = False

    task_poll_kernel_alive = asyncio.ensure_future(self._async_poll_kernel_alive())
    task_poll_output_msg = asyncio.ensure_future(
        self._async_poll_output_msg(parent_msg_id, cell, cell_index)
    )
    self.task_poll_for_reply = asyncio.ensure_future(
        self._async_poll_for_reply(
            parent_msg_id, cell, exec_timeout, task_poll_output_msg, task_poll_kernel_alive
        )
    )
    try:
        exec_reply = await self.task_poll_for_reply
    except asyncio.CancelledError:
        # can only be cancelled by task_poll_kernel_alive when the kernel is dead
        task_poll_output_msg.cancel()
        raise DeadKernelError("Kernel died")
    except Exception as e:
        # Best effort to cancel request if it hasn't been resolved
        try:
            # Check if the task_poll_output is doing the raising for us
            if not isinstance(e, CellControlSignal):
                task_poll_output_msg.cancel()
        finally:
            raise

    if execution_count:
        cell['execution_count'] = execution_count
  await self._check_raise_for_error(cell, cell_index, exec_reply)

../../../.local/lib/python3.8/site-packages/nbclient/client.py:965:


self = <testbook.client.TestbookNotebookClient object at 0x7fce9f489c10>
cell = {'id': 'f418ff8c', 'cell_type': 'code', 'metadata': {'execution': {'iopub.status.busy': '2022-10-21T16:12:23.199554Z',...t\x1b[38;5;241m.\x1b[39mis_server_ready()\n', '\x1b[0;31mRuntimeError\x1b[0m: Tritonserver failed to start (ret=1)']}]}
cell_index = 55
exec_reply = {'buffers': [], 'content': {'ename': 'RuntimeError', 'engine_info': {'engine_id': -1, 'engine_uuid': '107c204d-e713-47...e, 'engine': '107c204d-e713-47fe-8e95-5a7dc8c0c0e2', 'started': '2022-10-21T16:12:23.199959Z', 'status': 'error'}, ...}

async def _check_raise_for_error(
    self, cell: NotebookNode, cell_index: int, exec_reply: t.Optional[t.Dict]
) -> None:

    if exec_reply is None:
        return None

    exec_reply_content = exec_reply['content']
    if exec_reply_content['status'] != 'error':
        return None

    cell_allows_errors = (not self.force_raise_errors) and (
        self.allow_errors
        or exec_reply_content.get('ename') in self.allow_error_names
        or "raises-exception" in cell.metadata.get("tags", [])
    )
    await run_hook(self.on_cell_error, cell=cell, cell_index=cell_index)
    if not cell_allows_errors:
      raise CellExecutionError.from_cell_and_msg(cell, exec_reply_content)

E nbclient.exceptions.CellExecutionError: An error occurred while executing the following cell:
E ------------------
E
E import shutil
E from merlin.core.dispatch import get_lib
E from merlin.models.loader.tf_utils import configure_tensorflow
E configure_tensorflow()
E df_lib = get_lib()
E batch = df_lib.read_parquet(
E os.path.join("/tmp/data/processed_nvt/", "train", "part_0.parquet"),
E num_rows=1,
E columns=["user_id_raw"],
E )
E from merlin.systems.triton.utils import run_ensemble_on_tritonserver
E response = run_ensemble_on_tritonserver(
E "/tmp/examples/poc_ensemble", ensemble.graph.input_schema, batch, outputs, "ensemble_model"
E )
E response = [x.tolist()[0] for x in response["ordered_ids"]]
E shutil.rmtree("/tmp/examples/", ignore_errors=True)
E
E ------------------
E
E �[0;31m---------------------------------------------------------------------------�[0m
E �[0;31mRuntimeError�[0m Traceback (most recent call last)
E Cell �[0;32mIn [32], line 12�[0m
E �[1;32m 6�[0m batch �[38;5;241m=�[39m df_lib�[38;5;241m.�[39mread_parquet(
E �[1;32m 7�[0m os�[38;5;241m.�[39mpath�[38;5;241m.�[39mjoin(�[38;5;124m"�[39m�[38;5;124m/tmp/data/processed_nvt/�[39m�[38;5;124m"�[39m, �[38;5;124m"�[39m�[38;5;124mtrain�[39m�[38;5;124m"�[39m, �[38;5;124m"�[39m�[38;5;124mpart_0.parquet�[39m�[38;5;124m"�[39m),
E �[1;32m 8�[0m num_rows�[38;5;241m=�[39m�[38;5;241m1�[39m,
E �[1;32m 9�[0m columns�[38;5;241m=�[39m[�[38;5;124m"�[39m�[38;5;124muser_id_raw�[39m�[38;5;124m"�[39m],
E �[1;32m 10�[0m )
E �[1;32m 11�[0m �[38;5;28;01mfrom�[39;00m �[38;5;21;01mmerlin�[39;00m�[38;5;21;01m.�[39;00m�[38;5;21;01msystems�[39;00m�[38;5;21;01m.�[39;00m�[38;5;21;01mtriton�[39;00m�[38;5;21;01m.�[39;00m�[38;5;21;01mutils�[39;00m �[38;5;28;01mimport�[39;00m run_ensemble_on_tritonserver
E �[0;32m---> 12�[0m response �[38;5;241m=�[39m �[43mrun_ensemble_on_tritonserver�[49m�[43m(�[49m
E �[1;32m 13�[0m �[43m �[49m�[38;5;124;43m"�[39;49m�[38;5;124;43m/tmp/examples/poc_ensemble�[39;49m�[38;5;124;43m"�[39;49m�[43m,�[49m�[43m �[49m�[43mensemble�[49m�[38;5;241;43m.�[39;49m�[43mgraph�[49m�[38;5;241;43m.�[39;49m�[43minput_schema�[49m�[43m,�[49m�[43m �[49m�[43mbatch�[49m�[43m,�[49m�[43m �[49m�[43moutputs�[49m�[43m,�[49m�[43m �[49m�[38;5;124;43m"�[39;49m�[38;5;124;43mensemble_model�[39;49m�[38;5;124;43m"�[39;49m
E �[1;32m 14�[0m �[43m)�[49m
E �[1;32m 15�[0m response �[38;5;241m=�[39m [x�[38;5;241m.�[39mtolist()[�[38;5;241m0�[39m] �[38;5;28;01mfor�[39;00m x �[38;5;129;01min�[39;00m response[�[38;5;124m"�[39m�[38;5;124mordered_ids�[39m�[38;5;124m"�[39m]]
E �[1;32m 16�[0m shutil�[38;5;241m.�[39mrmtree(�[38;5;124m"�[39m�[38;5;124m/tmp/examples/�[39m�[38;5;124m"�[39m, ignore_errors�[38;5;241m=�[39m�[38;5;28;01mTrue�[39;00m)
E
E File �[0;32m~/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/utils.py:138�[0m, in �[0;36mrun_ensemble_on_tritonserver�[0;34m(tmpdir, schema, df, output_columns, model_name)�[0m
E �[1;32m 115�[0m �[38;5;124;03m"""Starts up a Triton server instance, loads up the ensemble model,�[39;00m
E �[1;32m 116�[0m �[38;5;124;03mprepares the inference request and returns the unparsed inference�[39;00m
E �[1;32m 117�[0m �[38;5;124;03mresponse.�[39;00m
E �[0;32m (...)�[0m
E �[1;32m 135�[0m �[38;5;124;03m the results of the prediction, parsed by output column name.�[39;00m
E �[1;32m 136�[0m �[38;5;124;03m"""�[39;00m
E �[1;32m 137�[0m response �[38;5;241m=�[39m �[38;5;28;01mNone�[39;00m
E �[0;32m--> 138�[0m �[38;5;28;01mwith�[39;00m run_triton_server(tmpdir) �[38;5;28;01mas�[39;00m client:
E �[1;32m 139�[0m response �[38;5;241m=�[39m send_triton_request(
E �[1;32m 140�[0m schema, df, output_columns, client�[38;5;241m=�[39mclient, triton_model�[38;5;241m=�[39mmodel_name
E �[1;32m 141�[0m )
E �[1;32m 143�[0m �[38;5;28;01mreturn�[39;00m response
E
E File �[0;32m/usr/lib/python3.8/contextlib.py:113�[0m, in �[0;36m_GeneratorContextManager.__enter__�[0;34m(self)�[0m
E �[1;32m 111�[0m �[38;5;28;01mdel�[39;00m �[38;5;28mself�[39m�[38;5;241m.�[39margs, �[38;5;28mself�[39m�[38;5;241m.�[39mkwds, �[38;5;28mself�[39m�[38;5;241m.�[39mfunc
E �[1;32m 112�[0m �[38;5;28;01mtry�[39;00m:
E �[0;32m--> 113�[0m �[38;5;28;01mreturn�[39;00m �[38;5;28;43mnext�[39;49m�[43m(�[49m�[38;5;28;43mself�[39;49m�[38;5;241;43m.�[39;49m�[43mgen�[49m�[43m)�[49m
E �[1;32m 114�[0m �[38;5;28;01mexcept�[39;00m �[38;5;167;01mStopIteration�[39;00m:
E �[1;32m 115�[0m �[38;5;28;01mraise�[39;00m �[38;5;167;01mRuntimeError�[39;00m(�[38;5;124m"�[39m�[38;5;124mgenerator didn�[39m�[38;5;124m'�[39m�[38;5;124mt yield�[39m�[38;5;124m"�[39m) �[38;5;28;01mfrom�[39;00m �[38;5;28mNone�[39m
E
E File �[0;32m~/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/utils.py:81�[0m, in �[0;36mrun_triton_server�[0;34m(model_repository, grpc_host, grpc_port, backend_config)�[0m
E �[1;32m 79�[0m �[38;5;28;01mif�[39;00m process�[38;5;241m.�[39mpoll() �[38;5;129;01mis�[39;00m �[38;5;129;01mnot�[39;00m �[38;5;28;01mNone�[39;00m:
E �[1;32m 80�[0m retcode �[38;5;241m=�[39m process�[38;5;241m.�[39mreturncode
E �[0;32m---> 81�[0m �[38;5;28;01mraise�[39;00m �[38;5;167;01mRuntimeError�[39;00m(�[38;5;124mf�[39m�[38;5;124m"�[39m�[38;5;124mTritonserver failed to start (ret=�[39m�[38;5;132;01m{�[39;00mretcode�[38;5;132;01m}�[39;00m�[38;5;124m)�[39m�[38;5;124m"�[39m)
E �[1;32m 83�[0m �[38;5;28;01mtry�[39;00m:
E �[1;32m 84�[0m ready �[38;5;241m=�[39m client�[38;5;241m.�[39mis_server_ready()
E
E �[0;31mRuntimeError�[0m: Tritonserver failed to start (ret=1)
E RuntimeError: Tritonserver failed to start (ret=1)

../../../.local/lib/python3.8/site-packages/nbclient/client.py:862: CellExecutionError

During handling of the above exception, another exception occurred:

def test_func():
    with testbook(
        REPO_ROOT
        / "examples"
        / "Building-and-deploying-multi-stage-RecSys"
        / "01-Building-Recommender-Systems-with-Merlin.ipynb",
        execute=False,
    ) as tb1:
        tb1.inject(
            """
            import os
            os.environ["DATA_FOLDER"] = "/tmp/data/"
            os.environ["NUM_ROWS"] = "100000"
            os.system("mkdir -p /tmp/examples")
            os.environ["BASE_DIR"] = "/tmp/examples/"
            """
        )
        tb1.execute()
        assert os.path.isdir("/tmp/examples/dlrm")
        assert os.path.isdir("/tmp/examples/feature_repo")
        assert os.path.isdir("/tmp/examples/query_tower")
        assert os.path.isfile("/tmp/examples/item_embeddings.parquet")
        assert os.path.isfile("/tmp/examples/feature_repo/user_features.py")
        assert os.path.isfile("/tmp/examples/feature_repo/item_features.py")

    with testbook(
        REPO_ROOT
        / "examples"
        / "Building-and-deploying-multi-stage-RecSys"
        / "02-Deploying-multi-stage-RecSys-with-Merlin-Systems.ipynb",
        execute=False,
        timeout=120,
    ) as tb2:
        tb2.inject(
            """
            import os
            os.environ["DATA_FOLDER"] = "/tmp/data/"
            os.environ["BASE_DIR"] = "/tmp/examples/"
            os.environ["topk_retrieval"] = "20"
            """
        )
        NUM_OF_CELLS = len(tb2.cells)
        tb2.execute_cell(list(range(0, NUM_OF_CELLS - 3)))
        top_k = tb2.ref("top_k")
        outputs = tb2.ref("outputs")
        assert outputs[0] == "ordered_ids"
      tb2.inject(
            """
            import shutil
            from merlin.core.dispatch import get_lib
            from merlin.models.loader.tf_utils import configure_tensorflow
            configure_tensorflow()
            df_lib = get_lib()
            batch = df_lib.read_parquet(
                os.path.join("/tmp/data/processed_nvt/", "train", "part_0.parquet"),
                num_rows=1,
                columns=["user_id_raw"],
            )
            from merlin.systems.triton.utils import run_ensemble_on_tritonserver
            response = run_ensemble_on_tritonserver(
                "/tmp/examples/poc_ensemble", ensemble.graph.input_schema, batch, outputs,  "ensemble_model"
            )
            response = [x.tolist()[0] for x in response["ordered_ids"]]
            shutil.rmtree("/tmp/examples/", ignore_errors=True)
            """
        )

tests/unit/examples/test_building_deploying_multi_stage_RecSys.py:61:


../../../.local/lib/python3.8/site-packages/testbook/client.py:237: in inject
cell = TestbookNode(self.execute_cell(inject_idx)) if run else TestbookNode(code_cell)


self = <testbook.client.TestbookNotebookClient object at 0x7fce9f489c10>
cell = [55], kwargs = {}, cell_indexes = [55], executed_cells = [], idx = 55

def execute_cell(self, cell, **kwargs) -> Union[Dict, List[Dict]]:
    """
    Executes a cell or list of cells
    """
    if isinstance(cell, slice):
        start, stop = self._cell_index(cell.start), self._cell_index(cell.stop)
        if cell.step is not None:
            raise TestbookError('testbook does not support step argument')

        cell = range(start, stop + 1)
    elif isinstance(cell, str) or isinstance(cell, int):
        cell = [cell]

    cell_indexes = cell

    if all(isinstance(x, str) for x in cell):
        cell_indexes = [self._cell_index(tag) for tag in cell]

    executed_cells = []
    for idx in cell_indexes:
        try:
            cell = super().execute_cell(self.nb['cells'][idx], idx, **kwargs)
        except CellExecutionError as ce:
          raise TestbookRuntimeError(ce.evalue, ce, self._get_error_class(ce.ename))

E testbook.exceptions.TestbookRuntimeError: An error occurred while executing the following cell:
E ------------------
E
E import shutil
E from merlin.core.dispatch import get_lib
E from merlin.models.loader.tf_utils import configure_tensorflow
E configure_tensorflow()
E df_lib = get_lib()
E batch = df_lib.read_parquet(
E os.path.join("/tmp/data/processed_nvt/", "train", "part_0.parquet"),
E num_rows=1,
E columns=["user_id_raw"],
E )
E from merlin.systems.triton.utils import run_ensemble_on_tritonserver
E response = run_ensemble_on_tritonserver(
E "/tmp/examples/poc_ensemble", ensemble.graph.input_schema, batch, outputs, "ensemble_model"
E )
E response = [x.tolist()[0] for x in response["ordered_ids"]]
E shutil.rmtree("/tmp/examples/", ignore_errors=True)
E
E ------------------
E
E �[0;31m---------------------------------------------------------------------------�[0m
E �[0;31mRuntimeError�[0m Traceback (most recent call last)
E Cell �[0;32mIn [32], line 12�[0m
E �[1;32m 6�[0m batch �[38;5;241m=�[39m df_lib�[38;5;241m.�[39mread_parquet(
E �[1;32m 7�[0m os�[38;5;241m.�[39mpath�[38;5;241m.�[39mjoin(�[38;5;124m"�[39m�[38;5;124m/tmp/data/processed_nvt/�[39m�[38;5;124m"�[39m, �[38;5;124m"�[39m�[38;5;124mtrain�[39m�[38;5;124m"�[39m, �[38;5;124m"�[39m�[38;5;124mpart_0.parquet�[39m�[38;5;124m"�[39m),
E �[1;32m 8�[0m num_rows�[38;5;241m=�[39m�[38;5;241m1�[39m,
E �[1;32m 9�[0m columns�[38;5;241m=�[39m[�[38;5;124m"�[39m�[38;5;124muser_id_raw�[39m�[38;5;124m"�[39m],
E �[1;32m 10�[0m )
E �[1;32m 11�[0m �[38;5;28;01mfrom�[39;00m �[38;5;21;01mmerlin�[39;00m�[38;5;21;01m.�[39;00m�[38;5;21;01msystems�[39;00m�[38;5;21;01m.�[39;00m�[38;5;21;01mtriton�[39;00m�[38;5;21;01m.�[39;00m�[38;5;21;01mutils�[39;00m �[38;5;28;01mimport�[39;00m run_ensemble_on_tritonserver
E �[0;32m---> 12�[0m response �[38;5;241m=�[39m �[43mrun_ensemble_on_tritonserver�[49m�[43m(�[49m
E �[1;32m 13�[0m �[43m �[49m�[38;5;124;43m"�[39;49m�[38;5;124;43m/tmp/examples/poc_ensemble�[39;49m�[38;5;124;43m"�[39;49m�[43m,�[49m�[43m �[49m�[43mensemble�[49m�[38;5;241;43m.�[39;49m�[43mgraph�[49m�[38;5;241;43m.�[39;49m�[43minput_schema�[49m�[43m,�[49m�[43m �[49m�[43mbatch�[49m�[43m,�[49m�[43m �[49m�[43moutputs�[49m�[43m,�[49m�[43m �[49m�[38;5;124;43m"�[39;49m�[38;5;124;43mensemble_model�[39;49m�[38;5;124;43m"�[39;49m
E �[1;32m 14�[0m �[43m)�[49m
E �[1;32m 15�[0m response �[38;5;241m=�[39m [x�[38;5;241m.�[39mtolist()[�[38;5;241m0�[39m] �[38;5;28;01mfor�[39;00m x �[38;5;129;01min�[39;00m response[�[38;5;124m"�[39m�[38;5;124mordered_ids�[39m�[38;5;124m"�[39m]]
E �[1;32m 16�[0m shutil�[38;5;241m.�[39mrmtree(�[38;5;124m"�[39m�[38;5;124m/tmp/examples/�[39m�[38;5;124m"�[39m, ignore_errors�[38;5;241m=�[39m�[38;5;28;01mTrue�[39;00m)
E
E File �[0;32m~/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/utils.py:138�[0m, in �[0;36mrun_ensemble_on_tritonserver�[0;34m(tmpdir, schema, df, output_columns, model_name)�[0m
E �[1;32m 115�[0m �[38;5;124;03m"""Starts up a Triton server instance, loads up the ensemble model,�[39;00m
E �[1;32m 116�[0m �[38;5;124;03mprepares the inference request and returns the unparsed inference�[39;00m
E �[1;32m 117�[0m �[38;5;124;03mresponse.�[39;00m
E �[0;32m (...)�[0m
E �[1;32m 135�[0m �[38;5;124;03m the results of the prediction, parsed by output column name.�[39;00m
E �[1;32m 136�[0m �[38;5;124;03m"""�[39;00m
E �[1;32m 137�[0m response �[38;5;241m=�[39m �[38;5;28;01mNone�[39;00m
E �[0;32m--> 138�[0m �[38;5;28;01mwith�[39;00m run_triton_server(tmpdir) �[38;5;28;01mas�[39;00m client:
E �[1;32m 139�[0m response �[38;5;241m=�[39m send_triton_request(
E �[1;32m 140�[0m schema, df, output_columns, client�[38;5;241m=�[39mclient, triton_model�[38;5;241m=�[39mmodel_name
E �[1;32m 141�[0m )
E �[1;32m 143�[0m �[38;5;28;01mreturn�[39;00m response
E
E File �[0;32m/usr/lib/python3.8/contextlib.py:113�[0m, in �[0;36m_GeneratorContextManager.__enter__�[0;34m(self)�[0m
E �[1;32m 111�[0m �[38;5;28;01mdel�[39;00m �[38;5;28mself�[39m�[38;5;241m.�[39margs, �[38;5;28mself�[39m�[38;5;241m.�[39mkwds, �[38;5;28mself�[39m�[38;5;241m.�[39mfunc
E �[1;32m 112�[0m �[38;5;28;01mtry�[39;00m:
E �[0;32m--> 113�[0m �[38;5;28;01mreturn�[39;00m �[38;5;28;43mnext�[39;49m�[43m(�[49m�[38;5;28;43mself�[39;49m�[38;5;241;43m.�[39;49m�[43mgen�[49m�[43m)�[49m
E �[1;32m 114�[0m �[38;5;28;01mexcept�[39;00m �[38;5;167;01mStopIteration�[39;00m:
E �[1;32m 115�[0m �[38;5;28;01mraise�[39;00m �[38;5;167;01mRuntimeError�[39;00m(�[38;5;124m"�[39m�[38;5;124mgenerator didn�[39m�[38;5;124m'�[39m�[38;5;124mt yield�[39m�[38;5;124m"�[39m) �[38;5;28;01mfrom�[39;00m �[38;5;28mNone�[39m
E
E File �[0;32m~/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/utils.py:81�[0m, in �[0;36mrun_triton_server�[0;34m(model_repository, grpc_host, grpc_port, backend_config)�[0m
E �[1;32m 79�[0m �[38;5;28;01mif�[39;00m process�[38;5;241m.�[39mpoll() �[38;5;129;01mis�[39;00m �[38;5;129;01mnot�[39;00m �[38;5;28;01mNone�[39;00m:
E �[1;32m 80�[0m retcode �[38;5;241m=�[39m process�[38;5;241m.�[39mreturncode
E �[0;32m---> 81�[0m �[38;5;28;01mraise�[39;00m �[38;5;167;01mRuntimeError�[39;00m(�[38;5;124mf�[39m�[38;5;124m"�[39m�[38;5;124mTritonserver failed to start (ret=�[39m�[38;5;132;01m{�[39;00mretcode�[38;5;132;01m}�[39;00m�[38;5;124m)�[39m�[38;5;124m"�[39m)
E �[1;32m 83�[0m �[38;5;28;01mtry�[39;00m:
E �[1;32m 84�[0m ready �[38;5;241m=�[39m client�[38;5;241m.�[39mis_server_ready()
E
E �[0;31mRuntimeError�[0m: Tritonserver failed to start (ret=1)
E RuntimeError: Tritonserver failed to start (ret=1)

../../../.local/lib/python3.8/site-packages/testbook/client.py:135: TestbookRuntimeError
----------------------------- Captured stderr call -----------------------------
2022-10-21 16:10:30.322921: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-10-21 16:10:34.380928: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 8139 MB memory: -> device: 0, name: Tesla P100-DGXS-16GB, pci bus id: 0000:07:00.0, compute capability: 6.0
2022-10-21 16:10:34.381707: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:1 with 15149 MB memory: -> device: 1, name: Tesla P100-DGXS-16GB, pci bus id: 0000:08:00.0, compute capability: 6.0
2022-10-21 16:10:34.382324: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:2 with 15149 MB memory: -> device: 2, name: Tesla P100-DGXS-16GB, pci bus id: 0000:0e:00.0, compute capability: 6.0
2022-10-21 16:10:34.382949: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:3 with 15149 MB memory: -> device: 3, name: Tesla P100-DGXS-16GB, pci bus id: 0000:0f:00.0, compute capability: 6.0
Error in atexit._run_exitfuncs:
Traceback (most recent call last):
File "/usr/lib/python3.8/logging/init.py", line 2127, in shutdown
h.close()
File "/usr/local/lib/python3.8/dist-packages/absl/logging/init.py", line 934, in close
self.stream.close()
File "/usr/local/lib/python3.8/dist-packages/ipykernel/iostream.py", line 438, in close
self.watch_fd_thread.join()
AttributeError: 'OutStream' object has no attribute 'watch_fd_thread'
WARNING clustering 449 points to 32 centroids: please provide at least 1248 training points
2022-10-21 16:12:16.664880: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-10-21 16:12:20.718486: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 8139 MB memory: -> device: 0, name: Tesla P100-DGXS-16GB, pci bus id: 0000:07:00.0, compute capability: 6.0
2022-10-21 16:12:20.719248: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:1 with 15149 MB memory: -> device: 1, name: Tesla P100-DGXS-16GB, pci bus id: 0000:08:00.0, compute capability: 6.0
2022-10-21 16:12:20.719872: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:2 with 15149 MB memory: -> device: 2, name: Tesla P100-DGXS-16GB, pci bus id: 0000:0e:00.0, compute capability: 6.0
2022-10-21 16:12:20.720528: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:3 with 15149 MB memory: -> device: 3, name: Tesla P100-DGXS-16GB, pci bus id: 0000:0f:00.0, compute capability: 6.0
I1021 16:12:23.536168 18086 pinned_memory_manager.cc:240] Pinned memory pool is created at '0x7f43b6000000' with size 268435456
I1021 16:12:23.536910 18086 cuda_memory_manager.cc:105] CUDA memory pool is created on device 0 with size 67108864
I1021 16:12:23.545209 18086 model_lifecycle.cc:459] loading: 1_predicttensorflow:1
I1021 16:12:23.545272 18086 model_lifecycle.cc:459] loading: 2_queryfaiss:1
I1021 16:12:23.545310 18086 model_lifecycle.cc:459] loading: 0_queryfeast:1
I1021 16:12:23.545357 18086 model_lifecycle.cc:459] loading: 3_queryfeast:1
I1021 16:12:23.545427 18086 model_lifecycle.cc:459] loading: 4_unrollfeatures:1
I1021 16:12:23.545475 18086 model_lifecycle.cc:459] loading: 5_predicttensorflow:1
I1021 16:12:23.545542 18086 model_lifecycle.cc:459] loading: 6_softmaxsampling:1
I1021 16:12:23.834604 18086 tensorflow.cc:2536] TRITONBACKEND_Initialize: tensorflow
I1021 16:12:23.834644 18086 tensorflow.cc:2546] Triton TRITONBACKEND API version: 1.10
I1021 16:12:23.834651 18086 tensorflow.cc:2552] 'tensorflow' TRITONBACKEND API version: 1.10
I1021 16:12:23.834657 18086 tensorflow.cc:2576] backend configuration:
{"cmdline":{"auto-complete-config":"true","backend-directory":"/opt/tritonserver/backends","min-compute-capability":"6.000000","version":"2","default-max-batch-size":"4"}}
I1021 16:12:23.834700 18086 tensorflow.cc:2642] TRITONBACKEND_ModelInitialize: 1_predicttensorflow (version 1)
2022-10-21 16:12:23.835328: I tensorflow/cc/saved_model/reader.cc:43] Reading SavedModel from: /tmp/examples/poc_ensemble/1_predicttensorflow/1/model.savedmodel
2022-10-21 16:12:23.839849: I tensorflow/cc/saved_model/reader.cc:81] Reading meta graph with tags { serve }
2022-10-21 16:12:23.839877: I tensorflow/cc/saved_model/reader.cc:122] Reading SavedModel debug info (if present) from: /tmp/examples/poc_ensemble/1_predicttensorflow/1/model.savedmodel
2022-10-21 16:12:23.839979: I tensorflow/core/platform/cpu_feature_guard.cc:194] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: SSE3 SSE4.1 SSE4.2 AVX
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-10-21 16:12:24.254598: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 6383 MB memory: -> device: 0, name: Tesla P100-DGXS-16GB, pci bus id: 0000:07:00.0, compute capability: 6.0
2022-10-21 16:12:24.290708: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:354] MLIR V1 optimization pass is not enabled
2022-10-21 16:12:24.292712: I tensorflow/cc/saved_model/loader.cc:230] Restoring SavedModel bundle.
2022-10-21 16:12:24.342695: I tensorflow/cc/saved_model/loader.cc:214] Running initialization op on SavedModel bundle at path: /tmp/examples/poc_ensemble/1_predicttensorflow/1/model.savedmodel
2022-10-21 16:12:24.366749: I tensorflow/cc/saved_model/loader.cc:321] SavedModel load for tags { serve }; Status: success: OK. Took 531432 microseconds.
I1021 16:12:24.376952 18086 tensorflow.cc:2691] TRITONBACKEND_ModelInstanceInitialize: 1_predicttensorflow (GPU device 0)
2022-10-21 16:12:24.377440: I tensorflow/cc/saved_model/reader.cc:43] Reading SavedModel from: /tmp/examples/poc_ensemble/1_predicttensorflow/1/model.savedmodel
2022-10-21 16:12:24.380794: I tensorflow/cc/saved_model/reader.cc:81] Reading meta graph with tags { serve }
2022-10-21 16:12:24.380817: I tensorflow/cc/saved_model/reader.cc:122] Reading SavedModel debug info (if present) from: /tmp/examples/poc_ensemble/1_predicttensorflow/1/model.savedmodel
2022-10-21 16:12:24.382790: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 6383 MB memory: -> device: 0, name: Tesla P100-DGXS-16GB, pci bus id: 0000:07:00.0, compute capability: 6.0
2022-10-21 16:12:24.390302: I tensorflow/cc/saved_model/loader.cc:230] Restoring SavedModel bundle.
2022-10-21 16:12:24.443947: I tensorflow/cc/saved_model/loader.cc:214] Running initialization op on SavedModel bundle at path: /tmp/examples/poc_ensemble/1_predicttensorflow/1/model.savedmodel
2022-10-21 16:12:24.467249: I tensorflow/cc/saved_model/loader.cc:321] SavedModel load for tags { serve }; Status: success: OK. Took 89812 microseconds.
I1021 16:12:24.467557 18086 model_lifecycle.cc:693] successfully loaded '1_predicttensorflow' version 1
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
I1021 16:12:41.980496 18086 tensorflow.cc:2642] TRITONBACKEND_ModelInitialize: 5_predicttensorflow (version 1)
2022-10-21 16:12:41.981569: I tensorflow/cc/saved_model/reader.cc:43] Reading SavedModel from: /tmp/examples/poc_ensemble/5_predicttensorflow/1/model.savedmodel
2022-10-21 16:12:41.997053: I tensorflow/cc/saved_model/reader.cc:81] Reading meta graph with tags { serve }
2022-10-21 16:12:41.997099: I tensorflow/cc/saved_model/reader.cc:122] Reading SavedModel debug info (if present) from: /tmp/examples/poc_ensemble/5_predicttensorflow/1/model.savedmodel
2022-10-21 16:12:41.999330: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 6383 MB memory: -> device: 0, name: Tesla P100-DGXS-16GB, pci bus id: 0000:07:00.0, compute capability: 6.0
2022-10-21 16:12:42.025672: I tensorflow/cc/saved_model/loader.cc:230] Restoring SavedModel bundle.
2022-10-21 16:12:42.154755: I tensorflow/cc/saved_model/loader.cc:214] Running initialization op on SavedModel bundle at path: /tmp/examples/poc_ensemble/5_predicttensorflow/1/model.savedmodel
2022-10-21 16:12:42.205899: I tensorflow/cc/saved_model/loader.cc:321] SavedModel load for tags { serve }; Status: success: OK. Took 224341 microseconds.
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
I1021 16:12:46.608058 18086 python_be.cc:1767] TRITONBACKEND_ModelInstanceInitialize: 0_queryfeast (GPU device 0)
I1021 16:12:49.907987 18086 python_be.cc:1767] TRITONBACKEND_ModelInstanceInitialize: 2_queryfaiss (GPU device 0)
I1021 16:12:49.908348 18086 model_lifecycle.cc:693] successfully loaded '0_queryfeast' version 1
1021 16:12:52.851056 18432 pb_stub.cc:309] Failed to initialize Python stub: RuntimeError: Error in faiss::FileIOReader::FileIOReader(const char*) at /project/faiss/faiss/impl/io.cpp:68: Error: 'f' failed: could not open /tmp/examples/faiss_index/index.faiss/index.faiss for reading: Not a directory

At:
/usr/local/lib/python3.8/dist-packages/faiss/swigfaiss.py(9849): read_index
/var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/faiss.py(67): load_artifacts
/var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/faiss.py(94): from_config
/var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/op_runner.py(45): init
/tmp/examples/poc_ensemble/2_queryfaiss/1/model.py(61): initialize

/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
I1021 16:12:53.381795 18086 python_be.cc:1767] TRITONBACKEND_ModelInstanceInitialize: 3_queryfeast (GPU device 0)
E1021 16:12:53.393098 18086 model_lifecycle.cc:596] failed to load '2_queryfaiss' version 1: Internal: RuntimeError: Error in faiss::FileIOReader::FileIOReader(const char*) at /project/faiss/faiss/impl/io.cpp:68: Error: 'f' failed: could not open /tmp/examples/faiss_index/index.faiss/index.faiss for reading: Not a directory

At:
/usr/local/lib/python3.8/dist-packages/faiss/swigfaiss.py(9849): read_index
/var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/faiss.py(67): load_artifacts
/var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/faiss.py(94): from_config
/var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/op_runner.py(45): init
/tmp/examples/poc_ensemble/2_queryfaiss/1/model.py(61): initialize

I1021 16:12:56.654904 18086 python_be.cc:1767] TRITONBACKEND_ModelInstanceInitialize: 6_softmaxsampling (GPU device 0)
I1021 16:12:56.655292 18086 model_lifecycle.cc:693] successfully loaded '3_queryfeast' version 1
I1021 16:12:59.589805 18086 tensorflow.cc:2691] TRITONBACKEND_ModelInstanceInitialize: 5_predicttensorflow (GPU device 0)
I1021 16:12:59.590111 18086 model_lifecycle.cc:693] successfully loaded '6_softmaxsampling' version 1
2022-10-21 16:12:59.590368: I tensorflow/cc/saved_model/reader.cc:43] Reading SavedModel from: /tmp/examples/poc_ensemble/5_predicttensorflow/1/model.savedmodel
2022-10-21 16:12:59.599158: I tensorflow/cc/saved_model/reader.cc:81] Reading meta graph with tags { serve }
2022-10-21 16:12:59.599194: I tensorflow/cc/saved_model/reader.cc:122] Reading SavedModel debug info (if present) from: /tmp/examples/poc_ensemble/5_predicttensorflow/1/model.savedmodel
2022-10-21 16:12:59.601148: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 6383 MB memory: -> device: 0, name: Tesla P100-DGXS-16GB, pci bus id: 0000:07:00.0, compute capability: 6.0
2022-10-21 16:12:59.622578: I tensorflow/cc/saved_model/loader.cc:230] Restoring SavedModel bundle.
2022-10-21 16:12:59.761266: I tensorflow/cc/saved_model/loader.cc:214] Running initialization op on SavedModel bundle at path: /tmp/examples/poc_ensemble/5_predicttensorflow/1/model.savedmodel
2022-10-21 16:12:59.810825: I tensorflow/cc/saved_model/loader.cc:321] SavedModel load for tags { serve }; Status: success: OK. Took 220463 microseconds.
I1021 16:12:59.811003 18086 python_be.cc:1767] TRITONBACKEND_ModelInstanceInitialize: 4_unrollfeatures (GPU device 0)
I1021 16:12:59.811224 18086 model_lifecycle.cc:693] successfully loaded '5_predicttensorflow' version 1
I1021 16:13:02.735374 18086 model_lifecycle.cc:693] successfully loaded '4_unrollfeatures' version 1
E1021 16:13:02.735543 18086 model_repository_manager.cc:481] Invalid argument: ensemble 'ensemble_model' depends on '2_queryfaiss' which has no loaded version
I1021 16:13:02.735684 18086 server.cc:561]
+------------------+------+
| Repository Agent | Path |
+------------------+------+
+------------------+------+

I1021 16:13:02.735802 18086 server.cc:588]
+------------+-----------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Backend | Path | Config |
+------------+-----------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| tensorflow | /opt/tritonserver/backends/tensorflow2/libtriton_tensorflow2.so | {"cmdline":{"auto-complete-config":"true","backend-directory":"/opt/tritonserver/backends","min-compute-capability":"6.000000","version":"2","default-max-batch-size":"4"}} |
| python | /opt/tritonserver/backends/python/libtriton_python.so | {"cmdline":{"auto-complete-config":"true","min-compute-capability":"6.000000","backend-directory":"/opt/tritonserver/backends","default-max-batch-size":"4"}} |
+------------+-----------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

I1021 16:13:02.736096 18086 server.cc:631]
+---------------------+---------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Model | Version | Status |
+---------------------+---------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| 0_queryfeast | 1 | READY |
| 1_predicttensorflow | 1 | READY |
| 2_queryfaiss | 1 | UNAVAILABLE: Internal: RuntimeError: Error in faiss::FileIOReader::FileIOReader(const char*) at /project/faiss/faiss/impl/io.cpp:68: Error: 'f' failed: could not open /tmp/examples/faiss_index/index.faiss/index.faiss for reading: Not a directory |
| | | |
| | | At: |
| | | /usr/local/lib/python3.8/dist-packages/faiss/swigfaiss.py(9849): read_index |
| | | /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/faiss.py(67): load_artifacts |
| | | /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/faiss.py(94): from_config |
| | | /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/op_runner.py(45): init |
| | | /tmp/examples/poc_ensemble/2_queryfaiss/1/model.py(61): initialize |
| 3_queryfeast | 1 | READY |
| 4_unrollfeatures | 1 | READY |
| 5_predicttensorflow | 1 | READY |
| 6_softmaxsampling | 1 | READY |
+---------------------+---------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

I1021 16:13:02.800010 18086 metrics.cc:650] Collecting metrics for GPU 0: Tesla P100-DGXS-16GB
I1021 16:13:02.800852 18086 tritonserver.cc:2214]
+----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Option | Value |
+----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| server_id | triton |
| server_version | 2.25.0 |
| server_extensions | classification sequence model_repository model_repository(unload_dependents) schedule_policy model_configuration system_shared_memory cuda_shared_memory binary_tensor_data statistics trace |
| model_repository_path[0] | /tmp/examples/poc_ensemble |
| model_control_mode | MODE_NONE |
| strict_model_config | 0 |
| rate_limit | OFF |
| pinned_memory_pool_byte_size | 268435456 |
| cuda_memory_pool_byte_size{0} | 67108864 |
| response_cache_byte_size | 0 |
| min_supported_compute_capability | 6.0 |
| strict_readiness | 1 |
| exit_timeout | 30 |
+----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

I1021 16:13:02.800890 18086 server.cc:262] Waiting for in-flight requests to complete.
I1021 16:13:02.800907 18086 server.cc:278] Timeout 30: Found 0 model versions that have in-flight inferences
I1021 16:13:02.801097 18086 server.cc:293] All models are stopped, unloading models
I1021 16:13:02.801113 18086 server.cc:300] Timeout 30: Found 6 live models and 0 in-flight non-inference requests
I1021 16:13:02.801104 18086 tensorflow.cc:2729] TRITONBACKEND_ModelInstanceFinalize: delete instance state
I1021 16:13:02.801174 18086 tensorflow.cc:2729] TRITONBACKEND_ModelInstanceFinalize: delete instance state
I1021 16:13:02.801420 18086 tensorflow.cc:2668] TRITONBACKEND_ModelFinalize: delete model state
I1021 16:13:02.801449 18086 tensorflow.cc:2668] TRITONBACKEND_ModelFinalize: delete model state
I1021 16:13:02.809769 18086 model_lifecycle.cc:578] successfully unloaded '1_predicttensorflow' version 1
I1021 16:13:02.830396 18086 model_lifecycle.cc:578] successfully unloaded '5_predicttensorflow' version 1
I1021 16:13:03.801219 18086 server.cc:300] Timeout 29: Found 4 live models and 0 in-flight non-inference requests
W1021 16:13:03.831514 18086 metrics.cc:468] Unable to get energy consumption for GPU 0. Status:Success, value:0
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
I1021 16:13:04.244596 18086 model_lifecycle.cc:578] successfully unloaded '4_unrollfeatures' version 1
I1021 16:13:04.286090 18086 model_lifecycle.cc:578] successfully unloaded '0_queryfeast' version 1
I1021 16:13:04.371046 18086 model_lifecycle.cc:578] successfully unloaded '6_softmaxsampling' version 1
I1021 16:13:04.801375 18086 server.cc:300] Timeout 28: Found 1 live models and 0 in-flight non-inference requests
W1021 16:13:04.831718 18086 metrics.cc:468] Unable to get energy consumption for GPU 0. Status:Success, value:0
I1021 16:13:05.801508 18086 server.cc:300] Timeout 27: Found 1 live models and 0 in-flight non-inference requests
W1021 16:13:05.850066 18086 metrics.cc:468] Unable to get energy consumption for GPU 0. Status:Success, value:0
I1021 16:13:06.801635 18086 server.cc:300] Timeout 26: Found 1 live models and 0 in-flight non-inference requests
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
I1021 16:13:07.467133 18086 model_lifecycle.cc:578] successfully unloaded '3_queryfeast' version 1
I1021 16:13:07.801766 18086 server.cc:300] Timeout 25: Found 0 live models and 0 in-flight non-inference requests
error: creating server: Internal - failed to load all models

---------- coverage: platform linux, python 3.8.10-final-0 -----------
Name Stmts Miss Cover

.tox/test-gpu/lib/python3.8/site-packages/merlin/core/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/_version.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/compat.py 10 4 60%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/dispatch.py 355 212 40%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/protocols.py 100 45 55%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/utils.py 195 108 45%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/init.py 5 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/base_operator.py 122 15 88%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/dictarray.py 54 30 44%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/executors.py 120 21 82%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/graph.py 99 24 76%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/node.py 344 146 58%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/init.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/concat_columns.py 17 1 94%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/selection.py 20 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/subset_columns.py 12 4 67%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/subtraction.py 21 11 48%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/selector.py 101 27 73%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/init.py 3 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/aliccp/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/aliccp/dataset.py 141 102 28%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/dressipi/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/dressipi/dataset.py 45 37 18%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/synthetic.py 147 56 62%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/init.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/csv.py 57 38 33%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dask.py 181 97 46%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dataframe_engine.py 61 38 38%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dataframe_iter.py 21 2 90%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dataset.py 346 157 55%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dataset_engine.py 37 8 78%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/fsspec_utils.py 127 108 15%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/hugectr.py 45 35 22%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/parquet.py 603 344 43%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/shuffle.py 38 18 53%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/worker.py 80 20 75%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/writer.py 190 78 59%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/writer_factory.py 18 5 72%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/_version.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/config/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/config/schema.py 62 19 69%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/backend.py 379 113 70%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/dataframe_iter.py 21 17 19%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/tf_utils.py 57 27 53%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/utils.py 40 15 62%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/init.py 70 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/cross.py 44 28 36%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/dlrm.py 49 8 84%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/experts.py 99 75 24%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/interaction.py 108 55 49%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/mlp.py 114 55 52%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/optimizer.py 173 127 27%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/retrieval/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/retrieval/base.py 169 89 47%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/retrieval/matrix_factorization.py 35 19 46%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/retrieval/two_tower.py 30 4 87%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/base.py 29 7 76%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/cross_batch.py 46 31 33%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/in_batch.py 35 12 66%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/queue.py 115 99 14%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/aggregation.py 245 109 56%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/base.py 244 108 56%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/combinators.py 421 149 65%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/encoder.py 170 117 31%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/index.py 104 69 34%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/prediction.py 50 18 64%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/tabular.py 288 74 74%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/inputs/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/inputs/base.py 59 35 41%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/inputs/continuous.py 39 4 90%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/inputs/embedding.py 457 150 67%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/loader.py 243 125 49%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/losses/init.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/losses/base.py 9 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/losses/listwise.py 13 1 92%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/losses/pairwise.py 115 57 50%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/metrics/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/metrics/topk.py 196 81 59%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/base.py 688 304 56%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/benchmark.py 16 6 62%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/ranking.py 67 43 36%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/retrieval.py 32 9 72%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/utils.py 10 2 80%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/base.py 123 90 27%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/classification.py 91 51 44%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/contrastive.py 147 107 27%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/regression.py 9 2 78%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/sampling/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/sampling/base.py 78 41 47%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/sampling/in_batch.py 37 22 41%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/sampling/popularity.py 27 17 37%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/topk.py 90 56 38%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/base.py 207 108 48%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/classification.py 68 22 68%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/multi.py 7 1 86%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/next_item.py 59 33 44%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/regression.py 35 19 46%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/retrieval.py 73 31 58%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transformers/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transformers/block.py 97 50 48%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transformers/transforms.py 36 8 78%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/bias.py 107 74 31%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/features.py 422 334 21%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/noise.py 43 28 35%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/regularization.py 17 6 65%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/sequence.py 282 212 25%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/tensor.py 107 54 50%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/typing.py 7 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/batch_utils.py 85 12 86%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/repr_utils.py 69 48 30%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/search_utils.py 34 22 35%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/tf_utils.py 207 139 33%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/constants.py 3 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/dataset.py 38 18 53%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/dependencies.py 26 19 27%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/doc_utils.py 10 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/example_utils.py 31 10 68%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/misc_utils.py 118 90 24%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/nvt_utils.py 27 24 11%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/registry.py 101 31 69%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/schema_utils.py 90 41 54%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/io/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/io/proto_utils.py 20 4 80%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/io/schema_bp.py 306 7 98%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/io/tensorflow_metadata.py 190 35 82%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/schema.py 209 53 75%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/tags.py 82 6 93%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/init.py 6 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/_version.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/init.py 3 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ensemble.py 151 58 62%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/node.py 23 1 96%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/op_runner.py 26 7 73%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/init.py 9 4 56%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/compat.py 24 8 67%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/faiss.py 74 36 51%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/feast.py 126 71 44%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/operator.py 76 30 61%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/softmax_sampling.py 51 22 57%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/tensorflow.py 112 31 72%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/unroll_features.py 50 23 54%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/workflow.py 72 26 64%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/model_registry.py 16 8 50%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/init.py 47 12 74%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/conversions.py 87 51 41%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/export.py 266 210 21%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/utils.py 72 14 81%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/init.py 22 20 9%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/base.py 113 14 88%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/hugectr.py 37 29 22%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/pytorch.py 10 6 40%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/tensorflow.py 32 13 59%

TOTAL 14210 6671 53%

=================== 1 failed, 2 passed in 284.49s (0:04:44) ====================
/usr/local/lib/python3.8/dist-packages/coverage/inorout.py:519: CoverageWarning: Module merlin was never imported. (module-not-imported)
self.warn(f"Module {pkg} was never imported.", slug="module-not-imported")
/usr/local/lib/python3.8/dist-packages/coverage/control.py:801: CoverageWarning: No data was collected. (no-data-collected)
self._warn("No data was collected.", slug="no-data-collected")
ERROR: InvocationError for command /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu/bin/python -m pytest --cov-report term --cov merlin -rxs tests/unit (exited with code 1)
___________________________________ summary ____________________________________
ERROR: test-gpu: commands failed
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Merlin/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[merlin_merlin] $ /bin/bash /tmp/jenkins2125536199052037126.sh

@jperez999
Copy link
Collaborator

rerun tests

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #705 of commit d9b0642b37b212e5074e1b79ad59d0747bdb06bd, no merge conflicts.
Running as SYSTEM
Setting status of d9b0642b37b212e5074e1b79ad59d0747bdb06bd to PENDING with url https://10.20.13.93:8080/job/merlin_merlin/530/console and message: 'Pending'
Using context: Jenkins
Building on master in workspace /var/jenkins_home/workspace/merlin_merlin
using credential systems-login
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Merlin # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Merlin
 > git --version # timeout=10
using GIT_ASKPASS to set credentials login for merlin-systems
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Merlin +refs/pull/705/*:refs/remotes/origin/pr/705/* # timeout=10
 > git rev-parse d9b0642b37b212e5074e1b79ad59d0747bdb06bd^{commit} # timeout=10
Checking out Revision d9b0642b37b212e5074e1b79ad59d0747bdb06bd (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f d9b0642b37b212e5074e1b79ad59d0747bdb06bd # timeout=10
Commit message: "Update for change of hugectr branch name:"
 > git rev-list --no-walk eab2281182ea1262d6a95ecfd3b19b0ff8b88f84 # timeout=10
[merlin_merlin] $ /bin/bash /tmp/jenkins7180008183482241821.sh
GLOB sdist-make: /var/jenkins_home/workspace/merlin_merlin/merlin/setup.py
test-gpu recreate: /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
test-gpu installdeps: pytest, pytest-cov
WARNING: Discarding $PYTHONPATH from environment, to override specify PYTHONPATH in 'passenv' in your configuration.
test-gpu inst: /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/.tmp/package/1/merlin-0.0.1.zip
WARNING: Discarding $PYTHONPATH from environment, to override specify PYTHONPATH in 'passenv' in your configuration.
test-gpu installed: absl-py==1.2.0,aiohttp==3.8.1,aiosignal==1.2.0,alabaster==0.7.12,anyio==3.6.1,argon2-cffi==21.3.0,argon2-cffi-bindings==21.2.0,astroid==2.5.6,asttokens==2.0.8,astunparse==1.6.3,asv==0.5.1,asvdb==0.4.2,async-timeout==4.0.2,attrs==22.1.0,awscli==1.25.96,Babel==2.10.3,backcall==0.2.0,beautifulsoup4==4.11.1,betterproto==1.2.5,black==22.6.0,bleach==5.0.1,boto3==1.24.75,botocore==1.27.95,Brotli==1.0.9,cachetools==5.2.0,certifi==2019.11.28,cffi==1.15.1,chardet==3.0.4,charset-normalizer==2.1.1,clang==5.0,click==8.1.3,cloudpickle==2.2.0,cmake==3.24.1.1,colorama==0.4.4,contourpy==1.0.5,coverage==6.5.0,cuda-python==11.7.1,cupy-cuda117==10.6.0,cycler==0.11.0,Cython==0.29.32,dask==2022.1.1,dbus-python==1.2.16,debugpy==1.6.3,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.5.1,distlib==0.3.6,distributed==2022.5.1,distro==1.7.0,dm-tree==0.1.6,docker-pycreds==0.4.0,docutils==0.16,emoji==1.7.0,entrypoints==0.4,execnet==1.9.0,executing==1.0.0,faiss==1.7.2,faiss-gpu==1.7.2,fastai==2.7.9,fastapi==0.85.0,fastavro==1.6.1,fastcore==1.5.27,fastdownload==0.0.7,fastjsonschema==2.16.1,fastprogress==1.0.3,fastrlock==0.8,feast==0.19.4,fiddle==0.2.2,filelock==3.8.0,flatbuffers==1.12,fonttools==4.37.3,frozenlist==1.3.1,fsspec==2022.5.0,gast==0.4.0,gevent==21.12.0,geventhttpclient==2.0.2,gitdb==4.0.9,GitPython==3.1.27,google==3.0.0,google-api-core==2.10.1,google-auth==2.11.1,google-auth-oauthlib==0.4.6,google-pasta==0.2.0,googleapis-common-protos==1.52.0,graphviz==0.20.1,greenlet==1.1.3,grpcio==1.41.0,grpcio-channelz==1.49.0,grpcio-reflection==1.48.1,grpclib==0.4.3,h11==0.13.0,h2==4.1.0,h5py==3.7.0,HeapDict==1.0.1,hpack==4.0.0,httptools==0.5.0,hugectr2onnx==0.0.0,huggingface-hub==0.9.1,hyperframe==6.0.1,idna==2.8,imagesize==1.4.1,implicit==0.6.1,importlib-metadata==4.12.0,importlib-resources==5.9.0,iniconfig==1.1.1,ipykernel==6.15.3,ipython==8.5.0,ipython-genutils==0.2.0,ipywidgets==7.7.0,jedi==0.18.1,Jinja2==3.1.2,jmespath==1.0.1,joblib==1.2.0,json5==0.9.10,jsonschema==4.16.0,jupyter-cache==0.4.3,jupyter-core==4.11.1,jupyter-server==1.18.1,jupyter-server-mathjax==0.2.5,jupyter-sphinx==0.3.2,jupyter_client==7.3.5,jupyterlab==3.4.7,jupyterlab-pygments==0.2.2,jupyterlab-widgets==1.1.0,jupyterlab_server==2.15.1,keras==2.9.0,Keras-Preprocessing==1.1.2,kiwisolver==1.4.4,lazy-object-proxy==1.7.1,libclang==14.0.6,libcst==0.4.7,lightfm==1.16,lightgbm==3.3.2,linkify-it-py==1.0.3,llvmlite==0.39.1,locket==1.0.0,lxml==4.9.1,Markdown==3.4.1,markdown-it-py==1.1.0,MarkupSafe==2.1.1,matplotlib==3.6.0,matplotlib-inline==0.1.6,mdit-py-plugins==0.2.8,merlin==0.0.1,merlin-core==0.6.0+1.g5926fcf,merlin-models==0.7.0+11.g280956aa4,merlin-systems==0.5.0+4.g15074ad,mistune==2.0.4,mmh3==3.0.0,mpi4py==3.1.3,msgpack==1.0.4,multidict==6.0.2,mypy-extensions==0.4.3,myst-nb==0.13.2,myst-parser==0.15.2,natsort==8.1.0,nbclassic==0.4.3,nbclient==0.6.8,nbconvert==7.0.0,nbdime==3.1.1,nbformat==5.5.0,nest-asyncio==1.5.5,ninja==1.10.2.3,notebook==6.4.12,notebook-shim==0.1.0,numba==0.56.2,numpy==1.22.4,nvidia-pyindex==1.0.9,# Editable install with no version control (nvtabular==1.4.0+8.g95e12d347),-e /usr/local/lib/python3.8/dist-packages,nvtx==0.2.5,oauthlib==3.2.1,oldest-supported-numpy==2022.8.16,onnx==1.12.0,onnxruntime==1.11.1,opt-einsum==3.3.0,packaging==21.3,pandas==1.3.5,pandavro==1.5.2,pandocfilters==1.5.0,parso==0.8.3,partd==1.3.0,pathtools==0.1.2,pexpect==4.8.0,pickleshare==0.7.5,Pillow==9.2.0,pkgutil_resolve_name==1.3.10,platformdirs==2.5.2,pluggy==1.0.0,prometheus-client==0.14.1,promise==2.3,prompt-toolkit==3.0.31,proto-plus==1.19.6,protobuf==3.19.5,psutil==5.9.2,ptyprocess==0.7.0,pure-eval==0.2.2,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pybind11==2.10.0,pycparser==2.21,pydantic==1.10.2,pydot==1.4.2,Pygments==2.13.0,PyGObject==3.36.0,pynvml==11.4.1,pyparsing==3.0.9,pyrsistent==0.18.1,pytest==7.1.3,pytest-cov==4.0.0,pytest-forked==1.4.0,pytest-xdist==2.5.0,python-apt==2.0.0+ubuntu0.20.4.8,python-dateutil==2.8.2,python-dotenv==0.21.0,python-rapidjson==1.8,pytz==2022.2.1,PyYAML==5.4.1,pyzmq==24.0.0,regex==2022.9.13,requests==2.22.0,requests-oauthlib==1.3.1,requests-unixsocket==0.2.0,rsa==4.7.2,s3fs==2022.2.0,s3transfer==0.6.0,sacremoses==0.0.53,scikit-build==0.15.0,scikit-learn==1.1.2,scipy==1.9.1,seedir==0.3.0,Send2Trash==1.8.0,sentry-sdk==1.9.8,setproctitle==1.3.2,setuptools-scm==7.0.5,shortuuid==1.0.9,six==1.15.0,sklearn==0.0,smmap==5.0.0,sniffio==1.3.0,snowballstemmer==2.2.0,sortedcontainers==2.4.0,soupsieve==2.3.2.post1,Sphinx==5.3.0,sphinx-multiversion==0.2.4,sphinx-togglebutton==0.3.1,sphinx_external_toc==0.3.0,sphinxcontrib-applehelp==1.0.2,sphinxcontrib-copydirs @ git+https://github.com/mikemckiernan/sphinxcontrib-copydirs.git@bd8c5d79b3f91cf5f1bb0d6995aeca3fe84b670e,sphinxcontrib-devhelp==1.0.2,sphinxcontrib-htmlhelp==2.0.0,sphinxcontrib-jsmath==1.0.1,sphinxcontrib-qthelp==1.0.3,sphinxcontrib-serializinghtml==1.1.5,SQLAlchemy==1.4.36,stack-data==0.5.0,starlette==0.20.4,stringcase==1.2.0,supervisor==4.1.0,tabulate==0.8.10,tblib==1.7.0,tdqm==0.0.1,tenacity==8.0.1,tensorboard==2.9.1,tensorboard-data-server==0.6.1,tensorboard-plugin-wit==1.8.1,tensorflow==2.6.2,tensorflow-estimator==2.9.0,tensorflow-gpu==2.9.2,tensorflow-io-gcs-filesystem==0.27.0,tensorflow-metadata==1.10.0,termcolor==2.0.1,terminado==0.15.0,testbook==0.4.2,threadpoolctl==3.1.0,tinycss2==1.1.1,tokenizers==0.10.3,toml==0.10.2,tomli==2.0.1,toolz==0.12.0,torch==1.12.1+cu113,torchmetrics==0.3.2,tornado==6.2,tox==3.26.0,tqdm==4.64.1,traitlets==5.4.0,transformers==4.12.0,transformers4rec==0.1.12+2.gbcc939255,treelite==2.3.0,treelite-runtime==2.3.0,tritonclient==2.25.0,typing-inspect==0.8.0,typing_extensions==4.3.0,uc-micro-py==1.0.1,urllib3==1.26.12,uvicorn==0.18.3,uvloop==0.17.0,versioneer==0.20,virtualenv==20.16.5,wandb==0.13.3,watchfiles==0.17.0,wcwidth==0.2.5,webencodings==0.5.1,websocket-client==1.4.1,websockets==10.3,Werkzeug==2.2.2,widgetsnbextension==3.6.0,wrapt==1.12.1,xgboost==1.6.2,yarl==1.8.1,zict==2.2.0,zipp==3.8.1,zope.event==4.5.0,zope.interface==5.4.0
test-gpu run-test-pre: PYTHONHASHSEED='1897368432'
test-gpu run-test: commands[0] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/systems.git
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/NVIDIA-Merlin/systems.git
  Cloning https://github.com/NVIDIA-Merlin/systems.git to /tmp/pip-req-build-lts22da0
  Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/systems.git /tmp/pip-req-build-lts22da0
  Resolved https://github.com/NVIDIA-Merlin/systems.git to commit e96921599fa414b7cc8b017aa4b90729dd9e2873
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: requests<3,>=2.10 in /usr/lib/python3/dist-packages (from merlin-systems==0.6.0+8.ge969215) (2.22.0)
Requirement already satisfied: nvtabular>=1.0.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-systems==0.6.0+8.ge969215) (1.1.1)
Requirement already satisfied: merlin-core>=0.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-systems==0.6.0+8.ge969215) (0.3.0+12.g78ecddd)
Requirement already satisfied: dask>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (2022.3.0)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (1.3.5)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (0.55.1)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (1.10.0)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (21.3)
Requirement already satisfied: distributed>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (2022.3.0)
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (3.19.5)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (7.0.0)
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (4.64.1)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (1.2.5)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (1.2.0)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (0.4.3)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (0.12.0)
Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (5.4.1)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (2.2.0)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (1.2.0)
Requirement already satisfied: fsspec>=0.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (2022.5.0)
Requirement already satisfied: tornado>=6.0.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (6.1)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (1.0.4)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (5.8.0)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (3.1.2)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (2.4.0)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (1.7.0)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (2.0.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (8.1.3)
Requirement already satisfied: setuptools in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (65.3.0)
Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (1.20.3)
Collecting llvmlite<0.39,>=0.38.0rc1
  Downloading llvmlite-0.38.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 34.5/34.5 MB 80.9 MB/s eta 0:00:00
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (3.0.9)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (2022.2.1)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (2.8.2)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (1.52.0)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (1.2.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (0.2.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (1.15.0)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (1.0.1)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (4.1.0)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (6.0.2)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from jinja2->distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (2.1.1)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (6.0.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.6.0+8.ge969215) (4.0.0)
Building wheels for collected packages: merlin-systems
  Building wheel for merlin-systems (pyproject.toml): started
  Building wheel for merlin-systems (pyproject.toml): finished with status 'done'
  Created wheel for merlin-systems: filename=merlin_systems-0.6.0+8.ge969215-py3-none-any.whl size=83613 sha256=4dc671e225b3542e4ba0f2e8b0a90067e010d12bc7ff38620cb051367775a56b
  Stored in directory: /tmp/pip-ephem-wheel-cache-vic2z9lk/wheels/d3/db/b8/99d510a979c278774eda4142f1c0643c93b7b2674aff321c16
Successfully built merlin-systems
Installing collected packages: llvmlite, merlin-systems
  Attempting uninstall: llvmlite
    Found existing installation: llvmlite 0.39.1
    Not uninstalling llvmlite at /usr/local/lib/python3.8/dist-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
    Can't uninstall 'llvmlite'. No files were found to uninstall.
  Attempting uninstall: merlin-systems
    Found existing installation: merlin-systems 0.5.0+4.g15074ad
    Not uninstalling merlin-systems at /usr/local/lib/python3.8/dist-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
    Can't uninstall 'merlin-systems'. No files were found to uninstall.
Successfully installed llvmlite-0.38.1 merlin-systems-0.6.0+8.ge969215

[notice] A new release of pip available: 22.2.2 -> 22.3
[notice] To update, run: pip install --upgrade pip
test-gpu run-test: commands[1] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/models.git
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/NVIDIA-Merlin/models.git
Cloning https://github.com/NVIDIA-Merlin/models.git to /tmp/pip-req-build-7wt_mugo
Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/models.git /tmp/pip-req-build-7wt_mugo
Resolved https://github.com/NVIDIA-Merlin/models.git to commit f11d77adca7fb39efd94d71ec3a420f60a2dbd89
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: merlin-core>=0.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-models==0.8.0+26.gf11d77ad) (0.3.0+12.g78ecddd)
Requirement already satisfied: dask>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2022.3.0)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.3.5)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (0.55.1)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.10.0)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (21.3)
Requirement already satisfied: distributed>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2022.3.0)
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (3.19.5)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (7.0.0)
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (4.64.1)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.2.5)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.2.0)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (0.4.3)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (0.12.0)
Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (5.4.1)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2.2.0)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.2.0)
Requirement already satisfied: fsspec>=0.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2022.5.0)
Requirement already satisfied: tornado>=6.0.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (6.1)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.0.4)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (5.8.0)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (3.1.2)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2.4.0)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.7.0)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2.0.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (8.1.3)
Requirement already satisfied: setuptools in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (65.3.0)
Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.20.3)
Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (0.38.1)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (3.0.9)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2022.2.1)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2.8.2)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.52.0)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.2.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (0.2.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.15.0)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (1.0.1)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (4.1.0)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (6.0.2)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from jinja2->distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (2.1.1)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (6.0.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.8.0+26.gf11d77ad) (4.0.0)
Building wheels for collected packages: merlin-models
Building wheel for merlin-models (pyproject.toml): started
Building wheel for merlin-models (pyproject.toml): finished with status 'done'
Created wheel for merlin-models: filename=merlin_models-0.8.0+26.gf11d77ad-py3-none-any.whl size=349807 sha256=0e81249b1b72cb7560845e8b27a9a400d7ba82c7c595cffc35ea3fb248227acb
Stored in directory: /tmp/pip-ephem-wheel-cache-lcik1nlv/wheels/5a/43/99/d50fe2c33b4f4686db73207ce3865e0d6be6609ffb03abade5
Successfully built merlin-models
Installing collected packages: merlin-models
Attempting uninstall: merlin-models
Found existing installation: merlin-models 0.7.0+11.g280956aa4
Not uninstalling merlin-models at /usr/local/lib/python3.8/dist-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
Can't uninstall 'merlin-models'. No files were found to uninstall.
Successfully installed merlin-models-0.8.0+26.gf11d77ad

[notice] A new release of pip available: 22.2.2 -> 22.3
[notice] To update, run: pip install --upgrade pip
test-gpu run-test: commands[2] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/NVTabular.git
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/NVIDIA-Merlin/NVTabular.git
Cloning https://github.com/NVIDIA-Merlin/NVTabular.git to /tmp/pip-req-build-2o7uj0wj
Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/NVTabular.git /tmp/pip-req-build-2o7uj0wj
Resolved https://github.com/NVIDIA-Merlin/NVTabular.git to commit c0636deadefebcf238935267239406bf7cc6803f
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: scipy in /usr/local/lib/python3.8/dist-packages (from nvtabular==1.5.0+6.gc0636dea) (1.9.1)
Requirement already satisfied: merlin-core>=0.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==1.5.0+6.gc0636dea) (0.3.0+12.g78ecddd)
Requirement already satisfied: dask>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (2022.3.0)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.3.5)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (0.55.1)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.10.0)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (21.3)
Requirement already satisfied: distributed>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (2022.3.0)
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (3.19.5)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (7.0.0)
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (4.64.1)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.2.5)
Requirement already satisfied: numpy<1.25.0,>=1.18.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from scipy->nvtabular==1.5.0+6.gc0636dea) (1.20.3)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.2.0)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (0.4.3)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (0.12.0)
Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (5.4.1)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (2.2.0)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.2.0)
Requirement already satisfied: fsspec>=0.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (2022.5.0)
Requirement already satisfied: tornado>=6.0.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (6.1)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.0.4)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (5.8.0)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (3.1.2)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (2.4.0)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.7.0)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (2.0.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (8.1.3)
Requirement already satisfied: setuptools in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (65.3.0)
Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (0.38.1)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (3.0.9)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (2022.2.1)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (2.8.2)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.52.0)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.2.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (0.2.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.15.0)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (1.0.1)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (4.1.0)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (6.0.2)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from jinja2->distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (2.1.1)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (6.0.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.5.0+6.gc0636dea) (4.0.0)
Building wheels for collected packages: nvtabular
Building wheel for nvtabular (pyproject.toml): started
Building wheel for nvtabular (pyproject.toml): finished with status 'done'
Created wheel for nvtabular: filename=nvtabular-1.5.0+6.gc0636dea-cp38-cp38-linux_x86_64.whl size=266742 sha256=6b2c022c7616a740638fcb5a69ad7cdf714d140dbafc1696dc25e4cf0acdb969
Stored in directory: /tmp/pip-ephem-wheel-cache-qkfk2s6f/wheels/c2/16/76/39994bff39d812513de5b5572bff0903b9eb8f6c645b44cedc
Successfully built nvtabular
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 1.1.1
Not uninstalling nvtabular at /var/jenkins_home/.local/lib/python3.8/site-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
Can't uninstall 'nvtabular'. No files were found to uninstall.
Successfully installed nvtabular-1.5.0+6.gc0636dea

[notice] A new release of pip available: 22.2.2 -> 22.3
[notice] To update, run: pip install --upgrade pip
test-gpu run-test: commands[3] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/core.git
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/NVIDIA-Merlin/core.git
Cloning https://github.com/NVIDIA-Merlin/core.git to /tmp/pip-req-build-23e1l0ty
Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/core.git /tmp/pip-req-build-23e1l0ty
Resolved https://github.com/NVIDIA-Merlin/core.git to commit 2c621a26a2b1b7ed786c99bd7c2790b9fc675098
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: dask>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.7.0+12.g2c621a2) (2022.3.0)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.7.0+12.g2c621a2) (1.3.5)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.7.0+12.g2c621a2) (0.55.1)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.7.0+12.g2c621a2) (1.10.0)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.7.0+12.g2c621a2) (21.3)
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.7.0+12.g2c621a2) (3.19.5)
Requirement already satisfied: fsspec==2022.5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.7.0+12.g2c621a2) (2022.5.0)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.7.0+12.g2c621a2) (7.0.0)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.7.0+12.g2c621a2) (1.2.5)
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.7.0+12.g2c621a2) (4.64.1)
Requirement already satisfied: distributed>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.7.0+12.g2c621a2) (2022.3.0)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.7.0+12.g2c621a2) (1.2.0)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.7.0+12.g2c621a2) (0.4.3)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (0.12.0)
Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (5.4.1)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (2.2.0)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (1.2.0)
Requirement already satisfied: tornado>=6.0.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (6.1)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (1.0.4)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (5.8.0)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (3.1.2)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (2.4.0)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (1.7.0)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (2.0.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (8.1.3)
Requirement already satisfied: setuptools in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.7.0+12.g2c621a2) (65.3.0)
Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.7.0+12.g2c621a2) (1.20.3)
Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.7.0+12.g2c621a2) (0.38.1)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core==0.7.0+12.g2c621a2) (3.0.9)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.7.0+12.g2c621a2) (2022.2.1)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.7.0+12.g2c621a2) (2.8.2)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.7.0+12.g2c621a2) (1.52.0)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.7.0+12.g2c621a2) (1.2.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (0.2.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core==0.7.0+12.g2c621a2) (1.15.0)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (1.0.1)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.7.0+12.g2c621a2) (4.1.0)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.7.0+12.g2c621a2) (6.0.2)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from jinja2->distributed>=2022.3.0->merlin-core==0.7.0+12.g2c621a2) (2.1.1)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.7.0+12.g2c621a2) (6.0.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.7.0+12.g2c621a2) (4.0.0)
Building wheels for collected packages: merlin-core
Building wheel for merlin-core (pyproject.toml): started
Building wheel for merlin-core (pyproject.toml): finished with status 'done'
Created wheel for merlin-core: filename=merlin_core-0.7.0+12.g2c621a2-py3-none-any.whl size=118267 sha256=2831d4e7a4beb940ce7f921db2f21f56f245e879d1c30c55f901d55f31017ed1
Stored in directory: /tmp/pip-ephem-wheel-cache-0wgynynv/wheels/c8/38/16/a6968787eafcec5fa772148af8408b089562f71af0752e8e84
Successfully built merlin-core
Installing collected packages: merlin-core
Attempting uninstall: merlin-core
Found existing installation: merlin-core 0.3.0+12.g78ecddd
Not uninstalling merlin-core at /var/jenkins_home/.local/lib/python3.8/site-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
Can't uninstall 'merlin-core'. No files were found to uninstall.
Successfully installed merlin-core-0.7.0+12.g2c621a2

[notice] A new release of pip available: 22.2.2 -> 22.3
[notice] To update, run: pip install --upgrade pip
test-gpu run-test: commands[4] | python -m pytest --cov-report term --cov merlin -rxs tests/unit
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
cachedir: .tox/test-gpu/.pytest_cache
rootdir: /var/jenkins_home/workspace/merlin_merlin/merlin
plugins: anyio-3.5.0, xdist-2.5.0, forked-1.4.0, cov-4.0.0
collected 3 items

tests/unit/test_version.py . [ 33%]
tests/unit/examples/test_building_deploying_multi_stage_RecSys.py . [ 66%]
tests/unit/examples/test_scaling_criteo_merlin_models.py . [100%]

---------- coverage: platform linux, python 3.8.10-final-0 -----------
Name Stmts Miss Cover

.tox/test-gpu/lib/python3.8/site-packages/merlin/core/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/_version.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/compat.py 10 4 60%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/dispatch.py 355 212 40%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/protocols.py 100 45 55%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/utils.py 195 108 45%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/init.py 5 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/base_operator.py 122 15 88%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/dictarray.py 54 19 65%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/executors.py 120 21 82%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/graph.py 99 24 76%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/node.py 344 146 58%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/init.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/concat_columns.py 17 1 94%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/selection.py 20 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/subset_columns.py 12 4 67%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/subtraction.py 21 11 48%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/selector.py 101 27 73%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/init.py 3 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/aliccp/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/aliccp/dataset.py 141 102 28%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/dressipi/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/dressipi/dataset.py 45 37 18%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/synthetic.py 147 56 62%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/init.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/csv.py 57 38 33%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dask.py 181 93 49%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dataframe_engine.py 61 38 38%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dataframe_iter.py 21 2 90%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dataset.py 346 157 55%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dataset_engine.py 37 8 78%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/fsspec_utils.py 127 108 15%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/hugectr.py 45 35 22%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/parquet.py 603 344 43%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/shuffle.py 38 18 53%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/worker.py 80 20 75%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/writer.py 190 78 59%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/writer_factory.py 18 5 72%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/_version.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/config/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/config/schema.py 62 19 69%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/backend.py 379 113 70%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/dataframe_iter.py 21 17 19%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/tf_utils.py 57 27 53%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/utils.py 40 15 62%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/init.py 70 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/cross.py 44 28 36%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/dlrm.py 49 8 84%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/experts.py 99 75 24%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/interaction.py 108 55 49%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/mlp.py 114 55 52%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/optimizer.py 173 127 27%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/retrieval/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/retrieval/base.py 169 89 47%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/retrieval/matrix_factorization.py 35 19 46%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/retrieval/two_tower.py 30 4 87%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/base.py 29 7 76%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/cross_batch.py 46 31 33%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/in_batch.py 35 12 66%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/queue.py 115 99 14%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/aggregation.py 245 109 56%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/base.py 244 108 56%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/combinators.py 421 149 65%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/encoder.py 170 117 31%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/index.py 104 69 34%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/prediction.py 50 18 64%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/tabular.py 288 74 74%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/inputs/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/inputs/base.py 59 35 41%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/inputs/continuous.py 39 4 90%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/inputs/embedding.py 457 150 67%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/loader.py 243 125 49%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/losses/init.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/losses/base.py 9 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/losses/listwise.py 13 1 92%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/losses/pairwise.py 115 57 50%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/metrics/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/metrics/topk.py 196 81 59%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/base.py 688 304 56%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/benchmark.py 16 6 62%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/ranking.py 67 43 36%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/retrieval.py 32 9 72%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/utils.py 10 2 80%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/base.py 123 90 27%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/classification.py 91 51 44%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/contrastive.py 147 107 27%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/regression.py 9 2 78%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/sampling/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/sampling/base.py 78 41 47%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/sampling/in_batch.py 37 22 41%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/sampling/popularity.py 27 17 37%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/topk.py 90 56 38%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/base.py 207 108 48%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/classification.py 68 22 68%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/multi.py 7 1 86%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/next_item.py 59 33 44%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/regression.py 35 19 46%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/retrieval.py 73 31 58%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transformers/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transformers/block.py 97 50 48%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transformers/transforms.py 36 8 78%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/bias.py 107 74 31%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/features.py 422 334 21%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/noise.py 43 28 35%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/regularization.py 17 6 65%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/sequence.py 282 212 25%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/tensor.py 107 54 50%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/typing.py 7 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/batch_utils.py 85 12 86%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/repr_utils.py 69 48 30%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/search_utils.py 34 22 35%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/tf_utils.py 207 139 33%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/constants.py 3 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/dataset.py 38 18 53%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/dependencies.py 26 19 27%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/doc_utils.py 10 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/example_utils.py 31 8 74%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/misc_utils.py 118 90 24%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/nvt_utils.py 27 24 11%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/registry.py 101 31 69%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/schema_utils.py 90 41 54%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/io/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/io/proto_utils.py 20 4 80%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/io/schema_bp.py 306 7 98%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/io/tensorflow_metadata.py 190 35 82%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/schema.py 209 53 75%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/tags.py 82 6 93%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/init.py 6 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/_version.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/init.py 3 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ensemble.py 151 58 62%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/node.py 23 1 96%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/op_runner.py 26 1 96%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/init.py 9 4 56%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/compat.py 24 8 67%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/faiss.py 77 27 65%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/feast.py 126 53 58%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/operator.py 76 30 61%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/softmax_sampling.py 51 12 76%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/tensorflow.py 112 31 72%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/unroll_features.py 50 12 76%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/workflow.py 72 26 64%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/model_registry.py 16 8 50%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/init.py 47 12 74%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/conversions.py 87 51 41%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/export.py 266 210 21%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/utils.py 72 14 81%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/init.py 22 20 9%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/base.py 113 14 88%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/hugectr.py 37 29 22%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/pytorch.py 10 6 40%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/tensorflow.py 32 13 59%

TOTAL 14213 6600 54%

======================== 3 passed in 298.46s (0:04:58) =========================
/usr/local/lib/python3.8/dist-packages/coverage/inorout.py:519: CoverageWarning: Module merlin was never imported. (module-not-imported)
self.warn(f"Module {pkg} was never imported.", slug="module-not-imported")
/usr/local/lib/python3.8/dist-packages/coverage/control.py:801: CoverageWarning: No data was collected. (no-data-collected)
self._warn("No data was collected.", slug="no-data-collected")
/usr/local/lib/python3.8/dist-packages/coverage/data.py:130: CoverageWarning: Data file '/var/jenkins_home/workspace/merlin_merlin/merlin/.coverage.10.20.17.231.24927.853727' doesn't seem to be a coverage data file: cannot unpack non-iterable NoneType object
data._warn(str(exc))
___________________________________ summary ____________________________________
test-gpu: commands succeeded
congratulations :)
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/Merlin/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[merlin_merlin] $ /bin/bash /tmp/jenkins11556378296769951921.sh

@jperez999 jperez999 merged commit 85f3e56 into NVIDIA-Merlin:main Oct 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
breaking Breaking change ci
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants