Reduce the size of synthetic data used in Criteo test #579
Conversation
On an 11GB GPU, 1m rows causes an out-of-memory error, while 100k rows makes the test pass.
Click to view CI ResultsGitHub pull request #579 of commit f322af30bde8acfd037c762570743eb29c5b324b, no merge conflicts.
Running as SYSTEM
Setting status of f322af30bde8acfd037c762570743eb29c5b324b to PENDING with url https://10.20.13.93:8080/job/merlin_merlin/399/console and message: 'Pending'
Using context: Jenkins
Building on master in workspace /var/jenkins_home/workspace/merlin_merlin
using credential systems-login
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/NVIDIA-Merlin/Merlin # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Merlin
> git --version # timeout=10
using GIT_ASKPASS to set credentials login for merlin-systems
> git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Merlin +refs/pull/579/*:refs/remotes/origin/pr/579/* # timeout=10
> git rev-parse f322af30bde8acfd037c762570743eb29c5b324b^{commit} # timeout=10
Checking out Revision f322af30bde8acfd037c762570743eb29c5b324b (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f f322af30bde8acfd037c762570743eb29c5b324b # timeout=10
Commit message: "Reduce the size of synthetic data used in Criteo test"
> git rev-list --no-walk bafa365f25ab479fb93df1c588213942439f6e90 # timeout=10
[merlin_merlin] $ /bin/bash /tmp/jenkins6378816191920119067.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/merlin_merlin/merlin
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-3.0.0
collected 3 items
|
Documentation preview |
Click to view CI ResultsGitHub pull request #579 of commit d72331b2aad7d4d134316a2087b6dcc495467fca, no merge conflicts.
Running as SYSTEM
Setting status of d72331b2aad7d4d134316a2087b6dcc495467fca to PENDING with url https://10.20.13.93:8080/job/merlin_merlin/400/console and message: 'Pending'
Using context: Jenkins
Building on master in workspace /var/jenkins_home/workspace/merlin_merlin
using credential systems-login
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/NVIDIA-Merlin/Merlin # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Merlin
> git --version # timeout=10
using GIT_ASKPASS to set credentials login for merlin-systems
> git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Merlin +refs/pull/579/*:refs/remotes/origin/pr/579/* # timeout=10
> git rev-parse d72331b2aad7d4d134316a2087b6dcc495467fca^{commit} # timeout=10
Checking out Revision d72331b2aad7d4d134316a2087b6dcc495467fca (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f d72331b2aad7d4d134316a2087b6dcc495467fca # timeout=10
Commit message: "Merge branch 'main' into fix/criteo-test"
> git rev-list --no-walk f322af30bde8acfd037c762570743eb29c5b324b # timeout=10
[merlin_merlin] $ /bin/bash /tmp/jenkins4976728707480426435.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/merlin_merlin/merlin
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-3.0.0
collected 3 items
|
On an 11GB GPU, 1m rows causes an out-of-memory error, while 100k rows makes the test pass.