Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add the support of different thresholds k in the TopkEncoder #869

Merged
merged 3 commits into from
Nov 9, 2022
Merged

Add the support of different thresholds k in the TopkEncoder #869

merged 3 commits into from
Nov 9, 2022

Conversation

sararb
Copy link
Contributor

@sararb sararb commented Nov 8, 2022

Fixes #866

Goals ⚽

  • Add the compile method to TopkEncoder class to support setting up different thresholds k.
  • Add the parameter k to the call method of TopkOutput to return different top-k predictions.

Testing Details 🔍

  • Extend the unit test test_topk_encoder to test different thresholds.

@sararb sararb added the enhancement New feature or request label Nov 8, 2022
@sararb sararb self-assigned this Nov 8, 2022
@nvidia-merlin-bot
Copy link

Click to view CI Results
GitHub pull request #869 of commit 5173a96155c11355744a5aa287749ce59f05a41e, no merge conflicts.
Running as SYSTEM
Setting status of 5173a96155c11355744a5aa287749ce59f05a41e to PENDING with url http://merlin-infra1.nvidia.com:8080/job/merlin_models/1781/ and message: 'Pending'
Using context: Jenkins
Building on master in workspace /var/jenkins_home/workspace/merlin_models
using credential nvidia-merlin-bot
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/models/ # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/models/
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/models/ +refs/pull/869/*:refs/remotes/origin/pr/869/* # timeout=10
 > git rev-parse 5173a96155c11355744a5aa287749ce59f05a41e^{commit} # timeout=10
Checking out Revision 5173a96155c11355744a5aa287749ce59f05a41e (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 5173a96155c11355744a5aa287749ce59f05a41e # timeout=10
Commit message: "add support of different thresholds `k` in topk-encoder"
 > git rev-list --no-walk 50622f4308c5ea660dac9e8a80ca2a8095387eba # timeout=10
[merlin_models] $ /bin/bash /tmp/jenkins1400512824898566992.sh
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: testbook in /usr/local/lib/python3.8/dist-packages (0.4.2)
Requirement already satisfied: nbformat>=5.0.4 in /usr/local/lib/python3.8/dist-packages (from testbook) (5.5.0)
Requirement already satisfied: nbclient>=0.4.0 in /usr/local/lib/python3.8/dist-packages (from testbook) (0.6.8)
Requirement already satisfied: jupyter-client>=6.1.5 in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (7.3.5)
Requirement already satisfied: nest-asyncio in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (1.5.5)
Requirement already satisfied: traitlets>=5.2.2 in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (5.4.0)
Requirement already satisfied: jsonschema>=2.6 in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.16.0)
Requirement already satisfied: fastjsonschema in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (2.16.1)
Requirement already satisfied: jupyter_core in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.11.1)
Requirement already satisfied: attrs>=17.4.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (22.1.0)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (0.18.1)
Requirement already satisfied: pkgutil-resolve-name>=1.3.10 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (1.3.10)
Requirement already satisfied: importlib-resources>=1.4.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (5.9.0)
Requirement already satisfied: python-dateutil>=2.8.2 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (2.8.2)
Requirement already satisfied: entrypoints in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (0.4)
Requirement already satisfied: pyzmq>=23.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (24.0.0)
Requirement already satisfied: tornado>=6.2 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (6.2)
Requirement already satisfied: zipp>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from importlib-resources>=1.4.0->jsonschema>=2.6->nbformat>=5.0.4->testbook) (3.8.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.8.2->jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (1.15.0)
GLOB sdist-make: /var/jenkins_home/workspace/merlin_models/models/setup.py
py38-gpu inst-nodeps: /var/jenkins_home/workspace/merlin_models/models/.tox/.tmp/package/2/merlin-models-0.9.0+34.g5173a961.zip
WARNING: Discarding $PYTHONPATH from environment, to override specify PYTHONPATH in 'passenv' in your configuration.
py38-gpu installed: absl-py==1.2.0,aiohttp==3.8.1,aiosignal==1.2.0,alabaster==0.7.12,alembic==1.8.1,anyio==3.6.1,appdirs==1.4.4,argon2-cffi==21.3.0,argon2-cffi-bindings==21.2.0,astroid==2.5.6,asttokens==2.0.8,astunparse==1.6.3,asv==0.5.1,asvdb==0.4.2,async-timeout==4.0.2,attrs==22.1.0,autopage==0.5.1,awscli==1.27.4,Babel==2.10.3,backcall==0.2.0,beautifulsoup4==4.11.1,betterproto==1.2.5,black==20.8b1,bleach==5.0.1,bokeh==3.0.1,boto3==1.24.75,botocore==1.29.4,Brotli==1.0.9,build==0.9.0,cachetools==5.2.0,certifi==2019.11.28,cffi==1.15.1,chardet==3.0.4,charset-normalizer==2.1.1,check-manifest==0.48,clang==5.0,click==8.1.3,cliff==4.0.0,cloudpickle==2.2.0,cmaes==0.9.0,cmake==3.24.1.1,cmd2==2.4.2,colorama==0.4.4,colorlog==6.7.0,contourpy==1.0.5,coverage==6.5.0,cuda-python==11.7.1,cupy-cuda117==10.6.0,cycler==0.11.0,Cython==0.29.32,dask==2022.1.1,dbus-python==1.2.16,debugpy==1.6.3,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.5.1,distlib==0.3.6,distributed==2022.5.1,distro==1.7.0,dm-tree==0.1.6,docker-pycreds==0.4.0,docutils==0.16,emoji==1.7.0,entrypoints==0.4,execnet==1.9.0,executing==1.0.0,faiss==1.7.2,faiss-gpu==1.7.2,fastai==2.7.9,fastapi==0.85.0,fastavro==1.6.1,fastcore==1.5.27,fastdownload==0.0.7,fastjsonschema==2.16.1,fastprogress==1.0.3,fastrlock==0.8,feast==0.19.4,fiddle==0.2.2,filelock==3.8.0,flake8==5.0.4,flatbuffers==1.12,fonttools==4.37.3,frozenlist==1.3.1,fsspec==2022.5.0,gast==0.4.0,gevent==21.12.0,geventhttpclient==2.0.2,gitdb==4.0.9,GitPython==3.1.27,google==3.0.0,google-api-core==2.10.1,google-auth==2.11.1,google-auth-oauthlib==0.4.6,google-pasta==0.2.0,googleapis-common-protos==1.52.0,graphviz==0.20.1,greenlet==1.1.3,grpcio==1.41.0,grpcio-channelz==1.49.0,grpcio-reflection==1.48.1,grpclib==0.4.3,h11==0.13.0,h2==4.1.0,h5py==3.7.0,HeapDict==1.0.1,horovod==0.26.1,hpack==4.0.0,httptools==0.5.0,hugectr2onnx==0.0.0,huggingface-hub==0.9.1,hyperframe==6.0.1,idna==2.8,imagesize==1.4.1,implicit==0.6.1,importlib-metadata==4.12.0,importlib-resources==5.9.0,iniconfig==1.1.1,interrogate==1.5.0,ipykernel==6.15.3,ipython==8.5.0,ipython-genutils==0.2.0,ipywidgets==7.7.0,isort==5.10.1,jedi==0.18.1,Jinja2==3.1.2,jmespath==1.0.1,joblib==1.2.0,json5==0.9.10,jsonschema==4.16.0,jupyter==1.0.0,jupyter-cache==0.4.3,jupyter-console==6.4.4,jupyter-core==4.11.1,jupyter-server==1.18.1,jupyter-server-mathjax==0.2.5,jupyter-sphinx==0.3.2,jupyter_client==7.3.5,jupyterlab==3.4.7,jupyterlab-pygments==0.2.2,jupyterlab-widgets==1.1.0,jupyterlab_server==2.15.1,keras==2.9.0,Keras-Preprocessing==1.1.2,kiwisolver==1.4.4,lazy-object-proxy==1.8.0,libclang==14.0.6,libcst==0.4.7,lightfm==1.16,lightgbm==3.3.2,linkify-it-py==1.0.3,llvmlite==0.39.1,locket==1.0.0,lxml==4.9.1,Mako==1.2.3,Markdown==3.4.1,markdown-it-py==1.1.0,MarkupSafe==2.1.1,matplotlib==3.6.0,matplotlib-inline==0.1.6,mccabe==0.7.0,mdit-py-plugins==0.2.8,merlin-core==0.6.0+1.g5926fcf,merlin-dataloader==0.0.2,merlin-models==0.9.0+34.g5173a961,merlin-systems==0.5.0+4.g15074ad,mistune==2.0.4,mmh3==3.0.0,mpi4py==3.1.3,msgpack==1.0.4,multidict==6.0.2,mypy==0.982,mypy-extensions==0.4.3,myst-nb==0.13.2,myst-parser==0.15.2,natsort==8.1.0,nbclassic==0.4.3,nbclient==0.6.8,nbconvert==7.0.0,nbdime==3.1.1,nbformat==5.5.0,nest-asyncio==1.5.5,ninja==1.10.2.3,notebook==6.4.12,notebook-shim==0.1.0,numba==0.56.2,numpy==1.22.4,nvidia-pyindex==1.0.9,# Editable install with no version control (nvtabular==1.4.0+8.g95e12d347),-e /usr/local/lib/python3.8/dist-packages,nvtx==0.2.5,oauthlib==3.2.1,oldest-supported-numpy==2022.8.16,onnx==1.12.0,onnxruntime==1.11.1,opt-einsum==3.3.0,optuna==3.0.3,packaging==21.3,pandas==1.3.5,pandavro==1.5.2,pandocfilters==1.5.0,parso==0.8.3,partd==1.3.0,pathspec==0.10.1,pathtools==0.1.2,pbr==5.11.0,pep517==0.13.0,pexpect==4.8.0,pickleshare==0.7.5,Pillow==9.2.0,pkgutil_resolve_name==1.3.10,platformdirs==2.5.2,plotly==5.11.0,pluggy==1.0.0,prettytable==3.5.0,prometheus-client==0.14.1,promise==2.3,prompt-toolkit==3.0.31,proto-plus==1.19.6,protobuf==3.19.5,psutil==5.9.2,ptyprocess==0.7.0,pure-eval==0.2.2,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pybind11==2.10.0,pycodestyle==2.9.1,pycparser==2.21,pydantic==1.10.2,pydot==1.4.2,pyflakes==2.5.0,Pygments==2.13.0,PyGObject==3.36.0,pynvml==11.4.1,pyparsing==3.0.9,pyperclip==1.8.2,pyrsistent==0.18.1,pytest==7.1.3,pytest-cov==4.0.0,pytest-xdist==3.0.2,python-apt==2.0.0+ubuntu0.20.4.8,python-dateutil==2.8.2,python-dotenv==0.21.0,python-rapidjson==1.8,pytz==2022.2.1,PyYAML==5.4.1,pyzmq==24.0.0,qtconsole==5.4.0,QtPy==2.2.1,regex==2022.9.13,requests==2.22.0,requests-oauthlib==1.3.1,requests-unixsocket==0.2.0,rsa==4.7.2,s3fs==2022.2.0,s3transfer==0.6.0,sacremoses==0.0.53,scikit-build==0.15.0,scikit-learn==1.1.2,scipy==1.8.1,seedir==0.3.0,Send2Trash==1.8.0,sentry-sdk==1.9.8,setproctitle==1.3.2,setuptools-scm==7.0.5,shortuuid==1.0.9,six==1.15.0,sklearn==0.0,smmap==5.0.0,sniffio==1.3.0,snowballstemmer==2.2.0,sortedcontainers==2.4.0,soupsieve==2.3.2.post1,Sphinx==5.3.0,sphinx-multiversion==0.2.4,sphinx-togglebutton==0.3.1,sphinx_external_toc==0.3.0,sphinxcontrib-applehelp==1.0.2,sphinxcontrib-copydirs @ git+https://github.com/mikemckiernan/sphinxcontrib-copydirs.git@bd8c5d79b3f91cf5f1bb0d6995aeca3fe84b670e,sphinxcontrib-devhelp==1.0.2,sphinxcontrib-htmlhelp==2.0.0,sphinxcontrib-jsmath==1.0.1,sphinxcontrib-qthelp==1.0.3,sphinxcontrib-serializinghtml==1.1.5,SQLAlchemy==1.4.43,stack-data==0.5.0,starlette==0.20.4,stevedore==4.1.0,stringcase==1.2.0,supervisor==4.1.0,tabulate==0.8.10,tblib==1.7.0,tdqm==0.0.1,tenacity==8.0.1,tensorboard==2.9.1,tensorboard-data-server==0.6.1,tensorboard-plugin-wit==1.8.1,tensorflow==2.9.2,tensorflow-estimator==2.9.0,tensorflow-gpu==2.9.2,tensorflow-io-gcs-filesystem==0.27.0,tensorflow-metadata==1.10.0,tensorflow-ranking==0.5.1,tensorflow-serving-api==2.9.2,termcolor==2.0.1,terminado==0.15.0,testbook==0.4.2,threadpoolctl==3.1.0,tinycss2==1.1.1,tokenizers==0.10.3,toml==0.10.2,tomli==2.0.1,toolz==0.12.0,torch==1.12.1+cu113,torchmetrics==0.3.2,tornado==6.2,tox==3.26.0,tqdm==4.64.1,traitlets==5.4.0,transformers==4.12.0,transformers4rec==0.1.12+2.gbcc939255,treelite==2.3.0,treelite-runtime==2.3.0,tritonclient==2.25.0,typed-ast==1.5.4,typing-inspect==0.8.0,typing_extensions==4.3.0,uc-micro-py==1.0.1,urllib3==1.26.12,uvicorn==0.18.3,uvloop==0.17.0,versioneer==0.20,virtualenv==20.16.5,wandb==0.13.3,watchfiles==0.17.0,wcwidth==0.2.5,webencodings==0.5.1,websocket-client==1.4.1,websockets==10.3,Werkzeug==2.2.2,widgetsnbextension==3.6.0,wrapt==1.12.1,xgboost==1.6.2,xyzservices==2022.9.0,yarl==1.8.1,zict==2.2.0,zipp==3.8.1,zope.event==4.5.0,zope.interface==5.4.0
py38-gpu run-test-pre: PYTHONHASHSEED='2650868508'
py38-gpu run-test: commands[0] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/core.git
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/NVIDIA-Merlin/core.git
  Cloning https://github.com/NVIDIA-Merlin/core.git to /tmp/pip-req-build-zqlf5r7j
  Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/core.git /tmp/pip-req-build-zqlf5r7j
  Resolved https://github.com/NVIDIA-Merlin/core.git to commit 64755badd4e5756601f66e7e568201aedb8a4144
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: dask>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (2022.3.0)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (1.3.5)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (0.55.1)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (7.0.0)
Requirement already satisfied: fsspec==2022.5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (2022.5.0)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (1.10.0)
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (3.19.5)
Requirement already satisfied: distributed>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (2022.3.0)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (1.2.5)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (21.3)
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (4.64.1)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (0.4.3)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (1.2.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (0.12.0)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.2.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.2.0)
Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (5.4.1)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (8.1.3)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.0.4)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (3.1.2)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (5.8.0)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.4.0)
Requirement already satisfied: tornado>=6.0.3 in ./.tox/py38-gpu/lib/python3.8/site-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (6.2)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.7.0)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.0.0)
Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+7.g64755ba) (1.20.3)
Requirement already satisfied: setuptools in ./.tox/py38-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+7.g64755ba) (65.4.1)
Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/py38-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+7.g64755ba) (0.38.1)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core==0.8.0+7.g64755ba) (3.0.9)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+7.g64755ba) (2.8.2)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+7.g64755ba) (2022.2.1)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.8.0+7.g64755ba) (1.2.0)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.8.0+7.g64755ba) (1.52.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (0.2.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+7.g64755ba) (1.15.0)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.0.1)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (6.0.2)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (4.1.0)
Requirement already satisfied: MarkupSafe>=2.0 in ./.tox/py38-gpu/lib/python3.8/site-packages (from jinja2->distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.0.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (4.0.0)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (6.0.1)

[notice] A new release of pip available: 22.2.2 -> 22.3.1

[notice] To update, run: pip install --upgrade pip

py38-gpu run-test: commands[1] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/nvtabular.git

Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com

Collecting git+https://github.com/NVIDIA-Merlin/nvtabular.git

Cloning https://github.com/NVIDIA-Merlin/nvtabular.git to /tmp/pip-req-build-g87nlkge

Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/nvtabular.git /tmp/pip-req-build-g87nlkge

Resolved https://github.com/NVIDIA-Merlin/nvtabular.git to commit ba4c14159a8e858c8998d4158a4376e65a8fa266

Installing build dependencies: started

Installing build dependencies: finished with status 'done'

Getting requirements to build wheel: started

Getting requirements to build wheel: finished with status 'done'

Preparing metadata (pyproject.toml): started

Preparing metadata (pyproject.toml): finished with status 'done'

Requirement already satisfied: merlin-dataloader>=0.0.2 in ./.tox/py38-gpu/lib/python3.8/site-packages (from nvtabular==1.6.0+4.gba4c1415) (0.0.2)

Requirement already satisfied: scipy in /usr/local/lib/python3.8/dist-packages (from nvtabular==1.6.0+4.gba4c1415) (1.8.1)

Requirement already satisfied: merlin-core>=0.2.0 in ./.tox/py38-gpu/lib/python3.8/site-packages (from nvtabular==1.6.0+4.gba4c1415) (0.8.0+7.g64755ba)

Requirement already satisfied: dask>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.3.0)

Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.3.5)

Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.55.1)

Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (7.0.0)

Requirement already satisfied: fsspec==2022.5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.5.0)

Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.10.0)

Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (3.19.5)

Requirement already satisfied: distributed>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.3.0)

Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.5)

Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (21.3)

Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (4.64.1)

Requirement already satisfied: numpy<1.25.0,>=1.17.3 in /var/jenkins_home/.local/lib/python3.8/site-packages (from scipy->nvtabular==1.6.0+4.gba4c1415) (1.20.3)

Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.4.3)

Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.0)

Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.12.0)

Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.0)

Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.2.0)

Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (5.4.1)

Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (8.1.3)

Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.0.4)

Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (3.1.2)

Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (5.8.0)

Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.4.0)

Requirement already satisfied: tornado>=6.0.3 in ./.tox/py38-gpu/lib/python3.8/site-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (6.2)

Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.7.0)

Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.0.0)

Requirement already satisfied: setuptools in ./.tox/py38-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (65.4.1)

Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/py38-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.38.1)

Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (3.0.9)

Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.8.2)

Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.2.1)

Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.0)

Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.52.0)

Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.2.1)

Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.15.0)

Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.0.1)

Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (6.0.2)

Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (4.1.0)

Requirement already satisfied: MarkupSafe>=2.0 in ./.tox/py38-gpu/lib/python3.8/site-packages (from jinja2->distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.0.1)

Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (4.0.0)

Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (6.0.1)


[notice] A new release of pip available: 22.2.2 -> 22.3.1

[notice] To update, run: pip install --upgrade pip

py38-gpu run-test: commands[2] | python -m pytest --cov-report term --cov merlin -rxs tests/unit

============================= test session starts ==============================

platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0

cachedir: .tox/py38-gpu/.pytest_cache

rootdir: /var/jenkins_home/workspace/merlin_models/models, configfile: pyproject.toml

plugins: anyio-3.5.0, xdist-3.0.2, cov-4.0.0

collected 875 items


tests/unit/config/test_schema.py ....                                    [  0%]

tests/unit/datasets/test_advertising.py .s                               [  0%]

tests/unit/datasets/test_ecommerce.py ..sss.s                            [  1%]

tests/unit/datasets/test_entertainment.py ....sss.                       [  2%]

tests/unit/datasets/test_social.py .                                     [  2%]

tests/unit/datasets/test_synthetic.py ......                             [  3%]

tests/unit/implicit/test_implicit.py .                                   [  3%]

tests/unit/lightfm/test_lightfm.py .                                     [  3%]

tests/unit/tf/test_core.py ......                                        [  4%]

tests/unit/tf/test_loader.py ................                            [  5%]

tests/unit/tf/test_public_api.py .                                       [  6%]

tests/unit/tf/blocks/test_cross.py ...........                           [  7%]

tests/unit/tf/blocks/test_dlrm.py ..........                             [  8%]

tests/unit/tf/blocks/test_interactions.py ...                            [  8%]

tests/unit/tf/blocks/test_mlp.py ....................................... [ 13%]

............................                                             [ 16%]

tests/unit/tf/blocks/test_optimizer.py s................................ [ 20%]

.....................                                                    [ 22%]

tests/unit/tf/blocks/retrieval/test_base.py .                            [ 22%]

tests/unit/tf/blocks/retrieval/test_matrix_factorization.py ..           [ 22%]

tests/unit/tf/blocks/retrieval/test_two_tower.py ............            [ 24%]

tests/unit/tf/blocks/sampling/test_cross_batch.py .                      [ 24%]

tests/unit/tf/blocks/sampling/test_in_batch.py .                         [ 24%]

tests/unit/tf/core/test_aggregation.py .........                         [ 25%]

tests/unit/tf/core/test_base.py ..                                       [ 25%]

tests/unit/tf/core/test_combinators.py s.....................            [ 28%]

tests/unit/tf/core/test_encoder.py ..                                    [ 28%]

tests/unit/tf/core/test_index.py ...                                     [ 28%]

tests/unit/tf/core/test_prediction.py ..                                 [ 29%]

tests/unit/tf/core/test_tabular.py ......                                [ 29%]

tests/unit/tf/examples/test_01_getting_started.py .                      [ 29%]

tests/unit/tf/examples/test_02_dataschema.py .                           [ 30%]

tests/unit/tf/examples/test_03_exploring_different_models.py .           [ 30%]

tests/unit/tf/examples/test_04_export_ranking_models.py .                [ 30%]

tests/unit/tf/examples/test_05_export_retrieval_model.py .               [ 30%]

tests/unit/tf/examples/test_06_advanced_own_architecture.py .            [ 30%]

tests/unit/tf/examples/test_07_train_traditional_models.py .             [ 30%]

tests/unit/tf/examples/test_usecase_accelerate_training_by_lazyadam.py . [ 30%]

[ 30%]

tests/unit/tf/examples/test_usecase_ecommerce_session_based.py .         [ 30%]

tests/unit/tf/examples/test_usecase_incremental_training_layer_freezing.py . [ 30%]

[ 30%]

tests/unit/tf/examples/test_usecase_pretrained_embeddings.py .           [ 31%]

tests/unit/tf/examples/test_usecase_retrieval_with_hpo.py .              [ 31%]

tests/unit/tf/horovod/test_horovod.py ...                                [ 31%]

tests/unit/tf/inputs/test_continuous.py ........                         [ 32%]

tests/unit/tf/inputs/test_embedding.py ................................. [ 36%]

........                                                                 [ 37%]

tests/unit/tf/inputs/test_tabular.py ..................                  [ 39%]

tests/unit/tf/layers/test_queue.py ..............                        [ 40%]

tests/unit/tf/losses/test_losses.py .......................              [ 43%]

tests/unit/tf/metrics/test_metrics_popularity.py .....                   [ 44%]

tests/unit/tf/metrics/test_metrics_topk.py .........................     [ 46%]

tests/unit/tf/models/test_base.py s........................              [ 49%]

tests/unit/tf/models/test_benchmark.py ..                                [ 49%]

tests/unit/tf/models/test_ranking.py ..................................  [ 53%]

tests/unit/tf/models/test_retrieval.py ................................. [ 57%]

...........................................                              [ 62%]

tests/unit/tf/outputs/test_base.py ......                                [ 63%]

tests/unit/tf/outputs/test_classification.py ......                      [ 63%]

tests/unit/tf/outputs/test_contrastive.py ..............                 [ 65%]

tests/unit/tf/outputs/test_regression.py ..                              [ 65%]

tests/unit/tf/outputs/test_sampling.py ....                              [ 66%]

tests/unit/tf/outputs/test_topk.py .                                     [ 66%]

tests/unit/tf/prediction_tasks/test_classification.py ..                 [ 66%]

tests/unit/tf/prediction_tasks/test_multi_task.py ................       [ 68%]

tests/unit/tf/prediction_tasks/test_next_item.py .....                   [ 68%]

tests/unit/tf/prediction_tasks/test_regression.py .....                  [ 69%]

tests/unit/tf/prediction_tasks/test_retrieval.py .                       [ 69%]

tests/unit/tf/prediction_tasks/test_sampling.py ......                   [ 70%]

tests/unit/tf/transformers/test_block.py .....................           [ 72%]

tests/unit/tf/transformers/test_transforms.py ..........                 [ 73%]

tests/unit/tf/transforms/test_bias.py ..                                 [ 74%]

tests/unit/tf/transforms/test_features.py s............................. [ 77%]

.......................s......                                           [ 80%]

tests/unit/tf/transforms/test_negative_sampling.py .........             [ 81%]

tests/unit/tf/transforms/test_noise.py .....                             [ 82%]

tests/unit/tf/transforms/test_sequence.py ....................           [ 84%]

tests/unit/tf/transforms/test_tensor.py ...                              [ 85%]

tests/unit/tf/utils/test_batch.py ....                                   [ 85%]

tests/unit/tf/utils/test_dataset.py ..                                   [ 85%]

tests/unit/tf/utils/test_tf_utils.py .....                               [ 86%]

tests/unit/torch/test_dataset.py .........                               [ 87%]

tests/unit/torch/test_public_api.py .                                    [ 87%]

tests/unit/torch/block/test_base.py ....                                 [ 88%]

tests/unit/torch/block/test_mlp.py .                                     [ 88%]

tests/unit/torch/features/test_continuous.py ..                          [ 88%]

tests/unit/torch/features/test_embedding.py ..............               [ 89%]

tests/unit/torch/features/test_tabular.py ....                           [ 90%]

tests/unit/torch/model/test_head.py ............                         [ 91%]

tests/unit/torch/model/test_model.py ..                                  [ 92%]

tests/unit/torch/tabular/test_aggregation.py ........                    [ 92%]

tests/unit/torch/tabular/test_tabular.py ...                             [ 93%]

tests/unit/torch/tabular/test_transformations.py .......                 [ 94%]

tests/unit/utils/test_schema_utils.py ................................   [ 97%]

tests/unit/xgb/test_xgboost.py ....................                      [100%]


=============================== warnings summary ===============================

../../../../../usr/lib/python3/dist-packages/requests/init.py:89

/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!

warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "


../../../.local/lib/python3.8/site-packages/flatbuffers/compat.py:19

/var/jenkins_home/.local/lib/python3.8/site-packages/flatbuffers/compat.py:19: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses

import imp


../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:36

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:36: DeprecationWarning: NEAREST is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.NEAREST or Dither.NONE instead.

'nearest': pil_image.NEAREST,


../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:37

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:37: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.

'bilinear': pil_image.BILINEAR,


../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:38

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:38: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.

'bicubic': pil_image.BICUBIC,


../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:39

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:39: DeprecationWarning: HAMMING is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.HAMMING instead.

'hamming': pil_image.HAMMING,


../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:40

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:40: DeprecationWarning: BOX is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BOX instead.

'box': pil_image.BOX,


../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:41

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:41: DeprecationWarning: LANCZOS is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.LANCZOS instead.

'lanczos': pil_image.LANCZOS,


tests/unit/datasets/test_advertising.py: 1 warning

tests/unit/datasets/test_ecommerce.py: 3 warnings

tests/unit/datasets/test_entertainment.py: 4 warnings

tests/unit/datasets/test_social.py: 1 warning

tests/unit/datasets/test_synthetic.py: 6 warnings

tests/unit/implicit/test_implicit.py: 1 warning

tests/unit/lightfm/test_lightfm.py: 1 warning

tests/unit/tf/test_core.py: 6 warnings

tests/unit/tf/test_loader.py: 1 warning

tests/unit/tf/blocks/test_cross.py: 5 warnings

tests/unit/tf/blocks/test_dlrm.py: 9 warnings

tests/unit/tf/blocks/test_interactions.py: 2 warnings

tests/unit/tf/blocks/test_mlp.py: 60 warnings

tests/unit/tf/blocks/test_optimizer.py: 30 warnings

tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings

tests/unit/tf/blocks/retrieval/test_two_tower.py: 11 warnings

tests/unit/tf/core/test_aggregation.py: 6 warnings

tests/unit/tf/core/test_base.py: 2 warnings

tests/unit/tf/core/test_combinators.py: 11 warnings

tests/unit/tf/core/test_encoder.py: 6 warnings

tests/unit/tf/core/test_index.py: 8 warnings

tests/unit/tf/core/test_prediction.py: 2 warnings

tests/unit/tf/horovod/test_horovod.py: 3 warnings

tests/unit/tf/inputs/test_continuous.py: 7 warnings

tests/unit/tf/inputs/test_embedding.py: 20 warnings

tests/unit/tf/inputs/test_tabular.py: 18 warnings

tests/unit/tf/models/test_base.py: 27 warnings

tests/unit/tf/models/test_benchmark.py: 2 warnings

tests/unit/tf/models/test_ranking.py: 38 warnings

tests/unit/tf/models/test_retrieval.py: 120 warnings

tests/unit/tf/outputs/test_base.py: 6 warnings

tests/unit/tf/outputs/test_classification.py: 6 warnings

tests/unit/tf/outputs/test_contrastive.py: 19 warnings

tests/unit/tf/outputs/test_regression.py: 2 warnings

tests/unit/tf/prediction_tasks/test_classification.py: 2 warnings

tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings

tests/unit/tf/prediction_tasks/test_regression.py: 5 warnings

tests/unit/tf/prediction_tasks/test_retrieval.py: 1 warning

tests/unit/tf/transformers/test_block.py: 15 warnings

tests/unit/tf/transforms/test_bias.py: 2 warnings

tests/unit/tf/transforms/test_features.py: 10 warnings

tests/unit/tf/transforms/test_negative_sampling.py: 10 warnings

tests/unit/tf/transforms/test_noise.py: 1 warning

tests/unit/tf/transforms/test_sequence.py: 15 warnings

tests/unit/tf/utils/test_batch.py: 9 warnings

tests/unit/tf/utils/test_dataset.py: 2 warnings

tests/unit/torch/block/test_base.py: 4 warnings

tests/unit/torch/block/test_mlp.py: 1 warning

tests/unit/torch/features/test_continuous.py: 1 warning

tests/unit/torch/features/test_embedding.py: 4 warnings

tests/unit/torch/features/test_tabular.py: 4 warnings

tests/unit/torch/model/test_head.py: 12 warnings

tests/unit/torch/model/test_model.py: 2 warnings

tests/unit/torch/tabular/test_aggregation.py: 6 warnings

tests/unit/torch/tabular/test_transformations.py: 3 warnings

tests/unit/xgb/test_xgboost.py: 18 warnings

/var/jenkins_home/workspace/merlin_models/models/.tox/py38-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.ITEM_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.ITEM: 'item'>, <Tags.ID: 'id'>].

warnings.warn(


tests/unit/datasets/test_ecommerce.py: 3 warnings

tests/unit/datasets/test_entertainment.py: 4 warnings

tests/unit/datasets/test_social.py: 1 warning

tests/unit/datasets/test_synthetic.py: 5 warnings

tests/unit/implicit/test_implicit.py: 1 warning

tests/unit/lightfm/test_lightfm.py: 1 warning

tests/unit/tf/test_core.py: 6 warnings

tests/unit/tf/test_loader.py: 1 warning

tests/unit/tf/blocks/test_cross.py: 5 warnings

tests/unit/tf/blocks/test_dlrm.py: 9 warnings

tests/unit/tf/blocks/test_interactions.py: 2 warnings

tests/unit/tf/blocks/test_mlp.py: 60 warnings

tests/unit/tf/blocks/test_optimizer.py: 30 warnings

tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings

tests/unit/tf/blocks/retrieval/test_two_tower.py: 11 warnings

tests/unit/tf/core/test_aggregation.py: 6 warnings

tests/unit/tf/core/test_base.py: 2 warnings

tests/unit/tf/core/test_combinators.py: 11 warnings

tests/unit/tf/core/test_encoder.py: 7 warnings

tests/unit/tf/core/test_index.py: 3 warnings

tests/unit/tf/core/test_prediction.py: 2 warnings

tests/unit/tf/horovod/test_horovod.py: 1 warning

tests/unit/tf/inputs/test_continuous.py: 7 warnings

tests/unit/tf/inputs/test_embedding.py: 20 warnings

tests/unit/tf/inputs/test_tabular.py: 18 warnings

tests/unit/tf/models/test_base.py: 27 warnings

tests/unit/tf/models/test_benchmark.py: 2 warnings

tests/unit/tf/models/test_ranking.py: 36 warnings

tests/unit/tf/models/test_retrieval.py: 86 warnings

tests/unit/tf/outputs/test_base.py: 6 warnings

tests/unit/tf/outputs/test_classification.py: 6 warnings

tests/unit/tf/outputs/test_contrastive.py: 19 warnings

tests/unit/tf/outputs/test_regression.py: 2 warnings

tests/unit/tf/prediction_tasks/test_classification.py: 2 warnings

tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings

tests/unit/tf/prediction_tasks/test_regression.py: 5 warnings

tests/unit/tf/transformers/test_block.py: 9 warnings

tests/unit/tf/transforms/test_features.py: 10 warnings

tests/unit/tf/transforms/test_negative_sampling.py: 10 warnings

tests/unit/tf/transforms/test_sequence.py: 15 warnings

tests/unit/tf/utils/test_batch.py: 7 warnings

tests/unit/tf/utils/test_dataset.py: 2 warnings

tests/unit/torch/block/test_base.py: 4 warnings

tests/unit/torch/block/test_mlp.py: 1 warning

tests/unit/torch/features/test_continuous.py: 1 warning

tests/unit/torch/features/test_embedding.py: 4 warnings

tests/unit/torch/features/test_tabular.py: 4 warnings

tests/unit/torch/model/test_head.py: 12 warnings

tests/unit/torch/model/test_model.py: 2 warnings

tests/unit/torch/tabular/test_aggregation.py: 6 warnings

tests/unit/torch/tabular/test_transformations.py: 2 warnings

tests/unit/xgb/test_xgboost.py: 17 warnings

/var/jenkins_home/workspace/merlin_models/models/.tox/py38-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.USER_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.USER: 'user'>, <Tags.ID: 'id'>].

warnings.warn(


tests/unit/datasets/test_ecommerce.py: 1 warning

tests/unit/datasets/test_entertainment.py: 1 warning

tests/unit/implicit/test_implicit.py: 1 warning

tests/unit/lightfm/test_lightfm.py: 1 warning

tests/unit/tf/test_loader.py: 1 warning

tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings

tests/unit/tf/blocks/retrieval/test_two_tower.py: 2 warnings

tests/unit/tf/core/test_combinators.py: 11 warnings

tests/unit/tf/core/test_encoder.py: 2 warnings

tests/unit/tf/core/test_prediction.py: 1 warning

tests/unit/tf/horovod/test_horovod.py: 1 warning

tests/unit/tf/inputs/test_continuous.py: 4 warnings

tests/unit/tf/inputs/test_embedding.py: 9 warnings

tests/unit/tf/inputs/test_tabular.py: 8 warnings

tests/unit/tf/models/test_ranking.py: 20 warnings

tests/unit/tf/models/test_retrieval.py: 10 warnings

tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings

tests/unit/tf/prediction_tasks/test_regression.py: 3 warnings

tests/unit/tf/transforms/test_negative_sampling.py: 9 warnings

tests/unit/xgb/test_xgboost.py: 12 warnings

/var/jenkins_home/workspace/merlin_models/models/.tox/py38-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.SESSION_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.SESSION: 'session'>, <Tags.ID: 'id'>].

warnings.warn(


tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export

tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export

tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export

tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export

tests/unit/tf/inputs/test_embedding.py::test_embedding_features_exporting_and_loading_pretrained_initializer

/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/inputs/embedding.py:968: DeprecationWarning: This function is deprecated in favor of cupy.from_dlpack

embeddings_cupy = cupy.fromDlpack(to_dlpack(tf.convert_to_tensor(embeddings)))


tests/unit/tf/blocks/retrieval/test_two_tower.py: 1 warning

tests/unit/tf/core/test_index.py: 4 warnings

tests/unit/tf/horovod/test_horovod.py: 3 warnings

tests/unit/tf/models/test_retrieval.py: 55 warnings

tests/unit/tf/prediction_tasks/test_next_item.py: 3 warnings

tests/unit/tf/utils/test_batch.py: 2 warnings

/tmp/autograph_generated_fileesfkpe4w.py:8: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead

ag.converted_call(ag__.ld(warnings).warn, ("The 'warn' method is deprecated, use 'warning' instead", ag__.ld(DeprecationWarning), 2), None, fscope)


tests/unit/tf/core/test_combinators.py::test_parallel_block_select_by_tags

/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/core/tabular.py:602: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3, and in 3.10 it will stop working

elif isinstance(self.feature_names, collections.Sequence):


tests/unit/tf/core/test_encoder.py: 1 warning

tests/unit/tf/core/test_index.py: 5 warnings

tests/unit/tf/models/test_retrieval.py: 30 warnings

tests/unit/tf/utils/test_batch.py: 4 warnings

tests/unit/tf/utils/test_dataset.py: 1 warning

/var/jenkins_home/workspace/merlin_models/models/merlin/models/utils/dataset.py:75: DeprecationWarning: unique_rows_by_features is deprecated and will be removed in a future version. Please use unique_by_tag instead.

warnings.warn(


tests/unit/tf/models/test_base.py::test_model_pre_post[True]

tests/unit/tf/models/test_base.py::test_model_pre_post[False]

tests/unit/tf/transforms/test_noise.py::test_stochastic_swap_noise[0.1]

tests/unit/tf/transforms/test_noise.py::test_stochastic_swap_noise[0.3]

tests/unit/tf/transforms/test_noise.py::test_stochastic_swap_noise[0.5]

tests/unit/tf/transforms/test_noise.py::test_stochastic_swap_noise[0.7]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/util/dispatch.py:1082: UserWarning: tf.keras.backend.random_binomial is deprecated, and will be removed in a future version.Please use tf.keras.backend.random_bernoulli instead.

return dispatch_target(*args, **kwargs)


tests/unit/tf/models/test_base.py::test_freeze_parallel_block[True]

tests/unit/tf/models/test_base.py::test_freeze_sequential_block

tests/unit/tf/models/test_base.py::test_freeze_unfreeze

tests/unit/tf/models/test_base.py::test_unfreeze_all_blocks

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/optimizers/optimizer_v2/gradient_descent.py:108: UserWarning: The lr argument is deprecated, use learning_rate instead.

super(SGD, self).init(name, **kwargs)


tests/unit/tf/models/test_base.py::test_retrieval_model_query

tests/unit/tf/models/test_base.py::test_retrieval_model_query

tests/unit/tf/models/test_retrieval.py::test_youtube_dnn_v2_export_embeddings

tests/unit/tf/models/test_retrieval.py::test_youtube_dnn_topk_evaluation[True]

tests/unit/tf/models/test_retrieval.py::test_youtube_dnn_topk_evaluation[False]

/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/utils/tf_utils.py:298: DeprecationWarning: This function is deprecated in favor of cupy.from_dlpack

tensor_cupy = cupy.fromDlpack(to_dlpack(tf.convert_to_tensor(tensor)))


tests/unit/tf/models/test_ranking.py::test_deepfm_model_only_categ_feats[False]

tests/unit/tf/models/test_ranking.py::test_deepfm_model_categ_and_continuous_feats[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_3/parallel_block_2/sequential_block_3/sequential_block_2/private__dense_1/dense_1/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_3/parallel_block_2/sequential_block_3/sequential_block_2/private__dense_1/dense_1/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_3/parallel_block_2/sequential_block_3/sequential_block_2/private__dense_1/dense_1/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/models/test_ranking.py::test_wide_deep_model[False]

tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_categorical_one_hot[False]

tests/unit/tf/models/test_ranking.py::test_wide_deep_model_hashed_cross[False]

tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[True]

tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]

/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/transforms/features.py:569: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag

warnings.warn(


tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/autograph/impl/api.py:371: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag

return py_builtins.overload_of(f)(*args)


tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_onehot_multihot_feature_interaction[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_feature_interaction_multi_optimizer[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_as_classfication_model[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/bert_block/prepare_transformer_inputs_1/RaggedToTensor/boolean_mask_1/GatherV2:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_1:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_as_classfication_model[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/bert_block/prepare_transformer_inputs_1/RaggedToTensor/boolean_mask_1/GatherV2:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_3:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape_1:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_causal_language_modeling[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/gpt2_block/prepare_transformer_inputs_5/RaggedToTensor/boolean_mask_1/GatherV2:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_1:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_causal_language_modeling[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/gpt2_block/prepare_transformer_inputs_5/RaggedToTensor/boolean_mask_1/GatherV2:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_3:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape_1:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/bert_block/prepare_transformer_inputs_1/RaggedToTensor/boolean_mask_1/GatherV2:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/bert_block/prepare_transformer_inputs_1/RaggedToTensor/boolean_mask/GatherV2:0", shape=(None, 48), dtype=float32), dense_shape=Tensor("gradient_tape/model/bert_block/prepare_transformer_inputs_1/RaggedToTensor/Shape:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/bert_block/replace_masked_embeddings/RaggedWhere/Reshape_3:0", shape=(None,), dtype=int64), values=Tensor("gradient_tape/model/bert_block/replace_masked_embeddings/RaggedWhere/Reshape_2:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/bert_block/replace_masked_embeddings/RaggedWhere/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/bert_block/replace_masked_embeddings/RaggedWhere/RaggedTile_2/Reshape_3:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_1:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/bert_block/replace_masked_embeddings/RaggedWhere/RaggedTile_2/Reshape_3:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_3:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape_1:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling_check_eval_masked[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/gpt2_block/prepare_transformer_inputs_5/RaggedToTensor/boolean_mask_1/GatherV2:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/gpt2_block/prepare_transformer_inputs_5/RaggedToTensor/boolean_mask/GatherV2:0", shape=(None, 48), dtype=float32), dense_shape=Tensor("gradient_tape/model/gpt2_block/prepare_transformer_inputs_5/RaggedToTensor/Shape:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling_check_eval_masked[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/gpt2_block/replace_masked_embeddings/RaggedWhere/Reshape_3:0", shape=(None,), dtype=int64), values=Tensor("gradient_tape/model/gpt2_block/replace_masked_embeddings/RaggedWhere/Reshape_2:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/gpt2_block/replace_masked_embeddings/RaggedWhere/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling_check_eval_masked[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/gpt2_block/replace_masked_embeddings/RaggedWhere/RaggedTile_2/Reshape_3:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_1:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling_check_eval_masked[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/gpt2_block/replace_masked_embeddings/RaggedWhere/RaggedTile_2/Reshape_3:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_3:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape_1:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/torch/block/test_mlp.py::test_mlp_block

/var/jenkins_home/workspace/merlin_models/models/tests/unit/torch/_conftest.py:151: UserWarning: Creating a tensor from a list of numpy.ndarrays is extremely slow. Please consider converting the list to a single numpy.ndarray with numpy.array() before converting to a tensor. (Triggered internally at  ../torch/csrc/utils/tensor_new.cpp:201.)

return {key: torch.tensor(value) for key, value in data.items()}


tests/unit/xgb/test_xgboost.py::test_without_dask_client

tests/unit/xgb/test_xgboost.py::TestXGBoost::test_music_regression

tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs0-DaskDeviceQuantileDMatrix]

tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs1-DaskDMatrix]

tests/unit/xgb/test_xgboost.py::TestEvals::test_multiple

tests/unit/xgb/test_xgboost.py::TestEvals::test_default

tests/unit/xgb/test_xgboost.py::TestEvals::test_train_and_valid

tests/unit/xgb/test_xgboost.py::TestEvals::test_invalid_data

/var/jenkins_home/workspace/merlin_models/models/merlin/models/xgb/init.py:344: UserWarning: Ignoring list columns as inputs to XGBoost model: ['item_genres', 'user_genres'].

warnings.warn(f"Ignoring list columns as inputs to XGBoost model: {list_column_names}.")


tests/unit/xgb/test_xgboost.py::TestXGBoost::test_unsupported_objective

/var/jenkins_home/workspace/merlin_models/models/.tox/py38-gpu/lib/python3.8/site-packages/tornado/ioloop.py:350: DeprecationWarning: make_current is deprecated; start the event loop first

self.make_current()


tests/unit/xgb/test_xgboost.py: 14 warnings

/usr/local/lib/python3.8/dist-packages/xgboost/dask.py:884: RuntimeWarning: coroutine 'Client._wait_for_workers' was never awaited

client.wait_for_workers(n_workers)

Enable tracemalloc to get traceback where the object was allocated.

See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info.


tests/unit/xgb/test_xgboost.py: 11 warnings

/usr/local/lib/python3.8/dist-packages/cudf/core/dataframe.py:1183: DeprecationWarning: The default dtype for empty Series will be 'object' instead of 'float64' in a future version. Specify a dtype explicitly to silence this warning.

mask = pd.Series(mask)


-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html


---------- coverage: platform linux, python 3.8.10-final-0 -----------

Name                                                                 Stmts   Miss  Cover


merlin/datasets/init.py                                              2      0   100%

merlin/datasets/advertising/init.py                                  2      0   100%

merlin/datasets/advertising/criteo/init.py                           0      0   100%

merlin/datasets/advertising/criteo/dataset.py                           79     49    38%

merlin/datasets/advertising/criteo/transformed/init.py               0      0   100%

merlin/datasets/ecommerce/init.py                                    4      0   100%

merlin/datasets/ecommerce/aliccp/init.py                             0      0   100%

merlin/datasets/ecommerce/aliccp/dataset.py                            141     87    38%

merlin/datasets/ecommerce/aliccp/raw/init.py                         0      0   100%

merlin/datasets/ecommerce/aliccp/transformed/init.py                 0      0   100%

merlin/datasets/ecommerce/booking/init.py                            0      0   100%

merlin/datasets/ecommerce/booking/dataset.py                           107     80    25%

merlin/datasets/ecommerce/booking/transformed/init.py                0      0   100%

merlin/datasets/ecommerce/dressipi/init.py                           0      0   100%

merlin/datasets/ecommerce/dressipi/dataset.py                           45     37    18%

merlin/datasets/ecommerce/dressipi/preprocessed/init.py              0      0   100%

merlin/datasets/ecommerce/large/init.py                              0      0   100%

merlin/datasets/ecommerce/small/init.py                              0      0   100%

merlin/datasets/ecommerce/transactions/init.py                       0      0   100%

merlin/datasets/entertainment/init.py                                2      0   100%

merlin/datasets/entertainment/movielens/1m-raw/init.py               0      0   100%

merlin/datasets/entertainment/movielens/1m-raw/ratings/init.py       0      0   100%

merlin/datasets/entertainment/movielens/1m/init.py                   0      0   100%

merlin/datasets/entertainment/movielens/25m/init.py                  0      0   100%

merlin/datasets/entertainment/movielens/100k/init.py                 0      0   100%

merlin/datasets/entertainment/movielens/init.py                      0      0   100%

merlin/datasets/entertainment/movielens/dataset.py                     152    122    20%

merlin/datasets/entertainment/music_streaming/init.py                0      0   100%

merlin/datasets/social/init.py                                       0      0   100%

merlin/datasets/synthetic.py                                           147     14    90%

merlin/datasets/testing/init.py                                      0      0   100%

merlin/datasets/testing/sequence_testing/init.py                     0      0   100%

merlin/models/init.py                                                2      0   100%

merlin/models/_version.py                                              354    205    42%

merlin/models/api.py                                                    14      5    64%

merlin/models/config/init.py                                         0      0   100%

merlin/models/config/schema.py                                          62      0   100%

merlin/models/implicit/init.py                                      27      4    85%

merlin/models/io.py                                                     15      0   100%

merlin/models/lightfm/init.py                                       23      0   100%

merlin/models/loader/init.py                                         0      0   100%

merlin/models/loader/backend.py                                        379     41    89%

merlin/models/loader/dataframe_iter.py                                  21     17    19%

merlin/models/loader/tf_utils.py                                        57     27    53%

merlin/models/loader/utils.py                                           40     15    62%

merlin/models/tf/init.py                                            70      0   100%

merlin/models/tf/blocks/init.py                                      0      0   100%

merlin/models/tf/blocks/cross.py                                        44      0   100%

merlin/models/tf/blocks/dlrm.py                                         49      2    96%

merlin/models/tf/blocks/experts.py                                      99     17    83%

merlin/models/tf/blocks/interaction.py                                 108     40    63%

merlin/models/tf/blocks/mlp.py                                         117      7    94%

merlin/models/tf/blocks/optimizer.py                                   173     12    93%

merlin/models/tf/blocks/retrieval/init.py                            0      0   100%

merlin/models/tf/blocks/retrieval/base.py                              169     62    63%

merlin/models/tf/blocks/retrieval/matrix_factorization.py               35      1    97%

merlin/models/tf/blocks/retrieval/two_tower.py                          30      0   100%

merlin/models/tf/blocks/sampling/init.py                             0      0   100%

merlin/models/tf/blocks/sampling/base.py                                29      2    93%

merlin/models/tf/blocks/sampling/cross_batch.py                         46      2    96%

merlin/models/tf/blocks/sampling/in_batch.py                            35      0   100%

merlin/models/tf/blocks/sampling/queue.py                              115     12    90%

merlin/models/tf/core/init.py                                        0      0   100%

merlin/models/tf/core/aggregation.py                                   241     45    81%

merlin/models/tf/core/base.py                                          244     50    80%

merlin/models/tf/core/combinators.py                                   426     53    88%

merlin/models/tf/core/encoder.py                                       175     28    84%

merlin/models/tf/core/index.py                                         104     16    85%

merlin/models/tf/core/prediction.py                                     50      1    98%

merlin/models/tf/core/tabular.py                                       280     29    90%

merlin/models/tf/distributed/init.py                                 0      0   100%

merlin/models/tf/distributed/backend.py                                  9      2    78%

merlin/models/tf/inputs/init.py                                      0      0   100%

merlin/models/tf/inputs/base.py                                         60     10    83%

merlin/models/tf/inputs/continuous.py                                   39      3    92%

merlin/models/tf/inputs/embedding.py                                   458     31    93%

merlin/models/tf/loader.py                                             268     94    65%

merlin/models/tf/losses/init.py                                      4      0   100%

merlin/models/tf/losses/base.py                                          9      0   100%

merlin/models/tf/losses/listwise.py                                     13      0   100%

merlin/models/tf/losses/pairwise.py                                    115      1    99%

merlin/models/tf/metrics/init.py                                     2      0   100%

merlin/models/tf/metrics/evaluation.py                                 105     48    54%

merlin/models/tf/metrics/topk.py                                       198     48    76%

merlin/models/tf/models/init.py                                      0      0   100%

merlin/models/tf/models/base.py                                        751    102    86%

merlin/models/tf/models/benchmark.py                                    16      0   100%

merlin/models/tf/models/ranking.py                                      67      3    96%

merlin/models/tf/models/retrieval.py                                    78      4    95%

merlin/models/tf/models/utils.py                                        10      1    90%

merlin/models/tf/outputs/init.py                                     0      0   100%

merlin/models/tf/outputs/base.py                                       122     17    86%

merlin/models/tf/outputs/classification.py                              91      1    99%

merlin/models/tf/outputs/contrastive.py                                147     10    93%

merlin/models/tf/outputs/regression.py                                   9      0   100%

merlin/models/tf/outputs/sampling/init.py                            0      0   100%

merlin/models/tf/outputs/sampling/base.py                               78     21    73%

merlin/models/tf/outputs/sampling/in_batch.py                           37      1    97%

merlin/models/tf/outputs/sampling/popularity.py                         27      1    96%

merlin/models/tf/outputs/topk.py                                        98      6    94%

merlin/models/tf/prediction_tasks/init.py                            0      0   100%

merlin/models/tf/prediction_tasks/base.py                              207     37    82%

merlin/models/tf/prediction_tasks/classification.py                     68     17    75%

merlin/models/tf/prediction_tasks/multi.py                               7      0   100%

merlin/models/tf/prediction_tasks/next_item.py                          59      6    90%

merlin/models/tf/prediction_tasks/regression.py                         35      2    94%

merlin/models/tf/prediction_tasks/retrieval.py                          73      3    96%

merlin/models/tf/transformers/init.py                                0      0   100%

merlin/models/tf/transformers/block.py                                 101      2    98%

merlin/models/tf/transformers/transforms.py                             63      0   100%

merlin/models/tf/transforms/init.py                                  0      0   100%

merlin/models/tf/transforms/bias.py                                    111      9    92%

merlin/models/tf/transforms/features.py                                435     36    92%

merlin/models/tf/transforms/negative_sampling.py                        77      3    96%

merlin/models/tf/transforms/noise.py                                    43      1    98%

merlin/models/tf/transforms/regularization.py                           17      1    94%

merlin/models/tf/transforms/sequence.py                                282     42    85%

merlin/models/tf/transforms/tensor.py                                  158     13    92%

merlin/models/tf/typing.py                                               7      0   100%

merlin/models/tf/utils/init.py                                       0      0   100%

merlin/models/tf/utils/batch_utils.py                                   85      4    95%

merlin/models/tf/utils/repr_utils.py                                    69      4    94%

merlin/models/tf/utils/search_utils.py                                  34     22    35%

merlin/models/tf/utils/testing_utils.py                                206     36    83%

merlin/models/tf/utils/tf_utils.py                                     209     42    80%

merlin/models/torch/init.py                                         12      0   100%

merlin/models/torch/block/init.py                                    0      0   100%

merlin/models/torch/block/base.py                                      167     32    81%

merlin/models/torch/block/mlp.py                                        38      5    87%

merlin/models/torch/dataset.py                                          68      5    93%

merlin/models/torch/features/init.py                                 0      0   100%

merlin/models/torch/features/base.py                                     4      0   100%

merlin/models/torch/features/continuous.py                              22      0   100%

merlin/models/torch/features/embedding.py                              165     12    93%

merlin/models/torch/features/tabular.py                                 65      8    88%

merlin/models/torch/losses.py                                           28     28     0%

merlin/models/torch/model/init.py                                    0      0   100%

merlin/models/torch/model/base.py                                      286     65    77%

merlin/models/torch/model/prediction_task.py                            24      0   100%

merlin/models/torch/tabular/init.py                                  0      0   100%

merlin/models/torch/tabular/aggregation.py                              75      0   100%

merlin/models/torch/tabular/base.py                                    247     39    84%

merlin/models/torch/tabular/transformations.py                          67      3    96%

merlin/models/torch/typing.py                                            6      0   100%

merlin/models/torch/utils/init.py                                    0      0   100%

merlin/models/torch/utils/data_utils.py                                117    117     0%

merlin/models/torch/utils/examples_utils.py                             39     39     0%

merlin/models/torch/utils/torch_utils.py                                80     22    72%

merlin/models/utils/init.py                                          0      0   100%

merlin/models/utils/constants.py                                         3      0   100%

merlin/models/utils/dataset.py                                          38      4    89%

merlin/models/utils/dependencies.py                                     26     19    27%

merlin/models/utils/doc_utils.py                                        10      0   100%

merlin/models/utils/example_utils.py                                    31      2    94%

merlin/models/utils/misc_utils.py                                      118     90    24%

merlin/models/utils/nvt_utils.py                                        27     24    11%

merlin/models/utils/registry.py                                        101     29    71%

merlin/models/utils/schema_utils.py                                     90     19    79%

merlin/models/xgb/init.py                                          124      4    97%


TOTAL                                                                11549   2332    80%


=========================== short test summary info ============================

SKIPPED [1] tests/unit/datasets/test_advertising.py:20: No data-dir available, pass it through env variable $INPUT_DATA_DIR

SKIPPED [1] tests/unit/datasets/test_ecommerce.py:64: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP

SKIPPED [1] tests/unit/datasets/test_ecommerce.py:80: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP

SKIPPED [1] tests/unit/datasets/test_ecommerce.py:94: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP

SKIPPED [1] tests/unit/datasets/test_ecommerce.py:115: No data-dir available, pass it through env variable $INPUT_DATA_DIR

SKIPPED [3] tests/unit/datasets/test_entertainment.py:44: No data-dir available, pass it through env variable $INPUT_DATA_DIR

SKIPPED [5] ../../../.local/lib/python3.8/site-packages/tensorflow/python/framework/test_util.py:2746: Not a test.

========= 862 passed, 13 skipped, 1431 warnings in 1685.05s (0:28:05) ==========

/usr/local/lib/python3.8/dist-packages/coverage/data.py:130: CoverageWarning: Data file '/var/jenkins_home/workspace/merlin_models/models/.coverage.10.20.17.231.23927.381974' doesn't seem to be a coverage data file: cannot unpack non-iterable NoneType object

data._warn(str(exc))

___________________________________ summary ____________________________________

py38-gpu: commands succeeded

congratulations :)

GLOB sdist-make: /var/jenkins_home/workspace/merlin_models/models/setup.py

py38-multi-gpu inst-nodeps: /var/jenkins_home/workspace/merlin_models/models/.tox/.tmp/package/2/merlin-models-0.9.0+34.g5173a961.zip

WARNING: Discarding $PYTHONPATH from environment, to override specify PYTHONPATH in 'passenv' in your configuration.

py38-multi-gpu installed: absl-py==1.2.0,aiohttp==3.8.1,aiosignal==1.2.0,alabaster==0.7.12,alembic==1.8.1,anyio==3.6.1,appdirs==1.4.4,argon2-cffi==21.3.0,argon2-cffi-bindings==21.2.0,astroid==2.5.6,asttokens==2.0.8,astunparse==1.6.3,asv==0.5.1,asvdb==0.4.2,async-timeout==4.0.2,attrs==22.1.0,autopage==0.5.1,awscli==1.27.4,Babel==2.10.3,backcall==0.2.0,beautifulsoup4==4.11.1,betterproto==1.2.5,black==20.8b1,bleach==5.0.1,bokeh==3.0.1,boto3==1.24.75,botocore==1.29.4,Brotli==1.0.9,build==0.9.0,cachetools==5.2.0,certifi==2019.11.28,cffi==1.15.1,chardet==3.0.4,charset-normalizer==2.1.1,check-manifest==0.48,clang==5.0,click==8.1.3,cliff==4.0.0,cloudpickle==2.2.0,cmaes==0.9.0,cmake==3.24.1.1,cmd2==2.4.2,colorama==0.4.4,colorlog==6.7.0,contourpy==1.0.5,coverage==6.5.0,cuda-python==11.7.1,cupy-cuda117==10.6.0,cycler==0.11.0,Cython==0.29.32,dask==2022.1.1,dbus-python==1.2.16,debugpy==1.6.3,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.5.1,distlib==0.3.6,distributed==2022.5.1,distro==1.7.0,dm-tree==0.1.6,docker-pycreds==0.4.0,docutils==0.16,emoji==1.7.0,entrypoints==0.4,execnet==1.9.0,executing==1.0.0,faiss==1.7.2,faiss-gpu==1.7.2,fastai==2.7.9,fastapi==0.85.0,fastavro==1.6.1,fastcore==1.5.27,fastdownload==0.0.7,fastjsonschema==2.16.1,fastprogress==1.0.3,fastrlock==0.8,feast==0.19.4,fiddle==0.2.2,filelock==3.8.0,flake8==5.0.4,flatbuffers==1.12,fonttools==4.37.3,frozenlist==1.3.1,fsspec==2022.5.0,gast==0.4.0,gevent==21.12.0,geventhttpclient==2.0.2,gitdb==4.0.9,GitPython==3.1.27,google==3.0.0,google-api-core==2.10.1,google-auth==2.11.1,google-auth-oauthlib==0.4.6,google-pasta==0.2.0,googleapis-common-protos==1.52.0,graphviz==0.20.1,greenlet==1.1.3,grpcio==1.41.0,grpcio-channelz==1.49.0,grpcio-reflection==1.48.1,grpclib==0.4.3,h11==0.13.0,h2==4.1.0,h5py==3.7.0,HeapDict==1.0.1,horovod==0.26.1,hpack==4.0.0,httptools==0.5.0,hugectr2onnx==0.0.0,huggingface-hub==0.9.1,hyperframe==6.0.1,idna==2.8,imagesize==1.4.1,implicit==0.6.1,importlib-metadata==4.12.0,importlib-resources==5.9.0,iniconfig==1.1.1,interrogate==1.5.0,ipykernel==6.15.3,ipython==8.5.0,ipython-genutils==0.2.0,ipywidgets==7.7.0,isort==5.10.1,jedi==0.18.1,Jinja2==3.1.2,jmespath==1.0.1,joblib==1.2.0,json5==0.9.10,jsonschema==4.16.0,jupyter==1.0.0,jupyter-cache==0.4.3,jupyter-console==6.4.4,jupyter-core==4.11.1,jupyter-server==1.18.1,jupyter-server-mathjax==0.2.5,jupyter-sphinx==0.3.2,jupyter_client==7.3.5,jupyterlab==3.4.7,jupyterlab-pygments==0.2.2,jupyterlab-widgets==1.1.0,jupyterlab_server==2.15.1,keras==2.9.0,Keras-Preprocessing==1.1.2,kiwisolver==1.4.4,lazy-object-proxy==1.8.0,libclang==14.0.6,libcst==0.4.7,lightfm==1.16,lightgbm==3.3.2,linkify-it-py==1.0.3,llvmlite==0.39.1,locket==1.0.0,lxml==4.9.1,Mako==1.2.3,Markdown==3.4.1,markdown-it-py==1.1.0,MarkupSafe==2.1.1,matplotlib==3.6.0,matplotlib-inline==0.1.6,mccabe==0.7.0,mdit-py-plugins==0.2.8,merlin-core==0.6.0+1.g5926fcf,merlin-dataloader==0.0.2,merlin-models==0.9.0+34.g5173a961,merlin-systems==0.5.0+4.g15074ad,mistune==2.0.4,mmh3==3.0.0,mpi4py==3.1.3,msgpack==1.0.4,multidict==6.0.2,mypy==0.982,mypy-extensions==0.4.3,myst-nb==0.13.2,myst-parser==0.15.2,natsort==8.1.0,nbclassic==0.4.3,nbclient==0.6.8,nbconvert==7.0.0,nbdime==3.1.1,nbformat==5.5.0,nest-asyncio==1.5.5,ninja==1.10.2.3,notebook==6.4.12,notebook-shim==0.1.0,numba==0.56.2,numpy==1.22.4,nvidia-pyindex==1.0.9,# Editable install with no version control (nvtabular==1.4.0+8.g95e12d347),-e /usr/local/lib/python3.8/dist-packages,nvtx==0.2.5,oauthlib==3.2.1,oldest-supported-numpy==2022.8.16,onnx==1.12.0,onnxruntime==1.11.1,opt-einsum==3.3.0,optuna==3.0.3,packaging==21.3,pandas==1.3.5,pandavro==1.5.2,pandocfilters==1.5.0,parso==0.8.3,partd==1.3.0,pathspec==0.10.1,pathtools==0.1.2,pbr==5.11.0,pep517==0.13.0,pexpect==4.8.0,pickleshare==0.7.5,Pillow==9.2.0,pkgutil_resolve_name==1.3.10,platformdirs==2.5.2,plotly==5.11.0,pluggy==1.0.0,prettytable==3.5.0,prometheus-client==0.14.1,promise==2.3,prompt-toolkit==3.0.31,proto-plus==1.19.6,protobuf==3.19.5,psutil==5.9.2,ptyprocess==0.7.0,pure-eval==0.2.2,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pybind11==2.10.0,pycodestyle==2.9.1,pycparser==2.21,pydantic==1.10.2,pydot==1.4.2,pyflakes==2.5.0,Pygments==2.13.0,PyGObject==3.36.0,pynvml==11.4.1,pyparsing==3.0.9,pyperclip==1.8.2,pyrsistent==0.18.1,pytest==7.1.3,pytest-cov==4.0.0,pytest-xdist==3.0.2,python-apt==2.0.0+ubuntu0.20.4.8,python-dateutil==2.8.2,python-dotenv==0.21.0,python-rapidjson==1.8,pytz==2022.2.1,PyYAML==5.4.1,pyzmq==24.0.0,qtconsole==5.4.0,QtPy==2.2.1,regex==2022.9.13,requests==2.22.0,requests-oauthlib==1.3.1,requests-unixsocket==0.2.0,rsa==4.7.2,s3fs==2022.2.0,s3transfer==0.6.0,sacremoses==0.0.53,scikit-build==0.15.0,scikit-learn==1.1.2,scipy==1.8.1,seedir==0.3.0,Send2Trash==1.8.0,sentry-sdk==1.9.8,setproctitle==1.3.2,setuptools-scm==7.0.5,shortuuid==1.0.9,six==1.15.0,sklearn==0.0,smmap==5.0.0,sniffio==1.3.0,snowballstemmer==2.2.0,sortedcontainers==2.4.0,soupsieve==2.3.2.post1,Sphinx==5.3.0,sphinx-multiversion==0.2.4,sphinx-togglebutton==0.3.1,sphinx_external_toc==0.3.0,sphinxcontrib-applehelp==1.0.2,sphinxcontrib-copydirs @ git+https://github.com/mikemckiernan/sphinxcontrib-copydirs.git@bd8c5d79b3f91cf5f1bb0d6995aeca3fe84b670e,sphinxcontrib-devhelp==1.0.2,sphinxcontrib-htmlhelp==2.0.0,sphinxcontrib-jsmath==1.0.1,sphinxcontrib-qthelp==1.0.3,sphinxcontrib-serializinghtml==1.1.5,SQLAlchemy==1.4.43,stack-data==0.5.0,starlette==0.20.4,stevedore==4.1.0,stringcase==1.2.0,supervisor==4.1.0,tabulate==0.8.10,tblib==1.7.0,tdqm==0.0.1,tenacity==8.0.1,tensorboard==2.9.1,tensorboard-data-server==0.6.1,tensorboard-plugin-wit==1.8.1,tensorflow==2.9.2,tensorflow-estimator==2.9.0,tensorflow-gpu==2.9.2,tensorflow-io-gcs-filesystem==0.27.0,tensorflow-metadata==1.10.0,tensorflow-ranking==0.5.1,tensorflow-serving-api==2.9.2,termcolor==2.0.1,terminado==0.15.0,testbook==0.4.2,threadpoolctl==3.1.0,tinycss2==1.1.1,tokenizers==0.10.3,toml==0.10.2,tomli==2.0.1,toolz==0.12.0,torch==1.12.1+cu113,torchmetrics==0.3.2,tornado==6.2,tox==3.26.0,tqdm==4.64.1,traitlets==5.4.0,transformers==4.12.0,transformers4rec==0.1.12+2.gbcc939255,treelite==2.3.0,treelite-runtime==2.3.0,tritonclient==2.25.0,typed-ast==1.5.4,typing-inspect==0.8.0,typing_extensions==4.3.0,uc-micro-py==1.0.1,urllib3==1.26.12,uvicorn==0.18.3,uvloop==0.17.0,versioneer==0.20,virtualenv==20.16.5,wandb==0.13.3,watchfiles==0.17.0,wcwidth==0.2.5,webencodings==0.5.1,websocket-client==1.4.1,websockets==10.3,Werkzeug==2.2.2,widgetsnbextension==3.6.0,wrapt==1.12.1,xgboost==1.6.2,xyzservices==2022.9.0,yarl==1.8.1,zict==2.2.0,zipp==3.8.1,zope.event==4.5.0,zope.interface==5.4.0

py38-multi-gpu run-test-pre: PYTHONHASHSEED='3704451810'

py38-multi-gpu run-test: commands[0] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/core.git

Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com

Collecting git+https://github.com/NVIDIA-Merlin/core.git

Cloning https://github.com/NVIDIA-Merlin/core.git to /tmp/pip-req-build-ktbk1lbp

Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/core.git /tmp/pip-req-build-ktbk1lbp

Resolved https://github.com/NVIDIA-Merlin/core.git to commit 64755badd4e5756601f66e7e568201aedb8a4144

Installing build dependencies: started

Installing build dependencies: finished with status 'done'

Getting requirements to build wheel: started

Getting requirements to build wheel: finished with status 'done'

Preparing metadata (pyproject.toml): started

Preparing metadata (pyproject.toml): finished with status 'done'

Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (1.3.5)

Requirement already satisfied: fsspec==2022.5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (2022.5.0)

Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (1.2.5)

Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (4.64.1)

Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (0.55.1)

Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (21.3)

Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (7.0.0)

Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (1.10.0)

Requirement already satisfied: distributed>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (2022.3.0)

Requirement already satisfied: dask>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (2022.3.0)

Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (3.19.5)

Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (1.2.0)

Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (0.4.3)

Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (0.12.0)

Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.2.0)

Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.2.0)

Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (5.4.1)

Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.4.0)

Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.0.4)

Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (8.1.3)

Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (3.1.2)

Requirement already satisfied: tornado>=6.0.3 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (6.2)

Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.7.0)

Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.0.0)

Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (5.8.0)

Requirement already satisfied: setuptools in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+7.g64755ba) (65.4.1)

Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+7.g64755ba) (0.38.1)

Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+7.g64755ba) (1.20.3)

Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core==0.8.0+7.g64755ba) (3.0.9)

Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+7.g64755ba) (2022.2.1)

Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+7.g64755ba) (2.8.2)

Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.8.0+7.g64755ba) (1.2.0)

Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.8.0+7.g64755ba) (1.52.0)

Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (0.2.1)

Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+7.g64755ba) (1.15.0)

Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.0.1)

Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (6.0.2)

Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (4.1.0)

Requirement already satisfied: MarkupSafe>=2.0 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from jinja2->distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.0.1)

Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (4.0.0)

Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (6.0.1)


[notice] A new release of pip available: 22.2.2 -> 22.3.1

[notice] To update, run: pip install --upgrade pip

py38-multi-gpu run-test: commands[1] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/nvtabular.git

Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com

Collecting git+https://github.com/NVIDIA-Merlin/nvtabular.git

Cloning https://github.com/NVIDIA-Merlin/nvtabular.git to /tmp/pip-req-build-245_5n_w

Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/nvtabular.git /tmp/pip-req-build-245_5n_w

Resolved https://github.com/NVIDIA-Merlin/nvtabular.git to commit ba4c14159a8e858c8998d4158a4376e65a8fa266

Installing build dependencies: started

Installing build dependencies: finished with status 'done'

Getting requirements to build wheel: started

Getting requirements to build wheel: finished with status 'done'

Preparing metadata (pyproject.toml): started

Preparing metadata (pyproject.toml): finished with status 'done'

Requirement already satisfied: merlin-core>=0.2.0 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from nvtabular==1.6.0+4.gba4c1415) (0.8.0+7.g64755ba)

Requirement already satisfied: merlin-dataloader>=0.0.2 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from nvtabular==1.6.0+4.gba4c1415) (0.0.2)

Requirement already satisfied: scipy in /usr/local/lib/python3.8/dist-packages (from nvtabular==1.6.0+4.gba4c1415) (1.8.1)

Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.3.5)

Requirement already satisfied: fsspec==2022.5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.5.0)

Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.5)

Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (4.64.1)

Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.55.1)

Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (21.3)

Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (7.0.0)

Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.10.0)

Requirement already satisfied: distributed>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.3.0)

Requirement already satisfied: dask>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.3.0)

Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (3.19.5)

Requirement already satisfied: numpy<1.25.0,>=1.17.3 in /var/jenkins_home/.local/lib/python3.8/site-packages (from scipy->nvtabular==1.6.0+4.gba4c1415) (1.20.3)

Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.0)

Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.4.3)

Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.12.0)

Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.2.0)

Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.0)

Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (5.4.1)

Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.4.0)

Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.0.4)

Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (8.1.3)

Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (3.1.2)

Requirement already satisfied: tornado>=6.0.3 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (6.2)

Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.7.0)

Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.0.0)

Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (5.8.0)

Requirement already satisfied: setuptools in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (65.4.1)

Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.38.1)

Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (3.0.9)

Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.2.1)

Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.8.2)

Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.0)

Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.52.0)

Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.2.1)

Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.15.0)

Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.0.1)

Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (6.0.2)

Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (4.1.0)

Requirement already satisfied: MarkupSafe>=2.0 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from jinja2->distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.0.1)

Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (4.0.0)

Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (6.0.1)


[notice] A new release of pip available: 22.2.2 -> 22.3.1

[notice] To update, run: pip install --upgrade pip

py38-multi-gpu run-test: commands[2] | horovodrun -np 2 sh examples/usecases/multi-gpu/hvd_wrapper.sh python -m pytest -m horovod -rxs tests/unit

[1,1]:�[1m============================= test session starts ==============================�[0m

[1,1]:platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0

[1,1]:cachedir: .tox/py38-multi-gpu/.pytest_cache

[1,1]:rootdir: /var/jenkins_home/workspace/merlin_models/models, configfile: pyproject.toml

[1,1]:plugins: anyio-3.5.0, xdist-3.0.2, cov-4.0.0

[1,1]:�[1mcollecting ... �[0m[1,0]:�[1m============================= test session starts ==============================�[0m

[1,0]:platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0

[1,0]:cachedir: .tox/py38-multi-gpu/.pytest_cache

[1,0]:rootdir: /var/jenkins_home/workspace/merlin_models/models, configfile: pyproject.toml

[1,0]:plugins: anyio-3.5.0, xdist-3.0.2, cov-4.0.0

[1,0]:�[1mcollecting ... �[0m[1,0]:�[1m

collecting 36 items                                                            �[0m[1,1]:�[1m

collecting 36 items                                                            �[0m[1,0]:�[1m

collecting 547 items                                                           �[0m[1,1]:�[1m

collecting 547 items                                                           �[0m[1,0]:�[1m

collected 875 items / 872 deselected / 3 selected                              �[0m

[1,0]:

[1,0]:tests/unit/tf/horovod/test_horovod.py [1,1]:�[1m

collected 875 items / 872 deselected / 3 selected                              �[0m

[1,1]:

[1,1]:tests/unit/tf/horovod/test_horovod.py [1,1]:�[32m.�[0m[1,0]:�[32m.�[0m[1,1]:�[32m.�[0m[1,0]:�[32m.�[0m[1,1]:�[32m.�[0m[1,1]:�[33m                                [100%]�[0m[1,1]:

[1,1]:

[1,1]:�[33m=============================== warnings summary ===============================�[0m

[1,1]:../../../../../usr/lib/python3/dist-packages/requests/init.py:89

[1,1]:  /usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!

[1,1]:    warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/flatbuffers/compat.py:19

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/flatbuffers/compat.py:19: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses

[1,1]:    import imp

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:36

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:36: DeprecationWarning: NEAREST is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.NEAREST or Dither.NONE instead.

[1,1]:    'nearest': pil_image.NEAREST,

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:37

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:37: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.

[1,1]:    'bilinear': pil_image.BILINEAR,

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:38

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:38: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.

[1,1]:    'bicubic': pil_image.BICUBIC,

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:39

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:39: DeprecationWarning: HAMMING is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.HAMMING instead.

[1,1]:    'hamming': pil_image.HAMMING,

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:40

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:40: DeprecationWarning: BOX is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BOX instead.

[1,1]:    'box': pil_image.BOX,

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:41

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:41: DeprecationWarning: LANCZOS is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.LANCZOS instead.

[1,1]:    'lanczos': pil_image.LANCZOS,

[1,1]:

[1,1]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_dlrm[True]

[1,1]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_dlrm[False]

[1,1]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,1]:  /var/jenkins_home/workspace/merlin_models/models/.tox/py38-multi-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.ITEM_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.ITEM: 'item'>, <Tags.ID: 'id'>].

[1,1]:    warnings.warn(

[1,1]:

[1,1]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,1]:  /var/jenkins_home/workspace/merlin_models/models/.tox/py38-multi-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.SESSION_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.SESSION: 'session'>, <Tags.ID: 'id'>].

[1,1]:    warnings.warn([1,1]:

[1,1]:

[1,1]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,1]:  /var/jenkins_home/workspace/merlin_models/models/.tox/py38-multi-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.USER_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.USER: 'user'>, <Tags.ID: 'id'>].

[1,1]:    warnings.warn(

[1,1]:

[1,1]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,1]:  /tmp/autograph_generated_filev18tgkw4.py:8: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead

[1,1]:    ag.converted_call(ag__.ld(warnings).warn, ("The 'warn' method is deprecated, use 'warning' instead", ag__.ld(DeprecationWarning), 2), None, fscope)

[1,1]:

[1,1]:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

[1,1]:�[33m=============== �[32m3 passed�[0m, �[33m�[1m872 deselected�[0m, �[33m�[1m14 warnings�[0m�[33m in 46.80s�[0m�[33m ================�[0m

[1,0]:�[32m.�[0m[1,0]:�[33m                                [100%]�[0m[1,0]:

[1,0]:

[1,0]:�[33m=============================== warnings summary ===============================�[0m

[1,0]:../../../../../usr/lib/python3/dist-packages/requests/init.py:89

[1,0]:  /usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!

[1,0]:    warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "[1,0]:

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/flatbuffers/compat.py:19

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/flatbuffers/compat.py:19: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses

[1,0]:    import imp[1,0]:

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:36

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:36: DeprecationWarning: NEAREST is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.NEAREST or Dither.NONE instead.

[1,0]:    'nearest': pil_image.NEAREST,[1,0]:

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:37

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:37: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.

[1,0]:    'bilinear': pil_image.BILINEAR,[1,0]:

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:38

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:38: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.

[1,0]:    'bicubic': pil_image.BICUBIC,

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:39

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:39: DeprecationWarning: HAMMING is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.HAMMING instead.

[1,0]:    'hamming': pil_image.HAMMING,

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:40

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:40: DeprecationWarning: BOX is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BOX instead.

[1,0]:    'box': pil_image.BOX,[1,0]:

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:41

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:41: DeprecationWarning: LANCZOS is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.LANCZOS instead.

[1,0]:    'lanczos': pil_image.LANCZOS,[1,0]:

[1,0]:

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_dlrm[True]

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_dlrm[False]

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,0]:  /var/jenkins_home/workspace/merlin_models/models/.tox/py38-multi-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.ITEM_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.ITEM: 'item'>, <Tags.ID: 'id'>].

[1,0]:    warnings.warn(

[1,0]:

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,0]:  /var/jenkins_home/workspace/merlin_models/models/.tox/py38-multi-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.SESSION_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.SESSION: 'session'>, <Tags.ID: 'id'>].

[1,0]:    warnings.warn(

[1,0]:

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,0]:  /var/jenkins_home/workspace/merlin_models/models/.tox/py38-multi-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.USER_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.USER: 'user'>, <Tags.ID: 'id'>].

[1,0]:    warnings.warn([1,0]:

[1,0]:

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,0]:  /tmp/autograph_generated_file4nvswzxi.py:8: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead

[1,0]:    ag.converted_call(ag__.ld(warnings).warn, ("The 'warn' method is deprecated, use 'warning' instead", ag__.ld(DeprecationWarning), 2), None, fscope)

[1,0]:

[1,0]:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

[1,0]:�[33m=============== �[32m3 passed�[0m, �[33m�[1m872 deselected�[0m, �[33m�[1m16 warnings�[0m�[33m in 51.41s�[0m�[33m ================�[0m

___________________________________ summary ____________________________________

py38-multi-gpu: commands succeeded

congratulations :)

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/models/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[merlin_models] $ /bin/bash /tmp/jenkins1341415938778320996.sh

@nvidia-merlin-bot
Copy link

Click to view CI Results
GitHub pull request #869 of commit 238611cdfec18950c42735a2888a9bfb6fd04708, no merge conflicts.
Running as SYSTEM
Setting status of 238611cdfec18950c42735a2888a9bfb6fd04708 to PENDING with url http://merlin-infra1.nvidia.com:8080/job/merlin_models/1782/ and message: 'Pending'
Using context: Jenkins
Building on master in workspace /var/jenkins_home/workspace/merlin_models
using credential nvidia-merlin-bot
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/models/ # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/models/
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/models/ +refs/pull/869/*:refs/remotes/origin/pr/869/* # timeout=10
 > git rev-parse 238611cdfec18950c42735a2888a9bfb6fd04708^{commit} # timeout=10
Checking out Revision 238611cdfec18950c42735a2888a9bfb6fd04708 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 238611cdfec18950c42735a2888a9bfb6fd04708 # timeout=10
Commit message: "Merge branch 'main' into topk-encoder"
 > git rev-list --no-walk 5173a96155c11355744a5aa287749ce59f05a41e # timeout=10
[merlin_models] $ /bin/bash /tmp/jenkins10086740318406938611.sh
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: testbook in /usr/local/lib/python3.8/dist-packages (0.4.2)
Requirement already satisfied: nbclient>=0.4.0 in /usr/local/lib/python3.8/dist-packages (from testbook) (0.6.8)
Requirement already satisfied: nbformat>=5.0.4 in /usr/local/lib/python3.8/dist-packages (from testbook) (5.5.0)
Requirement already satisfied: nest-asyncio in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (1.5.5)
Requirement already satisfied: jupyter-client>=6.1.5 in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (7.3.5)
Requirement already satisfied: traitlets>=5.2.2 in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (5.4.0)
Requirement already satisfied: jsonschema>=2.6 in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.16.0)
Requirement already satisfied: jupyter_core in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.11.1)
Requirement already satisfied: fastjsonschema in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (2.16.1)
Requirement already satisfied: attrs>=17.4.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (22.1.0)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (0.18.1)
Requirement already satisfied: pkgutil-resolve-name>=1.3.10 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (1.3.10)
Requirement already satisfied: importlib-resources>=1.4.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (5.9.0)
Requirement already satisfied: tornado>=6.2 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (6.2)
Requirement already satisfied: pyzmq>=23.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (24.0.0)
Requirement already satisfied: entrypoints in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (0.4)
Requirement already satisfied: python-dateutil>=2.8.2 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (2.8.2)
Requirement already satisfied: zipp>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from importlib-resources>=1.4.0->jsonschema>=2.6->nbformat>=5.0.4->testbook) (3.8.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.8.2->jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (1.15.0)
GLOB sdist-make: /var/jenkins_home/workspace/merlin_models/models/setup.py
py38-gpu inst-nodeps: /var/jenkins_home/workspace/merlin_models/models/.tox/.tmp/package/2/merlin-models-0.9.0+36.g238611cd.zip
WARNING: Discarding $PYTHONPATH from environment, to override specify PYTHONPATH in 'passenv' in your configuration.
py38-gpu installed: absl-py==1.2.0,aiohttp==3.8.1,aiosignal==1.2.0,alabaster==0.7.12,alembic==1.8.1,anyio==3.6.1,appdirs==1.4.4,argon2-cffi==21.3.0,argon2-cffi-bindings==21.2.0,astroid==2.5.6,asttokens==2.0.8,astunparse==1.6.3,asv==0.5.1,asvdb==0.4.2,async-timeout==4.0.2,attrs==22.1.0,autopage==0.5.1,awscli==1.27.4,Babel==2.10.3,backcall==0.2.0,beautifulsoup4==4.11.1,betterproto==1.2.5,black==20.8b1,bleach==5.0.1,bokeh==3.0.1,boto3==1.24.75,botocore==1.29.4,Brotli==1.0.9,build==0.9.0,cachetools==5.2.0,certifi==2019.11.28,cffi==1.15.1,chardet==3.0.4,charset-normalizer==2.1.1,check-manifest==0.48,clang==5.0,click==8.1.3,cliff==4.0.0,cloudpickle==2.2.0,cmaes==0.9.0,cmake==3.24.1.1,cmd2==2.4.2,colorama==0.4.4,colorlog==6.7.0,contourpy==1.0.5,coverage==6.5.0,cuda-python==11.7.1,cupy-cuda117==10.6.0,cycler==0.11.0,Cython==0.29.32,dask==2022.1.1,dbus-python==1.2.16,debugpy==1.6.3,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.5.1,distlib==0.3.6,distributed==2022.5.1,distro==1.7.0,dm-tree==0.1.6,docker-pycreds==0.4.0,docutils==0.16,emoji==1.7.0,entrypoints==0.4,execnet==1.9.0,executing==1.0.0,faiss==1.7.2,faiss-gpu==1.7.2,fastai==2.7.9,fastapi==0.85.0,fastavro==1.6.1,fastcore==1.5.27,fastdownload==0.0.7,fastjsonschema==2.16.1,fastprogress==1.0.3,fastrlock==0.8,feast==0.19.4,fiddle==0.2.2,filelock==3.8.0,flake8==5.0.4,flatbuffers==1.12,fonttools==4.37.3,frozenlist==1.3.1,fsspec==2022.5.0,gast==0.4.0,gevent==21.12.0,geventhttpclient==2.0.2,gitdb==4.0.9,GitPython==3.1.27,google==3.0.0,google-api-core==2.10.1,google-auth==2.11.1,google-auth-oauthlib==0.4.6,google-pasta==0.2.0,googleapis-common-protos==1.52.0,graphviz==0.20.1,greenlet==1.1.3,grpcio==1.41.0,grpcio-channelz==1.49.0,grpcio-reflection==1.48.1,grpclib==0.4.3,h11==0.13.0,h2==4.1.0,h5py==3.7.0,HeapDict==1.0.1,horovod==0.26.1,hpack==4.0.0,httptools==0.5.0,hugectr2onnx==0.0.0,huggingface-hub==0.9.1,hyperframe==6.0.1,idna==2.8,imagesize==1.4.1,implicit==0.6.1,importlib-metadata==4.12.0,importlib-resources==5.9.0,iniconfig==1.1.1,interrogate==1.5.0,ipykernel==6.15.3,ipython==8.5.0,ipython-genutils==0.2.0,ipywidgets==7.7.0,isort==5.10.1,jedi==0.18.1,Jinja2==3.1.2,jmespath==1.0.1,joblib==1.2.0,json5==0.9.10,jsonschema==4.16.0,jupyter==1.0.0,jupyter-cache==0.4.3,jupyter-console==6.4.4,jupyter-core==4.11.1,jupyter-server==1.18.1,jupyter-server-mathjax==0.2.5,jupyter-sphinx==0.3.2,jupyter_client==7.3.5,jupyterlab==3.4.7,jupyterlab-pygments==0.2.2,jupyterlab-widgets==1.1.0,jupyterlab_server==2.15.1,keras==2.9.0,Keras-Preprocessing==1.1.2,kiwisolver==1.4.4,lazy-object-proxy==1.8.0,libclang==14.0.6,libcst==0.4.7,lightfm==1.16,lightgbm==3.3.2,linkify-it-py==1.0.3,llvmlite==0.39.1,locket==1.0.0,lxml==4.9.1,Mako==1.2.3,Markdown==3.4.1,markdown-it-py==1.1.0,MarkupSafe==2.1.1,matplotlib==3.6.0,matplotlib-inline==0.1.6,mccabe==0.7.0,mdit-py-plugins==0.2.8,merlin-core==0.6.0+1.g5926fcf,merlin-dataloader==0.0.2,merlin-models==0.9.0+36.g238611cd,merlin-systems==0.5.0+4.g15074ad,mistune==2.0.4,mmh3==3.0.0,mpi4py==3.1.3,msgpack==1.0.4,multidict==6.0.2,mypy==0.982,mypy-extensions==0.4.3,myst-nb==0.13.2,myst-parser==0.15.2,natsort==8.1.0,nbclassic==0.4.3,nbclient==0.6.8,nbconvert==7.0.0,nbdime==3.1.1,nbformat==5.5.0,nest-asyncio==1.5.5,ninja==1.10.2.3,notebook==6.4.12,notebook-shim==0.1.0,numba==0.56.2,numpy==1.22.4,nvidia-pyindex==1.0.9,# Editable install with no version control (nvtabular==1.4.0+8.g95e12d347),-e /usr/local/lib/python3.8/dist-packages,nvtx==0.2.5,oauthlib==3.2.1,oldest-supported-numpy==2022.8.16,onnx==1.12.0,onnxruntime==1.11.1,opt-einsum==3.3.0,optuna==3.0.3,packaging==21.3,pandas==1.3.5,pandavro==1.5.2,pandocfilters==1.5.0,parso==0.8.3,partd==1.3.0,pathspec==0.10.1,pathtools==0.1.2,pbr==5.11.0,pep517==0.13.0,pexpect==4.8.0,pickleshare==0.7.5,Pillow==9.2.0,pkgutil_resolve_name==1.3.10,platformdirs==2.5.2,plotly==5.11.0,pluggy==1.0.0,prettytable==3.5.0,prometheus-client==0.14.1,promise==2.3,prompt-toolkit==3.0.31,proto-plus==1.19.6,protobuf==3.19.5,psutil==5.9.2,ptyprocess==0.7.0,pure-eval==0.2.2,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pybind11==2.10.0,pycodestyle==2.9.1,pycparser==2.21,pydantic==1.10.2,pydot==1.4.2,pyflakes==2.5.0,Pygments==2.13.0,PyGObject==3.36.0,pynvml==11.4.1,pyparsing==3.0.9,pyperclip==1.8.2,pyrsistent==0.18.1,pytest==7.1.3,pytest-cov==4.0.0,pytest-xdist==3.0.2,python-apt==2.0.0+ubuntu0.20.4.8,python-dateutil==2.8.2,python-dotenv==0.21.0,python-rapidjson==1.8,pytz==2022.2.1,PyYAML==5.4.1,pyzmq==24.0.0,qtconsole==5.4.0,QtPy==2.2.1,regex==2022.9.13,requests==2.22.0,requests-oauthlib==1.3.1,requests-unixsocket==0.2.0,rsa==4.7.2,s3fs==2022.2.0,s3transfer==0.6.0,sacremoses==0.0.53,scikit-build==0.15.0,scikit-learn==1.1.2,scipy==1.8.1,seedir==0.3.0,Send2Trash==1.8.0,sentry-sdk==1.9.8,setproctitle==1.3.2,setuptools-scm==7.0.5,shortuuid==1.0.9,six==1.15.0,sklearn==0.0,smmap==5.0.0,sniffio==1.3.0,snowballstemmer==2.2.0,sortedcontainers==2.4.0,soupsieve==2.3.2.post1,Sphinx==5.3.0,sphinx-multiversion==0.2.4,sphinx-togglebutton==0.3.1,sphinx_external_toc==0.3.0,sphinxcontrib-applehelp==1.0.2,sphinxcontrib-copydirs @ git+https://github.com/mikemckiernan/sphinxcontrib-copydirs.git@bd8c5d79b3f91cf5f1bb0d6995aeca3fe84b670e,sphinxcontrib-devhelp==1.0.2,sphinxcontrib-htmlhelp==2.0.0,sphinxcontrib-jsmath==1.0.1,sphinxcontrib-qthelp==1.0.3,sphinxcontrib-serializinghtml==1.1.5,SQLAlchemy==1.4.43,stack-data==0.5.0,starlette==0.20.4,stevedore==4.1.0,stringcase==1.2.0,supervisor==4.1.0,tabulate==0.8.10,tblib==1.7.0,tdqm==0.0.1,tenacity==8.0.1,tensorboard==2.9.1,tensorboard-data-server==0.6.1,tensorboard-plugin-wit==1.8.1,tensorflow==2.9.2,tensorflow-estimator==2.9.0,tensorflow-gpu==2.9.2,tensorflow-io-gcs-filesystem==0.27.0,tensorflow-metadata==1.10.0,tensorflow-ranking==0.5.1,tensorflow-serving-api==2.9.2,termcolor==2.0.1,terminado==0.15.0,testbook==0.4.2,threadpoolctl==3.1.0,tinycss2==1.1.1,tokenizers==0.10.3,toml==0.10.2,tomli==2.0.1,toolz==0.12.0,torch==1.12.1+cu113,torchmetrics==0.3.2,tornado==6.2,tox==3.26.0,tqdm==4.64.1,traitlets==5.4.0,transformers==4.12.0,transformers4rec==0.1.12+2.gbcc939255,treelite==2.3.0,treelite-runtime==2.3.0,tritonclient==2.25.0,typed-ast==1.5.4,typing-inspect==0.8.0,typing_extensions==4.3.0,uc-micro-py==1.0.1,urllib3==1.26.12,uvicorn==0.18.3,uvloop==0.17.0,versioneer==0.20,virtualenv==20.16.5,wandb==0.13.3,watchfiles==0.17.0,wcwidth==0.2.5,webencodings==0.5.1,websocket-client==1.4.1,websockets==10.3,Werkzeug==2.2.2,widgetsnbextension==3.6.0,wrapt==1.12.1,xgboost==1.6.2,xyzservices==2022.9.0,yarl==1.8.1,zict==2.2.0,zipp==3.8.1,zope.event==4.5.0,zope.interface==5.4.0
py38-gpu run-test-pre: PYTHONHASHSEED='454196642'
py38-gpu run-test: commands[0] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/core.git
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/NVIDIA-Merlin/core.git
  Cloning https://github.com/NVIDIA-Merlin/core.git to /tmp/pip-req-build-jl4bkz5d
  Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/core.git /tmp/pip-req-build-jl4bkz5d
  Resolved https://github.com/NVIDIA-Merlin/core.git to commit 64755badd4e5756601f66e7e568201aedb8a4144
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (3.19.5)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (1.10.0)
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (4.64.1)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (0.55.1)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (7.0.0)
Requirement already satisfied: fsspec==2022.5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (2022.5.0)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (1.2.5)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (21.3)
Requirement already satisfied: dask>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (2022.3.0)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (1.3.5)
Requirement already satisfied: distributed>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (2022.3.0)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (0.4.3)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (1.2.0)
Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (5.4.1)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (0.12.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.2.0)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.2.0)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.0.0)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.0.4)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.4.0)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.7.0)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (5.8.0)
Requirement already satisfied: tornado>=6.0.3 in ./.tox/py38-gpu/lib/python3.8/site-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (6.2)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (8.1.3)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (3.1.2)
Requirement already satisfied: setuptools in ./.tox/py38-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+7.g64755ba) (65.4.1)
Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/py38-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+7.g64755ba) (0.38.1)
Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+7.g64755ba) (1.20.3)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core==0.8.0+7.g64755ba) (3.0.9)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+7.g64755ba) (2.8.2)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+7.g64755ba) (2022.2.1)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.8.0+7.g64755ba) (1.52.0)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.8.0+7.g64755ba) (1.2.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (0.2.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+7.g64755ba) (1.15.0)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.0.1)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (6.0.2)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (4.1.0)
Requirement already satisfied: MarkupSafe>=2.0 in ./.tox/py38-gpu/lib/python3.8/site-packages (from jinja2->distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.0.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (4.0.0)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (6.0.1)

[notice] A new release of pip available: 22.2.2 -> 22.3.1

[notice] To update, run: pip install --upgrade pip

py38-gpu run-test: commands[1] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/nvtabular.git

Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com

Collecting git+https://github.com/NVIDIA-Merlin/nvtabular.git

Cloning https://github.com/NVIDIA-Merlin/nvtabular.git to /tmp/pip-req-build-87vh1ouv

Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/nvtabular.git /tmp/pip-req-build-87vh1ouv

Resolved https://github.com/NVIDIA-Merlin/nvtabular.git to commit ba4c14159a8e858c8998d4158a4376e65a8fa266

Installing build dependencies: started

Installing build dependencies: finished with status 'done'

Getting requirements to build wheel: started

Getting requirements to build wheel: finished with status 'done'

Preparing metadata (pyproject.toml): started

Preparing metadata (pyproject.toml): finished with status 'done'

Requirement already satisfied: merlin-dataloader>=0.0.2 in ./.tox/py38-gpu/lib/python3.8/site-packages (from nvtabular==1.6.0+4.gba4c1415) (0.0.2)

Requirement already satisfied: merlin-core>=0.2.0 in ./.tox/py38-gpu/lib/python3.8/site-packages (from nvtabular==1.6.0+4.gba4c1415) (0.8.0+7.g64755ba)

Requirement already satisfied: scipy in /usr/local/lib/python3.8/dist-packages (from nvtabular==1.6.0+4.gba4c1415) (1.8.1)

Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (3.19.5)

Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.10.0)

Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (4.64.1)

Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.55.1)

Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (7.0.0)

Requirement already satisfied: fsspec==2022.5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.5.0)

Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.5)

Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (21.3)

Requirement already satisfied: dask>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.3.0)

Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.3.5)

Requirement already satisfied: distributed>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.3.0)

Requirement already satisfied: numpy<1.25.0,>=1.17.3 in /var/jenkins_home/.local/lib/python3.8/site-packages (from scipy->nvtabular==1.6.0+4.gba4c1415) (1.20.3)

Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.4.3)

Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.0)

Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (5.4.1)

Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.12.0)

Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.2.0)

Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.0)

Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.0.0)

Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.0.4)

Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.4.0)

Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.7.0)

Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (5.8.0)

Requirement already satisfied: tornado>=6.0.3 in ./.tox/py38-gpu/lib/python3.8/site-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (6.2)

Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (8.1.3)

Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (3.1.2)

Requirement already satisfied: setuptools in ./.tox/py38-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (65.4.1)

Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/py38-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.38.1)

Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (3.0.9)

Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.8.2)

Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.2.1)

Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.52.0)

Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.0)

Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.2.1)

Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.15.0)

Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.0.1)

Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (6.0.2)

Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (4.1.0)

Requirement already satisfied: MarkupSafe>=2.0 in ./.tox/py38-gpu/lib/python3.8/site-packages (from jinja2->distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.0.1)

Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (4.0.0)

Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (6.0.1)


[notice] A new release of pip available: 22.2.2 -> 22.3.1

[notice] To update, run: pip install --upgrade pip

py38-gpu run-test: commands[2] | python -m pytest --cov-report term --cov merlin -rxs tests/unit

============================= test session starts ==============================

platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0

cachedir: .tox/py38-gpu/.pytest_cache

rootdir: /var/jenkins_home/workspace/merlin_models/models, configfile: pyproject.toml

plugins: anyio-3.5.0, xdist-3.0.2, cov-4.0.0

collected 875 items


tests/unit/config/test_schema.py ....                                    [  0%]

tests/unit/datasets/test_advertising.py .s                               [  0%]

tests/unit/datasets/test_ecommerce.py ..sss.s                            [  1%]

tests/unit/datasets/test_entertainment.py ....sss.                       [  2%]

tests/unit/datasets/test_social.py .                                     [  2%]

tests/unit/datasets/test_synthetic.py ......                             [  3%]

tests/unit/implicit/test_implicit.py .                                   [  3%]

tests/unit/lightfm/test_lightfm.py .                                     [  3%]

tests/unit/tf/test_core.py ......                                        [  4%]

tests/unit/tf/test_loader.py ................                            [  5%]

tests/unit/tf/test_public_api.py .                                       [  6%]

tests/unit/tf/blocks/test_cross.py ...........                           [  7%]

tests/unit/tf/blocks/test_dlrm.py ..........                             [  8%]

tests/unit/tf/blocks/test_interactions.py ...                            [  8%]

tests/unit/tf/blocks/test_mlp.py ....................................... [ 13%]

............................                                             [ 16%]

tests/unit/tf/blocks/test_optimizer.py s................................ [ 20%]

.....................                                                    [ 22%]

tests/unit/tf/blocks/retrieval/test_base.py .                            [ 22%]

tests/unit/tf/blocks/retrieval/test_matrix_factorization.py ..           [ 22%]

tests/unit/tf/blocks/retrieval/test_two_tower.py ............            [ 24%]

tests/unit/tf/blocks/sampling/test_cross_batch.py .                      [ 24%]

tests/unit/tf/blocks/sampling/test_in_batch.py .                         [ 24%]

tests/unit/tf/core/test_aggregation.py .........                         [ 25%]

tests/unit/tf/core/test_base.py ..                                       [ 25%]

tests/unit/tf/core/test_combinators.py s.....................            [ 28%]

tests/unit/tf/core/test_encoder.py ..                                    [ 28%]

tests/unit/tf/core/test_index.py ...                                     [ 28%]

tests/unit/tf/core/test_prediction.py ..                                 [ 29%]

tests/unit/tf/core/test_tabular.py ......                                [ 29%]

tests/unit/tf/examples/test_01_getting_started.py .                      [ 29%]

tests/unit/tf/examples/test_02_dataschema.py .                           [ 30%]

tests/unit/tf/examples/test_03_exploring_different_models.py .           [ 30%]

tests/unit/tf/examples/test_04_export_ranking_models.py .                [ 30%]

tests/unit/tf/examples/test_05_export_retrieval_model.py .               [ 30%]

tests/unit/tf/examples/test_06_advanced_own_architecture.py .            [ 30%]

tests/unit/tf/examples/test_07_train_traditional_models.py .             [ 30%]

tests/unit/tf/examples/test_usecase_accelerate_training_by_lazyadam.py . [ 30%]

[ 30%]

tests/unit/tf/examples/test_usecase_ecommerce_session_based.py .         [ 30%]

tests/unit/tf/examples/test_usecase_incremental_training_layer_freezing.py . [ 30%]

[ 30%]

tests/unit/tf/examples/test_usecase_pretrained_embeddings.py .           [ 31%]

tests/unit/tf/examples/test_usecase_retrieval_with_hpo.py .              [ 31%]

tests/unit/tf/horovod/test_horovod.py ...                                [ 31%]

tests/unit/tf/inputs/test_continuous.py ........                         [ 32%]

tests/unit/tf/inputs/test_embedding.py ................................. [ 36%]

........                                                                 [ 37%]

tests/unit/tf/inputs/test_tabular.py ..................                  [ 39%]

tests/unit/tf/layers/test_queue.py ..............                        [ 40%]

tests/unit/tf/losses/test_losses.py .......................              [ 43%]

tests/unit/tf/metrics/test_metrics_popularity.py .....                   [ 44%]

tests/unit/tf/metrics/test_metrics_topk.py .........................     [ 46%]

tests/unit/tf/models/test_base.py s........................              [ 49%]

tests/unit/tf/models/test_benchmark.py ..                                [ 49%]

tests/unit/tf/models/test_ranking.py ..................................  [ 53%]

tests/unit/tf/models/test_retrieval.py ................................. [ 57%]

...........................................                              [ 62%]

tests/unit/tf/outputs/test_base.py ......                                [ 63%]

tests/unit/tf/outputs/test_classification.py ......                      [ 63%]

tests/unit/tf/outputs/test_contrastive.py ..............                 [ 65%]

tests/unit/tf/outputs/test_regression.py ..                              [ 65%]

tests/unit/tf/outputs/test_sampling.py ....                              [ 66%]

tests/unit/tf/outputs/test_topk.py .                                     [ 66%]

tests/unit/tf/prediction_tasks/test_classification.py ..                 [ 66%]

tests/unit/tf/prediction_tasks/test_multi_task.py ................       [ 68%]

tests/unit/tf/prediction_tasks/test_next_item.py .....                   [ 68%]

tests/unit/tf/prediction_tasks/test_regression.py .....                  [ 69%]

tests/unit/tf/prediction_tasks/test_retrieval.py .                       [ 69%]

tests/unit/tf/prediction_tasks/test_sampling.py ......                   [ 70%]

tests/unit/tf/transformers/test_block.py .....................           [ 72%]

tests/unit/tf/transformers/test_transforms.py ..........                 [ 73%]

tests/unit/tf/transforms/test_bias.py ..                                 [ 74%]

tests/unit/tf/transforms/test_features.py s............................. [ 77%]

.......................s......                                           [ 80%]

tests/unit/tf/transforms/test_negative_sampling.py .........             [ 81%]

tests/unit/tf/transforms/test_noise.py .....                             [ 82%]

tests/unit/tf/transforms/test_sequence.py ....................           [ 84%]

tests/unit/tf/transforms/test_tensor.py ...                              [ 85%]

tests/unit/tf/utils/test_batch.py ....                                   [ 85%]

tests/unit/tf/utils/test_dataset.py ..                                   [ 85%]

tests/unit/tf/utils/test_tf_utils.py .....                               [ 86%]

tests/unit/torch/test_dataset.py .........                               [ 87%]

tests/unit/torch/test_public_api.py .                                    [ 87%]

tests/unit/torch/block/test_base.py ....                                 [ 88%]

tests/unit/torch/block/test_mlp.py .                                     [ 88%]

tests/unit/torch/features/test_continuous.py ..                          [ 88%]

tests/unit/torch/features/test_embedding.py ..............               [ 89%]

tests/unit/torch/features/test_tabular.py ....                           [ 90%]

tests/unit/torch/model/test_head.py ............                         [ 91%]

tests/unit/torch/model/test_model.py ..                                  [ 92%]

tests/unit/torch/tabular/test_aggregation.py ........                    [ 92%]

tests/unit/torch/tabular/test_tabular.py ...                             [ 93%]

tests/unit/torch/tabular/test_transformations.py .......                 [ 94%]

tests/unit/utils/test_schema_utils.py ................................   [ 97%]

tests/unit/xgb/test_xgboost.py ....................                      [100%]


=============================== warnings summary ===============================

../../../../../usr/lib/python3/dist-packages/requests/init.py:89

/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!

warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "


../../../.local/lib/python3.8/site-packages/flatbuffers/compat.py:19

/var/jenkins_home/.local/lib/python3.8/site-packages/flatbuffers/compat.py:19: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses

import imp


../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:36

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:36: DeprecationWarning: NEAREST is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.NEAREST or Dither.NONE instead.

'nearest': pil_image.NEAREST,


../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:37

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:37: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.

'bilinear': pil_image.BILINEAR,


../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:38

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:38: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.

'bicubic': pil_image.BICUBIC,


../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:39

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:39: DeprecationWarning: HAMMING is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.HAMMING instead.

'hamming': pil_image.HAMMING,


../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:40

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:40: DeprecationWarning: BOX is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BOX instead.

'box': pil_image.BOX,


../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:41

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:41: DeprecationWarning: LANCZOS is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.LANCZOS instead.

'lanczos': pil_image.LANCZOS,


tests/unit/datasets/test_advertising.py: 1 warning

tests/unit/datasets/test_ecommerce.py: 3 warnings

tests/unit/datasets/test_entertainment.py: 4 warnings

tests/unit/datasets/test_social.py: 1 warning

tests/unit/datasets/test_synthetic.py: 6 warnings

tests/unit/implicit/test_implicit.py: 1 warning

tests/unit/lightfm/test_lightfm.py: 1 warning

tests/unit/tf/test_core.py: 6 warnings

tests/unit/tf/test_loader.py: 1 warning

tests/unit/tf/blocks/test_cross.py: 5 warnings

tests/unit/tf/blocks/test_dlrm.py: 9 warnings

tests/unit/tf/blocks/test_interactions.py: 2 warnings

tests/unit/tf/blocks/test_mlp.py: 60 warnings

tests/unit/tf/blocks/test_optimizer.py: 30 warnings

tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings

tests/unit/tf/blocks/retrieval/test_two_tower.py: 11 warnings

tests/unit/tf/core/test_aggregation.py: 6 warnings

tests/unit/tf/core/test_base.py: 2 warnings

tests/unit/tf/core/test_combinators.py: 11 warnings

tests/unit/tf/core/test_encoder.py: 6 warnings

tests/unit/tf/core/test_index.py: 8 warnings

tests/unit/tf/core/test_prediction.py: 2 warnings

tests/unit/tf/horovod/test_horovod.py: 3 warnings

tests/unit/tf/inputs/test_continuous.py: 7 warnings

tests/unit/tf/inputs/test_embedding.py: 20 warnings

tests/unit/tf/inputs/test_tabular.py: 18 warnings

tests/unit/tf/models/test_base.py: 27 warnings

tests/unit/tf/models/test_benchmark.py: 2 warnings

tests/unit/tf/models/test_ranking.py: 38 warnings

tests/unit/tf/models/test_retrieval.py: 120 warnings

tests/unit/tf/outputs/test_base.py: 6 warnings

tests/unit/tf/outputs/test_classification.py: 6 warnings

tests/unit/tf/outputs/test_contrastive.py: 19 warnings

tests/unit/tf/outputs/test_regression.py: 2 warnings

tests/unit/tf/prediction_tasks/test_classification.py: 2 warnings

tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings

tests/unit/tf/prediction_tasks/test_regression.py: 5 warnings

tests/unit/tf/prediction_tasks/test_retrieval.py: 1 warning

tests/unit/tf/transformers/test_block.py: 15 warnings

tests/unit/tf/transforms/test_bias.py: 2 warnings

tests/unit/tf/transforms/test_features.py: 10 warnings

tests/unit/tf/transforms/test_negative_sampling.py: 10 warnings

tests/unit/tf/transforms/test_noise.py: 1 warning

tests/unit/tf/transforms/test_sequence.py: 15 warnings

tests/unit/tf/utils/test_batch.py: 9 warnings

tests/unit/tf/utils/test_dataset.py: 2 warnings

tests/unit/torch/block/test_base.py: 4 warnings

tests/unit/torch/block/test_mlp.py: 1 warning

tests/unit/torch/features/test_continuous.py: 1 warning

tests/unit/torch/features/test_embedding.py: 4 warnings

tests/unit/torch/features/test_tabular.py: 4 warnings

tests/unit/torch/model/test_head.py: 12 warnings

tests/unit/torch/model/test_model.py: 2 warnings

tests/unit/torch/tabular/test_aggregation.py: 6 warnings

tests/unit/torch/tabular/test_transformations.py: 3 warnings

tests/unit/xgb/test_xgboost.py: 18 warnings

/var/jenkins_home/workspace/merlin_models/models/.tox/py38-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.ITEM_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.ITEM: 'item'>, <Tags.ID: 'id'>].

warnings.warn(


tests/unit/datasets/test_ecommerce.py: 3 warnings

tests/unit/datasets/test_entertainment.py: 4 warnings

tests/unit/datasets/test_social.py: 1 warning

tests/unit/datasets/test_synthetic.py: 5 warnings

tests/unit/implicit/test_implicit.py: 1 warning

tests/unit/lightfm/test_lightfm.py: 1 warning

tests/unit/tf/test_core.py: 6 warnings

tests/unit/tf/test_loader.py: 1 warning

tests/unit/tf/blocks/test_cross.py: 5 warnings

tests/unit/tf/blocks/test_dlrm.py: 9 warnings

tests/unit/tf/blocks/test_interactions.py: 2 warnings

tests/unit/tf/blocks/test_mlp.py: 60 warnings

tests/unit/tf/blocks/test_optimizer.py: 30 warnings

tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings

tests/unit/tf/blocks/retrieval/test_two_tower.py: 11 warnings

tests/unit/tf/core/test_aggregation.py: 6 warnings

tests/unit/tf/core/test_base.py: 2 warnings

tests/unit/tf/core/test_combinators.py: 11 warnings

tests/unit/tf/core/test_encoder.py: 7 warnings

tests/unit/tf/core/test_index.py: 3 warnings

tests/unit/tf/core/test_prediction.py: 2 warnings

tests/unit/tf/horovod/test_horovod.py: 1 warning

tests/unit/tf/inputs/test_continuous.py: 7 warnings

tests/unit/tf/inputs/test_embedding.py: 20 warnings

tests/unit/tf/inputs/test_tabular.py: 18 warnings

tests/unit/tf/models/test_base.py: 27 warnings

tests/unit/tf/models/test_benchmark.py: 2 warnings

tests/unit/tf/models/test_ranking.py: 36 warnings

tests/unit/tf/models/test_retrieval.py: 86 warnings

tests/unit/tf/outputs/test_base.py: 6 warnings

tests/unit/tf/outputs/test_classification.py: 6 warnings

tests/unit/tf/outputs/test_contrastive.py: 19 warnings

tests/unit/tf/outputs/test_regression.py: 2 warnings

tests/unit/tf/prediction_tasks/test_classification.py: 2 warnings

tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings

tests/unit/tf/prediction_tasks/test_regression.py: 5 warnings

tests/unit/tf/transformers/test_block.py: 9 warnings

tests/unit/tf/transforms/test_features.py: 10 warnings

tests/unit/tf/transforms/test_negative_sampling.py: 10 warnings

tests/unit/tf/transforms/test_sequence.py: 15 warnings

tests/unit/tf/utils/test_batch.py: 7 warnings

tests/unit/tf/utils/test_dataset.py: 2 warnings

tests/unit/torch/block/test_base.py: 4 warnings

tests/unit/torch/block/test_mlp.py: 1 warning

tests/unit/torch/features/test_continuous.py: 1 warning

tests/unit/torch/features/test_embedding.py: 4 warnings

tests/unit/torch/features/test_tabular.py: 4 warnings

tests/unit/torch/model/test_head.py: 12 warnings

tests/unit/torch/model/test_model.py: 2 warnings

tests/unit/torch/tabular/test_aggregation.py: 6 warnings

tests/unit/torch/tabular/test_transformations.py: 2 warnings

tests/unit/xgb/test_xgboost.py: 17 warnings

/var/jenkins_home/workspace/merlin_models/models/.tox/py38-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.USER_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.USER: 'user'>, <Tags.ID: 'id'>].

warnings.warn(


tests/unit/datasets/test_ecommerce.py: 1 warning

tests/unit/datasets/test_entertainment.py: 1 warning

tests/unit/implicit/test_implicit.py: 1 warning

tests/unit/lightfm/test_lightfm.py: 1 warning

tests/unit/tf/test_loader.py: 1 warning

tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings

tests/unit/tf/blocks/retrieval/test_two_tower.py: 2 warnings

tests/unit/tf/core/test_combinators.py: 11 warnings

tests/unit/tf/core/test_encoder.py: 2 warnings

tests/unit/tf/core/test_prediction.py: 1 warning

tests/unit/tf/horovod/test_horovod.py: 1 warning

tests/unit/tf/inputs/test_continuous.py: 4 warnings

tests/unit/tf/inputs/test_embedding.py: 9 warnings

tests/unit/tf/inputs/test_tabular.py: 8 warnings

tests/unit/tf/models/test_ranking.py: 20 warnings

tests/unit/tf/models/test_retrieval.py: 10 warnings

tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings

tests/unit/tf/prediction_tasks/test_regression.py: 3 warnings

tests/unit/tf/transforms/test_negative_sampling.py: 9 warnings

tests/unit/xgb/test_xgboost.py: 12 warnings

/var/jenkins_home/workspace/merlin_models/models/.tox/py38-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.SESSION_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.SESSION: 'session'>, <Tags.ID: 'id'>].

warnings.warn(


tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export

tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export

tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export

tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export

tests/unit/tf/inputs/test_embedding.py::test_embedding_features_exporting_and_loading_pretrained_initializer

/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/inputs/embedding.py:968: DeprecationWarning: This function is deprecated in favor of cupy.from_dlpack

embeddings_cupy = cupy.fromDlpack(to_dlpack(tf.convert_to_tensor(embeddings)))


tests/unit/tf/blocks/retrieval/test_two_tower.py: 1 warning

tests/unit/tf/core/test_index.py: 4 warnings

tests/unit/tf/horovod/test_horovod.py: 3 warnings

tests/unit/tf/models/test_retrieval.py: 55 warnings

tests/unit/tf/prediction_tasks/test_next_item.py: 3 warnings

tests/unit/tf/utils/test_batch.py: 2 warnings

/tmp/autograph_generated_fileugqnckma.py:8: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead

ag.converted_call(ag__.ld(warnings).warn, ("The 'warn' method is deprecated, use 'warning' instead", ag__.ld(DeprecationWarning), 2), None, fscope)


tests/unit/tf/core/test_combinators.py::test_parallel_block_select_by_tags

/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/core/tabular.py:602: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3, and in 3.10 it will stop working

elif isinstance(self.feature_names, collections.Sequence):


tests/unit/tf/core/test_encoder.py: 1 warning

tests/unit/tf/core/test_index.py: 5 warnings

tests/unit/tf/models/test_retrieval.py: 30 warnings

tests/unit/tf/utils/test_batch.py: 4 warnings

tests/unit/tf/utils/test_dataset.py: 1 warning

/var/jenkins_home/workspace/merlin_models/models/merlin/models/utils/dataset.py:75: DeprecationWarning: unique_rows_by_features is deprecated and will be removed in a future version. Please use unique_by_tag instead.

warnings.warn(


tests/unit/tf/models/test_base.py::test_model_pre_post[True]

tests/unit/tf/models/test_base.py::test_model_pre_post[False]

tests/unit/tf/transforms/test_noise.py::test_stochastic_swap_noise[0.1]

tests/unit/tf/transforms/test_noise.py::test_stochastic_swap_noise[0.3]

tests/unit/tf/transforms/test_noise.py::test_stochastic_swap_noise[0.5]

tests/unit/tf/transforms/test_noise.py::test_stochastic_swap_noise[0.7]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/util/dispatch.py:1082: UserWarning: tf.keras.backend.random_binomial is deprecated, and will be removed in a future version.Please use tf.keras.backend.random_bernoulli instead.

return dispatch_target(*args, **kwargs)


tests/unit/tf/models/test_base.py::test_freeze_parallel_block[True]

tests/unit/tf/models/test_base.py::test_freeze_sequential_block

tests/unit/tf/models/test_base.py::test_freeze_unfreeze

tests/unit/tf/models/test_base.py::test_unfreeze_all_blocks

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/optimizers/optimizer_v2/gradient_descent.py:108: UserWarning: The lr argument is deprecated, use learning_rate instead.

super(SGD, self).init(name, **kwargs)


tests/unit/tf/models/test_base.py::test_retrieval_model_query

tests/unit/tf/models/test_base.py::test_retrieval_model_query

tests/unit/tf/models/test_retrieval.py::test_youtube_dnn_v2_export_embeddings

tests/unit/tf/models/test_retrieval.py::test_youtube_dnn_topk_evaluation[True]

tests/unit/tf/models/test_retrieval.py::test_youtube_dnn_topk_evaluation[False]

/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/utils/tf_utils.py:298: DeprecationWarning: This function is deprecated in favor of cupy.from_dlpack

tensor_cupy = cupy.fromDlpack(to_dlpack(tf.convert_to_tensor(tensor)))


tests/unit/tf/models/test_ranking.py::test_deepfm_model_only_categ_feats[False]

tests/unit/tf/models/test_ranking.py::test_deepfm_model_categ_and_continuous_feats[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_3/parallel_block_2/sequential_block_3/sequential_block_2/private__dense_1/dense_1/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_3/parallel_block_2/sequential_block_3/sequential_block_2/private__dense_1/dense_1/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_3/parallel_block_2/sequential_block_3/sequential_block_2/private__dense_1/dense_1/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/models/test_ranking.py::test_wide_deep_model[False]

tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_categorical_one_hot[False]

tests/unit/tf/models/test_ranking.py::test_wide_deep_model_hashed_cross[False]

tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[True]

tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]

/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/transforms/features.py:569: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag

warnings.warn(


tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/autograph/impl/api.py:371: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag

return py_builtins.overload_of(f)(*args)


tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_onehot_multihot_feature_interaction[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_feature_interaction_multi_optimizer[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_as_classfication_model[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/bert_block/prepare_transformer_inputs_1/RaggedToTensor/boolean_mask_1/GatherV2:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_1:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_as_classfication_model[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/bert_block/prepare_transformer_inputs_1/RaggedToTensor/boolean_mask_1/GatherV2:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_3:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape_1:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_causal_language_modeling[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/gpt2_block/prepare_transformer_inputs_5/RaggedToTensor/boolean_mask_1/GatherV2:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_1:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_causal_language_modeling[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/gpt2_block/prepare_transformer_inputs_5/RaggedToTensor/boolean_mask_1/GatherV2:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_3:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape_1:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/bert_block/prepare_transformer_inputs_1/RaggedToTensor/boolean_mask_1/GatherV2:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/bert_block/prepare_transformer_inputs_1/RaggedToTensor/boolean_mask/GatherV2:0", shape=(None, 48), dtype=float32), dense_shape=Tensor("gradient_tape/model/bert_block/prepare_transformer_inputs_1/RaggedToTensor/Shape:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/bert_block/replace_masked_embeddings/RaggedWhere/Reshape_3:0", shape=(None,), dtype=int64), values=Tensor("gradient_tape/model/bert_block/replace_masked_embeddings/RaggedWhere/Reshape_2:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/bert_block/replace_masked_embeddings/RaggedWhere/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/bert_block/replace_masked_embeddings/RaggedWhere/RaggedTile_2/Reshape_3:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_1:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/bert_block/replace_masked_embeddings/RaggedWhere/RaggedTile_2/Reshape_3:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_3:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape_1:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling_check_eval_masked[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/gpt2_block/prepare_transformer_inputs_5/RaggedToTensor/boolean_mask_1/GatherV2:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/gpt2_block/prepare_transformer_inputs_5/RaggedToTensor/boolean_mask/GatherV2:0", shape=(None, 48), dtype=float32), dense_shape=Tensor("gradient_tape/model/gpt2_block/prepare_transformer_inputs_5/RaggedToTensor/Shape:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling_check_eval_masked[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/gpt2_block/replace_masked_embeddings/RaggedWhere/Reshape_3:0", shape=(None,), dtype=int64), values=Tensor("gradient_tape/model/gpt2_block/replace_masked_embeddings/RaggedWhere/Reshape_2:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/gpt2_block/replace_masked_embeddings/RaggedWhere/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling_check_eval_masked[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/gpt2_block/replace_masked_embeddings/RaggedWhere/RaggedTile_2/Reshape_3:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_1:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling_check_eval_masked[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/gpt2_block/replace_masked_embeddings/RaggedWhere/RaggedTile_2/Reshape_3:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_3:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape_1:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/torch/block/test_mlp.py::test_mlp_block

/var/jenkins_home/workspace/merlin_models/models/tests/unit/torch/_conftest.py:151: UserWarning: Creating a tensor from a list of numpy.ndarrays is extremely slow. Please consider converting the list to a single numpy.ndarray with numpy.array() before converting to a tensor. (Triggered internally at  ../torch/csrc/utils/tensor_new.cpp:201.)

return {key: torch.tensor(value) for key, value in data.items()}


tests/unit/xgb/test_xgboost.py::test_without_dask_client

tests/unit/xgb/test_xgboost.py::TestXGBoost::test_music_regression

tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs0-DaskDeviceQuantileDMatrix]

tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs1-DaskDMatrix]

tests/unit/xgb/test_xgboost.py::TestEvals::test_multiple

tests/unit/xgb/test_xgboost.py::TestEvals::test_default

tests/unit/xgb/test_xgboost.py::TestEvals::test_train_and_valid

tests/unit/xgb/test_xgboost.py::TestEvals::test_invalid_data

/var/jenkins_home/workspace/merlin_models/models/merlin/models/xgb/init.py:344: UserWarning: Ignoring list columns as inputs to XGBoost model: ['item_genres', 'user_genres'].

warnings.warn(f"Ignoring list columns as inputs to XGBoost model: {list_column_names}.")


tests/unit/xgb/test_xgboost.py::TestXGBoost::test_unsupported_objective

/var/jenkins_home/workspace/merlin_models/models/.tox/py38-gpu/lib/python3.8/site-packages/tornado/ioloop.py:350: DeprecationWarning: make_current is deprecated; start the event loop first

self.make_current()


tests/unit/xgb/test_xgboost.py: 14 warnings

/usr/local/lib/python3.8/dist-packages/xgboost/dask.py:884: RuntimeWarning: coroutine 'Client._wait_for_workers' was never awaited

client.wait_for_workers(n_workers)

Enable tracemalloc to get traceback where the object was allocated.

See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info.


tests/unit/xgb/test_xgboost.py: 11 warnings

/usr/local/lib/python3.8/dist-packages/cudf/core/dataframe.py:1183: DeprecationWarning: The default dtype for empty Series will be 'object' instead of 'float64' in a future version. Specify a dtype explicitly to silence this warning.

mask = pd.Series(mask)


-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html


---------- coverage: platform linux, python 3.8.10-final-0 -----------

Name                                                                 Stmts   Miss  Cover


merlin/datasets/init.py                                              2      0   100%

merlin/datasets/advertising/init.py                                  2      0   100%

merlin/datasets/advertising/criteo/init.py                           0      0   100%

merlin/datasets/advertising/criteo/dataset.py                           79     49    38%

merlin/datasets/advertising/criteo/transformed/init.py               0      0   100%

merlin/datasets/ecommerce/init.py                                    4      0   100%

merlin/datasets/ecommerce/aliccp/init.py                             0      0   100%

merlin/datasets/ecommerce/aliccp/dataset.py                            141     87    38%

merlin/datasets/ecommerce/aliccp/raw/init.py                         0      0   100%

merlin/datasets/ecommerce/aliccp/transformed/init.py                 0      0   100%

merlin/datasets/ecommerce/booking/init.py                            0      0   100%

merlin/datasets/ecommerce/booking/dataset.py                           107     80    25%

merlin/datasets/ecommerce/booking/transformed/init.py                0      0   100%

merlin/datasets/ecommerce/dressipi/init.py                           0      0   100%

merlin/datasets/ecommerce/dressipi/dataset.py                           45     37    18%

merlin/datasets/ecommerce/dressipi/preprocessed/init.py              0      0   100%

merlin/datasets/ecommerce/large/init.py                              0      0   100%

merlin/datasets/ecommerce/small/init.py                              0      0   100%

merlin/datasets/ecommerce/transactions/init.py                       0      0   100%

merlin/datasets/entertainment/init.py                                2      0   100%

merlin/datasets/entertainment/movielens/1m-raw/init.py               0      0   100%

merlin/datasets/entertainment/movielens/1m-raw/ratings/init.py       0      0   100%

merlin/datasets/entertainment/movielens/1m/init.py                   0      0   100%

merlin/datasets/entertainment/movielens/25m/init.py                  0      0   100%

merlin/datasets/entertainment/movielens/100k/init.py                 0      0   100%

merlin/datasets/entertainment/movielens/init.py                      0      0   100%

merlin/datasets/entertainment/movielens/dataset.py                     152    122    20%

merlin/datasets/entertainment/music_streaming/init.py                0      0   100%

merlin/datasets/social/init.py                                       0      0   100%

merlin/datasets/synthetic.py                                           147     14    90%

merlin/datasets/testing/init.py                                      0      0   100%

merlin/datasets/testing/sequence_testing/init.py                     0      0   100%

merlin/models/init.py                                                2      0   100%

merlin/models/_version.py                                              354    205    42%

merlin/models/api.py                                                    14      5    64%

merlin/models/config/init.py                                         0      0   100%

merlin/models/config/schema.py                                          62      0   100%

merlin/models/implicit/init.py                                      27      4    85%

merlin/models/io.py                                                     15      0   100%

merlin/models/lightfm/init.py                                       23      0   100%

merlin/models/loader/init.py                                         0      0   100%

merlin/models/loader/backend.py                                        379     41    89%

merlin/models/loader/dataframe_iter.py                                  21     17    19%

merlin/models/loader/tf_utils.py                                        57     27    53%

merlin/models/loader/utils.py                                           40     15    62%

merlin/models/tf/init.py                                            70      0   100%

merlin/models/tf/blocks/init.py                                      0      0   100%

merlin/models/tf/blocks/cross.py                                        44      0   100%

merlin/models/tf/blocks/dlrm.py                                         49      2    96%

merlin/models/tf/blocks/experts.py                                      99     17    83%

merlin/models/tf/blocks/interaction.py                                 108     40    63%

merlin/models/tf/blocks/mlp.py                                         117      7    94%

merlin/models/tf/blocks/optimizer.py                                   173     12    93%

merlin/models/tf/blocks/retrieval/init.py                            0      0   100%

merlin/models/tf/blocks/retrieval/base.py                              169     62    63%

merlin/models/tf/blocks/retrieval/matrix_factorization.py               35      1    97%

merlin/models/tf/blocks/retrieval/two_tower.py                          30      0   100%

merlin/models/tf/blocks/sampling/init.py                             0      0   100%

merlin/models/tf/blocks/sampling/base.py                                29      2    93%

merlin/models/tf/blocks/sampling/cross_batch.py                         46      2    96%

merlin/models/tf/blocks/sampling/in_batch.py                            35      0   100%

merlin/models/tf/blocks/sampling/queue.py                              115     12    90%

merlin/models/tf/core/init.py                                        0      0   100%

merlin/models/tf/core/aggregation.py                                   241     45    81%

merlin/models/tf/core/base.py                                          244     50    80%

merlin/models/tf/core/combinators.py                                   426     53    88%

merlin/models/tf/core/encoder.py                                       175     28    84%

merlin/models/tf/core/index.py                                         104     16    85%

merlin/models/tf/core/prediction.py                                     50      1    98%

merlin/models/tf/core/tabular.py                                       280     29    90%

merlin/models/tf/distributed/init.py                                 0      0   100%

merlin/models/tf/distributed/backend.py                                  9      2    78%

merlin/models/tf/inputs/init.py                                      0      0   100%

merlin/models/tf/inputs/base.py                                         60     10    83%

merlin/models/tf/inputs/continuous.py                                   39      3    92%

merlin/models/tf/inputs/embedding.py                                   458     31    93%

merlin/models/tf/loader.py                                             268     94    65%

merlin/models/tf/losses/init.py                                      4      0   100%

merlin/models/tf/losses/base.py                                          9      0   100%

merlin/models/tf/losses/listwise.py                                     13      0   100%

merlin/models/tf/losses/pairwise.py                                    115      1    99%

merlin/models/tf/metrics/init.py                                     2      0   100%

merlin/models/tf/metrics/evaluation.py                                 105     48    54%

merlin/models/tf/metrics/topk.py                                       198     48    76%

merlin/models/tf/models/init.py                                      0      0   100%

merlin/models/tf/models/base.py                                        753    102    86%

merlin/models/tf/models/benchmark.py                                    16      0   100%

merlin/models/tf/models/ranking.py                                      67      3    96%

merlin/models/tf/models/retrieval.py                                    78      4    95%

merlin/models/tf/models/utils.py                                        10      1    90%

merlin/models/tf/outputs/init.py                                     0      0   100%

merlin/models/tf/outputs/base.py                                       122     17    86%

merlin/models/tf/outputs/classification.py                              91      1    99%

merlin/models/tf/outputs/contrastive.py                                147     10    93%

merlin/models/tf/outputs/regression.py                                   9      0   100%

merlin/models/tf/outputs/sampling/init.py                            0      0   100%

merlin/models/tf/outputs/sampling/base.py                               78     21    73%

merlin/models/tf/outputs/sampling/in_batch.py                           37      1    97%

merlin/models/tf/outputs/sampling/popularity.py                         27      1    96%

merlin/models/tf/outputs/topk.py                                        98      6    94%

merlin/models/tf/prediction_tasks/init.py                            0      0   100%

merlin/models/tf/prediction_tasks/base.py                              207     37    82%

merlin/models/tf/prediction_tasks/classification.py                     68     17    75%

merlin/models/tf/prediction_tasks/multi.py                               7      0   100%

merlin/models/tf/prediction_tasks/next_item.py                          59      6    90%

merlin/models/tf/prediction_tasks/regression.py                         35      2    94%

merlin/models/tf/prediction_tasks/retrieval.py                          73      3    96%

merlin/models/tf/transformers/init.py                                0      0   100%

merlin/models/tf/transformers/block.py                                 101      2    98%

merlin/models/tf/transformers/transforms.py                             63      0   100%

merlin/models/tf/transforms/init.py                                  0      0   100%

merlin/models/tf/transforms/bias.py                                    111      9    92%

merlin/models/tf/transforms/features.py                                435     36    92%

merlin/models/tf/transforms/negative_sampling.py                        77      3    96%

merlin/models/tf/transforms/noise.py                                    43      1    98%

merlin/models/tf/transforms/regularization.py                           17      1    94%

merlin/models/tf/transforms/sequence.py                                282     42    85%

merlin/models/tf/transforms/tensor.py                                  158     13    92%

merlin/models/tf/typing.py                                               7      0   100%

merlin/models/tf/utils/init.py                                       0      0   100%

merlin/models/tf/utils/batch_utils.py                                   85      4    95%

merlin/models/tf/utils/repr_utils.py                                    69      4    94%

merlin/models/tf/utils/search_utils.py                                  34     22    35%

merlin/models/tf/utils/testing_utils.py                                206     36    83%

merlin/models/tf/utils/tf_utils.py                                     209     42    80%

merlin/models/torch/init.py                                         12      0   100%

merlin/models/torch/block/init.py                                    0      0   100%

merlin/models/torch/block/base.py                                      167     32    81%

merlin/models/torch/block/mlp.py                                        38      5    87%

merlin/models/torch/dataset.py                                          68      5    93%

merlin/models/torch/features/init.py                                 0      0   100%

merlin/models/torch/features/base.py                                     4      0   100%

merlin/models/torch/features/continuous.py                              22      0   100%

merlin/models/torch/features/embedding.py                              165     12    93%

merlin/models/torch/features/tabular.py                                 65      8    88%

merlin/models/torch/losses.py                                           28     28     0%

merlin/models/torch/model/init.py                                    0      0   100%

merlin/models/torch/model/base.py                                      286     65    77%

merlin/models/torch/model/prediction_task.py                            24      0   100%

merlin/models/torch/tabular/init.py                                  0      0   100%

merlin/models/torch/tabular/aggregation.py                              75      0   100%

merlin/models/torch/tabular/base.py                                    247     39    84%

merlin/models/torch/tabular/transformations.py                          67      3    96%

merlin/models/torch/typing.py                                            6      0   100%

merlin/models/torch/utils/init.py                                    0      0   100%

merlin/models/torch/utils/data_utils.py                                117    117     0%

merlin/models/torch/utils/examples_utils.py                             39     39     0%

merlin/models/torch/utils/torch_utils.py                                80     22    72%

merlin/models/utils/init.py                                          0      0   100%

merlin/models/utils/constants.py                                         3      0   100%

merlin/models/utils/dataset.py                                          38      4    89%

merlin/models/utils/dependencies.py                                     26     19    27%

merlin/models/utils/doc_utils.py                                        10      0   100%

merlin/models/utils/example_utils.py                                    31      2    94%

merlin/models/utils/misc_utils.py                                      118     90    24%

merlin/models/utils/nvt_utils.py                                        27     24    11%

merlin/models/utils/registry.py                                        101     29    71%

merlin/models/utils/schema_utils.py                                     90     19    79%

merlin/models/xgb/init.py                                          124      4    97%


TOTAL                                                                11551   2332    80%


=========================== short test summary info ============================

SKIPPED [1] tests/unit/datasets/test_advertising.py:20: No data-dir available, pass it through env variable $INPUT_DATA_DIR

SKIPPED [1] tests/unit/datasets/test_ecommerce.py:64: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP

SKIPPED [1] tests/unit/datasets/test_ecommerce.py:80: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP

SKIPPED [1] tests/unit/datasets/test_ecommerce.py:94: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP

SKIPPED [1] tests/unit/datasets/test_ecommerce.py:115: No data-dir available, pass it through env variable $INPUT_DATA_DIR

SKIPPED [3] tests/unit/datasets/test_entertainment.py:44: No data-dir available, pass it through env variable $INPUT_DATA_DIR

SKIPPED [5] ../../../.local/lib/python3.8/site-packages/tensorflow/python/framework/test_util.py:2746: Not a test.

========= 862 passed, 13 skipped, 1431 warnings in 1688.51s (0:28:08) ==========

___________________________________ summary ____________________________________

py38-gpu: commands succeeded

congratulations :)

GLOB sdist-make: /var/jenkins_home/workspace/merlin_models/models/setup.py

py38-multi-gpu inst-nodeps: /var/jenkins_home/workspace/merlin_models/models/.tox/.tmp/package/2/merlin-models-0.9.0+36.g238611cd.zip

WARNING: Discarding $PYTHONPATH from environment, to override specify PYTHONPATH in 'passenv' in your configuration.

py38-multi-gpu installed: absl-py==1.2.0,aiohttp==3.8.1,aiosignal==1.2.0,alabaster==0.7.12,alembic==1.8.1,anyio==3.6.1,appdirs==1.4.4,argon2-cffi==21.3.0,argon2-cffi-bindings==21.2.0,astroid==2.5.6,asttokens==2.0.8,astunparse==1.6.3,asv==0.5.1,asvdb==0.4.2,async-timeout==4.0.2,attrs==22.1.0,autopage==0.5.1,awscli==1.27.4,Babel==2.10.3,backcall==0.2.0,beautifulsoup4==4.11.1,betterproto==1.2.5,black==20.8b1,bleach==5.0.1,bokeh==3.0.1,boto3==1.24.75,botocore==1.29.4,Brotli==1.0.9,build==0.9.0,cachetools==5.2.0,certifi==2019.11.28,cffi==1.15.1,chardet==3.0.4,charset-normalizer==2.1.1,check-manifest==0.48,clang==5.0,click==8.1.3,cliff==4.0.0,cloudpickle==2.2.0,cmaes==0.9.0,cmake==3.24.1.1,cmd2==2.4.2,colorama==0.4.4,colorlog==6.7.0,contourpy==1.0.5,coverage==6.5.0,cuda-python==11.7.1,cupy-cuda117==10.6.0,cycler==0.11.0,Cython==0.29.32,dask==2022.1.1,dbus-python==1.2.16,debugpy==1.6.3,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.5.1,distlib==0.3.6,distributed==2022.5.1,distro==1.7.0,dm-tree==0.1.6,docker-pycreds==0.4.0,docutils==0.16,emoji==1.7.0,entrypoints==0.4,execnet==1.9.0,executing==1.0.0,faiss==1.7.2,faiss-gpu==1.7.2,fastai==2.7.9,fastapi==0.85.0,fastavro==1.6.1,fastcore==1.5.27,fastdownload==0.0.7,fastjsonschema==2.16.1,fastprogress==1.0.3,fastrlock==0.8,feast==0.19.4,fiddle==0.2.2,filelock==3.8.0,flake8==5.0.4,flatbuffers==1.12,fonttools==4.37.3,frozenlist==1.3.1,fsspec==2022.5.0,gast==0.4.0,gevent==21.12.0,geventhttpclient==2.0.2,gitdb==4.0.9,GitPython==3.1.27,google==3.0.0,google-api-core==2.10.1,google-auth==2.11.1,google-auth-oauthlib==0.4.6,google-pasta==0.2.0,googleapis-common-protos==1.52.0,graphviz==0.20.1,greenlet==1.1.3,grpcio==1.41.0,grpcio-channelz==1.49.0,grpcio-reflection==1.48.1,grpclib==0.4.3,h11==0.13.0,h2==4.1.0,h5py==3.7.0,HeapDict==1.0.1,horovod==0.26.1,hpack==4.0.0,httptools==0.5.0,hugectr2onnx==0.0.0,huggingface-hub==0.9.1,hyperframe==6.0.1,idna==2.8,imagesize==1.4.1,implicit==0.6.1,importlib-metadata==4.12.0,importlib-resources==5.9.0,iniconfig==1.1.1,interrogate==1.5.0,ipykernel==6.15.3,ipython==8.5.0,ipython-genutils==0.2.0,ipywidgets==7.7.0,isort==5.10.1,jedi==0.18.1,Jinja2==3.1.2,jmespath==1.0.1,joblib==1.2.0,json5==0.9.10,jsonschema==4.16.0,jupyter==1.0.0,jupyter-cache==0.4.3,jupyter-console==6.4.4,jupyter-core==4.11.1,jupyter-server==1.18.1,jupyter-server-mathjax==0.2.5,jupyter-sphinx==0.3.2,jupyter_client==7.3.5,jupyterlab==3.4.7,jupyterlab-pygments==0.2.2,jupyterlab-widgets==1.1.0,jupyterlab_server==2.15.1,keras==2.9.0,Keras-Preprocessing==1.1.2,kiwisolver==1.4.4,lazy-object-proxy==1.8.0,libclang==14.0.6,libcst==0.4.7,lightfm==1.16,lightgbm==3.3.2,linkify-it-py==1.0.3,llvmlite==0.39.1,locket==1.0.0,lxml==4.9.1,Mako==1.2.3,Markdown==3.4.1,markdown-it-py==1.1.0,MarkupSafe==2.1.1,matplotlib==3.6.0,matplotlib-inline==0.1.6,mccabe==0.7.0,mdit-py-plugins==0.2.8,merlin-core==0.6.0+1.g5926fcf,merlin-dataloader==0.0.2,merlin-models==0.9.0+36.g238611cd,merlin-systems==0.5.0+4.g15074ad,mistune==2.0.4,mmh3==3.0.0,mpi4py==3.1.3,msgpack==1.0.4,multidict==6.0.2,mypy==0.982,mypy-extensions==0.4.3,myst-nb==0.13.2,myst-parser==0.15.2,natsort==8.1.0,nbclassic==0.4.3,nbclient==0.6.8,nbconvert==7.0.0,nbdime==3.1.1,nbformat==5.5.0,nest-asyncio==1.5.5,ninja==1.10.2.3,notebook==6.4.12,notebook-shim==0.1.0,numba==0.56.2,numpy==1.22.4,nvidia-pyindex==1.0.9,# Editable install with no version control (nvtabular==1.4.0+8.g95e12d347),-e /usr/local/lib/python3.8/dist-packages,nvtx==0.2.5,oauthlib==3.2.1,oldest-supported-numpy==2022.8.16,onnx==1.12.0,onnxruntime==1.11.1,opt-einsum==3.3.0,optuna==3.0.3,packaging==21.3,pandas==1.3.5,pandavro==1.5.2,pandocfilters==1.5.0,parso==0.8.3,partd==1.3.0,pathspec==0.10.1,pathtools==0.1.2,pbr==5.11.0,pep517==0.13.0,pexpect==4.8.0,pickleshare==0.7.5,Pillow==9.2.0,pkgutil_resolve_name==1.3.10,platformdirs==2.5.2,plotly==5.11.0,pluggy==1.0.0,prettytable==3.5.0,prometheus-client==0.14.1,promise==2.3,prompt-toolkit==3.0.31,proto-plus==1.19.6,protobuf==3.19.5,psutil==5.9.2,ptyprocess==0.7.0,pure-eval==0.2.2,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pybind11==2.10.0,pycodestyle==2.9.1,pycparser==2.21,pydantic==1.10.2,pydot==1.4.2,pyflakes==2.5.0,Pygments==2.13.0,PyGObject==3.36.0,pynvml==11.4.1,pyparsing==3.0.9,pyperclip==1.8.2,pyrsistent==0.18.1,pytest==7.1.3,pytest-cov==4.0.0,pytest-xdist==3.0.2,python-apt==2.0.0+ubuntu0.20.4.8,python-dateutil==2.8.2,python-dotenv==0.21.0,python-rapidjson==1.8,pytz==2022.2.1,PyYAML==5.4.1,pyzmq==24.0.0,qtconsole==5.4.0,QtPy==2.2.1,regex==2022.9.13,requests==2.22.0,requests-oauthlib==1.3.1,requests-unixsocket==0.2.0,rsa==4.7.2,s3fs==2022.2.0,s3transfer==0.6.0,sacremoses==0.0.53,scikit-build==0.15.0,scikit-learn==1.1.2,scipy==1.8.1,seedir==0.3.0,Send2Trash==1.8.0,sentry-sdk==1.9.8,setproctitle==1.3.2,setuptools-scm==7.0.5,shortuuid==1.0.9,six==1.15.0,sklearn==0.0,smmap==5.0.0,sniffio==1.3.0,snowballstemmer==2.2.0,sortedcontainers==2.4.0,soupsieve==2.3.2.post1,Sphinx==5.3.0,sphinx-multiversion==0.2.4,sphinx-togglebutton==0.3.1,sphinx_external_toc==0.3.0,sphinxcontrib-applehelp==1.0.2,sphinxcontrib-copydirs @ git+https://github.com/mikemckiernan/sphinxcontrib-copydirs.git@bd8c5d79b3f91cf5f1bb0d6995aeca3fe84b670e,sphinxcontrib-devhelp==1.0.2,sphinxcontrib-htmlhelp==2.0.0,sphinxcontrib-jsmath==1.0.1,sphinxcontrib-qthelp==1.0.3,sphinxcontrib-serializinghtml==1.1.5,SQLAlchemy==1.4.43,stack-data==0.5.0,starlette==0.20.4,stevedore==4.1.0,stringcase==1.2.0,supervisor==4.1.0,tabulate==0.8.10,tblib==1.7.0,tdqm==0.0.1,tenacity==8.0.1,tensorboard==2.9.1,tensorboard-data-server==0.6.1,tensorboard-plugin-wit==1.8.1,tensorflow==2.9.2,tensorflow-estimator==2.9.0,tensorflow-gpu==2.9.2,tensorflow-io-gcs-filesystem==0.27.0,tensorflow-metadata==1.10.0,tensorflow-ranking==0.5.1,tensorflow-serving-api==2.9.2,termcolor==2.0.1,terminado==0.15.0,testbook==0.4.2,threadpoolctl==3.1.0,tinycss2==1.1.1,tokenizers==0.10.3,toml==0.10.2,tomli==2.0.1,toolz==0.12.0,torch==1.12.1+cu113,torchmetrics==0.3.2,tornado==6.2,tox==3.26.0,tqdm==4.64.1,traitlets==5.4.0,transformers==4.12.0,transformers4rec==0.1.12+2.gbcc939255,treelite==2.3.0,treelite-runtime==2.3.0,tritonclient==2.25.0,typed-ast==1.5.4,typing-inspect==0.8.0,typing_extensions==4.3.0,uc-micro-py==1.0.1,urllib3==1.26.12,uvicorn==0.18.3,uvloop==0.17.0,versioneer==0.20,virtualenv==20.16.5,wandb==0.13.3,watchfiles==0.17.0,wcwidth==0.2.5,webencodings==0.5.1,websocket-client==1.4.1,websockets==10.3,Werkzeug==2.2.2,widgetsnbextension==3.6.0,wrapt==1.12.1,xgboost==1.6.2,xyzservices==2022.9.0,yarl==1.8.1,zict==2.2.0,zipp==3.8.1,zope.event==4.5.0,zope.interface==5.4.0

py38-multi-gpu run-test-pre: PYTHONHASHSEED='3925113090'

py38-multi-gpu run-test: commands[0] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/core.git

Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com

Collecting git+https://github.com/NVIDIA-Merlin/core.git

Cloning https://github.com/NVIDIA-Merlin/core.git to /tmp/pip-req-build-94d2vqy9

Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/core.git /tmp/pip-req-build-94d2vqy9

Resolved https://github.com/NVIDIA-Merlin/core.git to commit 64755badd4e5756601f66e7e568201aedb8a4144

Installing build dependencies: started

Installing build dependencies: finished with status 'done'

Getting requirements to build wheel: started

Getting requirements to build wheel: finished with status 'done'

Preparing metadata (pyproject.toml): started

Preparing metadata (pyproject.toml): finished with status 'done'

Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (21.3)

Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (3.19.5)

Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (4.64.1)

Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (0.55.1)

Requirement already satisfied: distributed>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (2022.3.0)

Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (1.2.5)

Requirement already satisfied: dask>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (2022.3.0)

Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (7.0.0)

Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (1.10.0)

Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (1.3.5)

Requirement already satisfied: fsspec==2022.5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (2022.5.0)

Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (0.4.3)

Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (1.2.0)

Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (5.4.1)

Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.2.0)

Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.2.0)

Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (0.12.0)

Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (8.1.3)

Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (3.1.2)

Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.0.4)

Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.4.0)

Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.0.0)

Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (5.8.0)

Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.7.0)

Requirement already satisfied: tornado>=6.0.3 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (6.2)

Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+7.g64755ba) (0.38.1)

Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+7.g64755ba) (1.20.3)

Requirement already satisfied: setuptools in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+7.g64755ba) (65.4.1)

Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core==0.8.0+7.g64755ba) (3.0.9)

Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+7.g64755ba) (2022.2.1)

Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+7.g64755ba) (2.8.2)

Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.8.0+7.g64755ba) (1.52.0)

Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.8.0+7.g64755ba) (1.2.0)

Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (0.2.1)

Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+7.g64755ba) (1.15.0)

Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.0.1)

Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (6.0.2)

Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (4.1.0)

Requirement already satisfied: MarkupSafe>=2.0 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from jinja2->distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.0.1)

Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (4.0.0)

Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (6.0.1)


[notice] A new release of pip available: 22.2.2 -> 22.3.1

[notice] To update, run: pip install --upgrade pip

py38-multi-gpu run-test: commands[1] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/nvtabular.git

Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com

Collecting git+https://github.com/NVIDIA-Merlin/nvtabular.git

Cloning https://github.com/NVIDIA-Merlin/nvtabular.git to /tmp/pip-req-build-x5zi8484

Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/nvtabular.git /tmp/pip-req-build-x5zi8484

Resolved https://github.com/NVIDIA-Merlin/nvtabular.git to commit ba4c14159a8e858c8998d4158a4376e65a8fa266

Installing build dependencies: started

Installing build dependencies: finished with status 'done'

Getting requirements to build wheel: started

Getting requirements to build wheel: finished with status 'done'

Preparing metadata (pyproject.toml): started

Preparing metadata (pyproject.toml): finished with status 'done'

Requirement already satisfied: merlin-dataloader>=0.0.2 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from nvtabular==1.6.0+4.gba4c1415) (0.0.2)

Requirement already satisfied: scipy in /usr/local/lib/python3.8/dist-packages (from nvtabular==1.6.0+4.gba4c1415) (1.8.1)

Requirement already satisfied: merlin-core>=0.2.0 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from nvtabular==1.6.0+4.gba4c1415) (0.8.0+7.g64755ba)

Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (21.3)

Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (3.19.5)

Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (4.64.1)

Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.55.1)

Requirement already satisfied: distributed>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.3.0)

Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.5)

Requirement already satisfied: dask>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.3.0)

Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (7.0.0)

Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.10.0)

Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.3.5)

Requirement already satisfied: fsspec==2022.5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.5.0)

Requirement already satisfied: numpy<1.25.0,>=1.17.3 in /var/jenkins_home/.local/lib/python3.8/site-packages (from scipy->nvtabular==1.6.0+4.gba4c1415) (1.20.3)

Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.4.3)

Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.0)

Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (5.4.1)

Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.2.0)

Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.0)

Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.12.0)

Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (8.1.3)

Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (3.1.2)

Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.0.4)

Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.4.0)

Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.0.0)

Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (5.8.0)

Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.7.0)

Requirement already satisfied: tornado>=6.0.3 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (6.2)

Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.38.1)

Requirement already satisfied: setuptools in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (65.4.1)

Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (3.0.9)

Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.2.1)

Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.8.2)

Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.52.0)

Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.0)

Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.2.1)

Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.15.0)

Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.0.1)

Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (6.0.2)

Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (4.1.0)

Requirement already satisfied: MarkupSafe>=2.0 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from jinja2->distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.0.1)

Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (4.0.0)

Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (6.0.1)


[notice] A new release of pip available: 22.2.2 -> 22.3.1

[notice] To update, run: pip install --upgrade pip

py38-multi-gpu run-test: commands[2] | horovodrun -np 2 sh examples/usecases/multi-gpu/hvd_wrapper.sh python -m pytest -m horovod -rxs tests/unit

[1,1]:�[1m============================= test session starts ==============================�[0m

[1,1]:platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0

[1,0]:�[1m============================= test session starts ==============================�[0m

[1,0]:platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0

[1,1]:cachedir: .tox/py38-multi-gpu/.pytest_cache

[1,1]:rootdir: /var/jenkins_home/workspace/merlin_models/models, configfile: pyproject.toml

[1,1]:plugins: anyio-3.5.0, xdist-3.0.2, cov-4.0.0

[1,1]:�[1mcollecting ... �[0m[1,0]:cachedir: .tox/py38-multi-gpu/.pytest_cache

[1,0]:rootdir: /var/jenkins_home/workspace/merlin_models/models, configfile: pyproject.toml

[1,0]:plugins: anyio-3.5.0, xdist-3.0.2, cov-4.0.0

[1,0]:�[1mcollecting ... �[0m[1,0]:�[1m

collecting 36 items                                                            �[0m[1,1]:�[1m

collecting 36 items                                                            �[0m[1,0]:�[1m

collecting 547 items                                                           �[0m[1,1]:�[1m

collecting 547 items                                                           �[0m[1,0]:�[1m

collected 875 items / 872 deselected / 3 selected                              �[0m

[1,0]:

[1,0]:tests/unit/tf/horovod/test_horovod.py [1,1]:�[1m

collected 875 items / 872 deselected / 3 selected                              �[0m

[1,1]:

[1,1]:tests/unit/tf/horovod/test_horovod.py [1,1]:�[32m.�[0m[1,0]:�[32m.�[0m[1,1]:�[32m.�[0m[1,0]:�[32m.�[0m[1,1]:�[32m.�[0m[1,1]:�[33m                                [100%]�[0m[1,1]:

[1,1]:

[1,1]:�[33m=============================== warnings summary ===============================�[0m

[1,1]:../../../../../usr/lib/python3/dist-packages/requests/init.py:89

[1,1]:  /usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!

[1,1]:    warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/flatbuffers/compat.py:19

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/flatbuffers/compat.py:19: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses

[1,1]:    import imp

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:36

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:36: DeprecationWarning: NEAREST is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.NEAREST or Dither.NONE instead.

[1,1]:    'nearest': pil_image.NEAREST,

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:37

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:37: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.

[1,1]:    'bilinear': pil_image.BILINEAR,

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:38

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:38: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.

[1,1]:    'bicubic': pil_image.BICUBIC,

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:39

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:39: DeprecationWarning: HAMMING is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.HAMMING instead.

[1,1]:    'hamming': pil_image.HAMMING,

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:40

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:40: DeprecationWarning: BOX is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BOX instead.

[1,1]:    'box': pil_image.BOX,

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:41

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:41: DeprecationWarning: LANCZOS is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.LANCZOS instead.

[1,1]:    'lanczos': pil_image.LANCZOS,

[1,1]:

[1,1]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_dlrm[True]

[1,1]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_dlrm[False]

[1,1]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower[1,1]:

[1,1]:  /var/jenkins_home/workspace/merlin_models/models/.tox/py38-multi-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.ITEM_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.ITEM: 'item'>, <Tags.ID: 'id'>].

[1,1]:    warnings.warn([1,1]:

[1,1]:

[1,1]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,1]:  /var/jenkins_home/workspace/merlin_models/models/.tox/py38-multi-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.SESSION_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.SESSION: 'session'>, <Tags.ID: 'id'>].

[1,1]:    warnings.warn(

[1,1]:

[1,1]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,1]:  /var/jenkins_home/workspace/merlin_models/models/.tox/py38-multi-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.USER_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.USER: 'user'>, <Tags.ID: 'id'>].

[1,1]:    warnings.warn(

[1,1]:

[1,1]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,1]:  /tmp/autograph_generated_fileq5wk5npr.py:8: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead

[1,1]:    ag.converted_call(ag__.ld(warnings).warn, ("The 'warn' method is deprecated, use 'warning' instead", ag__.ld(DeprecationWarning), 2), None, fscope)

[1,1]:

[1,1]:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

[1,1]:�[33m=============== �[32m3 passed�[0m, �[33m�[1m872 deselected�[0m, �[33m�[1m14 warnings�[0m�[33m in 46.50s�[0m�[33m ================�[0m

[1,0]:�[32m.�[0m[1,0]:�[33m                                [100%]�[0m[1,0]:

[1,0]:

[1,0]:�[33m=============================== warnings summary ===============================�[0m

[1,0]:../../../../../usr/lib/python3/dist-packages/requests/init.py:89

[1,0]:  /usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!

[1,0]:    warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/flatbuffers/compat.py:19

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/flatbuffers/compat.py:19: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses

[1,0]:    import imp

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:36

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:36: DeprecationWarning: NEAREST is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.NEAREST or Dither.NONE instead.

[1,0]:    'nearest': pil_image.NEAREST,

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:37

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:37: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.

[1,0]:    'bilinear': pil_image.BILINEAR,

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:38

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:38: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.

[1,0]:    'bicubic': pil_image.BICUBIC,

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:39

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:39: DeprecationWarning: HAMMING is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.HAMMING instead.

[1,0]:    'hamming': pil_image.HAMMING,[1,0]:

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:40

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:40: DeprecationWarning: BOX is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BOX instead.

[1,0]:    'box': pil_image.BOX,

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:41

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:41: DeprecationWarning: LANCZOS is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.LANCZOS instead.

[1,0]:    'lanczos': pil_image.LANCZOS,

[1,0]:

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_dlrm[True]

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_dlrm[False]

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,0]:  /var/jenkins_home/workspace/merlin_models/models/.tox/py38-multi-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.ITEM_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.ITEM: 'item'>, <Tags.ID: 'id'>].

[1,0]:    warnings.warn(

[1,0]:

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,0]:  /var/jenkins_home/workspace/merlin_models/models/.tox/py38-multi-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.SESSION_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.SESSION: 'session'>, <Tags.ID: 'id'>].

[1,0]:    warnings.warn([1,0]:

[1,0]:

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,0]:  /var/jenkins_home/workspace/merlin_models/models/.tox/py38-multi-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.USER_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.USER: 'user'>, <Tags.ID: 'id'>].

[1,0]:    warnings.warn(

[1,0]:

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,0]:  /tmp/autograph_generated_filepoj2e3dq.py:8: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead

[1,0]:    ag.converted_call(ag__.ld(warnings).warn, ("The 'warn' method is deprecated, use 'warning' instead", ag__.ld(DeprecationWarning), 2), None, fscope)

[1,0]:

[1,0]:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

[1,0]:�[33m=============== �[32m3 passed�[0m, �[33m�[1m872 deselected�[0m, �[33m�[1m16 warnings�[0m�[33m in 51.11s�[0m�[33m ================�[0m

___________________________________ summary ____________________________________

py38-multi-gpu: commands succeeded

congratulations :)

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/models/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[merlin_models] $ /bin/bash /tmp/jenkins15970068252777402866.sh

@nvidia-merlin-bot
Copy link

Click to view CI Results
GitHub pull request #869 of commit 26ccdbb726bbcc2a7580236d98fb354c8d082147, no merge conflicts.
Running as SYSTEM
Setting status of 26ccdbb726bbcc2a7580236d98fb354c8d082147 to PENDING with url http://merlin-infra1.nvidia.com:8080/job/merlin_models/1788/ and message: 'Pending'
Using context: Jenkins
Building on master in workspace /var/jenkins_home/workspace/merlin_models
using credential nvidia-merlin-bot
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/models/ # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/models/
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/models/ +refs/pull/869/*:refs/remotes/origin/pr/869/* # timeout=10
 > git rev-parse 26ccdbb726bbcc2a7580236d98fb354c8d082147^{commit} # timeout=10
Checking out Revision 26ccdbb726bbcc2a7580236d98fb354c8d082147 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 26ccdbb726bbcc2a7580236d98fb354c8d082147 # timeout=10
Commit message: "Merge branch 'main' into topk-encoder"
 > git rev-list --no-walk 7a270b50c82e9dec072d8a9ca1421d67b6186b0e # timeout=10
[merlin_models] $ /bin/bash /tmp/jenkins3130237007268529774.sh
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: testbook in /usr/local/lib/python3.8/dist-packages (0.4.2)
Requirement already satisfied: nbclient>=0.4.0 in /usr/local/lib/python3.8/dist-packages (from testbook) (0.6.8)
Requirement already satisfied: nbformat>=5.0.4 in /usr/local/lib/python3.8/dist-packages (from testbook) (5.5.0)
Requirement already satisfied: nest-asyncio in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (1.5.5)
Requirement already satisfied: jupyter-client>=6.1.5 in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (7.3.5)
Requirement already satisfied: traitlets>=5.2.2 in /usr/local/lib/python3.8/dist-packages (from nbclient>=0.4.0->testbook) (5.4.0)
Requirement already satisfied: jupyter_core in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.11.1)
Requirement already satisfied: fastjsonschema in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (2.16.1)
Requirement already satisfied: jsonschema>=2.6 in /usr/local/lib/python3.8/dist-packages (from nbformat>=5.0.4->testbook) (4.16.0)
Requirement already satisfied: pkgutil-resolve-name>=1.3.10 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (1.3.10)
Requirement already satisfied: attrs>=17.4.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (22.1.0)
Requirement already satisfied: importlib-resources>=1.4.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (5.9.0)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat>=5.0.4->testbook) (0.18.1)
Requirement already satisfied: python-dateutil>=2.8.2 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (2.8.2)
Requirement already satisfied: pyzmq>=23.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (24.0.0)
Requirement already satisfied: entrypoints in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (0.4)
Requirement already satisfied: tornado>=6.2 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (6.2)
Requirement already satisfied: zipp>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from importlib-resources>=1.4.0->jsonschema>=2.6->nbformat>=5.0.4->testbook) (3.8.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.8.2->jupyter-client>=6.1.5->nbclient>=0.4.0->testbook) (1.15.0)
GLOB sdist-make: /var/jenkins_home/workspace/merlin_models/models/setup.py
py38-gpu inst-nodeps: /var/jenkins_home/workspace/merlin_models/models/.tox/.tmp/package/2/merlin-models-0.9.0+38.g26ccdbb7.zip
WARNING: Discarding $PYTHONPATH from environment, to override specify PYTHONPATH in 'passenv' in your configuration.
py38-gpu installed: absl-py==1.2.0,aiohttp==3.8.1,aiosignal==1.2.0,alabaster==0.7.12,alembic==1.8.1,anyio==3.6.1,appdirs==1.4.4,argon2-cffi==21.3.0,argon2-cffi-bindings==21.2.0,astroid==2.5.6,asttokens==2.0.8,astunparse==1.6.3,asv==0.5.1,asvdb==0.4.2,async-timeout==4.0.2,attrs==22.1.0,autopage==0.5.1,awscli==1.27.5,Babel==2.10.3,backcall==0.2.0,beautifulsoup4==4.11.1,betterproto==1.2.5,black==20.8b1,bleach==5.0.1,bokeh==3.0.1,boto3==1.24.75,botocore==1.29.5,Brotli==1.0.9,build==0.9.0,cachetools==5.2.0,certifi==2019.11.28,cffi==1.15.1,chardet==3.0.4,charset-normalizer==2.1.1,check-manifest==0.48,clang==5.0,click==8.1.3,cliff==4.0.0,cloudpickle==2.2.0,cmaes==0.9.0,cmake==3.24.1.1,cmd2==2.4.2,colorama==0.4.4,colorlog==6.7.0,contourpy==1.0.5,coverage==6.5.0,cuda-python==11.7.1,cupy-cuda117==10.6.0,cycler==0.11.0,Cython==0.29.32,dask==2022.1.1,dbus-python==1.2.16,debugpy==1.6.3,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.5.1,distlib==0.3.6,distributed==2022.5.1,distro==1.7.0,dm-tree==0.1.6,docker-pycreds==0.4.0,docutils==0.16,emoji==1.7.0,entrypoints==0.4,execnet==1.9.0,executing==1.0.0,faiss==1.7.2,faiss-gpu==1.7.2,fastai==2.7.9,fastapi==0.85.0,fastavro==1.6.1,fastcore==1.5.27,fastdownload==0.0.7,fastjsonschema==2.16.1,fastprogress==1.0.3,fastrlock==0.8,feast==0.19.4,fiddle==0.2.2,filelock==3.8.0,flake8==5.0.4,flatbuffers==1.12,fonttools==4.37.3,frozenlist==1.3.1,fsspec==2022.5.0,gast==0.4.0,gevent==21.12.0,geventhttpclient==2.0.2,gitdb==4.0.9,GitPython==3.1.27,google==3.0.0,google-api-core==2.10.1,google-auth==2.11.1,google-auth-oauthlib==0.4.6,google-pasta==0.2.0,googleapis-common-protos==1.52.0,graphviz==0.20.1,greenlet==1.1.3,grpcio==1.41.0,grpcio-channelz==1.49.0,grpcio-reflection==1.48.1,grpclib==0.4.3,h11==0.13.0,h2==4.1.0,h5py==3.7.0,HeapDict==1.0.1,horovod==0.26.1,hpack==4.0.0,httptools==0.5.0,hugectr2onnx==0.0.0,huggingface-hub==0.9.1,hyperframe==6.0.1,idna==2.8,imagesize==1.4.1,implicit==0.6.1,importlib-metadata==4.12.0,importlib-resources==5.9.0,iniconfig==1.1.1,interrogate==1.5.0,ipykernel==6.15.3,ipython==8.5.0,ipython-genutils==0.2.0,ipywidgets==7.7.0,isort==5.10.1,jedi==0.18.1,Jinja2==3.1.2,jmespath==1.0.1,joblib==1.2.0,json5==0.9.10,jsonschema==4.16.0,jupyter==1.0.0,jupyter-cache==0.4.3,jupyter-console==6.4.4,jupyter-core==4.11.1,jupyter-server==1.18.1,jupyter-server-mathjax==0.2.5,jupyter-sphinx==0.3.2,jupyter_client==7.3.5,jupyterlab==3.4.7,jupyterlab-pygments==0.2.2,jupyterlab-widgets==1.1.0,jupyterlab_server==2.15.1,keras==2.9.0,Keras-Preprocessing==1.1.2,kiwisolver==1.4.4,lazy-object-proxy==1.8.0,libclang==14.0.6,libcst==0.4.7,lightfm==1.16,lightgbm==3.3.2,linkify-it-py==1.0.3,llvmlite==0.39.1,locket==1.0.0,lxml==4.9.1,Mako==1.2.3,Markdown==3.4.1,markdown-it-py==1.1.0,MarkupSafe==2.1.1,matplotlib==3.6.0,matplotlib-inline==0.1.6,mccabe==0.7.0,mdit-py-plugins==0.2.8,merlin-core==0.6.0+1.g5926fcf,merlin-dataloader @ git+https://github.com/NVIDIA-Merlin/dataloader.git@b6f9a67b2c0caf1b0b1ded10e5491b5a0f13230a,merlin-models==0.9.0+38.g26ccdbb7,merlin-systems==0.5.0+4.g15074ad,mistune==2.0.4,mmh3==3.0.0,mpi4py==3.1.3,msgpack==1.0.4,multidict==6.0.2,mypy==0.982,mypy-extensions==0.4.3,myst-nb==0.13.2,myst-parser==0.15.2,natsort==8.1.0,nbclassic==0.4.3,nbclient==0.6.8,nbconvert==7.0.0,nbdime==3.1.1,nbformat==5.5.0,nest-asyncio==1.5.5,ninja==1.10.2.3,notebook==6.4.12,notebook-shim==0.1.0,numba==0.56.2,numpy==1.22.4,nvidia-pyindex==1.0.9,# Editable install with no version control (nvtabular==1.4.0+8.g95e12d347),-e /usr/local/lib/python3.8/dist-packages,nvtx==0.2.5,oauthlib==3.2.1,oldest-supported-numpy==2022.8.16,onnx==1.12.0,onnxruntime==1.11.1,opt-einsum==3.3.0,optuna==3.0.3,packaging==21.3,pandas==1.3.5,pandavro==1.5.2,pandocfilters==1.5.0,parso==0.8.3,partd==1.3.0,pathspec==0.10.1,pathtools==0.1.2,pbr==5.11.0,pep517==0.13.0,pexpect==4.8.0,pickleshare==0.7.5,Pillow==9.2.0,pkgutil_resolve_name==1.3.10,platformdirs==2.5.2,plotly==5.11.0,pluggy==1.0.0,prettytable==3.5.0,prometheus-client==0.14.1,promise==2.3,prompt-toolkit==3.0.31,proto-plus==1.19.6,protobuf==3.19.5,psutil==5.9.2,ptyprocess==0.7.0,pure-eval==0.2.2,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pybind11==2.10.0,pycodestyle==2.9.1,pycparser==2.21,pydantic==1.10.2,pydot==1.4.2,pyflakes==2.5.0,Pygments==2.13.0,PyGObject==3.36.0,pynvml==11.4.1,pyparsing==3.0.9,pyperclip==1.8.2,pyrsistent==0.18.1,pytest==7.1.3,pytest-cov==4.0.0,pytest-xdist==3.0.2,python-apt==2.0.0+ubuntu0.20.4.8,python-dateutil==2.8.2,python-dotenv==0.21.0,python-rapidjson==1.8,pytz==2022.2.1,PyYAML==5.4.1,pyzmq==24.0.0,qtconsole==5.4.0,QtPy==2.2.1,regex==2022.9.13,requests==2.22.0,requests-oauthlib==1.3.1,requests-unixsocket==0.2.0,rsa==4.7.2,s3fs==2022.2.0,s3transfer==0.6.0,sacremoses==0.0.53,scikit-build==0.15.0,scikit-learn==1.1.2,scipy==1.8.1,seedir==0.3.0,Send2Trash==1.8.0,sentry-sdk==1.9.8,setproctitle==1.3.2,setuptools-scm==7.0.5,shortuuid==1.0.9,six==1.15.0,sklearn==0.0,smmap==5.0.0,sniffio==1.3.0,snowballstemmer==2.2.0,sortedcontainers==2.4.0,soupsieve==2.3.2.post1,Sphinx==5.3.0,sphinx-multiversion==0.2.4,sphinx-togglebutton==0.3.1,sphinx_external_toc==0.3.0,sphinxcontrib-applehelp==1.0.2,sphinxcontrib-copydirs @ git+https://github.com/mikemckiernan/sphinxcontrib-copydirs.git@bd8c5d79b3f91cf5f1bb0d6995aeca3fe84b670e,sphinxcontrib-devhelp==1.0.2,sphinxcontrib-htmlhelp==2.0.0,sphinxcontrib-jsmath==1.0.1,sphinxcontrib-qthelp==1.0.3,sphinxcontrib-serializinghtml==1.1.5,SQLAlchemy==1.4.43,stack-data==0.5.0,starlette==0.20.4,stevedore==4.1.0,stringcase==1.2.0,supervisor==4.1.0,tabulate==0.8.10,tblib==1.7.0,tdqm==0.0.1,tenacity==8.0.1,tensorboard==2.9.1,tensorboard-data-server==0.6.1,tensorboard-plugin-wit==1.8.1,tensorflow==2.9.2,tensorflow-estimator==2.9.0,tensorflow-gpu==2.9.2,tensorflow-io-gcs-filesystem==0.27.0,tensorflow-metadata==1.10.0,tensorflow-ranking==0.5.1,tensorflow-serving-api==2.9.2,termcolor==2.0.1,terminado==0.15.0,testbook==0.4.2,threadpoolctl==3.1.0,tinycss2==1.1.1,tokenizers==0.10.3,toml==0.10.2,tomli==2.0.1,toolz==0.12.0,torch==1.12.1+cu113,torchmetrics==0.3.2,tornado==6.2,tox==3.26.0,tqdm==4.64.1,traitlets==5.4.0,transformers==4.12.0,transformers4rec==0.1.12+2.gbcc939255,treelite==2.3.0,treelite-runtime==2.3.0,tritonclient==2.25.0,typed-ast==1.5.4,typing-inspect==0.8.0,typing_extensions==4.3.0,uc-micro-py==1.0.1,urllib3==1.26.12,uvicorn==0.18.3,uvloop==0.17.0,versioneer==0.20,virtualenv==20.16.5,wandb==0.13.3,watchfiles==0.17.0,wcwidth==0.2.5,webencodings==0.5.1,websocket-client==1.4.1,websockets==10.3,Werkzeug==2.2.2,widgetsnbextension==3.6.0,wrapt==1.12.1,xgboost==1.6.2,xyzservices==2022.9.0,yarl==1.8.1,zict==2.2.0,zipp==3.8.1,zope.event==4.5.0,zope.interface==5.4.0
py38-gpu run-test-pre: PYTHONHASHSEED='3213772457'
py38-gpu run-test: commands[0] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/core.git
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/NVIDIA-Merlin/core.git
  Cloning https://github.com/NVIDIA-Merlin/core.git to /tmp/pip-req-build-37cdi809
  Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/core.git /tmp/pip-req-build-37cdi809
  Resolved https://github.com/NVIDIA-Merlin/core.git to commit 64755badd4e5756601f66e7e568201aedb8a4144
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: dask>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (2022.3.0)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (1.10.0)
Requirement already satisfied: distributed>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (2022.3.0)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (7.0.0)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (21.3)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (1.3.5)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (0.55.1)
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (3.19.5)
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (4.64.1)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (1.2.5)
Requirement already satisfied: fsspec==2022.5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (2022.5.0)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (0.4.3)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (1.2.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (0.12.0)
Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (5.4.1)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.2.0)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.2.0)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.0.4)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (3.1.2)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (5.8.0)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.4.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (8.1.3)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.7.0)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.0.0)
Requirement already satisfied: tornado>=6.0.3 in ./.tox/py38-gpu/lib/python3.8/site-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (6.2)
Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+7.g64755ba) (1.20.3)
Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/py38-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+7.g64755ba) (0.38.1)
Requirement already satisfied: setuptools in ./.tox/py38-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+7.g64755ba) (65.4.1)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core==0.8.0+7.g64755ba) (3.0.9)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+7.g64755ba) (2.8.2)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+7.g64755ba) (2022.2.1)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.8.0+7.g64755ba) (1.2.0)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.8.0+7.g64755ba) (1.52.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (0.2.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+7.g64755ba) (1.15.0)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.0.1)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (6.0.2)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (4.1.0)
Requirement already satisfied: MarkupSafe>=2.0 in ./.tox/py38-gpu/lib/python3.8/site-packages (from jinja2->distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.0.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (4.0.0)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (6.0.1)

[notice] A new release of pip available: 22.2.2 -> 22.3.1

[notice] To update, run: pip install --upgrade pip

py38-gpu run-test: commands[1] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/nvtabular.git

Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com

Collecting git+https://github.com/NVIDIA-Merlin/nvtabular.git

Cloning https://github.com/NVIDIA-Merlin/nvtabular.git to /tmp/pip-req-build-dt_3k4rv

Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/nvtabular.git /tmp/pip-req-build-dt_3k4rv

Resolved https://github.com/NVIDIA-Merlin/nvtabular.git to commit ba4c14159a8e858c8998d4158a4376e65a8fa266

Installing build dependencies: started

Installing build dependencies: finished with status 'done'

Getting requirements to build wheel: started

Getting requirements to build wheel: finished with status 'done'

Preparing metadata (pyproject.toml): started

Preparing metadata (pyproject.toml): finished with status 'done'

Requirement already satisfied: scipy in /usr/local/lib/python3.8/dist-packages (from nvtabular==1.6.0+4.gba4c1415) (1.8.1)

Requirement already satisfied: merlin-dataloader>=0.0.2 in ./.tox/py38-gpu/lib/python3.8/site-packages (from nvtabular==1.6.0+4.gba4c1415) (0.0.2+3.gb6f9a67)

Requirement already satisfied: merlin-core>=0.2.0 in ./.tox/py38-gpu/lib/python3.8/site-packages (from nvtabular==1.6.0+4.gba4c1415) (0.8.0+7.g64755ba)

Requirement already satisfied: dask>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.3.0)

Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.10.0)

Requirement already satisfied: distributed>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.3.0)

Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (7.0.0)

Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (21.3)

Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.3.5)

Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.55.1)

Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (3.19.5)

Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (4.64.1)

Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.5)

Requirement already satisfied: fsspec==2022.5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.5.0)

Requirement already satisfied: numpy<1.25.0,>=1.17.3 in /var/jenkins_home/.local/lib/python3.8/site-packages (from scipy->nvtabular==1.6.0+4.gba4c1415) (1.20.3)

Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.4.3)

Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.0)

Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.12.0)

Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (5.4.1)

Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.2.0)

Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.0)

Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.0.4)

Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (3.1.2)

Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (5.8.0)

Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.4.0)

Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (8.1.3)

Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.7.0)

Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.0.0)

Requirement already satisfied: tornado>=6.0.3 in ./.tox/py38-gpu/lib/python3.8/site-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (6.2)

Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/py38-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.38.1)

Requirement already satisfied: setuptools in ./.tox/py38-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (65.4.1)

Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (3.0.9)

Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.8.2)

Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.2.1)

Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.0)

Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.52.0)

Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.2.1)

Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.15.0)

Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.0.1)

Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (6.0.2)

Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (4.1.0)

Requirement already satisfied: MarkupSafe>=2.0 in ./.tox/py38-gpu/lib/python3.8/site-packages (from jinja2->distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.0.1)

Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (4.0.0)

Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (6.0.1)


[notice] A new release of pip available: 22.2.2 -> 22.3.1

[notice] To update, run: pip install --upgrade pip

py38-gpu run-test: commands[2] | python -m pytest --cov-report term --cov merlin -rxs tests/unit

============================= test session starts ==============================

platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0

cachedir: .tox/py38-gpu/.pytest_cache

rootdir: /var/jenkins_home/workspace/merlin_models/models, configfile: pyproject.toml

plugins: anyio-3.5.0, xdist-3.0.2, cov-4.0.0

collected 876 items


tests/unit/config/test_schema.py ....                                    [  0%]

tests/unit/datasets/test_advertising.py .s                               [  0%]

tests/unit/datasets/test_ecommerce.py ..sss.s                            [  1%]

tests/unit/datasets/test_entertainment.py ....sss.                       [  2%]

tests/unit/datasets/test_social.py .                                     [  2%]

tests/unit/datasets/test_synthetic.py ......                             [  3%]

tests/unit/implicit/test_implicit.py .                                   [  3%]

tests/unit/lightfm/test_lightfm.py .                                     [  3%]

tests/unit/tf/test_core.py ......                                        [  4%]

tests/unit/tf/test_loader.py ................                            [  5%]

tests/unit/tf/test_public_api.py .                                       [  6%]

tests/unit/tf/blocks/test_cross.py ...........                           [  7%]

tests/unit/tf/blocks/test_dlrm.py ..........                             [  8%]

tests/unit/tf/blocks/test_interactions.py ...                            [  8%]

tests/unit/tf/blocks/test_mlp.py ....................................... [ 13%]

............................                                             [ 16%]

tests/unit/tf/blocks/test_optimizer.py s................................ [ 20%]

.....................                                                    [ 22%]

tests/unit/tf/blocks/retrieval/test_base.py .                            [ 22%]

tests/unit/tf/blocks/retrieval/test_matrix_factorization.py ..           [ 22%]

tests/unit/tf/blocks/retrieval/test_two_tower.py ............            [ 24%]

tests/unit/tf/blocks/sampling/test_cross_batch.py .                      [ 24%]

tests/unit/tf/blocks/sampling/test_in_batch.py .                         [ 24%]

tests/unit/tf/core/test_aggregation.py .........                         [ 25%]

tests/unit/tf/core/test_base.py ..                                       [ 25%]

tests/unit/tf/core/test_combinators.py s.....................            [ 28%]

tests/unit/tf/core/test_encoder.py ..                                    [ 28%]

tests/unit/tf/core/test_index.py ...                                     [ 28%]

tests/unit/tf/core/test_prediction.py ..                                 [ 29%]

tests/unit/tf/core/test_tabular.py ......                                [ 29%]

tests/unit/tf/examples/test_01_getting_started.py .                      [ 29%]

tests/unit/tf/examples/test_02_dataschema.py .                           [ 30%]

tests/unit/tf/examples/test_03_exploring_different_models.py .           [ 30%]

tests/unit/tf/examples/test_04_export_ranking_models.py .                [ 30%]

tests/unit/tf/examples/test_05_export_retrieval_model.py .               [ 30%]

tests/unit/tf/examples/test_06_advanced_own_architecture.py .            [ 30%]

tests/unit/tf/examples/test_07_train_traditional_models.py .             [ 30%]

tests/unit/tf/examples/test_usecase_accelerate_training_by_lazyadam.py . [ 30%]

[ 30%]

tests/unit/tf/examples/test_usecase_ecommerce_session_based.py .         [ 30%]

tests/unit/tf/examples/test_usecase_incremental_training_layer_freezing.py . [ 30%]

[ 30%]

tests/unit/tf/examples/test_usecase_pretrained_embeddings.py .           [ 31%]

tests/unit/tf/examples/test_usecase_retrieval_with_hpo.py .              [ 31%]

tests/unit/tf/horovod/test_horovod.py ...                                [ 31%]

tests/unit/tf/inputs/test_continuous.py ........                         [ 32%]

tests/unit/tf/inputs/test_embedding.py ................................. [ 36%]

........                                                                 [ 37%]

tests/unit/tf/inputs/test_tabular.py ..................                  [ 39%]

tests/unit/tf/layers/test_queue.py ..............                        [ 40%]

tests/unit/tf/losses/test_losses.py .......................              [ 43%]

tests/unit/tf/metrics/test_metrics_popularity.py .....                   [ 43%]

tests/unit/tf/metrics/test_metrics_topk.py .........................     [ 46%]

tests/unit/tf/models/test_base.py s.........................             [ 49%]

tests/unit/tf/models/test_benchmark.py ..                                [ 50%]

tests/unit/tf/models/test_ranking.py ..................................  [ 53%]

tests/unit/tf/models/test_retrieval.py ................................. [ 57%]

...........................................                              [ 62%]

tests/unit/tf/outputs/test_base.py ......                                [ 63%]

tests/unit/tf/outputs/test_classification.py ......                      [ 63%]

tests/unit/tf/outputs/test_contrastive.py ..............                 [ 65%]

tests/unit/tf/outputs/test_regression.py ..                              [ 65%]

tests/unit/tf/outputs/test_sampling.py ....                              [ 66%]

tests/unit/tf/outputs/test_topk.py .                                     [ 66%]

tests/unit/tf/prediction_tasks/test_classification.py ..                 [ 66%]

tests/unit/tf/prediction_tasks/test_multi_task.py ................       [ 68%]

tests/unit/tf/prediction_tasks/test_next_item.py .....                   [ 68%]

tests/unit/tf/prediction_tasks/test_regression.py .....                  [ 69%]

tests/unit/tf/prediction_tasks/test_retrieval.py .                       [ 69%]

tests/unit/tf/prediction_tasks/test_sampling.py ......                   [ 70%]

tests/unit/tf/transformers/test_block.py .....................           [ 72%]

tests/unit/tf/transformers/test_transforms.py ..........                 [ 73%]

tests/unit/tf/transforms/test_bias.py ..                                 [ 74%]

tests/unit/tf/transforms/test_features.py s............................. [ 77%]

.......................s......                                           [ 80%]

tests/unit/tf/transforms/test_negative_sampling.py .........             [ 81%]

tests/unit/tf/transforms/test_noise.py .....                             [ 82%]

tests/unit/tf/transforms/test_sequence.py ....................           [ 84%]

tests/unit/tf/transforms/test_tensor.py ...                              [ 85%]

tests/unit/tf/utils/test_batch.py ....                                   [ 85%]

tests/unit/tf/utils/test_dataset.py ..                                   [ 85%]

tests/unit/tf/utils/test_tf_utils.py .....                               [ 86%]

tests/unit/torch/test_dataset.py .........                               [ 87%]

tests/unit/torch/test_public_api.py .                                    [ 87%]

tests/unit/torch/block/test_base.py ....                                 [ 88%]

tests/unit/torch/block/test_mlp.py .                                     [ 88%]

tests/unit/torch/features/test_continuous.py ..                          [ 88%]

tests/unit/torch/features/test_embedding.py ..............               [ 89%]

tests/unit/torch/features/test_tabular.py ....                           [ 90%]

tests/unit/torch/model/test_head.py ............                         [ 91%]

tests/unit/torch/model/test_model.py ..                                  [ 92%]

tests/unit/torch/tabular/test_aggregation.py ........                    [ 92%]

tests/unit/torch/tabular/test_tabular.py ...                             [ 93%]

tests/unit/torch/tabular/test_transformations.py .......                 [ 94%]

tests/unit/utils/test_schema_utils.py ................................   [ 97%]

tests/unit/xgb/test_xgboost.py ....................                      [100%]


=============================== warnings summary ===============================

../../../../../usr/lib/python3/dist-packages/requests/init.py:89

/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!

warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "


../../../.local/lib/python3.8/site-packages/flatbuffers/compat.py:19

/var/jenkins_home/.local/lib/python3.8/site-packages/flatbuffers/compat.py:19: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses

import imp


../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:36

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:36: DeprecationWarning: NEAREST is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.NEAREST or Dither.NONE instead.

'nearest': pil_image.NEAREST,


../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:37

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:37: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.

'bilinear': pil_image.BILINEAR,


../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:38

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:38: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.

'bicubic': pil_image.BICUBIC,


../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:39

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:39: DeprecationWarning: HAMMING is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.HAMMING instead.

'hamming': pil_image.HAMMING,


../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:40

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:40: DeprecationWarning: BOX is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BOX instead.

'box': pil_image.BOX,


../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:41

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:41: DeprecationWarning: LANCZOS is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.LANCZOS instead.

'lanczos': pil_image.LANCZOS,


tests/unit/datasets/test_advertising.py: 1 warning

tests/unit/datasets/test_ecommerce.py: 3 warnings

tests/unit/datasets/test_entertainment.py: 4 warnings

tests/unit/datasets/test_social.py: 1 warning

tests/unit/datasets/test_synthetic.py: 6 warnings

tests/unit/implicit/test_implicit.py: 1 warning

tests/unit/lightfm/test_lightfm.py: 1 warning

tests/unit/tf/test_core.py: 6 warnings

tests/unit/tf/test_loader.py: 1 warning

tests/unit/tf/blocks/test_cross.py: 5 warnings

tests/unit/tf/blocks/test_dlrm.py: 9 warnings

tests/unit/tf/blocks/test_interactions.py: 2 warnings

tests/unit/tf/blocks/test_mlp.py: 60 warnings

tests/unit/tf/blocks/test_optimizer.py: 30 warnings

tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings

tests/unit/tf/blocks/retrieval/test_two_tower.py: 11 warnings

tests/unit/tf/core/test_aggregation.py: 6 warnings

tests/unit/tf/core/test_base.py: 2 warnings

tests/unit/tf/core/test_combinators.py: 11 warnings

tests/unit/tf/core/test_encoder.py: 6 warnings

tests/unit/tf/core/test_index.py: 8 warnings

tests/unit/tf/core/test_prediction.py: 2 warnings

tests/unit/tf/horovod/test_horovod.py: 3 warnings

tests/unit/tf/inputs/test_continuous.py: 7 warnings

tests/unit/tf/inputs/test_embedding.py: 20 warnings

tests/unit/tf/inputs/test_tabular.py: 18 warnings

tests/unit/tf/models/test_base.py: 28 warnings

tests/unit/tf/models/test_benchmark.py: 2 warnings

tests/unit/tf/models/test_ranking.py: 38 warnings

tests/unit/tf/models/test_retrieval.py: 120 warnings

tests/unit/tf/outputs/test_base.py: 6 warnings

tests/unit/tf/outputs/test_classification.py: 6 warnings

tests/unit/tf/outputs/test_contrastive.py: 19 warnings

tests/unit/tf/outputs/test_regression.py: 2 warnings

tests/unit/tf/prediction_tasks/test_classification.py: 2 warnings

tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings

tests/unit/tf/prediction_tasks/test_regression.py: 5 warnings

tests/unit/tf/prediction_tasks/test_retrieval.py: 1 warning

tests/unit/tf/transformers/test_block.py: 15 warnings

tests/unit/tf/transforms/test_bias.py: 2 warnings

tests/unit/tf/transforms/test_features.py: 10 warnings

tests/unit/tf/transforms/test_negative_sampling.py: 10 warnings

tests/unit/tf/transforms/test_noise.py: 1 warning

tests/unit/tf/transforms/test_sequence.py: 15 warnings

tests/unit/tf/utils/test_batch.py: 9 warnings

tests/unit/tf/utils/test_dataset.py: 2 warnings

tests/unit/torch/block/test_base.py: 4 warnings

tests/unit/torch/block/test_mlp.py: 1 warning

tests/unit/torch/features/test_continuous.py: 1 warning

tests/unit/torch/features/test_embedding.py: 4 warnings

tests/unit/torch/features/test_tabular.py: 4 warnings

tests/unit/torch/model/test_head.py: 12 warnings

tests/unit/torch/model/test_model.py: 2 warnings

tests/unit/torch/tabular/test_aggregation.py: 6 warnings

tests/unit/torch/tabular/test_transformations.py: 3 warnings

tests/unit/xgb/test_xgboost.py: 18 warnings

/var/jenkins_home/workspace/merlin_models/models/.tox/py38-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.ITEM_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.ITEM: 'item'>, <Tags.ID: 'id'>].

warnings.warn(


tests/unit/datasets/test_ecommerce.py: 3 warnings

tests/unit/datasets/test_entertainment.py: 4 warnings

tests/unit/datasets/test_social.py: 1 warning

tests/unit/datasets/test_synthetic.py: 5 warnings

tests/unit/implicit/test_implicit.py: 1 warning

tests/unit/lightfm/test_lightfm.py: 1 warning

tests/unit/tf/test_core.py: 6 warnings

tests/unit/tf/test_loader.py: 1 warning

tests/unit/tf/blocks/test_cross.py: 5 warnings

tests/unit/tf/blocks/test_dlrm.py: 9 warnings

tests/unit/tf/blocks/test_interactions.py: 2 warnings

tests/unit/tf/blocks/test_mlp.py: 60 warnings

tests/unit/tf/blocks/test_optimizer.py: 30 warnings

tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings

tests/unit/tf/blocks/retrieval/test_two_tower.py: 11 warnings

tests/unit/tf/core/test_aggregation.py: 6 warnings

tests/unit/tf/core/test_base.py: 2 warnings

tests/unit/tf/core/test_combinators.py: 11 warnings

tests/unit/tf/core/test_encoder.py: 7 warnings

tests/unit/tf/core/test_index.py: 3 warnings

tests/unit/tf/core/test_prediction.py: 2 warnings

tests/unit/tf/horovod/test_horovod.py: 1 warning

tests/unit/tf/inputs/test_continuous.py: 7 warnings

tests/unit/tf/inputs/test_embedding.py: 20 warnings

tests/unit/tf/inputs/test_tabular.py: 18 warnings

tests/unit/tf/models/test_base.py: 28 warnings

tests/unit/tf/models/test_benchmark.py: 2 warnings

tests/unit/tf/models/test_ranking.py: 36 warnings

tests/unit/tf/models/test_retrieval.py: 86 warnings

tests/unit/tf/outputs/test_base.py: 6 warnings

tests/unit/tf/outputs/test_classification.py: 6 warnings

tests/unit/tf/outputs/test_contrastive.py: 19 warnings

tests/unit/tf/outputs/test_regression.py: 2 warnings

tests/unit/tf/prediction_tasks/test_classification.py: 2 warnings

tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings

tests/unit/tf/prediction_tasks/test_regression.py: 5 warnings

tests/unit/tf/transformers/test_block.py: 9 warnings

tests/unit/tf/transforms/test_features.py: 10 warnings

tests/unit/tf/transforms/test_negative_sampling.py: 10 warnings

tests/unit/tf/transforms/test_sequence.py: 15 warnings

tests/unit/tf/utils/test_batch.py: 7 warnings

tests/unit/tf/utils/test_dataset.py: 2 warnings

tests/unit/torch/block/test_base.py: 4 warnings

tests/unit/torch/block/test_mlp.py: 1 warning

tests/unit/torch/features/test_continuous.py: 1 warning

tests/unit/torch/features/test_embedding.py: 4 warnings

tests/unit/torch/features/test_tabular.py: 4 warnings

tests/unit/torch/model/test_head.py: 12 warnings

tests/unit/torch/model/test_model.py: 2 warnings

tests/unit/torch/tabular/test_aggregation.py: 6 warnings

tests/unit/torch/tabular/test_transformations.py: 2 warnings

tests/unit/xgb/test_xgboost.py: 17 warnings

/var/jenkins_home/workspace/merlin_models/models/.tox/py38-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.USER_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.USER: 'user'>, <Tags.ID: 'id'>].

warnings.warn(


tests/unit/datasets/test_ecommerce.py: 1 warning

tests/unit/datasets/test_entertainment.py: 1 warning

tests/unit/implicit/test_implicit.py: 1 warning

tests/unit/lightfm/test_lightfm.py: 1 warning

tests/unit/tf/test_loader.py: 1 warning

tests/unit/tf/blocks/retrieval/test_matrix_factorization.py: 2 warnings

tests/unit/tf/blocks/retrieval/test_two_tower.py: 2 warnings

tests/unit/tf/core/test_combinators.py: 11 warnings

tests/unit/tf/core/test_encoder.py: 2 warnings

tests/unit/tf/core/test_prediction.py: 1 warning

tests/unit/tf/horovod/test_horovod.py: 1 warning

tests/unit/tf/inputs/test_continuous.py: 4 warnings

tests/unit/tf/inputs/test_embedding.py: 9 warnings

tests/unit/tf/inputs/test_tabular.py: 8 warnings

tests/unit/tf/models/test_ranking.py: 20 warnings

tests/unit/tf/models/test_retrieval.py: 10 warnings

tests/unit/tf/prediction_tasks/test_multi_task.py: 16 warnings

tests/unit/tf/prediction_tasks/test_regression.py: 3 warnings

tests/unit/tf/transforms/test_negative_sampling.py: 9 warnings

tests/unit/xgb/test_xgboost.py: 12 warnings

/var/jenkins_home/workspace/merlin_models/models/.tox/py38-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.SESSION_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.SESSION: 'session'>, <Tags.ID: 'id'>].

warnings.warn(


tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export

tests/unit/tf/blocks/retrieval/test_matrix_factorization.py::test_matrix_factorization_embedding_export

tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export

tests/unit/tf/blocks/retrieval/test_two_tower.py::test_matrix_factorization_embedding_export

tests/unit/tf/inputs/test_embedding.py::test_embedding_features_exporting_and_loading_pretrained_initializer

/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/inputs/embedding.py:968: DeprecationWarning: This function is deprecated in favor of cupy.from_dlpack

embeddings_cupy = cupy.fromDlpack(to_dlpack(tf.convert_to_tensor(embeddings)))


tests/unit/tf/blocks/retrieval/test_two_tower.py: 1 warning

tests/unit/tf/core/test_index.py: 4 warnings

tests/unit/tf/horovod/test_horovod.py: 3 warnings

tests/unit/tf/models/test_retrieval.py: 55 warnings

tests/unit/tf/prediction_tasks/test_next_item.py: 3 warnings

tests/unit/tf/utils/test_batch.py: 2 warnings

/tmp/autograph_generated_filedcs8f925.py:8: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead

ag.converted_call(ag__.ld(warnings).warn, ("The 'warn' method is deprecated, use 'warning' instead", ag__.ld(DeprecationWarning), 2), None, fscope)


tests/unit/tf/core/test_combinators.py::test_parallel_block_select_by_tags

/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/core/tabular.py:602: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3, and in 3.10 it will stop working

elif isinstance(self.feature_names, collections.Sequence):


tests/unit/tf/core/test_encoder.py: 1 warning

tests/unit/tf/core/test_index.py: 5 warnings

tests/unit/tf/models/test_retrieval.py: 30 warnings

tests/unit/tf/utils/test_batch.py: 4 warnings

tests/unit/tf/utils/test_dataset.py: 1 warning

/var/jenkins_home/workspace/merlin_models/models/merlin/models/utils/dataset.py:75: DeprecationWarning: unique_rows_by_features is deprecated and will be removed in a future version. Please use unique_by_tag instead.

warnings.warn(


tests/unit/tf/models/test_base.py::test_model_pre_post[True]

tests/unit/tf/models/test_base.py::test_model_pre_post[False]

tests/unit/tf/transforms/test_noise.py::test_stochastic_swap_noise[0.1]

tests/unit/tf/transforms/test_noise.py::test_stochastic_swap_noise[0.3]

tests/unit/tf/transforms/test_noise.py::test_stochastic_swap_noise[0.5]

tests/unit/tf/transforms/test_noise.py::test_stochastic_swap_noise[0.7]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/util/dispatch.py:1082: UserWarning: tf.keras.backend.random_binomial is deprecated, and will be removed in a future version.Please use tf.keras.backend.random_bernoulli instead.

return dispatch_target(*args, **kwargs)


tests/unit/tf/models/test_base.py::test_freeze_parallel_block[True]

tests/unit/tf/models/test_base.py::test_freeze_sequential_block

tests/unit/tf/models/test_base.py::test_freeze_unfreeze

tests/unit/tf/models/test_base.py::test_unfreeze_all_blocks

/var/jenkins_home/.local/lib/python3.8/site-packages/keras/optimizers/optimizer_v2/gradient_descent.py:108: UserWarning: The lr argument is deprecated, use learning_rate instead.

super(SGD, self).init(name, **kwargs)


tests/unit/tf/models/test_base.py::test_retrieval_model_query

tests/unit/tf/models/test_base.py::test_retrieval_model_query

tests/unit/tf/models/test_retrieval.py::test_youtube_dnn_v2_export_embeddings

tests/unit/tf/models/test_retrieval.py::test_youtube_dnn_topk_evaluation[True]

tests/unit/tf/models/test_retrieval.py::test_youtube_dnn_topk_evaluation[False]

/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/utils/tf_utils.py:298: DeprecationWarning: This function is deprecated in favor of cupy.from_dlpack

tensor_cupy = cupy.fromDlpack(to_dlpack(tf.convert_to_tensor(tensor)))


tests/unit/tf/models/test_ranking.py::test_deepfm_model_only_categ_feats[False]

tests/unit/tf/models/test_ranking.py::test_deepfm_model_categ_and_continuous_feats[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_3/parallel_block_2/sequential_block_3/sequential_block_2/private__dense_1/dense_1/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_3/parallel_block_2/sequential_block_3/sequential_block_2/private__dense_1/dense_1/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_3/parallel_block_2/sequential_block_3/sequential_block_2/private__dense_1/dense_1/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/models/test_ranking.py::test_wide_deep_model[False]

tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_categorical_one_hot[False]

tests/unit/tf/models/test_ranking.py::test_wide_deep_model_hashed_cross[False]

tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_2/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[True]

tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]

/var/jenkins_home/workspace/merlin_models/models/merlin/models/tf/transforms/features.py:569: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag

warnings.warn(


tests/unit/tf/models/test_ranking.py::test_wide_deep_embedding_custom_inputblock[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/autograph/impl/api.py:371: UserWarning: Please make sure input features to be categorical, detect user_age has no categorical tag

return py_builtins.overload_of(f)(*args)


tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_onehot_multihot_feature_interaction[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_5/sequential_block_9/sequential_block_8/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/models/test_ranking.py::test_wide_deep_model_wide_feature_interaction_multi_optimizer[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape_1:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Reshape:0", shape=(None, 1), dtype=float32), dense_shape=Tensor("gradient_tape/model/parallel_block_4/sequential_block_6/sequential_block_5/private__dense_3/dense_3/embedding_lookup_sparse/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_as_classfication_model[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/bert_block/prepare_transformer_inputs_1/RaggedToTensor/boolean_mask_1/GatherV2:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_1:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_as_classfication_model[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/bert_block/prepare_transformer_inputs_1/RaggedToTensor/boolean_mask_1/GatherV2:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_3:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape_1:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_causal_language_modeling[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/gpt2_block/prepare_transformer_inputs_5/RaggedToTensor/boolean_mask_1/GatherV2:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_1:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_causal_language_modeling[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/gpt2_block/prepare_transformer_inputs_5/RaggedToTensor/boolean_mask_1/GatherV2:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_3:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape_1:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/bert_block/prepare_transformer_inputs_1/RaggedToTensor/boolean_mask_1/GatherV2:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/bert_block/prepare_transformer_inputs_1/RaggedToTensor/boolean_mask/GatherV2:0", shape=(None, 48), dtype=float32), dense_shape=Tensor("gradient_tape/model/bert_block/prepare_transformer_inputs_1/RaggedToTensor/Shape:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/bert_block/replace_masked_embeddings/RaggedWhere/Reshape_3:0", shape=(None,), dtype=int64), values=Tensor("gradient_tape/model/bert_block/replace_masked_embeddings/RaggedWhere/Reshape_2:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/bert_block/replace_masked_embeddings/RaggedWhere/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/bert_block/replace_masked_embeddings/RaggedWhere/RaggedTile_2/Reshape_3:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_1:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/bert_block/replace_masked_embeddings/RaggedWhere/RaggedTile_2/Reshape_3:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_3:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape_1:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling_check_eval_masked[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/gpt2_block/prepare_transformer_inputs_5/RaggedToTensor/boolean_mask_1/GatherV2:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/gpt2_block/prepare_transformer_inputs_5/RaggedToTensor/boolean_mask/GatherV2:0", shape=(None, 48), dtype=float32), dense_shape=Tensor("gradient_tape/model/gpt2_block/prepare_transformer_inputs_5/RaggedToTensor/Shape:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling_check_eval_masked[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/gpt2_block/replace_masked_embeddings/RaggedWhere/Reshape_3:0", shape=(None,), dtype=int64), values=Tensor("gradient_tape/model/gpt2_block/replace_masked_embeddings/RaggedWhere/Reshape_2:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/gpt2_block/replace_masked_embeddings/RaggedWhere/Cast:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling_check_eval_masked[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/gpt2_block/replace_masked_embeddings/RaggedWhere/RaggedTile_2/Reshape_3:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_1:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/tf/transformers/test_block.py::test_transformer_with_masked_language_modeling_check_eval_masked[False]

/var/jenkins_home/.local/lib/python3.8/site-packages/tensorflow/python/framework/indexed_slices.py:444: UserWarning: Converting sparse IndexedSlices(IndexedSlices(indices=Tensor("gradient_tape/model/gpt2_block/replace_masked_embeddings/RaggedWhere/RaggedTile_2/Reshape_3:0", shape=(None,), dtype=int32), values=Tensor("gradient_tape/model/concat_features/RaggedConcat/Slice_3:0", shape=(None, None), dtype=float32), dense_shape=Tensor("gradient_tape/model/concat_features/RaggedConcat/Shape_1:0", shape=(2,), dtype=int32))) to a dense Tensor of unknown shape. This may consume a large amount of memory.

warnings.warn(


tests/unit/torch/block/test_mlp.py::test_mlp_block

/var/jenkins_home/workspace/merlin_models/models/tests/unit/torch/_conftest.py:151: UserWarning: Creating a tensor from a list of numpy.ndarrays is extremely slow. Please consider converting the list to a single numpy.ndarray with numpy.array() before converting to a tensor. (Triggered internally at  ../torch/csrc/utils/tensor_new.cpp:201.)

return {key: torch.tensor(value) for key, value in data.items()}


tests/unit/xgb/test_xgboost.py::test_without_dask_client

tests/unit/xgb/test_xgboost.py::TestXGBoost::test_music_regression

tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs0-DaskDeviceQuantileDMatrix]

tests/unit/xgb/test_xgboost.py::test_gpu_hist_dmatrix[fit_kwargs1-DaskDMatrix]

tests/unit/xgb/test_xgboost.py::TestEvals::test_multiple

tests/unit/xgb/test_xgboost.py::TestEvals::test_default

tests/unit/xgb/test_xgboost.py::TestEvals::test_train_and_valid

tests/unit/xgb/test_xgboost.py::TestEvals::test_invalid_data

/var/jenkins_home/workspace/merlin_models/models/merlin/models/xgb/init.py:344: UserWarning: Ignoring list columns as inputs to XGBoost model: ['item_genres', 'user_genres'].

warnings.warn(f"Ignoring list columns as inputs to XGBoost model: {list_column_names}.")


tests/unit/xgb/test_xgboost.py::TestXGBoost::test_unsupported_objective

/var/jenkins_home/workspace/merlin_models/models/.tox/py38-gpu/lib/python3.8/site-packages/tornado/ioloop.py:350: DeprecationWarning: make_current is deprecated; start the event loop first

self.make_current()


tests/unit/xgb/test_xgboost.py: 14 warnings

/usr/local/lib/python3.8/dist-packages/xgboost/dask.py:884: RuntimeWarning: coroutine 'Client._wait_for_workers' was never awaited

client.wait_for_workers(n_workers)

Enable tracemalloc to get traceback where the object was allocated.

See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info.


tests/unit/xgb/test_xgboost.py: 11 warnings

/usr/local/lib/python3.8/dist-packages/cudf/core/dataframe.py:1183: DeprecationWarning: The default dtype for empty Series will be 'object' instead of 'float64' in a future version. Specify a dtype explicitly to silence this warning.

mask = pd.Series(mask)


-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html


---------- coverage: platform linux, python 3.8.10-final-0 -----------

Name                                                                 Stmts   Miss  Cover


merlin/datasets/init.py                                              2      0   100%

merlin/datasets/advertising/init.py                                  2      0   100%

merlin/datasets/advertising/criteo/init.py                           0      0   100%

merlin/datasets/advertising/criteo/dataset.py                           79     49    38%

merlin/datasets/advertising/criteo/transformed/init.py               0      0   100%

merlin/datasets/ecommerce/init.py                                    4      0   100%

merlin/datasets/ecommerce/aliccp/init.py                             0      0   100%

merlin/datasets/ecommerce/aliccp/dataset.py                            141     87    38%

merlin/datasets/ecommerce/aliccp/raw/init.py                         0      0   100%

merlin/datasets/ecommerce/aliccp/transformed/init.py                 0      0   100%

merlin/datasets/ecommerce/booking/init.py                            0      0   100%

merlin/datasets/ecommerce/booking/dataset.py                           107     80    25%

merlin/datasets/ecommerce/booking/transformed/init.py                0      0   100%

merlin/datasets/ecommerce/dressipi/init.py                           0      0   100%

merlin/datasets/ecommerce/dressipi/dataset.py                           45     37    18%

merlin/datasets/ecommerce/dressipi/preprocessed/init.py              0      0   100%

merlin/datasets/ecommerce/large/init.py                              0      0   100%

merlin/datasets/ecommerce/small/init.py                              0      0   100%

merlin/datasets/ecommerce/transactions/init.py                       0      0   100%

merlin/datasets/entertainment/init.py                                2      0   100%

merlin/datasets/entertainment/movielens/1m-raw/init.py               0      0   100%

merlin/datasets/entertainment/movielens/1m-raw/ratings/init.py       0      0   100%

merlin/datasets/entertainment/movielens/1m/init.py                   0      0   100%

merlin/datasets/entertainment/movielens/25m/init.py                  0      0   100%

merlin/datasets/entertainment/movielens/100k/init.py                 0      0   100%

merlin/datasets/entertainment/movielens/init.py                      0      0   100%

merlin/datasets/entertainment/movielens/dataset.py                     152    122    20%

merlin/datasets/entertainment/music_streaming/init.py                0      0   100%

merlin/datasets/social/init.py                                       0      0   100%

merlin/datasets/synthetic.py                                           147     14    90%

merlin/datasets/testing/init.py                                      0      0   100%

merlin/datasets/testing/sequence_testing/init.py                     0      0   100%

merlin/models/init.py                                                2      0   100%

merlin/models/_version.py                                              354    205    42%

merlin/models/api.py                                                    14      5    64%

merlin/models/config/init.py                                         0      0   100%

merlin/models/config/schema.py                                          62      0   100%

merlin/models/implicit/init.py                                      27      4    85%

merlin/models/io.py                                                     15      0   100%

merlin/models/lightfm/init.py                                       23      0   100%

merlin/models/loader/init.py                                         0      0   100%

merlin/models/loader/backend.py                                        379     41    89%

merlin/models/loader/dataframe_iter.py                                  21     17    19%

merlin/models/loader/tf_utils.py                                        57     27    53%

merlin/models/loader/utils.py                                           40     15    62%

merlin/models/tf/init.py                                            70      0   100%

merlin/models/tf/blocks/init.py                                      0      0   100%

merlin/models/tf/blocks/cross.py                                        44      0   100%

merlin/models/tf/blocks/dlrm.py                                         49      2    96%

merlin/models/tf/blocks/experts.py                                      99     17    83%

merlin/models/tf/blocks/interaction.py                                 108     40    63%

merlin/models/tf/blocks/mlp.py                                         117      7    94%

merlin/models/tf/blocks/optimizer.py                                   173     12    93%

merlin/models/tf/blocks/retrieval/init.py                            0      0   100%

merlin/models/tf/blocks/retrieval/base.py                              169     62    63%

merlin/models/tf/blocks/retrieval/matrix_factorization.py               35      1    97%

merlin/models/tf/blocks/retrieval/two_tower.py                          30      0   100%

merlin/models/tf/blocks/sampling/init.py                             0      0   100%

merlin/models/tf/blocks/sampling/base.py                                29      2    93%

merlin/models/tf/blocks/sampling/cross_batch.py                         46      2    96%

merlin/models/tf/blocks/sampling/in_batch.py                            35      0   100%

merlin/models/tf/blocks/sampling/queue.py                              115     12    90%

merlin/models/tf/core/init.py                                        0      0   100%

merlin/models/tf/core/aggregation.py                                   241     45    81%

merlin/models/tf/core/base.py                                          244     50    80%

merlin/models/tf/core/combinators.py                                   426     53    88%

merlin/models/tf/core/encoder.py                                       175     28    84%

merlin/models/tf/core/index.py                                         104     16    85%

merlin/models/tf/core/prediction.py                                     50      1    98%

merlin/models/tf/core/tabular.py                                       280     29    90%

merlin/models/tf/distributed/init.py                                 0      0   100%

merlin/models/tf/distributed/backend.py                                  9      2    78%

merlin/models/tf/inputs/init.py                                      0      0   100%

merlin/models/tf/inputs/base.py                                         60     10    83%

merlin/models/tf/inputs/continuous.py                                   39      3    92%

merlin/models/tf/inputs/embedding.py                                   458     31    93%

merlin/models/tf/loader.py                                             268     94    65%

merlin/models/tf/losses/init.py                                      4      0   100%

merlin/models/tf/losses/base.py                                          9      0   100%

merlin/models/tf/losses/listwise.py                                     13      0   100%

merlin/models/tf/losses/pairwise.py                                    115      1    99%

merlin/models/tf/metrics/init.py                                     2      0   100%

merlin/models/tf/metrics/evaluation.py                                 105     48    54%

merlin/models/tf/metrics/topk.py                                       198     48    76%

merlin/models/tf/models/init.py                                      0      0   100%

merlin/models/tf/models/base.py                                        753    102    86%

merlin/models/tf/models/benchmark.py                                    16      0   100%

merlin/models/tf/models/ranking.py                                      67      3    96%

merlin/models/tf/models/retrieval.py                                    78      4    95%

merlin/models/tf/models/utils.py                                        10      1    90%

merlin/models/tf/outputs/init.py                                     0      0   100%

merlin/models/tf/outputs/base.py                                       123     17    86%

merlin/models/tf/outputs/classification.py                              91      1    99%

merlin/models/tf/outputs/contrastive.py                                147     10    93%

merlin/models/tf/outputs/regression.py                                   9      0   100%

merlin/models/tf/outputs/sampling/init.py                            0      0   100%

merlin/models/tf/outputs/sampling/base.py                               78     21    73%

merlin/models/tf/outputs/sampling/in_batch.py                           37      1    97%

merlin/models/tf/outputs/sampling/popularity.py                         27      1    96%

merlin/models/tf/outputs/topk.py                                        98      6    94%

merlin/models/tf/prediction_tasks/init.py                            0      0   100%

merlin/models/tf/prediction_tasks/base.py                              207     37    82%

merlin/models/tf/prediction_tasks/classification.py                     68     17    75%

merlin/models/tf/prediction_tasks/multi.py                               7      0   100%

merlin/models/tf/prediction_tasks/next_item.py                          59      6    90%

merlin/models/tf/prediction_tasks/regression.py                         35      2    94%

merlin/models/tf/prediction_tasks/retrieval.py                          73      3    96%

merlin/models/tf/transformers/init.py                                0      0   100%

merlin/models/tf/transformers/block.py                                 101      2    98%

merlin/models/tf/transformers/transforms.py                             63      0   100%

merlin/models/tf/transforms/init.py                                  0      0   100%

merlin/models/tf/transforms/bias.py                                    111      9    92%

merlin/models/tf/transforms/features.py                                435     36    92%

merlin/models/tf/transforms/negative_sampling.py                        77      3    96%

merlin/models/tf/transforms/noise.py                                    43      1    98%

merlin/models/tf/transforms/regularization.py                           17      1    94%

merlin/models/tf/transforms/sequence.py                                282     42    85%

merlin/models/tf/transforms/tensor.py                                  158     13    92%

merlin/models/tf/typing.py                                               7      0   100%

merlin/models/tf/utils/init.py                                       0      0   100%

merlin/models/tf/utils/batch_utils.py                                   85      4    95%

merlin/models/tf/utils/repr_utils.py                                    69      4    94%

merlin/models/tf/utils/search_utils.py                                  34     22    35%

merlin/models/tf/utils/testing_utils.py                                206     36    83%

merlin/models/tf/utils/tf_utils.py                                     209     42    80%

merlin/models/torch/init.py                                         12      0   100%

merlin/models/torch/block/init.py                                    0      0   100%

merlin/models/torch/block/base.py                                      167     32    81%

merlin/models/torch/block/mlp.py                                        38      5    87%

merlin/models/torch/dataset.py                                          68      5    93%

merlin/models/torch/features/init.py                                 0      0   100%

merlin/models/torch/features/base.py                                     4      0   100%

merlin/models/torch/features/continuous.py                              22      0   100%

merlin/models/torch/features/embedding.py                              165     12    93%

merlin/models/torch/features/tabular.py                                 65      8    88%

merlin/models/torch/losses.py                                           28     28     0%

merlin/models/torch/model/init.py                                    0      0   100%

merlin/models/torch/model/base.py                                      286     65    77%

merlin/models/torch/model/prediction_task.py                            24      0   100%

merlin/models/torch/tabular/init.py                                  0      0   100%

merlin/models/torch/tabular/aggregation.py                              75      0   100%

merlin/models/torch/tabular/base.py                                    247     39    84%

merlin/models/torch/tabular/transformations.py                          67      3    96%

merlin/models/torch/typing.py                                            6      0   100%

merlin/models/torch/utils/init.py                                    0      0   100%

merlin/models/torch/utils/data_utils.py                                117    117     0%

merlin/models/torch/utils/examples_utils.py                             39     39     0%

merlin/models/torch/utils/torch_utils.py                                80     22    72%

merlin/models/utils/init.py                                          0      0   100%

merlin/models/utils/constants.py                                         3      0   100%

merlin/models/utils/dataset.py                                          38      4    89%

merlin/models/utils/dependencies.py                                     26     19    27%

merlin/models/utils/doc_utils.py                                        10      0   100%

merlin/models/utils/example_utils.py                                    31      2    94%

merlin/models/utils/misc_utils.py                                      118     90    24%

merlin/models/utils/nvt_utils.py                                        27     24    11%

merlin/models/utils/registry.py                                        101     29    71%

merlin/models/utils/schema_utils.py                                     90     19    79%

merlin/models/xgb/init.py                                          124      4    97%


TOTAL                                                                11552   2332    80%


=========================== short test summary info ============================

SKIPPED [1] tests/unit/datasets/test_advertising.py:20: No data-dir available, pass it through env variable $INPUT_DATA_DIR

SKIPPED [1] tests/unit/datasets/test_ecommerce.py:64: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP

SKIPPED [1] tests/unit/datasets/test_ecommerce.py:80: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP

SKIPPED [1] tests/unit/datasets/test_ecommerce.py:94: ALI-CCP data is not available, pass it through env variable $DATA_PATH_ALICCP

SKIPPED [1] tests/unit/datasets/test_ecommerce.py:115: No data-dir available, pass it through env variable $INPUT_DATA_DIR

SKIPPED [3] tests/unit/datasets/test_entertainment.py:44: No data-dir available, pass it through env variable $INPUT_DATA_DIR

SKIPPED [5] ../../../.local/lib/python3.8/site-packages/tensorflow/python/framework/test_util.py:2746: Not a test.

========= 863 passed, 13 skipped, 1433 warnings in 1695.91s (0:28:15) ==========

___________________________________ summary ____________________________________

py38-gpu: commands succeeded

congratulations :)

GLOB sdist-make: /var/jenkins_home/workspace/merlin_models/models/setup.py

py38-multi-gpu inst-nodeps: /var/jenkins_home/workspace/merlin_models/models/.tox/.tmp/package/2/merlin-models-0.9.0+38.g26ccdbb7.zip

WARNING: Discarding $PYTHONPATH from environment, to override specify PYTHONPATH in 'passenv' in your configuration.

py38-multi-gpu installed: absl-py==1.2.0,aiohttp==3.8.1,aiosignal==1.2.0,alabaster==0.7.12,alembic==1.8.1,anyio==3.6.1,appdirs==1.4.4,argon2-cffi==21.3.0,argon2-cffi-bindings==21.2.0,astroid==2.5.6,asttokens==2.0.8,astunparse==1.6.3,asv==0.5.1,asvdb==0.4.2,async-timeout==4.0.2,attrs==22.1.0,autopage==0.5.1,awscli==1.27.5,Babel==2.10.3,backcall==0.2.0,beautifulsoup4==4.11.1,betterproto==1.2.5,black==20.8b1,bleach==5.0.1,bokeh==3.0.1,boto3==1.24.75,botocore==1.29.5,Brotli==1.0.9,build==0.9.0,cachetools==5.2.0,certifi==2019.11.28,cffi==1.15.1,chardet==3.0.4,charset-normalizer==2.1.1,check-manifest==0.48,clang==5.0,click==8.1.3,cliff==4.0.0,cloudpickle==2.2.0,cmaes==0.9.0,cmake==3.24.1.1,cmd2==2.4.2,colorama==0.4.4,colorlog==6.7.0,contourpy==1.0.5,coverage==6.5.0,cuda-python==11.7.1,cupy-cuda117==10.6.0,cycler==0.11.0,Cython==0.29.32,dask==2022.1.1,dbus-python==1.2.16,debugpy==1.6.3,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.5.1,distlib==0.3.6,distributed==2022.5.1,distro==1.7.0,dm-tree==0.1.6,docker-pycreds==0.4.0,docutils==0.16,emoji==1.7.0,entrypoints==0.4,execnet==1.9.0,executing==1.0.0,faiss==1.7.2,faiss-gpu==1.7.2,fastai==2.7.9,fastapi==0.85.0,fastavro==1.6.1,fastcore==1.5.27,fastdownload==0.0.7,fastjsonschema==2.16.1,fastprogress==1.0.3,fastrlock==0.8,feast==0.19.4,fiddle==0.2.2,filelock==3.8.0,flake8==5.0.4,flatbuffers==1.12,fonttools==4.37.3,frozenlist==1.3.1,fsspec==2022.5.0,gast==0.4.0,gevent==21.12.0,geventhttpclient==2.0.2,gitdb==4.0.9,GitPython==3.1.27,google==3.0.0,google-api-core==2.10.1,google-auth==2.11.1,google-auth-oauthlib==0.4.6,google-pasta==0.2.0,googleapis-common-protos==1.52.0,graphviz==0.20.1,greenlet==1.1.3,grpcio==1.41.0,grpcio-channelz==1.49.0,grpcio-reflection==1.48.1,grpclib==0.4.3,h11==0.13.0,h2==4.1.0,h5py==3.7.0,HeapDict==1.0.1,horovod==0.26.1,hpack==4.0.0,httptools==0.5.0,hugectr2onnx==0.0.0,huggingface-hub==0.9.1,hyperframe==6.0.1,idna==2.8,imagesize==1.4.1,implicit==0.6.1,importlib-metadata==4.12.0,importlib-resources==5.9.0,iniconfig==1.1.1,interrogate==1.5.0,ipykernel==6.15.3,ipython==8.5.0,ipython-genutils==0.2.0,ipywidgets==7.7.0,isort==5.10.1,jedi==0.18.1,Jinja2==3.1.2,jmespath==1.0.1,joblib==1.2.0,json5==0.9.10,jsonschema==4.16.0,jupyter==1.0.0,jupyter-cache==0.4.3,jupyter-console==6.4.4,jupyter-core==4.11.1,jupyter-server==1.18.1,jupyter-server-mathjax==0.2.5,jupyter-sphinx==0.3.2,jupyter_client==7.3.5,jupyterlab==3.4.7,jupyterlab-pygments==0.2.2,jupyterlab-widgets==1.1.0,jupyterlab_server==2.15.1,keras==2.9.0,Keras-Preprocessing==1.1.2,kiwisolver==1.4.4,lazy-object-proxy==1.8.0,libclang==14.0.6,libcst==0.4.7,lightfm==1.16,lightgbm==3.3.2,linkify-it-py==1.0.3,llvmlite==0.39.1,locket==1.0.0,lxml==4.9.1,Mako==1.2.3,Markdown==3.4.1,markdown-it-py==1.1.0,MarkupSafe==2.1.1,matplotlib==3.6.0,matplotlib-inline==0.1.6,mccabe==0.7.0,mdit-py-plugins==0.2.8,merlin-core==0.6.0+1.g5926fcf,merlin-dataloader==0.0.2,merlin-models==0.9.0+38.g26ccdbb7,merlin-systems==0.5.0+4.g15074ad,mistune==2.0.4,mmh3==3.0.0,mpi4py==3.1.3,msgpack==1.0.4,multidict==6.0.2,mypy==0.982,mypy-extensions==0.4.3,myst-nb==0.13.2,myst-parser==0.15.2,natsort==8.1.0,nbclassic==0.4.3,nbclient==0.6.8,nbconvert==7.0.0,nbdime==3.1.1,nbformat==5.5.0,nest-asyncio==1.5.5,ninja==1.10.2.3,notebook==6.4.12,notebook-shim==0.1.0,numba==0.56.2,numpy==1.22.4,nvidia-pyindex==1.0.9,# Editable install with no version control (nvtabular==1.4.0+8.g95e12d347),-e /usr/local/lib/python3.8/dist-packages,nvtx==0.2.5,oauthlib==3.2.1,oldest-supported-numpy==2022.8.16,onnx==1.12.0,onnxruntime==1.11.1,opt-einsum==3.3.0,optuna==3.0.3,packaging==21.3,pandas==1.3.5,pandavro==1.5.2,pandocfilters==1.5.0,parso==0.8.3,partd==1.3.0,pathspec==0.10.1,pathtools==0.1.2,pbr==5.11.0,pep517==0.13.0,pexpect==4.8.0,pickleshare==0.7.5,Pillow==9.2.0,pkgutil_resolve_name==1.3.10,platformdirs==2.5.2,plotly==5.11.0,pluggy==1.0.0,prettytable==3.5.0,prometheus-client==0.14.1,promise==2.3,prompt-toolkit==3.0.31,proto-plus==1.19.6,protobuf==3.19.5,psutil==5.9.2,ptyprocess==0.7.0,pure-eval==0.2.2,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pybind11==2.10.0,pycodestyle==2.9.1,pycparser==2.21,pydantic==1.10.2,pydot==1.4.2,pyflakes==2.5.0,Pygments==2.13.0,PyGObject==3.36.0,pynvml==11.4.1,pyparsing==3.0.9,pyperclip==1.8.2,pyrsistent==0.18.1,pytest==7.1.3,pytest-cov==4.0.0,pytest-xdist==3.0.2,python-apt==2.0.0+ubuntu0.20.4.8,python-dateutil==2.8.2,python-dotenv==0.21.0,python-rapidjson==1.8,pytz==2022.2.1,PyYAML==5.4.1,pyzmq==24.0.0,qtconsole==5.4.0,QtPy==2.2.1,regex==2022.9.13,requests==2.22.0,requests-oauthlib==1.3.1,requests-unixsocket==0.2.0,rsa==4.7.2,s3fs==2022.2.0,s3transfer==0.6.0,sacremoses==0.0.53,scikit-build==0.15.0,scikit-learn==1.1.2,scipy==1.8.1,seedir==0.3.0,Send2Trash==1.8.0,sentry-sdk==1.9.8,setproctitle==1.3.2,setuptools-scm==7.0.5,shortuuid==1.0.9,six==1.15.0,sklearn==0.0,smmap==5.0.0,sniffio==1.3.0,snowballstemmer==2.2.0,sortedcontainers==2.4.0,soupsieve==2.3.2.post1,Sphinx==5.3.0,sphinx-multiversion==0.2.4,sphinx-togglebutton==0.3.1,sphinx_external_toc==0.3.0,sphinxcontrib-applehelp==1.0.2,sphinxcontrib-copydirs @ git+https://github.com/mikemckiernan/sphinxcontrib-copydirs.git@bd8c5d79b3f91cf5f1bb0d6995aeca3fe84b670e,sphinxcontrib-devhelp==1.0.2,sphinxcontrib-htmlhelp==2.0.0,sphinxcontrib-jsmath==1.0.1,sphinxcontrib-qthelp==1.0.3,sphinxcontrib-serializinghtml==1.1.5,SQLAlchemy==1.4.43,stack-data==0.5.0,starlette==0.20.4,stevedore==4.1.0,stringcase==1.2.0,supervisor==4.1.0,tabulate==0.8.10,tblib==1.7.0,tdqm==0.0.1,tenacity==8.0.1,tensorboard==2.9.1,tensorboard-data-server==0.6.1,tensorboard-plugin-wit==1.8.1,tensorflow==2.9.2,tensorflow-estimator==2.9.0,tensorflow-gpu==2.9.2,tensorflow-io-gcs-filesystem==0.27.0,tensorflow-metadata==1.10.0,tensorflow-ranking==0.5.1,tensorflow-serving-api==2.9.2,termcolor==2.0.1,terminado==0.15.0,testbook==0.4.2,threadpoolctl==3.1.0,tinycss2==1.1.1,tokenizers==0.10.3,toml==0.10.2,tomli==2.0.1,toolz==0.12.0,torch==1.12.1+cu113,torchmetrics==0.3.2,tornado==6.2,tox==3.26.0,tqdm==4.64.1,traitlets==5.4.0,transformers==4.12.0,transformers4rec==0.1.12+2.gbcc939255,treelite==2.3.0,treelite-runtime==2.3.0,tritonclient==2.25.0,typed-ast==1.5.4,typing-inspect==0.8.0,typing_extensions==4.3.0,uc-micro-py==1.0.1,urllib3==1.26.12,uvicorn==0.18.3,uvloop==0.17.0,versioneer==0.20,virtualenv==20.16.5,wandb==0.13.3,watchfiles==0.17.0,wcwidth==0.2.5,webencodings==0.5.1,websocket-client==1.4.1,websockets==10.3,Werkzeug==2.2.2,widgetsnbextension==3.6.0,wrapt==1.12.1,xgboost==1.6.2,xyzservices==2022.9.0,yarl==1.8.1,zict==2.2.0,zipp==3.8.1,zope.event==4.5.0,zope.interface==5.4.0

py38-multi-gpu run-test-pre: PYTHONHASHSEED='223156988'

py38-multi-gpu run-test: commands[0] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/core.git

Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com

Collecting git+https://github.com/NVIDIA-Merlin/core.git

Cloning https://github.com/NVIDIA-Merlin/core.git to /tmp/pip-req-build-9c9vd7b_

Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/core.git /tmp/pip-req-build-9c9vd7b_

Resolved https://github.com/NVIDIA-Merlin/core.git to commit 64755badd4e5756601f66e7e568201aedb8a4144

Installing build dependencies: started

Installing build dependencies: finished with status 'done'

Getting requirements to build wheel: started

Getting requirements to build wheel: finished with status 'done'

Preparing metadata (pyproject.toml): started

Preparing metadata (pyproject.toml): finished with status 'done'

Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (0.55.1)

Requirement already satisfied: distributed>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (2022.3.0)

Requirement already satisfied: fsspec==2022.5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (2022.5.0)

Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (1.3.5)

Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (3.19.5)

Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (1.2.5)

Requirement already satisfied: dask>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+7.g64755ba) (2022.3.0)

Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (21.3)

Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (1.10.0)

Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (7.0.0)

Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+7.g64755ba) (4.64.1)

Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (0.4.3)

Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (1.2.0)

Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.2.0)

Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (0.12.0)

Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.2.0)

Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (5.4.1)

Requirement already satisfied: tornado>=6.0.3 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (6.2)

Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.7.0)

Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.0.0)

Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.0.4)

Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (3.1.2)

Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.4.0)

Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (5.8.0)

Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (8.1.3)

Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+7.g64755ba) (0.38.1)

Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+7.g64755ba) (1.20.3)

Requirement already satisfied: setuptools in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+7.g64755ba) (65.4.1)

Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core==0.8.0+7.g64755ba) (3.0.9)

Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+7.g64755ba) (2022.2.1)

Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+7.g64755ba) (2.8.2)

Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.8.0+7.g64755ba) (1.2.0)

Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.8.0+7.g64755ba) (1.52.0)

Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (0.2.1)

Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+7.g64755ba) (1.15.0)

Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (1.0.1)

Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (4.1.0)

Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (6.0.2)

Requirement already satisfied: MarkupSafe>=2.0 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from jinja2->distributed>=2022.3.0->merlin-core==0.8.0+7.g64755ba) (2.0.1)

Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (4.0.0)

Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.8.0+7.g64755ba) (6.0.1)


[notice] A new release of pip available: 22.2.2 -> 22.3.1

[notice] To update, run: pip install --upgrade pip

py38-multi-gpu run-test: commands[1] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/nvtabular.git

Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com

Collecting git+https://github.com/NVIDIA-Merlin/nvtabular.git

Cloning https://github.com/NVIDIA-Merlin/nvtabular.git to /tmp/pip-req-build-chdv0esh

Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/nvtabular.git /tmp/pip-req-build-chdv0esh

Resolved https://github.com/NVIDIA-Merlin/nvtabular.git to commit ba4c14159a8e858c8998d4158a4376e65a8fa266

Installing build dependencies: started

Installing build dependencies: finished with status 'done'

Getting requirements to build wheel: started

Getting requirements to build wheel: finished with status 'done'

Preparing metadata (pyproject.toml): started

Preparing metadata (pyproject.toml): finished with status 'done'

Requirement already satisfied: scipy in /usr/local/lib/python3.8/dist-packages (from nvtabular==1.6.0+4.gba4c1415) (1.8.1)

Requirement already satisfied: merlin-dataloader>=0.0.2 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from nvtabular==1.6.0+4.gba4c1415) (0.0.2)

Requirement already satisfied: merlin-core>=0.2.0 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from nvtabular==1.6.0+4.gba4c1415) (0.8.0+7.g64755ba)

Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.55.1)

Requirement already satisfied: distributed>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.3.0)

Requirement already satisfied: fsspec==2022.5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.5.0)

Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.3.5)

Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (3.19.5)

Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.5)

Requirement already satisfied: dask>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.3.0)

Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (21.3)

Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.10.0)

Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (7.0.0)

Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (4.64.1)

Requirement already satisfied: numpy<1.25.0,>=1.17.3 in /var/jenkins_home/.local/lib/python3.8/site-packages (from scipy->nvtabular==1.6.0+4.gba4c1415) (1.20.3)

Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.4.3)

Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.0)

Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.2.0)

Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.12.0)

Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.0)

Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (5.4.1)

Requirement already satisfied: tornado>=6.0.3 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (6.2)

Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.7.0)

Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.0.0)

Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.0.4)

Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (3.1.2)

Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.4.0)

Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (5.8.0)

Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (8.1.3)

Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.38.1)

Requirement already satisfied: setuptools in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (65.4.1)

Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (3.0.9)

Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2022.2.1)

Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.8.2)

Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.2.0)

Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.52.0)

Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (0.2.1)

Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.15.0)

Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (1.0.1)

Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (4.1.0)

Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (6.0.2)

Requirement already satisfied: MarkupSafe>=2.0 in ./.tox/py38-multi-gpu/lib/python3.8/site-packages (from jinja2->distributed>=2022.3.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (2.0.1)

Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (4.0.0)

Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+4.gba4c1415) (6.0.1)


[notice] A new release of pip available: 22.2.2 -> 22.3.1

[notice] To update, run: pip install --upgrade pip

py38-multi-gpu run-test: commands[2] | horovodrun -np 2 sh examples/usecases/multi-gpu/hvd_wrapper.sh python -m pytest -m horovod -rxs tests/unit

[1,0]:�[1m============================= test session starts ==============================�[0m

[1,0]:platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0

[1,1]:�[1m============================= test session starts ==============================�[0m

[1,1]:platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0

[1,0]:cachedir: .tox/py38-multi-gpu/.pytest_cache

[1,0]:rootdir: /var/jenkins_home/workspace/merlin_models/models, configfile: pyproject.toml

[1,0]:plugins: anyio-3.5.0, xdist-3.0.2, cov-4.0.0

[1,1]:cachedir: .tox/py38-multi-gpu/.pytest_cache

[1,1]:rootdir: /var/jenkins_home/workspace/merlin_models/models, configfile: pyproject.toml

[1,1]:plugins: anyio-3.5.0, xdist-3.0.2, cov-4.0.0

[1,0]:�[1mcollecting ... �[0m[1,1]:�[1mcollecting ... �[0m[1,1]:�[1m

collecting 36 items                                                            �[0m[1,0]:�[1m

collecting 36 items                                                            �[0m[1,0]:�[1m

collecting 548 items                                                           �[0m[1,1]:�[1m

collecting 548 items                                                           �[0m[1,0]:�[1m

collected 876 items / 873 deselected / 3 selected                              �[0m

[1,0]:

[1,0]:tests/unit/tf/horovod/test_horovod.py [1,1]:�[1m

collected 876 items / 873 deselected / 3 selected                              �[0m

[1,1]:

[1,1]:tests/unit/tf/horovod/test_horovod.py [1,1]:�[32m.�[0m[1,0]:�[32m.�[0m[1,1]:�[32m.�[0m[1,0]:�[32m.�[0m[1,1]:�[32m.�[0m[1,1]:�[33m                                [100%]�[0m[1,1]:

[1,1]:

[1,1]:�[33m=============================== warnings summary ===============================�[0m

[1,1]:../../../../../usr/lib/python3/dist-packages/requests/init.py:89

[1,1]:  /usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!

[1,1]:    warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/flatbuffers/compat.py:19

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/flatbuffers/compat.py:19: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses

[1,1]:    import imp

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:36

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:36: DeprecationWarning: NEAREST is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.NEAREST or Dither.NONE instead.

[1,1]:    'nearest': pil_image.NEAREST,

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:37

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:37: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.

[1,1]:    'bilinear': pil_image.BILINEAR,

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:38

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:38: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.

[1,1]:    'bicubic': pil_image.BICUBIC,

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:39

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:39: DeprecationWarning: HAMMING is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.HAMMING instead.

[1,1]:    'hamming': pil_image.HAMMING,

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:40

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:40: DeprecationWarning: BOX is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BOX instead.

[1,1]:    'box': pil_image.BOX,

[1,1]:

[1,1]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:41

[1,1]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:41: DeprecationWarning: LANCZOS is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.LANCZOS instead.

[1,1]:    'lanczos': pil_image.LANCZOS,

[1,1]:

[1,1]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_dlrm[True]

[1,1]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_dlrm[False]

[1,1]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,1]:  /var/jenkins_home/workspace/merlin_models/models/.tox/py38-multi-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.ITEM_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.ITEM: 'item'>, <Tags.ID: 'id'>].

[1,1]:    warnings.warn([1,1]:

[1,1]:

[1,1]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,1]:  /var/jenkins_home/workspace/merlin_models/models/.tox/py38-multi-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.SESSION_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.SESSION: 'session'>, <Tags.ID: 'id'>].

[1,1]:    warnings.warn(

[1,1]:

[1,1]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,1]:  /var/jenkins_home/workspace/merlin_models/models/.tox/py38-multi-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.USER_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.USER: 'user'>, <Tags.ID: 'id'>].

[1,1]:    warnings.warn([1,1]:

[1,1]:

[1,1]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,1]:  /tmp/autograph_generated_file7meucsyr.py:8: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead

[1,1]:    ag.converted_call(ag__.ld(warnings).warn, ("The 'warn' method is deprecated, use 'warning' instead", ag__.ld(DeprecationWarning), 2), None, fscope)

[1,1]:

[1,1]:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

[1,1]:�[33m=============== �[32m3 passed�[0m, �[33m�[1m873 deselected�[0m, �[33m�[1m14 warnings�[0m�[33m in 46.75s�[0m�[33m ================�[0m

[1,0]:�[32m.�[0m[1,0]:�[33m                                [100%]�[0m[1,0]:

[1,0]:

[1,0]:�[33m=============================== warnings summary ===============================�[0m

[1,0]:../../../../../usr/lib/python3/dist-packages/requests/init.py:89

[1,0]:  /usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!

[1,0]:    warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/flatbuffers/compat.py:19

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/flatbuffers/compat.py:19: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses

[1,0]:    import imp[1,0]:

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:36

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:36: DeprecationWarning: NEAREST is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.NEAREST or Dither.NONE instead.

[1,0]:    'nearest': pil_image.NEAREST,

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:37

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:37: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.

[1,0]:    'bilinear': pil_image.BILINEAR,

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:38

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:38: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.

[1,0]:    'bicubic': pil_image.BICUBIC,

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:39

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:39: DeprecationWarning: HAMMING is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.HAMMING instead.

[1,0]:    'hamming': pil_image.HAMMING,

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:40

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:40: DeprecationWarning: BOX is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BOX instead.

[1,0]:    'box': pil_image.BOX,

[1,0]:

[1,0]:../../../.local/lib/python3.8/site-packages/keras/utils/image_utils.py:41

[1,0]:  /var/jenkins_home/.local/lib/python3.8/site-packages/keras/utils/image_utils.py:41: DeprecationWarning: LANCZOS is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.LANCZOS instead.

[1,0]:    'lanczos': pil_image.LANCZOS,

[1,0]:

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_dlrm[True]

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_dlrm[False]

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,0]:  /var/jenkins_home/workspace/merlin_models/models/.tox/py38-multi-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.ITEM_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.ITEM: 'item'>, <Tags.ID: 'id'>].

[1,0]:    warnings.warn(

[1,0]:

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,0]:  /var/jenkins_home/workspace/merlin_models/models/.tox/py38-multi-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.SESSION_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.SESSION: 'session'>, <Tags.ID: 'id'>].

[1,0]:    warnings.warn(

[1,0]:

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,0]:  /var/jenkins_home/workspace/merlin_models/models/.tox/py38-multi-gpu/lib/python3.8/site-packages/merlin/schema/tags.py:148: UserWarning: Compound tags like Tags.USER_ID have been deprecated and will be removed in a future version. Please use the atomic versions of these tags, like [<Tags.USER: 'user'>, <Tags.ID: 'id'>].

[1,0]:    warnings.warn(

[1,0]:

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,0]:tests/unit/tf/horovod/test_horovod.py::test_horovod_multigpu_two_tower

[1,0]:  /tmp/autograph_generated_file_9higbst.py:8: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead

[1,0]:    ag.converted_call(ag__.ld(warnings).warn, ("The 'warn' method is deprecated, use 'warning' instead", ag__.ld(DeprecationWarning), 2), None, fscope)

[1,0]:

[1,0]:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

[1,0]:�[33m=============== �[32m3 passed�[0m, �[33m�[1m873 deselected�[0m, �[33m�[1m16 warnings�[0m�[33m in 51.41s�[0m�[33m ================�[0m

___________________________________ summary ____________________________________

py38-multi-gpu: commands succeeded

congratulations :)

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/models/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[merlin_models] $ /bin/bash /tmp/jenkins8905150570620259049.sh

@marcromeyn marcromeyn merged commit 9fb88b7 into main Nov 9, 2022
@marcromeyn marcromeyn deleted the topk-encoder branch November 9, 2022 13:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@marcromeyn marcromeyn marcromeyn approved these changes

Assignees

@sararb sararb

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[Task] Improve the flexibility of the topk-encoder class
3 participants
@sararb @nvidia-merlin-bot @marcromeyn