-
Notifications
You must be signed in to change notification settings - Fork 6.8k
[1.x] TensorRT: add INT8 with calibration #19011
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -1069,6 +1069,22 @@ unittest_ubuntu_python3_gpu_nocudnn() { | |
nosetests-3.4 $NOSE_COVERAGE_ARGUMENTS $NOSE_TIMER_ARGUMENTS --with-xunit --xunit-file nosetests_gpu.xml --verbose tests/python/gpu | ||
} | ||
|
||
unittest_ubuntu_tensorrt_gpu() { | ||
set -ex | ||
export PYTHONPATH=./python/ | ||
export MXNET_STORAGE_FALLBACK_LOG_VERBOSE=0 | ||
export MXNET_SUBGRAPH_VERBOSE=0 | ||
export LD_LIBRARY_PATH=/work/mxnet/lib:$LD_LIBRARY_PATH | ||
export CUDNN_VERSION=${CUDNN_VERSION:-7.0.3} | ||
export MXNET_ENABLE_CYTHON=0 | ||
export DMLC_LOG_STACK_TRACE_DEPTH=10 | ||
pip3 install --extra-index-url https://developer.download.nvidia.com/compute/redist nvidia-dali-cuda100==0.24 | ||
wget -nc http://data.mxnet.io/data/val_256_q90.rec | ||
python3.6 tests/python/tensorrt/rec2idx.py val_256_q90.rec val_256_q90.idx | ||
nosetests-3.4 $NOSE_COVERAGE_ARGUMENTS $NOSE_TIMER_ARGUMENTS --with-xunit --xunit-file nosetests_trt_gpu.xml --verbose --nocapture tests/python/tensorrt/ | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. in mxnet we switched to pytest and are no longer using nose. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I missed that discussion, can you point me to the RFC so I can catch up? There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I forgot to add the [1.x] tag, this is 1.x PR, where we still use nosetests There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. @szha is this fine to leave it as nosetests as this is the 1.8 branch? |
||
rm val_256_q90* | ||
} | ||
|
||
# quantization gpu currently only runs on P3 instances | ||
# need to separte it from unittest_ubuntu_python3_gpu() | ||
unittest_ubuntu_python3_quantization_gpu() { | ||
|
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -32,4 +32,3 @@ | |
from . import io | ||
from . import quantization | ||
from . import quantization as quant | ||
from . import tensorrt |
This file was deleted.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@leezu could you assist reviewing this PR? I think the structure wrt installation of packages and creating a new job might not be in line.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this address returns 404 for me: https://developer.download.nvidia.com/compute/redist
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
https://developer.download.nvidia.com/compute/redist isn't supposed to be accessed by itself
The pip install line is the standard way of installing DALI:
https://docs.nvidia.com/deeplearning/dali/user-guide/docs/installation.html