Error while importing tensorrt_llm #2380
Labels
installation
question
Further information is requested
triaged
Issue has been triaged by maintainers
After installation, getting error while importing tensorrt_llm:
ImportError: /opt/conda/lib/python3.10/site-packages/tensorrt_llm/bindings.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN3c106detail14torchCheckFailEPKcS2_jRKSs
I was trying to convert phi-3.5-vision-instruct model using tensorrt_llm, installed the requirements from this location:
https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/phi
Environment: Kaggle Notebook (T4 GPU)
pls help, how to install and run this code in above environment?
The text was updated successfully, but these errors were encountered: