Error while importing tensorrt_llm

[Aaryanverma]

After installation, getting error while importing tensorrt_llm:

ImportError: /opt/conda/lib/python3.10/site-packages/tensorrt_llm/bindings.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN3c106detail14torchCheckFailEPKcS2_jRKSs

I was trying to convert phi-3.5-vision-instruct model using tensorrt_llm, installed the requirements from this location:
https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/phi

Environment: Kaggle Notebook (T4 GPU)

pls help, how to install and run this code in above environment?

[Superjomn]

Can you try a clean build following the build-on-linux doc? Sometimes a legacy build with outdated Docker images may cause such an issue. @Aaryanverma