OpenVINO Torch-ORT Beta Preview v0.5 Release

Description:

OpenVINO Torch-ORT v0.5 Beta Preview Release based on the latest OpenVINO™ 2022.1 Release.

Announcement:

ONNX Runtime for PyTorch is now extended to support PyTorch model inference using ONNX Runtime.
It is available via the torch-ort-inference python package. This preview package enables OpenVINO™ Execution Provider for ONNX Runtime by default for accelerating inference on various Intel® CPUs, Intel® integrated GPUs, and Intel® Movidius™ Vision Processing Units - referred to as VPU.

Requirements:

Ubuntu 18.04, 20.04
Python 3.7, 3.8, 3.9
pip >= 22.0.4
torch >= 1.12.0
protobuf == 3.20.1

Installation steps:

Install onnxruntime-openvino

pip install onnxruntime_openvino -f https://github.com/intel-staging/ort/releases/tag/v0.5

Install torch-ort-inference

pip install https://github.com/intel-staging/ort/releases/download/v0.5/torch_ort_inference-1.12.0-py3-none-any.whl

Run BERT sample:

Please refer to Readme to run the BERT sample.