WOS-AI

Welcome to our repository! Here, we provide setup scripts and artifacts for Windows on Snapdragon developer workflows(ONNX and QNN). The setup script should be executed in Powershell Administrative mode.

Run the following to assign the working directory to $DIR_PATH, serves as the root working directory(by default C:\WoS_AI).

$DIR_PATH = "C:\WoS_AI"

For ONNX Runtime Setup(ORT):

Run the following command to download the ort_setup script.

Invoke-WebRequest -O ort_setup.ps1 https://raw.githubusercontent.com/quic/wos-ai/refs/heads/main/Scripts/ort_setup.ps1

ORT-CPU EP Setup:

powershell -command "&{. .\ort_setup.ps1; ORT_CPU_Setup -rootDirPath $DIR_PATH}"

ORT-DML EP (GPU) Setup:

powershell -command "&{. .\ort_setup.ps1; ORT_DML_Setup -rootDirPath $DIR_PATH}"

ORT-QNN EP Setup:

powershell -command "&{. .\ort_setup.ps1; ORT_QNN_Setup -rootDirPath $DIR_PATH}"

Hugging Face Optimum + ONNX-RT EP Setup:

powershell -command "&{. .\ort_setup.ps1; ORT_HF_Setup -rootDirPath $DIR_PATH}"

For DML NPU Setup:

Run the following command to download the dml_npu_setup script.

Invoke-WebRequest -O dml_npu_setup.ps1 https://raw.githubusercontent.com/quic/wos-ai/refs/heads/main/Scripts/dml_npu_setup.ps1

DML NPU Setup:

powershell -command "& {.\dml_npu_setup.ps1}"

For AI Engine Direct setup(QNN):

Run the following command to download the qnn_setup script.

Invoke-WebRequest -O qnn_setup.ps1 https://raw.githubusercontent.com/quic/wos-ai/refs/heads/main/Scripts/qnn_setup.ps1

QNN Setup:

powershell  -command "&{. .\qnn_setup.ps1; QNN_Setup -rootDirPath $DIR_PATH}"

For MLC LMM Setup:

Run the following command to download the mlc_llm_setup script.

Invoke-WebRequest -O mlc_setup.ps1 https://raw.githubusercontent.com/quic/wos-ai/refs/heads/main/Scripts/mlc_setup.ps1

MLC LLM Setup:

powershell -command "&{. .\mlc_setup.ps1; MLC_LLM_Setup -rootDirPath $DIR_PATH}"

License Information

This project is licensed under the BSD-3-Clause License. For the full license text, please refer to the LICENSE file in this repository.