Skip to content

v0.4.0
Compare
Choose a tag to compare
@ajindal1 ajindal1 released this 22 Aug 20:26
v0.4.0
b77e768
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Release Notes

  • Support for new models such as Qwen 2, LLaMA 3.1, Gemma 2, Phi-3 small on CPU
  • Support to build already-quantized models that were quantized with AWQ or GPTQ
  • Performance improvements for Intel and Arm CPU
  • Packing and language binding
    • Added Java bindings (build from source)
    • Separate OnnxRuntime.dll and directml.dll out of GenAI package to improve usability
    • Publish packages for Win Arm
    • Support for Android (build from source)
Assets 9
Loading