Portable LLM - A rust library for LLM inference
-
Updated
Apr 13, 2024 - Rust
#
cpu-inference
Here are 2 public repositories matching this topic...
rust api wrapper for llm-inference chatllm.cpp
rust chatbot inference bindings api-wrapper llama quantization gemma mistral cpu-inference llm llms chatllm ggml llm-inference qwen
-
Updated
Nov 27, 2024 - Rust
Improve this page
Add a description, image, and links to the cpu-inference topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the cpu-inference topic, visit your repo's landing page and select "manage topics."