Skip to content

v0.1.0

Compare
Choose a tag to compare
@github-actions github-actions released this 01 Jun 23:20
· 77 commits to main since this release

Aggregated Health Status Responses

Paddler aggregates all the underlying llama.cpp health statuses. When you check the /health endpoint, it reports aggregated results, making it a drop-in replacement for the llama.cpp server itself (in a sense that you can start making requests to Paddler instead of llama.cpp and things will work the same way).

paddler_aggregate