Skip to content

fix: Avoid thread starvation on many concurrent requests by making use of asyncio to lock llama_proxy context #2856

fix: Avoid thread starvation on many concurrent requests by making use of asyncio to lock llama_proxy context

fix: Avoid thread starvation on many concurrent requests by making use of asyncio to lock llama_proxy context #2856

Re-run triggered December 6, 2024 10:02
Status Success
Total duration 14m 6s
Artifacts

test.yaml

on: pull_request
download-model
34s
download-model
build-macos-metal
3m 15s
build-macos-metal
Matrix: build-linux
Matrix: build-macos
Matrix: build-windows
Fit to window
Zoom out
Zoom in

Annotations

5 warnings
download-model
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
build-linux (3.9)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
build-linux (3.12)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
build-linux (3.11)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
build-linux (3.10)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636