ZJLi2013 / auto_llm_bench Public

Notifications You must be signed in to change notification settings
Fork 2
Star 2

just another bench scripts for llm inference bench among different frameworks & GPUs

2 stars 2 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 7 Commits
serving		serving
trtllm		trtllm
vllm		vllm
README.md		README.md

Repository files navigation

auto_llm_bench

just another bench scripts for llm inference bench among different frameworks & GPUs

About

just another bench scripts for llm inference bench among different frameworks & GPUs

Report repository

Releases

No releases published

Packages

No packages published

Languages