Benchmark speed between OpenAI and OpenLLM #769
Unanswered
louis030195
asked this question in
Q&A
Replies: 1 comment
-
|
I'm not sure if I understand the questions, but this is more like comparing apples to oranges. Are you comparing gpt4 against llama running with vllm? If you want to compare pure tps then I don't have a number on my hands atm. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Curious, are there benchmarks comparing speed between OpenAI and OpenLLM in terms of token/s?
Beta Was this translation helpful? Give feedback.
All reactions