Skip to content

Releases: friendliai/LLMServingPerfEvaluator

Release v0.0.5 πŸš€

28 Aug 09:09
Compare
Choose a tag to compare
  • Update friendli-client version >= 1.5.3
  • Fix logic for normal distribution dummy dataset

Release v0.0.4 πŸš€

19 Jul 06:04
Compare
Choose a tag to compare
  • Handle aiohttp.ClientOSError when evaluating vLLM on high RPS.
  • Handle invalid unicode by replacing REPLACEMENT CHARACTER(U+FFFD).
  • Hofix for generating dummy dataset.

Release v0.0.3 πŸš€

27 Jun 04:33
Compare
Choose a tag to compare
  • Update vLLM & Friendli comparision example

Full Changelog: v0.0.2...v0.0.3

Release v0.0.2 πŸš€

19 Jun 08:17
Compare
Choose a tag to compare
  • support gRPC request for Friendli engine.

Release v0.0.1 πŸš€

22 May 10:50
Compare
Choose a tag to compare