Releases: friendliai/LLMServingPerfEvaluator
Releases Β· friendliai/LLMServingPerfEvaluator
Release v0.0.5 π
- Update
friendli-client
version >= 1.5.3 - Fix logic for normal distribution dummy dataset
Release v0.0.4 π
- Handle
aiohttp.ClientOSError
when evaluating vLLM on high RPS. - Handle invalid unicode by replacing REPLACEMENT CHARACTER(U+FFFD).
- Hofix for generating dummy dataset.
Release v0.0.3 π
- Update vLLM & Friendli comparision example
Full Changelog: v0.0.2...v0.0.3
Release v0.0.2 π
- support gRPC request for Friendli engine.