Code

batched : add bench tool#3545

Code

Merged

ggerganov merged 7 commits intomasterggerganov/llama.cpp:masterfrom batched-benchggerganov/llama.cpp:batched-benchCopy head branch name to clipboardOct 11, 2023

+321-3

Commits

Commits on Oct 8, 2023

• batched : add bench tool

  ggerganov

  committed
  bf06d65

• batched : minor fix table

  ggerganov

  committed
  7438728

Commits on Oct 11, 2023

• batched-bench : add readme + n_kv_max is now configurable

  ggerganov

  committed
  026bb1b

• Merge branch 'master' into batched-bench

  ggerganov

  committed
  76e17f8

• batched-bench : init warm-up batch

  ggerganov

  committed
  c062ffd

• batched-bench : pass custom set of PP, TG and PL

  ggerganov

  committed
  daeb834

• batched-bench : add mmq CLI arg

  ggerganov

  committed
  2fcdf86