Code

CUDA: tuned mul_mat_q kernels#2546

Code

Merged

JohannesGaessler merged 1 commit intoggerganov:masterggerganov/llama.cpp:masterfrom JohannesGaessler:cuda-faster-mmq-7JohannesGaessler/llama.cpp:cuda-faster-mmq-7Copy head branch name to clipboardAug 9, 2023

+682-392

Commits

Commits on Aug 7, 2023

• CUDA: tuned mul_mat_q kernels

  JohannesGaessler

  committed
  ca32203