Pinned Loading

1. exllamav2 exllamav2 Public

   A fast inference library for running LLMs locally on modern consumer-class GPUs

   Python 3.8k 287

2. theroyallab/tabbyAPI theroyallab/tabbyAPI Public

   An OAI compatible exllamav2 API that's both lightweight and fast

   Python 675 81

3. exui exui Public

   Web UI for ExLlamaV2

   JavaScript 450 44