Pinned Loading

1. turboderp-org/exllamav3 turboderp-org/exllamav3 Public

   An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

   Python 552 51

2. turboderp-org/exllamav2 turboderp-org/exllamav2 Public

   A fast inference library for running LLMs locally on modern consumer-class GPUs

   Python 4.4k 324

3. theroyallab/tabbyAPI theroyallab/tabbyAPI Public

   The official API server for Exllama. OAI compatible, lightweight, and fast.

   Python 1.1k 127

4. turboderp-org/exui turboderp-org/exui Public

   Web UI for ExLlamaV2

   JavaScript 511 47