Popular repositories Loading

1. ThunderOMLX ThunderOMLX Public

   Mac mini 最强本地推理引擎 - 融合 oMLX、ThunderLLAMA、ClawGate 的优势，配备 Web 管理面板和 macOS 菜单栏应用

   Python 8 3

2. omlx omlx Public

   Forked from jundot/omlx

   LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

   Python

3. ThunderKittens ThunderKittens Public

   Forked from HazyResearch/ThunderKittens

   Tile primitives for speedy kernels

   Cuda

4. TradingAgents TradingAgents Public

   Forked from TauricResearch/TradingAgents

   TradingAgents: Multi-Agents LLM Financial Trading Framework

   Python

5. LightLLM LightLLM Public

   Forked from ModelTC/LightLLM

   LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

   Python

6. flashinfer flashinfer Public

   Forked from flashinfer-ai/flashinfer

   FlashInfer: Kernel Library for LLM Serving

   Python