Pinned Loading

1. prism_npu prism_npu Public

   prism for npu

   Python

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. xllm-service xllm-service Public

   Forked from xLLM-AI/xllm-service

   A flexible serving framework that delivers efficient and fault-tolerant LLM inference for clustered deployments.

   C++ 1