Popular repositories Loading

1. AdapterSlots AdapterSlots Public

   Python

2. Awesome-LLM-Inference-Serving Awesome-LLM-Inference-Serving Public

   Forked from zenrran4nlp/Awesome-LLM-Inference-Serving

3. EAGLE EAGLE Public

   Forked from SafeAILab/EAGLE

   Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3 (NeurIPS'25).

   Python

4. Medusa Medusa Public

   Forked from FasterDecoding/Medusa

   Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

   Jupyter Notebook

5. AdapterSlotsPlusPlus AdapterSlotsPlusPlus Public

   Python

6. xxh3 xxh3 Public

   Forked from zeebo/xxh3

   XXH3 algorithm in Go

   Go