Pinned Loading

1. EntropyCache EntropyCache Public

   [NeurIPS 2026] EntropyCache: Decoded Token Entropy Guided KV Caching for Diffusion Language Models

   2

2. TaSQ TaSQ Public

   Official code for paper "Tailoring the Quantization Space for 1-Bit KV Cache Compression"

   Python 7

3. LoopVQ LoopVQ Public

   Official code for paper "LoopVQ: Sub 1-bit KV Cache Quantization for Looped Transformers"

   Python 3

4. ggml-org/llama.cpp ggml-org/llama.cpp Public

   LLM inference in C/C++

   C++ 134k 25.5k

5. krotoDC krotoDC Public

   Protobuf Kotlin Dataclass, Converter & Custom Kotlin Coroutine gRPC Generator

   Kotlin 108 12