Kimi Linear

Kimi Linear

Kimi Open-Sources New Linear Attention Architecture, Surpasses Full Attention Models for the First Time with 6× Faster Inference

The Transformer Era Is Being Rewritten Moonshot AI has unveiled its open-source Kimi Linear architecture — introducing a novel attention mechanism that, for the first time, outperforms traditional full attention under identical training conditions. In long-context tasks, Kimi Linear: * Reduces KV cache usage by 75% * Achieves up to 6× faster inference