turboquant

TurboQuant: Google's Algorithm Bringing Big AI to Your Phone

Google released TurboQuant, a technique that shrinks the KV cache via PolarQuant rotation and makes large models run on mobile devices.