Predictive Speculative KV Replication for Bursty LLM Inference jwlabs.vercel.app 15 points by shreybirmiwal 3 hours ago https://github.com/jwlaboratory/bite-the-bullet
the hand drawn diagrams and highlights are charming