Where the Blocks Live: Tier-Aware KV-Cache Routing for vLLM at Scale
Hi, I'm Pongup Pak from War at PyTorch Conference North America 2026. I'm presenting a poster called where the block lives. When GPU memory fmflows the KB cache to CPU or storage and LMD tracks where every block lives and sends each request to its cache. You will see when CPU is…
AI Summary & Key Takeaways
- Hi, I'm Pongup Pak from War at PyTorch Conference North America 2026
- I'm presenting a poster called where the block lives
- When GPU memory fmflows the KB cache to CPU or storage and LMD tracks where every block lives and sends each request to its cache
Related stories
Ensemble forecasting with IBM Granite time-series models
A Blog post by IBM Research on Hugging Face
Jensen Huang brought mini-robots to the stage and talked about the future of AI
🤖 Jensen Huang brought mini-robots to the stage and spoke about the future of AI While we are waiting for the head of NVIDIA in Kazakhstan, he spoke at the NVIDIA GTC Berlin 2026 conference and demonstrated the MicroDuck robots created by the French Pollen Robotics. Little robots were trained to walk...
Swapped a corporate career for a goat farm and earns $800,000 a year
They snorted and grumbled, they didn't like something. It turns out fruits and berries were much harder than goats. I am Zhuldys Kozhakhanova. Welcome to the Golomelk goat farm. I am a pediatrician, but I worked in the pharmaceutical industry for a long time. And once I had…
In ChatGPT you can hide conversations using a PIN code or Face ID
🔒 In ChatGPT you can hide conversations under a PIN code or Face ID OpenAI has begun to gradually launch the Locked Chats feature, which allows you to protect individual conversations in ChatGPT from strangers. Users can hide personal or confidential chats from regular history and...