Archive

Hot Chips 2026 Day 2: AMD MI400 and NVIDIA Vera Rubin Take the Stage as llama.cpp and MoE Research Push Inference Forward

Hot Chips 2026's second day delivered architectural deep-dives on AMD's MI400 GPU for Helios racks and NVIDIA's Vera Rubin NVL72, plus Nvidia's unexpected CUDA-on-RISC-V initiative. Meanwhile, llama.cpp shipped per-device Metal flash-attention tuning for Apple Silicon, and a new arXiv framework promises up to 3.1x faster MoE inference on memory-constrained GPUs.