You’ve probably heard the adage, “hardware is hard.” That’s definitely true. When you’re making chips for the rapidly changing world of AI, things really get hard early on. The AI…Read More
TL;DR: Generative AI inference is often bottlenecked by growing KV cache. There have been several numerous strategies proposed to compress the KVCache to allow longer inference-time context lengths. However, most of…Read More
Every March 8th, International Women’s Day (IWD) offers us a moment to pause, reflect, and celebrate the vast contributions of women across all areas of life—especially in technology. At d-Matrix,…Read More
