'AI success will be defined not by how much infrastructure organizations own, but by how productively they use it': Nvidia lays out its thoughts on how storage has become the next frontier of AI

Nvidia has open sourced its cuFile APIs and storage stack, launching the Storage-Next initiative with over 40 storage vendors including Google, Intel, and Meta. It introduced SCADA, a framework that moves storage control to GPUs, enabling efficient small data fetches directly from storage without CPU intervention. This innovation addresses the inefficiency of SSDs tuned for 4KB reads when handling the small, frequent data requests typical in AI inference workloads.