Checked for new stories 28m ago

Updates on AI Inference

Every AI story we track on AI Inference — 15 stories so far, each summarized in our own words and linked back to the publisher that reported it.

Pulled from 123 sources

This month

Chips & Compute5 min read

SCX.ai Partners With DDN to Scale Australia’s Sovereign AI Inference Cloud

Unite.AI
Dev8 min read

A proposed browser standard for provider-agnostic AI inference

Hacker News
Chips & Compute4 min read

Is the future of data centers portable? Runware builds a pod to find out

Covered by 2 sources
Chips & Compute3 min read

A startup says the AI bottleneck isn’t compute. It’s memory, and it ditched the GPU to prove it.

The Next Web
Chips & Compute5 min read

d-Matrix Buys Wallaroo to Orchestrate Inference Across Chips

Unite.AI
Chips & Compute3 min read

Startup swaps costly AI GPUs for Arm cores and up to 128TB of 'cheap' LPDDR6 RAM instead of expensive HBM to smash through the memory wall

TechRadar

Why compute might get 10x+ more expensive in coming years

Dwarkesh Podcast
Chips & Compute3 min read

Nvidia teams up with chip rival d-Matrix instead of fighting it

The Next Web

TensorX raises €8M to build sovereign AI inference for Europe on Nvidia Blackwell

The Next Web

AI inference startup Baseten reportedly raising $1.5B months after its last mega round

TechCrunch

Baseten is raising $1.5bn at up to $13bn, betting AI’s profits lie in cheap inference

The Next Web

Nebius paid $643 million for 20 people because inference is where the money is

The Next Web

Google is building a four-partner chip supply chain to challenge Nvidia in AI inference

The Next Web

Startup Gimlet Labs is solving the AI inference bottleneck in a surprisingly elegant way

TechCrunch

AI inference startup Modal Labs in talks to raise at $2.5B valuation, sources say

TechCrunch
That's everything we have on AI Inference right now