Startup swaps costly AI GPUs for Arm cores and up to 128TB of 'cheap' LPDDR6 RAM instead of expensive HBM to smash through the memory wall

Majestic Labs introduced the Prometheus server, replacing Nvidia GPUs and HBM with Arm-based AIUs and up to 128TB of LPDDR6 memory, promising vastly increased memory capacity and efficiency for AI workloads. The system aims to deliver up to 1000× more memory per processor and lower costs and power consumption compared to traditional GPU setups, supporting popular AI frameworks without model changes.