Maven Robotics wants to steal your robot deployment deal23m ago Positron Valued at $5 Billion in New Funding as Demand for AI Chips Surges32m ago 7 Steps to Become a Forward Deployed Engineer in 202640m ago Amazon partners with OpenAI to let users of Amazon's DSP run ads in ChatGPT in a pilot program limited to the US; ChatGPT Ads hit $1B in ARR last month55m ago D-Matrix Connects Raptor XPUs to NVIDIA AI Factories via NVLink Fusion1h ago Source: Meta AI researcher Andrew Tulloch, who came over from Thinking Machine Lab as one of the highest paid employees last year, is leaving the company (Reed Albergotti/Semafor)1h ago Mother Horrified When Instagram’s AI Scours Social Media for Invasive Information About Her Young Daughters1h ago Mach Industries, which makes unmanned military vehicles and weapons, raised $600M in an extension to its $300M Series C, doubling its valuation to $3.7B1h ago Salesforce Unveils Six-Capability Trusted AI Harness for Enterprises1h ago US closes $1.9bn loan to restart the Iowa nuclear plant powering Google1h ago OpenAI Gives US Agencies 50% Off Models, Ending $1 Per Year Deal1h ago 47,000 job listings reveal the engineering roles that AI is creating2h ago Anthropic's Alignment Science lead says there is a ">10%" chance AI could kill all humans within the next decade and is worried about recursive self-improvement (Evan Hubinger/@evanhub)2h ago Ukraine says AI is moving beyond drones and into strike missiles for the first time2h ago

Maven Robotics wants to steal your robot deployment deal23m ago Positron Valued at $5 Billion in New Funding as Demand for AI Chips Surges32m ago 7 Steps to Become a Forward Deployed Engineer in 202640m ago Amazon partners with OpenAI to let users of Amazon's DSP run ads in ChatGPT in a pilot program limited to the US; ChatGPT Ads hit $1B in ARR last month55m ago D-Matrix Connects Raptor XPUs to NVIDIA AI Factories via NVLink Fusion1h ago Source: Meta AI researcher Andrew Tulloch, who came over from Thinking Machine Lab as one of the highest paid employees last year, is leaving the company (Reed Albergotti/Semafor)1h ago Mother Horrified When Instagram’s AI Scours Social Media for Invasive Information About Her Young Daughters1h ago Mach Industries, which makes unmanned military vehicles and weapons, raised $600M in an extension to its $300M Series C, doubling its valuation to $3.7B1h ago Salesforce Unveils Six-Capability Trusted AI Harness for Enterprises1h ago US closes $1.9bn loan to restart the Iowa nuclear plant powering Google1h ago OpenAI Gives US Agencies 50% Off Models, Ending $1 Per Year Deal1h ago 47,000 job listings reveal the engineering roles that AI is creating2h ago Anthropic's Alignment Science lead says there is a ">10%" chance AI could kill all humans within the next decade and is worried about recursive self-improvement (Evan Hubinger/@evanhub)2h ago Ukraine says AI is moving beyond drones and into strike missiles for the first time2h ago

Machine Learning25 min reading time

How a Frontier Model Gets Built, Read from the Kimi K3 Report

Towards Data SciencePublished Aug 5, 2026

Moonshot AI released a detailed technical report on their Kimi K3 model, a 2.8-trillion-parameter mixture-of-experts transformer with innovations enabling million-token context windows and improved scaling efficiency. The report reveals how architectural tweaks and training refinements reduced compute costs while maintaining performance near top closed models.

More on this story

Deploying Kimi K3 on AWS
Jul 30· AWS Blog
With Moonshot’s free Kimi K3, China changes the sovereign AI playbook
Jul 30· Rest of World
Open weights vs. closed: An AI civil war's afoot, and the stakes are existential
Jul 29· ZDNet
Anthropic on open weights 🔓, Kimi releases K3 weights 🤖, MAI Cyber model 🔐
Jul 28· TLDR AI
Why China is giving away its best AI models
Jul 27· 3 sources
Moonshot Opens Kimi K3 Weights Under a Revenue-Tiered License
Jul 27· Unite.AI

#kimi-k3 #long-context-transformers #mixture-of-experts-models #moonshot-ai #transformer-architecture

More in Machine Learning

Machine Learning3 min read

Nvidia and Palantir fine-tune a 30B Nemotron model for Nvidia’s supply chain. It beats a model 18 times its size.

Covered by 3 sources6h ago

Machine Learning6 min read

CoreWeave Puts Field Engineers Inside Customer Teams for Physical AI

Covered by 2 sources2h ago

Machine Learning2 min read

Weatherwatch: AI model beats standard methods at predicting cyclones

The Guardian10h ago