Get the app
Machine Learning

Introducing Mellum2: A 12B Mixture-of-Experts Model by JetBrains

Hugging Face
Read full post
JetBrains has unveiled Mellum2, a 12-billion parameter Mixture-of-Experts (MoE) model designed to enhance AI performance by dynamically activating expert subsets during inference. This architecture aims to improve efficiency and scalability in AI applications.
#12b-parameters#jetbrains#mellum2#mixture-of-experts

More in Machine Learning

Machine Learning3 min read

Nvidia and Palantir fine-tune a 30B Nemotron model for Nvidia’s supply chain. It beats a model 18 times its size.

Covered by 3 sources
Machine Learning6 min read

CoreWeave Puts Field Engineers Inside Customer Teams for Physical AI

Covered by 2 sources
Machine Learning2 min read

Weatherwatch: AI model beats standard methods at predicting cyclones

The Guardian