Nintendo's latest sale is 'made possible' by the tariff refunds it's hoarding11m ago AI agents are flooding public services with new requests18m ago OpenAI’s Bubeck denies trying to cut Anthropic mathematician from credit52m ago 10 of the scariest AI villains in movie history53m ago Maven Robotics wants to steal your robot deployment deal55m ago Agent Security Is Not AI Governance: Why Conflating The Two Is A Risk Enterprises Can't Afford57m ago Positron Valued at $5 Billion in New Funding as Demand for AI Chips Surges1h ago 7 Steps to Become a Forward Deployed Engineer in 20261h ago Ramp eyes $60bn valuation three months after $44bn, Bloomberg reports1h ago D-Matrix Connects Raptor XPUs to NVIDIA AI Factories via NVLink Fusion2h ago Andrew Tulloch, Poster Child for Out-of-Control AI Spending, Reportedly Quits Meta2h ago Mother Horrified When Meta’s AI Scours Instagram and Facebook for Invasive Information About Her Young Daughters2h ago Salesforce Unveils Six-Capability Trusted AI Harness for Enterprises2h ago US closes $1.9bn loan to restart the Iowa nuclear plant powering Google2h ago

Nintendo's latest sale is 'made possible' by the tariff refunds it's hoarding11m ago AI agents are flooding public services with new requests18m ago OpenAI’s Bubeck denies trying to cut Anthropic mathematician from credit52m ago 10 of the scariest AI villains in movie history53m ago Maven Robotics wants to steal your robot deployment deal55m ago Agent Security Is Not AI Governance: Why Conflating The Two Is A Risk Enterprises Can't Afford57m ago Positron Valued at $5 Billion in New Funding as Demand for AI Chips Surges1h ago 7 Steps to Become a Forward Deployed Engineer in 20261h ago Ramp eyes $60bn valuation three months after $44bn, Bloomberg reports1h ago D-Matrix Connects Raptor XPUs to NVIDIA AI Factories via NVLink Fusion2h ago Andrew Tulloch, Poster Child for Out-of-Control AI Spending, Reportedly Quits Meta2h ago Mother Horrified When Meta’s AI Scours Instagram and Facebook for Invasive Information About Her Young Daughters2h ago Salesforce Unveils Six-Capability Trusted AI Harness for Enterprises2h ago US closes $1.9bn loan to restart the Iowa nuclear plant powering Google2h ago

Machine Learning Dev3 min reading time

Are we measuring AI coding ability wrong?

Hacker NewsPublished 6 days ago

Current AI coding benchmarks rely on pass/fail metrics that overlook code quality aspects like readability, fragility, and maintainability. The author proposes five programmatic views—reliability, verbosity, complexity, specialization, and writing clarity—to better evaluate AI-generated code beyond simple scores.

#code-quality-evaluation #opus-5 #terminal-bench

More in Machine Learning

Machine Learning3 min read

Nvidia and Palantir fine-tune a 30B Nemotron model for Nvidia’s supply chain. It beats a model 18 times its size.

Covered by 3 sources6h ago

Machine Learning6 min read

CoreWeave Puts Field Engineers Inside Customer Teams for Physical AI

Covered by 2 sources3h ago

Machine Learning2 min read

Weatherwatch: AI model beats standard methods at predicting cyclones

The Guardian10h ago