OpenAI’s Bubeck denies trying to cut Anthropic mathematician from credit28m ago 10 of the scariest AI villains in movie history29m ago Maven Robotics wants to steal your robot deployment deal30m ago Agent Security Is Not AI Governance: Why Conflating The Two Is A Risk Enterprises Can't Afford33m ago Positron Valued at $5 Billion in New Funding as Demand for AI Chips Surges40m ago 7 Steps to Become a Forward Deployed Engineer in 202648m ago Ramp eyes $60bn valuation three months after $44bn, Bloomberg reports1h ago Amazon partners with OpenAI to let users of Amazon's DSP run ads in ChatGPT in a pilot program limited to the US; ChatGPT Ads hit $1B in ARR last month1h ago D-Matrix Connects Raptor XPUs to NVIDIA AI Factories via NVLink Fusion1h ago Source: Meta AI researcher Andrew Tulloch, who came over from Thinking Machine Lab as one of the highest paid employees last year, is leaving the company (Reed Albergotti/Semafor)1h ago Mother Horrified When Instagram’s AI Scours Social Media for Invasive Information About Her Young Daughters1h ago Mach Industries, which makes unmanned military vehicles and weapons, raised $600M in an extension to its $300M Series C, doubling its valuation to $3.7B1h ago Salesforce Unveils Six-Capability Trusted AI Harness for Enterprises1h ago US closes $1.9bn loan to restart the Iowa nuclear plant powering Google1h ago

OpenAI’s Bubeck denies trying to cut Anthropic mathematician from credit28m ago 10 of the scariest AI villains in movie history29m ago Maven Robotics wants to steal your robot deployment deal30m ago Agent Security Is Not AI Governance: Why Conflating The Two Is A Risk Enterprises Can't Afford33m ago Positron Valued at $5 Billion in New Funding as Demand for AI Chips Surges40m ago 7 Steps to Become a Forward Deployed Engineer in 202648m ago Ramp eyes $60bn valuation three months after $44bn, Bloomberg reports1h ago Amazon partners with OpenAI to let users of Amazon's DSP run ads in ChatGPT in a pilot program limited to the US; ChatGPT Ads hit $1B in ARR last month1h ago D-Matrix Connects Raptor XPUs to NVIDIA AI Factories via NVLink Fusion1h ago Source: Meta AI researcher Andrew Tulloch, who came over from Thinking Machine Lab as one of the highest paid employees last year, is leaving the company (Reed Albergotti/Semafor)1h ago Mother Horrified When Instagram’s AI Scours Social Media for Invasive Information About Her Young Daughters1h ago Mach Industries, which makes unmanned military vehicles and weapons, raised $600M in an extension to its $300M Series C, doubling its valuation to $3.7B1h ago Salesforce Unveils Six-Capability Trusted AI Harness for Enterprises1h ago US closes $1.9bn loan to restart the Iowa nuclear plant powering Google1h ago

Agents AI Research6 min reading time

Obsessing over AI Agent Harnesses

Hacker NewsPublished 12 days ago

The author discusses challenges in evaluating improvements to AI agent harnesses, which include components beyond the model like prompts and memory. They question if benchmark increases truly reflect better agent performance given dynamic harness changes.

More on this story

The Evolution of the Agent Harness
19d· Latent.Space

More in Agents

Meta Announces Muse AI Agent for Personal Tasks and Organization

Covered by 12 sources2d ago

Agents4 min read

Exclusive: Cfo.ai launches an agentic CFO for business founders

SiliconANGLE2h ago

A16z Doubles Down On AI Coding Agents Months After Cursor Exit

Forbes18h ago