papersSEP 10 04:00 UTC
OpenDiscoveryTrace benchmark evaluates AI scientist workflows via process traces
A new arXiv paper presents OpenDiscoveryTrace, a benchmark built around process traces of autonomous AI scientist systems. Unlike existing evaluations that only score final artifacts such as generated code, hypotheses, or papers, it captures the reasoning steps used to produce them, enabling audits of scientific methodology.