A Judge Agent Closes the Reliability Gap in AI-Generated Scientific Simulation
arXiv:2603.25780v1 Announce Type: new Abstract: Large language models can generate scientific simulation code, but the generated code silently fails on most non-textbook problems. We show that classical mathematical validation — well-posedness, convergence, and error certification — can be fully automated by a Judge Agent, reducing the silent-failure rate from 42% to 1.5% across 134 test cases spanning 12 scientific domains. The headline result comes from a prospective benchmark: 72 blinded tasks submitted by 12 independent scientists yield an […]