The AutoResearch Moment: From Experimenter to Research Director

Automated research has just crossed a threshold, becoming increasingly visible through public-facing instruments like AUTORESEARCH https://github.com/karpathy/autoresearch. In this position paper, we use this system to highlight a broader methodological shift: the human role is moving from experimenter to research director. As agents cheaply generate and execute experimental branches, the primary unit of scientific accountability shifts from a successful run to an admissible claim—a concept we call the claim-governance thesis. NLP makes this shift especially apparent due to its dynamic evaluation, contamination risks, and normative trade-offs. Because current agents excel at short-horizon search but lack long-horizon evidential discipline, a traditional paper and final checkpoint no longer sufficiently convey the scientific object. We therefore propose a research-director bundle—comprising an objective sheet, program boundaries, discovery trace, verification ledger, provenance bundle, and role map—as a practical minimum artifact set for evaluating automated research.