AGENTIC-SYSTEMSJuly 13, 20261 min read

Toward Auditable AI Scientists: A Hypothesis Evolution Protocol for LLM Agents

Researchers have proposed the Hypothesis Evolution Protocol (HEP), a framework that makes the scientific reasoning of LLM agents explicit and auditable, marking a key step toward trustworthy AI scientists.

Computer Science > Artificial Intelligence

Title:Toward Auditable AI Scientists: A Hypothesis Evolution Protocol for LLM Agents

View PDF HTML (experimental)Abstract:Large language model (LLM) agents are increasingly expected to play a central role in AI-driven scientific discovery. Equipped with broad knowledge, flexible reasoning, and tool use, they have the potential to autonomously explore and solve scientific problems by repeatedly proposing hypotheses, testing them, and revising their beliefs in the light of the evidence. In current agents, however, these hypotheses, tests, and belief updates are buried in unstructured logs, and no mechanism lets the agent or the human researcher audit that process. Here we propose the Hypothesis Evolution Protocol (HEP), an agent harness that provides hypothesis generation, evaluation, and evolution as explicit, auditable operations. On materials-science research tasks, a HEP-equipped agent operates the hypothesis--test--evidence--belief cycle that planning-style agents lack, generalizes across research questions, and exploits the protocol more fully as the base LLM becomes more capable. These results mark a step toward auditable AI scientists, whose scientific reasoning can be inspected, verified, and built upon.

Current browse context:

Bibliographic and Citation Tools

Code, Data and Media Associated with this Article

Demos

Recommenders and Search Tools

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Source: arXiv cs.AI Recent

More in this category

agentic-systems

Communication-Efficient Digital-Twin Coordination for Heterogeneous LLM Embodied Agents over Computing Power Networks

Researchers have proposed LDT-Coord, a lightweight digital twin-based coordination framework for heterogeneous LLM-powered embodied agents. The solution addresses network congestion and latency issues by reducing communication overhead by over 70x while maintaining optimal task performance.

agentic-systems

GATS: Graph-Augmented Tree Search with Layered World Models for Efficient Agent Planning

Researchers have developed GATS, a breakthrough planning framework for AI agents that completely eliminates LLM calls during inference. Achieving a 100% success rate in complex tasks, GATS paves the way for highly efficient and deterministic autonomous agents.

agentic-systems

A Formalization of the Mean-Field Derivation of the Vlasov Equation: AI-Assisted Lean Formalization as a Strategy Game

Researchers have successfully formalized the complex Vlasov equation in the Lean 4 proof assistant by framing the collaboration between a mathematician and an AI agent as a strategy game.

agentic-systems

MedRealMM: A Real-World Multimodal Benchmark for Chinese Online Medical Consultation

Researchers have introduced MedRealMM, a large-scale multimodal benchmark built from real-world patient-doctor interactions. This benchmark provides a more accurate evaluation of large language models (LLMs) in online medical consultation scenarios, where safety and precision are paramount.

agentic-systems

L-MAD: A Systematic Evaluation of Multi-Agent Debate Structures in Legal Reasoning

The new L-MAD framework demonstrates that assigning expert personas to AI agents in a debate structure improves legal reasoning accuracy by up to 8%. However, the study also warns of an 'over-deliberation drift' where prolonged discussions lead agents to reinforce each other's errors.

agentic-systems

Ceci n'est pas une pipe: AI systems as semantic abstractions

A new study proposes a semantic framework to distinguish between actual facts and AI-generated representations. By defining common failures like extrapolation or source mismatch, this framework aims to evaluate AI systems based on reliable claims rather than apparent fluency.