AGENTIC-SYSTEMSJuly 7, 20261 min read

Reinforcement Learning for Evidence-Seeking Diagnostic Reasoning with Large Language Models

Researchers have proposed a novel framework leveraging Reinforcement Learning with Verifiable Rewards (RLVR) and a high-fidelity simulator called RAGES to enable LLMs to actively seek clinical evidence, transitioning them from passive responders to autonomous diagnostic assistants.

Computer Science > Artificial Intelligence

Title:Reinforcement Learning for Evidence-Seeking Diagnostic Reasoning with Large Language Models

View PDF HTML (experimental)Abstract:Recent reasoning-centric Large Language Models (LLMs) have made significant strides, yet they predominantly operate on a passive-inference pattern that assumes complete information. In contrast, real-world clinical intelligence is inherently an iterative investigative process requiring strategic evidence acquisition. To bridge this gap, we formalize medical diagnosis as an Iterative Evidence-Seeking Task. We leverage Reinforcement Learning with Verifiable Rewards (RLVR) to elicit intrinsic reasoning within a closed-loop environment, guided by a novel suite of rewards that enforce diagnostic precision and examination consistency. To facilitate this, we introduce the Retrieval-Augmented Generation-based Examination Simulator (RAGES), a high-fidelity clinical oracle that provides realistic, knowledge-grounded follow-up evidence. Empirical results across diverse datasets demonstrate that our framework enables LLMs to transition from passive responders to autonomous assistants. Notably, our model demonstrates comparable performance to larger and reasoning-enhanced baselines, while RAGES proves superior to vanilla LLMs in generating biologically plausible clinical feedback.

Bibliographic and Citation Tools

Code, Data and Media Associated with this Article

Demos

Recommenders and Search Tools

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Source: arXiv cs.AI Recent

Stay in the loop

Get the best AI & tech insights in your inbox — no spam, unsubscribe anytime.

More in this category

agentic-systems

Automated Data Readiness for Scientific AI

Researchers have introduced REDI, an open-source framework that automates the transformation of raw scientific datasets into AI-ready data. Tested on the Frontier supercomputer, REDI addresses the data preparation bottleneck in scientific AI domains.

agentic-systems

ASK in the Dark: Uncertainty-Gated LLM Assistance under Partial Observability

Researchers have introduced ASK+, a novel framework that significantly enhances small language model (SLM) assistance for reinforcement learning agents under partial observability. By providing trajectory-aware context and structured reasoning, ASK+ demonstrates that prompt design and selective gating can outperform sheer model scale.

agentic-systems

When Aggregate Alignment Misleads: Auditing Policy Repair Without Per-State Expert Actions

Evaluating agentic policy repair without per-state expert labels is challenging, as aggregate behavioral alignment metrics can be highly misleading. A new study using a hotel-pricing simulator demonstrates that LLM-based editors can achieve near-benchmark revenue by leveraging indirect diagnostic feedback, highlighting the need for closed-loop evaluation.

agentic-systems

Embodied Operators and Benchmarking: Toward Reusable and Deployable Embodied Intelligence Systems

A new study proposes 'embodied operators' to modularize embodied intelligence systems, enabling reusable and deployable robot pipelines beyond end-to-end models, supported by a multi-dimensional benchmarking framework.

agentic-systems

Evaluating Generative Agents with Actions Grounded in Socially Distributed Task Environments using Incognita

Researchers introduce Incognita, a framework to evaluate generative agents in socially distributed task environments where knowledge is partitioned across multiple entities. Testing shows that while advanced models perform better at gathering hidden information, overall reliability in executing grounded actions remains low.

agentic-systems

Object-Centric Environment Modeling for Agentic Tasks

Researchers propose Object-Centric Environment Modeling (OCM) to help AI agents organize accumulated experiences into an executable programmatic model, addressing the limitations of traditional free-form textual memories.