UP-NRPA: User Portrait based Nested Rollout Policy Adaptation for Planning with Large Language Models in Goal-oriented Dialogue Systems

NOW LET US Article – UP-NRPA: User Portrait based Nested Rollout Policy Adaptation for Planning with Large Language Models in Goal-oriented Dialogue Systems

Researchers have proposed UP-NRPA, a novel online framework that enables Large Language Models to dynamically adapt dialogue strategies based on real-time user portraits. The framework achieves a 100% success rate in multiple dialogue tasks and significantly improves negotiation outcomes without requiring offline reinforcement learning.

Computer Science > Artificial Intelligence

Title:UP-NRPA: User Portrait based Nested Rollout Policy Adaptation for Planning with Large Language Models in Goal-oriented Dialogue Systems

View PDF HTML (experimental)Abstract:To address the challenge that current dialogue policy planning methods struggle to dynamically adapt to diverse user characteristics, this paper proposes a User Portrait based Nested Rollout Policy Adaptation (UP-NRPA) online framework with Large Language Models. In contrast to conventional approaches dependent on model training and require offline reinforcement learning policy models for user groups, UP-NRPA enables dynamic customization of dialogue strategies through an adaptive mechanism. This is achieved by leveraging real-time user feedback alongside personality, preferences, and objectives mapped from the current user portrait, thereby adapting to user characteristics without offline reinforcement learning. In collaborative and non-collaborative dialogue benchmarks, UP-NRPA demonstrated considerable benefits, achieving an impressive 100% success rate in multiple dialogue tasks. Particularly in negotiation tasks, the sale-to-list ratio (SL) increased by 56.41%. This demonstrates that UP-NRPA can adapt to diverse user needs without requiring a training mechanism, enabling the dialogue system to adapt to user characteristics.

Bibliographic and Citation Tools

Code, Data and Media Associated with this Article

Demos

Recommenders and Search Tools

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Source: arXiv cs.AI Recent

More in this category

agentic-systems

History of the Muddy Children Puzzle

A recent study traces the two-century history of the "Muddy Children Puzzle", a classic problem that inspired the development of epistemic logic in AI. The paper also introduces unique variations and a novel self-referential puzzle.

agentic-systems

Orchestra-o1: Omnimodal Agent Orchestration

Orchestra-o1 is a breakthrough omnimodal agent orchestration framework designed to coordinate diverse inputs like text, image, audio, and video. Powered by the new DA-GRPO reinforcement learning approach, Orchestra-o1-8B achieves state-of-the-art performance among open-source omnimodal agents.

agentic-systems

A Deep Reinforcement Learning (DRL)-Based Transformer Method for Solving the Open Shop Scheduling Problem

Researchers have developed a novel Transformer-based method integrated with Deep Reinforcement Learning (DRL) to solve the Open Shop Scheduling Problem (OSSP). This approach offers a highly scalable, learning-based alternative to traditional dispatching rules, generalizing effectively from small to large-scale industrial scenarios without retraining.

agentic-systems

TrajGenAgent: A Hierarchical LLM Agent for Human Mobility Trajectory Generation

Researchers have proposed TrajGenAgent, a hierarchical LLM-agent framework that generates realistic human mobility trajectories without model fine-tuning, addressing privacy and cost constraints in urban planning and epidemic control.

agentic-systems

From AGI to ASI

Over the last decade, building human-level artificial general intelligence has moved from far-fetched speculation to being a concrete next-decade target. This report investigates the transition from human-level AGI to artificial general superintelligence (ASI).

agentic-systems

Definitional alignment before capability alignment: a Design-Science framework for adjudicating claims about AGI

A new research paper proposes DAF-AGI, a design-science framework to resolve conflicting claims about the arrival of Artificial General Intelligence (AGI) by prioritizing definitional alignment over capability alignment.

EXPLORE TOPICS