AGENTIC-SYSTEMSJuly 8, 20261 min read

Controlling Tool Use with Heading-Specific Activation Steering

Researchers have demonstrated that steering vectors extracted from heading-anchor positions can exert bidirectional causal control over tool-invocation behavior in LLMs, helping suppress unnecessary tool use.

Computer Science > Artificial Intelligence

Title:Controlling Tool Use with Heading-Specific Activation Steering

View PDF HTML (experimental)Abstract:Tool-augmented large language models extend their capabilities beyond parametric knowledge through external tools, but tend to invoke them unnecessarily. We investigate whether tool-use decisions have any stable internal representation that can be extracted and manipulated, a question that is non-trivial given that tools exist entirely in context at inference time and have no direct encoding in model weights. We show that steering vectors extracted from heading-anchors positions exert bidirectional causal control over tool-invocation behavior across five open-source models and three domains, suppressing unnecessary tool use most effectively in domains where parametric reasoning suffices. However, geometric analysis reveals that this causal effectiveness does not correspond to clean linear structure: tool-invocation steps exhibit diffuse, bimodal alignment with the suppression vector rather than the consistent negative alignment a linear encoding account would predict, and different tool types recruit largely distinct internal signatures with low cross-tool feature overlap. We hypothesize these geometric properties are indicative of the non-parametric nature of tools, and distinguish tool-use steering vectors from those extracted for parametrically grounded concepts. The relationship between this geometric irregularity and the observed causal effectiveness remains an open question.

Bibliographic and Citation Tools

Code, Data and Media Associated with this Article

Demos

Recommenders and Search Tools

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Source: arXiv cs.AI Recent

Stay in the loop

Get the best AI & tech insights in your inbox — no spam, unsubscribe anytime.

More in this category

agentic-systems

Onnes: A Physics-Grounded Multi-Agent LLM Simulator for Cryogenic Fault Diagnosis in Quantum Computing Infrastructure

Researchers have introduced Onnes, a physics-grounded digital-twin simulator driven by multi-agent LLMs to automate and accurately diagnose faults in dilution refrigerators for quantum computers. By combining real-world physics models with AI, Onnes achieves up to 99% accuracy, paving the way for more stable quantum computing infrastructure operations.

agentic-systems

FirstResearch: Auditable Question Formation for LLM Scientific Discovery Agents

Researchers have introduced FirstResearch, a first-principles framework that makes AI-generated scientific questions auditable through a structured 'Research Question Certificate'.

agentic-systems

ArtisanCAD: An Industrial-Level CAD Agent with Expert-Grounded Knowledge Distillation

Researchers have introduced ArtisanCAD, an industrial-grade AI agent capable of transforming vague natural language prompts into complete, editable 3D CAD models by leveraging a novel CAD-IR representation and distilling expert knowledge.

agentic-systems

From Passive Retrieval to Active Memory Navigation: Learning to Use Memory as a Structured Action Space

Current AI agents often rely on passive memory retrieval, limiting their personalization capabilities. The new NapMem framework addresses this by treating long-term memory as a structured action space, enabling agents to actively navigate and inspect memory at multiple granularities.

agentic-systems

Beyond the Leaderboard: A Synthesis of Tool-Use, Planning, and Reasoning Failures in Large Language Model Agents

A new synthesis paper uncovers critical limitations in LLM agents that are often masked by high benchmark scores. By identifying six core failure clusters, the study reveals that strong sub-task performance does not guarantee end-to-end success in complex, real-world applications.

agentic-systems

Beyond Static Evaluation: Building Simulation Environments for Scalable Agentic Reinforcement Learning

As Large Language Models (LLMs) evolve into autonomous agents, traditional static evaluation fails to capture multi-step decision-making. This paper introduces AgenticAI-Supervisor, an RL Gym environment designed to enable scalable, multi-step decision-making evaluation and mitigate reward hacking.