Set-shifting Behavioral Test for Harnessed Agents

본문 미리보기

arXiv:2607.13396v1 Announce Type: new Abstract: What happens to an LLM agent's tool choice when the reliable tool silently changes within an ongoing session? We borrow set-shifting from cognitive psychology to study how well agents adapt to hidden reliability shifts. Our benchmark mounts tool-skill libraries with redundancies, where many tools solve the same task but differ in hidden reliability. In our evaluation framework, a branched schedule shifts the reliable tool group at hidden boundarie

Set-shifting Behavioral Test for Harnessed Agents

본문 미리보기

관련 글

OriginBlame: Record- and Token-Level Data Provenance for AI Training Datasets

Improving Molecular Property Prediction in Small Language Models Using Graph-based Tools

Multi-Agent Collaborative Reasoning with Tool-Augmented Evidence for Urban Region Profiling

SPINE: Bridging the Cyber-Physical Gap with Agentic AI