C1 Advanced Real News

One Task, Many Interfaces: Simple Cross-Interface Consistency Training Improves LLM Agent Robustness

Post-training binds the competence of an LLM agent to the interface it was trained on. Semantics-preserving perturbations of that interface, such as renaming an action or changing the notation, leave the underlying task unchanged yet make the agent worse at it. Scoring each sample independently means interface randomization only broadens this dependence from a single interface to the training interface distribution, so out-of-distribution perturbations still degrade the agent. We propose Cross-Interface Policy Regularization (CIPR), a self-supervised objective that replaces action names with uninformative identifiers and presents each training sample under two interfaces in which equivalent actions are identified by construction. CIPR penalizes the KL divergence between the action distributions induced under the two interfaces, so the policy behaves consistently across them. We evaluate CIPR in both supervised and reinforcement-learning post-training, where it improves robustness. On agentic function calling, held-out interface perturbations reduce the accuracy of a post-trained agent by nearly 25%, and CIPR recovers 10.5% while leaving accuracy on the unchanged interface intact.

Cover image for One Task, Many Interfaces: Simple Cross-Interface Consistency Training Improves LLM Agent Robustness
Image: Daily English Reader / Local generated SVG (Project-owned local asset)
5 min read C1

C1 reading

Select any word for its Thai meaning and pronunciation.

0:00 0:00
Post-training binds the competence of an LLM agent to the interface it was trained on. Semantics-preserving perturbations of that interface, such as renaming an action or changing the notation, leave the underlying task unchanged yet make the agent worse at it. Scoring each sample independently means interface randomization only broadens this dependence from a single interface to the training interface distribution, so out-of-distribution perturbations still degrade the agent. We propose Cross-Interface Policy Regularization (CIPR), a self-supervised objective that replaces action names with uninformative identifiers and presents each training sample under two interfaces in which equivalent actions are identified by construction. CIPR penalizes the KL divergence between the action distributions induced under the two interfaces, so the policy behaves consistently across them. We evaluate CIPR in both supervised and reinforcement-learning post-training, where it improves robustness. On agentic function calling, held-out interface perturbations reduce the accuracy of a post-trained agent by nearly 25%, and CIPR recovers 10.5% while leaving accuracy on the unchanged interface intact.

ประโยคและวลีที่ใช้ได้จริงจากเรื่องนี้

Useful phrases from this story

training binds the competence ofCollocation

การฝึกอบรมเชื่อมโยงความสามารถของ.

From the storyPost-training binds the competence of an LLM agent to the interface it was trained on.

was trained onCollocation

ได้รับการฝึกอบรม.

From the storyPost-training binds the competence of an LLM agent to the interface it was trained on.

preserving perturbations of that interfaceCollocation

การอนุรักษ์ความผิดปกติของแหล่งสัมผัสนั้น.

From the storySemantics-preserving perturbations of that interface, such as renaming an action or changing the notation, leave the underlying task unchanged yet make the agent worse at it.

renaming an action or changingCollocation

เปลี่ยนชื่อการดําเนินการ หรือ เปลี่ยนชื่อการดําเนินการ.

From the storySemantics-preserving perturbations of that interface, such as renaming an action or changing the notation, leave the underlying task unchanged yet make the agent worse at it.

underlying task unchanged yet makeCollocation

การทํางานที่อยู่เบื้องหลังยังคงไม่เปลี่ยนแปลง.

From the storySemantics-preserving perturbations of that interface, such as renaming an action or changing the notation, leave the underlying task unchanged yet make the agent worse at it.

Save & Review

Only words saved from this story appear here.