‹ 返回 2026-06-21

ENPIRE:现实世界中基于代理的机器人政策自我改进

ENPIRE: Agentic Robot Policy Self-Improvement in the Real World

▲ 7 2026-06-21

Wenli Xiao, Jia Xie, Tonghe Zhang, Haotian Lin, Letian "Max" Fu, Haoru Xue, Jalen Lu, Yi Yang, Cunxi Dai, Zi Wang, Jimmy Wu, Guanzhi Wang, S. Shankar Sastry, Ken Goldberg, Linxi "Jim" Fan, Yuke Zhu, Guanya Shi

摘要

在现实世界中实现灵巧的机器人操作,离不开人类的监督与算法设计,而这正是实现通用物理智能的关键瓶颈。虽然新兴的编程智能体能够生成代码以自动完成算法搜索工作,但它们的应用仍然主要局限于数字环境之中。我们认为,自动化机器人研究所缺乏的,是一种可重复使用的反馈机制,用于优化现实世界中的策略:重置场景、执行策略、验证结果,然后进一步改进下一轮操作。为了填补这一空白,我们提出了ENPIRE框架——一个用于编程智能体的工具框架,该框架包含四个核心模块:环境模块(EN),用于自动重置和验证;策略优化模块(PI),用于改进策略;部署模块(R),用于评估由多个物理机器人共同执行的策略;以及进化模块(E),用于让编程智能体分析日志、查阅文献、改进训练环境和算法代码,从而解决各种故障问题。这种闭环系统将现实世界的操作学习转化为可控制的优化过程,既能减少人工投入,又能确保不同训练方案和智能体变体之间的公平性。有了ENPIRE的支持,前沿的编程智能体可以自主训练策略,从而在复杂的灵巧操作任务中达到99%的成功率,比如整理储物箱、使用拉链或工具等。当我们将智能体团队部署到机器人系统中时,这一过程会更快完成。我们的研究结果表明,存在一种实用且可扩展的方法,可以让编程智能体自主推动物理世界中的机器人技术发展。

English Abstract

Achieving dexterous robotic manipulation in the real world heavily relies on human supervision and algorithm engineering, which becomes a central bottleneck in the pursuit of general physical intelligence. Although emerging coding agents can generate code to automate algorithm search, their successes remain largely confined in digital environments. We conjecture that the missing abstraction to automate robotics research is a repeatable feedback loop for real-world policy improvement: reset the scene, execute a policy, verify the outcome, and refine the next iteration. To bridge this gap, we introduce ENPIRE, a harness framework for coding agents that instantiates this physical feedback routine with four core modules: an Environment module (EN) for automatic reset and verification, a Policy Improvement module (PI) that launches policy refinement, a Rollout module (R) to evaluate policies with one or multiple physical robots operating in parallel, and an Evolution module (E) in which coding agents analyze logs, consult literature, improve training infrastructure and algorithm code to address failure modes. This closed-loop system transforms real-world manipulation learning into a controllable optimization procedure, minimizing human effort while allowing fair ablations across training recipe and agent variants. Powered by ENPIRE, frontier coding agents can autonomously train a policy to achieve a 99% success rate on challenging, dexterous manipulation tasks, such as organizing a pin box, fastening a zip tie, and tool use, a process that further accelerates when we dispatch an agent team on a robot fleet. Our results suggest a practical and scalable path toward deploying coding agents to autonomously advancing robotics in the physical world.