‹ 返回 2026-06-26

Fast LeWorldModel

▲ 10 2026-06-26

Yuntian Gao, Xiangyu Xu

摘要

联合嵌入预测架构(JEPAs),包括最新的LeWorldModel(LeWM),已成为无需重建的视觉世界模型构建的有效方法。然而,在视觉规划中,LeWM通过反复应用局部一步隐式转换模型来评估各种动作序列。这种自回归式处理方式使得规划过程在计算上非常昂贵,而且随着时间范围的扩大,预测的轨迹会受到累积的隐式误差的影响。我们提出了Fast LeWorldModel(Fast-LeWM),这是一种高效的隐式世界模型,它用动作前缀预测来替代重复的局部处理过程。给定当前的隐式状态以及某个候选动作序列,Fast-LeWM可以编码该动作的前缀信息,并同时预测执行这些前缀后所达到的后续隐式状态。通过将动作前缀作为基本预测单元,Fast-LeWM能够直接模拟不同时间范围内不同程度的行为影响。这种前缀级监督机制使得模型能够学习到在不同动作前缀下状态如何持续变化,而不仅仅是拟合一步级的状态转换。在规划过程中,预测器可以利用编码后的动作序列中的最后一个前缀标记来评估相应的未来隐式状态,而无需显式地遍历所有中间状态。在多个任务中,Fast-LeWM在平均成功率上优于LeWM,同时大幅减少了规划时间,其开放式隐式损失也降低了——随着时间范围的扩大,这种损失的增长速度则明显变慢。

English Abstract

Joint-Embedding Predictive Architectures (JEPAs), including recent LeWorldModel (LeWM), have become a promising foundation for reconstruction-free visual world models. For visual planning, however, LeWM evaluates candidate action sequences by repeatedly applying a local one-step latent transition model. This autoregressive rollout makes planning computationally expensive and exposes the predicted trajectory to accumulated latent errors as the horizon grows. We propose Fast LeWorldModel (Fast-LeWM), a fast latent world model that replaces repeated local rollout with action-prefix prediction. Given the current latent and a candidate action sequence, Fast-LeWM encodes its prefixes and predicts the future latents reached after executing those prefixes in parallel. By making action prefixes the basic prediction unit, Fast-LeWM directly models action effects accumulated to different extents over multiple horizons. This prefix-level supervision forces the model to learn how states continuously evolve under different action prefixes, rather than only fitting one-step state transitions. During planning, the predictor can use the last prefix token from the encoded action sequence to evaluate the corresponding future latent without explicitly rolling through each intermediate imagined state. Across multiple tasks, Fast-LeWM improves average success over LeWM while substantially reducing planning time, achieving lower open-loop latent loss whose growth becomes significantly slower as the rollout horizon increases.