Papers
arxiv:2607.26657

Enfold: Folding World-Generator Computation into Predictive Representations for Efficient Embodied Control

Published on Jul 29
Authors:
,
,
,
,
,
,
,
,
,
,

Abstract

World generative models are typically used through what they produce: a rendered future, a video-conditioned action, or latent context computed by a costly generative branch. We argue that their more reusable asset is the computation that constructs a future. As a generator transforms a corrupted future into a coherent trajectory, its intermediate states organize appearance, spatial layout, and interaction across levels of abstraction. Can this future-generative computation be internalized in a representation inferred from the present alone? We present Enfold, which transfers this computation into a representation predicted from the current visual context and language instruction. During training, multi-level states exposed as the generator processes the observed future supervise a current-only encoder. The learned representation is fed back to condition future generation and is read by task heads without allowing task gradients to reshape the encoder. At deployment, action prediction no longer executes the generator. Across LIBERO, RoboTwin2.0, and real-robot tasks, Enfold supports strong control while reducing action latency by 3.7times relative to Fast--WAM, Enfold-Flash reaches 10.1times. Representation analyses show that it suppresses nuisance variation and preferentially captures changes that emerge over longer horizons. When the current scene is altered by human intervention, both the generated continuation and the executed actions adapt, which is inconsistent with fixed trajectory replay. These results recast a world generator as a source of predictive control representations: its future need not be materialized at every step if its internal structure can be enfolded into the present.

Community

🚀 Enfold: Folding World-Generator Computation into Predictive Representations for Efficient Embodied Control

Do world models really need to generate a future at every control step?

Enfold explores a different idea: the most reusable asset of a world generator may not be the future it produces, but the computation that constructs that future.

During training, Enfold transfers multi-level future-generative states into a predictive representation inferred from the current observation and instruction alone. At deployment, action prediction no longer runs the world generator.

Highlights:
• 97.8% on LIBERO
• 92.02% on RoboTwin2.0
• 49 ms action latency with Enfold-Flash
• Up to 10.1× lower latency than generation-based world-action modeling
• Real-robot experiments with OOD scenes and human perturbations

The broader question we hope to explore:
Can imagination be internalized into representation rather than repeatedly materialized at inference?

Paper: arXiv:2607.26657
Code: github.com/zwl666666/enfold
Project: zwl666666.github.io/enfold

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2607.26657
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2607.26657 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2607.26657 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2607.26657 in a Space README.md to link it from this page.

Collections including this paper 1