Add pipeline tag, links to paper, project page and code
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,11 +1,35 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
# MNIST World Models
|
| 2 |
|
| 3 |
-
This repository hosts a curated set of checkpoints used for experiments
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4 |
|
| 5 |
## Contents
|
| 6 |
-
|
| 7 |
-
- `mnistworld/dfot
|
| 8 |
-
- `mnistworld/
|
| 9 |
-
- `mnistworld/
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
|
| 11 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
pipeline_tag: image-to-video
|
| 3 |
+
---
|
| 4 |
+
|
| 5 |
# MNIST World Models
|
| 6 |
|
| 7 |
+
This repository hosts a curated set of checkpoints used for experiments in the paper [Flow Equivariant World Models: Memory for Partially Observed Dynamic Environments](https://huggingface.co/papers/2601.01075).
|
| 8 |
+
|
| 9 |
+
[**Project Page**](https://flowequivariantworldmodels.github.io/) | [**GitHub**](https://github.com/hlillemark/flowm)
|
| 10 |
+
|
| 11 |
+
## Description
|
| 12 |
+
Flow Equivariant World Modeling (FloWM) is a framework that leverages time-parameterized symmetries within a latent memory for stable and accurate dynamics prediction over long horizons. The latent memory shifts and transforms equivariantly with self-motion and inferred external object motion, keeping information about out-of-view regions aligned as time progresses. These specific checkpoints correspond to the **MNIST World** (2D) environment benchmarks.
|
| 13 |
|
| 14 |
## Contents
|
| 15 |
+
This repository contains the following checkpoints:
|
| 16 |
+
- `mnistworld/dfot/dynamic_po.ckpt` β MNIST World Diffusion Forcing Transformer (DFoT)
|
| 17 |
+
- `mnistworld/dfot-ssm/dynamic_po.ckpt` β MNIST World Diffusion State Space Model (DFoT-SSM)
|
| 18 |
+
- `mnistworld/flowm-fernn/dynamic_po_flowm.pt` β MNIST World FloWM (FERN-N)
|
| 19 |
+
- `mnistworld/vae/mnist_world_vae.ckpt` β MNIST World VAE
|
| 20 |
+
|
| 21 |
+
## Usage
|
| 22 |
+
For detailed instructions on environment setup, training, and inference (including replicating the paper's results), please refer to the [official GitHub repository](https://github.com/hlillemark/flowm) and its [wiki](https://github.com/hlillemark/flowm/wiki).
|
| 23 |
|
| 24 |
+
## Citation
|
| 25 |
+
```bibtex
|
| 26 |
+
@misc{lillemark2026flowequivariantworldmodels,
|
| 27 |
+
title={Flow Equivariant World Models: Memory for Partially Observed Dynamic Environments},
|
| 28 |
+
author={Hansen Jin Lillemark and Benhao Huang and Fangneng Zhan and Yilun Du and Thomas Anderson Keller},
|
| 29 |
+
year={2026},
|
| 30 |
+
eprint={2601.01075},
|
| 31 |
+
archivePrefix={arXiv},
|
| 32 |
+
primaryClass={cs.LG},
|
| 33 |
+
url={https://arxiv.org/abs/2601.01075},
|
| 34 |
+
}
|
| 35 |
+
```
|