DiT & Visual Generation
Collection
Diffusion transformers, conditional decoders, and generation models, with their conditioning, codec, and sampling requirements. โข 8 items โข Updated
How to use gatilin/open-genception-1.3b-pytorch with Diffusers:
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("gatilin/open-genception-1.3b-pytorch", dtype=torch.bfloat16, device_map="cuda")
prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]Format conversion of Google DeepMind's released GenCeption Colab checkpoint
from JAX/NNX .npz to a Diffusers WanTransformer3DModel safetensors file.
This is the multi-task author implementation, not Specialist-S and not a
Table 1 / Table 2 checkpoint. paper_comparable=false.
| Upstream | https://github.com/google-deepmind/representations4d (Apache-2.0) |
| Source weights | https://storage.googleapis.com/representations4d/checkpoints/genception/genception_1.3b_transformer.npz |
| Conversion | https://github.com/isLinXu/open-genception scripts/export_author_impl_pytorch.py |
| DiT | 1.419B params, 825 tensors, float32, 30 layers, 12 heads, FFN 8960 |
| Token heads | 12 tensors in token_heads/ (token1 13ร1, token2 33ร3) |
| VAE | Official PyTorch WAN VAE copied from the DeepMind release. Not a JAX conversion. |
The DiT loads with Diffusers. Token heads are a sidecar: they need the grouped attention path in Open-GenCeption and are not a drop-in Wan pipeline.
import torch
from diffusers import AutoencoderKLWan, WanTransformer3DModel
dit = WanTransformer3DModel.from_pretrained(
"gatilin/open-genception-1.3b-pytorch",
subfolder="transformer",
torch_dtype=torch.float32,
)
vae = AutoencoderKLWan.from_pretrained(
"gatilin/open-genception-1.3b-pytorch",
subfolder="vae",
torch_dtype=torch.float32,
)
Provenance, key counts, and the source .npz sha256 are in export_ledger.json.