Skip to content

sp12138/TBSM

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

TBSM: Three-Body Scattering for Generative Modeling
Three-Body Interaction. One-Step Generation!

Peng Sun1,2 · Zhenglin Cheng1,2 · Deyuan Liu1 · Jun Xie1,2 · Xinyi Shang3 · Tao Lin1

1Westlake University    2Zhejiang University    3University College London

Paper · Why TBSM? · Quick start · TODO · Citation

tbsm_demo.mp4

TBSM in two acts: from three-body scattering to one-step generation.

TBSM one-step samples across handwritten digits, fashion items, CIFAR-10, ImageNet, and text-to-image generation.

One-step generation across datasets, resolutions, and output spaces.

One-step 1024 × 1024 text-to-image samples generated by a TBSM-trained model.

One-step text-to-image generation at 1024 × 1024 resolution.

Why TBSM?

Structural bottleneck Practical limitation
GANs
learned adversarial critic
training is sensitive to the adversarial min–max objective
AR / Diffusion
ordered factorization or path-indexed objective
sequential decoding or iterative sampling slows inference
Drifting Models
minibatch-wide pairwise field
all-pairs cost grows with batch size
same-condition batches poorly fit one-image-per-caption T2I data
Diffusion distillation
often requires extra distillation losses, auxiliary training models, schedules, or stabilization tricks
some pipelines require additional teacher or online score networks during training, increasing systems complexity and potentially peak GPU memory

At its energy-distance endpoint, TBSM turns a proper distributional energy into direct, sample-level supervision for one-step generation—without an adversarial critic, teacher queries, or a batch-wide all-pairs field.

Paper design map showing one-step samples and four reference regimes across the rho-lambda TBSM design space.

Two parameters, one design space.
The (ρ, λ) map links four TBSM configurations to Drift-like dynamics, diffusion-related supervision, and GAN-like objectives.

Quick start

Performance

Resolution Space Backbone NFE FID ↓ IS ↑
256²latentDiT-XL/211.63243.0
256²pixelPixelDiT-XL/1612.23230.9
256²pixelJiT-B/1612.69247.4
512²latentDiT-XL/411.92252.1

Before and after · ImageNet-512

Before TBSM · NFE 1 · FID 398.20 After TBSM · NFE 1 · FID 1.92
Single-pass samples from a pretrained multi-step DiT-XL/4 before TBSM conversion. Single-pass ImageNet-512 samples after TBSM training.

Run

The minimal MNIST implementation provides a lightweight, low-cost path to understanding the core TBSM training algorithm through a compact, runnable example.

For full ImageNet-1K experiments, see the ImageNet training and evaluation code, including configurations for pixel- and latent-space generators.

TODO

  • Release a minimal TBSM implementation for quick experimentation
  • Release the ImageNet-1K training codebase
  • Release ImageNet-1K checkpoints (by July 28, 2026)
  • Release the Qwen-Image-20B checkpoint
  • Release the Qwen-Image-20B training code
  • Update the paper

Citation

@article{sun2026three,
  title   = {Three-Body Scattering for Generative Modeling},
  author  = {Sun, Peng and Cheng, Zhenglin and Liu, Deyuan and Xie, Jun and Shang, Xinyi and Lin, Tao},
  journal = {arXiv preprint arXiv:2607.18198},
  year    = {2026}
}

License

This is a mixed-license repository. Unless otherwise noted, original TBSM code is licensed under the Apache License 2.0. Vendored or adapted third-party files remain subject to their upstream licenses. In particular, imgnet/networks/pixdit_core/ is governed by the NVIDIA License (NSCLv1), which permits use only for non-commercial research or evaluation. See Third-Party Notices for file-level scope, attribution, and applicable license texts. External model weights and datasets remain subject to their upstream terms.

About

Official implementation of TBSM: Three-Body Scattering for Generative Modeling.

Topics

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages