Generative Image Dynamics, CVPR2024 Best Paper Award

Table of Contents

Paper: Li et al., Generative Image Dynamics (project page, cvpr2024 open access or arxiv).

This paper won the CVPR2024 best paper award.

img

img

(Images are from the original paper)

  • They proposed a new diffusion-based method to generate loop videos containing motion trajectories from a single RGB image.
  • Their model learns oscillatory dynamics of objects swaying by the wind from real video sequences.
  • Motions are treated as spectral volumes in Fourier domain.