The Statistical Physics of Generative Diffusion Models
A special issue of Entropy (ISSN 1099-4300). This special issue belongs to the section "Statistical Physics".
Deadline for manuscript submissions: 31 March 2025 | Viewed by 1220
Special Issue Editor
Special Issue Information
Dear Colleagues,
Generative diffusion models and related methods such as stochastic interpolants have become the state of the art in image and video generation. While these methods were inspired by the physics of out-of-equilibrium systems, recent work revealed deep connections between generative diffusion models and equilibrium statistical physics. In particular, it was shown that the generative diffusion process is punctuated by spontaneous symmetry breaking events that correspond to splits between semantic classes or visual features and are formally equivalent to mean-field critical phase transitions. These ‘speciation’ phase transitions correspond to critical windows where the generative process is maximally controllable. Another fascinating venue of research is the connection between generative diffusion models and associative memory networks such as (modern) Hopfield networks. For example, using Hopfield techniques, it has been shown that memorization in generative diffusion is the result of ‘glassy’ (i.e., disordered) phase transitions in the average free energy. The connections between spin glass sampling and generative diffusion have been further investigated using the concept of stochastic localization, which describes the (spontaneous) concentration of measure observed in generative diffusion sampling. These developments have the potential to drive a large inflow of physical theory and techniques to the study of generative machine learning models, which could lead to radical insights on the nature of learning and intelligence.
Given these fascinating developments, we are excited to launch a Special Issue aimed at connecting research in statistical physics and generative diffusion modeling. Authors are encouraged to submit their research to this Special Issue. Topics include, but are not limited to, the following:
- Theoretical analysis of generative diffusion processes;
- Connection between diffusion models and Hopfield networks;
- Statistical physics analysis of flow matching processes and stochastic interpolants;
- Theoretical analysis of prompt conditioning in generative diffusion;
- Differential geometry of diffusion latent manifolds;
- Acceleration of generative diffusion sampling using computational physics methods;
- Discrete generative diffusion processes;
- Connection between generative diffusion processes and spin glasses;
- Spontaneous symmetry breaking in equivariant generative diffusion models;
- Applications of generative diffusion to statistical physics problems;
- Stochastic localization processes;
- Statistical physics of consistency models;
- Applications of generative diffusion to econophysics and finance.
Dr. Luca Ambrogioni
Guest Editor
Manuscript Submission Information
Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.
Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Entropy is an international peer-reviewed open access monthly journal published by MDPI.
Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.
Keywords
- generative diffusion models
- generative models
- statistical physics
- equilibrium thermodynamics
- symmetry breaking
- phase transition
- stochastic localization
- Hopfield networks
Benefits of Publishing in a Special Issue
- Ease of navigation: Grouping papers by topic helps scholars navigate broad scope journals more efficiently.
- Greater discoverability: Special Issues support the reach and impact of scientific research. Articles in Special Issues are more discoverable and cited more frequently.
- Expansion of research network: Special Issues facilitate connections among authors, fostering scientific collaborations.
- External promotion: Articles in Special Issues are often promoted through the journal's social media, increasing their visibility.
- e-Book format: Special Issues with more than 10 articles can be published as dedicated e-books, ensuring wide and rapid dissemination.
Further information on MDPI's Special Issue polices can be found here.
