Skip to main content

Menu

LEVEL 0
0/5 XP
HomeAboutTopicsPricingMy VaultStats

Categories

🤖 Artificial Intelligence
☁️ Cloud and Infrastructure
💾 Data and Databases
💼 Professional Skills
🎯 Programming and Development
🔒 Security and Networking
📚 Specialized Topics
HomeAboutTopicsPricingMy VaultStats
LEVEL 0
0/5 XP
GitHub
© 2026 CheatGrid™. All rights reserved.
Privacy PolicyTerms of UseAboutContact

Diffusion Models Cheat Sheet

Diffusion Models Cheat Sheet

Back to Generative AI
Updated 2026-03-17
Next Topic: Direct Preference Optimization (DPO) and Alignment Methods Cheat Sheet

Diffusion models are a class of generative models that create data by learning to reverse a gradual noising process, transforming random noise into structured outputs through iterative denoising. Operating on the principle of stochastic differential equations and score-based modeling, they have achieved state-of-the-art results in image, video, and audio generation. Unlike GANs which require adversarial training or VAEs which compress data into fixed latent spaces, diffusion models iteratively refine noise using learned score functions, enabling highly controllable generation with stable training dynamics. The key insight is that reversing a carefully designed forward diffusion process—which progressively adds noise—can be learned as a denoising task, allowing models to generate diverse, high-fidelity outputs by starting from pure noise and gradually removing it through multiple timesteps.

What This Cheat Sheet Covers

This topic spans 13 focused tables and 96 indexed concepts. Below is a complete table-by-table outline of this topic, spanning foundational concepts through advanced details.

Table 1: Forward Diffusion ProcessTable 2: Reverse Diffusion and DenoisingTable 3: Training Objectives and Loss FunctionsTable 4: Model Parameterization and Prediction TargetsTable 5: Sampling Methods and AlgorithmsTable 6: Architecture Components (U-Net)Table 7: Architecture Evolution (Transformers)Table 8: Latent Diffusion ModelsTable 9: Conditioning TechniquesTable 10: Advanced Training TechniquesTable 11: Distillation and AccelerationTable 12: Evaluation MetricsTable 13: Applications and Variants

Table 1: Forward Diffusion Process

ConceptExampleDescription
Forward diffusion
x_t = \sqrt{\bar{\alpha}_t} x_0 + \sqrt{1-\bar{\alpha}_t} \epsilon
• Gradually adds Gaussian noise to data over T timesteps until reaching pure noise
• defines the corruption trajectory that the model learns to reverse
Noise schedule
Linear: \beta_t = 0.0001 \to 0.02
Cosine: \bar{\alpha}_t = \cos^2(\frac{t/T + s}{1+s} \cdot \frac{\pi}{2})
• Controls variance \beta_t of noise added at each step
• linear increases uniformly, cosine slows noise near endpoints to preserve signal longer
Signal-to-noise ratio (SNR)
\text{SNR}(t) = \frac{\bar{\alpha}_t}{1 - \bar{\alpha}_t}
• Ratio of signal variance to noise variance at timestep t
• determines how much original structure remains versus noise corruption
Zero terminal SNR
Rescale schedule so \text{SNR}(T) = 0
Ensures pure noise at final timestep by forcing noise variance to dominate completely, eliminating train-inference mismatch from residual signal

More in Generative AI

  • DALL-E and Midjourney Cheat Sheet
  • Direct Preference Optimization (DPO) and Alignment Methods Cheat Sheet
  • Advanced RAG Patterns and Optimization Cheat Sheet
  • Chain-of-Thought Reasoning Cheat Sheet
  • LangSmith Cheat Sheet
  • Multimodal AI Cheat Sheet
View all 77 topics in Generative AI