Awesome-diffusion-model-for-image-processing

<p align="center"> <img src="./figures/framework.png" alt="image" style="width:1000px;"> </p>

Purpose: We aim to provide a summary of diffusion model-based image processing, including restoration, enhancement, coding, and quality assessment. More papers will be summarized.

Xin Li, Yulin Ren, Xin Jin, Cuiling Lan, Xingrui Wang, Wenjun Zeng, Xinchao Wang, Zhibo Chen

University of Science and Technology of China (USTC), National University of Singapore (NUS), Microsoft Research Asia (MSRA), Eastern Institute of Technology (EIT)

Brief intro: The survey for diffusion model-based IR has been released.

:bookmark: News!!!

• 2023-09-19: Updated new related works before 15/09/2023 in this GitHub.
• 2023-11-24: Updated new related works before 10/11/2023 in this GitHub.
• 2023-12-25: Updated new related works before 25/12/2023 in this GitHub.
• 2024-01-25: Updated new related works before 25/01/2024 in this GitHub.
• 2024-03-25: Updated new related works before 25/03/2024 in this GitHub.
• 2024-04-25: Updated new related works before 25/04/2024 in this GitHub.
• 2024-06-25: Updated new related works before 25/06/2024 in this GitHub.
• 2024-08-25: Updated new related works before 25/08/2024 in this GitHub.

📌 About new works. If you want to incorporate your studies (e.g., the link of paper or project) on diffusion model-based image processing in this repository. Welcome to raise an issue or email us. We will incorporate it into this repository and our survey report as soon as possible.

🌟 Features

• Survey for diffusion model-based Image Restoration (Arxiv version is released)
• Summary for diffusion model-based Image/Video Compression
• Summary for diffusion model-based Quality Assessment

Diffusion model-based Image Restoration/Enhancement

Table of contents

<!-- - [Survey paper](#survey-paper) - [Table of contents](#table-of-contents) -->

• Diffusion model for Image Super resolution
• Diffusion model for Image Restoration
• Diffusion model for Image Inpainting
• Diffusion model for Image Shadow Removal
• Diffusion model for Image Denoising
• Diffusion model for Image Dehazing
• Diffusion model for Image Deblurring
• Diffusion model for Medical IR
• Diffusion model for Low-Light Enchancement
• Diffusion model for other tasks
• Benchmark Datasets

<!-- - [Diffusion model for Image/video compression](#compression) --> <!-- - [Recommended Datasets](#recommended-datasets) - [All Datasets](#all-datasets) -->

Image Super-Resolution

Models	Paper	First Author	Training Way	Venue	Topic	Project
SR3	Image super-resolution via iterative refinement	Chitwan Saharia	Supervised	TPAMI2022	Super-resolution
SRDiff	SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Models	Haoying Li	Supervised	Neurocomputing 2022	Super-resolution
SDE-SR	Face super-resolution using stochastic differential equations	Marcelo dos Santos	Supervised	SIBGRAPI 2022	Super-resolution
IDM	Implicit diffusion models for continuous super-resolution	Sicheng Gao	Supervised	CVPR2023	Super-resolution
PromptSR	Image Super-Resolution with Text Prompt Diffusion	Zheng Chen	Supervised	Preprint'23	Super-resolution
DiffIR	DiffIR: Efficient diffusion model for image restoration	Bin Xia	Supervised	ICCV 2023	Super-resolution
CDM	Cascaded Diffusion Models for High Fidelity Image Generation	Jonathan Ho	Supervised	J.Mach.Learn.Res 2022	Super-resolution
StableSR	Exploiting diffusion prior for real-world image super-resolution	Jianyi Wang	Supervised	Preprint'23	Real-World Super-resolution
ResShift	ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shifting	Zongsheng Yue	Supervised	NeurIPS 2023	Real-World Super-resolution
ECDP	Efficient Conditional Diffusion Model with Probability Flow Sampling for Image Super-resolution	Yutao Yuan	Supervised	AAAI 2024	Super-resolution
SinSR	SinSR: Diffusion-Based Image Super-Resolution in a Single Step	Yufei Wang	Supervised	CVPR 2024	Real-World Super-resolution
TextDiff	TextDiff: Mask-Guided Residual Diffusion Models for Scene Text Image Super-Resolution	Baolin Liu	Supervised	Preprint'23	Super-resolution
PASD	Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylization	Tao Yang	Supervised	Preprint'23	Super-resolution
CCSR	Improving the Stability of Diffusion Models for Content Consistent Super-Resolution	Lingchen Sun	Supervised	Preprint'23	Super-resolution
EDiffSR	EDiffSR: An Efficient Diffusion Probabilistic Model for Remote Sensing Image Super-Resolution	Yi Xiao	Supervised	IEEE TGRS	Super-resolution
SeeSR	SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution	Rongyuan Wu	Supervised	Preprint'23	Super-resolution
CoSeR	CoSeR: Bridging Image and Language for Cognitive Super-Resolution	Haoze Sun	Supervised	CVPR 2024	Super-resolution
BI-DiffSR	Binarized Diffusion Model for Image Super-Resolution	Zheng Chen	Supervised	Preprint'24	Super-resolution
DaLPSR	DaLPSR: Leverage Degradation-Aligned Language Prompt for Real-World Image Super-Resolution	Aiwen Jiang	Supervised	Preprint'24	Super-resolution
FDDiff	Frequency-Domain Refinement with Multiscale Diffusion for Super Resolution	Xingjian Wang	Supervised	Preprint'24	Super-resolution
PartDiff	PartDiff: Image Super-resolution with Partial Diffusion Models	Kai Zhao	Supervised	Preprint'23	Super-resolution
DeeDSR	DeeDSR: Towards Real-World Image Super-Resolution via Degradation-Aware Stable Diffusion	Chunyang Bi	Supervised	Preprint'24	(Real-World) Super-resolution
SR3+	Denoising diffusion probabilistic models for robust image super-resolution in the wild	Hshmat Sahak	Supervised	Preprint'23	(Real-World) Super-resolution
DKP	A Dynamic Kernel Prior Model for Unsupervised Blind Image Super-Resolution	Zhixiong Yang	Supervised	CVPR 2024	(Real-World) Super-resolution
Diwa	Waving Goodbye to Low-Res: A Diffusion-Wavelet Approach for Image Super-Resolution	Brian Moser	Supervised	Preprint'23	Super-resolution
YODA	YODA: You Only Diffuse Areas. An Area-Masked Diffusion Approach For Image Super-Resolution	Brian B. Moser	Supervised	Preprint'23	Super-resolution
CDPMSR	CDPMSR: Conditional Diffusion Probabilistic Models for Single Image Super-Resolution	Axi Niu	Supervised	Preprint'23	Super-resolution
ACDPMSR	ACDMSR: Accelerated Conditional Diffusion Models for Single Image Super-Resolution	Axi Niu	Supervised	Preprint'23	Super-resolution
ResDiff	ResDiff: Combining cnn and diffusion model for image superresolution	Shuyao Shang	Supervised	Preprint'23	Super-resolution
OSEDiff	One-Step Effective Diffusion Network for Real-World Image Super-Resolution	Rongyuan Wu	Supervised	Preprint'24	Super-resolution
DiffTSR	Diffusion-based Blind Text Image Super-Resolution	Yuzhe Zhang	Supervised	CVPR 2024	Super-resolution
SAM-DiffSR	SAM-DiffSR: Structure-Modulated Diffusion Model for Image Super-Resolution	Chengcheng Wang	Supervised	Preprint'24	Super-resolution
BlindDiff	BlindDiff: Empowering Degradation Modelling in Diffusion Models for Blind Image Super-Resolution	Feng Li	Supervised	Preprint'24	Super-resolution
XPSR	XPSR: Cross-modal Priors for Diffusion-based Image Super-Resolution	Yunpeng Qu	Supervised	Preprint'24	Super-resolution
--	Text-guided Explorable Image Super-resolution	Kanchana Vaishnavi Gandikota	Zero-shot	Preprint'24