12 Downloads (Pure)

Abstract

While many methods have been proposed to solve the Super-Resolution (SR) problem of Low-Resolution (LR) images with complex unknown degradations, their performance still drops significantly when evaluated on images with challenging real-world degradations. One often overlooked factor contributing to this, is the presence of spatially varying degradations in real LR images. To address this issue, we propose a novel degradation pipeline capable of generating paired LR/High-Resolution (HR) images with spatially varying noise, a key contributor to reduced image quality. Furthermore, to fully leverage such training data, we novelly propose a Pixel-Wise Degradation Adaptive Real-World Super-Resolution (PDA-RWSR) framework. Specifically, we design a new Restormer-based Real-World Super-Resolution (RWSR) model capable of adapting the reconstruction process based on pixel-wise degradation features extracted by a new supervised degradation estimation model. Along with our proposed method, we also introduce a new challenging real-world Spatially Variant Super-Resolution (SVSR) benchmarking dataset, where the images are degraded by complex noise of varying intensity and type, to evaluate the robustness of existing RWSR methods. Comprehensive experiments on synthetic and the proposed challenging real dataset demonstrates the superiority of our method over the current State-of-The-Art (SoTA). The SVSR dataset is available at https://doi.org/10.5281/zenodo.10044260.
Original languageEnglish
Title of host publicationProceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2024
Number of pages11
PublisherIEEE (Institute of Electrical and Electronics Engineers)
Publication date3 Jan 2024
Pages4085-4095
ISBN (Print)979-8-3503-1893-7
ISBN (Electronic)979-8-3503-1892-0
DOIs
Publication statusPublished - 3 Jan 2024
Event2024 IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2024 - Waikoloa Beach Marriott Resort, Waikoloa, United States
Duration: 4 Jan 20248 Jan 2024
https://wacv2024.thecvf.com/

Conference

Conference2024 IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2024
LocationWaikoloa Beach Marriott Resort
Country/TerritoryUnited States
CityWaikoloa
Period04/01/202408/01/2024
Internet address
SeriesIEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
ISSN2642-9381

Keywords

  • Algorithms
  • Computational photography
  • Datasets and evaluations
  • image and video synthesis

Fingerprint

Dive into the research topics of 'PDA-RWSR: Pixel-Wise Degradation Adaptive Real-World Super-Resolution'. Together they form a unique fingerprint.

Cite this