RARE: Image Reconstruction Using Deep Priors Learned Without Groundtruth

You are here

Top Reasons to Join SPS Today!

1. IEEE Signal Processing Magazine
2. Signal Processing Digital Library*
3. Inside Signal Processing Newsletter
4. SPS Resource Center
5. Career advancement & recognition
6. Discounts on conferences and publications
7. Professional networking
8. Communities for students, young professionals, and women
9. Volunteer opportunities
10. Coming soon! PDH/CEU credits
Click here to learn more.

RARE: Image Reconstruction Using Deep Priors Learned Without Groundtruth

Jiaming Liu; Yu Sun; Cihat Eldeniz; Weijie Gan; Hongyu An; Ulugbek S. Kamilov

Regularization by denoising (RED) is an image reconstruction framework that uses an image denoiser as a prior. Recent work has shown the state-of-the-art performance of RED with learned denoisers corresponding to pre-trained convolutional neural nets (CNNs). In this work, we propose to broaden the current denoiser-centric view of RED by considering priors corresponding to networks trained for more general artifact-removal. The key benefit of the proposed family of algorithms, called regularization by artifact-removal (RARE), is that it can leverage priors learned on datasets containing only undersampled measurements. This makes RARE applicable to problems where it is practically impossible to have fully-sampled groundtruth data for training. We validate RARE on both simulated and experimentally collected data by reconstructing a free-breathing whole-body 3D MRIs into ten respiratory phases from heavily undersampled k-space measurements. Our results corroborate the potential of learning regularizers for iterative inversion directly on undersampled and noisy measurements. 

SPS on Twitter

  • Students, it's time to form your teams! The 2022 Signal Processing Cup competition is underway. This year's topic,… https://t.co/fVw7tA7zTG
  • The DEGAS Webinar Series continues this Thursday, 13 January when Peter Battaglia presents "Modeling Physical Struc… https://t.co/Kndvzl8BpE
  • The SPS Webinar Series continues on Wednesday, 26 January when Dr. Ba-Ngu Vo presents "Bayesian Multi-object Tracki… https://t.co/sKejcUeyys
  • Call for Speakers! The IEEE Women in Engineering International Leadership Conference () is seeking submissio… https://t.co/bSaRgMw2uD
  • CALL FOR PROPOSALS: The SPS Education Board is soliciting proposals for short courses in conjunction with ICASSP 20… https://t.co/LiVjYgEVGU

SPS Videos

Signal Processing in Home Assistants


Multimedia Forensics

Careers in Signal Processing             


Under the Radar