Multi-Scale Deep Compressive Imaging

You are here

Top Reasons to Join SPS Today!

1. IEEE Signal Processing Magazine
2. Signal Processing Digital Library*
3. Inside Signal Processing Newsletter
4. SPS Resource Center
5. Career advancement & recognition
6. Discounts on conferences and publications
7. Professional networking
8. Communities for students, young professionals, and women
9. Volunteer opportunities
10. Coming soon! PDH/CEU credits
Click here to learn more.

Multi-Scale Deep Compressive Imaging

By: 
Thuong Nguyen Canh; Byeungwoo Jeon

Recently, deep learning-based compressive imaging (DCI) has surpassed conventional compressive imaging in reconstruction quality and running speed. While multi-scale sampling has shown superior performance over single-scale, research in DCI has been limited to single-scale sampling. Despite training with single-scale images, DCI tends to favor low-frequency components similar to conventional multi-scale sampling, especially at low subrates. From this perspective, it would be easier for the network to learn multi-scale features with a multi-scale sampling architecture. In this work, we propose a multi-scale deep compressive imaging (MS-DCI) framework which jointly learns to decompose, sample, and reconstruct images at multi-scale. A three-phase end-to-end training scheme is introduced with an initial and two enhanced reconstruction phases to demonstrate the efficiency of multi-scale sampling and further improve the reconstruction performance. We analyze the decomposition methods (including pyramid, wavelet, and scale-space), sampling matrices, and measurements and show the empirical benefit of MS-DCI, which consistently outperforms both conventional and deep learning-based approaches.

SPS Social Media

IEEE SPS Educational Resources

IEEE SPS Resource Center

IEEE SPS YouTube Channel