Trainable ISTA for Sparse Signal Recovery

You are here

Top Reasons to Join SPS Today!

1. IEEE Signal Processing Magazine
2. Signal Processing Digital Library*
3. Inside Signal Processing Newsletter
4. SPS Resource Center
5. Career advancement & recognition
6. Discounts on conferences and publications
7. Professional networking
8. Communities for students, young professionals, and women
9. Volunteer opportunities
10. Coming soon! PDH/CEU credits
Click here to learn more.

Trainable ISTA for Sparse Signal Recovery

Daisuke Ito; Satoshi Takabe; Tadashi Wadayama

In this paper, we propose a novel sparse signal recovery algorithm called the trainable iterative soft thresholding algorithm (TISTA). The proposed algorithm consists of two estimation units: a linear estimation unit and a minimum mean squared error (MMSE) estimator based shrinkage unit. The error variance required in the MMSE shrinkage unit is precisely estimated from a tentative estimate of the original signal. The remarkable feature of the proposed scheme is that TISTA includes adjustable variables that control step size and the error variance for the MMSE shrinkage function. The variables are adjusted by standard deep learning techniques. The number of trainable variables of TISTA is nearly equal to the number of iteration rounds and is much smaller than that of known learnable sparse signal recovery algorithms. This feature leads to highly stable and fast training processes of TISTA. Computer experiments show that TISTA is applicable to various classes of sensing matrices, such as Gaussian matrices, binary matrices, and matrices with large condition numbers. Numerical results also demonstrate that, in many cases, TISTA provides significantly faster convergence than approximate message passing (AMP) and the learned iterative shrinkage thresholding algorithm and also outperforms orthogonal AMP in the NMSE performance.

SPS on Twitter

  • SPS is now accepting nominations for several positions, including three Members-at-Large and two Regional Directors…
  • Many of our events, including and , have been or are in the process of being transitioned to f…
  • DEADLINE EXTENDED: The 2020 IEEE Statistical Signal Processing Workshop has extended their paper submission deadlin…
  • The IEEE Journal on Selected Topics in Signal Processing welcomes submissions for a Special Issue on Reconstruction…
  • SPS is now accepting proposals for Winter 2020-2021 schools. Head to our website for more information:

SPS Videos

Signal Processing in Home Assistants


Multimedia Forensics

Careers in Signal Processing             


Under the Radar