Encoding-decoding convolutional neural networks (CNNs) play a central role in data-driven noise reduction and can be found within numerous deep learning algorithms. However, the development of these CNN architectures is often done in an ad hoc fashion and theoretical underpinnings for important design choices are generally lacking. Up to now, there have been different existing relevant works that have striven to explain the internal operation of these CNNs. Still, these ideas are either scattered and/or may require significant expertise to be accessible for a bigger audience.

The objectives of IEEE Signal Processing Magazine ( SPM ) are to propose, for any IEEE Signal Processing Society (SPS) member and beyond, a wide range of tutorial articles on both methods and applications in signal and image processing. The articles are divided into different categories: feature articles, column and forum articles, and articles in special issues, the specificities of which are detailed on the SPM webpage “Information for Authors - SPM”.

As we gear up for the International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2024, it is essential to take a moment to celebrate the achievements and highlights of ICASSP 2023, which took place on Rhodes Island, Greece, this past June. ICASSP 2023 was a momentous event as it marked the first postpandemic ICASSP, and the return to in-person meetings. With the theme “Signal Processing in the AI Era,” the conference underscored the strong connection between signal processing and machine learning, highlighting the pivotal role of signal processing in shaping the development of artificial intelligence (AI).

Compression is essential for efficient storage and transmission of signals. One powerful method for compression is through the application of orthogonal transforms, which convert a group of N data samples into a group of N transform coefficients. In transform coding, the N samples are first transformed, and then the coefficients are individually quantized and entropy coded into binary bits. The transform serves two purposes: one is to compact the energy of the original N samples into coefficients with increasingly smaller variances so that removing smaller coefficients have negligible reconstruction errors, and another is to decorrelate the original samples so that the coefficients can be quantized and entropy coded individually without losing compression performance. 

Deep learning (DL) has been wildly successful in practice, and most of the state-of-the-art machine learning methods are based on neural networks (NNs). Lacking, however, is a rigorous mathematical theory that adequately explains the amazing performance of deep NNs (DNNs). In this article, we present a relatively new mathematical framework that provides the beginning of a deeper understanding of DL. This framework precisely characterizes the functional properties of NNs that are trained to fit to data. The key mathematical tools that support this framework include transform-domain sparse regularization, the Radon transform of computed tomography, and approximation theory, which are all techniques deeply rooted in signal processing.