SPM Articles
Teaching Signal Processing Through Frequent and Diverse Design: A Pedagogical Approach
Novice to Postgraduate Researcher Perceptions of Threshold Concepts and Capabilities in Signal Processing: Understanding Students' and Researchers' Perspectives
Teaching Digital Signal Processing by Partial Flipping, Active Learning, and Visualization: Keeping Students Engaged With Blended Teaching
Demystifying Lie Group Methods for Signal Processing: A Tutorial
Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processing
The Vulnerability of Semantic Segmentation Networks to Adversarial Attacks in Autonomous Driving: Enhancing Extensive Environment Sensing
Nonconvex Structured Phase Retrieval: A Focus on Provably Correct Approaches
A Primer on Zeroth-Order Optimization in Signal Processing and Machine Learning: Principals, Recent Advances, and Applications
Zeroth-order (ZO) optimization is a subset of gradient-free optimization that emerges in many signal processing and machine learning (ML) applications. It is used for solving optimization problems similarly to gradient-based methods. However, it does not require the gradient, using only function evaluations. Specifically, ZO optimization iteratively performs three major steps: gradient estimation, descent direction computation, and the solution update. In this article, we provide a comprehensive review of ZO optimization, with an emphasis on showing the underlying intuition, optimization principles, and recent advances in convergence analysis.
Pagination
- First page
- Previous page
- 1
- 2
- 3
- 4
- 5
- 6
