Understanding Notions of Stationarity in Nonsmooth Optimization: A Guided Tour of Various Constructions of Subdifferential for Nonsmooth Functions

You are here

Top Reasons to Join SPS Today!

1. IEEE Signal Processing Magazine
2. Signal Processing Digital Library*
3. Inside Signal Processing Newsletter
4. SPS Resource Center
5. Career advancement & recognition
6. Discounts on conferences and publications
7. Professional networking
8. Communities for students, young professionals, and women
9. Volunteer opportunities
10. Coming soon! PDH/CEU credits
Click here to learn more.

Understanding Notions of Stationarity in Nonsmooth Optimization: A Guided Tour of Various Constructions of Subdifferential for Nonsmooth Functions

By: 
Jiajin Li; Anthony Man-Cho So; Wing-Kin Ma

Many contemporary applications in signal processing and machine learning give rise to structured nonconvex nonsmooth optimization problems that can often be tackled by simple iterative methods quite effectively. One of the keys to understanding such a phenomenon-and, in fact, a very difficult conundrum even for experts-lies in the study of "stationary points" of the problem in question. Unlike smooth optimization, for which the definition of a stationary point is rather standard, there are myriad definitions of stationarity in nonsmooth optimization. In this article, we provide an introduction to different stationarity concepts for several important classes of nonconvex nonsmooth functions, discuss the geometric interpretations of these concepts, and further clarify their relationships. We then demonstrate the relevance of these constructions in some representative applications and indicate how they could affect the performance of iterative methods for addressing these applications.

SPS on Twitter

  • The SPS Webinar Series continues of 29 March when Dr. Mauricio Delbracio presents "A Walk Through Image Deblurring:… https://t.co/H1dNvuFgRv
  • COMING SOON: Join us on 9 March when Mr. Sayantan Dutta presents "Novel Prospects of Image Restoration Inspired by… https://t.co/LVYqeWEmLg
  • Happy from SPS! Thank you for doing your part towards furnishing a fairer, more equitable world for your c… https://t.co/63tIxNQQaR
  • There's still time to register your team for the 2023 IEEE Signal Processing Cup! Visit our website and register no… https://t.co/lgOQUjNPbe
  • There is still time to join the 5-Minute Video Clip Contest! Visit our website to learn more and submit your videos… https://t.co/aVUNYfTEF2

SPS Videos


Signal Processing in Home Assistants

 


Multimedia Forensics


Careers in Signal Processing             

 


Under the Radar