Demystifying Lie Group Methods for Signal Processing: A Tutorial

You are here

Top Reasons to Join SPS Today!

1. IEEE Signal Processing Magazine
2. Signal Processing Digital Library*
3. Inside Signal Processing Newsletter
4. SPS Resource Center
5. Career advancement & recognition
6. Discounts on conferences and publications
7. Professional networking
8. Communities for students, young professionals, and women
9. Volunteer opportunities
10. Coming soon! PDH/CEU credits
Click here to learn more.

Demystifying Lie Group Methods for Signal Processing: A Tutorial

By: 
Riccardo Bernardini; Roberto Rinaldo

Many problems in signal processing [e.g., filter bank design, independent component analysis (ICA), beamforming design, and neural network training] can be formulated as optimization over groups of transformations that depend continuously on real parameters (Lie groups). Such problems are usually tackled in two ways: using a constrained optimization procedure or using some parameterization to transform them into unconstrained problems.

Many problems in signal processing [e.g. filter bank design, independent component analysis (ICA), beamforming design, and neural network training] can be formulated as optimization over groups of transformations that depend continuously on real parameters (Lie groups). Such problems are usually tackled in two ways: using a constrained optimization procedure or using some parameterization to transform them into unconstrained problems.

There is a third way, though. In the numerical analysis literature, it is possible to find several algorithms especially tailored for Lie groups. The description of such algorithms, however, uses mathematical concepts that are not widely known in the signal processing community and can be obscure for the practitioner. This article presents to the signal processing community these specialized techniques using only some basic analysis and linear algebra.

The objective of this article is to present some very powerful but little-known techniques for optimization over spaces that can be constructed as homogeneous spaces starting from continuous groups of transformations (Lie groups). Despite the apparently very abstract setting, this kind of problem is found in several signal processing contexts.

SPS on Twitter

  • CALL FOR PAPERS: The IEEE Journal of Selected Topics in Signal Processing is now accepting papers for a Special Iss… https://t.co/fQ25UHWidg
  • DEADLINE EXTENDED: The IEEE Journal of Selected Topics in Signal Processing is now accepting submissions for a Spec… https://t.co/AuMC67sUKd
  • The SPACE Webinar Series continues Tuesday, 6 April at 10:00 AM EDT when Dr. Ivan Dokmanić presents "Learning the G… https://t.co/4coVRWm0lc
  • NEW SPS WEBINAR: Join us on Wednesday, 28 April at 1:00 PM EDT when Dr. Fernando Gama presents "Graph Neural Networ… https://t.co/UI6Oi2PYYi
  • The 2021 IEEE International Workshop on Machine Learning for Signal Processing Data Challenge is now live! The L3DA… https://t.co/PX0VNZaVY6

SPS Videos


Signal Processing in Home Assistants

 


Multimedia Forensics


Careers in Signal Processing             

 


Under the Radar