Demystifying Lie Group Methods for Signal Processing: A Tutorial

You are here

Top Reasons to Join SPS Today!

1. IEEE Signal Processing Magazine
2. Signal Processing Digital Library*
3. Inside Signal Processing Newsletter
4. SPS Resource Center
5. Career advancement & recognition
6. Discounts on conferences and publications
7. Professional networking
8. Communities for students, young professionals, and women
9. Volunteer opportunities
10. Coming soon! PDH/CEU credits
Click here to learn more.

Demystifying Lie Group Methods for Signal Processing: A Tutorial

By: 
Riccardo Bernardini; Roberto Rinaldo

Many problems in signal processing [e.g., filter bank design, independent component analysis (ICA), beamforming design, and neural network training] can be formulated as optimization over groups of transformations that depend continuously on real parameters (Lie groups). Such problems are usually tackled in two ways: using a constrained optimization procedure or using some parameterization to transform them into unconstrained problems.

Many problems in signal processing [e.g. filter bank design, independent component analysis (ICA), beamforming design, and neural network training] can be formulated as optimization over groups of transformations that depend continuously on real parameters (Lie groups). Such problems are usually tackled in two ways: using a constrained optimization procedure or using some parameterization to transform them into unconstrained problems.

There is a third way, though. In the numerical analysis literature, it is possible to find several algorithms especially tailored for Lie groups. The description of such algorithms, however, uses mathematical concepts that are not widely known in the signal processing community and can be obscure for the practitioner. This article presents to the signal processing community these specialized techniques using only some basic analysis and linear algebra.

The objective of this article is to present some very powerful but little-known techniques for optimization over spaces that can be constructed as homogeneous spaces starting from continuous groups of transformations (Lie groups). Despite the apparently very abstract setting, this kind of problem is found in several signal processing contexts.

SPS on Twitter

  • Our Biomedical Imaging and Signal Processing Webinar Series continues on Tuesday, 5 July when Michael Unser present… https://t.co/7bYh8ZPHI0
  • Join us TODAY at 11:00 AM ET when the Brain Space Initiative Talk Series continues with Dr. Tianming Liu presenting… https://t.co/MEfnzk6dAE
  • Our 75th anniversary is approaching in 2023, and we're celebrating with a Special Issue of IEEE Signal Processing M… https://t.co/U6UNv8kLSO
  • The SPS Webinar Series continues on Monday, 20 June when Dr. Zhijin Qin presents "Semantic Communications: Principl… https://t.co/FhI7aP3GLi
  • CALL FOR PROPOSALS: Now seeking proposals for the 2024 IEEE International Workshop on Machine Learning for Signal P… https://t.co/Stt6OG2qo7

SPS Videos


Signal Processing in Home Assistants

 


Multimedia Forensics


Careers in Signal Processing             

 


Under the Radar