Demystifying Lie Group Methods for Signal Processing: A Tutorial

You are here

Top Reasons to Join SPS Today!

1. IEEE Signal Processing Magazine
2. Signal Processing Digital Library*
3. Inside Signal Processing Newsletter
4. SPS Resource Center
5. Career advancement & recognition
6. Discounts on conferences and publications
7. Professional networking
8. Communities for students, young professionals, and women
9. Volunteer opportunities
10. Coming soon! PDH/CEU credits
Click here to learn more.

Demystifying Lie Group Methods for Signal Processing: A Tutorial

By: 
Riccardo Bernardini; Roberto Rinaldo

Many problems in signal processing [e.g., filter bank design, independent component analysis (ICA), beamforming design, and neural network training] can be formulated as optimization over groups of transformations that depend continuously on real parameters (Lie groups). Such problems are usually tackled in two ways: using a constrained optimization procedure or using some parameterization to transform them into unconstrained problems.

Many problems in signal processing [e.g. filter bank design, independent component analysis (ICA), beamforming design, and neural network training] can be formulated as optimization over groups of transformations that depend continuously on real parameters (Lie groups). Such problems are usually tackled in two ways: using a constrained optimization procedure or using some parameterization to transform them into unconstrained problems.

There is a third way, though. In the numerical analysis literature, it is possible to find several algorithms especially tailored for Lie groups. The description of such algorithms, however, uses mathematical concepts that are not widely known in the signal processing community and can be obscure for the practitioner. This article presents to the signal processing community these specialized techniques using only some basic analysis and linear algebra.

The objective of this article is to present some very powerful but little-known techniques for optimization over spaces that can be constructed as homogeneous spaces starting from continuous groups of transformations (Lie groups). Despite the apparently very abstract setting, this kind of problem is found in several signal processing contexts.

SPS on Twitter

  • Join Dr. Peilan Wang and Dr Jun Fang for "Channel State Information Acquisition for Intelligent Reflecting Surface-… https://t.co/jOhyA10xuG
  • The SPS Webinar Series continues on Monday, 10 October when Dr. Luisa Verdoliva presents "Media Forensics and DeepF… https://t.co/aInDvTSQZc
  • DEADLINE EXTENDED: The IEEE Transactions on Multimedia is accepting submissions for a Special Issue on Point Cloud… https://t.co/UqoOXUd8BH
  • Short courses return to ! Register for live and remote sessions, "A Hands-on Approach for Implementing Sto… https://t.co/qMoR6iqp4F
  • Join Dr. Sabyasachi Ghosh on Wednesday, 21 September for a new SPS Webinar, “Tapestry: A Compressed Sensing Approac… https://t.co/MNhu1kBmxG

SPS Videos


Signal Processing in Home Assistants

 


Multimedia Forensics


Careers in Signal Processing             

 


Under the Radar