Demystifying Lie Group Methods for Signal Processing: A Tutorial

You are here

Top Reasons to Join SPS Today!

1. IEEE Signal Processing Magazine
2. Signal Processing Digital Library*
3. Inside Signal Processing Newsletter
4. SPS Resource Center
5. Career advancement & recognition
6. Discounts on conferences and publications
7. Professional networking
8. Communities for students, young professionals, and women
9. Volunteer opportunities
10. Coming soon! PDH/CEU credits
Click here to learn more.

Demystifying Lie Group Methods for Signal Processing: A Tutorial

By: 
Riccardo Bernardini; Roberto Rinaldo

Many problems in signal processing [e.g., filter bank design, independent component analysis (ICA), beamforming design, and neural network training] can be formulated as optimization over groups of transformations that depend continuously on real parameters (Lie groups). Such problems are usually tackled in two ways: using a constrained optimization procedure or using some parameterization to transform them into unconstrained problems.

Many problems in signal processing [e.g. filter bank design, independent component analysis (ICA), beamforming design, and neural network training] can be formulated as optimization over groups of transformations that depend continuously on real parameters (Lie groups). Such problems are usually tackled in two ways: using a constrained optimization procedure or using some parameterization to transform them into unconstrained problems.

There is a third way, though. In the numerical analysis literature, it is possible to find several algorithms especially tailored for Lie groups. The description of such algorithms, however, uses mathematical concepts that are not widely known in the signal processing community and can be obscure for the practitioner. This article presents to the signal processing community these specialized techniques using only some basic analysis and linear algebra.

The objective of this article is to present some very powerful but little-known techniques for optimization over spaces that can be constructed as homogeneous spaces starting from continuous groups of transformations (Lie groups). Despite the apparently very abstract setting, this kind of problem is found in several signal processing contexts.

SPS on Twitter

  • Registration for ICIP 2021 is now open! This hybrid event will take place 19-22 September, with the in-person compo… https://t.co/s3kiGP4EPh
  • The Brain Space Initiative Talk Series continues on Friday, 30 July when Dr. Ioulia Kovelman presents "The Bilingua… https://t.co/6EqwqmBD0Q
  • There’s still time to register your team to win the US$5,000 grand prize in the 5-Minute Video Clip Contest, “Autom… https://t.co/76kh4jeL6i
  • Join the SPS Vizag Bay, Long Island, and Finland Chapters for the Seasonal School on Signal Processing and Communic… https://t.co/l04xac8qP5
  • Calling students and graduate students! The 5-Minute Video Clip Contest returns for ICIP 2021, and there's still ti… https://t.co/4hxYYY2Va3

SPS Videos


Signal Processing in Home Assistants

 


Multimedia Forensics


Careers in Signal Processing             

 


Under the Radar