SPS Webinar: A Single-shot Fourier Camera and its Application to Multipath ToF Imaging

Date: 2 April 2025
Time: 10:30 AM ET (New York Time)
Presenter(s): Dr. Peyman Fayyaz Shahandashti

Based on the IEEE Xplore® article: 
Simultaneous Multifrequency Demodulation for Single-Shot Multiple-Path ToF Imaging, published in the IEEE Transactions on Computational Imaging, January 2024.

Download article: Original article is open access, and publicly available to all for download.

Abstract

In the rapidly evolving field of computational imaging, the coherent codesign of image sensors and signal/image processing unlocks numerous new capabilities. To retrieve sparse macroscopic impulse response functions (IRF) to modulated light we integrate advanced circuit design with signal processing techniques. The presenter will introduce a novel sensor design that enables the realization of a single-shot Fourier camera, alongside computationally efficient methods for sparse IRF recovery. The camera uses optimal (Fourier) sensing kernels to capture sparse signals, all while maintaining an affordable cost in terms of spatial resolution. This approach has applications in various fields, including multi-path Time-of-Flight (ToF) imaging, transient imaging, ultrafast photography of sparse events, high-energy particle detection, and non-line-of-sight (NLOS) imaging.

In this webinar, he will focus particularly on resolving multipath interference (MPI), where light reflects off multiple surfaces before reaching the sensor. The aim is to capture the IRF of a macroscopic scene, which is often sparse or highly compressible. Resolving MPI requires bandwidth, and since conventional ToF cameras often rely on a single frequency to reconstruct a single return path, they fail in the presence of MPI. By leveraging multifrequency data, the Fourier camera can effectively distinguish direct and indirect light paths, thereby improving the accuracy and reliability of depth information at high speed, ensuring efficient and accurate 3D imaging in real-time applications.

Biography

Kaiming Shen

Peyman Fayyaz Shahandashti received the B.S. degree from Iran University of Science and Technology and his M.Sc. from Amirkabir University of Technology (Tehran Polytechnic), both in electrical engineering, electronics, in 2015 and 2019, respectively. He is currently pursuing a Ph.D. in information technology at the University of Santiago de Compostela, Spain.

He has been a Research Assistant at the Centro Singular de Investigación en Tecnoloxías Intelixentes (CiTIUS), Santiago de Compostela, Spain, working on the design and characterization of novel CMOS Time-of-Flight (ToF) Fourier sensing since 2020. His research interests include image sensors, analog/mixed-signal integrated circuit design, sensors, and sensor signal processing.

Mr. Fayyaz is a recipient of fellowships from the European Union’s Horizon 2020 Research and Innovation Programme under the Marie Skłodowska-Curie Actions (MENELAOSNT Project) and the Spanish Ministry of Science, Innovation, and Universities. Since 2023, he has been a reviewer for the IEEE Circuits and Systems Society (CAS).