Chacko, Nikhil (University of California, Santa Barbara), “Spatio-Temporal Reconstruction Techniques for Optical Microscopy” (2015)

You are here

Inside Signal Processing Newsletter Home Page

Top Reasons to Join SPS Today!

1. IEEE Signal Processing Magazine
2. Signal Processing Digital Library*
3. Inside Signal Processing Newsletter
4. SPS Resource Center
5. Career advancement & recognition
6. Discounts on conferences and publications
7. Professional networking
8. Communities for students, young professionals, and women
9. Volunteer opportunities
10. Coming soon! PDH/CEU credits
Click here to learn more.

News and Resources for Members of the IEEE Signal Processing Society

Chacko, Nikhil (University of California, Santa Barbara), “Spatio-Temporal Reconstruction Techniques for Optical Microscopy” (2015)

Chacko, Nikhil (University of California, Santa Barbara), “Spatio-Temporal Reconstruction Techniques for Optical Microscopy” (2015), Advisor: Michael Liebling

Optical microscopy offers the unique possibility to study living samples under conditions akin to their native state. However, the technique is not void of inherent problems such as optical blur due to light diffraction, contamination with out-of-focus light from adjacent focal planes, and spherical aberrations. Furthermore, with a dearth of techniques that are capable of imaging multiple focal sections in quick succession, the multi-dimensional capture of dynamically changing samples remains a challenge of its own. Computational techniques that use auxiliary knowledge about the imaging system and the sample to mitigate these problems are hence of great interest in optical microscopy.
The first part of this thesis deals with the design of a discrete model to characterize light propagation. Following the scalar diffraction theory in optics, the authors propose a discrete algorithm, based on generalized sampling theory, to reverse the coherent diffraction process via back propagation. The algorithm consists of a wavelet-based model for the spherical waves emanating from the object of interest and an optimized multi-rate filtering protocol for reconstruction from the diffraction data recorded by non-ideal detectors.
The second part of this thesis describes a spatial registration tool designed for multi-view microscopy. Here, the imaged sample is rotated about a lateral axis for the acquisition of multiple 3D datasets from different views in order to subsequently alleviate the severe axial blur found in each such dataset. Automatic algorithms that only rely on maximizing pixel-based similarity provide poor results in such applications owing to the anisotropic point-spread-function (PSF) of optical microscopes. The authors propose a pyramid-based spatial registration algorithm that re-blurs the multi-view datasets with transformed forms of the PSF in order to make them comparable, before maximizing their pixel-based similarity for registration.
The third part of this thesis describes a fast converging iterative multi-view deconvolution technique that can be applied to the spatially registered forms of the 3D datasets acquired using multi-view microscopy. The proposed sparsity based algorithm solves a non-linear objective function to jointly deconvolve and fuse the multi-view datasets to finally produce a single deblurred 3D result that has nearly isotropic spatial resolution.
The fourth part of this thesis addresses problems due to spherical aberrations encountered during the imaging of thick samples in optical microscopy. The depth-varying nature of the optical blur found in such cases renders fast and efficient shift-invariant deconvolution techniques to be inapplicable. Here, the authors propose a fast iterative-shrinkage-thresholding shift-variant 3D deconvolution method that uses depth-dependent PSFs to reconstruct a 3D deblurred form of the imaged thick specimen.
The final part of this thesis describes a non-rigid temporal registration tool that aids in the multi-dimensional imaging of quasi-periodic processes such as cardiac cycles. The authors propose a variant of dynamic time warping that is capable of both temporally warping and wrapping an input sequence by allowing for jump discontinuities in the non-linear temporal alignment function akin to those found in wrapped phase functions.
This work provides a new set of tools for spatio-temporal reconstruction in optical microscopy and the authors anticipate them to be useful for a wide range of problems in practice.


IEEE SPS Educational Resources

IEEE SPS Resource Center

IEEE SPS YouTube Channel