A Multichannel Cross-Modal Fusion Framework for Electron Tomography

You are here

Top Reasons to Join SPS Today!

1. IEEE Signal Processing Magazine
2. Signal Processing Digital Library*
3. Inside Signal Processing Newsletter
4. SPS Resource Center
5. Career advancement & recognition
6. Discounts on conferences and publications
7. Professional networking
8. Communities for students, young professionals, and women
9. Volunteer opportunities
10. Coming soon! PDH/CEU credits
Click here to learn more.

A Multichannel Cross-Modal Fusion Framework for Electron Tomography

Yan Guo; Richard Aveyard; Bernd Rieger

In this paper, we present a multichannel cross-modal fusion algorithm to combine two complementary modalities in electron tomography: X-ray spectroscopy and scanning transmission electron microscopy (STEM). The former reveals compositions with high elemental specificity but low signal-to-noise ratio (SNR), while the latter characterizes the structure with high SNR but little chemical information. We use a multivariate regression to build a cross-modal fusion framework for these two modalities to simultaneously achieve high elemental specificity and high SNR for a target element chosen from the sample under study. Specifically, we first compute three-dimensional tomograms from tilt-series datasets of X-ray and STEM using different reconstruction algorithms. Then, we generate many feature images from each tomogram. Finally, we adopt partial least squares regression to assess the connection between these feature images and the reconstruction of the target element. Based on the simulated and experimental datasets of semiconductor devices, we demonstrate that our algorithm can not only produce continuous edges, homogeneous foreground, and clean background in its element-specific reconstructions but also can more accurately preserve fine structures than state-of-the-art tomography techniques. Moreover, we show that it can deliver results with high fidelity even for X-ray datasets with limited tilts or low counts. This property is highly desired in the semiconductor industry where acquisition time and sample damage are essential.

SPS on Twitter

  • Share SPS membership with your students, colleagues, and friends! Celebrate - Students and Professionals… https://t.co/qXNA12wxQ6
  • DEADLINE APPROACHING: The IEEE Transactions on Multimedia is accepting submissions for a Special Issue on Learning… https://t.co/XHR6eqwR1p
  • Celebrate now through 27 February! Get a 50% discount on SPS membership – offers available for Student a… https://t.co/enKoDMwiek
  • The SPACE Webinar Series continues Tuesday, 23 February at 10:00 AM EST when Dr. Pier Luigi Dragotti presents "Comp… https://t.co/FcZaAiHzZE
  • The Brain Space Initiative Talk Series continues on Friday, 26 February at 11:00 AM EST when Dr. Emmanuelle Tognoli… https://t.co/PTMXdSGpMa

SPS Videos

Signal Processing in Home Assistants


Multimedia Forensics

Careers in Signal Processing             


Under the Radar