Green Fluorescent Protein and Phase Contrast Image Fusion Via Detail Preserving Cross Network

You are here

Top Reasons to Join SPS Today!

1. IEEE Signal Processing Magazine
2. Signal Processing Digital Library*
3. Inside Signal Processing Newsletter
4. SPS Resource Center
5. Career advancement & recognition
6. Discounts on conferences and publications
7. Professional networking
8. Communities for students, young professionals, and women
9. Volunteer opportunities
10. Coming soon! PDH/CEU credits
Click here to learn more.

Green Fluorescent Protein and Phase Contrast Image Fusion Via Detail Preserving Cross Network

By: 
Wei Tang; Yu Liu; Juan Cheng; Chang Li; Xun Chen

In cell and molecular biology, the fusion of green fluorescent protein (GFP) and phase contrast (PC) images aims to generate a composite image, which can simultaneously display the functional information in the GFP image related to the molecular distribution of biological living cells and the structural information in the PC image such as nucleus and mitochondria. In this paper, we propose a detail preserving cross network (DPCN), which consists of a structural-guided functional feature extraction branch (SFFEB), a functional-guided structural feature extraction branch (FSFEB) and a detail preserving module (DPM), to address the GFP and PC image fusion issue. Unlike traditional parallel multi-branch architectures used for multiple inputs, the SFFEB and the FSFEB are interacted via a cross manner to fuse the functional information from the GFP image and the structural information from the PC image more adequately. Moreover, the DPM is composed of eight multi-scale convolutional blocks (MSCBs) associated with short, medium, and long skip connections to further extract the detail information from the source images. Experimental results on the popular Arabidopsis thaliana cell database demonstrate that the proposed method outperforms the state-of-the-art methods in terms of both qualitative and quantitative evaluations. The proposed method is also extended to deal with the functional and structural image fusion issue in medical imaging, and the promising results obtained exhibit its good generalizability. The code of our method is available at https://github.com/yuliu316316/DPCN-Fusion.

SPS on Twitter

  • Join us this Tuesday, 21 September for the Women in Signal Processing event at ICIP 2021! Registration available on… https://t.co/hXXZ61zLBe
  • The SPACE Webinar Series continues this Tuesday, 21 September when Dr. Bin Dong presents "Data- and Task-Driven CT… https://t.co/dkwz0lb2Jk
  • Join SPS President Ahmed Tewfik on Wednesday, 22 September for the IEEE Signal Processing Society Town Hall in conj… https://t.co/31AOCWXvam
  • DEADLINE EXTENDED: The deadline to apply to PROGRESS at ICIP 2021 has been extended to this Thursday, 16 September!… https://t.co/8V2O4lpXr9
  • Voting is now live for the 5-Minute Video Clip Contest! Support SPS students by watching their videos on this year'… https://t.co/PTXiUzRI1u

SPS Videos


Signal Processing in Home Assistants

 


Multimedia Forensics


Careers in Signal Processing             

 


Under the Radar