Green Fluorescent Protein and Phase Contrast Image Fusion Via Detail Preserving Cross Network

You are here

Top Reasons to Join SPS Today!

1. IEEE Signal Processing Magazine
2. Signal Processing Digital Library*
3. Inside Signal Processing Newsletter
4. SPS Resource Center
5. Career advancement & recognition
6. Discounts on conferences and publications
7. Professional networking
8. Communities for students, young professionals, and women
9. Volunteer opportunities
10. Coming soon! PDH/CEU credits
Click here to learn more.

Green Fluorescent Protein and Phase Contrast Image Fusion Via Detail Preserving Cross Network

Wei Tang; Yu Liu; Juan Cheng; Chang Li; Xun Chen

In cell and molecular biology, the fusion of green fluorescent protein (GFP) and phase contrast (PC) images aims to generate a composite image, which can simultaneously display the functional information in the GFP image related to the molecular distribution of biological living cells and the structural information in the PC image such as nucleus and mitochondria. In this paper, we propose a detail preserving cross network (DPCN), which consists of a structural-guided functional feature extraction branch (SFFEB), a functional-guided structural feature extraction branch (FSFEB) and a detail preserving module (DPM), to address the GFP and PC image fusion issue. Unlike traditional parallel multi-branch architectures used for multiple inputs, the SFFEB and the FSFEB are interacted via a cross manner to fuse the functional information from the GFP image and the structural information from the PC image more adequately. Moreover, the DPM is composed of eight multi-scale convolutional blocks (MSCBs) associated with short, medium, and long skip connections to further extract the detail information from the source images. Experimental results on the popular Arabidopsis thaliana cell database demonstrate that the proposed method outperforms the state-of-the-art methods in terms of both qualitative and quantitative evaluations. The proposed method is also extended to deal with the functional and structural image fusion issue in medical imaging, and the promising results obtained exhibit its good generalizability. The code of our method is available at

SPS on Twitter

  • DEADLINE EXTENDED: The 2023 IEEE International Workshop on Machine Learning for Signal Processing is now accepting…
  • ONE MONTH OUT! We are celebrating the inaugural SPS Day on 2 June, honoring the date the Society was established in…
  • The new SPS Scholarship Program welcomes applications from students interested in pursuing signal processing educat…
  • CALL FOR PAPERS: The IEEE Journal of Selected Topics in Signal Processing is now seeking submissions for a Special…
  • Test your knowledge of signal processing history with our April trivia! Our 75th anniversary celebration continues:…

IEEE SPS Educational Resources

IEEE SPS Resource Center

IEEE SPS YouTube Channel