Multi-Modal Visual Place Recognition in Dynamics-Invariant Perception Space

You are here

Top Reasons to Join SPS Today!

1. IEEE Signal Processing Magazine
2. Signal Processing Digital Library*
3. Inside Signal Processing Newsletter
4. SPS Resource Center
5. Career advancement & recognition
6. Discounts on conferences and publications
7. Professional networking
8. Communities for students, young professionals, and women
9. Volunteer opportunities
10. Coming soon! PDH/CEU credits
Click here to learn more.

Multi-Modal Visual Place Recognition in Dynamics-Invariant Perception Space

By: 
Lin Wu; Teng Wang; Changyin Sun

Visual place recognition is one of the essential and challenging problems in the fields of robotics. In this letter, we for the first time explore the use of multi-modal fusion of semantic and visual modalities in dynamics-invariant space to improve place recognition in dynamic environments. We achieve this by first designing a novel deep learning architecture to generate the static semantic segmentation and recover the static image directly from the corresponding dynamic image. We then innovatively leverage the spatial-pyramid-matching model to encode the static semantic segmentation into feature vectors. In parallel, the static image is encoded using the popular Bag-of-words model. On the basis of the above multi-modal features, we finally measure the similarity between the query image and target landmark by the joint similarity of their semantic and visual codes. Extensive experiments demonstrate the effectiveness and robustness of the proposed approach for place recognition in dynamic environments.

SPS on Twitter

  • The SPS Biomedical Imaging and Signal Processing Technical Committee Webinar Series continues on Tuesday, 6 Decembe… https://t.co/SYEEzoxIAK
  • SPS is close to reaching 20,000 members for the first time since 1995! Wouldn't that be a great way to kick off our… https://t.co/F2QMYmkW1W
  • The DEGAS Webinar Series continues on Wednesday, 30 November when Selin Aviyente presents "Single View and Multivie… https://t.co/07tgZXwcpK
  • CALL FOR PAPERS: The IEEE Transactions on Multimedia is accepting submissions for a Special Issue on When Multimedi… https://t.co/2sorOUwhLZ
  • SPS needs your support! is approaching. If our program receives 30 unique donations of US$10 or… https://t.co/hdxELXvKcK

SPS Videos


Signal Processing in Home Assistants

 


Multimedia Forensics


Careers in Signal Processing             

 


Under the Radar