Magic-Wall: Visualizing Room Decoration by Enhanced Wall Segmentation

You are here

Top Reasons to Join SPS Today!

1. IEEE Signal Processing Magazine
2. Signal Processing Digital Library*
3. Inside Signal Processing Newsletter
4. SPS Resource Center
5. Career advancement & recognition
6. Discounts on conferences and publications
7. Professional networking
8. Communities for students, young professionals, and women
9. Volunteer opportunities
10. Coming soon! PDH/CEU credits
Click here to learn more.

Magic-Wall: Visualizing Room Decoration by Enhanced Wall Segmentation

Ting Liu; Yunchao Wei; Yao Zhao; Si Liu; Shikui Wei

This paper presents an intelligent system named Magic-wall, which enables visualization of the effect of room decoration automatically. Concretely, given an image of the indoor scene and a preferred color, the Magic-wall can automatically locate the wall regions in the image and smoothly replace the existing wall with the required one. The key idea of the proposed Magic-wall is to leverage visual semantics to guide the entire process of color substitution, including wall segmentation and replacement. To strengthen the reality of visualization, we make the following contributions. First, we propose an edge-aware fully convolutional neural network (Edge-aware-FCN) for indoor semantic scene parsing, in which a novel edge-prior branch is introduced to identify the boundary of different semantic regions better. To further polish the details between the wall and other semantic regions, we leverage the output of Edge-aware-FCN as the prior knowledge, concatenating with the image to form a new input for the Enhanced-Net. In such a case, the Enhanced-Net is able to capture more semantic-aware information from the input and polish some ambiguous regions. Finally, to naturally replace the color of the original walls, a simple yet effective color space conversion method is proposed for replacement with brightness reserved. We build a new indoor scene dataset upon ADE20K for training and testing, which includes six semantic labels. Extensive experimental evaluations and visualizations well demonstrate that the proposed Magic-wall is effective and can automatically generate a set of visually pleasing results.

SPS on Twitter

  • Share SPS membership with your students, colleagues, and friends! Celebrate - Students and Professionals…
  • DEADLINE APPROACHING: The IEEE Transactions on Multimedia is accepting submissions for a Special Issue on Learning…
  • Celebrate now through 27 February! Get a 50% discount on SPS membership – offers available for Student a…
  • The SPACE Webinar Series continues Tuesday, 23 February at 10:00 AM EST when Dr. Pier Luigi Dragotti presents "Comp…
  • The Brain Space Initiative Talk Series continues on Friday, 26 February at 11:00 AM EST when Dr. Emmanuelle Tognoli…

SPS Videos

Signal Processing in Home Assistants


Multimedia Forensics

Careers in Signal Processing             


Under the Radar