Xu, PingMei (Princeton University), “Understanding and predicting human visual attention” (2016)

You are here

Inside Signal Processing Newsletter Home Page

Top Reasons to Join SPS Today!

1. IEEE Signal Processing Magazine
2. Signal Processing Digital Library*
3. Inside Signal Processing Newsletter
4. SPS Resource Center
5. Career advancement & recognition
6. Discounts on conferences and publications
7. Professional networking
8. Communities for students, young professionals, and women
9. Volunteer opportunities
10. Coming soon! PDH/CEU credits
Click here to learn more.

10 years of news and resources for members of the IEEE Signal Processing Society

Xu, PingMei (Princeton University), “Understanding and predicting human visual attention” (2016)

Xu, PingMei (Princeton University), “Understanding and predicting human visual attention” (2016) Advisor: Kulkarni, Sanjeev ; Xiao, Jianxiong

An understanding of how the human visual system works is essential for many applications in computer vision, computer graphics, computational photography, psychology, sociology, and human-computer-interaction. To provide the research community with access to easier, cheaper eye tracking data for developing and evaluating computational models for human visual attention, this thesis introduces a webcam-based gaze tracking system that supports large-scale, crowdsourced eye tracking deployed on a crowd-sourcing platform. By using this tool, the authors also provide a benchmark data set to quantitatively compare existing and future models for saliency prediction. To explore where people look while performing complicated tasks in an interactive environment, the authors introduce a method to synthesize user interface layouts, present a computational model to predict users' spatio-temporal visual attention for graphical user interfaces, and show that their model outperforms existing methods. In addition, the authors explore how visual stimuli affect brain signals extracted by fMRI. Their tool for crowd-sourced eye tracking, a large data set for scene image saliency, models for user interface layouts synthesis and visual attention prediction and study for visual stimuli driven change of brain connectivity should be useful resources for future researchers to create more powerful computational models for human visual attention.

Table of Contents:

Research Opportunities

SPS on Twitter

  • Share SPS membership with your students, colleagues, and friends! Celebrate - Students and Professionals… https://t.co/qXNA12wxQ6
  • DEADLINE APPROACHING: The IEEE Transactions on Multimedia is accepting submissions for a Special Issue on Learning… https://t.co/XHR6eqwR1p
  • Celebrate now through 27 February! Get a 50% discount on SPS membership – offers available for Student a… https://t.co/enKoDMwiek
  • The SPACE Webinar Series continues Tuesday, 23 February at 10:00 AM EST when Dr. Pier Luigi Dragotti presents "Comp… https://t.co/FcZaAiHzZE
  • The Brain Space Initiative Talk Series continues on Friday, 26 February at 11:00 AM EST when Dr. Emmanuelle Tognoli… https://t.co/PTMXdSGpMa

SPS Videos

Signal Processing in Home Assistants


Multimedia Forensics

Careers in Signal Processing             


Under the Radar