Towards a Unified Theory of Sensor Pattern Noise: An analysis of dark current, lens effects, and temperature bias in CMOS image sensors

You are here

Inside Signal Processing Newsletter Home Page

Top Reasons to Join SPS Today!

1. IEEE Signal Processing Magazine
2. Signal Processing Digital Library*
3. Inside Signal Processing Newsletter
4. SPS Resource Center
5. Career advancement & recognition
6. Discounts on conferences and publications
7. Professional networking
8. Communities for students, young professionals, and women
9. Volunteer opportunities
10. Coming soon! PDH/CEU credits
Click here to learn more.

News and Resources for Members of the IEEE Signal Processing Society

Towards a Unified Theory of Sensor Pattern Noise: An analysis of dark current, lens effects, and temperature bias in CMOS image sensors

PhD Thesis by: Richard Matthews 

PhD Advisor: Matthew Sorell

School of Electrical and Electronic Engineering

University of Adelaide

ABSTRACT:

Matching images to a discrete camera is of significance in forensic investigation. In the case of digital images, forensic matching is possible through the use of sensor noise present within every image. There exist misconceptions, however, around how this noise reacts under variables such as temperature and the use of different lens systems. This study aims to formulate a revised model of the additive noise for an image sensor to determine if a new method for matching images to sensors could be created which uses fewer resources than the existing methods, and takes into account a wider range of environmental conditions. Specifically, a revised noise model was needed to determine the effects of different lens systems and the impact of temperature on sensor noise. To determine the revised model, an updated literature search was conducted on the background theory relating to CMOS sensors, as the existing work focuses on CCD imaging sensors. This theory was then applied using six off the shelf CMOS imaging sensors with integrated lens systems. An image sensor was examined under scanning electron microscopy and through the use of Energydispersive x-ray spectroscopy the non-uniform structure of individual pixels was visually observed within the sensor. The lens systems were removed and made interchangeable through the use of a 3D printed camera housing. Lens effects were assessed by swapping lens systems between the cameras and using a pinhole lens to remove all optical effects. The temperature was controlled using an Arduino controlled Peltier plate device, and dark current images were obtained at different temperatures using a blackout lens. It was observed that dark current could be used to identify the temperature of the image sensor at the time of acquisition, contrary to the statements in existing literature that sensor pattern noise is temperature invariant. It was shown that the lens system contributes approximately a quarter of the signal power xii used for pattern matching between the image and sensor. Moreover, through the use of targeted signal processing methods and simple ”Goldilocks” filters processing times could be reduced by more than half by sacrificing precision without losing accuracy. This work indicates that sensor pattern noise, while already viable for forensic identification of images to a specific camera, can also be used for identification of an image to a specific lens system and an image sensors temperature. It has also shown that a tool using sensor pattern noise may have a viable future as a forensic method of triage when confronted with large image data sets. Such additional information could prove effective for forensic investigators, intelligence agencies and police when faced with any form of crime involving imaging technology such as fraud, child exploitation or terrorism.

Link: https://digital.library.adelaide.edu.au/dspace/handle/2440/119974

SPS on Twitter

  • DEADLINE EXTENDED: The 2023 IEEE International Workshop on Machine Learning for Signal Processing is now accepting… https://t.co/NLH2u19a3y
  • ONE MONTH OUT! We are celebrating the inaugural SPS Day on 2 June, honoring the date the Society was established in… https://t.co/V6Z3wKGK1O
  • The new SPS Scholarship Program welcomes applications from students interested in pursuing signal processing educat… https://t.co/0aYPMDSWDj
  • CALL FOR PAPERS: The IEEE Journal of Selected Topics in Signal Processing is now seeking submissions for a Special… https://t.co/NPCGrSjQbh
  • Test your knowledge of signal processing history with our April trivia! Our 75th anniversary celebration continues:… https://t.co/4xal7voFER

IEEE SPS Educational Resources

IEEE SPS Resource Center

IEEE SPS YouTube Channel