Why don’t image sensors record exposure over time for built-in HDR in a single shot?

Asked 11/27/2017

79 views

2 answers

0

If a scene’s dynamic range is too wide for one normal exposure, why can’t an electronic-shutter camera keep track of how each pixel fills with light during the whole exposure and then combine that information into one final image? In theory, this seems like it could preserve highlight and shadow detail from a range of effective exposures in one shot, similar to HDR, and allow more exposure adjustment later. Why isn’t this commonly done in regular cameras?

Originally by Photography Stack Exchange contributor. Source · Licensed CC BY-SA 4.0

Photography Stack Exchange contributor

8y ago

2 Answers

20

It's been done in X-rays.

The TimePix is a 256x256 detector. It has three operating modes:

  • the usual "total energy in this pixel since we started integrating";
  • Time-over-Threshold (TOT): the detected pulse height is recorded in the pixel counter in the TOT mode; and
  • Time-of-Arrival (TOA): the TOA mode measures time between trigger and arrival of the radiation into each pixel.

This technology has been adapted to optical imaging. The TOT mode is best described as acting like a Wilkinson ADC -- the readout corresponds to total time where accumulated charge is at or above threshold. Subtracting this from the shutter time tells you how long it took for this pixel to saturate. Thus, for each pixel, you can draw the line from 0 to saturation over time since the shutter opened. So you can pick whatever virtual shutter time you want (as long as all the pixels saturated) and use each pixel's line to estimate its accumulated light up to that virtual shutter time.


A more direct implementation of your idea has been done in CMOS. Each pixel records and reports its time to reach a threshold charge. (Rather than ADC the pixels that do not saturate in time, the threshold is swept, so every pixel eventually exceeds a sufficiently lowered threshold.)


I recall that the Pixim Digital Pixel System (example) also did this using an ADC per pixel and nondestructively reading out the accumulated charge repeatedly (to get the accumulation slope). But I can't find current corroborating evidence.

Originally by user70185. Source · Licensed CC BY-SA 4.0

user70185

8y ago

0

AI Answer

Generated from our catalog & community — verify before relying on it.

Image sensors already integrate light over the exposure, but a normal camera records only the final accumulated value for each pixel. To do what you describe, the camera would need much more information from each pixel during the exposure—either many intermediate readouts or something like per-pixel timing/threshold data.

The main reasons this isn’t common are data and readout limits. Modern cameras have millions of pixels, and capturing multiple states for every pixel during one exposure would require extremely fast sensor readout plus huge bandwidth and storage. If you go further and imagine timestamping individual photon arrivals, the data volume becomes enormous—far beyond what typical camera pipelines can handle.

There are specialized sensors and scientific systems that use time-based or threshold-based measurements, but they are not the same as mainstream photo sensors. In regular photography cameras, the practical tradeoffs of speed, complexity, heat, power, and storage make this difficult.

So the idea is real in principle, but current consumer cameras generally use simpler approaches such as single-exposure capture, dual conversion gain, or multiple exposures for HDR instead of continuously recording the full exposure history of every pixel.

UniqueBot

AI

8y ago

Your Answer