How does super-resolution improve image detail from multiple shots?

Asked 6/27/2012

1 views

2 answers

0

I read about super-resolution and understand that it combines multiple low-resolution images, but I don’t see why stacking copies of the same image would increase resolution. If the images are of the same subject, where does the extra detail come from, and how is it different from simply averaging images together?

Originally by Photography Stack Exchange contributor. Source · Licensed CC BY-SA 4.0

Photography Stack Exchange contributor

14y ago

2 Answers

13

The process is complicated but this should give an intuition into what's going on. Imagine you have a regular camera, but with motors to move the sensor half a pixel in any direction.

Instead of taking one image this camera takes four: one centred, one shifted half a pixel right, one shifted half a pixel down, and one shifted half a pixel right and half a pixel down.

We can then take the centred image, make it double the size, spacing out the pixels like so:

xxxx               x x x x 
xxxx      ____\    
xxxx          /    x x x x 
xxxx               
                   x x x x

                   x x x x

Then we can fill in the gaps, using the other shifted images, 1, 2, and 3:

x1x1x1x1
23232323
x1x1x1x1
23232323
x1x1x1x1
23232323
x1x1x1x1
23232323

Leaving us with a image of twice the resolution. Interestingly enough there are cameras than employ this technique - such as the Hasselblad H4D-200MS (sorry if you have to ask how much you can't afford one).

Superresolution with a standard camera is a bit more complex as when you have uncontrolled camera or subject motion you don't get anywhere near an exact half pixel shift, but unless you are extremely unlucky your shifted image will be some amount offset from the original. By combining enough images you will get a very irregularly sampled image (with pixel samples that don't fall onto a grid) but one which can be interpolated (by tracing lines between samples to guess a result that does fall on an exact gridline) into a regular image.

Originally by user1375. Source · Licensed CC BY-SA 4.0

user1375

14y ago

0

AI Answer

Generated from our catalog & community — verify before relying on it.

Super-resolution is not just stacking identical copies. It works when multiple shots contain slightly different information.

Two things can help:

  1. Sub-pixel shifts: If the camera, sensor, or subject moves by tiny fractions of a pixel between exposures, each image samples the scene a little differently. Those offset samples can be combined to estimate detail between the original pixel positions, effectively building a higher-resolution result.

  2. Noise reduction by averaging: Multiple exposures of the same scene can be averaged, which reduces random sensor error/noise. That doesn’t by itself create new resolution, but it can make the recovered detail cleaner and more accurate.

A simple way to picture it is a sensor shifted half a pixel between shots: one frame samples the “normal” positions, others sample the gaps. When aligned and merged, those frames can fill in missing spatial information.

This only works if the images are not truly identical at the pixel level. The extra information often comes from tiny shifts and aliasing differences between frames. It also isn’t guaranteed to work in every case.

UniqueBot

AI

14y ago

Your Answer