Does in-camera downsampling improve noise like a lower effective ISO?
Asked 1/6/2017
4 views
2 answers
0
My Sony APS-C camera can save JPEGs at 24MP, 12MP, or 6MP. Since 6MP is one quarter the pixel count of 24MP, it seems like the camera could average roughly four sensor pixels into one output pixel, which should improve signal-to-noise ratio by about the square root of 4, or 2x. In theory, would that be similar to about a one-stop noise advantage, so I could use a higher ISO at 6MP and get noise comparable to 24MP when viewed at the same output size?
In real cameras, does in-camera downsampling usually achieve that theoretical noise benefit, or is it typically better to shoot full resolution and downsample later in post?
Originally by Photography Stack Exchange contributor. Source · Licensed CC BY-SA 4.0
Photography Stack Exchange contributor
9y ago
2 Answers
1
It's always possible that a poorly written post-processing application could do noise reduction and downsampling, as well as other raw conversion processes, at lower quality than the in-camera routine. But the well written post-processing applications (which would include all of the popular ones and a lot of the less popular ones) can do it much better than the in-camera routines that are limited by speed and power concerns as well as a one-size-fits-all approach to each image converted in-camera.
Every picture your camera takes starts out as a 6000x4000 pixel raw data file. To produce the JPEGs in 24MP, 12, MP, or 6MP resolution the camera processes that raw data into a JPEG image file.
You can do the same thing at least as well and usually much better developing that raw data and applying noise reduction after the fact on a computer. The reasons should be fairly obvious:
- Cameras are optimized (or at least take a balanced approach) to conserve battery power. Computers are optimized for processing power. The in-camera processor is designed for efficiency and the processing algorithms are written for efficiency in terms of power consumption. Processing on the computer isn't normally as concerned with conserving power - the raw conversion application on the computer is usually more optimized for maximum processing power because it has a power supply much greater than the battery in most cameras.
- Cameras are designed for speed. The shorter a processing routine is the faster it can be executed. This allows the camera to process each image more quickly and move on to the next image. Shorter in-camera processing times allow higher frame rates until the point is reached where the internal buffer is filled (when the camera to card write speed becomes the bottleneck). There are a few computer photo processing applications that are optimized for speed at the expense of quality but most allow the user to set quality as a priority if the application isn't written that way to start with.
- Noise reduction is fairly processor intensive. Sometimes it can require more processing power than the demosaicing of the same file. See the first two points above.
- Noise reduction is also more flexible with most post processing applications than it is with most in-camera controls. Rather than selecting Off-Low-Medium-High in camera and letting the camera actually set the values for luminance and chrominance noise based strictly on a preset value for a particular ISO, in post processing you can control luminance and chrominance noise reduction independently and on a custom basis for each frame based on the actual content. You can also selectively apply different NR levels to different areas of the same photo using a brush tool if your application has that feature.
- Cameras process the raw data into a jpeg image. If jpeg is the file output selected the camera will only save the information in the jpeg to the memory card. The rest of the data in the raw file is discarded and not saved. So you're stuck with a single interpretation of the raw data. If you don't like that result you can't go back to the raw data and do it again with different settings. If given a raw file, computers retain all of the raw data even though they only display a portion of it in more or less jpeg form on the monitor. When changes to settings are made the application can draw upon all of the data in the raw file to reconvert that data into another more or less jpeg type form to display on the screen. Those changes are non-destructive to the original raw data. The only thing that has changed is how that raw data is interpreted to produce an image. If the user doesn't like that interpretation they can change the settings and let the application reinterpret the original raw data again. And again. And again. And again...
- There are many other considerations when processing the raw data regarding image quality besides noise reduction. For in-camera processing, please see the first and second points above. On the computer each step can take as long as the user desires and be done one at a time to optimize each step in the process to the preference of the photographer/editor. Cameras tend to use a one size fits all approach to processing the raw data into a jpeg image.
- All approaches to downsampling are not equal. A brute 4 pixel square into one pixel in a 4:1 reduction as described in the question does not produce as smooth an image as a method that uses info from surrounding pixels, in much the same way that demosaicing does to produce color values, to interpolate the pixel values of the resulting reduction. Of course such an approach is also more complex and requires more processing power.
Originally by user15871. Source · Licensed CC BY-SA 4.0
user15871
9y ago
0
Generated from our catalog & community — verify before relying on it.
In principle, yes: when you reduce resolution and compare images at the same final display or print size, downsampling can improve visible noise by about the expected square-root relationship. A 24MP image reduced to 6MP can look roughly one stop cleaner.
But that does not mean the sensor itself became “lower ISO.” The camera still captures the full-resolution raw data first, then creates a smaller JPEG from it.
In practice, shooting full resolution and downsampling later is usually the better choice. The camera’s JPEG/downsampling pipeline is constrained by speed, power, and a one-size-fits-all approach. Good raw converters and post-processing software can generally do the resizing, demosaicing, and noise reduction at least as well, and often better, than the in-camera routine.
So the practical advice is: if image quality matters, record full-resolution raw (or at least full-resolution files) and downsample in post. You should still get the expected noise benefit when reducing size, with more control and often better results than the camera’s built-in processing.
Recommended products
UniqueBot
AI9y ago
Your Answer
Related Questions
How does a Nikon D600 create smaller image sizes, and is it better to downsample or use DX crop?
How does smartphone pixel binning compare to larger native pixels?
If I downsample both to 12MP, will a Nikon D3200 have better image quality than a D3100?
When a camera is set to a lower resolution, at what stage is the image downscaled, and does it reduce noise?
Should I shoot at full resolution and downsize later for less noise in low light?