How can I map RGB plus infrared channels into a standard RGB image?
Asked 10/9/2014
6 views
2 answers
0
I’m combining a normal visible-light photo with an infrared image, so I effectively have more than three channels to work with. Since a display can only show RGB, what are good ways to reduce RGB+IR down to three output channels? I’ve tried simple remaps like assigning infrared to red and averaging visible channels into green and blue, but I’m looking for approaches that are more meaningful or perceptually reasonable.
Originally by Photography Stack Exchange contributor. Source · Licensed CC BY-SA 4.0
Photography Stack Exchange contributor
11y ago
2 Answers
3
I'm afraid there is no one-size-fits-all answer to this question, as mapping of incoming light values to output pixel values is never 1-to-1, not even for plain visible light photos. You can start by reading about gamma correction and tone mapping. Typically, the exact mapping will vary depending on the content of the photograph.
I suspect you will have more luck working on such composite images using a graphics editor rather than a math driven application that simply iterates over all pixels. For best results, you may need to use masks to apply slightly different curves to different areas of the same image.
Originally by user29595. Source · Licensed CC BY-SA 4.0
user29595
11y ago
0
Generated from our catalog & community — verify before relying on it.
There isn’t a single “correct” or universally perceptual mapping from RGB+IR to display RGB. Even ordinary photos require interpretation through tone mapping, gamma, and color rendering, so adding infrared makes the result even more subjective.
In practice, you have two main options:
-
Artistic/manual mapping: Choose a false-color rendering that emphasizes the information you want, then refine it with curves, masks, and local adjustments in an editor. Different parts of the image may need different treatment.
-
Data-driven compression: Use a method such as PCA (principal component analysis) to transform the multiple input bands into three new components that retain as much variation/information as possible. This is a common engineering approach for reducing multi-band data to three channels.
This is similar to how astronomy imaging often maps non-visible filter data into RGB for human viewing: the channels are intentionally remixed rather than reproduced “literally.”
So the short answer is: no one-size-fits-all mapping exists. If your goal is visual impact, edit creatively; if your goal is preserving information from multiple bands, try PCA or a similar multi-band reduction method, then tone-map the result for display.
Recommended products
UniqueBot
AI11y ago
Your Answer
Related Questions
Can a converted camera record three infrared channels, or do you need extra filters?
Can a full-spectrum digital camera produce separate RGB and near-infrared channels from one RAW file?
Why don't consumer cameras use more than three color channels?
Can the color filter array on a DSLR sensor be removed, and is it necessary for infrared conversion?
How can I extract the depth map from an iPhone HEIF/HEIC image?