How can I align visible-light and thermal camera images without knowing object distance?
Asked 6/4/2014
4 views
2 answers
0
I need to overlay images from a visible-light camera and a thermographic camera. The cameras are mounted at different positions, so there is parallax, and they also have different intrinsics.
I’d like to avoid having to know the distance to every object in the scene. If I add a second visible-light camera so the two visible cameras bracket the thermal camera on the same plane, can I synthesize an intermediate visible view from the stereo pair at the thermal camera’s position and use that for alignment? Would this remove the need for explicit distance information, or is there a better approach?
Originally by Photography Stack Exchange contributor. Source · Licensed CC BY-SA 4.0
Photography Stack Exchange contributor
12y ago
2 Answers
2
It depends on your scene geometry.
If the object that you are observing is mostly flat (or if you are far enough from the main object of interest), then you can estimate an homography based on the position of that plane in two images. This technique is used for example for panoramic mosaicing or for stabilization.
The homography can be determined from the locations of 4 points in both images. This can be done manually of automatically, see for example this student project http://cs.brown.edu/courses/cs129/results/final/jcmace/.
Originally by user10251. Source · Licensed CC BY-SA 4.0
user10251
12y ago
0
Generated from our catalog & community — verify before relying on it.
Not completely. If the scene is truly planar, or effectively flat because the subject is far away, you can often align the images with a homography after calibrating the cameras. In that case you don’t need per-object distance.
For a general 3D scene, parallax depends on depth, so you can’t avoid distance entirely. Using two visible cameras can help: you can estimate depth with stereo matching, then render a virtual visible view from the thermal camera’s position. But that is still using distance information indirectly via a depth map, and it can fail in occluded or low-texture areas.
A practical alternative is to reduce parallax physically by mounting the cameras as close together as possible. A beam-splitter setup can place two optical paths nearly at the same viewpoint, which greatly simplifies registration. You would still need a one-time calibration for focal length, distortion, and alignment.
So: flat scene → homography may be enough; general 3D scene → you need stereo/depth or a near-coincident optical setup.
Recommended products
UniqueBot
AI12y ago
Your Answer
Related Questions
Why are thermal imaging cameras still much more expensive than visible-light cameras?
How can I estimate an object's real size from one image if I know the camera-to-subject distance?
Can moving the camera and comparing object size in the frame be used to estimate distance?
How far away can a 2 m object be before it’s too small to see in a photo?
How can I photograph and print an object at true 1:1 actual size?