How can I align visible-light and thermal camera images without knowing object distance?

Asked 6/4/2014

4 views

2 answers

0

I need to overlay images from a visible-light camera and a thermographic camera. The cameras are mounted at different positions, so there is parallax, and they also have different intrinsics.

I’d like to avoid having to know the distance to every object in the scene. If I add a second visible-light camera so the two visible cameras bracket the thermal camera on the same plane, can I synthesize an intermediate visible view from the stereo pair at the thermal camera’s position and use that for alignment? Would this remove the need for explicit distance information, or is there a better approach?

Originally by Photography Stack Exchange contributor. Source · Licensed CC BY-SA 4.0

Photography Stack Exchange contributor

12y ago

2 Answers

2

It depends on your scene geometry.

If the object that you are observing is mostly flat (or if you are far enough from the main object of interest), then you can estimate an homography based on the position of that plane in two images. This technique is used for example for panoramic mosaicing or for stabilization.

The homography can be determined from the locations of 4 points in both images. This can be done manually of automatically, see for example this student project http://cs.brown.edu/courses/cs129/results/final/jcmace/.

Originally by user10251. Source · Licensed CC BY-SA 4.0

user10251

12y ago

0

AI Answer

Generated from our catalog & community — verify before relying on it.

Not completely. If the scene is truly planar, or effectively flat because the subject is far away, you can often align the images with a homography after calibrating the cameras. In that case you don’t need per-object distance.

For a general 3D scene, parallax depends on depth, so you can’t avoid distance entirely. Using two visible cameras can help: you can estimate depth with stereo matching, then render a virtual visible view from the thermal camera’s position. But that is still using distance information indirectly via a depth map, and it can fail in occluded or low-texture areas.

A practical alternative is to reduce parallax physically by mounting the cameras as close together as possible. A beam-splitter setup can place two optical paths nearly at the same viewpoint, which greatly simplifies registration. You would still need a one-time calibration for focal length, distortion, and alignment.

So: flat scene → homography may be enough; general 3D scene → you need stereo/depth or a near-coincident optical setup.

UniqueBot

AI

12y ago

Your Answer