0

I have an IR and RGB camera set up such that they are 2cm apart from each other (horizontally). My goal is to fuse both the images (RGB and IR) to obtain a more informative image. Because of the offset between the RGB and the IR data, both the images do not match. Is there a way to align the images so that they are on the same coordinate system.

Rohan Sada
  • 1
  • 1
  • Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer. – Community Oct 21 '21 at 08:18
  • How about sharing your images to allow folk to help you better? Have a read here... https://www.pyimagesearch.com/2020/08/31/image-alignment-and-registration-with-opencv/ – Mark Setchell Oct 21 '21 at 08:33
  • Does _"register"_ mean record? Does _"fuse"_ mean blend (overlay)? Are you a programmer looking to write such software? If not a coder then maybe try **FFmpeg**. It might allow inputs from two camera and then you can add some layer blending command... – VC.One Oct 21 '21 at 09:18

1 Answers1

0

I would suggest to perform an edge detection (or something similar to reduce the amount of information in both images), and then to make a wrap of one image onto the other.

If you are using OpenCV, I suggest using findTransformECC() method (doc) to find the transformation matrix needed to get the best overlay between your images.

Than you can warp the second image using this transformation matrix with warpAffine() method (doc).

jeandemeusy
  • 226
  • 3
  • 12