I am trying to patch one image that has missing data with another taken from another angle. I had some success with computing features i.e. SIFT and finding a homography with surfaces with unique features. I later do blending to make the images nice.
The trouble appears when I am trying to patch images of the floor which can be featureless or have many non-unique features. Repeating this method has very poor results as far too many features are computed and not well matched. Is there a much better way to do this? I was looking at plane estimation algorithms. At worst if I could estimate the plane and very roughly align the images that would be fine.
It would be great to hear a different view point on this problem. Here are 2 example images I have tried (a very hard case I know).
Edit: My camera lens right now is faulty. The images would be more clear than this normally so I am aware this is an extra difficult case.