I am struggling with blending 3D models with a flat background in Unity. What I want to achieve is a desktop app that allows users to import a photo of some room (for example living room) and then use 3D models to "upgrade" the room. Currently, my effects are miserable, it looks awful.
My current approach: after the user imports the photo, it is displayed on fullscreen canvas with the "screen space - camera" setting. Underneath the camera, I represent a plane, so the user can adjust it with the floor on the picture. By sliders users can change manually camera angle (X-axis), camera height over the plane, plane size, and plane Y-axis rotation. Later, when the above parameters are set, users can instantiate different furniture on the surface of the plane, drag it over the surface, etc. I thought that it should be easy to use and accurate, but the effects are unsightly and inaccurate.
Am I missing something? Maybe someone here has experience with such an app?