|Funding Reference||FCT - SAPIENS PROJECT 34121/99|
This project proposes to develop a methodology for video coding by using intermediate 3D representations. The coded video includes a representation of the scene’s 3D shape and texture, producing as output a sequence of synthetic views of the scene (which could be different from the original ones). This opens new perspectives to go one step forward towards general content-based video representations.
1 – Image to image matching,
The main idea is to create a feedback loop of “a priori” knowledge provided by the existent 3D scene model into the matching process, in a global way. By formalizing image to image and image to model matching as an integer programming problem which is then relaxed to a concave programming problem (see ), authors believe the whole process of matching and 3D reconstruction can be integrated into a single recursive framework.
Computer and Robot Vision Lab (VisLab)
Signal and Image Processing Group (SIPG)
3D Modeling from Video