View Synthesis from Uncalibrated Images using Parallax

with L. Irsara

Overview

View synthesis starts from some real sample images and generate snapshots of a scene taken from a “virtual” viewpoint different from all the viewpoints of the real views. We start from uncalibrated reference images and recover a proxy for the geometry of the scene (the relative affine structure). This information is used to render novel views from viewpoints that can be easily controlled by the user.

Method

• the uncalibrated rectification yield an approximation of the plane at infinity, that is used as the reference plane for the relative affine structure.
• a techinque based on linear combination of dispacements in the log space is used to generate parametric trajectories for the novel camera.

Results

Reference views			Synthetic movie
Left	Right	Up

1	2	3

Code

Reference papers

1. Fusiello, A. Specifying Virtual Cameras in Uncalibrated View Synthesis. In IEEE Transactions on Circuits and Systems for Video Technology, 17 (5): 604-611, 2007. pdf  doi 
2. Fusiello, A. and Irsara, L. An Uncalibrated View-Synthesis Pipeline. In Proceedings of the International Conference on Image Analysis and Processing (ICIAP), pages 609-614, IEEE Computer Society, Modena, IT, 2007. pdf 

Previous work