Universal Mosaicing using Pipe Projection

Video mosaicing is commonly used to increase the visual eld of view by pasting together many video frames. Existing mosaicing methods are e ective only in very limited cases where the image motion is almost a uniform translation or the camera performs a pure pan. Forward camera motion or camera zoom are very problematic for traditional mosaicing. A mosaicing methodology to allow image mosaicing in the most general cases is presented, where frames in the video sequence are transformed such that the optical ow becomes parallel. This transformation is an oblique projection of the image into a \viewing pipe" whose central axis is the trajectory of the camera. The \pipe projection" enables to de ne high-quality mosaicing even for the most challenging cases of forward motion and of zoom. In addition, view interpolation, generating dense intermediate views, is used to overcome parallax e ects.