3D RECONSTRUCTION AND APPLICATIONS

3D RECONSTRUCTION AND APPLICATIONS Automatic reconstruction of video sequences from natural video sequences

F. Galpin,

contact: F. Galpin, L. Morin

Goal

The goal of our work is the reconstruction of a natural video sequence with a set of 3D models. The input video sequence is a set of images in the context of a static and rigid scene. This issue is of interest in many applications, such as compression or navigation in multimedia applications.
See also page 1.

Approach

Principle Principle2

Algoritm

2D3D 3D2D

Experimental Results

Indoor natural sequence

This sequence is a part of a large indoor sequence. We can see the original one and the reconstructed one which uses several 3D models. Images of these sequences have been cropped in order to avoid flicking textures.

Originale Sequence Reconstructed sequence
Original video sequence Reconstructed sequence

Outdoor natural sequence

This sequence is an outdoor sequence with sew geometric primitives. Optic flow algorithms are known to be better than primitive based algorithms on this kind of sequence. We can see the original one and the reconstructed one which uses several 3D models (this sequence have not been cropped, so we can see texture flicking). Moreover a texture morphing technique have been used in order to produce a smooth transition between 3D models. On bottom we can see a small part of the original sequence and a virtual reconstructed one : a rotation of 15deg over x axe have been applied on the camera.

Originale Sequence Reconstructed sequence Z-buffer
Original video sequence Reconstructed sequence Zbuffer of a image in the sequence
(click to load a VRML model)
Originale Sequence Reconstructed virtual sequence
Original video sequence Reconstructed virtual sequence

References

[Galpin00a]
F. Galpin, Luce Morin: "Video Coding Using Streamed 3D representation" Revue Réseaux et systèmes répartis, Image et vidéo, Vol 12, num 3-4, 2000 (downloadable: PS version)
[Galpin00b]
F. Galpin, Luce Morin: "Video Coding Using Streamed 3D representation" ICIP, 2000 (downloadable: PDF version)
[Galpin00c]
F. Galpin, Luce Morin: "Construction de modèles 3D pour la transmission très bas débit" CORESA, 2000 (downloadable: PDF version)
Webmaster: Valid CSS! Valid XHTML IRISA
Last time modified: 2006-02-20