3D RECONSTRUCTION OF URBAN AREAS - TEXTURES EXTRACTION

G. Sourimant,

contact: G. Sourimant, L. Morin

Goal

The goal of this work is to exploit an estimated registration between rough 3D building models (extracted from a GIS database) and real videos in order to extract the buildings façade textures. Buildings 3D models can then be imported into virtual reality or augmented reality applications. See also page 1.

Approach

The registration between videos ans 3D models allows the extraction of N textures for each building façade, thanks to homographic transformations. These textures beeing defined in the same coordinate space (the façade main plane space), they are fused to compute the final and unique façade texture. The criteria used for this fusion include visibility tests, geometric resolution tests, and non modelled occlutions suppression.

Textures Extraction Fig. 1 - Extracted Façade Textures.

Textures Fusion Fig. 2 - Textures Fusion.

Experimental Results

Augmented Reality

The figures 3 and 4 provide a comparison between the original video sequences and the same videos, augmented with the registered textured 3D models (click on the images to download the videos).

Fig. 3 - Augmented Ifsic video.

Fig. 4 - Augmented Beaulieu2 video.

Virtual Reality

The figure 5 represents a novel view of the buildings. Here, even the ground and the sky are virtual.

Fig. 5 - Virtual view of the buildings reconstructed via the Ifsic video.

References

• Gaël Sourimant, Reconstruction de scènes urbaines à l'aide de fusion de données de type GPS, SIG et Vidéo, PhD Thesis, 2007. [PDF]