Augmented reality in the Lagadic INRIA team

Contact : Eric Marchand Creation date : August, 4 2004 Last modification : August, 4 2004

In the Lagadic team, we are interested in the real-time 3D localisation and tracking. One of the possible application of these algorithms is Augmented Reality.

Overview

We consider the problem of real-time augmented reality. We do not restrict ourself to a particular display technology and we restrict the problem to the use of a unique vision sensor: a camera. Now that little cameras such as webcams are available at low cost for any personal computer, a vision-based augmented reality system is an attractive interface for various applications such as video games, architecture, interior design, etc. We therefore focus on the registration techniques that allow alignment of real and virtual worlds using images acquired in real-time by a moving camera. In such systems AR is mainly a pose (or viewpoint) computation issue. We mainly address the pose computation problem as a virtual visual servoing problem.

Related pages

• Virtual visual servoing (Eurographics 2002)
• Robust model-based tracking (IROS'04)
• Model-free augmented reality by virtual visual servoing (ICPR'04)

Videos

Videos of the tracking results are availble here

Softwares

We currently propose two softwares:

• Marker (Marker-based augmented reality kernel)
• Markerless (Markerless-based augmented reality kernel)

These softwares have been implemented at IRISA-INRIA Rennes within the Lagadic research team.

These softwares are licenced to a french company: Total Immersion.
They are part of their D'Fusion (tm) software.

References

• A.I. Comport, E. Marchand, M. Pressigout, F. Chaumette. Real-time markerless tracking for augmented reality: the virtual visual servoing framework. IEEE Trans. on Visualization and Computer Graphics, 2006. (À paraître)
• A. Comport, E. Marchand, F. Chaumette. Robust model-based tracking for robot vision. In IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, IROS'04, Sendai, Japon, Septembre 2004.
• A. Comport, E. Marchand, F. Chaumette. A real-time tracker for markerless augmented reality. In ACM/IEEE Int. Symp. on Mixed and Augmented Reality, ISMAR'03, Pages 36-45, Tokyo, Japon, Octobre 2003.
• E. Marchand, F. Chaumette. Virtual Visual Servoing: a framework for real-time augmented reality. In EUROGRAPHICS 2002 Conference Proceeding, G. Drettakis, H.-P. Seidel (eds.), Computer Graphics Forum, Volume 21(3), Pages 289-298, Sarrebruck, Allemagne, Septembre 2002.
• M. Pressigout, E. Marchand. Model-free augmented reality by virtual visual servoing. In IAPR Int. Conf. on Pattern Recognition, ICPR'04, Cambridge, Royaume-Uni, Août 2004.