An important and recent application which requires real-time 3D localisation and tracking is that of Augmented Reality. Here some real-time augmented reality results and applications are presented.

Overview

Real-time augmented reality results developed during my thesis are presented here. This software is protected under the name Markerless.

In summary, the 3D tracking technique used is not restricted to a particular display technology and only a single monocular camera sensor is required. Now that cheap cameras such as webcams are available at low cost for any personal computer, a vision-based augmented reality system is an attractive interface for various applications such as video games, architecture, interior design, etc. The research behind this application has therfore been focused on the alignment of real and virtual worlds using images acquired in real-time by a moving camera. In such systems AR is mainly a pose (or viewpoint) computation issue.

Tracking of a roughly modeled chair in real-time with a webcam. (Click on the image to see the video)	Tracking a block with highly textured background. (Click on the image to see the video)
Tracking an electrical switchboard. (Click on the image to see the video)	Tracking an airconditionner. (Click on the image to see the video)

All these videos have been done by Total Immersion see [ISMAR'03] paper for details

Tracking within a building ( 11.2 Mo ). (Click on the image to see the video)	Integration within an animation module (1.2 Mo). (Click on the image to see the video)
Tracking a BMW 740i armrest (34 Mo). (Click on the image to see the video)	Tracking a PC (10.1 Mo) (Click on the image to see the video)

Markerless tracking the castle demo

Collegues Eric Marchand and Cederic Riou presenting the Markerless tracker for the Lagadic presentation video.	Collegues at Total Immersion demonstrating the castle demo.

Related Publications

A.I. Comport, E. Marchand, M. Pressigout, F. Chaumette. Real-time markerless tracking for augmented reality: the virtual visual servoing framework. IEEE Transactions on Visualization and Computer Graphics, 12(4):615-628, July 2006.

A.I. Comport, E. Marchand, F. Chaumette. A real-time tracker for markerless augmented reality. In ACM/IEEE Int. Symp. on Mixed and Augmented Reality, ISMAR'03, Pages 36-45, Tokyo, Japan, October 2003.