Mixed Reality Teleconferencing

Table of contents

• MRConference
• Introduction
• Main Features
• More Information

Introduction

MRConference a Mixed Reality (MR) teleconferencing application based on Second Life (SL) and the OpenSim virtual world. Augmented Reality (AR) techniques are used for displaying virtual avatars of remote meeting participants in real physical spaces, while Augmented Virtuality (AV), in form of video based gesture detection, enables capturing of human expressions to control avatars and to manipulate virtual objects in virtual worlds. The use of Second Life for creating a shared augmented space to represent different physical locations allows us to incorporate the application into existing infrastructure. The application is implemented using open source Second Life viewer and ARToolkit and OpenCV libraries.

Main Features

• Augmenting reality with Second Life avatars and objects..
• using head mounted displays.
• within a video teleconference image.
• Controlling an avatar within Second Life..
• moving avatar hand by hand tracking.
• rotating avatar head by head tracking.
• animating avatar face by facial gesture recognition.
• animating avatar by body posture/gesture recognition.
• Interacting with virtual objects..
• using hand gestures.

More Information

There is a preliminary demonstration video in the videos page. The project will also be demonstrated at the ISMAR 2009 conference.
More information will become available later.

Copyright © 2008, 2009 VTT, Finland

If you can't see menu bar (links) on the left, click here