This thesis describes a system for mixing reality, as captured by a camera, with a virtual 3-dimensional world. A system to recognize and track a square pattern of markers is created in order to obtain the extrinsic parameters of the camera. The parameters are used for rotating and translating the virtual world to align it with the pattern of markers in the image. The result is a system where a...

Correct tracking of the user position is crucial for an Augmented Reality (AR) application. For this reason, tracking became a very important research subject in the field of real-time AR. The most common solution to implement an AR system is based on the use of an Head Mounted Display (HMD) and two cameras for the stereoscopic video see-through visualization. Almost all the systems presented i...

We describe a systematic, quantitative study of the benefits using context recognition (specifically task tracking) for a wearable maintenance assistance system. A key objective of the work is to do the evaluation in an environment that is as close as possible to a real world setting. To this end, we use actual maintenance tasks on a complex piece of machinery at an industrial site. Subjects fo...

In this paper, we propose a new gaze estimation method by analyzing the cornea surface model which is estimated through three dimensional analysis of human eye in HMD (Head Mounted Display) environments. This paper has four advantages over previous works. First, in order to obtain accurate gaze position, we use a cornea sphere model based on Gullstrand eye scheme. Second, we calculate the 3D po...

In this paper we present “Touching the Cloud”, a bi-manual user interface for the interaction, selection and annotation of immersive point cloud data. With minimal instrumentation, the setup allows a user in an immersive head-mounted display (HMD) environment to naturally interact with point clouds. By tracking the user’s hands using an OpenNI sensor and displaying them in the virtual environme...

It is known for decades that users tend to significantly underestimate or overestimate distances or speed in immersive virtual environments (IVEs) compared to corresponding judgments in the real world. Although several factors have been identified in the past that could explain small portions of this effect, the main causes of these perceptual discrepancies still remain elusive. One of the fact...

We present a summary of the development of a new virtual reality setup for behavioural experiments in the area of spatial cognition. Most previous virtual reality setups can either not provide accurate body motion cues when participants are moving in a virtual environment, or participants are hindered by cables while walking in virtual environments with a head-mounted display (HMD). Our new set...

OBJECTIVE We tested whether the method of sound delivery affects people's ability to integrate information from multiple modalities when they are walking and using a head-mounted display (HMD). BACKGROUND HMDs increasingly support mobile work. Human operators may benefit from auditory support when using an HMD. However, it is unclear whether sound is better delivered publicly in free field or...