We present the development of a multi-touch display based on computer vision techniques. The developed system is built upon low cost, off-the-shelf hardware components and a careful selection of computer vision techniques. The resulting system is capable of detecting and tracking several objects that may move freely on the surface of a wide projection screen. It also provides additional informa...

We describe our approach to support ongoing meetings with an automated meeting assistant. The system based on the AMIDA Content Linking Device aims at providing relevant documents used in previous meetings for the ongoing meeting based on automatic speech recognition. Once the content linking device finds documents linked to a discussion about a similar subject in a previous meeting, it assumes...

In this paper, we present a method for robustly extracting the silhouette form of the participant within an interactive environment. The approach overcomes the inherent problems associated with traditional chroma-keying, background subtraction, and rear-light projection methods. We employ a specialized infrared system while not making the underlying technology apparent to those interacting with...

Treadmill-based virtual environments have the potential to allow near natural locomotion through large-scale simulated spaces. To be effective, such devices need to provide users with visual and biomechanical sensations of walking that are sufficiently accurate to evoke perception-action couplings comparable to those occurring in the real world. We are exploring this problem using a custom buil...

MouseHaus Table is a computationally enhanced physical environment that supports collaborative urban design discussion. The system consists of a custom-made table with a rear projection screen, a video camera, projector and a simple pedestrian simulation program. MouseHaus Table provides a physical interface that enables participants who have no previous computer experience to interact with a p...

The recent development of immersive displays with high resolution and a wide field of view (e.g., hemi-spherical projection screen) has made it possible to play video games with higher levels of presence. However, it is not yet clear how players utilize the visual and auditory information provided by such displays for game play. In this paper, we report three experiments on an arcade video game...

Standard Natural Classroom (SNC) is a real-time classroom based on smart space and design principles of e-learning, aiming at creating face-to-face, interactive and pervasive learning scene for students who are far from live classroom. We use various techniques in developing different kinds of components in SNC. Two components among them are specially described in this paper: E-pen and Emotion ...

Visual performance with a large video projection screen is popular for various entertainment events such as DJ events. Some performers use computers to generate visuals, but using a keyboard or a mouse to control the visuals in front of a large screen is neither exciting nor intuitive for performers and audiences. We developed an interactive display system using camera-tracked laser pointers th...

During self-motion the perceived positions of objects remain fixed in perceptual space. This requires that their perceived positions are updated relative to the viewer. Here we assess the roles of visual and nonvisual information in this spatial updating. To investigate the role of visual cues observers sat in an enclosed, immersive, virtual environment formed by six rear-projection screens. A ...