Vision and Graphics in Producing Mixed Reality Worlds

This paper introduces prominent topics of our Mixed Reality (MR) project and states what kind of role computer vision and graphics play in the project. MR is a part of VR in broader sense, but it treats the physical space as well as the virtual space created in computers. Here we use the term “mixed reality” instead of often used “augmented reality (AR).” This is because MR is not only the mixture of real world and virtual world but also the mixture of AR and “augmented virtuality (AV).” In that sense, we first describe that there is no clear distinction between AR and AV, then introduce some research results at the early stage of our MR project.