We present a system for visuo-auditory substitution that takes as input a depth map, and produces as output a corresponding melody. A real-time apparatus based on the Kinect R ©, a computer and a headphone, is developed within our team. Earlier experiment with the system shows that, when equipped, a sighted person temporary deprived from vision can therefore move in an unknown indoor environmen...

This paper performs the first investigation into depth for large-scale human action recognition in video where the depth cues are estimated from the videos themselves. We develop a new framework called depth2action and experiment thoroughly into how best to incorporate the depth information. We introduce spatio-temporal depth normalization (STDN) to enforce temporal consistency in our estimated...

For 3-D video applications, dense depth maps are required. We present a segment-based structure-from-motion technique. After image segmentation, we estimate the motion of each segment. With knowledge of the camera motion, this can be translated into depth. The optimal depth is found by minimizing a suitable error norm, which can handle occlusions as well. This method combines the advantages of ...

We propose a low-complexity algorithm for stereoscopic video applications that generates a high-quality 3D image depth map from a single 2D image. Based on their characteristics, 2D images are classified into one of three categories before being processed by the proposed lowcomplexity algorithm to generate corresponding depth maps. We also extend the 3D depth algorithm to construct a parallel 3...

Complex Gabor filters with phases in quadrature are often used to model evenand odd-symmetric simple cells in the primary visual cortex. In stereo vision, the phase difference between the responses of the left and right views can be used to construct a disparity or depth map. Various constraints can be applied in order to construct smooth maps, but this leads to very imprecise depth transitions...

Given a pair of stereo images, the spatial coordinates of a scene point can be derived from its projections onto the two considered image planes. Finding the correspondences between such projections however remains the main difficulty of the depth estimation problem: the matching of points across homogeneous regions is ambiguous and occluded points cannot be matched as their projections do not ...

We aim at predicting a complete and high-resolution depth map from incomplete, sparse and noisy depth measurements. Existing methods handle this problem either by exploiting various regularizations on the depth maps directly or resorting to learning based methods. When the corresponding color images are available, the correlation between the depth maps and the color images are used to improve t...

Inaccurate depth map discontinuities are an important source of artifact and distortion in multiview systems and applications requiring depth-based view rendering such as 3DTV or free-viewpoint video. Such errors along depth discontinuities frequently occur during depth estimation and/or depth map coding. In this paper we present a novel method for correcting inaccuracies on the discontinuities...

In recent years consumer-level depth sensors have been adopted in various applications. However, they often produce depth maps at a not very fast frame rate (around 30 frames per second), preventing them from being used for applications like digitizing human performance involving fast motion. On the other hand there are available low-cost faster-rate video cameras. This motivates us to develop ...

This paper presents a method of converting a 2D still photo containing the head & shoulders of a human (e.g. a passport photo) to pseudo-3D, so that the depth can be perceived via stereopsis. This technology has the potential to be included in self-serve photo booths and, also as an added accessory (i.e. software package) for digital still cameras and scanners. The basis of the algorithm is to ...