Can robots mold soft plastic materials by shaping depth images? The short answer is no: current day can not. In this article, we address the problem of material with an anthropomorphic arm/hand robot, which observes a fixed camera. Robots capable molding could assist humans in many tasks, such as cooking, scooping, or gardening. Yet, complex, due to its high-dimensionality at both perception an...

In this paper, we propose systems which can render free viewpoint images by using depth image based rendering for live video communications. Experimental results show that an image and depth transmission system is more suitable than an all multi view transmission and an only free viewpoint image transmission system. Especially in the image and depth transmission system, transmitting two images ...

For a few years cameras have been available which are able to provide depth values gained from a PMD chip through the Time-of-Flight principle. Recently, cameras combining a normal color chip with such a PMD chip in a monocular setup have been developed. One drawback of these 2D/3D cameras is that the resolution of the depth images is much lower than those of the color images due to the limited...

Face recognition from RGB-D images utilizes 2 complementary types of image data, i.e. colour and depth images, to achieve more accurate recognition. In this paper, we propose a face recognition system based on deep learning, which can be used to verify and identify a subject from the colour and depth face images captured with a consumer-level RGB-D camera. To recognize faces with colour and dep...

The finite depth of field of a real camera can be used to estimate the depth structure of a scene. While the distance of an object from the plane in focus determines the defocus blur size, the shape of the aperture determines the shape of the blur. This blur shape can be manipulated by introducing masks into the main lens aperture. We propose an intuitive criterion to design aperture patterns f...

This thesis studies Faster R-CNN, the state-of-art method for object detection in RGB images, and proposes its extension to RGB-D images. Solutions to the following problems are proposed and evaluated: filling missing values in depth images, depth encoding (raw depth vs. surface normals), extension of the CNN architecture to accept the extra depth information, and initialization of weights in t...

In this paper, we present a method to calibrate and enhance depth information captured by an infrared (IR)-based time-of-flight video-plus-depth camera called “Kinect camera”. For depth data calibration, we use color and IR images of a chessboard with on-off halogen light sources to calculate camera parameters of the video and IR sensors in the Kinect camera. For depth data enhancement, we intr...