We present a hierarchical control framework to allow for robust manipulation and exploration of objects with unknown shape, mass, and friction. The framework is divided into 3 layers: joint-level, tactile servoing, and visual servoing. While the middle layer provides “blind” surface exploration skills, maintaining desired contact patterns, the visual layer monitors and controls the actual objec...

Event-based visual servoing is a recently presented approach that performs the positioning of a robot using visual information only when it is required. From the basis of the classical image-based visual servoing control law, the scheme proposed in this paper can reduce the processing time at each loop iteration in some specific conditions. The proposed control method enters in action when an e...

Traditional visual servoing systems do not deal with the topic of moving objects tracking. When these systems are employed to track a moving object, depending on the object velocity, visual features can go out of the image, causing the fail of the tracking task. This occurs specially when the object and the robot are both stopped and then the object starts the movement. In this work, we have em...

The general aim of visual servoing is to control the motion of a robot so that visual features acquired by a camera become superimposed with a desired visual pattern. Visual servoing based on geometrical features such as image point coordinates is now well established. Nevertheless, this approach has the drawback that it usually needs visual marks on the observed object to retrieve geometric fe...

In this chapter, both visual servoing and pose estimation from a set of points are dealt with. More precisely, a unique scheme based on the projection onto the unit sphere for cameras obeying the unified model is proposed. From the projection onto the surface of the unit sphere, new visual features based on invariants to rotations are proposed. It is shown that satisfactory results can be obtai...

Traditional visual servoing systems do not deal with the topic of moving objects tracking. When these systems are employed to track a moving object, depending on the object velocity, visual features can go out of the image, causing the fail of the tracking task. This occurs specially when the object and the robot are both stopped and then the object starts the movement. In this work, we have em...

Visual servoing applies image sensors instead of mechanical encoders for position acquisition. It can achieve higher resolutions than mechanical encoders at comparable cost. However, visual servoing is computation intensive. Special purpose hardware is often required. This work performs a case study on organic light emitting diode (OLED) manufacturing, a typical industrial application of machin...

This work addresses the visual tracking problem of robot manipulators with non-negligible dynamics using a fixed camera, when the camera-robot system parameters are uncertain. An adaptive strategy is developed for visual servoing systems based on the image-based look-and-move structure to allow the tracking of a 2D reference trajectory, without using image velocity measurements. The adaptive vi...

In this chapter, image-based visual servoing is addressed via nonlinear model predictive control. The visual servoing task is formulated into a nonlinear optimization problem in the image plane. The proposed approach, named visual predictive control, can easily and explicitly take into account 2D and 3D constraints. Furthermore, the image prediction over a finite prediction horizon plays a cruc...

This paper deals with position-based 6-DoF visual servoing. With a common sense of feedback control, we stress that improvement of the dynamics of the sensing feedback unit is important for a stable visual servoing system. We propose a method to improve dynamics in visual recognition of model-based matching, with the on-line matching compensating the fictional motion of the target in the hand-e...