Integrating Millimeter Wave Radar with a Monocular Vision Sensor for On-Road Obstacle Detection Applications
نویسندگان
چکیده
This paper presents a systematic scheme for fusing millimeter wave (MMW) radar and a monocular vision sensor for on-road obstacle detection. As a whole, a three-level fusion strategy based on visual attention mechanism and driver's visual consciousness is provided for MMW radar and monocular vision fusion so as to obtain better comprehensive performance. Then an experimental method for radar-vision point alignment for easy operation with no reflection intensity of radar and special tool requirements is put forward. Furthermore, a region searching approach for potential target detection is derived in order to decrease the image processing time. An adaptive thresholding algorithm based on a new understanding of shadows in the image is adopted for obstacle detection, and edge detection is used to assist in determining the boundary of obstacles. The proposed fusion approach is verified through real experimental examples of on-road vehicle/pedestrian detection. In the end, the experimental results show that the proposed method is simple and feasible.
منابع مشابه
Modeling and Measurements of Scattering from Road Surfaces at Millimeter-Wave Frequencies
Millimeter-wave radar-based sensors are being considered for a number of automotive applications including obstacle detection and collision warning, true-speed, and road-surface recognition. In this paper, the interaction of electromagnetic waves with asphalt road surfaces, possibly covered with ice or water, at millimeter-wave frequencies is studied. First, an experimental procedure for determ...
متن کاملReview of Antenna Technology for Millimeter Wave Automotive Sensors
Automotive sensors for the detection and discrimination of other vehicles on the road, obstacles, and boundaries use miniature radar systems and are heavily dependent in their performance on the antenna system. In this contribution, the requirements for such antenna systems are reviewed and the various options of antenna technology are discussed. In particular, prominent and presently employed,...
متن کاملNew Robust Obstacle Detection System using Color Stereo Vision
Intelligent transportation systems (ITS) are divided into intelligent infrastructure systems and intelligent vehicle systems. Intelligent vehicle systems are typically classified in three categories, namely 1) Collision Avoidance Systems; 2) Driver Assistance Systems and 3) Collision Notification Systems. Obstacle detection is one of crucial tasks for Collision Avoidance Systems and Driver Assi...
متن کاملPELICAN: Panoramic millimeter-wave radar for perception in mobile robotics applications, Part 1: Principles of FMCW radar and of 2D image construction
Robust environmental perception is a crucial parameter for the development of autonomous ground vehicle applications, especially in the field of agricultural robotics which is one of the priorities for the Horizon 2020 robotics funding (EU funding program for research and innovation). Because of uncontrolled and changing environmental conditions in outdoor and natural environments, data from op...
متن کاملRobust Obstacle Detection Based on Dense Disparity Maps
Obstacle detection is an important component for many autonomous vehicle navigation systems. Several methods for obstacle detection have been proposed using various active sensors such as radar, sonar and laser range finders. Vision based techniques have the advantage of low cost and provide a large amount of information about the environment around an intelligent vehicle. This paper deals with...
متن کامل