A Hybrid Algorithm based on Deep Learning and Restricted Boltzmann Machine for Car Semantic Segmentation from Unmanned Aerial Vehicles (UAVs)-based Thermal Infrared Images

Authors

  • Khoshboresh Masouleh, Mahdi University of Tehran
Abstract:

Nowadays, ground vehicle monitoring (GVM) is one of the areas of application in the intelligent traffic control system using image processing methods. In this context, the use of unmanned aerial vehicles based on thermal infrared (UAV-TIR) images is one of the optimal options for GVM due to the suitable spatial resolution, cost-effective and low volume of images. The methods that have been proposed for vehicle extraction from thermal infrared imaging often experience problems such as low accuracy in detection, segmentation (e.g. HOG+SVM) and also the need for big data training (e.g. deep learning methods). In the present study, a new model, called SegRBM-Net, based on deep learning (DL) and the restricted Boltzmann machine (RBM) is being presented. One of the features of the SegRBM-Net model is the improving accuracy of vehicle detection and segmentation from thermal infrared images by using both convolutional layers and the features of the Gaussian-Bernoulli restricted Boltzmann machine. This structure has led the algorithm to find the target faster and more accurately than other DL methods. To examine the performance of the proposed method, we performed a controlled benchmark (e.g. high density of vehicles scene, and difference in viewing angle) of SegRBM-Net and other DL models on four UAV-TIR image datasets.The results showed that the SegRBM-Net model with a mean accuracy of 99% and improved processing speed compared with similar methods have a good performance.

Upgrade to premium to download articles

Sign up to access the full text

Already have an account?login

similar resources

designing unmanned aerial vehicle based on neuro-fuzzy systems

در این پایان نامه، کنترل نرو-فازی در پرنده هدایت پذیر از دور (پهپاد) استفاده شده است ابتدا در روش پیشنهادی اول، کنترل کننده نرو-فازی توسط مجموعه اطلاعات یک کنترل کننده pid به صورت off-line آموزش دیده است و در روش دوم یک کنترل کننده نرو-فازی on-line مبتنی بر شناسایی سیستم توسط شبکه عصبی rbf پیشنهاد شده است. سپس کاربرد این کنترل کننده در پهپاد بررسی شده است و مقایسه ای ما بین کنترل کننده های معمو...

Novel Levenberg-Marquardt based learning algorithm for unmanned aerial vehicles

In this paper, a Levenberg-Marquardt inspired sliding mode control theory based adaptation laws are proposed to train an intelligent fuzzy neural network controller for a quadrotor aircraft. The proposed controller is used to control and stabilize a quadrotor unmanned aerial vehicle in the presence of periodic wind gust. A proportional-derivative controller is firstly introduced based on which ...

full text

A hybrid model based on machine learning and genetic algorithm for detecting fraud in financial statements

Financial statement fraud has increasingly become a serious problem for business, government, and investors. In fact, this threatens the reliability of capital markets, corporate heads, and even the audit profession. Auditors in particular face their apparent inability to detect large-scale fraud, and there are various ways to identify this problem. In order to identify this problem, the majori...

full text

Ontology-Based Deep Restricted Boltzmann Machine

Deep neural networks are known for their capabilities for automatic feature learning from data. For this reason, previous research has tended to interpret deep learning techniques as data-driven methods, while few advances have been made from knowledge-driven perspectives. We propose to design a semantic rich deep learning model from a knowledge driven perspective, by introducing formal semanti...

full text

Automatic Modulation Classification Based on Deep Learning for Unmanned Aerial Vehicles

Deep learning has recently attracted much attention due to its excellent performance in processing audio, image, and video data. However, few studies are devoted to the field of automatic modulation classification (AMC). It is one of the most well-known research topics in communication signal recognition and remains challenging for traditional methods due to complex disturbance from other sourc...

full text

My Resources

Save resource for easier access later

Save to my library Already added to my library

{@ msg_add @}


Journal title

volume 7  issue 4

pages  77- 99

publication date 2020-03

By following a journal you will be notified via email when a new issue of this journal is published.

Keywords

No Keywords

Hosted on Doprax cloud platform doprax.com

copyright © 2015-2023