MapReduce-based Parallel Learning for Large-scale Remote Sensing Im- ages
نویسنده
چکیده
Machine learning applied to large-scale remote sensing images shows inadequacies in computational capability and storage space. To solve this problem, we propose a cloud computing-based scheme for learning remote sensing images in a parallel manner: (1) a hull vector-based hybrid parallel support vector machine model (HHB-PSVM) is proposed. It can substantially improve the efficiency of training and prediction for the large-scale samples while guaranteeing classification accuracy. (2) The MapReduce model is used to achieve parallel extraction of the classification features for the remote sensing images, and the MapReduce-based HHB-PSVM model (MapReduce-HHB-PSVM) is used to implement the training and prediction for large-scale samples. (3) MapReduce-HHB-PSVM is applied to land use classification, enabling various types of land use to be classified more efficiently by using fused hyperspectral images. Experimental results show that MapReduce-HHB-PSVM can substantially improve classification efficiency of large-scale remote sensing images while guaranteeing classification accuracy, and it can promote the machine interpretation of ground objects information extracted from the large-scale remote sensing images to be conducted intelligently.
منابع مشابه
A Hadoop-based Distributed Framework for Efficient Managing and Processing Big Remote Sensing Images
Various sensors from airborne and satellite platforms are producing large volumes of remote sensing images for mapping, environmental monitoring, disaster management, military intelligence, and others. However, it is challenging to efficiently storage, query and process such big data due to the dataand computingintensive issues. In this paper, a Hadoop-based framework is proposed to manage and ...
متن کاملMapReduce for Parallel Reinforcement Learning
We investigate the parallelization of reinforcement learning algorithms using MapReduce, a popular parallel computing framework. We present parallel versions of several dynamic programming algorithms, including policy evaluation, policy iteration, and off-policy updates. Furthermore, we design parallel reinforcement learning algorithms to deal with large scale problems using linear function app...
متن کاملParallel K-Means Clustering of Remote Sensing Images Based on MapReduce
The K-Means clustering is a basic method in analyzing RS (remote sensing) images, which generates a direct overview of objects. Usually, such work can be done by some software (e.g. ENVI, ERDAS IMAGINE) in personal computers. However, for PCs, the limitation of hardware resources and the tolerance of time consuming present a bottleneck in processing a large amount of RS images. The techniques o...
متن کاملPDTSSE: A Scalable Parallel Decision Tree Algorithm Based on MapReduce
Parallel decision tree learning is an effective and efficient approach to scaling the decision tree to large data mining application. Aiming at large scale decision tree learning, we present a novel parallel decision tree learning algorithm in MapReduce framework, called PDTSSE (Parallel Decision Tree via Sampling Splitting points with Estimation). We first propose an estimation method for samp...
متن کاملParallel k means clustering based on mapreduce pdf
Parallel K-Means Clustering Based on. Weizhong Zhao1, 2, Huifang Ma1, 2, and Qing He1. The Key Laboratory of Intelligent Information.The K-Means clustering is a basic method in analyzing RS remote sensing images.
متن کامل