A Deep Learning Multimodal Method for Precipitation Estimation
نویسندگان
چکیده
To improve precipitation estimation accuracy, new methods, which are able to merge different measurement modalities, necessary. In this study, we propose a deep learning method rain gauge measurements with ground-based radar composite and thermal infrared satellite imagery. The proposed convolutional neural network, composed of an encoder–decoder architecture, performs multiscale analysis the three input modalities estimate simultaneously rainfall probability rate value spatial resolution 2 km. training our model its performance evaluation carried out on dataset spanning 5 years from 2015 2019 covering Belgium, Netherlands, Germany North Sea. Our results for instantaneous detection, estimation, daily accumulation show that best accuracy is obtained combining all modalities. ablation done compare every possible combination shows gauges data allows considerable increase in addition imagery provides estimates where coverage lacking. We also multi-modal significantly improves compared European product provided by OPERA quasi gauge-adjusted RADOLAN DWD estimation.
منابع مشابه
Multimodal Deep Learning Library
The Neural Network is a directed graph consists of multiple layers of neurons, which is also referred to as units. In general there is no connection between units of the same layer and there are only connections between adjacent layers. The first layer is the input and is referred to as visible layer v. Above the visible layer there are multiple hidden layers {h1, h2, ..., hn}. And the output o...
متن کاملMultimodal Deep Learning
Deep networks have been successfully applied to unsupervised feature learning for single modalities (e.g., text, images or audio). In this work, we propose a novel application of deep networks to learn features over multiple modalities. We present a series of tasks for multimodal learning and show how to train deep networks that learn features to address these tasks. In particular, we demonstra...
متن کاملMultimodal Emotion Recognition Using Multimodal Deep Learning
To enhance the performance of affective models and reduce the cost of acquiring physiological signals for real-world applications, we adopt multimodal deep learning approach to construct affective models from multiple physiological signals. For unimodal enhancement task, we indicate that the best recognition accuracy of 82.11% on SEED dataset is achieved with shared representations generated by...
متن کاملDeep Similarity Learning for Multimodal Medical Images
An effective similarity measure for multi-modal images is crucial for medical image fusion in many clinical applications. The underlining correlation across modalities is usually too complex to be modelled by intensity-based statistical metrics. Therefore, approaches of learning a similarity metric are proposed in recent years. In this work, we propose a novel deep similarity learning method th...
متن کاملMultimodal Deep Learning for Cervical Dysplasia Diagnosis
To improve the diagnostic accuracy of cervical dysplasia, it is important to fuse multimodal information collected during a patient’s screening visit. However, current multimodal frameworks suffer from low sensitivity at high specificity levels, due to their limitations in learning correlations among highly heterogeneous modalities. In this paper, we design a deep learning framework for cervica...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Remote Sensing
سال: 2021
ISSN: ['2315-4632', '2315-4675']
DOI: https://doi.org/10.3390/rs13163278