Remote Sensing Cross-Modal Text-Image Retrieval Based on Global and Local Information

نویسندگان

چکیده

Cross-modal remote sensing text-image retrieval (RSCTIR) has recently become an urgent research hotspot due to its ability of enabling fast and flexible information extraction on (RS) images. However, current RSCTIR methods mainly focus global features RS images, which leads the neglect local that reflect target relationships saliency. In this article, we first propose a novel framework based (GaLR), design multi-level dynamic fusion (MIDF) module efficaciously integrate different levels. MIDF leverages correct information, utilizes supplement uses addition two generate prominent visual representation. To alleviate pressure redundant targets graph convolution network (GCN) improve model s attention salient instances during modeling features, de-noised representation matrix enhanced adjacency (DREA) are devised assist GCN in producing superior representations. DREA not only filters out with high similarity, but also obtains more powerful by enhancing objects. Finally, make full use similarity inference, come up plug-and-play multivariate rerank (MR) algorithm. The algorithm k nearest neighbors results perform reverse search, improves performance combining multiple components bidirectional retrieval. Extensive experiments public datasets strongly demonstrate state-of-the-art GaLR task. code method, MR algorithm, corresponding files have been made available at https://github.com/xiaoyuan1996/GaLR .

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Geoscience and Remote Sensing

سال: 2022

ISSN: ['0196-2892', '1558-0644']

DOI: https://doi.org/10.1109/tgrs.2022.3163706