TopicFM: Robust and Interpretable Topic-Assisted Feature Matching

نویسندگان

چکیده

This study addresses an image-matching problem in challenging cases, such as large scene variations or textureless scenes. To gain robustness to situations, most previous studies have attempted encode the global contexts of a via graph neural networks transformers. However, these do not explicitly represent high-level contextual information, structural shapes semantic instances; therefore, encoded features are still sufficiently discriminative We propose novel method that applies topic-modeling strategy images. The proposed trains latent instances called topics. It models image multinomial distribution topics, and then performs probabilistic feature matching. approach improves matching by focusing on same areas between In addition, inferred topics provide interpretability for results, making our explainable. Extensive experiments outdoor indoor datasets show outperforms other state-of-the-art methods, particularly cases.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Robust feature matching in 2.3µs

In this paper we present a robust feature matching scheme in which features can be matched in 2.3μs. For a typical task involving 150 features per image, this results in a processing time of 500μs for feature extraction and matching. In order to achieve very fast matching we use simple features based on histograms of pixel intensities and an indexing scheme based on their joint distribution. Th...

متن کامل

Robust Feature Matching and Selection Methods

1. INTRODUCTION Multisensor image registration is necessary in many applications of remote sensing imagery, whose crucial problem is how to establish the correspondence between the features extracted from the reference and input images. Most existing methods only consider how to extract features, however, the quality of the features are ignored. In this paper, we combine scale invariant feature...

متن کامل

Efficient algorithms for robust feature matching

One of the basic building blocks in any point-based registration scheme involves matching feature points that are extracted from a sensed image to their counterparts in a reference image. This leads to the fundamental problem of point matching: Given two sets of points, find the (affine) transformation that transforms one point set so that its distance from the other point set is minimized. Bec...

متن کامل

Interpretable Machine Learning: Lessons from Topic Modeling

Paste the appropriate copyright statement here. ACM now supports three different copyright statements: • ACM copyright: ACM holds the copyright on the work. This is the historical approach. • License: The author(s) retain copyright, but ACM receives an exclusive publication license. • Open Access: The author(s) wish to pay for the work to be open access. The additional fee must be paid to ACM. ...

متن کامل

Robust Track Association and Fusion with Extended Feature Matching

In this work, we propose a new data processing architecture as well as track association and fusion algorithms to improve target classification and tracking accuracy using distributed and, possibly, legacysensor platforms. We present a robust data fusion algorithm that can incorporate target classes/types at the fusion center when receiving sensor reports and/or local tracks. We aim to tackle t...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2023

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v37i2.25341