TopicFM: Robust and Interpretable Topic-Assisted Feature Matching
نویسندگان
چکیده
This study addresses an image-matching problem in challenging cases, such as large scene variations or textureless scenes. To gain robustness to situations, most previous studies have attempted encode the global contexts of a via graph neural networks transformers. However, these do not explicitly represent high-level contextual information, structural shapes semantic instances; therefore, encoded features are still sufficiently discriminative We propose novel method that applies topic-modeling strategy images. The proposed trains latent instances called topics. It models image multinomial distribution topics, and then performs probabilistic feature matching. approach improves matching by focusing on same areas between In addition, inferred topics provide interpretability for results, making our explainable. Extensive experiments outdoor indoor datasets show outperforms other state-of-the-art methods, particularly cases.
منابع مشابه
Robust feature matching in 2.3µs
In this paper we present a robust feature matching scheme in which features can be matched in 2.3μs. For a typical task involving 150 features per image, this results in a processing time of 500μs for feature extraction and matching. In order to achieve very fast matching we use simple features based on histograms of pixel intensities and an indexing scheme based on their joint distribution. Th...
متن کاملRobust Feature Matching and Selection Methods
1. INTRODUCTION Multisensor image registration is necessary in many applications of remote sensing imagery, whose crucial problem is how to establish the correspondence between the features extracted from the reference and input images. Most existing methods only consider how to extract features, however, the quality of the features are ignored. In this paper, we combine scale invariant feature...
متن کاملEfficient algorithms for robust feature matching
One of the basic building blocks in any point-based registration scheme involves matching feature points that are extracted from a sensed image to their counterparts in a reference image. This leads to the fundamental problem of point matching: Given two sets of points, find the (affine) transformation that transforms one point set so that its distance from the other point set is minimized. Bec...
متن کاملInterpretable Machine Learning: Lessons from Topic Modeling
Paste the appropriate copyright statement here. ACM now supports three different copyright statements: • ACM copyright: ACM holds the copyright on the work. This is the historical approach. • License: The author(s) retain copyright, but ACM receives an exclusive publication license. • Open Access: The author(s) wish to pay for the work to be open access. The additional fee must be paid to ACM. ...
متن کاملRobust Track Association and Fusion with Extended Feature Matching
In this work, we propose a new data processing architecture as well as track association and fusion algorithms to improve target classification and tracking accuracy using distributed and, possibly, legacysensor platforms. We present a robust data fusion algorithm that can incorporate target classes/types at the fusion center when receiving sensor reports and/or local tracks. We aim to tackle t...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2023
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v37i2.25341