Multi-Modal Entity Alignment Method Based on Feature Enhancement

نویسندگان

چکیده

Multi-modal entity alignment refers to identifying equivalent entities between two different multi-modal knowledge graphs that consist of information such as structural triples and descriptive images. Most previous methods have mainly used corresponding encoders each modality encode then perform feature fusion obtain the joint representation. However, this approach does not fully utilize aligned entities. To address issue, we propose MEAFE, a method based on enhancement. The MEAFE adopts pre-trained model, OCR GATv2 network enhance model’s ability extract useful features in structure triplet image description, respectively, thereby generating more effective representations. Secondly, it further adds modal distribution understanding modeling information. Experiments bilingual cross-graph datasets demonstrate proposed outperforms models use traditional extraction methods.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Feature-Based Alignment of Volumetric Multi-modal Images

This paper proposes a method for aligning image volumes acquired from different imaging modalities (e.g. MR, CT) based on 3D scale-invariant image features. A novel method for encoding invariant feature geometry and appearance is developed, based on the assumption of locally linear intensity relationships, providing a solution to poor repeatability of feature detection in different image modali...

متن کامل

Automatic Method for Thalamus Parcellation Using Multi-modal Feature Classification

Segmentation and parcellation of the thalamus is an important step in providing volumetric assessment of the impact of disease n brain structures. Conventionally, segmentation is carried out on T1-weighted magnetic resonance (MR) images and nuclear parcellation using diffusion weighted MR images. We present the first fully automatic method that incorporates both tissue contrasts and several der...

متن کامل

Oriented Edge-Based Feature Descriptor for Multi-Sensor Image Alignment and Enhancement

In this paper, we present an efficient image alignment and enhancement method for multi-sensor images. The shape of the object captured in a multisensor images can be determined by comparing variability of contrast using corresponding edges across multi-sensor image. Using this cue, we construct a robust feature descriptor based on the magnitudes of the oriented edges. Our proposed method enabl...

متن کامل

Image Resolution Enhancement Method Based on Feature Space

In this paper, an approach for resolution enhancement of color image based on feature space method is proposed. Many images, such as landscape, natural scene and so on, are fractal, and they can often be assumed as self-correlation. Focusing on this point, we describe the image by feature space. This method reflects the characteristics of color image, and realizes the image interpolation by usi...

متن کامل

Image alignment via kernelized feature learning

Machine learning is an application of artificial intelligence that is able to automatically learn and improve from experience without being explicitly programmed. The primary assumption for most of the machine learning algorithms is that the training set (source domain) and the test set (target domain) follow from the same probability distribution. However, in most of the real-world application...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Applied sciences

سال: 2023

ISSN: ['2076-3417']

DOI: https://doi.org/10.3390/app13116747