Similarity Is Not Entailment — Jointly Learning Similarity Transformations for Textual Entailment
نویسندگان
چکیده
Predicting entailment between two given texts is an important task upon which the performance of numerous NLP tasks depend on such as question answering, text summarization, and information extraction. The degree to which two texts are similar has been used extensively as a key feature in much previous work in predicting entailment. However, using similarity scores directly, without proper transformations, results in suboptimal performance. Given a set of lexical similarity measures, we propose a method that jointly learns both (a) a set of non-linear transformation functions for those similarity measures and, (b) the optimal non-linear combination of those transformation functions to predict textual entailment. Our method consistently outperforms numerous baselines, reporting a micro-averaged F -score of 46.48 on the RTE7 benchmark dataset. The proposed method is ranked 2-nd among 33 entailment systems participated in RTE-7, demonstrating its competitiveness over numerous other entailment approaches. Although our method is statistically comparable to the current state-of-the-art, we require less external knowledge resources.
منابع مشابه
Similarity Is Not Entailment - Jointly Learning Similarity Transformation for Textual Entailment
Predicting entailment between two given texts is an important task upon which the performance of numerous NLP tasks depend on such as question answering, text summarization, and information extraction. The degree to which two texts are similar has been used extensively as a key feature in much previous work in predicting entailment. However, using similarity scores directly, without proper tran...
متن کاملLearning Shallow Semantic Rules for Textual Entailment
In this paper we present a novel technique for integrating lexical-semantic knowledge in systems for learning textual entailment recognition rules: the typed anchors. These describe the semantic relations between words across an entailment pair. We integrate our approach in the cross-pair similarity model. Experimental results show that our approach increases performance of cross-pair similarit...
متن کاملRecognizing Textual Entailment Using a Machine Learning Approach
We present our experiments on Recognizing Textual Entailment based on modeling the entailment relation as a classification problem. As features used to classify the entailment pairs we use a symmetric similarity measure and a non-symmetric similarity measure. Our system achieved an accuracy of 66% on the RTE-3 development dataset (with 10-fold cross validation) and accuracy of 63% on the RTE-3 ...
متن کاملShallow Semantic in Fast Textual Entailment Rule Learners
In this paper, we briefly describe two enhancements of the cross-pair similarity model for learning textual entailment rules: 1) the typed anchors and 2) a faster computation of the similarity. We will report and comment on the preliminary experiments and on the submission results.
متن کاملEffects of Using Simple Semantic Similarity on Textual Entailment Recognition
We applied various WordNet based similarity measures to the RTE (Recognizing Textual Entailment) task in order to compare the effects of them on Textual Entailment Recognition. Although the improvements over a baseline system are not big, many of them show positive effects.
متن کامل