Toward Automated Factchecking

نویسندگان

چکیده

In an effort to assist factcheckers in the process of factchecking, we tackle claim detection task, one necessary stages prior determining veracity a claim. It consists identifying set sentences, out long text, deemed capable being factchecked. This article is collaborative work between Full Fact, independent factchecking charity, and academic partners. Leveraging expertise professional factcheckers, develop annotation schema benchmark for automated that more consistent across time, topics, annotators than are previous approaches. Our has been used crowdsource dataset with sentences from UK political TV shows. We introduce approach based on universal sentence representations perform classification, achieving F1 score 0.83, over 5% relative improvement state-of-the-art methods ClaimBuster ClaimRank. The system was deployed production received positive user feedback.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Toward Automated Component Adaptation

This paper explores the use of specification matching to discover and select component adaptation strategies. This is done within a formal framework that integrates specification-based component retrieval with a formal architecture representation to support component retrieval and adaptation. The key to integration is determining the relationship between what components are potentially reusable...

متن کامل

Plans Toward Automated Chat Summarization

We describe the beginning stages of our work on summarizing chat, which is motivated by our observations concerning the information overload of US Navy watchstanders. We describe the challenges of summarizing chat and focus on two chat-specific types of summarizations we are interested in: thread summaries and temporal summaries. We then discuss our plans for addressing these challenges and eva...

متن کامل

Toward Automated Component-Level Evaluation

Automated component-level evaluation of information retrieval is discussed. The advantages of such an approach are considered, as well as the requirements for implementing it. Acceptance of such systems by researchers is discussed.

متن کامل

Toward automated evaluation of interactive segmentation

We previously described a system for evaluating interactive segmentation by means of user experiments [1]. This method, while effective, is time-consuming and labor-intensive. This paper aims to make evaluation more practicable by investigating if it is feasible to automate user interactions. To this end, we propose a general algorithm for driving the segmentation that uses the ground truth and...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Digital threats

سال: 2021

ISSN: ['2692-1626', '2576-5337']

DOI: https://doi.org/10.1145/3412869