Towards Consistency-Based Reliability Assessment

نویسندگان

  • Laurence Cholvy
  • Laurent Perrussel
  • William Raynaut
  • Jean-Marc Thévenin
چکیده

1. MOTIVATION Merging information provided by several sources is an important issue and merging techniques have been extensively studied. When the reliability of the sources is not known, one can apply merging techniques such as majority or arbitration merging or distancebased merging for solving conflicts between information. At the opposite, if the reliability of the sources is known, either represented in a quantitative or in a qualitative way, then it can be used to manage contradictions: information provided by a source is generally weakened or ignored if it contradicts information provided by a more reliable source [1, 4, 6]. Assessing the reliability of information sources is thus crucial. The present paper addresses this key question. We adopt a qualitative point of view for reliability representation by assuming that the relative reliability of information sources is represented by a total preorder. This works considers that we have no information about the sources and in particular, we do not know if they are correct (i.e they provide true information) or not. We focus on a preliminary stage of observation and assessment of sources. We claim that during that stage the key issue is a consistency analysis of information provided by sources, whether it is the consistency of single reports or consistency w.r.t trusted knowledge or the consistency of different reports together. We adopt an axiomatic approach: first we give some postulates which characterize what this reliability preorder should be, then we define a generic operator for building this preorder in agreement with the postulates.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Towards a Task-Based Assessment of Professional Competencies

Performance assessment is exceedingly considered a key concept in teacher education programs worldwide. Accordingly, in Iran, a national assessment system was proposed by Farhangian University to assess the professional competencies of its ELT graduates. The concerns regarding the validity and authenticity of traditional measures of teachers' competencies have motivated us to devise a localized...

متن کامل

Persian Translation, Internal Consistency and Reliability of Wolf Motor Function Test

Background: Wolf Motor Function Test (WMFT) is used in the assessment of upper extremity motor function in stroke patients. This scale contains 15 items and assesses joint-segment movements and functional tasks. Objectives: Translation and assessment of internal consistency and reliability of the Persian version of WMFT in Iranian stroke patients. Materials and Methods: After translation ...

متن کامل

Reliability: on the reproducibility of assessment data.

CONTEXT All assessment data, like other scientific experimental data, must be reproducible in order to be meaningfully interpreted. PURPOSE The purpose of this paper is to discuss applications of reliability to the most common assessment methods in medical education. Typical methods of estimating reliability are discussed intuitively and non-mathematically. SUMMARY Reliability refers to the...

متن کامل

Validity and Reliability of the Attitudes towards and Self-Reported Ability in Evidence-Based Medicine Questionnaire

Introduction: Evidence-Based Medicine is the proper application of the best available evidence in making health care decisions for each patient and merging personal clinical experiences with the best available clinical evidence resulted from systematic research. This study aimed to investigate the validity and reliability of the attitudes towards and self-reported ability in evidence based medi...

متن کامل

A Psychometric Study of the Faculty’ Attitudes Towards Research Scale in Iran University of Medical Sciences

Background: In modern world, attitudes of people are considered more important than their experiences and academic preparation. A positive attitude towards research is a key factor for success and progress in societies. Methods: This study was psychometric assessment with 141 faculty member from Iran university of medical sciences. Initial instrument with 10 –items was translated to Persian aft...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2015