We present our correction annotation guidelines to create a manually corrected nonnative (L2) Arabic corpus. We develop our approach by extending an L1 large-scale Arabic corpus and its manual corrections, to include manually corrected non-native Arabic learner essays. Our overarching goal is to use the annotated corpus to develop components for automatic detection and correction of language er...

Explaining why the same passage may have different rhetorical structures when conveyed in different languages remains an open question. Starting from a trilingual translation corpus, this paper aims to provide a new qualitative method for the comparison of rhetorical structures in different languages and to specify why translated texts may differ in their rhetorical structures. To achieve these...

Opinion Mining is a discipline that has attracted some attention lately. Most of the research in this field has been done for English or Asian languages, due to the lack of resources in other languages. In this paper we describe our methodology for developing a manually annotated multilingual corpus with fine-grained opinion and target annotations. The languages represented in the corpus are En...

This paper will introduce a procedure that we call pair annotation after pair programming. We describe initial annotation procedure of the TDB, followed by the inception of the pair annotation idea and how it came to be used in the Turkish Discourse Bank. We discuss the observed benefits and issues encountered during the process, and conclude by discussing the major benefit of pair annotation, ...

The card sort is a key scale development tool that is frequently used in IS survey instrument development. Cohen's Kappa is a recommended measure of inter-rater agreement in this process, however one of its underlying statistical assumptions is violated when it is used in open card sorts. To address this issue, Matrix Kappa is proposed as a complement to other card sort analysis techniques, ref...

This paper describes on-going efforts to annotate a corpus of almost 16000 answer pairs with an estimated 69000 fine-grained entailment relationships. We illustrate the need for more detailed classification than currently exists and describe our corpus and annotation scheme. We discuss early statistical analysis showing substantial inter-annotator agreement even at the finegrained level. The co...

Materials and methods The government budget documents from 5 ministries including Ministry of Transport, Education, Interior, Public Health and Royal Thai Police were reviewed. Two researchers identified budget used in road safety projects with 5-E strategies independently; the kappa analysis was used to test inter-rater reliability. Information from Thai Health Promotion Foundation and Road Sa...

BACKGROUND The Behavioral Inhibition Observation System (BIOS) is a brief clinician-report scale for detecting behavioral inhibition (BI) from direct observation. This study aims to compare the validity coefficients obtained in the natural context of use of the BIOS (i.e., a clinical situation) with those obtained using the BIOS after standardized observation. METHOD The participants were 74 ...

The previous literature has suggested that the hand movement in co-speech gestures and signs consists of a series of phases with qualitatively different dynamic characteristics. In this paper, we propose a syntagmatic rule system for movement phases that applies to both co-speech gestures and signs. Descriptive criteria for the rule system were developed for the analysis video-recorded continuo...

BACKGROUND The bridge test with unilateral knee extension evaluates the stability of the trunk and pelvis. The evaluation of this stability can contribute to the understanding of the occurrence of musculoskeletal injuries. OBJECTIVES To investigate the intra- and inter-rater reliability of a qualitative analysis and intra-test reliability of a quantitative analysis of transverse plane pelvic ...