BACKGROUND In the problem-based learning (PBL) medical curriculum at the Arabian Gulf University in Bahrain, students construct concept maps related to each case they study in PBL tutorials. AIM To evaluate the interrater reliability and predictive validity of concept map scores using a structured assessment tool. METHODS We examined concept maps of the same cohort of students at the beginn...

We present a new annotation scheme for normalizing time expressions, such as three days ago, to computer-readable forms, such as 2016-03-07. The annotation scheme addresses several weaknesses of the existing TimeML standard, allowing the representation of time expressions that align to more than one calendar unit (e.g., the past three summers), that are defined relative to events (e.g., three w...

Four decades of forensic research have left unanswered a fundamental issue regarding the best conceptualization of competency to stand trial vis-à-vis the Dusky standard. The current study investigated three competing models (discrete abilities, domains, and cognitive complexity) on combined data (N = 411) from six forensic and correctional samples. Using the Evaluation of Competency to Stand T...

This paper presents findings of a series of analyses of human similarity judgments from the Symbolic Melodic Similarity, and Audio Music Similarity tasks from the Music Information Retrieval Evaluation Exchange (MIREX) 2006. The categorical judgment data generated by the evaluators is analyzed with regard to judgment stability, inter-grader reliability, and patterns of disagreement, both within...

The inter-human communication is a continuous process: a person receives, decodes and interprets messages (according to his/her own semantics) and encodes information in his/her answers. In 1954, Schramm and Osgood defined the circular communication model, according to which feedback is the most important. Communication is described as a continuous process consisting in messages sending and rec...

In this paper, we present an annotated corpus of political election news in Chinese for opinion analysis, and discuss some issues in the manual annotation process. The annotation scheme is described with examples, and inter-annotator agreement is explored for different levels of annotation: expression, sentence and document.

This paper presents a project whose main goal is to construct a corpus of clinical text manually annotated for part-of-speech information. We describe and discuss the process of training three domain experts to perform linguistic annotation. We list some of the challenges as well as encouraging results pertaining to inter-rater agreement and consistency of annotation. We also present preliminar...

This study is a preliminary report on an experiment relating PhonePass SET-10 scores to the scale of level descriptors in the Council of Europe Framework. This scale describes the content and level of second language proficiency from a functional communicative perspective. Speech samples from 121 non-native speakers of English were: (1) scored in SET-10, the automatic test of spoken English, an...

Within the realm of globalization of R&D, offshoring is a relatively recent and still emerging phenomenon. Rooted in the notion of comparative advantage, offshoring of R&D involves disaggregation and global distribution of the firm’s R&D value chain activities to leverage innovation capacity of low-cost countries. Characteristically different from marketand technology-seeking globalization of R...

Exploring topological structure at Autonomous System (AS) level is indispensable for understanding most issues in Internet services. Previous models of AS graph involve address or connectivity information separately, and neither of these information can serve as a comprehensive metric for evaluating an AS’s contribution to the global routing. In this paper, we propose a new model for AS ranking...