Background: This study aims to develop a test for assessing pragmatic comprehension ability in Chinese as a second language (L2). Following the framework of an argument-based approach to test validation, this study attempts to obtain backing for the Evaluation and Explanation inferences. Methods: Test items were developed based on two sources of authentic language use (i.e., field notes and a c...

Background: As there is no standard aphasia screening tool for Azeri language yet, the aim of this study was to develop an aphasia screening test with acceptable validity and reliability. Methods: The present study was conducted in two phases. In the first phase, by literature search, the screening test was designed and to obtain validity it was peer reviewed by expert panel. After collecting e...

The lecture is one of the most valuable genres of audiovisual data. However, spoken lectures are difficult to reuse because browsing and efficient searching within spoken lectures is difficult. To promote the research activities in the spoken lecture retrieval, this paper reports a test collection for its evaluation. The test collection consists of the target spoken documents of about 2,700 lec...

Promoting diversity in search has gained much recent interest, however there exists a lack of sufficient benchmarks for evaluation. In this paper, we describe the creation of a new test collection for evaluating diversity in image search. To ensure the creation of a realistic resource, query variations from an image search log were used as the basis for identifying topics that might require a s...

Objective The innovative Neonatal-Perinatal Medicine (NPM) Ethics Teaching Program at the University of Ottawa provides NPM trainees with vital foundational knowledge required to manage ethically contentious clinical scenarios frequently encountered in practice. In this study, our aim was to develop a knowledge test to assess the impact of the NPM Ethics Teaching Program on trainees' knowledge ...

Research has established that firms’ IT-related capabilities at a point in time explain IT-related performance differences across firms. IT resources, however, are dynamic, and evolve at an exponential rate. This means we need to understand how to sustain firms’ existing capabilities to leverage opportunities offered by new IT resources. Wet suggests a higher-level resource that can sustain fir...

Ambiguity, the phenomenon that a word has more than one sense, poses difficulties for many current Natural Language Processing (NLP) systems. Algorithms that assist in the resolution of these ambiguities, i.e. which make unambiguous a word, or more generally, a text string, will boost performance of these systems. To test such techniques in the biomedical language domain, we have developed a Wo...

An experimental optical bench test-bed for developing new wavefront sensing concepts for Multi-Conjugate Adaptive Optics (MCAO) systems is described. The main objective is to resolve imaging problems associated with wavefront sensing of the atmospheric turbulence for future MCAO systems on Extremely Large Telescopes (ELTs). The test-bed incorporates five reference sources, two deformable mirror...

BACKGROUND Finding the right word is a necessity in communication, and its evaluation has always been a challenging clinical issue, suggesting the need for valid and reliable measurements. The Homophone Meaning Generation Test (HMGT) can measure the ability to switch between verbal concepts, which is required in word retrieval. The purpose of this study was to adapt and validate the Persian ver...

The poster discusses the characteristics needed in an information retrieval (IR) test collection to facilitate the evaluation of integrated search, i.e. search across a range of different sources but with one search box and one ranked result list, and describes and analyses a new test collection constructed for this purpose. The test collection consists of approx. 18,000 monographic records, 16...