We propose a novel approach for the automatic assessment of hypernasality in the speech of children with cleft lip and palate. Our system is based on short-time features as well as on large-scale features. It is compared to the perceptive evaluation of two experienced speech therapists. While the correlation between the scores of the speech therapists is 0.80 the correlation between the composi...

A study was conducted to determine the interrater and test-retest reliability of the Motor Development Checklist (Doudlah, 1976). Thirty-six subjects with diagnosed multiple disabilities and severe and profound mental retardation were evaluated by two experienced occupational therapists. Reliability was established by means of the intraclass correlation approach, and results indicated that coef...

onveying a strong message within a language stems from not only a linguistically appropriate utterance but also a pragmatically appropriate discourse. Broadly considering various facets of pragmatics, pragmatic assessment has not been potentially brought into perspective. To address this discourse gap, this study, guided by the principles of mixed-method design, pursued three purposes: ...

Pragmatic rating is considered as one of the novel and crucial aspects of second language education which has not been maneuvered upon in the literature. To address this gap, the current study aimed to inspect the matches and mismatches, to explore rating variations, and to assess the rater consistency between the holistic and analytic rating methods of the speech act of agreement in L2 by non-...

A method is presented to estimate the accuracy of an automated classification system based only on expert ratings on test cases, where the system may be substantially more accurate than the raters. In this method an estimate of overall rater accuracy is derived from the level of inter-rater agreement, Bayesian updating based on estimated rater accuracy is applied to estimate a ground truth prob...

OBJECTIVE To assess the inter-observer agreement of the electroencephalogram (EEG) diagnosis of (non-convulsive) seizures in comatose patients. DESIGN/SETTING/PATIENTS Nine clinicians with different levels of experience in clinical neurophysiology were asked to evaluate in a strictly controlled way 90 epochs (10s each) of 30 EEG's of 23 comatose patients admitted to the intensive care unit (I...