Establishing adequacy of psychometric properties of an instrument involves acquisition and evaluation of evidence based on item content and internal structure. Content validity evidence consists of subject matter experts providing quantitative ratings of the extent to which items are a representative sample of targeted domain. Evidence of internal structure includes factor analytic studies and ...

Mixed-initiative learning integrates complementary human and automated reasoning, taking advantage of their respective reasoning styles and computational strengths in order to solve complex learning problems. Mixed-initiative learning is at the basis of the Disciple approach for developing intelligent agents where a subject matter expert teaches an agent how to perform complex problem solving t...

There is a rapidly growing body of work in the use of Embodied Conversational Agents (ECA) to convey complex contextual relationships through verbal and non-verbal communication, in domains ranging from military C2 to e-learning. In these applications the subject matter expert is often naïve to the technical requirements of ECAs. ENGAGE (the Extensible Natural Gesture Animation Generation Engin...

Purpose – The importance of involving subject matter experts (SMEs) in ERP implementations is well established. SMEs’ knowledge of business and system processes are critical to conducting gap analyses and configuring enterprise systems. But what happens to SMEs on completion of the implementation phase? Prior qualitative research found that some organizations return SMEs to their old department...

Recipients of educational score reports generally welcome the idea of receiving more descriptive feedback about examinee performance than is provided by a total score or a percentile rank indicating overall performance. This is not surprising as descriptive score reports have the potential to aid score users in the development of student-based instructional plans and/or suggest areas for classr...

Over the years we have developed the Disciple theory, methodology, and family of tools for building knowledge-based agents. This approach consists of developing an agent shell that can be taught directly by a subject matter expert in a way that resembles how the expert would teach a human apprentice when solving problems in cooperation. This paper presents the most recent version of the Discipl...

Often the manual review of large data sets, either for purposes of labeling unlabeled instances or for classifying meaningful results from uninteresting (but statistically significant) ones is extremely resource intensive, especially in terms of subject matter expert (SME) time. Use of active learning has been shown to diminish this review time significantly. However, since active learning is a...

In 12 Navy–Marine Corps medical logistics studies and analyses conducted by the Naval Health Research Center (NHRC) and Teledyne Brown Engineering (TBE) over the past 5 years, estimates of battlefield mortality have been a major metric of interest to medical planners. An ongoing concern is how mortality is related to delays in treatment for medical logistics reasons. In this paper, we describe ...

The purpose of this study was to investigate experienced secondary school teachers' (N"80) current and prior perceptions of their professional identity. A questionnaire was used to explore the way teachers see (and saw) themselves as subject matter experts, didactical experts, and pedagogical experts. The teachers currently see their professional identity as consisting of a combination of the d...

This paper presents an application of association rule mining in compliance in the context of health service management. There are approximately 500 million transactions processed by Medicare Australia each year. Among these transactions, there exist a small proportion of suspicious claims. This study applied association rule mining to examine billing patterns within a particular specialist gro...