Games: An Experiment with Nation-Wide Representative Subjects Tsu-Tan Fu Center for Survey Research and Institute of Economics, Academia Sinica, Nankang, Taipei 115, Taiwan Wei-Hsin Kong Institute of Industrial Economics, National Central University C.C. Yang* Institute of Economics, Academia Sinica, Nankang, Taipei 115, Taiwan Department of Public Finance, National Chengchi University, Wenshan...

In the 21st century, with rise of popularity standardized or large-scale tests, their high-stakes have started to be apparent. High-stake tests are not new, but in most cases, current use as social practice tends shape individuals’ futures. Currently new trend for quality discussion aims critically evaluate through focus on functions, and power testing discourse, whereas traditionally what was ...

Automated scoring of written and spoken responses is an NLP application that can significantly impact lives especially when deployed as part of high-stakes tests such as the GRE® and the TOEFL®. Ethical considerations require that automated scoring algorithms treat all testtakers fairly. The educational measurement community has done significant research on fairness in assessments and automated...

We describe our on-going work in the creation of a web-based Intelligent Tutoring System (ITS) for the mathematics section of the Scholastic Aptitude Test (SAT). Wayang Oupost focuses on geometry problems, and uses web-based multimedia to communicate concepts to the student. Decisions about problem and help selection made on a remote web server, which stores data on student-system interactions ...

Mindfulness enhances emotion regulation and cognitive performance. A mindful approach may be especially beneficial in high-stakes academic testing environments, in which anxious thoughts disrupt cognitive control. The current studies examined whether mindfulness improves the emotional response to anxiety-producing testing situations, freeing working memory resources, and improving performance. ...

The discussion in Drs. Sanchez Escobedo and Hollingworth's paper independently confirms virtually all our observations regarding the psychometric and interpretive deficiencies of the Mexican norms for very high-stakes decisions, such as that involved in an Atkins hearing. Test publishers have an ethical obligation to caution potential users against the premature use of a developing assessment t...

Recent work demonstrates that process data from intelligent tutoring systems (ITSs) can be used to predict student outcomes on high-stakes, standardized tests. Such models are important if ITSs are to be used for formative assessment and as replacements for external assessments. Recent work used various measures of learning efficiency and performance from problem-level, aggregate data from Carn...

Automatic essay scoring is nowadays successfully used even in high-stakes tests, but this is mainly limited to holistic scoring of learner essays. We present a new dataset of essays written by highly proficient German native speakers that is scored using a fine-grained rubric with the goal to provide detailed feedback. Our experiments with two state-of-the-art scoring systems (a neural and a SV...

Many factors have been proposed to explain the attrition of women in science, technology, engineering and math fields, among them the lower performance of women in introductory courses resulting from deficits in incoming preparation. We focus on the impact of mixed methods of assessment, which minimizes the impact of high-stakes exams and rewards other methods of assessment such as group partic...