Assessing Assessment Literacy: Insights From a High-Stakes Test
author
Abstract:
This study constitutes an attempt to see what Language assessment literacy (LAL) isfor three groups of stakeholders, namely LAL test developers, LAL instructors, andLAL test-takers. The perceptions of the former group were derived from the contentanalysis of the latest version of the LAL test, and those of the latter 2 groups wereassessed through a survey designed by the researcher. Participants were 54 M.A.TEFL students sampled conveniently. Descriptive statistical analysis of the datarevealed that for test designers LAL is mainly a matter of knowledge and theorywith little importance accorded to skills and even less so to principles. Forinstructors and test-takers, LAL was perceived to be mainly a matter of skills.Moreover, test-takers perceived of LAL as the most challenging module of the testbecause of its dealing with statistics, its theoretical nature, and test-takers' lack ofhands-on experience with language tests.
similar resources
assessing assessment literacy: insights from a high-stakes test
this study constitutes an attempt to see what language assessment literacy (lal) isfor three groups of stakeholders, namely lal test developers, lal instructors, andlal test-takers. the perceptions of the former group were derived from the contentanalysis of the latest version of the lal test, and those of the latter 2 groups wereassessed through a survey designed by the researcher. participant...
full textInterpreting the Validity of a High-Stakes Test in Light of the Argument-Based Framework: Implications for Test Improvement
The validity of large-scale assessments may be compromised, partly due to their content inappropriateness or construct underrepresentation. Few validity studies have focused on such assessments within an argument-based framework. This study analyzed the domain description and evaluation inference of the Ph.D. Entrance Exam of ELT (PEEE) sat by Ph.D. examinees (n = 999) in 2014 in Iran....
full textSimulation as a high stakes assessment tool in emergency medicine
The Australasian College for Emergency Medicine (ACEM) will introduce high stakes simulation-based summative assessment in the form of Objective Structured Clinical Examinations (OSCEs) into the Fellowship Examination from 2015. Miller's model emphasises that, no matter how realistic the simulation, it is still a simulation and examinees do not necessarily behave as in real life. OSCEs are suit...
full textFlow and diffusion of high-stakes test scores.
We apply visualization and modeling methods for convective and diffusive flows to public school mathematics test scores from Texas. We obtain plots that show the most likely future and past scores of students, the effects of random processes such as guessing, and the rate at which students appear in and disappear from schools. We show that student outcomes depend strongly upon economic class, a...
full textDifferential Item Functioning (DIF) in Terms of Gender in the Reading Comprehension Subtest of a High-Stakes Test
Validation is an important enterprise especially when a test is a high stakes one. Demographic variables like gender and field of study can affect test results and interpretations. Differential Item Functioning (DIF) is a way to make sure that a test does not favor one group of test takers over the others. This study investigated DIF in terms of gender in the reading comprehension subtest (35 i...
full textAutomatic Assessment of Prosody in High-Stakes English Tests
Prosody can be used to infer whether or not candidates fully understand a passage they are reading aloud. In this paper, we focused on automatic assessment of prosody in a read-aloud section for a high-stakes English test. A new method was proposed to handle fundamental frequency (F0) of unvoiced segments that significantly improved the predictive power of F0. The kmeans clustering method was u...
full textMy Resources
Journal title
volume 4 issue 1
pages 111- 131
publication date 2013-04-01
By following a journal you will be notified via email when a new issue of this journal is published.
Hosted on Doprax cloud platform doprax.com
copyright © 2015-2023