Comparison of methods for controlling maximum exposure rates in computerized adaptive testing.
نویسندگان
چکیده
This paper has two objectives: (a) to provide a clear description of three methods for controlling the maximum exposure rate in computerized adaptive testing -the Symson-Hetter method, the restricted method, and the item-eligibility method- showing how all three can be interpreted as methods for constructing the variable sub-bank of items from which each examinee receives the items in his or her test; (b) to indicate the theoretical and empirical limitations of each method and to compare their performance. With the three methods, we obtained basically indistinguishable results in overlap rate and RMSE (differences in the third decimal place). The restricted method is the best method for controlling exposure rate, followed by the item-eligibility method. The worst method is the Sympson-Hetter method. The restricted method presents problems of sequential overlap rate. Our advice is to use the item-eligibility method, as it saves time and satisfies the goals of restricting maximum exposure.
منابع مشابه
Maximum information stratification method for controlling item exposure in computerized adaptive testing.
The proposal for increasing the security in Computerized Adaptive Tests that has received most attention in recent years is the a-stratified method (AS - Chang and Ying, 1999): at the beginning of the test only items with low discrimination parameters ( a ) can be administered, with the values of the a parameters increasing as the test goes on. With this method, distribution of the exposure rat...
متن کاملStrategies for controlling item exposure in computerized adaptive testing with the partial credit model.
Exposure control research with polytomous item pools has determined that randomization procedures can be very effective for controlling test security in computerized adaptive testing (CAT). The current study investigated the performance of four procedures for controlling item exposure in a CAT under the partial credit model. In addition to a no exposure control baseline condition, the Kingsbury...
متن کاملA Gradual Maximum Information Ratio Approach to Item Selection in Computerized Adaptive Testing
For long-term quality control of computerized adaptive test (CAT) programs, optimizing the usage of the item bank (i.e., controlling item exposure rate) is critical. Selecting the best item often conflicts with the procedure for item exposure control, however. In this study, a newly proposed approach to item selection in CAT, in which the efficiency of items is considered in the early stages of...
متن کاملA Strategy for Controlling Item Exposure in Multidimensional Computerized Adaptive Testing
While computerized adaptive tests have enjoyed tremendous growth in the past decade, satisfactory solutions for many important problems are still unavailable. Among these problems, a critical one is the control of item exposure rate. Because adaptive algorithms are designed to select optimal items, they tend to choose items with high discriminating power. Thus, these items are selected far more...
متن کاملContent Balancing in Stratified Computerized Adaptive Testing Designs
For computerized adaptive testing (CAT) programs that adopt three-parameter logistic model, high discriminative items generally provide more information for trait estimation. The information based item selection methods in administering computerized adaptive tests (CATs) tend to choose the item that provides maximum information at an examinee’s estimated trait level. As a result, these methods ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Psicothema
دوره 21 2 شماره
صفحات -
تاریخ انتشار 2009