Modelling Mathematics Problem Solving Item Responses Using a Multidimensional IRT Model
نویسندگان
چکیده
This research examined students’ responses to mathematics problem-solving tasks and applied a general multidimensional IRT model at the response category level. In doing so, cognitive processes were identified and modelled through item response modelling to extract more information than would be provided using conventional practices in scoring items. More specifically, the study consisted of two parts. The first part involved the development of a mathematics problem-solving framework that was theoretically grounded, drawing upon research in mathematics education and cognitive psychology. The framework was then used as the basis for item development. The second part of the research involved the analysis of the item response data. It was demonstrated that multidimensional IRT models were powerful tools for extracting information from a limited number of item responses. A problem-solving profile for each student could be constructed from the results of IRT scaling.
منابع مشابه
plink: An R Package for Linking Mixed-Format Tests Using IRT-Based Methods
This introduction to the R package plink is a (slightly) modified version of Weeks (2010), published in the Journal of Statistical Software. The R package plink has been developed to facilitate the linking of mixed-format tests for multiple groups under a common item design using unidimensional and multidimensional IRT-based methods. This paper presents the capabilities of the package in the co...
متن کاملCommonalities and differences in IRT-based methods for nonignorable item nonresponses
Missing responses resulting from omitted or not-reached items are beyond researchers’ control and potentially threaten the validity of test results. Empirical evidence concerning the relationship between missingness and test takers’ performance on the test have suggested that the missing data mechanism is nonignorable and needs to be taken into account. Various IRT-based models for nonignorable...
متن کاملModel-Based Collaborative Filtering Analysis of Student Response Data: Machine-Learning Item Response Theory
We apply collaborative filtering (CF) to dichotomously scored student response data (right, wrong, or no interaction), finding optimal parameters for each student and item based on cross-validated prediction accuracy. The approach is naturally suited to comparing different models, both unidimensional and multidimensional in ability, including a widely used subset of Item Response Theory (IRT) m...
متن کاملTowards IRT-based student modeling from problem solving steps
In this research, we use Item Response Theory based model for computing procedural knowledge of a sample of primary school children solving fraction addition exercises. For each exercise, the model needs to automatically construct a solution graph. We have explored different strategies for building such graphs and the effects they have on the quality of the model predictions. The results obtain...
متن کاملRunning head: MODELING LANGUAGE COMPONENTS IN MATH ITEMS Modeling Language Components in Mathematical Items Using Multiple-Random-Effects IRT Models
Language components in mathematical word problems might have some profound impacts on the problem solving processes engaged by examinees. Such impacts usually do not occur uniformly across examinees, but rather are the results of the interactions between the characteristics of the mathematical item and the cognitive properties of the particular examinee. This study examined such impacts through...
متن کامل