Computer based testing using "digital ink": Participatory design of a Tablet PC based assessment application for secondary education

In this paper, we identify key challenges faced by computer-based assessment (CBA) in secondary education and we put forward a framework of design considerations: design with the students and teachers, select the most appropriate media platform and plan an evolution rather than a revolution of prior practices. We present the CBA application ‘MyTest’ which was developed using the participatory methodology We!Design, with the collaboration of 31 students and teachers. The application is targeted for the Tablet PC platform, provides ‘‘digital ink” capabilities and supports both closed-type and open questions, facilitating the transfer of traditional assessment practices to CBA. Both students and teachers were excited about the design sessions, and they asserted that they would rely more on educational software designed using this approach. The comparison of the ‘MyTest’ application with an assessment application developed with the same participatory methodology and the involvement of 40 undergraduate students revealed dissimilar expectations and needs of high school and undergraduate students that are often disguised or misinterpreted. A pilot evaluation of the application in real learning conditions was conducted with 31 students using Tablet PCs and with 37 students using traditional PCs. Interestingly, the Tablet PC platform rendered the ‘MyTest’ application more useful and usable to the students, validating our claims. 2008 Elsevier Ltd. All rights reserved.