Beyond test accuracy: Benefits of measuring response time in computerised testing

  • Eugene Gvozdenko The University of Melbourne
  • Dianne Chambers The University of Melbourne

Abstract

This paper investigates how monitoring the time spent on a question in a test of basic mathematics skills can provide insights into learning processes, the quality of test takers' knowledge, and cognitive demands and performance of test items that otherwise would remain undiscovered if the usual test outcome of accuracy only format ("correct/incorrect") was used. Data from three tests of basic mathematics skills taken by tertiary students in 2004-2006 were analysed. Means and distributions of individual response times on parallel test questions were examined and differences were further investigated.

Analysis of response time data revealed a number of surprising findings in regard to the impact of variables on preferences for written and mental calculation methods and regarding additional cognitive demands of a question. The study examined how simple statistical analysis of response time distribution can be used to investigate abnormalities of the item functioning. These findings may be of value to educators and to test producers by informing them about the potential of utilising response time measurements as a diagnostic facility in computerised tests, for the purposes of improving teaching and learning.

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Author Biographies

Eugene Gvozdenko, The University of Melbourne
Faculty of Education, The University of Melbourne
Dianne Chambers, The University of Melbourne
Faculty of Education, The University of Melbourne
Published
2007-10-31
How to Cite
Gvozdenko, E., & Chambers, D. (2007). Beyond test accuracy: Benefits of measuring response time in computerised testing. Australasian Journal of Educational Technology, 23(4). https://doi.org/10.14742/ajet.1251