Making sense of audit trail data

  • Gregor E. Kennedy The University of Melbourne
  • Terry S. Judd The University of Melbourne

Abstract

In this paper we argue that the use of audit trail data for research and evaluation purposes has attracted scepticism due to real and perceived difficulties associated with the data's interpretation. We suggest that educational technology researchers and evaluators need to better understand how audit trail data can be processed and analysed effectively, and identify three stages of audit trail analysis. We present an investigation of a computer based learning resource as a vehicle for exploring strategies that can assist researchers and evaluators in the analysis and interpretation of audit trail data. The analytical approach we describe is iterative in nature, moving to greater levels of specificity as it proceeds. By combining this approach with primarily descriptive techniques we were able to establish distinct patterns of access to the learning resource. We then performed a series of cluster analyses which, guided by a clear understanding of two critical components of the learning environment, led to the identification of four distinct 'types' or 'categories' of users. Our results demonstrate that it is possible to document meaningful usage patterns at a number of levels of analysis using electronic records from technology based learning environments. The implications of these results for future work are discussed.

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Author Biographies

Gregor E. Kennedy, The University of Melbourne
Biomedical Multimedia Unit
Faculty of Medicine, Dentistry and Health Sciences
The University of Melbourne
Terry S. Judd, The University of Melbourne
Biomedical Multimedia Unit, Faculty of Medicine, Dentistry and Health Sciences, The University of Melbourne
Published
2004-04-22
How to Cite
Kennedy, G. E., & Judd, T. S. (2004). Making sense of audit trail data. Australasian Journal of Educational Technology, 20(1). https://doi.org/10.14742/ajet.1365