An evaluation of semi-automated, collaborative marking and feedback systems: Academic staff perspectives

Abstract

Online marking and feedback systems are critical for providing timely and accurate feedback to students and maintaining the integrity of results in large class teaching. Previous investigations have involved much in-house development and more consideration is needed for deploying or customising off the shelf solutions. Furthermore, keeping up to date with the state of the art from both academia and industry is essential. This paper is motivated by a project aiming to identify a marking and feedback system for deployment at the authors' university. A detailed investigation is described which is open minded towards adopting or modifying an existing product, or the implementation of a new solution, with key features and shortcomings described in detail. Moodle Workshops, Turnitin GradeMark, Waypoint and WebMark were shortlisted and carried forward for user analysis testing. The outcomes have not only provided key conclusions concerning the suitability of existing solutions, but resulted in a comprehensive collection of functional requirements that leaders of new projects should consider. This paper should be of interest for anyone considering the adoption or upgrade of any marking and feedback system at their home institution.