Loughborough University
Leicestershire, UK
LE11 3TU
+44 (0)1509 263171
Loughborough University

Loughborough University Institutional Repository

Please use this identifier to cite or link to this item: https://dspace.lboro.ac.uk/2134/1872

Title: The development and application of an expert marker system to support ‘High Stakes’ examinations
Authors: Craven, Patrick
Long, S.
Issue Date: 2002
Publisher: © Loughborough University
Citation: CRAVEN and LONG, 2002. The Development and Application of an Expert Marker System to Support ‘High Stakes’ Examinations . IN: Proceedings of the 6th CAA Conference, Loughborough: Loughborough University
Abstract: been used as the benchmark assessment for vocational IT skills ever since. It currently attracts over 300,000 entries per year across 9 different application areas. This equates to over 1m scripts per year, all of which require marking, moderation and processing to award of result. Over the last 5 years OCR has worked with the University of East Anglia to develop an automated ‘expert’ marking system for four of the application areas within CLAIT (Core, Word Processing, Spreadsheet, Database). This system is now operational and during the first pilot phase successfully supported 30 Centres and processed over 2000 script submissions. From initial concept the system set out to extend the scope of computer assisted assessment beyond simple skill tests as it was not desirable to reduce the CLAIT assessment to series of atomised functions tests or to place software simulations within testing Centres (over 3500 in the UK). It was also important that the candidate experience of the assessment remained relatively untouched and so an off-line delivery/on-line processing solution was proposed. This paper provides an overview of the modular approach taken by OCR and reflects on the successes and challenges faced during implementation. The presentation will provide a demonstration of the system with a brief explanation of the intelligent workflow processing and the application of expert marking rules to ensure valid and reliable assessment outcomes.
Description: This is a conference paper.
URI: https://dspace.lboro.ac.uk/2134/1872
Appears in Collections:CAA Conference

Files associated with this item:

File Description SizeFormat
craven_p1.pdf192.45 kBAdobe PDFView/Open

 

SFX Query

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.