Loughborough University
Leicestershire, UK
LE11 3TU
+44 (0)1509 263171
Loughborough University

Loughborough University Institutional Repository

Please use this identifier to cite or link to this item: https://dspace.lboro.ac.uk/2134/24702

Title: Measuring performance in the interpretation of chest radiographs: a pilot study
Authors: Chen, Yan
James, Jonathan
Dong, Leng
Gale, Alastair G.
Issue Date: 2016
Publisher: © Elsevier on behalf of The Royal College of Radiologists
Citation: CHEN, Y. ... et al, 2016. Measuring performance in the interpretation of chest radiographs: a pilot study. Clinical Radiology, 72 (3), pp. 230-235.
Abstract: AIM: To develop a system to assess the image interpretation performance of radiologists in identifying signs of malignancy on chest radiographs. MATERIALS AND METHODS: A test set of 30 chest radiographs was chosen by an experienced radiologist consisting of 11 normal and 19 abnormal cases. The malignant cases all had biopsyproven pathology; the normal and benign cases all had at least 2 years of imaging follow-up. Fourteen radiologists with a range of experiences were recruited. Participants individually read the test set displayed on a standard reporting workstation, with their findings entered directly into a laptop running specially designed reporting software. For each case, relevant clinical information was given and the reader was asked to mark any perceived abnormality and rate their level of suspicion on a five-point scale (normal, benign, indeterminate, suspicious, or malignant). On completion, participants were given instant feedback with performance parameters including sensitivity and specificity automatically calculated. An opportunity was then given to review the cases together with an expert opinion and pathology. The time each participant took to complete the test was recorded. RESULTS: Six consultant radiologists who took part showed significantly better performance as determined by receiver operating characteristic (ROC) analysis compared to eight specialist registrars (area under the ROC curve [AUC]¼0.9297 and 0.7648 respectively, p¼0.003). There was a significant correlation with years of experience in the interpretation of chest radiographs and performance on the test set (r¼0.573, p¼0.032). Consultant radiologists completed the test significantly more quickly that the specialist registrars: mean time 19.65 minutes compared to 26.51 minutes (p¼0.033). CONCLUSION: It is possible to use a test set to measure individual differences in the interpretation of chest radiographs. This has the potential to be a useful tool in performance testing.
Description: This paper is embargoed until 29th November 2017.
Version: Accepted
DOI: 10.1016/j.crad.2016.11.004
URI: https://dspace.lboro.ac.uk/2134/24702
Publisher Link: http://dx.doi.org/10.1016/j.crad.2016.11.004
ISSN: 0009-9260
Appears in Collections:Closed Access (Computer Science)

Files associated with this item:

File Description SizeFormat
Measuring performance in the interpretation of chest radiographs- a pilot study.pdfAccepted version588.9 kBAdobe PDFView/Open

 

SFX Query

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.