ROCView : prototype software for data collection in jackknife alternative free-response receiver operating characteristic analysis

Thompson, JD; Hogg, P; Thompson, S; Manning, D; Szczepura, K

Abstract

ROCView has been developed as an image display and response capture (IDRC) solution to image display and consistent recording of reader responses in relation to the free-response receiver operating characteristic paradigm. A web-based solution to IDRC for observer response studies allows observations to be completed from any location, assuming that display performance and viewing conditions are consistent with the study being completed. The simplistic functionality of the software allows observations to be completed without supervision. ROCView can display images from multiple modalities, in a randomised order if required. Following registration, observers are prompted to begin their image evaluation. All data are recorded via mouse clicks, one to localise (mark) and one to score confidence (rate) using either an ordinal or continuous rating scale. Up to nine ‘‘mark-rating’’ pairs can be made per image. Unmarked images are given a default score of zero. Upon completion of the study, both true-positive and false-positive reports can be downloaded and adapted for analysis. ROCView has the potential to be a useful tool in the assessment of modality performance difference for a range of imaging methods.

Citation

Thompson, J., Hogg, P., Thompson, S., Manning, D., & Szczepura, K. (2012). ROCView : prototype software for data collection in jackknife alternative free-response receiver operating characteristic analysis. British Journal of Radiology, 85, 1320-1326. https://doi.org/10.1259/bjr/99497945

• Journal Article Type: Article
• Acceptance Date: Dec 14, 2011
• Publication Date: Sep 28, 2012
• Deposit Date: Jan 11, 2016
• Publicly Available Date: Apr 5, 2016
• Journal: British Journal of Radiology
• Print ISSN: 0007-1285
• Electronic ISSN: 1748-880X
• Publisher: British Institute of Radiology
• Volume: 85
• Pages: 1320-1326
• DOI: https://doi.org/10.1259/bjr/99497945
• Publisher URL: http://dx.doi.org/10.1259/bjr/99497945