Skip to content

Research at St Andrews

Constructing and model-fitting receiver operator characteristics using continuous data

Research output: Contribution to journalArticle

DOI

Open Access permissions

Open

Author(s)

Josephine Ann Urquhart, Akira Robert O'Connor

School/Research organisations

Abstract

Receiver operating characteristics (ROCs) are plots which provide a visual summary of a classifier’s decision response accuracy at varying discrimination thresholds. Typical practice, particularly within psychological studies, involves plotting an ROC from a limited number of discrete thresholds before fitting signal detection parameters to the plot. We propose that additional insight into decision-making could be gained through increasing ROC resolution, using trial-by-trial measurements derived from a continuous variable, in place of discrete discrimination thresholds. Such continuous ROCs are not yet routinely used in behavioural research, which we attribute to issues of practicality (i.e. the difficulty of applying standard ROC model-fitting methodologies to continuous data). Consequently, the purpose of the current article is to provide a documented method of fitting signal detection parameters to continuous ROCs. This method reliably produces model fits equivalent to the unequal variance least squares method of model-fitting (Yonelinas et al., 1998), irrespective of the number of data points used in ROC construction. We present the suggested method in three main stages: I) building continuous ROCs, II) model-fitting to continuous ROCs and III) extracting model parameters from continuous ROCs. Throughout the article, procedures are demonstrated in Microsoft Excel, using an example continuous variable: reaction time, taken from a single-item recognition memory. Supplementary MATLAB code used for automating our procedures is also presented in Appendix B, with a validation of the procedure using simulated data shown in Appendix C.
Close

Details

Original languageEnglish
JournalPsyArXiv
DOIs
Publication statusPublished - 20 Apr 2018

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. Déjà vu experiences in anxiety

    Wells, C., O'Connor, A. R. & Moulin, C., 1 Nov 2018, In : Memory. In press

    Research output: Contribution to journalArticle

  2. fMRI evidence supporting the role of memory conflict in the déjà vu experience

    Urquhart, J. A., Sivakumaran, M. H., Macfarlane, J. A. & O'Connor, A. R., 20 Sep 2018, In : Memory. Latest Articles

    Research output: Contribution to journalArticle

  3. How accurate are runners’ prospective predictions of their race times?

    Liverakos, K., McIntosh, K., Moulin, C. & O'Connor, A. R., 1 Aug 2018, In : PLoS One. 13, 8, 24 p., e0200744.

    Research output: Contribution to journalArticle

  4. The discrimination ratio derived from novel object recognition tasks as a measure of recognition memory sensitivity, not bias

    Sivakumaran, M. H., MacKenzie, A. K., Callan, I. R., Ainge, J. A. & O'Connor, A. R., 1 Aug 2018, In : Scientific Reports. 8, 11579.

    Research output: Contribution to journalArticle

  5. Understanding metacognitive confidence: insights from judgment-of-learning justifications

    Jersakova, R., Allan, R., Booth, J., Souchay, C. & O'Connor, A. R., Dec 2017, In : Journal of Memory and Language. 97, p. 187-207 21 p.

    Research output: Contribution to journalArticle

Related by journal

  1. Prevalence and heritability of handedness in a Chinese twin and singleton sample

    Zheng, M., McBride, C., Ho, C. S-H., Chan, J. K-C., Choy, K. W. & Paracchini, S., 22 Oct 2019, In : PsyArXiv. 31 p.

    Research output: Contribution to journalArticle

  2. The prevalence of left-handedness: Five meta-analyses of 200 studies totaling 2,396,170 individuals

    Papadatou-Pastou, M., Martin, M., Munafò, M. R., Ntolka, E., Ocklenburg, S. & Paracchini, S., 23 Apr 2019, In : PsyArXiv. 120 p.

    Research output: Contribution to journalArticle

ID: 254911602

Top