Skip to content

Research at St Andrews

Constructing and model-fitting receiver operator characteristics using continuous data

Research output: Contribution to journalArticle

DOI

Open Access permissions

Open

Author(s)

Josephine Ann Urquhart, Akira Robert O'Connor

School/Research organisations

Abstract

Receiver operating characteristics (ROCs) are plots which provide a visual summary of a classifier’s decision response accuracy at varying discrimination thresholds. Typical practice, particularly within psychological studies, involves plotting an ROC from a limited number of discrete thresholds before fitting signal detection parameters to the plot. We propose that additional insight into decision-making could be gained through increasing ROC resolution, using trial-by-trial measurements derived from a continuous variable, in place of discrete discrimination thresholds. Such continuous ROCs are not yet routinely used in behavioural research, which we attribute to issues of practicality (i.e. the difficulty of applying standard ROC model-fitting methodologies to continuous data). Consequently, the purpose of the current article is to provide a documented method of fitting signal detection parameters to continuous ROCs. This method reliably produces model fits equivalent to the unequal variance least squares method of model-fitting (Yonelinas et al., 1998), irrespective of the number of data points used in ROC construction. We present the suggested method in three main stages: I) building continuous ROCs, II) model-fitting to continuous ROCs and III) extracting model parameters from continuous ROCs. Throughout the article, procedures are demonstrated in Microsoft Excel, using an example continuous variable: reaction time, taken from a single-item recognition memory. Supplementary MATLAB code used for automating our procedures is also presented in Appendix B, with a validation of the procedure using simulated data shown in Appendix C.
Close

Details

Original languageEnglish
JournalPsyArXiv
DOIs
Publication statusPublished - 20 Apr 2018

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. Perirhinal cortex and the recognition of relative familiarity

    Ameen-Ali, K. E., Sivakumaran, M., Eacott, M. J., O'Connor, A. R., Ainge, J. A. & Easton, A., 14 Apr 2021, In: Neurobiology of Learning and Memory. In press, 107439.

    Research output: Contribution to journalArticlepeer-review

  2. Distance- rather than location-based temporal judgements are more accurate during episodic recall in a real-world task

    Kuruvilla, M. V., O'Connor, A. R. & Ainge, J. A., 25 Jun 2020, In: Memory. Latest Articles

    Research output: Contribution to journalArticlepeer-review

  3. Converging on an understanding of the déjà vu experience

    Aitken, C. B. & O'Connor, A. R., 12 May 2020, Memory quirks: The study of odd phenomena in memory. Cleary, A. M. & Schwartz, B. L. (eds.). Routledge, p. 288-305 18 p.

    Research output: Chapter in Book/Report/Conference proceedingChapter

  4. Material culture, museums, and memory: experiments in visitor recall and memory

    Sweetman, R., Hadfield, A. & O'Connor, A., 17 Mar 2020, In: Visitor Studies. p. 1-28 28 p.

    Research output: Contribution to journalArticlepeer-review

  5. The the the the induction of jamais vu in the laboratory: word alienation and semantic satiation

    Moulin, C. J. A., Bell, N., Turunen, M., Baharin, A. & O'Connor, A. R., 20 Feb 2020, In: Memory. Latest Articles, 10 p.

    Research output: Contribution to journalArticlepeer-review

Related by journal

  1. Handedness in Twins: Meta-Analyses

    Paracchini, S., 2021, In: PsyArXiv.

    Research output: Contribution to journalArticle

  2. The prevalence of left-handedness: Five meta-analyses of 200 studies totaling 2,396,170 individuals

    Papadatou-Pastou, M., Martin, M., Munafò, M. R., Ntolka, E., Ocklenburg, S. & Paracchini, S., 23 Apr 2019, In: PsyArXiv. 120 p.

    Research output: Contribution to journalArticle

ID: 254911602

Top