Skip to content

Research at St Andrews

Underestimation of Pearson's product moment correlation statistic

Research output: Contribution to journalArticle

Author(s)

Rosalind K. Humphreys, Marie-Therese Puth, Markus Neuhäuser, Graeme Douglas Ruxton

School/Research organisations

Abstract

Pearson’s product moment correlation coefficient (more commonly Pearson’s r) tends to underestimate correlations that exist in the underlying population. This phenomenon is generally unappreciated in studies of ecology, although a range of corrections are suggested in the statistical literature. The use of Pearson’s r as the classical measure for correlation is widespread in ecology, where manipulative experiments are impractical across the large spatial scales concerned; it is therefore vital that ecologists are able to use this correlation measure as effectively as possible. Here, our literature review suggests that corrections for the issue of underestimation in Pearson’s r should not be adopted if either the data deviate from bivariate normality or sample size is greater than around 30. Through our simulations, we then aim to offer advice to researchers in ecology on situations where both distributions can be described as normal, but sample sizes are lower than around 30. We found that none of the methods currently offered in the literature to correct the underestimation bias offer consistently reliable performance, and so we do not recommend that they be implemented when making inferences about the behaviour of a population from a sample. We also suggest that, when considering the importance of the bias towards underestimation in Pearson’s product moment correlation coefficient for biological conclusions, the likely extent of the bias should be discussed. Unless sample size is very small, the issue of sample bias is unlikely to call for substantial modification of study conclusions.
Close

Details

Original languageEnglish
Pages (from-to)1-7
Number of pages7
JournalOecologia
Volume189
Issue number1
Early online date30 Jul 2018
DOIs
Publication statusPublished - Jan 2019

    Research areas

  • Association, Bias, Correlation, Pearson’s r, Sampling

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. Secondary dispersal mechanisms of winged seeds: a review

    der Weduwen, D. & Ruxton, G. D., 19 Jun 2019, In : Biological Reviews. 94, 5, p. 1830-1838 9 p.

    Research output: Contribution to journalReview article

  2. Deconstructing collective building in social insects: implications for ecological adaptation and evolution

    Invernizzi, E. & Ruxton, G. D., 8 Aug 2019, In : Insectes Sociaux. First Online, 12 p.

    Research output: Contribution to journalReview article

  3. The Hermans–Rasson test as a powerful alternative to the Rayleigh test for circular statistics in biology

    Landler, L., Ruxton, G. D. & Malkemper, E. P., 7 Aug 2019, In : BMC Ecology. 19, 8 p., 30.

    Research output: Contribution to journalArticle

  4. A theory for investment across defences triggered at different stages of a predator-prey encounter

    Wang, L., Ruxton, G. D., Cornell, S. J., Speed, M. P. & Broom, M., 21 Jul 2019, In : Journal of Theoretical Biology. 473, p. 9-19 11 p.

    Research output: Contribution to journalArticle

  5. Circular statistics meets practical limitations: a simulation-based Rao’s spacing test for non-continuous data

    Landler, L., Ruxton, G. D. & Malkemper, E. P., 10 May 2019, In : Movement Ecology. 7, 5 p., 15.

    Research output: Contribution to journalArticle

Related by journal

  1. Oecologia (Journal)

    Nora Nell Hanson (Reviewer)
    Jul 2011

    Activity: Publication peer-review and editorial work typesPeer review of manuscripts

Related by journal

  1. Weather-driven change in primary productivity explains variation in the amplitude of two herbivore population cycles in a boreal system

    Schmidt, J. H., Rexstad, E. A., Roland, C. A., McIntyre, C. L., MacCluskie, M. C. & Flamme, M. J., Feb 2018, In : Oecologia. 186, 2, p. 435-446 12 p.

    Research output: Contribution to journalArticle

  2. Bayesian inference supports the host selection hypothesis in explaining adaptive host specificity by European bitterling

    Smith, C., Feb 2017, In : Oecologia. 183, 2, p. 379-389 11 p.

    Research output: Contribution to journalArticle

  3. Neighbouring populations, opposite dynamics: influence of body size and environmental variation on the demography of stream-resident brown trout (Salmo trutta)

    Fernández-Chacón, A., Genovart, M., Álvarez, D., Cano, J. M., Ojanguren, A. F., Rodriguez-Muñoz, R. & Nicieza, A. G., Jun 2015, In : Oecologia. 178, 2, p. 379-389 11 p.

    Research output: Contribution to journalArticle

ID: 255043566