Skip to content

Research at St Andrews

Multiple regressions: the meaning of multiple regression and the non-problem of collinearity

Research output: Contribution to journalArticle

Abstract

Simple regression (regression analysis with a single explanatory variable), and multiple regression (regression models with multiple explanatory variables), typically correspond to very different biological questions. The former use regression lines to describe univariate associations. The latter describe the partial, or direct, effects of multiple variables, conditioned on one another. We suspect that the superficial similarity of simple and multiple regression leads to confusion in their interpretation. A clear understanding of these methods is essential, as they underlie a large range of procedures in common use in biology. Beyond simple and multiple regression in their most basic forms, understanding the key principles of these procedures is critical to understanding, and properly applying, many methods, such as mixed models, generalised models, and causal inference using graphs (including path analysis and its extensions). A simple, but careful, look at the distinction between these two analyses is valuable in its own right, and can also be used to clarify widely-held misconceptions about collinearity (correlations among explanatory variables). There is no general sense in which collinearity is a problem. We suspect that the perception of collinearity as a hindrance to analysis stems from misconceptions about interpretation of multiple regression models, and so we pursue discussions about these misconceptions in this light. In particular, collinearity causes multiple regression coefficients to be less precisely estimated than corresponding simple regression coefficients. This should not be interpreted as a problem, as it is perfectly natural that direct effects should be harder to characterise than univariate associations. Purported solutions to the perceived problems of collinearity are detrimental to most biological analyses.
Close

Details

Original languageEnglish
Article number3
Number of pages24
JournalPhilosophy, Theory and Practice in Biology
Volume10
DOIs
Publication statusPublished - 2018

    Research areas

  • Regression, Multiple regression, Collinearity, Ordinary least squares, Linear model, Causal effect, Correlation

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. Deconstructing collective building in social insects: implications for ecological adaptation and evolution

    Invernizzi, E. & Ruxton, G. D., 8 Aug 2019, In : Insectes Sociaux. First Online, 12 p.

    Research output: Contribution to journalReview article

  2. The Hermans–Rasson test as a powerful alternative to the Rayleigh test for circular statistics in biology

    Landler, L., Ruxton, G. D. & Malkemper, E. P., 7 Aug 2019, In : BMC Ecology. 19, 8 p., 30.

    Research output: Contribution to journalArticle

  3. No evidence that warmer temperatures are associated with selection for smaller body sizes

    Siepielski, A. M., Morrissey, M. B., Carlson, S. M., Francis, C. D., Kingsolver, J. G., Whitney, K. D. & Kruuk, L. E. B., 24 Jul 2019, In : Proceedings of the Royal Society B: Biological Sciences. 286, 1907, 10 p., 20191332.

    Research output: Contribution to journalArticle

  4. A theory for investment across defences triggered at different stages of a predator-prey encounter

    Wang, L., Ruxton, G. D., Cornell, S. J., Speed, M. P. & Broom, M., 21 Jul 2019, In : Journal of Theoretical Biology. 473, p. 9-19 11 p.

    Research output: Contribution to journalArticle

  5. Secondary dispersal mechanisms of winged seeds: a review

    der Weduwen, D. & Ruxton, G. D., 19 Jun 2019, In : Biological Reviews. Early View, 9 p.

    Research output: Contribution to journalReview article

ID: 253120157