Skip to content

Research at St Andrews

On the correspondence of deviances and maximum likelihood and interval estimates from log-linear to logistic regression modelling

Research output: Contribution to journalArticle

Links

Abstract

Consider a set of categorical variables P where at least one, denoted by Y, is binary. The log-linear model that describes the counts in the resulting contingency table implies a specific logistic regression model, with the binary variable as the outcome. We prove that, when the log-linear model is the largest of all log-linear models that correspond to the logistic regression, the Maximum Likelihood Estimate (MLE) for the parameters of the logistic regression equals the MLE for the corresponding parameters of the log-linear model. We prove that, asymptotically, standard errors for the two sets of parameters are also equal. Subsequently, Wald confidence intervals are asymptotically equal. These results demonstrate the extent to which inferences from the log-linear framework can be translated to inferences within the logistic regression framework, on the magnitude of main effects and interactions. Finally, we prove that when the log-linear model is the largest of all models that correspond to the logistic regression, the deviance of the log-linear model is equal to the deviance of the corresponding logistic regression, provided that the latter is fitted to a dataset where no cell observations are merged when one or more factors in P∖{Y} become obsolete. We illustrate the derived results with the analysis of a real dataset.
Close

Details

Original languageEnglish
JournalMathematics arXiv
Publication statusPublished - Nov 2017

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. Parameter redundancy and the existence of maximum likelihood estimates in log-linear models

    Sharifi Far, S., Papathomas, M. & King, R., 10 Sep 2019, (Accepted/In press) In : Statistica Sinica.

    Research output: Contribution to journalArticle

  2. Common Methodological Challenges Encountered with Multiple Systems Estimation Studies

    Vincent, K., Sharifi Far, S. & Papathomas, M., 2019, (Submitted) In : Submitted.

    Research output: Contribution to journalArticle

  3. Multiple System Estimation of Victims of Human Trafficking: Model Assessment and Selection

    Cruff, M., Overstall, A., Papathomas, M. & McCRea, R., 2019, (Submitted) In : Submitted.

    Research output: Contribution to journalArticle

  4. On the correspondence from Bayesian log-linear modelling to logistic regression modelling with g-priors

    Papathomas, M., Mar 2018, In : TEST. 27, 1, p. 197-220 24 p.

    Research output: Contribution to journalArticle

  5. Primary education in Vietnam and pupil online engagement

    Nguyen, Q., Naguib, R., Das, A., Papathomas, M., Vallar, E., Wickramasinghe, N., Santos, G. N., Galvez, M. C. & Nguyen, V., 8 Jan 2018, In : International Journal of Educational Management. 32, 1, p. 71-83

    Research output: Contribution to journalArticle

Related by journal

ID: 251647706