Skip to content

Research at St Andrews

Quantification of advanced dementia patients' engagement in therapeutic sessions: an automatic video based approach using computer vision and machine learning

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Author(s)

Liangfei Zhang, Ognjen Arandjelovic, Sonia Dewar, Arlene Astell, Gayle Doherty, Maggie Ellis

School/Research organisations

Abstract

Most individuals with advanced dementia lose the ability to communicate with the outside world through speech. This limits their ability to participate in social activities crucial to their well-being and quality of life. However, there is mounting evidence that individuals with advanced dementia can still communicate non-verbally and benefit greatly from these interactions. A major problem in facilitating the advancement of this research is of a practical and methodical nature: assessing the success of treatment is currently done by humans, prone to subjective bias and inconsistency, and it involves laborious and time consuming effort. The present work is the first attempt at exploring if automatic (artificial intelligence based) quantification of the degree of patient engagement in Adaptive Interaction sessions, a highly promising intervention developed to improve the quality of life of nonverbal individuals with advanced dementia. Hence we describe a framework which uses computer vision and machine learning as a potential first step towards answering this question. Using a real-world data set of videos of therapeutic sessions, not acquired specifically for the purposes of the present work, we demonstrate highly promising results.

Close

Details

Original languageEnglish
Title of host publication2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)
PublisherIEEE
Pages5785-5788
Number of pages4
Volume2020
ISBN (Electronic)978-1-7281-1990-8
ISBN (Print)978-1-7281-1991-5
DOIs
Publication statusPublished - Jul 2020
Event42nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) in conjunction with the 43rd Annual Conference of the Canadian Medical and Biological Engineering Society (EMBC 2020) - EMBS Virtual Academy, Montreal, Canada
Duration: 20 Jul 202024 Jul 2020
https://embc.embs.org/2020/

Publication series

NameAnnual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference
ISSN (Print)2375-7477

Conference

Conference42nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) in conjunction with the 43rd Annual Conference of the Canadian Medical and Biological Engineering Society (EMBC 2020)
Abbreviated titleEMBC 2020
CountryCanada
CityMontreal
Period20/07/2024/07/20
Internet address

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. Review of automatic microexpression recognition in the past decade

    Zhang, L. & Arandjelović, O., 2 May 2021, In: Machine Learning and Knowledge Extraction. 3, 2, p. 414-434 21 p.

    Research output: Contribution to journalReview articlepeer-review

  2. Assessment of immunological features in muscle-invasive bladder cancer prognosis using ensemble learning

    Gavriel, C., Dimitriou, N., Brieu, N., Nearchou, I. P., Arandelovic, O., Schmidt, G., Harrison, D. J. & Caie, P. D., 1 Apr 2021, In: Cancers. 13, 7, 1624.

    Research output: Contribution to journalArticlepeer-review

  3. Neuroprotective actions of leptin facilitated through balancing mitochondrial morphology and improving mitochondrial function

    Cheng, Y., Buchan, M., Vitanova, K., Aitken, L., Gunn-Moore, F. J., Ramsay, R. R. & Doherty, G., 13 Oct 2020, In: Journal of Neurochemistry. 155, 2, p. 191-206 e15003.

    Research output: Contribution to journalArticlepeer-review

ID: 271067680

Top