Skip to content

Research at St Andrews

Visualization as Intermediate Representations (VLAIR) for human activity recognition

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Ambient, binary, event-driven sensor data is useful for many human activity recognition applications such as smart homes and ambient-assisted living. These sensors are privacy-preserving, unobtrusive, inexpensive and easy to deploy in scenarios that require detection of simple activities such as going to sleep, and leaving the house. However, classification performance is still a challenge, especially when multiple people share the same space or when different activities take place in the same areas. To improve classification performance we develop what we call a Visualization as Intermediate Representations (VLAIR) approach. The main idea is to re-represent the data as visualizations (generated pixel images) in a similar way as how visualizations are created for humans to analyze and communicate data. Then we can feed these images to a convolutional neural network whose strength resides in extracting effective visual features. We have tested five variants (mappings) of the VLAIR approach and compared them to a collection of classifiers commonly used in classic human activity recognition. The best of the VLAIR approaches outperforms the best baseline, with strong advantage in recognising less frequent activities and distinguishing users and activities in common areas. We conclude the paper with a discussion on why and how VLAIR can be useful in human activity recognition scenarios and beyond.
Close

Details

Original languageEnglish
Title of host publicationPervasiveHealth '20:
Subtitle of host publicationProceedings of the 14th EAI International Conference on Pervasive Computing Technologies for Healthcare
EditorsSean A. Munson, Stephen M. Schueller
PublisherACM
Pages201-210
Number of pages10
ISBN (Print)9781450375320
DOIs
Publication statusPublished - 18 May 2020
Event14th EAI International Conference on Pervasive Computing Technologies for Healthcare (EAI PervasiveHealth 2020) - Atlanta, United States
Duration: 6 Oct 20208 Oct 2020
Conference number: 14

Conference

Conference14th EAI International Conference on Pervasive Computing Technologies for Healthcare (EAI PervasiveHealth 2020)
Abbreviated titleEAI PervasiveHealth 2020
CountryUnited States
CityAtlanta
Period6/10/208/10/20

    Research areas

  • Information visualization, Intermediate representations, Human activity recognition, Convolutional neural networks, Smart homes

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. Continual learning in sensor-based human activity recognition: an empirical benchmark analysis

    Jha, S., Schiemer, M., Zambonelli, F. & Ye, J., 16 Apr 2021, In: Information Sciences. In Press, p. 1-35 35 p.

    Research output: Contribution to journalArticlepeer-review

  2. Continual activity recognition with generative adversarial networks

    Ye, J., Nakwijit, P., Schiemer, M., Jha, S. & Zambonelli, F., 27 Mar 2021, In: ACM Transactions on Internet of Things. 2, 2, p. 1-25 25 p., 9.

    Research output: Contribution to journalArticlepeer-review

  3. Shared learning activity labels across heterogeneous datasets

    Ye, J., 9 Mar 2021, In: Journal of Ambient Intelligence and Smart Environments. Pre-press, p. 1-18

    Research output: Contribution to journalArticlepeer-review

  4. Few-shot linguistic grounding of visual attributes and relations using gaussian kernels

    Koudouna, D. & Terzić, K., 8 Feb 2021, Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - (Volume 5). Farinella, G. M., Radeva, P., Braz, J. & Bouatouch, K. (eds.). SCITEPRESS - Science and Technology Publications, Vol. 5 VISAPP. p. 146-156

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

  5. Unsupervised domain adaptation in activity recognition: a GAN-based approach

    Rosales Sanabria, A., Zambonelli, F. & Ye, J., 22 Jan 2021, In: IEEE Access. 9, p. 19421-19438 18 p.

    Research output: Contribution to journalArticlepeer-review

ID: 267071323

Top