Skip to content

Research at St Andrews

SWAG demo: smart watch assisted gesture interaction for mixed reality head-mounted displays

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Author(s)

Hyung-il Kim, Juyoung Lee, Hui Shyong Yeo, Aaron John Quigley, Woontack Woo

School/Research organisations

Abstract

In this demonstration, we will show a prototype system with sensor fusion approach to robustly track 6 degrees of freedom of hand movement and support intuitive hand gesture interaction and 3D object manipulation for Mixed Reality head-mounted displays. Robust tracking of hand and finger with egocentric camera remains a challenging problem, especially with self-occlusion – for example, when user tries to grab a virtual object in midair by closing the palm. Our approach leverages the use of a common smart watch worn on the wrist to provide a more reliable palm and wrist orientation data, while fusing the data with camera to achieve robust hand motion and orientation for interaction.
Close

Details

Original languageEnglish
Title of host publication2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)
PublisherIEEE Computer Society
Pages428-429
DOIs
Publication statusPublished - 16 Dec 2018
Event2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) - Munich, Germany
Duration: 16 Dec 201820 Dec 2018
Conference number: 17
https://www.ismar2018.org/

Conference

Conference2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
Abbreviated titleISMAR
CountryGermany
CityMunich
Period16/12/1820/12/18
Internet address

    Research areas

  • Augmented reality, Wearable computing, 3D user interfaces, Hand interaction, Virtual 3D object manipulation

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. Exploring tangible interactions with radar sensing

    Yeo, H. S., Minami, R., Rodriguez, K., Shaker, G. & Quigley, A. J., 27 Dec 2018, In : Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. 2, 4, 25 p., 200.

    Research output: Contribution to journalArticle

  2. Towards end-user development for chronic disease management

    Rough, D. J. & Quigley, A. J., 1 Oct 2018, Designing Technologies to Support Human Problem Solving: A Workshop in Conjunction with VL/HCC 2018 in Lisbon, Portugal, Oct. 1, 2018. IEEE Computer Society

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

  3. End-user development in social psychology research: factors for adoption

    Rough, D. J. & Quigley, A. J., 1 Oct 2018, IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC 2018). Cunha, J., Fernandes, J. P., Kelleher, C., Engels, G. & Mendes, J. (eds.). IEEE, p. 75-83 8506573

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

  4. The evolution of SIGCHI conferences and the future of CHI

    Terveen, L., Mentis, H., Quigley, A. & Palanque, P., 22 Sep 2018, Interactions, 25, 5, p. 84-85 2 p.

    Research output: Contribution to specialist publicationArticle

  5. Change blindness in proximity-aware mobile interfaces

    Brock, M. O., Quigley, A. J. & Kristensson, P. O., 21 Apr 2018, Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI'18). New York, NY: ACM, 7 p. 43

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

ID: 257369125