Skip to content

Research at St Andrews

SWAG Demo: Smart Watch Assisted Gesture Interaction for Mixed Reality Head-mounted Displays

Research output: Contribution to conferenceOther

Author(s)

Hyung-il Kim, Juyoung Lee, Hui Shyong Yeo, Aaron John Quigley, Woontack Woo

School/Research organisations

Abstract

In this demonstration, we will show a prototype system with sensor fusion approach to robustly track 6 degree s of freedom of hand movement and support intuitive hand gesture interaction and 3D object manipulation for Mixed Reality head - mounted displa y s . Robust tracking of hand and finger with egocentric camera remains a challenging problem, especially with self - occlusion – for example, when user tries to grab a virtual object in midair by closing the palm. Our approach leverages the use of a common sma rt watch worn on the wrist to provide a more reliable palm and wrist orientation data , while fusing the data with camera to achieve robust hand motion and orientation for interaction
Close

Details

Original languageEnglish
Pages428
Number of pages429
DOIs
StatePublished - 16 Oct 2018
Event2018 IEEE International Symposium on Mixed and Augmented Reality - Munich, Germany
Duration: 16 Dec 201820 Dec 2018
https://www.ismar2018.org/

Conference

Conference2018 IEEE International Symposium on Mixed and Augmented Reality
Abbreviated titleISMAR
CountryGermany
CityMunich
Period16/12/1820/12/18
Internet address

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. Exploring tangible interactions with radar sensing

    Yeo, H. S., Minami, R., Rodriguez, K., Shaker, G. & Quigley, A. J. 27 Dec 2018 In : Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. 2, 4, 25 p., 200

    Research output: Contribution to journalArticle

  2. Towards end-user development for chronic disease management

    Rough, D. J. & Quigley, A. J. 1 Oct 2018 Designing Technologies to Support Human Problem Solving: A Workshop in Conjunction with VL/HCC 2018 in Lisbon, Portugal, Oct. 1, 2018. IEEE Computer Society

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

  3. End-user development in social psychology research: factors for adoption

    Rough, D. J. & Quigley, A. J. 1 Oct 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC 2018). Cunha, J., Fernandes, J. P., Kelleher, C., Engels, G. & Mendes, J. (eds.). IEEE, p. 75-83 8506573

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

  4. Change blindness in proximity-aware mobile interfaces

    Brock, M. O., Quigley, A. J. & Kristensson, P. O. 21 Apr 2018 Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI'18). New York, NY: ACM, 7 p. 43

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

  5. AdaM: adapting multi-user interfaces for collaborative environments in real-time

    Park, S., Gebhardt, C., Rädle, R., Feit, A., Vrzakova, H., Dayama, N., Yeo, H. S., Klokmose, C., Quigley, A. J., Oulasvirta, A. & Hilliges, O. 21 Apr 2018 Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI'18). New York, NY: ACM, 14 p. 184

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

ID: 256992451