Skip to content

Research at St Andrews

Out of sight: a toolkit for tracking occluded human joint positions

Research output: Contribution to journalArticle


Chi-Jui Wu, Aaron John Quigley, David Cameron Christopher Harris-Birtill

School/Research organisations


Real-time identification and tracking of the joint positions of people can be achieved with off-the-shelf sensing technologies such as the Microsoft Kinect, or other camera-based systems with computer vision. However, tracking is constrained by the system’s field of view of people. When a person is occluded from the camera view, their position can no longer be followed. Out of Sight addresses the occlusion problem in depth-sensing tracking systems. Our new tracking infrastructure provides human skeleton joint positions during occlusion, by combining the field of view of multiple Kinects using geometric calibration and affine transformation. We verified the technique’s accuracy through a system evaluation consisting of 20 participants in stationary position and in motion, with two Kinects positioned parallel, 45°, and 90° apart. Results show that our skeleton matching is accurate to within 16.1 cm (s.d. = 5.8 cm), which is within a person’s personal space. In a realistic scenario study, groups of two people quickly occlude each other, and occlusion is resolved for 85% of the participants. A RESTful API was developed to allow distributed access of occlusion-free skeleton joint positions. As a further contribution, we provide the system as open source.


Original languageEnglish
Pages (from-to)125-135
Number of pages11
JournalPersonal and Ubiquitous Computing
Issue number1
Early online date2 Dec 2016
Publication statusPublished - Feb 2017

    Research areas

  • Kinect, Occlusion, Toolkit

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. Understanding computation time: a critical discussion of time as a computational performance metric

    Harris-Birtill, D. & Harris-Birtill, R., 3 Aug 2020, (Accepted/In press) Time in variance: the study of time. Parker, J., Harris, P. & Misztal, A. (eds.). Brill, Vol. 17. (The Study of Time).

    Research output: Chapter in Book/Report/Conference proceedingChapter (peer-reviewed)

  2. Paying per-label attention for multi-label extraction from radiology reports

    Schrempf, P., Watson, H., Mikhael, S., Pajak, M., Falis, M., Lisowska, A., Muir, K. W., Harris-Birtill, D. & O'Neil, A. Q., 2020, Interpretable and Annotation-Efficient Learning for Medical Image Computing: Third International Workshop, iMIMIC 2020, Second International Workshop, MIL3iD 2020, and 5th International Workshop, LABELS 2020, Held in Conjunction with MICCAI 2020, Lima, Peru, October 4–8, 2020, Proceedings. Cardoso, J., Van Nguyen, H., Heller, N., Henriques Abreu, P., Isgum, I., Silva, W., Cruz, R., Pereira Amorim, J., Patel, V., Roysam, B., Zhou, K., Jiang, S., Le, N., Luu, K., Sznitman, R., Cheplygina, V., Mateus, D., Trucco, E. & Abbasi, S. (eds.). Cham: Springer, p. 277-289 13 p. (Lecture Notes in Computer Science (including subseries Image Processing, Computer Vision, Pattern Recognition, and Graphics); vol. 12446 LNCS).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

  3. Smart Homes for elderly to promote their health and wellbeing

    Pirzada, P., Wilde, A. G. & Harris-Birtill, D. C. C., 16 Sep 2019. 1 p.

    Research output: Contribution to conferencePoster

  4. A comparison of level set models in image segmentation

    Rahmat, R. & Harris-Birtill, D., 6 Dec 2018, In : IET Image Processing. 12, 12, p. 2212-2221 11 p.

    Research output: Contribution to journalArticle

  5. ‘Multiplicity embarrasses the eye’: The digital mapping of literary Edinburgh

    Loxley, J., Alex, B., Anderson, M., Hinrichs, U., Grover, C., Harris-Birtill, D., Thomson, T., Quigley, A. & Oberlander, J., 1 Jan 2018, The Routledge Companion to Spatial History. Taylor and Francis, p. 604-628 25 p.

    Research output: Chapter in Book/Report/Conference proceedingChapter

Related by journal

  1. A taxonomy for and analysis of multi-person-display ecosystems

    Terrenghi, L., Quigley, A. & Dix, A., Nov 2009, In : Personal and Ubiquitous Computing. 13, 8, p. 583-598 16 p.

    Research output: Contribution to journalArticle

  2. Special issue on interaction with coupled and public displays

    Quigley, A., Subramanian, S. & Izadi, S., Nov 2009, In : Personal and Ubiquitous Computing. 13, 8, p. 549-550 2 p.

    Research output: Contribution to journalEditorial

  3. MEMENTO: a digital-physical scrapbook for memory sharing

    West, D., Quigley, A. & Kay, J., 2007, In : Personal and Ubiquitous Computing. 11, 4, p. 313-328 16 p.

    Research output: Contribution to journalArticle

  4. Epidemic Messaging Middleware for Ad hoc networks

    Musolesi, M., Mascolo, C. & Hailes, S., 2006, In : Personal and Ubiquitous Computing. 10, 1, p. 28-36 9 p.

    Research output: Contribution to journalArticle

ID: 248040132