Skip to content

Research at St Andrews

Quantifying gaze and mouse interactions on spatial visual interfaces with a new movement analytics methodology

Research output: Contribution to journalArticle

DOI

Open Access permissions

Open

Author(s)

Urška Demšar, Arzu Çöltekin

School/Research organisations

Abstract

Eye movements provide insights into what people pay attention to, and therefore are commonly included in a variety of human-computer interaction studies. Eye movement recording devices (eye trackers) produce gaze trajectories, that is, sequences of gaze location on the screen. Despite recent technological developments that enabled more affordable hardware, gaze data are still costly and time consuming to collect, therefore some propose using mouse movements instead. These are easy to collect automatically and on a large scale. If and how these two movement types are linked, however, is less clear and highly debated. We address this problem in two ways. First, we introduce a new movement analytics methodology to quantify the level of dynamic interaction between the gaze and the mouse pointer on the screen. Our method uses volumetric representation of movement, the space-time densities, which allows us to calculate interaction levels between two physically different types of movement. We describe the method and compare the results with existing dynamic interaction methods from movement ecology. The sensitivity to method parameters is evaluated on simulated trajectories where we can control interaction levels. Second, we perform an experiment with eye and mouse tracking to generate real data with real levels of interaction, to apply and test our new methodology on a real case. Further, as our experiment tasks mimics route-tracing when using a map, it is more than a data collection exercise and it simultaneously allows us to investigate the actual connection between the eye and the mouse. We find that there seem to be natural coupling when eyes are not under conscious control, but that this coupling breaks down when instructed to move them intentionally. Based on these observations, we tentatively suggest that for natural tracing tasks, mouse tracking could potentially provide similar information as eye-tracking and therefore be used as a proxy for attention. However, more research is needed to confirm this.
Close

Details

Original languageEnglish
Number of pages36
JournalPLoS One
Volume12
Issue number8
DOIs
StatePublished - 4 Aug 2017

    Research areas

  • Human-Computer Interaction, Eye Tracking, Mouse Tracking, Hand-Eye coordination, Movement Analytics, Movement Visualization, Geographic Information Science

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. Geospatial big data and cartography: research challenges and opportunities for making maps that matter

    Robinson, A. C., Demsar, U., Moore, A. B., Buckley, A., Jiang, B., Field, K., Kraak, M-J., Camboim, S. P. & Sluter, C. R. 13 Mar 2017 In : International Journal of Cartography. Latest Articles

    Research output: Contribution to journalArticle

  2. Analysis of human mobility patterns from GPS trajectories and contextual information

    Sila-Nowicka, K., Vandrol, J., Oshan, T. M., Long, J., Demsar, U. & Fotheringham, S. 30 Oct 2015 In : International Journal of Geographical Information Science. 30, 5, p. 881-906 26 p.

    Research output: Contribution to journalArticle

  3. Analysis and visualisation of movement: an interdisciplinary review

    Demsar, U., Buchin, K., Cagnacci, F., Safi, K., Speckmann, B., Van de Weghe, N., Weiskopf, D. & Weibel, R. 10 Mar 2015 In : Movement Ecology. 3, 5, 24 p.

    Research output: Contribution to journalArticle

Related by journal

  1. Physiological, morphological, and ecological tradeoffs influence vertical habitat use of deep-diving toothed-whales in the Bahamas

    Joyce, T. W., Durban, J. W., Claridge, D. E., Dunn, C. A., Fearnbach, H., Parsons, K. M., Andrews, R. D. & Ballance, L. T. 11 Oct 2017 In : PLoS One. 12, 10, 27 p., e0185113

    Research output: Contribution to journalArticle

  2. Beyond group engagement: multiple pathways from encounters with the police to cooperation and compliance in Northern Ireland

    Pehrson, S., Devaney, L., Bryan, D. & Blaylock, D. L. 7 Sep 2017 In : PLoS One. 12, 9, 20 p., e0184436

    Research output: Contribution to journalArticle

  3. New synthetic lipid antigens for rapid serological diagnosis of tuberculosis

    Jones, A., Pitts, M., Al Dulayymi, J. R., Gibbons, J., Ramsay, A., Goletti, D., Gwenin, C. D. & Baird, M. S. 14 Aug 2017 In : PLoS One. 12, 8, 28 p., e0181414

    Research output: Contribution to journalArticle

Related by journal

  1. PLoS One (Journal)

    Young, S. (Reviewer)
    7 Jun 201719 Jun 2017

    Activity: Publication peer-review and editorial workPeer review of manuscripts

  2. PLoS One (Journal)

    Hughes, D. J. (Reviewer)
    2014 → …

    Activity: Publication peer-review and editorial workPeer review of manuscripts

  3. PLoS One (Journal)

    Smith, T. K. (Member of editorial board)
    2014 → …

    Activity: Publication peer-review and editorial workPeer review of manuscripts

  4. PLoS One (Journal)

    Ozakinci, G. (Editor)
    2013

    Activity: Publication peer-review and editorial workEditor of research journal

  5. PLoS One (Journal)

    Williams, D. J. (Reviewer)
    2013 → …

    Activity: Publication peer-review and editorial workPeer review of manuscripts

ID: 250537402