Skip to content

Research at St Andrews

Quantifying gaze and mouse interactions on spatial visual interfaces with a new movement analytics methodology

Research output: Contribution to journalArticle

Abstract

Eye movements provide insights into what people pay attention to, and therefore are commonly included in a variety of human-computer interaction studies. Eye movement recording devices (eye trackers) produce gaze trajectories, that is, sequences of gaze location on the screen. Despite recent technological developments that enabled more affordable hardware, gaze data are still costly and time consuming to collect, therefore some propose using mouse movements instead. These are easy to collect automatically and on a large scale. If and how these two movement types are linked, however, is less clear and highly debated. We address this problem in two ways. First, we introduce a new movement analytics methodology to quantify the level of dynamic interaction between the gaze and the mouse pointer on the screen. Our method uses volumetric representation of movement, the space-time densities, which allows us to calculate interaction levels between two physically different types of movement. We describe the method and compare the results with existing dynamic interaction methods from movement ecology. The sensitivity to method parameters is evaluated on simulated trajectories where we can control interaction levels. Second, we perform an experiment with eye and mouse tracking to generate real data with real levels of interaction, to apply and test our new methodology on a real case. Further, as our experiment tasks mimics route-tracing when using a map, it is more than a data collection exercise and it simultaneously allows us to investigate the actual connection between the eye and the mouse. We find that there seem to be natural coupling when eyes are not under conscious control, but that this coupling breaks down when instructed to move them intentionally. Based on these observations, we tentatively suggest that for natural tracing tasks, mouse tracking could potentially provide similar information as eye-tracking and therefore be used as a proxy for attention. However, more research is needed to confirm this.
Close

Details

Original languageEnglish
Number of pages36
JournalPLoS One
Volume12
Issue number8
DOIs
StatePublished - 4 Aug 2017

    Research areas

  • Human-Computer Interaction, Eye Tracking, Mouse Tracking, Hand-Eye coordination, Movement Analytics, Movement Visualization, Geographic Information Science

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. Activity seascapes highlight central place foraging strategies in marine predators that never stop swimming

    Papastamatiou, Y., Watanabe, Y., Demsar, U., Leos-Barajas, V., Bradley, D., Langrock, R., Weng, K., Lowe, C., Friedlander, A. & Caselle, J. 21 Jun 2018 In : Movement Ecology. 6, 15 p., 9

    Research output: Contribution to journalArticle

  2. Weather effects on human mobility: a study using multi-channel sequence analysis

    Brum-Bastos, V. S., Long, J. A. & Demsar, U. 23 May 2018 In : Computers, Environment and Urban Systems. In press, 22 p.

    Research output: Contribution to journalArticle

  3. Revisiting the past: replicating fifty-year-old flow analysis using contemporary taxi flow data

    Demsar, U., Reades, J., Manley, E. & Batty, M. 2018 In : Annals of the American Association of Geographers. 108, 3, p. 811-828 19 p.

    Research output: Contribution to journalArticle

  4. Using geographically weighted choice models to account for the spatial heterogeneity of preferences

    Budzinski, W., Campbell, D., Czajkowski, M., Demsar, U. & Hanley, N. 29 Dec 2017 In : Journal of Agricultural Economics. Early View

    Research output: Contribution to journalArticle

Related by journal

  1. 16S rRNA gene metabarcoding and TEM reveals different ecological strategies within the genus Neogloboquadrina (planktonic foraminifer)

    Bird, C., Darling, K. F., Russell, A. D., Fehrenbacher, J. S., Davis, C. V., Free, A. & Ngwenya, B. T. 29 Jan 2018 In : PLoS One. 13, 1, 26 p., e0191653

    Research output: Contribution to journalArticle

  2. Autophagic flux blockage by accumulation of weakly basic tenovins leads to elimination of B-Raf mutant tumour cells that survive vemurafenib

    Ladds, M. J. G. W., Pastor-Fernández, A., Popova, G., van Leeuwen, I. M. M., Eng, K. E., Drummond, C. J., Johansson, L., Svensson, R., Westwood, N. J., McCarthy, A. R., Tholander, F., Popa, M., Lane, D. P., McCormack, E., McInerney, G. M., Bhatia, R. & Laín, S. 23 Apr 2018 In : PLoS One. 13, 4, 21 p., e0195956

    Research output: Contribution to journalArticle

  3. Body density of humpback whales (Megaptera novaengliae) in feeding aggregations estimated from hydrodynamic gliding performance

    Narazaki, T., Isojunno, S., Nowacek, D. P., Swift, R., Friedlaender, A. S., Ramp, C., Smout, S., Aoki, K., Deecke, V. B., Sato, K. & Miller, P. J. O. 12 Jul 2018 In : PLoS ONE. 13, 7, 23 p., e0200287

    Research output: Contribution to journalArticle

  4. Context or composition: how does neighbourhood deprivation impact upon adolescent smoking behaviour?

    Morris, T., Manley, D. & van Ham, M. 8 Feb 2018 In : PLoS One. 13, 2, 16 p., e0192566

    Research output: Contribution to journalArticle

  5. Primate social attention: species differences and effects of individual experience in humans, great apes, and macaques

    Kano, F., Shepherd, S. V., Hirata, S. & Call, J. 23 Feb 2018 In : PLoS One. 13, 2, 25 p., e0193283

    Research output: Contribution to journalArticle

Related by journal

  1. PLoS One (Journal)

    Young, S. (Reviewer)
    7 Jun 201719 Jun 2017

    Activity: Publication peer-review and editorial workPeer review of manuscripts

  2. PLoS One (Journal)

    Hughes, D. J. (Reviewer)
    2014 → …

    Activity: Publication peer-review and editorial workPeer review of manuscripts

  3. PLoS One (Journal)

    Smith, T. K. (Member of editorial board)
    2014 → …

    Activity: Publication peer-review and editorial workPeer review of manuscripts

  4. PLoS One (Journal)

    Ozakinci, G. (Editor)
    2013

    Activity: Publication peer-review and editorial workEditor of research journal

  5. PLoS One (Journal)

    Williams, D. J. (Reviewer)
    2013 → …

    Activity: Publication peer-review and editorial workPeer review of manuscripts

ID: 250537402