Skip to content

Research at St Andrews

The visual and beyond: characterizing experiences with auditory, haptic and visual data representations

Research output: Chapter in Book/Report/Conference proceedingConference contribution

DOI

Open Access permissions

Open

Author(s)

Trevor Hogan, Uta Hinrichs, Eva Hornecker

School/Research organisations

Abstract

Research in sonification and physicalization have expanded data representation techniques to include senses beyond the visual. Yet, little is known of how people interpret and make sense of haptic and sonic compared to visual representations. We have conducted two phenomenologically oriented comparative studies (applying the Repertory Grid and the Microphenomenological interview technique) to gather in-depth accounts of people's interpretation and experience of different representational modalities that included auditory, haptic and visual variations . Our findings show a rich characterization of these different representational modalities: our visually oriented representations engage through their familiarity, accuracy and easy interpretation, while our representations that stimulated auditory and haptic interpretation were experienced as more ambiguous, yet stimulated an engaging interpretation of data that involved the whole body. We describe and discuss in detail participants' processes of making sense and generating meaning using the modalities' unique characteristics, individually and as a group. Our research informs future research in the area of multimodal data representations from both a design and methodological perspective.
Close

Details

Original languageEnglish
Title of host publicationProceedings of the 2017 Conference on Designing Interactive Systems (DIS'17)
Place of PublicationNew York
PublisherACM
Pages797-809
ISBN (Print)9781450349222
DOIs
StatePublished - 10 Jun 2017
EventDesigning Interactive Systems - Edinburgh, United Kingdom

Conference

ConferenceDesigning Interactive Systems
Abbreviated titleDIS
CountryUnited Kingdom
CityEdinburgh
Period10/06/1714/06/17
Internet address

    Research areas

  • Qualitative evalutation, Sonification, Physicalization, Phenomenology, Repertory Grid, Micro-phenomenological interview, Data interpretation, Embodiment

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. Synesthetic visualization: balancing sensate experience and sense making in digitized print collections

    Forlini, S. & Hinrichs, U. 14 Jun 2017 Proceedings of the conference on Digital Preservation for Social Sciences and Humanities.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

  2. Let’s get physical: promoting data physicalization in workshop formats

    Huron, S., Gourlet, P., Hinrichs, U., Hogan, T. & Jansen, Y. 10 Jun 2017 Proceedings of the 2017 ACM Conference on Designing Interactive Systems (DIS'17). ACM, 14 p.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

  3. Pedagogy & physicalization: designing learning activities around physical data representations

    Hogan, T., Hinrichs, U., Jansen, Y., Huron, S., Gourlet, P., Hornecker, E. & Nissen, B. 10 Jun 2017 Proceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems (DIS'17). New York: ACM, p. 345-347 3 p.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

  4. Data craft: integrating data into daily practices and shared reflections

    Thudt, A., Hinrichs, U. & Carpendale, S. 7 May 2017 5 p.

    Research output: Contribution to conferencePaper

  5. Bottom-up vs. top-down: trade-offs in efficiency, understanding, freedom and creativity with InfoVis tools

    Mendez, G. G., Hinrichs, U. & Nacenta, M. 2 May 2017 Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. New York: ACM, p. 841-852

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

ID: 249812254