Skip to content

Research at St Andrews

SpeCam: sensing surface color and material with the front-facing camera of mobile device

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Author(s)

Hui Shyong Yeo, Juyoung Lee, Andrea Bianchi, David Harris-Birtill, Aaron John Quigley

School/Research organisations

Abstract

SpeCam is a lightweight surface color and material sensing approach for mobile devices which only uses the front-facing camera and the display as a multi-spectral light source. We leverage the natural use of mobile devices (placing it face-down) to detect the material underneath and therefore infer the location or placement of the device. SpeCam can then be used to support discreet micro-interactions to avoid the numerous distractions that users daily face with today's mobile devices. Our two-parts study shows that SpeCam can i) recognize colors in the HSB space with 10 degrees apart near the 3 dominant colors and 4 degrees otherwise and ii) 30 types of surface materials with 99% accuracy. These findings are further supported by a spectroscopy study. Finally, we suggest a series of applications based on simple mobile micro-interactions suitable for using the phone when placed face-down.
Close

Details

Original languageEnglish
Title of host publicationProceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '17)
Place of PublicationNew York, NY
PublisherACM
Pages1-9
Number of pages9
ISBN (Print)9781450350754
DOIs
Publication statusPublished - 4 Sep 2017
Event19th International Conference on Human-Computer Interaction with Mobile Devices and Services - Aula der Wissenschaft – Hall of Science, Vienna, Austria
Duration: 4 Sep 20177 Sep 2017
Conference number: 19
https://mobilehci.acm.org/2017/index.html

Conference

Conference19th International Conference on Human-Computer Interaction with Mobile Devices and Services
Abbreviated titleMobileHCI
CountryAustria
CityVienna
Period4/09/177/09/17
Internet address

    Research areas

  • Surface detection, Material detection, Discreet interaction

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. Understanding computation time: a critical discussion of time as a computational performance metric

    Harris-Birtill, D. & Harris-Birtill, R., 3 Aug 2020, (Accepted/In press) Time in variance: the study of time. Parker, J., Harris, P. & Misztal, A. (eds.). Brill, Vol. 17. (The Study of Time).

    Research output: Chapter in Book/Report/Conference proceedingChapter (peer-reviewed)peer-review

  2. Autofocus Net: Auto-focused 3D CNN for Brain Tumour Segmentation.

    Stefani, A., Rahmat, R. & Harris-Birtill, D. C. C., 8 Jul 2020, In Annual Conference on Medical Image Understanding and Analysis: Part of the Communications in Computer and Information Science book series (CCIS). Springer, Vol. 1248. p. 43-55 13 p.

    Research output: Chapter in Book/Report/Conference proceedingChapter (peer-reviewed)peer-review

  3. Paying per-label attention for multi-label extraction from radiology reports

    Schrempf, P., Watson, H., Mikhael, S., Pajak, M., Falis, M., Lisowska, A., Muir, K. W., Harris-Birtill, D. & O'Neil, A. Q., 2020, Interpretable and Annotation-Efficient Learning for Medical Image Computing: Third International Workshop, iMIMIC 2020, Second International Workshop, MIL3iD 2020, and 5th International Workshop, LABELS 2020, Held in Conjunction with MICCAI 2020, Lima, Peru, October 4–8, 2020, Proceedings. Cardoso, J., Van Nguyen, H., Heller, N., Henriques Abreu, P., Isgum, I., Silva, W., Cruz, R., Pereira Amorim, J., Patel, V., Roysam, B., Zhou, K., Jiang, S., Le, N., Luu, K., Sznitman, R., Cheplygina, V., Mateus, D., Trucco, E. & Abbasi, S. (eds.). Cham: Springer, p. 277-289 13 p. (Lecture Notes in Computer Science (including subseries Image Processing, Computer Vision, Pattern Recognition, and Graphics); vol. 12446 LNCS).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

  4. Smart Homes for elderly to promote their health and wellbeing

    Pirzada, P., Wilde, A. G. & Harris-Birtill, D. C. C., 16 Sep 2019. 1 p.

    Research output: Contribution to conferencePosterpeer-review

  5. A comparison of level set models in image segmentation

    Rahmat, R. & Harris-Birtill, D., 6 Dec 2018, In: IET Image Processing. 12, 12, p. 2212-2221 11 p.

    Research output: Contribution to journalArticlepeer-review

ID: 249811373

Top