note

Investigation of Material Properties for Thermal Imaging-Based Interaction

Authors:

Yomna Abdelrahman,

Alireza Sahami Shirazi,

Albrecht SchmidtAuthors Info & Claims

CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Pages 15 - 18

https://doi.org/10.1145/2702123.2702290

Published: 18 April 2015 Publication History

Abstract

Recent work demonstrated the exciting opportunities that thermal imaging offers for the development of interactive systems. It was shown that a thermal camera can sense when a user touches a surface, performs gestures in the camera's direct field of view and, in addition, performs gestures outside the camera's direct field of view through thermal reflection. In this paper, we investigate the material properties that should be considered for detecting interaction using thermal imaging considering both in- and outdoor settings. We conducted a study to analyze the recognition performance for different gestures and different surfaces. Using the results, we derive guidelines on material properties of surfaces for detecting on-surface as well as mid-air interaction using a thermal camera. We discuss the constrains that should be taken into account using thermal imaging as the sensing technology. Finally, we present a material space based on our findings. The space depicts surfaces and the required properties that enable the different interaction techniques.

Supplementary Material

MP4 File (p15.mp4)

Download
66.11 MB

References

[1]

Anthony, L & Wobbrock, J. A lightweight multistroke recognizer for user interface prototypes. In Proc. GI (2010).

Digital Library

[2]

Cooper, M., Mikic, B., and Yovanovich, M. Thermal contact conductance. International Journal of heat and mass transfer 12, 3 (1969).

[3]

Hilliges, O., Izadi, S., Wilson, A. D., Hodges, S., and et al. Interactions in the air: adding further depth to interactive tabletops. In Proc. UIST (2009).

Digital Library

[4]

Iwai, D., and Sato, K. Heat sensation in image creation with thermal vision. In Proc. ACET (2005).

Digital Library

[5]

Iwai, D., and Sato, K. Limpid desk: see-through access to disorderly desktop in projection-based mixed reality. In Proc. VRST (2006).

Digital Library

[6]

Kane, S. K., Avrahami, D., Wobbrock, J. O., Harrison, B., and et al. Bonfire: a nomadic system for hybrid laptop-tabletop interaction. In Proc. UIST (2009).

Digital Library

[7]

Larson, E., Cohn, G., Gupta, S., Ren, X., Harrison, B., Fox, D., and Patel, S. Heatwave: thermal imaging for surface user interaction. In Proc. CHI (2011).

Digital Library

[8]

Manresa, C., Varona, J., Mas, R., and Perales, F. Hand tracking and gesture recognition for human-computer interaction. ELCVIA 5, 3 (2005).

[9]

Murugappan, S., Vinayak, and et al. Extended multitouch: recovering touch posture and differentiating users using a depth camera. In Proc. UIST (2012).

Digital Library

[10]

Parsons, K. Contact between human skin & hot surfaces equivalent contact temperature. In Proc. ICEE (1992).

[11]

Ray, R. The theory and practice of safe handling temperatures. Applied ergonomics 15, 1 (1984).

[12]

Sahami Shirazi, A., Abdelrahman, Y., Henze, N., and et al. Exploiting thermal reflection for interactive systems. In Proc. CHI (2014).

Digital Library

[13]

Vollmer, M., Henke, S., Karstädt, D., and et al. Identification and suppression of thermal reflections in infrared thermal imaging. In Proc. Inframation (2004).

[14]

Wilson, A. D., and Benko, H. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In Proc. UIST (2010).

Digital Library

[15]

Wobbrock, J. O., Wilson, A. D., and Li, Y. Gestures without libraries, toolkits or training: a recognizer for user interface prototypes. In Proc. UIST (2007).

Digital Library

Cited By

Lee KPark J(2023)Contactless Interface Using Exhaled Breath and Thermal ImagingSensors10.3390/s2307360123:7(3601)Online publication date: 30-Mar-2023
https://doi.org/10.3390/s23073601
Jiang WWang CSarsenbayeva ZIrlitti AWei JKnibbe JDingler TGoncalves JKostakos V(2023)InfoPrintProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109337:3(1-29)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610933
Villa SNiess JSchmidt AWelsch R(2023)Society's Attitudes Towards Human Augmentation and Performance Enhancement Technologies (SHAPE) ScaleProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109157:3(1-23)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610915
Show More Cited By

Index Terms

Investigation of Material Properties for Thermal Imaging-Based Interaction
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Are Thermal Attacks Ubiquitous?: When Non-Expert Attackers Use Off the shelf Thermal Cameras
AVI '20: Proceedings of the 2020 International Conference on Advanced Visual Interfaces

Recent work showed that using image processing techniques on thermal images taken by high-end equipment reveals passwords entered on touchscreens and keyboards. In this paper, we investigate the susceptibility of common touch inputs to thermal attacks ...
Exploiting thermal reflection for interactive systems
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Thermal cameras have recently drawn the attention of HCI researchers as a new sensory system enabling novel interactive systems. They are robust to illumination changes and make it easy to separate human bodies from the image background. Far-infrared ...
Thermal cameras and applications: a survey

Thermal cameras are passive sensors that capture the infrared radiation emitted by all objects with a temperature above absolute zero. This type of camera was originally developed as a surveillance and night vision tool for the military, but recently ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

April 2015

4290 pages

ISBN:9781450331456

DOI:10.1145/2702123

General Chairs:
Bo Begole
Huawei, USA
,
Jinwoo Kim
Yonsei University, Korea
,
Program Chairs:
Kori Inkpen
Microsoft Research, USA
,
Woontack Woo
KAIST, Korea

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Note

Funding Sources

German Research Foundation within the SimTech Cluster of Exc

Conference

CHI '15

Sponsor:

SIGCHI

CHI '15: CHI Conference on Human Factors in Computing Systems

April 18 - 23, 2015

Seoul, Republic of Korea

Acceptance Rates

CHI '15 Paper Acceptance Rate 486 of 2,120 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

29
Total Citations
View Citations
677
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)1

Reflects downloads up to 12 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lee KPark J(2023)Contactless Interface Using Exhaled Breath and Thermal ImagingSensors10.3390/s2307360123:7(3601)Online publication date: 30-Mar-2023
https://doi.org/10.3390/s23073601
Jiang WWang CSarsenbayeva ZIrlitti AWei JKnibbe JDingler TGoncalves JKostakos V(2023)InfoPrintProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109337:3(1-29)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610933
Villa SNiess JSchmidt AWelsch R(2023)Society's Attitudes Towards Human Augmentation and Performance Enhancement Technologies (SHAPE) ScaleProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109157:3(1-23)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610915
Alharbi RShahi SCruz SLi LSen SPedram MRomano CHester JKatsaggelos AAlshurafa N(2023)SmokeMonProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694606:4(1-25)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3569460
Alotaibi NWilliamson JKhamis M(2023)ThermoSecure: Investigating the Effectiveness of AI-Driven Thermal Attacks on Commonly Used Computer KeyboardsACM Transactions on Privacy and Security10.1145/356369326:2(1-24)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3563693
Saad AIzadi KAhmad Khan AKnierim PSchneegass SAlt FAbdelrahman Y(2023)HotFoot: Foot-Based User Identification Using Thermal ImagingProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580924(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580924
Villa SKosch TGrelka FSchmidt AWelsch R(2023)The placebo effect of human augmentationComputers in Human Behavior10.1016/j.chb.2023.107787146:COnline publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1016/j.chb.2023.107787
Jones MVon Feldt MAndrus N(2022)Outside Where? A Survey of Climates and Built Environments in Studies of HCI outdoorsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3507656(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3507656
Zuniga AMotlagh NHoque MTarkoma SFlores HNurmi P(2022)See No Evil: Discovering Covert Surveillance Devices Using Thermal ImagingIEEE Pervasive Computing10.1109/MPRV.2022.318746421:4(33-42)Online publication date: 1-Oct-2022
https://doi.org/10.1109/MPRV.2022.3187464
Dar FEmenike HYin ZLiyanage MSharma RZuniga AHoque MRadeta MNurmi PFlores H(2022)The MIDAS touch: Thermal dissipation resulting from everyday interactions as a sensing modalityPervasive and Mobile Computing10.1016/j.pmcj.2022.10162584(101625)Online publication date: Aug-2022
https://doi.org/10.1016/j.pmcj.2022.101625
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents