demonstration

ThermalPen: Adding Thermal Haptic Feedback to 3D Sketching

Authors:

Philipp Pascal Hoffmann,

Hesham Elsayed,

Max Mühlhäuser,

Mayra Donaji Barrera MachucaAuthors Info & Claims

CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

Article No.: 474, Pages 1 - 4

https://doi.org/10.1145/3544549.3583901

Published: 19 April 2023 Publication History

Abstract

Sketching in virtual 3D environments has enabled new forms of artistic expression and a variety of novel design use-cases. However, the lack of haptic feedback proves to be one of the main challenges in this field. While prior work has investigated vibrotactile and force-feedback devices, this paper proposes the addition of thermal feedback. We present ThermalPen, a novel pen for 3D sketching that associates the texture and colour of strokes with different thermal properties. For example, a fire texture elicits an increase in temperature, while an ice texture causes a temperature drop in the pen. Our goal with ThermalPen is to enhance the 3D sketching experience and allow users to use this tool to increase their creativity while sketching. We plan on evaluating the influence of thermal feedback on the 3D sketching experience, with a focus on user creativity in the future.

Supplementary Material

MP4 File (3544549.3583901-walkthrough.mp4)

Walkthrough Video

Download
133.12 MB

MP4 File (3544549.3583901-preview.mp4)

Video Preview

Download
52.72 MB

References

[1]

R. Arora, M. D. Barrera Machuca, P. Wacker, D. Keefe, and J. H. Israel. in print. Introduction to 3D Sketching. In Interactive Sketch-Based Interfaces and Modelling for Design, Alexandra Bonniciand Kenneth P. Camilleri (Eds.). River Series in Document Engineering, 9260 Gistrup, Denmark, Chapter 6, 143–161.

[2]

Rahul Arora, Rubaiat Habib Kazi, Tovi Grossman, George Fitzmaurice, and Karan Singh. 2018. SymbiosisSketch: Combining 2D & 3D Sketching for Designing Detailed 3D Objects in Situ. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). ACM, New York, NY, USA, Article 185, 15 pages. https://doi.org/10.1145/3173574.3173759

Digital Library

[3]

Emilia Djonov and Theo Van Leeuwen. 2011. The semiotics of texture: from tactile to visual. Visual Communication 10, 4 (2011), 541–564. https://doi.org/10.1177/1470357211415786 arXiv:https://doi.org/10.1177/1470357211415786

[4]

Tomás Dorta, Gokce Kinayoglu, and Michael Hoffmann. 2016. Hyve-3D and the 3D Cursor: Architectural co-design with freedom in Virtual Reality. International Journal of Architectural Computing 14, 2 (2016), 87–102. https://doi.org/10.1177/1478077116638921 arXiv:https://doi.org/10.1177/1478077116638921

[5]

Hesham Elsayed, Mayra Donaji Barrera Machuca, Christian Schaarschmidt, Karola Marky, Florian Müller, Jan Riemann, Andrii Matviienko, Martin Schmitz, Martin Weigel, and Max Mühlhäuser. 2020. VRSketchPen: Unconstrained Haptic Assistance for Sketching in Virtual 3D Environments. In Proceedings of the 26th ACM Symposium on Virtual Reality Software and Technology (Virtual Event, Canada) (VRST ’20). Association for Computing Machinery, New York, NY, USA, Article 3, 11 pages. https://doi.org/10.1145/3385956.3418953

Digital Library

[6]

S Kamuro, K Minamizawa, and S Tachi. 2011. 3D Haptic Modeling System Using Ungrounded Pen-Shaped Kinesthetic Display. In Proceedings of the 2011 IEEE Virtual Reality Conference(VR ’11). IEEE Computer Society, USA, 217–218. https://doi.org/10.1109/VR.2011.5759476

Digital Library

[7]

D. Keefe, R. Zeleznik, and D. Laidlaw. 2007. Drawing on Air: Input Techniques for Controlled 3D Line Illustration. IEEE Transactions on Visualization and Computer Graphics 13, 5 (Sep. 2007), 1067–1081. https://doi.org/10.1109/TVCG.2007.1060

Digital Library

[8]

D. F. Keefe, R. C. Zeleznik, and D. H. Laidlaw. 2008. Tech-note: Dynamic dragging for input of 3D trajectories. In 2008 IEEE Symposium on 3D User Interfaces. IEEE, New York, USA, 51–54.

Digital Library

[9]

Yongkwan Kim, Sang-Gyun An, Joon Hyub Lee, and Seok-Hyung Bae. 2018. Agile 3D Sketching with Air Scaffolding. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173812

Digital Library

[10]

Johann P Kuhtz-Buschbeck, Wiebke Andresen, Stephan Göbel, René Gilster, and Carsten Stick. 2010. Thermoreception and nociception of the skin: a classic paper of Bessou and Perl and analyses of thermal sensitivity during a student laboratory exercise. Advances in physiology education 34, 2 (2010), 25–34.

[11]

Kin Chung Kwan and Hongbo Fu. 2019. Mobi3DSketch: 3D Sketching in Mobile AR. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). ACM, New York, NY, USA, Article 176, 11 pages. https://doi.org/10.1145/3290605.3300406

Digital Library

[12]

Ronak R. Mohanty, Ricardo M. Castillo, Eric D. Ragan, and Vinayak R. Krishnamurthy. 2019. Investigating Force-Feedback in Mid-Air Sketching of Multi-Planar Three-Dimensional Curve-Soups. Journal of Computing and Information Science in Engineering 20, 1 (10 2019), 11 pages. https://doi.org/10.1115/1.4045142 arXiv:https://asmedigitalcollection.asme.org/computingengineering/article-pdf/20/1/011010/6437380/jcise_20_1_011010.pdf011010.

[13]

Samuel B. Schorr and Allison M. Okamura. 2017. Fingertip Tactile Devices for Virtual Object Manipulation and Exploration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3115–3119. https://doi.org/10.1145/3025453.3025744

Digital Library

[14]

Scott Snibbe, Sean Anderson, Bill Verplank, Page Mill Road, Building C, and Palo Alto. 1998. Springs and Constraints for 3D Drawing. Artificial Intelligence 3 (1998), 4 pages.

[15]

Paul Strohmeier, Sebastian Boring, and Kasper Hornbæk. 2018. From Pulse Trains to "Coloring with Vibrations": Motion Mappings for Mid-Air Haptic Textures. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3173639

Digital Library

Cited By

Fender AKari M(2024)OptiBasePen: Mobile Base+Pen Input on Passive Surfaces by Sensing Relative Base Motion Plus Close-Range Pen PositionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676467(1-9)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676467
Shen XKamiyama YMinamizawa KNishida J(2024)DexteriSync: A Hand Thermal I/O Exoskeleton for Morphing Finger Dexterity ExperienceProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676422(1-12)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676422
Hoffmann PWehbe RMühlhäuser MBarrera Machuca M(2024)ThermalPen: Investigating the Influence of Thermal Haptic Feedback for Creativity in 3D SketchingProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656191(661-673)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656191
Show More Cited By

Index Terms

ThermalPen: Adding Thermal Haptic Feedback to 3D Sketching
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices
    2. Interaction paradigms
      1. Virtual reality

Recommendations

Therminator: Understanding the Interdependency of Visual and On-Body Thermal Feedback in Virtual Reality
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Recent advances have made Virtual Reality (VR) more realistic than ever before. This improved realism is attributed to today's ability to increasingly appeal to human sensations, such as visual, auditory or tactile. While research also examines ...
VRSketchPen: Unconstrained Haptic Assistance for Sketching in Virtual 3D Environments
VRST '20: Proceedings of the 26th ACM Symposium on Virtual Reality Software and Technology

Accurate sketching in virtual 3D environments is challenging due to aspects like limited depth perception or the absence of physical support. To address this issue, we propose VRSketchPen – a pen that uses two haptic modalities to support virtual ...
ThermalPen: Investigating the Influence of Thermal Haptic Feedback for Creativity in 3D Sketching
C&C '24: Proceedings of the 16th Conference on Creativity & Cognition

This paper presents ThermalPen, a novel device for 3D sketching that utilizes thermal feedback to allow users to feel the materiality of their sketches. The pen lets users draw using six colors and three textures mapped to different temperatures. Our ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

April 2023

3914 pages

ISBN:9781450394222

DOI:10.1145/3544549

Editors:
Albrecht Schmidt
LMU Munich, Germany
,
Kaisa Väänänen
Tampere University, Finland
,
Tesh Goyal
Google Research, USA
,
Per Ola Kristensson
University of Cambridge, UK
,
Anicia Peters
University of Namibia, Namibia

Copyright © 2023 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 April 2023

Check for updates

Author Tags

Qualifiers

Demonstration
Research
Refereed limited

Funding Sources

Natural Sciences and Engineering Research Council of Canada

Conference

CHI '23

Sponsor:

SIGCHI

CHI '23: CHI Conference on Human Factors in Computing Systems

April 23 - 28, 2023

Hamburg, Germany

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
293
Total Downloads

Downloads (Last 12 months)161
Downloads (Last 6 weeks)19

Reflects downloads up to 11 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Fender AKari M(2024)OptiBasePen: Mobile Base+Pen Input on Passive Surfaces by Sensing Relative Base Motion Plus Close-Range Pen PositionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676467(1-9)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676467
Shen XKamiyama YMinamizawa KNishida J(2024)DexteriSync: A Hand Thermal I/O Exoskeleton for Morphing Finger Dexterity ExperienceProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676422(1-12)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676422
Hoffmann PWehbe RMühlhäuser MBarrera Machuca M(2024)ThermalPen: Investigating the Influence of Thermal Haptic Feedback for Creativity in 3D SketchingProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656191(661-673)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656191
Rodriguez RSullivan BBarrera Machuca MBatmaz ATornatzky COrtega F(2024)An Artists' Perspectives on Natural Interactions for Virtual Reality 3D SketchingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642758(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642758
Afzaal HAlim U(2024)Evaluating Force-Based Haptics for Immersive Tangible Interactions with Surface VisualizationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345631631:1(886-896)Online publication date: 10-Sep-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456316

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View full text|Download PDF

View Table of Contents