abstract

What You Sketch Is What You Get: Quick and Easy Augmented Reality Prototyping with PintAR

Authors:

Danilo Gasques,

Janet G. Johnson,

Tommy Sharkey,

Nadir WeibelAuthors Info & Claims

CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

Paper No.: LBW1416, Pages 1 - 6

https://doi.org/10.1145/3290607.3312847

Published: 02 May 2019 Publication History

Get Access

Abstract

Augmented Reality(AR) tools are currently primarily targeted at programmers, making designing for AR challenging and time-consuming. We developed an interactive prototype, PintAR, that enables the authoring and rapid-prototyping of situated experiences by allowing designers to bring their ideas to life using a digital pen for sketching and a head-mounted display for visualizing and interacting with virtual content. In this paper, we explore the versatility such a tool could provide through case studies of a researcher, an artist, a ballerina, and a clinician.

References

[1]

J. Amores and J. Lanier. Holoart: Painting with holograms in mixed reality. In Proc. CHI 2017, pages 421--424. ACM, 2017.

Digital Library

Google Scholar

[2]

R. Arora, R. Habib Kazi, T. Grossman, G. Fitzmaurice, and K. Singh. Symbiosissketch: Combining 2d & 3d sketching for designing detailed 3d objects in situ. In Proc. CHI 2018, page 185. ACM, 2018.

Digital Library

Google Scholar

[3]

B. Buxton. Sketching user experiences: getting the design right and the right design. Morgan Kaufmann, 2010.

Digital Library

Google Scholar

[4]

M. Gandy and B. MacIntyre. Designer's augmented reality toolkit, ten years later: implications for new media authoring tools. In Proc. UIST 2014, pages 627--636. ACM, 2014.

Digital Library

Google Scholar

[5]

N. Hagbi, R. Grasset, O. Bergig, M. Billinghurst, and J. El-Sana. In-place sketching for content authoring in augmented reality games. 2010.

Google Scholar

[6]

A. J. Hunsucker, K. McClinton, J. Wang, and E. Stolterman. Augmented reality prototyping for interaction design students. In Proc. CHI 2017, pages 1018--1023. ACM, 2017.

Digital Library

Google Scholar

[7]

T. Langlotz, S. Mooslechner, S. Zollmann, C. Degendorfer, G. Reitmayr, and D. Schmalstieg. Sketching up the world: in situ authoring for mobile augmented reality. Personal and ubiquitous computing, 16(6):623--630, 2012.

Digital Library

Google Scholar

[8]

B. MacIntyre, M. Gandy, J. Bolter, S. Dow, and B. Hannigan. Dart: The designer's augmented reality toolkit. In Proc. Symposium on Mixed and Augmented Reality, pages 329--330. IEEE, 2003.

Digital Library

Google Scholar

[9]

R. Stoakley, M. J. Conway, and R. Pausch. Virtual reality on a wim: interactive worlds in miniature. In Proc. CHI 1995, pages 265--272. ACM Press/Addison-Wesley Publishing Co., 1995.

Digital Library

Google Scholar

[10]

B. Yee, Y. Ning, and H. Lipson. Augmented reality in-situ 3d sketching of physical objects. In Intelligent UI workshop on sketch recognition, volume 1. Citeseer, 2009.

Google Scholar

Cited By

View all

Takeyama YNagayama KChoi MShizuki B(2024)PhoneCanvas: 3D Sketching System Using a Depth Camera-Equipped Smartphone as a CanvasProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682078(1-12)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682078
Cho HYan YTodi KParent MSmith MJonker TBenko HLindlbauer D(2024)MineXR: Mining Personalized Extended Reality InterfacesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642394(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642394
Zhang NHuang TLiao H(2024)ARMedicalSketch: Exploring 3D Sketching for Medical Image Using True 2D-3D Interlinked Visualization and InteractionIEEE Transactions on Human-Machine Systems10.1109/THMS.2024.343273554:5(589-598)Online publication date: Oct-2024
https://doi.org/10.1109/THMS.2024.3432735
Show More Cited By

Index Terms

What You Sketch Is What You Get: Quick and Easy Augmented Reality Prototyping with PintAR
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI theory, concepts and models

Recommendations

PintAR: Sketching Spatial Experiences in Augmented Reality
DIS '19 Companion: Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion

In this demo, we present PintAR: an interactive prototyping tool that explores Augmented Reality for the design of interactive spatial experiences. Our system aims to remedy the lack of tools for rapid-prototyping situated experiences in AR without ...
Rapid Prototyping for AR/VR Experiences
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

This course will provide an introduction to techniques for rapid prototyping for Augmented Reality (AR) and Virtual Reality (VR) experiences. With the rise of consumer head mounted displays and powerful mobile phones, AR and VR are becoming increasingly ...
PeriMR: a prototyping tool for head-mounted peripheral light displays in mixed reality
MobileHCI '17: Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services

Nowadays, Mixed and Virtual Reality devices suffer from a field of view that is too small compared to human visual perception. Although a larger field of view is useful (e.g., conveying peripheral information or improving situation awareness), technical ...

Comments

Information & Contributors

Information

Published In

CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

May 2019

3673 pages

ISBN:9781450359719

DOI:10.1145/3290607

General Chairs:
Stephen Brewster
University of Glasgow, Scotland, UK
,
Geraldine Fitzpatrick
TU Wien, Austria
,
Program Chairs:
Anna Cox
University College London, UK
,
Vassilis Kostakos
University of Melbourne, Australia

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

NSF Award 1640909

Conference

CHI '19

Sponsor:

SIGCHI

CHI '19: CHI Conference on Human Factors in Computing Systems

May 4 - 9, 2019

Glasgow, Scotland Uk

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

41
Total Citations
View Citations
1,205
Total Downloads

Downloads (Last 12 months)75
Downloads (Last 6 weeks)10

Reflects downloads up to 12 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Takeyama YNagayama KChoi MShizuki B(2024)PhoneCanvas: 3D Sketching System Using a Depth Camera-Equipped Smartphone as a CanvasProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682078(1-12)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682078
Cho HYan YTodi KParent MSmith MJonker TBenko HLindlbauer D(2024)MineXR: Mining Personalized Extended Reality InterfacesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642394(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642394
Zhang NHuang TLiao H(2024)ARMedicalSketch: Exploring 3D Sketching for Medical Image Using True 2D-3D Interlinked Visualization and InteractionIEEE Transactions on Human-Machine Systems10.1109/THMS.2024.343273554:5(589-598)Online publication date: Oct-2024
https://doi.org/10.1109/THMS.2024.3432735
Ying EXiong TZhu GQiu MQin YGuo S(2024)WristSketcher: Creating 2D Dynamic Sketches in AR With a Sensing WristbandInternational Journal of Human–Computer Interaction10.1080/10447318.2024.230185741:1(557-573)Online publication date: 22-Jan-2024
https://doi.org/10.1080/10447318.2024.2301857
Pallot MFleury SPoussard BRichir S(2023)What are the Challenges and Enabling Technologies to Implement the Do-It-Together Approach Enhanced by Social Media, its Benefits and Drawbacks?Journal of Innovation Economics & Management10.3917/jie.pr1.0132N° 40:1(39-80)Online publication date: 5-Jan-2023
https://doi.org/10.3917/jie.pr1.0132
Lee JJin TLee SLee SBae S(2023)Stereoscopic Viewing and Monoscopic Touching: Selecting Distant Objects in VR Through a Mobile DeviceProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606809(1-7)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606809
Zhang CZhou ZHu YLiu LWu JShao YLiu JZhang LLiu LChen HYing FYao C(2023)Observe It, Draw It: Scaffolding Children’s Observations of Plant Biodiversity with an Interactive Drawing ToolProceedings of the 22nd Annual ACM Interaction Design and Children Conference10.1145/3585088.3589380(253-266)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3585088.3589380
Ye HLeng JXiao CWang LFu H(2023)ProObjAR: Prototyping Spatially-aware Interactions of Smart Objects with AR-HMDProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580750(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580750
Xu PHospedales TYin QSong YXiang TWang L(2023)Deep Learning for Free-Hand Sketch: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2022.314885345:1(285-312)Online publication date: 1-Jan-2023
https://doi.org/10.1109/TPAMI.2022.3148853
Srinivasan LNarasimhalu S(2023)Automatic Sketch Generation for Person Recognition2023 8th International Conference on Signal and Image Processing (ICSIP)10.1109/ICSIP57908.2023.10270833(36-40)Online publication date: 8-Jul-2023
https://doi.org/10.1109/ICSIP57908.2023.10270833
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Cited By

Index Terms

Recommendations

PintAR: Sketching Spatial Experiences in Augmented Reality

Rapid Prototyping for AR/VR Experiences

PeriMR: a prototyping tool for head-mounted peripheral light displays in mixed reality

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Share

Share this Publication link

Share on social media

Affiliations