Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3025453.3025474acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Experimental Evaluation of Sketching on Surfaces in VR

Published: 02 May 2017 Publication History

Abstract

Sketching in immersive 3D virtual reality (VR) environments has great potential for a variety of interactive 3D design applications. Precisely sketching the intended strokes in mid-air, however, can be a challenge. In this paper, we present a set of controlled studies to analyze the factors affecting human ability to sketch freely in a 3D VR environment. In our first study, we directly compare traditional sketching on a physical surface to sketching in VR, with and without a physical surface to rest the stylus on. Our results indicate that the lack of a physical drawing surface is a major cause of inaccuracies in VR drawing, and that the effect is dependent on the orientation of the drawing surface. In a second experiment, we evaluate the extent to which visual guidance can compensate for the loss of sketching precision in VR. We found that while additional visual guidance improves positional accuracy, it can be detrimental to the aesthetic quality of strokes. We conclude by distilling our experimental findings into design guidelines for sketching tools in immersive 3D environments.

Supplementary Material

suppl.mov (pn1107-file3.mp4)
Supplemental video
suppl.mov (pn1107p.mp4)
Supplemental video

References

[1]
W. Abend, E. Bizzi, and P. Morasso. 1982. Human Arm Trajectory Formation. Brain 105, 2: 331--348.
[2]
George J. Andersen, Myron L. Braunstein, and Asad Saidpour. 1998. The perception of depth and slant from texture in three-dimensional scenes. Perception 27, 9: 1087--1106.
[3]
Tom M. Apostol and Mamikon A. Mnatsakanian. 2007. Unwrapping curves from cylinders and cones. American Mathematical Monthly 114, 5: 388--416.
[4]
Seok-Hyung Bae, Ravin Balakrishnan, and Karan Singh. 2008. ILoveSketch: as-natural-as-possible sketching system for creating 3d curve models. Proceedings of the 21st annual ACM symposium on User interface software and technology, ACM, 151--160.
[5]
A. Bair and D. House. 2007. Grid With a View: Optimal Texturing for Perception of Layered Surface Shape. IEEE Transactions on Visualization and Computer Graphics 13, 6: 1656--1663.
[6]
Barbara Bradley. 2003. Drawing People. North Light Books, Cincinnati, Ohio.
[7]
Xiang Cao and Shumin Zhai. 2007. Modeling Human Performance of Pen Stroke Gestures. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07), ACM, 1495--1504.
[8]
Dale J. Cohen and Susan Bennett. 1997. Why can't most people draw what they see? Journal of Experimental Psychology: Human Perception and Performance 23, 3: 609.
[9]
Josh Constine. Oculus "Quill" Turns VR Painting Into Performance Art. TechCrunch. Retrieved September 20, 2016 from http://social.techcrunch.com/2016/01/26/oculus-quill/
[10]
Chris De Paoli and Karan Singh. 2015. SecondSkin: Sketch-based Construction of Layered 3D Models. ACM Trans. Graph. 34, 4: 126:1--126:10.
[11]
C. Donalek, S. G. Djorgovski, A. Cioc, et al. 2014. Immersive and collaborative data visualization using virtual reality platforms. 2014 IEEE International Conference on Big Data (Big Data), 609--614.
[12]
Gerald Farin and Nickolas Sapidis. 1989. Curvature and the Fairness of Curves and Surfaces. IEEE Comput. Graph. Appl. 9, 2: 52--57.
[13]
George W. Fitzmaurice, Ravin Balakrishnan, Gordon Kurtenbach, and Bill Buxton. 1999. An Exploration into Supporting Artwork Orientation in the User Interface. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '99), ACM, 167--174.
[14]
Anthony G. Gallagher, E. Matt Ritter, Howard Champion, et al. 2005. Virtual Reality Simulation for the Operating Room: Proficiency-Based Training as a Paradigm Shift in Surgical Skills Training. Annals of Surgery 241, 2: 364--372.
[15]
Tovi Grossman, Ravin Balakrishnan, Gordon Kurtenbach, George Fitzmaurice, Azam Khan, and Bill Buxton. 2002. Creating Principal 3D Curves with Digital Tape Drawing. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '02), ACM, 121--128.
[16]
Tovi Grossman, Ravin Balakrishnan, and Karan Singh. 2003. An Interface for Creating and Manipulating Curves Using a High Degree-of-freedom Curve Input Device. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03), ACM, 185--192.
[17]
Rorik Henrikson, Bruno De Araujo, Fanny Chevalier, Karan Singh, and Ravin Balakrishnan. 2016. Multidevice storyboards for cinematic narratives in VR. In proceedings of UIST 2016.
[18]
Takeo Igarashi, Satoshi Matsuoka, and Hidehiko Tanaka. 1999. Teddy: A Sketching Interface for 3D Freeform Design. Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '99), ACM Press/AddisonWesley Publishing Co., 409--416.
[19]
Poika Isokoski. 2001. Model for Unistroke Writing Time. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '01), ACM, 357--364.
[20]
J. H. Israel, E. Wiese, M. Mateescu, C. Zöllner, and R. Stark. 2009. Investigating three-dimensional sketching for early conceptual design - Results from expert discussions and user studies. Computers & Graphics 33, 4: 462--473.
[21]
B. Jackson and D. F. Keefe. 2016. Lift-Off: Using Reference Imagery and Freehand Sketching to Create 3D Models in VR. IEEE Transactions on Visualization and Computer Graphics 22, 4: 1442--1451.
[22]
Bret Jackson and Daniel F. Keefe. 2011. Sketching Over Props: Understanding and Interpreting 3D Sketch Input Relative to Rapid Prototype Props. IUI 2011 Sketch Recognition Workshop.
[23]
Peter Karasev, Ivan Kolesov, Karl Fritscher, Patricio Vela, Phillip Mitchell, and Allen Tannenbaum. 2013. Interactive medical image segmentation using PDE control of active contours. IEEE transactions on medical imaging 32, 11: 2127--2139.
[24]
Raghavendra S. Kattinakere, Tovi Grossman, and Sriram Subramanian. 2007. Modeling steering within above-the-surface interaction layers. Proceedings of the SIGCHI conference on Human factors in computing systems, ACM, 317--326.
[25]
Daniel F. Keefe, Daniel Acevedo Feliz, Tomer Moscovich, David H. Laidlaw, and Joseph J. LaViola Jr. 2001. CavePainting: a fully immersive 3D artistic medium and interactive experience. Proceedings of the 2001 symposium on Interactive 3D graphics, ACM, 85--93.
[26]
Daniel F. Keefe and David H. Laidlaw. 2007. Poster: Analysis of Performance in Precise 3D Curve Input Tasks in Virtual Reality. IEEE Visualization (Best Posters Session).
[27]
Daniel Keefe, Robert Zeleznik, and David Laidlaw. 2007. Drawing on air: Input techniques for controlled 3D line illustration. IEEE Transactions on Visualization and Computer Graphics 13, 5: 1067--1081.
[28]
T. Kuehnert, S. Rusdorf, and G. Brunnett. 2011. Virtual Prototyping of Shoes. IEEE Computer Graphics and Applications 31, 5: 30--42.
[29]
Jung-hoon Kwon, Han-wool Choi, Jeong-in Lee, and Young-Ho Chai. 2005. Free-Hand Stroke Based NURBS Surface for Sketching and Deforming 3D Contents. In Advances in Multimedia Information Processing - PCM 2005, Yo-Sung Ho and Hyoung Joong Kim (eds.). Springer Berlin Heidelberg, 315--326.
[30]
James McCrae, Nobuyuki Umetani, and Karan Singh. 2014. FlatFitFab: Interactive Modeling with Planar Sections. Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14), ACM, 13--22.
[31]
J. McCrae and K. Singh. 2008. Sketching piecewise clothoid curves. Proceedings of the Fifth Eurographics conference on Sketch-Based Interfaces and Modeling, Eurographics Association, 1--8.
[32]
Julius Panero and Martin Zelnik. 1979. Human Dimension and Interior Space: A Source Book of Design Reference Standards. Watson-Guptill, New York.
[33]
Emanuel Sachs, Andrew Roberts, and David Stoops. 1991. 3-Draw: A Tool for Designing 3D Shapes. IEEE Comput. Graph. Appl. 11, 6: 18--26.
[34]
Johannes Schmid, Martin Sebastian Senn, Markus Gross, and Robert W. Sumner. 2011. OverCoat: An Implicit Canvas for 3D Painting. ACM SIGGRAPH 2011 Papers (SIGGRAPH '11), ACM, 28:1--28:10.
[35]
Ryan Schmidt, Azam Khan, Gord Kurtenbach, and Karan Singh. 2009. On Expert Performance in 3D Curve-drawing Tasks. Proceedings of the 6th Eurographics Symposium on Sketch-Based Interfaces and Modeling (SBIM '09), ACM, 133--140.
[36]
Shun'ichi Tano, Shinya Yamamoto, Junko Ichino, Tomonori Hashiyama, and Mitsuru Iwata. 2013. Truly Useful 3D Drawing System for Professional Designer by "Life-Sized and Operable" Feature and New Interaction. In Human-Computer Interaction - INTERACT 2013. Springer Berlin Heidelberg, 37--55.
[37]
Yannick Thiel, Karan Singh, and Ravin Balakrishnan. 2011. Elasticurves: exploiting stroke dynamics and inertia for the real-time neatening of sketched 2D curves. Proceedings of the 24th annual ACM symposium on User interface software and technology, ACM, 383--392.
[38]
P. Viviani and C. Ternuolo. 1982. Trajectory Determines Movement Dynamics. Neuroscience 7, 2: 431--7.
[39]
Gerold Wesche and Hans-Peter Seidel. 2001. FreeDrawer: a free-form sketching system on the responsive workbench. ACM Press, 167.
[40]
Eva Wiese, Johann Habakuk Israel, Achim Meyer, and Sara Bongartz. 2010. Investigating the learnability of immersive free-hand sketching. Proceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium, Eurographics Association, 135--142.
[41]
Baoxuan Xu, William Chang, Alla Sheffer, Adrien Bousseau, James McCrae, and Karan Singh. 2014. True2Form: 3D Curve Networks from 2D Sketches via Selective Regularization. ACM Trans. Graph. 33, 4: 131:1--131:13.
[42]
Youyi Zheng, Han Liu, Julie Dorsey, and Niloy J. Mitra. 2016. SmartCanvas: Context-inferred Interpretation of Sketches for Preparatory Design Studies. Computer Graphics Forum, Wiley Online Library, 37--48.
[43]
Tilt Brush by Google. Retrieved January 8, 2017 from https://www.tiltbrush.com/
[44]
PaintLab VR - Paint and Sculpt in Virtual Reality. PaintLab VR. Retrieved September 20, 2016 from http://paintlabvr.com
[45]
DesignSpace. Retrieved September 20, 2016 from http://www.designspacevr.com/
[46]
Tvori - Anyone Can Tell a Story. Retrieved September 20, 2016 from http://tvori.co
[47]
Virtual Art Sessions. Retrieved September 20, 2016 from https://virtualart.chromeexperiments.com/

Cited By

View all
  • (2024)Exploring the Impact of VR Scaffolding on EFL Teaching and Learning: Anxiety Reduction, Perceptions, and Influencing FactorsMultimodal Technologies and Interaction10.3390/mti81000858:10(85)Online publication date: 27-Sep-2024
  • (2024)Interactive Modelling in Augmented Reality with Subdivision Surfaces and Advanced User Gesture RecognitionApplied Sciences10.3390/app14241187314:24(11873)Online publication date: 19-Dec-2024
  • (2024)VRCreatIn: Taking In-Situ Pen and Tablet Interaction Beyond Ideation to 3D Modeling Lighting and TexturingProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701580(24-35)Online publication date: 1-Dec-2024
  • Show More Cited By

Index Terms

  1. Experimental Evaluation of Sketching on Surfaces in VR

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
    May 2017
    7138 pages
    ISBN:9781450346559
    DOI:10.1145/3025453
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 May 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. 3d drawing
    2. motor ability
    3. virtual reality
    4. visual factors

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    CHI '17
    Sponsor:

    Acceptance Rates

    CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;
    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)231
    • Downloads (Last 6 weeks)11
    Reflects downloads up to 13 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Exploring the Impact of VR Scaffolding on EFL Teaching and Learning: Anxiety Reduction, Perceptions, and Influencing FactorsMultimodal Technologies and Interaction10.3390/mti81000858:10(85)Online publication date: 27-Sep-2024
    • (2024)Interactive Modelling in Augmented Reality with Subdivision Surfaces and Advanced User Gesture RecognitionApplied Sciences10.3390/app14241187314:24(11873)Online publication date: 19-Dec-2024
    • (2024)VRCreatIn: Taking In-Situ Pen and Tablet Interaction Beyond Ideation to 3D Modeling Lighting and TexturingProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701580(24-35)Online publication date: 1-Dec-2024
    • (2024)VRPaperCrafting: Exploring Child-Friendly Paper Crafting in Virtual Environments using Physical Proxies and Hand GesturesProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685379(1-13)Online publication date: 13-Oct-2024
    • (2024)3D Flight Planning Using Extended RealityProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682088(1-10)Online publication date: 7-Oct-2024
    • (2024)LoopBot: Representing Continuous Haptics of Grounded Objects in Room-scale VRProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676389(1-10)Online publication date: 13-Oct-2024
    • (2024)Enhancing VR Sketching with a Dynamic Shape DisplayProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687714(1-11)Online publication date: 9-Oct-2024
    • (2024)Bimanual Interactions for Surfacing Curve Networks in VRExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650988(1-7)Online publication date: 11-May-2024
    • (2024)Demonstrating VRScroll: A Shape-Changing Device for Precise Sketching in Virtual RealityExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3648662(1-5)Online publication date: 11-May-2024
    • (2024)An Artists' Perspectives on Natural Interactions for Virtual Reality 3D SketchingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642758(1-20)Online publication date: 11-May-2024
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media