research-article

ShadowDraw: real-time user guidance for freehand drawing

Authors:

C. Lawrence Zitnick,

Michael F. CohenAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 30, Issue 4

Article No.: 27, Pages 1 - 10

https://doi.org/10.1145/2010324.1964922

Published: 25 July 2011 Publication History

Abstract

We present ShadowDraw, a system for guiding the freeform drawing of objects. As the user draws, ShadowDraw dynamically updates a shadow image underlying the user's strokes. The shadows are suggestive of object contours that guide the user as they continue drawing. This paradigm is similar to tracing, with two major differences. First, we do not provide a single image from which the user can trace; rather ShadowDraw automatically blends relevant images from a large database to construct the shadows. Second, the system dynamically adapts to the user's drawings in real-time and produces suggestions accordingly. ShadowDraw works by efficiently matching local edge patches between the query, constructed from the current drawing, and a database of images. A hashing technique enforces both local and global similarity and provides sufficient speed for interactive feedback. Shadows are created by aggregating the edge maps from the best database matches, spatially weighted by their match scores. We test our approach with human subjects and show comparisons between the drawings that were produced with and without the system. The results show that our system produces more realistically proportioned line drawings.

Supplemental Material

MP4 File

Download
22.11 MB

ZIP File - Supplemental material.

Download
68.36 MB

References

[1]

Arvo, J., and Novins, K. 2000. Fluid sketches: Continuous recognition and morphing of simple hand-drawn shapes. ACM UIST.

Digital Library

[2]

Ballard, D. 1981. Generalizing the hough transform to detect arbitray shapes. In Pattern Recognition, vol. 13, 111--122.

[3]

Beaudot, W., and Mullen, K. 2003. How long range is contour integration in human color vision. In Visual Neuroscience, vol. 15, 51--64.

[4]

Bhat, P., Zitnick, C. L., Cohen, M., and Curless, B. 2009. Gradientshop: A gradient-domain optimization framework for image and video filtering. TOG.

Digital Library

[5]

Canny, J. 1986. A computational approach to edge detection. In TPAMI, vol. 8, 679--698.

Digital Library

[6]

Cao, Y., Wang, H., Wang, C., Li, Z., Zhang, L., and Zhang, L. 2010. Mindfinder: Finding images by sketching. In ACM Multimedia International Conference.

[7]

Carson, C., Belongie, S., Greenspan, H., and Malik, J. 2002. Blobworld: Image segmentation using expectation-maximization and its application to image querying. In TPAMI, vol. 24, 1026--1038.

Digital Library

[8]

Chalechale, A., Naghdy, G., and Mertins, A. 2005. Sketch-based image matching using angular partitioning. IEEE Trans. Systems, Man, and Cybernetics.

Digital Library

[9]

Chaudhuri, S., and Koltun, V. 2010. Data-driven suggestions for creativity support in 3d modeling. ACM SIGGRAPH ASIA.

Digital Library

[10]

Chen, T., Cheng, M.-M., Tan, P., Shamir, A., and Hu, S.-M. 2009. Sketch2photo: Internet image montage. ACM SIGGRAPH ASIA.

Digital Library

[11]

Chum, O., Philbin, J., Sivic, J., Isard, M., and Zisserman, A. 2007. Total recall: Automatic query expansion with a generative feature model for object retrieval. In CVPR.

[12]

Chum, O., Philbin, J., and Zisserman, A. 2008. Near duplicate image detection: min-hash and tf-idf weighting. In BMVC.

[13]

Cole, F., Golovinskiy, A., Limpaecher, A., Barros, H. S., Finkelstein, A., Funkhouser, T., and Rusinkiewicz, S. 2008. Where do people draw lines? SIGGRAPH.

Digital Library

[14]

Datta, R., Joshi, D., Li, J., and Wang, J. Z. 2008. Image retrieval: Ideas, influences, and trends of the new age. In ACM Computing Surveys, vol. 40, 1--60.

Digital Library

[15]

Dixon, D., Prasad, M., and Hammond, T. 2010. icandraw: Using sketch recognition and corrective feedback to assist a user in drawing human faces. ACM CHI.

Digital Library

[16]

Eitz, M., Hildebrand, K., Boubekeur, T., and Alexa, M. 2009. Photosketch: A sketch based image query and compositing system. ACM SIGGRAPH - Talk Program.

Digital Library

[17]

Elder, J., and Goldberg, R. 2001. Image editing in the contour domain. In TPAMI, vol. 23, 291--296.

Digital Library

[18]

Fei-Fei, L., Fergus, R., and Perona, P. 2004. Learning generative visual models from few training examples: an incremental bayesian approach tested on 101 object categories. In Workshop on Generative-Model Based Vision, CVPR.

Digital Library

[19]

Gavilan, D., Saito, S., and Nakajima, M. 2007. Sketch-to-collage. ACM SIGGRAPH - Posters.

Digital Library

[20]

Hays, J., and Efros, A. A. 2007. Scene completion using millions of photographs. ACM SIGGRAPH.

Digital Library

[21]

Hu, R., Barnard, M., and Collomosse, J. 2010. Gradient field descriptor for sketch based retrieval and localization. ICIP.

[22]

Igarashi, T., and Hughes, J. F. 2001. A suggestive interface for 3d drawing. ACM UIST.

Digital Library

[23]

Igarashi, T., Matsuoka, S., and Tanaka, H. 1999. Teddy: A sketching interface for 3d freeform design. ACM SIGGRAPH.

Digital Library

[24]

Jacobs, C. E., Finkelstein, A., and Salesin, D. H. 1995. Fast multiresolution image querying. In SIGGRAPH.

Digital Library

[25]

Lee, D. C., Ke, Q., and Isard, M. 2010. Partition min-hash for partial duplicate image discovery. In ECCV.

Digital Library

[26]

Lowe, D. G. 2004. Distinctive image features from scale-invariant keypoints. IJCV.

Digital Library

[27]

Nister, D., and Stewenius, H. 2006. Scalable recognition with a vocabulary tree. In CVPR.

Digital Library

[28]

Sivic, J., Kaneva, B., Torralba, A., Avidan, S., and Freeman, W. 2008. Creating and exploring a large photorealistic virtual space. In Workshop on Internet Vision, CVPR.

[29]

Winder, S., Hua, G., and Brown, M. 2009. Picking the best daisy. In CVPR.

[30]

Witten, I. H., Moffat, A., and Bell, T. 1999. Managing Gigabytes: Compressing and Indexing Documents and Images. Morgan Kaufmann.

Digital Library

[31]

Zitnick, C. L. 2010. Binary coherent edge descriptors. In ECCV.

Digital Library

Cited By

Kianzad SSeifi H(2024)MagicDraw: Haptic-Assisted One-Line Drawing with Shared ControlAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686753(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686753
Sarukkai VYuan LTang MAgrawala MFatahalian K(2024)Block and Detail: Scaffolding Sketch-to-Image GenerationProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676444(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676444
Wan QHu SZhang YWang PWen BLu Z(2024)"It Felt Like Having a Second Mind": Investigating Human-AI Co-creativity in Prewriting with Large Language ModelsProceedings of the ACM on Human-Computer Interaction10.1145/36373618:CSCW1(1-26)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637361
Show More Cited By

Index Terms

ShadowDraw: real-time user guidance for freehand drawing
1. Applied computing
  1. Document management and text processing
    1. Document capture
      1. Graphics recognition and interpretation
2. Computing methodologies
  1. Computer graphics

Recommendations

ShadowDraw: real-time user guidance for freehand drawing
SIGGRAPH '11: ACM SIGGRAPH 2011 papers

We present ShadowDraw, a system for guiding the freeform drawing of objects. As the user draws, ShadowDraw dynamically updates a shadow image underlying the user's strokes. The shadows are suggestive of object contours that guide the user as they ...
The drawing assistant: automated drawing guidance and feedback from photographs
UIST '13: Proceedings of the 26th annual ACM symposium on User interface software and technology

We present an interactive drawing tool that provides automated guidance over model photographs to help people practice traditional drawing-by-observation techniques. The drawing literature describes a number of techniques to %support this task and help ...
Interactive Cartographic Drawing within the RIA/Silverlight Environment
DMDCM '11: Proceedings of the 2011 Workshop on Digital Media and Digital Content Management

Cartographic drawing from manual work to computer-aided design has made a great achievement. We can interactively draw, edit, manipulate, render geographical map by means of computer drawing applications. These drawing functionalities, up to now, are ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 30, Issue 4

July 2011

829 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/2010324

Issue’s Table of Contents

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 July 2011

Published in TOG Volume 30, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

168
Total Citations
View Citations
4,443
Total Downloads

Downloads (Last 12 months)98
Downloads (Last 6 weeks)19

Reflects downloads up to 16 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kianzad SSeifi H(2024)MagicDraw: Haptic-Assisted One-Line Drawing with Shared ControlAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686753(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686753
Sarukkai VYuan LTang MAgrawala MFatahalian K(2024)Block and Detail: Scaffolding Sketch-to-Image GenerationProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676444(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676444
Wan QHu SZhang YWang PWen BLu Z(2024)"It Felt Like Having a Second Mind": Investigating Human-AI Co-creativity in Prewriting with Large Language ModelsProceedings of the ACM on Human-Computer Interaction10.1145/36373618:CSCW1(1-26)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637361
Ibarrola FLawton TGrace K(2024)A Collaborative, Interactive and Context-Aware Drawing Agent for Co-Creative DesignIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.329385330:8(5525-5537)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1109/TVCG.2023.3293853
Wang JNakano KChen DHuang ZFukusato TMiyata KXie H(2024)A Study on Cognitive Effects of Canvas Size for Augmenting Drawing Skill2024 Nicograph International (NicoInt)10.1109/NICOInt62634.2024.00018(49-53)Online publication date: 14-Jun-2024
https://doi.org/10.1109/NICOInt62634.2024.00018
Li SDu XXie HMiyata K(2024)Interactive Drawing Interface for Aging Anime Face Sketches Using Transformer-Based Generative ModelIEEE Access10.1109/ACCESS.2024.346623012(138751-138762)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3466230
Du XZhang TXie H(2024)DualShape: Sketch-Based 3D Shape Design With Part Generation and RetrievalIEEE Access10.1109/ACCESS.2024.336165912(18888-18900)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3361659
Liu YDai DZou KTan XWu YWang G(2024)Prior semantic-embedding representation learning for on-the-fly FG-SBIRExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.124532255:PAOnline publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1016/j.eswa.2024.124532
Yang LPang KZhang HSong Y(2024)Annotation-Free Human Sketch Quality AssessmentInternational Journal of Computer Vision10.1007/s11263-024-02001-1132:8(2743-2764)Online publication date: 17-Feb-2024
https://doi.org/10.1007/s11263-024-02001-1
PENG YZHAO CXIE HFUKUSATO TMIYATA KIGARASHI T(2023)DualMotion: Global-to-Local Casual Motion Design for Character AnimationsIEICE Transactions on Information and Systems10.1587/transinf.2022IIP0011E106.D:4(459-468)Online publication date: 1-Apr-2023
https://doi.org/10.1587/transinf.2022IIP0011
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents