Abstract
Wartegg Test is a drawing completion task designed to reflect the personal characteristics of the testers. A complete Wartegg Test has eight 4 cm \(\times \) 4 cm boxes with a printed hint in each of them. The tester will be required to use pencil to draw eight pictures in the boxes after they saw these printed hints. In recent years the trend of utilizing high-speed hardware and deep learning based model for object detection makes it possible to recognize hand-drawn objects from images. However, recognizing them is not an easy task, like other hand-drawn images, the Wartegg images are abstract and diverse. Also, Wartegg Test images are multi-object images, the number of objects in one image, their distribution and size are all unpredictable. These factors make the recognition task on Wartegg Test images more difficult. In this paper, we present a complete framework including PCC (Pearson’s Correlation Coefficient) to extract lines and curves, SLIC for the selection of feature key points, DBSCAN for object cluster, and finally YoloV3-SPP model for detecting shapes and objects. Our system produced an accuracy of 87.9\(\%\) for one object detection and 75\(\%\) for multi-object detection which surpass the previous results by a wide margin.
Supported by CENPARMI & NSERC.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Süsstrunk, S.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012). https://doi.org/10.1109/TPAMI.2012.120
Donati, L., Cesano, S., Prati, A.: A complete hand-drawn sketch vectorization framework. Multimed. Tools Appl. 78(14), 19083–19113 (2019). https://doi.org/10.1007/s11042-019-7311-3
Eitz, M., Hildebrand, K., Boubekeur, T., Alexa, M.: Sketch-based image retrieval: benchmark and bag-of-features descriptors. IEEE Trans. Vis. Comput. Graph. 17(11), 1624–1636 (2011)
Ester, M., Kriegel, H.P., Sander, J., Xu, X., et al.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: KDD, vol. 96, pp. 226–231 (1996)
Ha, D., Eck, D.: A neural representation of sketch drawings. In: International Conference on Learning Representations (2018)
He, J.Y., Wu, X., Jiang, Y.G., Zhao, B., Peng, Q.: Sketch recognition with deep visual-sequential fusion model. In: Proceedings of the 25th ACM International Conference on Multimedia, pp. 448–456 (2017)
He, K., Zhang, X., Ren, S., Sun, J.: Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans. Pattern Anal. Mach. Intell. 37(9), 1904–1916 (2015). https://doi.org/10.1109/TPAMI.2015.2389824
Li, K., et al.: Universal sketch perceptual grouping. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11212, pp. 593–609. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01237-3_36
Liu, L., Pettinati, G., Suen, C.Y.: Computer-aided Wartegg drawing completion test. In: Lu, Y., Vincent, N., Yuen, P.C., Zheng, W.-S., Cheriet, F., Suen, C.Y. (eds.) ICPRAI 2020. LNCS, vol. 12068, pp. 575–580. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-59830-3_50
Ly, N.T., Liu, L., Suen, C.Y., Nakagawa, M.: Hand-drawn object detection for scoring Wartegg Zeichen test. In: Lu, Y., Vincent, N., Yuen, P.C., Zheng, W.-S., Cheriet, F., Suen, C.Y. (eds.) ICPRAI 2020. LNCS, vol. 12068, pp. 109–114. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-59830-3_9
Nguyen, N.-D., Do, T., Ngo, T.D., Le, D.-D.: An evaluation of deep learning methods for small object detection. J. Electr. Comput. Eng. 2020, 1–18 (2020). https://doi.org/10.1155/2020/3189691. Article ID 3189691
Redmon, J., Farhadi, A.: YOLOv3: an incremental improvement. arXiv (2018)
Sangkloy, P., Burnell, N., Ham, C., Hays, J.: The sketchy database: learning to retrieve badly drawn bunnies. ACM Trans. Graph. (TOG) 35(4), 1–12 (2016)
Wang, F., et al.: Multi-column point-CNN for sketch segmentation. Neurocomputing 392, 50–59 (2020)
Wartegg, E.: Gestaltung und charakter. ausdrucksdeutung zeichnerischer gestaltung und entwurf einer charakterologischen typologie (1939)
Xu, P., Hospedales, T.M., Yin, Q., Song, Y.-Z., Xiang, T., Wang, L.: Deep learning for free-hand sketch: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 1. https://doi.org/10.1109/TPAMI.2022.3148853.
Xu, P., et al.: SketchMate: deep hashing for million-scale human sketch retrieval. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 8090–8098 (2018)
Yu, Q., Yang, Y., Liu, F., Song, Y.Z., Xiang, T., Hospedales, T.M.: Sketch-a-net: a deep neural network that beats humans. Int. J. Comput. Vis. 122(3), 411–425 (2017). https://doi.org/10.1007/s11263-016-0932-3
Zhang, P., Zhong, Y., Li, X.: SlimYOLOv3: narrower, faster and better for real-time UAV applications. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops, October 2019
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Xu, Y., Suen, C.Y. (2022). Recognition of Graphological Wartegg Hand-Drawings. In: Carmona-Duarte, C., Diaz, M., Ferrer, M.A., Morales, A. (eds) Intertwining Graphonomics with Human Movements. IGS 2022. Lecture Notes in Computer Science, vol 13424. Springer, Cham. https://doi.org/10.1007/978-3-031-19745-1_13
Download citation
DOI: https://doi.org/10.1007/978-3-031-19745-1_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-19744-4
Online ISBN: 978-3-031-19745-1
eBook Packages: Computer ScienceComputer Science (R0)