Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
Springer Nature Link
Log in

Easy-to-use virtual brick manipulation techniques using hand gestures

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Nowadays, LEGO may be regarded as the best toys that ever existed. It not only appeals to people of all ages, but also encourages creativity and innovation. The popularity of LEGO entails the introduction of a range of computer applications that simulate this toy. However, assembling by mouse and keyboard is not more interesting than playing a real LEGO toy. Recently, with the development of interactive virtual reality technology, many novel acquisition devices like Leap Motion and Kinect have been introduced which allow the user to control the device without touching the keyboard, the mouse, or the screen. In this paper, we present a VR application that simulates a real LEGO toy, and players can interact with this application via Leap Motion device. In other words, the player can use both hands to control the in-game objects including LEGO bricks, game camera, and even GUI. Also, we propose a set of gestures which enable the user to perform and memorize easily.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Vanus J, Smolon M, Martinek R, Koziorek J, Zidek J, Bilik P (2015) Testing of the voice communication in smart home care. Human-centric Comput Inf Sci 5(15). doi:10.1186/s13673-015-0035-0

  2. Lee Jeong Kyu, Kang Won Min, Park Jong Hyuk, Kim Jae Soo (2014) GWD: gesture-based wearable device for secure and effective information exchange on battlefield environment. J Converg 5(4):6–10

    Google Scholar 

  3. Chagnaadorj Oyuntungalag, Tanaka Jiro (2014) Gesture Input as an Out-of-band Channel. J Inf Process Syst 10(1):92–102. doi:10.3745/JIPS.2014.10.1.092

    Article  Google Scholar 

  4. Hongzhe L, Yulong X, Wei S, Kyhyun U, Kyungeun C (2013) Gesture-based NUI application for real-time path modification. In: Proceding of the 11th IEEE international conference on dependable, autonomic and secure computing, DASC 2013, pp 446–449. doi:10.1109/DASC.2013.104

  5. Bassily D, Georgoulas C, Guettler J, Linner T, Bock T (2014) Intuitive and Adaptive Robotic Arm Manipulation using the Leap Motion Controller. In: Proceeding of the 41st International Symposium on Robotics, ISR/Robotik 2014, pp 1–7

  6. Wu J, Konrad J, Ishwar P (2013) Dynamic time warping for gesture-based user identification and authentication with Kinect. In: Proceeding of the IEEE international conference on acoustics, speech and signal processing, ICASSP 2013:2371–2375. doi:10.1109/ICASSP.2013.6638079

  7. Guan-Feng H, Sun-Kyung K, Won-Chang S, Sung-Tae J (2011) Real-time gesture recognition using 3D depth camera. In: Proceeding of the 2nd IEEE international conference on software engineering and service science, ICSESS 2011, pp 187–190. doi:10.1109/ICSESS.2011.5982286

  8. Kenneth S, Christian S, Bruce T, Sean I. O’Donoghue (2013) The Molecular Control Toolkit: controlling 3D molecular graphics via gesture and voice. In: Proceeding of the IEEE symposium on biological data visualization, BioVis 2013, pp 49–56. doi:10.1109/BioVis.2013.6664346

  9. Shen J, Luo Y, Wang X, Zhongke W, Zhou M (2014) GPU-Based real-time hand gesture interaction and rendering for volume datasets using leap motion. In: Proceeding of the international conference on cyberworlds, CW 2014:85–92. doi:10.1109/CW.2014.20

  10. Zainal Azmi N (2014) A Natural Interface for 3D Manipulation. University of Otago, New Zealand

  11. Raheja JL, Chaudhary A, Singal K (2011) Tracking of fingertips and centers of palm using Kinect. In: Proceeding of the third international conference on computational intelligence, modelling and simulation, CIMSiM 2011, pp 248–252. doi:10.1109/CIMSim.2011.51

  12. Li Yi (2012) Multi-scenario Gesture Recognition Using Kinect. In: Proceeding of the 17th international conference on computer games, CGAMES 2012, pp 126-130, doi: 10.1109/CGames.2012.6314563

  13. Marin G, Dominio F, Zanuttigh P (2014) Hand gesture recognition with Leap Motion and Kinect devices. In: Proceeding of the IEEE international conference on image processing, ICIP 2014:1565–1569. doi:10.1109/ICIP.2014.7025313

  14. Bacim F, Nabiyouni, Mahdi, Bowman Doug A (2014) Slice-n-Swipe: A Free-Hand Gesture User Interface for 3D Point Cloud Annotation. In: Proceeding of the IEEE Symposium on 3D user interfaces, 3DUI 2014, pp 185–186, doi:10.1109/3DUI.2014.6798882

  15. Daniel M, Alfredo F (2011) Virtual LEGO modelling on multi-touch surfaces. In: Proceeding of the 19th international conference in central Europe on computer graphics, visualization and computer vision in cooperation with EUROGRAPHICS association, WSCG 2011, pp 73–80

  16. Zhou R, Jingjing M, Junsong Y (2011) Depth camera based hand gesture recognition and its applications in human-computer-interaction. In: Proceeding of the 8th international conference on information communications and signal processing, ICICS 2011, pp 1–5. doi:10.1109/ICICS.2011.6173545

  17. Rautaray Siddharth S, Agrawal Anupam (2012) Design of Gesture Recognition System for Dynamic User Interface. In: Proceeding of the IEEE international conference on technology enhanced education, ICTEE 2012:1–6. doi:10.1109/ICTEE.2012.6208628

  18. Yingying S, Qian W, Yunzhe J, Ting G, Qun H, Baorong Y (2014) A real-time hand gesture recognition approach based on motion features of feature points. In: Proceeding of the 17th IEEE international conference on computational science and engineering, CSE 2014, pp 1096–1102. doi:10.1109/CSE.2014.216

  19. Huang P-K, Lin T-Y, Lin H-T, Wu C-H, Hsiao C-C, Liao C-K, Lemmens P (2012) Real-time stereo matching for 3D hand gesture recognition. In: Proceeding of the international conference on SoC design, ISOCC 2012:29–32. doi:10.1109/ISOCC.2012.6406917

  20. Mitra S, Acharya T (2007) Gesture recognition: a survey. IEEE Trans Syst Man Cybernet Part C Appl Rev 37(3):311–324. doi:10.1109/TSMCC.2007.893280

    Article  Google Scholar 

  21. Rethinking Menu Design in the Natural Interface Wild West: http://blog.leapmotion.com/42/. Accessed 15 July 2015

  22. Leap motion: https://www.leapmotion.com/. Accessed 15 July 2015

  23. Build with Chrome: https://www.buildwithchrome.com/. Accessed 15 July 2015

  24. Unity3D. https://unity3d.com/. Accessed 15 July 2015

  25. Lego. https://en.wikipedia.org/wiki/Lego/. Accessed 15 July 2015

  26. Youwen W, Cheng Y, Xiaoyu W, Shengmiao X, Hui L (2011) Gesture Recognition using Microsoft Kinect. In: Proceeding of the 5th international conference on intelligent human-machine systems and cybernetics, IHMSC 2011, pp 100-103. doi:10.1109/ICARA.2011.6144864

  27. Yao Yuan, Yun Fu (2014) Contour model-based hand-gesture recognition using the kinect sensor. Proc IEEE Trans Circuit Syst Video Technol 24(11):1935–1944. doi:10.1109/TCSVT.2014.2302538

    Article  Google Scholar 

  28. LDraw unit. http://www.brickwiki.info/wiki/LDraw_unit. Accessed 14 Sept 2015

Download references

Acknowledgments

This work was supported by ICT R&D program of MSIP/IITP. [14-811-12-003, Development of the graphic engine and framework of 3D contents for the creative hands-on science education].

Author information

Authors and Affiliations

  1. Department of Digital Media, Soongsil University, Seoul, Korea

    Van Thanh Tran, Jaewoon Lee & Dongho Kim

  2. Department of Multimedia Engineering, Dongguk University, Seoul, Korea

    Young-Sik Jeong

Authors
  1. Van Thanh Tran
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jaewoon Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dongho Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Young-Sik Jeong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dongho Kim.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tran, V.T., Lee, J., Kim, D. et al. Easy-to-use virtual brick manipulation techniques using hand gestures. J Supercomput 72, 2752–2766 (2016). https://doi.org/10.1007/s11227-015-1588-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-015-1588-4

Keywords

Search

Navigation