Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
SpringerLink
Log in

Vision based two-level hand tracking system for dynamic hand gestures in indoor environment

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Object detection and tracking is one of the most challenging phases in any image processing application. The challenges that arise during hand gesture recognition are: hand shape variation, presence of multiple persons, illumination variation or occlusion with background. In this paper, a robust hand detector and tracker algorithm has been proposed which overcomes the above difficulties to a great extent. The proposed system first detects hand using a combination of color and motion information. Then, the hand is tracked using combination of feature based tracker modified KLT algorithm and a color-based tracker Camshift algorithm. New feature points have been added to our modified combination of feature and color based tracker. This prevents the loss of tracking as seen in traditional KLT algorithm. The experiments carried out using the proposed system shows that the system provides better results in comparison to the existing literatures on various challenging hand sequences.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Allen JG, Xu RYD, Jin JS (2004) Object tracking using camshift algorithm and multiple quantized feature spaces. In Proceedings of the Pan-Sydney area workshop on Visual information processing 100:3–7

  2. Asaari MSM, Rosdi BA, Suandi SA (2014) Intelligent biometric group hand tracking (IBGHT) database for visual hand tracking research and development. Multimedia tools and applications 70(3):1869–1898

    Article  Google Scholar 

  3. Chibelushi CC, Bourel F (2003) Facial expression recognition: A brief tutorial overview. CVonline: On-Line Compendium of Computer Vision 9

  4. Dhote A, Badwaik SC (2015) Hand tracking and gesture recognition. In: 2015 International Conference on Pervasive Computing (ICPC). IEEE, pp 1–5

  5. Guo J-M, Liu Y-F, Chang C-H, Nguyen H-S (2011) Improved hand tracking system. IEEE Trans Circuits Syst Video Technol 22(5):693–701

    Article  Google Scholar 

  6. Khan MH-M, Ittoo N, Coder BK (2019) Hand Gestures Categorisation and Recognition. In: Information Systems Design and Intelligent Applications. Springer, Singapore, pp 295–304

    Chapter  Google Scholar 

  7. Khetarpal P, Kumar N, Rai N (2019) Real-Time Static Hand Gesture Recognition Using MATLAB. In: Applications of Computing, Automation and Wireless Systems in Electrical Engineering. Springer, Singapore, pp 1149–1158

    Chapter  Google Scholar 

  8. Kolsch M, Turk M (2004) Fast 2d hand tracking with flocks of features and multi-cue integration. In: 2004 Conference on Computer Vision and Pattern Recognition Workshop. IEEE, pp 158–158

  9. Lee H-K, Choi K-W, Kong D, Won J (2013) Improved Kanade-Lucas-Tomasi tracker for images with scale changes. In: 2013 IEEE International Conference on Consumer Electronics (ICCE). IEEE, pp 33–34

  10. Nouar O-D, Ali G, Raphael C (2006) Improved object tracking with camshift algorithm. In: 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings. IEEE, pp II–II

  11. Nouar O-D, Ali G, Raphael CANALS (2006) Improved object tracking with camshift algorithm. In 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings, vol. 2, pp. II-II. IEEE

  12. Rahman MA, Purnama IKE, Purnomo MH (2014) Simple method of human skin detection using HSV and YCbCr color spaces. In: 2014 International Conference on Intelligent Autonomous Agents, Networks and Systems. IEEE, pp 58–61

  13. Ramakrishna BB, Sharmila Kumari M (2019) Human face tracking using normalized CamShift face tracker. J Comput Theor Nanosci 16(4):1485–1488

    Article  Google Scholar 

  14. Singha J, Semwal VB, Laskar RH (2016) An accurate hand tracking system for complex background based on modified KLT Tracker. In 2016 IEEE Region 10 Conference (TENCON), pp 3644–3647. IEEE

  15. Singha J, Roy A, Laskar RH (2018) Dynamic hand gesture recognition using vision-based approach for human–computer interaction. Neural Computing Applications 29(4):1129–1141

  16. Sinha K, Kumari R, Priya A, Paul P (2019) A Computer Vision-Based Gesture Recognition Using Hidden Markov Model. In: Innovations in Soft Computing and Information Technology. Springer, Singapore, pp 55–67

    Chapter  Google Scholar 

  17. Suhr JK (2009) Kanade-lucas-tomasi (klt) feature tracker. Computer Vision (EEE6503) 9–18

  18. Viola P, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57(2):137–154

    Article  Google Scholar 

  19. Xiu C, Su X, Pan X (2018) Improved target tracking algorithm based on Camshift. In: 2018 Chinese Control And Decision Conference (CCDC). IEEE, pp 4449–4454

  20. Yuan Y, Fang J, Wang Q (2013) Robust superpixel tracking via depth fusion. IEEE Trans Circuits Syst Video Technol 24(1):15–26

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported by DST (Govt. of India) under the SEED Division [SP/YO/407/2018].

Author information

Authors and Affiliations

  1. Department of Electronics & Communication, Jaipur, India

    Shweta Saboo & Joyeeta Singha

  2. The LNM Institute of Information Technology, Jaipur, 302031, India

    Shweta Saboo & Joyeeta Singha

Authors
  1. Shweta Saboo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Joyeeta Singha
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Joyeeta Singha.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Saboo, S., Singha, J. Vision based two-level hand tracking system for dynamic hand gestures in indoor environment. Multimed Tools Appl 80, 20579–20598 (2021). https://doi.org/10.1007/s11042-021-10669-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-10669-7

Keywords

Search

Navigation