research-article

A committee machine implementing the pattern recognition module for fingerspelling applications

Authors:

Clodis BoscarioliAuthors Info & Claims

SAC '10: Proceedings of the 2010 ACM Symposium on Applied Computing

Pages 954 - 958

https://doi.org/10.1145/1774088.1774287

Published: 22 March 2010 Publication History

Get Access

Abstract

In several countries, deaf communities adopt the sign language as their official and natural language. This fact inserts a new field for the software application development that can improve sign language dissemination and social inclusion of deaf people. Alphabetic character-based applications, like games and educational softwares, can be adapted to run as fingerspelling-based applications, in which the inputs are signs (static images or videos) rather than letters (typed letters). In this paper, we present a Pattern Recognition Module, implemented by Committee Machine, for fingerspelling applications. The committee experts are built with supervised and unsupervised Fuzzy Learning Vector Quantization models using the "boosting by filtering" strategy. The module was tested in a specific sign language context considering hand configurations and hand movements.

References

[1]

J. C. Bezdek, E. C. Tsao, and N. R. Pal. Fuzzy kohonen clustering networks. In IEEE International Conference on Fuzzy Systems, pages 1035--1043, 1992.

Crossref

Google Scholar

[2]

F.-S. Chen, C.-M. Fu, and C.-L. Huang. Hand gesture recognition using a real-time tracking method and hidden markov models. Image and Vision Computing, 21(8):745--758, August 2003.

Crossref

Google Scholar

[3]

F. Chung and T. Lee. Fuzzy learning vector quantization. In IEEE International Joint Conference on Neural Networks, pages 2793--2742, 1993.

Google Scholar

[4]

D. B. Dias, R. C. B. Madeo, T. Rocha, H. H. Bíscaro, and S. M. Peres. Hand movement recognition for brazilian sign language: A study using distance-based neural networks. In International Joint Conference on Neural Networks, pages 697--704. IEEE, 2009.

Digital Library

Google Scholar

[5]

L. Fausett. Fundamentals of Neural Networks: architectures, algorithms, and appliations. Prentice-Hall, Inc., New Jersey, USA, 1994.

Digital Library

Google Scholar

[6]

R. C. Gonzalez and R. Woods. Image Processing using MATLAB. Prentice Hall Inc, New Jersey, 2002.

Digital Library

Google Scholar

[7]

S. Haykin. Neural Networks: a comprehensive foundation. Prentice Hall Inc, NJ, 2nd edition, 1998.

Digital Library

Google Scholar

[8]

M. Lamar, M. S. Bhuiyan, and A. Iwata. Biologically Motivated Computer Vision - LNCS, chapter T-CombNET - A Neural Network Dedicated to Hand Gesture Recognition, pages 613--622. Springer, 2000.

Digital Library

Google Scholar

[9]

S. Mitra and T. Acharya. Gesture recognition: A survey. IEEE Trans. on Systems, Man, and Cybernetics - Part C, 37(3), May 2007.

Digital Library

Google Scholar

[10]

V. I. Pavlovic, R. Sharma, and T. S. Huang. Visual interpretation of hand gestures for human-computer interaction: A review. IEEE Trans. on Pattern Analysis and Machine Intelligence, 19:677--695, 1997.

Digital Library

Google Scholar

[11]

A. Ramamoorthy, N. Vaswani, S. Chaudhury, and S. Banerjee. Recognition of dynamic hand gestures. Pattern Recognition, 36:2069--2081, 2003.

Crossref

Google Scholar

[12]

T. Starner, J. Weaver, and A. Pentland. Real-time american sign language recognition from video using hidden markov models. IEEE Trans. on Pattern Analysis and Machine Intelligence, 20:1371--1375, 1998.

Digital Library

Google Scholar

[13]

M.-H. Yang and N. Ahuja. Recognizing hand gesture using motion trajectories. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, volume 1, pages 466--472, Juny 1999.

Google Scholar

[14]

H. S. Yoon, J. Soh, Y. J. Bae, and H. S. Yang. Hand gesture recognition using combined features of location, angle and velocity. Pattern Recognition, 34:1491--1501, 2001.

Crossref

Google Scholar

Cited By

View all

Furtado SDe Oliveira JShirmohammadi S(2023)Interactive and Markerless Visual Recognition of Brazilian Sign Language Alphabet2023 IEEE International Instrumentation and Measurement Technology Conference (I2MTC)10.1109/I2MTC53148.2023.10176037(01-06)Online publication date: 22-May-2023
https://doi.org/10.1109/I2MTC53148.2023.10176037
Madeo RPeres SLima C(2016)Gesture phase segmentation using support vector machinesExpert Systems with Applications: An International Journal10.1016/j.eswa.2016.02.02156:C(100-115)Online publication date: 1-Sep-2016
https://dl.acm.org/doi/10.1016/j.eswa.2016.02.021
Chen B(2012)Mobile Agents in E-CommerceComputer Engineering10.4018/978-1-61350-456-7.ch614(1583-1590)Online publication date: 2012
https://doi.org/10.4018/978-1-61350-456-7.ch614
Show More Cited By

Index Terms

A committee machine implementing the pattern recognition module for fingerspelling applications
1. Computer systems organization
  1. Architectures
    1. Other architectures
      1. Special purpose systems
2. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Machine learning
    1. Learning paradigms
      1. Supervised learning
        Supervised learning by classification
    2. Machine learning approaches
      1. Classification and regression trees

Recommendations

An AI-Based Detection System for Mudrabharati: A Novel Unified Fingerspelling System for Indic Scripts
Text, Speech, and Dialogue
Abstract
Sign Language (SL) is a potential tool for communication in the hearing and speech-impaired community. As individual words cannot be communicated accurately using the SL gestures, fingerspelling is adopted to spell out names of people and places. ...
Gesture recognition for fingerspelling applications: an approach based on sign language cheremes
ASSETS '10: Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility

This paper presents an approach for carrying out gesture recognition for the Brazilian Sign Language Manual Alphabet. The gestural patterns are treated as a combination of three primitives, or cheremes - hand configuration, hand orientation and hand ...
Improving realism in automated fingerspelling of American sign language
Abstract
Fingerspelling is a process of communicating letters of a spoken language alphabet using a person’s hand or hands. Portraying animations of fingerspelling has proved surprisingly resistant to automation because of the collisions that arise from ...

Comments

Information & Contributors

Information

Published In

SAC '10: Proceedings of the 2010 ACM Symposium on Applied Computing

March 2010

2712 pages

ISBN:9781605586397

DOI:10.1145/1774088

Conference Chairs:
Sung Y. Shin
South Dakota State University
,
Sascha Ossowski
University Rey Juan Carlos, Spain
,
Michael Schumacher
University of Applied Sciences Western Switzerland, Switzerland
,
Program Chairs:
Mathew J. Palakal
Indiana University Purdue University
,
Chih-Cheng Hung
Southern Polytechnic State University

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 March 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conselho Nacional de Desenvolvimento Científico e Tecnológico

Conference

SAC'10

Sponsor:

SIGAPP

SAC'10: The 2010 ACM Symposium on Applied Computing

March 22 - 26, 2010

Sierre, Switzerland

Acceptance Rates

SAC '10 Paper Acceptance Rate 364 of 1,353 submissions, 27%;

Overall Acceptance Rate 1,650 of 6,669 submissions, 25%

Upcoming Conference

SAC '25

Sponsor:
sigapp

The 40th ACM/SIGAPP Symposium on Applied Computing

March 31 - April 4, 2025

Catania , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
326
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Furtado SDe Oliveira JShirmohammadi S(2023)Interactive and Markerless Visual Recognition of Brazilian Sign Language Alphabet2023 IEEE International Instrumentation and Measurement Technology Conference (I2MTC)10.1109/I2MTC53148.2023.10176037(01-06)Online publication date: 22-May-2023
https://doi.org/10.1109/I2MTC53148.2023.10176037
Madeo RPeres SLima C(2016)Gesture phase segmentation using support vector machinesExpert Systems with Applications: An International Journal10.1016/j.eswa.2016.02.02156:C(100-115)Online publication date: 1-Sep-2016
https://dl.acm.org/doi/10.1016/j.eswa.2016.02.021
Chen B(2012)Mobile Agents in E-CommerceComputer Engineering10.4018/978-1-61350-456-7.ch614(1583-1590)Online publication date: 2012
https://doi.org/10.4018/978-1-61350-456-7.ch614
Peres SBoscarioli CBidarra JFantinato M(2012)Human-Computer Interaction and Artificial IntelligenceComputer Engineering10.4018/978-1-61350-456-7.ch101(1-18)Online publication date: 2012
https://doi.org/10.4018/978-1-61350-456-7.ch101
Madeo RPeres SLima CBoscarioli C(2012)Hybrid architecture for gesture recognition: Integrating fuzzy-connectionist and heuristic classifiers using fuzzy syntactical strategyThe 2012 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN.2012.6252448(1-8)Online publication date: Jun-2012
https://doi.org/10.1109/IJCNN.2012.6252448
Peres SBoscarioli CBidarra JFantinato M(2011)Human-Computer Interaction and Artificial IntelligenceComputer Engineering10.4018/978-1-61350-456-7.ch1.1(1-18)Online publication date: 31-Dec-2011
https://doi.org/10.4018/978-1-61350-456-7.ch1.1
Peres SBoscarioli CBidarra JFantinato M(2011)Human-Computer Interaction and Artificial IntelligenceBusiness, Technological, and Social Dimensions of Computer Games10.4018/978-1-60960-567-4.ch011(168-184)Online publication date: 2011
https://doi.org/10.4018/978-1-60960-567-4.ch011
Madeo RMcCoy KYesilada Y(2011)Brazilian sign language multimedia hangman gameThe proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility10.1145/2049536.2049623(311-312)Online publication date: 24-Oct-2011
https://dl.acm.org/doi/10.1145/2049536.2049623
Mattos CBarreto G(2011)ARTIE and MUSCLE models: building ensemble classifiers from fuzzy ART and SOM networksNeural Computing and Applications10.1007/s00521-011-0747-722:1(49-61)Online publication date: 14-Oct-2011
https://doi.org/10.1007/s00521-011-0747-7
Madeo RPeres SDias DBoscarioli CBarreto AHanson V(2010)Gesture recognition for fingerspelling applicationsProceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility10.1145/1878803.1878861(261-262)Online publication date: 25-Oct-2010
https://dl.acm.org/doi/10.1145/1878803.1878861

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

An AI-Based Detection System for Mudrabharati: A Novel Unified Fingerspelling System for Indic Scripts

Gesture recognition for fingerspelling applications: an approach based on sign language cheremes

Improving realism in automated fingerspelling of American sign language

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations