| Title |
Video Retrieval in Sign Language Videos : How to Model and Compare Signs? |
| Authors |
François Lefebvre-Albaret and Patrice Dalle |
| Abstract |
This paper deals with the problem of finding sign occurrences in a sign language (SL) video. It begins with an analysis of sign models and the way they can take into account the sign variability. Then, we review the most popular technics dedicated to automatic sign language processing and we focus on their adaptation to model sign variability. We present a new method to provide a parametric description of the sign as a set of continuous and discrete parameters. Signs are classified according to there categories (ballistic movements, circles ...), the symmetry between the hand movements, hand absolute and relative locations. Membership grades to sign categories and continuous parameter comparisons can be combined to estimate the similarity between two signs. We set out our system and we evaluate how much time can be saved when looking for a sign in a french sign language video. By now, our formalism only uses hand 2D locations, we finally discuss about the way of integrating other parameters as hand shape or facial expression in our framework. |
| Topics |
Sign Language Recognition/Generation, Language modelling, Multimedia Document Processing |
Full paper |
Video Retrieval in Sign Language Videos : How to Model and Compare Signs? |
Slides |
- |
| Bibtex |
@InProceedings{LEFEBVREALBARET10.176,
author = {François Lefebvre-Albaret and Patrice Dalle},
title = {Video Retrieval in Sign Language Videos : How to Model and Compare Signs?},
booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)},
year = {2010},
month = {may},
date = {19-21},
address = {Valletta, Malta},
editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias},
publisher = {European Language Resources Association (ELRA)},
isbn = {2-9517408-6-7},
language = {english}
} |
Summary of the paper