Summary of the paper
| Title | Heterogeneous Data Sources for Signed Language Analysis and Synthesis: The SignCom Project |
|---|---|
| Authors | Kyle Duarte and Sylvie Gibet |
| Abstract | This paper describes how heterogeneous data sources captured in the SignComproject may be used for the analysis and synthesis of French Sign Language(LSF) utterances. The captured data combine video data and multimodal motioncapture (mocap) data, including body and hand movements as well as facialexpressions. These data are pre-processed, synchronized, and enriched by textannotations of signed language elicitation sessions. The addition of mocap datato traditional data structures provides additional phonetic data to linguistswho desire to better understand the various parts of signs (handshape,movement, orientation, etc.) to very exacting levels, as well as theirinteractions and relative timings. We show how the phonologies of handconfigurations and articulator movements may be studied using signal processingand statistical analysis tools to highlight regularities or temporal schematabetween the different modalities. Finally, mocap data allows us to replay signsusing a computer animation engine, specifically editing and rearrangingmovements and configurations in order to create novel utterances. |
| Language | Sign Language Recognition/Generation |
| Topics | Discourse annotation, representation and processing, Natural Language Generation, Sign Language Recognition/Generation |
Full paper  |
Heterogeneous Data Sources for Signed Language Analysis and Synthesis: The SignCom Project |
| Bibtex | @InProceedings{DUARTE10.421, author = {Kyle Duarte and Sylvie Gibet}, title = {Heterogeneous Data Sources for Signed Language Analysis and Synthesis: The SignCom Project}, booktitle = {Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, Mike Rosner, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |