Summary of the paper
| Title | Towards an Integrated Scheme for Semantic Annotation of Multimodal Dialogue Data |
|---|---|
| Authors | Volha Petukhova and Harry Bunt |
| Abstract | Recent years witness a growing interest in the use of multimodal data formodelling of communicative behaviour in dialogue. Dybkjaer and Bernsen (2002), point out that coding schemes for multimodal dataare used solely by their creators. Standardisation has been achieved to someextent for coding behavioural features for certain nonverbal expressions, e.g.for facial expression, however, for the semantic annotation of such expressionscombined with other modalities such as speech there is still a long way to go. The majority of existing dialogue act annotation schemes that are designed tocode semantic and pragmatic dialogue information are limited to analysis ofspoken modality.This paper investigates the applicability of existing dialogue act annotationschemes to the semantic annotation of multimodal data, and the way a dialogueact annotation scheme can be extended to cover dialogue phenomena from multiplemodalities. The general conclusion of our explorative study is that amultidimensional dialogue act taxonomy is usable for this purpose when someadjustments are made. We proposed a solution for adding these aspects to adialogue act annotation scheme without changing its set of communicativefunctions, in the form of qualifiers that can be attached to communicativefunction tags. |
| Language | |
| Topics | Dialogue, Discourse annotation, representation and processing |
Full paper  |
Towards an Integrated Scheme for Semantic Annotation of Multimodal Dialogue Data |
| Bibtex | @InProceedings{PETUKHOVA10.195, author = {Volha Petukhova and Harry Bunt}, title = {Towards an Integrated Scheme for Semantic Annotation of Multimodal Dialogue Data}, booktitle = {Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, Mike Rosner, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |