Summary of the paper
| Title | HIFI-AV: An Audio-visual Corpus for Spoken Language Human-Machine Dialogue Research in Spanish |
|---|---|
| Authors | Fernando Fernández-Martínez, Juan Manuel Lucas-Cuesta, Roberto Barra Chicote, Javier Ferreiros and Javier Macías-Guarasa |
| Abstract | In this paper, we describe a new multi-purpose audio-visual database on thecontext of speech interfaces for controlling household electronic devices. Thedatabase comprises speech and video recordings of 19 speakers interacting witha HIFI audio box by means of a spoken dialogue system. Dialogue management isbased on Bayesian Networks and the system is provided with contextualinformation handling strategies. Each speaker was requested to fulfil differentsets of specific goals following predefined scenarios, according to bothdifferent complexity levels and degrees of freedom or initiative allowed to theuser. Due to a careful design and its size, the recorded database allowscomprehensive studies on speech recognition, speech understanding, dialoguemodeling and management, microphone array based speech processing, and bothspeech and video-based acoustic source localisation. The database has beenlabelled for quality and efficiency studies on dialogue performance. The wholedatabase has been validated through both objective and subjective tests. |
| Language | Voice Command and Control |
| Topics | Corpus (creation, annotation, etc.), Dialogue, Voice Command and Control |
Full paper  |
HIFI-AV: An Audio-visual Corpus for Spoken Language Human-Machine Dialogue Research in Spanish |
| Bibtex | @InProceedings{FERNNDEZMARTNEZ10.230, author = {Fernando Fernández-Martínez, Juan Manuel Lucas-Cuesta, Roberto Barra Chicote, Javier Ferreiros and Javier Macías-Guarasa}, title = {HIFI-AV: An Audio-visual Corpus for Spoken Language Human-Machine Dialogue Research in Spanish}, booktitle = {Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, Mike Rosner, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |