Summary of the paper
| Title | Cognitive Evaluation Approach for a Controlled Language Post-Editing Experiment |
|---|---|
| Authors | Irina Temnikova |
| Abstract | In emergency situations it is crucial that instructions are straightforward tounderstand. For this reason a controlled language for crisis management (CLCM),based on psycholinguistic studies of human comprehension under stress, wasdeveloped. In order to test the impact of CLCM machine translatability of thisparticular kind of sub-language text, a previous experiment involving machinetranslation and human post-editing has been conducted. Employing two automaticevaluation metrics, a previous evaluation of the experiment has proved thatinstructions written according to this CL can improve machine translation (MT)performance. This paper presents a new cognitive evaluation approach for MTpost-editing, which is tested on the previous controlled and uncontrolledtextual data. The presented evaluation approach allows a deeper look into thepost-editing process and specifically how much effort post-editors put intocorrecting the different kinds of MT errors. The method is based on existing MTerror classification, which is enriched with a new error ranking motivated bythe cognitive effort involved in the detection and correction of these MTerrors. The preliminary results of applying this approach to a subset of theoriginal data confirmed once again the positive impact of CLCM on emergencyinstructions' machine translatability and thus the validity of the approach. |
| Language | Cognitive methods |
| Topics | Controlled languages, Machine Translation, SpeechToSpeech Translation, Cognitive methods |
Full paper  |
Cognitive Evaluation Approach for a Controlled Language Post-Editing Experiment |
| Bibtex | @InProceedings{TEMNIKOVA10.437, author = {Irina Temnikova}, title = {Cognitive Evaluation Approach for a Controlled Language Post-Editing Experiment}, booktitle = {Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, Mike Rosner, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |