Summary of the paper
| Title | Annotation Scheme and Gold Standard for Dutch Subjective Adjectives |
|---|---|
| Authors | Isa Maks and Piek Vossen |
| Abstract | Many techniques are developed to derive automatically lexical resources foropinion mining. In this paper we present a gold standard for Dutch adjectivesdeveloped for the evaluation of these techniques. In the first part of thepaper we introduce our annotation guidelines. They are based upon guidelinesrecently developed for English which annotate subjectivity and polarity at wordsense level. In addition to subjectivity and polarity we propose a thirdannotation category: that of the attitude holder. The identity of the attitudeholder is partly implied by the word itself and may provide useful informationfor opinion mining systems. In the second part of paper we present the criteriaadopted for the selection of items which should be included in this goldstandard. Our design is aimed at an equal representation of all dimensions ofthe lexicon , like frequency and polysemy, in order to create a gold standardwhich can be used not only for benchmarking purposes but also may help toimprove in a systematic way, the methods which derive the word lists. Finallywe present the results of the annotation task including annotator agreementrates and disagreement analysis. |
| Language | Text mining |
| Topics | Emotion Recognition/Generation, Lexicon, lexical database, Text mining |
Full paper  |
Annotation Scheme and Gold Standard for Dutch Subjective Adjectives |
| Bibtex | @InProceedings{MAKS10.165, author = {Isa Maks and Piek Vossen}, title = {Annotation Scheme and Gold Standard for Dutch Subjective Adjectives}, booktitle = {Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, Mike Rosner, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |