Summary of the paper
| Title | Development and Use of an Evaluation Collection for Personalisation of Digital Newspapers |
|---|---|
| Authors | Alberto Díaz, Pablo Gervás, Antonio García and Laura Plaza |
| Abstract | This paper presents the process of development and the characteristics of anevaluation collection for a personalisation system for digital newspapers. Thissystem selects, adapts and presents contents according to a user model thatdefine information needs. The collection presented here contains data that arecross-related over four different axes: a set of news items from an electronicnewspaper, collected into subsets corresponding to a particular sequence ofdays, packaged together and cross-indexed with a set of user profiles thatrepresent the particular evolution of interests of a set of real users over thegiven days, expressed in each case according to four different representationframeworks: newspaper sections, Yahoo categories, keywords, and relevancefeedback over the set of news items for the previous day. This informationprovides a minimum starting material over which one can evaluate for a givensystem how it addresses the first two observations - adapting to differentusers and adapting to particular users over time - providing that theparticular system implements the representation of information needs accordingto the four frameworks employed in the collection. This collection has beensuccessfully used to perform some different experiments to determine theeffectiveness of the personalization system presented. |
| Language | LR Infrastructures and Architectures |
| Topics | Evaluation methodologies, Document Classification, Text categorisation, LR Infrastructures and Architectures |
Full paper  |
Development and Use of an Evaluation Collection for Personalisation of Digital Newspapers |
| Bibtex | @InProceedings{DAZ10.569, author = {Alberto Díaz, Pablo Gervás, Antonio García and Laura Plaza}, title = {Development and Use of an Evaluation Collection for Personalisation of Digital Newspapers}, booktitle = {Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, Mike Rosner, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |