Summary of the paper
| Title | U-Compare: An Integrated Language Resource Evaluation Platform Including a Comprehensive UIMA Resource Library |
|---|---|
| Authors | Yoshinobu Kano, Ruben Dorado, Luke McCrohon, Sophia Ananiadou and Jun'ichi Tsujii |
| Abstract | Language resources, including corpus and tools, are normally required to becombined in order to achieve a user’s specific task. However, resources tendto be developed independently in different, incompatible formats. In this paperwe describe about U-Compare, which consists of the U-Compare componentrepository and the U-Compare platform. We have been building a highlyinteroperable resource library, providing the world largest ready-to-use UIMAcomponent repository including wide variety of corpus readers andstate-of-the-art language tools. These resources can be deployed as localservices or web services, even possible to be hosted in clustered machines toincrease the performance, while users do not need to be aware of suchdifferences. In addition to the resource library, an integrated languageprocessing platform is provided, allowing workflow creation, comparison,evaluation and visualization, using the resources in the library or any UIMAcomponent, without any programming via graphical user interfaces, while acommand line launcher is also available without GUIs. The evaluation itself isprocessed in a UIMA component, users can create and plug their own evaluationmetrics in addition to the predefined metrics. U-Compare has been successfullyused in many projects including BioCreative, Conll and the BioNLP shared task. |
| Language | Tools, systems, applications |
| Topics | LR Infrastructures and Architectures, Usability, user satisfaction, Tools, systems, applications |
Full paper  |
U-Compare: An Integrated Language Resource Evaluation Platform Including a Comprehensive UIMA Resource Library |
| Bibtex | @InProceedings{KANO10.307, author = {Yoshinobu Kano, Ruben Dorado, Luke McCrohon, Sophia Ananiadou and Jun'ichi Tsujii}, title = {U-Compare: An Integrated Language Resource Evaluation Platform Including a Comprehensive UIMA Resource Library}, booktitle = {Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, Mike Rosner, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |