Resource: CLEF QAST (2007-2009) – Evaluation Package
|Reference||CLEF QAST (2007-2009) – Evaluation Package|
|Date of Submission||Jan. 24, 2014, 4:22 p.m.|
|Resource Type||Primary Text|
|Language||English, French, Spanish, Castilian|
The Cross-Language Evaluation Forum (CLEF) promotes R&D in multilingual information access (MLIA) by (i) developing an infrastructure for the testing, tuning and evaluation of information retrieval systems operating on European languages in both monolingual and cross-language contexts, and (ii) creating test-suites of reusable data which can be employed by system developers for benchmarking purposes.
CLEF QAST (2007-2009) contains the data used for the Question Answering on Speech Transcripts tracks of the CLEF campaigns carried out from 2007 to 2009. These tracks tested the performance of monolingual Question Answering systems on collections of audio transcriptions.
The CLEF Test Suite is composed of:
The Transcript Data Collections consist of manual transcriptions and ASR automatic transcriptions from the following development and evaluation corpora:
The full package is stored on 1 CD.