Resource: CLEFeHealth 2014 Task 3 Evaluation Package
|Reference||CLEFeHealth 2014 Task 3 Evaluation Package|
|Date of Submission||Feb. 26, 2015, 12:55 p.m.|
|Resource Type||Primary Text|
The CLEF Initiative (Conference and Labs of the Evaluation Forum) promotes the systematic evaluation of information access systems through experimentation on shared tasks, with an emphasis on multilingual and multimodal information. It is structured in two main parts: a series of Evaluation Labs for the systems devised and a peer-reviewed conference on a broad range of issues related to the project.
The CLEFeHealth 2014 Task 3 Evaluation Package contains data used for the User-centred health information retrieval Shared task at the CLEFeHealth Lab conducted in 2014.
The package contains:
The collection consists of a set of around 1 million medical-related documents, provided by the Khresmoi project. This collection contains documents covering a broad set of medical topics, and does not contain any patient information.
Five sample development queries, 50 test queries and their translation in Czech, French and German, as well as result set are provided with the data set. The queries have been manually generated by medical professionals from disorders mentioned in discharge summaries used for task 2 of CLEF eHealth.
The training set contains 20 topics:
Topic Test Set
The test set contains 200 topics:
A demo version of the package is available from http://clefpackages.elra.info/clefehealthtask3/