Resource: PANACEA Labour Italian monolingual corpus

Reference PANACEA Labour Italian monolingual corpus
Date of Submission Jan. 24, 2014, 4:30 p.m.
Status accepted
ISLRN 393-864-255-110-7
Resource Type Primary Text
Media Type Text
Language Italian
Format/MIME Type Plain text

The PANACEA Labour Italian monolingual corpus was acquired in the framework of the PANACEA project (Platform for Automatic, Normalized Annotation and Cost-Effective Acquisition of Language Resources for Human Language Technologies), under the European Commission's Seventh Framework Programme.

This corpus contains documents that were acquired from the web, were automatically detected to be in the Italian language and were automatically classified as relevant to the “Labour Legislation” domain. It was constructed in the summer of 2011 using the Focused Monolingual Crawler (FMC) developed in the context of PANACEA.

The corpus contains 70,563,320 tokens, excluding tokens in a) short (smaller than 10 tokens) paragraphs, b) paragraphs that were automatically classified as boilerplate and c) paragraphs that were automatically detected in a language other than Italian. They are divided into a total of 12,706 documents that were crawled from 864 web sites. The dataset consists of the original crawled HTML files and the corresponding CesDoc XML files with basic metadata.

Version 1.0
Distributor ELRA