Resource: TC-STAR 2007 Evaluation Package - SLT Spanish-to-English - CORTES
|Reference||TC-STAR 2007 Evaluation Package - SLT Spanish-to-English - CORTES|
|Date of Submission||Jan. 24, 2014, 4:31 p.m.|
|Resource Type||Primary Text|
|Language||English, Spanish, Castilian|
TC-STAR is a European integrated project focusing on Speech-to-Speech Translation (SST). To encourage significant breakthrough in all SST technologies, annual open competitive evaluations are organized. Automatic Speech Recognition (ASR), Spoken Language Translation (SLT) and Text-To-Speech (TTS) are evaluated independently and within an end-to-end system.
The third TC-STAR evaluation campaign took place in March 2007.
Each evaluation package includes resources, protocols, scoring tools, results of the official campaign, etc., that were used or produced during the second evaluation campaign. The aim of these evaluation packages is to enable external players to evaluate their own system and compare their results with those obtained during the campaign itself.
The speech databases made within the TC-STAR project were validated by SPEX, in the Netherlands, to assess their compliance with the TC-STAR format and content specifications.
This package includes the material used for the TC-STAR 2007 Spoken Language Translation (SLT) third evaluation campaign for Spanish-to-English translation. The same packages are available for English (ELRA-E0025), Spanish (ELRA-E0026-01 et E0026-02) and Mandarin Chinese (ELRA-E0027) for ASR and for SLT in 2 other directions, English-to-Spanish (ELRA-E0028) and Chinese-to-English (ELRA-E0030), as well as for the EPPS task of Spanish-to-English (ELRA-E0029-02).
To be able to chain the components, ASR, SLT and TTS evaluation tasks were designed to use common sets of raw data and conditions. Three evaluation tasks, common to ASR, SLT and TTS, were selected: EPPS (European Parliament Plenary Sessions) task, CORTES (Spanish Parliament Sessions) task and VOA (Voice of America) task. The CORTES data were used in addition to the EPPS data to evaluate ASR in Spanish and SLT from Spanish into English.
This package was used within the CORTES task and consists of one test data set, composed of two subsets of about 30,000 words each (one subset from the manual transcriptions and one subset from the Final Text Edition documents), that were selected from the June 2006 CORTES sessions. The source data were then translated into English by two independent agencies.