Resource: Ema-lon Manipuri Corpus (including word embedding and language model)

Reference Ema-lon Manipuri Corpus (including word embedding and language model)
Date of Submission Oct. 8, 2021, 1:09 p.m.
Status accepted
ISLRN 588-170-827-016-7
Resource Type Primary Text
Media Type Text
Source
Language English, Manipuri
Format/MIME Type text/plain
Size 124975 sentences (for aligned corpus) and 3330088 sentences (monolingual corpus v2)
Description

The Ema-lon Manipuri Corpus consists of a set of resources for Manipuri language (locally known as Meiteilon) for the purpose of machine translation. The main source for these resources is the Sangai Express news website. The resources that constitute the present corpus are listed below:
1. EM Corpus, abbreviation of Ema-lon Manipuri Corpus, which translates to ‘our mother tongue Manipuri corpus’. This is the first comparable corpus built for the Manipuri (mni)-English (eng) language pair from sentences crawled and collected from The Sangai Express (https://www.thesangaiexpress.com) from August 2020 to March 2021. It contains :
- Monolingual data: 1,034,715 Manipuri sentences and 846,796 English sentences in version 1 and 1,880,035 Manipuri sentences and 1,450,053 English sentences in version 2. This makes a comparable corpus in the two languages.
- Parallel data: 124,975 Manipuri-English aligned sentences extracted from the comparable data version 2.
2. EM-FT is also the first FastText word embedding available for Manipuri language trained on 1,880,035 Manipuri sentences.
3. EM-ALBERT is the first ALBERT model available for Manipuri language which is trained on 1,034,715 Manipuri sentences (from the first version of the EM Corpus).

Version 1.0
Distributor ELRA