Automatic and human evaluation on English-Croatian legislative test set
This paper presents work on the manual and automatic evaluation of the online available machine translation (MT) service Google Translate, for the English-Croatian language pair in legislation and general domains. The experimental study is conducted on the test set of 200 sentences in total. Human e...
| Permalink: | http://skupni.nsk.hr/Record/ffzg.KOHA-OAI-FFZG:309373/Details |
|---|---|
| Matična publikacija: |
Computational Linguistics and Intelligent Text Processing : Proceedings : Part II 7816 (2013), 1 ; str. 311-317 |
| Glavni autori: | Brkić, Marija (-), Vičić, Tomislav (Author), Seljan, Sanja |
| Vrsta građe: | Članak |
| Jezik: | eng |
| Online pristup: |
http://bib.irb.hr/datoteka/547340.Brkic_Seljan_Vicic_CICling.pdf http://link.springer.com/content/pdf/bfm%3A978-3-642-37247-6%2F1.pdf |
| LEADER | 02491naa a2200313uu 4500 | ||
|---|---|---|---|
| 008 | 131105s2013 xx eng|d | ||
| 022 | |a 0302-9743 | ||
| 024 | |2 doi |a 10.1007/978-3-642-37247-6 | ||
| 035 | |a (CROSBI)547340 | ||
| 040 | |a HR-ZaFF |b hrv |c HR-ZaFF |e ppiak | ||
| 100 | 1 | |a Brkić, Marija | |
| 245 | 1 | 0 | |a Automatic and human evaluation on English-Croatian legislative test set / |c Brkić, Marija ; Seljan, Sanja ; Vičić, Tomislav. |
| 246 | 3 | |i Naslov na engleskom: |a Automatic and Human Evaluation on English-Croatian Legislative Test Set | |
| 300 | |a 311-317 |f str. | ||
| 363 | |i 2013 | ||
| 500 | |a ISBN 978-3-642-37246-9 ; 14th International Conference (CICLing 2013) "Computational Linguistics and Intelligent Text Processing" : proceedings. Part I ; Alexander Gelbukh (ur.) ; Samos, Grčka ; 24.-30.03.2013. | ||
| 520 | |a This paper presents work on the manual and automatic evaluation of the online available machine translation (MT) service Google Translate, for the English-Croatian language pair in legislation and general domains. The experimental study is conducted on the test set of 200 sentences in total. Human evaluation is performed by native speakers, using the criteria of fluency and adequacy, and it is enriched by error analysis. Automatic evaluation is performed on a single reference set by using the following metrics: BLEU, NIST, F-measure and WER. The influence of lowercasing, tokenization and punctuation is discussed. Pearson's correlation between automatic metrics is given, as well as cor relation between the two criteria, fluency and adequacy, and automatic metrics. | ||
| 536 | |a Projekt MZOS |f 130-1300646-0909 | ||
| 546 | |a ENG | ||
| 690 | |a 5.04 | ||
| 693 | |a automatic evaluation, machine translation, English-Croatia, BLEU, NIST, WER, F-measure |l hrv |2 crosbi | ||
| 693 | |a automatic evaluation, machine translation, English-Croatia, BLEU, NIST, WER, F-measur |l eng |2 crosbi | ||
| 700 | 1 | |a Vičić, Tomislav |4 aut | |
| 700 | 1 | |9 430 |a Seljan, Sanja |4 aut | |
| 773 | 0 | |t Computational Linguistics and Intelligent Text Processing : Proceedings : Part II |x 0302-9743 |g 7816 (2013), 1 ; str. 311-317 |a International Conference, CICLing (14 ; 2013 ; Samos, Greece) |k Lecture Notes in Computer Science - LNCS |z 978-3-642-37246-9 | |
| 856 | |u http://bib.irb.hr/datoteka/547340.Brkic_Seljan_Vicic_CICling.pdf | ||
| 856 | |u http://link.springer.com/content/pdf/bfm%3A978-3-642-37247-6%2F1.pdf | ||
| 942 | |c RZB |t 1.08 |u 2 |z Znanstveni - clanak | ||
| 999 | |c 309373 |d 309371 | ||