Show simple item record

dc.contributor.authorPopovic, Maja
dc.contributor.authorArcan, Mihael
dc.contributor.authorLommel, Arle
dc.identifier.citationPopovic, Maja, Arcan, Mihael, & Lommel, Arle. (2016). Potential and limits of using post-edits as reference translations for MT evaluation. Paper presented at the EAMT 2016 The 19th Annual Conference of the European Association for Machine Translation, Riga, Latvia, 30 May - 01 June.en_IE
dc.description.abstractThis work investigates the potential use of post-edited machine translation (MT) outputs as reference translations for automatic machine translation evaluation, focusing mainly on the following important question: Is it necessary to take into account the machine translation system and the source language from which the given post-edits are generated? In order to explore this, we investigated the use of post-edits originating from different machine translation systems (two statistical systems and two rule-based systems), as well as the use of post-edits originating from two different source languages (English and German). The obtained results shown that for comparison of different systems using automatic evaluation metrics, a good option is to use a post-edit originating from a high-quality (possibly distinct) system. A better option is to use it together with other references and post-edits, however post-edits originating from poor translation systems should be avoided. For tuning or development of a particular system, post-edited output of this same system seems to be the best reference translation.en_IE
dc.description.sponsorshipThis publication has emanated from research supported by the TRAMOOC project (Translation for Massive Open Online Courses), partially funded by the European Commission under H2020-ICT-2014/H2020-ICT-2014-1 under Grant Agreement Number 644333, and by a research grant from Science Foundation Ireland (SFI) under Grant Number SFI/12/RC/2289 (Insight)en_IE
dc.publisherVilnius University, University of Latvia, Latvia University of Agriculture, Institute of Mathematics and Informatics of University of Latviaen_IE
dc.relation.ispartofEuropean Association for Machine Translation (EAMT-2016)en
dc.subjectMachine translation evaluationen_IE
dc.subjectReference translationsen_IE
dc.subjectPost-edited translationsen_IE
dc.titlePotential and limits of using post-edits as reference translations for MT evaluationen_IE
dc.typeConference Paperen_IE
dc.contributor.funderHorizon 2020en_IE
dc.contributor.funderScience Foundation Irelanden_IE
dc.local.contactMihael Arcan. Email:
dcterms.projectinfo:eu-repo/grantAgreement/EC/H2020::IA/644333/EU/Translation for Massive Open Online Courses/TraMOOCen_IE
dcterms.projectinfo:eu-repo/grantAgreement/SFI/SFI Research Centres/12/RC/2289/IE/INSIGHT - Irelands Big Data and Analytics Research Centre/en_IE

Files in this item

Attribution-NonCommercial-NoDerivs 3.0 Ireland
This item is available under the Attribution-NonCommercial-NoDerivs 3.0 Ireland. No item may be reproduced for commercial purposes. Please refer to the publisher's URL where this is made available, or to notes contained in the item itself. Other terms may apply.

The following license files are associated with this item:


This item appears in the following Collection(s)

Show simple item record