A Quantitative Analysis of Discourse Phenomena in Machine Translation
State-of-the-art Machine Translation (MT) systems translate documents by considering isolated sentences, disregarding information beyond sentence level. As a result, machine-translated documents often contain problems related to discourse coherence and cohesion. Recently, some initiatives in the eva...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Presses universitaires de Caen
2015-09-01
|
| Series: | Discours |
| Subjects: | |
| Online Access: | https://journals.openedition.org/discours/9047 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832581875629031424 |
|---|---|
| author | Carolina Scarton Lucia Specia |
| author_facet | Carolina Scarton Lucia Specia |
| author_sort | Carolina Scarton |
| collection | DOAJ |
| description | State-of-the-art Machine Translation (MT) systems translate documents by considering isolated sentences, disregarding information beyond sentence level. As a result, machine-translated documents often contain problems related to discourse coherence and cohesion. Recently, some initiatives in the evaluation and quality estimation of MT outputs have attempted to detect discourse problems in order to assess the quality of these machine translations. However, a quantitative analysis of discourse phenomena in MT outputs is still needed in order to better understand the phenomena and identify possible solutions or ways to improve evaluation. This paper aims to answer the following questions: What is the impact of discourse phenomena on MT quality? Can we capture and measure quantitatively any issues related to discourse in MT outputs? In order to answer these questions, we present a quantitative analysis of several discourse phenomena and correlate the resulting figures with scores from automatic translation quality evaluation metrics. We show that figures related to discourse phenomena present a higher correlation with quality scores than the baseline counts widely used for quality estimation of MT. |
| format | Article |
| id | doaj-art-f6fb883d12184fc7a8a6a5fc16c19d9d |
| institution | Kabale University |
| issn | 1963-1723 |
| language | English |
| publishDate | 2015-09-01 |
| publisher | Presses universitaires de Caen |
| record_format | Article |
| series | Discours |
| spelling | doaj-art-f6fb883d12184fc7a8a6a5fc16c19d9d2025-01-30T09:52:48ZengPresses universitaires de CaenDiscours1963-17232015-09-011610.4000/discours.9047A Quantitative Analysis of Discourse Phenomena in Machine TranslationCarolina ScartonLucia SpeciaState-of-the-art Machine Translation (MT) systems translate documents by considering isolated sentences, disregarding information beyond sentence level. As a result, machine-translated documents often contain problems related to discourse coherence and cohesion. Recently, some initiatives in the evaluation and quality estimation of MT outputs have attempted to detect discourse problems in order to assess the quality of these machine translations. However, a quantitative analysis of discourse phenomena in MT outputs is still needed in order to better understand the phenomena and identify possible solutions or ways to improve evaluation. This paper aims to answer the following questions: What is the impact of discourse phenomena on MT quality? Can we capture and measure quantitatively any issues related to discourse in MT outputs? In order to answer these questions, we present a quantitative analysis of several discourse phenomena and correlate the resulting figures with scores from automatic translation quality evaluation metrics. We show that figures related to discourse phenomena present a higher correlation with quality scores than the baseline counts widely used for quality estimation of MT.https://journals.openedition.org/discours/9047discourse in machine translationdocument-level quality estimationdiscourse features for quality estimation |
| spellingShingle | Carolina Scarton Lucia Specia A Quantitative Analysis of Discourse Phenomena in Machine Translation Discours discourse in machine translation document-level quality estimation discourse features for quality estimation |
| title | A Quantitative Analysis of Discourse Phenomena in Machine Translation |
| title_full | A Quantitative Analysis of Discourse Phenomena in Machine Translation |
| title_fullStr | A Quantitative Analysis of Discourse Phenomena in Machine Translation |
| title_full_unstemmed | A Quantitative Analysis of Discourse Phenomena in Machine Translation |
| title_short | A Quantitative Analysis of Discourse Phenomena in Machine Translation |
| title_sort | quantitative analysis of discourse phenomena in machine translation |
| topic | discourse in machine translation document-level quality estimation discourse features for quality estimation |
| url | https://journals.openedition.org/discours/9047 |
| work_keys_str_mv | AT carolinascarton aquantitativeanalysisofdiscoursephenomenainmachinetranslation AT luciaspecia aquantitativeanalysisofdiscoursephenomenainmachinetranslation AT carolinascarton quantitativeanalysisofdiscoursephenomenainmachinetranslation AT luciaspecia quantitativeanalysisofdiscoursephenomenainmachinetranslation |