Corpora for document-level neural machine translation

Liu,Siyou;Zhang,Xiaojun

[Liu,Siyou] Macao Polytechnic Institute,Macau,Macao [Zhang,Xiaojun] Xi'an Jiaotong-Liverpool University,Suzhou,China

LREC 2020 - 12th International Conference on Language Resources and Evaluation, Conference Proceedings

Pages:3775-3781

Publication Year:2020

Document Type:Conference Paper

Identifier:http://hdl.handle.net/20.500.12791/000643

Abstract

Instead of translating sentences in isolation, document-level machine translation aims to capture discourse dependencies across sentences by considering a document as a whole. In recent years, there have been more interests in modelling larger context for the state-of-the-art neural machine translation (NMT). Although various document-level NMT models have shown significant improvements, there nonetheless exist three main problems: 1) compared with sentence-level translation tasks, the data for training robust document-level models are relatively low-resourced; 2) experiments in previous work are conducted on their own datasets which vary in size, domain and language; 3) proposed approaches are implemented on distinct NMT architectures such as recurrent neural networks (RNNs) and self-attention networks (SANs). In this paper, we aim to alleviate the low-resource and under-universality problems for document-level NMT. First, we collect a large number of existing document-level corpora, which covers 7 language pairs and 6 domains. In order to address resource sparsity, we construct a novel document parallel corpus in Chinese-Portuguese, which is a non-English-centred and low-resourced language pair. Besides, we implement and evaluate the commonly-cited document-level method on top of the advanced Transformer model with universal settings. Finally, we not only demonstrate the effectiveness and universality of document-level NMT, but also release the preprocessed data, source code and trained models for comparison and reproducibility.

Keywords

Corpus Discourse Neural Machine Translation Document-Level Translation

Copyright 2006-2020 © Xi'an Jiaotong-Liverpool University 苏ICP备07016150号-1 京公网安备 11010102002019号