Common Contracts
2 similar Research and Development contracts
AbstractResearch and Development • November 8th, 2022
The attentional mechanism has proven to be ef- fective in improving end-to-end neural machine translation. However, due to the intricate struc- tural divergence between natural languages, unidi- rectional attention-based models might only cap- ture partial aspects of attentional regularities. We propose agreement-based joint training for bidirec- tional attention-based end-to-end neural machine translation. Instead of training source-to-target and target-to-source translation models independently, our approach encourages the two complementary models to agree on word alignment matrices on the same training data. Experiments on Chinese- English and English-French translation tasks show that agreement-based joint training significantly improves both alignment and translation quality over independent training.
Institute for Interdisciplinary Information Sciences, Tsinghua University, Beijing, ChinaResearch and Development • April 19th, 2016
The attentional mechanism has proven to be ef- fective in improving end-to-end neural machine translation. However, due to the intricate struc- tural divergence between natural languages, unidi- rectional attention-based models might only cap- ture partial aspects of attentional regularities. We propose agreement-based joint training for bidirec- tional attention-based end-to-end neural machine translation. Instead of training source-to-target and target-to-source translation models independently, our approach encourages the two complementary models to agree on word alignment matrices on the same training data. Experiments on Chinese- English and English-French translation tasks show that agreement-based joint training significantly improves both alignment and translation quality over independent training.
