Publications of the Bergamot Project

Backtranslation Feedback Improves User Confidence in MT, Not Quality. Vilém Zouhar, Michal Novák, Matúš Žilinec, Ondřej Bojar, Mateo Obregón, Robin L. Hill, Frédéric Blain, Marina Fomicheva, Lucia Specia, Lisa Yankovskaya. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021.
COSTRA 1.0: A Dataset of Complex Sentence Transformations. Petra Barancikova, Ondřej Bojar. Proceedings of The 12th Language Resources and Evaluation Conference, 2020.
CUNI Submission for Low-Resource Languages in WMT News 2019. Tom Kocmi, Ondřej Bojar. Proceedings of the Fourth Conference on Machine Translation (Volume 2: Shared Task Papers, Day 1), 2019.
CUNI System for the WMT19 Robustness Task. Jindřich Helcl, Jindřich Libovický, Martin Popel. Proceedings of the Fourth Conference on Machine Translation (Volume 2: Shared Task Papers, Day 1), 2019.
Character Mapping and Ad-hoc Adaptation: Edinburgh’s IWSLT 2020 Open Domain Translation System. Pinzhen Chen, Nikolay Bogoychev, Ulrich Germann. Proceedings of the 17th International Conference on Spoken Language Translation, 2020.
Compressing Neural Machine Translation Models with 4-bit Precision. Alham Fikri Aji, Kenneth Heafield. Proceedings of the Fourth Workshop on Neural Generation and Translation, 2020.
Costra 1.1: An Inquiry into Geometric Properties of Sentence Spaces. Petra Barančı́ková, Ondřej Bojar. Proceedings of the 23nd International Conference on Text, Speech and Dialogue - TSD 2020, 2020.
Edinburgh’s Submissions to the 2020 Machine Translation Efficiency Task. Nikolay Bogoychev, Roman Grundkiewicz, Alham Fikri Aji, Maximiliana Behnke, Kenneth Heafield, Sidharth Kashyap, Emmanouil-Ioannis Farsarakis, Mateusz Chudyk. Proceedings of the Fourth Workshop on Neural Generation and Translation, 2020.
Efficiently Reusing Old Models Across Languages via Transfer Learning. Tom Kocmi, Ondřej Bojar. Proceedings of the 22st Annual Conference of the European Association for Machine Translation (2020), 2020.
End-to-End Lexically Constrained Machine Translation for Morphologically Rich Languages. Josef Jon, João Paulo Aires, Dusan Varis, Ondrej Bojar. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP 2021, (Volume 1: Long Papers), Virtual Event, August 1-6, 2021, 2021.
Expand and Filter: CUNI and LMU Systems for the WNGT 2020 Duolingo Shared Task. Jindřich Libovický, Zdeněk Kasner, Jindřich Helcl, Ondřej Dušek. Proceedings of the Fourth Workshop on Neural Generation and Translation, 2020.
Exploring Benefits of Transfer Learning in Neural Machine Translation. Tom Kocmi. PhD thesis, 2019.
Findings of the 2019 Conference on Machine Translation (WMT19). Loı̈c Barrault, Ondřej Bojar, Marta R. Costa-jussà, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn, Shervin Malmasi, Christof Monz, Mathias Müller, Santanu Pal, Matt Post, Marcos Zampieri. Proceedings of the Fourth Conference on Machine Translation (Volume 2: Shared Task Papers, Day 1), 2019.
Findings of the Fourth Workshop on Neural Generation and Translation. Kenneth Heafield, Hiroaki Hayashi, Yusuke Oda, Ioannis Konstas, Andrew Finch, Graham Neubig, Xian Li, Alexandra Birch. Proceedings of the Fourth Workshop on Neural Generation and Translation, 2020.
Findings of the WMT 2019 Shared Tasks on Quality Estimation. Erick Fonseca, Lisa Yankovskaya, André F. T. Martins, Mark Fishel, Christian Federmann. Proceedings of the Fourth Conference on Machine Translation (Volume 3: Shared Task Papers, Day 2), 2019.
From Research to Production and Back: Ludicrously Fast Neural Machine Translation. Young Jin Kim, Marcin Junczys-Dowmunt, Hany Hassan, Alham Fikri Aji, Kenneth Heafield, Roman Grundkiewicz, Nikolay Bogoychev. Proceedings of the 3rd Workshop on Neural Generation and Translation, 2019.
Multi-Hypothesis Machine Translation Evaluation. Marina Fomicheva, Lucia Specia, Francisco Guzmán. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020.
Multimodal Quality Estimation for Machine Translation. Shu Okabe, Frédéric Blain, Lucia Specia. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020.
Outbound Translation User Interface Ptakopět: A Pilot Study. Vilém Zouhar, Ondřej Bojar. Proceedings of The 12th Language Resources and Evaluation Conference, 2020.
Quality Estimation and Translation Metrics via Pre-trained Word and Sentence Embeddings. Elizaveta Yankovskaya, Andre Tättar, Mark Fishel. Proceedings of the Fourth Conference on Machine Translation (Volume 3: Shared Task Papers, Day 2), 2019.
Quality In, Quality Out: Learning from Actual Mistakes. Frédéric Blain, Nikolaos Aletras, Lucia Specia. Proceedings of the 22nd Annual Conference of the European Association for Machine Translation (EAMT 2020), 2020.
Replacing Linguists with Dummies: A Serious Need for Trivial Baselines in Multi-Task Neural Machine Translation. Daniel Kondratyuk, Ronald Cardenas, Ondřej Bojar. The Prague Bulletin of Mathematical Linguistics, 2019.
SAO WMT19 Test Suite: Machine Translation of Audit Reports. Tereza Vojtěchová, Michal Novák, Miloš Klouček, Ondřej Bojar. Proceedings of the Fourth Conference on Machine Translation (Volume 2: Shared Task Papers, Day 1), 2019.
The University of Edinburgh’s Submissions to the WMT19 News Translation Task. Rachel Bawden, Nikolay Bogoychev, Ulrich Germann, Roman Grundkiewicz, Faheem Kirefu, Antonio Valerio Miceli Barone, Alexandra Birch. Proceedings of the Fourth Conference on Machine Translation (Volume 2: Shared Task Papers, Day 1), 2019.
University of Tartu’s Multilingual Multi-domain WMT19 News Translation Shared Task Submission. Andre Tättar, Elizaveta Korotkova, Mark Fishel. Proceedings of the Fourth Conference on Machine Translation (Volume 2: Shared Task Papers, Day 1), 2019.
Unsupervised Quality Estimation for Neural Machine Translation. Marina Fomicheva, Shuo Sun, Lisa Yankovskaya, Frédéric Blain, Francisco Guzmán, Mark Fishel, Nikolaos Aletras, Vishrav Chaudhary, Lucia Specia. Transactions of the Association for Computational Linguistics, 2020.

Partner Publications Relevant to the Bergamot Project

University of Edinburgh

TranslateLocally: Blazing-fast translation running on the local CPU, Nikolay Bogoychev, Jelmer Van der Linde, Kenneth Heafield. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, Punta Cana, Dominican Republic. 2021
Not all parameters are born equal: Attention is mostly what you need, Nikolay Bogoyche. In Proceedings of the Fourth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP, Punta Cana, Dominican Republic, 2021.
The University of Edinburgh’s Neural MT Systems for WMT17, Rico Sennrich, Alexandra Birch, Anna Currey, Ulrich Germann, Barry Haddow, Kenneth Heafield, Antonio Valerio Miceli Barone, and Philip Williams. In Proceedings of the EMNLP 2017 Second Conference on Machine Translation (WMT17), 2017.
Marian: Fast Neural Machine Translation in C++, Marcin Junczys-Dowmunt, Roman Grundkiewicz, Tomasz Dwojak, Hieu Hoang, Kenneth Heafield, Tom Neckermann, Frank Seide, Ulrich Germann, Alham Fikri Aji, Nikolay Bogoychev, Andre ́ F. T. Martins, and Alexandra Birch.
Improving Neural Machine Translation Models with Monolingual Data, Rico Sennrich,Barry Haddow,Alexandra Birch, Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2016.
Sparse Communication for Distributed Gradient Descent, Alham Fikri Aji, Kenneth Heafield, Conference on Empirical Methods in Natural Language Processing, 2017.
Regularization techniques for fine-tuning in neural machine translation, Antonio Valerio Miceli Barone, Barry Haddow, Ulrich Germann, and Rico Sennrich. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, 2017.

Charles University

Neural Monkey: An Open-source Tool for Sequence Learning, Jindřich Helcl, Jindřich Libovický. In The Prague Bulletin of Mathematical Linguistics, 2017.
CUNI System for WMT16 Automatic Post-Editing and Multimodal Translation Tasks, Jindřich Libovický, Jindřich Helcl, Marek Tlustý, Pavel Pecina, Ondřej Bojar. In Proceedings of the First Conference on Machine Translation (WMT). Volume 2: Shared Task Papers, 2016
CUNI System for WMT17 Automatic Post-Editing Task, Dušan Variš, Ondřej Bojar. In Proceedings of the Second Conference on Machine Translation, Volume 2: Shared Task Papers, 2017
CUNI Submission in WMT17: Chimera Goes Neural, Ondřej Bojar, Tom Kocmi, David Mareček, Roman Sudarikov and Dušan Variš. In Proceedings of the EMNLP 2017 Second Conference on Machine Translation, 2017
Attention Strategies for Multi-Source Sequence-to-Sequence Learning, Jindřich Libovický, Jindřich Helcl. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2017

University of Sheffield

Combining Quality Estimation And Automatic Post-editing to Enhance Machine Translation output, Rajen Chatterjee, Matteo Negri, Marco Turchi, Frédéric Blain, Lucia Specia, in Proceedings of the 13th Biennial Conference of the Association for Machine Translation in the America. 2018
Bilexical Embeddings for Quality Estimation, Frédéric Blain, Carolina Scarton, Lucia Specia, in Proceedings of the Second Conference on Machine Translation, Volume 3: Shared Task Papers. 2017
Exploring Hypothesis Spaces in Neural Machine Translation, Frédéric Blain, Lucia Specia, Pranava S. Madhyastha, in Proceedings of the Machine Translation Summit XVI. 2017
Phrase Level Segmentation and Labelling of Machine Translation Errors, Frédéric Blain, Varvara Logacheva, Lucia Specis, in Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC), Portoro, Slovenia, 2016.
Multi-level Translation Quality Prediction with QuEst++, Lucia Specia, Gustavo Henrique Paetzold and Carolina Scarton. In the Proceedings of ACL-IJCNLP 2015 System Demonstrations, Beijing, China, pp. 110-120. 2015.

University of Tartu

Confidence through Attention, Matīss Rikters and Mark Fishel, in Proceedings of MT Summit XVI, 2017, pp. 299–311
Open-Source Neural Machine Translation API Server, Sander Tars, Kaspar Papli, Dmytro Chasovskyi, Mark Fishel, the Prague Bulletin of Mathematical Linguistics 109, 2017, pp. 5–14
Linear Ensembles of Word Embedding Models, Avo Muromägi, Kairit Sirts and Sven Laur, Proceedings of the 21st Nordic Conference on Computational Linguistics NoDaLiDa, 2017, pp. 96–104
Machine Translation for Subtitling: A Large-Scale Evaluation, Lindsay Bywood, Thierry Etchegoyhen, Yota Georgakopoulou, Mark Fishel, Jie Jiang, Gerard Loenhout, Arantza Pozo, Anja Turner, Martin Volk, Mirjam Maucec, Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC’14), 2014, pp. 46–53