Yvette Graham, Timothy Baldwin, Alistair Moffat,
and Justin Zobel. 2015. Can machine transla-
tion systems be evaluated by the crowd alone.
Natural Language Engineering 23(1):3–30.
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and
Jian Sun. 2016. Deep residual learning for image
recognition. In IEEE Conference on Computer
Vision and Pattern Recognition. pages 770–778.
Jindrich Helcl and Jindrich Libovický. 2017. CUNI
System for the WMT17 Multimodal Translation
Task. In Proceedings of the Second Conference
on Machine Translation, Volume 2: Shared Task
Papers. pages 450–457.
Julian Hitschler, Shigehiko Schamoni, and Stefan
Riezler. 2016. Multimodal Pivots for Image Cap-
tion Translation. In 54th Annual Meeting of
the Association for Computational Linguistics.
pages 2399–2409.
Alan Jaffe. 2017. Generating Image Descriptions
using Multilingual Data. In Proceedings of the
Second Conference on Machine Translation, Vol-
ume 2: Shared Task Papers. pages 458–464.
Douwe Kiela. 2016. MMFeat: A toolkit for ex-
tracting multi-modal features. In Proceedings of
ACL-2016 System Demonstrations. pages 55–60.
Mert Kilickaya, Aykut Erdem, Nazli Ikizler-Cinbis,
and Erkut Erdem. 2017. Re-evaluating automatic
metrics for image captioning. In Proceedings of
EACL 2017. pages 199–209.
Philipp Koehn, Hieu Hoang, Alexandra Birch,
Chris Callison-Burch, Marcello Federico, Nicola
Bertoldi, Brooke Cowan, Wade Shen, Christine
Moran, Richard Zens, et al. 2007. Moses: Open
source toolkit for statistical machine translation.
In 45th Annual meeting of Association for Com-
putational Linguistics. pages 177–180.
D.T. Le, R. Bernardi, and J.R.R. Uijlings. 2014.
TUHOI: Trento Universal Human Object Inter-
action Dataset. In Vision and Language Work-
shop at the 26th International Conference on
Computational Linguistics.
Xirong Li, Weiyu Lan, Jianfeng Dong, and Hailong
Liu. 2016. Adding chinese captions to images. In
Proceedings of the 2016 ACM on International
Conference on Multimedia Retrieval. pages 271–
275.
Jindrich Libovický and Jindrich Helcl. 2017. At-
tention strategies for multi-source sequence-to-
sequence learning. CoRR abs/1704.06567.
Tsung-Yi Lin, Michael Maire, Serge J. Belongie,
Lubomir D. Bourdev, Ross B. Girshick, James
Hays, Pietro Perona, Deva Ramanan, Piotr
Dollár, and C. Lawrence Zitnick. 2014. Mi-
crosoft COCO: common objects in context.
CoRR abs/1405.0312.
Minh-Thang Luong, Hieu Pham, and Christo-
pher D Manning. 2015. Effective approaches
to attention-based neural machine translation. In
Proceedings of the 2015 Conference on Empir-
ical Methods in Natural Language Processing.
pages 1412–1421.
Mingbo Ma, Dapeng Li, Kai Zhao, and Liang
Huang. 2017. OSU Multimodal Machine Trans-
lation System Report. In Proceedings of the
Second Conference on Machine Translation, Vol-
ume 2: Shared Task Papers. pages 465–469.
Pranava Swaroop Madhyastha, Josiah Wang, and
Lucia Specia. 2017. Sheffield MultiMT: Using
Object Posterior Predictions for Multimodal Ma-
chine Translation. In Proceedings of the Second
Conference on Machine Translation, Volume 2:
Shared Task Papers. pages 470–476.
Takashi Miyazaki and Nobuyuki Shimizu. 2016.
Cross-lingual image caption generation. In Pro-
ceedings of the 54th Annual Meeting of the As-
sociation for Computational Linguistics. pages
1780–1790.
Franz Josef Och. 2003. Minimum error rate train-
ing in statistical machine translation. In 41st An-
nual Meeting on Association for Computational
Linguistics. Sapporo, Japan, pages 160–167.
Kishore Papineni, Salim Roukos, Todd Ward, and
Wei-Jing Zhu. 2002. Bleu: A method for au-
tomatic evaluation of machine translation. In
40th Annual Meeting on Association for Compu-
tational Linguistics. pages 311–318.
Janarthanan Rajendran, Mitesh M Khapra, Sarath
Chandar, and Balaraman Ravindran. 2016.
Bridge correlational neural networks for mul-
tilingual multimodal representation learning. In
Proceedings of the 2016 Conference of the North
American Chapter of the Association for Com-
putational Linguistics: Human Language Tech-
nologies. pages 171–181.
Olga Russakovsky, Jia Deng, Hao Su, Jonathan
Krause, Sanjeev Satheesh, Sean Ma, Zhi-
heng Huang, Andrej Karpathy, Aditya Khosla,
Michael Bernstein, Alexander C. Berg, and