Homer restored: Virtual reconstruction of Papyrus Bodmer 1
Authors: 
Simon Perrin, Léopold Cudilla, Yejing Xie, Harold Mouchère, Isabelle Marthot-SantanielloAuthors Info & Claims
Simon Perrin, Léopold Cudilla, Yejing Xie, Harold Mouchère, Isabelle Marthot-SantanielloAuthors Info & ClaimsAbstract
In this paper, we propose a complete method to reconstruct a damaged piece of papyrus using its image annotated at the character level and the original ancient Greek text (known otherwise). Our reconstruction allows us to recreate the written surface, making it readable and consistent with the original one. Our method is in two stages. First, the text is reconstructed by pasting character patches in their possible locations. Second, we reconstruct the background of the papyrus by applying inpainting methods. Two different inpainting techniques are tested in this article, one traditional and one using a GAN.
This global reconstruction method is applied on a piece of Papyrus Bodmer 1. The results are evaluated visually by the authors of the paper and by researchers in papyrology. This reconstruction allows historians to investigate new paths on the topic of writing culture and materiality while it significantly improves the ability of non specialists to picture what this papyrus, and ancient books in general, could have looked like in Antiquity.
References
[1]
Marcelo Bertalmio, Guillermo Sapiro, Vincent Caselles, and Coloma Ballester. 2000. Image Inpainting. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques(SIGGRAPH ’00). ACM Press/Addison-Wesley Publishing Co., USA, 417–424.
[2]
Ugur Demir and Gozde Unal. 2018. Patch-based image inpainting with generative adversarial networks. arXiv preprint arXiv:1803.07422 (2018).
[3]
Tomasz Derda. 2010. P. Bodmer I Recto, A Land List from the Upper Panopolite Nome in Upper Egypt (after AD 213/4).Warsaw.
[4]
Alexei A Efros and Thomas K Leung. 1999. Texture synthesis by non-parametric sampling. In Proceedings of the seventh IEEE international conference on computer vision, Vol. 2. IEEE, 1033–1038.
[5]
Mohammad Hossein Givkashi, Mahshid Hadipour, Arezoo PariZanganeh, Zahra Nabizadeh, Nader Karimi, and Shadrokh Samavi. 2022. Image Inpainting Using AutoEncoder and Guided Selection of Predicted Pixels. In 2022 30th International Conference on Electrical Engineering (ICEE). IEEE, 700–704.
[6]
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2020. Generative adversarial networks. Commun. ACM 63, 11 (2020), 139–144.
[7]
Fabian Hollaus, Simon Brenner, and Robert Sablatnig. 2019. CNN based binarization of multispectral document images. In 2019 International Conference on Document Analysis and Recognition (ICDAR). IEEE, 533–538.
[8]
Amreen Kaur, Ankit Raj, N Jayanthi, and S Indu. 2020. Inpainting of irregular holes in a manuscript using unet and partial convolution. In 2020 Second International Conference on Inventive Research in Computing Applications (ICIRCA). IEEE, 778–784.
[9]
Yong Jun Kim, Debapriya Hazra, Yungcheol Byun, and Khi-Jung Ahn. 2019. Old document restoration using super resolution GAN and semantic image inpainting. In Proceedings of the International Workshop on Artificial Intelligence and Education. 34–38.
[10]
Wenbo Li, Zhe Lin, Kun Zhou, Lu Qi, Yi Wang, and Jiaya Jia. 2022. MAT: Mask-Aware Transformer for Large Hole Image Inpainting. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 10758–10768.
[11]
Guilin Liu, Fitsum A Reda, Kevin J Shih, Ting-Chun Wang, Andrew Tao, and Bryan Catanzaro. 2018. Image inpainting for irregular holes using partial convolutions. In Proceedings of the European conference on computer vision (ECCV). 85–100.
[12]
Hongyu Liu, Bin Jiang, Yibing Song, Wei Huang, and Chao Yang. 2020. Rethinking image inpainting via a mutual encoder-decoder with feature equalizations. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow. 725–741.
[13]
Hongyu Liu, Ziyu Wan, Wei Huang, Yibing Song, Xintong Han, and Jing Liao. 2021. Pd-gan: Probabilistic diverse gan for image inpainting. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 9371–9381.
[14]
Andreas Lugmayr, Martin Danelljan, Andres Romero, Fisher Yu, Radu Timofte, and Luc Van Gool. 2022. Repaint: Inpainting using denoising diffusion probabilistic models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 11461–11471.
[15]
Cecilia Ostertag and Marie Beurton-Aimar. 2021. Using Graph Neural Networks to Reconstruct Ancient Documents. In Pattern Recognition. ICPR International Workshops and Challenges: Virtual Event, January 10-15, 2021, Proceedings, Part VII. Springer-Verlag, Berlin, Heidelberg, 39–53.
[16]
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems 32 (2019).
[17]
Deepak Pathak, Philipp Krahenbuhl, Jeff Donahue, Trevor Darrell, and Alexei A Efros. 2016. Context encoders: Feature learning by inpainting. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2536–2544.
[18]
Antoine Pirrone. 2022. Apprentissage profond auto-supervisé de métriques : application à la prédiction d’assemblage de fragments de papyrus. Theses. Université de Bordeaux.
[19]
Ioannis Pratikakis, Konstantinos Zagoris, Xenofon Karagiannis, Lazaros Tsochatzidis, Tanmoy Mondal, and Isabelle Marthot-Santaniello. 2019. ICDAR 2019 Competition on Document Image Binarization (DIBCO 2019). In 2019 International Conference on Document Analysis and Recognition (ICDAR). 1547–1556.
[20]
Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18. Springer, 234–241.
[21]
Chitwan Saharia, William Chan, Huiwen Chang, Chris Lee, Jonathan Ho, Tim Salimans, David Fleet, and Mohammad Norouzi. 2022. Palette: Image-to-image diffusion models. In ACM SIGGRAPH 2022 Conference Proceedings. 1–10.
[22]
Yong-Goo Shin, Min-Cheol Sagong, Yoon-Jae Yeo, Seung-Wook Kim, and Sung-Jea Ko. 2020. Pepsi++: Fast and lightweight network for image inpainting. IEEE transactions on neural networks and learning systems 32, 1 (2020), 252–265.
[23]
Matthew I Swindall, Timothy Player, Ben Keener, Alex C Williams, James H Brusuelas, Federica Nicolardi, Marzia D’Angelo, Claudio Vergara, Michael McOsker, and John F Wallin. 2022. Dataset Augmentation in Papyrology with Generative Models: A Study of Synthetic Ancient Greek Character Images. In The 31st International Joint Conference on Artificial Intelligence. IJCAIECAI.
[24]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems, I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.). Vol. 30. Curran Associates, Inc.
[25]
Raymond A Yeh, Chen Chen, Teck Yian Lim, Alexander G Schwing, Mark Hasegawa-Johnson, and Minh N Do. 2017. Semantic image inpainting with deep generative models. In Proceedings of the IEEE conference on computer vision and pattern recognition. 5485–5493.
[26]
Jiahui Yu, Zhe Lin, Jimei Yang, Xiaohui Shen, Xin Lu, and Thomas Huang. 2019. Free-Form Image Inpainting With Gated Convolution. In 2019 IEEE/CVF International Conference on Computer Vision (ICCV). 4470–4479.
[27]
Yingchen Yu, Fangneng Zhan, Rongliang WU, Jianxiong Pan, Kaiwen Cui, Shijian Lu, Feiying Ma, Xuansong Xie, and Chunyan Miao. 2021. Diverse Image Inpainting with Bidirectional and Autoregressive Transformers(MM ’21). Association for Computing Machinery, New York, NY, USA, 69–78.
[28]
Shengyu Zhao, Jonathan Cui, Yilun Sheng, Yue Dong, Xiao Liang, Eric I Chang, and Yan Xu. 2021. Large scale image completion via co-modulated generative adversarial networks. arXiv preprint arXiv:2103.10428 (2021).
[29]
Nina Žižakić, Izumi Ito, Laurens Meeus, and Aleksandra Pizurica. 2019. Autoencoder-learned local image descriptor for image inpainting. In BNAIC/BENELEARN 2019, Vol. 2491.
Index Terms
- Homer restored: Virtual reconstruction of Papyrus Bodmer 1
Recommendations
Identification of Ancient Greek Papyrus Fragments Using Genetic Sequence Alignment Algorithms
E-SCIENCE '14: Proceedings of the 2014 IEEE 10th International Conference on e-Science - Volume 02Papyrologists analyze, transcribe, and edit papyrus fragments in order to enrich modern lives by better understanding the linguistics, culture, and literature of the ancient world. One of their common tasks is to match an unknown fragment to a known ...
Kinect Depth Map Inpainting using a Multi-Scale Deep Convolutional Neural Network
ICIGP '18: Proceedings of the 2018 International Conference on Image and Graphics ProcessingConsumer level RGB-D camera, such as Kinect, is one of the most important devices to get depth data of 3D vision. However, it is quite difficult to get a high-quality depth map which has the same resolution with its corresponding color image and can be ...
Virtual stonehenge reconstruction
EuroMed'12: Proceedings of the 4th international conference on Progress in Cultural Heritage PreservationVisual and spatial technologies are increasingly revolutionising how archaeology and many other disciplines understand the past in relation to the contemporary world. From digital objects to landscapes, through geophysics, geographical imaging systems ...
Comments
Information & Contributors
Information
Published In
August 2023
117 pages
ISBN:9798400708411
DOI:10.1145/3604951
Copyright © 2023 Owner/Author.
This work is licensed under a Creative Commons Attribution-NonCommercial International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 25 August 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
HIP '23
HIP '23: 7th International Workshop on Historical Document Imaging and Processing
August 25 - 26, 2023
CA, San Jose, USA
Acceptance Rates
Overall Acceptance Rate 52 of 90 submissions, 58%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 251Total Downloads
- Downloads (Last 12 months)222
- Downloads (Last 6 weeks)33
Reflects downloads up to 04 Oct 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatGet Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in