Cross-collection Linking of Botanical Imagery in Ghent Altarpiece to Learn More about Van Eyck’s Masterpiece and to Explore a Region’s Plant Richness and Diversity over Time
Authors: 
Krishna Kumar Thirukokaranam Chandrasekar, Emile Deman, Steven VerstocktAuthors Info & Claims
Krishna Kumar Thirukokaranam Chandrasekar, Emile Deman, Steven VerstocktAuthors Info & ClaimsArticle No.: 40, Pages 1 - 14
Abstract
As people on average only spent 20 seconds(s) observing an artwork, they mostly miss a lot of informative details that are contained within it. As an example, the 75 different plants that can be found in the Ghent Altarpiece is something not a lot of people are aware of. Within this article, we present a methodology, based on cross-collection linking, to create awareness about the botanical imagery in Van Eyck’s masterpiece and to inform people about their region’s plant richness and diversity over time. As such, this article is a nice example of how the interdisciplinary fields of cultural heritage and botany can go hand in hand to facilitate its dissemination to the general public. The plants in the painting can be queried by their name or by a picture taken with a mobile device—a plant recognition app is used to evaluate the pictures taken from the plants. A study has also been performed to evaluate these apps and to select the most appropriate one for the collection of plants in the Ghent Alterpiece. Currently, we link the detected plants to herbaria, observation data, Global Biodiversity Information Facility plantinfo, and recent wikimedia commons pictures, but other links can also be easily integrated with the platform. Finally, we also studied nowadays plant observations (volunteered geographic information) in more detail and reveal which region currently has most of Van Eyck’s plants/flowers.
References
[1]
Eneko Agirre, Ander Barrena, Oier Lopez De Lacalle, Aitor Soroa, Samuel Fernando, and Mark Stevenson. 2012. Matching cultural heritage items to wikipedia. In LREC. Citeseer, 1729–1735.
[2]
Pierre Barré, Ben C. Stöver, Kai F. Müller, and Volker Steinhage. 2017. LeafNet: A computer vision system for automatic plant species identification. Ecol. Inf. 40 (2017), 50–56.
[3]
Victor Boer, Jan Wielemaker, Judith Gent, Michiel Hildebrand, Antoine Isaac, Jacco Van Ossenbruggen, and Guus Schreiber. 2012. Supporting linked data production for cultural heritage institutes: The amsterdam museum case study. ACM J. Exp. Algor. (2012).
[4]
Claus-Christian Carbon. 2017. Art perception in the museum: How we spend time and space in art exhibitions. i-Perception 8, 1 (01 Feb. 2017).
[5]
Chris Dijkshoorn, Lizzy Jongma, Lora Aroyo, Jacco Van Ossenbruggen, Guus Schreiber, Wesley Ter Weele, and Jan Wielemaker. 2018. The rijksmuseum collection as linked data. Semantic Web 9, 2 (2018), 221–230.
[6]
Nuno Freire, René Voorburg, Roland Cornelissen, Sjors de Valk, Enno Meijers, and Antoine Isaac. 2019. Aggregation of linked data in the cultural heritage domain: A case study in the europeana network. Information 10, 8 (Jul. 2019), 252.
[7]
Herve Goeau, Pierre Bonnet, and Alexis Joly. 2017. Plant identification based on noisy web data: The amazing performance of deep learning (LifeCLEF 2017).
[8]
Hervé Goëau, Pierre Bonnet, and Alexis Joly. 2017. Plant identification based on noisy web data: The amazing performance of deep learning (LifeCLEF 2017). In Proceeduings of the Conference and Labs of the Evaluation Forum (CLEF’17), Vol. CEUR Workshop Proceedings. Dublin, Ireland. https://hal.archives-ouvertes.fr/hal-01629183.
[9]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Deep residual learning for image recognition. arxiv:1512.03385. Retrieved from http://arxiv.org/abs/1512.03385.
[10]
Gao Huang, Zhuang Liu, and Kilian Q. Weinberger. 2016. Densely connected convolutional networks. arxiv:1608.06993. Retrieved from http://arxiv.org/abs/1608.06993.
[11]
Alexis Joly, Hervé Goëau, Pierre Bonnet, Vera Bakić, Julien Barbe, Souheil Selmi, Itheri Yahiaoui, Jennifer Carré, Elise Mouysset, Jean-François Molino, Nozha Boujemaa, and Daniel Barthélémy. 2014. Interactive plant identification based on social image data. Ecol. Inf. 23 (2014), 22–34.
[12]
Neeraj Kumar, Peter N. Belhumeur, Arijit Biswas, David W. Jacobs, W. John Kress, Ida C. Lopez, and João V. B. Soares. 2012. Leafsnap: A computer vision system for automatic plant species identification. In Proceedings of the European Conference on Computer Vision (ECCV’12), Andrew Fitzgibbon, Svetlana Lazebnik, Pietro Perona, Yoichi Sato, and Cordelia Schmid (Eds.). Springer, Berlin, 502–516.
[13]
Mario Lasseck. 2017. Image-based plant species identification with deep convolutional neural networks. In Proceedings of the Conference and Labs of the Evaluation Forum (CLEF’17), Working Notes.
[14]
S. H. Lee, C. S. Chan, P. Wilkin, and P. Remagnino. 2015. Deep-plant: Plant identification with convolutional neural networks. In Proceedings of the IEEE International Conference on Image Processing (ICIP’15). 452–456.
[15]
Jennifer Meagher. 2007. Botanical imagery in european painting. Heilbrunn Timeline of Art History. The Metropolitan Museum of Art, New York. Retrieved from http://www.metmuseum.org/toah/hd/bota/hd_bota.htm.
[16]
Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556. Retrieved from http://arxiv.org/abs/1409.1556.
[17]
Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jonathon Shlens, and Zbigniew Wojna. 2015. Rethinking the inception architecture for computer vision. arxiv:1512.00567. Retrieved from http://arxiv.org/abs/1512.00567.
[18]
Krishna Kumar Thirukokaranam Chandrasekar, Redouane Arroubai, Gerwin Dox, Samnang Nop, Pieter Stroobant, Jeroen Stragier, Kristof De Mey, and Steven Verstockt. 2018. RUNAMIC: Dynamic generation of personalized running routes. In Proceedings of the 6th International Congress on Sport Sciences Research and Technology Support, volume 1 : icSPORTS. Science and and Technology Publications, SCITEPRESS 98–105. http://dx.doi.org/10.5220/0006889600980105.
[19]
C. Zhang, P. Zhou, C. Li, and L. Liu. 2015. A convolutional neural network for leaves recognition using data augmentation. In Proceedings of the 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing. 2143–2150.
Index Terms
- Cross-collection Linking of Botanical Imagery in Ghent Altarpiece to Learn More about Van Eyck’s Masterpiece and to Explore a Region’s Plant Richness and Diversity over Time
Recommendations
Identification of plants from multiple images and botanical IdKeys
ICMR '13: Proceedings of the 3rd ACM conference on International conference on multimedia retrievalAutomatic retrieval tools are becoming increasingly important in botany and agriculture due to the growing interest in biodiversity and the ongoing shortage of skilled taxonomists. Our work is motivated by a botanical field scenario where the basic unit ...
A machine learning approach for cross-domain plant identification using herbarium specimens
AbstractThe preservation of plant specimens in herbaria has been carried out for centuries in efforts to study and confirm plant taxa. With the increasing collection of herbaria made available digitally, it is practical to use herbarium specimens for the ...
Plant identification based on very deep convolutional neural networks
Plant identification is a critical step in protecting plant diversity. However, many existing identification systems prohibitively rely on hand-crafted features for plant species identification. In this paper, a deep learning method is employed to ...
Comments
Information & Contributors
Information
Published In
July 2021
315 pages
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 01 July 2021
Accepted: 01 March 2021
Revised: 01 January 2021
Received: 01 May 2020
Published in JOCCH Volume 14, Issue 3
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 133Total Downloads
- Downloads (Last 12 months)43
- Downloads (Last 6 weeks)1
Reflects downloads up to 26 Jul 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format