research-article

Evaluating the quality of linked open data in digital libraries

Authors:

Gustavo Candela,

Pilar Escobar, Rafael C Carrasco, Manuel Marco-SuchAuthors Info & Claims

Journal of Information Science, Volume 48, Issue 1

Pages 21 - 43

https://doi.org/10.1177/0165551520930951

Published: 01 February 2022 Publication History

Abstract

Cultural heritage institutions have recently started to share their metadata as Linked Open Data (LOD) in order to disseminate and enrich them. The publication of large bibliographic data sets as LOD is a challenge that requires the design and implementation of custom methods for the transformation, management, querying and enrichment of the data. In this report, the methodology defined by previous research for the evaluation of the quality of LOD is analysed and adapted to the specific case of Resource Description Framework (RDF) triples containing standard bibliographic information. The specified quality measures are reported in the case of four highly relevant libraries.

References

[1]

Berners-Lee T, Hendler J, and Lassila O. The semantic web in scientific American. Scientific American Magazine, May 2001, p. 284.

[2]

World Wide Web Consortium (W3C). Resource description framework (RDF), http://www.w3.org/RDF (2014, accessed 10 July 2018).

[3]

World Wide Web Consortium (W3C). SPARQL query language for RDF, https://www.w3.org/TR/rdf-sparql-query/ (2008, accessed 10 July 2018).

[4]

Marden J, Li-Madeo C, and Whysel N, et al. Linked open data for cultural heritage: evolution of an information technology. In: Proceedings of the 31st ACM international conference on design of communication (ed Albers MJ and Gossett K), Greenville, NC, 30 September–1 October 2013, pp. 107–112. New York: ACM.

[5]

Candela G, Escobar P, and Carrasco RC, et al. A linked open data framework to enhance the discoverability and impact of culture heritage. J Inform Sci 2019; 45(6): 756–766.

Digital Library

[6]

Jett J, Cole TW, and Han MK, et al. Linked open data (LOD) for library special collections. In: 2017 ACM/IEEE joint conference on digital libraries, JCDL 2017, Toronto, ON, Canada, 19–23 June 2017, pp. 309–310. New York: ACM.

[7]

Mika P, Tudorache T, and Bernstein A, et al. (eds.). The semantic web – ISWC 2014 – 13th international semantic web conference, Riva del Garda, Italy, October 19–23, 2014. Proceedings, Part I (Lecture Notes in Computer Science), vol. 8796. Cham: Springer, 2014.

[8]

Auer S, Bizer C, and Kobilarov G, et al. DBpedia: a nucleus for a web of open data. In: Aberer K, Choi K, and Noy NF. (eds) The semantic web, 6th international semantic web conference, 2nd Asian semantic web conference, ISWC 2007 + ASWC 2007, Busan, Korea, November 11–15, 2007 (Lecture Notes in Computer Science), vol. 4825. Berlin: Springer, pp. 722–735.

[9]

Tanon TP, Vrandecic D, and Schaffert S, et al. From freebase to Wikidata: the great migration. In: Proceedings of the 25th international conference on world wide web, WWW 2016 (ed Bourdeau J, Hendler J, and Nkambou R, et al.), Montreal, QC, Canada, 11–15 April 2016, pp. 1419–1428. New York: ACM.

[10]

Rebele T, Suchanek FM, and Hoffart J, et al. YAGO: a multilingual knowledge base from Wikipedia, WordNet, and GeoNames. In: Groth PT, Simperl E, and Gray AJG. (eds) The semantic web – ISWC 2016 – 15th international semantic web conference, Kobe, Japan, October 17-21, 2016, Proceedings, Part II (Lecture Notes in Computer Science), vol. 9982. Cham: Springer, pp. 177–185.

[11]

Ehrlinger L and Wöß W. Towards a definition of knowledge graphs. In: Joint proceedings of the posters and demos track of the 12th international conference on semantic systems – SEMANTiCS2016 and the 1st international workshop on semantic change & evolving semantics (SuCCESS’16) co-located with the 12th international conference on semantic systems (SEMANTiCS 2016) (ed Martin M, Cuquet M, and Folmer E), Leipzig, 12–15 September 2016, CEUR workshop proceedings, vol. 1695, http://ceur-ws.org/Vol-1695/paper4.pdf

[12]

Adamou A, Brown S, and Barlow H, et al. Crowdsourcing linked data on listening experiences through reuse and enhancement of library data. Int J Dig Lib 2019; 20(1): 61–79.

Digital Library

[13]

Achichi M, Lisena P, and Todorov K, et al. DOREMUS: a graph of linked musical works. In: The semantic web – ISWC 2018 – 17th international semantic web conference, Monterey, CA, 8–12 October 2018, Proceedings, Part II, pp. 3–19. Cham: Springer.

[14]

Debattista J, Lange C, and Auer S, et al. Evaluating the quality of the LOD cloud: an empirical investigation. Semantic Web 2018; 9(6): 859–901.

Digital Library

[15]

Färber M, Bartscherer F, and Menne C, et al. Linked data quality of DBpedia, Freebase, OpenCyc, Wikidata, and YAGO. Semantic Web 2018; 9(1): 77–129.

Digital Library

[16]

Joint Steering Committee for Revision of AACR. Anglo-American cataloguing rules. 2nd ed. Ottawa, Chicago: American Library Association Canadian Library Association, 1998.

[17]

Standing Committee of the IFLA Cataloguing Section. International standard bibliographic description (ISBD). De Gruyter Saur: IFLA, 2011.

[18]

IFLA. IFLA study group on the FRBR. Functional requirements for bibliographic records. München: IFLA Series on Bibliographic Control, 1998.

[19]

RDA Steering Committee. RDA toolkit: resource description and access, http://www.rdatoolkit.org (2012, accessed 19 November 2018).

[20]

Aalberg T and Zumer M. Looking for entities in bibliographic records. In: Buchanan G, Masoodian M, and Cunningham SJ (eds) Digital libraries: universal and ubiquitous access to information, 11th international conference on Asian Digital Libraries, ICADL 2008, Bali, Indonesia, December 2–5, 2008. Proceedings (Lecture Notes in Computer Science), vol. 5362. Berlin: Springer, pp. 327–330.

[21]

Vila-Suero D, Villazón-Terrazas B and Gómez-Pérez A. datos.bne.es: a library linked dataset. Semantic Web 2013; 4(3): 307–313.

Digital Library

[22]

Candela G, Escobar P, and Carrasco RC, et al. Migration of a library catalogue into RDA linked open data. Semantic Web 2018; 9(4): 481–491.

Digital Library

[23]

Waagmeester A, Willighagen EL, and Queralt-Rosinach N, et al. Linking Wikidata to the rest of the semantic web. In: Proceedings of the 9th international conference semantic web applications and tools for life sciences, Amsterdam, 5–8 December 2016. http://ceur-ws.org/Vol-1795/paper46.pdf

[24]

Wikidata. SPARQL federation input/Archive. https://www.wikidata.org/wiki/Wikidata:SPARQL_federation_input/Archive (2017, accessed 10 July 2018).

[25]

Sim SE, Easterbrook SM, and Holt RC. Using benchmarking to advance research: a challenge to software engineering. In Proceedings of the 25th international conference on software engineering, Portland, OR, 3–10 May 2003, pp. 74–83. New York: IEEE.

[26]

Heckman SS and Williams L. On establishing a benchmark for evaluating static analysis alert prioritization and classification techniques. In: Proceedings of the second international symposium on empirical software engineering and measurement, ESEM 2008, Kaiserslautern, 9–10 October 2008, pp. 41–50. New York: ACM.

[27]

Spahiu B, Maurino A, and Meusel R. Topic profiling benchmarks in the linked open data cloud: issues and lessons learned. Semantic Web 2019; 10(2): 329–348.

Digital Library

[28]

Piscopo A. Wikidata: requests for comment/data quality framework for Wikidata, https://www.wikidata.org/wiki/Wikidata:Requests_for_comment/Data_quality_framework_for_Wikidata (2016, accessed 11-February-2018).

[29]

Radulovic F, Mihindukulasooriya N, and Garca-Castro R, et al. A comprehensive quality model for linked data. Semantic Web 2018; 9(1): 3–24.

Digital Library

[30]

Carrasco MH, Luján-Mora S, and Maté A, et al. Current state of linked data in digital libraries. J Inform Sci 2016; 42(2): 117–127.

[31]

Mitchell ET. Library linked data: early activity and development. Lib Technol Rep 2016; 52(1): 5–13.

[32]

Shen G and Liu G. The selection of benchmarking partners for value management: an analytic approach. Int J Construct Manage 2014; 7: 11–22.

[33]

IFLA Information Technology Section, IFLA Semantic Web Special Interest Group and Bibliothèque nationale de France. We grew up together: data.bnf.fr from the BnF and Logilab perspectives. Paris: Bibliothèque nationale de France, Petit auditorium: IFLA Information Technology Section; IFLA Semantic Web Special Interest Group; Bibliothèque nationale de France, 2014, http://ifla2014-satdata.bnf.fr/program.html

[34]

Hillmann D and Dunsire Phipps GJ. FRBR entities for RDA vocabulary, 2014, http://rdvocab.info/uri/schema/FRBRentitiesRDA

[35]

Bibliothèque nationale de France. Subject reference systems. RAMEAU, 1980, http://www.bnf.fr/en/professionals/anx_cataloging_indexing/a.subject_reference_systems.html

[36]

British Library. Basic RDF/XML, http://www.bl.uk/bibliographic/datafree.html#basicrdfxml (2014, accessed 8 November 2018).

[37]

RDA Steering Committee. RDA registry, http://www.rdaregistry.info/ (2015, accessed 11 February 2018).

[38]

Wang RY and Strong DM. Beyond accuracy: what data quality means to data consumers. J Manage Inf Sys 1996; 12(4): 5–33, http://www.jmis-web.org/articles/1002

[39]

Beall J. Metadata and data quality problems in the digital library. J Digit Inf 2005; 6(3), http://journals.tdl.org/jodi/article/view/65

[40]

World Wide Web Consortium (W3C). W3C RDF validation service, 2006, https://www.w3.org/RDF/Validator/

[41]

Gordon Dunsire. ISBD elements, http://metadataregistry.org/schemaprop/show/id/2128.html (2015, accessed 4 April 2018).

[42]

Online Computer Library Center. The virtual international authority file, 2012, https://viaf.org/

[43]

Zaveri A, Rula A, and Maurino A, et al. Quality assessment for linked data: a survey. Semantic Web 2016; 7(1): 63–93.

[44]

World Wide Web Consortium (W3C). PROV-O: the PROV ontology, https://www.w3.org/TR/prov-o/ (2013, accessed 1 August 2018).

[45]

Mecella M, Scannapieco M, and Virgillito A, et al. Managing data quality in cooperative information systems. In: On the move to meaningful internet systems, 2002 – DOA/CoopIS/ODBASE 2002 confederated international conferences DOA, CoopIS and ODBASE 2002, Irvine, CA, 30 October–1 November 2002, pp. 486–502. Berlin: Springer.

[46]

Shreeves SL, Knutson E, and Stvilia B, et al. Is quality metadata shareable metadata? The implications of local metadata practices for federated collections, https://www.ideals.illinois.edu/bitstream/handle/2142/145/shreeves05.pdf

[47]

Cooper MD and Chen H. Predicting the relevance of a library catalog search. JASIST 2001; 52(10): 813–827.

Digital Library

[48]

Pipino L, Lee YW, and Wang RY. Data quality assessment. Commun ACM 2002; 45(4): 211–218.

Digital Library

[49]

Gonçalves MA, Moreira BL, and Fox EA, et al. ‘what is a good digital library?’ A quality model for digital libraries. Inf Process Manage 2007; 43(5): 1416–1437.

Digital Library

[50]

World Wide Web Consortium (W3C). Notation3 (n3): a readable RDF syntax, https://www.w3.org/TeamSubmission/n3/ (2011, accessed 13 November 2018).

[51]

World Wide Web Consortium (W3C). Semantic integration & interoperability using RDF and OWL, https://www.w3.org/2001/sw/BestPractices/OEP/SemInt/ (2005, accessed 4 September 2019).

[52]

World Wide Web Consortium (W3C). Describing linked datasets with the void vocabulary, https://www.w3.org/TR/void/ (2011, accessed 19 February 2018).

[53]

Etalab. Open platform for French public data, http://data.bnf.fr/docs/Licence-Ouverte-Open-Licence-ENG.pdf (2011, accessed 1 March 2018).

Cited By

Candela GCuper MHolownia OGabriëls NDobreva MMahey M(2024)A Systematic Review of Wikidata in GLAM Institutions: a Labs ApproachLinking Theory and Practice of Digital Libraries10.1007/978-3-031-72440-4_4(34-50)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1007/978-3-031-72440-4_4
Stork LZijdeman RTiddi Iten Teije A(2024)Enabling Social Demography Research Using Semantic TechnologiesThe Semantic Web10.1007/978-3-031-60635-9_12(199-216)Online publication date: 26-May-2024
https://dl.acm.org/doi/10.1007/978-3-031-60635-9_12
Paneva-Marinova DGoynov MZhelev YMonova-Zheleva MMitreva ELuchev DPavlov RPavlova L(2023)Full-fledged Access and Usability of Content in Digital Cultural Heritage Library: Approaches, Paradigms and ImplementationJournal on Computing and Cultural Heritage 10.1145/3631135Online publication date: 6-Nov-2023
https://dl.acm.org/doi/10.1145/3631135
Show More Cited By

Index Terms

Evaluating the quality of linked open data in digital libraries

Index terms have been assigned to the content through auto-classification.

Recommendations

Linked data publishing and ontology in Korea libraries
DCMI'18: Proceedings of the 2018 International Conference on Dublin Core and Metadata Applications

This poster was to analyze three linked open data (LOD) services in Korea in an aspect of ontology, and to suggest three LOD to transform their local ontology to BIBFRAME as a measure for interoperability of LOD. For this study, literature review and ...
Retrieving and ranking scientific publications from linked open data repositories
i-KNOW '14: Proceedings of the 14th International Conference on Knowledge Technologies and Data-driven Business

Content enrichment of publications stored in different cross domain Digital Libraries can facilitate the scholarly communication in big way. However, current DL still entails limitation of interoperability between cross domain repositories. This paper ...
Current state of Linked Data in digital libraries

The Semantic Web encourages institutions, including libraries, to collect, link and share their data across the Web in order to ease its processing by machines to get better queries and results. Linked Data technologies enable us to connect related data ...

Comments

Information & Contributors

Information

Published In

cover image Journal of Information Science

Journal of Information Science Volume 48, Issue 1

Feb 2022

136 pages

ISSN:0165-5515

Issue’s Table of Contents

© The Author(s) 2020.

Publisher

Sage Publications, Inc.

United States

Publication History

Published: 01 February 2022

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Candela GCuper MHolownia OGabriëls NDobreva MMahey M(2024)A Systematic Review of Wikidata in GLAM Institutions: a Labs ApproachLinking Theory and Practice of Digital Libraries10.1007/978-3-031-72440-4_4(34-50)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1007/978-3-031-72440-4_4
Stork LZijdeman RTiddi Iten Teije A(2024)Enabling Social Demography Research Using Semantic TechnologiesThe Semantic Web10.1007/978-3-031-60635-9_12(199-216)Online publication date: 26-May-2024
https://dl.acm.org/doi/10.1007/978-3-031-60635-9_12
Paneva-Marinova DGoynov MZhelev YMonova-Zheleva MMitreva ELuchev DPavlov RPavlova L(2023)Full-fledged Access and Usability of Content in Digital Cultural Heritage Library: Approaches, Paradigms and ImplementationJournal on Computing and Cultural Heritage 10.1145/3631135Online publication date: 6-Nov-2023
https://dl.acm.org/doi/10.1145/3631135
Blin IStork LSpillner LSantagiustina C(2023)OKG: A Knowledge Graph for Fine-grained Understanding of Social Media Discourse on InequalityProceedings of the 12th Knowledge Capture Conference 202310.1145/3587259.3627557(166-174)Online publication date: 5-Dec-2023
https://dl.acm.org/doi/10.1145/3587259.3627557
Candela G(2023)An automatic data quality approach to assess semantic data from cultural heritage institutionsJournal of the Association for Information Science and Technology10.1002/asi.2476174:7(866-878)Online publication date: 21-Apr-2023
https://dl.acm.org/doi/10.1002/asi.24761
Kusu KKomamizu THatano K(2022)Towards Efficient Data Access Through Multiple Relationship in Graph-Structured Digital ArchivesFrom Born-Physical to Born-Virtual: Augmenting Intelligence in Digital Libraries10.1007/978-3-031-21756-2_29(377-391)Online publication date: 30-Nov-2022
https://dl.acm.org/doi/10.1007/978-3-031-21756-2_29
Bernasconi ECeriani MMecella MMorvillo A(2022)Automatic Knowledge Extraction from a Digital Library and Collaborative ValidationLinking Theory and Practice of Digital Libraries10.1007/978-3-031-16802-4_49(480-484)Online publication date: 20-Sep-2022
https://dl.acm.org/doi/10.1007/978-3-031-16802-4_49

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents