research-article

Overall quality assessment of SKOS thesauri

Authors:

Alfonso Quarati,

Riccardo Albertoni, and

Monica De MartinoAuthors Info & Claims

Journal of Information Science, Volume 43, Issue 6

Pages 816 - 834

https://doi.org/10.1177/0165551516671079

Published: 01 December 2017 Publication History

Abstract

The article proposes a methodology for a thesauri quality assessment that supports decision-makers in selecting thesauri by exploiting an overall quality measure. This measure takes into account the subjective perceptions of the decision-maker according to the reuse of thesauri in a specific application context. The analytic hierarchy process methodology is adopted to capture both subjective and objective facets involved in the thesauri quality assessment, thus providing a ranking of the thesauri assessed. Our methodology is applied to a set of thesauri by using user-driven application contexts. A step-by-step explanation of how the approach supports the decision process in the creation, maintenance and exploitation of a framework of linked thesauri is provided.

References

[1]

{1} Hodge G. Systems of knowledge organization for digital libraries: beyond traditional authority files. Council on Library and Information Resources Publications, <ext-link ext-link-type="uri" xlink:href="http://www.clir.org/pubs/reports/reports/pub91/pub91.pdf">http://www.clir.org/pubs/reports/reports/pub91/pub91.pdf</ext-link>2000.

[2]

{2} Shiri AA, Revie C, Chowdhury G. Thesaurus-enhanced search interfaces. J Inf Sci2002; Volume 28 Issue 2: pp.111-–122.

[3]

{3} Albertoni R, De Martino M, Di Franco S . EARTh: an environmental application reference thesaurus in the linked open data cloud. Semant Web J2014; Volume 5 Issue 2: pp.165-–171.

Digital Library

[4]

{4} Caracciolo C, Stellato A, Morshed A . The AGROVOC linked dataset. Semant Web J2012; Volume 4 Issue 2: pp.341-–348.

Digital Library

[5]

{5} Zapilko B, Schaible J, Mayr P . TheSoz: a SKOS representation of the thesaurus for the social sciences. Semant Web J2013; Volume 4 Issue 3: pp.257-–263.

Digital Library

[6]

{6} Miles A, Bechhofer S. W3C recommendation: simple knowledge organization system reference, <ext-link ext-link-type="uri" xlink:href="http://www.w3.org/TR/skos-reference">http://www.w3.org/TR/skos-reference</ext-link>2009.

[7]

{7} Berners-Lee T. Linked data, <ext-link ext-link-type="uri" xlink:href="http://www.w3.org/DesignIssues/LinkedData.html">http://www.w3.org/DesignIssues/LinkedData.html</ext-link>2009.

[8]

{8} Heath T, Bizer C . Linked data: evolving the web into a global data space. Morgan & Claypool, 2011. San Rafael, California USA.

Digital Library

[9]

{9} De Martino M, Albertoni R . A multilingual/multicultural semantic-based approach to improve Data Sharing in a SDI for Nature Conservation. Int J Spat Data Infrastuct Res2011; Volume 6 : pp.206-–233.

[10]

{10} Abecker A, Albertoni R, De Martino M . Latest developments of the linked thesaurus framework for the environment LusTRE. In: Proceedings of the 29th EnviroInfo 2015 conference, Copenhagen, 7-9 September 2015.

[11]

{11} Palavitsinis N, Manouselis N . A survey of knowledge organization systems in environmental sciences. In: Proceedings of the 4th international ICSC symposium ITEE 2009, Thessaloniki</conf-loc>, 28-29 May 2009, pp. pp.505-–517. <conf-loc>Berlin: Springer.

[12]

{12} Albertoni R, De Martino M, Podestà P . Environmental thesauri under the lens of reusability. In: Proceedings of the EGOVIS 2014 conference, Munich</conf-loc>, 1-3 September 2014, Volume vol. 8650, pp. pp.222-–236. <conf-loc>Cham: Springer.

[13]

{13} Zaveri A, Rula A, Maurino A . Quality assessment for linked open data: a survey. Semant Web J2016; Volume 7 Issue 1: pp.63-–93.

[14]

{14} Suominen O, Mader C. Assessing and improving the quality of SKOS vocabularies. J Data Semant2013; Volume 3 : pp.47-–73.

[15]

{15} Saaty TL. The analytic hierarchy process. New York: McGraw-Hill, 1980.

[16]

{16} Bawden D, Robinson L. The dark side of information overload, anxiety and other paradoxes and pathologies. J Inf Sci2009; Volume 35 Issue 2: pp.180-–191.

Digital Library

[17]

{17} Ouzzani M, Papotti P, Rahm E. Introduction to the special issue on data quality. Inform Syst2013; Volume 38 : pp.885-–886.

Digital Library

[18]

{18} Wang RY, Strong D. Beyond accuracy: what data quality means to data consumers. J Manage Inform Syst1996; Volume 12 Issue 4: pp.5-–34.

Digital Library

[19]

{19} Tayi GK, Ballou DP. Examining data quality. Commun ACM1998; Volume 41 Issue 2: pp.54-–57.

Digital Library

[20]

{20} Bordogna G, Carrara P, Criscuolo L . A linguistic decision making approach to assess the quality of volunteer geographic information for citizen science. Inform Sciences2014; Volume 258 : pp.312-–327.

Digital Library

[21]

{21} Juran JM. Quality control handbook. 3rd ed.New York: McGraw-Hill, 1974.

[22]

{22} Bizer C, Cyganiak R. Quality-driven information filtering using the WIQA policy framework. J Web Semant2009; Volume 7 Issue 1: pp.1-–10.

[23]

{23} Naumann F. Quality-driven query answering for integrated information systems. Lect Notes Comput Sc2002; Volume 2261 : pp.1-–166.

[24]

{24} Redman TC. Data quality for the information age. London: Artech House, 1997.

Digital Library

[25]

{25} Delone WH, McLean ER. Information systems success: the quest for the dependent variable. Inform Syst Res1992; Volume 3 Issue 1: pp.60-–95.

Digital Library

[26]

{26} Pirsig R. Zen and the art of motocycle maintenance. New York: Bantam Books, 1974.

[27]

{27} Batini C, Cappiello C, Francalanci C . Methodologies for data quality assessment and improvement. ACM Comput Surv2009; Volume 41 Issue 3: pp.16-1-–16-52.

Digital Library

[28]

{28} Kim KS, Sin SCJ . Selecting quality sources: bridging the gap between the perception and use of information sources. J Inf Sci2011; Volume 37 Issue 2: pp.178-–188.

Digital Library

[29]

{29} Naumann F. Information quality: fundamentals, techniques, and use. EDBT Tutorial, <ext-link ext-link-type="uri" xlink:href="http://www.hpi.uni-potsdam.de/fileadmin/hpi/FG_Naumann/publications/EDBT06Tutorial_IQ.pdf">http://www.hpi.uni-potsdam.de/fileadmin/hpi/FG_Naumann/publications/EDBT06Tutorial_IQ.pdf</ext-link>2006.

[30]

{30} DeMarco T. Controlling software projects: management measurement and estimation. New York: Yourdon, 1982.

[31]

{31} Guéret C, Groth P, Stadler C . Assessing linked data mappings using network measures. In: Proceedings of the 9th extended semantic web conference ESWC, Heraklion, 27-31 May 2012, Volume vol. 7295, pp. pp.87-–102. Berlin: Springer.

Digital Library

[32]

{32} Albertoni R, Gómez-Pérez A . Assessing linkset quality for complementing third-party datasets. In: Proceedings of the joint EDBT/ICDT 2013 workshops, Genoa, 18-22 March 2013, pp. pp.52-–59. ACM: New York.

Digital Library

[33]

{33} Kontokostas D, Zaveri A, Auer S . TripleCheckMate: a tool for crowdsourcing the quality assessment of linked data. In: Proceedings of the 4th conference on knowledge engineering and semantic web, St. Petersburg, Russia, 7-9 October 2013.

[34]

{34} Demartini G, Difallah DE, Cudré-Mauroux P. Large-scale linked data integration using probabilistic reasoning and crowdsourcing. Int J Very Larg Data Bases2013; Volume 22 Issue 5: pp.665-–687.

Digital Library

[35]

{35} Debattista J, Lange C, Sören A . LUZZU - a framework for linked data quality assessment CoRR abs/1412.3750, <ext-link ext-link-type="uri" xlink:href="http://arxiv.org/abs/1412.3750">http://arxiv.org/abs/1412.3750</ext-link>2015.

[36]

{36} Kless D, Milton S . Towards quality measures for evaluating thesauri Communications in computer and information science. In: Proceedings of the 4th metadata and semantics research conference MTSR 2010, Alcalá de Henares, 20-22 October 2010, Volume vol. 108, pp. pp.312-–319. Berlin: Springer.

[37]

{37} Albertoni R, De Martino M, Podestà P. A linkset quality metric measuring multilingual gain in SKOS thesauri. In: Proceedings of the 2nd workshop on linked data quality co-located with 12th extended semantic web conference ESWC 2015, 2015. 01 June 2015, Portorož;, Slovenia.

[38]

{38} Sabbah T, Selamat A, Ashraf M . Effect of thesaurus size on schema matching quality. Knowl Based Syst2014; Volume 71 : pp.211-–226.

Digital Library

[39]

{39} Mader C, Haslhofer B, Isaac A. Finding quality issues in SKOS vocabularies Lecture notes in computer science. In: Proceedings of the second international conference on theory and practice of digital libraries TPDL 2012, Paphos, 23-27 September 2012, Volume vol. 7489, pp. pp.222-–233. Berlin: Springer.

Digital Library

[40]

{40} Suominen O, Hyvönen E . Improving the quality of SKOS vocabularies with Skosify Lecture notes in computer science. In: Proceedings of the 18th international conference on knowledge engineering and knowledge management EKAW 2012, Galway, 8-12 October 2012, Volume vol. 7603, pp. pp.383-–397. Berlin: Springer.

Digital Library

[41]

{41} Pipino L, Lee Y, Wang R. Data quality assessment. Commun ACM2002; Volume 45 Issue 4: pp.211-–218.

[42]

{42} Jiménez Martín A, Suárez-Figueroa MC, Mateos Caballero A . A Maut approach for reusing domain ontologies on the basis of the NeOn methodology. Int J Inf Tech Decis2013; Volume 12 Issue 5: pp.945-–968.

[43]

{43} Lozano-Tello A, Gómez-Pérez A. ONTOMETRIC: a method to choose the appropriate ontology. J Database Manage2004; Volume 2 Issue 15: pp.1-–18.

[44]

{44} Guarino N, Welty C. Evaluating ontological decisions with OntoClean. Commun ACM2002; Volume 45 Issue 2: pp.61-–65.

Digital Library

[45]

{45} Hwang SH, Kim HG, Yang HS . A FCA-based ontology construction for the design of class hierarchy. In: Proceedings of the computational science and its applications ICCSA, Singapore, 9-12 May 2005, pp. pp.307-–320. Berlin: Springer.

Digital Library

[46]

{46} . Guidelines for multilingual thesauri. IFLA professional reports, Report no. 115, <ext-link ext-link-type="uri" xlink:href="http://www.ifla.org/files/assets/hq/publications/professional-report/115.pdf">http://www.ifla.org/files/assets/hq/publications/professional-report/115.pdf</ext-link>2009.

[47]

{47} Bergamin G, Lucarelli A. The Nuovo soggettario as a service for the linked data world. Ital J Libr Arch Inf Sci2013; Volume 4 Issue 1: pp.213-–226.

[48]

{48} Suominen O, Pessala S, Tuominen J . Deploying national ontology services: from ONKI to Finto. In: Proceedings of the ISWC 2014 industry track, Trentino, 19-23 October 2014.

[49]

{49} International Society on Multiple Criteria Decision Making. Mission of the society, <ext-link ext-link-type="uri" xlink:href="http://www.mcdmsociety.org/content/mission-society">http://www.mcdmsociety.org/content/mission-society</ext-link> .

[50]

{50} Kazimieras Zavadskasa E, Turskisa Z, Kildienė S. State of art surveys of overviews on MCDM-MADM methods. Technol Econ Dev Eco2014; Volume 20 Issue 1: pp.165-–179.

[51]

{51} Triantaphyllou E, Shu B, Sanchez SN . Multi-criteria decision making: an operations research approach. Encycl Electr Electron Eng1998; Volume 15 : pp.175-–186.

[52]

{52} Hwang CL, Yoon K. Multiple attribute decision making: methods and applications. New York: Springer-Verlag, 1981.

[53]

{53} Roy B. Classement et choix en présence de points de vue multiples la méthode ELECTRE. Rev d'Informatique Rech Op1968; Volume 8 : pp.57-–75.

[54]

{54} Roy B. The optimisation problem formulation: criticism and overstepping. J Oper Res Soc1981; Volume 32 Issue 6: pp.427-–436.

[55]

{55} Ishizaka A, Pearman C, Nemery P. AHPSort: an AHP-based method for sorting problems. Int J Prod Res2012; Volume 50 Issue 17: pp.4767-–4784.

[56]

{56} Vaidyaa OS, Kumar S. Analytic hierarchy process: an overview of applications. Eur J Oper Res2006; Volume 169 Issue 1: pp.1-–29.

[57]

{57} Forman EH, Selly MA . Decision by objectives, <ext-link ext-link-type="uri" xlink:href="http://professorforman.com/DecisionByObjectives/DBO.pdf">http://professorforman.com/DecisionByObjectives/DBO.pdf</ext-link> .

[58]

{58} Mustajoki J, Marttunen M. Comparison of multi-criteria decision analytical software: searching for ideas for developing a new EIA-specific multi-criteria software. IMPERIA project report, <ext-link ext-link-type="uri" xlink:href="http://imperia.jyu.fi/tuotokset/Annex7.5.13ComparisonofMultiCriteriaDecisionAnalyticalSoftware.pdf">http://imperia.jyu.fi/tuotokset/Annex7.5.13ComparisonofMultiCriteriaDecisionAnalyticalSoftware.pdf</ext-link>2013.

[59]

{59} Mesarovic MD, Macko D. Foundations for a scientific theory of hierarchical systems. Hierarchical structures. New York: Elsevier, 1969, pp. pp.29-–50.

[60]

{60} Saaty TL. A scaling method for priorities in hierarchical structures. J Math Psychol1977; Volume 15 : pp.234-–281.

[61]

{61} Saaty TL, Vargas LG. Comparison of eigenvalue, logarithmic least squares and least squares methods in estimating ratios. Math Mod1984; Volume 5 : pp.309-–324.

[62]

{62} Saaty TL, Vargas LG. The seven pillars of the analytic hierarchy process International series in operations research & management science 175. In: Saaty TL, Vargas G eds Models, methods, concepts & applications of the analytic hierarchy process. New York: Springer Science+Business Media, 2012, pp. pp.23-–40.

[63]

{63} Haslhofer B, Martins F, Magalhães J . Using SKOS vocabularies for improving web search. In: Proceedings of the 22nd international conference on world wide web WWW '13 companion, Rio de Janeiro, Brazil, 13-17 May 2013, pp. pp.1253-–1258. New York: ACM.

Digital Library

[64]

{64} Saaty TL. The fundamentals of decision making and priority theory with the analytic hierarchy process. Pittsburgh: RWS Publications, 2011.

[65]

{65} Von Solms SH . Validity of the AHP/ANP: comparing apples and oranges. Int J Anal Hierar Process2011; Volume 3 Issue 1: pp.2-–27.

[66]

{66} Saaty TL. Reflections and projections on creativity in operations research and management science: a pressing need for a shift in paradigm. Oper Res1998; Volume 46 Issue 1: pp.9-–16.

Digital Library

[67]

{67} Triantaphyllou E, Sanchez A. A sensitivity analysis approach for some deterministic multi-criteria decision-making methods. Decision Sci1997; Volume 28 Issue 1: pp.151-–194.

[68]

{68} Masuda T. Hierarchical sensitivity analysis of the priorities used in the analytic hierarchy process. Syst Sci1990; Volume 21 Issue 2: pp.415-–427.

Cited By

Quarati A(2023)Open Government DataJournal of Information Science10.1177/0165551521102777549:4(887-910)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1177/01655515211027775
Quarati ARaffaghelli J(2022)Do researchers use open research data? Exploring the relationships between usage trends and metadata quality across scientific disciplines from the Figshare caseJournal of Information Science10.1177/016555152096104848:4(423-448)Online publication date: 1-Aug-2022
https://dl.acm.org/doi/10.1177/0165551520961048

Recommendations

Streamlining Vocabulary Conversion to SKOS: A YAML-Based Approach to Facilitate Participation in the Semantic Web
Web Engineering
Abstract
Controlled vocabularies, such as classification schemes, glossaries, taxonomies, or thesauri, play an important role in many Web services. One of the main areas of application of controlled vocabularies is the domain of information retrieval ...
Read More
A method to convert thesauri to SKOS
ESWC'06: Proceedings of the 3rd European conference on The Semantic Web: research and applications

Thesauri can be useful resources for indexing and retrieval on the Semantic Web, but often they are not published in RDF/OWL. To convert thesauri to RDF for use in Semantic Web applications and to ensure the quality and utility of the conversion a ...
Read More
PoolParty: SKOS thesaurus management utilizing linked data
ESWC'10: Proceedings of the 7th international conference on The Semantic Web: research and Applications - Volume Part II

Building and maintaining thesauri are complex and laborious tasks. PoolParty is a Thesaurus Management Tool (TMT) for the Semantic Web, which aims to support the creation and maintenance of thesauri by utilizing Linked Open Data (LOD), text-analysis and ...
Read More

Comments

Information & Contributors

Information

Published In

cover image Journal of Information Science

Journal of Information Science Volume 43, Issue 6

12 2017

143 pages

ISSN:0165-5515

Issue’s Table of Contents

Copyright © © The Authors 2016.

Publisher

Sage Publications, Inc.

United States

Publication History

Published: 01 December 2017

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Other Metrics

View Author Metrics

Citations

Cited By

Quarati A(2023)Open Government DataJournal of Information Science10.1177/0165551521102777549:4(887-910)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1177/01655515211027775
Quarati ARaffaghelli J(2022)Do researchers use open research data? Exploring the relationships between usage trends and metadata quality across scientific disciplines from the Figshare caseJournal of Information Science10.1177/016555152096104848:4(423-448)Online publication date: 1-Aug-2022
https://dl.acm.org/doi/10.1177/0165551520961048

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents