research-article

The quest for quality tags

Authors:

F. Maxwell Harper,

John RiedlAuthors Info & Claims

GROUP '07: Proceedings of the 2007 ACM International Conference on Supporting Group Work

Pages 361 - 370

https://doi.org/10.1145/1316624.1316678

Published: 04 November 2007 Publication History

Abstract

Many online communities use tags - community selected words or phrases - to help people find what they desire. The quality of tags varies widely, from tags that capture akey dimension of an entity to those that are profane, useless, or unintelligible. Tagging systems must often select a subset of available tags to display to users due to limited screen space. Because users often spread tags they have seen, selecting good tags not only improves an individual's view of tags, it also encourages them to create better tags in the future. We explore implicit (behavioral) and explicit (rating) mechanisms for determining tag quality. Based on 102,056 tag ratings and survey responses collected from 1,039 users over 100 days, we offer simple suggestions to designers of online communities to improve the quality of tags seen by their users.

References

[1]

A. Arnt and S. Zilberstein. Learning to perform moderation in online forums. Web Intelligence, 2003. WI 2003. Proceedings. IEEE/WIC International Conference on, pages 637--641, 2003.

Digital Library

[2]

S. Asch. Studies of independence and conformity: A minority of one against a unanimous majority. Psychological Monographs, 70, 1956.

[3]

M. Balabanovic and Y. Shoham. Content-based, collaborative recommendation. Communications of the ACM, 40(3):66--72, 1997.

Digital Library

[4]

V. Bouthors and O. Dedieu. Pharos, a collaborative infrastructure for web knowledge sharing. In ECDL, pages 215--233, London, UK, 1999. Springer-Verlag.

Digital Library

[5]

C. Carson and V. Ogle. Storage and Retrieval of Feature Data for a Very Large Online Image Collection. Data Engineering Bulletin, 19(4):1927, 1996.

[6]

C. Cattuto, V. Loreto, and L. Pietronero. Semiotic dynamics in online social communities. In The European Physical Journal C (accepted). Springer-Verlag, 2006.

[7]

D. Cosley, D. Frankowski, S. Kiesler, L. Terveen, and J. Riedl. How oversight improves member-maintained communities. In Proceedings of CHI 2005, pages 11--20, New York, NY, 2005. ACM Press.

Digital Library

[8]

D. Cosley, D. Frankowski, L. Terveen, and J. Riedl. Using intelligent task routing and contribution review to help communities build artifacts of lasting value. In Proceedings of ACM CHI, Montreal, CA, 2006.

Digital Library

[9]

T. Dietterich. Ensemble methods in machine learning. Lecture Notes in Computer Science, 1857:115, 2000.

Digital Library

[10]

E. Frank and G. Paynter. Predicting Library of Congress classifications from Library of Congress subject headings. Journal of the American Society for Information Science and Technology, 55(3):214--227, 2004.

Digital Library

[11]

N. Glance, D. Arregui, and M. Dardenne. Knowledge pump: Supporting the flow and use of knowledge. In Information Technology for Knowledge Management. Springer-Verlag, 1998.

[12]

S. Golder and B. A. Huberman. The structure of collaborative tagging systems. Journal of Information Science (accepted), 2006.

[13]

C. Lampe and P. Resnick. Slash (dot) and Burn: Distributed Moderation in a Large Online Conversation Space. Proceedings of SIGCHI, pages 543--550.

Digital Library

[14]

G. MacGregor and E. McCulloch. Collaborative tagging as a knowledge organisation and resource discovery tool. Library View (accepted), 55(5), 2006.

[15]

D. Millen, J. Feinberg, and B. Kerr. Social bookmarking in the enterprise. ACM Queue, 3(9):2835, 2005.

Digital Library

[16]

P. Schmitz. Inducing ontology from flickr tags. Collaborative Web Tagging Workshop at WWW2006, Edinburgh, Scotland, May, 2006.

[17]

S. Sen, S. K. Lam, A. M. Rashid, D. Cosley, D. Frankowski, J. Osterhouse, F. M. Harper, and J. Riedl. tagging, communities, vocabulary, evolution. In Proceedings of the ACM 2006 Conference on CSCW, Banff, Alberta, Canada, 2006.

Digital Library

[18]

C. Shirky. Ontology is overrated. http://www.shirky.com/writings/ontology overrated.html, 2005. Retrieved on May 26, 2007.

[19]

J. Voss. Measuring wikipedia. In Proceedings of the International Conference of the International Society for Scientometrics and Informetrics, Stockholm, Sweden, 2005.

Cited By

Kotkov DMedlar AMaslov ASatyal UNeovius MGlowacka DElsweiler DKruschwitz ULudwig B(2022)The Tag Genome Dataset for BooksProceedings of the 2022 Conference on Human Information Interaction and Retrieval10.1145/3498366.3505833(353-357)Online publication date: 14-Mar-2022
https://dl.acm.org/doi/10.1145/3498366.3505833
Radlinski FBalog KDiaz FDixon LWedin BAmigo ECastells PGonzalo JCarterette BCulpepper JKazai G(2022)On Natural Language User Profiles for Transparent and Scrutable RecommendationProceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3477495.3531873(2863-2874)Online publication date: 6-Jul-2022
https://dl.acm.org/doi/10.1145/3477495.3531873
Quamar ALei CMiller DOzcan FKreulen JMoore REfthymiou VMaier DPottinger RDoan ATan WAlawini ANgo H(2020)An Ontology-Based Conversation System for Knowledge BasesProceedings of the 2020 ACM SIGMOD International Conference on Management of Data10.1145/3318464.3386139(361-376)Online publication date: 11-Jun-2020
https://dl.acm.org/doi/10.1145/3318464.3386139
Show More Cited By

Index Terms

The quest for quality tags
1. Human-centered computing
  1. Collaborative and social computing
  2. Human computer interaction (HCI)

Recommendations

Learning to recognize valuable tags
IUI '09: Proceedings of the 14th international conference on Intelligent user interfaces

Many websites use tags as a mechanism for improving item metadata through collective user effort. Users of tagging systems often apply far more tags to an item than a system can display. These tags can range in quality from tags that capture a key facet ...
Visualizing Tags with Spatiotemporal References
IV '11: Proceedings of the 2011 15th International Conference on Information Visualisation

Nowadays, a great amount of data is created and distributed on the Internet. Tagging has become common practice to structure these data for easy access. Often the data and the associated tags contain spatial and temporal information. In this paper, we ...
Content-Based Tag Generation for the Grouping of Tags
ELML '09: Proceedings of the 2009 International Conference on Mobile, Hybrid, and On-line Learning

A tagging system can encounter too few or too many tags. To solve these problems, we propose a content-based automatic generation of tags. Applied to an e-Learning 2.0 application, the proposal creates tags based on lecture slide contents, generating an ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

GROUP '07: Proceedings of the 2007 ACM International Conference on Supporting Group Work

November 2007

422 pages

ISBN:9781595938459

DOI:10.1145/1316624

General Chairs:
Tom Gross
Bauhaus-University Weimar, Germany
,
Kori Inkpen
Dalhousie University, Canada

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 November 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

GROUP07

Sponsor:

GROUP07: ACM 2007 International Conference on Supporting Group Work

November 4 - 7, 2007

Florida, Sanibel Island, USA

Acceptance Rates

Overall Acceptance Rate 125 of 405 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

54
Total Citations
View Citations
821
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)3

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kotkov DMedlar AMaslov ASatyal UNeovius MGlowacka DElsweiler DKruschwitz ULudwig B(2022)The Tag Genome Dataset for BooksProceedings of the 2022 Conference on Human Information Interaction and Retrieval10.1145/3498366.3505833(353-357)Online publication date: 14-Mar-2022
https://dl.acm.org/doi/10.1145/3498366.3505833
Radlinski FBalog KDiaz FDixon LWedin BAmigo ECastells PGonzalo JCarterette BCulpepper JKazai G(2022)On Natural Language User Profiles for Transparent and Scrutable RecommendationProceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3477495.3531873(2863-2874)Online publication date: 6-Jul-2022
https://dl.acm.org/doi/10.1145/3477495.3531873
Quamar ALei CMiller DOzcan FKreulen JMoore REfthymiou VMaier DPottinger RDoan ATan WAlawini ANgo H(2020)An Ontology-Based Conversation System for Knowledge BasesProceedings of the 2020 ACM SIGMOD International Conference on Management of Data10.1145/3318464.3386139(361-376)Online publication date: 11-Jun-2020
https://dl.acm.org/doi/10.1145/3318464.3386139
Balog KRadlinski FArakelyan SPiwowarski BChevalier MGaussier EMaarek YNie JScholer F(2019)Transparent, Scrutable and Explainable User Models for Personalized RecommendationProceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3331184.3331211(265-274)Online publication date: 18-Jul-2019
https://dl.acm.org/doi/10.1145/3331184.3331211
Gattupalli VZhuo YLi B(2019)Weakly Supervised Deep Image Hashing Through Tag Embeddings2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR.2019.01062(10367-10376)Online publication date: Jun-2019
https://doi.org/10.1109/CVPR.2019.01062
Lian TDu LZhao MCui CChen ZMa J(2019)Evaluating and improving the interpretability of item embeddings using item-tag relevance informationFrontiers of Computer Science: Selected Publications from Chinese Universities10.1007/s11704-019-7427-714:3Online publication date: 19-Dec-2019
https://dl.acm.org/doi/10.1007/s11704-019-7427-7
Zhang YMa XWan SAbbas HGuizani M(2018)CrossRecMobile Networks and Applications10.1007/s11036-018-1112-123:6(1610-1623)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1007/s11036-018-1112-1
Kaufman GFlanagan MPunjasthitkul SKaye JDruin ALampe CMorris DHourcade J(2016)Investigating the Impact of 'Emphasis Frames' and Social Loafing on Player Motivation and Performance in a Crowdsourcing GameProceedings of the 2016 CHI Conference on Human Factors in Computing Systems10.1145/2858036.2858588(4122-4128)Online publication date: 7-May-2016
https://dl.acm.org/doi/10.1145/2858036.2858588
Suh HOh JYoon W(2016)Which Tags Do We Remember in Personal Information Management?International Journal of Human-Computer Interaction10.1080/10447318.2016.118129132:7(568-583)Online publication date: 2-May-2016
https://doi.org/10.1080/10447318.2016.1181291
Hajibayova LJacob E(2016)An investigation of the levels of abstraction of tags across three resource genresInformation Processing and Management: an International Journal10.1016/j.ipm.2016.05.00552:6(1178-1187)Online publication date: 1-Nov-2016
https://dl.acm.org/doi/10.1016/j.ipm.2016.05.005
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten