research-article

Hypertext’s meta-history: Documenting in-conference citations, authors and keyword data, 1987-2021

Authors:

Mark W. R. Anderson,

David MillardAuthors Info & Claims

HT '22: Proceedings of the 33rd ACM Conference on Hypertext and Social Media

Pages 96 - 106

https://doi.org/10.1145/3511095.3531271

Published: 28 June 2022 Publication History

Abstract

Conferences such as ACM Hypertext have been running for many decades and the metadata on their collected publications represent a valuable scholarly meta-history on areas such as the community’s health, diversity, and changing interests. But the metadata about these papers is not readily available for analysis, and the data collection and cleaning tasks appear substantial. In this paper we attempt to explore this challenge using the ACM Hypertext series as a case study. Taking the ACM Digital Library as a starting point, and using a combination of manual and automatic methods, we have constructed and released a 3-star Open Dataset representing over 1000 publications by almost 2,500 authors. An initial analysis reveals a modestly-sized but robust conference, with a changing pattern of in-citations that co-occurs with the arrival of social media, and a relatively consistent but imbalanced gender ratio of authors that shows some signs of recent improvements. The challenges encountered included identifying discrete author names, potential issues with text retrieval from PDF, and a disparate set of author keywords that reveals an absence of a common vocabulary. These insights are the results of a hard-fought process that is made complex by an incomplete digital record and a lack of consistency in naming. This Hypertext case study thus reveals a serious shortfall in the way that scholarly activity is captured and described, and questions PDF as the primary method of recording publications. Addressing these issues would make further analysis more straightforward and would allow larger events (with orders of magnitude more data) to be analysed in a similar way.

Supplementary Material

MP4 File (HT22-3.mp4)

A video of our HT'22 Research Paper "Hypertext?s meta-history: Documenting in-conference citations, authors and keyword data, 1987-2021"

Download
79.31 MB

References

[1]

Tim Berners-Lee. 2006. Linked Data. W3C.org. https://www.w3.org/DesignIssues/LinkedData.html

[2]

Tim Berners-Lee, Wendy Hall, James Hendler, Nigel Shadbolt, and Daniel J. Weitzner. 2006. Creating a Science of the Web. Science 313, 5788 (2006), 769–771. https://doi.org/10.1126/science.1126902 arXiv:https://www.science.org/doi/pdf/10.1126/science.1126902

[3]

Mark Bernstein. 1998. Patterns of Hypertext. In Proceedings of the Ninth ACM Conference on Hypertext and Hypermedia: Links, Objects, Time and Space—Structure in Hypermedia Systems (Pittsburgh, Pennsylvania, USA). Association for Computing Machinery, New York, New York, USA, 21–29. https://doi.org/10.1145/276627.276630

Digital Library

[4]

Sylvia Beyer. 2014. Why are women underrepresented in Computer Science? Gender differences in stereotypes, self-efficacy, values, and interests and predictors of future CS course-taking and grades. Computer Science Education 24, 2–3 (2014), 153–192. arXiv:https://doi.org/10.1080/08993408.2014.963363https://doi.org/10.1080/08993408.2014.963363

[5]

Jay David Bolter and Michael Joyce. 1987. Hypertext and Creative Writing. In Proceedings of the ACM Conference on Hypertext(Chapel Hill, North Carolina, USA). Association for Computing Machinery, New York, New York, USA, 41–50. https://doi.org/10.1145/317426.317431

Digital Library

[6]

Joanne McGrath Cohoon and William Aspray. 2006. Women and Information Technology: Research on Underrepresentation. The MIT Press, Cambridge, MA, USA. 137–180 pages. https://doi.org/10.7551/mitpress/9780262033459.001.0001

[7]

J. McGrath Cohoon, Sergey Nigai, and Joseph ”Jofish” Kaye. 2011. Gender and Computing Conference Papers. Commun. ACM 54, 8 (Aug 2011), 72–80. https://doi.org/10.1145/1978542.1978561

[8]

Blaise Cronin and Cassidy R. Sugimoto. 2014. Beyond Bibliometrics: Harnessing Multidimensional Indicators of Scholarly Impact. MIT Press, Cambridge, MA, USA. 432 pages. https://doi.org/10.7551/mitpress/9445.001.0001

[9]

H. C. Davis, D. E. Millard, S. Reich, N. Bouvin, K. Grønbæk, P. J. Nürnberg, L. Sloth, U. K. Wiil, and K. Anderson. 1999. Interoperability between Hypermedia Systems: The Standardisation Work of the OHSWG. In Proceedings of the Tenth ACM Conference on Hypertext and Hypermedia (Darmstadt, Germany) (HYPERTEXT ’99). Association for Computing Machinery, New York, NY, USA, 201–202. https://doi.org/10.1145/294469.294904

[10]

Stephan Doerfel, Robert Jäschke, and Gerd Stumme. 2012. Publication Analysis of the Formal Concept Analysis Community. In Formal Concept Analysis. Springer Berlin Heidelberg, Berlin, Heidelberg, 77–95. https://doi.org/10.1007/978-3-642-29892-9_12

[11]

Eastgate Systems, Inc.2018. Tinderbox: The Tool For Notes. Eastgate.com. http://www.eastgate.com/Tinderbox/

[12]

Douglas Carl Engelbart and William K. English. 1968. A Research Center for Augmenting Human Intellect. In Proceedings of the December 9-11, 1968, Fall Joint Computer Conference, Part I. ACM, San Francisco, California New York, NY, USA, 395–410. https://doi.org/10.1145/1476589.1476645

Digital Library

[13]

Sylvain Fraïssé, Franca Garzotto, Tomas Isakowitz, Jocelyne Nanard, and Marc Nanard (Eds.). 1996. Hypermedia Design (Montpelier, France). Vol. Proceedings of the International Workshop on Hypermedia Design. Springer Science & Business Media. https://doi.org/10.1007/978-1-4471-3082-6

[14]

Yves Gingras. 2016. Bibliometrics and Research Evaluation. MIT Press, Cambridge, MA, USA. 136 pages. https://doi.org/10.7551/mitpress/10719.001.0001

[15]

Thomas Gruber. 2007. Ontology of folksonomy: A mash-up of apples and oranges. International Journal on Semantic Web and Information Systems (IJSWIS) 3, 1(2007), 1–11. https://www.igi-global.com/article/ontology-folksonomy-mash-apples-oranges/2828

[16]

Frank G. Halasz. 1987. Reflections on NoteCards: Seven Issues for the next Generation of Hypermedia Systems. In Proceedings of the ACM Conference on Hypertext (Chapel Hill, North Carolina, USA). Association for Computing Machinery, New York, NY, USA, 345–365. https://doi.org/10.1145/317426.317451

Digital Library

[17]

Frank G. Halasz. 1991. “Seven Issues”: Revisited. In Proceedings of ACM Hypertext ’91 Conference (San Antonio, Texas, USA). Association for Computing Machinery, New York, NY, USA. Closing keynote, not in Proceedings.

[18]

Frank G. Halasz. 1996. “Seven Issues”: Revisited. PARC XEROX. https://web.archive.org/web/19970605120053http://www.parc.xerox.com:80/spl/projects/halasz-keynote/1991 keynote, recovered transcript from audio; via archive.org.

[19]

Frank G. Halasz. 2001. Reflections on “Seven Issues”: Hypertext in the Era of the Web. ACM Journal of Computer Documentation (JCD) 25, 3 (2001), 109–114. https://doi.org/10.1145/507317.507328

Digital Library

[20]

Frank G. Halasz, Mayer Schwartz, Kaj Grønbæk, and Randall H. Trigg. 1994. The Dexter Hypertext Reference Model. Communications of the ACM (CACM) 37, 2 (1994), 30–39. https://doi.org/10.1145/175235.175237

Digital Library

[21]

Michael Hausenblas and James G. Kim. 2012. 5-star Open Data. W3C.org. https://5stardata.info/en/

[22]

Frode Hegland. 2018. The Future of Text. Future of Text. https://www.thefutureoftext.org

[23]

Frode Hegland. 2019. Visual-Meta: An Approach to Surfacing Metadata. In Proceedings of the 2nd International Workshop on Human Factors in Hypertext (Hof, Germany). Association for Computing Machinery, New York, NY, USA, 31–33. https://doi.org/10.1145/3345509.3349281

Digital Library

[24]

James Hendler, Nigel Shadbolt, Wendy Hall, Tim Berners-Lee, and Daniel Weitzner. 2008. Web Science: An Interdisciplinary Approach to Understanding the Web. Commun. ACM 51, 7 (jul 2008), 60–69. https://doi.org/10.1145/1364782.1364798

[25]

Diana Hicks, Paul Wouters, Ludo Waltman, Sarah De Rijcke, and Ismael Rafols. 2015. Bibliometrics: the Leiden Manifesto for research metrics. Nature News 520, 7548 (2015), 429. https://doi.org/10.1038/520429a

[26]

Luke Holman, Devi Stuart-Fox, and Cindy E. Hauser. 2018. The gender gap in science: How long until women are equally represented. PLoS biology 16, 4 (2018), e2004956. https://doi.org/10.1371/journal.pbio.2004956

[27]

Clare Hooper, Isabella Peters, and Cécile Robin. 2018. Mapping the Topics and Intellectual Structure of Web Science. The Journal of Web Science 5 (2018), 1–15. https://doi.org/10.34962/xhmm-0425

[28]

Nettie Lagace. 2016. NISO Releases Recommended Practice Covering Outputs of Its Multiyear Project in Alternative Assessment Metrics. Serials Review 42, 4 (2016), 337–338. https://doi.org/10.1080/00987913.2016.1246343

[29]

Catherine C. Marshall, Frank G. Halasz, Russell A. Rogers, and William C. Janssen, Jr. 1991. Aquanet: A Hypertext Tool to Hold Your Knowledge in Place. In Proceedings of the Third Annual ACM Conference on Hypertext (San Antonio, Texas, USA). Association for Computing Machinery, New York, NY, USA, 261–275. https://doi.org/10.1145/122974.123000

Digital Library

[30]

Catherine C. Marshall, Frank M. Shipman, III, and James H. Coombs. 1994. VIKI: Spatial Hypertext Supporting Emergent Structure. In Proceedings of the 1994 ACM European Conference on Hypermedia technology (Edinburgh, Scotland, UK). Association for Computing Machinery, New York, NY, USA, 13–23. https://doi.org/10.1145/192757.192759

Digital Library

[31]

Ray McAleese (Ed.). 1989. Hypertext: Theory Into Practice. Intellect Books, Oxford. https://www.intellectbooks.com/hypertext-1

[32]

Ray McAleese and Catherine Green (Eds.). 1990. Hypertext: State of the Art. Intellect Books, Oxford. https://www.intellectbooks.com/hypertext

[33]

David Millard. 2008. Hypertext 2008: A Great Safari (ACM SIGWEB Trip Report). ACM SIGWEB Newsletter October, 2008 (October 2008), 1–6. https://eprints.soton.ac.uk/266674/

[34]

Theodor Holm Nelson. 1968. Hypertext Implementation Notes. Archive.org. https://archive.org/details/hin68

[35]

Jakob Nielsen. 1988. Hypertext ‘87. SIGCHI Bulletin 19, 4 (1988), 27–35. https://doi.org/10.1145/43950.43953

Digital Library

[36]

Jakob Nielsen. 1990. Trip Report: Hypertext ‘89. SIGCHI Bulletin 21, 4 (1990), 52–61. https://doi.org/10.1145/379106.379121

Digital Library

[37]

NISO. 2016. Outputs of the NISO Alternative Assessment Metrics Project. Vol. NISO RP-25-2016. National Information Standards Organization (NISO), Baltimore, MD, USA. 77 pages. http://www.niso.org/publications/rp-25-2016-altmetrics

[38]

Jason Priem, Dario Taraborelli, Paul Groth, and Cameron Neylon. 2011. Altmetrics: A manifesto. Altmetrics.org. http://altmetrics.org/manifesto/

[39]

Antoine Rizk, Norbert A. Streitz, and Jacques André (Eds.). 1990. Hypertext: Concepts, Systems and Applications. Cambridge University Press. https://www.cambridge.org/gb/academic/subjects/computer-science/computing-and-society/hypertext-concepts-systems-and-applications-proceedings-first-european-conference-hypertext-inria-france-november-1990

[40]

Frank M. Shipman, III and Catherine C. Marshall. 1999. Formality Considered Harmful: Experiences, Emerging Themes, and Directions on the Use of Formal Representations in Interactive Systems. Computer Supported Cooperative Work (CSCW) 8, 4 (1999), 333–352. https://doi.org/10.1023/A:1008716330212 based on their 1993 Technical Report ISTL-CSA-94-08-02, q.v.

Digital Library

[41]

Norbert A. Streitz, Jörg Haake, Jörg Hannemann, Andreas Lemke, Wolfgang Schuler, Helge Schütt, and Manfred Thüring. 1992. SEPIA: A Cooperative Hypermedia Authoring Environment. In Proceedings of the ACM Conference on Hypertext (Milan, Italy). Association for Computing Machinery, New York, NY, USA, 11–22. https://doi.org/10.1145/168466.168479

Digital Library

[42]

Thomas Vander Wal. 2007. Folksonomy. Vvanderwal.net. https://www.vanderwal.net/essays/051130/folksonomy.pdf

[43]

Jill Walker. 2005. Feral Hypertext: When Hypertext Literature Escapes Control. In Proceedings of the Sixteenth ACM Conference on Hypertext and Hypermedia (Salzburg, Austria) (HYPERTEXT ’05). Association for Computing Machinery, New York, NY, USA, 46–53. https://doi.org/10.1145/1083356.1083366

Digital Library

[44]

Polle T. Zellweger. 1989. Scripted Documents: A Hypermedia Path Mechanism. In Proceedings of the Second Annual ACM Conference on Hypertext (Pittsburgh, Pennsylvania, USA). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/74224.74225

Digital Library

Cited By

Zhu SHaisfield RLangen BChan J(2024)Patterns of Hypertext-Augmented SensemakingProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676338(1-17)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676338
Anderson M(2024)Beyond The Page-Break: Towards Better Tools for Remediation of Born-Digital DocumentsProceedings of the 35th ACM Conference on Hypertext and Social Media10.1145/3648188.3678215(70-77)Online publication date: 10-Sep-2024
https://dl.acm.org/doi/10.1145/3648188.3678215
Grigar DHegland FThompson AAnderson M(2024)Demonstration of The Future of Text in XR: Year 1Proceedings of the 35th ACM Conference on Hypertext and Social Media10.1145/3648188.3677047(316-317)Online publication date: 10-Sep-2024
https://dl.acm.org/doi/10.1145/3648188.3677047
Show More Cited By

Recommendations

Systematic examination of pre‐ and post‐retraction citations
ABSTRACT
Scientific retractions occur for a multitude of reasons. A growing body of research has studied the phenomenon of retraction through systematic analyses of the characteristics of retracted articles and their associated citations. In our study, ...
Don't Dream It, See It: A Live Demo of The Microcosm Hypertext System
HUMAN '21: Proceedings of the 4th Workshop on Human Factors in Hypertext

Here we revisit hypertexts as found before the Web became its current established form. One such system from that time is 'Microcosm', which was initially developed at the University of Southampton in UK from the late-1980s to the late-1990s. Microcosm ...
Feral hypertext: when hypertext literature escapes control
HYPERTEXT '05: Proceedings of the sixteenth ACM conference on Hypertext and hypermedia

This paper presents a historical view of hypertext looking at pre-web hypertext as a domesticated species bred in captivity, and arguing that on the web, some breeds of hypertext have gone feral. Feral hypertext is no longer tame and domesticated, but ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HT '22: Proceedings of the 33rd ACM Conference on Hypertext and Social Media

June 2022

272 pages

ISBN:9781450392334

DOI:10.1145/3511095

General Chairs:
Alejandro Bellogín
Universidad Autonoma de Madrid, Spain
,
Ludovico Boratto
University of Cagliari, Italy
,
Program Chair:
Federica Cena
University of Torino, Italy

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 June 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

HT '22

Sponsor:

HT '22: 33rd ACM Conference on Hypertext and Social Media

June 28 - July 1, 2022

Barcelona, Spain

Acceptance Rates

Overall Acceptance Rate 378 of 1,158 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
107
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)2

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhu SHaisfield RLangen BChan J(2024)Patterns of Hypertext-Augmented SensemakingProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676338(1-17)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676338
Anderson M(2024)Beyond The Page-Break: Towards Better Tools for Remediation of Born-Digital DocumentsProceedings of the 35th ACM Conference on Hypertext and Social Media10.1145/3648188.3678215(70-77)Online publication date: 10-Sep-2024
https://dl.acm.org/doi/10.1145/3648188.3678215
Grigar DHegland FThompson AAnderson M(2024)Demonstration of The Future of Text in XR: Year 1Proceedings of the 35th ACM Conference on Hypertext and Social Media10.1145/3648188.3677047(316-317)Online publication date: 10-Sep-2024
https://dl.acm.org/doi/10.1145/3648188.3677047
Brooker S(2024)Navigating Intersections: Negotiating language and collaboration in hypertext scholarshipProceedings of the 35th ACM Conference on Hypertext and Social Media10.1145/3648188.3675158(148-152)Online publication date: 10-Sep-2024
https://dl.acm.org/doi/10.1145/3648188.3675158
Anderson MMillard D(2023)Seven HypertextsProceedings of the 34th ACM Conference on Hypertext and Social Media10.1145/3603163.3609048(1-15)Online publication date: 4-Sep-2023
https://dl.acm.org/doi/10.1145/3603163.3609048
Rowberry S(2023)Historiographies of HypertextProceedings of the 34th ACM Conference on Hypertext and Social Media10.1145/3603163.3609038(1-10)Online publication date: 4-Sep-2023
https://dl.acm.org/doi/10.1145/3603163.3609038

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents