Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3576840.3578320acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article
Open access

The Evolution of Web Search User Interfaces - An Archaeological Analysis of Google Search Engine Result Pages

Published: 20 March 2023 Publication History

Abstract

Web search engines have marked everyone’s life by transforming how one searches and accesses information. Search engines give special attention to the user interface, especially search engine result pages (SERP). The well-known “10 blue links” list has evolved into richer interfaces, often personalized to the search query, the user, and other aspects. More than 20 years later, the literature has not adequately portrayed this development. We present a study on the evolution of SERP interfaces during the last two decades using Google Search as a case study. We used the most searched queries by year to extract a sample of SERP from the Internet Archive. Using this dataset, we analyzed how SERP evolved in content, layout, design (e.g., color scheme, text styling, graphics), navigation, and file size. We have also analyzed the user interface design patterns associated with SERP elements. We found that SERP are becoming more diverse in terms of elements, aggregating content from different verticals and including more features that provide direct answers. This systematic analysis portrays evolution trends in search engine user interfaces and, more generally, web design. We expect this work will trigger other, more specific studies that can take advantage of our dataset.

References

[1]
Khalil Amjad and Fadi Alrub. 2013. A comparison of search engine’s features and mechanisms. Advanced Database Systems 2131-8070580-sec1 (December 2013), 1–8.
[2]
Avishek Anand, Lawrence Cavedon, Hideo Joho, Mark Sanderson, and Benno Stein. 2020. Conversational Search (Dagstuhl Seminar 19461). Dagstuhl Reports 9, 11 (2020), 34–83. https://doi.org/10.4230/DagRep.9.11.34
[3]
The Internet Archive. 2021. The Wayback Machine’s First Crawl 1996. https://archive.org/details/wayback-machine-1996.
[4]
Jaime Arguello, Wan-Ching Wu, Diane Kelly, and Ashlee Edwards. 2012. Task Complexity, Vertical Display and User Interaction in Aggregated Search. In Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval (Portland, Oregon, USA) (SIGIR ’12). Association for Computing Machinery, New York, NY, USA, 435–444. https://doi.org/10.1145/2348283.2348343
[5]
Ricardo Baeza-Yates and Berthier Ribeiro-Neto. [n.d.]. Modern Information Retrieval: The Concepts and Technology behind Search (2nd ed.). Addison-Wesley Publishing Company, USA.
[6]
N. J. Belkin, D. Kelly, G. Kim, J.-Y. Kim, H.-J. Lee, G. Muresan, M.-C. Tang, X.-J. Yuan, and C. Cool. 2003. Query Length in Interactive Information Retrieval. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Informaion Retrieval(Toronto, Canada) (SIGIR ’03). Association for Computing Machinery, New York, NY, USA, 205–212. https://doi.org/10.1145/860435.860474
[7]
Markus Bink, Steven Zimmerman, and David Elsweiler. 2022. Featured Snippets and Their Influence on Users’ Credibility Judgements. In ACM SIGIR Conference on Human Information Interaction and Retrieval (Regensburg, Germany) (CHIIR ’22). Association for Computing Machinery, New York, NY, USA, 113–122. https://doi.org/10.1145/3498366.3505766
[8]
Deepayan Chakrabarti, Ravi Kumar, and Kunal Punera. 2009. Quicklink Selection for Navigational Query Results. In Proceedings of the 18th International Conference on World Wide Web (Madrid, Spain) (WWW ’09). Association for Computing Machinery, New York, NY, USA, 391–400. https://doi.org/10.1145/1526709.1526762
[9]
Lydia B. Chilton and Jaime Teevan. 2011. Addressing People’s Information Needs Directly in a Web Search Result Page. In Proceedings of the 20th International Conference on World Wide Web (Hyderabad, India) (WWW ’11). Association for Computing Machinery, New York, NY, USA, 27–36. https://doi.org/10.1145/1963405.1963413
[10]
Alex Chris. 2020. Top 10 Search Engines In The World (2021 Update). https://www.reliablesoft.net/top-10-search-engines-in-the-world/.
[11]
Charles L. A. Clarke, Eugene Agichtein, Susan Dumais, and Ryen W. White. 2007. The Influence of Caption Features on Clickthrough Patterns in Web Search. In Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (Amsterdam, The Netherlands) (SIGIR ’07). Association for Computing Machinery, New York, NY, USA, 135–142. https://doi.org/10.1145/1277741.1277767
[12]
European Commission. 2017. Antitrust: Commission fines Google €2.42 billion for abusing dominance as search engine by giving illegal advantage to own comparison shopping service. https://ec.europa.eu/commission/presscorner/detail/en/IP_17_1784.
[13]
Nick Craswell and Martin Szummer. 2007. Random Walks on the Click Graph. In Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval(Amsterdam, The Netherlands) (SIGIR ’07). Association for Computing Machinery, New York, NY, USA, 239–246. https://doi.org/10.1145/1277741.1277784
[14]
J. Shane Culpepper, Guglielmo Faggioli, Nicola Ferro, and Oren Kurland. 2021. Topic Difficulty: Collection and Query Formulation Effects. ACM Trans. Inf. Syst. 40, 1, Article 19 (sep 2021), 36 pages. https://doi.org/10.1145/3470563
[15]
Edward Cutrell and Zhiwei Guan. 2007. What Are You Looking for? An Eye-Tracking Study of Information Usage in Web Search. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’07). Association for Computing Machinery, New York, NY, USA, 407–416. https://doi.org/10.1145/1240624.1240690
[16]
Cristian Danescu-Niculescu-Mizil, Andrei Z. Broder, Evgeniy Gabrilovich, Vanja Josifovski, and Bo Pang. 2010. Competing for Users’ Attention: On the Interplay between Organic and Sponsored Search Results. In Proceedings of the 19th International Conference on World Wide Web (Raleigh, North Carolina, USA) (WWW ’10). Association for Computing Machinery, New York, NY, USA, 291–300. https://doi.org/10.1145/1772690.1772721
[17]
Danny Sullivan. 2020. Google’s Knowledge Graph and Knowledge Panels. https://blog.google/products/search/about-knowledge-graph-and-knowledge-panels/.
[18]
Eelke. 2012. Interaction Design Patterns. https://www.interaction-design.org/literature/book/the-glossary-of-human-computer-interaction/interaction-design-patterns.
[19]
Kristofer Franzén and Jussi Karlgren. 2000. Verbosity and Interface Design. Technical Report. Human Computer Interaction and Language Engineering Laboratory.
[20]
Zhiwei Guan and Edward Cutrell. 2007. An Eye Tracking Study of the Effect of Target Rank on Web Search. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’07). Association for Computing Machinery, New York, NY, USA, 417–420. https://doi.org/10.1145/1240624.1240691
[21]
Kevin Haas, Peter Mika, Paul Tarjan, and Roi Blanco. 2011. Enhanced Results for Web Search. In Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval (Beijing, China) (SIGIR ’11). Association for Computing Machinery, New York, NY, USA, 725–734. https://doi.org/10.1145/2009916.2010014
[22]
Marti A. Hearst. 2009. Search User Interfaces(1st ed.). Cambridge University Press, USA.
[23]
Nadine Höchstötter and Dirk Lewandowski. 2009. What users see - Structures in search engine results pages. Information Sciences 179, 12 (2009), 1796–1812. https://doi.org/10.1016/j.ins.2009.01.028
[24]
Bernard J. Jansen, Amanda Spink, and Sherry Koshman. 2007. Web Searcher Interaction with the Dogpile.com Metasearch Engine. J. Am. Soc. Inf. Sci. Technol. 58, 5 (mar 2007), 744–755.
[25]
Bernard J. Jansen, Amanda Spink, and Jan Pedersen. 2005. A temporal comparison of AltaVista Web searching. Journal of the American Society for Information Science and Technology 56, 6 (2005), 559–570. https://doi.org/10.1002/asi.20145
[26]
Thorsten Joachims, Laura Granka, Bing Pan, Helene Hembrooke, and Geri Gay. 2005. Accurately Interpreting Clickthrough Data as Implicit Feedback. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (Salvador, Brazil) (SIGIR ’05). Association for Computing Machinery, New York, NY, USA, 154–161. https://doi.org/10.1145/1076034.1076063
[27]
Joseph Johnson. 2022. Global market share of search engines 2010-2022. https://www.statista.com/statistics/216573/worldwide-market-share-of-search-engines/.
[28]
Rosie Jones, Benjamin Rey, Omid Madani, and Wiley Greiner. 2006. Generating Query Substitutions. In Proceedings of the 15th International Conference on World Wide Web (Edinburgh, Scotland) (WWW ’06). Association for Computing Machinery, New York, NY, USA, 387–396. https://doi.org/10.1145/1135777.1135835
[29]
Othar Hansson Kavi Goel, Ramanathan V. Guha. 2009. Introducing Rich Snippets. https://developers.google.com/search/blog/2009/05/introducing-rich-snippets. Accessed: 2022-10-04.
[30]
Madian Khabsa, Aidan Crook, Ahmed Hassan Awadallah, Imed Zitouni, Tasos Anastasakos, and Kyle Williams. 2016. Learning to Account for Good Abandonment in Search Success Metrics. In Proceedings of the 25th ACM International on Conference on Information and Knowledge Management(Indianapolis, Indiana, USA) (CIKM ’16). Association for Computing Machinery, New York, NY, USA, 1893–1896. https://doi.org/10.1145/2983323.2983867
[31]
Ron Kohavi, Alex Deng, Brian Frasca, Toby Walker, Ya Xu, and Nils Pohlmann. 2013. Online Controlled Experiments at Large Scale. In Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (Chicago, Illinois, USA) (KDD ’13). Association for Computing Machinery, New York, NY, USA, 1168–1176. https://doi.org/10.1145/2487575.2488217
[32]
Michael Lesk. 1997. Practical Digital Libraries: Books, Bytes, and Bucks. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
[33]
Jane Li, Scott Huffman, and Akihito Tokuda. 2009. Good Abandonment in Mobile and PC Internet Search. In Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval (Boston, MA, USA) (SIGIR ’09). Association for Computing Machinery, New York, NY, USA, 43–50. https://doi.org/10.1145/1571941.1571951
[34]
Eric Lin, Saul Greenberg, Eileah Trotter, David Ma, and John Aycock. 2011. Does Domain Highlighting Help People Identify Phishing Sites?. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 2075–2084. https://doi.org/10.1145/1978942.1979244
[35]
Chang Liu, Ying-Hsang Liu, Jingjing Liu, and Ralf Bierig. 2021. Search Interface Design and Evaluation. Foundations and Trends® in Information Retrieval 15, 3-4(2021), 243–416. https://doi.org/10.1561/1500000073
[36]
Feifei Liu. 2020. How Search Engines Shape Gaze Patterns During Information Seeking: Google vs. Baidu. https://web.archive.org/web/20220511211235/https://www.nngroup.com/articles/google-baidu-serp-comparison/.
[37]
Emma Lurie and Eni Mustafaraj. 2018. Investigating the Effects of Google’s Search Engine Result Page in Evaluating the Credibility of Online News Sources. In Proceedings of the 10th ACM Conference on Web Science (Amsterdam, Netherlands) (WebSci ’18). Association for Computing Machinery, New York, NY, USA, 107–116. https://doi.org/10.1145/3201064.3201095
[38]
Gary Marchionini. 1995. Information Seeking in Electronic Environments. Cambridge University Press, USA.
[39]
Marissa Mayer. 2017. Universal search: The best answer is still the best answer. https://googleblog.blogspot.com/2007/05/universal-search-best-answer-is-still.html. Accessed: 2022-10-04.
[40]
Kate Moran and Cami Goray. 2019. The Anatomy of a Search-Results Page. https://web.archive.org/web/20220511210638/https://www.nngroup.com/articles/anatomy-search-results-page/.
[41]
Kate Moran and Cami Goray. 2020. Good Abandonment on Search Results Pages. https://web.archive.org/web/20220511211722/https://www.nngroup.com/articles/good-abandonment/.
[42]
Kate Moran and Cami Goray. 2020. Three Key SERP Features: Featured Snippets, People Also Ask, and Knowledge Panels. https://web.archive.org/web/20220511203205/https://www.nngroup.com/articles/key-serp-features/.
[43]
Peter Morville and Jeffery Callender. 2010. Search Patterns: Design for Discovery(1st ed.). O’Reilly Media, Inc., USA.
[44]
Peter Norvig. 2012. English Letter Frequency Counts: Mayzner Revisited. http://norvig.com/mayzner.html.
[45]
Bruno Oliveira and Carla Teixeira Lopes. 2023. From 10 Blue Links Pages to Feature-Full Search Engine Results Pages - Analysis of the Temporal Evolution of SERP Features. In Proceedings of the 2023 Conference on Human Information Interaction and Retrieval (Austin, TX, USA) (CHIIR ’23). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3576840.3578307
[46]
James Reynolds. 2022. A Brief History of Link Buying - The Ultimate Link Buyers Guide for SEO (2022). https://seosherpa.com/buy-backlinks/.
[47]
Larisa Rosu. 2020. The Anatomy of a Google Search Results Page in 2020 - Advanced Web Ranking. https://www.advancedwebranking.com/serp/.
[48]
Tony Russell-Rose and Tyler Tate. 2012. Designing the Search Experience: The Information Architecture of Discovery (1st ed.). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
[49]
Sebastian Schultheiß and Dirk Lewandowski. 0. Misplaced trust? The relationship between trust, ability to identify commercially influenced results and search engine preference. Journal of Information Science 0, 0 (0), 01655515211014157. https://doi.org/10.1177/01655515211014157
[50]
Julia Schwarz and Meredith Morris. 2011. Augmenting Web Pages and Search Results to Support Credibility Assessment. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 1245–1254. https://doi.org/10.1145/1978942.1979127
[51]
Bongwon Suh, Haibin Ling, Benjamin B. Bederson, and David W. Jacobs. 2003. Automatic Thumbnail Cropping and Its Effectiveness. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (Vancouver, Canada) (UIST ’03). Association for Computing Machinery, New York, NY, USA, 95–104. https://doi.org/10.1145/964696.964707
[52]
Danny Sullivan. 2003. Searching With Invisible Tabs. https://www.searchenginewatch.com/2003/12/02/searching-with-invisible-tabs/.
[53]
Tanja Svarre and Tony Russell-Rose. 2022. Think outside the search box: A comparative study of visual and form-based query builders. https://doi.org/10.48550/ARXIV.2205.04212
[54]
Jaime Teevan, Edward Cutrell, Danyel Fisher, Steven M. Drucker, Gonzalo Ramos, Paul André, and Chang Hu. 2009. Visual Snippets: Summarizing Web Pages for Search and Revisitation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI ’09). Association for Computing Machinery, New York, NY, USA, 2023–2032. https://doi.org/10.1145/1518701.1519008
[55]
Teoalida. 2019. Screen resolution statistics. https://www.teoalida.com/webdesign/screen-resolution/.
[56]
Paul Thomas, Alistair Moffat, Peter Bailey, Falk Scholer, and Nick Craswell. 2018. Better Effectiveness Metrics for SERPs, Cards, and Rankings. In Proceedings of the 23rd Australasian Document Computing Symposium (Dunedin, New Zealand) (ADCS ’18). Association for Computing Machinery, New York, NY, USA, Article 1, 8 pages. https://doi.org/10.1145/3291992.3292002
[57]
Jenifer Tidwell, Charles Brewer, and Aynne Valencia-Brooks. 2020. Designing Interfaces, 3rd Edition. O’Reilly Media, Inc, USA. 500 pages. https://learning.oreilly.com/library/view/designing-interfaces-3rd/9781492051954/
[58]
Anders Toxboe. 2022. Design patterns. http://ui-patterns.com/patterns.
[59]
Kristen Vaughn. 2019. SERP Features in 2019: The Complete Guide | KoMarketing. https://komarketing.com/blog/serp-features/.
[60]
Nicholas Vincent and Brent Hecht. 2021. A Deeper Investigation of the Importance of Wikipedia Links to Search Engine Results. Proc. ACM Hum.-Comput. Interact. 5, CSCW1, Article 4 (apr 2021), 15 pages. https://doi.org/10.1145/3449078
[61]
Ryen White and Resa Roth. 2013. Exploratory Search: Beyond the Query-Response Paradigm. Morgan & Claypool Publishers, USA.
[62]
Ryen W. White. 2016. Interactions with Search Systems. Cambridge University Press, Cambridge. https://doi.org/10.1017/CBO9781139525305
[63]
Max L. Wilson. 2011. Search User Interface Design. Synthesis Lectures on Information Concepts, Retrieval, and Services 3, 3(2011), 1–143. https://doi.org/10.2200/S00371ED1V01Y201111ICR020
[64]
Zhijing Wu, Mark Sanderson, B. Barla Cambazoglu, W. Bruce Croft, and Falk Scholer. 2020. Providing Direct Answers in Search Results: A Study of User Behavior. In Proceedings of the 29th ACM International Conference on Information and Knowledge Management (Virtual Event, Ireland) (CIKM ’20). Association for Computing Machinery, New York, NY, USA, 1635–1644. https://doi.org/10.1145/3340531.3412017
[65]
Ann Wylie. 2021. What’s the best length of a word online?https://web.archive.org/web/20221012095143/https://www.wyliecomm.com/2021/11/whats-the-best-length-of-a-word-online/.
[66]
Ke Zhou, Ronan Cummins, Mounia Lalmas, and Joemon M. Jose. 2012. Evaluating Aggregated Search Pages. In Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval (Portland, Oregon, USA) (SIGIR ’12). Association for Computing Machinery, New York, NY, USA, 115–124. https://doi.org/10.1145/2348283.2348302

Cited By

View all
  • (2024)Unveiling Health Literacy through Web Search Behavior: A Classification-Based Analysis of User InteractionsProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638318(1-11)Online publication date: 10-Mar-2024
  • (2024)Perceptions in Pixels: Analyzing Perceived Gender and Skin Tone in Real-world Image Search ResultsProceedings of the ACM Web Conference 202410.1145/3589334.3645666(1249-1259)Online publication date: 13-May-2024
  • (2024)A Heuristic Multimedia Verticals Aggregated Search Approach and User Behavioral Analysis2024 International Conference on Engineering & Computing Technologies (ICECT)10.1109/ICECT61618.2024.10581027(1-6)Online publication date: 23-May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHIIR '23: Proceedings of the 2023 Conference on Human Information Interaction and Retrieval
March 2023
520 pages
ISBN:9798400700354
DOI:10.1145/3576840
  • Editors:
  • Jacek Gwizdka,
  • Soo Young Rieh
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 March 2023

Check for updates

Author Tags

  1. Evolution
  2. SERP features
  3. Search engines
  4. Web design
  5. Web interfaces

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

CHIIR '23
Sponsor:

Acceptance Rates

Overall Acceptance Rate 55 of 163 submissions, 34%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)741
  • Downloads (Last 6 weeks)87
Reflects downloads up to 09 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Unveiling Health Literacy through Web Search Behavior: A Classification-Based Analysis of User InteractionsProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638318(1-11)Online publication date: 10-Mar-2024
  • (2024)Perceptions in Pixels: Analyzing Perceived Gender and Skin Tone in Real-world Image Search ResultsProceedings of the ACM Web Conference 202410.1145/3589334.3645666(1249-1259)Online publication date: 13-May-2024
  • (2024)A Heuristic Multimedia Verticals Aggregated Search Approach and User Behavioral Analysis2024 International Conference on Engineering & Computing Technologies (ICECT)10.1109/ICECT61618.2024.10581027(1-6)Online publication date: 23-May-2024
  • (2024)Googling Politics? Comparing Five Computational Methods to Identify Political and News-related Searches from Web Browser HistoriesCommunication Methods and Measures10.1080/19312458.2024.2363776(1-27)Online publication date: 18-Jun-2024
  • (2023)Search Engine Optimisation for Social MarketingEffective Digital Marketing for Improving Society Behavior Toward DEI and SDGs10.4018/978-1-6684-8984-0.ch005(76-103)Online publication date: 14-Nov-2023
  • (2023)From 10 Blue Links Pages to Feature-Full Search Engine Results Pages - Analysis of the Temporal Evolution of SERP FeaturesProceedings of the 2023 Conference on Human Information Interaction and Retrieval10.1145/3576840.3578307(338-345)Online publication date: 19-Mar-2023
  • (2023)The Archive Query Log: Mining Millions of Search Result Pages of Hundreds of Search Engines from 25 Years of Web ArchivesProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591890(2848-2860)Online publication date: 19-Jul-2023
  • (2023)Moderating and Mediating Roles of Users' Self-Efficacy and User Behavior amongst the Internet of Things and Search Engine Optimization2023 International Conference on Business Analytics for Technology and Security (ICBATS)10.1109/ICBATS57792.2023.10111300(1-6)Online publication date: 7-Mar-2023
  • (2023)JASIST Special Issue EditorialJournal of the Association for Information Science and Technology10.1002/asi.2484575:5(503-511)Online publication date: 27-Oct-2023

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media