Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3576840.3578298acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

Driven to Distraction: Examining the Influence of Distractors on Search Behaviours, Performance and Experience

Published: 20 March 2023 Publication History

Abstract

Advertisements, sponsored links, clickbait, in-house recommendations and similar elements pervasively shroud featured content. Such elements vie for people’s attention, potentially distracting people from their task at hand. The effects of such “distractors” is likely to increase people’s cognitive workload and reduce their performance as they need to work harder to discern the relevant from non-relevant. In this paper, we investigate how people of varying cognitive abilities (measured using Perceptual Speed and Cognitive Failure instruments) are affected by these different types of distractions when completing search tasks. We performed a crowdsourced within-subjects user study, where 102 participants completed four search tasks using our news search engine over four different interface conditions: (i) one with no additional distractors; (ii) one with advertisements; (iii) one with sponsored links; and (iv) one with in-house recommendations. Our results highlight a number of important trends and findings. Participants perceived the interface condition without distractors as significantly better across numerous dimensions. Participants reported higher satisfaction, lower workload, higher topic recall, and found it easier to concentrate. Behaviourally, participants issued queries faster and clicked results earlier when compared to the interfaces with distractors. When using the interfaces with distractors, one in ten participants clicked on a distractor—and despite engaging with a distractor for less than twenty seconds, their task time increased by approximately two minutes. We found that the effects were magnified depending on cognitive abilities—with a greater impact of distractors on participants with lower perceptual speed, and for those with a higher propensity of cognitive failures. Distractors—regardless of their type—have negative consequences on a user’s search experience and performance. As a consequence, interfaces containing visually distracting elements are creating poorer search experiences due to the “distractor tax” being placed on people’s limited attention.

References

[1]
Phillip L Ackerman and Anna T Cianciolo. 2000. Cognitive, perceptual-speed, and psychomotor determinants of individual differences during skill acquisition.Journal of Experimental Psychology: Applied 6, 4 (2000), 259.
[2]
Azzah Al-Maskari and Mark Sanderson. 2011. The Effect of User Characteristics on Search Effectiveness in Information Retrieval. Information Processing & Management 47, 5 (Sept. 2011), 719–729. https://doi.org/10.1016/j.ipm.2011.03.002
[3]
Afrah Olayan Alanazi, Mark Sanderson, Zhifeng Bao, and Jaewon Kim. 2020. The Impact of Ad Quality and Position on Mobile SERPs. In Proc. 5th ACM CHIIR. 318–322. https://doi.org/10.1145/3343413.3377990
[4]
Bryce Allen. 1994. Cognitive Abilities and Information System Usability. IP&M 30, 2 (1994), 177–191.
[5]
Bryce Allen. 1994. Perceptual Speed, Learning and Information Retrieval Performance. In SIGIR ’94, Bruce W. Croft and C. J. van Rijsbergen (Eds.). Springer London, London, 71–80. https://doi.org/10.1007/978-1-4471-2099-5_8
[6]
Jaime Arguello and Rob Capra. 2016. The Effects of Aggregated Search Coherence on Search Behavior. ACM Trans. Inf. Syst. 35, 1, Article 2 (2016), 30 pages.
[7]
Jaime Arguello and Bogeum Choi. 2019. The Effects of Working Memory, Perceptual Speed, and Inhibition in Aggregated Search. ACM Transactions on Information Systems 37, 3 (July 2019), 1–34. https://doi.org/10.1145/3322128
[8]
Jaime Arguello, Wan-Ching Wu, Diane Kelly, and Ashlee Edwards. 2012. Task Complexity, Vertical Display and User Interaction in Aggregated Search. In Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval(SIGIR ’12). Association for Computing Machinery, New York, NY, USA, 435–444. https://doi.org/10.1145/2348283.2348343
[9]
Leif Azzopardi, Paul Thomas, and Nick Craswell. 2018. Measuring the Utility of Search Engine Result Pages: An Information Foraging Based Measure. In Proc. 41st ACM SIGIR. 605–614. https://doi.org/10.1145/3209978.3210027
[10]
Becker-Olsen, Karen L.2003. And Now, a Word from Our Sponsor: A Look at the Effects of Sponsored Content and Banner Advertising. Journal of Advertising 32, 2 (2003), 17–32.
[11]
Iva Beleslin, Biljana R. Njegovan, and Maja S Vukadinović. 2017. Clickbait Titles: Risky Formula for Attracting Readers and Advertisers. In Proc. XVII Int’l. Sci. Conf. Industrial Systems. 364–369.
[12]
Gerd Berget and Andrew MacFarlane. 2020. What Is Known About the Impact of Impairments on Information Seeking and Searching?Journal of the Association for Information Science and Technology 71, 5 (May 2020), 596–611. https://doi.org/10.1002/asi.24256
[13]
Benjamin Boeuf, François. A. Carrillat, and Alian D’Astous. 2018. Interference Effects in Competitive Sponsorship Clutter. Psychology & Marketing 35, 12 (2018), 968–979.
[14]
Pia Borlund and Peter Ingwersen. 1997. The Development of a Method for the Evaluation of Interactive Information Retrieval Systems. J. of Documentation 53(1997). Issue 3.
[15]
Horatiu Bota, Ke Zhou, and Joemon M. Jose. 2016. Playing Your Cards Right: The Effect of Entity Cards on Search Behaviour and Workload. In Proc. 1st ACM CHIIR. 131–140.
[16]
Margaret M Bradley and Peter J Lang. 1994. Measuring emotion: the self-assessment manikin and the semantic differential. Journal of behavior therapy and experimental psychiatry 25, 1(1994), 49–59.
[17]
Kathy Brennan, Diane Kelly, and Jaime Arguello. 2014. The Effect of Cognitive Abilities on Information Search for Tasks of Varying Levels of Complexity. In Proceedings of the 5th Information Interaction in Context Symposium. ACM, Regensburg Germany, 165–174. https://doi.org/10.1145/2637002.2637022
[18]
Donald E. Broadbent. 1957. A mechanical model for human attention and immediate memory.Psychological review 64, 3 (1957), 205.
[19]
Donald E. Broadbent, P. F. Cooper, P. FitzGerald, and Katharine R. Parkes. 1982. The Cognitive Failures Questionnaire (CFQ) and Its Correlates. British Journal of Clinical Psychology 21, 1 (1982), 1–16. https://doi.org/10.1111/j.2044-8260.1982.tb01421.x arXiv:https://bpspsychub.onlinelibrary.wiley.com/doi/pdf/10.1111/j.2044-8260.1982.tb01421.x
[20]
Moira Burke, Anthony Hornof, Erik Nilsen, and Nicholas Gorman. 2005. High-cost banner blindness: Ads increase perceived workload, hinder visual search, and are forgotten. ACM Transactions on Computer-Human Interaction (TOCHI) 12, 4(2005), 423–445.
[21]
Georg Buscher, Susan Dumais, and Edward Cutrell. 2010. The Good, the Bad, and the Random: An Eye-Tracking Study of Ad Quality in Web Search. In Proc. 33rd ACM SIGIR. 42–49.
[22]
Bogeum Choi, Robert Capra, and Jaime Arguello. 2019. The Effects of Working Memory during Search Tasks of Varying Complexity. In Proceedings of the 2019 Conference on Human Information Interaction and Retrieval. ACM, Glasgow Scotland UK, 261–265. https://doi.org/10.1145/3295750.3298948
[23]
Jacob Cohen. 1973. Eta-Squared and Partial Eta-Squared in Fixed Factor ANOVA Designs. Educational and psychological measurement 33, 1 (1973), 107–112.
[24]
Lynne Cole, Andrew MacFarlane, and Stephann Makri. 2020. More than Words: The Impact of Memory on How Undergraduates with Dyslexia Interact with Information. In Proceedings of the 2020 Conference on Human Information Interaction and Retrieval. ACM, Vancouver BC Canada, 353–357. https://doi.org/10.1145/3343413.3378005
[25]
Henriette Cramer. 2015. Effects of Ad Quality & Content-Relevance on Perceived Content Quality. In Proc. 33rd ACM CHI. 2231–2234.
[26]
Thomas H. Davenport and John C. Beck. 2001. The Attention Economy. Ubiquity 2001, May, Article 6 (May 2001). https://doi.org/10.1145/375348.376626
[27]
Jon Driver and Gordon C. Baylis. 1989. Movement and visual attention: the spotlight metaphor breaks down.Journal of Experimental Psychology: Human perception and performance 15, 3(1989), 448.
[28]
Susan Dumais, Georg Buscher, and Edward Cutrell. 2010. Individual Differences in Gaze Patterns for Web Search. In Proc. 3rdIIiX. 185–194.
[29]
Ruth B. Ekstrom, John W. French, Harry H. Harman, and Diran Dermen. 1976. Manual for Kit of Factor-Referenced Cognitive Tests (education ed.). Princeton N.J:.
[30]
Susan T Fiske and Shelley E Taylor. 2013. Social Cognition: From Brains to Culture. Sage.
[31]
Olivia Foulds, Leif Azzopardi, and Martin Halvey. 2020. Reflecting upon Perceptual Speed Tests in Information Retrieval: Limitations, Challenges, and Recommendations. In Proceedings of the 2020 Conference on Human Information Interaction and Retrieval. ACM, Vancouver BC Canada, 234–242. https://doi.org/10.1145/3343413.3377982
[32]
Olivia Foulds, Leif Azzopardi, and Martin Halvey. 2021. Investigating the Influence of Ads on User Search Performance, Behaviour, and Experience during Information Seeking. In Proceedings of the 2021 Conference on Human Information Interaction and Retrieval. ACM, Canberra ACT Australia, 107–117. https://doi.org/10.1145/3406522.3446024
[33]
Gary L. Geissler, George M. Zinkhan, and Richard T. Watson. 2006. The Influence of Home Page Complexity on Consumer Attention, Attitudes, and Purchase Intent. Journal of Advertising 35, 2 (May 2006), 69–80. https://doi.org/10.1080/00913367.2006.10639232
[34]
Richard Glassey and Leif Azzopardi. 2011. Finding interest in the stream. Proceedings of the American Society for Information Science and Technology 48 (01 2011). https://doi.org/10.1002/meet.2011.14504801297
[35]
Daniel G. Goldstein, Siddharth Suri, R. Preston McAfee, Matthew Ekstrand-Abueg, and Fernando Diaz. 2014. The Economic and Cognitive Costs of Annoying Display Advertisements. Journal of Marketing Research 51, 6 (Dec. 2014), 742–752. https://doi.org/10.1509/jmr.13.0439
[36]
Louisa Ha. 2008. Online Advertising Research in Advertising Journals: A Review. Journal of Current Issues & Research in Advertising 30, 1(2008), 31–48.
[37]
Bianca Harms, Tammo H.A. Bijmolt, and Janny C. Hoekstra. 2019. You Don’t Fool Me! Consumer Perceptions of Digital Native Advertising and Banner Advertising. Journal of Media Business Studies 16, 4 (2019), 275–294.
[38]
Sandra G Hart. 2006. NASA-task Load Index (NASA-TLX); 20 Years Later. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 50. Sage publications Sage CA: Los Angeles, CA, 904–908.
[39]
Yu-Chen Hsieh and Kuo-Hsiang Chen. 2011. How Different Information Types Affect Viewer’s Attention on Internet Advertising. Comput. Hum. Behav. 27, 2 (mar 2011), 935–945. https://doi.org/10.1016/j.chb.2010.11.019
[40]
Yi-Ting Huang. 2018. The Female Gaze: Content Composition and Slot Position in Personalized Banner Ads, and How They Influence Visual Attention in Online Shoppers. In Computers in Human Behavior, Vol. 82. 1–15.
[41]
Hyunjoo Im, Hae Won Ju, and Kim K.P. Johnson. 2021. Beyond Visual Clutter: The Interplay among Products, Advertisements, and the Overall Webpage. Journal of Research in Interactive Marketing 15, 4 (Oct. 2021), 804–821. https://doi.org/10.1108/JRIM-10-2020-0213
[42]
Jaroslaw Jankowski, Juho Hamari, and Jaroslaw Wa̧tróbski. 2019. A Gradual Approach for Maximising User Conversion without Compromising Experience with High Visual Intensity Website Elements. Internet Research 29, 1 (2019), 194–217.
[43]
Daniel Kahneman. 1973. Attention and Effort. Prentice-Hall, Englewood Cliffs, N.J.
[44]
Diane Kelly and Leif Azzopardi. 2015. How Many Results per Page? A Study of SERP Size, Search Behavior and User Experience. In Proc. 5th ACM ICTIR. 183–192.
[45]
Minchul Kim. 2013. The Effects of Online Advertisements and News Images on News Reception. Ph.D. Dissertation. The University of Wisconsin - Milwaukee.
[46]
Nam Young Kim and S. Shyam Sundar. 2010. Relevance to the Rescue: Can “Smart Ads” Reduce Negative Response to Online Ad Clutter?Journalism and Mass Communication Quarterly 87, 2 (2010), 346–362.
[47]
Youngseek Kim. 2009. How Does Web Advertising Affect Users’ Information Seeking, Website Evaluation, and Source Evaluation?. In Proc. iConference. 2.
[48]
Annie Lang. 2000. The Limited Capacity Model of Mediated Message Processing. Journal of communication 50, 1 (2000), 46–70.
[49]
Dirk Lewandowski. 2017. Users’ Understanding of Search Engine Advertisements. Journal of Information Science Theory and Practice 5, 4 (2017), 6–25.
[50]
James R. Lewis. 1995. IBM Computer Usability Satisfaction Questionnaires: Psychometric Evaluation and Instructions for Use. Int. J. Hum.-Comput. Interact. 7, 1 (Jan. 1995), 57–78. https://doi.org/10.1080/10447319509526110
[51]
Yujie Li. 2019. User Perception Affects Search Engine Advertising Avoidance: Moderating Role of User Characteristics. Social Behavior and Personality: an international journal 47, 4(2019), 1–12.
[52]
Gary Marchionini. 2006. Exploratory search: from finding to understanding. Commun. ACM 49, 4 (2006), 41–46.
[53]
Antti Oulasvirta, Janne P. Hukkinen, and Barry Schwartz. 2009. When More Is Less: The Paradox of Choice in Search Engine Use. In Proc. 32nd ACM SIGIR. 516–523.
[54]
Dolors Palau-Sampio. 2016. Reference Press Metamorphosis in the Digital Context: Clickbait and Tabloid Strategies in Elpais.Com. Communication and Society 29, 2 (2016), 63–71.
[55]
K. Pawlik. 1966. Concepts and Calculations in Human Cognitive Abilities. In Handbook of Multivariate Experimental Psychology. Rand McNally.
[56]
Marc Resnick and William Albert. 2014. The Impact of Advertising Location and User Task on the Emergence of Banner Ad Blindness: An Eye Tracking Study. International Journal of Human-Computer Interaction 30, 3(2014), 206–219.
[57]
Kate Scott. 2021. You Won’t Believe What’s in This Paper! Clickbait, Relevance and the Curiosity Gap. Journal of Pragmatics 175 (April 2021), 53–66. https://doi.org/10.1016/j.pragma.2020.12.023
[58]
Elizabeth A. Styles. 2005. The Psychology of Attention. Taylor & Francis e-Library, London.
[59]
Anne Treisman. 1991. Search, similarity, and integration of features between and within dimensions.Journal of Experimental Psychology: Human Perception and Performance 17, 3(1991), 652.
[60]
Lauren Turpin, Diane Kelly, and Jaime Arguello. 2016. To Blend or Not to Blend?: Perceptual Speed, Visual Memory and Aggregated Search. In Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, Pisa Italy, 1021–1024. https://doi.org/10.1145/2911451.2914739
[61]
Oliver Wilhelm, Michael Witthöft, and Stefan Schipolowski. 2010. Self-Reported Cognitive Failures: Competing Measurement Models and Self-Report Correlates. Journal of Individual Differences 31, 1 (Jan. 2010), 1–14. https://doi.org/10.1027/1614-0001/a000001
[62]
Eric Zeng, Tadayoshi Kohno, and Franziska Roesner. 2021. What Makes a “Bad” Ad? User Perceptions of Problematic Online Advertising. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, Yokohama Japan, 1–24. https://doi.org/10.1145/3411764.3445459
[63]
Ping Zhang. 2000. The Effects of Animation on Information Seeking Performance on the World Wide Web: Securing Attention or Interfering with Primary Tasks?Journal of the Association for Information Systems 1, 1 (2000), 30.

Cited By

View all
  • (2023)Online newspapers and banner AdsInternational Journal of Business Ecosystem & Strategy (2687-2293)10.36096/ijbes.v5i2.4075:2(94-101)Online publication date: 15-May-2023
  • (2023)Report on the 8th ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR 2023)ACM SIGIR Forum10.1145/3636341.363635357:1(1-7)Online publication date: 4-Dec-2023

Index Terms

  1. Driven to Distraction: Examining the Influence of Distractors on Search Behaviours, Performance and Experience

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CHIIR '23: Proceedings of the 2023 Conference on Human Information Interaction and Retrieval
      March 2023
      520 pages
      ISBN:9798400700354
      DOI:10.1145/3576840
      • Editors:
      • Jacek Gwizdka,
      • Soo Young Rieh
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 20 March 2023

      Permissions

      Request permissions for this article.

      Check for updates

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Conference

      CHIIR '23
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 55 of 163 submissions, 34%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)78
      • Downloads (Last 6 weeks)6
      Reflects downloads up to 15 Oct 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2023)Online newspapers and banner AdsInternational Journal of Business Ecosystem & Strategy (2687-2293)10.36096/ijbes.v5i2.4075:2(94-101)Online publication date: 15-May-2023
      • (2023)Report on the 8th ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR 2023)ACM SIGIR Forum10.1145/3636341.363635357:1(1-7)Online publication date: 4-Dec-2023

      View Options

      Get Access

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media