Idea-Centric Search: Four Patterns of Information Seeking During Creative Ideation
Authors: 
Xiaotong (Tone) Xu, 
Srishti Palani, Azzaya Munkhbat, Tiffany Lee, Steven P. DowAuthors Info & Claims
Xiaotong (Tone) Xu, Srishti Palani, Azzaya Munkhbat, Tiffany Lee, Steven P. DowAuthors Info & ClaimsPages 280 - 291
Abstract
As search evolves and Generative AI enables users to express more complex information needs and goals, it is an opportune moment to investigate how the search for information influences creativity. Little is known about how creators — especially novices who lack domain-specific terminology — use web search when developing an idea, and vice versa, how new information shapes an idea. To investigate how ideas evolve through web search, we conducted an online lab study with 56 design students who engaged in a 3-week product redesign project. Through a mixed-method analysis of web search logs, surveys, and interviews, we report on the different search behaviors, strategies, challenges and four distinct patterns–Orienters, Refiners, Confirmers, and Pivoters–that illustrate how the impact of search depends on the maturity of an idea. We discuss design opportunities to enhance web search systems for ideation and pedagogical interventions to teach creators how to improve idea-centric search.
References
[1]
Mikhail Ageev, Qi Guo, Dmitry Lagun, and Eugene Agichtein. 2011. Find it if you can: a game for modeling different types of web search success using interaction data. In Proceedings of SIGIR 2011. ACM.
[2]
Anne Aula and Daniel M Russell. 2008. Complex and exploratory web search. In Information Seeking Support Systems Workshop (ISSS 2008), Chapel Hill, NC, USA. Citeseer.
[3]
Michael Mose Biskjaer, Bo T Christensen, Morten Friis-Olivarius, Sille JJ Abildgaard, Caroline Lundqvist, and Kim Halskov. 2020. How task constraints affect inspiration search strategies. International Journal of Technology and Design Education 30 (2020), 101–125.
[4]
Lera Boroditsky. 2011. How language shapes thought. Scientific American 304, 2 (2011), 62–65.
[5]
Andrei Broder. 2002. A taxonomy of web search. SIGIR FORUM 36, 2 (2002), 3–10.
[6]
Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin Tat Lee, Yuanzhi Li, Scott Lundberg, 2023. Sparks of artificial general intelligence: Early experiments with gpt-4. arXiv preprint arXiv:2303.12712 (2023).
[7]
Joel Chan and David Anthony Rudd. 2023. Supporting Exploration of Far-Domain Analogical Inspirations with Bridging Analogies. In Proceedings of the 15th Conference on Creativity and Cognition. 293–297.
[8]
Joel Chan, Pao Siangliulue, Denisa Qori McDonald, Ruixue Liu, Reza Moradinezhad, Safa Aman, Erin T Solovey, Krzysztof Z Gajos, and Steven P Dow. 2017. Semantically far inspirations considered harmful? accounting for cognitive states in collaborative ideation. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition. 93–105.
[9]
Joseph Chee Chang, Nathan Hahn, and Aniket Kittur. 2020. Mesh: Scaffolding comparison tables for online decision making. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. 391–405.
[10]
Kathy Charmaz. 2014. Constructing grounded theory. sage.
[11]
Paul-Alexandru Chirita, Claudiu S. Firan, and Wolfgang Nejdl. 2006. Summarizing Local Context to Personalize Global Web Search. In Proceedings of the 15th ACM International Conference on Information and Knowledge Management (Arlington, Virginia, USA) (CIKM ’06). Association for Computing Machinery, New York, NY, USA, 287–296. https://doi.org/10.1145/1183614.1183658
[12]
Michael Chui, Roger Roberts, Lareina Yee Yee, Eric Hazan, Alex Singla, Kate Smaje, Alex Sukharevsky, and Rodney Zemmel. 2023. The economic potential of generative AI: The next productivity frontier. https://www.mckinsey.com/capabilities/mckinsey-digital/our-insights/the-economic-potential-of-generative-ai-the-next-productivity-frontier. Published: June 14, 2023.
[13]
British Design Council. 2024. The Double Diamond. https://www.designcouncil.org.uk/our-resources/the-double-diamond/ [Accessed: 2024-01-28].
[14]
Rikke Friis Dam and Teo Yu Siang. 2023. Stage 4 in the design thinking process: Prototype. https://www.interaction-design.org/literature/article/stage-4-in-the-design-thinking-process-prototype
[15]
Peter J Denning and Nicholas Dew. 2012. The myth of the elevator pitch. Commun. ACM 55, 6 (2012), 38–40.
[16]
Zijian Ding, Arvind Srinivasan, Stephen MacNeil, and Joel Chan. 2023. Fluid transformers and creative analogies: Exploring large language models’ capacity for augmenting cross-domain analogical creativity. In Proceedings of the 15th Conference on Creativity and Cognition. 489–505.
[17]
Jonas Frich, Lindsay MacDonald Vermeulen, Christian Remy, Michael Mose Biskjaer, and Peter Dalsgaard. 2019. Mapping the landscape of creativity support tools in HCI. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–18.
[18]
Katherine Fu, Jeremy Murphy, Maria Yang, Kevin Otto, Dan Jensen, and Kristin Wood. 2015. Design-by-analogy: experimental evaluation of a functional analogy search methodology for concept generation improvement. Research in Engineering Design 26 (2015), 77–95.
[19]
Google. 2023. Get AI-powered overviews & ask follow ups on SGE in Search. https://support.google.com/websearch/answer/13572151. [Accessed: 2024-01-28].
[20]
Google. 2023. Year in Search. https://trends.google.com/trends/yis/2023/GLOBAL/. [Accessed: 2024-01-28].
[21]
Sofi Hanif, Agus Fany Chandra Wijaya, and Nanang Winarno. 2019. Enhancing Students’ Creativity through STEM Project-Based Learning.Journal of science Learning 2, 2 (2019), 50–57.
[22]
Tom Hope, Joel Chan, Aniket Kittur, and Dafna Shahaf. 2017. Accelerating innovation through analogy mining. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 235–243.
[23]
Tom Hope, Jason Portenoy, Kishore Vasan, Jonathan Borchardt, Eric Horvitz, Daniel S Weld, Marti A Hearst, and Jevin West. 2020. SciSight: Combining faceted navigation and research group detection for COVID-19 exploratory scientific search. arXiv preprint arXiv:2005.12668 (2020).
[24]
Tom Hope, Ronen Tamari, Hyeonsu Kang, Daniel Hershcovich, Joel Chan, Aniket Kittur, and Dafna Shahaf. 2021. Scaling creative inspiration with fine-grained functional facets of product ideas. arXiv preprint arXiv:2102.09761 (2021).
[25]
Ching-Ting Hsin, Ying-Hsueh Cheng, and Chin-Chung Tsai. 2016. Searching and sourcing online academic literature: Comparisons of doctoral students and junior faculty in education. Online Information Review 40, 7 (2016), 979–997.
[26]
Nanna Inie and Peter Dalsgaard. 2017. A typology of design ideas. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition. 393–406.
[27]
Zachary C Irving, Catherine McGrath, Lauren Flynn, Aaron Glasser, and Caitlin Mills. 2022. The shower effect: Mind wandering facilitates creative incubation during moderately engaging activities.Psychology of Aesthetics, Creativity, and the Arts (2022).
[28]
Bernard J Jansen, Danielle Booth, and Brian Smith. 2009. Using the taxonomy of cognitive learning to model online searching. Information Processing & Management 45, 6 (2009), 643–663.
[29]
Hyeonsu B Kang, Xin Qian, Tom Hope, Dafna Shahaf, Joel Chan, and Aniket Kittur. 2022. Augmenting scientific creativity with an analogical search engine. ACM Transactions on Computer-Human Interaction 29, 6 (2022), 1–36.
[30]
Andruid Kerne, Andrew M Webb, Steven M Smith, Rhema Linder, Nic Lupfer, Yin Qu, Jon Moeller, and Sashikanth Damaraju. 2014. Using metrics of curation to evaluate information-based ideation. ACM Transactions on Computer-Human Interaction (ToCHI) 21, 3 (2014), 1–48.
[31]
Jon Kolko. 2010. Abductive thinking and sensemaking: The drivers of design synthesis. Design issues 26, 1 (2010), 15–28.
[32]
Bill Kules. 2005. Supporting creativity with search tools. Creativity Support Tools 50 (2005), 53–64.
[33]
Steve Lawrence. 2000. Context in web search. IEEE Data Eng. Bull. 23, 3 (2000), 25–32.
[34]
Junyi Jessy Li and Ani Nenkova. 2015. Fast and accurate prediction of sentence specificity. In Twenty-Ninth AAAI Conference on Artificial Intelligence.
[35]
Michael Xieyang Liu, Aniket Kittur, and Brad A Myers. 2022. Crystalline: Lowering the Cost for Developers to Collect and Organize Information for Decision Making. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–16.
[36]
Larry Livingston. 2010. Teaching creativity in higher education. Arts education policy review 111, 2 (2010), 59–62.
[37]
Stephann Makri, Tsui-Ling Hsueh, and Sara Jones. 2019. Ideation as an intellectual information acquisition and use context: Investigating game designers’ information-based ideation Behavior. Journal of the Association for Information Science and Technology 70, 8 (2019), 775–787.
[38]
Gary Marchionini. 2006. Exploratory search: from finding to understanding. Commun. ACM 49, 4 (2006), 41–46.
[39]
Merriam-Webster.com. 2024. idea. https://www.merriam-webster.com/dictionary/idea [Accessed: 2024-01-28].
[40]
Midjourney. 2024. Vary Region + Remix — docs.midjourney.com. https://docs.midjourney.com/docs/vary-region-remix. [Accessed: 2024-05-10].
[41]
Meredith Ringel Morris, Adam Fourney, Abdullah Ali, and Laura Vonessen. 2018. Understanding the needs of searchers with dyslexia. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 35.
[42]
Reiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeff Wu, Long Ouyang, Christina Kim, Christopher Hesse, Shantanu Jain, Vineet Kosaraju, William Saunders, 2021. Webgpt: Browser-assisted question-answering with human feedback. arXiv preprint arXiv:2112.09332 (2021).
[43]
Raymond S Nickerson. 1998. Confirmation bias: A ubiquitous phenomenon in many guises. Review of general psychology 2, 2 (1998), 175–220.
[44]
Michael Norman and Peter Thomas. 1990. The very idea: informing HCI design from conversation analysis. In Computers and conversation. Elsevier, 51–65.
[45]
Srishti Palani, Zijian Ding, Stephen MacNeil, and Steven P Dow. 2021. The" Active Search" Hypothesis: How Search Strategies Relate to Creative Learning. In Proceedings of the 2021 conference on human information interaction and retrieval. 325–329.
[46]
Srishti Palani, Adam Fourney, Shane Williams, Kevin Larson, Irina Spiridonova, and Meredith Ringel Morris. 2020. An eye tracking study of web search by people with and without dyslexia. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 729–738.
[47]
Srishti Palani, Yingyi Zhou, Sheldon Zhu, and Steven W Dow. 2022. InterWeave: Presenting Search Suggestions in Context Scaffolds Information Search and Synthesis. Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (2022).
[48]
Perplexity. 2022. Perplexity AI. https://www.perplexity.ai/. [Accessed: 2024-01-28].
[49]
Stuart Pugh. 1991. Total design: integrated methods for successful product engineering. (No Title) (1991).
[50]
Soo Young Rieh, Kevyn Collins-Thompson, Preben Hansen, and Hye-Jung Lee. 2016. Towards searching as a learning process: A review of current perspectives and future directions. Journal of Information Science 42, 1 (2016), 19–34.
[51]
Soo Young Rieh, Jacek Gwizdka, Luanne Freund, and Kevyn Collins-Thompson. 2014. Searching as learning: Novel measures for information interaction research. Proceedings of the American Society for Information Science and Technology 51, 1 (2014), 1–4.
[52]
Frank E Saal, Ronald G Downey, and Mary A Lahey. 1980. Rating the ratings: Assessing the psychometric quality of rating data.Psychological bulletin 88, 2 (1980), 413.
[53]
Robert Keith Sawyer, Vera John-Steiner, Seana Moran, Robert J Sternberg, David Henry Feldman, Mihaly Csikszentmihalyi, Howard Gardner, and Jeanne Nakamura. 2003. Creativity and development. Counterpoints: Cognition, Memo.
[54]
Pao Siangliulue, Kenneth C Arnold, Krzysztof Z Gajos, and Steven P Dow. 2015. Toward collaborative ideation at scale: Leveraging ideas from others to generate more creative and diverse ideas. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. 937–945.
[55]
Robert J Sternberg. 1999. Handbook of creativity. Cambridge University Press.
[56]
Robert J Sternberg and Elena L Grigorenko. 2001. Guilford’s structure of intellect model and model of creativity: Contributions and limitations. Creativity Research Journal 13, 3-4 (2001), 309–316.
[57]
Fiona Stewart and Chris Mann. 2000. Internet communication and qualitative research: A handbook for researching online. Internet Communication and Qualitative Research (2000), 1–272.
[58]
Cristen Torrey, Elizabeth F Churchill, and David W McDonald. 2009. Learning how: the search for craft knowledge on the internet. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1371–1380.
[59]
Pertti Vakkari. 2003. Task-based information searching.Annual Review of Information Science and Technology (ARIST) 37 (2003), 413–64.
[60]
Belle Wallace. 1986. Creativity: Some definitions: The creative personality; the creative process; the creative classroom. Gifted Education International 4, 2 (1986), 68–73.
[61]
John P Walsh, You-Na Lee, and Sadao Nagaoka. 2016. Openness and innovation in the US: Collaboration form, idea generation and implementation. Research Policy 45, 8 (2016), 1660–1671.
[62]
Thomas B Ward, Merryl J Patterson, and Cynthia M Sifonis. 2004. The role of specificity and abstraction in creative idea generation. Creativity Research Journal 16, 1 (2004), 1–9.
[63]
Ryen W White and Jeff Huang. 2010. Assessing the scenic route: measuring the value of search trails in web logs. In Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval. 587–594.
[64]
Ryen W White and Resa A Roth. 2008. Evaluation of Exploratory Search Systems. In Exploratory Search: Beyond the Query—Response Paradigm. Springer, 61–69.
[65]
Ryen W. White and Resa A. Roth. 2009. Exploratory Search: Beyond the Query-Response Paradigm. Morgan and Claypool Publishers.
[66]
Wan-Ching Wu, Diane Kelly, Ashlee Edwards, and Jaime Arguello. 2012. Grannies, tanning beds, tattoos and NASCAR: Evaluation of search tasks with varying levels of cognitive complexity. In Proceedings of the 4th information interaction in context symposium. 254–257.
[67]
Xiaotong (Tone) Xu, Jiayu Yin, Catherine Gu, Jenny Mar, Sydney Zhang, Jane L. E, and Steven P. Dow. 2024. Jamplate: Exploring LLM-Enhanced Templates for Idea Reflection. In Proceedings of the 29th International Conference on Intelligent User Interfaces (, Greenville, SC, USA, ) (IUI ’24). Association for Computing Machinery, New York, NY, USA, 907–921. https://doi.org/10.1145/3640543.3645196
[68]
Yinglong Zhang and Robert Capra. 2019. Understanding how people use search to support their everyday creative tasks. In Proceedings of the 2019 Conference on Human Information Interaction and Retrieval. 153–162.
[69]
Yinglong Zhang, Rob Capra, and Yuan Li. 2020. An in-situ study of information needs in design-related creative projects. In Proceedings of the 2020 Conference on Human Information Interaction and Retrieval. 113–123.
[70]
Chunfang Zhou. 2012. Integrating creativity training into problem and project-based learning curriculum in engineering education. European Journal of Engineering Education 37, 5 (2012), 488–499.
[71]
Chunfang Zhou, Anette Kolmos, and Jens Dalsgaard Nielsen. 2012. A problem and project-based learning (PBL) approach to motivate group creativity in engineering education. International Journal of Engineering Education 28, 1 (2012), 3.
Index Terms
- Idea-Centric Search: Four Patterns of Information Seeking During Creative Ideation
Recommendations
Creative Computing for Bespoke Ideation
COMPSAC '15: Proceedings of the 2015 IEEE 39th Annual Computer Software and Applications Conference - Volume 01Today, idea generation is an extremely important activity for both academic researchers and industrial groups. A considerable number of applications and research studies have been made in the past years in order to increase the effectiveness of idea ...
Supporting Ideation by Integrating Exploratory Search, Browsing, and Curation
CHIIR '16: Proceedings of the 2016 ACM on Conference on Human Information Interaction and RetrievalThis research integrates exploratory search, browsing, and curation in information-based ideation (IBI) environments, to support users finding, discovering, and combining web content. Information-based ideation refers to open-ended activities in which ...
It Is Your Turn: Collaborative Ideation With a Co-Creative Robot through Sketch
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing SystemsCo-creative systems have been widely explored in the field of computational creativity. However, existing AI partners of these systems are mostly virtual agents. As sketching on paper with embodied robots could be more engaging for designers' early-stage ...
Comments
Information & Contributors
Information
Published In
June 2024
718 pages
ISBN:9798400704857
DOI:10.1145/3635636
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 23 June 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
C&C '24
Sponsor:
Acceptance Rates
Overall Acceptance Rate 108 of 371 submissions, 29%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 145Total Downloads
- Downloads (Last 12 months)145
- Downloads (Last 6 weeks)145
Reflects downloads up to 26 Jul 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatGet Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in