research-article

Distributed analogical idea generation: inventing with crowds

Authors:

Robert E. KrautAuthors Info & Claims

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1245 - 1254

https://doi.org/10.1145/2556288.2557371

Published: 26 April 2014 Publication History

Abstract

Harnessing crowds can be a powerful mechanism for increasing innovation. However, current approaches to crowd innovation rely on large numbers of contributors generating ideas independently in an unstructured way. We introduce a new approach called distributed analogical idea generation, which aims to make idea generation more effective and less reliant on chance. Drawing from the literature in cognitive science on analogy and schema induction, our approach decomposes the creative process in a structured way amenable to using crowds. In three experiments we show that distributed analogical idea generation leads to better ideas than example-based approaches, and investigate the conditions under which crowds generate good schemas and ideas. Our results have implications for improving creativity and building systems for distributed crowd innovation.

Supplementary Material

Part 1 of 2 (p1245-sidebyside.mp4)

Download
37.84 MB

Part 2 of 2 (p1245-sidebyside_pt2.mp4)

Download
132.72 MB

References

[1]

Andre, P., Kittur, A., and Dow, S. P. 2014. Crowd synthesis: Extracting categories and clusters from complex data. In Proc. CSCW, ACM.

Digital Library

[2]

Alexander, C., Ishikawa, S., and Silverstein, M. A., Pattern Language: Towns, Buildings, Construction. Oxford University Press, 1977.

[3]

Buxton, B. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann, 2010.

Digital Library

[4]

Cheng, P. W. and Holyoak, K. J. Pragmatic reasoning schemas. Cognitive psychology 17, 4 (1985), 391--416.

[5]

Chilton, L., Little, G., Edge, D., Weld, D. S., and Landay, J. A. Cascade: Crowdsourcing Taxonomy Creation. In Proc. CHI 2013.

Digital Library

[6]

Clement, C. A. Effect of structural embedding on analogical transfer: Manifest versus latent analogs. The American journal of psychology, (1994), 1--38.

[7]

Finke, R. A., Ward, T. B., and Smith, S. M. Creative cognition: Theory, research, and applications. MIT press Cambridge, MA, 1992.

[8]

Fisher, R., Statistical methods for research workers. Oliver and Boyd, 1954.

[9]

Galton, F. The geometric mean, in vital and social statistics. In Proc RSL 29, (1879), 365--367.

[10]

Gentner, D. Structure-mapping: A theoretical framework for analogy. Cognitive Science 7, (1983), 155--170.

[11]

Gentner, D., S. Brem, R. Ferguson, P. Wolff, A. B. Markaman, K. and Forbus. Analogy and creativity in the works of Johannes Kepler. T. N. Ward, S. M. Smith, J. Vaid, eds. Creative Thought. Amer. Psych. Association, Washington, DC, (1997). 403--460.

[12]

Gick, M. L. and Holyoak, K. J. Schema induction and analogical transfer. Cognitive psychology 15, (1983), 1--38.

[13]

Gick, M. L. and Paterson, K. Do contrasting examples facilitate schema acquisition and analogical transfer? Canadian Journal of Psychology 46, 4 (1992), 539.

[14]

Hargadon, A. B. Brokering knowledge: Linking learning and innovation. Research in Organizational behavior 24, (2002), 41--85.

[15]

Hesse, Mary B., The Structure of Scientific Inference. Macmillan, London, 1974.

[16]

Hutter, K., Hautz, J., Füller, J., Mueller, J., and Matzler, K. The Tension between Competition and Collaboration in Community-Based Design Contests. Creativity and Innovation Management 20, 1 (2011), 3--21.

[17]

Hummel, J. E. and Holyoak K. J., Distributed representations of structure: a theory of analogical access and mapping. Psychological Review 104, (1997), 427--66.

[18]

Hummel, J. E. and Holyoak, K. J., A symbolic-connectionist theory of relational inference and generalization. Psychological Review 110, (2003), 220--264.

[19]

Kittur, A., Chi, E. H., and Suh, B. Crowdsourcing user studies with Mechanical Turk. In Proc. CHI'2008, 453--456.

Digital Library

[20]

Kittur, A., Holyoak, K. J. and Hummel, J. E. Using idea observers in higher-order human category learning. In Proc. CogSci, 2006.

[21]

Kittur, A., Kraut, R. E. 2008. Harnessing the Wisdom of Crowds in Wikipedia: Quality Through Coordination. CSCW 2008. ACM.

Digital Library

[22]

Koh, T. K. Essays on Technology-Enabled Platforms. PhD Dissertation, Carnegie Mellon University, 2012.

Digital Library

[23]

Kulkarni, C., Dow, S. P., and Klemmer, S. R. Early and Repeated Exposure to Examples Improves Creative Work. In Proc. CogSci, 2012.

[24]

Lakhani, K. R. and Panetta, J. A. The principles of distributed innovation. Innovations 2, 3 (2007), 97--112.

[25]

Linsey, J., Laux, J., Clauss, E., Wood, K. L., and Markman, A. Increasing innovation: A trilogy of experiments towards a design-by-analogy method. Proceedings of the ASME 2007.

[26]

Reeves, L. and Weisberg, R. W. The role of content and abstract information in analogical transfer. Psychological Bulletin 115, 3 (1994), 381.

[27]

Smith, S. M., Ward, T. B., and Schumacher, J. S. Constraining effects of examples in a creative generation task. Memory & Cognition 21, 6 (1993), 837--845.

[28]

Sternberg, R. J. Handbook of creativity. Cambridge University Press, 1998.

[29]

Talton, J., Yang, L., Kumar, R., Lim, M., Goodman, N., and Mech, R. Learning design patterns with Bayesian grammar induction. In Proc. UIST, 2012, 63--74.

Digital Library

[30]

Wolfgang, P., Design patterns for object-oriented software development. Addison-Wesley Publishing, England, 1995.

Digital Library

[31]

Yang, Y., Chen, P. Y., and Pavlou, P. Open innovation: An empirical study of online contests. In Proc. ICIS 2009.

[32]

Yu, L., Kittur, A., and Kraut, R. Searching for analogical ideas with crowds. CHI'14.

Digital Library

[33]

Yu, L. and Nickerson, J. V. Cooks or cobblers? Crowd creativity through combination. In Proc. CHI 2011, 1393--1402.

Digital Library

[34]

Yu, L. and Sakamoto, Y. Feature selection in crowd creativity. In Foundations of Augmented Cognition. Directing the Future of Adaptive Systems. Springer, 2011, 383--392.

Digital Library

Cited By

Anderson BShah JKreminski M(2024)Homogenization Effects of Large Language Models on Human Creative IdeationProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656204(413-425)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656204
Ding ZSrinivasan AMacneil SChan J(2023)Fluid Transformers and Creative Analogies: Exploring Large Language Models’ Capacity for Augmenting Cross-Domain Analogical CreativityProceedings of the 15th Conference on Creativity and Cognition10.1145/3591196.3593516(489-505)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3591196.3593516
Wang SPetridis SKwon TMa XChilton L(2023)PopBlends: Strategies for Conceptual Blending with Large Language ModelsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580948(1-19)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580948
Show More Cited By

Index Terms

Distributed analogical idea generation: inventing with crowds
1. Human-centered computing
  1. Collaborative and social computing

Recommendations

Idea Generation and the Quality of the Best Idea

In a wide variety of settings, organizations generate a number of possible solutions to a problem---ideas---and then select a few for further development. We examine the effectiveness of two group structures for such tasks---the team structure, in which ...
Idea Generation, Creativity, and Prototypicality

We explore the use of big data tools to shed new light on the idea generation process, automatically "read" ideas to identify promising ones, and help people be more creative. The literature suggests that creativity results from the optimal balance ...
An internet-scale idea generation system
Special section on internet-scale human problem solving and regular papers

A method of organizing the crowd to generate ideas is described. It integrates crowds using evolutionary algorithms. The method increases the creativity of ideas across generations, and it works better than greenfield idea generation. Specifically, a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2014

4206 pages

ISBN:9781450324731

DOI:10.1145/2556288

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI '14 Paper Acceptance Rate 465 of 2,043 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

49
Total Citations
View Citations
1,377
Total Downloads

Downloads (Last 12 months)44
Downloads (Last 6 weeks)15

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Anderson BShah JKreminski M(2024)Homogenization Effects of Large Language Models on Human Creative IdeationProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656204(413-425)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656204
Ding ZSrinivasan AMacneil SChan J(2023)Fluid Transformers and Creative Analogies: Exploring Large Language Models’ Capacity for Augmenting Cross-Domain Analogical CreativityProceedings of the 15th Conference on Creativity and Cognition10.1145/3591196.3593516(489-505)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3591196.3593516
Wang SPetridis SKwon TMa XChilton L(2023)PopBlends: Strategies for Conceptual Blending with Large Language ModelsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580948(1-19)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580948
Malhotra AKubowicz Malhotra C(2023)Searching for ideas from creative Crowds: The role of examples in problem statementsJournal of Business Research10.1016/j.jbusres.2023.113963164(113963)Online publication date: Sep-2023
https://doi.org/10.1016/j.jbusres.2023.113963
Zhang CHuang WLiang L(2022)Application of Crowdsourcing to the Design of Behavior Change Technologies2022 15th International Symposium on Computational Intelligence and Design (ISCID)10.1109/ISCID56505.2022.00058(232-235)Online publication date: Dec-2022
https://doi.org/10.1109/ISCID56505.2022.00058
Sun LGao WXiang W(2022)Supporting Crowd Workers in Ideation Tasks Through Information Gathering and Reflective ActivityInternational Journal of Human–Computer Interaction10.1080/10447318.2022.206174839:6(1257-1270)Online publication date: 21-Apr-2022
https://doi.org/10.1080/10447318.2022.2061748
Xiao SCheshire CBruckman A(2021)Sensemaking and the Chemtrail Conspiracy on the Internet: Insights from Believers and Ex-believersProceedings of the ACM on Human-Computer Interaction10.1145/34795985:CSCW2(1-28)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3479598
Chilton LOzmen ERoss SLiu VKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)VisiFit: Structuring Iterative Improvement for Novice DesignersProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445089(1-14)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445089
Wakatsuki YYamamoto Y(2021)Clustering to Support Users Finding Unexpected Perspectives in Brainstorming2021 10th International Congress on Advanced Applied Informatics (IIAI-AAI)10.1109/IIAI-AAI53430.2021.00086(494-497)Online publication date: Jul-2021
https://doi.org/10.1109/IIAI-AAI53430.2021.00086
Ross SOzmen EKogan MChilton LPaternò FOliver NConati CSpano LTintarev N(2020)WordBlenderProceedings of the 25th International Conference on Intelligent User Interfaces10.1145/3377325.3377527(38-42)Online publication date: 17-Mar-2020
https://dl.acm.org/doi/10.1145/3377325.3377527
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents