Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

ImageSense: An Intelligent Collaborative Ideation Tool to Support Diverse Human-Computer Partnerships

Published: 29 May 2020 Publication History

Abstract

Professional designers create mood boards to explore, visualize, and communicate hard-to-express ideas. We present ImageCascade, an intelligent, collaborative ideation tool that combines individual and shared work spaces, as well as collaboration with multiple forms of intelligent agents. In the collection phase, ImageCascade offers fluid transitions between serendipitous discovery of curated images via ImageCascade, combined text- and image-based Semantic search, and intelligent AI suggestions for finding new images. For later composition and reflection, ImageCascade provides semantic labels, generated color palettes, and multiple tag clouds to help communicate the intent of the mood board. A study of nine professional designers revealed nuances in designers' preferences for designer-led, system-led, and mixed-initiative approaches that evolve throughout the design process. We discuss the challenges in creating effective human-computer partnerships for creative activities, and suggest directions for future research.

Supplementary Material

ZIP File (v4cscw045aux.m4v.zip)
Video Figure

References

[1]
Salvatore Andolina, Khalil Klouche, Diogo Cabral, Tuukka Ruotsalo, and Giulio Jacucci. 2015. InspirationWall: supporting idea generation through automatic information exploration. In Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition. ACM, 103--106.
[2]
Salvatore Andolina, Hendrik Schneider, Joel Chan, Khalil Klouche, Giulio Jacucci, and Steven Dow. 2017. Crowdboard: augmenting in-person idea generation with real-time crowds. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition. 106--118.
[3]
Patti Bao, Elizabeth Gerber, Darren Gergle, and David Hoffman. 2010. Momentum: getting and staying on topic during a brainstorm. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1233--1236.
[4]
Brent Berlin and Paul Kay. 1991. Basic color terms: Their universality and evolution .Univ of California Press.
[5]
Dan Bloomberg. 2019. Color quantization using modified median cut. (03 2019), 6.
[6]
Susanne Bødker. 1991. Through the interface-A human activity approach to user interface design. DAIMI Report Series 224 (1991).
[7]
Carole Bouchard, Jean-francois Omhover, Celine Mougenot, Ameziane Aoussat, and Stephen J Westerman. 2008. TRENDS: a content-based information retrieval system for designers. In Design Computing and Cognition'08. Springer, 593--611.
[8]
Adrien Bousseau, Theophanis Tsandilas, Lora Oehlberg, and Wendy E. Mackay. 2016. How Novices Sketch and Prototype Hand-Fabricated Objects. In Conference on Human Factors in Computing Systems (CHI). ACM, San Jose, United States. https://doi.org/10.1145/2858036.2858159
[9]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology, Vol. 3, 2 (2006), 77--101.
[10]
Search by Muzli. 2019. Muzli (2019). https://search.muz.li
[11]
Hernan Casakin and Gabriela Goldschmidt. 1999. Expertise and the use of visual analogy: implications for design education. Design studies, Vol. 20, 2 (1999), 153--175.
[12]
Tracy Cassidy. 2011. The mood board process modeled and understood as a qualitative design research tool. Fashion Practice, Vol. 3, 2 (2011).
[13]
Tracy Diane Cassidy. 2008. Mood boards: Current practice in learning and teaching strategies and students' understanding of the process. International Journal of Fashion Design, Vol. 1, 1 (2008), 43--54.
[14]
Joel Chan, Pao Siangliulue, Denisa Qori McDonald, Ruixue Liu, Reza Moradinezhad, Safa Aman, Erin T. Solovey, Krzysztof Z. Gajos, and Steven P. Dow. 2017. Semantically Far Inspirations Considered Harmful?: Accounting for Cognitive States in Collaborative Ideation. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition (Singapore, Singapore) (C&C '17). ACM, New York, NY, USA, 93--105.
[15]
Jean Chevalier. 1996. The Penguin dictionary of symbols. (1996).
[16]
Mihaly Csikszentmihalyi and Keith Sawyer. 2014. Shifting the focus from individual to organizational creativity. In The systems model of creativity. Springer, 67--71.
[17]
Douglass R. Cutting, David R. Karger, Jan O. Pedersen, and John W. Tukey. 1992. Scatter/Gather: A Cluster-based Approach to Browsing Large Document Collections. In Proceedings of the 15th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (Copenhagen, Denmark) (SIGIR '92). ACM, New York, NY, USA, 318--329.
[18]
Graham Dove, Nicolai Brodersen Hansen, and Kim Halskov. 2016. An argument for design space reflection. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction. ACM, 17.
[19]
Volodymyr Dziubak. 2019. Supporting graphic designers' online inspiration seeking practices via software tools. (2019).
[20]
James Fogarty, Jodi Forlizzi, and Scott E Hudson. 2001. Aesthetic information collages: generating decorative displays that contain information. In Proceedings of the 14th annual ACM symposium on User interface software and technology. ACM, 141--150.
[21]
James Fogarty, Desney Tan, Ashish Kapoor, and Simon Winder. 2008. CueFlik: Interactive Concept Learning in Image Search. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI '08). ACM, New York, NY, USA, 29--38.
[22]
Charles Freeman, Sara Marcketti, and Elena Karpova. 2017. Creativity of images: using digital consensual assessment to evaluate mood boards. Fashion and Textiles, Vol. 4, 1 (2017), 17.
[23]
Jonas Frich, Lindsay MacDonald Vermeulen, Christian Remy, Michael Mose Biskjaer, and Peter Dalsgaard. 2019. Mapping the Landscape of Creativity Support Tools in HCI. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). ACM, New York, NY, USA, Article 389, 18 pages. https://doi.org/10.1145/3290605.3300619
[24]
Alex Gabriel, Davy Monticolo, Mauricio Camargo, and Mario Bourgault. 2016. Creativity support systems: A systematic mapping study. Thinking Skills and Creativity, Vol. 21 (2016), 109--122.
[25]
John Gage. 1999. Color and meaning: Art, science, and symbolism .Univ of California Press.
[26]
Steve Garner and Deana McDonagh-Philp. 2001. Problem interpretation and resolution via visual stimuli: the use of `mood boards' in design education. Journal of Art & Design Education, Vol. 20, 1 (2001), 57--64.
[27]
Karni Gilon, Joel Chan, Felicia Y. Ng, Hila Liifshitz-Assaf, Aniket Kittur, and Dafna Shahaf. 2018. Analogy Mining for Specific Design Needs. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). ACM, New York, NY, USA, Article 121, 11 pages.
[28]
Milene Goncc alves, Carlos Cardoso, and Petra Badke-Schaub. 2016. Inspiration choices that matter: the selection of external stimuli during ideation. Design Science, Vol. 2 (2016).
[29]
Francois Guimbretière, Maureen Stone, and Terry Winograd. 2001. Fluid interaction with high-resolution wall-size displays. In Proceedings of the 14th annual ACM symposium on User interface software and technology. 21--30.
[30]
Sonja Gutwein. 2013. Computer support for collaborative creativity. Beyond the Desktop (2013), 15.
[31]
Joshua Hailpern, Erik Hinterbichler, Caryn Leppert, Damon Cook, and Brian P Bailey. 2007. TEAM STORM: demonstrating an interaction model for working with multiple ideas during creative group work. In Proceedings of the 6th ACM SIGCHI Conference on Creativity & Cognition. 193--202.
[32]
Noe Vargas Hernandez, Jami J Shah, and Steven M Smith. 2010. Understanding design ideation mechanisms through multilevel aligned empirical studies. Design Studies, Vol. 31, 4 (2010), 382--410.
[33]
Otmar Hilliges, Lucia Terrenghi, Sebastian Boring, David Kim, Hendrik Richter, and Andreas Butz. 2007. Designing for collaborative creative problem solving. In Proceedings of the 6th ACM SIGCHI conference on Creativity & cognition. 137--146.
[34]
Eric Horvitz. 1999. Principles of mixed-initiative user interfaces. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. 159--166.
[35]
Incredibleart.org. 2019. Color Symbolism and Culture. https://www.incredibleart.org/lessons/middle/color2.htm
[36]
Nanna Inie and Peter Dalsgaard. 2017. A Typology of Design Ideas. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition. ACM, 393--406.
[37]
Mikhail Jacob, Alexander Zook, and Brian Magerko. 2013. Viewpoints AI: Procedurally Representing and Reasoning about Gestures. In DiGRA Conference.
[38]
Ben Jonson. 2005. Design ideation: the conceptual sketch in the digital age. Design studies, Vol. 26, 6 (2005), 613--624.
[39]
AI Keller, GJ Pasman, and Pieter Jan Stappers. 2006. Collections designers keep: Collecting visual material for inspiration and reference. CoDesign, Vol. 2, 01 (2006), 17--33.
[40]
Gary Klein, Brian Moon, and Robert R Hoffman. 2006. Making sense of sensemaking 1: Alternative perspectives. IEEE intelligent systems, Vol. 21, 4 (2006), 70--73.
[41]
Janin Koch, Andrés Lucero, Lena Hegemann, and Antti Oulasvirta. 2019. May AI?: Design Ideation with Cooperative Contextual Bandits. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 633.
[42]
Janin Koch, Nicolas Taffin, Andrés Lucero, and Wendy Mackay. 2020. SemanticCollage: Enriching Digital Mood Board Design with Semantic Labels. In Proceedings of the Designing Interactive Systems Conference 2020 (DIS '20). ACM.
[43]
John Kolko. 2010. Sensemaking and framing: A theoretical reflection on perspective in design synthesis. Design Research Society (2010).
[44]
Rebecca Leis and Lauren Reinerman-Jones. 2015. Methodological implications of confederate use for experimentation in safety-critical domains. Procedia Manufacturing, Vol. 3 (2015), 1233--1240.
[45]
Antonios Liapis and Georgios N Yannakakis. 2016. Boosting computational creativity with human interaction in mixed-initiative co-creation tasks. In Proceedings of the ICCC workshop on Computational Creativity and Games, Vol. 310.
[46]
Google LLC. 2018. Google Images Search. (2018). https://images.google.com/
[47]
Andrés Lucero. 2012. Framing, aligning, paradoxing, abstracting, and directing: how design mood boards work. In Proceedings of the designing interactive systems conference. ACM, 438--447.
[48]
Andrés Lucero. 2015. Funky-Design-Spaces: Interactive Environments for Creativity Inspired by Observing Designers Making Mood Boards. In Human-Computer Interaction. Springer, 474--492.
[49]
Andrés Lucero, Dima Aliakseyeu, and Jean-Bernard Martens. 2007. Augmenting mood boards: flexible and intuitive interaction in the context of the design studio. In Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07). IEEE, 147--154.
[50]
Andrés Lucero, Dzmitry Aliakseyeu, Kees Overbeeke, and Jean-Bernard Martens. 2009. An interactive support tool to convey the intended message in asynchronous presentations. In Proceedings of the International Conference on Advances in Computer Enterntainment Technology. 11--18.
[51]
Lena Mamykina, Linda Candy, and Ernest Edmonds. 2002. Collaborative creativity. Commun. ACM, Vol. 45, 10 (2002), 96--99.
[52]
Ine Mols, Elise Van den Hoven, and Berry Eggen. 2016. Informing design for reflection: an overview of current everyday practices. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction. ACM, 21.
[53]
Philippaa MOTHERSILL and V. Michaela BOVE. 2018. An Ontology of Computational Tools for Design Activities. In Proceedings of Design Research (DRS). DRS.
[54]
Jaap MJ Murre and Joeri Dros. 2015. Replication and analysis of Ebbinghaus' forgetting curve. PloS one, Vol. 10, 7 (2015).
[55]
Changhoon Oh, Jungwoo Song, Jinhan Choi, Seonghyeon Kim, Sungwoo Lee, and Bongwon Suh. 2018. I Lead, You Help but Only with Enough Details: Understanding User Experience of Co-Creation with Artificial Intelligence. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 649.
[56]
Alex F Osborn. 1953. Applied imagination. Charles Scribner, New York (1953).
[57]
Rajan Patel. 2018. World around you with Google Lens and the Assistant. (2018). https://www.blog.google/products/google-lens/google-lens-real-time-answers-questions-about-world-around-you/
[58]
Sharoda A Paul and Meredith Ringel Morris. 2011. Sensemaking in collaborative web search. Human-Computer Interaction, Vol. 26, 1--2 (2011), 72--122.
[59]
Charles Sanders Peirce. 1974. Collected papers of charles sanders peirce. Vol. 5. Harvard University Press.
[60]
Unsplash: Beautiful Free Images & Pictures. 2019. Unsplash (2019). https://unsplash.com//
[61]
Pinterest. 2019. Pinterest (2019). https://www.pinterest.com
[62]
Peter Pirolli and Stuart Card. 2005. The sensemaking process and leverage points for analyst technology as identified through cognitive task analysis. In Proceedings of international conference on intelligence analysis, Vol. 5. McLean, VA, USA, 2--4.
[63]
Martin Porcheron, Andrés Lucero, and Joel E. Fischer. 2016. Co-Curator: Designing for Mobile Ideation in Groups. In Proceedings of the 20th International Academic Mindtrek Conference (Tampere, Finland) (AcademicMindtrek '16). Association for Computing Machinery, New York, NY, USA, 226--234. https://doi.org/10.1145/2994310.2994350
[64]
Image Finder High quality free stock images. 2019. ImageFinder (2019). https://imagefinder.co/
[65]
Guillermo Rauch. 2019. Socket. io. Socket IO.[Online] http://socket. io (2019).
[66]
Paul Resnick and Hal R. Varian. 1997. Recommender Systems. Commun. ACM, Vol. 40, 3 (March 1997), 56--58. https://doi.org/10.1145/245108.245121
[67]
Donald A Schön. 2017. The reflective practitioner: How professionals think in action .Routledge.
[68]
Moushumi Sharmin and Brian P Bailey. 2011. I reflect to improve my design: investigating the role and process of reflection in creative design. In Proceedings of the 8th ACM conference on Creativity and cognition. ACM, 389--390.
[69]
Ben Shneiderman. 2000. Creating creativity: user interfaces for supporting innovation. ACM Transactions on Computer-Human Interaction (TOCHI), Vol. 7, 1 (2000), 114--138.
[70]
Ben Shneiderman. 2007. Creativity support tools: Accelerating discovery and innovation. Commun. ACM, Vol. 50, 12 (2007), 20--32.
[71]
Pao Siangliulue, Joel Chan, Steven P Dow, and Krzysztof Z Gajos. 2016. IdeaHound: improving large-scale collaborative ideation with crowd-powered real-time semantic modeling. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. 609--624.
[72]
Pao Siangliulue, Joel Chan, Krzysztof Z. Gajos, and Steven P. Dow. 2015. Providing Timely Examples Improves the Quantity and Quality of Generated Ideas. In Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition (Glasgow, United Kingdom) (C&C '15). ACM, New York, NY, USA, 83--92.
[73]
Shaun Singh. 2019. Death to Stock - When stock dies art thrives. https://deathtothestockphoto.com/
[74]
Kyle Steinfeld. 2017. Dreams may come. In Acadia. 590--599.
[75]
Timo Strohmann, Dominik Siemon, and Susanne Robra-Bissantz. 2017. brAInstorm: Intelligent Assistance in Group Idea Generation. In International Conference on Design Science Research in Information System and Technology. Springer, 457--461.
[76]
Lucy A Suchman. 2007. Human-machine reconfigurations: Plans and situated actions .Cambridge university press.
[77]
Hillevi Sundholm, Henrik Artman, and Robert Ramberg. 2004. Backdoor Creativity: Collaborative Creativity in Technology Supported Teams. In COOP. 99--114.
[78]
Cem Tekin and Mihaela van der Schaar. 2015. Distributed online learning via cooperative contextual bandits. IEEE transactions on signal processing, Vol. 63, 14 (2015), 3700--3714.
[79]
Belinda Thom. 2000. BoB: an interactive improvisational music companion. In Proceedings of the fourth international conference on Autonomous agents. ACM, 309--316.
[80]
Inc. Twinword. 2018. Natural Language Processing APIs - Twinword API. https://www.twinword.com/api/word-associations.php
[81]
Peter-Paul Verbeek. 2015. COVER STORY Beyond interaction: a short introduction to mediation theory. interactions, Vol. 22, 3 (2015), 26--31.
[82]
Hao-Chuan Wang, Dan Cosley, and Susan R Fussell. 2010. Idea expander: supporting group brainstorming with conversationally triggered visual thinking stimuli. In Proceedings of the 2010 ACM conference on Computer supported cooperative work. 103--106.
[83]
Kai Wang and Jeffrey V Nickerson. 2017. A literature review on individual creativity support systems. Computers in Human Behavior, Vol. 74 (2017), 139--151.
[84]
Andrew M Webb, Rhema Linder, Andruid Kerne, Nic Lupfer, Yin Qu, Bryant Poffenberger, and Colton Revia. 2013. Promoting reflection and interpretation in education: Curating rich bookmarks as information composition. In Proceedings of the 9th ACM Conference on Creativity & Cognition. ACM, 53--62.
[85]
Jun Xiao, Xuemei Zhang, Phil Cheatle, Yuli Gao, and C Brian Atkins. 2008. Mixed-initiative photo collage authoring. In Proceedings of the 16th ACM international conference on Multimedia. ACM, 509--518.
[86]
Georgios N Yannakakis, Antonios Liapis, and Constantine Alexopoulos. 2014. Mixed-initiative co-creativity. In FDG.

Cited By

View all
  • (2024)Introduction to Generative AI in Web EngineeringGenerative AI for Web Engineering Models10.4018/979-8-3693-3703-5.ch015(297-330)Online publication date: 27-Sep-2024
  • (2024)"We Are Visual Thinkers, Not Verbal Thinkers!": A Thematic Analysis of How Professional Designers Use Generative AI Image Generation ToolsProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685370(1-14)Online publication date: 13-Oct-2024
  • (2024)Exploring the Supportive Role of Artificial Intelligence in Participatory Design: A Systematic ReviewProceedings of the Participatory Design Conference 2024: Exploratory Papers and Workshops - Volume 210.1145/3661455.3669868(37-44)Online publication date: 11-Aug-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction
Proceedings of the ACM on Human-Computer Interaction  Volume 4, Issue CSCW1
CSCW
May 2020
1285 pages
EISSN:2573-0142
DOI:10.1145/3403424
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 May 2020
Published in PACMHCI Volume 4, Issue CSCW1

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. agency
  2. creativity support tool
  3. ideation
  4. mood board design

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)350
  • Downloads (Last 6 weeks)43
Reflects downloads up to 09 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Introduction to Generative AI in Web EngineeringGenerative AI for Web Engineering Models10.4018/979-8-3693-3703-5.ch015(297-330)Online publication date: 27-Sep-2024
  • (2024)"We Are Visual Thinkers, Not Verbal Thinkers!": A Thematic Analysis of How Professional Designers Use Generative AI Image Generation ToolsProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685370(1-14)Online publication date: 13-Oct-2024
  • (2024)Exploring the Supportive Role of Artificial Intelligence in Participatory Design: A Systematic ReviewProceedings of the Participatory Design Conference 2024: Exploratory Papers and Workshops - Volume 210.1145/3661455.3669868(37-44)Online publication date: 11-Aug-2024
  • (2024)DesignPrompt: Using Multimodal Interaction for Design Exploration with Generative AIProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661588(804-818)Online publication date: 1-Jul-2024
  • (2024)Co-Creating Question-and-Answer Style Articles with Large Language Models for Research PromotionProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660705(975-994)Online publication date: 1-Jul-2024
  • (2024)"That comes with a huge career cost:" Understanding Collaborative Ideation Experiences of Disabled ProfessionalsProceedings of the ACM on Human-Computer Interaction10.1145/36410188:CSCW1(1-28)Online publication date: 26-Apr-2024
  • (2024)"It Felt Like Having a Second Mind": Investigating Human-AI Co-creativity in Prewriting with Large Language ModelsProceedings of the ACM on Human-Computer Interaction10.1145/36373618:CSCW1(1-26)Online publication date: 26-Apr-2024
  • (2024)HearHere: Mitigating Echo Chambers in News Consumption through an AI-based Web SystemProceedings of the ACM on Human-Computer Interaction10.1145/36373408:CSCW1(1-34)Online publication date: 26-Apr-2024
  • (2024)The Effects of Generative AI on Design Fixation and Divergent ThinkingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642919(1-18)Online publication date: 11-May-2024
  • (2024)Prompting for Discovery: Flexible Sense-Making for AI Art-Making with DreamsheetsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642858(1-17)Online publication date: 11-May-2024
  • Show More Cited By

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media