poster

Harmonized Banner Creation from Multimodal Design Assets

Authors:

Praneetha Vaddamanu,

Vinay Aggarwal,

Bhanu Prakash Reddy Guda,

Balaji Vasan Srinivasan,

Niyati ChhayaAuthors Info & Claims

CHI EA '22: CHI Conference on Human Factors in Computing Systems Extended Abstracts

Article No.: 217, Pages 1 - 7

https://doi.org/10.1145/3491101.3519610

Published: 28 April 2022 Publication History

Abstract

Designing aesthetically pleasing single-page graphic designs (”banners”) that appeal to the target recipients is non-trivial and requires considerable human effort. Designers often start by collecting assets like background images, inspirational banners, and relevant taglines/textual phrases, and iterate over variants of the designs by testing different combinations of these assets for their current task. To expand creative processes beyond professionals, it is crucial to accelerate this tedious process of creating design variants. To this end, we propose an algorithm that takes as input multiple image and text elements to generate several visually pleasing banner designs harmonized for text colors, font styles, and the placement of these multimodal assets. The generated layout accounts for background image saliency and uses this to select typographic and color variants yielding the harmonized outputs. We demonstrate the effectiveness of the proposed algorithm in generating aesthetic banners with the help of a crowdsourced experiment.

Supplementary Material

Supplemental Materials (3491101.3519610-supplemental-materials.zip)

Download
3.67 MB

MP4 File (3491101.3519610-talk-video.mp4)

Talk Video

Download
52.20 MB

References

[1]

Diego Martin Arroyo, Janis Postels, and Federico Tombari. 2021. Variational Transformer Networks for Layout Generation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 13642–13652.

[2]

Dan S. Bloomberg and Leptonica. 2008. Color quantization using modified median cut. http://leptonica.org/papers/mediancut.pdf

[3]

Zoya Bylinskii, Nam Wook Kim, Peter O’Donovan, Sami Alsheikh, Spandan Madan, Hanspeter Pfister, Fredo Durand, Bryan Russell, and Aaron Hertzmann. 2017. Learning visual importance for graphic designs and data visualizations. In Proceedings of the 30th Annual ACM symposium on user interface software and technology. 57–69.

Digital Library

[4]

Ben Caldwell, Michael Cooper, Loretta Guarino Reid, Gregg Vanderheiden, Wendy Chisholm, John Slatin, and Jason White. 2008. Web content accessibility guidelines (WCAG) 2.0. WWW Consortium (W3C) 290(2008).

[5]

Saemi Choi, Kiyoharu Aizawa, and Nicu Sebe. 2018. Fontmatcher: font image paring for harmonious digital graphic design. In 23rd International Conference on Intelligent User Interfaces. 37–41.

Digital Library

[6]

Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition. IEEE, 248–255.

[7]

Mairéad Grogan, Matis Hudon, Daniel McCormack, and Aljosa Smolic. 2018. Automatic Palette Extraction for Image Editing.

[8]

Kamal Gupta, Alessandro Achille, Justin Lazarow, Larry Davis, Vijay Mahadevan, and Abhinav Shrivastava. 2020. Layout Generation and Completion with Self-attention. arXiv preprint arXiv:2006.14615(2020).

[9]

Susan Hall, Keith Cockerham, and Duncan Rhodes. 2002. What’s your color?[human-machine interface design]. IEEE industry applications magazine 8, 2 (2002), 50–54.

[10]

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770–778.

[11]

Johannes Itten. 1970. The elements of color. Vol. 4. John Wiley & Sons.

[12]

Ali Jahanian, Jerry Liu, Daniel R Tretter, Qian Lin, Niranjan Damera-Venkata, Eamonn O’Brien-Strain, Seungyon Lee, Jian Fan, and Jan P Allebach. 2012. Automatic design of magazine covers. In Imaging and Printing in a Web 2.0 World III, Vol. 8302. International Society for Optics and Photonics, 83020N.

[13]

Dorothea Jameson and Leo M Hurvich. 1964. Theory of brightness and color contrast in human vision. Vision research 4, 1-2 (1964), 135–154.

[14]

Shuhui Jiang, Zhaowen Wang, Aaron Hertzmann, Hailin Jin, and Yun Fu. 2019. Visual font pairing. IEEE Transactions on Multimedia 22, 8 (2019), 2086–2097.

[15]

Akash Abdu Jyothi, Thibaut Durand, Jiawei He, Leonid Sigal, and Greg Mori. 2019. Layoutvae: Stochastic scene layout generation from a label set. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 9895–9904.

[16]

Shigenobu Kobayashi. 2009. Color image scale. http://www. ncd-ri. co. jp/english/main_0104. html (2009).

[17]

Illa Pavan Kumar, VP Hara Gopal, Somula Ramasubbareddy, Sravani Nalluri, and K Govinda. 2020. Dominant color palette extraction by K-means clustering algorithm and reconstruction of image. In Data Engineering and Communication Technology. Springer, 921–929.

[18]

Hsin-Ying Lee, Lu Jiang, Irfan Essa, Phuong B Le, Haifeng Gong, Ming-Hsuan Yang, and Weilong Yang. 2020. Neural design network: Graphic layout generation with constraints. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part III 16. Springer, 491–506.

[19]

Jianan Li, Jimei Yang, Aaron Hertzmann, Jianming Zhang, and Tingfa Xu. 2018. LayoutGAN: Generating Graphic Layouts with Wireframe Discriminators. In International Conference on Learning Representations.

[20]

Jianan Li, Jimei Yang, Jianming Zhang, Chang Liu, Christina Wang, and Tingfa Xu. 2020. Attribute-conditioned Layout GAN for Automatic Graphic Design. IEEE Transactions on Visualization and Computer Graphics (2020).

Digital Library

[21]

Rensis Likert. 1932. A technique for the measurement of attitudes.Archives of psychology(1932).

[22]

Paridhi Maheshwari, Nitish Bansal, Surya Dwivedi, Rohan Kumar, Pranav Manerikar, and Balaji Vasan Srinivasan. 2019. Exemplar Based Experience Transfer. In Proceedings of the 24th International Conference on Intelligent User Interfaces (Marina del Ray, California) (IUI ’19). Association for Computing Machinery, New York, NY, USA, 673–680. https://doi.org/10.1145/3301275.3302300

Digital Library

[23]

Paridhi Maheshwari, Nitish Bansal, Surya Dwivedi, Rohan Kumar, Pranav Manerikar, and Balaji Vasan Srinivasan. 2019. Exemplar based experience transfer. In Proceedings of the 24th International Conference on Intelligent User Interfaces. 673–680.

Digital Library

[24]

Ahamed M Mithun, Z Abu Bakar, and Wael MS Yafooz. 2019. The Impact of Web Contents Color Contrast on Human Psychology in the Lens of HCI. International Journal of Information Technology and Computer Science 11, 10(2019), 27–33.

[25]

Céline Mougenot, Carole Bouchard, Ameziane Aoussat, and Steve Westerman. 2008. Inspiration, images and design: an investigation of designers’ information gathering strategies. Journal of Design Research 7, 4 (2008), 331–351.

[26]

Peter O’Donovan, Aseem Agarwala, and Aaron Hertzmann. 2015. Designscape: Design with interactive layout suggestions. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. 1221–1224.

Digital Library

[27]

Peter O’Donovan, Aseem Agarwala, and Aaron Hertzmann. 2014. Learning layouts for single-pagegraphic designs. IEEE transactions on visualization and computer graphics 20, 8(2014), 1200–1213.

Digital Library

[28]

Sreekanth Vempati, Korah T Malayil, V Sruthi, and R Sandeep. 2020. Enabling hyper-personalisation: Automated ad creative generation and ranking for fashion e-commerce. In Fashion Recommender Systems. Springer, 25–48.

[29]

Zhangyang Wang, Jianchao Yang, Hailin Jin, Eli Shechtman, Aseem Agarwala, Jonathan Brandt, and Thomas S Huang. 2015. Deepfont: Identify your font from an image. In Proceedings of the 23rd ACM international conference on Multimedia. 451–459.

Digital Library

[30]

Peiying Zhang, Chenhui Li, and Changbo Wang. 2020. Smarttext: Learning To Generate Harmonious Textual Layout Over Natural Image. In 2020 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 1–6.

[31]

Xinru Zheng, Xiaotian Qiao, Ying Cao, and Rynson WH Lau. 2019. Content-aware generative modeling of graphic design layouts. ACM Transactions on Graphics (TOG) 38, 4 (2019), 1–15.

Digital Library

Cited By

Liu ZLiu FZhang M(2024)Intelligent Graphic Layout Generation: Current Status and Future Perspectives2024 27th International Conference on Computer Supported Cooperative Work in Design (CSCWD)10.1109/CSCWD61410.2024.10580676(2632-2637)Online publication date: 8-May-2024
https://doi.org/10.1109/CSCWD61410.2024.10580676
Weng HHuang DZhang TLin CElkind E(2023)Learn and sample togetherProceedings of the Thirty-Second International Joint Conference on Artificial Intelligence10.24963/ijcai.2023/649(5851-5859)Online publication date: 19-Aug-2023
https://dl.acm.org/doi/10.24963/ijcai.2023/649
Lin JZhou MMa YGao YFei CChen YYu ZGe TEl Saddik AMei TCucchiara RBertini MTobon Vallejo DAtrey PHossain M(2023)AutoPoster: A Highly Automatic and Content-aware Design System for Advertising Poster GenerationProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3611930(1250-1260)Online publication date: 26-Oct-2023
https://dl.acm.org/doi/10.1145/3581783.3611930

Recommendations

NeurTEx: A Neural Framework for Template Extraction from Flat Images
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

With the increasing demands of digital creation, a creative user often starts by looking for inspirational resources online. Once they find such inspirations, they recreate certain design elements using tracing-like applications to internalize the ...
A New Method of Banner Color Design
Human-Computer Interaction. Perspectives on Design
Abstract
The style of an existing banner color design is often based on subjective feelings of the person or the accumulated design experience, which is not efficient and applicable. The purpose of this research is to create a good visual effect of banners,...
Designing online banner advertisements: should we animate?
CHI '02: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

A common medium for advertising on the Internet is the use of banner ads. This study investigates recall and recognition of animated banner advertisements in an attempt to identify design guidelines. It was hypothesized that animation would increase ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

April 2022

3066 pages

ISBN:9781450391566

DOI:10.1145/3491101

Editors:
Simone Barbosa
PUC-Rio, Brazil
,
Cliff Lampe
University of Michigan, USA
,
Caroline Appert
Université Paris-Saclay, France
,
David A. Shamma
Toyota Research Institute, USA

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 April 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Conference

CHI '22

Sponsor:

SIGCHI

CHI '22: CHI Conference on Human Factors in Computing Systems

April 29 - May 5, 2022

LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
396
Total Downloads

Downloads (Last 12 months)94
Downloads (Last 6 weeks)4

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Liu ZLiu FZhang M(2024)Intelligent Graphic Layout Generation: Current Status and Future Perspectives2024 27th International Conference on Computer Supported Cooperative Work in Design (CSCWD)10.1109/CSCWD61410.2024.10580676(2632-2637)Online publication date: 8-May-2024
https://doi.org/10.1109/CSCWD61410.2024.10580676
Weng HHuang DZhang TLin CElkind E(2023)Learn and sample togetherProceedings of the Thirty-Second International Joint Conference on Artificial Intelligence10.24963/ijcai.2023/649(5851-5859)Online publication date: 19-Aug-2023
https://dl.acm.org/doi/10.24963/ijcai.2023/649
Lin JZhou MMa YGao YFei CChen YYu ZGe TEl Saddik AMei TCucchiara RBertini MTobon Vallejo DAtrey PHossain M(2023)AutoPoster: A Highly Automatic and Content-aware Design System for Advertising Poster GenerationProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3611930(1250-1260)Online publication date: 26-Oct-2023
https://dl.acm.org/doi/10.1145/3581783.3611930

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents