Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3394171.3414357acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
abstract

Text-to-Image Synthesis via Aesthetic Layout

Published: 12 October 2020 Publication History

Abstract

In this work, we introduce a practical system which synthesizes an appealing image from natural language descriptions such that the generated image should maintain the aesthetic level of photographs. Our proposed method takes the text from the end-users via a user-friendly interface and produces a set of different label maps via the primary generator PG. Then, choosing a subset from the label maps set is performed through the primary aesthetic appreciation PAA. Next, our subset of label maps is fed into the accessory generator AG, which is the state-of-the-art image-to-image translation. Last but not least, our subset of generated images is ranked via the accessory aesthetic appreciation AAA, and the most appealing image is produced.

References

[1]
Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley,Sherjil Ozair, Aaron Courville and Yoshua Bengio. 2014. Generative adversarial nets. In NIPS.
[2]
Raghudeep Gadde and Kamalakar Karlapalem. 2011. Aesthetic guideline driven photography by robots. In IJCAI.
[3]
Ligang Liu, Renjie Chen, Lior Wolf and Daniel Cohen-Or. 2010. Optimizing photo composition. In Comput. Graph. Forum.
[4]
Holger Caesar, Jasper Uijlings and Vittorio Ferrari. 2018. COCO-stuff: thing and stuff classes in context. In CVPR.
[5]
Taesung Park, Ming-Yu Liu, Ting-Chun Wang and Jun-Yan Zhu. 2019. Semantic image synthesis with spatially-adaptive normalization. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.
[6]
Samah S. Baraheem and Tam V. Nguyen. 2020. Text-to-image via mask anchor points. In Pattern Recognition Letters (PRL), Volume 133, pp. 25--32.
[7]
Samah S. Baraheem and Tam V. Nguyen. 2020. Aesthetic-Aware Text to Image Synthesis. In 54th Annual Conference on Information Sciences and Systems (CISS), pp. 1--6.

Cited By

View all
  • (2022)Multilingual Communication System with Deaf Individuals Utilizing Natural and Visual Languages2022 RIVF International Conference on Computing and Communication Technologies (RIVF)10.1109/RIVF55975.2022.10013851(683-688)Online publication date: 20-Dec-2022

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '20: Proceedings of the 28th ACM International Conference on Multimedia
October 2020
4889 pages
ISBN:9781450379885
DOI:10.1145/3394171
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 October 2020

Check for updates

Author Tags

  1. center anchor point
  2. composition rules.
  3. image aesthetics
  4. image synthesis
  5. mask dataset

Qualifiers

  • Abstract

Conference

MM '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)15
  • Downloads (Last 6 weeks)3
Reflects downloads up to 01 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Multilingual Communication System with Deaf Individuals Utilizing Natural and Visual Languages2022 RIVF International Conference on Computing and Communication Technologies (RIVF)10.1109/RIVF55975.2022.10013851(683-688)Online publication date: 20-Dec-2022

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media