research-article

Data-driven image color theme enhancement

Authors:

Tien-Tsin Wong,

Ying-Qing XuAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 29, Issue 6

Article No.: 146, Pages 1 - 10

https://doi.org/10.1145/1882261.1866172

Published: 15 December 2010 Publication History

Abstract

It is often important for designers and photographers to convey or enhance desired color themes in their work. A color theme is typically defined as a template of colors and an associated verbal description. This paper presents a data-driven method for enhancing a desired color theme in an image. We formulate our goal as a unified optimization that simultaneously considers a desired color theme, texture-color relationships as well as automatic or user-specified color constraints. Quantifying the difference between an image and a color theme is made possible by color mood spaces and a generalization of an additivity relationship for two-color combinations. We incorporate prior knowledge, such as texture-color relationships, extracted from a database of photographs to maintain a natural look of the edited images. Experiments and a user study have confirmed the effectiveness of our method.

Supplementary Material

Supplemental material. (146-150-0152-auxiliary.zip)

Download
45.69 MB

References

[1]

An, X., and Pellacini, F. 2008. Appprop: all-pairs appearance-space edit propagation. ACM Trans. Graph. 27, 3, 40.

Digital Library

[2]

Bae, S., Paris, S., and Durand, F. 2006. Two-scale tone management for photographic look. In SIGGRAPH '06: ACM SIGGRAPH 2006 Papers, ACM, New York, NY, USA, 637--645.

Digital Library

[3]

Chang, Y., Saito, S., Uchikawa, K., and Nakajima, M. 2005. Example-based color stylization of images. ACM Trans. Appl. Percept. 2, 3, 322--345.

Digital Library

[4]

Cohen-Or, D., Sorkine, O., Gal, R., Leyvand, T., and Xu, Y.-Q. 2006. Color harmonization. In SIGGRAPH '06: ACM SIGGRAPH 2006 Papers, ACM, New York, NY, USA, 624--630.

Digital Library

[5]

Felzenszwalb, P. F., and Huttenlocher, D. P. 2004. Efficient graph-based image segmentation. Int. J. Comput. Vision 59, 2, 167--181.

Digital Library

[6]

Freeman, W. T., Pasztor, E. C., and Carmichael, O. T. 2000. Learning low-level vision. Int. J. Comput. Vision 40, 1, 25--47.

Digital Library

[7]

Hogg, J. 1969. The prediction of semantic differential ratings of color combinations. J Gen Psychol 80, 141152.

[8]

Lawrence, C. T., and Tits, A. L. 1996. Nonlinear equality constraints in feasible sequential quadratic programming. Optimization Methods and Software 6, 265--282.

[9]

Lawrence, C. T., Zhou, J. L., and Tits, A. L. 1997. User's guide for cfsqp version 2.5: A c code for solving (large scale) constrained nonlinear (minimax) optimization problems, generating iterates satisfying all inequality constraints. Institute for Systems Research, University of Maryland, Technical Report TR-94-16r1 College Park, MD 20742.

[10]

Leung, T., and Malik, J. 2001. Representing and recognizing the visual appearance of materials using three-dimensional textons. Int. J. Comput. Vision 43, 1, 29--44.

Digital Library

[11]

Levin, A., Lischinski, D., and Weiss, Y. 2004. Colorization using optimization. ACM Trans. Graph. 23, 3, 689--694.

Digital Library

[12]

Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Trans. Graph. 25, 3, 646--653.

Digital Library

[13]

Luan, Q., Wen, F., Cohen-Or, D., Liang, L., Xu, Y.-Q., and Shum, H.-Y. 2007. Natural Image Colorization. In Rendering Techniques 2007 (Proceedings Eurographics Symposium on Rendering), J. Kautz and S. Pattanaik, Eds., Eurographics.

Digital Library

[14]

Manjunath, B. S., and Ma, W. Y. 1996. Texture features for browsing and retrieval of image data. IEEE Trans. Pattern Anal. Mach. Intell. 18, 8, 837--842.

Digital Library

[15]

Ou, L.-C., Luo, M. R., Woodcock, A., and Wright, A. 2004. A study of colour emotion and colour preference. part i: Colour emotions for single colours. Color Research & Application 29, 3, 232--240.

[16]

Ou, L.-C., Luo, M. R., Woodcock, A., and Wright, A. 2004. A study of colour emotion and colour preference. part ii: Colour emotions for two-colour combinations. Color Research & Application 29, 4, 292--298.

[17]

Pellacini, F., and Lawrence, J. 2007. Appwand: editing measured materials using appearance-driven optimization. ACM Trans. Graph. 26, 3, 54.

Digital Library

[18]

Piti, F., and Kokaram, A. 2007. The linear monge-kantorovitch linear colour mapping for example-based colour transfer. Visual Media Production, 4th European Conference on Visual Media Production, London, UK, 1--9.

[19]

Qu, Y., Wong, T.-T., and Heng, P.-A. 2006. Manga colorization. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2006) 25, 3, 1214--1220.

Digital Library

[20]

Reinhard, E., Ashikhmin, M., Gooch, B., and Shirley, P. 2001. Color transfer between images. IEEE Comput. Graph. Appl. 21, 5, 34--41.

Digital Library

[21]

Rubner, Y., Tomasi, C., and Guibas, L. J. 1998. A metric for distributions with applications to image databases. In ICCV '98: Proceedings of the Sixth International Conference on Computer Vision, IEEE Computer Society, Washington, DC, USA, 59.

Digital Library

[22]

Sato, T., Kajiwara, K., Hoshino, H., and Nakamura, T. 2000. Quantitative evaluation and categorising of human emotion induced by colour. Advances in Colour Science and Technology 3, 53--59.

[23]

Shapira, L., Shamir, A., and Cohen-Or, D. 2009. Image appearance exploration by model-based navigation. Comput. Graph. Forum 28, 2, 629--638.

[24]

Welsh, T., Ashikhmin, M., and Mueller, K. 2002. Transferring color to greyscale images. ACM Transactions on Graphics 21, 3, 277--280.

Digital Library

[25]

Xu, K., Li, Y., Ju, T., Hu, S.-M., and Liu, T.-Q. 2009. Efficient affinity-based edit propagation using k-d tree. In SIGGRAPH Asia '09: ACM SIGGRAPH Asia 2009 papers, ACM, New York, NY, USA, 1--6.

Digital Library

[26]

Yedidia, J. S., Freeman, W. T., and Weiss, Y. 2003. Understanding belief propagation and its generalizations. 239--269.

Digital Library

Cited By

Sun QNie YZhang QLi G(2024)Building Coarse to Fine Convex Hulls With Auxiliary Vertices for Palette-Based Image RecoloringIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.329638630:8(5581-5595)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3296386
Sato SSakurai KMizushima FDobashi Y(2023)An Optimization-based Recoloring System to Theme-Color最適化に基づくテーマカラーへの変換システムThe Journal of the Society for Art and Science10.3756/artsci.22.12_122:4(12_1-12_10)Online publication date: 2023
https://doi.org/10.3756/artsci.22.12_1
Shi YGao TJiao XCao N(2023)Understanding Design Collaboration Between Designers and Artificial Intelligence: A Systematic Literature ReviewProceedings of the ACM on Human-Computer Interaction10.1145/36102177:CSCW2(1-35)Online publication date: 4-Oct-2023
https://doi.org/10.1145/3610217
Show More Cited By

Index Terms

Data-driven image color theme enhancement
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Interest point and salient region detections
      2. Computer vision representations
        Image representations
  2. Computer graphics
    1. Image manipulation

Recommendations

Data-driven image color theme enhancement
SIGGRAPH ASIA '10: ACM SIGGRAPH Asia 2010 papers

It is often important for designers and photographers to convey or enhance desired color themes in their work. A color theme is typically defined as a template of colors and an associated verbal description. This paper presents a data-driven method for ...
Efficient edge-preserving algorithm for color contrast enhancement with application to color image segmentation

In this paper, a new and efficient edge-preserving algorithm is presented for color contrast enhancement in CIE Lu^'v^' color space. The proposed algorithm not only can enhance the color contrast as the previous algorithm does, but also has an edge-...
Underwater image enhancement by color correction and color constancy via Retinex for detail preserving
Abstract
In underwater, light attenuation causes non-uniform illumination that degrades underwater image. To enhance the degraded image, we propose an underwater image enhancement method that includes color correction, color constancy, multi-...
Graphical abstract

Display Omitted
Highlights
- The formulation of color correction compensates the red and blue channels by masking.

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 29, Issue 6

December 2010

480 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1882261

Issue’s Table of Contents

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 December 2010

Published in TOG Volume 29, Issue 6

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

136
Total Citations
View Citations
1,505
Total Downloads

Downloads (Last 12 months)40
Downloads (Last 6 weeks)1

Reflects downloads up to 12 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sun QNie YZhang QLi G(2024)Building Coarse to Fine Convex Hulls With Auxiliary Vertices for Palette-Based Image RecoloringIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.329638630:8(5581-5595)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3296386
Sato SSakurai KMizushima FDobashi Y(2023)An Optimization-based Recoloring System to Theme-Color最適化に基づくテーマカラーへの変換システムThe Journal of the Society for Art and Science10.3756/artsci.22.12_122:4(12_1-12_10)Online publication date: 2023
https://doi.org/10.3756/artsci.22.12_1
Shi YGao TJiao XCao N(2023)Understanding Design Collaboration Between Designers and Artificial Intelligence: A Systematic Literature ReviewProceedings of the ACM on Human-Computer Interaction10.1145/36102177:CSCW2(1-35)Online publication date: 4-Oct-2023
https://doi.org/10.1145/3610217
Beaudouin-Lafon ME JXia H(2023)Color Field: Developing Professional Vision by Visualizing the Effects of Color FiltersProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606828(1-16)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606828
Xu LPark SLee S(2023)Color2Vec: Web-Based Modeling of Word-Color Association with Sociocultural ContextsACM Transactions on Computer-Human Interaction10.1145/357181630:4(1-29)Online publication date: 12-Sep-2023
https://dl.acm.org/doi/10.1145/3571816
Guo SShi YXiao PFu YLin JZeng WLee T(2023)Creative and Progressive Interior Color Design with Eye-tracked User PreferenceACM Transactions on Computer-Human Interaction10.1145/354292230:1(1-31)Online publication date: 7-Mar-2023
https://dl.acm.org/doi/10.1145/3542922
Lin MShen IChin HChen RChen B(2023)Palette‐Based and Harmony‐Guided Colorization for Vector IconsComputer Graphics Forum10.1111/cgf.1495042:7Online publication date: 30-Oct-2023
https://doi.org/10.1111/cgf.14950
He YJin YLiu YLu BYu G(2023)Color-Correlated Texture Synthesis for Hybrid Indoor ScenesComputer-Aided Design and Computer Graphics10.1007/978-981-99-9666-7_14(200-214)Online publication date: 19-Aug-2023
https://dl.acm.org/doi/10.1007/978-981-99-9666-7_14
Lin JXiao PFu YShi YWang HGuo SHe YLee T(2022)C3 Assignment: Camera Cubemap Color Assignment for Creative Interior DesignIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.304172828:8(2895-2908)Online publication date: 1-Aug-2022
https://dl.acm.org/doi/10.1109/TVCG.2020.3041728
Xiao YWu JZhang JZhou PZheng YLeung CKavan L(2022)Interactive Deep Colorization and its Application for Image CompressionIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.302151028:3(1557-1572)Online publication date: 1-Mar-2022
https://doi.org/10.1109/TVCG.2020.3021510
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents