Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3284398.3284404acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
research-article

Image recoloring for home scene

Published: 02 December 2018 Publication History

Abstract

Indoor home scene coloring technology is a hot topic for home design, helping users make home coloring decisions. Image based home scene coloring is preferable for e-commerce customers since it only requires users to describe coloring expectations or manipulate colors through images, which is intuitive and inexpensive. In contrast, if home scene coloring is performed based on 3D scenes, the process becomes expensive due to the high cost and time in obtaining 3D models and constructing 3D scenes. To realize image based home scene coloring, our framework can extract the coloring of individual furniture together with their relationship. This allows us to formulate the color structure of the home scene, serving as the basis for color migration. Our work is challenging since it is not intuitive to identify the coloring of furniture and their parts as well as the coloring relationship among furniture. This paper presents a new color migration framework for home scenes. We first extract local coloring from a home scene image forming a regional color table. We then generate a matching color table from a template image based on its color structure. Finally we transform the target image coloring based on the matching color table and well maintain the boundary transitions among image regions. We also introduce an interactive operation to guide such transformation. Experiments show our framework can produce good results meeting human visual expectations.

References

[1]
{n. d.}. Adobe Kuler. {Online}. Available: http://kuler.adobe.com. ({n. d.}).
[2]
{n. d.}. Colourlovers. {Online}. Available: http://www.colurlovers.com. ({n. d.}).
[3]
James C Bezdek. 1981. Objective Function Clustering. In Pattern recognition with fuzzy objective function algorithms. Springer, 43--93.
[4]
Faber Birren. 1969. A grammar of color, a basic treatise on the color system of Albert H. Munsell. (1969).
[5]
Huiwen Chang, Ohad Fried, Yiming Liu, Stephen DiVerdi, and Adam Finkelstein. 2015. Palette-based photo recoloring. ACM Transactions on Graphics (TOG) 34, 4 (2015), 139.
[6]
Guangming Chen, Guiqing Li, Yongwei Nie, Chuhua Xian, and Aihua Mao. 2016. Stylistic indoor colour design via Bayesian network. Computers & Graphics 60 (2016), 34--45.
[7]
Kang Chen, Kun Xu, Yizhou Yu, Tian-Yi Wang, and Shi-Min Hu. 2015. Magic decorator: automatic material suggestion for indoor digital scenes. ACM Transactions on Graphics (TOG) 34, 6 (2015), 232.
[8]
Daniel Cohen-Or, Olga Sorkine, Ran Gal, Tommer Leyvand, and Ying-Qing Xu. 2006. Color harmonization. In ACM Transactions on Graphics (TOG), Vol. 25. ACM, 624--630.
[9]
Johannes Itten. 1973. the art of Color: the subjective experience and objective rationale of Color. translated by ernst van haagen. Van Nostrand Reinhold.
[10]
Sharon Lin and Pat Hanrahan. 2013. Modeling how people extract color themes from images. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 3101--3110.
[11]
László Neumann and Attila Neumann. 2005. Color style transfer techniques using hue, lightness and saturation histogram matching. In Computational Aesthetics. Citeseer, 111--122.
[12]
Rang MH Nguyen, Seon Joo Kim, and Michael S Brown. 2014. Illuminant Aware Gamut-Based Color Transfer. In Computer Graphics Forum, Vol. 33. Wiley Online Library, 319--328.
[13]
Peter O'Donovan, Aseem Agarwala, and Aaron Hertzmann. 2011. Color compatibility from large datasets. In ACM Transactions on Graphics (TOG), Vol. 30. ACM, 63.
[14]
Li-Chen Ou and M Ronnier Luo. 2006. A colour harmony model for two-colour combinations. Color Research & Application 31, 3 (2006), 191--204.
[15]
Nicolas Papadakis, Edoardo Provenzi, and Vicent Caselles. 2011. A variational model for histogram transfer of color images. IEEE Transactions on Image Processing 20, 6 (2011), 1682--1695.
[16]
Gabriele Peters. 2007. Aesthetic primitives of images for visualization. In Information Visualization, 2007. IV'07. 11th International Conference. IEEE, 316--325.
[17]
Tania Pouli and Erik Reinhard. 2011. Progressive color transfer for images of arbitrary dynamic range. Computers & Graphics 35, 1 (2011), 67--80.
[18]
Brian L Price, Bryan Morse, and Scott Cohen. 2010. Geodesic graph cut for interactive image segmentation. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on. IEEE, 3161--3168.
[19]
Erik Reinhard, Michael Adhikhmin, Bruce Gooch, and Peter Shirley. 2001. Color transfer between images. IEEE Computer graphics and applications 21, 5 (2001), 34--41.
[20]
Yu-Wing Tai, Jiaya Jia, and Chi-Keung Tang. 2005. Local color transfer via probabilistic segmentation by expectation-maximization. In Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, Vol. 1. IEEE, 747--754.
[21]
Go Tanaka, Noriaki Suetake, and Eiji Uchino. 2010. Color transfer based on normalized cumulative hue histograms. Journal of Advanced Computational Intelligence and Intelligent Informatics 14, 2 (2010), 185--192.
[22]
Xiao-Hui Wang, Jia Jia, Han-Yu Liao, and Lian-Hong Cai. 2012. Affective image colorization. Journal of Computer Science and Technology 27, 6 (2012), 1119--1128.
[23]
Arthur Robert Weeks and G Eric Hague. 1997. Color segmentation in the HSI color space using the K-means algorithm. In Nonlinear Image Processing VIII, Vol. 3026. International Society for Optics and Photonics, 143--155.
[24]
Li Xu, Qiong Yan, Yang Xia, and Jiaya Jia. 2012. Structure extraction from texture via relative total variation. ACM Transactions on Graphics (TOG) 31, 6 (2012), 139.
[25]
Suiyun Zhang, Zhizhong Han, Ralph R Martin, and Hui Zhang. 2017. Semantic 3D indoor scene enhancement using guide words. The Visual Computer 33, 6-8 (2017), 925--935.
[26]
Jie Zhu, Yanwen Guo, and Han Ma. 2017. A Data-driven Approach for Furniture and Indoor Scene Colorization. IEEE transactions on visualization and computer graphics (2017).

Cited By

View all
  • (2019)A Color‐Pair Based Approach for Accurate Color Harmony EstimationComputer Graphics Forum10.1111/cgf.1385438:7(481-490)Online publication date: 14-Nov-2019

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VRCAI '18: Proceedings of the 16th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry
December 2018
200 pages
ISBN:9781450360876
DOI:10.1145/3284398
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 December 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. color migration
  2. color structure
  3. coloring expectation
  4. indoor home scene
  5. interactive operation

Qualifiers

  • Research-article

Funding Sources

  • Natural Science Foundation of China

Conference

VRCAI '18
Sponsor:

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)11
  • Downloads (Last 6 weeks)0
Reflects downloads up to 28 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2019)A Color‐Pair Based Approach for Accurate Color Harmony EstimationComputer Graphics Forum10.1111/cgf.1385438:7(481-490)Online publication date: 14-Nov-2019

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media