Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Single-view hair modeling using a hairstyle database

Published: 27 July 2015 Publication History

Abstract

Human hair presents highly convoluted structures and spans an extraordinarily wide range of hairstyles, which is essential for the digitization of compelling virtual avatars but also one of the most challenging to create. Cutting-edge hair modeling techniques typically rely on expensive capture devices and significant manual labor. We introduce a novel data-driven framework that can digitize complete and highly complex 3D hairstyles from a single-view photograph. We first construct a large database of manually crafted hair models from several online repositories. Given a reference photo of the target hairstyle and a few user strokes as guidance, we automatically search for multiple best matching examples from the database and combine them consistently into a single hairstyle to form the large-scale structure of the hair model. We then synthesize the final hair strands by jointly optimizing for the projected 2D similarity to the reference photo, the physical plausibility of each strand, as well as the local orientation coherency between neighboring strands. We demonstrate the effectiveness and robustness of our method on a variety of hairstyles and challenging images, and compare our system with state-of-the-art hair modeling algorithms.

Supplementary Material

ZIP File (a125-hu.zip)
Supplemental files
MP4 File (a125.mp4)

References

[1]
Baltrusaitis, T., Robinson, P., and Morency, L.-P. 2013. Constrained local neural fields for robust facial landmark detection in the wild. In IEEE ICCVW, 354--361.
[2]
Bergou, M., Wardetzky, M., Robinson, S., Audoly, B., and Grinspun, E. 2008. Discrete elastic rods. ACM Trans. Graph. 27, 3, 63:1--63:12.
[3]
Bertails, F., Audoly, B., Cani, M.-P., Querleux, B., Leroy, F., and Lévêque, J.-L. 2006. Super-helices for predicting the dynamics of natural hair. ACM Trans. Graph. 25, 3, 1180--1187.
[4]
Blanz, V., and Vetter, T. 1999. A morphable model for the synthesis of 3d faces. In SIGGRAPH '99, 187--194.
[5]
Bonneel, N., Paris, S., van de Panne, M., Durand, F., and Drettakis, G. 2009. Single photo estimation of hair appearance. In EGSR'09, 1171--1180.
[6]
Chai, M., Wang, L., Weng, Y., Yu, Y., Guo, B., and Zhou, K. 2012. Single-view hair modeling for portrait manipulation. ACM Trans. Graph. 31, 4, 116:1--116:8.
[7]
Chai, M., Wang, L., Weng, Y., Jin, X., and Zhou, K. 2013. Dynamic hair manipulation in images and videos. ACM Trans. Graph. 32, 4, 75:1--75:8.
[8]
Chai, M., Zheng, C., and Zhou, K. 2014. A reduced model for interactive hairs. ACM Trans. Graph. 33, 4, 124:1--124:11.
[9]
Chaudhuri, S., Kalogerakis, E., Guibas, L., and Koltun, V. 2011. Probabilistic reasoning for assembly-based 3D modeling. ACM Trans. Graphics 30, 4, 35:1--35:10.
[10]
Chen, T., Cheng, M.-M., Tan, P., Shamir, A., and Hu, S.-M. 2009. Sketch2photo: Internet image montage. ACM Trans. Graph. 28, 5, 124:1--124:10.
[11]
Cherin, N., Cordier, F., and Melkemi, M. 2014. Modeling piecewise helix curves from 2d sketches. Computer-Aided Design 46, 258--262.
[12]
Choe, B., and Ko, H.-S. 2005. A statistical wisp model and pseudophysical approaches for interactive hairstyle generation. IEEE Trans. Vis. Comput. Graph. 11, 2, 160--170.
[13]
Delong, A., Osokin, A., Isack, H. N., and Boykov, Y. 2012. Fast approximate energy minimization with label costs. International Journal of Computer Vision 96, 1, 1--27.
[14]
Derouet-Jourdan, A., Bertails-Descoubes, F., Daviet, G., and Thollot, J. 2013. Inverse dynamic hair modeling with frictional contact. ACM Trans. Graph. 32, 6, 159:1--159:10.
[15]
Echevarria, J. I., Bradley, D., Gutierrez, D., and Beeler, T. 2014. Capturing and stylizing hair for 3d fabrication. ACM Trans. Graph. 33, 4, 125:1--125:11.
[16]
Electronic Arts, 2014. The Sims Resource. http://www.thesimsresource.com/.
[17]
Fu, H., Wei, Y., Tai, C.-L., and Quan, L. 2007. Sketching hairstyles. In SBIM '07, 31--36.
[18]
Funkhouser, T., Kazhdan, M., Shilane, P., Min, P., Kiefer, W., Tal, A., Rusinkiewicz, S., and Dobkin, D. 2004. Modeling by example. ACM Trans. Graphics 23, 3, 652--663.
[19]
Hu, L., Ma, C., Luo, L., and Li, H. 2014. Robust hair capture using simulated examples. ACM Trans. Graph. 33, 4, 126:1--126:10.
[20]
Hu, L., Ma, C., Luo, L., Wei, L.-Y., and Li, H. 2014. Capturing braided hairstyles. ACM Trans. Graph. 33, 6, 225:1--225:9.
[21]
Huang, Z., Fu, H., and Lau, R. W. H. 2014. Data-driven segmentation and labeling of freehand sketches. ACM Trans. Graph. 33, 6, 175:1--175:10.
[22]
Jakob, W., Moon, J. T., and Marschner, S. 2009. Capturing hair assemblies fiber by fiber. ACM Trans. Graph. 28, 5, 164:1--164:9.
[23]
Kalogerakis, E., Chaudhuri, S., Koller, D., and Koltun, V. 2012. A probabilistic model for component-based shape synthesis. ACM Trans. Graph. 31, 4, 55:1--55:11.
[24]
Kholgade, N., Simon, T., Efros, A., and Sheikh, Y. 2014. 3d object manipulation in a single photograph using stock 3d models. ACM Trans. Graph. 33, 4, 127:1--127:12.
[25]
Kim, T.-Y., and Neumann, U. 2002. Interactive multiresolution hair modeling and editing. ACM Trans. Graph. 21, 3, 620--629.
[26]
Lay Herrera, T., Zinke, A., and Weber, A. 2012. Lighting hair from the inside: A thermal approach to hair reconstruction. ACM Trans. Graph. 31, 6, 146:1--146:9.
[27]
Lewis, J. P., Cordner, M., and Fong, N. 2000. Pose space deformation: A unified approach to shape interpolation and skeleton-driven deformation. In SIGGRAPH '00, 165--172.
[28]
Li, H., Adams, B., Guibas, L. J., and Pauly, M. 2009. Robust single-view geometry and motion reconstruction. ACM Trans. Graph. 28, 5, 175:1--175:10.
[29]
Luo, L., Li, H., and Rusinkiewicz, S. 2013. Structure-aware hair capture. ACM Trans. Graph. 32, 4, 76:1--76:12.
[30]
Newsea, 2014. Newsea SIMS. http://www.newseasims.com/.
[31]
Olsen, L., Samavati, F. F., Sousa, M. C., and Jorge, J. A. 2009. Sketch-based modeling: A survey. Computers & Graphics 33, 1, 85--103.
[32]
Paris, S., Chang, W., Kozhushnyan, O. I., Jarosz, W., Matusik, W., Zwicker, M., and Durand, F. 2008. Hair photobooth: Geometric and photometric acquisition of real hairstyles. ACM Trans. Graph. 27, 3, 30:1--30:9.
[33]
Shen, C.-H., Fu, H., Chen, K., and Hu, S.-M. 2012. Structure recovery by part assembly. ACM Trans. Graph. 31, 6, 180:1--180:11.
[34]
Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., and Blake, A. 2011. Real-time human pose recognition in parts from single depth images. In CVPR '11, 1297--1304.
[35]
Takayama, K., Panozzo, D., Sorkine-Hornung, A., and Sorkine-Hornung, O. 2013. Sketch-based generation and editing of quad meshes. ACM Trans. Graph. 32, 4, 97:1--97:8.
[36]
Wang, R. Y., and Popović, J. 2009. Real-time hand-tracking with a color glove. ACM Trans. Graph. 28, 3, 63:1--63:8.
[37]
Wang, L., Yu, Y., Zhou, K., and Guo, B. 2009. Example-based hair geometry synthesis. ACM Trans. Graph. 28, 3, 56:1--56:9.
[38]
Ward, K., Bertails, F., Kim, T.-Y., Marschner, S. R., Cani, M.-P., and Lin, M. C. 2007. A survey on hair modeling: Styling, simulation, and rendering. IEEE TVCG 13, 2, 213--234.
[39]
Weng, Y., Wang, L., Li, X., Chai, M., and Zhou, K. 2013. Hair interpolation for portrait morphing. Computer Graphics Forum 32, 7, 79--84.
[40]
Wither, J., Bertails, F., and Cani, M.-P. 2007. Realistic hair from a sketch. In SMI '07, 33--42.
[41]
Xu, K., Zheng, H., Zhang, H., Cohen-Or, D., Liu, L., and Xiong, Y. 2011. Photo-inspired model-driven 3d object modeling. ACM Trans. Graph. 30, 4, 80:1--80:10.
[42]
Xu, K., Zhang, H., Cohen-Or, D., and Chen, B. 2012. Fit and diverse: Set evolution for inspiring 3d shape galleries. ACM Trans. Graph. 31, 4, 57:1--57:10.
[43]
Xu, K., Chen, K., Fu, H., Sun, W.-L., and Hu, S.-M. 2013. Sketch2scene: Sketch-based co-retrieval and co-placement of 3d models. ACM Trans. Graph. 32, 4, 123:1--123:15.
[44]
Xu, B., Chang, W., Sheffer, A., Bousseau, A., McCrae, J., and Singh, K. 2014. True2form: 3d curve networks from 2d sketches via selective regularization. ACM Trans. Graph. 33, 4, 131:1--131:13.
[45]
Xu, Z., Wu, H.-T., Wang, L., Zheng, C., Tong, X., and Qi, Y. 2014. Dynamic hair capture using spacetime optimization. ACM Trans. Graph. 33, 6, 224:1--224:11.
[46]
Yu, X., Yu, Z., Chen, X., and Yu, J. 2014. A hybrid image-cad based system for modeling realistic hairstyles. In I3D '14, 63--70.
[47]
Yuksel, C., Schaefer, S., and Keyser, J. 2009. Hair meshes. ACM Trans. Graph. 28, 5, 166:1--166:7.
[48]
Zhou, S., Fu, H., Liu, L., Cohen-Or, D., and Han, X. 2010. Parametric reshaping of human bodies in images. ACM Trans. Graph. 29, 4, 126:1--126:10.

Cited By

View all
  • (2024)Modeling Hair Strands with Roving CapsulesACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657450(1-9)Online publication date: 13-Jul-2024
  • (2024)HairStyle Editing via Parametric Controllable StrokesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324189430:7(3857-3870)Online publication date: 1-Jul-2024
  • (2024)LayerNet: High-Resolution Semantic 3D Reconstruction of Clothed PeopleIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.333267746:2(1257-1272)Online publication date: 1-Feb-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 34, Issue 4
August 2015
1307 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/2809654
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 July 2015
Published in TOG Volume 34, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. data-driven modeling
  2. hairstyle database
  3. piecewise helices
  4. sketch-based retrieval
  5. structure-aware shape processing

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)102
  • Downloads (Last 6 weeks)7
Reflects downloads up to 10 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Modeling Hair Strands with Roving CapsulesACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657450(1-9)Online publication date: 13-Jul-2024
  • (2024)HairStyle Editing via Parametric Controllable StrokesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324189430:7(3857-3870)Online publication date: 1-Jul-2024
  • (2024)LayerNet: High-Resolution Semantic 3D Reconstruction of Clothed PeopleIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.333267746:2(1257-1272)Online publication date: 1-Feb-2024
  • (2024)MonoHair: High-Fidelity Hair Modeling from a Monocular Video2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.02281(24164-24173)Online publication date: 16-Jun-2024
  • (2024)Dr.Hair: Reconstructing Scalp-Connected Hair Strands without Pre-Training via Differentiable Rendering of Line Segments2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.01947(20601-20611)Online publication date: 16-Jun-2024
  • (2024)Text-Conditioned Generative Model of 3D Strand-Based Human Hairstyles2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00450(4703-4712)Online publication date: 16-Jun-2024
  • (2024)SPHEAR: Spherical Head Registration for Complete Statistical 3D Modeling2024 International Conference on 3D Vision (3DV)10.1109/3DV62453.2024.00145(213-224)Online publication date: 18-Mar-2024
  • (2024)A Local Appearance Model for Volumetric Capture of Diverse Hairstyles2024 International Conference on 3D Vision (3DV)10.1109/3DV62453.2024.00013(190-200)Online publication date: 18-Mar-2024
  • (2024)Spline-Based TransformersComputer Vision – ECCV 202410.1007/978-3-031-73016-0_1(1-17)Online publication date: 26-Oct-2024
  • (2023)Research on the influence of new media on the ideological and political education of college students in the background of the Internet and countermeasuresApplied Mathematics and Nonlinear Sciences10.2478/amns.2023.2.000609:1Online publication date: 19-Jul-2023
  • Show More Cited By

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media