A Survey on Hair Modeling

Authors

  • Jingrong Yang

DOI:

https://doi.org/10.54097/y7bzrg65

Keywords:

Hair Modeling, Deep Learning, Physics-Based Methods, Interactive Editing, 3D Reconstruction.

Abstract

Hair modeling is a vital research area in computer graphics, aiming to create realistic, controllable, and interactive hair models. Recent advancements in computer vision, deep learning, and physical simulations have significantly propelled the field of hair modeling. This paper provides a comprehensive overview of current hair modeling techniques, including generative models, physics-based approaches, interactive editing methods, deep learning-driven methods, and 3D modeling and reconstruction techniques. The fundamental principles, advantages, limitations, and potential applications of these methods are discussed.

Downloads

Download data is not yet available.

References

[1] Zhang, Meng, and Y. Zheng. "Hair-GAN: Recovering 3D hair structure from a single image using generative adversarial networks." 3.2(2019):11.

[2] Zhang M, Chai M, Wu H, et al. A data-driven approach to four-view image-based hair modeling. Acm Transactions on Graphics, 2017, 36(4):1-11. DOI :10.1145/3072959.3073627.

[3] Vanessa Sklyarova, Egor Zakharov, Otmar Hilliges, Michael J. Black, Justus Thies. HAAR: Text-Conditioned Generative Model of 3D Strand-based Human Hairstyles arXiv:2312.11666

[4] Wenpeng Xiao, Wentao Liu, Yitong Wang, Bernard Ghanem, Bing Li. Automatic Animation of Hair Blowing in Still Portrait Photos.arXiv:2309.14207

[5] Chen, H., & Zhu, S. C. (2005). A generative model of human hair for hair sketching. In CVPR '05: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 (Vol. 2, pp. 74-81). IEEE Computer Society

[6] Qiu H, Wang C, Zhu H, et al. Two ‐phase Hair Image Synthesis by Self‐Enhancing Generative Model. Computer Graphics Forum, 2019, 38(7). DOI :10.1111/cgf.13847.

[7] Bertails, F., Audoly, B., Querleux, B., Leroy, F., Leveque, J.-L., & Cani, M.-P. (2005). Predicting natural hair shapes by solving the statics of flexible rods. In European Association for Computer Graphics.

[8] A. Selle, M. Lentine, and R. Fedkiw. 2008. A Mass Spring Model for Hair Simulation. ACM Trans. Graph. 27, 3 (2008), 64:1--64:11.

[9] Akkermans R L C, Warren P B. Multiscale modelling of human hair. Philosophical Transactions of The Royal Society A: Mathematical Physical and Engineering Sciences, 2004, 362(1821):1783-1793. DOI :10.1098/rsta.2004.1395.

[10] Koh, C. K., & Huang, Z. (2001). A simple physics model to animate human hair modeled in 2D strips in real time. Proceedings of the Eurographics Workshop on Computer Animation and Simulation, 127-138.

[11] Yang, G., & Huang, Z. (2002). A method of human short hair modeling and real-time animation. In PG '02: Proceedings of the 10th Pacific Conference on Computer Graphics and Applications (p. 435). IEEE Computer Society.

[12] Herrera, T. L., Zinke, A., & Weber, A. (2012). Lighting hair from the inside: A thermal approach to hair reconstruction. ACM Transactions on Graphics (TOG), 31(6), 146.

[13] Derouet-Jourdan, A., Bertails-Descoubes, F., Daviet, G., & Thollot, J. (2013). Inverse dynamic hair modeling with frictional contact. ACM Transactions on Graphics (TOG), 32(6), 159.

[14] Tan, Z., Chai, M., Chen, D., Liao, J., Chu, Q., Yuan, L., Tulyakov, S., & Yu, N. (2020). MichiGAN: Multi-input-conditioned hair image generation for portrait editing. ACM Transactions on Graphics (TOG), 39(4).

[15] Wei, T., et al. (2022). HairCLIP: Design your hair by text and reference image. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 18051-18060).

[16] Xu Z, Yang X D. V-HairStudio: An interactive tool for hair design. IEEE Computer Graphics and Applications, 2001, 21(3): 36-43.DOI:10.1109/38.920625

[17] Tae-Yong Kim and Ulrich Neumann. 2002. Interactive multiresolution hair modeling and editing. ACM Transactions on Graphics 21, 3 (2002), 620--629.

[18] Ma Y, Wang C, Li S, et al. Hair Segmentation on Time-of-Flight RGBD Images. 2019. DOI:10.48550/ arXiv.1903.02775.

[19] Zheng, Y., Jin, Z., Li, M., Huang, H., Ma, C., Cui, S., Han, X., & Zhou, K. (2023). HairStep: Transfer synthetic to real using strand and depth maps for single-view 3D hair modeling. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 12726-12735)

[20] Wu, K., Ye, Y., Yang, L., et al. (2022). NeuralHDHair: Automatic high-fidelity hair modeling from a single image using implicit neural representations. arXiv:2205.04175.

[21] Wu, K., Yang, L., Kuang, Z., Feng, Y., Han, X., Shen, Y., Fu, H., Zhou, K., & Zheng, Y. (2024). MonoHair: High-fidelity hair modeling from a monocular video. arXiv:2403.18356.

[22] Zhou, Y., Chai, M., Pepe, A., Gross, M., & Beeler, T. (2023). GroomGen: A high-quality generative hair model using hierarchical latent representations. ACM Transactions on Graphics (TOG), 42(6)

[23] Zhou Y, Hu L, Xing J, et al. HairNet: Single-View Hair Reconstruction using Convolutional Neural Networks[J]. 2018.DOI:10.48550/arXiv.1806.07467

[24] Wei T, Chen D, Zhou W, et al. HairCLIPv2: Unifying Hair Editing via Proxy Feature Blending[C]//2023 IEEE/CVF International Conference on Computer Vision (ICCV). DOI:10.1109/ICCV51070.2023.02156.

[25] V. Sklyarova, J. Chelishev, A. Dogaru, I. Medvedev, V. Lempitsky and E. Zakharov, "Neural Haircut: Prior-Guided Strand-Based Hair Reconstruction," 2023 IEEE/CVF International Conference on Computer Vision (ICCV), Paris, France, 2023, pp. 19705-19716, doi: 10.1109/ICCV51070.2023.01810.

[26] Maxim Nikolaev, Mikhail Kuznetsov, Dmitry Vetrov, Aibek Alanov. HairFastGAN: Realistic and Robust Hair Transfer with a Fast Encoder-Based Approach arXiv:2404.01094

[27] Z. Wang et al., "NeuWigs: A Neural Dynamic Model for Volumetric Hair Capture and Animation," 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada, 2023, pp. 8641-8651, doi: 10.1109/CVPR52729.2023.00835.

[28] Kim, T., Chung, C., Kim, Y., Park, S., Kim, K., & Choo, J. (2022). Style Your Hair: Latent Optimization for Pose-Invariant Hairstyle Transfer via Local-Style-Aware Hair Alignment. In Computer Vision – ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part XVII (pp. 188-203). Springer.

[29] Kips R, Bokaris P A, Perrot M, et al. Hair Color Digitization through Imaging and Deep Inverse Graphics[J]. 2022.DOI:10.48550/arXiv.2202.03723.

[30] Chai, M., Ren, J., & Tulyakov, S. (2020). Neural Hair Rendering. In Computer Vision – ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XVIII (pp. 371-388)

[31] Saito, S., Hu, L., Ma, C., Ibayashi, H., Luo, L., & Li, H. (2018). 3D hair synthesis using volumetric variational autoencoders. ACM Transactions on Graphics (TOG), 37(6), 208.

[32] Lingchen Yang, Zefeng Shi, Youyi Zheng, and Kun Zhou. 2019. Dynamic hair modeling from monocular videos using deep neural networks. ACM Transactions on Graphics (TOG)38, 6 (2019), 1–12

[33] Xiao, C., Yu, D., Han, X., Zheng, Y., & Fu, H. (2021). SketchHairSalon: Deep sketch-based hair image synthesis. ACM Transactions on Graphics (TOG), 40(6), 216.

[34] Pektas, M., & Uğur, A. (2022). Realistic Hair Synthesis with Generative Adversarial Networks. ArXiv, abs/2209.12875.

[35] Radu Alexandru Rosu, Shunsuke Saito, Ziyan Wang, Chen-glei Wu, Sven Behnke, and Giljoo Nam. Neural strands: Learning hair geometry and appearance from multi-view images. In European Conference on Computer Vision, pages 73–89. Springer, 2022

[36] Z. Wang et al., "HVH: Learning a Hybrid Neural Volumetric Representation for Dynamic Hair Performance Capture," 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA, 2022, pp. 6133-6144, doi: 10.1109/CVPR52688.2022.00605.

[37] Chai, M., Shao, T., Wu, H., et al. (2016). AutoHair: Fully automatic hair modeling from a single image. ACM Transactions on Graphics (TOG), 35(4), 116:1-116:11.

[38] Chai, M., Luo, L., Sunkavalli, K., et al. (2015). High-quality hair modeling from a single portrait photo. ACM Transactions on Graphics (TOG), 34(6), 204:1-204:10.

[39] Hu L, Ma C, Luo L, et al. Single-View Hair Modeling Using a Hairstyle Database[J].ACM Transactions on Graphics, 2016, 35(4CD):125.1-125.9

[40] Luo, H., Min, O., Zhao, Z., Jiang, S., Zhang, L., Zhang, Q., Yang, W., Xu, L., & Yu, J. (2024). GaussianHair: Hair Modeling and Rendering with Light-aware Gaussians. ArXiv, abs/2402.10483.

[41] Shen Y, Zhang C, Fu H, et al. DeepSketchHair: Deep Sketch-based 3D Hair Modeling. IEEE Transactions on Visualization and Computer Graphics, 2020, PP (99): 1-1.DOI:10.1109/TVCG.2020.2968433.

[42] Paris, S., Chang, W., Kozhushnyan, O. I., Jarosz, W., Matusik, W., Zwicker, M., & Durand, F. (2008). Hair photobooth: Geometric and photometric acquisition of real hairstyles. ACM Transactions on Graphics (TOG), 27(3), 1-9.

[43] Beeler T, Bickel B, Noris G, et al. Coupled 3D Reconstruction of Sparse Facial Hair and Skin[J]. Acm Transactions on Graphics, 2012, 31(4). DOI:10.1145/2185520.2185613.

[44] Meng Zhang, Pan Wu, Hongzhi Wu, Yanlin Weng, Youyi Zheng, and Kun Zhou. 2018. Modeling hair from an rgb-d camera. ACM Transactions on Graphics (TOG) 37, 6 (2018).

[45] Jose I. Echevarria, Derek Bradley, Diego Gutierrez, and Thabo Beeler. 2014. Capturing and Stylizing Hair for 3D Fabrication. ACM Trans. Graph. 33, 4, 125 (jul 2014), 11 pages.

[46] Yusuke Takimoto, Hikari Takehara, Hiroyuki Sato, Zihao Zhu, Bo Zheng. Dr.Hair: Reconstructing Scalp-Connected Hair Strands without Pre-training via Differentiable Rendering of Line Segments arXiv:2403.17496

[47] Wei, Y., Ofek, E., Quan, L., & Shum, H.-Y. (2005). Modeling hair from multiple views. ACM Transactions on Graphics (TOG), 24(3), 816-820.

[48] Ward K., Lin M. C., Lee J., Fisher S., Macri D.: Modeling hair using level-of-detail representations. In Proceedings of the 16th International Conference on Computer Animation and Social Agents (CASA 2003) (2003), CASA '03, pp. 41--47. 2

[49] Noble, P., and Tang, W. 2004. Modelling and animating cartoon hair with nurbs surfaces. In Computer Graphics International, 2004. Proceedings, IEEE, 60--67.

[50] Yu, Y. 2001. Modeling realistic virtual hairstyles. In Proceedings of the 9th Pacific Conference on Computer Graphics and Applications, IEEE Computer Society, Washington, DC, USA, PG '01, 295--304.

[51] Yamaguchi, T., Wilburn, B., & Ofek, E. (2009). Video-based modeling of dynamic hair. In PSIVT '09: Proceedings of the 3rd Pacific Rim Symposium on Advances in Image and Video Technology (pp. 585-596).

[52] Liang S, Huang X, Meng X, et al. Video to Fully Automatic 3D Hair Model[J].ACM Transactions on Graphics, 2018, 37(6):1-14. DOI :10.1145/3272127.3275020.

[53] Kong, W. M., Takahashi, H., & Nakajima, M. (1998). Generation of a 3D hair model from hair volume. In Multimedia Networks: Security, Displays, Terminals, and Gateways (Vol. 3228).

[54] Sedaghat N. Hair modeling and rendering using Ray-tracing on GPU[J]. 2008.

[55] Nuttapon, Vanakittistien, Attawith. et al. Game‐ready 3D hair model from a small set of images. Computer Animation & Virtual Worlds, 2019.DOI:10.1002/cav.1855.

[56] T. Sakai and V. Savchenko, "Skeleton-Based Anime Hair Modeling and Visualization," 2013 International Conference on Cyberworlds, Yokohama, Japan, 2013, pp. 318-321, doi: 10.1109/CW.2013.39.

[57] Zufeng, W., Shoujue, W., Lian-fen, H., & Chao, H. (2016). A Realistic Automatic 3D Hair Visual Effect Modeling Method.

[58] Qing Zhang, Jing Tong, Huamin Wang, Zhigeng Pan, and Ruigang Yang. 2012. Simulation Guided Hair Dynamics Modeling from Video. Computer Graph. Forum 31, 7pt1 (September 2012), 2003–2010.

[59] Tao Huang, Yang Zhou, Daqi Lin, Junqiu Zhu, Ling-Qi Yan, Kui Wu Real-time Level-of-detail Strand-based Hair Rendering, 2024 arXiv:2405.10565

[60] Daldegan A, Thalmann N M, Kurihara T, et al. An Integrated System for Modeling, Animating and Rendering Hair. Computer Graphics Forum, 2010, 12(3):211-221. DOI :10.1111/1467-8659.1230211

[61] Yang, X. D., Xu, Z., Yang, J., & Wang, T. (2000). The cluster hair model. Graphical Models, 62(2), 85-103.

[62] Stheirin A, Pasko A, Savchenko V. Using Real Functions with Application to Hair Modelling. Computers & Graphics, 1996, 20(1):11-19. doi:10.1016/0097-8493(95)00088-7

[63] Nakamura, S., & Kikuchi, T. (2019). Procedural modeling of hair. Reports of the Technical Conference of the Institute of Image Electronics Engineers of Japan, 126-129.

[64] Sakai, T., & Savchenko, V. (2013). Skeleton-based cartoon hair modeling using blobby model. In SIGGRAPH Asia 2013 Posters (SA '13) (No. 17, p. 1).

[65] Menglei C, Yanlin W, Qiming H, et al. Surface Mesh Controlled Fast Hair Modeling[J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Jtheirnal of Computer-Aided Design and Computer Graphics, 2012, 24(8):975-983.

[66] Piuze, E., Kry, P. G., & Siddiqi, K. (2011). Generalized helicoids for modeling hair geometry. Computer Graphics Forum, 30(2), 247-256.

[67] Nicolas Bonneel, Sylvain Paris, Michiel Van De Panne, Fredo Durand, and George Drettakis. 2009. Single Photo Estimation of Hair Appearance. Computer Graphics Forum 28, 4 (2009), 1171–1180

[68] Chai, Menglei, et al. "Single-view hair modeling for portrait manipulation." Acm Transactions on Graphics 31.4(2012):1-8.

[69] Chen, Lieu Hen, S Saeyor, and H. Dohi. "A system of 3D hair style synthesis based on the wisp model." Visual Computer 15.4(1999):159-170.

[70] Yeh, C.-K., Jayaraman, P. K., Liu, X., Fu, C.-W., & Lee, T.-Y. (2015). 2.5D cartoon hair modeling and manipulation. IEEE Transactions on Visualization and Computer Graphics, 21(3), 304-314.

[71] Zhao Min, Sun Dihua, He Hengpan, Hair-color Modeling and Head Detection[C]. Proceedings of the 7th World Congress on Intelligent Control and Automation, WCICA'08, 2008:7768-7772

[72] Tkachenka, A.; Karpiak, G.; Vakunov, A.; Kartynnik, Y.; Ablavatski, A.; Bazarevsky, V.; Pisarchyk, S. Real-time Hair Segmentation and Recoloring on Mobile GPUs. In Proceedings of the CVPR Workshop on Computer Vision for Augmented and Virtual Reality,Long Beach, CA, USA, 17 June 2019; pp. 1–3.

[73] Attia M, Hossny M, Nahavandi S, et al. Realistic Hair Simulation Using Image Blending. 2019.DOI:10.48550

[74] Ma, Y., Wang, C., Zhang, G., Jiang, Q., Li, S., & Yu, J. (2019). Hair Segmentation on Time-of-Flight RGBD Images. ArXiv, abs/1903.02775.

[75] Pektas M, Gecer B, Ugur A. Efficient Hair Style Transfer with Generative Adversarial Networks. arXiv e-prints, 2022.DOI:10.48550/arXiv.2210.12524.

[76] Chaeyeon Chung, Taewoo Kim, Hyelin Nam, Seunghwan Choi, Gyojung Gu, Sunghyun Park, Jaegul Choo HairFIT: Pose-Invariant Hairstyle Transfer via Flow-based Hair Alignment and Semantic-Region-Aware Inpainting arXiv:2206.08585

[77] Chai, M., Wang, L., Weng, Y., Jin, X., & Zhou, K. (2013). Dynamic hair manipulation in images and videos. ACM Transactions on Graphics (TOG), 32(4), 75.

[78] Yu, X., Yu, Z., Chen, X., & Yu, J. (2014). A hybrid image-CAD based system for modeling realistic hairstyles. In Proceedings of the 18th ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D '14) (pp. 63-70).

[79] L. Cheng, Y. Bao and Y. Qi, "Automatic Hair Modeling from One Image," 2019 International Conference on Virtual Reality and Visualization (ICVRV), Hong Kong, China, 2019, pp. 108-112, doi: 10.1109/ICVRV47840.2019.00026.

[80] Morace, C. C., Wu, F.-W., Yeh, C.-K., Chen, C.-H., Yeh, I.-C., & Lee, T.-Y. (2018). Hair modeling from a single anime-style image. In SIGGRAPH Asia 2018 Posters (SA '18) (No. 31, pp. 1-2).

Downloads

Published

28-10-2024