Motion capture and retargeting for character animation: A Survey
DOI:
https://doi.org/10.54097/2g40mx68Keywords:
Motion capture; motion retargeting; multi-sensor tracking; physical constraint optimization.Abstract
Motion capture serves as the core data acquisition method for character animation, while motion retargeting enables the cross-character reuse of captured motion sequences. The integrated pipeline of capture and retargeting has become the mainstream production workflow for games, VR, and digital human creation. Traditional geometric retargeting methods are prone to foot sliding, ground penetration, and loss of contact semantics when processing motion capture data with occlusion noise, whereas recent deep learning and physical optimization algorithms have significantly improved the naturalness of retargeted motions. This paper systematically reviews representative literature on motion capture and retargeting, organized into five categories following the complete industrial workflow: multi-modal motion acquisition and preprocessing, cross-skeleton shape-adaptive retargeting, AI-assisted motion generation, physically constrained interactive retargeting, and end-to-end integrated pipelines with cross-domain applications. For each category, we elaborate on core technical schemes, inherent limitations, and typical experimental outcomes with standard citations. This survey provides systematic literature support for researchers engaged in motion capture and retargeting animation.
References
[1] BOLANOS L, WYDER-HODGE P, LIN X D, et al. Measuring human motion under clothing[C]. SIGGRAPH Asia 2024 Conference Papers, 2024.
[2] JANG D K, YANG D, JANG D Y, et al. ELMO: Enhanced Real-time LiDAR Motion Capture through Upsampling[J]. ACM Transactions on Graphics, 2024, 43(6): 237.
[3] LU Y, SHI Z Y, WU Y H, et al. Shape-aware Inertial Poser: Motion Tracking for Humans with Diverse Shapes[J]. ACM Transactions on Graphics, 2025, 44(6): 221.
[4] PAN X Y, ZHENG B W, JIANG X W, et al. RoMo: a robust solver for full-body unlabeled optical motion capture[C]. SIGGRAPH Asia 2024 Conference Papers, 2024.
[5] DONG P Y, ZHANG Y, ZHANG Z H. Data processing method of 3D motion capture based on bone constraint[C]. 2021 33rd Chinese Control and Decision Conference, 2021: 833.
[6] GHORBANI S, MAHDAVIANI K, THALER A, et al. MoVi: a large multi-purpose human motion and video dataset[J]. PLOS ONE, 2021, 16(6): e0253157.
[7] LABUGUEN R T, NEGRETE S B, KOGAMI T, et al. Performance evaluation of markerless 3D skeleton pose estimates with pop dance motion[C]. IEEE Conference, 2020.
[8] ZHANG H D, CHEN Z K, XU H C, et al. Unified cross-structural motion retargeting for humanoid characters[J]. IEEE Transactions on Visualization and Computer Graphics, 2025, 31(7): 3863.
[9] JIN T, LEE Y, LEE S H. InterFaceRays: interaction-oriented furniture surface representation for human pose retargeting[J]. Computer Graphics Forum, 2025, 44(2): e70094.
[10] GUO T Z, CHEN Z D, JIANG Y, et al. Ultrafast and controllable online motion retargeting for game scenarios[J]. ACM Transactions on Graphics, 2025, 44(6): 261.
[11] TRIPATHI S, TAHERI O, LASSNER C, et al. HUMOS: Human Motion Model Conditioned on Body Shape[C]. Proceedings of the 18th European Conference on Computer Vision, 2024.
[12] VYAS B, O’SULLIVAN C. ShapeVerse: Physics-based Characters with Varied Body Shapes[C]. Eurographics 2024 Posters, 2024.
[13] CHEYNEL T, ROSSI T, BELLOT-GURLET B, et al. ReConForM: Real-time Contact-aware Motion Retargeting for more Diverse Character Morphologies[J]. Computer Graphics Forum, 2025.
[14] SHEWHORAK S. A Data-driven Approach to Motion Diversification over Increases in Body Morphology[D]. Teesside University, 2017.
[15] HASSAN M, GUO Y R, WANG T W, et al. Synthesizing physical character-scene interactions[C]. SIGGRAPH '23 Conference Proceedings, 2023.
[16] DENG Y B, LI Z, XIE N, et al. PIMT: physics-based interactive motion transition for hybrid character animation[C]. Proceedings of the 32nd ACM International Conference on Multimedia, 2024.
[17] ZHANG H, X H, F C, et al. PhysRig: Differentiable Physics-Based Skinning and Rigging Framework[C]. 2025 IEEE/CVF International Conference on Computer Vision, 2025:6609-6620.
[18] HÄFLIGER A, KURABAYASHI S. Dynamic motion matching: design and implementation of a context-aware animation system for games[J]. International Journal of Semantic Computing, 2022, 16: 189-212.
[19] KAPADIA M, XIANGHAO X, NITTI M, et al. PRECISION: Precomputing Environment Semantics for Contact-Rich Character Animation[C]. SIGGRAPH I3D 2016, 2016:29-37.
[20] PENG Y, ZHAO C, HUANG Z, et al. Two-Stage Motion Editing Interface for Character Animation[C]. Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 2021.
[21] LAMBERTI F, et al. Virtual character animation based on affordable motion capture and reconfigurable tangible interfaces[J]. IEEE Transactions on Visualization and Computer Graphics, 2018, 24(5): 1742.
[22] PONTON J L. Motion Matching for Character Animation and Virtual Reality Avatars[D]. Universitat Politècnica de Catalunya, 2022.
[23] JIANG X Y, LUO M Y, IBRAHIM Z, et al. Immersive VR-MoCap for creative motion design in character animation training[J]. Computers, 2026, 15(5): 284.
[24] HAMILTON R I, GLAVCHEVA-LALEVA Z, MILON M I H, et al. Comparison of computational pose estimation models for joint angles with 3D motion capture[J]. Journal of Bodywork & Movement Therapies, 2024, 40: 315-319.
[25] SUO X, TANG W D, LI Z. Motion capture technology in sports scenarios: a survey[J]. Sensors, 2024, 24(9): 2947.
[26] KAMMERLANDER R K, PEREIRA A, ALEXANDER S. Using virtual reality to support acting in motion capture with differently scaled characters[C]. 2021 IEEE Virtual Reality and 3D User Interfaces, 2021: 1402.
[27] ZHU X D, LI K F. Real-time motion capture: an overview[C] //2016 10th International Conference on Complex, Intelligent, and Software Intensive Systems, 2016: 522.
Downloads
Published
Issue
Section
License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.







