Research on Application of Multi-modal Large Model in Robot Control


  • Xiran Su



Multi-modal Large Model, Robot Control, AI and Robotics


This study discusses the application of multi-modal large model in robot control. With the rapid development of AI and robotics, multi-modal large-scale model, as a large-scale deep learning model integrating multiple sensing modes, provides new ideas and methods for intelligent control of robots in complex environments. Firstly, this paper introduces the basic principle and technical characteristics of multi-modal large-scale model, including its structure, training methods and application scenarios. Then, aiming at the specific application scenarios in smart home environment, this paper designs a series of experiments to evaluate the performance of multi-modal large model in path planning, task effect and generalization ability. The experimental results show that the multi-modal large model can achieve more accurate and efficient path planning and task execution in smart home environment, and has strong generalization ability, which can adapt to the needs of different environments and tasks. Finally, this paper summarizes and looks forward to the application of multi-modal large model in robot control, and points out its important significance and potential application prospect in the development of intelligent robot technology.


Download data is not yet available.


Vladareanu, L. , Vladareanu, V. , Yu, H. , Wang, H. , & Smarandache, F. (2018). Robot advanced intelligent control developed through versatile intelligent portable platform. Sensors, 20(13), 5.

Fan, J. (2020). The automation control system of intelligent flexible clearing robot:. International Journal of Advanced Robotic Systems, 17(3), 3009-3023.

Wang, B., Li, B. , Yang, J. , Yu, T. , & Wang, W. (2019). Simulation and monitoring of a 6r industrial robot for intelligent manufacturing. Harbin Gongcheng Daxue Xuebao/Journal of Harbin Engineering University, 40(2), 365-373.

Zhang, Z. , Liu, C. , & Ma, X. (2019). Intelligent distance measurement of robot obstacle avoidance in cloud computing environment. International Journal of Performability Engineering, 15(3), 959-968.

Lu, F. , Liu, S. , & Tian, G. (2019). Methods for sensor data mapping and automatic service composition in intelligent robot service environment. Jiqiren/Robot, 41(1), 30-39.

Wang, W. K. , Wu, X. B. , & Chen, W. B. (2018). Research on path planning of intelligent plant inspection robot. Journal of Computers (Taiwan), 29(2), 174-185.

Wu, J. , Ma, C. , Xu, P. , Guo, S. , & Qiao, L. (2018). Implementation of the dual-body intelligent inspection robot in substation based on data mining algorithm. Academic Journal of Manufacturing Engineering, 16(4), 102-109.

Li, M., Li, Y. , & Wang, Q. (2018). Research progress on modeling, control and application of eap flexible intelligent driving materials. Jiqiren/Robot, 40(5), 660-672.

Hsu, H. K. , Ting, H. Y. , Huang, M. B. , & Huang, H. P. (2021). Intelligent fault detection, diagnosis and health evaluation for industrial robots. Mechanika, 27(1), 70-79.

Wei, Y. , An, D. , Liu, J. , Wu, Y. , Li, W. , & Wei, Q. , et al. (2022). Intelligent control method of underwater inspection robot in netcage. Aquaculture Research, 53(5), 1928-1938.







How to Cite

Su, X. (2024). Research on Application of Multi-modal Large Model in Robot Control . Frontiers in Computing and Intelligent Systems, 8(1), 107-111.