Application And Challenges of Alphazero Algorithm in Chinese Chess
DOI:
https://doi.org/10.54097/e6373366Keywords:
Artificial intelligence, alphaZero algorithm, reinforcement learning, Chinese Chess, computational complexity.Abstract
In the field of artificial intelligence, AlphaZero has achieved significant success in games like Go and Shogi. However, its application in Chinese Chess remains relatively unexplored. This study aims to unveil the potential and limitations of AlphaZero in Chinese Chess and explore strategies for optimizing its performance. In this paper, we begin by reviewing the fundamental principles and algorithmic structure of AlphaZero, emphasizing its deep reinforcement learning and self-play characteristics. Subsequently, we delve into the specific application of AlphaZero in Chinese Chess, encompassing aspects such as chess rule representation, training procedures, position evaluation, and strategy prediction. By analyzing successful instances of AlphaZero in Chinese Chess, we showcase its potential in the domain of board games. Furthermore, this paper elucidates the challenges that AlphaZero encounters in the context of Chinese Chess, including issues related to computational complexity and position representation. We particularly underscore the potential cost escalation due to high computational resource requirements and the risk of data loss or excessive time consumption associated with extended computation periods. IN conclusion, this research provides valuable insights into the application of AlphaZero in the realm of Chinese Chess and offers recommendations for future research directions to further expand its utility in this domain.
Downloads
References
Silver, D., Schrittwieser, J., Hassabis, D. (2017). Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm. Nature 3.
Schrittwieser, J., Antonoglou, I., Hubert, T., Simonyan, K., Sifre, L., (2019). Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model. Nature 342.
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., (2015). Human-level control through deep reinforcement learning. Nature, 518(7540), 529-533.
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y. (2016). Continuous control with deep reinforcement learning. International Conference on Learning Representations.1-11.
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017). Proximal Policy Optimization Algorithms. International Conference on Machine Learning, 1-10.
Anthony, T., Tian, Z., & Barber, D. (2017). Thinking Fast and Slow with Deep Learning and Tree Search. International Conference on Machine Learning 73(2).
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., ..., & Hassabis, D. (2013). Playing Atari with Deep Reinforcement Learning. Conference On Neural Information Processing Systems 454(1).
Tian, Y., Ma, J., Gong, Q., Sengupta, S., Chen, Z., Pinkerton, J., & Zitnick, L. (2019). ELF OpenGo: an analysis and open reimplementation of AlphaZero. Proceedings of the 36th International Conference on Machine Learning, 97, 6244-6253.
Browne, C. B., Powley, E., Whitehouse, D., Lucas, S. M., Cowling, P. I., Rohlfshagen, P. (2012). A survey of monte carlo tree search method. IEEE Transactions on Computational Intelligence and AI in Games, 4(1), 1-43.
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017). Deep reinforcement learning: A brief survey. IEEE Signal Processing Magazine, 34(6), 26-38.
Lee David/Leela-chess-to-Chinese-Chess Available: https://github.com/leedavid/leela-chess-to-Chinese-Chess.
Bupticybee/icyChessZero. Available: https://github.com/bupticybee/icyChessZero.
OpenAI. Openai five. (2018). Available at: https://blog.openai.com/openai-five/.
Online chess games database. Available at: https://www.365chess.com/.
Allis, V. (1994). Searching for Solutions in Games and Artificial Intelligence. PhD thesis, University of Limburg, Netherlands.
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G. (2016). Mastering the game of Go with deep neural networks and tree search.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Highlights in Science, Engineering and Technology
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
