Machine Learning Through Physics–Informed Neural Networks: Progress and Challenges

Authors

  • Klapa Antonion
  • Xiao Wang
  • Maziar Raissi
  • Laurn Joshie

DOI:

https://doi.org/10.54097/b1d21816

Keywords:

Physics–Informed Neural Networks, Machine Learning, Numerical Methods, Partial Differential Equations.

Abstract

 Physics-Informed Neural Networks (PINNs) represent a groundbreaking approach wherein neural networks (NNs) integrate model equations, such as Partial Differential Equations (PDEs), within their architecture. This innovation has become instrumental in solving diverse problem sets including PDEs, fractional equations, integral-differential equations, and stochastic PDEs. It's a versatile multi-task learning framework that tasks NNs with fitting observed data while simultaneously minimizing PDE residuals. This paper delves into the landscape of PINNs, aiming to delineate their inherent strengths and weaknesses. Beyond exploring the fundamental characteristics of these networks, this review endeavors to encompass a wider spectrum of collocation-based physics-informed neural networks, extending beyond the core PINN model. Variants like physics-constrained neural networks (PCNN), variational hp-VPINN, and conservative PINN (CPINN) constitute pivotal aspects of this exploration. The study accentuates a predominant focus in research on tailoring PINNs through diverse strategies: adapting activation functions, refining gradient optimization techniques, innovating neural network structures, and enhancing loss function architectures. Despite the extensive applicability demonstrated by PINNs, surpassing classical numerical methods like Finite Element Method (FEM) in certain contexts, the review highlights ongoing opportunities for advancement. Notably, there are persisting theoretical challenges that demand resolution, ensuring the continued evolution and refinement of this revolutionary approach.

Downloads

Download data is not yet available.

References

J. Wu, N. Hovakimyan, J. Hobbs, Genco: An auxiliary generator from contrastive learning for enhanced few-shot learning in remote sensing, arXiv preprint arXiv:2307.14612 (2023).

Y. Tang, J. Yan, Y. Wu, J. Hong, L. Xu, Z. Lin, Design of Remote Sensing Image Data Analysis and Processing Platform Based on Environmental Monitoring, Journal of Physics: Conference Series, IOP Publishing, 2021, p. 012056.

J. Wu, D. Pichler, D. Marley, D. Wilson, N. Hovakimyan, J. Hobbs, Extended Agriculture-Vision: An Extension of a Large Aerial Image Dataset for Agricultural Pattern Analysis, arXiv preprint arXiv:2303.02460 (2023).

J. Wu, J. Hobbs, N. Hovakimyan, Hallucination improves the performance of unsupervised visual representation learning, Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 16132-16143.

Z. Xu, Analysis and research on financial risk prevention based on artificial intelligence algorithms, Proceedings of the 2nd International Conference on Bigdata Blockchain and Economy Management, ICBBEM 2023, May 19–21, 2023, Hangzhou, China, 2023.

R. Tao, P. Zhao, J. Wu, N.F. Martin, M.T. Harrison, C. Ferreira, Z. Kalantari, N. Hovakimyan, Optimizing crop management with reinforcement learning and imitation learning, arXiv preprint arXiv:2209.09991 (2022).

J. Huo, Y. Wang, N. Wang, W. Gao, J. Zhou, Y. Cao, Data-driven design and optimization of ultra-tunable acoustic metamaterials, Smart Materials and Structures 32(5) (2023) 05LT01.

Y. Wang, J. Wu, N. Hovakimyan, R. Sun, Double Dynamic Sparse Training for GANs, arXiv preprint arXiv:2302.14670 (2023).

Y. Tang, K. Yoshihiro, A. Tohru, B. Danushka, BS-1-12 Analyzing Patterns from Twitter Happiness referring Stock Market and American Unemployment Rate Announcement, Proceedings of the Electronic Information and Communication Society Comprehensive System Conference 2013(2) (2013) " S-23"-" S-24".

J. Wu, R. Tao, P. Zhao, N.F. Martin, N. Hovakimyan, Optimizing nitrogen management with deep reinforcement learning and crop simulations, Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 1712-1720.

Y. Tang, S. Song, S. Gui, W. Chao, C. Cheng, R. Qin, Active and Low-Cost Hyperspectral Imaging for the Spectral Analysis of a Low-Light Environment, Sensors 23(3) (2023) 1437.

D. Huang, Y. Tang, R. Qin, An evaluation of PlanetScope images for 3D reconstruction and change detection–experimental validations with case studies, GIScience & Remote Sensing 59(1) (2022) 744-761.

S. Gui, R. Qin, Y. Tang, Sat2lod2: A Software For Automated Lod-2 Modeling From Satellite-Derived Orthophoto And Digital Surface Model, arXiv preprint arXiv:2204.04139 (2022).

X. Lai, Y. Tang, L. Li, P. Chan, Q. Zeng, Study on microclimate observation network for urban unit: A case study in a campus of Shenzhen, China, Physics and Chemistry of the Earth, Parts A/B/C 110 (2019) 117-124.

J. Blechschmidt, O.G. Ernst, Three ways to solve partial differential equations with neural networks—A review, GAMM‐Mitteilungen 44(2) (2021) e202100006.

J. Huo, Y. Wang, Y. Cao, 3D computational study of arc splitting during power interruption: the influence of metal vapor enhanced radiation on arc dynamics, Journal of Physics D: Applied Physics 54(8) (2020) 085502.

I.E. Lagaris, A. Likas, D.I. Fotiadis, Artificial neural networks for solving ordinary and partial differential equations, IEEE transactions on neural networks 9(5) (1998) 987-1000.

J. Berg, K. Nyström, A unified deep artificial neural network approach to partial differential equations in complex geometries, Neurocomputing 317 (2018) 28-41.

J. Huo, Y. Cao, Computational Study of the Arc Splitting in Power Interruption: The Effect of the Metallic Vapor on Arc Dynamics, 2020 IEEE Conference on Electrical Insulation and Dielectric Phenomena (CEIDP), IEEE, 2020, pp. 415-418.

S.W. Kim, I. Kim, J. Lee, S. Lee, Knowledge Integration into deep learning in dynamical systems: an overview and taxonomy, Journal of Mechanical Science and Technology 35 (2021) 1331-1342.

H. Owhadi, Bayesian numerical homogenization, Multiscale Modeling & Simulation 13(3) (2015) 812-828.

M. Raissi, G.E. Karniadakis, Hidden physics models: Machine learning of nonlinear partial differential equations, Journal of Computational Physics 357 (2018) 125-141.

M. Raissi, P. Perdikaris, G.E. Karniadakis, Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations, Journal of Computational physics 378 (2019) 686-707.

J. Huo, J. Ronzello, A. Rontey, Y. Wang, L. Jacobs, T. Sommerer, Y. Cao, Development of an arc root model for studying the electrode vaporization and its influence on arc dynamics, AIP Advances 10(8) (2020).

J. Huo, S. Selezneva, L. Jacobs, Y. Cao, Study of wall ablation on low-voltage arc interruption: The effect of Stefan flow, Journal of Applied Physics 125(21) (2019).

J. Huo, S. Selezneva, L. Jacobs, Y. Cao, Low-voltage arc interruption computation: The effect of Stefan flow, 2018 IEEE Conference on Electrical Insulation and Dielectric Phenomena (CEIDP), IEEE, 2018, pp. 318-321.

J. Huo, A. Rontey, Y. Wang, L. Jacobs, Q. Chen, N. Wang, S. Ma, Y. Cao, Arc hopping dynamics induced by interfacial negative differential resistance, PNAS nexus 1(3) (2022) pgac129.

J. Huo, Y. Cao, Interfacial potential barrier induced constriction and stepwise transition of a dynamic arc root, 2019 IEEE Conference on Electrical Insulation and Dielectric Phenomena (CEIDP), IEEE, 2019, pp. 564-567.

M. Dissanayake, N. Phan‐Thien, Neural‐network‐based approximations for solving partial differential equations, communications in Numerical Methods in Engineering 10(3) (1994) 195-201.

H. Lee, I.S. Kang, Neural algorithm for solving differential equations, Journal of Computational Physics 91(1) (1990) 110-131.

S. Goswami, C. Anitescu, S. Chakraborty, T. Rabczuk, Transfer learning enhanced physics informed neural network for phase-field modeling of fracture, Theoretical and Applied Fracture Mechanics 106 (2020) 102447.

S. Mishra, R. Molinaro, Estimates on the generalization error of physics-informed neural networks for approximating a class of inverse problems for PDEs, IMA Journal of Numerical Analysis 42(2) (2022) 981-1022.

S. Wang, X. Yu, P. Perdikaris, When and why PINNs fail to train: A neural tangent kernel perspective, Journal of Computational Physics 449 (2022) 110768.

M. Hinze, R. Pinnau, M. Ulbrich, S. Ulbrich, Optimization with PDE constraints, Springer Science & Business Media2008.

Downloads

Published

20-01-2024

Issue

Section

Articles

How to Cite

Machine Learning Through Physics–Informed Neural Networks: Progress and Challenges. (2024). Academic Journal of Science and Technology, 9(1), 46-49. https://doi.org/10.54097/b1d21816

Similar Articles

1-10 of 371

You may also start an advanced similarity search for this article.