Unlocking Complex Systems: A New Approach Combines Machine Learning and Physical Laws

Saturday 08 March 2025


Scientists have long struggled to accurately predict and understand complex natural phenomena, such as the behavior of fluids in pipes or the spread of disease through populations. These predictions are crucial for making informed decisions in fields like engineering, medicine, and climate science.


One major challenge is that these systems are often governed by partial differential equations (PDEs), which describe how different variables change over space and time. However, solving PDEs analytically can be extremely difficult or even impossible, especially when dealing with nonlinear systems.


Recently, a new approach has emerged that combines machine learning techniques with physical laws to create more accurate predictions. This method, known as physics-informed neural networks (PINNs), uses artificial neural networks to approximate the solutions of PDEs.


In traditional machine learning approaches, data is used to train neural networks to make predictions. However, PINNs go a step further by incorporating physical laws and constraints into the training process. This ensures that the predicted solutions not only match observed data but also satisfy the underlying physics of the system.


The researchers behind this work have developed an innovative approach that combines PINNs with ensemble Kalman inversion (EKI), a technique used to estimate unknown parameters in complex systems. They call their method DTEKI, which stands for dropout Tikhonov EKI.


DTEKI uses a combination of neural networks and traditional numerical methods to solve PDEs. The neural network is trained on data generated by solving the PDE using EKI, while also incorporating physical laws and constraints. This allows the network to learn not only the patterns in the data but also the underlying physics of the system.


The researchers tested DTEKI on several complex systems, including a nonlinear fluid flow problem and a porous media equation. In each case, they found that DTEKI was able to accurately predict the behavior of the system, even in situations where traditional methods failed.


One of the key advantages of DTEKI is its ability to handle large amounts of noise and uncertainty in the data. This is particularly important in fields like climate science, where small changes in initial conditions can lead to significant differences in outcomes.


The development of DTEKI has far-reaching implications for a wide range of scientific disciplines. It offers a powerful new tool for solving complex problems that were previously thought to be unsolvable. By combining machine learning techniques with physical laws, scientists may be able to make more accurate predictions and better understand the behavior of complex systems.


Cite this article: “Unlocking Complex Systems: A New Approach Combines Machine Learning and Physical Laws”, The Science Archive, 2025.


Machine Learning, Physics-Informed Neural Networks, Partial Differential Equations, Artificial Neural Networks, Ensemble Kalman Inversion, Dropout Tikhonov Eki, Numerical Methods, Fluid Flow, Porous Media Equation, Uncertainty Analysis


Reference: Zhiwei Gao, George Em Karniadakis, “Scalable Bayesian Physics-Informed Kolmogorov-Arnold Networks” (2025).


Leave a Reply