Bulletin of the American Physical Society
76th Annual Meeting of the Division of Fluid Dynamics
Sunday–Tuesday, November 19–21, 2023; Washington, DC
Session L29: Modeling Methods III: Deep Learning and Physics-Informed Learning
8:00 AM–10:36 AM,
Monday, November 20, 2023
Room: 152B
Chair: Pedram Hassanzadeh, University of Chicago
Abstract: L29.00007 : Improving Neural Operators with Physics Informed Token Transformers*
9:18 AM–9:31 AM
Presenter:
Cooper Lorsung
(Carnegie Mellon University)
Authors:
Cooper Lorsung
(Carnegie Mellon University)
Zijie Li
(Carnegie Mellon University)
Amir Barati Farimani
(Carnegie Mellon University)
Solving Partial Differential Equations (PDEs) is the core of many fields of science and engineering. While classical approaches are often prohibitively slow, machine learning models often fail to incorporate complete system information. Over the past few years, neural operators have shown significant promise in PDE surrogate modeling. However, neural operators often do not incorporate physically relevant information into the learning process, namely the governing equations. To address this issue, we introduce PITT: Physics Informed Token Transformer, that uses a transformer-based architecture on top of existing, popular neural operators. The purpose of PITT is to incorporate the knowledge of physics by embedding partial differential equations (PDEs) into the learning process. PITT uses an equation tokenization method to learn an analytically-driven numerical update operator. By tokenizing PDEs and embedding partial derivatives, the transformer models become aware of the underlying knowledge behind physical processes. Combining neural operators with transformers offers a powerful and flexible method to incorporate physics knowledge into the neural operator learning process. To demonstrate this, PITT is tested on challenging 1D and 2D PDE neural operator prediction tasks. The results show that PITT outperforms popular neural operator models and has the ability to extract physically relevant information from governing equations.
*This material is based upon work supported by the National Science Foundation under Grant No. 1953222.
Follow Us |
Engage
Become an APS Member |
My APS
Renew Membership |
Information for |
About APSThe American Physical Society (APS) is a non-profit membership organization working to advance the knowledge of physics. |
© 2024 American Physical Society
| All rights reserved | Terms of Use
| Contact Us
Headquarters
1 Physics Ellipse, College Park, MD 20740-3844
(301) 209-3200
Editorial Office
100 Motor Pkwy, Suite 110, Hauppauge, NY 11788
(631) 591-4000
Office of Public Affairs
529 14th St NW, Suite 1050, Washington, D.C. 20045-2001
(202) 662-8700