PAPM: A Physics-aware Proxy Model for Process Systems
Pengwei Liu, Zhongkai Hao, Xingyu Ren, Hangjie Yuan, Jiayang Ren, Dong, Ni

TL;DR
This paper introduces PAPM, a physics-aware proxy model that integrates partial physics knowledge and a temporal-spatial module to improve generalization and efficiency in process system modeling.
Contribution
PAPM fully incorporates partial prior physics and a temporal-spatial module, enhancing generalization and reducing computational costs compared to existing models.
Findings
Achieves 6.7% performance improvement over state-of-the-art models.
Requires only 1% of the parameters of previous methods.
Demonstrates superior generalization across five benchmark tasks.
Abstract
In the context of proxy modeling for process systems, traditional data-driven deep learning approaches frequently encounter significant challenges, such as substantial training costs induced by large amounts of data, and limited generalization capabilities. As a promising alternative, physics-aware models incorporate partial physics knowledge to ameliorate these challenges. Although demonstrating efficacy, they fall short in terms of exploration depth and universality. To address these shortcomings, we introduce a physics-aware proxy model (PAPM) that fully incorporates partial prior physics of process systems, which includes multiple input conditions and the general form of conservation relations, resulting in better out-of-sample generalization. Additionally, PAPM contains a holistic temporal-spatial stepping module for flexible adaptation across various process systems. Through…
Peer Reviews
Decision·ICML 2024 Poster
The paper explicitly takes into account the physics of the system when designing the system, yielding better generalization capability compare to baselines like FNO
I am a bit confused with the experimental setting. I really like the argument of baking more physics prior to the model. However, it seems that during the training, the model is still trained with a large-scale dataset - where one needs up to 10^6 times to generate this dataset.
1. Paper is mostly well written 2. Experiments are clear
1. While I appreciate the intuitive explanations, process systems are not defined adequately, and this really impedes assessment of the paper. The terms describing this main concept are vague (abstract, introduction and in section 3), and qualitative. Nevertheless, I hope authors can clarify this in the discussion phase (see questions). 2. It is unclear what is required in training vs. at inference 3. The experiments seem to be run for one setting (no monte-carlo simulations) 4. The experiments
1. The paper addresses a critical issue in the field of process systems modeling, proposing an innovative solution that combines partial prior mechanistic knowledge with a holistic temporal and spatial stepping method. 2. The PAPM model shows impressive results in terms of both improved performance and reduced computational costs compared to existing methods. 3. The paper is well-structured and the methodology is clearly explained, with extensive validation.
1. The paper could dive further into limitations of the method. 2. The paper could benefit from a more detailed comparison with existing methods. While the authors compare their method to state-of-the-art models, it would be helpful to see a more detailed analysis of why their method outperforms these existing approaches.
- Introducing parameterized operators is a very interesting contribution.
- The presentation is slightly hard to follow, it is not clear to me how exactly all these operators are parameterized and how such models can be scaled up. Is there only one operator block used or can these modules be stacked? Pseudocode / real code would definitely help. - The models are evaluated on a fixed grid with fixed resolution. For such systems standard models such as modern U-Nets and / or convolutional based neural operators should be used for comparison (Raonic et al, Gupta et al),
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsBusiness Process Modeling and Analysis
