Benchmarking of Deep Learning models on 2D Laminar Flow behind Cylinder
Mritunjay Musale, Vaibhav Vasani

TL;DR
This paper evaluates deep learning models, especially Transformers, for simulating 2D laminar flow behind a cylinder, demonstrating that Transformers outperform other architectures in this fluid dynamics task.
Contribution
It introduces the application of Transformer architectures to Direct Numerical Simulation in CFD, showing their superior performance over traditional deep learning models.
Findings
Transformers outperform other models on the DNS dataset.
Deep learning models can effectively simulate fluid flow in CFD.
Transformers are promising for future CFD research.
Abstract
The rapidly advancing field of Fluid Mechanics has recently employed Deep Learning to solve various problems within that field. In that same spirit we try to perform Direct Numerical Simulation(DNS) which is one of the tasks in Computational Fluid Dynamics, using three fundamental architectures in the field of Deep Learning that were each used to solve various high dimensional problems. We train these three models in an autoencoder manner, for this the dataset is treated like sequential frames given to the model as input. We observe that recently introduced architecture called Transformer significantly outperforms its counterparts on the selected dataset.Furthermore, we conclude that using Transformers for doing DNS in the field of CFD is an interesting research area worth exploring.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsLattice Boltzmann Simulation Studies · Model Reduction and Neural Networks · Computational Physics and Python Applications
MethodsMulti-Head Attention · Attention Is All You Need · Linear Layer · Softmax · Layer Normalization · Byte Pair Encoding · Dense Connections · Absolute Position Encodings · Dropout · Adam
