DD-FEM: Progress Toward Foundation Models via Data-Driven Reduced Order Modeling
Please login to view abstract download link
Foundation models promise reusable representations that transfer across tasks; achieving an analogous capability in computational science is challenging because governing PDEs, discretizations, geometries, and inference goals can differ substantially. This work reports overall progress toward a scientific foundation model through the Data-Driven Finite Element Method (DD-FEM): a modular, data-driven reduced-order modeling framework that learns local solution representations from heterogeneous data and assembles them into physics-consistent global solutions through PDE-constrained coupling. DD-FEM replaces hand-crafted polynomial finite-element trial spaces with data-driven local bases / manifolds, while retaining a “learn locally, assemble globally” architecture that supports reuse and scale-up. In particular, we exploit the expressivity of neural networks to learn compact, nonlinear local representations (e.g., element-wise trial spaces/manifolds) that capture multiscale and non-polynomial behaviors beyond classical bases, improving both accuracy and data efficiency. We describe multiple coupling/assembly frameworks under active development, including: (i) static condensation, (ii) residual minimization with continuity constraints, (iii) discontinuous Galerkin coupling via soft interface constraints, (iv) partition-of-unity coupling, and (v) null-space coupling. These variants provide complementary tradeoffs among stability, flexibility, and enforcement of inter-subdomain compatibility. Numerical results demonstrate scale-up and transfer aligned with foundation-model criteria: spatial extrapolation (training on small subdomains and solving much larger systems), generalization across PDE families, transfer to inverse problems, and robustness to unseen source/forcing functions. Representative highlights include: > 1000× speedup with < 1% relative error for lattice elasticity via static condensation; 23.7× speedup with < 4% relative error for steady Navier–Stokes porous-media flow using DG coupling; and 662× speedup with∼ 1% relative error for time-dependent Burgers dynamics under 25× spatial extrapolation using constrained residual minimization. Collectively, these results support DD-FEM as an actionable foundation-model architecture for computational science: reusable, physics-consistent, and scalable across domains and tasks.
