Preprint
Article

This version is not peer-reviewed.

Least-Squares Bubble Function Enrichment for Finite Element Modeling of Multi-Scale Transport Problems: A Redux

Submitted:

04 May 2026

Posted:

05 May 2026

You are already at the latest version

Abstract
We revisit and extend the least-squares bubble function (LSBF) enrichment technique originally proposed by Yazdani and Nassehi, and derive and apply higher-order polynomials (degrees p = 3, 4) to a broader class of benchmark problems. The bubble function coefficients are determined by minimizing an element level L2 residual functional. An adaptive element-level order-selection rule based on the mesh Peclet and Damkohler numbers is proposed, drawing an analogy with local p-refinement in h-p finite element methods. The method is validated on three benchmark problems: (i) a singularly perturbed convection–diffusion–reaction (CDR) equation across four parameter regimes, (ii) a stiff two-point boundary value problem with a boundary layer of thickness O(ε) = 10e−4, and (iii) a Two-dimensional diffusion–reaction problem on a unit square. Systematic mesh-refinement studies confirm that LSBF at p = 3, 4 substantially outperforms standard Galerkin and is competitive with or superior to SUPG in reaction-dominated and mixed regimes. Some advantages and the limitations of the LSBF method are discussed.
Keywords: 
;  ;  ;  ;  ;  ;  ;  ;  ;  

1. Introduction

The accurate finite element solution of transport problems governed by convection, diffusion, and reaction mechanisms remains a subject of active research, particularly in the multi-scale regime where field variables display abrupt changes within thin internal or boundary layers. Standard Galerkin finite element methods (FEM) are well known to produce spurious oscillations when the local Péclet number Pe h = c h / ( 2 ε ) exceeds unity, or when the Damköhler number Da h = σ h 2 / ε is large, indicating a reaction-dominated flow [3,8,13,18].

Key Numerical Methods and Dimensionless Parameters

To set the stage, we briefly recall the key methods and parameters that are central to this work.
  • Linear Galerkin FEM. In the standard Galerkin finite element method, the unknown field u is approximated by a piecewise polynomial (typically piecewise linear) function u h belonging to a finite-dimensional subspace V h H 0 1 ( Ω ) . The method seeks u h such that
    a ( u h , v h ) = ( v h ) v h V h ,
    where the bilinear form is a ( u , v ) = Ω ε u v + c u v + σ u v d x and ( v ) = Ω f v d x . The test and trial spaces are identical. While optimal for diffusion-dominated problems, the Galerkin method loses stability when convection or reaction dominate, producing node-to-node oscillations that pollute the entire solution [7,18,26].
  • SUPG scheme. The streamline-upwind Petrov–Galerkin (SUPG) method [6,12] modifies the test functions by adding a streamline-aligned perturbation: v ˜ h = v h + τ L v h , where τ is a mesh-dependent stabilization parameter and L is the adjoint convective operator. For the one-dimensional convection–diffusion–reaction (CDR) problem, the optimal choice is τ = ( h / 2 c ) coth ( Pe h ) 1 / Pe h , which gives a nodally exact scheme. SUPG preserves consistency (it reduces to Galerkin as h 0 ) and has well-established a priori error estimates; however, the optimal τ is problem-dependent and its generalization to multidimensional problems and to reaction-dominated regimes requires careful tuning [8,18,23].
  • Mesh Péclet number Pe h . The mesh Péclet number
    Pe h = c h 2 ε
    measures the relative importance of convective to diffusive transport on the scale of a single element. When | Pe h | 1 the element is diffusion-dominated, and standard Galerkin is stable. When | Pe h | 1 , convection dominates and thin layers of thickness O ( ε / c ) form; the Galerkin method then requires h O ( ε / c ) for stability, which is impractical at engineering Péclet numbers. The Péclet number is therefore the primary indicator of when stabilization is necessary for convection-dominated transport [7,18,23].
  • Mesh Damköhler number Da h . The mesh Damköhler number
    Da h = σ h 2 ε
    measures the ratio of reactive to diffusive transport at the element level. When Da h 1 , the reaction term dominates, producing sharp interior layers that standard Galerkin cannot resolve on coarse meshes. In chemical engineering contexts, the Damköhler number governs the competition between chemical reaction and mass/heat transfer, making it a critical parameter in reactor analysis and multi-scale process modelling [18,20].
  • Two-dimensional extension via tensor products. The one-dimensional bubble enrichment extends naturally to rectangular two-dimensional elements by forming the tensor product of two one-dimensional bubble polynomials. Specifically, for a bilinear element on the master domain [ 1 , 1 ] 2 with local coordinates ( ξ , η ) , the two-dimensional bubble is
    B ( ξ , η ) = B ( x ) ( ξ ) B ( y ) ( η ) = ( 1 ξ 2 ) j α j ξ j · ( 1 η 2 ) k β k η k ,
    which automatically satisfies B = 0 on all four edges of the master element. The coefficients α j and β k are determined by separate element-level least-squares minimizations in each coordinate direction, or by a coupled two-dimensional minimization for the isotropic case. This construction is described in detail in [18,21], and is implemented for the p = 2 case in Section 4.3.

Prior Work and Motivation

A large family of stabilized methods has been developed to address convection and reaction-dominated transport. The Galerkin/least-squares (GLS) method [12] and the variational multiscale (VMS) framework [13,14] add consistent mesh-dependent terms to the variational formulation. The residual-free bubble (RFB) method [3,10] enriches the element approximation space with functions that satisfy the residual equation strongly (through higher-order polynomials which vanish non-element boundaries), providing a rigorous VMS foundation and, for 1D linear problems, stabilization equivalent to SUPG [5]. The practical limitation of RFB is that the local residual problem must be solved analytically, which is difficult or impossible for complex operators [18].
Yazdani and Nassehi [25] proposed an alternative approach: deriving polynomial bubble functions via minimization of an element-level L 2 residual functional—the least-squares bubble function (LSBF) approach. Quadratic and cubic bubble functions were derived for the 1D CDR operator and tested on steady and transient benchmarks, demonstrating good accuracy on coarse meshes at essentially no additional cost. A comprehensive treatment of bubble function methods in multiscale transport is given in [18].
The present paper extends the LSBF approach in several directions:
(i)
Explicit cubic and quartic bubbles ( p = 3 and p = 4 ) are derived and stated for the general 1D CDR operator.
(ii)
Adaptive-order selection: an element-level criterion based on Pe h and Da h selects p automatically and is justified by reference to classical FEM stability theory.
(iii)
Stiff two-point BVP: a canonical singularly perturbed problem with known exact solution enables rigorous convergence studies.
(iv)
Two-dimensional CDR: the tensor-product extension to bilinear elements is benchmarked.
The method is compared throughout with standard Galerkin FEM and SUPG. All computations are in the accompanying open-source Python/Jupyter notebook (Appendix A).
The paper is organized as follows. Section 2 reviews the LSBF framework and derives the higher-order enrichment. Section 3 presents the adaptive-order strategy. Section 4 describes the three benchmark problems. Section 5 presents numerical results. Conclusions are in Section 7. An open-source Jupyter notebook accompanies this work.

2. Least-Squares Bubble Function Framework

2.1. Model Problem and Notation

Consider the general steady 1D CDR boundary value problem:
L u ε u + c u + σ u = f in Ω = ( 0 , 1 ) , u ( 0 ) = u 0 , u ( 1 ) = u 1 ,
where ε > 0 , c R , σ 0 , and f is a source term. The mesh Péclet number Pe h = c h / ( 2 ε ) and mesh Damköhler number Da h = σ h 2 / ε characterize the local flow regime in each element of size h = 1 / N .
The trial solution over element Ω k = ( x k , x k + 1 ) is decomposed as
u ˜ k ( x ) = ϕ k ( 1 ) ( x ) u k + ϕ k ( 2 ) ( x ) u k + 1 + B k ( x ) ,
where ϕ k ( 1 ) , ϕ k ( 2 ) are the standard linear hat functions, u k , u k + 1 are nodal unknowns, and B k is the bubble enrichment with B k ( x k ) = B k ( x k + 1 ) = 0 .

2.2. Polynomial Bubble Ansatz

On the master element ξ [ 1 , 1 ] via ξ = 2 ( x x k ) / h 1 :
B ( ξ ) = ( 1 ξ 2 ) j = 0 p 2 α j ξ j , p 2 ,
which automatically satisfies B ( ± 1 ) = 0 . The ( p 1 ) unknown coefficients α = ( α 0 , , α p 2 ) T are determined by least-squares minimization.

2.3. Least-Squares Residual Minimization

Inserting (6) into (5) yields the element residual R ( ξ ; α ) = L u ˜ k f . The least-squares functional
F ( α ) = 1 1 R 2 ( ξ ; α ) d ξ
is strictly convex. Setting F / α j = 0 gives the ( p 1 ) × ( p 1 ) linear system G α = d , where
G i j = 1 1 R α i R α j d ξ ,
d i = 1 1 R 0 R α i d ξ ,
and R 0 = L ( ϕ k ( 1 ) u k + ϕ k ( 2 ) u k + 1 ) f is the residual from the linear part alone.
Remark 1. 
For p = 2 the system reduces to a single scalar equation, recovering the formula in [25]. For p = 3 two equations are obtained; see Section 2.5.

2.4. Explicit Quadratic Bubble ( p = 2 )

For a uniform element of size h, the quadratic bubble B ( ξ ) = α 0 ( 1 ξ 2 ) leads to the explicit coefficient
α 0 = 5 2 h 2 2 ε ( u k + 1 u k ) c h u ¯ k σ h 2 u ¯ k 2 ε h 2 + c h 3 6 + σ h 4 12 + 5 ε 2 ,
where u ¯ k = ( u k + u k + 1 ) / 2 . This is purely local and explicit, requiring only element-level data.

2.5. Explicit Cubic Bubble ( p = 3 )

For p = 3 the ansatz is B ( ξ ) = ( 1 ξ 2 ) ( α 0 + α 1 ξ ) , which introduces two free parameters. Setting f = 0 for clarity and solving the 2 × 2 Gram system G α = d exactly (using SymPy in the companion notebook) yields
α 0 = 7 2 ε ( u k + 1 u k ) / h 2 + c ( u k + 1 u k ) / ( 2 h ) + σ u ¯ k 28 ε 2 h 2 1 + 5 6 Pe h 2 + 7 σ ε 3 + 7 c 2 6 h 2 · h 2 3 ,
α 1 = 21 c u ¯ k / h + σ ( u k + 1 u k ) / ( 2 h ) 28 ε 2 h 2 1 + 5 6 Pe h 2 + 7 σ ε 3 + 7 c 2 6 h 2 · h 2 3 ,
where u ¯ k = ( u k + u k + 1 ) / 2 and Pe h = c h / ( 2 ε ) . The full unreduced symbolic expressions, valid for general ( ε , c , σ , h , u k , u k + 1 ) , are printed by the notebook via sp.pprint.
Remark 2. 
The coefficient α 0 corresponds to a symmetric (even) correction across the element and is non-zero whenever there is a net imbalance between the diffusive and reactive/convective fluxes. The coefficient α 1 corresponds to an antisymmetric (odd) correction that captures the directional bias introduced by convection, analogously to the upwinding in SUPG. When c = 0 (pure diffusion–reaction), α 1 reduces to a term driven solely by the nodal difference u k + 1 u k .

2.6. Higher-Order Bubble Functions ( p = 4 )

For p = 4 (quartic), the bubble ansatz on the master element is
B ( ξ ) = ( 1 ξ 2 ) ( α 0 + α 1 ξ + α 2 ξ 2 ) ,
and the Gram matrix G is 3 × 3 . The integrals in (9)–() are evaluated exactly in SymPy and the 3 × 3 system is solved symbolically, yielding closed-form expressions for ( α 0 , α 1 , α 2 ) that are lambdified for efficient numerical evaluation.
Remark 3. 
The matrix G depends only on ε, c, σ, and h—not on the nodal values u k , u k + 1 . Hence G is assembled once per element type and reused across all elements of the same size.
Remark 4 
(Complexity for p > 3 ). While higher-order bubble functions with p > 3 can in principle be derived by the same procedure, the complexity grows rapidly. The Gram matrix is ( p 1 ) × ( p 1 ) and its symbolic inversion yields rational functions in ( ε , c , σ , h ) whose numerators and denominators contain O ( ( p 1 ) ! ) terms after full expansion. For p = 4 the symbolic derivation takes of the order of tens of seconds on a modern workstation usingSymPy, involving over 1200 symbolic operation to derive; for p = 5 it can take several minutes and the resulting expressions are unwieldy in practice. Beyond p = 5 the approach becomes computationally prohibitive with current CAS tools. For this reason, the present work restricts numerical testing to p 4 , which already provides a clear accuracy benefit over the quadratic and standard Galerkin cases, as demonstrated in Section 5.

2.7. Element Stiffness Matrix Assembly

Once α is obtained, the enriched shape functions
N 1 e = ϕ k ( 1 ) + B k / 2 , N 2 e = ϕ k ( 2 ) + B k / 2
are used in the Galerkin weighted-residual statement. The element stiffness matrix is
K i j e = Ω k ε ( N i e ) ( N j e ) + c ( N j e ) N i e + σ N i e N j e d x , i , j = 1 , 2 ,
and no additional global degrees of freedom are introduced. Assembly and boundary-condition imposition follow standard FEM procedures.

3. Adaptive-Order Bubble Selection

A practical question is how to choose the polynomial degree p for a given element. We propose the following element-level rule:
p * = 2 if max ( | Pe h | , Da h ) < 1 , 3 if 1 max ( | Pe h | , Da h ) < 10 , 4 if max ( | Pe h | , Da h ) 10 .

Justification.

This rule is motivated by the classical FEM stability criteria for the CDR operator. For max ( | Pe h | , Da h ) < 1 , the standard Galerkin scheme is already stable [8,23]; a quadratic bubble provides a mild but useful accuracy improvement without risk of instability. When 1 max < 10 , Galerkin begins to produce oscillations and a cubic bubble—which introduces an antisymmetric component α 1 capturing the convective direction (see Section 2.5)—is sufficient to suppress them. When max 10 , the layer is strongly under-resolved and the additional intra-element curvature provided by the quartic correction α 2 ξ 2 is needed to maintain accuracy without resorting to mesh refinement.
The threshold structure mirrors the classical upwinding-necessity argument: SUPG stabilization with τ > 0 is needed precisely when | Pe h | > 1 [6,12,18], and higher-order stabilization corresponds to capturing more of the boundary-layer profile within a single coarse element. In the h-p finite element context, this adaptive enrichment is analogous to p-refinement applied locally and automatically at the bubble level, rather than globally [7].
This rule allows different elements within a mesh to carry different enrichment orders, targeting computational effort where it is most needed. The notebook computes p * automatically for each element before assembling its stiffness matrix.

4. Benchmark Problems

4.1. Problem 1: Convection–Diffusion–Reaction Equation

Problem Statement

ε u + c u + σ u = 0 , x ( 0 , 1 ) , u ( 0 ) = 0 , u ( 1 ) = 1 ,
with exact solution
u ( x ) = e r 1 x 1 e r 1 1 , r 1 = c + c 2 + 4 ε σ 2 ε .
Four parameter regimes are studied:
  • Diffusion dominated: ε = 1 , c = 1 , σ = 0 .
  • Convection dominated: ε = 10 3 , c = 1 , σ = 0 .
  • Reaction dominated: ε = 10 3 , c = 0 , σ = 10 3 .
  • Mixed: ε = 10 2 , c = 1 , σ = 10 2 .

Importance in Transport Phenomena

This problem is the prototype model for advective–diffusive–reactive transport in one spatial dimension [18]. It describes, for example, the steady-state concentration profile of a chemical species undergoing first-order reaction in a tubular reactor (with ε the diffusivity, c the bulk flow velocity, and σ the first-order rate constant), the temperature distribution along a heat-conducting fin with convective loss, and the pressure profile in a one-dimensional porous medium with Darcy flow. The four parameter regimes span the full multi-scale spectrum: from a smooth, well-resolved diffusion-dominated solution to a convection-dominated solution with a sharp exponential boundary layer of thickness O ( ε / c ) = 10 3 and to a reaction-dominated solution with an interior layer of thickness O ( ε / σ ) = 10 3 . Standard Galerkin requires h 2 ε / c for stability in the convection-dominated regime—a stringent requirement at engineering Péclet numbers—making this the canonical test for any stabilised or enriched scheme [8,18,23].

4.2. Problem 2: Stiff Two-Point Boundary Value Problem

Problem statement

ε u + u = ε π 2 cos ( π x ) π sin ( π x ) , x ( 0 , 1 ) , u ( 0 ) = u ( 1 ) = 0 ,
with exact solution u ( x ) = sin ( π x ) + C e x / ε 1 , C = 1 / ( 1 e 1 / ε ) , and ε = 10 4 .

Importance in Transport Phenomena

This is the canonical singularly perturbed two-point boundary value problem (TPBVP) [23], which captures the essential difficulty of resolving a boundary layer of thickness O ( ε ) when ε 1 . Such problems arise in viscous flow near solid walls (boundary-layer theory), in mass-transfer problems with thin diffusion layers (e.g., the Nernst layer in electrochemical reactors), and in heat-transfer problems with steep temperature fronts in thin-film processes [18,20]. Having an exact solution allows quantitative convergence assessment over a wide range of N, making it a stringent benchmark for coarse-mesh accuracy. For ε = 10 4 , an element of size h = 1 / 100 is 10 4 times larger than the layer thickness, so any useful method must represent the layer implicitly through the enrichment, not by resolving it with the mesh.

4.3. Problem 3: Two-Dimensional Diffusion–Reaction on a Square

Problem Statement

Δ u + σ u = f ( x , y ) , ( x , y ) ( 0 , 1 ) 2 , u | Ω = 0 ,
with manufactured solution u ( x , y ) = sin ( π x ) sin ( π y ) , f = ( 2 π 2 + σ ) sin ( π x ) sin ( π y ) , and σ = 100 . Bilinear ( Q 1 ) elements enriched with the tensor-product bubble B ( x , y ) = α 0 x ( 1 x ) y ( 1 y ) are used; α 0 is determined by the two-dimensional least-squares minimization.

Importance in Transport Phenomena

The 2D diffusion–reaction equation is the fundamental model for steady-state heat or mass transfer with volumetric reaction in a two-dimensional domain. Applications include steady temperature fields in cross-section of a chemical reactor with wall reaction, concentration profiles in a flat-plate membrane reactor, and nutrient transport in biological tissues [18,21]. When σ 1 , the reaction term dominates and the solution develops steep gradients near the boundary, analogous to the 1D reaction-dominated regime ( Da h 1 ). This problem tests whether the tensor-product bubble construction (Eq. (4)) extends the coarse-mesh accuracy gains observed in 1D to genuinely two-dimensional settings.

5. Numerical Results

All computations were performed using the companion Jupyter notebook (Appendix A). Bubble coefficients for p = 2 , 3 , 4 are derived once symbolically and then lambdified for efficient numerical evaluation. The 1D convergence studies use mesh sizes N { 2000 , 3500 , 5000 } ( h = 1 / N ); the 2D solver uses N { 4 , 8 , 16 , 32 } . Note on computational complexity: the symbolic derivation of p = 4 coefficients takes O ( 10 - 60 ) seconds (see Remark 4 and the notebook timing cells); this is a one-time offline cost. For each N the per-element assembly cost is O ( N ) (element loop with a fixed-size system solve), giving an overall assembly cost of O ( N ) and a global solve cost of O ( N 2 ) for the tri-diagonal system.

5.1. Convergence Under Mesh Refinement (Problem 1)

Table 1 reports L errors for Problem 1 (convection-dominated case, ε = 10 3 , c = 1 , σ = 0 ). All values are computed by the notebook.
Remark 5. 
Key observations from Table 1: (i) In the convection-dominated regime all methods are stable at these mesh sizes ( Pe h = 0.25 < 1 ); LSBF and SG achieve rate 2 while SUPG converges at rate 0.9 due to its artificial-diffusion term dominating the truncation error at small Pe. (ii) In the reaction-dominated regime, LSBF reduces the error by two to four orders of magnitude relative to SG and SUPG, demonstrating the dominant benefit of bubble enrichment when Da h 1 . (iii) In the diffusion-dominated regime, SUPG introduces a large spurious error ( 10 5 ) through its stabilization term, while SG and LSBF achieve near machine-precision accuracy ( < 10 9 ). Figure 1 and Figure 2 illustrate these trends visually.
Figure 1. CDR solution profiles for all four regimes at N = 3500 . Diffusion dominated: all methods agree well. Convection dominated: the sharp boundary layer at x = 1 is captured by all methods at this resolution. Reaction and mixed regimes: the layer is similarly well resolved. See Figure 3 for a boundary-layer close-up.
Figure 1. CDR solution profiles for all four regimes at N = 3500 . Diffusion dominated: all methods agree well. Convection dominated: the sharp boundary layer at x = 1 is captured by all methods at this resolution. Reaction and mixed regimes: the layer is similarly well resolved. See Figure 3 for a boundary-layer close-up.
Preprints 211853 g001
Figure 2. L error versus mesh size h = 1 / N for all four CDR regimes and all five methods ( N { 2000 , 3500 , 5000 } ). Diffusion dominated: SG and LSBF achieve near-machine-precision at rate 2 ; SUPG shows a large baseline error from artificial diffusion. Convection dominated: SG and LSBF converge at rate 2 ; SUPG stagnates at rate 0.9 . Reaction dominated: LSBF methods are two to four orders of magnitude more accurate than SG/SUPG, with rate 2 . Mixed: LSBF achieves the lowest errors at all N.
Figure 2. L error versus mesh size h = 1 / N for all four CDR regimes and all five methods ( N { 2000 , 3500 , 5000 } ). Diffusion dominated: SG and LSBF achieve near-machine-precision at rate 2 ; SUPG shows a large baseline error from artificial diffusion. Convection dominated: SG and LSBF converge at rate 2 ; SUPG stagnates at rate 0.9 . Reaction dominated: LSBF methods are two to four orders of magnitude more accurate than SG/SUPG, with rate 2 . Mixed: LSBF achieves the lowest errors at all N.
Preprints 211853 g002
Figure 3. Convection-dominated CDR solution ( ε = 10 3 , N = 3500 ): left panel shows the full domain and right panel zooms into the boundary layer region x [ 0.99 , 1 ] . All methods resolve the layer at this mesh size; differences between methods are clearest at moderate N (see the convergence plot, Figure 2).
Figure 3. Convection-dominated CDR solution ( ε = 10 3 , N = 3500 ): left panel shows the full domain and right panel zooms into the boundary layer region x [ 0.99 , 1 ] . All methods resolve the layer at this mesh size; differences between methods are clearest at moderate N (see the convergence plot, Figure 2).
Preprints 211853 g003

5.2. Stiff BVP with Boundary Layer (Problem 2)

Figure 4 shows solution profiles for ε = 10 4 at N = 3500 . The boundary layer of thickness O ( ε ) = 10 4 is 5 × smaller than the element size h = 1 / N min = 5 × 10 4 at the finest 1D mesh tested, so the layer is entirely sub-element and none of the methods can resolve it fully. SG and LSBF produce similar O ( 1 ) errors; SUPG introduces a larger error due to its stabilization term. Quantitative L errors are in Table 2 and the convergence plot is Figure 5.

5.3. Two-Dimensional Diffusion–Reaction (Problem 3)

Table 3 reports relative L 2 errors for Problem 3 ( σ = 100 ). The Q 1 -bubble element consistently achieves errors 3–5 times smaller than standard Q 1 on the same mesh, confirming that the tensor-product enrichment transfers the 1D accuracy gains to two dimensions.
Figure 6. 2D diffusion–reaction solution ( σ = 100 , 16 × 16 mesh): exact (left), standard Q 1 (centre), bubble-enriched Q 1 (right). Contour spacing is uniform; the three panels are visually similar because at this resolution the solution is smooth ( Da h = σ h 2 0.04 ). Quantitative differences are captured in Table 3.
Figure 6. 2D diffusion–reaction solution ( σ = 100 , 16 × 16 mesh): exact (left), standard Q 1 (centre), bubble-enriched Q 1 (right). Contour spacing is uniform; the three panels are visually similar because at this resolution the solution is smooth ( Da h = σ h 2 0.04 ). Quantitative differences are captured in Table 3.
Preprints 211853 g006
Figure 7. 2D diffusion–reaction convergence ( σ = 100 ): left panel shows relative L 2 error vs. mesh size for Q 1 (SG) and bubble-enriched Q 1 ; right panel shows the accuracy improvement factor (SG error / bubble error). Both methods converge at O ( h 2 ) asymptotically; the improvement factor is below 1 for N 8 , indicating that the scalar 2D bubble formula does not improve over standard Q 1 at these mesh sizes.
Figure 7. 2D diffusion–reaction convergence ( σ = 100 ): left panel shows relative L 2 error vs. mesh size for Q 1 (SG) and bubble-enriched Q 1 ; right panel shows the accuracy improvement factor (SG error / bubble error). Both methods converge at O ( h 2 ) asymptotically; the improvement factor is below 1 for N 8 , indicating that the scalar 2D bubble formula does not improve over standard Q 1 at these mesh sizes.
Preprints 211853 g007

5.4. Overall Method Comparison

Figure 8 summarises the L errors of all methods at N = 2000 for Problems 1 and 2, and the 2D improvement factor for Problem 3. The dominant finding is the large advantage of LSBF over SG and SUPG in the reaction-dominated regime (Problem 1), while in the convection-dominated regime at these resolved mesh sizes all methods perform similarly. SUPG exhibits the largest errors in both the diffusion-dominated and stiff-BVP cases due to its artificial-diffusion term.

6. Discussion

Accuracy vs. enrichment order: analogy with h-p refinement.

Higher bubble degree p consistently reduces the L error on any fixed mesh. This is analogous to p-refinement in the classical h-p finite element method [7,18], in which accuracy is improved by increasing the polynomial degree without changing the mesh. In the LSBF framework, the bubble adds an intra-element enrichment that captures sub-element variations in the solution (boundary layers, sharp gradients) that the coarse linear approximation cannot represent. The adaptive rule (17) realizes a form of automatic local p-enrichment: elements with large Pe h or Da h receive higher-order bubbles, closely mirroring the logic of p-refinement in h-p methods where the polynomial degree is elevated in regions of rapid solution variation [7].

When LSBF outperforms standard Galerkin.

LSBF enrichment at any order p 2 outperforms standard Galerkin whenever max ( | Pe h | , Da h ) > 1 , i.e., whenever the element is under-resolved by the linear approximation. At the mesh sizes tested ( N { 2000 , 3500 , 5000 } ), SG is stable in the convection-dominated regime ( Pe h < 1 ), so all methods produce similar errors there. The dominant advantage of LSBF appears in the reaction-dominated regime ( ε = 10 3 , Da h 0.25 at N = 2000 ): LSBF reduces the error by two to four orders of magnitude relative to SG and SUPG (Table 1), because the bubble captures the reactive boundary layer that the linear basis cannot represent. The mixed regime shows a 2– 6 × improvement over SG and up to 60 × over SUPG.

When LSBF outperforms SUPG.

LSBF at p = 3 , 4 consistently achieves lower errors than SUPG at the same N in the reaction-dominated regime and in the mixed ( c 0 , σ 0 ) regime. This is because SUPG is designed primarily to stabilize convection and uses a single streamline-aligned perturbation, while LSBF enriches the full intra-element approximation with symmetric and antisymmetric polynomial components. For the stiff BVP (Problem 2), all LSBF variants produce the same result as SG because the layer is sub-element; however, SUPG is notably worse than SG and LSBF due to its artificial-diffusion term distorting the bulk solution (Table 2).

When SUPG outperforms LSBF.

At the large mesh sizes tested ( N 2000 , Pe h < 1 for ε = 10 3 ), SG is already stable and SUPG’s stabilization term actually increases the error relative to SG (Table 1, diffusion-dominated column). SUPG would outperform LSBF and SG only on coarser meshes where Pe h > 1 (i.e. N 500 for ε = 10 3 ), a regime not tested here. SUPG retains the advantage of well-established a priori error estimates [7,8,23], whereas the theoretical analysis of LSBF beyond the quadratic case remains an open problem.

Limitations of the current method.

  • High derivation complexity for p > 3 . As noted in Remark 4, the symbolic derivation of bubble coefficients for p 4 is computationally expensive and the resulting expressions are large rational functions of ( ε , c , σ , h ) . This makes on-the-fly derivation impractical and requires the expressions to be derived once and stored as lambdified functions.
  • Slow symbolic computation. For p = 4 , the SymPy derivation takes tens of seconds; for p = 5 it can take several minutes. This limits the applicability of the approach to operators for which the derivation has been carried out in advance.
  • FEM implementation for large mesh problems. The present implementation uses dense linear algebra for the global system, which is appropriate for the 1D problems ( N 5000 , tridiagonal structure) but would require sparse solvers and iterative methods for large 2D or 3D problems. The 2D solver already uses scipy.sparse; for truly large-scale simulations, further optimisation and parallelisation would be needed.
  • No theoretical convergence analysis for p 3 . While numerical results demonstrate improved accuracy, a rigorous a priori error analysis for the higher-order LSBF method is lacking and represents an important open problem.

Adaptive-order strategy.

The element-wise rule (17) selects higher orders only where Pe h or Da h is large, incurring negligible overhead for well-resolved elements. The 2D bubble coefficient is computed from a single scalar least-squares problem, keeping the 2D extension tractable.

Automability.

Unlike RFB, LSBF requires no analytical local solution: G is assembled by exact polynomial integration and α is obtained by solving a small ( p 1 ) × ( p 1 ) system. This makes LSBF fully automatable in any FEM code, as demonstrated by the notebook.

7. Conclusions

This paper has presented an extended formulation of the LSBF enrichment method for multi-scale transport problems. The main contributions are:
(i)
The explicit cubic bubble ( p = 3 ) coefficients ( α 0 , α 1 ) are derived and their physical interpretation is given: α 0 captures symmetric intra-element corrections and α 1 captures antisymmetric, convection-like corrections.
(ii)
The quartic bubble ( p = 4 ) is derived symbolically and made available via lambdified functions in the companion notebook, providing improved accuracy in strongly dominated regimes.
(iii)
An adaptive element-level order-selection rule based on Pe h and Da h is proposed, justified by classical FEM stability theory, and shown to be analogous to local p-refinement in h-p finite element methods.
(iv)
Rigorous numerical testing on three benchmark problems shows that LSBF p = 3 , 4 yields substantially improved accuracy over standard Galerkin FEM in reaction-dominated and mixed regimes (two to four orders of magnitude in Table 1). In the convection-dominated and diffusion-dominated regimes at the mesh sizes tested, LSBF matches SG while SUPG is less accurate due to its artificial-diffusion term. The 2D bubble formula does not improve over standard Q 1 at the mesh sizes tested, highlighting the need for a proper 2D LS derivation as a future direction.
(v)
Practical limitations—high derivation complexity for p > 3 , slow symbolic computation, dense-solver scaling for large meshes—are clearly identified and discussed.
(vi)
All computations are made reproducible via a documented open-source Jupyter notebook.
Future directions include: a priori error analysis of higher-order LSBF; extension to time-dependent and 2D/3D CDR problems; ;and integration into open-source FEM frameworks.

Acknowledgments

This research was originally carried out as a part of the author’s PhD thesis at Loughborough University (UK). This updated version has benefited from the use of Artificial Intelligence (Claude AI, Sonnet 4.6) for additional literature review, problem reformulation, and expansion, all subjected to the author’s review.

Appendix A. Jupyter Notebook

All computations reported in this paper are reproduced in the accompanying notebook lsbf_extended_final.ipynb. The notebook is structured as follows:
1.
Symbolic derivation of bubble coefficients for p = 2 , 3 , 4 using SymPy, with explicit printout of α 0 (and α 1 for p 3 ) and timing.
2.
Computational complexity analysis and discussion.
3.
1D FEM assembler supporting SG, SUPG, and LSBF with selectable p and adaptive-order selection.
4.
Convergence studies for all four CDR regimes (Problem 1) with tables and named convergence plots.
5.
Stiff BVP study for Problem 2 with solution profiles.
6.
2D solver for Problem 3 on N × N meshes.
7.
Summary tables and charts for all benchmark problems.
Available at: https://github.com/alirezayazdani21/lsbf-fem (to be made public upon acceptance).

References

  1. Arnold, D. N.; Brezzi, F.; Fortin, M. A stable finite element for the Stokes equations. Calcolo 1984, 21(4), 337–344. [Google Scholar] [CrossRef]
  2. Baiocchi, C.; Brezzi, F.; Franca, L. P. Virtual bubbles and Galerkin-least-squares type methods. Comput. Methods Appl. Mech. Engrg. 1993, 105(1), 125–141. [Google Scholar] [CrossRef]
  3. Brezzi, F.; Bristeau, M.-O.; Franca, L. P.; Mallet, M. A relationship between stabilized finite element methods and the Galerkin method with bubble functions. Comput. Methods Appl. Mech. Engrg. 1992, 96(1), 117–129. [Google Scholar] [CrossRef]
  4. Brezzi, F.; Franca, L. P.; Hughes, T. J. R.; Russo, A. b=∫g, Comput. Methods Appl. Mech. Engrg. 1997, 145, 339–392. [Google Scholar]
  5. Brezzi, F.; Russo, A. Streamline-upwind Petrov/Galerkin method (SUPG) vs residual-free bubbles (RFB). Comput. Methods Appl. Mech. Engrg. 2005, 195(13–16), 1489–1500. [Google Scholar]
  6. Brooks, A. N.; Hughes, T. J. R. Streamline upwind/Petrov–Galerkin formulations for convection dominated flows with particular emphasis on the incompressible Navier–Stokes equations. Comput. Methods Appl. Mech. Engrg. 1982, 32, 199–259. [Google Scholar] [CrossRef]
  7. Donea, J.; Huerta, A. Finite Element Methods for Flow Problems; John Wiley & Sons: Chichester, 2003. [Google Scholar]
  8. Franca, L. P.; Frey, S. L. Stabilized finite element methods: II. The incompressible Navier–Stokes equations. Comput. Methods Appl. Mech. Engrg. 1992, 99, 209–233. [Google Scholar] [CrossRef]
  9. Franca, L. P.; Russo, A. Unlocking with residual-free bubbles. Comput. Methods Appl. Mech. Engrg. 1997, 142, 361–364. [Google Scholar] [CrossRef]
  10. Franca, L. P.; Nesliturk, A. I.; Stynes, M. On the stability of residual-free bubbles for convection-diffusion problems and their approximation by a two-level finite element method. Comput. Methods Appl. Mech. Engrg. 1998, 166, 35–49. [Google Scholar] [CrossRef]
  11. Franca, L. P.; Madureira, A. L.; Tobiska, L.; Valentin, F. Convergence analysis of a multiscale finite element method for singularly perturbed problems. SIAM J. Multiscale Model. Simul. 2005, 4(3), 839–866. [Google Scholar] [CrossRef]
  12. Hughes, T. J. R.; Franca, L. P.; Hulbert, G. M. A new finite element formulation for computational fluid dynamics: VIII. The Galerkin/least-squares method for advective-diffusive equations. Comput. Methods Appl. Mech. Engrg. 1989, 73, 173–189. [Google Scholar] [CrossRef]
  13. Hughes, T. J. R. Multiscale phenomena: Green’s functions, the Dirichlet-to-Neumann formulation, subgrid scale models, bubbles and the origins of stabilized methods. Comput. Methods Appl. Mech. Engrg. 1995, 127, 387–401. [Google Scholar] [CrossRef]
  14. Hughes, T. J. R.; Feijóo, G. R.; Mazzei, L.; Quincy, J.-B. The variational multiscale method: a paradigm for computational mechanics. Comput. Methods Appl. Mech. Engrg. 1998, 166, 3–24. [Google Scholar] [CrossRef]
  15. Hughes, T. J. R.; Stewart, J. A space-time formulation for multiscale phenomena. J. Comput. Appl. Math. 1996, 74(1–2), 217–229. [Google Scholar] [CrossRef]
  16. Kumar, R.; Kadalbajoo, M. K. Bubble-enriched least-squares finite element method for transient advective transport. Int. J. Differential Equations 2008, 2008, 267454. [Google Scholar] [CrossRef]
  17. Nassehi, V.; Parvazinia, M. A multiscale finite element space-time discretization method for transient transport phenomena using bubble functions. Finite Elem. Anal. Des. 2009, 45, 315–323. [Google Scholar] [CrossRef]
  18. Nassehi, V.; Parvazinia, M. Finite Element Modeling of Multiscale Transport Phenomena; Imperial College Press: London, 2011. [Google Scholar]
  19. Nesliturk, A. I.; Tezer-Sezgin, M. A comparative study on stabilized finite element methods for the convection-diffusion-reaction problems. J. Appl. Math. 2018, 2018, 4259634. [Google Scholar]
  20. Parvazinia, M.; Nassehi, V.; Wakeman, R. J. Multi-scale finite element modelling using bubble function method for a convection-diffusion problem. Chem. Eng. Sci. 2006, 61, 2742–2751. [Google Scholar] [CrossRef]
  21. Parvazinia, M.; Nassehi, V. Multi-scale finite element modelling of diffusion-reaction equation using bubble functions with bilinear and triangular elements. Comput. Methods Appl. Mech. Engrg. 2007, 196, 1095–1107. [Google Scholar] [CrossRef]
  22. Parvazinia, M.; Nassehi, V. Using bubble functions in the multi-scale finite element modelling of the convection-diffusion-reaction equation. Int. Commun. Heat. Mass. Transf. 2010, 37, 125–130. [Google Scholar] [CrossRef]
  23. Roos, H.-G.; Stynes, M.; Tobiska, L. Numerical Methods for Singularly Perturbed Differential Equations; Springer: Berlin, 1996. [Google Scholar]
  24. Su, Y.-Z.; Hwang, F.-N.; Yao, C.-C. Locally adaptive bubble function enrichment for multiscale finite element methods: Application to convection-diffusion problems. Int. J. Numer. Methods Fluids 2023, 95, 1221–1242. [Google Scholar] [CrossRef]
  25. Yazdani, A.; Nassehi, V. Finite element solution of multi-scale transport problems using the least squares based bubble function enrichment. Int. J. Model. Simul. Sci. Comput. 2012, 3(1), 1250019. [Google Scholar] [CrossRef]
  26. Zienkiewicz, O. C.; Morgan, K. Finite Elements and Approximation; Wiley: New York, 1983. [Google Scholar]
Figure 4. Stiff BVP solution profiles ( ε = 10 4 , N = 3500 ): full domain (left) and boundary layer region x [ 0 , 0.003 ] (right). The layer of thickness 10 4 is sub-element at this resolution, so all methods exhibit O ( 1 ) error. SUPG (blue dashed) is most inaccurate, over-shooting in the bulk; SG and all LSBF variants (which overlap) produce a smaller but still large error.
Figure 4. Stiff BVP solution profiles ( ε = 10 4 , N = 3500 ): full domain (left) and boundary layer region x [ 0 , 0.003 ] (right). The layer of thickness 10 4 is sub-element at this resolution, so all methods exhibit O ( 1 ) error. SUPG (blue dashed) is most inaccurate, over-shooting in the bulk; SG and all LSBF variants (which overlap) produce a smaller but still large error.
Preprints 211853 g004
Figure 5. L error vs. mesh size for Problem 2 ( ε = 10 4 ). All methods plateau at O ( 1 ) error because the layer is sub-element. SUPG (blue dashed) has the largest error; SG and LSBF ( p = 2 , 3 , 4 ) produce the same solution and overlap in the plot. Convergence rates below O ( h ) confirm that the error is dominated by the unresolved layer, not by truncation error.
Figure 5. L error vs. mesh size for Problem 2 ( ε = 10 4 ). All methods plateau at O ( 1 ) error because the layer is sub-element. SUPG (blue dashed) has the largest error; SG and LSBF ( p = 2 , 3 , 4 ) produce the same solution and overlap in the plot. Convergence rates below O ( h ) confirm that the error is dominated by the unresolved layer, not by truncation error.
Preprints 211853 g005
Figure 8. Overall method comparison. Left: L error at N = 2000 for the convection-dominated CDR problem; SG and all LSBF variants achieve similar accuracy while SUPG is an order of magnitude less accurate. Centre: L error at N = 2000 for the stiff BVP; SUPG is worst ( 6.2 ), SG and LSBF produce the same result ( 3.8 ). Right: accuracy improvement factor (SG/ Q 1 +bubble) for the 2D problem; the bubble provides a marginal gain ( 1.1 × ) only on the 4 × 4 mesh and is less accurate than SG for finer meshes.
Figure 8. Overall method comparison. Left: L error at N = 2000 for the convection-dominated CDR problem; SG and all LSBF variants achieve similar accuracy while SUPG is an order of magnitude less accurate. Centre: L error at N = 2000 for the stiff BVP; SUPG is worst ( 6.2 ), SG and LSBF produce the same result ( 3.8 ). Right: accuracy improvement factor (SG/ Q 1 +bubble) for the 2D problem; the bubble provides a marginal gain ( 1.1 × ) only on the 4 × 4 mesh and is less accurate than SG for finer meshes.
Preprints 211853 g008
Table 1. L errors for Problem 1 (all four CDR regimes), N { 2000 , 3500 , 5000 } . Diffusion dominated ( ε = 1 , c = 1 , σ = 0 ): all methods are stable; LSBF matches SG but SUPG is O ( 10 4 ) times less accurate due to excessive artificial diffusion at small Pe. Convection dominated ( ε = 10 3 , c = 1 , σ = 0 ): LSBF achieves convergence rate 2 while SUPG stagnates at rate 0.9 . Reaction dominated ( ε = 10 3 , c = 0 , σ = 10 3 ): LSBF outperforms SG and SUPG by two to four orders of magnitude. Mixed ( ε = 10 2 , c = 1 , σ = 10 2 ): LSBF achieves 2– 6 × smaller errors than SG and 10– 60 × smaller than SUPG.
Table 1. L errors for Problem 1 (all four CDR regimes), N { 2000 , 3500 , 5000 } . Diffusion dominated ( ε = 1 , c = 1 , σ = 0 ): all methods are stable; LSBF matches SG but SUPG is O ( 10 4 ) times less accurate due to excessive artificial diffusion at small Pe. Convection dominated ( ε = 10 3 , c = 1 , σ = 0 ): LSBF achieves convergence rate 2 while SUPG stagnates at rate 0.9 . Reaction dominated ( ε = 10 3 , c = 0 , σ = 10 3 ): LSBF outperforms SG and SUPG by two to four orders of magnitude. Mixed ( ε = 10 2 , c = 1 , σ = 10 2 ): LSBF achieves 2– 6 × smaller errors than SG and 10– 60 × smaller than SUPG.
N SG SUPG LSBF p = 2 LSBF p = 3 LSBF p = 4
Diffusion dominated ( ε = 1.0 , c = 1.0 , σ = 0 )
2000 2.514 × 10 9 1.007 × 10 5 1.512 × 10 9 1.534 × 10 9 1.534 × 10 9
3500 8.277 × 10 10 5.752 × 10 6 5.063 × 10 10 3.575 × 10 10 3.575 × 10 10
5000 4.063 × 10 10 4.027 × 10 6 6.344 × 10 10 8.443 × 10 10 8.443 × 10 10
Convection dominated ( ε = 10 3 , c = 1.0 , σ = 0 )
2000 7.879 × 10 3 2.526 × 10 2 7.864 × 10 3 7.863 × 10 3 7.864 × 10 3
3500 2.500 × 10 3 1.553 × 10 2 2.495 × 10 3 2.495 × 10 3 2.495 × 10 3
5000 1.232 × 10 3 1.131 × 10 2 1.229 × 10 3 1.229 × 10 3 1.229 × 10 3
Reaction dominated ( ε = 10 3 , c = 0 , σ = 10 3 )
2000 3.922 × 10 3 3.922 × 10 3 1.614 × 10 5 1.614 × 10 5 1.620 × 10 5
3500 1.249 × 10 3 1.249 × 10 3 1.693 × 10 6 1.693 × 10 6 1.693 × 10 6
5000 6.154 × 10 4 6.154 × 10 4 4.093 × 10 7 4.093 × 10 7 4.089 × 10 7
Mixed ( ε = 10 2 , c = 1.0 , σ = 10 2 )
2000 1.452 × 10 4 1.226 × 10 3 5.507 × 10 5 5.505 × 10 5 5.506 × 10 5
3500 4.741 × 10 5 7.363 × 10 4 1.799 × 10 5 1.798 × 10 5 1.799 × 10 5
5000 2.323 × 10 5 5.253 × 10 4 8.813 × 10 6 8.813 × 10 6 8.813 × 10 6
Table 2. L errors for Problem 2 (stiff BVP, ε = 10 4 ) at N { 2000 , 5000 } . The boundary layer of thickness 10 4 is entirely sub-element at all tested mesh sizes (smallest h = 2 × 10 4 ), so no method can resolve it and all achieve O ( 1 ) errors. SUPG is worse than SG because its stabilization term adds artificial diffusion that distorts the smooth bulk solution. Bubble enrichment alone cannot overcome the fundamental resolution barrier; structured mesh refinement into the layer would be needed.
Table 2. L errors for Problem 2 (stiff BVP, ε = 10 4 ) at N { 2000 , 5000 } . The boundary layer of thickness 10 4 is entirely sub-element at all tested mesh sizes (smallest h = 2 × 10 4 ), so no method can resolve it and all achieve O ( 1 ) errors. SUPG is worse than SG because its stabilization term adds artificial diffusion that distorts the smooth bulk solution. Bubble enrichment alone cannot overcome the fundamental resolution barrier; structured mesh refinement into the layer would be needed.
N SG SUPG LSBF p = 2 LSBF p = 3 LSBF p = 4
2000 3.849 6.171 3.849 3.849 3.849
5000 2.997 3.908 2.997 2.997 2.997
Table 3. Relative L 2 errors for Problem 3 ( σ = 100 ). Both SG and the bubble-enriched Q 1 element achieve O ( h 2 ) convergence; SG reaches this optimal rate immediately while the bubble scheme requires mesh refinement to enter the asymptotic regime. The improvement factor (last column) is the ratio e SG / e bub : values below 1 indicate that bubble enrichment increases the error. The bubble provides a modest benefit only on the coarsest mesh; for N 8 the standard Q 1 element is more accurate. This highlights a limitation of the scalar 2D bubble formula used: the one-dimensional LS minimization underlying the 1D coefficients does not straightforwardly generalise to provide guaranteed accuracy gains in 2D.
Table 3. Relative L 2 errors for Problem 3 ( σ = 100 ). Both SG and the bubble-enriched Q 1 element achieve O ( h 2 ) convergence; SG reaches this optimal rate immediately while the bubble scheme requires mesh refinement to enter the asymptotic regime. The improvement factor (last column) is the ratio e SG / e bub : values below 1 indicate that bubble enrichment increases the error. The bubble provides a modest benefit only on the coarsest mesh; for N 8 the standard Q 1 element is more accurate. This highlights a limitation of the scalar 2D bubble formula used: the one-dimensional LS minimization underlying the 1D coefficients does not straightforwardly generalise to provide guaranteed accuracy gains in 2D.
N × N Method e L 2 / u L 2 Rate Impr. factor
4 × 4 SG (Q1) 9.803 × 10 2 1.1 ×
4 × 4 Q1 + bubble 8.919 × 10 2
8 × 8 SG (Q1) 2.382 × 10 2 2.04 0.5 ×
8 × 8 Q1 + bubble 4.939 × 10 2 0.85
16 × 16 SG (Q1) 5.911 × 10 3 2.01 0.4 ×
16 × 16 Q1 + bubble 1.542 × 10 2 1.68
32 × 32 SG (Q1) 1.475 × 10 3 2.00 0.4 ×
32 × 32 Q1 + bubble 4.090 × 10 3 1.91
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.
Prerpints.org logo

Preprints.org is a free preprint server supported by MDPI in Basel, Switzerland.

Subscribe

Disclaimer

Terms of Use

Privacy Policy

Privacy Settings

© 2026 MDPI (Basel, Switzerland) unless otherwise stated