Preprint
Article

This version is not peer-reviewed.

Optimization of Arrangements of Heat-Storage Bricks in a Regenerative Combustion System by Tree Search

A peer-reviewed article of this preprint also exists.

Submitted:

07 June 2025

Posted:

09 June 2025

You are already at the latest version

Abstract
When there are several different types of heat-storage ceramic bricks that can be arranged in the fix-bed heat regenerators of a regenerative combustion system, one must find an optimal arrangement of these bricks, of possibly different types, in the fix-bed heat regenerators of a regenerative combustion system. It seems impractical to evaluate the efficiency of each of all the possible arrangements of heat-storage ceramic bricks, in the fix-bed heat regenerators of a rege-nerative combustion system, by 3-dimensional CFD (Computational Fluid Dynamics) simulations on Ansys Fluent. In this article, we present an efficient tree search method to tackle this optimization problem.
Keywords: 
;  ;  ;  ;  ;  

1. Introduction

In this article, we will propose a method for solving an optimization problem on the arrangements of heat-storage ceramic bricks (checkers) in a heat regenerator system.
Usually two fixed-bed heat regenerators are utilized in pairs with a central furnace to form a regenerative combustion system. See Figure 1. In each heat regenerator, checkers are arranged. The regenerative combustion system operates periodically with a two-phase cycle. The checkers arranged in the heat regenerators, on both ends of a regenerative combustion system, are used to absorb heat from the high temperature exhaust gas expelled from the central furnace.
In Phase 1, the cool fresh air flows into the left heat regenerator and is preheated by the checkers arranged there. (The checkers arranged in the left heat regenerator are designed to absorb periodically heat from the high temperature exhaust gas expelled from the central furnace in Phase 2.) The preheated fresh air then flows into the central furnace for combustion with Natural Gas. After combustion with Natural Gas, the high temperature exhaust gas, expelled from the central furnace, then flows into the right heat regenerator and heats up the checkers arranged there. Then Phase 2 starts at the Phase Switch point of time. In Phase 2, the above process is reversed. The cool fresh air flows into the right heat regenerator and is preheated by the checkers arranged there, which already absorbed heat from the high temperature exhaust gas expelled from the central furnace during Phase 1. Then the preheated fresh air flows into the central furnace for combustion with Natural Gas. Finally, the high temperature exhaust gas, expelled from the central furnace, flows into the left heat regenerator and heats up the checkers arranged there. Then Phase 1 starts again at the Phase Switch point of time. A new cycle of operations follows.
Usually there are several different types of heat-storage ceramic bricks that can be arranged in a heat regenerator. So one must find an optimal arrangement of these checkers, of possibly several different types, in a heat regenerator to reach the best performance of the regenerative combustion system with this heat regenerator. Naturally, the objective function for this optimization problem is the long-term Waste Heat Recovery Ratio defined for each arrangement of selected heat-storage ceramic bricks (of possibly different types) in this heat regenerator.
However, the number of possible arrangements of checkers in a heat regenerator could be very huge. Thus finding the optimal arrangement of checkers, of possibly different types, in a heat regenerator could be difficult. In fact, when there are p different types of checkers that can be selected for each of n positions in a fixed-bed heat regenerator, the total number of possible arrangements of checkers at n positions is
p n .
Thus, when 5 different types of checkers are available for each of 14 positions in a heat regenerator, the total number of possible arrangements of checkers, of possibly different types, is
5 14 = 6,103,515,625 .
This means that one must evaluate more than 6 billion arrangements to reach an optimal arrangement of checkers at 14 positions in a heat regenerator. To tackle this optimization problem, one must find a effective method for deciding the optimal (most efficient) arrangements of checkers among the huge number of possible arrangements of checkers, of possibly different types, at n positions in a fixed-bed heat regenerator.
Over the past few years, the Artificial Intelligence (AI), based on combination of “Deep Learning” with MCTS, has proved to be very successful in creating computer player for the incredibly complicated board game Go. Motivated by this great progress in AI, we propose, in this article, a simple stochastic tree search method to find the most efficient arrangement of checkers in a heat regenerator.
Though the total number
p n
depends exponentially on the number n of positions for checkers in a heat regenerator, our stochastic tree search method usually exhibits only complexity of polynomial growth on the number n of positions for checkers in a heat regenerator.
To speed up the search process for the most efficient arrangements of checkers, we use a simplified system of 1-dimensional partial differential equations to evaluate the long-term Waste Heat Recovery Ratio of each node (arrangement of checkers) considered in our search tree. We demonstrate this search method to find the most efficient arrangements of checkers when the number of positions for checkers in a heat regenerator is 6. Empirical results reveal that our search method is highly efficient for finding the optimal arrangements of checkers in a heat regenerator.

2. Materials and Methods

The “Monte-Carlo Method” was proposed in 1949, [1], to calculate the area of a region, based on Random Sampling, to solve problems in statistical physics. According to the mathematical principle “Law of Large Numbers”, [2,3,4], one should be able to speculate almost correctly the genuine area of a region when the sampling number is large enough. By the way, other probabilistic methods “Stochastic Integrals”, [5,6], based on the Central Limit Theorem, were applied to mathematical finance, [7], in those decades.

2.1. Tree Search by the Monte-Carlo Method

In 1987, B. Abramson applied the “Monte-Carlo Method” to certain “Two-Player Games”: tic-tac-toe, Othello and Chess, [8]. B. Abramson proposed the “Expected-Outcome model”, based on the statistical data of “random game playouts to the end”, as the basis of strategies for a game player. B. Brügmann considered the applications of the “Monte-Carlo Method” to the board game “Go” in 1993, but not seriously, [9]. In 2006, inspired by many predecessors, R. Coulom considered seriously the applications of the “Monte-Carlo Method” to the search tree for the board game “Go”, [10]. See also [11] for the work by Kocsis and Szepesvári. The decision-making algorithm proposed in [10] was considered as “Monte-Carlo Tree Search (MCTS)” by R. Coulom. More modifications and improvements, [12,13,14,15,16,17,18], are made for MCTS after the important contributions by Kocsis and Szepesvári, [11] and by Coulom, [10]. The MCTS algorithm was also applied to certain games, [19,20,21,22,23]. By combining MCTS with Reinforcement Learning based on CNN (Convolutional Neural Networks), the computer Go player AlphaGo, developed by Google DeepMind, defeated Lee, Sedol, one of the most brilliant Go players, in a five game Go match in 2016. See [24,25]. The following three pictures are taken from [26], which can be found on the website of Rémi Coulom.
Figure 2. List of Game Complexity. Taken from [26].
Figure 2. List of Game Complexity. Taken from [26].
Preprints 162767 g002
Figure 3. Principle of Monte-Carlo Evaluation. Taken from [26].
Figure 3. Principle of Monte-Carlo Evaluation. Taken from [26].
Preprints 162767 g003
Figure 4. Monte-Carlo Tree Search. Taken from [26].
Figure 4. Monte-Carlo Tree Search. Taken from [26].
Preprints 162767 g004
Figure 5. The board game Go.
Figure 5. The board game Go.
Preprints 162767 g005
In 2017, Google DeepMind added a new ingredient “Dirichlet noise” to AlphaGo Zero to encourage further exploration by MCTS, which could be omitted by the earlier versions of AlphaGo because of low prior probabilities. This deepened the MCTS reinforcement learning of AlphaGo Zero. AlphaGo Zero is considered as a genuine AI because AlphaGo Zero is able to explore the board game Go by MCTS without human knowledge (experience), [27]. Applications of Artificial Intelligence with MCTS to other games were developed in [28,29,30,31]. Artificial Intelligence with MCTS was also applied to chemical syntheses of organic compounds, [32]. Application of MCTS to floor plans was considered in [33]. More applications of MCTS are still explored, [34,35]. For a recent review on MCTS, see [36].

2.2. Our Simple Tree Search Method

Motivated by the principles of MCTS, we will introduce a simple Tree Search method to find the optimal (most efficient) arrangements of heat-storage ceramic bricks (checkers) in a heat regenerator, when there are p different types of checkers that can be selected for each of n positions in a fixed-bed heat regenerator. Our search method can be performed easily on an ordinary computer, while a super computer is usually necessary for AI with MCTS.
We begin with the notion of a “Partition” of the set
S = 1 , , n
of positions, to be placed by checkers, in a fixed-bed heat regenerator. A Partition  α of S is a subset of S = 1 , , n such that the largest integer n must be included in α .
Example 1. For the set S = 1 , , 9 , α = 4 , 9 and β = 4 , 6 , 9 are Partitions of S .
Assume that
α = c 1 , , c m with   c 1 < < c m = n
is a Partition of S = 1 , , n . Using the positive integers c 1 , , c m = n in α , we may create the following decomposition
S = I 1 I m
for S = 1 , , n , in which
I 1 = 1 , , c 1 ,   I 2 = c 1 + 1 , , c 2 ,   I m = c m 1 + 1 , , c m = n .
Example 2. For the Partition α = 4 , 9 of the set S = 1 , , 9 , we have the following decomposition
S = I 1 I 2 with I 1 = 1 , 2 , 3 , 4 and I 2 = 5 , 6 , 7 , 8 , 9 .
For the Partition
α = c 1 , , c m with c 1 < < c m = n
of the S = 1 , , n , we will conveniently say that each I k is an “Interval Component” of S  with respect to  α , because each I k contains certain consecutive positive integers taken from S = 1 , , n . This phenomenon is clear from the example (Example 2) shown above.
We have the following simple facts about the decomposition (2) of S = 1 , , n .
Fact A. The endpoints of the Interval Components  I k in (2) simply constitute the Partition set α of S .
Fact B. The Interval Components of the decomposition (2) of S = 1 , , n , with respect to the Partition  α , are disjoint.
Fact C. Elements of the Interval Components of the decomposition (2) of S = 1 , , n are linearly ordered.
There is a Partial Ordering on the collection of all Partitions of S = 1 , , n . For Partitions α and β of S = 1 , , n , we say that β is finer than α if and only if
α β .
We say that β is strictly finer than α if and only if
α β and   β α .
We will use the notation
α β
to indicate the condition that β is strictly finer than α .
Example 3. For the Partitions α = 4 , 9 and β = 4 , 6 , 9 of S = 1 , , 9 , we have α β .
Now we discuss the notion of “qualified arrangements with respect to a Partition”. Assume that α is a Partition of S = 1 , , n as shown in (1). We say that an arrangement  U of checkers on S = 1 , , n is a “qualified arrangement with respect to the Partition  α ” if and only if the following condition (4) is satisfied.
Definition. We say that an arrangement  U of checkers on S = 1 , , n is a “qualified arrangement with respect to the Partition  α ” if the following condition is satisfied.
For each Interval Component I k of S = 1 , , n in the decomposition (2) with respect to the Partition  α ,
the   checkers   on   I k ,   arranged   by U ,   are   of   the   s a m e type .
Let Ω α denote the class of all “qualified arrangements with respect to the Partition  α ”. Let Ω α denote the norm (the total number of qualified arrangements with respect to α ) of Ω α . Then we have
Ω α = p m = p α
in which m = α is the norm (number of elements) of α , as shown in (1).
Example 4. For the Partition α = 4 , 9 of S = 1 , , 9 , the total number of “qualified arrangements with respect to the Partition  α ” is
p 2 ,   in   which   α = 2 .
For the Partition β = 4 , 6 , 9 , the total number of “qualified arrangements with respect to the Partition  β ” is
p 3 ,   in   which   β = 3 .
However, the number of all possible arrangements of checkers on S = 1 , , 9 is p 9 .
For Partitions α and β of S = 1 , , n , we have the following important
Fact D. For Partitions α and β of S = 1 , , n satisfying α β , we have
Ω α Ω β but   Ω α Ω β .
Thus any “qualified arrangement of checkers with respect to the Partition  α ” is naturally a “qualified arrangement of checkers with respect to the Partition  β ”. Besides, the class Ω β of arrangements is strictly larger than the class Ω α of arrangements.
To initialize a search tree for the optimal (most efficient) arrangements of checkers in a heat regenerator, when p different types of checkers are available for selection at each of n positions in the heat regenerator, we must choose a strictly increasing sequence
α 0 α 1 α q
of Partitions of S = 1 , , n . Let Ω α k denote the class of all “qualified arrangements with respect to the Partition  α k ”. Then, according to Fact D, the sequence of classes
Ω α 0 Ω α 1 Ω α q ,
of arrangements corresponding to the strictly increasing sequence α 0 α 1 α q of Partitions, is naturally strictly increasing.
In our tree search, each arrangement of checkers on S = 1 , , n will be considered as a “node” in the search tree. At the initial stage α 0 , we evaluate the efficiency of each of the arrangements in Ω α 0 (“qualified arrangements with respect to the Partition  α 0 ”) by numerical Simulation. Then we select the top K arrangements in Ω α 0 as the “mother (root) nodes” in Ω α 1 . These selected “mother (root) nodes” will be used to createchild nodes” (qualified arrangements with respect to the Partition  α 1 ) in Ω α 1 . This process is the Expansion operator of our algorithm. Then we evaluate the efficiency of each of the child nodes, created by the Expansion operator, in Ω α 1 by numerical Simulation. See Figure 6 for the phases of our tree search.
In the Expansion phase of Figure 6, The “mother (root) nodes” selected in Ω α k will be used to create “child nodes” in Ω α k + 1 .

2.3. The Expansion Operators

We will discuss two Expansion operators, “Gradient Expansion operator” and “Mutation Expansion operator”, for our tree search method.
We consider the following typical case. Assume that α and β are Partitions of S = 1 , , n satisfying
α β .
Then, by Fact D, we have
Ω α Ω β .
Let
S = I 1 I m β
be the decomposition of S = 1 , , n into a union of Interval Components with respect to the Partition β . Assume that U Ω α . Since Ω α Ω β , we note that, for each Interval Component I k , only checkers of the same type are placed on I k by the arrangement U . We assume that, on the Interval Component I k , the checkers arranged by U are all of the type
U k .
Assume that V Ω β is a “qualified arrangement with respect to the Partition  β ”. Assume that, on the Interval Component I k , the checkers arranged by V are all of the type
V k .
We say that the arrangement V Ω β of checkers is a “child-node” of U in Ω β , by the “Gradient Expansion operator”, if the following GE Condition is satisfied.
GE(Gradient Expansion) Condition. There is a sequence G E U V = ϕ ( 1 ) , , ϕ ( q ) of positive integers taken from 1 , , m β , satisfying
ϕ ( s ) + 2 ϕ ( s + 1 ) ,   for   all   s = 1 , , ( q 1 ) ,
such that
U ϕ ( s ) U ϕ ( s ) + 1 ,   for   all   s = 1 , , q .
For each s = 1 , , q , we have
( V ϕ ( s ) , V ϕ ( s ) + 1 ) = ( U ϕ ( s ) , U ϕ ( s ) ) or   ( V ϕ ( s ) , V ϕ ( s ) + 1 ) = ( U ϕ ( s ) , U ϕ ( s ) + 1 ) or ( V ϕ ( s ) , V ϕ ( s ) + 1 ) = ( U ϕ ( s ) + 1 , U ϕ ( s ) + 1 ) ,
for the arrangements U and V of checkers on the pair ( I ϕ ( s ) , I ϕ ( s ) + 1 ) of adjacent Interval components I ϕ ( s ) and I ϕ ( s ) + 1 . Besides, outside these pairs ( I ϕ ( s ) , I ϕ ( s ) + 1 ) of adjacent Interval components, s = 1 , , q , we have
V K = U k ,   if   k is   not   in   the   union   ϕ ( 1 ) , , ϕ ( q ) ϕ ( 1 ) + 1 , , ϕ ( q ) + 1 .
Example 5. For the Partitions α = 4 , 9 and β = 4 , 6 , 9 of S = 1 , , 9 , we have
S = 1 , 2 , 3 , 4 5 , 6 , 7 , 8 , 9 and   S = 1 , 2 , 3 , 4 5 , 6 7 , 8 , 9 .
These are the decompositions of S = 1 , , 9 into unions of Interval Components respectively with respect to the Partitions α = 4 , 9 and β = 4 , 6 , 9 . Assume that we have two different types of checkers A and B . Then
U = ( A , A , A , A , B , B , B , B , B )
is a qualified arrangement of checkers with respect to the Partition  α = 4 , 9 . When U is considered as a qualified arrangement with respect to the Partition  β = 4 , 6 , 9 , it has the following child-nodes
( A , A , A , A , A , A , B , B , B ) ,   ( A , A , A , A , B , B , B , B , B ) ,   ( B , B , B , B , B , B , B , B , B )
by the “Gradient Expansion operator”.
This “Gradient Expansion operator” is motivated by the usual Gradient Descent method adopted in Machine Learning. See, for example, [37]. Search through the simple Gradient Descent method usually converges slowly. (To expedite the training process of AI, Stochastic Gradient Descent was introduced. See [37].)
Now we discuss the “Mutation Expansion operator” under the assumptions (9) to (12). We say that the arrangement V Ω β of checkers is a “child-node” of U in Ω β , by the “Mutation Expansion operator”, if the following ME Condition is satisfied.
ME(Mutation Expansion) Condition. There is a sequence G E U V = ϕ ( 1 ) , , ϕ ( q ) of positive integers taken from 1 , , m β , satisfying
ϕ ( s ) + 2 ϕ ( s + 1 ) ,   for   all   s = 1 , , ( q 1 ) ,
such that
U ϕ ( s ) U ϕ ( s ) + 1 , ,   for   all   s = 1 , , q .
For each s = 1 , , q , we have
( V ϕ ( s ) , V ϕ ( s ) + 1 ) = ( U ϕ ( s ) , U ϕ ( s ) + 1 )   or   ( V ϕ ( s ) , V ϕ ( s ) + 1 ) = ( U ϕ ( s ) + 1 , U ϕ ( s ) )
for the arrangements U and V of checkers on the pair ( I ϕ ( s ) , I ϕ ( s ) + 1 ) of adjacent Interval components I ϕ ( s ) and I ϕ ( s ) + 1 . Besides, outside these pairs ( I ϕ ( s ) , I ϕ ( s ) + 1 ) of adjacent Interval components, s = 1 , , q , we have
V K = U k ,   if   k   is n o t   in   the   union ϕ ( 1 ) , , ϕ ( q ) ϕ ( 1 ) + 1 , , ϕ ( q ) + 1
Example 6. For the Partitions α = 4 , 9 and β = 4 , 6 , 9 of S = 1 , , 9 , we have the following decompositions
S = 1 , 2 , 3 , 4 5 , 6 , 7 , 8 , 9 and   S = 1 , 2 , 3 , 4 5 , 6 7 , 8 , 9
of S = 1 , , 9 into unions of Interval Components respectively with respect to the Partitions α = 4 , 9 and β = 4 , 6 , 9 . Assume that we have two different types of checkers A and B . Then
U = ( A , A , A , A , B , B , B , B , B )
is a qualified arrangement of checkers with respect to the Partition  α = 4 , 9 . When U is considered as a qualified arrangement with respect to the Partition  β = 4 , 6 , 9 , it has the following child-nodes
( A , A , A , A , B , B , B , B , B ) and   ( B , B , B , B , A , A , B , B , B )
by the “Mutation Expansion operator”.
This “Mutation Expansion operator” is motivated by the Differential Evolution method. See, for example, [38,39,40,41]. Search through this “Mutation Expansion operator” usually lead to rapid convergence. Thus we may use “tree search through the Mutation Expansion operator” to help us to find a satisfactory strictly increasing sequence
α 0 α 1 α q
of Partitions of S = 1 , , n . Then we may use this proper strictly increasing sequence of Partitions of S = 1 , , n to execute a delicate “tree search through the Gradient Expansion operator”, which usually converges slowly.

2.4. The Numerical Simulation Methods

To speed up the evaluation process for an arrangement of checkers in a fixed-bed heat regenerator, our numerical simulations are based on certain 1-dimensional partial differential equations as in [42,43,44]. These 1-dimensional partial differential equations were developed in [45,46] based on the theories of W. Nusselt. Empirical evidence shows that, in the long term, simulation results of the Inlet temperature and the Outlet temperature, by the 1-dimensional partial differential equations, are consistent with that by CFD (Computational Fluid Dynamics) on Ansys Fluent.
Let us consider the two-phase cycle of a fixed-bed heat regenerator, which is placed on the right end of a regenerative combustion system, as shown in Figure 7. In Phase 1, the high temperature exhaust gas, from the central furnace, flows into the right heat regenerator and heats up the checkers arranged there. Then Phase 2 starts at the Phase Switch point of time. In Phase 2, the above process is reversed. The cool fresh air flows into the right heat regenerator and is preheated by the checkers arranged there, which already absorbed heat from the high temperature exhaust gas expelled from the central furnace during Phase 1. Then the preheated fresh air flows into the central furnace for combustion with Natural Gas.
Let t s w denote the switch time of the operation cycle of the fixed-bed heat regenerator shown above. Thus
2 t s w = t s w + t s w
is the period of the operation cycle. When 0 t t s w , Phase 1 operates. When t s w t 2 t s w , Phase 2 operates. To evaluate the efficiency of an arrangement of checkers on a fixed-bed heat regenerator, this operation cycle must be performed periodically until we reach approximately at a steady state. We assume that the fixed-bed heat regenerator is located on the interval [ 0 , l ] of the x -axis. See Figure 7.
We use the subscript ar to indicate functions related to the fresh air flow. We use the subscript ex to indicate functions related to the exhaust gas flow. We use the subscript s to indicate functions related to the checkers (solid porous medium). Let n be a nonnegative integer. When
n 2 t s w + 0 t n 2 t s w + t s w ,
we have the following 1-dimensional partial differential equations:
ε ( ρ e x C e x T e x ) t + ( ρ e x C e x u T e x ) x = x ε k e x T e x x h a s ( T e x T s )
and
( 1 ε ) ( ρ s C s T s ) t = x ( 1 ε ) k s T s x + h a s ( T e x T s ) q d
satisfying the following boundary conditions
T s x x = 0 = 0 = T s x x = l ,   T e x x x = l = 0 and   T e x ( 0 , t )   g i v e n .
When n 2 t s w + t s w t n 2 t s w + 2 t s w , we have the following 1-dimensional partial differential equations:
ε ( ρ a r C a r T a r ) t + ( ρ a r C a r [ u ] T a r ) x = x ε k a r T a r x h a s ( T a r T s )
and
( 1 ε ) ( ρ s C s T s ) t = x ( 1 ε ) k s T s x + h a s ( T a r T s ) q d
satisfying the following boundary conditions
T s x x = 0 = 0 = T s x x = l ,   T a r x x = 0 = 0 and   T a r ( l , t )   g i v e n .
Here u (m/s) is the superficial flow velocity of the gas/air. ρ (kg/m3) and ρ s (kg/m3) are respectively the densities of the gas/air and the solid porous medium (checkers). C (J/kgK) and C s (J/kgK) are respectively the specific heat capacities of the gas/air and the solid porous medium (checkers). k (W/mK) and k s (W/mK) are respectively the thermal conductivities of the gas/air and the solid porous medium (checkers). T (K) and T s (K) are respectively the temperatures of the gas/air and the solid porous medium (checkers). ε is the void fraction (porosity) of the solid porous medium (checkers). a s (m2) is the specific surface area of the porous ceramic medium (checkers) exposed to gas/air per unit volume. h (w/m2K) is the heat transfer coefficient of the solid porous medium (checkers). q d is the heat dissipation through the external surface of a fixed-bed heat regenerator. We assume that q d = 0 .
We have the following relation for the Nusselt number of the fluid (gas/air) flow:
N u = h × d k
in which d is the characteristic length. Let Re and Pr denote respectively the Reynolds number and the Prandtl number of the fluid (gas/air) flow. We will use the following classic relation
Nu = 1.86 × d L × Re × Pr 1 3 × μ b μ w 0.14
of Sieder and Tate to calculate the Nusselt number. Here μ b and μ w are respectively the viscosity of fluid at the mean bulk temperature and the viscosity of fluid at the wall. See page 583 of [47]. Note that
M 0.14 = e ( 0.14 ) × ln M e 0 = 1
when ln M is not large. Thus, when performing numerical simulations, we will use the simplified formula
Nu = 1.86 × d L × Re × Pr 1 3
Let M e x (kg/s) and M a r (kg/s) be respectively the mass flow rates of the exhaust gas flow and of the fresh air flow. Let C a r , i (J/kgK) and C a r , o (J/kgK) be the specific heat capacities of the fresh air respectively at the Inlet of fresh air (into the right heat regenerator) and at the Outlet of fresh air (into the central furnace). Let T a r , i (K) and T a r , o (K) be the temperatures of the fresh air respectively at the Inlet of fresh air (into the right heat regenerator) and at the Outlet of fresh air (into the central furnace). Let C e x , i (J/kgK) be the specific heat capacity of the exhaust gas flow at the Inlet of exhaust gas (into the right heat regenerator). Let T e x , i (K) be the temperature of the exhaust gas flow at the Inlet of exhaust gas (into the right heat regenerator).
We define the Waste Heat Recovery Ratio (%) of an arrangement of checkers in a fixed-bed heat regenerator as follows:
E ' = M a r ( C a r , o × T a r , o C a r , i × T a r , i ) M e x × C e x , i × T e x , i × 100 .
We use the long term Waste Heat Recovery Ratio to evaluate the efficiency of an arrangement of checkers in a fixed-bed heat regenerator.
To expedite the process of simulations, we use the following polynomials in our simulations.
C e x = 7 × 10 8 × T e x 3 + 0.0002 × T e x 2 + 0.1756 × T e x + 1043.4 .
C a r = 5 × 10 20 × T a r 3 + 0.0002 × T a r 2 + 0.0683 × T a r + 976.04 .
k e x = 10 8 × T e x 2 + 8 × 10 5 × T e x + 0.0017 .
k a r = 7 × 10 9 × T a r 2 + 7 × 10 5 × T a r + 0.0078 .
These polynomials are derived based on the data provided in the Appendices of [48] at atmospheric pressure. For the densities of the air/gas, we use the following polynomial
ρ = 7.7352 × 10 13 × T 4 3.8908 × 10 9 × T 3 + 7.2935 × 10 6 × T 2 0.0063 × T + 2.4655
in our simulations. This polynomial is derived based on the data for air provided in the Appendices of [48] at atmospheric pressure.

3. Results

Before starting our optimization process by tree search, we must test the validity of our 1-dimensional partial differential equations, though similar 1-dimensional modeling had been developed before in [42,43,44,45,46]. We test our 1-dimensional modeling for two types of checkers: Cordierite and Mullite with material parameters shown in Table 1. We consider the following arrangement of checkers
( Cordierite , Cordierite , Cordierite , Cordierite , Mullite , Mullite )
at 6 positions in a fixed-bed heat regenerator. We assume that the temperature of exhaust gas, expelled from the central furnace, is 900℃ (1173.15K). We assume that the temperature of fresh air, at the Inlet, is 40℃ (313.15K). We assume that the time of Phase Switch is 30s. We assume that the superficial flow velocity of the exhaust gas is 2.52 m / s . We assume that the superficial flow velocity of the fresh air is 0.56 m / s .
The comparison of our 1-D simulations with the 3-D CFD simulations on Ansys Fluent for the arrangement of checkers
( Cordierite , Cordierite , Cordierite , Cordierite , Mullite , Mullite )
at 6 positions, in a fixed-bed heat regenerator, is shown in Figure 8.
In Figure 8, the Inlet temperature of exhaust gas (expelled from the central furnace) and the Outlet temperature of fresh air (into the central furnace), based on our 1-D simulations using C++, is shown in black color. In Figure 8, the Inlet temperature of exhaust gas (expelled from the central furnace) and the Outlet temperature of fresh air (into the central furnace), based on 3-D CFD simulations on Ansys Fluent, is shown in red color.
In Figure 8, the Outlet temperature of exhaust gas (expelled from the right heat regenerator) and the Inlet temperature of fresh air (into the right heat regenerator), based on our 1-D simulations using C++, is shown in blue color. In Figure 8, the Outlet temperature of exhaust gas (expelled from the right heat regenerator) and the Inlet temperature of fresh air (into the right heat regenerator), based on 3-D CFD simulations on Ansys Fluent, is shown in green color.
It can be observed that, in the long term, our numerical simulation results, based on the 1-dimensional partial differential equations, are consistent with the simulation results based on CFD (Computational Fluid Dynamics) on Ansys Fluent. See Figure 8.
Now we apply our simple tree search method with Mutation Expansion operator to solve the optimization problem for 3 types of checkers to be arranged at 6 positions in a fixed bed regenerator. The material parameters of these 3 types, A, B and C, of checkers are shown in Table 2. The operating parameters for a regenerative combustion system with two fixed-bed heat regenerators are shown in Table 3.
Thus we have S = 1 , 2 , 3 , 4 , 5 , 6 . We choose the strictly increasing sequence
α 0 = 1 , 2 , 3 α 1 = 1 , 2 , 3 , 4 , 5 , 6
of Partitions of S = 1 , 2 , 3 , 4 , 5 , 6 . Thus we have the following decomposition
S = 1 , 2 3 , 4 5 , 6
of S into a union of Interval Components
I 1 = 1 , 2 ,   I 2 = 3 , 4 ,   I 3 = 5 , 6
with respect to the Partition α 0 = 1 , 2 , 3 .
We select the top 15 arrangements in Ω α 0 as the “mother (root) nodes” in Ω α 1 to create “child nodes” (qualified arrangements with respect to the Partition  α 1 ) in Ω α 1 .
For a complete evaluation process for the total
729 = 3 6
possible arrangements of checkers, based on 1-D simulations, it takes 63 hours to finish this evaluation process. The top 3 arrangements are shown in Table 4.
For the optimization process by our simple tree search method, it takes only 6 hours to evaluate
42 = 3 3 + 15
possible arrangements of checkers, based on 1-D simulations. The top 3 arrangements, found by this simple tree search method, are shown in Table 5.
Thus empirical evidence shows that our tree search method is helpful and efficient. An algorithm based on our simple tree search method, with the Mutation Expansion operator, is shown in Figure 9.

4. Discussion

In this article, we propose a tree search method for finding the optimal arrangements of heat-storage ceramic bricks (checkers) in a heat regenerator. Empirical evidence shows that this simple tree search method is efficient and helpful.
This tree search method is motivated by the Monte-Carlo Tree Search (MCTS) algorithm used in Artificial Intelligence, combined with “Deep Learning”, to create computer players for the incredibly complicated board game Go. The combination of “Deep Learning” with MCTS has proved to be very successful in creating powerful computer players for the incredibly complicated board game Go.
The principles and ideas for MCTS are partly adopted and developed in this research. However, there is key difference between these problems. The mathematics behind the incredibly complicated board game Go is still not properly understood by humans. But for the optimization problem of arrangements of heat-storage ceramic bricks (checkers) in a heat regenerator, we do understand that the performance of all the arrangements of checkers is governed by Physics Laws. This might explain why our simple stochastic tree search method seems to exhibit high efficiency.

5. Conclusions

In this article, we propose a tree search method for finding the optimal arrangements of heat-storage ceramic bricks (checkers) in a heat regenerator. Empirical evidence shows that this simple tree search method is efficient and helpful.

Author Contributions

Conceptualization, T.-J.C., Y.-J.H. and C.-S. W.; Investigation, T.-J.C. and S.-C. C.; Methodology, T.-J.C. and Y.-J.H.; Software, T.-J.C. and S.-C. C.; Validation, T.-J.C., S.-C. C.; Writing—original draft, T.-J.C. and Y.-J.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research was partly supported by the National Science and Technology Council of Taiwan Government, grant NSC 112-2115-M-006 -007 -.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. N. Metropolis, N.; Ulam, S. The Monte Carlo Method. Journal of the American Statistical Association. 1949, 44, 335–341. [Google Scholar] [CrossRef] [PubMed]
  2. Terrell, G. Mathematical Statistics: A Unified Introduction; Springer-Verlag, New-York, Inc., 1999.
  3. DeGroot, M; Schervish, M. Probability and Statistics; Pearson Education, Inc., 2012.
  4. Roe, B. Probability and Statistics in the Physical Sciences; Springer Nature, Switzerland AG, 2020.
  5. Ito, K.; McKean, H. P., Jr. Diffusion Processes and Their Sample Paths; Springer-Verlag, New York, 1965.
  6. Ito, K.; Watanabe, S. Transformation of Markov Processes by Multiplicative Functionals. J. Math. Kyoto Univ. 1965, 4, 1–75. [Google Scholar] [CrossRef]
  7. Black, F.; Scholes, M. The Pricing of Options and Corporate Liabilities. Journal of Political Economy. 1973, 81, 637–654. [Google Scholar] [CrossRef]
  8. Abramson, B. The Expected-Outcome Model of Two-Player Games; Technical Report, Department of Computer Science, Columbia University, 1987.
  9. Brügmann, B. Monte Carlo Go; Technical report, Department of Physics, Syracuse University, 1993.
  10. Coulom, R. Efficient Selectivity and Backup Operators in Monte Carlo Tree Search; International conference on computers and games,72-83, Springer, 2006.
  11. Kocsis,L.; Szepesvári, C. Bandit based Monte Carlo planning; Proceedings of the 17th European conference on machine learning, ECML’06, 282-293, Springer, Berlin, 2006.
  12. Chaslot, G.M.J.B.; Winands, M.H.M.; Uiterwijk, J.W.H.M.; van den Herik, H.J.; Bouzy, B. Progressive Strategies for Monte-Carlo Tree Search. New Mathematics and Natural Computation. 2008, 4, 343–359. [Google Scholar] [CrossRef]
  13. Cazenave, T.; Jouandeau, N. On the parallelization of UCT; Computer Games Workshop, Amsterdam, Netherlands, 93-101, 2007.
  14. Cazenave, T.; Jouandeau, N. A parallel Monte-Carlo Tree Search algorithm; International conference 19 on computers and games, Springer, 72-80, 2008.
  15. Gelly, S.; Wang, Y. Exploration Exploitation in Go: UCT for Monte-Carlo Go; Neural Information 19, Processing Systems Conference on Line Trading of Exploration and Exploitation Workshop, Canada, 2006.
  16. Gelly, S.; Silver, D. Monte-Carlo Tree Search and Rapid Action Value Estimation in Computer Go. Artificial Intelligence. 2011, 175, 1856–1875. [Google Scholar] [CrossRef]
  17. Gelly, S.; Kocsis, L.; Schoenauer, M.; Sebag, M.; Silver, D.; Szepesvári, C.; Teytaud, O. The Grand Challenge of Computer Go: Monte-Carlo Tree Search and Extensions. Communications of the ACM. 2012, 55, 106–113. [Google Scholar] [CrossRef]
  18. Silver, D.; Sutton, R. S.; Müller, M. Temporal-Difference Search in Computer Go. Machine Learning. 2012, 87, 183–219. [Google Scholar] [CrossRef]
  19. Van den Broeck, G.; Driessens, K.; Ramon, J. Monte-Carlo Tree Search in Poker Using Expected Reward Distributions; Asian Conference on Machine Learning, Springer, 367-381, 2009.
  20. Robles. D.; Rohlfshagen, P.; Lucas, S. M. Learning Non-Random Moves for Playing Othello: Improving Monte-Carlo Tree Search; 2011 IEEE Conference on Computational Intelligence and Games (CIG’11), IEEE, 305-312, 2011.
  21. Arneson, B.; Hayward, R. B.; Henderson, P. Monte-Carlo tree search in Hex. IEEE Transactions on Computational Intelligence and AI in Games. 2010, 2, 251–258. [Google Scholar] [CrossRef]
  22. Winands, M. H.; Bjornsson, Y.; Saito, J. T. Monte-Carlo Tree Search in Lines of Action. IEEE Transactions on Computational Intelligence and AI in Games. 2010, 2, 239–250. [Google Scholar] [CrossRef]
  23. Teytaud, F.; Teytaud, O. Creating an Upper-Confidence-Tree Program for Havannah; Advances in Computer Games, Springer, 65-74, 2010.
  24. Silver, D.; Huang, A.; Maddison, C. J.; Guez, A.; Sifre, L.; Van Den Driessche, G.; Schrittwieser, J.; Antonoglou, I.; Panneershelvam, V.; Lanctot, M.; Dieleman, S.; Grewe, D.; Nham, J.; Kalchbrenner, N.; Sutskever, I.; Lillicrap, T.; Leach, M.; Kavukcuoglu, K.; Graepel, T.; Hassabis, D. Mastering the Game of Go with Deep Neural Networks and Tree Search. Nature. 2016, 529, 484–489. [Google Scholar] [CrossRef]
  25. Science News Staff. From AI to protein folding: Our Breakthrough Runners-up; Science, 22 December 2016.
  26. Coulom, R. The Monte-Carlo Revolution in Go; Japanese-French Frontiers of Science Symposium, 2008. Available online: https://www.remi-coulom.fr/JFFoS/JFFoS.pdf.
  27. Silver, D.; Schrittwieser, J.; Simonyan, K.; Antonoglou, I.; Huang, A.; Guez, A.; Hubert, T.; Baker, L.; Lai, M.; Bolton, A.; Chen, Y.; Lillicrap, T.; Hui, F.; Sifre, L.; van den Driessche, G.; Thore, T.; Hassabis, D. Mastering the Game of Go without Human Knowledge. Nature. 2017, 550, 354–371. [Google Scholar] [CrossRef] [PubMed]
  28. Silver, D.; Hubert, T.; Schrittwieser, J.; Antonoglou, I. Lai, M.; Guez, A.; Lanctot, M.; Sifre, L.; Kumaran, D; Graepel, T.; Lillicrap, T.; Simonyan, K.; Hassabis, D. A General Reinforcement Learning Algorithm That Masters Chess, Shogi, and Go through Self-Play. Science. 2018, 362, 1140–1144. [Google Scholar] [CrossRef]
  29. Yang, B.; Wang, L.; Lu, H.; Yang, Y. Learning the Game of Go by Scalable Network without Prior Knowledge of Komi. IEEE Transactions on Games. 2020, 12, 187–198. [Google Scholar] [CrossRef]
  30. Gaina, R. D.; Perez-Liebana, D.; Lucas, S.M.; Sironi, C. F.; Winands, M. H. Self-Adaptive Rolling Horizon Evolutionary Algorithms for General Video Game Playing; 2020 IEEE Conference on Games, IEEE, 367–374, 2020.
  31. Gaina, R. D.; Devlin, S.; Lucas, S. M.; Perez, D. Rolling Horizon Evolutionary Algorithms for General Video Game Playing. IEEE Transactions on Games. 2021, 14, 232–242. [Google Scholar] [CrossRef]
  32. Segler, M. H.; Preuss, M.; Waller, M. P. Planning Chemical Syntheses with Deep Neural Networks and Symbolic AI. Nature. 2018, 555, 604–610. [Google Scholar] [CrossRef]
  33. Shi, F.; Soman, R. K.; Han, J.; Whyte, J. K. Addressing adjacency Constraints in Rectangular Floor Plans using Monte-Carlo Tree Search. Automation in Construction. 2020, 115, 103187. [Google Scholar] [CrossRef]
  34. Roucairol, M.; Georgiou, A.; Cazenave, T.; Prischi, F.; Pardo, O. E. DrugSynthMC: An Atom-Based Generation of Drug-like Molecules with Monte Carlo Search. Journal of Chemical Information and Modelling. 2024, 64, 7097–7107. [Google Scholar] [CrossRef]
  35. Misono, N.; Hirosawa, T.; Sato, Y.; Matsumoto, H. Two-Step Monte Carlo Tree Search for Optimal Design of High-Frequency Toroidal Inductors in Power Electronics Circuits. IEEE Transactions on Magnetics. 2025, 61, 8400105. [Google Scholar] [CrossRef]
  36. Świechowski, M.; Godlewski, K.; Sawicki, B.; Mańdziuk, J. Monte Carlo Tree Search: a Review of Recent Modifications and Applications. Artificial Intelligence Review. 2023, 56, 2497–2562. [Google Scholar] [CrossRef]
  37. Plaat, A. Deep Reinforcement Learning; Springer Nature Singapore Pte Ltd., 2022.
  38. Storn, R.; Price, K.V. Differential Evolution: A Practical Approach to Global Optimization; Springer: Berlin/Heidelberg, Germany, 2005. [Google Scholar]
  39. Wang, Y.; Cai, Z.; Hang, Q. Differential Evolution with Composite Trial Vector Generation Strategies and Control Parameters. IEEE Trans. Evol. Comput. 2011, 15, 55–66. [Google Scholar] [CrossRef]
  40. Arafa, M.; Sallam, E.A.; Fahmy, M.M. An Enhanced Differential Evolution Optimization Algorithm; Proceedings of the 2014 Fourth International Conference on Digital Information and Communication Technology and its Applications (DICTAP), Bangkok, Thailand, 6–8 May 2014.
  41. Chen, T.-J.; Hong, Y.-J.; Lin, C.-H.; Wang, J.-Y. Optimization on Linkage System for Vehicle Wipers by the Method of Differential Evolution. Applied Sciences. 2023, 13, 332. [Google Scholar] [CrossRef]
  42. Amelio, M.; Morrone, P. Numerical Evaluation of the Energetic Performances of Structured and Random Packed Beds in Regenerative Thermal Oxidizers. Applied Thermal Engineering. 2007, 27, 762–770. [Google Scholar] [CrossRef]
  43. Marín, P.; Díez, F.V.; Ordóñez, S. Reverse Flow Reactors as Sustainable Devices for Performing Exothermic Reactions: Applications and Engineering Aspects. Chemical Engineering and Processing: Process Intensification. 2019, 135, 175–189. [Google Scholar] [CrossRef]
  44. Giuntini, L.; Bertei, A.; Tortorelli, S.; Percivale, M.; Paoletti, E.; Nicolella, C.; Galletti, C. Coupled CFD and 1-D Dynamic Modeling for the Analysis of Industrial Regenerative Thermal Oxidizers. Chemical Engineering and Processing: Process Intensification. 2020, 157, 108117. [Google Scholar] [CrossRef]
  45. Zarrinehkafsh, M.T.; Sadrameli, S.M. Simulation of Fixed Bed Regenerative Heat Exchangers for Flue gas Heat Recovery. Applied Thermal Engineering. 2004, 24, 373–382. [Google Scholar] [CrossRef]
  46. Yu, J.; Zhang, M.; Fan, W.; Zhou, Y.; Zhao, G. Study on Performance of the Ball Packed-Bed Regenerator: Experiments and Simulation. Applied Thermal Engineering. 2002, 22, 641–651. [Google Scholar] [CrossRef]
  47. Karwa, R. Heat and Mass Transfer; Springer Nature Singapore Pte Ltd., 2020.
  48. Incropera, F. P.; DeWitt, D. P.; Bergman, T. L. Principles of Heat and Mass Transfer; John Wiley & Sons, 2017.
  49. Yu, Y.-L.; Chen, T.-J.; Chung, S.-C.; Tsai, C.-H.; Chen, C.-C.; Hong, Y.-J. A Study on the Numerical Simulation for the Heat Trans-fer Process of Regenerative Heat Chamber with Heat Storage Brick; International Stirling Engine Conference, Tainan,Taiwan, 2018.
  50. Chung, S.-C.; Chen, T.-J.; Yu, Y.-L.; Tsai, C.-H.; Chen, C.-C. A Study on the Mathematical Model for the Heat Transfer Process of Regenerative Heat Chamber With Heat Storage; the 12th Pacific Symposium on Flow Visualization and Image Processing PSVIP12, Taiwan, 2019.
  51. Syu, W.-J. Numerical Simulation Analysis of High Temperature Heat Exchange Module; Master Thesis, National Pingtung University of Science and Technology, 2017.
  52. Nield, D. A.; Bejan, A. Convection in Porous Media; Springer International Publishing AG, 2017.
Figure 1. A regenerative combustion system with two fixed-bed heat regenerators.
Figure 1. A regenerative combustion system with two fixed-bed heat regenerators.
Preprints 162767 g001
Figure 6. Phases of our tree search.
Figure 6. Phases of our tree search.
Preprints 162767 g006
Figure 7. Two-phase cycle of a fixed-bed heat regenerator.
Figure 7. Two-phase cycle of a fixed-bed heat regenerator.
Preprints 162767 g007
Figure 8. Comparison of 1-D simulations with 3-D CFD simulations on Ansys Fluent.
Figure 8. Comparison of 1-D simulations with 3-D CFD simulations on Ansys Fluent.
Preprints 162767 g008
Figure 9. Algorithm based on our simple tree search with the Mutation Expansion operator.
Figure 9. Algorithm based on our simple tree search with the Mutation Expansion operator.
Preprints 162767 g009
Table 1. Material parameters of checkers.
Table 1. Material parameters of checkers.
Cordierite Mullite
size ( m m ) 150×150×100 150×150×100
pore size ( m m ) 4.9 3.0
wall thickness ( m m ) 1.04 0.70
porosity 0.62 0.64
specific surface area ( 1 / m ) 501 853
density ( kg / m 3 ) 2200 2500
specific heat capacity ( J / kgK ) 1000 1200
thermal conductivity ( W / mK ) 2 2
Table 2. Material parameters of checkers.
Table 2. Material parameters of checkers.
Mullite A Mullite B Mullite C
size ( m m ) 100×100×100 150×150×100 150×150×100
pore size ( m m ) 17 4 6
wall thickness ( m m ) 0.8 1.5 2
porosity 0.182 0.524 0.524
specific surface area ( 1 / m ) 42.7 523.8 349.2
density ( kg / m 3 ) 2200 2200 2200
specific heat capacity ( J / kgK ) 836 836 836
thermal conductivity ( W / mK ) 1.8 1.8 1.8
Table 3. Operating parameters for Experiments 1 and 2.
Table 3. Operating parameters for Experiments 1 and 2.
Total horizontal length of stacking ( mm ) 200
Total vertical length of stacking ( mm ) 300
Natural gas flow ( N m 3 / hr ) 17.65
Air-fuel ratio ( mm ) 15.9
Inlet temperature of exhaust gas ( K ) 1050 (Experiment 1)
1150 (Experiment 2)
Inlet temperature of fresh air ( K ) 313
Time of Phase Switch ( sec ) 30
Table 4. Optimization by the usual complete search method.
Table 4. Optimization by the usual complete search method.
Rank Arrangements of checkers Inlet temperature of exhaust gas (℃) Outlet temperature of exhaust gas (℃) Waste Heat Recovery Ratio (%)
1 ( B , B , B , B , B , B ) 886.82 264.67 67.88
2 ( B , B , B , B , B , C ) 886.28 286.82 65.82
3 ( B , B , B , B , C , B ) 885.82 259.48 63.77
Table 5. Optimization by our simple tree search method.
Table 5. Optimization by our simple tree search method.
Rank Arrangements of checkers Inlet temperature of exhaust gas (℃) Outlet temperature of exhaust gas (℃) Waste Heat Recovery Ratio (%)
1 ( B , B , B , B , B , B ) 886.82 264.67 67.88
9 ( B , B , B , C , B , C ) 885.14 284.35 61.72
11 ( B , B , C , B , C , B ) 885.08 286.08 60.70
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.
Prerpints.org logo

Preprints.org is a free preprint server supported by MDPI in Basel, Switzerland.

Subscribe

Disclaimer

Terms of Use

Privacy Policy

Privacy Settings

© 2026 MDPI (Basel, Switzerland) unless otherwise stated