Pivot Clustering to Minimize Error in Forecasting Aggregated ARMA Demand

1. Introduction

Modern-day technologies not only permit firms to accurately track their point of sales data and lost sales (purchases not made by customers due to a lack of inventory) data but also gather more granular data. These data streams deluge firms with information which either can be aggregated for planning purposes or considered in its entirety or follow an in-between approach. In this paper we analyze a model in which a retailer is faced with exactly the same choices and provide guidelines for combining the data for the purpose of forecasting demand.

Consider a retailer who has access to its individual customer’s demand streams. Assume that each of these demand streams follow an ARMA model having possibly contemporaneously correlated shock sequences. The primary contribution of this research is to quantify to what extent such a retailer would benefit from forecasting each of the individual streams as opposed to the aggregate. In general, retailers forecast their aggregate demand stream since historically the retailer may only have accurate aggregate demand information and the forecasting of the individual customer demand streams is often thought of as being cumbersome and time consuming. We demonstrate that a retailer observing multiple demand streams generated by ARMA models can drastically reduce its mean squared forecasting error (MSFE) by forecasting the individual demand streams as opposed to just the aggregate demand stream as noted in [1].

Although the retailer’s MSFE is never lower when forecasting using aggregated demand compared to the individual demand streams1, there are cases when the individual streams do not reduce the MSFE. The primary situation where this occurs, as is discussed in the paper, is when various models generating the demand streams have identical ARMA parameter values. For the in-between case, our results demonstrate that the retailer’s MSFE under aggregate forecasting can be greatly reduced if the retailer forecasts various clusters of aggregated demand streams. We show by example that clustering continues to perform well in the event that ARMA models are estimated for non-ARMA data (see Figure 9).

In other words, retailers can make use of data mining and other clustering approaches in order to generate clusters of similar customers and their demand streams. We show that such clustering methods significantly enhance forecast accuracy. This is related to the study of telephone data in [2] where the authors concluded that subaggregated data can be effective for improving forecast accuracy compared to aggregate data. They also note that data is often aggregated to the level that forecasts are required. We describe here ways in which subaggregated clusters can be selected to minimize forecast error. Several examples are mentioned in [3] in the context of assigning demand allocation to different facilities.

Many researchers and practitioners focus on the need to determine clusters of similarly situated customers in order to create and provide customized and/or personalized products. This type of clustering is generally performed on specific characteristics that customers possess (see for example, [4] and the references within). On the other hand, our focus is on forecasting demand for a product by a firm’s customers, recognizing that these customers may have different preferences and hence differing demand. As we describe below, from the demand forecasting perspective, the information contained within the individual demand streams provides the optimal forecast (in terms of minimizing the MSFE and hence inventory related costs) for product demand. Nonetheless, there has been research on the use of clustering methods within a forecasting environment when customer demand data is high dimensional (see for example, [5]).

As opposed to generating clusters based upon customer preferences and customer demographics, we explain how clusters can be generated explicitly from the individual time series structure of the individual demand streams or customers. Even though, it is always optimal from a forecasting perspective to use the individual streams, clusters of similar customer streams may be very helpful to the firm for other reasons as described above. Future empirical work would be necessary to investigate to what extent and in what contexts, clusters generated based upon time series structure of the demand streams correlate to clusters based upon other customer preferences. In such a case where there exists such a relationship, firms could use clustering for simplifying their demand forecasting while identifying groups of customers to receive personalized products.

The purpose of this paper is to demonstrate that clustering based upon time series structure can be utilized within demand forecasting that is superior to forecasting aggregate demand and nearly as good as forecasting the individual demand streams. The structure of our paper is as follows. In the next section, we describe the demand framework and supply chain setting of our research problem, as well as the way that theoretical MSFE computations are determined for the various forecasts (using aggregated demand processes) included herein. In Section 3, we illustrate (through example) that there exists a particular set of subaggregated clusters which results in an MSFE that is close to the MSFE obtained from using disaggregated streams and much lower than the MSFE obtained from the fully aggregated sequence. In Section 4, we describe how to cluster demand streams generated by ARMA models using Pivot Clustering and how this compares to other clustering methods. In Section 5, we describe an objective function that can be minimized to obtain an optimal assignment of streams to clusters in terms of MSFE reduction. Finally, we obtain theoretical results on how demand streams produced by MA(1) models can be clustered in the most efficient way possible to reduce the resulting subaggregated MSFE in Section 6.

2. Model Framework

We consider a retailer with possibly many large customers. In general, retailers forecast their aggregate demand stream since the forecasting of the individual customer demand streams is often thought of as being cumbersome and time consuming. We demonstrate that a retailer observing multiple streams of demand generated by ARMA models can drastically reduce its MSFE by forecasting the individual demand streams or aggregated clusters of similar demand streams. We limit the focus of this paper on ARMA models that describe stationary demand in order to keep the exposition as clear as possible. If we were to consider ARIMA (or Seasonal ARIMA) models then differencing (or seasonal differencing) would need to be carried out on the data to apply the methodology discussed here. We further note that even simple ARMA(1,1) models appearing in Section 4 can have coefficients that produce seasonal patterns in demand realizations.

Hence, consider a retailer that observes multiple demand streams for a single product $\left\{X_{1,t}\right\},\left\{X_{2,t}\right\},\dots ,\left\{X_{N,t}\right\}$. Each demand stream $\left\{X_k\right\}$ is assumed to be generated by an ARMA model with respect to a sequence of shocks $\left\{{ϵ}_{k,t}\right\}$ given by

$${\mathsf{\Phi }}_k\left(B\right)X_{k,t}={\mathsf{\Theta }}_k\left(B\right){ϵ}_{k,t}$$

(1)

where ${\mathsf{\Phi }}_k\left(z\right)=1+{\mathsf{\Phi }}_{k,1}z+\dots +{\mathsf{\Phi }}_{k,p_k}{z}^{p_k}$ and ${\mathsf{\Theta }}_k\left(z\right)=1+{\mathsf{\Theta }}_{k,1}z+\dots +{\mathsf{\Theta }}_{k,q_k}{z}^{q_k}$, such that$\left\{X_{k,t}\right\}$ is invertible and causal with respect to $\left\{{ϵ}_{k,t}\right\}$ (see Brockwell and Davis, page 77 for a definition and discussion about causality and invertibility). We denote the variance of each shock sequence ${\sigma }_k^2=E\left[{ϵ}_k^2\right]$. Furthermore we note that the shock sequences are potentially contemporaneously correlated with ${\sigma }_{ij}=E\left[{ϵ}_{i,t}{ϵ}_{j,t}\right]$. In general, this set up guarantees that the shocks ${ϵ}_{k,t}$ are the retailer’s Wold shocks (see [6] pp 187-188 for a description of a Wold decomposition of a time series) and that the MSFE of one-step-ahead leadtime demand (when using the disaggregated (individual) streams) is the sum of the elements in the covariance matrix ${\mathsf{\Sigma }}_{ϵ}$ where ${\mathsf{\Sigma }}_{ij}={\sigma }_{ij}$ such that ${\sigma }_k^2={\sigma }_{kk}$ (see Equation (7).

The focus of this paper is evaluating the difference in one-step-ahead MSFEs at time t when the forecast of leadtime demand, given by ${\displaystyle \sum _{i=1}^{\ell +1}(X_{1,t+i}+X_{2,t+i}+\dots +X_{N,t+i})}$, is based on the different series described below where $C_{k,\tau }=X_{1,\tau }^{C_k}+\dots +X_{n_{C_k},\tau }^{C_k}$. Studying one-step-ahead MSFEs is mathematically simpler than those for general leadtimes since the former does not depend on model parameters.

Disaggregated (individual) sequences	${\left\{X_{1,\tau }\right\}}_{\tau =-\infty }^t,{\left\{X_{2,\tau }\right\}}_{\tau =-\infty }^t,\dots ,{\left\{X_{N,\tau }\right\}}_{\tau =-\infty }^t$
Subaggregated (clustered) sequences	${\left\{C_{1,\tau }\right\}}_{\tau =-\infty }^t,{\left\{C_{2,\tau }\right\}}_{\tau =-\infty }^t,\dots ,{\left\{C_{n,\tau }\right\}}_{\tau =-\infty }^t$
Aggregated (full) sequence	${\{D_{\tau }=X_{1,\tau }+X_{2,\tau }+\dots +X_{N,\tau }\}}_{\tau =-\infty }^t$

Our problem is related to the one posed by [7] where a two-stage supply chain was considered with the retailer observing two demand streams. The focus of that paper was in evaluating information sharing between the retailer and supplier in a situation where the retailer forecasts each demand stream separately. Here we show the benefit to the retailer2 in determining the separate forecasts, while considering the existence of (possibly) more than two demand streams. Kohn [1] was the first to identify conditions under which using the individual demand streams leads to a better forecast than using the aggregated sequence, however he did not determine the MSFE in the two cases. The same conditions can be used to show that if streams are subaggregated into clusters where optimal clusters are always used, then the MSFE of the forecast decreases as the number of clusters increases. Our aim is to determine the optimal cluster assignment based on a predetermined choice of the number of clusters. The number of clusters can be based on the level of detailed data available to a firm or based on the tradeoff from lowering MSFE and increasing the complexity of the model when increasing the amount of clusters used.

In this paper we extend the results of [7] by providing formulas for computing MSFEs under the possibility of more than two streams and a general leadtime in the situation where a player’s (retailer’s) forecast can only be based on their Wold shocks. We also describe how a retailer would forecast its demand by identifying clusters of similar demand streams and then forecasting each cluster after it is aggregated. We provide a pivot algorithm, which we call Pivot Clustering, for identifying a locally optimal assignment of streams into a fixed number of clusters. The algorithm will often find the best possible assignment. We also describe a fast clustering algorithm which results in a globally optimal assignment when demand streams are generated by independent MA(1) models. Our results show that after the algorithms are carried out, much of the benefit of forecasting individual streams can be obtained by forecasting the aggregated clusters.

2.1. Forecasting Using the Disaggregated (Individual) Sequences ${\left\{X_{1,\tau }\right\}}_{\tau =-\infty }^t,\dots ,{\left\{X_{n,\tau }\right\}}_{\tau =-\infty }^t$

In this section we are interested in forecasting ${\displaystyle \sum _{i=1}^{\ell +1}(X_{1,t+i}+X_{2,t+i}+\dots +X_{N,t+i})}$ when the forecast is based on the diaggregated individual sequences as discussed in the previous section. The forecasting contained here is a textbook multivariate time-series result along with the propagation described in [8] as seen in (5). Thus we consider processes $\left\{X_{k,t}\right\},\dots ,\left\{X_{N,t}\right\}$ such that $X_{k,t}$ generated by ARMA models given by

$${\mathsf{\Phi }}_k\left(B\right)X_{k,t}={\mathsf{\Theta }}_k\left(B\right){ϵ}_{k,t}$$

(2)

with ${\sigma }_{jk}=E\left[{ϵ}_{j,t}{ϵ}_{k,t}\right]$.

In this case the disaggregated MSFE given by

$${\displaystyle MSF{E}_{ind}=E\left[{\left(\sum _{k=1}^N\sum _{i=1}^{\ell +1}{X}_{k,t+i}-\sum _{k=1}^N\widehat{{\displaystyle \sum _{i=1}^{\ell +1}{X}_{k,t+i}}}\right)}^2\right]}$$

(3)

where $\widehat{{\displaystyle \sum _{i=1}^{\ell +1}{X}_{k,t+i}}}$ is the best linear forecast of leadtime demand at time t for stream $\left\{X_{k,t}\right\}$ based on (2). We note that

$${\displaystyle E\left[\left(\sum _{i=1}^{\ell +1}{X}_{j,t+i}-\widehat{{\displaystyle \sum _{i=1}^{\ell +1}{X}_{j,t+i}}}\right)\left(\sum _{i=1}^{\ell +1}{X}_{k,t+i}-\widehat{{\displaystyle \sum _{i=1}^{\ell +1}{X}_{k,t+i}}}\right)\right]={\sigma }_{jk}\sum _{i=0}^{\ell }{\omega }_{j,i}{\omega }_{k,i}}$$

(4)

such that

$${\omega }_{k,i}=\left\{\begin{array}{cc}0\hfill & i<0\hfill \\ {\psi }_{k,i}\hfill & i=0\hfill \\ {\omega }_{k,i-1}+{\psi }_{k,i}\hfill & 0<i<\ell +1\hfill \\ {\omega }_{k,i-1}+{\psi }_{k,i}-{\psi }_{k,i-\ell -1}\hfill & i\ge \ell +1.\hfill \end{array}\right.$$

(5)

with ${\psi }_{k,i}$ is the $i^{th}$ coefficient appearing in the MA(∞) representation of $\left\{X_{k,t}\right\}$ with respect to $\left\{{ϵ}_{k,t}\right\}$ (see [8] for details). That is $1+{\psi }_{k,1}z+{\psi }_{k,2}{z}^2+\dots ={\mathsf{\Psi }}_k\left(z\right)$ and

$$X_{k,t}={\mathsf{\Psi }}_k\left(B\right){ϵ}_{k,t}$$

(6)

such that ${\mathsf{\Psi }}_k\left(z\right)={\displaystyle \frac{{\mathsf{\Theta }}_k\left(z\right)}{{\mathsf{\Phi }}_k\left(z\right)}}$.

Thus the MSFE of the best linear forecast (BLF) of leadtime demand when using the individual sequences

$${\left\{X_{1,\tau }\right\}}_{\tau =-\infty }^t,{\left\{X_{2,\tau }\right\}}_{\tau =-\infty }^t,\dots ,{\left\{X_{N,\tau }\right\}}_{\tau =-\infty }^t$$

is given by

$${\displaystyle MSFEind=\sum _{k=1}^N\sum _{j=1}^N\sum _{i=0}^{\ell }{\sigma }_{kj}{\omega }_{j,i}{\omega }_{k,i}.}$$

(7)

We note that the one-step-ahead ($\ell =0$) disaggregated MSFE is given by ${\displaystyle \sum _{j=1}^N\sum _{k=1}^N{\sigma }_{jk}}$. Thus we can compare (7) with (26) below to determine the reduction in MSFE when using the individual sequences as opposed to the aggregated sequence.

2.2. ARMA Representation of a Summed Sequence ${\{S_{\tau }=X_{1,\tau }+\dots +X_{s,\tau }\}}_{\tau =-\infty }^t$

In this subsection we determine the ARMA representation of a series $\left\{S_t\right\}$ with respect to a series of Wold shocks, where $\left\{S_t\right\}$ is the sum of several ARMA-generated streams given by $\left\{S_t\right\}=\{X_{1,t}+X_{2,t}+\dots +X_{s,t}\}$. Furthermore we determine the variance of the Wold shocks appearing in this representation. This will allow us to determine the MSFE when forecasts are based on the fully aggregated series as well as when the forecasts are based on subaggregated clusters. In order to obtain the ARMA representation we first need to obtain the spectral density $f_S\left(\lambda \right)$ and the covariance generating function $G_S\left(z\right)$ of $\left\{S_t\right\}$.

Proposition 1.

Let $\left\{S_t\right\}=\{X_{1,t}+X_{2,t}+\dots +X_{s,t}\}$. The spectral density of $\left\{S_t\right\}$ is given by

$${\displaystyle f_S\left(\lambda \right)=\sum _{i=1}^s{f}_{X_i}\left(\lambda \right)+\sum _{i=1}^{s-1}\sum _{j=i+1}^s\left(f_{X_i{X}_j}\left(\lambda \right)+{\overline{f}}_{X_i{X}_j}\left(\lambda \right)\right)}$$

(8)

where the cross-spectrum $f_{X_i{X}_j}\left(\lambda \right)$ is defined ${\displaystyle f_{X_i,X_j}\left(\lambda \right)={\displaystyle \frac{1}{2\pi }}\sum _{r=-\infty }^{\infty }{e}^{-i\lambda r}{C}_{X_i{X}_j}\left(r\right)}$ with $C_{X_i{X}_j}\left(r\right)=E\left[X_{i,t+r}{X}_{j,t}\right]$ and ${\displaystyle {\overline{f}}_{X_i{X}_j}\left(\lambda \right)={\displaystyle \frac{1}{2\pi }}\sum _{r=-\infty }^{\infty }{e}^{i\lambda r}{C}_{X_i{X}_j}\left(r\right)}$.

Proof. We will prove this by induction. Note that when $\left\{S_t\right\}=\{X_{1,t}+X_{2,t}\}$, $f_S\left(\lambda \right)$ is given by

$$\begin{array}{ccc}\hfill f_S\left(\lambda \right)& =& {\displaystyle {\displaystyle \frac{1}{2\pi }}\sum _{r=-\infty }^{\infty }{e}^{-i\lambda r}E\left[(X_{1,t+r}+X_{2,t+r})(X_{1,t}+X_{2,t})\right]}\hfill \\ & =& {\displaystyle {\displaystyle \frac{1}{2\pi }}\sum _{r=-\infty }^{\infty }{e}^{-i\lambda r}E\left[X_{1,t+r}{X}_{1,t}\right]+{\displaystyle \frac{1}{2\pi }}\sum _{r=-\infty }^{\infty }{e}^{-i\lambda r}E\left[X_{2,t+r}{X}_{2,t}\right]}\hfill \end{array}$$

(9)

$$\begin{array}{ccc}& +& {\displaystyle {\displaystyle \frac{1}{2\pi }}\sum _{r=-\infty }^{\infty }{e}^{-i\lambda r}E\left[X_{1,t+r}{X}_{2,t}\right]+{\displaystyle \frac{1}{2\pi }}\sum _{r=-\infty }^{\infty }{e}^{-i\lambda r}E\left[X_{2,t+r}{X}_{1,t}\right].}\hfill \end{array}$$

(10)

Noting that ${\displaystyle \sum _{r=-\infty }^{\infty }{e}^{-i\lambda r}E\left[X_{2,t+r}{X}_{1,t}\right]=\sum _{r=-\infty }^{\infty }{e}^{i\lambda r}E\left[X_{2,t}{X}_{1,t+r}\right]={\overline{f}}_{X_1{X}_2}\left(\lambda \right)}$ we see that

$$f_S\left(\lambda \right)=f_{X_1}\left(\lambda \right)+f_{X_2}\left(\lambda \right)+f_{X_1{X}_2}\left(\lambda \right)+{\overline{f}}_{X_1{X}_2}\left(\lambda \right)$$

which matches representation (8).

Now suppose (8) holds for $\left\{S_{n,t}\right\}=\{X_{1,t}+\dots +X_{n,t}\}$ processes. Thus

$${\displaystyle f_{S_n}\left(\lambda \right)=\sum _{i=1}^n{f}_{X_i}\left(\lambda \right)+\sum _{i=1}^{n-1}\sum _{j=i+1}^n\left(f_{X_i{X}_j}\left(\lambda \right)+{\overline{f}}_{X_i{X}_j}\left(\lambda \right)\right)}$$

(11)

Consider $\left\{S_{n+1}\right\}=\{S_{n,t}+X_{n+1,t}\}$. Since $\left\{S_{n,t}\right\}$ follows and ARMA model, we observe that

$$f_{S_{n+1}}\left(\lambda \right)=f_{S_n}\left(\lambda \right)+f_{X_{n+1}}\left(\lambda \right)+f_{S_n,X_{n+1}}\left(\lambda \right)+{\overline{f}}_{S_n,X_{n+1}}\left(\lambda \right)$$

(12)

Note that starting with the definition of $f_{S_n,X_{n+1}}\left(\lambda \right)$,

$$\begin{array}{ccc}\hfill f_{S_n,X_{n+1}}\left(\lambda \right)& =& {\displaystyle {\displaystyle \frac{1}{2\pi }}\sum _{r=-\infty }^{\infty }{e}^{-i\lambda r}E\left[S_{n,t}{X}_{n+1,t+r}\right]}\hfill \end{array}$$

(13)

$$\begin{array}{ccc}& =& {\displaystyle {\displaystyle \frac{1}{2\pi }}\sum _{r=-\infty }^{\infty }{e}^{-i\lambda r}E[X_{1,t}{X}_{n+1,t+r}+\dots +X_{n,t}{X}_{n+1,t+r}]}\hfill \end{array}$$

(14)

$$\begin{array}{ccc}& =& {\displaystyle {\displaystyle \frac{1}{2\pi }}\sum _{r=-\infty }^{\infty }{e}^{-i\lambda r}E\left[X_{1,t}{X}_{n+1,t+r}\right]+\dots +{\displaystyle \frac{1}{2\pi }}\sum _{r=-\infty }^{\infty }{e}^{-i\lambda r}E\left[X_{n,t}{X}_{n+1,t+r}\right]}\hfill \end{array}$$

(15)

$$\begin{array}{ccc}& =& f_{X_1{X}_{n+1}}\left(\lambda \right)+\dots +f_{X_n{X}_{n+1}}\left(\lambda \right)\hfill \end{array}$$

(16)

Similarly,

$${\overline{f}}_{S_n,X_{n+1}}\left(\lambda \right)={\overline{f}}_{X_1{X}_{n+1}}\left(\lambda \right)+\dots +{\overline{f}}_{X_n{X}_{n+1}}\left(\lambda \right)$$

Thus from (12),

$$\begin{array}{ccc}\hfill f_{S_{n+1}}\left(\lambda \right)& =& f_{S_n}\left(\lambda \right)+f_{X_{n+1}}\left(\lambda \right)+f_{X_1{X}_{n+1}}\left(\lambda \right)+\dots \hfill \\ & +& f_{X_n{X}_{n+1}}\left(\lambda \right)+{\overline{f}}_{X_1{X}_{n+1}}\left(\lambda \right)+\dots +{\overline{f}}_{X_n{X}_{n+1}}\left(\lambda \right)\hfill \end{array}$$

(17)

or equivalently

$$\begin{array}{ccc}\hfill {\displaystyle f_{S_{n+1}}\left(\lambda \right)=\sum _{i=1}^n{f}_{X_i}\left(\lambda \right)}& +& {\displaystyle \sum _{i=1}^{n-1}\sum _{j=i+1}^n\left(f_{X_i{X}_j}\left(\lambda \right)+{\overline{f}}_{X_i{X}_j}\left(\lambda \right)\right)}\hfill \\ & +& f_{X_{n+1}}\left(\lambda \right)+f_{X_1{X}_{n+1}}\left(\lambda \right)+\dots \hfill \\ & +& f_{X_n{X}_{n+1}}\left(\lambda \right)+{\overline{f}}_{X_1{X}_{n+1}}\left(\lambda \right)+\dots +{\overline{f}}_{X_n{X}_{n+1}}\left(\lambda \right)\hfill \end{array}$$

which can be simply written as

$${\displaystyle f_{S_{n+1}}\left(\lambda \right)=\sum _{i=1}^{n+1}{f}_{X_i}+\sum _{i=1}^n\sum _{j=i+1}^{n+1}\left(f_{X_i{X}_j}\left(\lambda \right)+{\overline{f}}_{X_i{X}_j}\left(\lambda \right)\right)}$$

(18)

and the result is proved. □

Now consider the covariance generating function ${\displaystyle G_S\left(z\right)=\sum _{j=-\infty }^{\infty }E\left[S_t{S}_{t-j}\right]z^j}$ of $\left\{S_t\right\}$. Here we use the equivalence $G_S\left(e^{-i\lambda }\right)=2\pi f_S\left(\lambda \right)$ and note the following:

$$\begin{array}{ccc}\hfill f_{X_i}\left(\lambda \right)& =& \frac{{\sigma }_i^2}{2\pi }\frac{|{\mathsf{\Theta }}_i\left(e^{-i\lambda }\right){|}^2}{|{\mathsf{\Phi }}_i\left(e^{-i\lambda }\right){|}^2}\hfill \end{array}$$

(19)

$$\begin{array}{ccc}\hfill f_{X_i{X}_j}\left(\lambda \right)& =& \frac{{\sigma }_{ij}}{2\pi }\frac{{\mathsf{\Theta }}_i\left(e^{-i\lambda }\right)}{{\mathsf{\Phi }}_i\left(e^{-i\lambda }\right)}\frac{{\mathsf{\Theta }}_j\left(e^{i\lambda }\right)}{{\mathsf{\Phi }}_j\left(e^{i\lambda }\right)}\hfill \end{array}$$

(20)

$$\begin{array}{ccc}\hfill {\overline{f}}_{X_i{X}_j}\left(\lambda \right)& =& \frac{{\sigma }_{ij}}{2\pi }\frac{{\mathsf{\Theta }}_i\left(e^{i\lambda }\right)}{{\mathsf{\Phi }}_i\left(e^{i\lambda }\right)}\frac{{\mathsf{\Theta }}_j\left(e^{-i\lambda }\right)}{{\mathsf{\Phi }}_j\left(e^{-i\lambda }\right)}\hfill \end{array}$$

(21)

Thus from Proposition 1 we observe that

$${\displaystyle G_S\left(z\right)=\sum _{i=1}^s{\sigma }_i^2\frac{{\mathsf{\Theta }}_i\left(z\right){\mathsf{\Theta }}_i\left(z^{-1}\right)}{{\mathsf{\Phi }}_i\left(z\right){\mathsf{\Phi }}_i\left(z^{-1}\right)}+\sum _{i=1}^{s-1}\sum _{j=i+1}^s\left({\sigma }_{ij}\frac{{\mathsf{\Theta }}_i\left(z\right)}{{\mathsf{\Phi }}_i\left(z\right)}\frac{{\mathsf{\Theta }}_j\left(z^{-1}\right)}{{\mathsf{\Phi }}_j\left(z^{-1}\right)}+{\sigma }_{ij}\frac{{\mathsf{\Theta }}_i\left(z^{-1}\right)}{{\mathsf{\Phi }}_i\left(z^{-1}\right)}\frac{{\mathsf{\Theta }}_j\left(z\right)}{{\mathsf{\Phi }}_j\left(z\right)}\right)}$$

(22)

As described in Theorem 5 of [7], the covariance generating function $G_S\left(z\right)$ can be factorized as the ratio ${\displaystyle \frac{O\left(z\right)P\left(z\right)}{Q\left(z\right)}}$ where $O\left(z\right)$, $P\left(z\right)$ and $Q\left(z\right)$ are Laurent polynomials, with $O\left(z\right)$ having all its roots on the unit circle and $P\left(z\right)$ and $Q\left(z\right)$ having no roots on the unit circle. This result follows from the fact that each additive term in (77) is a ratio of Laurent Polynomials and the fact that for any Laurent polynomial $P\left(z\right)$, both $P\left(z\right)P\left(z^{-1}\right)$ and $P\left(z\right)+P\left(z^{-1}\right)$ will be Laurent polynomials. Furthermore if $P_1\left(z\right)$ and $P_2\left(z\right)$ are Laurent polynomials then $P_1\left(z\right)P_2\left(z\right)$ and $P_1\left(z\right)+P_2\left(z\right)$ will be Laurent polynomials as well.

We can now use the factorization provided in [9] and described in [7] to obtain the ARMA representation of $\left\{S_t\right\}$ with respect to the Wold shocks $\left\{{ϵ}_t\right\}$ (appearing in its Wold representation). It should be noted that Remark 1 is simply a restatement of Theorem 5 of [7] with the slight addition of determining the polynomials appearing in the ARMA representation of the aggregate sequence $\left\{S_t\right\}$.

Remark 1.

$\left\{S_t\right\}$ can be represented with respect to shocks $\left\{{ϵ}_t\right\}$ using the ARMA model

$$\mathsf{\Phi }\left(B\right)S_t=\mathsf{\Theta }\left(B\right){ϵ}_t$$

(23)

where ${\displaystyle \mathsf{\Theta }\left(z\right)=\prod _{i=1}^m(1-a_{i}z)}$ where $\left\{a_i\right\}$ are the roots of $O\left(z\right)P\left(z\right)$ on or inside the unit circle and ${\displaystyle \mathsf{\Phi }\left(z\right)=\prod _{i=1}^n(1-b_{i}z)}$ where $\left\{b_i\right\}$ are the roots of $Q\left(z\right)$ inside the unit circle. Furthermore

$${\sigma }_{ϵ}^2=E\left[{ϵ}_t^2\right]={\displaystyle \frac{p_m{\prod }_{j=1}^m(-1/a_j)}{q_n{\prod }_{j=1}^n(-1/b_j)}}$$

(24)

where $p_m$ is the coefficient of $z^m$ in $P\left(z\right)$ and $q_n$ is the coefficient of $z^n$ in $Q\left(z\right)$.

2.3. Forecasting Using the Fully Aggregated Sequence ${\left\{D_{\tau }\right\}}_{\tau =-\infty }^t$ For A General Leadtime

We note that Remark 1 can be used to obtain the ARMA representation of $\left\{D_t\right\}$ with respect to its Wold shocks $\left\{{ϵ}_t\right\}$ as well as ${\sigma }_{ϵ}^2=E\left[{ϵ}_t^2\right]$. We can therefore use Lemma 1 of [8] and its proof to determine the BLF of ${\displaystyle \left(\sum _{k=1}^{\ell +1}{D}_{t+k}\right)}$ and its MSFE when forecasting using the infinite past of $\left\{D_t\right\}$ up to time t, namely ${\left\{D_{\tau }\right\}}_{\tau =-\infty }^t$. That is, if we consider the MA(∞) representation of $\left\{D_t\right\}$ with respect to $\left\{{ϵ}_t\right\}$ given by

$$D_t=\mathsf{\Psi }\left(B\right){ϵ}_t$$

(25)

where $\mathsf{\Psi }\left(z\right)=1+{\mathsf{\Psi }}_{1}z+{\mathsf{\Psi }}_2{z}^2+\dots$, then the MSFE of the BLF when using ${\left\{D_{\tau }\right\}}_{\tau =-\infty }^t$ is

$${\displaystyle MSFEagg={\sigma }_{ϵ}^2\sum _{i=0}^{\ell }{\omega }_i^2}$$

(26)

where

$${\omega }_i=\left\{\begin{array}{cc}0\hfill & i<0\hfill \\ {\psi }_i\hfill & i=0\hfill \\ {\omega }_{i-1}+{\psi }_i\hfill & 0<i<\ell +1\hfill \\ {\omega }_{i-1}+{\psi }_i-{\psi }_{i-\ell -1}\hfill & i\ge \ell +1.\hfill \end{array}\right.$$

(27)

We note that $\mathsf{\Psi }\left(z\right)={\displaystyle \frac{\mathsf{\Theta }\left(z\right)}{\mathsf{\Phi }\left(z\right)}}$.

2.4. Forecasting Using Subaggregated Sequences

In this section we use the results in the previous section to create a forecast and compute its MSFE when some of the individual streams are subaggregated. That is, for $k\in 1\dots n$, let cluster $C_k$ consist of $n_{C_k}$ streams such that $\{C_{k,t}=X_{1,t}^{C_k}+\dots +X_{n_{C_k},t}^{C_k}\}$. We are interested in the forecast and MSFE based on ${\left\{C_{1,\tau }\right\}}_{\tau =-\infty }^t,\dots ,{\left\{C_{n,\tau }\right\}}_{\tau =-\infty }^t$.

Section 2.2 describes how we can obtain the ARMA representation and variance of the Wold shocks appearing in the Wold representation for each sequence $\left\{C_{k,t}\right\}$. This can then be used to create a forecast from each subaggregated sequence, the sum of which can be taken as the forecast for $D_{t+\ell +1}$. The one-step ahead MSFE of this forecast is the sum of the entries of the covariance matrix of the Wold shocks appearing in the Wold representation of $\{C_{1,t},\dots ,C_{n,t}\}$. Equation (7) describes how we can also use the covariance matrix of the shocks of $\{C_{1,t},\dots ,C_{n,t}\}$ to obtain the MSFE for multi-step ahead forecasts. The remainder of this section will focus on obtaining this covariance matrix.

Without loss of generality, consider two subaggregated series $\{C_{1,t}=X_{1,t}+\dots +X_{a,t}\}$ and $\{C_{2,t}=X_{a+1,t}+\dots +X_{b,t}\}$ with ARMA representations

$$\begin{array}{ccc}\hfill {\varphi }_1^{★}\left(B\right)C_{1,t}& =& {\theta }_1^{★}\left(B\right){ϵ}_{1,t}^{★}\hfill \end{array}$$

(28)

$$\begin{array}{ccc}\hfill {\varphi }_2^{★}\left(B\right)C_{2,t}& =& {\theta }_2^{★}\left(B\right){ϵ}_{2,t}^{★}\hfill \end{array}$$

(29)

where $\left\{{ϵ}_{1,t}^{★}\right\}$ and $\left\{{ϵ}_{2,t}^{★}\right\}$ are the shocks appearing in the Wold representation of $\left\{C_{1,t}\right\}$ and $\left\{C_{2,t}\right\}$ respectively. We note that the variances of $\left\{{ϵ}_{1,t}^{★}\right\}$ and $\left\{{ϵ}_{2,t}^{★}\right\}$ can be obtained using Remark 1. To obtain the covariance ${\sigma }_{12}^{★}=E\left[{ϵ}_{1,t}^{★}{ϵ}_{2,t}^{★}\right]$ consider the following.

We can rewrite the ARMA representations above as

$${ϵ}_{1,t}^{★}={\displaystyle \frac{{\varphi }_1^{★}\left(B\right)}{{\theta }_1^{★}\left(B\right)}}{C}_{1,t}$$

(30)

$${ϵ}_{2,t}^{★}={\displaystyle \frac{{\varphi }_2^{★}\left(B\right)}{{\theta }_2^{★}\left(B\right)}}{C}_{2,t}$$

(31)

The ARMA representations of $\left\{X_{1,t}\right\},\dots ,\left\{X_{b,t}\right\}$ can also be rewritten as

$$X_{1,t}={\displaystyle \frac{{\mathsf{\Theta }}_1\left(B\right)}{{\mathsf{\Phi }}_1\left(B\right)}}{ϵ}_{1,t}\dots X_{b,t}={\displaystyle \frac{{\mathsf{\Theta }}_b\left(B\right)}{{\mathsf{\Phi }}_b\left(B\right)}}{ϵ}_{b,t}$$

(32)

Based on the definition of $C_{1,t}=X_{1,t}+\dots +X_{a,t}$ and $C_{2,t}=X_{a+1,t}+\dots +X_{b,t}$ we observe that

$${ϵ}_{1,t}^{★}={\displaystyle \frac{{\varphi }_1^{★}\left(B\right)}{{\theta }_1^{★}\left(B\right)}}\left[{\displaystyle \frac{{\mathsf{\Theta }}_1\left(B\right)}{{\mathsf{\Phi }}_1\left(B\right)}}{ϵ}_{1,t}+\dots +{\displaystyle \frac{{\mathsf{\Theta }}_a\left(B\right)}{{\mathsf{\Phi }}_a\left(B\right)}}{ϵ}_{a,t}\right]$$

(33)

$${ϵ}_{2,t}^{★}={\displaystyle \frac{{\varphi }_2^{★}\left(B\right)}{{\theta }_2^{★}\left(B\right)}}\left[{\displaystyle \frac{{\mathsf{\Theta }}_{a+1}\left(B\right)}{{\mathsf{\Phi }}_{a+1}\left(B\right)}}{ϵ}_{a+1,t}+\dots +{\displaystyle \frac{{\mathsf{\Theta }}_b\left(B\right)}{{\mathsf{\Phi }}_b\left(B\right)}}{ϵ}_{b,t}\right]$$

(34)

To obtain $E\left[{ϵ}_{1,t}^{★}{ϵ}_{2,t}^{★}\right]$ we need to compute the expectation of the the product of the right-hand-sides of these two equations. Thus we need to consider the sum of terms such as

$$E\left[{\displaystyle \frac{{\varphi }_1^{★}\left(B\right)}{{\theta }_1^{★}\left(B\right)}}{\displaystyle \frac{{\mathsf{\Theta }}_i\left(B\right)}{{\mathsf{\Phi }}_i\left(B\right)}}{ϵ}_{i,t}{\displaystyle \frac{{\varphi }_2^{★}\left(B\right)}{{\theta }_2^{★}\left(B\right)}}{\displaystyle \frac{{\mathsf{\Theta }}_j\left(B\right)}{{\mathsf{\Phi }}_j\left(B\right)}}{ϵ}_{j,t}\right].$$

(35)

Note that we can write

$${\displaystyle {\displaystyle \frac{{\varphi }_1^{★}\left(B\right)}{{\theta }_1^{★}\left(B\right)}}{\displaystyle \frac{{\mathsf{\Theta }}_i\left(B\right)}{{\mathsf{\Phi }}_i\left(B\right)}}{ϵ}_{i,t}=\sum _{k=0}^{\infty }{\tilde{\psi }}_{i,k}{ϵ}_{i,t-k}}$$

(36)

and

$${\displaystyle {\displaystyle \frac{{\varphi }_2^{★}\left(B\right)}{{\theta }_2^{★}\left(B\right)}}{\displaystyle \frac{{\mathsf{\Theta }}_j\left(B\right)}{{\mathsf{\Phi }}_j\left(B\right)}}{ϵ}_{j,t}=\sum _{k=0}^{\infty }{\tilde{\psi }}_{j,k}{ϵ}_{j,t-k}}$$

(37)

where ${\tilde{\psi }}_{i,k}$ and ${\tilde{\psi }}_{j,k}$ can be obtained in the same way as the MA(∞) coefficients in (27). Hence the term in Equation (35) can be rewritten as

$${\displaystyle E\left[\sum _{k=0}^{\infty }{\tilde{\psi }}_{i,k}{ϵ}_{i,t-k}\sum _{k=0}^{\infty }{\tilde{\psi }}_{j,k}{ϵ}_{j,t-k}\right]}$$

(38)

Since the shock sequences are not correlated across time by assumption, this is equivalent to

$${\displaystyle E\left[\sum _{k=0}^{\infty }{\tilde{\psi }}_{i,k}{\tilde{\psi }}_{j,k}{ϵ}_{i,t-k}{ϵ}_{j,t-k}\right]}$$

(39)

or equivalently

$${\displaystyle \sum _{k=0}^{\infty }{\tilde{\psi }}_{i,k}{\tilde{\psi }}_{j,k}{\sigma }_{ij}}$$

(40)

Adding up these terms as required would yield the covariance. Hence

$${\displaystyle {\sigma }_{12}^{★}=E\left[{ϵ}_{1,t}^{★}{ϵ}_{2,t}^{★}\right]=\sum _{i=1}^a\sum _{j=a+1}^b\sum _{k=0}^{\infty }{\tilde{\psi }}_{i,k}{\tilde{\psi }}_{j,k}{\sigma }_{ij}}$$

(41)

We note that this methodology can easily be extended to obtain any of the covariances in the covariance matrix

$${\mathsf{\Sigma }}_{ϵ}^{★}=\left(\begin{array}{ccc}{\sigma }_{11}^{★}& \dots & {\sigma }_{1n}^{★}\\ {\sigma }_{21}^{★}& \ddots & {\sigma }_{2n}^{★}\\ ⋮& & ⋮\\ {\sigma }_{n1}^{★}& \dots & {\sigma }_{nn}^{★}\end{array}\right)$$

(42)

We will use the previous methodology for all theoretical MSFE computations found in this paper. In the next subsection, we provide an example describing the importance of forecasting leadtime demand based upon the individual sequences.

2.5. Example

Consider a retailer that observes Aggregate demand $\{D_t=X_{1,t}+X_{2,t}+X_{3,t}\}$ where each individual demand stream is generated by one of the following ARMA models:

$$\begin{array}{ccc}\hfill X_{1,t}& =& (1-.9B){ϵ}_{1,t}\hfill \end{array}$$

(43)

$$\begin{array}{ccc}\hfill X_{2,t}& =& (1+.9B){ϵ}_{2,t}\hfill \end{array}$$

(44)

$$\begin{array}{ccc}\hfill X_{3,t}& =& (1+.9B){ϵ}_{3,t}\hfill \end{array}$$

(45)

where the shock covariance matrix is given by $\mathsf{\Sigma }=\left(\begin{array}{ccc}1.6& -1.4& 0.5\\ -1.4& 1.3& -0.8\\ 0.5& -.8& 2.0\end{array}\right)$

We use the results described in Section 2.1 and Section 2.2 to compare the MSFE of the forecasts of leadtime demand ${\displaystyle \sum _{j=1}^{\ell +1}{D}_{t+j}}$ when using the individual sequences ${\left\{X_{1,t}\right\}}_{\tau =-\infty }^t,{\left\{X_{2,t}\right\}}_{\tau =-\infty }^t,{\left\{X_{3,t}\right\}}_{\tau =-\infty }^t$ versus when using the aggregate sequence ${\left\{D_{\tau }\right\}}_{\tau =-\infty }^t$.

The covariance generating function of $\left\{D_t\right\}$ is given by

$$G_S\left(z\right)={\displaystyle \frac{0.090z^{-1}+5.631+0.090z}{1}}$$

(46)

and the ARMA representation of $\left\{D_t\right\}$ is given by

$$D_t=(1+.01598704B){ϵ}_t$$

(47)

where ${\sigma }_{ϵ}^2=5.629561$. We can check that the ARMA representation of $\left\{D_t\right\}$ and its covariance generating function match up by noting that

$$G_S\left(z\right)={\sigma }_{ϵ}^2{\displaystyle \frac{\mathsf{\Theta }\left(z\right)\mathsf{\Theta }\left(z^{-1}\right)}{\mathsf{\Phi }\left(z\right)\mathsf{\Phi }\left(z^{-1}\right)}}=5.629561(1+.01598704z)(1+.01598704z^{-1})=0.090z^{-1}+5.631+0.090z$$

(48)

with $\mathsf{\Theta }\left(z\right)=(1+.01598704z)$ and $\mathsf{\Phi }\left(z\right)=1$ being the MA and AR polynomials appearing in the ARMA representation of $\left\{D_t\right\}$ as defined in Remark 1.

We note that the one-step ahead forecast then has a MSFE=5.629561 and a two-step ahead forecast (of $D_{t+1}+D_{t+2}$) has a MSFE=11.44056.

Using equation (7) and noting that ${\omega }_{k,0}={\psi }_{k,0}=1$ in equation (5) we can obtain the MSFE of the forecast based on the individual demand streams. In this case the MSFE is 1.5, which is 4.129561 (73.3%) lower that the forecast error when using the aggregated series. We can likewise compute the elements ${\omega }_{k,i}$ when forecasting $D_{t+1}+D_{t+2}$. In this case, ${\omega }_{k,0}={\psi }_{k,0}=1$ and ${\omega }_{1,1}=.1$, ${\omega }_{2,1}=1.9$, and ${\omega }_{3,1}=1.9$. From (7) this implies that the MSFE=7.311, which is also 4.129561 (36.1%) lower3 than the forecast error when using the aggregated series. In the next section we demonstrate, with example, the benefit of forecasting using subaggregated clusters (which would have been identified using a suitable technique).

3. The Benefit of Forecasting Using Subaggregated Clusters

In this section, we consider a retailer that has ten demand streams, which aggregate into three clusters consisting of similar streams. The models generating these streams are specifically chosen to provide a clear separation between "good" clusters leading to low MSFE and "bad" clusters leading to high MSFE. Intuition gleaned from Section 6 and Section 7 hint that streams generated from ARMA models with similar coefficients should be clustered together. Hence for our example we consider three groups of models having similar sets of coefficients within each group. Later, in Section 4, we will randomly assign coefficients to streams and still observe a sharp drop in MSFE when streams are clustered to minimize MSFE.

Suppose the retailer observes Aggregate demand $\{D_t=X_{1,t}+X_{2,t}+\dots +X_{10,t}\}$ where each individual demand stream is generated by one of the following ARMA processes:

$$\begin{array}{ccc}\hfill (1-.3B-.6B^2)X_{1,t}& =& (1-.6B-.2B^2){ϵ}_{1,t}\hfill \end{array}$$

(49)

$$\begin{array}{ccc}\hfill (1-.35B-.5B^2)X_{2,t}& =& (1-.65B-.15B^2){ϵ}_{2,t}\hfill \end{array}$$

(50)

$$\begin{array}{ccc}\hfill (1-.27B-.55B^2)X_{3,t}& =& (1-.63B-.17B^2){ϵ}_{3,t}\hfill \end{array}$$

(51)

$$\begin{array}{ccc}\hfill (1-.8B)X_{4,t}& =& {ϵ}_{4,t}\hfill \end{array}$$

(52)

$$\begin{array}{ccc}\hfill (1-.9B)X_{5,t}& =& {ϵ}_{5,t}\hfill \end{array}$$

(53)

$$$$

(54)

$$\begin{array}{ccc}\hfill (1-.75B)X_{6,t}& =& {ϵ}_{6,t}\hfill \end{array}$$

(55)

$$\begin{array}{ccc}\hfill (1+.77B)X_{7,t}& =& (1+.6B){ϵ}_{7,t}\hfill \end{array}$$

(56)

$$\begin{array}{ccc}\hfill (1+.68B)X_{8,t}& =& (1+.55B){ϵ}_{8,t}\hfill \end{array}$$

(57)

$$\begin{array}{ccc}\hfill (1+.73B)X_{9,t}& =& (1+.52B){ϵ}_{9,t}\hfill \end{array}$$

(58)

$$\begin{array}{ccc}\hfill (1+.7B)X_{10,t}& =& (1+.5B){ϵ}_{10,t}\hfill \end{array}$$

(59)

where the shock covariance matrix is given by

$$\mathsf{\Sigma }=\left(\begin{array}{cccccccccc}2& 1& 0.8& -0.9& -1.2& -1.5& 0.8& 0.9& 0.95& 1\\ 1& 2.1& 0.7& -0.6& -0.5& -0.4& 0.21& 0.31& 0.36& 0.39\\ 0.8& 0.7& 2.2& -0.5& -1.3& -1& 0.4& 0.8& 1& 1.1\\ -0.9& -0.6& -0.5& 3& 1.8& 1.9& -2& -2.1& -2.2& -2.3\\ -1.2& -0.5& -1.3& 1.8& 3.2& 2& -1.9& -1.8& -1.7& -1.5\\ -1.5& -0.4& -1& 1.9& 2& 3.3& -2.2& -2.3& -2.4& -2.5\\ 0.8& 0.21& 0.4& -2& -1.9& -2.2& 5& 1& 1.25& 1.5\\ 0.9& 0.31& 0.8& -2.1& -1.8& -2.3& 1& 5.1& 1.3& 1.6\\ 0.95& 0.36& 1& -2.2& -1.7& -2.4& 1.25& 1.3& 5.7& 1.8\\ 1& 0.39& 1.1& -2.3& -1.5& -2.5& 1.5& 1.6& 1.8& 5.9\end{array}\right)$$

(60)

Consider the three natural clusters in the above ten demand streams, namely, streams 1-3, 4-6, and 7-10. It can be shown that indeed this grouping is optimal out of any other possible choice of three clusters simply by looking at all possible combinations and computing their MSFEs. Our analysis of the MA(1) case in Section 6 also points to these being the correct clusters based on the proximity of the ARMA coefficients of the models generating the demand streams. We demonstrate that even though the best the retailer can do in such a situation is forecast all ten streams individually, if the retailer would correctly cluster the demand streams as mentioned, the results are similar. All MSFEs stated in this section are obtained using the methods described in Section 2.

Specifically in this case if the retailer were to forecast the individual streams, its one-step ahead theoretical MSFE would be 21.64. If the retailer were to consider the subaggregated processes consisting of the correct clusters and forecast these separately then the MSFE would be 21.74. This is in stark contrast to a MSFE of 61.39 when forecasting using the aggregate process of all ten streams. In other words, it is sufficient to determine clusters of similar customers as opposed to forecasting each individual stream in order to keep inventory related costs down.

To see the impact of choosing the correct clusters we consider the case that the retailer incorrectly clusters the streams as 1-2, 3-5, and 6-10. In this case the MSFE rises to 33.4. Similarly, if the clusters chosen are $1\&4,2\&3\&5$, and 6-10 then the MSFE is 45.04. Assigning streams randomly to three clusters consisting of three, two and five streams yields the following table.

Table 1. The MSFEs for various clusters of three, two and five streams.

MSFE	Clusters
52.34495576	6,10,9 and 1,2 and 8,3,4,5,7
51.90912188	2,10,5 and 3,8 and 4,1,7,6,9
31.40789218	7,2,10 and 8,9 and 5,4,6,3,1
44.15962369	10,1,7 and 3,4 and 8,2,9,6,5
50.32525078	5,8,3 and 1,10 and 4,2,7,6,9
39.31100769	6,9,5 and 10,7 and 1,3,8,4,2
45.09358141	3,1,10 and 5,8 and 2,4,9,7,6
51.54828609	9,5,10 and 4,2 and 7,6,8,1,3
34.21154829	8,7,2 and 1,9 and 6,4,5,10,3
55.21445794	6,1,10 and 2,4 and 7,3,8,5,9

Table 1. The MSFEs for various clusters of three, two and five streams.

MSFE	Clusters
52.34495576	6,10,9 and 1,2 and 8,3,4,5,7
51.90912188	2,10,5 and 3,8 and 4,1,7,6,9
31.40789218	7,2,10 and 8,9 and 5,4,6,3,1
44.15962369	10,1,7 and 3,4 and 8,2,9,6,5
50.32525078	5,8,3 and 1,10 and 4,2,7,6,9
39.31100769	6,9,5 and 10,7 and 1,3,8,4,2
45.09358141	3,1,10 and 5,8 and 2,4,9,7,6
51.54828609	9,5,10 and 4,2 and 7,6,8,1,3
34.21154829	8,7,2 and 1,9 and 6,4,5,10,3
55.21445794	6,1,10 and 2,4 and 7,3,8,5,9

We note that there could be substantial reduction in MSFE even when multiple streams are clustered incorrectly. In the next section, we demonstrate how a retailer would be able to generate clusters of its individual demand streams using Pivot Clustering.

4. TS Clustering Algorithms and Pivot Clustering, Empirical Evaluation

We have shown that the when the retailer forecasts using clusters of its demand streams as opposed to the individual streams, its MSFE can vary greatly from close to the optimal value (when forecasting using the individual streams) to close to the MSFE of a forecast based on the aggregate of all the streams. Hence, if the retailer wishes to forecast using clusters of its demand streams, the selection of the clusters is important. In general, a retailer might have customer related information that could be used to generate the clusters. The benefit of generating the clusters and forecasting them is that there could be situations where it would be cumbersome for the retailer to collect the individual demand streams and service them individually. Forecasting clusters would therefore be a second best option.

We propose Pivot Clustering for determining clusters which usually results in a relatively low MSFE among all choices of streams to clusters. We consider two ways to obtain the subaggregated MSFE based on some clustering assignment. The first is to use the individual ARMA demand models appearing in (2) to compute the subaggregated theoretical MSFE as per Section 2.2, Section 2.3 and Section 2.4. We note that if there is only one cluster then the MSFE is the one computed for a forecast based on the aggregate of the all the streams while if the number of clusters is equal to the number of streams, the MSFE is for a forecast based on the disaggregated (individual) sequences. We also estimate the MSFE by generating demand realizations for each stream based on (2). Once a demand realizations are simulated for each stream, we subaggregate the realizations based on our choice of clusters. So if some cluster is made up of streams $\left\{X_{i,t}\right\}$ and $\left\{X_{j,t}\right\}$, we say that the cluster has realization $\{X_{i,t}+X_{j,t}\}$. We then estimate an ARMA(5,5)4 model using each cluster’s realization. Finally we use the estimated models to obtain in-sample forecast errors and compute the covariance matrix of these forecast errors to estimate the MSFE for a particular assignment of streams to clusters. In the analysis below we see that the estimated MSFEs are close to theoretical ones and often lead to similar choices of clusters. Based on a predetermined number of clusters n, Pivot Clustering works as follows.

For each stream, randomly assign it to a cluster.

  For each cluster,

    For each stream in the cluster,

      Compute or estimate the MSFE for the current assignment along

      with the resulting MSFEs if the stream was moved to each of the other clusters.

      # MSFE can be either estimated based on realizations of the demand streams or

      # computed using Equations (28), (29), (41) and (42).

    Move each stream in the cluster to a cluster which leads to largest overall MSFE-

    reduction among all choice of clusters.

In the remainder of this section we perform various simulations to assess the efficacy of Pivot clustering. We focus on ARMA(1,1) models as these do not require too much runtime for Pivot clustering based on theoretical MSFE and are complex enough to describe demand data such as in [10]. Additionally forecasting an aggregate of ARMA(1,1) demand sequences has been studied by [11] where forecasts were based on exponential smoothing. The methods herein are generally applicable however to higher-order ARMA models. From a computational standpoint, it is possible to determine theoretical MSFE based on the aggregate of up to twenty demand streams generated by ARMA(1,1) models. The burden lies in having to find roots of large degree polynomials in order to determine the ARMA model and shock variance that describes the aggregated sequence. To understand the computational requirements we check the runtimes of Pivot Clustering when determining theoretical and estimated MSFEs. Based on a given number of streams (between 10 and 20) we carry out Pivot Clustering for twenty different combinations of ARMA(1,1) models and plot the average of the runtimes in Figure 1 in assigning the streams to four clusters. If using estimated MSFE then many more streams can be clustered and Pivot Clustering has faster runtimes for larger amounts of streams. Upon checking, Pivot Clustering with estimated MSFEs for 200 streams takes approximately 20 minutes.

We can check the efficacy of Pivot Clustering through simulation. We begin by randomly assigning coefficients to twenty ARMA(1,1) models to produce twenty demand streams as well as the covariance matrix of the shock sequences. We make sure that each assignment results in causal and invertible demand with respect to the shocks and that the resulting covariance matrix is positive definite. The AR and MA coefficients and covariance matrix can be found in https://github.com/vkovtun84/Pivot-Clustering-of-Demand-Streams under Models.csv and covarmat.csv.

After randomly assigning streams to one of four clusters we compute both the estimated and theoretical one-step-ahead MSFEs based on this random assignment and use it to start Pivot Clustering. We output the clusters found by Pivot as well as the MSFE of the forecast based on this set of clusters. We iterate this procedure 50 times to study how much the MSFE improves based on Pivot Clustering for the starting allocations. The MSFEs of the final clusters and random clusters can be found under MSFEresults.csv in https://github.com/vkovtun84/Pivot-Clustering-of-Demand-Streams. These can also be compared with the MSFEs of the forecast based on the individual (disaggregated) demand streams and the forecast based on fully aggregating the streams.

For the twenty demand streams and models used, the theoretical and estimated MSFEs when forecasting based on individual (disaggregated) streams are 102.1 and 96.2. The theoretical and estimated MSFEs when forecasting based on the fully aggregated streams are 231.3 and 220.6. For the 50 simulations of assigning streams to random clusters (used in the initialization step of Pivot) the average of the theoretical and estimated MSFEs based on the subaggregated random clusters are 202.2 and 194.2. After Pivot Clustering is carried out to obtain a better set of subaggregated clusters in each of the 50 simulations, the averages of the theoretical and estimated MSFEs are 109.4 and 101.0. The various theoretical and estimated MSFEs for the different initializations are provided in Figure 2 and Figure 3. We note that regardless of the initial random assignment of streams to clusters, Pivot Clustering leads to the clustering of streams such that the subaggregated MSFE is very low. In fact, typically Pivot Clustering results in clusters for which the subaggregated MSFE ends up very close to the MSFE obtained when forecasts are based on the individual (disaggregated) streams.

We can compare our results with existing time-series clustering methods. Two distance measures that can be computed for time-series realizations are available in the TSclust package for R, namely AR.PIC and AR.LPC.CEPS. These distances can be used to perform hierarchical clustering such as average-linkage clustering. The final groups determined by these methods lead to MSFEs of 123.4 and 108.8 respectively, higher than those found by Pivot starting from random assignments. We note that the cluster assignments found by these methods can also be used in the initialization of Pivot Clustering, potentially leading to even better clusters.

Since the previous simulations were carried out on only one set of twenty ARMA(1,1) demand models, we should also check the efficacy of Pivot Clustering for other sets of models as well. As such, we consider twenty simulations where within each simulation a new set of twenty demand models is considered. We compare the estimated and theoretical MSFEs of one random assignment of streams to four clusters with the estimated and theoretical MSFEs of the four clusters obtained by Pivot Clustering. In each simulation we also compute the MSFEs that would be found when fully aggregating the streams or when considering forecasts based on individual streams as well as the MSFEs that would be found using the AR.PIC and AR.LPC.CEPS distances for hierarchical clustering streams into four clusters. The results of these simulations are displayed in Figure 4 and Figure 5. We note that if forecasts are to be based on four clusters, the lowest MSFEs are obtained when clusters are formed using Pivot Clustering. Furthermore, Pivot Clustering leads to forecasts whose MSFE is very close to the MSFE of the forecast based on the individual streams in every simulation.

We continue with twenty simulations where in each simulation we consider a separate set of 20 streams being subaggregated into four clusters with 10 random initializations of Pivot Clustering. The means of the various theoretical and estimated MSFEs under different clustering approaches are displayed in Figure 6 and Figure 7. We note again that in every set of twenty streams, the averaged subaggregated MSFEs are very close to the disaggregated MSFEs when averaged for different initial random assignments of streams to clusters.

We continue by assessing how well Pivot clustering does when compared against an exhaustive algorithm which checks all possible assignments of streams to clusters using theoretical MSFE calculations. To do so, we consider twenty simulations where within each simulation we randomly generate 10 ARMA(1,1) streams5 and compute the lowest MSFE possible among all choices of streams to 3 clusters. Furthermore we consider 10 random initializations of Pivot each time new streams are considered. The results are displayed in Figure 8. We note in the first row of that table that for the first simulation of twenty streams 8 out of 10 initializations of our algorithm led Pivot clustering to find the optimal solution. Among the 2 initializations that did not lead to the optimal solution, the ratio of optimal MSFE to the MSFE of the grouping found by pivot is 96.81%. The median was 96.81% while the minimum ratio was 96.24%. In some instances Pivot clustering never found an optimal solution (such as in the 6th simulation), however the average MSFE of the optimal solution was around 99.6% of the MSFE of the groupings found by Pivot. In the worst performance of Pivot (simulation 15), the best possible grouping led to an MSFE that was 80.27464% lower than the MSFE found by Pivot.

Finally, we consider the robustness of the Pivot algorithm to cases where the data generation process is not ARMA. To do so we perform ten simulations where in each simulation we simulate twenty demand stream realizations such that stream $X_k$ follows an ARFIMA($0,d_k,0$) model given by

$${(1-B)}^{d_k}{X}_{k,t}={ϵ}_{k,t}$$

(61)

where $-.4<d_k<.4$ and $Cov({ϵ}_{k,t},{ϵ}_{j,t})$ may be nonzero. Each realization, consisting of 1500 time periods is used to fit an ARMA(5,5) model to compute an estimated one-step-ahead MSFE for the disaggregated series (appearing as a blue dot in Figure 9). Summing the realizations together to fit an ARMA(5,5) model yields an estimated MSFE for the aggregated series (appearing as a black dot in Figure 9). Finally the Pivot algorithm is carried out using five different random initializations of assigning streams to one of four clusters. The MSFEs for the subaggregated random clusters and Pivot clusters appear as red and green dots in Figure 9. We note that in the subaggregated case the number of ARMA models that needs to be estimated is equal to the number of clusters.

As before, we note that Pivot clustering provides a sharp reduction in MSFE compared to random cluster assignments as well as compared to the aggregated case. We also observe that when fitting ARMA models to non-ARMA data it is possible for Pivot clustering to yield clusters which lead to a subaggregated MSFE that is lower than the MSFE using the individual (disaggregated) series. The exact cause of this is unclear, however it is possible it has to do with the extra number of misspecified ARMA models that are fit in the disaggregated case.

Figure 9. Estimated MSFEs when using aggregated, disaggregated, and subaggregated series to forecast one-step-ahead demand for series that are not generated using an ARMA process. A total of 10 simulations is performed where within each simulation twenty separate demand realizations are generated according to the ARFIMA($0,d,0$) model with a different d for each realization such that the shocks appearing in the ARFIMA model are contemporaneously correlated. Pivot clustering is carried out for 5 random initialization of assigning the streams to one of four clusters. We compute the estimated MSFEs for the disaggregated series (blue), aggregated series (black), subaggregated clusters generated using random assignment (red) and subaggregated clusters generated using the result of Pivot clustering. We note the supremacy of Pivot clustering in all ten simulations.

Figure 9. Estimated MSFEs when using aggregated, disaggregated, and subaggregated series to forecast one-step-ahead demand for series that are not generated using an ARMA process. A total of 10 simulations is performed where within each simulation twenty separate demand realizations are generated according to the ARFIMA($0,d,0$) model with a different d for each realization such that the shocks appearing in the ARFIMA model are contemporaneously correlated. Pivot clustering is carried out for 5 random initialization of assigning the streams to one of four clusters. We compute the estimated MSFEs for the disaggregated series (blue), aggregated series (black), subaggregated clusters generated using random assignment (red) and subaggregated clusters generated using the result of Pivot clustering. We note the supremacy of Pivot clustering in all ten simulations.

5. Clustering Demand Streams Through Minimizing An Objective Function Based on Subaggregated MSFE

In this section we describe how to determine the optimal assignment of streams to clusters by identifying and minimizing an objective function which computes the overall MSFE given a particular assignment of streams to clusters. We begin by assuming that the desired number of clusters is known to be n. For $\alpha \in 1,2,\dots n$, let subaggregated cluster series $\left\{C_{\alpha ,t}\right\}=\{X_{1,t}{y}_{1,\alpha }+\dots +X_{N,t}{y}_{N,\alpha }\}$, where $y_{i,\alpha }=1$ if stream $\left\{X_{i,t}\right\}$ is in cluster $\left\{C_{\alpha ,t}\right\}$ and 0 otherwise, have the ARMA representation

$${\varphi }_{\alpha }^{★}\left(B\right)C_{\alpha ,t}={\theta }_{\alpha }^{★}\left(B\right){ϵ}_{\alpha ,t}^{★}.$$

(62)

For $\alpha \in 1,2,\dots n$, the shocks ${ϵ}_{\alpha ,t}^{★}$ have covariance matrix ${\mathsf{\Sigma }}_{ϵ}^{★}$ given in equation (42). We define the number of demand streams in cluster $\left\{C_{\alpha ,t}\right\}$ to be ${\displaystyle n_{C_{\alpha }}=\sum _{i=0}^N{y}_{i,\alpha }>0}$ for all $\alpha \in 1,2,\dots n$. Furthermore if $y_{i,\alpha }=1$ then $y_{i,\beta }=0$ for all $\alpha \ne \beta \in 1,2,\dots n$. For each of $n_{C_{\alpha }}$ streams $\left\{X_{i,t}^{C_{\alpha }}\right\}$ in cluster $\left\{C_{\alpha ,t}\right\}$ we adapt the notation of its ARMA representation to be

$${\mathsf{\Phi }}_{i,\alpha }\left(B\right)X_{i,t}^{C_{\alpha }}={\mathsf{\Theta }}_{i,\alpha }\left(B\right){ϵ}_{\alpha ,i,t}.$$

(63)

Lemma 1.

An optimal set of clusters can be found by minimizing the subaggregated MSFE given by

$${\displaystyle MSFEsubagg=\sum _{\alpha =1}^n\sum _{\beta =1}^n\sum _{l=0}^{\ell }{\omega }_{\beta ,l}^{★}{\omega }_{\alpha ,l}^{★}·\sum _{i=1}^{n_{C_{\alpha }}}\sum _{j=1}^{n_{C_{\beta }}}\sum _{k=0}^{\infty }{\tilde{\psi }}_{\alpha ,i,k}{\tilde{\psi }}_{\beta ,j,k}{\sigma }_{ij}}$$

(64)

where ${\tilde{\psi }}_{\alpha ,i,k}$ and ${\tilde{\psi }}_{\beta ,j,k}$ are obtained from the equivalence

$${\displaystyle {\displaystyle \frac{{\varphi }_{\alpha }^{★}\left(z\right)}{{\theta }_{\alpha }^{★}\left(z\right)}}{\displaystyle \frac{{\mathsf{\Theta }}_{i,\alpha }\left(z\right)}{{\mathsf{\Phi }}_{i,\alpha }\left(z\right)}}\equiv \sum _{k=0}^{\infty }{\tilde{\psi }}_{\alpha ,i,k}{z}^k}$$

(65)

and

$${\displaystyle {\displaystyle \frac{{\varphi }_{\beta }^{★}\left(z\right)}{{\theta }_{\beta }^{★}\left(z\right)}}{\displaystyle \frac{{\mathsf{\Theta }}_{j,\beta }\left(z\right)}{{\mathsf{\Phi }}_{j,\beta }\left(z\right)}}\equiv \sum _{k=0}^{\infty }{\tilde{\psi }}_{\beta ,j,k}{z}^k.}$$

(66)

where the key terms are defined in the proof below.

Alternatively, the objective can be stated as finding the optimal set of $\{y_1,\dots ,y_N\}$ such that we minimize

$${\displaystyle MSFEsubagg=\sum _{\alpha =1}^n\sum _{\beta =1}^n\sum _{l=0}^{\ell }{\omega }_{\beta ,l}^{★}{\omega }_{\alpha ,l}^{★}·\sum _{i=1}^N\sum _{j=1}^N\sum _{k=0}^{\infty }{y}_{i,\alpha }{y}_{j,\beta }{\tilde{\psi }}_{\alpha ,i,k}{\tilde{\psi }}_{\beta ,j,k}{\sigma }_{ij}}$$

(67)

where ${\omega }_{\alpha ,l}^{★}$ and ${\psi }_{\alpha ,l}^{★}$ in equation (70) are obtained through the equivalence

$${\displaystyle {\displaystyle \frac{{\theta }_{\alpha }^{★}\left(z\right)}{{\varphi }_{\alpha }^{★}\left(z\right)}}=\sum _{l=0}^{\infty }{\psi }_{\alpha ,l}^{★}{z}^l}$$

(68)

where again the key terms are defined in subsequent proof.

Proof

From equation (7) we note that a forecast based on the clusters would have MSFE given by

$${\displaystyle MSFEsubagg=\sum _{\alpha =1}^n\sum _{\beta =1}^n\sum _{l=0}^{\ell }{\sigma }_{\alpha \beta }^{★}{\omega }_{\beta ,l}^{★}{\omega }_{\alpha ,l}^{★}}$$

(69)

where

$${\omega }_{\alpha ,l}^{★}=\left\{\begin{array}{cc}0\hfill & i<0\hfill \\ {\psi }_{\alpha ,l}^{★}\hfill & l=0\hfill \\ {\omega }_{\alpha ,l-1}^{★}+{\psi }_{\alpha ,l}^{★}\hfill & 0<l<\ell +1\hfill \\ {\omega }_{\alpha ,l-1}+{\psi }_{\alpha ,l}^{★}-{\psi }_{\alpha ,l-\ell -1}^{★}\hfill & l\ge \ell +1.\hfill \end{array}\right.$$

(70)

where ${\psi }_{\alpha ,l}^{★}$ is the $l^{th}$ coefficient appearing in the MA(∞) representation of $\left\{C_{\alpha ,t}\right\}$ with respect to $\left\{{ϵ}_{\alpha ,t}^{★}\right\}$. From equation (41) we note that for any two subaggregated clusters $\left\{C_{\alpha ,t}\right\}$ and $\left\{C_{\beta ,t}\right\}$ consisting of $n_{C_{\alpha }}$ and $n_{C_{\beta }}$ streams respectively, the corresponding shock series $\left\{{ϵ}_{\alpha ,t}^{★}\right\}$ and $\left\{{ϵ}_{\beta ,t}^{★}\right\}$, the covariance $E\left[{ϵ}_{\alpha ,t}^{★}{ϵ}_{\beta ,t}^{★}\right]$ is expressed by

$${\displaystyle {\sigma }_{\alpha \beta }^{★}=\sum _{i=1}^{n_{C_{\alpha }}}\sum _{j=1}^{n_{C_{\beta }}}\sum _{k=0}^{\infty }{\tilde{\psi }}_{\alpha ,i,k}{\tilde{\psi }}_{\beta ,j,k}{\sigma }_{ij}.}$$

(71)

Therefore the objective is to assign streams to clusters such that we minimize the MSFE

$${\displaystyle MSFEsubagg=\sum _{\alpha =1}^n\sum _{\beta =1}^n\sum _{l=0}^{\ell }{\omega }_{\beta ,l}^{★}{\omega }_{\alpha ,l}^{★}·\sum _{i=1}^{n_{C_{\alpha }}}\sum _{j=1}^{n_{C_{\beta }}}\sum _{k=0}^{\infty }{\tilde{\psi }}_{\alpha ,i,k}{\tilde{\psi }}_{\beta ,j,k}{\sigma }_{ij}}$$

(72)

where ${\tilde{\psi }}_{\alpha ,i,k}$ and ${\tilde{\psi }}_{\beta ,j,k}$ are obtained from the equivalence

$${\displaystyle {\displaystyle \frac{{\varphi }_{\alpha }^{★}\left(z\right)}{{\theta }_{\alpha }^{★}\left(z\right)}}{\displaystyle \frac{{\mathsf{\Theta }}_{i,\alpha }\left(z\right)}{{\mathsf{\Phi }}_{i,\alpha }\left(z\right)}}\equiv \sum _{k=0}^{\infty }{\tilde{\psi }}_{\alpha ,i,k}{z}^k}$$

(73)

and

$${\displaystyle {\displaystyle \frac{{\varphi }_{\beta }^{★}\left(z\right)}{{\theta }_{\beta }^{★}\left(z\right)}}{\displaystyle \frac{{\mathsf{\Theta }}_{j,\beta }\left(z\right)}{{\mathsf{\Phi }}_{j,\beta }\left(z\right)}}\equiv \sum _{k=0}^{\infty }{\tilde{\psi }}_{\beta ,j,k}{z}^k.}$$

(74)

Alternatively, we can say that we are finding the optimal set of $\{y_1,\dots ,y_N\}$ such that we minimize

$${\displaystyle MSFEsubagg=\sum _{\alpha =1}^n\sum _{\beta =1}^n\sum _{l=0}^{\ell }{\omega }_{\beta ,l}^{★}{\omega }_{\alpha ,l}^{★}·\sum _{i=1}^N\sum _{j=1}^N\sum _{k=0}^{\infty }{y}_{i,\alpha }{y}_{j,\beta }{\tilde{\psi }}_{\alpha ,i,k}{\tilde{\psi }}_{\beta ,j,k}{\sigma }_{ij}}$$

(75)

where ${\omega }_{\alpha ,l}^{★}$ and ${\psi }_{\alpha ,l}^{★}$ in equation (70) are obtained through the equivalence

$${\displaystyle {\displaystyle \frac{{\theta }_{\alpha }^{★}\left(z\right)}{{\varphi }_{\alpha }^{★}\left(z\right)}}=\sum _{l=0}^{\infty }{\psi }_{\alpha ,l}^{★}{z}^l}$$

(76)

with ${\theta }_{\alpha }^{★}\left(z\right)$ and ${\varphi }_{\alpha }^{★}\left(z\right)$ found using Remark 1 where Laurent polynomials $O\left(z\right),P\left(z\right)$ and $Q\left(z\right)$ are obtained from the covariance generating function $G_{C_{\alpha }}\left(z\right)$ given by

$$\begin{array}{ccc}\hfill G_{C_{\alpha }}\left(z\right)& =& {\displaystyle \sum _{i=1}^N{y}_{i,\alpha }{\sigma }_i^2\frac{{\mathsf{\Theta }}_i\left(z\right){\mathsf{\Theta }}_i\left(z^{-1}\right)}{{\mathsf{\Phi }}_i\left(z\right){\mathsf{\Phi }}_i\left(z^{-1}\right)}}\hfill \\ & +& {\displaystyle \sum _{i=1}^{N-1}\sum _{j=i+1}^N{y}_{i,\alpha }{y}_{j,\alpha }\left({\sigma }_{ij}\frac{{\mathsf{\Theta }}_i\left(z\right)}{{\mathsf{\Phi }}_i\left(z\right)}\frac{{\mathsf{\Theta }}_j\left(z^{-1}\right)}{{\mathsf{\Phi }}_j\left(z^{-1}\right)}+{\sigma }_{ij}\frac{{\mathsf{\Theta }}_i\left(z^{-1}\right)}{{\mathsf{\Phi }}_i\left(z^{-1}\right)}\frac{{\mathsf{\Theta }}_j\left(z\right)}{{\mathsf{\Phi }}_j\left(z\right)}\right).}\hfill \end{array}$$

(77)

□

We note that it is impossible to offer an explicit solution because of the dependence of coefficients ${\omega }_{\beta ,l}^{★},{\omega }_{\alpha ,l}^{★},{\tilde{\psi }}_{\alpha ,i,k}$ and ${\tilde{\psi }}_{\beta ,j,k}$ on the selection of clusters. In the next section we consider a much simpler case of demand streams being generated by MA(1) models which leads to a much simpler objective function. This allows us to find several theoretical results, culminating in the fact that optimal clusters can be found in this case by identifying streams having the closest MA coefficients with one another.

6. MA(1) Streams

In this section we consider the case that the demand streams being considered are independent MA(1). As we demonstrate below this leads to a simpler objective function. We will use this fact to show how we can use non-linear optimization to assign clusters to streams and to come up with an efficient way to cluster independent MA(1) streams based on segmenting the coefficient space into intervals. The focus on MA(1) streams here allows us to observe that streams with their MA coefficients close to each other should be clustered together. At the end of the section, we provide a lemma on aggregating streams produced by models having identical ARMA coefficients.

Lemma 2.

Suppose $\left\{X_{1,t}\right\},\left\{X_{2,t}\right\},\dots ,\left\{X_{N,t}\right\}$ are MA(1) with MA coefficients ${\theta }_1,{\theta }_2,\dots ,{\theta }_N$. Optimal clusters can be found by assigning $y_{jk}$ as an indicator variable for stream $X_j$ being in cluster $C_k$ such that we minimize

$${\displaystyle \sum _{k=1}^n\sqrt{(b_k+2a_k)(b_k-2a_k)}}$$

(78)

where

$$b_k=\sum _{j=1}^N{\sigma }_j^2(1+{\theta }_j^2)y_{jk}$$

(79)

and

$$a_k=\sum _{j=1}^N{\sigma }_j^2{\theta }_j{y}_{jk}.$$

(80)

Alternatively, the objective function (78) can be written as

$${\displaystyle \sum _{k=1}^n\sqrt{\sum _{j=1}^N\sum _{i=1}^N{\sigma }_j^2{\sigma }_i^2{(1+{\theta }_j)}^2{(1-{\theta }_i)}^2{y}_{jk}{y}_{ik}}.}$$

(81)

Proof uppose $\left\{X_{1,t}\right\},\left\{X_{2,t}\right\},\dots ,\left\{X_{N,t}\right\}$ are MA(1) with MA coefficients ${\theta }_1,{\theta }_2,\dots ,{\theta }_N$. Suppose cluster $C_{\alpha ,t}$ consists of streams $\left\{X_{1,t}\right\},\dots ,\left\{X_{\alpha ,t}\right\}$. The covariance generating function of $C_{\alpha ,t}$ simplifies to

$$G_{C_{\alpha }}\left(z\right)={\sigma }_1^2(1+{\theta }_{1}z)(1+{\theta }_1{z}^{-1})+\dots +{\sigma }_{\alpha }^2(1+{\theta }_{\alpha }z)(1+{\theta }_{\alpha }{z}^{-1}).$$

(82)

In order to determine the variance of the shocks of $C_{\alpha ,t}$ we need to find the roots of equation (82). Note that it can be rewritten as

$$\left({\sigma }_1^2{\theta }_1+\dots +{\sigma }_{\alpha }^2{\theta }_{\alpha }\right)z^{-1}+\left({\sigma }_1^2(1+{\theta }_1^2)+\dots +{\sigma }_{\alpha }^2(1+{\theta }_{\alpha }^2)\right)+\left({\sigma }_1^2{\theta }_1+\dots +{\sigma }_{\alpha }^2{\theta }_{\alpha }\right)z.$$

(83)

We can find the roots of equation (83) using the quadratic formula ${\displaystyle \frac{-b\pm \sqrt{b^2-4a^2}}{2a}}$ where

$$\begin{array}{ccc}\hfill a& =& {\displaystyle {\sigma }_1^2{\theta }_1+\dots +{\sigma }_{\alpha }^2{\theta }_{\alpha }=\sum _{j=1}^{\alpha }{\sigma }_j^2{\theta }_j}\hfill \end{array}$$

(84)

$$\begin{array}{ccc}\hfill b& =& {\displaystyle {\sigma }_1^2(1+{\theta }_1^2)+\dots +{\sigma }_{\alpha }^2(1+{\theta }_{\alpha }^2)=\sum _{j=1}^{\alpha }{\sigma }_j^2(1+{\theta }_j^2)}\hfill \end{array}$$

(85)

We note that one roots $r_1$ will be outside the unit circle and from Remark 1 that the variance of the shocks of $C_{\alpha ,t}$ is equal to $-a{r}_1$. Since $b>0$, the variance is then given by

$${\sigma }_{\alpha }^2={\displaystyle \frac{b+\sqrt{(b+2a)(b-2a)}}{2}}$$

(86)

Thus if we are subaggregating into n clusters, the MSFE is given by

$${\displaystyle MSF{E}_{subagg}=\frac{1}{2}\left(\sum _{k=1}^n{b}_k+\sum _{k=1}^n\sqrt{(b_k+2a_k)(b_k-2a_k)}\right)}$$

(87)

Since ${\displaystyle \sum _{k=1}^n{b}_k}$ will be the same regardless of choice of clusters, we are minimizing the objective function given by

$${\displaystyle \sum _{k=1}^n\sqrt{(b_k+2a_k)(b_k-2a_k)}}$$

(88)

where

$$b_k=\sum _{j=1}^N{\sigma }_j^2(1+{\theta }_j^2)y_{jk}$$

(89)

and

$$a_k=\sum _{j=1}^N{\sigma }_j^2{\theta }_j{y}_{jk}$$

(90)

where $y_{jk}$ is an indicator variable for stream $X_j$ being in cluster $C_k$.

Noting that

$$\begin{array}{ccc}\hfill (b_k+2a_k)& =& {\displaystyle \sum _{j=1}^N{\sigma }_j^2{(1+{\theta }_j)}^2{y}_{jk}}\hfill \end{array}$$

(91)

$$\begin{array}{ccc}\hfill (b_k-2a_k)& =& {\displaystyle \sum _{j=1}^N{\sigma }_j^2{(1-{\theta }_j)}^2{y}_{jk}}\hfill \end{array}$$

(92)

The objective function can also be rewritten as

$${\displaystyle \sum _{k=1}^n\sqrt{\sum _{j=1}^N\sum _{i=1}^N{\sigma }_j^2{\sigma }_i^2{(1+{\theta }_j)}^2{(1-{\theta }_i)}^2{y}_{jk}{y}_{ik}}.}$$

(93)

□

We have results (not shown here) where we use equation (93) in a non-linear optimization algorithm to come up with clusters. When using 10 streams with 3 clusters, the approach actually leads to a globally optimal solution almost every time.

We note that equation (93) can also be rewritten as

$${\displaystyle \sum _{k=1}^n\sqrt{\sum _{X_i,X_j\in C_k}{\sigma }_j^2{\sigma }_i^2{(1+{\theta }_j)}^2{(1-{\theta }_i)}^2}.}$$

(94)

where the inner sum is taken over all pairs of streams in each cluster, including pairs of streams with themselves.

If stream $X_p$ is moved from cluster k to cluster $\kappa$ then the change in the objective function is

$$\begin{array}{ccc}& & \sqrt{{\sigma }_p^2{(1+{\theta }_p)}^2\sum _{X_i\in C_{\kappa }}{\sigma }_i^2{(1-{\theta }_i)}^2+{\sigma }_p^2{(1-{\theta }_p)}^2\sum _{X_i\in C_{\kappa }}{\sigma }_i^2{(1+{\theta }_i)}^2}\hfill \\ & -& \sqrt{{\sigma }_p^2{(1+{\theta }_p)}^2\sum _{X_i\in C_k}{\sigma }_i^2{(1-{\theta }_i)}^2+{\sigma }_p^2{(1-{\theta }_p)}^2\sum _{X_i\in C_k}{\sigma }_i^2{(1+{\theta }_i)}^2}\hfill \end{array}$$

(95)

which provides an alternative way to cluster streams by identifying and moving the stream from one cluster to another which yields the largest drop in the objective function.

6.1. Aggregate of Two MA(1) Streams

In this subsection we consider two MA(1) streams whose variance of shocks is unitary. We demonstrate that the MA coefficient6 of their aggregate process is always between the two MA coefficients of the individual streams. Furthermore we show that as the two coefficients of the two MA(1) streams are moved further apart from each other the variance of the shocks appearing in the Aggregated process increases. These two facts imply that if we are studying N individual MA(1) streams (with unit shock variance) and would like to cluster them into n clusters then the globally optimal clustering assignment will cluster the streams along intervals. That is, the assignment will have split the clusters into groups of streams whose MA coefficients are next to each other in a sorted arrangement. This implies that an efficient algorithm for obtaining a globally optimal cluster assignment consists of arranging the MA coefficients in increasing order and checking all possible "interval" clusters, without worrying that if two streams are clustered together, another stream with an MA coefficient between the two is assigned to a different cluster. This algorithm would need to check $\left(\genfrac{}{}{0pt}{}{N}{n}\right)$ possible cluster assignments to find the globally optimal arrangement.

Theorem 1.

Consider two streams whose ARMA representations are given by

$$X_{1,t}=(1+{\theta }_{1}B){ϵ}_{1,t}$$

$$X_{2,t}=(1+{\theta }_{2}B){ϵ}_{2,t}$$

with $var\left({ϵ}_{1,t}\right)=var\left({ϵ}_{2,t}\right)=1$ and ${\sigma }_{12}=0$ and ${\theta }_1<{\theta }_2$. Note that ${\theta }_1$ and ${\theta }_2$ are allowed to equal 0.

The Aggregated process $\{X_{1,t}+X_{2,t}\}$ is described by the MA(1) model

$$X_{1,t}+X_{2,t}=(1+\theta B){ϵ}_t$$

such that ${\theta }_1<\theta <{\theta }_2$.

Proof. Note that the covariance generating function of the aggregate process is

$$G_S\left(z\right)=({\theta }_1+{\theta }_2)z^{-1}+(2+{\theta }_1^2+{\theta }_2^2)+({\theta }_1+{\theta }_2)z.$$

(96)

As long as7 ${\theta }_1\ne -{\theta }_2$, this polynomial has roots $a_1$ and $1/a_1$. Suppose $a_1$ is inside the unit circle, then according to Remark 1, $\theta =-a_1$ and $var\left({ϵ}_t\right)={\sigma }_{ϵ}^2=-({\theta }_1+{\theta }_2)(1/a_1)$.

We can note that the Laurent polynomial in Equation (96) has roots given by

$${\displaystyle \frac{-(2+{\theta }_1^2+{\theta }_2^2)\pm \sqrt{{(2+{\theta }_1^2+{\theta }_2^2)}^2-4{({\theta }_1+{\theta }_2)}^2}}{2({\theta }_1+{\theta }_2)}}$$

(97)

This implies that

$$a_1={\displaystyle \frac{-(2+{\theta }_1^2+{\theta }_2^2)+\sqrt{{(2+{\theta }_1^2+{\theta }_2^2)}^2-4{({\theta }_1+{\theta }_2)}^2}}{2({\theta }_1+{\theta }_2)}}$$

(98)

and

$$\theta ={\displaystyle \frac{(2+{\theta }_1^2+{\theta }_2^2)-\sqrt{{(2+{\theta }_1^2+{\theta }_2^2)}^2-4{({\theta }_1+{\theta }_2)}^2}}{2({\theta }_1+{\theta }_2)}}$$

(99)

In the remainder of this section we will prove that

$${\theta }_1<{\displaystyle \frac{(2+{\theta }_1^2+{\theta }_2^2)-\sqrt{{(2+{\theta }_1^2+{\theta }_2^2)}^2-4{({\theta }_1+{\theta }_2)}^2}}{2({\theta }_1+{\theta }_2)}}<{\theta }_2$$

(100)

Suppose first that ${\theta }_1+{\theta }_2>0$.

Then we can rewrite equation (100) as

$$2{\theta }_1^2+2{\theta }_2{\theta }_1<(2+{\theta }_1^2+{\theta }_2^2)-\sqrt{{(2+{\theta }_1^2+{\theta }_2^2)}^2-4{({\theta }_1+{\theta }_2)}^2}<2{\theta }_2^2+2{\theta }_2{\theta }_1$$

(101)

or equivalently,

$${\theta }_1^2-{\theta }_2^2+2{\theta }_2{\theta }_1-2<-\sqrt{{(2+{\theta }_1^2+{\theta }_2^2)}^2-4{({\theta }_1+{\theta }_2)}^2}<{\theta }_2^2-{\theta }_1^2+2{\theta }_1{\theta }_2-2$$

(102)

or

$${\theta }_1^2-{\theta }_2^2-2{\theta }_2{\theta }_1+2<\sqrt{{(2+{\theta }_1^2+{\theta }_2^2)}^2-4{({\theta }_1+{\theta }_2)}^2}<{\theta }_2^2-{\theta }_1^2-2{\theta }_1{\theta }_2+2$$

(103)

Noting that the left and right-hand sides of the inequality are always larger than zero, (103) holds if and only if the following inequality holds as well

$${({\theta }_1^2-{\theta }_2^2-2{\theta }_2{\theta }_1+2)}^2<{(2+{\theta }_1^2+{\theta }_2^2)}^2-4{({\theta }_1+{\theta }_2)}^2<{({\theta }_2^2-{\theta }_1^2-2{\theta }_1{\theta }_2+2)}^2.$$

(104)

Labeling the three sides of this inequality as $A<B<C$, we observe that

$$\begin{array}{ccc}\hfill A& =& {\theta }_1^4-{\theta }_1^2{\theta }_2^2-2{\theta }_1^3{\theta }_2+2{\theta }_1^2-{\theta }_1^2{\theta }_2^2+{\theta }_2^4+2{\theta }_2^3{\theta }_1-2{\theta }_2^2\hfill \\ & -& 2{\theta }_1^3{\theta }_2+2{\theta }_2^3{\theta }_1+4{\theta }_1^2{\theta }_2^2-4{\theta }_2{\theta }_1+2{\theta }_1^2-2{\theta }_2^2-4{\theta }_2{\theta }_1+4\hfill \\ \hfill B& =& 4+2{\theta }_1^2+2{\theta }_2^2+2{\theta }_1^2+{\theta }_1^4+{\theta }_1^2{\theta }_2^2+2{\theta }_2^2+{\theta }_1^2{\theta }_2^2+{\theta }_2^4-4({\theta }_1^2+2{\theta }_1{\theta }_2+{\theta }_2^2)\hfill \\ \hfill C& =& {\theta }_2^4-{\theta }_2^2{\theta }_1^2-2{\theta }_2^3{\theta }_1+2{\theta }_2^2-{\theta }_2^2{\theta }_1^2+{\theta }_1^4+2{\theta }_1^3{\theta }_2-2{\theta }_1^2\hfill \\ & -& 2{\theta }_2^3{\theta }_1+2{\theta }_1^3{\theta }_2+4{\theta }_2^2{\theta }_1^2-4{\theta }_1{\theta }_2+2{\theta }_2^2-2{\theta }_1^2-4{\theta }_1{\theta }_2+4\hfill \end{array}$$

$$$$

(105)

Removing equivalent terms and combining like terms, we observe

$$\begin{array}{ccc}& & 2{\theta }_1^2{\theta }_2^2-4{\theta }_1^3{\theta }_2+4{\theta }_1^2+4{\theta }_2^3{\theta }_1-4{\theta }_2^2-8{\theta }_1{\theta }_2\hfill \\ & <& 2{\theta }_1^2{\theta }_2^2-8{\theta }_1{\theta }_2\hfill \\ & <& {\theta }_2^2{\theta }_1^2-4{\theta }_2^3{\theta }_1+4{\theta }_2^2+4{\theta }_1^3{\theta }_2-4{\theta }_1^2-8{\theta }_2{\theta }_1\hfill \end{array}$$

which can be rewritten as

$$-4{\theta }_1^3{\theta }_2+4{\theta }_1^2+4{\theta }_1{\theta }_2^3-4{\theta }_2^2<0<-4{\theta }_1{\theta }_2^3+4{\theta }_2^2+4{\theta }_1^3{\theta }_2-4{\theta }_1^2.$$

(106)

Noting that the left and right-hand sides of this inequality are additive inverses, we see that this inequality holds8 and therefore inequality (100) holds.

Finally, if ${\theta }_1+{\theta }_2<0$ in (100) then the direction of the inequalities is reversed in (101) and a similar sequence of steps would lead us to observe

$$-4{\theta }_1^3{\theta }_2+4{\theta }_1^2+4{\theta }_1{\theta }_2^3-4{\theta }_2^2>0>-4{\theta }_1{\theta }_2^3+4{\theta }_2^2+4{\theta }_1^3{\theta }_2-4{\theta }_1^2$$

(107)

and by the same argument we see that (100) holds and the theorem is proved. □.

Theorem 2.

Consider two streams whose ARMA representations are given by

$$X_{1,t}=(1+{\theta }_{1}B){ϵ}_{1,t}$$

$$X_{2,t}=(1+{\theta }_{2}B){ϵ}_{2,t}$$

with ${\sigma }_1^2={\sigma }_2^2=1$ and ${\sigma }_{12}=0$ and ${\theta }_1<{\theta }_2$. Note that ${\theta }_1$ and ${\theta }_2$ may be 0.

As the distance between ${\theta }_1$ and ${\theta }_2$ increases, $var\left({ϵ}_t\right)={\sigma }_{ϵ}^2$ increases.

Proof

From Equation (96) we see that the root $1/a_1$ of $G_S\left(z\right)$, which is outside the unit circle, is given by

$${\displaystyle \frac{-(2+{\theta }_1^2+{\theta }_2^2)-\sqrt{{(2+{\theta }_1^2+{\theta }_2^2)}^2-4{({\theta }_1+{\theta }_2)}^2}}{2({\theta }_1+{\theta }_2)}}.$$

(108)

Since ${\sigma }_{ϵ}^2=-({\theta }_1+{\theta }_2)/a_1$, we have

$${\sigma }_{ϵ}^2={\displaystyle \frac{(2+{\theta }_1^2+{\theta }_2^2)+\sqrt{{(2+{\theta }_1^2+{\theta }_2^2)}^2-4{({\theta }_1+{\theta }_2)}^2}}{2}}$$

(109)

To show that this is increasing in ${\theta }_2$, consider the derivative of the above with respect to ${\theta }_2$:

$${\displaystyle \frac{\partial {\sigma }_{ϵ}^2}{\partial {\theta }_2}}={\theta }_2+{\displaystyle \frac{{\theta }_2(2+{\theta }_1^2+{\theta }_2^2)-2({\theta }_1+{\theta }_2)}{\sqrt{{(2+{\theta }_1^2+{\theta }_2^2)}^2-4{({\theta }_1+{\theta }_2)}^2}.}}$$

(110)

We need to show that (110) is larger than zero, thus consider

$${\displaystyle \frac{\partial {\sigma }_{ϵ}^2}{\partial {\theta }_2}}={\theta }_2+{\displaystyle \frac{{\theta }_2(2+{\theta }_1^2+{\theta }_2^2)-2({\theta }_1+{\theta }_2)}{\sqrt{{(2+{\theta }_1^2+{\theta }_2^2)}^2-4{({\theta }_1+{\theta }_2)}^2}}}>0$$

(111)

or equivalently

$${\theta }_2(2+{\theta }_1^2+{\theta }_2^2)-2({\theta }_1+{\theta }_2)>-{\theta }_2\sqrt{{(2+{\theta }_1^2+{\theta }_2^2)}^2-4{({\theta }_1+{\theta }_2)}^2}$$

(112)

which simplifies to

$$2({\theta }_1+{\theta }_2)-{\theta }_2(2+{\theta }_1^2+{\theta }_2^2)<{\theta }_2\sqrt{{(2+{\theta }_1^2+{\theta }_2^2)}^2-4{({\theta }_1+{\theta }_2)}^2}$$

(113)

or

$$2{\theta }_1-{\theta }_2{\theta }_1^2-{\theta }_2^3<{\theta }_2\sqrt{{(2+{\theta }_1^2+{\theta }_2^2)}^2-4{({\theta }_1+{\theta }_2)}^2}.$$

(114)

We will refer to the left and right hand sides of the inequality in (114) as $LHS$ and $RHS$. Note that squaring both yields

$$\begin{array}{ccc}\hfill LH{S}^2& =& 4{\theta }_1^2-4{\theta }_1^3{\theta }_2-4{\theta }_1{\theta }_2^3+{\theta }_1^4{\theta }_2^2+2{\theta }_1^2{\theta }_2^4+{\theta }_2^6\hfill \\ \hfill RH{S}^2& =& 4{\theta }_2^2+4{\theta }_1^2\theta 2^2+{\theta }_1^4{\theta }_2^2+2{\theta }_1^2{\theta }_2^4+{\theta }_2^6-4{\theta }_1^2{\theta }_2^2-8{\theta }_1{\theta }_2^3\hfill \end{array}$$

(115)

Note that furthermore

$$LH{S}^2-RH{S}^2=4{\theta }_1^2-4{\theta }_2^2-4{\theta }_1^3{\theta }_2+4{\theta }_1{\theta }_2^3=4(1-{\theta }_1{\theta }_2)({\theta }_1^2-{\theta }_2^2)$$

(116)

Suppose first that ${\theta }_1<{\theta }_2=0$. Note that (114) reduces to $2{\theta }_1<0$, which holds, and therefore (111) holds as well.

Next suppose that $0={\theta }_1<{\theta }_2$. Note that (114) reduces to

$$-{\theta }_2^3<{\theta }_2\sqrt{{(2+{\theta }_2^2)}^2-4{\theta }_2^2}$$

(117)

which holds as well since the left-hand side is negative in this case.

In the remainder of the proof we assume that ${\theta }_1\ne 0$ and ${\theta }_2\ne 0$. Consider the case that $|{\theta }_2|>|{\theta }_1|$. Note that this implies that ${\theta }_2$>0 (since ${\theta }_2>{\theta }_1$) and that (116) is less than zero. Thus in this case $LH{S}^2<RH{S}^2$ and $LHS<RHS$ in (114). Therefore (111) holds in this case as well.

Now suppose that $|{\theta }_1|>|{\theta }_2|$ and that ${\theta }_2>0$. The former implies that $LH{S}^2-RH{S}^2>0$ and the latter implies that $RHS>0$. Therefore $LHS<0$ and therefore $LHS<RHS$. Therefore (111) holds in this case as well.

Finally suppose that $|{\theta }_1|>|{\theta }_2|$ and that ${\theta }_2<0$. The former again implies that $LH{S}^2-RH{S}^2>0$ while the latter implies that $RHS<0$. Therefore $LHS<RHS$ and (111) holds in all cases. □.

7. Demand Streams Produced by Identical ARMA models

Note that Theorem 1 and Theorem 2 imply that the prescribed algorithm at the top of the previous subsection always leads to an optimal solution. The following lemma establishes that in the event that two streams are generated by the same ARMA model, the aggregate will also follow the same ARMA model. Therefore, we can greatly reduce the dimensionality of the number of streams that need to be assigned to clusters by first aggregating demand streams from equivalent models.

Lemma 3.

Consider two sequences $\left\{X_{1,t}\right\}$ and $\left\{X_{2,t}\right\}$ that have the same ARMA representation with respect to Wold shock sequences $\left\{{ϵ}_{1,t}\right\}$ and $\left\{{ϵ}_{2,t}\right\}$ given by

$$\begin{array}{ccc}\hfill {\mathsf{\Phi }}^{★}\left(B\right)X_{1,t}& =& {\mathsf{\Theta }}^{★}\left(B\right){ϵ}_{1,t}\hfill \end{array}$$

(118)

$$\begin{array}{ccc}\hfill {\mathsf{\Phi }}^{★}\left(B\right)X_{2,t}& =& {\mathsf{\Theta }}^{★}\left(B\right){ϵ}_{2,t}\hfill \end{array}$$

(119)

such that the variance of the shock sequences are ${\sigma }_1^2$ and ${\sigma }_2^2$ with covariance ${\sigma }_{12}$.

The aggregate $\{S_t=X_{1,t}+X_{2,t}\}$ also has the same ARMA representation with respect to its Wold shocks $\left\{{ϵ}_t\right\}$ given by

$${\mathsf{\Phi }}^{★}\left(B\right)S_t={\mathsf{\Theta }}^{★}\left(B\right){ϵ}_t$$

(120)

such that the variance of $\left\{{ϵ}_t\right\}$ is given by ${\sigma }_1^2+{\sigma }_2^2+2{\sigma }_{12}$.

Proof. From Remark 1 we note that the ARMA representation of $\left\{S_t\right\}$ is given by

$$\mathsf{\Phi }\left(B\right)S_t=\mathsf{\Theta }\left(B\right){ϵ}_t$$

(121)

such that ${\displaystyle \mathsf{\Theta }\left(z\right)=\prod _{i=1}^m(1-a_{i}z)}$ where $\left\{a_i\right\}$ are the roots of $O\left(z\right)P\left(z\right)$ on or inside the unit circle and ${\displaystyle \mathsf{\Phi }\left(z\right)=\prod _{i=1}^n(1-b_{i}z)}$ where $\left\{b_i\right\}$ are the roots of $Q\left(z\right)$ inside the unit circle with $O\left(z\right)$,$P\left(z\right)$ and $Q\left(z\right)$ are obtained from the covariance generating function $G_S\left(z\right)$ given by

$$G_S\left(z\right)=({\sigma }_1^2+{\sigma }_2^2){\displaystyle \frac{{\mathsf{\Theta }}^{★}\left(z\right){\mathsf{\Theta }}^{★}\left(z^{-1}\right)}{{\mathsf{\Phi }}^{★}\left(z\right){\mathsf{\Phi }}^{★}\left(z^{-1}\right)}}+2{\sigma }_{12}{\displaystyle \frac{{\mathsf{\Theta }}^{★}\left(z\right){\mathsf{\Theta }}^{★}\left(z^{-1}\right)}{{\mathsf{\Phi }}^{★}\left(z\right){\mathsf{\Phi }}^{★}\left(z^{-1}\right)}}$$

(122)

as per (77). This can further be simplified as

$$G_S\left(z\right)=({\sigma }_1^2+{\sigma }_2^2+2{\sigma }_{12}){\displaystyle \frac{{\mathsf{\Theta }}^{★}\left(z\right){\mathsf{\Theta }}^{★}\left(z^{-1}\right)}{{\mathsf{\Phi }}^{★}\left(z\right){\mathsf{\Phi }}^{★}\left(z^{-1}\right)}}$$

(123)

and therefore $\mathsf{\Phi }\left(z\right)={\mathsf{\Phi }}^{★}\left(z\right)$ and $\mathsf{\Theta }\left(z\right)={\mathsf{\Theta }}^{★}\left(z\right)$ and the result is proved. □

Lemma 3 shows us that if we have n demand sequences $X_{1,t},\dots ,X_{n,t}$, generated by models with the same ARMA coefficients with respect to their Wold shocks, their aggregate will have the same ARMA coefficients. Therefore if the customer base of a firm is comprised of many demand streams having the same ARMA representation, it is possible to greatly reduce the number of streams that need to be considered for clustering by first aggregating these equivalent streams.

8. Extensions and Other Questions

In this paper we compare theoretical MSFEs of a firm forecasting its leadtime demand based on disaggregated (individual) demand streams and subaggregated clusters formed from those streams. We highlight examples that illustrate that the MSFE based on subaggregates need not be much larger than the MSFE based on the disaggregated streams as long as those clusters are well-formed. We propose a Pivot algorithm to form clusters which minimize the MSFE among all cluster assignments. We end with some theoretical results when the demand streams are generated by MA(1). Here we show that clusters resulting in the lowest MSFE are formed by grouping streams by the proximity of their MA coefficient.

The MA(1) case hints that in a general ARMA case, "best" clusters would be formed based on proximity of the ARMA coefficients between models generating the various streams (or equivalently based on the proximity of roots of the AR and MA polynomials). Alternatively, best cluster assignments may result from grouping streams with most similar coefficients appearing in the MA(∞) representation. Future work can be done to establish the best approach.

Our current theoretical approach based on general ARMA models is limited in that root-finding algorithms are unstable once the degree of a polynomial gets too large. In our study, this begins to occur when we consider the aggregate of around twenty streams with at least one AR coefficient. It is possible to greatly reduce the dimensionality however by first aggregating demand streams that are produced by identical or nearly-identical ARMA models. This is another direction for future research.