Probability Bracket Notation for Probability Modeling

1. Introduction

The postulates of Quantum Mechanics (QM) were established in terms of Hilbert Spaces and linear Hermitian operators. Values of physical observables such as energy and momentum were considered as eigenvalues, more precisely as spectral values of linear operators in a Hilbert space. Dirac’s vector bracket notation (VBN) is a very powerful tool to manipulate vectors in Hilbert spaces. It has been widely used in QM and quantum field theories. The main beauty of the VBN is that many formulas can be presented in an abstract symbolic fashion, independent of state expansions or basis selections, which, when needed, can be easily done by inserting an appropriate v-identity operator [1]

$$\begin{array}{ccc}\hfill \mathrm{v-}\mathrm{Bracket}:\langle {\psi }_A|{\psi }_B\rangle & \Rightarrow & \mathrm{v-}\mathrm{bra}:\langle {\psi }_A|,\mathrm{v-}\mathrm{ket}:|{\psi }_B\rangle \hfill \end{array}$$

(1)

$$\begin{array}{ccc}\hfill \mathrm{where}:\langle {\psi }_A|{\psi }_B\rangle & =& {\langle {\psi }_B|{\psi }_A\rangle }^{*},{\langle {\psi }_A|=|{\psi }_A\rangle }^{†}\hfill \end{array}$$

(2)

$$\begin{array}{ccc}\hfill \mathrm{v-}\mathrm{basis}\&\mathrm{v-}\mathrm{identity}\text{:}\widehat{H}|{\epsilon }_i\rangle & =& {\epsilon }_i|{\epsilon }_i\rangle ,\langle {\epsilon }_i|{\epsilon }_j\rangle ={\delta }_{ij},{\widehat{I}}_H=\sum _i|{\epsilon }_i\rangle \langle {\epsilon }_i|\hfill \end{array}$$

(3)

$$\begin{array}{ccc}\hfill \mathrm{Normalization}\text{:}1=\langle \mathsf{\Psi }|\mathsf{\Psi }\rangle & =& \langle \mathsf{\Psi }|{\widehat{I}}_H|\mathsf{\Psi }\rangle ={\sum }_i\langle \mathsf{\Psi }|{\epsilon }_i\rangle \langle {\epsilon }_i|\mathsf{\Psi }\rangle ={\sum }_i|c_i{|}^2\hfill \end{array}$$

(4)

$$\begin{array}{ccc}\hfill \mathrm{Expectation}\text{:}\langle H\rangle \equiv \overline{H}& \equiv & \langle \mathsf{\Psi }|\widehat{H}|\mathsf{\Psi }\rangle ={\sum }_i\langle \mathsf{\Psi }|\widehat{H}|{\epsilon }_i\rangle \langle {\epsilon }_i|\mathsf{\Psi }\rangle ={\sum }_i{\epsilon }_i|c_i{|}^2\hfill \end{array}$$

(5)

where † denotes the Hermitian adjoint and * is the complex conjugate. However, when applying operators, the more mathematically minded worried if the transformation yielded a result contained within a Hilbert Space or subspace. They had to consider if the operator was bounded or unbounded, etc…One had to develop an entire spectral theory for Hermitian operators in a Hilbert space[2].

Inspired by the great success of the VBN in QM, we now propose the Probability Bracket Notation (PBN). The latter relies on a sample space which is less constrained than a Hilbert space. Assuming X is a random variable $(R.V)$, $\mathsf{\Omega }$ is the set of all its outcomes and $P\left(x_i\right)$ is the probability of $x_i\in \mathsf{\Omega }$. Then we can make an expression like Equation (4):

$${\sum }_{i}P(x_i)={\sum }_{i}P(x_i|\mathsf{\Omega })={\sum }_{i}P(\mathsf{\Omega }|x_i)(x_i|\mathsf{\Omega })=P(\mathsf{\Omega }|\left\{{\sum }_i|x_i\left)P\right(x_i|\right\}|\mathsf{\Omega })=P(\mathsf{\Omega }|\mathsf{\Omega })=1$$

Here we have used the definition of conditional probability for $A,B\subseteq \mathsf{\Omega }$ [3].

$$P(A|B)\equiv P(A\cap B)/P\left(B\right),\therefore P(x_i|\mathsf{\Omega })=P\left(x_i\right),P(\mathsf{\Omega }|x_i)=1\mathrm{for}\forall x_i\in \mathsf{\Omega }$$

(6)

Therefore, we seem to have discovered a probability “identity operator”:

$$I_X\equiv {\sum }_i|x_i\left)P\right(x_i|\Rightarrow P(\mathsf{\Omega }|\mathsf{\Omega })=P(\mathsf{\Omega }|I_X|\mathsf{\Omega })={\sum }_{i}P(\mathsf{\Omega }|x_i)P(x_i|\mathsf{\Omega })\underset{\left(\right)}{=}{\sum }_{i}P\left(x_i\right)=1$$

Then, following Dirac’s notation, we define the probability bra (P-bra), P-ket, P-bracket (as conditional probabilities by nature), P-basis, the system P-ket, P-identity, normalization, expectation and more, similar but not identical to their counterparts in Equations (1) - (5). In Section 2, for systems of one $R.V$, we show that the PBN has an advantage similar to that of the VBN: miscellaneous probability expressions [3,4,5] now can be presented in an abstract way, independent of P-basis and can expanded by inserting a suitable P-identity.

Next, in Section 3, we investigate the time evolution of homogeneous Markov chains (HMC) [3,4,5]. We realize that the time evolution of a continuous-time HMC can be written in a symbolic abstract expression (in Section 3.2), just like the stationary Schrödinger equation in the VBN:

$$\begin{array}{ccc}\hfill i\hslash \frac{\partial }{\partial t}|\mathsf{\Psi }\left(t\right)\rangle & =& \widehat{H}|\mathsf{\Psi }\left(t\right)\rangle =\left[-\frac{{\hslash }^2}{2m}\frac{{\partial }^2}{\partial x^2}-V\left(x\right)\right]|\mathsf{\Psi }\left(t\right)\rangle \hfill \\ \hfill |\mathsf{\Psi }(t)\rangle =U(t)|\mathsf{\Psi }\left(0\right)\rangle & =& exp\left[\frac{-i}{\hslash }\widehat{H}t\right]|\mathsf{\Psi }\left(0\right)\rangle \hfill \end{array}$$

(7)

We also find that our time-dependent system P-kets can be identified with probability vectors ([3]). Our system P-bra is closely related to the state function or standard bra introduced in Doi-Peliti Techniques [6,7,8]. We show that by transforming from the Schrödinger picture to the Heisenberg picture in the PBN, the time-dependence of a system P-ket relocates to the $R.V$, which becomes a stochastic process; the Chapman-Kolmogorov Theorem [4,5,9] for transition probabilities can be derived by just inserting a time-dependent P-identity. Section 5 shows that a Schrödinger equation transforms to a master equation by making a special Wick rotation. Section 6 showcases the potential applications of the PBN, such as handling non-Hermitian operators and clustering text datasets. Discussion and concluding remarks are made at the end.

2. Probability Bracket Notation and Random Variable ($R.V$)

2.1. Discrete random variable

We define a probability space $(\mathsf{\Omega },X,P)$ of a discrete random variable ($R.V$, or observable) X as follows: the set of all elementary events $\omega$, associated with a discrete random variable X, is the sample space $\mathsf{\Omega }$, and

$$\mathrm{For}\forall {\omega }_i\in \mathsf{\Omega },X\left({\omega }_i\right)=x_i\in \Re ,P:{\omega }_i\mapsto P\left({\omega }_i\right)=m\left({\omega }_i\right)\ge 0,{\sum }_{i}m\left({\omega }_i\right)=1$$

(8)

Definition 1. (Probability event-bra and evidence-ket) :Let $A\subseteq \mathsf{\Omega }$ and, $B\subseteq \mathsf{\Omega }$,

1 

The symbol $P(A|$represents a probability event bra, or P-bra;

2 

The symbol $|B)$represents a probability evidence ket, or P-ket.

Definition 2.(Probability Event-Evidence Bracket): Theconditional probability(CP) of event A given evidence B in the sample space Ω can be treated as aP-bracket, and it can be split into a P-bra and a P-ket, similar to a Dirac bracket. For $A,B\subseteq \mathsf{\Omega }$, we define:

$$\begin{array}{ccc}& & \mathit{P-}\mathit{bracket}\text{:}\mathit{P}(\mathit{A}|\mathit{B})\Rightarrow \mathit{P-}\mathit{bra}\text{:}\mathit{P}(\mathit{A}|,\mathit{P-}\mathit{ket}\text{:}|\mathit{B})\mathit{Note}\text{:}\mathit{P}{(\mathit{A}|\ne |\mathit{A})}^{†}\hfill \\ & & \mathit{Here}\text{:}\mathit{P}(\mathit{A}|\mathit{B})\equiv \frac{\mathit{P}(\mathit{A}\cap \mathit{B})}{\mathit{P}\left(\mathit{B}\right)}(\mathrm{a}\mathit{conditional}\mathit{probability}\mathit{by}\mathit{nature})\hfill \end{array}$$

(9)

As a CP, the P-bracket has the following properties for $A,B\subseteq \mathsf{\Omega }$:

$$\begin{array}{ccc}\hfill P(A|B)& =& 1\mathrm{if}A\supseteq B\supset ⌀\hfill \end{array}$$

(10)

$$\begin{array}{ccc}\hfill P(A|B)& =& 0\mathrm{if}A\cap B=⌀\hfill \end{array}$$

(11)

Definition 3. 

System P-ket:For any subset, the probability $P\left(E\right)$can be written as a conditional probability, or a P-bracket:

$$P\left(E\right)=P(E|\mathsf{\Omega })$$

(12)

Here$|\mathsf{\Omega })$is called thesystem P-ket. The P-bracket defined in Equations (9) now becomes:

$$P(A|B)=\frac{P(A\cap B)}{P\left(B\right)}=\frac{P(A\cap B|\mathsf{\Omega })}{P(B|\mathsf{\Omega })}$$

(13)

We have the following important property expressed in PBN:

$$\mathrm{For}\forall B\subseteq \mathsf{\Omega }\mathrm{and}B\ne ⌀,P(\mathsf{\Omega }|B)=1$$

(14)

The Bayes formula (see [3, Sec.(2.1)])) now can be expressed as:

$$P(A|B)\equiv \frac{P(B|A\left)P\right(A)}{P\left(B\right)}=\frac{P(B|A\left)P\right(A|\mathsf{\Omega })}{P(B|\mathsf{\Omega })}$$

(15)

The set of all elementary events in $\mathsf{\Omega }$ forms a complete mutually disjoint set:

$${\bigcup }_{{\omega }_i\in \mathsf{\Omega }}{\omega }_i=\mathsf{\Omega },{\omega }_i\cap {\omega }_j={\delta }_{ij}{\omega }_i,{\sum }_i m\left({\omega }_i\right)=1.$$

(16)

Definition 4.(Discrete P-Basis and P-Identity): Using Equations (8-), we have the following properties for basis elements in $(\mathsf{\Omega },X,P)$:

$$X\left({\omega }_j\right)=x_j\to X|{\omega }_j)=x_j|{\omega }_j),P(\mathsf{\Omega }|{\omega }_j)=1,P({\omega }_i|\mathsf{\Omega })=m\left({\omega }_i\right)$$

(17)

In view of the one-to-one correlation between $x_j$ and ${\omega }_j$, from now on, we will use $x_j$ to label basis elements, just like labeling eigenstates in Equation (3) in the VBN for QM:

$$X\left(x_j\right)=x_j\to X|x_j)=x_j|x_j),P(\mathsf{\Omega }|x_j)=1,P(x_i|\mathsf{\Omega })=m\left(x_i\right)$$

(18)

Here X behaves like a right-acting operator. The complete mutually-disjoint events in (16-18) form a probability basis (or P-basis) and a P-identity, similar to Equation (3) in QM:

$$P(x_i|x_k)={\delta }_{ik},{\sum }_{x\in \mathsf{\Omega }}|x)P(x|={\sum }_i^{ }|x_i)P(x_i|=I_X.$$

(19)

The system P-ket, $|\mathsf{\Omega })$, now can be expanded from left as:

$$|\mathsf{\Omega })=I_X|\mathsf{\Omega })=\sum _i^{ }|x_i)P(x_i|\mathsf{\Omega })=\sum _i^{ }m\left(x_i\right)|x_i)$$

(20)

While the system P-bra, has its expansion from right as:

$$P(\mathsf{\Omega }|=P(\mathsf{\Omega }|I_X={\sum }_i(\mathsf{\Omega }|x_i)P(x_i|\underset{\left(14\right)}{=}{\sum }_{i}P(x_i|$$

(21)

The two expansions are quite different, and $P{(\mathsf{\Omega }|\ne [|\mathsf{\Omega }\left)\right]}^{†}$. But their P-bracket is consistent with the requirement of normalization, similar to Equation (4) in the VBN:

$$1=P\left(\mathsf{\Omega }\right)\equiv P(\mathsf{\Omega }|\mathsf{\Omega })={\sum }_{i,j=1}^{N}P(x_i|m\left(x_j\right)|x_j)={\sum }_{i,j=1}^{N}m\left(x_j\right){\delta }_{ij}={\sum }_{i=1}^{N}m\left(x_i\right)$$

(22)

Definition 5.(Expectation Value): Analogous to Equation (5) in QM, the expected value of the $R.V$ or observable X in $(\mathsf{\Omega },X,P)$ now can be expressed as:

$$\langle X\rangle \equiv \overline{X}\equiv E\left[X\right]=P(\mathsf{\Omega }|X|\mathsf{\Omega })={\sum }_{x\in \mathsf{\Omega }}P(\mathsf{\Omega }|X|x)P(x|\mathsf{\Omega })={\sum }_{x\in \mathsf{\Omega }}xm\left(x\right)$$

(23)

If $f\left(X\right)$ is a continuous function of observable X, then it is easy to show that:

$$\langle f\left(X\right)\rangle \equiv E\left[f\left(X\right)\right]\equiv P(\mathsf{\Omega }|f\left(X\right)|\mathsf{\Omega })={\sum }_{x\in \mathsf{\Omega }}f\left(x\right)m\left(x\right)$$

(24)

2.2. Independent random variables

Let $\overrightarrow{X}=\{X_1,X_2,\dots X_n\}$ be a vector of independent random variables and the sample space (i.e., the set of possible outcomes) of $X_i$ is the set ${\mathsf{\Omega }}_i$. Then the joint probability distribution can be denoted as:

$$P(x_1,...,x_N|\mathsf{\Omega })=P(X_1=x_1,...,X_n=x_n|\mathsf{\Omega }),|\mathsf{\Omega })=|{\mathsf{\Omega }}_1\otimes \dots \otimes {\mathsf{\Omega }}_n)$$

(25)

The joint probability of independent $R.V$ are factorable, e.g.:

$$P(x_i,x_k|\mathsf{\Omega })=P(x_i|{\mathsf{\Omega }}_i)P(x_k|{\mathsf{\Omega }}_k)=P\left(x_i\right)P\left(x_k\right)$$

(26)

The factorable system have the following factorable expectation, for example:

$$P(\mathsf{\Omega }|X_i{X}_j{X}_k|\mathsf{\Omega })=P({\mathsf{\Omega }}_i|X_i|{\mathsf{\Omega }}_i\left)P\right({\mathsf{\Omega }}_j|X_j|{\mathsf{\Omega }}_i\left)P\right({\mathsf{\Omega }}_k|X_k|{\mathsf{\Omega }}_k)$$

(27)

As an example, in Fock space, we have the following basis from the occupation numbers

$$\langle N_i\rangle \equiv P(\mathsf{\Omega }|N_i|\mathsf{\Omega })=P({\mathsf{\Omega }}_i|N_i|{\mathsf{\Omega }}_i)=P({\mathsf{\Omega }}_i|N_i{I}_i|{\mathsf{\Omega }}_i)={\sum }_{n_i}{n}_{i}P(n_i|{\mathsf{\Omega }}_i)$$

(28)

The expectation value of an occupation number now is given by:

$$\langle N_i\rangle \equiv P(\mathsf{\Omega }|N_i|\mathsf{\Omega })=P({\mathsf{\Omega }}_i|N_i|{\mathsf{\Omega }}_i)=P(\mathsf{\Omega }|N_i{I}_i|{\mathsf{\Omega }}_i)={\sum }_{n_i}{n}_{i}P(n_i|{\mathsf{\Omega }}_i)$$

(29)

Moreover, if sets A and B are mutually independent in $\mathsf{\Omega }$, we have following equivalence:

$$P(A|B)=P(A|\mathsf{\Omega })\iff P(A\cap B|\mathsf{\Omega })=P(A|\mathsf{\Omega })P(B|\mathsf{\Omega })$$

(30)

2.3. Continuous P-basis and P-Identity

Equations (17-19) can be extended to the probability space $(\mathsf{\Omega },X,P)$ of a continuous random variable X,

$$\begin{array}{ccc}\hfill X\left(x\right)=x\to X|x)& =& x|x),P(\mathsf{\Omega }|x)=1,P:x\mapsto P(x)\equiv P(x|\mathsf{\Omega })\hfill \end{array}$$

(31)

$$\begin{array}{ccc}\hfill P(x|x^{\prime })& =& \delta (x-x^{\prime }),{\int }_{x\in \mathsf{\Omega }}|x)dxP(x|=I_X\hfill \end{array}$$

(32)

We see that it is consistent with the normalization requirement:

$$P(\mathsf{\Omega }|\mathsf{\Omega })=P(\mathsf{\Omega }|I_X|\mathsf{\Omega })={\int }_{ }P(\mathsf{\Omega }|x)dxP(x|\mathsf{\Omega })={\int }_{x\in \mathsf{\Omega }}dxP(x|\mathsf{\Omega })={\int }_{x\in \mathsf{\Omega }}dxP\left(x\right)=1$$

(33)

The expected value $E\left(X\right)$ can be easily extended from (23):

$$\langle X\rangle \equiv \overline{X}\equiv E\left[X\right]=P(\mathsf{\Omega }|X|\mathsf{\Omega })={\int }_{x\in \mathsf{\Omega }}P(\mathsf{\Omega }|X|x)dxP(x|\mathsf{\Omega })={\int }_{x\in \mathsf{\Omega }}dxxP\left(x\right)$$

(34)

The basis-independent expressions in the PBN are similar to those in Dirac VBN, among them are the expectation and normalization formulas in the two notations:

$$\begin{array}{ccc}\hfill PBN:\langle f\left(X\right)\rangle & \equiv & E\left[f\right(X\left)\right]=P(\mathsf{\Omega }|f\left(X\right)|\mathsf{\Omega }),P(\mathsf{\Omega }|\mathsf{\Omega })=1,\hfill \end{array}$$

(35)

$$\begin{array}{ccc}\hfill VBN\text{:}\langle f\left(\widehat{X}\right)\rangle & \equiv & E\left[f\left(\widehat{X}\right)\right]=\langle \psi |f\left(\widehat{X}\right)|\psi \rangle ,\langle \psi |\psi \rangle =1.\hfill \end{array}$$

(36)

Of course, there exist differences between the PBN and Dirac VBN. For example, the expansions of bra, ket and normalization have their own expressions:

$$\begin{array}{ccc}\hfill PBN:|\mathsf{\Omega })& =& {\int }_{ }dx|x)P(x|\mathsf{\Omega }),P(\mathsf{\Omega }|={\int }_{ }dxP(x|,P(\mathsf{\Omega }|\mathsf{\Omega })={\int }_{ }dxP(x|\mathsf{\Omega })=1,\hfill \end{array}$$

(37)

$$\begin{array}{ccc}\hfill VBN:|\psi \rangle & =& {\int }_{ }dx|x\rangle \langle x|\psi \rangle ,\langle \psi |={\int }_{ }dx\langle \psi |x\rangle \langle x|,\langle \psi |\psi \rangle ={\int }_{ }dx|\langle \psi |x\rangle {|}^2=1.\hfill \end{array}$$

(38)

2.4. Conditional probability and expectation

The conditional expectation of X given $H\subset \mathsf{\Omega }$ in the continuous basis (31) can be expressed as ([5, p.61]):

$$E[X|H]\equiv P(\mathsf{\Omega }|X|H)=\int P(\mathsf{\Omega }|X|x)dxP(x|H)=\int xdxP(x|H)$$

(39)

$$\mathrm{where}\text{:}P(x|H)\underset{\left(\right)}{=}\frac{P(x\cap H|\mathsf{\Omega })}{P(H|\mathsf{\Omega })}(\mathrm{conditional}\mathrm{probability})$$

(40)

To get familiar with the PBN, let us see two simple examples.

2.4.1. Example: Rolling a Die, (Ref. [3, Example 2.6-2.8])

A die is rolled once. We let X denote the outcome of this experiment. Then the sample space for this experiment is the 6-element set $\mathsf{\Omega }=\{1,2,3,4,5,6\}$. We assumed that the die was fair, and we chose the distribution function defined by $m\left(i\right)=1/6$, for $i=1,\cdots 6$. Using the PBN, we have the P-identity for this sample space:

$$\sum _{i=1}^6|i)P(i|=I_D,$$

(41)

and because the six outcomes have the same probability p, we can calculate the probability for each outcome:

$$1=P(\mathsf{\Omega }|\mathsf{\Omega })=\sum _{i=1}^{6}P(\mathsf{\Omega }|i\left)P\right(i|\mathsf{\Omega })=\sum _{i=1}^{6}P(i|\mathsf{\Omega })=6p.$$

(42)

Hence, the probability for each outcome has the same value:

$$P\left(i\right)\equiv P(i|\mathsf{\Omega })=p=\frac{1}{6}.$$

(43)

Its expectation value can be readily calculated:

$$\begin{array}{ccc}\hfill P(\mathsf{\Omega }|X|\mathsf{\Omega })& =& \sum _{{i=1}_{ }}^{6}P(\mathsf{\Omega }|X|i)P(i|\mathsf{\Omega })=\sum _{i=1}^{6}P(\mathsf{\Omega }|i|i)P(i|\mathsf{\Omega })\hfill \\ & =& \sum _{{i=1}_{ }}^{6}P(\mathsf{\Omega }|i)\frac{i}{6}=\sum _{{i=1}_{ }}^6\frac{i}{6}=\frac{21}{6}=\frac{7}{2}\hfill \end{array}$$

(44)

And the variance can be calculated as:

$${\sigma }^2=\langle X^2\rangle -{\overline{X}}^2=\sum _{i=1}^6\frac{1}{6}{i}^2-\frac{49}{4}=\frac{91}{6}-\frac{49}{4}=\frac{45}{4}$$

(45)

2.4.2. Example: Rolling a Die (Examples 2.1 continued,[3, 2.8 continued])

If E is the event that the result of the roll is an even number, then $E=\{2,4,6\}$ and $P\left(E\right)=m\left(2\right)+m\left(4\right)+m\left(6\right)=1/6+1/6+1/6=\frac{1}{2}$. Using the PBN, the probability of event E can be easily calculated as:

$$\begin{array}{ccc}\hfill P\left(E\right)\equiv P(E|\mathsf{\Omega })& =& P(E|\widehat{I}|\mathsf{\Omega })=\sum _{i=1}^{6}P(E|i\left)P\right(i|\mathsf{\Omega })\hfill \end{array}$$

(46)

$$\begin{array}{ccc}& =& \sum _{i\in E}^{ }P(i|\mathsf{\Omega })=\sum _{i=2,4,6}^{ }p=3·\frac{1}{6}=\frac{1}{2}\hfill \end{array}$$

(47)

Applying Equation (40), we can calculate the conditional probabilities $P(i|E)$ as follows:

$$P(i|E)=\frac{P(E\wedge i|\mathsf{\Omega })}{P(E|\mathsf{\Omega })}=\left\{\begin{array}{c}\frac{P(i|\mathsf{\Omega })}{1/2}=\frac{1/6}{1/2}=\frac{1}{3},\left(ieven\right)\\ 0,\left(iodd\right)\end{array}\right.$$

(48)

Our discussions above can be easily extended to systems of multiple $R.V.$ For example, we can introduce the following system of three independent discrete $R.V$:

$$\begin{array}{ccc}\hfill X|x,y,z)& =& x|x,y,z),Y|x,y,z)=y|x,y,z),Z|x,y,z)=z|x,y,z)\hfill \\ \hfill P(x,y,z)& =& P(x,y,z|\mathsf{\Omega });P(\mathsf{\Omega }|\mathsf{\Omega })=1;P(\mathsf{\Omega }|H)=1\mathrm{if}H\subseteq \mathsf{\Omega }\to P(\mathsf{\Omega }|x,y,z)=1\hfill \end{array}$$

(49)

$$\begin{array}{ccc}\hfill \mathrm{Orthonormality}\text{:}& & P(x,y,z|x^{\prime },y^{\prime },z^{\prime })={\delta }_{x{x}^{\prime }}{\delta }_{y{y}^{\prime }}{\delta }_{z{z}^{\prime }}\hfill \\ \hfill \mathrm{Completeness}\text{:}& & {\sum }_{x,y,z}|x,y,z)P(x,y,z|=I_{X,Y,Z}\hfill \end{array}$$

(50)

3. Probability Vectors and Homogeneous Markov Chains (HMCs)

For simplicity, from now on, we will only discuss time evolution for one $R.V$. We assume our probability space $(\mathsf{\Omega },N,P)$ has the following stationary discrete P-basis from a random variable (possible for state-labeling or occupation-number counting):

$$\widehat{N}|i)=i|i),P(i|j)={{\delta }_i}_j,{\sum }_{i=1}^N|i)P(i|=I$$

(51)

3.1. Discrete-time HMC

The transition matrix element $p_{ij}$ is defined as ([3, p.407]]:

$${p_i}_j\equiv P(N_{t+1}=j|N_t=i)\equiv P(j,t+1|i,t),{\sum }_{j=1}^N{p}_{ij}=1$$

(52)

In matrix form, if we define a probability row vector (PRV) at $t=0$ as $\langle u^{\left(0\right)}|$ , then matrix P acting on it from right for k times gives the PRV at $time=k$ ([3]):

$$\langle u^{\left(k\right)}|=\langle u^{\left(0\right)}|P^k,\mathrm{or}:\langle u^{\left(k\right)}|i\rangle ={u^{\left(k\right)}}_i={u^{\left(0\right)}}_j{P^k}_{ji}$$

(53)

Definition 6. 

Time-dependent System P-ket: we use the following system P-ket, to represent aprobability column vectorin probability space $(\mathsf{\Omega },X,P)$:

$$|{\mathsf{\Omega }}_t)={\sum }_i^N|i)P(i|{\mathsf{\Omega }}_t)={\sum }_i^{N}m(i,t)|i),P(\mathsf{\Omega }|{\mathsf{\Omega }}_t)={\sum }_i^{N}m(i,t)=1$$

(54)

The time evolution equation (53) now can be written in a basis-independent way:

$$|{\mathsf{\Omega }}_t)={\left(P^T\right)}^t|{\mathsf{\Omega }}_0)\equiv \widehat{U}\left(t\right)|{\mathsf{\Omega }}_0),t\in \mathbb{N};|{\mathsf{\Omega }}_0)\equiv [{\langle u^{\left(0\right)}|]}^T$$

(55)

Definition 7.(Time-dependent Expectation): The expectation value of a continuous function f of occupation number $\widehat{N}$ in $(\mathsf{\Omega },N,P)$ can be expressed as:

$$\langle f\left(\widehat{N}\right)\rangle =P(\mathsf{\Omega }|f\left(\widehat{N}\right)|{\mathsf{\Omega }}_t)={\sum }_{i}P(\mathsf{\Omega }|f\left(i\right)|i)P(i|{\mathsf{\Omega }}_t)={\sum }_{i}f(i)m(i,t)$$

(56)

We can map the P-bra and P-ket into the Hilbert space by using Dirac’s notation:

$$P(\mathsf{\Omega }|={\sum }_{i}P(i|\leftrightarrow \langle \mathsf{\Psi }|={\sum }_i\langle i|,|{\mathsf{\Omega }}_t)\leftrightarrow |{\mathsf{\Psi }}_t\rangle ={\sum }_i|i\rangle \langle i|{\mathsf{\Psi }}_t\rangle ={\sum }_{i}c(i,t)|i\rangle$$

(57)

Then the expectation Equation (56) can be rewritten in Dirac’s notation as:

$$\begin{array}{ccc}\hfill \langle f\left(\widehat{N}\right)\rangle & =& \langle {\mathsf{\Psi }}_t|f\left(\widehat{N}\right)|{\mathsf{\Psi }}_t\rangle ={\sum }_i\langle {\mathsf{\Psi }}_t|f\left(i\right)|i\rangle \langle i|{\mathsf{\Psi }}_t\rangle ={\sum }_{i}f(i)|c(i,t){|}^2\hfill \end{array}$$

(58)

$$\begin{array}{ccc}& \therefore & P(i|{\mathsf{\Omega }}_t)\equiv m(i,t)=|c(i,t){|}^2\equiv |\langle i|{\mathsf{\Psi }}_t\rangle {|}^2,t\in \mathbb{N}\hfill \end{array}$$

(59)

3.2. Continuous-time HMC

The time-evolution equation of a continuous-time HMC with a discrete basis (see Equation $\left(85\right)$ or Ref. [5, p.221]) can be written as:

$$\begin{array}{ccc}\hfill \frac{\partial }{\partial t}{p}_j\left(t\right)={\sum }_k^{ }{p}_k\left(t\right)q_{kj}& \Rightarrow & \frac{\partial }{\partial t}P(j|{\mathsf{\Omega }}_t)={\sum }_k^{ }{{\widehat{Q}}^T}_{jk}P(k|{\mathsf{\Omega }}_t)\hfill \end{array}$$

(60)

$$\begin{array}{ccc}\hfill ={\sum }_{k}P(j|{\widehat{Q}}^T|k)P(k|{\mathsf{\Omega }}_t)& =& P(j|{\widehat{Q}}^{T}I|{\mathsf{\Omega }}_t)=P(j|{\widehat{Q}}^T|{\mathsf{\Omega }}_t)\equiv P(j|\widehat{L}|{\mathsf{\Omega }}_t)\hfill \end{array}$$

(61)

Equations (60-61) lead to a basis-independent master equation (see Equation [8, Eq.(2.12)]):

$$\frac{\partial }{\partial t}|{\mathsf{\Omega }}_t)=\widehat{L}|{\mathsf{\Omega }}_t),|{\mathsf{\Omega }}_t)=\widehat{U}\left(t\right)|{\mathsf{\Omega }}_0)=e^{\widehat{L}t}|{\mathsf{\Omega }}_0),t\ge 0$$

(62)

It looks just like Schrödinger’s equation (7) of a conserved quantum system in Dirac’ notation. With the discrete P-basis of Fock space in Equation (28), Equations (56-59) now can be written as:

$$|{\mathsf{\Omega }}_t)={\sum }_{\overrightarrow{n}}m(\overrightarrow{n},t)|\overrightarrow{n}),P(\mathsf{\Omega }|={\sum }_{\overrightarrow{n}}(\overrightarrow{n}|,\therefore \langle f\left(\overrightarrow{n}\right)\rangle =P(\mathsf{\Omega }|f\left(\overrightarrow{n}\right)|{\mathsf{\Omega }}_t)$$

(63)

Doi’s definition of the state function and state vector ([8,9]) correspond to our system P-bra and P-ket respectively:

$$P(\mathsf{\Omega }|={\sum }_{\overrightarrow{n}}P(\overrightarrow{n}|\leftrightarrow \langle s|\equiv {\sum }_{\overrightarrow{n}}\langle \overrightarrow{n}|$$

$$|F\left(t\right)\rangle \equiv {\sum }_{\overrightarrow{n}}P(\overrightarrow{n},t)|\overrightarrow{n}\rangle \leftrightarrow |{\mathsf{\Omega }}_t)={\sum }_{\overrightarrow{n}}|\overrightarrow{n}\left)P\right(\overrightarrow{n}|{\mathsf{\Omega }}_t)$$

$$\therefore \langle \widehat{B}\left(\overrightarrow{n}\right)\rangle =\langle s|\widehat{B}\left(\overrightarrow{n}\right)|F\left(t\right)\rangle =P(\mathsf{\Omega }|\widehat{B}\left(\overrightarrow{n}\right)|{\mathsf{\Omega }}_t)$$

(64)

Note that the vector-basis here corresponds to the P-basis in Equation (28):

$${\widehat{n}}_i|\overrightarrow{n}\rangle =n_i|\overrightarrow{n}\rangle ,{\sum }_{\overrightarrow{n}}|\overrightarrow{n}\rangle \langle \overrightarrow{n}|=I_{\overrightarrow{n}},\langle \overrightarrow{n}|{\overrightarrow{n}}^{\prime }\rangle ={\delta }_{\overrightarrow{n},{\overrightarrow{n}}^{\prime }}=\prod _{i=1}{\delta }_{n_i,{n_i}^{\prime }}$$

(65)

In Peliti’s formalism ([8, p.1472]), the vector-basis (from population operator n) is normalized in a special way, so the expansion of the system P-bra is also changed:

$${\sum }_n|n\rangle \frac{1}{n!}\langle n|=I_n,\langle m|n\rangle =n!{\delta }_{m,n}$$

(66)

$$P(\mathsf{\Omega }|=P(\mathsf{\Omega }|I_n=\sum _n^{\infty }P(\mathsf{\Omega }|n)\frac{1}{n!}P(n|\underset{\left(2.3\right)}{=}\sum _n^{\infty }P(n|\frac{1}{n!}$$

(67)

Equation (67) can be identified with the standard bra, introduced in [8, Eq.(2.27-28)]:

$$\begin{array}{ccc}\hfill P(\mathsf{\Omega }|& =& {\sum }_n\frac{1}{n!}P(n|\leftrightarrow \langle |\equiv {\sum }_n\frac{1}{n!}\langle n|\hfill \\ \hfill |\mathsf{\Omega })& =& {\sum }_n|n)\frac{1}{n!}P(n|\mathsf{\Omega })\leftrightarrow |\varphi \rangle ={\sum }_m|m\rangle \frac{1}{m!}\langle m|\varphi \rangle \hfill \\ \hfill \therefore E\left[\widehat{A}\right]& \equiv & \langle \widehat{A}\rangle =\langle |\widehat{A}|\varphi \rangle =P(\mathsf{\Omega }|\widehat{A}|\mathsf{\Omega })\hfill \end{array}$$

(68)

3.3. The Heisenberg Picture

We call Equation (55) and (62) the evolution equations in the Schrödinger picture. Now we introduce the Heisenberg picture of a $R.V$ (or observable), similar to what is used in QM [1]:

$$|{\mathsf{\Omega }}_t)=\widehat{U}\left(t\right)|{\mathsf{\Omega }}_0)\Rightarrow \widehat{X}\left(t\right)={\widehat{U}}^{-1}\left(t\right)\widehat{X}\widehat{U}\left(t\right)$$

(69)

Based on $\widehat{U}\left(t\right)$, we can introduce following time-dependent P-basis:

$$\begin{array}{ccc}& & |x,t)={\widehat{U}}^{-1}\left(t\right)|x),P(x|\widehat{U}\left(t\right)=P(x,t|,P(x,t|x^{\prime },t)=P(x|x^{\prime }),P(\mathsf{\Omega }|x,t)=1\hfill \end{array}$$

(70)

$$\begin{array}{ccc}& & P(x^{\prime },t|\widehat{X}\left(t\right)|x,t)=P(x^{\prime }|\widehat{U}\left(t\right){\widehat{U}}^{-1}\left(t\right)\widehat{X}\widehat{U}\left(t\right){\widehat{U}}^{-1}\left(t\right)|x)=P(x^{\prime }|\widehat{X}|x)=xP(x^{\prime }|x)\hfill \end{array}$$

(71)

The probability density now can be interpreted in the two pictures:

$$P(x,t)\equiv P(x|{\mathsf{\Omega }}_t)=P(x|\widehat{U}\left(t\right)|{\mathsf{\Omega }}_0)=P(x,t|{\mathsf{\Omega }}_0)=P(x,t|\mathsf{\Omega })$$

(72)

In the last step, we have used the fact that in the Heisenberg picture, $|{\mathsf{\Omega }}_0)=|\mathsf{\Omega })$.

Definition 8. 

Time-dependent P-Identity: Equation (69-) also provides us with a time-dependent P-identity in the Heisenberg Picture:

$$\begin{array}{ccc}\hfill \mathrm{Discrete}\text{:}{I}_X\left(t\right)& =& {\widehat{U}}^{-1}\left(t\right)I_X\widehat{U}\left(t\right)={\widehat{U}}^{-1}\left(t\right){\sum }_i|x_i\left)P\right(x_i|\widehat{U}\left(t\right)\underset{\left(70\right)}{=}{\sum }_i|x_i,t\left)P\right(x_i,t|\hfill \\ \hfill \mathrm{Continuous}\text{:}{I}_X\left(t\right)& =& {\widehat{U}}^{-1}\left(t\right)I_X\widehat{U}\left(t\right)={\widehat{U}}^{-1}\left(t\right)\int |x)dxP(x|\widehat{U}\left(t\right)\underset{\mathit{(70)}}{=}\int |x,t)dxP(x,t|\hfill \end{array}$$

(73)

Now the expectation value of the stochastic process $X\left(t\right)$ can be expressed as:

$$\begin{array}{ccc}\hfill P(\mathsf{\Omega }|\widehat{X}\left(t\right)|\mathsf{\Omega })& =& P(\mathsf{\Omega }|\widehat{X}\left(t\right)I_X\left(t\right)|\mathsf{\Omega })=\int dxP(\mathsf{\Omega }|\widehat{X}\left(t\right)|x,t)P(x,t|\mathsf{\Omega })\hfill \\ & =& \int dxxP(x,t|\mathsf{\Omega })=\int dxxP(x|{\mathsf{\Omega }}_t)=P(\mathsf{\Omega }|X|{\mathsf{\Omega }}_t)\hfill \end{array}$$

(74)

This suggests that a Markov stochastic process can be thought as an operator in the Heisenberg picture, and its expectation value can be found from its Schrödinger picture. Additionally, if a Markov process $X\left(t\right)\equiv X_t$ is homogeneous, with independent and stationary increments ([4, p.15]), we can always set $X_0=0$ , and obtain the following useful property:

$$\begin{array}{ccc}\hfill P(X_{t+s}-X_s=x)& =& P(X_t-X_0=x|\mathsf{\Omega })\hfill \\ & =& P(X_t=x|\mathsf{\Omega })=P(x,t|\mathsf{\Omega })=P(x|{\mathsf{\Omega }}_t)\equiv P(x,t)\hfill \end{array}$$

(75)

Moreover, there is a relation between their transition probability and probability density:

$$P(x_2,t_2|x_1,t_1)=P(x_2-x_1,t_2-t_1|\mathsf{\Omega })\equiv P(x_2-x_1,t_2-t_1),(t_1<t_2)$$

(76)

3.4. Chapman-Kolmogorov Equations of transition probability [5,9]

These can now be easily obtained by inserting our time-dependent P-identity in Equations (73). For the HMC of discrete $R.V$ ([5]):

$$\begin{array}{ccc}\hfill {p^{m+n}}_{ij}& \equiv & P(j,m+n|i,0)=P(j,m+n|\widehat{I}\left(m\right)|i,0)=52\sum _k^{ }P(j,m+n|k,m\left)P\right(k,m|i,0)\hfill \\ & \underset{\mathrm{HMC}}{=}& {\sum }_{k}P(j,n|k,0)P(k,m|i,0)\underset{\underset{52}{=}}{ }{\sum }_k{p}^m{{ }_i}_k{p}^n{{ }_k}_j(\mathrm{Discrete}\mathrm{time})\hfill \end{array}$$

(77)

$$\begin{array}{ccc}\hfill p_{ij}(t+s)& \equiv & P(j,t+s|i,0)=P(j,t+s|\widehat{I}\left(s\right)|i,0)={\sum }_{k}P(j,t+s|k,s\left)P\right(k,s|0,i)\hfill \\ & \underset{\mathrm{HMC}}{=}& {\sum }_{k}P(j,t|k,0\left)P\right(k,s|0,i)={\sum }_k{p_i}_k\left(s\right){p_k}_j\left(t\right)(\mathrm{Continuous}\mathrm{time})\hfill \end{array}$$

(78)

For a Markov process of both continuous $R.V$ and time [9, Eq.(3.9),p.31]):

$$P(x,t|y,s)=P(x,t|\widehat{I}\left(\tau \right)|y,s)={\int }_{ }^{ }P(x,t|z,\tau \left)dzP\right(z,\tau |y,s)\mathrm{where}t>\tau >s$$

(79)

3.4.1. Absolute probability distribution (APD)

Likewise, we can find the time evolution of APD for a HMC simply by inserting P-identity $I(t=0)=I\left(0\right)$. For the HMC with discrete states ([5, p.174,214]):

$$\begin{array}{ccc}\hfill \mathrm{Discrete}\mathrm{time}:P(i,m)& =& P(i,m|\mathsf{\Omega })=P_i^{\left(m\right)},P(i,0)\equiv p_i^{\left(0\right)}\hfill \\ \hfill \therefore P_i^{\left(m\right)}=P(i,m|I\left(0\right)|\mathsf{\Omega })& =& {\sum }_{k}P(i,m|k,0)P(k,0|\mathsf{\Omega })={\sum }_k{p}_{{ }_k}^{\left(0\right)}{p^m}_{ki}\hfill \end{array}$$

(80)

Note that Equations (80) are identical to Equation (52):

$$\begin{array}{ccc}\hfill \mathrm{Continuous}\mathrm{time}:P(x_i,t)& =& P(x_i,t|\mathsf{\Omega })=P(x_i|{\mathsf{\Omega }}_t),P(x_i,0)\equiv p_i\left(0\right)\hfill \\ \hfill \therefore P(x_i,t)=P(x_i,t|I\left(0\right)|\mathsf{\Omega })& =& {\sum }_{k}P(x_i,t|x_k,0)P(x_k,0|\mathsf{\Omega })={\sum }_k{p}_k\left(0\right)p_{ki}\left(t\right)\hfill \end{array}$$

(81)

For a Markov process of both continuous $R.V$ and time ([9, p.26]]):

$$\begin{array}{ccc}\hfill P(x,t)& =& P(x,t|\mathsf{\Omega })=P(x|{\mathsf{\Omega }}_t),P(x,0)\equiv p^{\left(0\right)}\left(x\right)\hfill \\ \hfill \therefore P(x,t)& =& P(x,t|I\left(0\right)|\mathsf{\Omega })=\underset{ }{\int }dyP(x,t|y,0)P(y,0|\mathsf{\Omega })=\underset{ }{\int }dyP(x,t|y,0)p^{\left(0\right)}\left(y\right)\hfill \end{array}$$

(82)

3.5. Kolmogorov Forward and Backward Equations

If the Markov chains are stochastically continuous, then for infinitesimal h, the transition probability has the Taylor expansions ([4, Sec.(6.8)];[5, p.217]):

$$p_{ij}\left(h\right)=p_{ij}\left(0\right)+{p_{ij}}^{\prime }\left(0\right)h+o\left(h^2\right)={\delta }_{ij}+q_{ij}h+o\left(h^2\right)$$

(83)

Then, using the Chapman-Kolmogorov Equation (78), we have:

$$\begin{array}{ccc}\hfill {p_i}_j(t+h)& =& \sum _k^{ }{p_i}_k\left(t\right){p_k}_j\left(h\right)=\sum _k^{ }{p_i}_k\left(t\right)({\delta }_{kj}+q_{kj}h+o\left(h^2\right))\hfill \\ & =& {p_i}_j\left(t\right)+\sum _k^{ }{p_i}_k\left(t\right)(q_{kj}h+o\left(h^2\right))\hfill \end{array}$$

(84)

Therefore, we get following Kolmogorov Forward equations:

$$p{{{ }^{\prime }}_i}_j\left(t\right)=\underset{h\to 0}{lim}[({p_i}_j(t+h)-{p_i}_j\left(t\right))/h]=\sum _k^{ }{p_i}_k\left(t\right){q_k}_j$$

(85)

Similarly, we can derive the Kolmogorov Backward equations:

$${p_i}_j(h+t)=\sum _k^{ }{p_i}_k\left(h\right){p_k}_j\left(t\right)\Rightarrow p{{{ }^{\prime }}_i}_j\left(t\right)=\sum _k^{ }{q_i}_k{p_k}_j\left(t\right)$$

(86)

Using Equations (81) and (83) one can extend Equation (62) to a continuous-time HMC.

3.6. Transition Probability and Path Integrals

From Equation (62) and (70) the transition probability of a Markov process can be expressed as follows (assuming $t_a<t_0<t_b$):

$$P(x_b,t_b|x_a,t_b)=P(x_b|U(t_b,t_0)U^{-1}(t_a,t_0)|x_a)=P(x_b|U(t_b,t_a)|x_a)=P(x_b|e^{{\int }_{t_a}^{t_b}dtL}|x_a)$$

(87)

We can divide time interval into small pieces and insert the P-identity N times:

$$\begin{array}{ccc}\hfill \Delta t=t_{n+1}-t_n=(t_b-t_a)/(N+1)>0,& & t_N=t_b,t_0=t_a;x_N=x_b,x_0=x_a,\hfill \\ \hfill P(x_b,t_b|x_a,t_a)=P(x_b,t_b|I\left(t_N\right)..I\left(t_1\right)|x_a,t_a)& =& {\prod }_{n=1}^N{\int }_{-\infty }^{\infty }d{x}_{n}P(x_n,t_n|x_{n-1},t_{n-1})\hfill \end{array}$$

(88)

$$\begin{array}{ccc}\hfill ={\prod }_{n=1}^N{\int }_{-\infty }^{\infty }d{x}_{n}P(x_n|\widehat{U}(t_n,t_{n-1})|x_{n-1})& =& {\prod }_{n=1}^N{\int }_{-\infty }^{\infty }d{x}_{n}P(x_n|e^{L\Delta t}|x_{n-1})\hfill \end{array}$$

(89)

It perfectly matches the starting equation of Feynman’s path integral for the transition amplitude in QM ([10]):

$$\langle x_b,t_b|x_a,t_a\rangle ={\prod }_{n=1}^N{\int }_{-\infty }^{\infty }d{x}_n\langle x_n|\widehat{U}(t_n,t_{n-1})|x_{n-1}\rangle ={\prod }_{n=1}^N{\int }_{-\infty }^{\infty }d{x}_n\langle x_n|e^{-\frac{i}{\hslash }\widehat{H}\Delta t}|x_{n-1}\rangle$$

(90)

For a free particle, $V\left(x\right)=0$, the Schrödinger equation and resulted transition amplitude from Feynman’s path integral are (see [10, Eq.(2.125)]):

$$i\hslash \frac{\partial }{\partial t}\psi \left(x\right)=\langle x|\widehat{H}|\mathsf{\Psi }\left(t\right)\rangle =-\frac{{\hslash }^2}{2m}\frac{{\partial }^2}{\partial x^2}\psi \left(x\right),\langle x|\mathsf{\Psi }\left(t\right)\rangle =\psi \left(x\right)$$

(91)

$$\langle x_b,t_b|x_a,t_a\rangle =\sqrt{\frac{m}{2\pi i\hslash (t_b-t_a)}}exp\left[\frac{im{(x_b-x_a)}^2}{2\hslash (t_b-t_a)}\right]$$

(92)

4. Examples of Homogeneous Markov Processes

Now let us observe some important examples of the HMC using the PBN.

4.1. PoissonProcess([4, p.250],[5, p.161])

It is a counting process, $N\left(t\right)$, having following properties:

1

$\left\{N\right(t),t\ge 0\}$ is non-negative process with independent increments and $N\left(0\right)=0$;

2

It is homogeneous and its probability distribution is given by:

$$\begin{array}{ccc}\hfill m(k,t)& \equiv & P([N(t+s)-N\left(s\right)=k]|\mathsf{\Omega })\underset{\begin{array}{c}independent\\ increment\end{array}}{=}P([N\left(t\right)-N\left(0\right)=k]|\mathsf{\Omega })\hfill \\ & \underset{N\left(0\right)=0}{=}& P([N\left(t\right)=k]|\mathsf{\Omega })\equiv P(k|\mathsf{\Omega }\left(t\right))\underset{\begin{array}{c}Poisson\\ Distribution\end{array}}{=}\frac{{\left(\lambda t\right)}^k}{k!}{e}^{-\lambda t}\hfill \end{array}$$

(93)

It can be shown [5, p.161] that:

$$\mu \left(t\right)\equiv \overline{N}\left(t\right)=\sum _k^{ }km(k,t)=\lambda t;{\sigma }^2\left(t\right)\equiv P(\mathsf{\Omega }|{[N\left(t\right)-\overline{N}\left(t\right)]}^2|\mathsf{\Omega })=\lambda t$$

(94)

It can be shown (see [5, p.215]; [11, Theorem 1.5,p.6]) that Poisson Process has Markov property, and its transition probability is:

$$\begin{array}{ccc}& & P([N(t+s)=j]|N\left(t\right)=i)=P([N(t+s)-N\left(t\right)=j-i]|\mathsf{\Omega })=\frac{{\left(\lambda t\right)}^{j-i}}{(j-i)!}{e}^{-\lambda t},i\mathrm{f}j\ge i\hfill \\ & & p_{ij}\left(t\right)=0,\mathrm{if}j<i\hfill \end{array}$$

(95)

4.2. Wiener-LevyProcess(see[5, p.159];[9, sec.(3.6),p.32])

It is a homogeneous process with independent and stationary increments and $W\left(0\right)=0$. Its probability density is a normal (Gaussian) distribution $N(0,t{\sigma }^2)$:

$$P(x,t)\equiv P([W(t+s)-W\left(s\right)=x]|\mathsf{\Omega })\underset{homogeneous}{=}P([W\left(t\right)-W\left(0\right)=x]|\mathsf{\Omega })$$

(96)

Its stationary increment is defined as:

$$P(x_2,t_2|x_1,t_1)=\frac{1}{\sqrt{2\pi (t_2-t_1)}\sigma }exp\left[-\frac{{(y_2-y_1)}^2}{2(t_2-t_1){\sigma }^2}\right],(t_1<t_2)$$

(97)

We see that the Wiener-Levy process satisfies Equation (76).

$$P(x_2,t_2|x_1,t_1)=P(x_2-x_1,t_2-t_1),(t_1<t_2)$$

(98)

It can be verified ([5, p.161]) that it is an $N(0,t{\sigma }^2)$:

$$\tilde{\mu }\left(t\right)\equiv P(\mathsf{\Omega }|W\left(t\right)|\mathsf{\Omega })=0,{\tilde{\sigma }}^2\left(t\right)\equiv P(\mathsf{\Omega }|W{\left(t\right)}^2|\mathsf{\Omega })=t{\sigma }^2$$

(99)

4.3. Brownianmotion([4, Sec.(10.1),p.524];[9, p.6,42])

The stochastic process $X\left(t\right)$ has $X\left(0\right)=0$, has stationary and independent increments for $t\ge 0$ and its density function for $t>0$ is a normal distribution $N(t\mu ,t{\sigma }^2)$, or:

$$P(x,t)\equiv P(x|\mathsf{\Omega }\left(t\right))=\frac{1}{\sqrt{2\pi t}\sigma }exp\left[-\frac{{(x-\mu t)}^2}{2t{\sigma }^2}\right]$$

(100)

Brownian motions have stationary and independent increments ([4, Sec.(10),p.524,529]), so they are a HMC and satisfy Equation (76). They are the solution of the following master equation (Einstein’s diffusion equation, see [9, p.6]) with a drift speed $\mu$:

$$\frac{\partial }{\partial t}P(x,t)=D\frac{{\partial }^2}{\partial x^2}P(x,t),D=\frac{\sigma }{\sqrt{2}}.$$

(101)

Here the constant D is called the diffusion coefficient. Equation (101) can be interpreted as a special HMC case of Equation (62), given in the x-basis:

$$\frac{\partial }{\partial t}P(x|{\mathsf{\Omega }}_t)={\int }_{ }d{x}^{\prime }P(x|\widehat{L}|x^{\prime })P(x^{\prime }|{\mathsf{\Omega }}_t),P(x|\widehat{L}|x^{\prime })=D\frac{{\partial }^2}{\partial x^2}\delta (x-x^{\prime })$$

(102)

Equation (102) closely resembling Schrödinger’s Equation (7) for a free particle in the x-basis:

$$i\hslash \frac{\partial }{\partial t}\langle x|\mathsf{\Psi }\left(t\right)\rangle ={\int }_{ }d{x}^{\prime }\langle x|\widehat{H}|x^{\prime }\rangle \langle x^{\prime }|\mathsf{\Psi }\left(t\right)\rangle ,P(x|\widehat{H}|x^{\prime })=\frac{-{\hslash }^2}{2m}\frac{{\partial }^2}{\partial x^2}\delta (x-x^{\prime })$$

(103)

5. Special Wick Rotation, Time Evolution and Induced Diffusions

The induced microscopic diffusion is defined by the following equation:

$$\frac{\partial }{\partial t}P(x,t)=\widehat{G}\left(x\right)P(x,t),\widehat{G}=\frac{1}{2{\mu }_{\hslash }}\frac{{\partial }^2}{\partial x^2}-{\mu }_{\hslash }u\left(x\right),{\mu }_{\hslash }\equiv \frac{m}{\hslash }$$

(104)

The Special Wick Rotation (SWR), caused by the imaginary time rotation Wick rotation $(it\to t)$ [12], is defined by:

$$\mathrm{SWR}\text{:}it\to t,|\psi \left(t\right)\rangle \to |{\mathsf{\Omega }}_t),\langle x_b,t_b|x_a,t_a\rangle \to P(x_b,t_b|x_a,t_a)$$

(105)

Under a SWR, Schrödinger Equation (7) is shifted to the induced micro diffusion (104):

$$\begin{array}{ccc}\hfill \frac{\partial }{i\partial t}|\psi \left(t\right)\rangle & =& \frac{-1}{\hslash }\widehat{H}|\psi \left(t\right)\rangle \to \frac{\partial }{\partial t}|{\mathsf{\Omega }}_t)=G|{\mathsf{\Omega }}_t)\hfill \end{array}$$

(106)

$$\begin{array}{ccc}\hfill -\frac{1}{\hslash }\widehat{H}=\frac{\hslash {{\partial }_x}^2}{2m}-\frac{m}{\hslash }\frac{V\left(x\right)}{m}& \equiv & \frac{{{\partial }_x}^2}{2{\mu }_{\hslash }}-{\mu }_{\hslash }u\left(x\right)\to \widehat{G}=\frac{1}{2{\mu }_{\hslash }}\frac{{\partial }^2}{\partial x^2}-{\mu }_{\hslash }u\left(x\right)\hfill \end{array}$$

(107)

The simplest example is the Induced Micro Einstein-Brown motion when $u\left(x\right)=0$ in Equation (104). Applying (105) to the transition amplitude in Equation (92), we get the transition probability:

$$P(x_b,t_b|x_a,t_a)=\sqrt{\frac{1}{4\pi D_{\hslash }(t_b-t_a)}}exp\left[-\frac{{(x_b-x_a)}^2}{4D_{\hslash }(t_b-t_a)}\right]$$

(108)

Here we have introduced the induced micro diffusion coefficient,

$$D_{\hslash }\equiv 1/\left(2{\mu }_{\hslash }\right)=\hslash /\left(2m\right)$$

(109)

Similarly, applying (105) to the Schrödinger for free particle, Equation (103), we get the Einstein’s diffusion equation (102), with $D_{\hslash }\to D$.

5.0.1. A Special non-Hermitian Case

We can apply Dirac notation and the PBN together to solve the following special quantum system with a non-Hermitian Hamiltonian:

$$\widehat{H}={\widehat{H}}_1-i{\widehat{H}}_2;{\widehat{H}}_1={{\widehat{H}}_1}^{†};{\widehat{H}}_2={{\widehat{H}}_2}^{†};[{\widehat{H}}_1,{\widehat{H}}_2]=0;{\partial }_t\widehat{H}=0$$

(110)

Then the time-evolution equation can be written as:

$$i\hslash {\partial }_t\left[|{\mathsf{\Psi }}_t\rangle |{\mathsf{\Omega }}_t)\right]=\left[{\widehat{H}}_1|\mathsf{\Psi }{ }_t\rangle \right]|{\mathsf{\Omega }}_t)+|\mathsf{\Psi }{ }_t\rangle \left[-i{\widehat{H}}_2|{\mathsf{\Omega }}_t)\right]$$

(111)

It leads to two equations:

$${\partial }_t|\mathsf{\Psi }{ }_t\rangle =-\frac{i}{\hslash }{\widehat{H}}_1|\mathsf{\Psi }{ }_t\rangle ,{\partial }_t|{\mathsf{\Omega }}_t)=\frac{-1}{\hslash }{\widehat{H}}_2|{\mathsf{\Omega }}_t)\underset{\left(\right)}{=}\widehat{G}|{\mathsf{\Omega }}_t\left)\right)$$

(112)

The first is an ordinary Schrodinger equation while the second is a master equation for an induced micro diffusion. The product of their solutions is the solution of Equation (111). Suppose we have ${\widehat{H}}_1\left(x\right)$ and ${\widehat{H}}_2\left(y\right)$, then the product of Equation (89) and Equation (90) gives the path-integral expression of the system:

$$[\langle x_b,t_b|P(y_b,t_b|]e^{-{\int }_{t_a}^{t_b}dt\frac{i}{\hslash }[{\widehat{H}}_1\left(x\right)-i{\widehat{H}}_2\left(y\right)]}|[x_a,t_a\rangle |y_a,t_a\left)\right]$$

$$={\prod }_{m=1}^N{\int }_{-\infty }^{\infty }d{x}_m\langle x_m|e^{-\frac{i}{\hslash }{\widehat{H}}_1\left(x\right)\Delta t}|x_{m-1}\rangle {\prod }_{n=1}^N{\int }_{-\infty }^{\infty }d{y}_{n}P(y_n|e^{\widehat{G}\left(y\right)\Delta t}|y_{n-1})$$

(113)

6. Potential Applications

Hermitian operators are sufficient for “pure” eigenvalue states for closed systems where the energies are conserved and real valued. However, for mixed states and in a number of physical circumstances, non-Hermitian operators have had to be considered. It is well known that any non-Hermitian linear operator $\widehat{C}$ can be expressed in the form:

$$\widehat{C}=\widehat{A}+i\widehat{B}$$

(114)

where $\widehat{A}$ and $\widehat{B}$ are Hermitian and commute with each other, by letting $\widehat{A}=(\widehat{C}+{\widehat{C}}^{†})/2$ and $\widehat{B}=(\widehat{C}-{\widehat{C}}^{†})/\left(2i\right)$. Note that $\widehat{B}\to i\widehat{B}$ can be treated as a wick rotation in the path-integral application of the PBN. Section 5.0.1 dovetails into the matter of general linear operators where there have been a number of applications. We mention:

• The method of “complex scaling” applied to quantum mechanical Hamiltonians was a “hot” area in the area of atomic and molecular Physics during the 1970s and early 1980s and involved non-Hermitian linear operators. We cite an application by the Mathematician Barry Simon of complex scaling to non-relativistic Hamiltonians for molecules [13].
• Another application requiring such an operator was made by Botten et al. [14]. They show how to solve a practical problem involving wave scattering using a bi-orthogonal basis, where there is a VPN bra basis and a ket basis consisting of different functions. In a unitary problem, these VPN bra and ket basis functions would be the same. Here, the Helmholtz equation Laplacian ${\nabla }^{2}f+k^{2}f=0$ has a wave number k which is complex. The imaginary part of k indicates loss or gain depending on its sign.
• Konstantin G. Zloshchastiev has made many applications on the general density operator approach with non-Hermitian Hamiltonians of the form Equation (114) applied to e.g. open dissipative systems, which automatically deals with mixed states (see [15,16,17]).
• Consider a rectangular real data matrix $\widehat{Q}$. Its similarity matrix (or adjacency matrix) $\widehat{S}$ and corresponding row stochastic (Markov) matrix $\widehat{R}$ defined by:

  $$\widehat{S}=\widehat{Q}*{\widehat{Q}}^T{R}_{i,j}=S_{ij}/\sum _k{S}_{i,k}$$

  (115)
  The symmetric matrix $\widehat{S}$ has real eigenvalues as does $\widehat{R}$ even though the latter is non-symmetric. $\widehat{R}$ is a transition matrix in the language of QM but also the key operator in the Meila-Shi algorithm of spectral clustering, and quantum clustering with IT applications in science, engineering, (unstructured) text using a “bag-of-words” model [18,19,20,21] and even medicine [22]. Probably, the PBN may provide us with some new approaches to quantum clustering.

If the real data matrix $\widehat{Q}$ in Equation (115) is huge but very sparse (as is often the case in a “bag-of-words” model[20]), we may use the PBN to find other alternative algorithms for text document clustering. Suppose that the dataset has a vocabulary of N labeled keywords, which serve as the P-basis in Equation (28), and $q_{\mu ,k}$ represents the frequency of $k^{th}$ keyword in document $Q_{\mu }$. Since $q_{\mu ,k}$ can be greater than 1, they behave like the occupation numbers of a Boson system in Quantum Field Theory. The conditional probability of finding doc $Q_{\mu }$ given doc $Q_{\nu }$ is:

$$P(Q_{\mu }|Q_{\nu })={\sum }_k^{N}P(Q_{\mu }|k)(k|Q_{\nu })\underset{\left(14\right)}{=}{\sum }_{k\in Q_{\mu }}^{ }P(k|Q_{\nu });P(k|Q_{\mu })=q_{\mu ,k}/{\sum }_{k\in Q_{\mu }}^{ }{q}_{\mu ,k}$$

(116)

Now, for example, we can define the relevance of two docs and get its expression as:

$$R_{\mu ,\nu }\equiv \frac{1}{2}[P(Q_{\mu }|Q_{\nu })+P(Q_{\nu }|Q_{\mu })]=\frac{1}{2}\left[{\sum }_{k\subset Q_{\mu }}^{ }P(k|Q_{\nu })+{\sum }_{k\subset Q_v}^{ }P(k|Q_{\mu })\right]$$

(117)

This algorithm may be very effective for huge data sets with a lot of abstracts of articles published in many journals with different subjects.

7. Summary and Discussion

Inspired by Dirac’s notation used in quantum mechanics (QM), we proposed the Probability Bracket Notation (PBN). We demonstrated that the PBN could be a very useful tool for symbolic representation and manipulation in probability modeling, like the various normalization and expectation formulas for systems of single or multiple random variables, as well as the master equations of homogeneous Markov processes. We also show that a stationary Schrödinger Equation (103) naturally becomes a master equation under the special Wick rotation (see Equations 106-).

We have shown the similarities between many QM expressions in VBN and related probabilistic expressions in PBN, which might provide us with a beneficial bridge connecting the quantum world with the classical one. We also showed how the PBN could be applied to problems which require non-Hermitian operators. We make no pretense that the PBN creates new Physics. Rather it provides a notational interdisciplinary “umbrella” to various statistical and physical processes and thereby opens up the possibility of their synthesis and integration.

8. Conclusions

Of course, more investigations need to be done to verify the consistency (or correctness), usefulness and limitations of our proposal of the PBN but it is is intriguing in its possibility of expressing formulations from classical statistics and QM and handling non-Hermitian operators.