Preprint
Article

This version is not peer-reviewed.

A Transverse Hamiltonian Approach to Infinitesimal Perturbation Analysis of Quantum Stochastic Systems

A peer-reviewed article of this preprint also exists.

Submitted:

29 May 2023

Posted:

31 May 2023

You are already at the latest version

Abstract
This paper is concerned with variational methods for open quantum systems with Markovian dynamics governed by Hudson-Parthasarathy quantum stochastic differential equations. These QSDEs are driven by quantum Wiener processes of the external bosonic fields and are specified by the system Hamiltonian and system-field coupling operators. We consider the system response to perturbations in these operators and introduce a transverse Hamiltonian which encodes the propagation of the perturbations through the unitary system-field evolution. This approach provides an infinitesimal perturbation analysis tool which can be used for the development of optimality conditions in quantum control and filtering problems. Such settings employ, as performance criteria, quadratic (or more complicated) cost functionals of the system and field variables to be minimised over the energy and coupling parameters of system interconnections. We demonstrate an application of the transverse Hamiltonian variational approach to a mean square optimal coherent quantum filtering problem for a measurement-free field-mediated cascade connection of a quantum system with a quantum observer.
Keywords: 
;  ;  ;  

1. Introduction

In comparison with classical mechanics which considers macroscopic objects both in deterministic and stochastic settings, quantum mechanics, concerned with physical phenomena at atomic and subatomic scales, inherently incorporates randomness. In particular, the squared absolute value of the wave function of a quantum mechanical particle is interpreted as a probability density function, mixed quantum states are built of pure ones using randomisation, and the latter is also present in the model of quantum measurement [39,51]. However, in contrast to scalar-valued classical probability measures [41], quantum probability describes statistical properties of quantum variables by using quantum states in the form of density operators [16,30] on the same Hilbert space where those variables act as linear operators.
The noncommutativity and canonical commutation structures, coming from the operator-valued nature of quantum variables and quantum states, give rise to specific features of quantum probability such as the absence of a classical joint probability distribution and conditional expectations for a set of noncommuting quantum variables (whereas an individual self-adjoint operator has a well-defined marginal distribution). Furthermore, since the microscopic realm is less amenable to manipulation by conventional macroscopic tools (unlike, for example, the coin tossing as a manageable “random number generator” for thought and practical experiments in classical probability theory), its natural time evolution makes statistical properties of quantum systems particularly tied to their dynamics. While an isolated quantum system undergoes a reversible evolution (according to a one-parameter unitary group generated by the system Hamiltonian), a more realistic open dynamics scenario [6] involves interaction of the system with its environment which can include other quantum or classical systems, measuring devices and external quantum fields (quantised electromagnetic radiation).
The interaction of an open quantum system with its surroundings is accompanied by energy exchange between the subsystems and gives rise to dissipative effects. This provides a way to influence statistical and dynamic properties of such systems by arranging them into quantum networks [14] and varying the energy and coupling parameters of the resulting interconnections, which can consist of a quantum plant coupled in a measurement-based or coherent (that is, measurement-free) fashion to a controller or observer. This paradigm is used in quantum control [3,5,8] which develops systematic methods for achieving stability, robustness with respect to unmodelled dynamics, and optimality in the sense of relevant performance criteria for quantum systems and their applications, for example, in quantum optics [11,50] and quantum information processing [32].
An important part in these developments belongs to quantum filtering, which, similarly to its classical predecessor (see for example, [23,28]), is concerned with mean square optimal real time estimation of the internal variables of the quantum plant using a measurement-based quantum Kalman filter [2,4,9] or a qualitatively different coherent quantum observer [31,45]. The latter does not process classical observations and, in contrast to the classical filters, does not compute the conditional expectations of the plant variables (this conditioning and related Bayesian approaches are not applicable in the noncommutative quantum case as mentioned above). Instead, the coherent quantum filter is driven by the output quantum fields of the plant so as to produce a quantum process, whose performance, as an estimator of the plant variables, can be optimised in the sense of minimising the mean square value of the “estimation error” by varying the parameters of the Hamiltonian and coupling operators of the filter.
The optimisation problems, arising in coherent quantum filtering and control (with the latter considering more complicated feedback interconnections of a quantum plant and a quantum controller) involve physical realisability (PR) constraints [22,40] which originate from the canonical commutation structures of quantum dynamic variables, the energetics of open quantum systems, and unitarity in the augmented system-environment evolution. These features of open quantum dynamics are incorporated in the Hudson-Parthasarathy quantum stochastic calculus [19,35] (see also [15]) which is often employed as a unified modelling framework in quantum filtering and control. In this approach, the external fields at the input of a quantum system of interest are represented by a multichannel quantum Wiener process with noncommuting components, which act on a symmetric Fock space and drive the quantum stochastic differential equation (QSDE) governing the system dynamics. In contrast to the classical SDEs with a standard Wiener process [24], the QSDE reflects the unitarity of the augmented system-field evolution, and its drift and dispersion terms (as well as the generator of Markovian quantum dynamics) are specified by the Hamiltonian and coupling operators. These operators (together with a scattering matrix representing the photon exchange between the fields [35]) describe the energetics of the quantum system and its interaction with the environment and are usually functions (for example, polynomials or Weyl quantization integrals [10]) of the system variables. A particular form of this dependence and the commutation structure of the system variables affect tractability of the quantum system.
In particular, a quadratic dependence of the system Hamiltonian and a linear dependence of the system-field coupling operators on the quantum mechanical position-momentum variables [29] lead to linear QSDEs for open quantum harmonic oscillators (OQHOs) [9,11] which play the role of building blocks in linear quantum control theory [8,22,34,38,54,55]. The dynamics of such systems are relatively well understood and are similar to the classical linear SDEs in a number of respects, including the preservation of Gaussian nature of quantum states [20,36] in the case of vacuum input fields. However, the coherent quantum analogue [33] of the classical linear-quadratic-Gaussian (LQG) control problem [1,25] for OQHOs is complicated by the above mentioned PR constraints on the state-space matrices of the quantum controller and by the impossibility to take advantage of the classical estimation-actuation separation principle and classical conditional expectations with their variational properties [28].
One of the existing approaches to the coherent quantum LQG (CQLQG) control and coherent quantum filtering (CQF) problems employs the Frechet derivatives of the mean square cost (with respect to the state-space matrices subject to the PR constraints) for obtaining the optimality conditions [44,45] and for the numerical optimization [42]. This approach takes into account the quantum nature of the underlying problem only through the PR constraints, being “classical” in all other respects, which has its own advantages from the viewpoint of well-developed conventional optimization methods. However, a disadvantage of this approach is that it is limited to certain parametric classes of linear controllers and observers. In particular, the resulting optimality conditions do not provide information on whether nonlinear quantum controllers or observers can outperform the linear ones for linear quantum plants. For this reason, the coherent quantum control and filtering problems require novel variational methods for their solution, which would be able to operate with sensitivity of the system dynamics and relevant cost functionals to perturbations over wider classes of the Hamiltonian and coupling operators in a “coordinate-free” fashion.
To this end, the present paper (some of its results were briefly announced in [48]) outlines a fully quantum variational method which allows the sensitivity of the internal and output variables of a nonlinear quantum stochastic system to be investigated with respect to arbitrary (that is, not only linear-quadratic) perturbations of the Hamiltonian and coupling operators. This approach is based on using a transverse Hamiltonian, defined as an auxiliary time-varying self-adjoint operator which encodes the propagation of such perturbations through the unitary system-field evolution. This leads to an infinitesimal perturbation formula for quantum averaged performance criteria (such as the mean square cost functional) which is applicable to the development of optimality conditions in coherent quantum control and filtering problems over larger classes of controllers and observers. In particular, this approach allows the sensitivity of OQHOs with quadratic performance criteria to be studied with respect to general perturbations of the Hamiltonian and coupling operators. In fact, the transverse Hamiltonian method has already been employed in [47] in order to establish local sufficiency of linear observers in the mean square optimal CQF problem [45] for linear quantum systems with respect to varying the Hamiltonian and coupling operators of the observer along linear combinations of the Weyl operators [10]. Note that our approach is different from [13] which develops a quantum Hamilton-Jacobi-Bellman principle (for the density operator instead of the dynamic variables) in a measurement-based quantum feedback control problem. We also mention a parallel between the perturbation analysis, discussed in the present paper, and the fluctuation-dissipation theorem [26].
The paper is organised as follows. Section 2 specifies the class of quantum stochastic systems under consideration. Section 3 discusses sensitivity of the internal and output variables of OQHOs to parametric perturbations within the families of quadratic system Hamiltonians and linear system-field coupling operators. Section 4 returns to general QSDEs and introduces the transverse Hamiltonian associated with arbitrary perturbations of the Hamiltonian and coupling operators of the system. The transverse Hamiltonian is used in Section 5 for infinitesimal perturbation analysis of system operators. Section 6 extends the transverse Hamiltonian method to quantum averaged performance criteria. Section 7 applies this approach to a mean square optimal CQF problem. Section 8 makes concluding remarks.
We use the following principal notation in the paper. Denoted by [ A , B ] : = A B B A is the commutator of linear operators A, B, with ad A ( · ) : = [ A , · ] a linear superoperator associated with A. This extends to the commutator ( n × m ) -matrix [ X , Y T ] : = X Y T ( Y X T ) T = ( [ X j , Y k ] ) 1 < j < n , 1 < k < m for vectors X, Y of operators X 1 , , X n , Y 1 , , Y m , respectively. Vectors are organised as columns unless indicated otherwise, and the transpose ( · ) T acts on matrices of operators as if their entries were scalars. In application to such matrices, ( · ) : = ( ( · ) # ) T is the transpose of the entry-wise operator adjoint ( · ) # . For complex matrices, ( · ) is the usual complex conjugate transpose ( · ) * : = ( ( · ) ¯ ) T . The subspaces of real symmetric, real antisymmetric and complex Hermitian matrices of order n are denoted by S n , A n and H n : = S n + i A n , respectively, where i : = 1 is the imaginary unit. The real and imaginary parts of a complex matrix are denoted by Re ( · ) and Im ( · ) . These extend to matrices M with operator-valued entries as Re M : = 1 2 ( M + M # ) and Im M : = 1 2 i ( M M # ) which consist of self-adjoint operators. Positive (semi-) definiteness of matrices and the corresponding partial ordering are denoted by (≽) ≻. Also, S n + and H n + denote the sets of positive semi-definite real symmetric and complex Hermitian matrices of order n, respectively. The tensor product of spaces or operators (in particular, the Kronecker product of matrices) is denoted by ⊗. The tensor product A B of operators A, B acting on different spaces will sometimes be abbreviated as A B . The identity matrix of order n is denoted by I n , and the identity operator on a space H by I H . The Frobenius inner product of real or complex matrices is denoted by M , N : = Tr ( M * N ) . Denoted by v K : = v T K v is a weighted Euclidean (semi-)norm of a real vector v specified by a real positive (semi-)definite symmetric matrix K. The quantum expectation E ξ : = Tr ( ρ ξ ) of a quantum variable ξ over a density operator ρ extends in an entry-wise fashion to vectors and matrices of such variables.

2. Quantum stochastic systems being considered

We consider an open quantum system, which interacts with an external multichannel bosonic field and is equipped with dynamic variables X 1 ( t ) , , X n ( t ) , evolving in time t 0 and assembled into a vector X ( t ) : = ( X k ( t ) ) 1 k n . These system variables are assumed to be self-adjoint operators on a composite system-field Hilbert space H F . Here, H is the initial space of the system, which provides a domain for X 1 ( 0 ) , , X n ( 0 ) , and F is a symmetric Fock space [35] for the action of an even number m of quantum Wiener processes W 1 ( t ) , , W m ( t ) . The latter are time-varying self-adjoint operators, which model the external fields and are assembled into a vector W ( t ) : = ( W k ( t ) ) 1 k m . Unlike the classical Brownian motion [24] in R m , the quantum Wiener process W consists of noncommuting operator-valued components and has a complex Ito matrix Ω : = ( ω j k ) 1 j , k m H m + (identified with Ω I F ) for its future-pointing Ito increments d W :
d W ( t ) d W ( t ) T = Ω d t , Ω : = I m + i J .
Here, the matrix J A m specifies the canonical commutation relations (CCRs) for the constituent field processes W 1 , , W m :
[ d W ( t ) , d W ( t ) T ] = 2 i J d t , J : = I m / 2 J , J : = 0 1 1 0
(with J spanning the subspace of antisymmetric ( 2 × 2 ) -matrices), which is an incremental form of the two-point CCRs
[ W ( s ) , W ( t ) T ] = 2 i min ( s , t ) J , s , t 0 .
These CCRs are closely related to the continuous tensor-product structure of the Fock space [37] and are complemented by the commutativity between the Ito increments of W and adapted processes Z : = ( Z ( t ) ) t 0 taken at the same (or an earlier) moment of time:
[ Z ( s ) , d W ( t ) ] = 0 , t s 0 .
The adaptedness of quantum processes on the system-field space H F is understood with respect to a filtration ( H t ) t 0 , where
H t : = H F t ,
and ( F t ) t 0 is the Fock space filtration, so that for any t 0 , the operators W j ( t ) act effectively on F t , while X k ( t ) act on the subspace H t .
The energetics of the quantum system and its interaction with the external fields is specified by a system Hamiltonian H ( t ) and system-field coupling operators L 1 ( t ) , , L m ( t ) which are time-varying self-adjoint operators, organised as deterministic functions (for example, polynomials with constant coefficients) of the system variables X 1 ( t ) , , X n ( t ) and assembled into a vector L ( t ) : = ( L k ( t ) ) 1 k m . Accordingly, the operators H ( 0 ) , L 1 ( 0 ) , , L m ( 0 ) act on the initial space H . Depending on the context, a system operator σ (a function of the initial system variables X 1 ( 0 ) , , X n ( 0 ) ) on the initial space H will be identified with its extension σ I F to the system-field space H F .
The system and the fields form a composite quantum system which evolves according to a quantum stochastic flow as described below. This evolution is specified at any time t 0 by a unitary operator U ( t ) on H F governed by the following stochastic Schrödinger equation [19,35]:
d U ( t ) = i ( H 0 d t + L 0 T d W ( t ) ) + 1 2 L 0 T Ω L 0 d t U ( t ) ,
with initial condition U 0 : = I H F , so that U ( t ) captures the internal dynamics of the system and the system-field interaction over the time interval [ 0 , t ] . Here and in what follows, the subscript 0 marks the initial values of time-varying operators (or vectors or matrices of operators): H 0 : = H ( 0 ) , L 0 : = L ( 0 ) , U 0 : = U ( 0 ) , while the time arguments will often be omitted for the sake of brevity. Also, the units are chosen so that the reduced Planck constant is = 1 . The quantum stochastic differential equation (QSDE) (6) corresponds to a particular yet important case of the identity scattering matrix, when there is no photon exchange between the fields, and the gauge processes [35] can be eliminated from consideration. The term L 0 T d W in (6) can be interpreted as an incremental Hamiltonian of the system-field interaction, while 1 2 L 0 T Ω L 0 d t involves the quantum Ito matrix Ω from (1) and counterbalances the Ito correction term d U d U = L 0 T Ω L 0 d t in the differential relation d ( U U ) = ( d U ) U + U d U + d U d U = 0 which describes the preservation of the co-isometry property U ( t ) U ( t ) = U 0 U 0 = I H F for all t 0 . The system variables at time t 0 , as operators on the system-field space H F , are the images
X k ( t ) = j t ( X k ( 0 ) ) , k = 1 , , n ,
of their initial values under the quantum stochastic flow j t which maps a system operator σ 0 on the initial space H to the operator
σ ( t ) : = j t ( σ 0 ) = U ( t ) ( σ 0 I F ) U ( t )
on H t in (5). The resulting quantum adapted process σ satisfies the following Hudson-Parthasarathy QSDE [19,35]:
d σ = G ( σ ) d t i [ σ , L T ] d W , G ( σ ) : = i [ H , σ ] + D ( σ ) ,
where use is made of the Hamiltonian and the coupling operators evolved by the flow j t from (8) as
H ( t ) = j t ( H 0 ) , L ( t ) = j t ( L 0 ) : = ( j t ( L k ( 0 ) ) ) 1 k m
(the flow acts entry-wise on vectors and matrices of operators). Also, D in (9) is the decoherence superoperator which acts on σ ( t ) as
D ( σ ) : = 1 2 ( L T Ω [ σ , L ] + [ L T , σ ] Ω L ) = [ σ , L T ] Ω L 1 2 [ L T Ω L , σ ] .
The second equality in (11) is applicable to the case when σ is a vector of operators on which the superoperator D acts entry-wise. The superoperator G in (9) is the Gorini-Kossakowski-Sudarshan-Lindblad (GKSL) generator [12,27], which is a quantum counterpart of the infinitesimal generators of classical Markov processes [24]. The identity ( σ 0 I F ) U = U σ , which holds for system operators σ in view of (8) and the unitarity of U ( t ) , allows the QSDE (6) to be represented in the Heisenberg picture by using (10) along with the commutativity (4) as
d U = U i ( H d t + L T d W ) + 1 2 L T Ω L d t .
In application to the vector X ( t ) of system variables, the quantum stochastic flow j t also acts entry-wise as
X ( t ) : = j t ( X 0 ) = U ( t ) ( X 0 I F ) U ( t ) ,
in accordance with (7), (8), so that the corresponding QSDE (9) can be represented in vector-matrix form:
d X = F d t + G d W , F : = G ( X ) , G : = i [ X , L T ] ,
where the n-dimensional drift vector F = ( G ( X j ) ) 1 j n and the dispersion ( n × m ) -matrix G = i ( [ X j , L k ] ) 1 j n , 1 k m consist of time-varying self-adjoint operators on H F .
The interaction of the system with the input field W produces the output fields Y 1 ( t ) , , Y m ( t ) assembled into a vector
Y ( t ) : = ( Y k ( t ) ) 1 k m = U ( t ) ( I H W ( t ) ) U ( t ) ,
where the system-field unitary evolution is applied to the current input field variables (which reflects the innovation nature of the quantum Wiener process and the continuous tensor product structure of the Fock space mentioned above). The output field Y satisfies the QSDE
d Y = 2 J L d t + d W ,
where the matrix J is given by (2), and L is the vector of system-field coupling operators from (10). The system-field interaction makes the output field Y different from the input field W only through the drift vector 2 J L in (16).
The common unitary evolution in (13), (15) preserves the commutativity between the system variables and the output field variables in time t 0 :
[ X ( t ) , Y ( t ) T ] = U ( t ) [ X 0 I F , I H W ( t ) T ] U ( t ) = 0 ,
where the entries of X 0 , W ( t ) commute as operators on different spaces H , F . By a similar reasoning, the output field Y inherits the CCR matrix J from the input quantum Wiener process W:
[ Y ( t ) , Y ( t ) T ] = U ( t ) [ I H W ( t ) , I H W ( t ) T ] U ( t ) = 2 i t J U ( t ) I H F U ( t ) = 2 i t J ,
where (3) is used with s = t . By (1), (2), the relation (18) can also be established as a corollary of the property that Y in (16) inherits the quantum Ito matrix Ω from W as d Y d Y T = d W d W T = Ω d t .
In view of (6) (see also (12)), the quantum stochastic flow j t in (8) depends on the system Hamiltonian H 0 and the system-field coupling operators in L 0 . In turn, H 0 and L 0 are usually functions (such as polynomials or Weyl quantization integrals [10] in [49]) of the initial system variables X 1 ( 0 ) , , X n ( 0 ) . The dependence of H 0 , L 0 on X ( 0 ) is inherited by H, L as functions of X and (along with a given commutation structure of the system variables) specifies a particular form of the resulting QSDEs (14), (16), thus influencing their tractability.

3. Open quantum harmonic oscillators with parametric dependence

An important class of quantum stochastic systems is provided by multimode open quantum harmonic oscillators (OQHOs) [9] with an even number n of system variables X 1 , , X n (for example, consisting of n 2 conjugate position-momentum pairs [29]) satisfying the Heisenberg CCRs
[ X ( t ) , X ( t ) T ] = 2 i Θ
(on a dense domain in H F ), where the CCR matrix Θ A n is identified with Θ I H F and remains unchanged over the course of time t 0 . The Hamiltonian H of the OQHO is a quadratic function and the system-field coupling operators L 1 , , L m in (10) are linear functions of the system variables,
H = 1 2 X T R X , L = N X ,
parameterised by an energy matrix  R S n and a coupling matrix N R m × n . In this case, the QSDEs (14), (16) take the form
d X = A X d t + B d W , d Y = C X d t + d W ,
where the drifts F = A X and 2 J L = C X depend linearly on the system variables X 1 , , X n , with A R n × n , C R m × n and the dispersion matrices G = B R n × m and I m being constant real matrices. This linearity makes some of the dynamic properties of (21) similar to those of a classical linear stochastic system with a state-space realization quadruple ( A , B , C , I m ) and the corresponding C m × m -valued transfer function F on the complex plane:
F ( s ) : = C ( s I n A ) 1 B + I m , s C ,
thus allowing for application of transfer function techniques [52]. However, in addition to the noncommutative nature of quantum variables, the matrices of coefficients of these QSDEs have a specific parameterization in terms of the energy, coupling and CCR matrices:
A = 2 Θ ( R + N T J N ) , B = 2 Θ N T , C = 2 J N .
Since the energy matrix R is symmetric, and the CCR matrices Θ , J are antisymmetric, the matrices A, B, C satisfy
A Θ + Θ A T + B J B T = 0 , Θ C T + B J = 0 .
These equalities pertain to the fulfillment of the CCRs (19) and the commutativity (17) at any moment of time and provide necessary and sufficient conditions for physical realizability (PR) [22,40] of the linear QSDEs (21) as an OQHO with the CCR matrix Θ for the system variables. The first equality in (24) has the structure of an algebraic Lyapunov equation (ALE) with respect to Θ , which has a unique solution if and only if the Kronecker sum A A : = I n A + A I n is a nonsingular matrix (that is, no two eigenvalues of A are centrally symmetric about the origin in C ). The latter condition holds, for example, when the matrix A is Hurwitz. For more general open quantum systems (such as anharmonic oscillators whose dynamic variables satisfy the CCRs (19), while the Hamiltonian and the coupling operators are not necessarily quadratic and linear functions of the system variables), the CCR preservation is secured by the unitary evolution of the system variables in (13).
By analogy with the state-space realizations of transfer functions in classical linear systems theory [1,25], we will use the input-output map for the OQHO (21) with the matrix quadruple ( A , B , C , I m ) :
S A , B , C , I m : ( X 0 , W ) Y .
Now, suppose the energy and coupling matrices R, N, which specify the Hamiltonian and the coupling operators in (20), depend smoothly on an auxiliary parameter ϵ R (while the quantum Wiener process W is independent of ϵ ). Then so also do the matrices A, B, C in (23) and the system and output variables which comprise the vectors X ( t ) , Y ( t ) (the differentiability of X, Y is understood in the weak sense). The corresponding partial derivatives
X ( t ) : = ϵ X ( t ) , Y ( t ) : = ϵ Y ( t )
at any t 0 give rise to adapted quantum processes with self-adjoint operator-valued entries satisfying the QSDEs
d X = ( A X + A X ) d t + B d W , d Y = ( C X + C X ) d t
(the second of which is, in fact, an ODE ( Y ) = C X + C X involving the time derivative ( ) ˙ of Y ), with zero initial conditions X 0 = 0 , Y 0 = 0 since X 0 , Y 0 do not depend on ϵ . Here,
A = 2 Θ ( R + N T J N + N T J N ) , B = 2 Θ N T , C = 2 J N
are the derivatives of the matrices A, B, C from (23) with respect to the parameter ϵ satisfying the relations
A Θ + Θ A T + B J B T + B J B T = 0 , Θ C T + B J = 0 ,
which are obtained by differentiating the PR conditions (24), with the CCR matrices Θ , J being constant. Since the CCR matrices Θ , J are antisymmetric (and hence, Θ A T + B J B T = ( A Θ + B J B T ) T ), the first equality in (29) implies that
A Θ + B J B T S n .
By assembling the system variables and their parametric derivatives from (26) to an augmented vector
S : = X X
a combination of the QSDEs (21), (27) allows the parametric derivative of the map (25) to be represented as the input-output map
S A , B , C , I m = S A , B , C , 0 : ( X 0 , W ) Y
associated with
d S = A S d t + B d W , ( Y ) = C S .
Here, the initial condition S 0 = X 0 0 , in view of X 0 = 0 , is identified with X 0 , and the matrices A R 2 n × 2 n , B R 2 n × m , C R m × 2 n are given by
A : = A 0 A A , B : = B B , C : = C C .
This can also be obtained by using the transfer functions of the corresponding linear systems (including (22)) as
F ( s ) = C ( s I n A ) 1 B + C ( s I n A ) 1 A ( s I n A ) 1 B + C ( s I n A ) 1 B = C ( s I n A ) 1 0 ( s I n A ) 1 A ( s I n A ) 1 ( s I n A ) 1 B = C s I 2 n A 1 B
for any s C which is not an eigenvalue of A. Here, use is made of a particular case of the block matrix inverse formula [17]:
α 0 γ β 1 = α 1 0 β 1 γ α 1 β 1 .
The block lower triangular structure of the dynamics matrix A in (32), (34) is closely related to the Gateaux derivative of the matrix exponential e A in the direction A (see, for example, [18]):
( e A ) = 0 I n e A I n 0 = 0 1 e ( 1 s ) A A e s A d s .
At any time t 0 , both X ( t ) and Y ( t ) depend linearly on the matrices R , N from (28) in view of the following representation of the solutions of the QSDEs (27), which regards A X d t + B d W as a forcing term in the first of these QSDEs:
X ( t ) = 0 t e ( t s ) A ( A X ( s ) d s + B d W ( s ) ) , Y ( t ) = 0 t ( C X ( s ) + C X ( s ) ) d s ,
where
X ( t ) = e t A X 0 + 0 t e ( t s ) A B d W ( s )
is the unperturbed solution of the first QSDE in (21) which does not depend on R , N . In the case of linear QSDEs whose coefficients depend smoothly on parameters, the mean square differentiability of their solutions with respect to those parameters can be verified directly by using the closed form (37) (under certain integrability conditions for the underlying quantum state in terms of relevant moments of the system variables such as E ( X 0 T X 0 ) < + ).
An additional insight into the structure of the process X is provided by its cross-commutation relations with X, W. In particular, X inherits the commutativity with the Ito increments of the input field W from that of the underlying system variables in (4), and so also does S in (31):
[ S , d W T ] = [ X , d W T ] , d W T ] = 0 .
Furthermore, the differentiation of (19) in ϵ , combined with the identity [ ξ , η T ] = [ η , ξ T ] T for vectors ξ , η of operators, leads to
0 = [ X , X T ] + [ X , X T ] = [ X , X T ] [ X , X T ] T ,
whereby the cross-commutation matrix [ X , X T ] is symmetric (which holds regardless of a particular structure of the QSDEs (21) and remains valid for quantum anharmonic oscillators with nonlinear dynamics). This matrix evolves in time (with zero initial condition because X 0 = 0 ) and has a steady-state value computed below.
Theorem 1. 
Suppose the matrix A of the OQHO (21) in (23) is Hurwitz. Then there exist the following limits
lim t + [ X ( t ) , X ( t ) T ] = 2 i Θ 21 , lim t + [ X ( t ) , X ( t ) T ] = 2 i Θ 22 ,
where the matrices Θ 21 S n , Θ 22 A n are found as unique solutions of the ALEs
A Θ 21 + Θ 21 A T + A Θ + B J B T = 0 ,
A Θ 22 + Θ 22 A T A Θ 21 + Θ 21 A T + B J B T = 0 .
Proof. 
In view of the CCRs (19), the commutator matrix for the vector S in (31) is organised as
Ξ : = [ S , S T ] = [ X , X T ] [ X , X T ] , X T ] [ X , X T ] = 2 i Θ Ξ 12 Ξ 21 Ξ 22 ,
where the blocks Ξ 21 : = [ X , X T ] = Ξ 12 T , Ξ 12 : = [ X , X T ] and Ξ 22 : = [ X , X T ] consist of time-varying skew self-adjoint operators on the system-field space H F . By using the quantum Ito lemma [19,35] and the bilinearity of the commutator along with the QSDE (33) and the commutativity (38), it follows that (43) satisfies the QSDE
d Ξ = [ d S , S T ] + [ S , d S T ] + [ d S , d S T ] = [ A S d t + B d W , S T ] + [ S , S T A T d t + d W T B T ] + [ B d W , d W T B T ] = A [ S , S T ] d t + B [ d W , S T ] + [ S , S T ] A T d t + [ S , d W T ] B T + B [ d W , d W T ] B T = ( A Ξ + Ξ A T + 2 i B J B T ) d t ,
which (similarly to [22], Eq. (56)]) reduces to the ODE
Ξ ˙ = A Ξ + Ξ A T + 2 i B J B T ,
with the initial condition
Ξ 0 = 2 i Θ 0 0 0
in view of X 0 = 0 . Hence, at any time t 0 , the matrix Ξ ( t ) is an imaginary antisymmetric matrix which can be represented as
Ξ ( t ) = 2 i Θ Θ 12 ( t ) Θ 21 ( t ) Θ 22 ( t )
with time-varying matrices Θ 12 ( t ) = Θ 21 ( t ) T R n × n and Θ 22 ( t ) A n . Substitution of (46) into (44) and using (34) leads to the ODEs
Θ ˙ 21 = A Θ 21 + Θ 21 A T + A Θ + B J B T ,
Θ ˙ 22 = A Θ 22 + Θ 22 A T + A Θ 12 + Θ 21 A T + B J B T ,
with zero initial conditions Θ 21 ( 0 ) = 0 , Θ 22 ( 0 ) = 0 in accordance with the corresponding blocks in (45). Now, the matrix Θ 21 ( t ) is symmetric at any time t 0 due to (39). This also follows from (47) in view of the symmetry (30). Hence, Θ 12 = Θ 21 , and the ODE (48) takes the form
Θ ˙ 22 = A Θ 22 + Θ 22 A T A Θ 21 + Θ 21 A T + B J B T .
If the matrix A is Hurwitz, then the solutions of the ODEs (47), (49) converge to their unique steady-state values which (slightly abusing notation) satisfy the ALEs (41), (42) and specify the limits (40). □
The relations (28)–(36) and Theorem 1 provide infinitesimal perturbation analysis for sensitivity of the internal and output variables of the OQHO to the matrices R, N. Under the perturbations of R, N, the Hamiltonian H and the coupling operators in L, given by (20), remain in the corresponding classes of quadratic and linear functions of the system variables. Accordingly, the above analysis is not applicable to more general perturbations (for example, higher order polynomials of the system variables) and is restricted to linear QSDEs, so that an alternative approach is needed in the general case.

4. Transverse Hamiltonian

For the general quantum stochastic system, described in Section 2 and governed by (14), (16), we will now consider its response to arbitrary perturbations in the system Hamiltonian H 0 and the system-field coupling operators in L 0 . More precisely, suppose they are perturbed in directions K 0 , M 0 as
H 0 H 0 + ϵ K 0 , L 0 L 0 + ϵ M 0 .
Here, K 0 and the entries of the m-dimensional vector M 0 are self-adjoint operators on the initial system space H , and ϵ is a small real-valued parameter as before, so that K 0 = H 0 and M 0 = L 0 . In what follows, the derivative ( · ) : = ϵ ( · ) is taken at ϵ = 0 . The perturbations K 0 , M 0 in (50) are also assumed to be functions of the initial system variables X 1 ( 0 ) , , X n ( 0 ) , and these dependencies describe
K ( t ) : = j t ( K 0 ) , M ( t ) : = j t ( M 0 )
as functions of X ( t ) under the unperturbed flow (8). For example, in the case of OQHOs considered in Section 3, the perturbations K, M, which are caused by the perturbations in the energy and coupling matrices R, N, inherit the structure of the Hamiltonian as a quadratic function and the coupling operators as linear functions of the system variables in (20), respectively:
K = 1 2 X T R X , M = N X .
Returning to the general case, we will avoid at this stage technical assumptions on K 0 , M 0 in (50), so that the calculations, carried out below for arbitrary perturbations, should be regarded as formal. Since the operators H 0 , L 0 completely specify the dynamics of the unitary operator U ( t ) in (6) which determines the evolution of the system and output field variables, the response of the latter to the perturbations (50) of H 0 , L 0 reduces to that of U ( t ) . Therefore, the propagation of the initial perturbations K 0 , M 0 of the operators H 0 , L 0 through the subsequent unitary system-field evolution can be described in terms of the operator
V ( t ) : = U ( t ) ,
which satisfies V 0 = 0 since U 0 = I H F does not depend on ϵ . The smoothness of dependence of U ( t ) on the parameter ϵ is analogous to the corresponding property of solutions of classical SDEs (whose drift and dispersion satisfy suitable regularity conditions [24,43]) and holds at least in the case of linear QSDEs discussed in Section 3. The following theorem is closely related to Stone’s theorem on generators of one-parameter unitary groups [53].
Theorem 2. 
For any time t 0 , the operator V ( t ) in (53), associated with the unitary evolution U ( t ) from (6), can be represented as
V ( t ) = i U ( t ) Q ( t ) .
Here, Q ( t ) is a self-adjoint operator on the system-field space H F , which satisfies zero initial condition Q 0 = 0 and is governed by the QSDE
d Q = ( K Im ( L T Ω M ) ) d t + M T d W .
Furthermore, Q ( t ) depends linearly on the initial perturbations K 0 , M 0 of the Hamiltonian and coupling operators in (50) through their unperturbed evolutions in (51).
Proof. 
The differentiation of both sides of the unitarity relation U ( t ) U ( t ) = I H F with respect to the parameter ϵ at ϵ = 0 leads to V U + U V = ( U V ) + U V = 0 , which implies self-adjointness of the operator
Q ( t ) : = i U ( t ) V ( t ) ,
thus establishing (54). Now, consider the time evolution of Q ( t ) . To this end, the differentiation of (6) with respect to ϵ yields
d V = ( i ( K 0 d t + M 0 T d W ) + Re ( L 0 T Ω M 0 ) d t ) U i ( H 0 d t + L 0 T d W ) + 1 2 L 0 T Ω L 0 d t V .
By left multiplying both sides of (57) by U and recalling (56), it follows that
U d V = i ( K d t + M T d W ) Re ( L T Ω M ) d t + i 2 L T Ω L d t H d t L T d W Q = i K Re ( L T Ω M ) + i 2 L T Ω L H Q d t ( L Q + i M ) T d W ,
where use is made of the evolved perturbations (51). By a similar reasoning, a combination of (12) with (56) leads to
( d U ) V = i H d t + L T d W 1 2 L T Ω L d t U V
= H d t + L T d W + i 2 L T Ω L d t Q , d U d V = i L T d W U d V = i L T d W d W T ( L Q + i M )
= L T Ω ( M i L Q ) d t ,
where use is also made of (58) along with the quantum Ito product rules [35] and (1), (4). It now follows from (56), (58)–(60) that
d Q = i ( ( d U ) V + U d V + d U d V ) = ( K + i L T Ω M i Re ( L T Ω M ) ) d t + M T d W = ( K Im ( L T Ω M ) ) d t + M T d W ,
which establishes (55). The linear dependence of Q ( t ) on K 0 , M 0 follows from the integral representation
Q ( t ) = 0 t ( ( K ( s ) Im ( L ( s ) T Ω M ( s ) ) ) d s + M ( s ) T d W ( s ) )
of the QSDE (55) and the property that the evolved perturbations K, M in (51) depend linearly on K 0 , M 0 , respectively. □
In view of Theorem 2, for any fixed but otherwise arbitrary time t 0 , the relation (54), represented as
U ( t ) = i U ( t ) Q ( t ) ,
has the structure of isolated quantum dynamics in fictitious time ϵ , where Q ( t ) plays the role of a Hamiltonian pertaining to the perturbation of the unitary operator U ( t ) . In order to reflect this property, we will refer to the time-varying operator Q as the transverse Hamiltonian associated with the perturbations K, M of the system Hamiltonian H and the system-field coupling operators in L. The computation of Q is illustrated by the following two examples.

Example 1

In the absence of perturbation to the system-field coupling, when the vector M 0 in (50) consists of zero operators, and hence, so also does M in (51), the transverse Hamiltonian in (61) reduces to
Q ( t ) = 0 t K ( s ) d s .
Moreover, if the system is isolated, that is, L = 0 , then (6) reduces to the ODE U ˙ ( t ) = i H 0 U ( t ) which leads to
U ( t ) = e i t H 0 ,
with the Hamiltonian being preserved in time: H ( t ) = H 0 for all t 0 . In this case of isolated system dynamics, (62) takes the form
Q ( t ) = 0 t e i s H 0 K 0 e i s H 0 d s = 0 t e i s ad H 0 ( K 0 ) d s = t E ( i t ad H 0 ) ( K 0 ) .
Here, use is made of Hadamard’s lemma [29] along with an entire function E ( z ) : = e z 1 z = k = 0 + z k ( k + 1 ) ! of a complex variable (with E ( 0 ) = 1 by continuity) which plays a role in the solution of nonhomogeneous linear ODEs with constant coefficients and constant forcing terms [18]. The Gateaux derivative (53) of (63) can be represented by using an operator version of (35) as
V ( t ) = 0 I H exp i t H 0 0 K 0 H 0 I H 0 = i t 0 1 e i ( s 1 ) t H 0 K 0 e i s t H 0 d s = i U ( t ) 0 t e i s H 0 K 0 e s H 0 d s ,
which provides an alternative verification of (54) for this particular case, with Q given by (64). ▲

Example 2

For the OQHO of Section 3, substitution of the perturbations (52) into (61) leads to the transverse Hamiltonian
Q ( t ) = 0 t 1 2 X ( s ) T R X ( s ) Im ( X ( s ) T N T Ω N X ( s ) ) d s + X ( s ) T N T d W ( s ) = 0 t 1 2 X ( s ) T R + i ( N T Ω N N T Ω N ) X ( s ) d s + X ( s ) T N T d W ( s ) = 0 t 1 2 X ( s ) T R + N T J N N T J N X ( s ) d s + X ( s ) T N T d W ( s ) N Θ , N t
which depends linearly on the matrices R , N and in a quadratic fashion on the past history of the system variables. The latter are given by the unperturbed equation (37). The last term N Θ , N t in (66) comes from the relation Im ( i ( N T Ω N N T Ω N ) ) = N T N N T N (following from (1)) and the identity X T Υ X = i Υ , Θ which holds for any matrix Υ A n in view of the CCRs (19). ▲

5. Infinitesimal perturbation analysis of system operators

Since the transverse Hamiltonian Q ( t ) in (56), (61) encodes the propagation of the initial perturbations of the Hamiltonian and coupling operators in (50) through the unitary system-field evolution over the time interval [ 0 , t ] , it provides a tool for infinitesimal perturbation analysis of general system operators. The following theorem is concerned with an extended setting which, in addition to (50), allows for a smooth dependence of a system operator σ 0 on the parameter ϵ , so that an appropriate infinitesimal perturbation in it is specified by an operator σ 0 on the initial space H , with σ 0 also being a function of the initial system variables X 1 ( 0 ) , , X n ( 0 ) .
Theorem 3. 
For any self-adjoint system operator σ 0 on the initial space H , which smoothly depends on the same scalar parameter ϵ as in (50) and is evolved by the flow (8), the derivative of its evolved version σ ( t ) with respect to ϵ can be represented as
τ ( t ) : = σ ( t ) = j t ( σ 0 ) + ϕ ( t ) , ϕ ( t ) : = i [ Q ( t ) , σ ( t ) ]
at any time t 0 , where Q ( t ) is the transverse Hamiltonian from Theorem 2. Here, the operator ϕ ( t ) satisfies the QSDE
d ϕ = ( i [ Q , G ( σ ) ] + χ ( σ ) ) d t + [ Q , [ σ , L T ] ] i [ σ , M T ] d W ,
with zero initial condition ϕ 0 = 0 , where G is the unperturbed GKSL generator from (9), and χ is a linear superoperator given by
χ ( σ ) : = i [ K Im ( L T Ω M ) , σ ] 2 Re ( [ σ , L T ] Ω M ) .
Proof. 
By using the Leibniz product rule together with (8), (53), (54) and the self-adjointness of Q ( t ) , it follows that
σ = U ( σ 0 I F ) U + V ( σ 0 I F ) U + U ( σ 0 I F ) V = j t ( σ 0 ) + ( i U Q ) ( σ 0 I F ) U i U ( σ 0 I F ) U Q = j t ( σ 0 ) + i Q U ( σ 0 I F ) U i σ Q = j t ( σ 0 ) + i [ Q , σ ] ,
which establishes (67), with the initial condition φ 0 = 0 being inherited by ϕ from Q 0 = 0 . We will now obtain a QSDE for the process ϕ . To this end, by combining the quantum Ito lemma with the bilinearity of the commutator, and using the QSDEs (9), (55), it follows that
d [ Q , σ ] = [ d Q , σ ] + [ Q , d σ ] + [ d Q , d σ ] = [ K Im ( L T Ω M ) , σ ] d t [ σ , M T ] d W + [ Q , G ( σ ) ] d t i [ Q , [ σ , L T ] ] d W [ M T d W , i [ σ , L T ] d W ] = ( [ K Im ( L T Ω M ) , σ ] + [ Q , G ( σ ) ] + 2 i Im ( i [ σ , L T ] Ω M ) ) d t ( [ σ , M T ] + i [ Q , [ σ , L T ] ] ) d W = ( [ K Im ( L T Ω M ) , σ ] + [ Q , G ( σ ) ] + 2 i Re ( [ σ , L T ] Ω M ) ) d t ( [ σ , M T ] + i [ Q , [ σ , L T ] ] ) d W .
Here, the quantum Ito product rules are applied together with the commutativity (4) between adapted processes and the Ito increments of the quantum Wiener process W. In the second and third of the equalities (71), use is also made of the relations [ α , β T d W ] = [ α , β T ] d W and [ α T d W , β T d W ] = 2 i Im ( α T Ω β ) d t for appropriately dimensioned adapted processes α , β with self-adjoint operator-valued entries. These relations are combined with the identity Im ( i [ σ , L T ] Ω M ) = Re ( [ σ , L T ] Ω M ) in the fourth equality of (71). The QSDE (68) is now obtained my multiplying both sides of (71) by i and using the superoperator χ from (69). □
As can be seen from (70), the process j t ( σ 0 ) in (67) is the response of σ ( t ) to the initial perturbation σ 0 of the system operator under the unperturbed flow (8) and satisfies the QSDE (9):
d j t ( σ 0 ) = G ( j t ( σ 0 ) ) d t i [ j t ( σ 0 ) , L T ] d W .
In contrast to j t ( σ 0 ) , the operator ϕ ( t ) in (67) describes the response of the flow j t itself to the perturbations (50) of the Hamiltonian and coupling operators and will be referred to as the derivative process for the system operator σ . Accordingly, the term i [ Q , G ( σ ) ] in the drift of the QSDE (68) is the derivative process for G ( σ ) . At any given time t 0 , the last equality in (67) is organised as the right-hand side of the Heisenberg ODE (in fictitious time ϵ ) of an isolated quantum system with the state space H F and the Hamiltonian Q ( t ) . While j t ( σ 0 ) (evolved by the unperturbed flow) depends linearly on σ 0 , the derivative process ϕ ( t ) depends linearly on the perturbations K 0 , M 0 of the Hamiltonian H 0 and the coupling operators in L 0 through the transverse Hamiltonian Q and the superoperator χ in (69).
In application to the vectors X, L of the system variables and the system-field coupling operators, the QSDEs (68), (72) and the definition (69) lead to
d X = ( i ( [ K Im ( L T Ω M ) , X ] + [ Q , F ] ) + 2 Im ( G Ω M ) ) d t
+ i ( [ Q , G ] [ X , M T ] ) d W , d L = ( G ( M ) + i ( [ K Im ( L T Ω M ) , L ] + [ Q , G ( L ) ] ) 2 Re ( [ L , L T ] Ω M ) ) d t
+ ( [ Q , [ L , L T ] ] i [ L , M T ] i [ M , L T ] ) d W ,
where F, G are the unperturbed drift vector and the dispersion matrix from (14). In (73), use is also made of the absence X 0 = 0 of initial perturbations in the system variables, whereby j t ( X 0 ) = 0 for any t 0 . Furthermore, in (74), we have used the relations j t ( L 0 ) = j t ( M 0 ) = M ( t ) in view of (50), (51). Since the matrix J and the quantum Wiener process W do not depend on the parameter ϵ , the derivative of the output field Y of the system in (16) evolves according to the ODE
( Y ) = 2 J L ,
where L is governed by the QSDE (74).
In particular, for the OQHO of Section 3 with the perturbations (52), the QSDEs (73)–(75) lead to the relations (27), (28) which were obtained in Section 3 using more elementary techniques. However, the latter are limited to quadratic perturbations of the Hamiltonian and linear perturbations of the coupling operators in (52), whereas the transverse Hamiltonian approach allows the system response to be investigated for general perturbations of these operators. Therefore, this approach can be used for the development of optimality conditions in quantum control and filtering problems for larger classes of controllers and observers.

6. Sensitivity of infinite-horizon quantum averaged functionals

Similarly to optimal control of classical time invariant stochastic systems [1,25], suppose the infinite-horizon performance of the quantum system being considered is described by a cost functional
Z : = lim t + E Z ( t ) ,
which (whenever it exists) leads to the same Cesaro limit lim t + ( 1 t 0 t E Z ( s ) d s ) = Z and is to be minimised in optimal quantum control settings. Here, the quantum expectation E ( · ) is taken over the tensor product
ρ : = ϖ υ
of the initial quantum state ϖ of the system and the vacuum state [35] υ in the Fock space F for the external bosonic fields. This expectation is applied in (76) to a quantum criterion processZ, specified as
Z ( t ) : = f ( X ( t ) , L ( t ) )
by a function f : R n + m R . The latter is extended to the noncommutative system variables and the coupling operators (with L being in a bijective correspondence with the drift vector 2 J L of the output field in (16) since det J 0 in view of (2)) so as to make Z ( t ) a self-adjoint operator for any t 0 . Such an operator-valued extension of f is straightforward in the case of polynomials and can be carried out through the Weyl quantization [10] for more general functions. In the coherent quantum linear-quadratic-Gaussian (CQLQG) control and filtering problems [33,44,45], the function f in (78) is a positive semi-definite quadratic form, in which case, the minimization of (76) provides an infinite-horizon mean square optimality criterion.
Now, if the Hamiltonian and coupling operators of the quantum system are perturbed according to (50), then application of the transverse Hamiltonian Q from Theorems 2, 3 leads to
( E Z ( t ) ) = E ( j t ( Z 0 ) + ϕ ( t ) ) , ϕ ( t ) : = i [ Q ( t ) , Z ( t ) ] ,
where ϕ is the derivative process for Z. Note that, despite X 0 = 0 , the operator Z 0 can be nonzero due to the dependence of Z in (78) on L. Assuming the existence and interchangeability of appropriate limits, (79) leads to the following perturbation formula for the cost functional Z in (76):
Z : = lim t + ( E j t ( Z 0 ) + E ϕ ( t ) ) .
The right-hand side of (80) is a linear functional of the perturbations K 0 , M 0 , which describes the corresponding (formal) Gateaux derivative of Z in the direction ( K 0 , M 0 ) . Therefore, the quantum system is a stationary point of the performance criterion (76) with respect to a subspace T of perturbations ( K 0 , M 0 ) in (50), if T is contained by the null space of the linear functional Z in (80):
T ker Z .
This inclusion provides a first-order necessary condition of optimality in the quantum control problem of minimising (76) over a manifold of the Hamiltonian and coupling operators with the local tangent space T .
While lim t + E j t ( Z 0 ) in (80) reduces to averaging over the invariant quantum state of the unperturbed system (provided certain integrability conditions are satisfied together with the existence of and weak convergence to the invariant state), the computation of lim t + E ϕ ( t ) is less straightforward. Due to the product structure (77) of the system-field state ρ (with the external fields being in the vacuum state υ ), the martingale part of the QSDE (68) does not contribute to the time derivative
( E ϕ ) = E ψ + E χ ( Z ) , ψ : = i [ Q , G ( Z ) ] ,
where ψ is the derivative process for G ( Z ) , and the superoperator χ from (69) is applied to the criterion process Z in (78).
The relation (82) is a complicated integro-differential equation (IDE). However, this IDE admits an efficient solution, for example, in the case when the system is an OQHO, and the function f in (78) is a polynomial. In this case, due to the structure of the GKSL generator of the OQHO, G ( Z ) is also a polynomial in the system variables of the same degree, thus leading to a linear relation (with constant coefficients) between the derivative processes ϕ , ψ and to algebraic closedness in the IDE (82). Therefore, for stable OQHOs (with a Hurwitz matrix A) and a polynomial criterion process Z, the computation of Z (and verification of the stationarity condition (81)) reduces to averaging over the unperturbed invariant state (which is unique and Gaussian [36]). These calculations are exemplified below.

Example 3

Consider the OQHO of Section 3, described by (19)–(23) with a Hurwitz matrix A. Suppose the criterion process Z in (78) is a quadratic polynomial of the system variables X 1 , , X n and the system-field coupling operators L 1 , , L m :
Z : = 1 2 X T L T Π X L = 1 2 X T P X , Π : = Π 11 Π 12 Π 21 Π 22 ,
where Π S n + m + is a given weighting matrix, partitioned into blocks Π 11 S n + , Π 22 S m + , Π 12 = Π 21 T R n × m , and
P : = Π 11 + Π 12 N + N T Π 21 + N T Π 22 N S n +
is an auxiliary matrix which involves the coupling matrix N from (20). Then, in view of X 0 = 0 , it follows from (83), (52) that
j t ( Z 0 ) = Re ( ( Π 21 X + Π 22 L ) T M ) = Re ( X T ( Π 12 + N T Π 22 ) M ) .
The second equality in (83) allows the quantum average of the corresponding derivative process ϕ in (79) to be represented as
E ϕ = 1 2 P , Υ , Υ : = i E [ Q , Ξ ] , Ξ : = Re ( X X T ) = X X T i Θ .
Here, Υ is the expectation of the derivative process i [ Q , Ξ ] for Ξ and hence, satisfies the following IDE, similar to (82):
Υ ˙ = i E [ Q , G ( Ξ ) ] + E χ ( Ξ ) ,
where the superoperator χ from (69) is applied to Ξ entry-wise as
χ ( X j X k ) = i [ K Im ( L T Ω M ) , X j X k ] 2 Re ( [ X j X k , L T ] Ω M ) = i [ K Im ( X T N T Ω M ) , X j X k ] + 4 Im ( ( X k Θ j + X j Θ k ) N T Ω M ) ,
with Θ the th row of the CCR matrix Θ . By substituting the Hamiltonian and coupling operators of the OQHO from (20) into the GKSL generator G in (9), (11) and using the CCRs (19) together with the state-space matrices (23), it follows that
G ( Ξ ) = A Ξ + Ξ A T + B B T .
Substitution of (89) into (87) reduces the IDE to a Lyapunov ODE:
Υ ˙ = i E [ Q , A Ξ + Ξ A T + B B T ] + E χ ( Ξ ) = A Υ + Υ A T + E χ ( Ξ ) .
Since the matrix A is Hurwitz, the unperturbed OQHO has an invariant state which is Gaussian [36] with zero mean E X = 0 and covariance matrix E ( X X T ) = Σ + i Θ H n + , where Σ S n + is a unique solution of the ALE
A Σ + Σ A T + B B T = 0 .
Therefore, under appropriate integrability conditions for χ ( Ξ ) , the solution of the Lyapunov ODE (90) has a limit Υ : = lim t + Υ ( t ) which is a unique solution of the ALE
A Υ + Υ A T + lim t + E χ ( Ξ ) = 0 ,
where lim t + E χ ( Ξ ) can be computed by averaging χ ( Ξ ) over the invariant Gaussian state of the OQHO. Therefore, by assembling (85), (86) into (80), it follows that
Z = lim t + E Re ( X T ( Π 12 + N T Π 22 ) M ) + 1 2 P , Υ ,
where the limit also reduces to averaging over the invariant Gaussian state and is expressed in terms of E ( X M T ) as
E Re ( X T ( Π 12 + N T Π 22 ) M ) = Π 12 + N T Π 22 , Re E ( X M T ) .
The relations (84), (88), (92)–(94) allow the Gateaux derivative Z of the quadratic cost functional (76), specified by (83), to be computed through mixed moments of the system variables X and the perturbations K, M over the invariant zero-mean Gaussian quantum state whose covariance matrix is found from (91). In particular, if K, M are polynomials of the system variables X 1 , , X n , then these moments can be calculated in terms of the covariances by using the Isserlis-Wick theorem [21]. Alternatively, the perturbations K, M can be trigonometric polynomials, that is, linear combinations of unitary Weyl operators [10]
W u : = e i u T X = W u , u R n ,
associated with the system variables, or more generally, represented as the Weyl quantization integrals
K : = R n W u α ( d u ) , M : = R n W u β ( d u ) ,
similar to those in [49], (Eq. 32). Here, α , β are countably additive measures of finite variation on the σ -algebra B n of Borel subsets of R n , which take values in C and C m , respectively, and satisfy the Hermitian property α ( S ) ¯ = α ( S ) and β ( S ) ¯ = β ( S ) for any S B n , thus ensuring that K and the entries of M in (96) are self-adjoint operators in view of the second equality in (95). Now, the Weyl CCRs W u + v = e i u T Θ v W u W v for all u , v R n (with their infinitesimal Heisenberg form given by (19)) imply that u W u = v e i v T ( X + Θ u ) | v = 0 W u = i ( X + Θ u ) W u , whereby
X W u = ( Θ u + i u ) W u .
Since the quantum expectation commutes with the differential operator on the right-hand side of (97), and the quasi-characteristic function [7] of the invariant zero-mean Gaussian state is given by E W u = e 1 2 u Σ 2 , then
E ( X W u ) = ( Θ u + i u ) E W u = ( Θ u + i u ) e 1 2 u Σ 2 = e 1 2 u Σ 2 ( i Σ Θ ) u , u R n ,
which can also be obtained by using quantum Price’s theorem [46]. A combination of the second equality from (96) with (98) leads to
Re E ( X M T ) : = Re R n E ( X W u ) β ( d u ) T = R n e 1 2 u Σ 2 Re ( ( i Σ Θ ) u β ( d u ) T ) = R n e 1 2 u Σ 2 ( Σ u Im β ( d u ) T + Θ u Re β ( d u ) T ) .
The computation of the limit in (93) in the Weyl quantization framework is now completed by substituting (99) into (94). In this framework, the matrix E χ ( Ξ ) , which is needed for finding Υ from the ALE (92) for the last term in (93), is computed by averaging (88) in a similar fashion. ▲

7. Mean square optimal coherent quantum filtering problem

We will now outline an application of the transverse Hamiltonian approach of Section 4, Section 5 and Section 6 to a quantum filtering problem for the open quantum system, described in Section 2 and referred to as a quantum plant. The plant has the Hamiltonian H, the vector L of system-field coupling operators, the input field W, the vector X of internal variables and the output field Y governed by the QSDEs (14), (16). Although the plant is not necessarily an OQHO, we assume that the plant variables X 1 , , X n are organised as position-momentum pairs and satisfy the CCRs (19).
Suppose the quantum plant is cascaded in a measurement-free field-mediated fashion with another open quantum system, playing the role a coherent quantum observer, which is driven by the plant output Y and another quantum Wiener process ω of an even dimension μ on a different bosonic Fock space F ; see Fig. Figure 1.
The observer is endowed with its own initial Hilbert space H , dynamic variables ξ 1 ( t ) , , ξ ν ( t ) with a CCR matrix Λ A ν (so that [ ξ ( t ) , ξ ( t ) T ] = 2 i Λ for any t 0 , similarly to (19)), and an ( m + μ ) -dimensional output field η ( t ) :
ξ : = ( ξ k ) 1 k ν , ω : = ( ω k ) 1 k μ , η : = ( η k ) 1 k m + μ .
Since the observer is driven by the plant output Y (together with the quantum noise ω ), the observer output η acquires, over the course of time, quantum statistical correlations with the plant variables and can be used for estimating the latter in a mean square optimal fashion as specified below. To this end, we denote the observer Hamiltonian by Γ and the vectors of operators of coupling of the observer with the plant output Y and with the quantum Wiener process ω by
Φ : = ( Φ k ) 1 k m , Ψ : = ( Ψ k ) 1 k μ ,
respectively. The Hamiltonian Γ and the coupling operators Φ 1 , , Φ m , Ψ 1 , , Ψ μ are functions of the dynamic variables ξ 1 , , ξ ν of the observer and hence, commute with the plant variables and functions thereof, including H, L. The plant and observer form a composite quantum stochastic system, whose vector X of dynamic variables satisfies the CCRs
[ X , X T ] = 2 i Θ , Θ : = Θ 0 0 Λ , X : = X ξ
and is driven by an augmented quantum Wiener process W with the following Ito table:
d W d W T = Ω d t , Ω : = Ω 0 0 = I m + μ + i J , J : = I ( m + μ ) / 2 J , W : = W ω .
Here, ℧ is the Ito matrix of the quantum Wiener process ω of the observer, which is defined similarly to Ω from (1), (2) as
d ω d ω T = d t , : = I μ + i I μ / 2 J .
The quantum feedback network formalism [14] allows the Hamiltonian H of the plant-observer system and its vector L of operators of coupling with W to be computed as
H = H + Γ + Φ T J L , L = L + Φ Ψ .
Hence, the internal and output variables ξ 1 , , ξ ν and η 1 , , η m + μ of the observer in (100) are governed by the QSDEs
d ξ = G ( ξ ) d t i [ ξ , L T ] d W = ( i [ Γ , ξ ] + Δ ( ξ ) ) d t i ξ , Φ T Ψ T d Y ω ,
d η = 2 J L d t + d W .
Here,
G ( ζ ) : = i [ H , ζ ] + D ( ζ )
is the GKSL generator of the plant-observer system, and
D ( ζ ) = [ ζ , L T ] Ω L 1 2 [ L T Ω L , ζ ]
is the corresponding decoherence superoperator, in accordance with (11), (103), (105). In (106), use is also made of the partial decoherence superoperator Δ which acts on the observer variables as
Δ ( ξ ) = [ ξ , Φ T ] Ω Φ [ ξ , Ψ T ] Ψ 1 2 [ Φ T Ω Φ + Ψ T Ψ , ξ ]
in view of (102)–(105). Now, consider a coherent quantum filtering (CQF) problem formulated as the minimisation of the mean square discrepancy
Z : = lim t + E Z ( t ) min , Z : = 1 2 ( S X T L ) T ( S X T L )
between r linear combinations of the plant variables of interest and the entries of the drift part 2 J L of the observer output η in (107) as specified by given weighting matrices S R r × n and T : = T 1 T 2 , with T 1 R r × m , T 2 R r × μ . The criterion process Z in (108) is similar to that in (83):
Z : = 1 2 X T L T Π X L , Π : = S T S S T T T T S T T T ,
with X being the only subvector of X from (102) which is present in (109). The minimization in (108) is over the observer Hamiltonian Γ and the vector Φ of the observer-plant coupling operators in (101) as functions of the observer variables ξ 1 , , ξ ν . This mean square optimal CQF problem extends [45] in that we do not restrict attention to linear observers even if the plant is an OQHO and Ψ depends linearly on the observer variables ξ . Note that the Hamiltonian H of the plant and its coupling L to the input quantum noise W are fixed, and so also is the coupling Ψ of the observer to the input quantum noise ω ; see Figure 1. If Γ 0 , Φ 0 are perturbed in the directions
K 0 : = Γ 0 , M 0 : = Φ 0 ,
consisting of self-adjoint operators representable as functions of the initial observer variables ξ 1 ( 0 ) , , ξ ν ( 0 ) , then the corresponding perturbations of the plant-observer Hamiltonian and coupling operators in (105) are
H 0 = K 0 + M 0 T J L 0 , L 0 = M 0 0 .
By applying Theorem 2 and using (103), (110), (111), it follows that the corresponding transverse Hamiltonian Q for the plant-observer system satisfies the QSDE
d Q = K + M T J L Im L T Ω M 0 d t + M T 0 d W = ( K Im ( ( 2 L + Φ ) T Ω M ) ) d t + M T d W ,
where use is also made of Im ( L T Ω M ) = M T J L (following from (1) and the commutativity [ L , M T ] = 0 ). Then the Gateaux derivative Z of the cost functional in (108) is given by (80), where
j t ( Z 0 ) = Re ( ( T L S X ) T T 1 M )
in view of (109), (111) and similarly to (85). In accordance with (82), the expectation of the derivative process ϕ : = i [ Q , Z ] satisfies the IDE
( E ϕ ) = i E [ Q , G ( Z ) ] + E χ ( Z ) ,
where, in view of (112), the superoperator χ in (69) is given by
χ ( Z ) = i [ K Im ( ( 2 L + Φ ) T Ω M ) , Z ] 2 Re ( [ Z , ( L + Φ ) T ] Ω M ) .
In particular, if both the plant and the unperturbed observer are OQHOs with Hurwitz dynamics matrices (while the perturbations in (110) are not necessarily linear-quadratic), then Z can be found (in a form similar to (93)) along the lines of Example 3 of Section 6 due to the criterion process Z in (108), (109) being a quadratic function of the plant and observer variables in X from (102).
The transverse Hamiltonian method, outlined above, was used in [47] for showing that, in the mean square optimal CQF problem for linear quantum plants, those observers, which are locally optimal in the class of linear quantum observers, cannot be improved locally (in the sense of the first-order optimality conditions (81)) by varying the Hamiltonian and coupling operators of the observer along linear combinations of the Weyl operators associated with the observer variables.

8. Concluding remarks

For a class of open quantum systems governed by Markovian Hudson-Parthasarathy QSDEs, we have introduced a transverse Hamiltonian and derivative processes associated with perturbations of the system Hamiltonian and system-field coupling operators. This provides a fully quantum tool for infinitesimal perturbation analysis of system operators and cost functionals which involve averaging over the invariant quantum state of the system. The proposed variational method can be used for the development of first-order necessary conditions of optimality in quantum control and filtering problems. We have illustrated these ideas for OQHOs with quadratic performance criteria and the mean square optimal CQF problem.

Funding

This research was funded by the Australian Research Council grant DP210101938.

Conflicts of Interest

The author declares no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
ALE algebraic Lyapunov equation
CCR canonical commutation relation
CQF coherent quantum filtering
CQLQG coherent quantum linear-quadratic-Gaussian
GKSL Gorini-Kossakowski-Sudarshan-Lindblad
IDE integro-differential equation
ODE ordinary differential equation
OQHO open quantum harmonic oscillator
PR physical realizability
QSDE quantum stochastic differential equation

References

  1. Anderson, B.D.O.; Moore, J.B. Optimal Control: Linear Quadratic Methods; Prentice Hall: London, 1989. [Google Scholar]
  2. Belavkin, V.P. Quantum filtering of Markovian signals with quantum white noises. Radiotekhn. i Elektron. 1980, 25, 1445–1453. [Google Scholar]
  3. Belavkin, V.P. On the theory of controlling observable quantum systems. Autom. Remote Control 1983, 44, 178–188. [Google Scholar]
  4. Belavkin, V.P. Quantum stochastic calculus and quantum nonlinear filtering, J. Multivar. Anal. 1992, 42, 171–201. [Google Scholar] [CrossRef]
  5. Boukas, A. Stochastic control of operator-valued processes in boson Fock space. Russian J. Math. Phys. 1996, 4, 139–150. [Google Scholar]
  6. Breuer, H.-P.; Petruccione, F. The Theory of Open Quantum Systems; Clarendon Press: Oxford, 2006. [Google Scholar]
  7. Cushen, C.D.; Hudson, R.L. A quantum-mechanical central limit theorem. J. Appl. Prob. 1971, 8, 454–469. [Google Scholar] [CrossRef]
  8. Dong, D.; Petersen, I.R. Quantum control theory and applications: a survey. IET Contr. Theor. Appl. 2010, 4, 2651–2671. [Google Scholar] [CrossRef]
  9. Edwards, S.C.; Belavkin, V.P. Optimal quantum filtering and quantum feedback control. Available online: URL https://arxiv.org/abs/quant-ph/0506018 (arXiv:quant-ph/0506018v2, 1 August 2005).
  10. Folland, G.B. Harmonic Analysis in Phase Space; Princeton University Press: Princeton, 1989. [Google Scholar]
  11. Gardiner, C.W.; Zoller, P. Quantum Noise, 3rd Ed. ed; Springer: Berlin, 2004. [Google Scholar]
  12. Gorini, V.; Kossakowski, A.; Sudarshan, E.C.G. Completely positive dynamical semigroups of N-level systems. J. Math. Phys. 1976, 17, 821–825. [Google Scholar] [CrossRef]
  13. Gough, J.; Belavkin, V.P.; Smolyanov, O.G. Hamilton-Jacobi-Bellman equations for quantum optimal feedback control. J. Opt. B: Quant. Semiclass. Opt. 2005, 7, S237–S244. [Google Scholar] [CrossRef]
  14. Gough, J.; James, M.R. Quantum feedback networks: Hamiltonian formulation. Commun. Math. Phys. 2009, 287, 1109–1132. [Google Scholar] [CrossRef]
  15. Holevo, A.S. Quantum stochastic calculus. J. Math. Sci. 1991, 56, 2609–2624. [Google Scholar] [CrossRef]
  16. Holevo, A.S. Statistical Structure of Quantum Theory; Springer: Berlin, 2001. [Google Scholar]
  17. Horn, R.A.; Johnson, C.R. Matrix Analysis; Cambridge University Press: New York, 2007. [Google Scholar]
  18. Higham, N.J. Functions of Matrices; SIAM: Philadelphia, 2008. [Google Scholar]
  19. Hudson, R.L.; Parthasarathy, K.R. Quantum Ito’s formula and stochastic evolutions. Commun. Math. Phys. 1984, 93, 301–323. [Google Scholar] [CrossRef]
  20. Jacobs, K.; Knight, P.L. Linear quantum trajectories: applications to continuous projection measurements. Phys. Rev. A 1998, 57, 2301–2310. [Google Scholar] [CrossRef]
  21. Janson, S. Gaussian Hilbert Spaces; Cambridge University Press: Cambridge, 1997. [Google Scholar]
  22. James, M.R.; Nurdin, H.I.; Petersen, I.R. H control of linear quantum stochastic systems. IEEE Trans. Automat. Contr. 2008, 53, 1787–1803. [Google Scholar] [CrossRef]
  23. Kallianpur, G. Stochastic Filtering Theory; Springer: New York, 1980. [Google Scholar]
  24. Karatzas, I.; Shreve, S.E. Brownian Motion and Stochastic Calculus, 2nd Ed. ed; Springer-Verlag: New York, 1991. [Google Scholar]
  25. Kwakernaak, H.; Sivan, R. Linear Optimal Control Systems; Wiley: New York, 1972. [Google Scholar]
  26. Landau, L.D.; Lifshitz, E.M. Statistical Physics, 3rd Ed. ed; Elsevier: Amsterdam, 1980. [Google Scholar]
  27. Lindblad, G. On the generators of quantum dynamical semigroups. Commun. Math. Phys. 1976, 48, 119–130. [Google Scholar] [CrossRef]
  28. Liptser, R.S.; Shiryayev, A.N. Statistics of Random Processes I: General Theory; Springer-Verlag: Berlin, 1977. [Google Scholar]
  29. Merzbacher, E. Quantum Mechanics, 3rd Ed. ed; Wiley: New York, 1998. [Google Scholar]
  30. Meyer, P.-A. Quantum Probability for Probabilists; Springer: Berlin, 1995. [Google Scholar]
  31. Miao, Z.; James, M.R. Quantum observer for linear quantum stochastic systems. In Proceedings of the 51st IEEE Conf. Decision Control, Maui, Hawaii, USA, 1680–1684., 10-13 December 2012. [Google Scholar]
  32. Nielsen, M.A.; Chuang, I.L. Quantum Computation and Quantum Information; Cambridge University Press: Cambridge, 2000. [Google Scholar]
  33. Nurdin, H.I.; James, M.R.; Petersen, I.R. Coherent quantum LQG control. Automatica 2009, 45, 1837–1846. [Google Scholar] [CrossRef]
  34. Nurdin, H.I.; Yamamoto, N. Linear Dynamical Quantum Systems; Springer: Netherlands, 2017. [Google Scholar]
  35. Parthasarathy, K.R. An Introduction to Quantum Stochastic Calculus; Birkhäuser: Basel, 1992. [Google Scholar]
  36. Parthasarathy, K.R. What is a Gaussian state? Commun. Stoch. Anal. 2010, 4, 143–160. [Google Scholar] [CrossRef]
  37. Parthasarathy, K.R.; Schmidt, K. Positive Definite Kernels, Continuous Tensor Products, and Central Limit Theorems of Probability Theory; Springer-Verlag: Berlin, 1972. [Google Scholar]
  38. Petersen, I.R. Quantum linear systems theory. Open Automat. Contr. Syst. J. 2017, 8, 67–93. [Google Scholar] [CrossRef]
  39. Sakurai, J.J. Modern Quantum Mechanics; Addison-Wesley: Reading, Mass, 1994. [Google Scholar]
  40. Shaiju, A.J.; Petersen, I.R. A frequency domain condition for the physical realizability of linear quantum systems. IEEE Trans. Automat. Contr. 2012, 57, 2033–2044. [Google Scholar] [CrossRef]
  41. Shiryaev, A.N. Probability, 2nd Ed. ed; Springer: New York, 1996. [Google Scholar]
  42. Sichani, A.K.; Vladimirov, I.G.; Petersen, I.R. A numerical approach to optimal coherent quantum LQG controller design using gradient descent. Automatica 2017, 85, 314–326. [Google Scholar] [CrossRef]
  43. Stroock, D.W. Partial Differential Equations for Probabilists; Cambridge University Press: Cambridge, 2008. [Google Scholar]
  44. Vladimirov, I.G.; Petersen, I.R. A quasi-separation principle and Newton-like scheme for coherent quantum LQG control. Syst. Contr. Lett. 2013, 62, 550–559. [Google Scholar] [CrossRef]
  45. Vladimirov, I.G.; Petersen, I.R. Coherent quantum filtering for physically realizable linear quantum plants. In Proceedings of the European Control Conference, Zurich, Switzerland, 2717–2723., 17-19 July 2013. [Google Scholar]
  46. Vladimirov, I.G. A quantum mechanical version of Price’s theorem for Gaussian states. In Proceedings of the 4th Australian Control Conference, Canberra, Australia, 118–123., 17-18 November 2014. [Google Scholar]
  47. Vladimirov, I.G. Weyl variations and local sufficiency of linear observers in the mean square optimal coherent quantum filtering problem. In Proceedings of the 5th Australian Control Conference, Gold Coast, Australia, 93–98., 5-6 November 2015. [Google Scholar]
  48. Vladimirov, I.G. A transverse Hamiltonian variational technique for open quantum stochastic systems and its application to coherent quantum control. In Proceedings of the 2015 IEEE Conference on Control Applications (CCA), Sydney, NSW, Australia, 29–34., 21-23 September 2015. [Google Scholar]
  49. Vladimirov, I.G. A phase-space formulation and Gaussian approximation of the filtering equations for nonlinear quantum stochastic systems. Contr. Theory Techn. 2017, 15, 177–192. [Google Scholar] [CrossRef]
  50. Walls, D.F.; Milburn, G.J. Quantum Optics, Springer, Berlin, 2008.
  51. Wiseman, H.M.; Milburn, G.J. Quantum Measurement and Control; Cambridge University Press: Cambridge, 2010. [Google Scholar]
  52. Yanagisawa, M.; Kimura, H. Transfer function approach to quantum control – part I: dynamics of quantum feedback systems, part II: control concepts and applications. IEEE Trans. Automat. Contr. 2003, 48, 2107–2120. [Google Scholar] [CrossRef]
  53. Yosida, K. Functional Analysis, 6th Ed. ed; Springer: Berlin, 1980. [Google Scholar]
  54. Zhang, G.; James, M.R. Direct and indirect couplings in coherent feedback control of linear quantum systems. IEEE Trans. Automat. Contr. 2011, 56, 1535–1550. [Google Scholar] [CrossRef]
  55. Zhang, G.; Dong, Z. Linear quantum systems: a tutorial. Annual Reviews in Control 2022, 54, 274–294. [Google Scholar] [CrossRef]
Figure 1. The series connection of a quantum plant with a coherent quantum observer, mediated by the plant output field Y and affected by the environment through the input quantum Wiener processes W, ω . The observer design objective is that the drift part of its output η has to approximate the plant variables of interest in a mean square optimal fashion.
Figure 1. The series connection of a quantum plant with a coherent quantum observer, mediated by the plant output field Y and affected by the environment through the input quantum Wiener processes W, ω . The observer design objective is that the drift part of its output η has to approximate the plant variables of interest in a mean square optimal fashion.
Preprints 75059 g001
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.
Prerpints.org logo

Preprints.org is a free preprint server supported by MDPI in Basel, Switzerland.

Subscribe

Disclaimer

Terms of Use

Privacy Policy

Privacy Settings

© 2025 MDPI (Basel, Switzerland) unless otherwise stated