Preprint
Article

This version is not peer-reviewed.

Privacy Factor and Relative Fisher Geometry for Parametric Dynamical Systems Under Gaussian Observation Noise

Submitted:

15 August 2026

Posted:

18 August 2026

You are already at the latest version

Abstract
We develop a theory of informational privacy for parametric deterministic dynamical systems observed in real time through a noisy channel. Starting from the Kullback–Leibler divergence between the law of observations and a reference law, we define the absolute privacy factor as the exponential of the negative KL rate. We then construct a relative Fisher metric on the space-time parameter manifold and an associated relative informational energy functional whose stationary curves are characterized as eigenfunctions of a variational eigenvalue problem, with eigenvalues quantifying the leakage-per-unit-work trade-off. The spectral problem is analyzed in full in the linear Gaussian setting via the Galerkin method, yielding a finite-dimensional approximation with monotone convergence. A sharp lower bound on the privacy factor in terms of the first eigenvalue establishes the fundamental privacy-efficiency trade-off intrinsic to the system. The resulting framework provides a constructive and deterministic solution: the first eigenfunction of the spectral problem is the optimal perturbation of a nominal parameter trajectory that, for a prescribed kinetic budget, maximises the time over which an observer—accessing only the observables—cannot determine the nominal parameter with statistical certainty.
Keywords: 
;  ;  ;  ;  ;  ;  

1. Introduction

Imagine a wind farm whose controller continuously adjusts the pitch of each turbine in response to gusts, a fleet of autonomous vehicles exchanging telemetry with a traffic-management server, or a patient wearing a glucose monitor that streams data to a cloud service. In each case a physical system, governed by parameters that may be commercially sensitive, medically private, or operationally confidential, is observed in real time through a noisy channel. The observer—benign or adversarial—accumulates measurements as the system evolves, and may eventually be able to infer not only the current value of those parameters but also the way they change over time. How much can be learned about the parameter trajectory from the observation stream, and how can the system be operated so as to leak as little as possible?
The intuition we will pursue is geometric. Think of the parameter θ ( t ) as drawing a curve in the system’s parameter space; the observations trace a corresponding curve in the data space, smeared by noise. If the two curves nearly coincide with a reference behaviour, the observer learns very little; if they depart from it, every unit of “effort” the parameter spends deviating from the reference shows up, sooner or later, as statistical distinguishability. The natural way to quantify this trade-off is to compare the law of the observations under the true trajectory with their law under a reference: the more divergent the two laws are, the more readily the observer can tell them apart, with a precise asymptotic rate governed by classical results in hypothesis testing [2,11]. Taking the exponential of the negative divergence rate yields a single dimensionless number in ( 0 , 1 ] , the privacy factor, which measures the asymptotic probability that the best possible test fails to detect a deviation. Maximising it amounts to operating the system along the parametric trajectory that, for a given budget of variation, is hardest to detect.
This intuitive picture turns out to have a clean mathematical counterpart. The space-time parameter manifold inherits a Fisher metric from the observation channel, and curves in this manifold can be assigned an informational energy whose minimisers, at fixed kinetic budget, solve a variational eigenvalue problem. The first eigenvalue λ 1 of this problem is the intrinsic constant of the system: it sets the optimal leakage rate per unit of variational work, and the associated eigenfunction is the optimal-privacy parametric path. In the linear Gaussian case the problem reduces to a generalised matrix eigenproblem of standard Galerkin type, computable in closed form.
Three lines of work in the privacy literature for dynamical systems are relevant to the present paper. The first is differential privacy for trajectories and control loops, originating in the algorithmic results of Dwork and collaborators [19] and adapted to filtering and time-series releases by Le Ny, Pappas, Cortés and others [20,21]; these guarantees are worst-case and typically achieved by injecting calibrated noise into the released outputs. The second is information-theoretic privacy, where mutual information or KL divergence between sensitive variables and released observations plays the role of leakage measure [22,23]; this strand has focused mainly on memoryless or i.i.d. channels. The third addresses privacy in stochastic processes and stochastic control [24,25,26], often via the Fisher information of the parameter estimator. The framework we propose is closest in spirit to the third strand, in that it works with a Fisher-type metric, but differs from all three in two respects: it treats the noise already present in the observation channel as the privacy resource (no additional noise is injected); and it reduces the problem of finding the optimal parametric path to a single spectral problem whose first eigenvalue plays the role of an intrinsic privacy-efficiency constant.
Section 2 introduces the probabilistic setup, the Kullback–Leibler divergence and the privacy factor. Section 3 develops the relative Fisher metric on the space-time manifold Θ ^ = [ 0 , T ] × Θ . Section 4 defines the relative informational energy functional, the Rayleigh quotient, and the variational eigenvalue problem that characterises stationary curves. Section 5 specialises to linear Gaussian dynamics, where the bilinear form is explicit, the structural assumptions are verified concretely, and the Galerkin method delivers a finite-dimensional spectral approximation with monotone convergence. Section 6 establishes the asymptotic upper bound on the KL divergence in terms of the energy functional and the resulting lower bound on the privacy factor, together with its connection to the first eigenvalue.

2. Probabilistic Setup, Divergence, and Privacy Factor

Consider a parametric dynamical system
x ˙ ( t , θ ) = f ( t , x , θ ) x ( 0 ) = x 0
where t [ 0 , T ] , θ Θ R q is the parameter vector, and f is smooth. An external observer O who knows (1) and x 0 measures the system through the noisy observable
y ( t ) = h ( t , x ( t ) , θ ) + ν ( t ) ,
where h : [ 0 , T ] × R n × Θ R m is C 1 in all arguments and ν ( t ) is a zero-mean Gaussian sensor noise of fixed, time-invariant covariance Σ 0 0 , independent across the sampling instants below. Relative to the initial reading,
y ( t ) h ( 0 , x 0 , θ ) N μ ( t , x , θ ) , Σ ( t ) ,
with
μ ( t , x , θ ) = h ( t , x ( t ) , θ ) h ( 0 , x 0 , θ ) , Σ ( t ) Σ 0 .
This is the natural model for repeated independent measurements of a fixed-precision instrument.
Suppose that the observer samples (2) uniformly at times
t i = a + i Δ t , i = 1 , , T , Δ t = b a T ,
obtaining Y : = { y 1 , , y T } with
y i = μ ( t i , x ( t i θ ( t i ) ) , θ ( t i ) ) + w i , w i N ( 0 , Σ 0 ) ,
the noise terms { w i } are mutually independent. The joint law conditioned on θ ( · ) is
P θ ( T ) = i = 1 T N ( μ i , Σ i ) , μ i : = μ ( t i , x ( t i θ ( t i ) ) , θ ( t i ) ) , Σ i : = Σ ( t i ) = Σ 0 .
The object P θ ( T ) represents everything the observer can see: any inference or test is a function of a sample from P θ ( T ) .
We now introduce an instrument for comparing different distributions.
Definition 1
([1,2]). Let P , Q be probability laws on ( Y , B ) with P Q . The Kullback–Leibler divergence is
D K L ( P Q ) : = Y log d P d Q d P [ 0 , + ] .
Here we recall some basic properties.
Lemma 1.
If P ( T ) = i = 1 T P i and Q ( T ) = i = 1 T Q i with P i Q i , then
D K L P ( T ) Q ( T ) = i = 1 T D K L ( P i Q i ) .
Lemma 2.
Let P = N ( μ 1 , Σ ) and Q = N ( μ 2 , Σ ) with Σ 0 . Then
D K L ( P Q ) = 1 2 ( μ 1 μ 2 ) Σ 1 ( μ 1 μ 2 ) .
Proof. 
Expanding the Gaussian densities gives log ( p 1 / p 2 ) = ( μ 1 μ 2 ) Σ 1 y 1 2 ( μ 1 Σ 1 μ 1 μ 2 Σ 1 μ 2 ) . Taking expectation under P = N ( μ 1 , Σ ) with E P [ y ] = μ 1 and simplifying gives (10). □
Corollary 1.
For P ( T ) = i N ( μ i P , Σ i ) and Q ( T ) = i N ( μ i Q , Σ i ) with Σ i 0 ,
D K L P ( T ) Q ( T ) = 1 2 i = 1 T ( μ i P μ i Q ) Σ i 1 ( μ i P μ i Q ) .
Proof. 
Combine Lemmas 1 and 2. □
The total divergence D K L ( P ( T ) Q ( T ) ) grows linearly with T and is thus not a resolution-independent privacy measure [2,8]. We normalize and pass to the limit.
Definition 2.
A reference law for the observation process is a sequence of product Gaussian measures
Q ( T ) = i = 1 T N μ q ( t i ) , Σ i , i = 1 , , T ,
where μ q : [ 0 , T ] R m is a deterministic function of time alone, sharing the noise covariance Σ i of P θ ( T ) in (7).
Definition 3
([6,8,12]). The KL rate of P with respect to a reference law Q is
D ¯ ( P Q ) : = lim sup T 1 T D K L P ( T ) Q ( T ) .
Definition 4.
The absolute privacy factor of P with respect to a reference law Q is
Π ¯ abs ( P Q ) : = exp D ¯ ( P Q ) ( 0 , 1 ] .
Remark 1.
We adopt the lim sup formulation rather than the ordinary limit for two reasons. First, the lim sup exists for every sequence of laws P ( T ) , Q ( T ) , so D ¯ is well-defined without any additional hypothesis. Second, the lim sup is the conservative choice from the privacy perspective: it controls the worst-case exponential rate of optimal hypothesis tests in Stein’s sense [2]. When the limit lim T 1 T D K L ( P ( T ) Q ( T ) ) exists, the lim sup in (13) coincides with this limit. All bounds below remain valid for the lim sup.
The factor Π ¯ abs attains its extreme values as follows: Π ¯ abs = 1 when the KL rate is zero (maximal privacy: the trajectory is statistically indistinguishable from the reference at every frequency), and Π ¯ abs 0 when D ¯ + (zero privacy).
The exponential form is motivated by Stein’s lemma [11]: for the test H 0 : Q vs H 1 : P , the optimal type-II error at fixed level decays as e T D ¯ ( P Q ) [12,13]. Thus Π ¯ abs corresponds, up to normalization, to the Bahadur efficiency of the optimal test [15] — the asymptotic probability that the adversary fails to distinguish P from Q.

3. Relative Fisher Metric

Throughout the paper we use t for physical time (the variable of the original dynamical system and of the sampling times t i ) and s for the parameter along curves on Θ ^ . When a curve is in graph form (Definition 8) the two coincide, s = t . Where no ambiguity arises we tacitly identify the two; otherwise we make the dependence explicit by writing γ ( s ) = ( t ( s ) , θ ( s ) ) .
Now we have to go in the geometric details. The parameter space extended to time,
Θ ^ : = [ 0 , T ] × Θ ,
is a differentiable ( q + 1 ) -dimensional manifold. A generic local coordinate is ξ = ( s , θ 1 , , θ q ) , with s the temporal component. We use index 0 for the temporal component, indices 1 , , q for the parametric ones, and Latin indices a , b , c running over { 0 , 1 , , q } .
The manifold Θ ^ inherits the Fisher metric by pullback from the statistical space { p ξ = N ( μ ( ξ ) , Σ ( s ) ) } [3]:
g a b ( ξ ) : = E p ( a log p ) ( b log p ) = ( a μ ) Σ ( s ) 1 ( b μ ) .
Here a log p ( y ; ξ ) denotes the scalar partial derivative of log p with respect to the a-th coordinate of ξ , so the expectation above is of a product of two scalar functions of y. This metric measures velocity of μ ( ξ ) in the absolute observation space. To adapt it to a fixed reference, we introduce the following.
Definition 5.
Fix a reference q with mean μ q : [ 0 , T ] R m depending only on s. The relative observable is
μ ˜ ( s , θ ) : = μ ( s , θ ) μ q ( s ) .
Definition 6.
The Fisher metric relative to qon Θ ^ is
g ˜ a b ( ξ ) : = ( a μ ˜ ) Σ ( s ) 1 ( b μ ˜ ) , a , b = 0 , 1 , , q .
We now collect the basic properties of g ˜ .
Proposition 1.
The metric g ˜ satisfies:
(i) 
Purely parametric components are reference-independent: g ˜ i j = g i j for all i , j { 1 , , q } .
(ii) 
Temporal and mixed components depend on μ ˙ q :
g ˜ 0 j ( ξ ) = ( 0 μ μ ˙ q ) Σ 1 ( j μ ) , g ˜ 00 ( ξ ) = 0 μ μ ˙ q Σ 1 2 .
(iii) 
If μ q is constant, then g ˜ g .
(iv) 
When μ q ( s ) = μ ( s , θ 0 ) (nominal reference), g ˜ depends on θ only through η : = θ θ 0 .
Proof. (i) Since μ q depends only on s, i μ ˜ = i μ for i 1 . (ii) 0 μ ˜ = 0 μ μ ˙ q ; substitute into (17). (iii) If μ ˙ q = 0 , all blocks recover g. (iv) When μ q ( s ) = μ ( s , θ 0 ) , the dependence on θ in 0 μ ˜ and j μ ˜ occurs exclusively through η = θ θ 0 . □
The metric g ˜ is the Fisher metric of the statistical space of deviations from the reference. While g measures absolute velocity in the observation space, g ˜ measures the velocity of the deviation curve s μ ˜ ( s , θ ( s ) ) . When μ q ( s ) = μ ( s , θ 0 ) , the metric g ˜ is translation-invariant in parameter space (property (iv)), making it structurally simpler than the absolute metric.

4. Informational Energy Functional and Spectral Problem

We now introduce the core of this paper: the variational approach to the privacy problem in the Fisher-metric context.
Definition 7.
For a curve γ : [ a , b ] Θ ^ with γ ( s ) = ( s , θ ( s ) ) , the Fisher energy is
E ˜ [ γ ] : = 1 2 a b g ˜ a b ( γ ( s ) ) γ ˙ a ( s ) γ ˙ b ( s ) d s .
Setting δ μ ( s ) : = μ ( s , θ ( s ) ) μ q ( s ) and δ μ ˙ : = d d s δ μ , and using the previous results for the Gaussian case, this becomes
E ˜ [ γ ] = 1 2 a b δ μ ˙ ( s ) Σ ( s ) 1 δ μ ˙ ( s ) d s ,
the integral of the squared velocity of the deviation curve weighted by the inverse covariance [3]. When μ ˙ q 0 , the classical Fisher–Rao energy is recovered.
Definition 8.
A curve γ : [ a , b ] Θ ^ is a t-section if t ( s ) = γ 0 ( s ) is strictly monotone. It is in graph form if γ ˙ 0 = + 1 , equivalently if γ 0 ( s ) = s .
Remark 2.
Compatibility with the endpoints γ 0 ( a ) = a , γ 0 ( b ) = b and strict monotonicity force, after reparametrisation, the graph form γ 0 ( s ) = s . We therefore identify every admissible t-section with its graph γ ( s ) = ( s , θ ( s ) ) , s [ a , b ] , and write the deviation as η ( s ) : = θ ( s ) θ 0 .
Suppose now that γ ( t ) = θ 0 + η ( t ) where θ 0 Θ is fixed. We impose η ( a ) = 0 and leave η ( b ) free. The admissible space is
V : = η H 1 ( [ a , b ] ; R q ) : η ( a ) = 0 ,
a Hilbert space with inner product [17] η 1 , η 2 H 1 = a b ( η 1 η 2 + η ˙ 1 η ˙ 2 ) d s .
We assume henceforth that E ˜ [ · ] restricts to a continuous quadratic form on V , i.e., there exists a bounded symmetric bilinear form E : V × V R with E ˜ [ η ] = 1 2 E ( η , η ) . This holds in the linear Gaussian setting (Section 5); see Proposition 3.
Define the Euclidean kinetic energy and its bilinear form:
K [ η ] : = K ( η , η ) , K ( η 1 , η 2 ) : = a b η ˙ 1 ( s ) η ˙ 2 ( s ) d s .
For η V , the Poincaré inequality together with the boundary condition η ( a ) = 0 gives K [ η ] = 0 η 0 , so K is non-degenerate.
Definition 9.
For each η V { 0 } ,
R [ η ] : = E ˜ [ η ] K [ η ] = E ( η , η ) 2 K ( η , η ) .
The quotient R [ η ] is the informational leakage rate per unit of Euclidean work. It is scale-invariant: R [ c η ] = R [ η ] for all c 0 , so it characterizes the shape of η , not its amplitude.
Lemma 3.
For every η , v V ,
D E ˜ [ η ] , v = E ( η , v ) ,
D K [ η ] , v = 2 K ( η , v ) = 2 a b η ˙ ( s ) v ˙ ( s ) d s .
The two bilinear forms E and K are distinct objects on V × V : E is the energy form introduced after Definition 7 (explicitly realised, in the linear Gaussian case, by (41)), while K is the kinetic form (21), i.e. the L 2 inner product of the velocities η ˙ and v ˙ .
Proof. 
By quadraticity of E ˜ : d d ϵ | ϵ = 0 1 2 E ( η + ϵ v , η + ϵ v ) = E ( η , v ) . Analogously, K [ η ] = K ( η , η ) with K from (21) gives d d ϵ | ϵ = 0 K [ η + ϵ v ] = 2 K ( η , v ) = 2 a b η ˙ v ˙ d s . □
Lemma 4.
For every η V with K [ η ] > 0 and every v V ,
D R [ η ] , v = 1 K [ η ] E ( η , v ) 2 R [ η ] K ( η , v ) .
Proof. 
Apply the quotient rule to R = E ˜ / K using Lemma 3. □
Theorem 1.
Let η * V with K [ η * ] > 0 . The following are equivalent:
(i) 
η * is a stationary point of R ;
(ii) 
the pair ( λ * , η * ) with λ * : = R [ η * ] satisfies
E ( η * , v ) = 2 λ * K ( η * , v ) v V .
Proof.(i)⇒(ii). Setting D R [ η * ] , v = 0 in (25) and dividing by K [ η * ] > 0 gives (26). (ii)⇒(i). Taking v = η * in (26) and dividing by 2 K [ η * ] > 0 shows λ * = R [ η * ] , then (25) gives zero. □
We have thus found that the perturbation of θ 0 which is optimal with respect to the Fisher information metric at fixed kinetic budget is a solution of an eigenvalue problem. This motivates the following definition.
Definition 10.
Find pairs ( λ , η ) R × ( V { 0 } ) such that
E ( η , v ) = 2 λ K ( η , v ) v V .
In order to effectively achieve a solution we need some basic assumptions on the involved functionals.
Assumption 1.
The bilinear form E on V is:
(A1) 
symmetric and bounded: | E ( η 1 , η 2 ) | C E η 1 H 1 η 2 H 1 ;
(A2) 
there exist α > 0 , β R with E ( η , η ) α K [ η ] + β η L 2 2 .
Under Assumption 1, the compact embedding H 1 L 2 (Rellich–Kondrachov [17]) and the spectral theory of symmetric pencils ( E , 2 K ) with K positive definite [9] imply that problem (26) admits a real, discrete spectrum λ 1 λ 2 + , with K -orthonormal eigenfunctions { η ( k ) } .
Theorem 2
([9,17]). Under Assumption 1, the first eigenvalue λ 1 admits the variational characterization
λ 1 = inf η V { 0 } R [ η ] = inf η V { 0 } E ˜ [ η ] K [ η ] ,
attained by every eigenfunction η ( 1 ) associated to λ 1 . For k 2 ,
λ k = inf W V dim W = k sup η W { 0 } R [ η ]

5. The Linear Gaussian Case

We now specialize all constructions to the linear Gaussian setting, which admits explicit closed-form expressions for the metric, the energy functional, and the Galerkin matrices, and for which Assumption 1 is verified concretely.
Consider the linear parametric system
x ˙ ( t , θ ) = A ( t ) x ( t , θ ) + B ( t ) θ , x ( 0 ) = x 0 ,
with A C 2 ( [ 0 , T ] ; R n × n ) , B C 2 ( [ 0 , T ] ; R n × q ) , and the affine observable
h ( t , x , θ ) = C x + D , C R m × n , D R m .
We take the sensor covariance time-invariant, Σ ( t ) Σ 0 with Σ 0 0 (fixed-precision measurements).
By linearity, x ( t , θ ) = ξ ( t ) + B ( t ) θ where
ξ ˙ = A ( t ) ξ , ξ ( 0 ) = x 0 ; B ˙ = A ( t ) B + B ( t ) , B ( 0 ) = 0 ,
so the observation mean is
μ ( t , θ ) = C ( ξ ( t ) x 0 ) + C B ( t ) θ .
With nominal reference at θ 0 , the relative observable (16) becomes
μ ˜ ( s , θ ) = C B ( s ) η , η : = θ θ 0 .
Define
M : = C Σ 0 1 C R n × n , M = M , M 0 ,
M ( s ) : = B ( s ) M B ( s ) , N ( s ) : = B ( s ) M B ˙ ( s ) , P ( s ) : = B ˙ ( s ) M B ˙ ( s ) .
Here M and P are symmetric, while N is not symmetric in general. The following elementary identity holds.
Lemma 5.
M ˙ ( s ) = N ( s ) + N ( s ) .
Proof. 
Differentiate M = B M B using the product rule. □
Definition 11.
The model satisfies observational identifiability on [ a , b ] if M ( s ) 0 for all s [ a , b ] .
Remark 3.
If M ( s ) is only positive semidefinite—i.e. observational identifiability fails—there exist directions η R q with M ( s ) η = 0 for all s [ a , b ] , meaning those parameter directions leave the relative observable μ ˜ ( s , θ ) = C B ( s ) η unchanged. Such directions are perfectly private : they contribute zero to E ˜ and therefore to the KL divergence, so λ 1 = 0 and the privacy-factor bound (63) reduces to the trivial estimate Π ¯ abs 1 . Moreover, the optimal trajectory is no longer unique. A complete treatment requires decomposing R q into an observable subspace (on which M ( s ) is positive definite) and a hidden subspace (the kernel of M ( s ) ), and restricting the spectral problem to the former. We assume observational identifiability throughout and defer the degenerate case to future work.
The first step in specialising the eigenproblem to this case is to identify the elements involved. We begin with g ˜ .
Proposition 2.
For the linear Gaussian system, the components of g ˜ at ( s , θ ) are
g ˜ i j ( s , θ ) = [ M ( s ) ] i j ,
g ˜ 0 j ( s , θ ) = [ N ( s ) η ] j ,
g ˜ 00 ( s , θ ) = η P ( s ) η .
Proof. 
From (34): i μ ˜ = C B e ^ i and 0 μ ˜ = C B ˙ η . Substituting into (17) with Σ ( s ) 1 = Σ 0 1 and M = C Σ 0 1 C :
g ˜ i j = e ^ i B M B e ^ j = M i j , g ˜ 0 j = η B ˙ M B e ^ j = [ N η ] j , g ˜ 00 = η B ˙ M B ˙ η = η P η .
From this, the energy E ˜ follows.
Proposition 3.
Along a t-section γ ( s ) = ( s , θ 0 + η ( s ) ) ,
E ˜ [ γ ] = 1 2 a b η P ( s ) η + 2 η ˙ N ( s ) η + η ˙ M ( s ) η ˙ d s .
Proof. 
With γ ˙ 0 = 1 , γ ˙ j = η ˙ j , the integrand g ˜ a b γ ˙ a γ ˙ b = g ˜ 00 + 2 g ˜ 0 j η ˙ j + g ˜ i j η ˙ i η ˙ j becomes, using Proposition 2,
η P η + 2 η N η ˙ + η ˙ M η ˙ .
The mixed term is the scalar η N η ˙ = η ˙ N η , hence the writing in (40). Integrating over [ a , b ] gives the claim. □
The formula (40) shows that E ˜ is a continuous quadratic form on V ; the associated symmetric bilinear form is
E ( η 1 , η 2 ) : = a b η 1 P η 2 + η ˙ 1 N η 2 + η 1 N η ˙ 2 + η ˙ 1 M η ˙ 2 d s .
Symmetry of E is manifest: M and P are symmetric, and the mixed terms η ˙ 1 N η 2 and η 1 N η ˙ 2 exchange under η 1 η 2 . The specialisation η 1 = η 2 = η recovers (40) via E ( η , η ) = 2 E ˜ [ η ] .
Proposition 4.
Assume observational identifiability (Definition 11) and M , N , P C 0 ( [ a , b ] ) . Then Assumption 1 holds with explicit constants. Specifically, set
m * : = inf s [ a , b ] λ min ( M ( s ) ) > 0 , M * : = sup s [ a , b ] M ( s ) , N * : = sup s [ a , b ] N ( s ) , P * : = sup s [ a , b ] P ( s ) ,
all finite by continuity and compactness of [ a , b ] . Then
(A1) 
E is bounded:
| E ( η 1 , η 2 ) | C E η 1 H 1 η 2 H 1 , C E : = max ( M * , P * , 2 N * ) .
(A2) 
E is coercive: for every ε ( 0 , 1 ) ,
E ( η , η ) α K [ η ] + β η L 2 2 ,
with
α : = ( 1 ε ) m * , β : = P * N * 2 ε m * .
The constant α is strictly positive; β can be made arbitrarily close to P * by choosing ε 1 , at the price of decreasing the coercivity constant α.
Proof.(A1). Each of the four summands in (41) is controlled by Cauchy–Schwarz in L 2 : η 1 P η 2 d s P * η 1 L 2 η 2 L 2 , and analogously for the other three terms with weights N * , N * , M * on the appropriate L 2 -norms of η j and η ˙ j . Summing and using η L 2 η H 1 , η ˙ L 2 η H 1 yields (42).
(A2). By observational identifiability, M ( s ) m * I q on [ a , b ] . Hence
a b η ˙ M ( s ) η ˙ d s m * a b η ˙ 2 d s = m * K [ η ] .
The cross term is controlled by Young’s inequality with parameter ε ( 0 , 1 ) :
2 a b η ˙ N ( s ) η d s N * 2 ε m * η L 2 2 + ε m * a b η ˙ 2 d s .
(Here we used the elementary identity 2 | x y | δ x 2 + δ 1 y 2 with x = N η , y = η ˙ and δ = 1 / ( ε m * ) , rearranged.) The diagonal P -term contributes η P η d s P * η L 2 2 (if P is not sign-definite; if P 0 the bound becomes + P * , which only improves (43)). Collecting,
E ( η , η ) ( 1 ε ) m * K [ η ] N * 2 ε m * P * η L 2 2 ,
which is (43) with α , β as in (44). □
Remark 4.
Even when β in (44) is negative, the bound (A2) of Assumption 1 only requires α > 0 , and the Poincaré-type inequality K [ η ] C P η L 2 2 for η V (with C P = π 2 / [ 4 ( b a ) 2 ] , from the boundary condition η ( a ) = 0 [17]) allows the L 2 -term to be absorbed into K [ η ] at the cost of replacing α by α | β | / C P , which remains positive provided | β | < α C P . This is automatic for sufficiently small ε or whenever the observation window b a is short enough. In either case the net coercivity constant α | β | / C P is strictly positive, so E is coercive relative to K [ · ] on V , and the spectral theory of Section 4 applies without modification.
We now have all the ingredients to solve the problem via the Galerkin method. The Galerkin method [9,10] discretizes (26) in a finite-dimensional subspace V N V . Choose the adapted sine basis satisfying ϕ j , α ( a ) = 0 :
ϕ j , α ( s ) : = sin ( 2 j 1 ) π 2 ( b a ) ( s a ) e ^ α , j = 1 , 2 , , α = 1 , , q ,
Remark 5.
The basis (45) satisfies two boundary conditions consistent with the variational problem. By construction, ϕ j , α ( a ) = 0 (Dirichlet condition, required by V ). For the natural condition at s = b , note that with ω j : = ( 2 j 1 ) π / [ 2 ( b a ) ] ,
ϕ j , α ( b ) = ω j cos ω j ( b a ) e ^ α = ω j cos ( 2 j 1 ) π 2 e ^ α = 0 ,
since cos ( ( 2 j 1 ) π / 2 ) = 0 for every integer j 1 . Consequently η ˙ N ( b ) = 0 for every η N V N , which is consistent. A basis with ϕ j , α ( b ) = 0 (full Dirichlet at b) would not respect this condition and would reduce the convergence rate.
and set V N : = span { ϕ 1 , , ϕ N } . The Galerkin ansatz is
η N ( s ) = j = 1 N c j ϕ j ( s ) , c : = ( c 1 , , c N ) .
Define the symmetric matrices
[ M E ] i j : = E ( ϕ i , ϕ j ) , [ M K ] i j : = 2 K ( ϕ i , ϕ j ) .
Proposition 5.
Restricting (26) to V N is equivalent to
M E c = λ M K c , c R N { 0 } .
This has N real eigenvalues λ 1 ( N ) λ N ( N ) with K -orthonormal eigenvectors.
Proof. 
Substitute (47) into (26) with v = ϕ i : j c j E ( ϕ j , ϕ i ) = λ j c j · 2 K ( ϕ j , ϕ i ) , i.e., M E c = λ M K c . Symmetry and positive definiteness of M K give a real spectrum. □
Setting ω j : = ( 2 j 1 ) π 2 ( b a ) and ψ j ( s ) : = sin ( ω j ( s a ) ) :
Proposition 6.
In the sine basis (45),
[ M K ] ( j , α ) , ( k , β ) = ( b a ) ω j 2 δ j k δ α β ,
so M K is diagonal. The stiffness matrix M E has entries
[ M E ] ( j , α ) , ( k , β ) = a b ψ j ψ k P α β + ω j ψ j ψ k N α β + ω k ψ j ψ k N β α + ω j ω k ψ j ψ k M α β d s ,
where ψ j ( s ) = cos ( ω j ( s a ) ) .
Proof. 
Diagonality of M K follows from a b cos ( ω j ( s a ) ) cos ( ω k ( s a ) ) d s = b a 2 δ j k and the factor 2 in (48). The formula for M E follows from substituting ϕ j , α , ϕ k , β into (41). □
Diagonality of M K reduces the generalized problem to the standard one
( M K 1 / 2 M E M K 1 / 2 ) c ˜ = λ c ˜ .
The integrals in (51) are computed via Gauss–Legendre quadrature; the dominant cost is O ( J 2 q 2 N quad ) to assemble M E and O ( ( J q ) 3 ) to diagonalize.
We have thus reduced the functional eigenproblem to a matrix eigenproblem via a Galerkin approximation. This approximation converges in an appropriate sense, so we can truncate the expansion after a certain N in order to achieve a satisfactory approximation.
Theorem 3
([9,10]). Under observational identifiability, for each fixed k and N k :
(i) 
λ k λ k ( N + 1 ) λ k ( N ) (monotone from above);
(ii) 
λ k ( N ) λ k as N ;
(iii) 
if η ( k ) is simple, then η N ( k ) η ( k ) in V .
For the sine basis (45), the error λ k ( N ) λ k decays as O ( N 2 r ) with r the Sobolev regularity of η ( k ) [10]. When M , N , P C , the decay is exponential in N.
Corollary 2.
Let η ( k ) be an eigenfunction with K [ η ( k ) ] = 1 . For every c R ,
K [ c η ( k ) ] = c 2 , E ˜ [ c η ( k ) ] = λ k c 2 .
Proof. 
Quadraticity of K and E ˜ , together with E ˜ [ η ( k ) ] = λ k K [ η ( k ) ] = λ k . □
Corollary 3.
Among all t-sections with K [ γ ] = K 0 and θ ( a ) = θ 0 , the curve η = K 0 η ( 1 ) uniquely minimizes E ˜ :
min η V : K [ η ] = K 0 E ˜ [ η ] = λ 1 K 0 .
Proof. 
By Theorem 2, E ˜ [ η ] λ 1 K [ η ] = λ 1 K 0 for all admissible η , with equality iff η η ( 1 ) . □
Every η V decomposes as η = k c k η ( k ) with K -orthonormal eigenfunctions, giving
K [ η ] = k c k 2 , E ˜ [ η ] = k λ k c k 2 .
Minimizing E ˜ at fixed K concentrates all weight on η ( 1 ) . Modes k 2 (with λ k > λ 1 ) become relevant only when additional constraints (waypoints, forbidden parametric regions) prevent using η ( 1 ) alone.

6. Privacy Factor Bound and Connection with the First Eigenvalue

We establish that the informational energy E ˜ [ γ ] controls Π ¯ abs through an explicit asymptotic bound, and connect this bound to the spectral structure via the Rayleigh principle.
We work under the following regularity hypotheses:
(R1)
h C 1 ( [ 0 , T ] × R n × Θ ; R m ) ;
(R2)
f C 1 ( [ 0 , T ] × R n × Θ ; R n ) ;
(R3)
θ C 1 ( [ a , b ] ; Θ ) ;
(R4)
Σ ( t ) Σ 0 0 (constant, time-invariant sensor covariance).
Lemma 6.
Under (R1)–(R3), with δ μ ( s ) : = μ ( s , θ ( s ) ) μ q ( s ) ,
δ μ ( t i ) = δ μ ( a ) + a t i δ μ ˙ ( s ) d s , i = 1 , , T .
Lemma 7.
For continuous v : [ a , t i ] R m and A 0 ,
a t i v d s A a t i v d s ( t i a ) a t i v A v d s .
Proof. 
Apply Jensen’s inequality [18] to the convex quadratic ϕ ( v ) = v A v under the uniform measure on [ a , t i ] , then multiply by ( t i a ) 2 . □
Proposition 7.
Under (R1)–(R4), for every t-section γ and every i,
δ μ ( t i ) Σ 0 1 δ μ ( t i ) 2 δ μ ( a ) Σ 0 1 2 + 2 ( t i a ) a t i g ˜ a b ( γ ) γ ˙ a γ ˙ b d s .
Proof. 
Apply u + v A 2 2 u A 2 + 2 v A 2 to (55) with A = Σ 0 1 , then Lemma 7 with A = Σ 0 1 and v = δ μ ˙ . Since Σ ( s ) Σ 0 , the weight Σ i 1 coincides with Σ ( s ) 1 for every s, so the inequality is exact with no remainder. □
Lemma 8.
For the uniform sampling (5) with k ( s ) : = min { i : t i s } ,
Δ t i k ( s ) ( t i a ) = 1 2 ( b a ) 2 ( s a ) 2 + O ( Δ t ) .
Proof. 
Set j = i k ( s ) + 1 and use j = 1 N j = N ( N + 1 ) / 2 with k ( s ) Δ t s a and T Δ t = b a . □
Theorem 4.
Under (R1)–(R4) and the boundary condition δ μ ( a ) = 0 (equivalently θ ( a ) = θ 0 when μ q ( s ) = μ ( s , θ 0 ) ), for every t-section γ and every sufficiently small Δ t = ( b a ) / T ,
D K L P γ ( T ) Q ( T ) ( b a ) 2 2 Δ t E ˜ [ γ ] + R ( Δ t ) ,
where the remainder R ( Δ t ) is uniformly bounded as Δ t 0 : | R ( Δ t ) | C ( γ , Σ , b a ) , with C depending only on the trajectory γ, the noise covariance Σ and the window length b a . Consequently, for the KL rate,
D ¯ ( P γ Q ) : = lim sup T 1 T D K L ( P γ ( T ) Q ( T ) ) 1 2 ( b a ) E ˜ [ γ ] .
Proof. 
By Corollary 1 and Proposition 7, summing the pointwise bound over i = 1 , , T ,
2 D K L ( P γ ( T ) Q ( T ) ) 2 i = 1 T δ μ ( a ) Σ 0 1 2 + 2 i = 1 T ( t i a ) a t i g ˜ a b γ ˙ a γ ˙ b d s .
First term. Under the standing boundary condition δ μ ( a ) = 0 the first sum vanishes identically. (If dropped, it would contribute T δ μ ( a ) Σ 0 1 2 = O ( T ) , hence a nonzero constant to the rate after division by T; under δ μ ( a ) = 0 it disappears.)
Main term. Exchange integration and summation:
i = 1 T ( t i a ) a t i g ˜ a b γ ˙ a γ ˙ b d s = a b g ˜ a b γ ˙ a γ ˙ b W T ( s ) d s , W T ( s ) : = i k ( s ) ( t i a ) .
By Lemma 8, Δ t W T ( s ) = 1 2 [ ( b a ) 2 ( s a ) 2 ] + r T ( s ) with | r T ( s ) | c Δ t uniformly in s [ a , b ] . Therefore
i ( t i a ) a t i g ˜ a b γ ˙ a γ ˙ b d s = 1 Δ t a b g ˜ a b γ ˙ a γ ˙ b · 1 2 [ ( b a ) 2 ( s a ) 2 ] d s + R 1 ( Δ t ) ( b a ) 2 2 Δ t a b g ˜ a b γ ˙ a γ ˙ b d s + R 1 ( Δ t ) ,
where the inequality uses ( s a ) 2 0 , and the absolute value of R 1 is bounded by c a b g ˜ a b γ ˙ a γ ˙ b d s = 2 c E ˜ [ γ ] , hence again constant in Δ t .
Dividing the resulting inequality by 2 produces (59) with R ( Δ t ) = R 1 ( Δ t ) uniformly bounded as Δ t 0 . Dividing instead by T = ( b a ) / Δ t gives, for every finite T,
1 T D K L P γ ( T ) Q ( T ) 1 2 ( b a ) E ˜ [ γ ] + 1 T R ( Δ t ) = 1 2 ( b a ) E ˜ [ γ ] + o ( 1 ) , T ,
since R ( Δ t ) is bounded and 1 / T 0 . Taking lim sup T on both sides yields (60). □
Corollary 4.
Under (R1)–(R4),
Π ¯ abs ( P γ Q ) exp 1 2 ( b a ) E ˜ [ γ ] .
Corollary 5.
For every t-section γ with η = θ θ 0 V ,
Π ¯ abs ( P γ Q ) exp 1 2 ( b a ) λ 1 K [ γ ] ,
with equality in the Rayleigh principle achieved by η = K [ γ ] η ( 1 ) . The eigenvalue λ 1 is approximated from above by λ 1 ( N ) of the Galerkin problem (49) (Theorem 3).
Proof. 
Corollary 3 gives E ˜ [ γ ] λ 1 K [ γ ] . Substituting into (62) yields (63). □
The bound (63) establishes a fundamental privacy-efficiency trade-off: for any parametric budget K 0 = K [ γ ] , the optimal curve K 0 η ( 1 ) has privacy decaying as exp ( 1 2 ( b a ) λ 1 K 0 ) . The first eigenvalue λ 1 is the intrinsic constant of the system governing this trade-off, depending only on M , N , P (dynamics and observable) and the interval [ a , b ] [3,16].
Theorem 5.
For the linear Gaussian system with nominal reference Q ( T ) = i N ( μ ( t i , θ 0 ) , Σ i ) ,
D K L ( P γ ( T ) Q ( T ) ) = 1 2 i = 1 T η ( t i ) M ( t i ) η ( t i ) , η ( t i ) = θ ( t i ) θ 0 .
Proof. 
By Corollary 1, μ ( t i , θ ( t i ) ) μ ( t i , θ 0 ) = C B ( t i ) η ( t i ) by (33). Using Σ i 1 = Σ 0 1 and M = C Σ 0 1 C gives each term as η M η , yielding (64). □
The formula (64) is an identity and not a bound. Along the scaled eigenfunction γ k ( s ) : = ( s , θ 0 + c η ( k ) ( s ) ) , the KL sum is a Riemann sum converging, as Δ t 0 , to
Δ t i = 1 T 1 2 c 2 η ( k ) ( t i ) M ( t i ) η ( k ) ( t i ) Δ t 0 c 2 2 a b η ( k ) ( s ) M ( s ) η ( k ) ( s ) d s = : I k c 2 ,
so that
D K L ( P γ k ( T ) Q ( T ) ) = c 2 I k Δ t + o ( 1 / Δ t ) , Δ t 0 .
The bound of Theorem 4 predicts D K L ( b a ) 2 2 Δ t λ k c 2 + O ( 1 ) , so the asymptotic gap ratio between the exact divergence and the bound along the k-th eigenmode is
τ k : = lim T D K L ( P γ k ( T ) Q ( T ) ) ( b a ) 2 2 Δ t λ k c 2 = 2 I k ( b a ) 2 λ k ( 0 , 1 ] .
The upper bound τ k 1 follows from the Cauchy–Schwarz and Jensen steps used in Theorem 4; equality holds only when those inequalities are saturated, which in general fails along eigenfunctions. The numerical value of τ k thus quantifies how tight the privacy-factor bound (63) is on the k-th optimal-privacy trajectory of the system.

7. Numerical Results

We instantiate the linear Gaussian framework of Section 5 with the following very easy choices. The state matrix
A = 0 1 1 0
has purely imaginary eigenvalues ± i . The remaining parameters are
B = 1.0 0.5 0.3 1.0 , C = 1.0 0.5 0.2 0.8 , Σ ( t ) Σ 0 = diag ( σ 1 2 , σ 2 2 ) ,
with n = q = m = 2 , σ 1 = 0.5 , σ 2 = 1.2 , x 0 = ( 1 , 0 ) , θ 0 = ( 0.3 , 0.2 ) , and observation window [ a , b ] = [ 0.5 , 10 ] . The bivariate observation ( m = 2 ) with anisotropic noise ( σ 2 > σ 1 ) breaks the symmetry between the two parameter components in the Fisher weight M = C Σ 0 1 C R 2 × 2 , yielding a richer spectral structure than the scalar case. The five qualitative displays (Figure 1, Figure 2, Figure 3 and Figure 4) use a Galerkin space of dimension N = J q = 4 × 2 = 8 , sufficient to resolve the geometric features of the lowest modes. All five displayed modes are scaled to kinetic budget K 0 = K [ η ( k ) ] = 1 .
Figure 1 collects the state-space picture. The left block shows x 1 ( t ) and x 2 ( t ) for the nominal trajectory θ θ 0 (solid black) together with the five mode-optimal perturbations θ ( k ) ( t ) = θ 0 + η ( k ) ( t ) (dashed). The framing phase-plane panels confirm the center structure: the nominal orbit is a closed circle, while each mode-optimal path deforms it in a pattern determined by the shape of η ( k ) . Lower modes ( k = 1 , 2 ) produce wider, smoother deformations; higher modes introduce faster oscillations that keep the trajectory close to the nominal.
Figure 1. State trajectories under mode-optimal parameter paths θ ( k ) ( t ) = θ 0 + η ( k ) ( t ) , all scaled to K 0 = 1 . Left block: time series x 1 ( t ) (top) and x 2 ( t ) (bottom); nominal in solid black, modes k = 1 , , 5 in dashed colour. Framing panels: phase plane ( x 1 , x 2 ) per mode vs. nominal; circles mark t = a , triangles t = b .
Figure 1. State trajectories under mode-optimal parameter paths θ ( k ) ( t ) = θ 0 + η ( k ) ( t ) , all scaled to K 0 = 1 . Left block: time series x 1 ( t ) (top) and x 2 ( t ) (bottom); nominal in solid black, modes k = 1 , , 5 in dashed colour. Framing panels: phase plane ( x 1 , x 2 ) per mode vs. nominal; circles mark t = a , triangles t = b .
Preprints 228552 g001
Figure 2 shows the mode-optimal paths directly in the two-dimensional parameter space ( θ 1 , θ 2 ) . All curves originate and terminate near the nominal θ 0 , forming loops whose shape reflects the basis structure of the eigenfunction η ( k ) ( t ) = ( η 1 ( k ) ( t ) , η 2 ( k ) ( t ) ) . Mode 1 executes the widest, smoothest excursion — consistent with it having the smallest Rayleigh quotient R [ η ( 1 ) ] = λ 1 and therefore the lowest informational leakage per unit of kinetic work. Higher modes wind more tightly, reflecting the increasing oscillatory frequency ω j = ( 2 j 1 ) π / [ 2 ( b a ) ] of the corresponding basis functions.
Figure 2. Mode-optimal trajectories ( θ 1 ( t ) , θ 2 ( t ) ) in the two-dimensional parameter space for k = 1 , , 5 , K 0 = 1 . Filled circle: nominal θ 0 ; open circles: t = a ; triangles: t = b .
Figure 2. Mode-optimal trajectories ( θ 1 ( t ) , θ 2 ( t ) ) in the two-dimensional parameter space for k = 1 , , 5 , K 0 = 1 . Filled circle: nominal θ 0 ; open circles: t = a ; triangles: t = b .
Preprints 228552 g002
Figure 3 plots the cumulative privacy factor Π abs ( t ) = exp ( D K L ( t ) ) , where D K L ( t ) is evaluated via the closed-form expression (64). All curves start at Π = 1 at t = a (no information yet) and decrease monotonically as the observer accumulates measurements. The ordering
Π abs ( 1 ) ( t ) Π abs ( 2 ) ( t ) Π abs ( 5 ) ( t ) t [ a , b ]
holds throughout, in agreement with the eigenvalue ordering λ 1 λ 2 and Corollary 5: among all trajectories with the same kinetic budget K 0 , the first eigenfunction η ( 1 ) minimises the KL divergence and therefore maximises the privacy factor at every time instant.
Figure 3. Privacy factor Π abs ( t ) = exp ( D K L ( t ) ) along each mode-optimal trajectory ( K 0 = 1 ). Mode k = 1 (lowest λ 1 ) decays most slowly, confirming that it is the least detectable path at any fixed kinetic budget.
Figure 3. Privacy factor Π abs ( t ) = exp ( D K L ( t ) ) along each mode-optimal trajectory ( K 0 = 1 ). Mode k = 1 (lowest λ 1 ) decays most slowly, confirming that it is the least detectable path at any fixed kinetic budget.
Preprints 228552 g003
Figure 4 isolates the first observation channel y 1 ( t ) , the quantity directly accessible to the adversary. Each panel compares the nominal mean μ 1 nom ( t ) (black) with the mode-optimal mean μ 1 ( k ) ( t ) (colour), both surrounded by the constant  ± σ 1 noise band arising from Var ( y 1 ( t ) ) = σ 1 2 . At every instant t, the adversary observes a single draw from N ( μ 1 ( t , θ ( t ) ) , σ 1 2 ) and must decide whether the underlying path is nominal or mode-optimal. The noise band has fixed width, so distinguishability depends on the ratio of the mean displacement | μ 1 ( k ) μ 1 nom | to the standard deviation σ 1 . Modes with smaller λ k keep this ratio small, quantifying the privacy gain identified by Corollary 5.
Figure 4. First observation channel y 1 ( t ) for modes k = 1 , , 5 vs. nominal. Solid lines: conditional means μ 1 ( t , θ ( k ) ( t ) ) . Shaded bands: ± σ 1 constant noise envelope ( σ 1 = 0.5 ). Panels are arranged in two rows of three and two (centred) respectively.
Figure 4. First observation channel y 1 ( t ) for modes k = 1 , , 5 vs. nominal. Solid lines: conditional means μ 1 ( t , θ ( k ) ( t ) ) . Shaded bands: ± σ 1 constant noise envelope ( σ 1 = 0.5 ). Panels are arranged in two rows of three and two (centred) respectively.
Preprints 228552 g004
Theorem 3 guarantees that λ k ( N ) λ k as N , monotonically and from above. We document this convergence numerically by computing the generalized eigenvalues (49) for the system introduced above on a sequence of Galerkin spaces of increasing dimension N = J q , J = 2 , 4 , 8 , 16 , 32 . Table 1 reports the first five eigenvalues λ 1 ( N ) , , λ 5 ( N ) together with the relative error err k ( N ) : = ( λ k ( N ) λ k ) / λ k , where λ k : = λ k ( N max ) is the reference value computed at N max = 256 .
Two qualitative features of Table 1 are predicted by the theory and are visible in the data: (i) monotone decay of λ k ( N ) in N at fixed k, in agreement with Theorem 3(i); (ii) approximate algebraic decay λ k ( N ) λ k N r with r 2 empirically. The exponential decay rate guaranteed by Theorem 3 for C data is therefore not yet reached at N = 256 : the sequence λ 1 ( N ) is approaching a limit close to 0, which reflects the near-degeneracy of the spectrum for the undamped oscillator on the relatively long window [ a , b ] = [ 0.5 , 10 ] . This near-degeneracy is consistent with Proposition 4 and Remark 4: for the present system the Poincaré-absorbed coercivity constant α | β | / C P is small but positive, so λ 1 > 0 , yet the spectral gap to 0 is itself small. Note that the privacy-factor bound of Corollary 5 remains valid for any value of λ 1 and is therefore not affected by the slow convergence; what the table quantifies is how much resolution is required to obtain a tight numerical estimate of the bound, not its validity.
The bound (63), Π ¯ abs ( P γ Q ) exp ( 1 2 ( b a ) λ 1 K 0 ) , is obtained through one Cauchy–Schwarz and one Jensen step in the proof of Theorem 4.
The bound of Theorem 4 reads D K L ( P γ ( T ) Q ( T ) ) ( b a ) 2 2 Δ t E ˜ [ γ ] + R ( Δ t ) , where the leading term grows as 1 / Δ t and R ( Δ t ) is bounded as Δ t 0 . Similarly, the exact expression (64) for the linear Gaussian case satisfies D K L I k c 2 / Δ t along the k-th eigenmode (Equation (66)). Both the exact divergence and the bound therefore scale as 1 / Δ t : finer sampling accumulates more information, and the bound tracks this growth proportionally.
Table 2 demonstrates this by reporting, along the first eigenmode γ ( 1 ) with K 0 = 1 and λ 1 0.000274 , the exact KL divergence (64), the leading bound ( b a ) 2 2 Δ t λ 1 , and their ratio τ 1 ( T ) , for four values of T (equivalently, four values of Δ t = ( b a ) / T ).
Three observations follow from Table 2. First, as T increases ( Δ t decreases), both the exact divergence and the bound grow proportionally to 1 / Δ t , confirming the asymptotic scaling predicted by (66) and Theorem 4. Second, the ratio τ 1 ( T ) converges rapidly (already within 4 % of its limit at T = 50 ), so the O ( Δ t ) correction term R ( Δ t ) is negligible even at coarse sampling. Third, the bound overestimates the exact divergence by a factor 1 / τ 1 5000 × at all resolutions; this factor is a property of the system (the shape of η ( 1 ) relative to δ μ ˙ ), not of the discretisation. Consequently, the qualitative ordering Π ¯ abs ( 1 ) Π ¯ abs ( 2 ) and the privacy bound of Corollary 5 are robust with respect to the choice of Δ t .

Author Contributions

Conceptualization, R.V.; methodology, R.V.; formal analysis, R.V.; writing—original draft preparation, R.V.; writing—review and editing, R.V. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Data Availability Statement

No new data were created or analyzed in this study.

Conflicts of Interest

The author declares no conflicts of interest.

References

  1. Kullback, S. Information Theory and Statistics; John Wiley & Sons: New York, NY, USA, 1959.
  2. Cover, T.M.; Thomas, J.A. Elements of Information Theory, 2nd ed.; Wiley-Interscience: Hoboken, NJ, USA, 2006.
  3. Amari, S.; Nagaoka, H. Methods of Information Geometry; Translations of Mathematical Monographs, Vol. 191; American Mathematical Society: Providence, RI, USA, 2000.
  4. Karatzas, I.; Shreve, S.E. Brownian Motion and Stochastic Calculus, 2nd ed.; Graduate Texts in Mathematics, Vol. 113; Springer: New York, NY, USA, 1991.
  5. ksendal, B. Stochastic Differential Equations: An Introduction with Applications, 6th ed.; Universitext; Springer: Berlin, Germany, 2003. [CrossRef]
  6. Barron, A.R. The strong ergodic theorem for densities: Generalized Shannon–McMillan–Breiman theorem. Ann. Probab. 1985, 13, 1292–1303. [CrossRef]
  7. Pinsker, M.S. Information and Information Stability of Random Variables and Processes; Holden-Day: San Francisco, CA, USA, 1964.
  8. Gray, R.M. Entropy and Information Theory, 2nd ed.; Springer: New York, NY, USA, 2011.
  9. Babuška, I.; Osborn, J. Eigenvalue problems. In Handbook of Numerical Analysis; Ciarlet, P.G., Lions, J.L., Eds.; North-Holland: Amsterdam, The Netherlands, 1991; Volume II, pp. 641–787.
  10. Boffi, D. Finite element approximation of eigenvalue problems. Acta Numer. 2010, 19, 1–120. [CrossRef]
  11. Chernoff, H. A measure of asymptotic efficiency for tests of a hypothesis based on the sum of observations. Ann. Math. Stat. 1952, 23, 493–507. [CrossRef]
  12. Csiszár, I.; Shields, P.C. Information theory and statistics: A tutorial. Found. Trends Commun. Inf. Theory 2004, 1, 417–528. [CrossRef]
  13. van der Vaart, A.W. Asymptotic Statistics; Cambridge Series in Statistical and Probabilistic Mathematics; Cambridge University Press: Cambridge, UK, 1998.
  14. Tsybakov, A.B. Introduction to Nonparametric Estimation; Springer Series in Statistics; Springer: New York, NY, USA, 2009.
  15. Le Cam, L. Asymptotic Methods in Statistical Decision Theory; Springer Series in Statistics; Springer: New York, NY, USA, 1986.
  16. Duchi, J.C. Lecture Notes for Statistics 311 / Electrical Engineering 377: Information Theory and Statistics; Stanford University: Stanford, CA, USA, 2019.
  17. Brezis, H. Functional Analysis, Sobolev Spaces and Partial Differential Equations; Universitext; Springer: New York, NY, USA, 2011.
  18. Rudin, W. Principles of Mathematical Analysis, 3rd ed.; McGraw-Hill: New York, NY, USA, 1976.
  19. Dwork, C.; Roth, A. The algorithmic foundations of differential privacy. Found. Trends Theor. Comput. Sci. 2014, 9, 211–407.
  20. Le Ny, J.; Pappas, G.J. Differentially private filtering. IEEE Trans. Autom. Control 2014, 59, 341–354.
  21. Cortés, J.; Dullerud, G.E.; Han, S.; Le Ny, J.; Mitra, S.; Pappas, G.J. Differential privacy in control and network systems. In Proceedings of the 55th IEEE Conference on Decision and Control (CDC), Las Vegas, NV, USA, 12–14 December 2016; pp. 4252–4272.
  22. Sankar, L.; Rajagopalan, S.R.; Poor, H.V. Utility–privacy tradeoffs in databases: An information-theoretic approach. IEEE Trans. Inf. Forensics Secur. 2013, 8, 838–852. [CrossRef]
  23. Issa, I.; Wagner, A.B.; Kamath, S. An operational approach to information leakage. IEEE Trans. Inf. Theory 2020, 66, 1625–1657. [CrossRef]
  24. Mohajerin Esfahani, P.; Sutter, T.; Kuhn, D.; Lygeros, J. From infinite to finite programs: Explicit error bounds with applications to approximate dynamic programming. SIAM J. Optim. 2018, 28, 1968–1998. [CrossRef]
  25. Nekouei, E.; Tanaka, T.; Skoglund, M.; Johansson, K.H. Information-theoretic approaches to privacy in estimation and control. Annu. Rev. Control 2019, 47, 412–422. [CrossRef]
  26. Farokhi, F.; Sandberg, H. Fisher information as a measure of privacy: Preserving privacy of households with smart meters using batteries. IEEE Trans. Smart Grid 2017, 9, 4726–4734. [CrossRef]
Table 1. Galerkin eigenvalues λ k ( N ) and relative errors err k ( N ) = ( λ k ( N ) λ k ) / λ k for the linear oscillator introduced above, computed in double precision with adaptive Gauss–Legendre quadrature ( N quad 8 J ). Reference definition: λ k is the Galerkin eigenvalue at the highest resolution N max = 256 ( J = 128 , column ); consequently err k ( 256 ) = 0 for all kby construction (i.e. because the reference is taken at N = 256 , not because the sequence has converged to the exact eigenvalue λ k ). The first eigenvalue λ 1 ( N ) decreases monotonically in N, consistently with Theorem 3; the slow rate of decrease on this oscillatory system is discussed below.
Table 1. Galerkin eigenvalues λ k ( N ) and relative errors err k ( N ) = ( λ k ( N ) λ k ) / λ k for the linear oscillator introduced above, computed in double precision with adaptive Gauss–Legendre quadrature ( N quad 8 J ). Reference definition: λ k is the Galerkin eigenvalue at the highest resolution N max = 256 ( J = 128 , column ); consequently err k ( 256 ) = 0 for all kby construction (i.e. because the reference is taken at N = 256 , not because the sequence has converged to the exact eigenvalue λ k ). The first eigenvalue λ 1 ( N ) decreases monotonically in N, consistently with Theorem 3; the slow rate of decrease on this oscillatory system is discussed below.
N λ 1 ( N ) λ 2 ( N ) λ 3 ( N ) λ 4 ( N ) λ 5 ( N ) err 1 ( N )
8 0.171829 0.408537 3.050673 5.320961 8.526536 6.26 × 10 2
16 0.064508 0.077252 0.144494 0.261677 0.324363 2.34 × 10 2
32 0.017242 0.018930 0.052104 0.069445 0.082433 6.19 × 10 1
64 0.004400 0.004528 0.017658 0.018439 0.026297 1.51 × 10 1
128 0.001096 0.001119 0.004399 0.004473 0.009968 3.00
256 ( ) 0.000274 0.000277 0.001096 0.001108 0.002472 0
Table 2. Effect of sampling rate on the exact KL divergence and the variational bound along mode k = 1 ( K 0 = 1 , λ 1 = 0.000274 , b a = 9.5 ). Both divergence and bound scale as 1 / Δ t ; the ratio τ 1 ( T ) converges rapidly to τ 1 0.0002 .
Table 2. Effect of sampling rate on the exact KL divergence and the variational bound along mode k = 1 ( K 0 = 1 , λ 1 = 0.000274 , b a = 9.5 ). Both divergence and bound scale as 1 / Δ t ; the ratio τ 1 ( T ) converges rapidly to τ 1 0.0002 .
T Δ t D K L (exact) Bound ( b a ) 2 λ 1 / ( 2 Δ t ) τ 1 ( T )
50 0.1900 1.438 × 10 5 6.506 × 10 2 0.0002
100 0.0950 2.475 × 10 5 1.301 × 10 1 0.0002
500 0.0190 1.250 × 10 4 6.506 × 10 1 0.0002
1000 0.0095 2.499 × 10 4 1.301 0.0002
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.