Preprint
Article

This version is not peer-reviewed.

Characterization of Positive Invariance of Quadratic Convex Sets for Discrete Systems Using Optimization Approaches

A peer-reviewed article of this preprint also exists.

Submitted:

23 April 2023

Posted:

24 April 2023

You are already at the latest version

Abstract
Positive invariant set is an important concept of dynamic systems. The purpose of this paper is to study the sufficient and necessary conditions that the set of ellipsoids and the Lorenz cone are positive invariant sets of discrete time systems. By means of nonlinear programming and induced norm, the problem of positive invariance is formulated as an optimization problem, and the equivalent dual form optimization is also presented using the dual optimization method. Our results provide more alternative methods for determining the positive invariance of quadratic form convex sets from the point of view of optimization and dual optimization. The effectiveness of this method is demonstrated by numerical examples.
Keywords: 
;  ;  ;  ;  

1. Introduction

Positive invariant set is an important concept of dynamic systems. As long as the initial state and the subsequent trajectory of the system are always in a certain positive invariant set, the state quantity of the system can be guaranteed to remain in the positive invariant set. Due to its good properties, positive invariant sets play an important role in the study of system stability analysis and feedback controller design [1,2,3,4,5]. Lyapunov stability theory provides theoretical support to the study the stability of dynamic systems. Bitsoris firstly proposed in [6] the sufficient and necessary conditions for the polyhedra set to be the positive invariant set of a linear discrete system. Ellipsoids and Lorenz cones have also been studied extensively as classical convex sets, but both of them have quadratic forms and the Lorenz cone itself has a second constraint, which makes the study of positive invariance of them more difficult than that of polyhedral sets. The Riccati equation approach is proposed in [7] to be the ellipsoidal set of a linear discrete time system. The maximum invariant ellipsoid for discrete time systems is obtained in [8,9] using linear matrix inequalities and bilinear matrix inequalities. A special class of Lorenz cones is constructed in [10] using the Dickin ellipsoid and some hyperplanes, and the invariant cone of the given system is studied. The ellipsoidal positive invariant set of the Lorenz system has been estimated in [11] for all positive values of the parameters of the Lorenz system, and the minimum volume value of the ellipsoid has been obtained. There are many ways to determine that a set is a positive invariant set of the dynamic system. The Lyapunov function is a classical method for studying the stability of systems, and a new method for solving the positive invariant set of Lorenz chaotic systems was obtained in [12] by constructing the Lyapunov function. The problem of finite-time stability of closed invariant sets of a class of nonlinear systems is discussed in [13] by using Lyapunov functions. [14] is an excellent review paper about the conditions for positive invariance, in an algebraic perspective the sufficient and necessary conditions for ellipsoidal sets to be positive invariant sets of linear systems. [15] investigated sufficient conditions for the existence of robust positive invariant sets for switching systems with average dwell time on the basis of a novel sequence-based technique. In [16], a sufficient and necessary condition for an ordered class of sets to be a positive invariant set for nonlinear discrete time systems is proposed from the point of view of the existence of monotone mappings. The condition for ellipsoidal invariance is proposed in [17,18] by the method of linear matrix inequality (LMI), and the optimal solution of the LMI problem is combined to determine whether the maximum ellipsoid is obtained. The S-procedure is an effective method to study the positive invariance conditions for quadratic convex sets, and sufficient and necessary conditions for ellipsoidal sets and Lorenz cones to be positive invariant sets of linear systems are given in [19] based on Lyapunov stability and S-procedure, but the invariance conditions for Lorenz cones are more complicated. The nonlinear programming techniques in [20,21] provide new alternative directions for the invariance condition. The problem of estimating the maximum robust invariant set for discrete time nonlinear regenerative systems in an optimal control framework is considered in [22]. The study of polyhedral sets positive invariance by optimization is investigated in [23,24]. The ellipsoid and Lorenz cone invariance condition in a nonconvex optimization form for continuous time systems is given in [25], and the existence problem of the solution is discussed in conjunction with KKT theorem.
Although there have been many methods to verify that a convex set is a positive invariant set of a dynamic system, most of them are polyhedral sets and for linear dynamic systems, there are few results for a quadratic convex set like the Lorenz cone which itself has a second constraint. The main contribution of this paper is the positive invariance condition of ellipsoids and Lorenz cones by virtue of optimization approach and dual optimization. For convex sets of complex quadratic forms like Lorenz cones three sufficient and necessary conditions to the positive invarianance of a discrete time system are proposed, which has not been studied before as far as we know. The proposed Lagrange dual and Wolfe dual optimization methods in [26,27] can simplify the feasible domain of the primal problem and make the verification process simpler. The method proposed in this paper establishes a connection among positive invariance conditions, optimization, dual optimization and induced norm, which provides an additional methods for the positive invariance of quadratic convex sets for nonlinear and linear discrete time dynamic systems.
The rest of this paper is orgnized as follows: Section 2 provides some preparatory knowledge and definitions. In Section 3, the sufficient and necessary conditions for ellipsoids positive invariance of nonlinear and linear discrete time systems are studied respectively. In Section 4, the positive invariance condition of Lorenz cone is studied. Illustrative numerical example is given in Section 5. Conclusions of this paper are summarized in Section 6.
Notations.  x k , x k + 1 R n denotes the state vector, where k N { 0 } . The set of real numbers is given by R. R n represents a column vector in dimension n × 1 . R n × n represents a real square matrix of n × n dimension. Q 0 means Q is a positive definite matrix.

2. Mathematical Preliminaries

2.1. Discrete-time dynamic systems

In this paper, we mainly consider discrete time dynamic systems, and the forms of linear and nonlinear discrete-time dynamic systems are given in the following:
x k + 1 = A x k .
x k + 1 = f d ( x k ) .
where, A is a n by n dimensional matrix. x k , x k + 1 R n , denotes the state vector, where k N { 0 } . f d ( x k ) denotes a continuous differentiable function on R n R n .
Definition 1
(Positively invariant set). The set D is an positively invariant set of discrete time systems if and only if x k D implies x k + 1 D for all k N .

2.2. Convex sets

In this paper, we mainly study classical convex sets with quadratic forms, namely, ellipsoidal sets and Lorenz cones. The ellipsoidal set is defined as
S = { x R n x T Q x 1 } ,
where Q R n × n , and Q 0 . The ellipsoidal set is also often writen as an unit ball in the form of a quadratic norm, namely
S ( Q , 1 ) = { x R n x T Q x 1 } ,
that is
x Q = x T Q x .
Any ellipsoid whose center is not at the origin can be transformed into an ellipsoid whose center is at the origin. Therefore, this paper discusses the invariance condition for the ellipsoidal set whose center is at the origin.
Lorenz cone is defined as
S L = { x R n x T P x 0 , x T P u n 0 } ,
where P R n × n is a symmetric nonsingular matrix with only one negative eigenvalue λ n . u n is the eigenvector corresponding to the negative eigenvalue λ n .

2.3. Lagrange function

For optimization problem in the following form:
m i n f ( x ) s . t g i ( x ) 0 , i = 1 , 2 , , m , y j ( x ) = 0 , j = 1 , 2 , , n .
Define the Lagrange function as follows:
L ( x , λ , μ ) = f ( x ) + i = 1 m λ i g i ( x ) + j = 1 n μ j y j ( x ) .
where λ i , μ j is called the Lagrange operator and required that λ i 0 , i = 1 , 2 , . . . , m .

2.4. Wolfe dual theory

Let f ( x ) be a convex differentiable function with respect to x R n , g i ( x ) is a differentiable convex function. Denote the gradient of the function g ( x ) by g ( x ) , i.e. g ( x ) = ( g ( x ) x 1 , g ( x ) x 2 , , g ( x ) x n ) T . The primal problem is in the following form:
m i n f ( x ) s . t g i ( x ) 0 , i = 1 , 2 , . . . , m .
The Wolfe dual form is:
m a x f ( x ) + i = 1 m c i g i ( x ) s . t f ( x ) = i = 1 m c i g i ( x ) , c i 0 .

2.5. Slater condition

For the convex programming problem m i n { f ( x ) g ( x ) 0 , h ( x ) = 0 , x R n } , if there exists a feasible point x ¯ such that g ( x ¯ ) < 0 , the programming problem is said to satisfy the Slater constraint qualification, which is also known as the Slater condition.

3. Invariance conditions for ellipsoids

In this section, we study the necessary and sufficient conditions for ellipsoids to be positive invariant sets of discrete time systems. By virtue of Lagrange duality and Wolfe duality, three equivalent optimization models for invariance conditions of nonlinear discrete systems are given. The case of f d ( x k ) = A x k and the corresponding invariance conditions are discussed.

3.1. Formulation of positive invariance conditions

The invariance conditions for discrete time systems include linear and nonlinear systems are discussed respectively in this section.
Theorem 1.
For the ellipsoidal set (3) and nonlinear discrete time system (2), the sufficient and necessary condition for the ellipsoidal set to be a positive invariant set of the nonlinear discrete time system is that the optimal value of the following optimization problem is nonnegative.
min x 1 f d T ( x ) Q f d ( x ) s . t x T Q x 1 0 .
Proof. 
The set S is a positive invariant set of the system (2) if and only if x k S , and x k + 1 S . It is necessary to satisfy
x k T Q x k 1 0 ,
1 f d ( x ) T Q f d ( x ) 0 ,
(12) holds implies that (13) also holds. It is necessary that all function values of (13) are greater than or equal to zero, i.e., the minimum value of the (13) is satisfied by being non-negative. Then an optimization is formulated as
min x 1 f d T ( x ) Q f d ( x ) s . t x T Q x 1 0 .
When the system is a linear discrete time system, i.e., with f d ( x ) = A x , the invariance condition is presented by Theorem 2.
Theorem 2.
The ellipsoid set S is a positive invariant set of the linear discrete time system (1) if and only if the optimal value of the following optimization problem is nonnegative.
min x 1 x T A T Q A x s . t x T Q x 1 0 .
Since the proof procedure of Theorem 2 is similar to that of Theorem 1, we do not repeat it.
For ellipsoidal set in quadratic norm form, we apply the induced norm to give sufficient and necessary condition for the ellipsoidal.
Lemma 1.
A vector norm on C n is known, and for any square matrix M C n × n , let M = sup x = 1 M x , then M is said to be the induced norm of the vector norm x .
Theorem 3.
The ellipsoid set S ( Q , 1 ) is a positive invariant set of the linear discrete time system x k + 1 = A x k if and only if the optimal value of this optimization problem below is positive.
min x x T ( A T Q A Q ) x s . t x T Q x 1 = 0 .
Proof. 
From the definition of the induced norm in Lemma 1, a sufficient and necessary condition for the ellipsoid set S ( Q , 1 ) to be a positive invariant set of a linear discrete time system is that (17) holds for all x.
A Q = sup x T Q x = 1 ( A x ) T Q ( A x ) < 1 .
That is,
( A x ) T Q ( A x ) 1 < 0 x T A T Q A x x T Q x < 0 , x T ( A T Q A Q ) x < 0 , A T Q A Q 0 .
Transformed (18) into an optimization problem with constraints as
min x x T ( A T Q A Q ) x s . t x T Q x 1 = 0 .
From Theorems 1 and 2, we formulate the problem of positive invariance as the optimization problems. In practice, the dual method sometimes can simplify the primal problem, then we also present the Lagrangian dual and Wolfe dual forms of (11), (15) and (16). Note that since the constraint function in (16) is nonconvex, the Wolfe dual is invalid.

3.2. Lagrange dual

The Lagrange dual is a convex optimization problem regardless of whether the primal problem is convex or not, and the dual gives at least a lower bound on the optimal solution of the original problem. In this section, we will consider the Lagrange dual of the primal problem. Theorem 4 gives positive invariance conditions in the Lagrange dual form of the ellipsoidal set for the nonlinear dynamic systems.
Theorem 4.
Consider the nonlinear discrete time system x k + 1 = f d ( x k ) and the ellipsoidal set be S = { x R n x T Q x 1 } , where Q R n × n , and Q 0 . Let 1 f d T ( x ) Q f d ( x ) be a continuous differentiable function with respect to x. The ellipsoid set S is a positive invariant set of the nonlinear discrete system (2) if and only if there exists λ 0 , such that the optimal value of the following optimization problem is non-negative.
max λ 0 min x 1 f d T ( x ) Q f d ( x ) + λ ( x T Q x 1 )
Proof. 
Consider (11) as the primal problem and set it as P ( x ) . Let the Lagrange multiplier be λ , λ 0 , then the Lagrange function is
L ( x , λ ) = 1 f d T ( x ) Q f d ( x ) + λ ( x T Q x 1 ) .
Then we have
max λ 0 1 f d T Q f d ( x ) + λ ( x T Q x 1 ) = , o t h e r w i s e P ( x ) , x T Q x 1
Then min x R n max λ 0 L ( x , λ ) is equivalent to the primal problem that satisfies the constraint, i.e.
min x R n max λ 0 L ( x , λ ) = min x R n { 1 f d T Q f d ( x ) | x T Q x 1 0 }
Then the Lagrange dual of the primal problem (11) is
max λ 0 min x R n 1 f d T Q f d ( x ) + λ ( x T Q x 1 )
Since the Lagrange dual satisfies
min x R n max λ 0 L ( x , λ ) max λ 0 min x R n L ( x , λ ) .
As a result, the optimal value of the primal problem must be non-negative when the optimal value of the dual problem (20) is non-negative. □
Remark 1.
Lagrange duals are only useful for dual problems when the optimal value function of the inner optimization problem can be reduced to an analytic formula. Therefore, it is necessary to satisfy in Theorem 4 that 1 f d T ( x ) Q f d ( x ) is a continuous function differentiable with respect to x.
Similarly, we give sufficient and necessary conditions for the ellipsoidal set to be a positive invariant set of the linear discrete system.
Theorem 5.
Let the linear discrete system be x k + 1 = A x k and the ellipsoidal set be S = { x R n x T Q x 1 } , where Q R n × n , and Q 0 . Then the ellipsoidal set is a positive invariant set of the linear discrete system if and only if there exists λ [ 0 , 1 ] such that the optimal value of the following optimization problem is non-negative.
max 0 λ 1 min x 1 x T A T Q A x + λ ( x T Q x 1 )
Proof. 
The process of proving Lagrange dual is similar to Theorem 3, here we focus on the range of values of Lagrange multipliers.
Let the Lagrange function of the primal problem be
L ( x , λ ) = 1 x T A T Q A x + λ ( x T Q x 1 ) , λ 0 .
When x = 0 , the positive invariance condition should also satisfy L ( 0 , λ ) 0 , i.e.
1 λ 0 ,
that is
0 λ 1 .
Theorem 6.
[19] The ellipsoidal set S is a positive invariant set of the linear discrete system x k + 1 = A x k if and only if there exists λ [ 0 , 1 ] , such that A T Q A λ Q 0 .
Proof. 
From the proof of Theorem 5, it follows that if the ellipsoid set S is a positive invariant set of the linear discrete system (1), then there exists λ [ 0 , 1 ] such that the optimal value of the optimization problem (25) is nonnegative. Then we have
1 x T A T Q A x + λ ( x T Q x 1 ) 0
which means,
x T A T Q A x λ x T Q x 1 λ
that is,
x T ( A T Q A λ Q ) x 0
i.e.
A T Q A λ Q 0 .
The proof is completed.
Remark 2.
Theorem 5 was once proved in [19] using S-procedure, and in this paper we use to give a novel proof from an optimization point of view, showing a direct connection between positive invariant sets and pairwise optimization.
Theorem 7.
The linear discrete system is x k + 1 = A x k , and when the ellipsoid is given by the quadratic norm of the form (4), then the ellipsoid is a positive invariant set of the linear discrete system (1) if and only if there exists λ 0 such that the optimal value of the following optimization problem is positive.
max λ 0 min x x T ( A T Q A Q ) x + λ ( x T Q x 1 )
Remark 3.
The proof of Theorem 7 is similar to the proof in Theorem 4, and we omit the proof here.
By comparing the primal optimization problem with the optimization problem after Lagrange dual, we can see that the feasible domain of the dual programming problem is simpler than that of the primal problem. Next, we discuss the case when the primal problem is convex optimization problem, at which time we apply the Wolfe dual approach to the primal optimization problem.

3.3. Wolfe dual forms

When the objective function is convex and the constraint is also convex, the primal optimization problem can be transformed into the form of Wolfe dual. We study the Wolfe dual form for the ellipsoid positive invariance set for the discrete time systems.
Remark 4.
Since the primal problem is a convex optimization problem and the Slater’s condition is satisfied, the strong duality theorem holds. Therefore, the optimal value of the dual problem is theoretically equivalent to the primal problem. Then, we can use the positivity or negativity of the optimal value result to determine whether the ellipsoidal set is a positive invariant set of the discrete time systems or not.
Theorem 8.
The ellipsoidal set S = { x R n x T Q x 1 } , where Q R n × n , and Q 0 . The nonlinear discrete system is given by (2). Let 1 f d T ( x ) Q f d ( x ) be a convex function differentiable with respect to x and x T Q x 1 be a convex function, then the ellipsoidal set S is a positive invariant set of nonlinear discrete systems (2) if and only if there exists λ 0 , such that the optimal value of the following problem is nonnegative.
max x R n 1 f d T Q f d ( x ) + λ ( x T Q x 1 ) , s . t ( f d T Q f d ( x ) ) = λ ( x T Q x ) .
Proof. 
From the primal problem (11), both the objective function and the constraint are convex functions then Wolfe’s dual theorem can be applied, i.e.
max x R n 1 f d T Q f d ( x ) + λ ( x T Q x 1 ) , s . t ( f d T Q f d ( x ) ) = λ ( x T Q x ) .
Theorem 9.
Let the linear discrete system be (1) and the ellipsoid set S = { x R n x T Q x 1 } , where Q R n × n , and Q 0 . Assume 1 x T A T Q A x be a convex function and x T Q x 1 be a convex function, then the ellipsoidal set S is a positive invariant set of linear discrete systems (1) if and only if there exists λ [ 0 , 1 ] , such that the optimal value of the following problem is nonnegative.
max x R n 1 x T A T Q A x + λ ( x T Q x 1 ) , s . t λ Q A T Q A = 0 .
Proof. 
From the assumptions, it is clear that (15) is a convex optimization problem, so Wolfe’s dual theory can be applied. In particular, when x = 0 , there is 1 λ 0 , i.e., 0 λ 1 . The Wolfe dual of (15) is
max x R n 1 x T A T Q A x + λ ( x T Q x 1 ) , s . t λ Q A T Q A = 0 .
Remark 5.
By comparing Theorems 4 and 5 with Theorems 8 and 9, it can be seen that the Wolfe dual applies to the case where the primal problem is a convex optimization problem, while the Lagrange dual applies to the more general case.

4. Positive invariance conditions for Lorenz cone

Lorenz cone is also one of the classical convex sets with quadratic form, but the study of its positive invariance is more complicated because Lorenz cone contains the second constraint itself. The positive invariance condition for Lorenz cone given in this paper is simpler. Similar to the ellipsoid, we give the following three equivalent sufficient and necessary conditions on the Lorenz cone positive invariance for nonlinear discrete time systems.
Theorem 10.
Lorenz cone (6) is a positive invariant set for a nonlinear discrete time system (2) if and only if the optimal value of the following optimization problem is nonnegative.
min x R n f d ( x ) T P f d ( x ) , s . t f d ( x ) T P u n 0 x T P x 0 x T P u n 0 .
If f d ( x ) = A x , the Lorenz cone S L is a positive invariant set of linear discrete time systems, then the optimal value of the following optimization problem needs to be nonnegative.
min x R n x T A T P A x , s . t x T A T P u n 0 x T P x 0 x T P u n 0 .
Proof. 
First, if the Lorenz cone is a positive invariant set of the nonlinear discrete system (2) if and only if x k S L , and x k + 1 S L . i.e., it needs to satisfy
x k T P x k 0 , x k T P u n 0 ,
and
f ( x k ) T P f ( x k ) 0 , f ( x k ) T P u n 0 .
Translated into an optimization problem, i.e.
min x R n f d ( x ) T P f d ( x ) s . t f d ( x ) T P u n 0 , x T P x 0 , x T P u n 0 .
When the discrete time system is linear, i.e., when f ( x k ) = A x , the positive invariance condition is
min x R n x T A T P A x s . t x T A T P u n 0 , x T P x 0 , x T P u n 0 .
Next, the optimization problem in (32) and (33) is transformed into its equivalent Lagrange dual optimization form.
Theorem 11.
Consider the nonlinear discrete time systems be x k + 1 = f d ( x k ) and the Lorenz cone given by (6). Let f d T ( x ) P f d ( x ) be a continuous differentiable function with respect to x. Then the Lorenz cone S L is a positive invariant set of the nonlinear discrete system (2) if and only if there exists λ , μ , η 0 , such that the optimal value of the following optimization problem is non-negative.
max λ , μ , η 0 min x R n f d T ( x ) P f d ( x ) + λ ( f d ( x ) T P u n ) + μ ( x T P x ) + η ( x T P u n )
If f d ( x ) = A x , the Lorenz cone S L is a positive invariant set of linear discrete systems, then the optimal value of the following optimization problem needs to be nonnegative.
max λ , μ , η 0 min x R n x T A T P A x + λ ( x T A T P u n ) + μ ( x T P x ) + η ( x T P u n )
Proof. 
Taking (32) as the primary problem and introducing the multiplier λ , μ , η 0 , one can write its Lagrange function, i.e.
f d T ( x ) P f d ( x ) + λ ( f d ( x ) T P u n ) + μ ( x T P x ) + η ( x T P u n ) .
Then, let the primary problem be P ( x ) , we have
max λ , μ , η 0 f d T ( x ) P f d ( x ) + λ ( f d ( x ) T P u n ) + μ ( x T P x ) + η ( x T P u n ) = , o t h e r w i s e P ( x ) , f d ( x ) T P u n 0 , x T P x 0 , x T P u n 0 .
Therefore min x R n max λ , μ , η 0 L ( x , λ , μ , η ) is equivalent to (32), and the Lagrange dual of (32) is
max λ , μ , η 0 min x R n x T A T P A x + λ ( x T A T P u n ) + μ ( x T P x ) + η ( x T P u n )
Since the optimal value of the primal problem must be greater than or equal to the optimal value of its Lagrange dual problem, when the optimal value of the Lagrange dual problem is non-negative, the optimal value of the primal problem must be non-negative. When f ( x k ) = A x , the Lagrange dual problem of (33) is
max λ , μ , η 0 min x R n x T A T P A x + λ ( x T A T P u n ) + μ ( x T P x ) + η ( x T P u n ) .
When the optimization problem in (32) and (33) is convex optimization, it can be transformed into the equivalent Wolfe dual optimization.
Theorem 12.
The Lorenz cone S L = { x R n x T P x 0 , x T P u n 0 } , where P R n × n . Let (32) be a convex optimization problem then the Lorenz cone S L is a positive invariant set of nonlinear discrete systems (2) if and only if there exists λ , μ , η 0 such that the optimal value of the following problem is nonnegative.
max x R n f d T P f d ( x ) + λ ( f d ( x ) T P u n ) + μ ( x T P x ) + η ( x T P u n ) , s . t ( f d ( x ) T P f d ( x ) ) = λ ( f d ( x ) T P u n ) + μ ( x T P x ) + η ( x T P u n ) .
If f d ( x ) = A x , when (33) is convex optimization, the Lorenz cone S L is a positive invariant set of linear discrete systems, if and only if there exists λ , μ , η 0 , such that the optimal value of the following optimization problem needs to be nonnegative.
max x R n x T A T P A x + λ ( x T A T P u n ) + μ ( x T P x ) + η ( x T P u n ) , s . t 2 ( A T P A μ P ) x = λ A T P u n + η P u n .
The proof of Theorem 12 is similar to the proof of Theorem 8, and we omit it here.

5. Numerical Examples

In this section we present some numerical examples to verify the theorems presented in Section 3 and Section 4. Note that for convenience, we set the initial state of the system for each example to the origin, and the change of the initial state does not affect the final determination of whether it is a positively invariant set or not.
Example 1.
The ellipsoid set is S = { ( x 1 ( k ) , x 2 ( k ) ) ( x 1 ( k ) ) 2 + ( x 2 ( k ) ) 2 1 } , the nonlinear discrete system be x 1 ( k + 1 ) = x 1 ( k ) + x 2 ( k ) 2 , x 2 ( k + 1 ) = x 1 ( k ) 3 x 2 ( k ) 2 .
In method 1, using (11) of Theorem 1 to verify the positive invariance of this ellipsoid set. We transform the invariance problem into an optimization problem, i.e.
min x 1 f d T ( x ) Q f d ( x ) s . t x T Q x 1 .
First, we simplify the objective function.
min x 1 ( x 1 ( k ) + x 2 ( k ) 2 x 1 ( k ) 3 x 2 ( k ) 2 ) = min x 1 [ x 1 ( k ) + x 2 ( k ) 4 + x 1 ( k ) 3 x 2 ( k ) 4 ] = min x 1 [ x 1 ( k ) x 2 ( k ) 2 ] = min x 1 x 1 ( k ) 2 + x 2 ( k ) 2 .
Next, we simplify the constraint.
x 1 ( k ) x 2 ( k ) 1 0 0 1 x 1 ( k ) x 2 ( k ) = ( x 1 ( k ) ) 2 + ( x 2 ( k ) ) 2 1 .
The simplified optimization problem is
min x 1 x 1 ( k ) 2 + x 2 ( k ) 2 s . t ( x 1 ( k ) ) 2 + ( x 2 ( k ) ) 2 1 .
Taking the initial state as [ 0 ; 0 ] , the optimal value of this optimization problem is obtained by MATLAB as 0.2929 > 0 , then the ellipsoidal set S is a positive invariant set of the nonlinear discrete system.
In method 2, apply (20) in Theorem 4 to verify whether the ellipsoid set is a positive invariant set of this nonlinear discrete system. The optimization problem in method 1 is transformed into its Lagrange dual optimization form, i.e
max λ 0 min x 1 f d T ( x ) Q f d ( x ) + λ ( x T Q x 1 ) max λ 0 min x 1 x 1 ( k ) 2 + x 2 ( k ) 2 + λ [ ( x 1 ( k ) ) 2 + ( x 2 ( k ) ) 2 1 ]
First, let the inner optimization problem be g ( x 1 ( k ) , x 2 ( k ) ) , and we take the partial derivatives of x 1 ( k ) , x 2 ( k ) in g ( x 1 ( k ) , x 2 ( k ) ) to be equal to zero, respectively, i.e
g x 1 ( k ) = 1 2 + 2 λ x 1 ( k ) = 0 x 1 ( k ) = 1 4 λ , g x 2 ( k ) = 1 2 + 2 λ x 2 ( k ) = 0 x 2 ( k ) = 1 4 λ .
By substituting x 1 ( k ) and x 2 ( k ) into the optimization function, we can get the function which is only related to λ. When λ = 0.5 , the optimal value of the function is 1 > 0 . Therefore, the ellipsoid set is the positive invariant set of the nonlinear discrete system.
In method 3, Since the optimization problem in Method 1 is convex optimization problem, we can apply (29) in Theorem 8 to solve this problem. That is, we need to find u satisfying u > 0 such that the optimal value of the objective function is nonnegative.
max x R n 1 f d T Q f d ( x ) + λ ( x T Q x 1 ) , s . t ( f d T Q f d ( x ) ) = λ ( x T Q x ) .
In this example, we let λ = 0.25 and substitute the objective function to obtain the value 0.25 > 0 . Therefore, the ellipsoidal set is the positive invariant set of this nonlinear discrete system.
Example 2.
Let the linear discrete system x k + 1 = A x k , where A = 0 3.2 0.1 0.4 and the set of ellipsoids is S = { ( x 1 ( k ) ) 2 + ( x 2 ( k ) ) 2 1 . Next, we apply (15) in Theorem 2 to verify it. Substituting the data in this example into (15) yields an optimization problem.
min x 1 x 1 ( k ) x 2 ( k ) 0 0.1 3.2 0.4 1 0 0 1 0 3.2 0.1 0.4 x 1 ( k ) x 2 ( k ) s . t ( x 1 ( k ) ) 2 + ( x 2 ( k ) ) 2 1 0 .
First, the objective function is simplified.
1 x 1 ( k ) x 2 ( k ) 0 0.1 3.2 0.4 1 0 0 1 0 3.2 0.1 0.4 x 1 ( k ) x 2 ( k ) = 1 0.01 x 1 ( k ) 0.04 x 2 ( k ) 0.04 x 1 ( k ) + 10.4 x 2 ( k ) x 1 ( k ) x 2 ( k ) = 1 0.01 ( x 1 ( k ) ) 2 + 0.08 x 1 ( k ) x 2 ( k ) 10.4 ( x 2 ( k ) ) 2 .
The constraint function is ( x 1 ( k ) ) 2 + ( x 2 ( k ) ) 2 1 0 . The optimization function is finally reduced to
min x 1 0.01 ( x 1 ( k ) ) 2 + 0.08 x 1 ( k ) x 2 ( k ) 10.4 ( x 2 ( k ) ) 2 , s . t ( x 1 ( k ) ) 2 + ( x 2 ( k ) ) 2 1 0 .
Taking the initial state as [ 0 ; 0 ] and the optimal value of the optimization function as 9.4002 < 0 , then the ellipsoidal set is not a positive invariant set of this linear discrete system.
Example 3.
The linear discrete system is x k + 1 = A x k , where A = 0.5 0 0 0.5 . And the ellipsoid set is ( x 1 ( k ) ) 2 + ( x 2 ( k ) ) 2 1 .
In method 1, using (15) in Theorem 2, the problem of verifying that the ellipsoid set is a positive invariant set of a linear discrete system is transformed into an optimization problem.
min x 1 x T A T Q A x s . t x T Q x 1 0 .
Where
A = 0.5 0 0 0.5 , Q = 1 0 0 1 .
Then, the matrices A, Q are substituted into the objective function to obtain
min x x 1 ( k ) x 2 ( k ) 0.5 0 0 0.5 1 0 0 1 0.5 0 0 0.5 x 1 ( k ) x 2 ( k ) = 1 0.25 ( x 1 ( k ) ) 2 0.25 ( x 2 ( k ) ) 2 .
Then the optimization function is
min x 1 0.25 ( x 1 ( k ) ) 2 0.25 ( x 2 ( k ) ) 2 s . t ( x 1 ( k ) ) 2 + ( x 2 ( k ) ) 2 1 0 .
The initial state is set as r a n d ( 2 , 1 ) in MATLAB, and the optimal value of the objective function is 0.7500000998413878 > 0 . Therefore, the ellipsoid set S is the positive invariant set of the linear discrete system.
In Method 2, the ellipsoid set is written in the form of (4), and the invariance condition of the ellipsoid set is transformed into an optimization problem by using (16) in Theorem 3.
min x x T ( A T Q A Q ) x s . t x T Q x 1 = 0 .
Where
A = 0.5 0 0 0.5 , Q = 1 0 0 1 .
Then the matrix A and Q are substituted and simplified to obtain the following optimization problem, i.e
min x 0.75 ( x 1 ( k ) ) 2 0.75 ( x 2 ( k ) ) 2 s . t ( x 1 ( k ) ) 2 + ( x 2 ( k ) ) 2 1 = 0 .
The initial state is set as r a n d ( 2 , 1 ) in MATLAB, and the optimal value of the objective function is 0.750000000000004 > 0 . Therefore, the ellipsoid set S is the positive invariant set of the linear discrete system.
In method 3, using (25) in Theorem 5 to determine whether the ellipsoid set is a positive invariant set of the linear discrete system.
max 0 λ 1 min x 1 x T A T Q A x + λ ( x T Q x 1 )
That is
max 0 λ 1 min x 1 0.25 ( x 1 ( k ) ) 2 0.25 ( x 2 ( k ) ) 2 + λ ( ( x 1 ( k ) ) 2 + ( x 2 ( k ) ) 2 1 )
Let the inner optimization function be g ( x 1 ( k ) , ( x 2 ( k ) ) , and we take the partial derivatives with respect to x 1 ( k ) , x 2 ( k ) to be equal to zero respectively, i.e
g x 1 ( k ) = 2 ( λ 0.25 ) x 1 ( k ) = 0 , g x 2 ( k ) = 2 ( λ 0.25 ) x 2 ( k ) = 0 .
When x 1 = x 2 = 0 , the optimal value is 1 > 0 by substituting it into the objective function. When x 1 , x 2 0 , λ = 0.25 can be obtained, and the optimal value is 0.75 > 0 by substituting it into the objective function. Therefore, the set of ellipsoids is the positive invariant set of this linear discrete system.
In method 4, apply (28) in Theorem 7 to determine the positive invariance of the ellipsoid set. That is, we need to find λ < 0 , such that the optimal value of the optimization problem is positive. Substituting the data in this example into (28) and simplifying gives
max λ 0 min x 0.75 ( x 1 ( k ) ) 2 + 0.75 ( x 2 ( k ) ) 2 + λ ( ( x 1 ( k ) ) 2 + ( x 2 ( k ) ) 2 ) 1 )
The optimal value is 0.75 when λ = 0.75 . Therefore, this ellipsoidal set is the positive invariant set of this linear discrete system.
In method 5, apply (29) in Theorem 8 to determine the positive invariance of the ellipsoid set. We need to verify whether we can find a λ satisfying the conditions such that the optimal value of the optimization problem is nonnegative.
max x R n 1 x T A T Q A x + λ ( x T Q x 1 ) , s . t λ Q A T Q A = 0 .
Where
A = 0.5 0 0 0.5 , Q = 1 0 0 1 .
The constraint condition is satisfied when λ = 0.25 , and the value of 0.75 > 0 can be obtained by substituting λ into the objective function. Therefore, the ellipsoid set is the positive invariant set of the linear discrete system.
Example 4.
The Lorenz cone is represented by S L = { ( x 1 ( k ) ) 2 ( x 2 ( k ) ) 2 0 , x 2 ( k ) 0 } , and the nonlinear discrete system is x 1 ( k + 1 ) = [ ( x 1 ( k ) ) 2 + 2 x 2 ( k ) x 1 ( k ) ] 1 2 , x 2 ( k + 1 ) = [ ( x 2 ( k ) ) 2 x 2 ( k ) 2 x 1 ( k ) ] 1 2 . In method one, we apply (32) in Theorem 10 to determine whether the Lorenz cone is a positive invariant set of this nonlinear discrete system.
min x R n f d ( x ) T P f d ( x ) , s . t f d ( x ) T P u n 0 x T P x 0 x T P u n 0 .
Where
P = 1 0 0 1 , u n = 0 1 .
Substituting P, u n into the optimization problem and simplifying, we obtain
min x R n ( x 1 ( k ) ) 2 + ( x 2 ( k ) ) 2 x 1 ( k ) 4 x 2 ( k ) , s . t ( x 2 ( k ) ) 2 x 2 ( k ) 2 x 1 ( k ) 0 ( x 1 ( k ) ) 2 ( x 2 ( k ) ) 2 0 x 2 ( k ) 0 .
The optimal value is 0, so the Lorenz cone is the positive invariant set of the nonlinear discrete system.
In method 2, apply (34) in Theorem 11.
Since the optimization problem in method 1 is convex optimization, Wolfe dual can be used to solve it. Substituting the data in this example into (34) and simplifying, we get
max x R n ( x 1 ( k ) ) 2 + ( x 2 ( k ) ) 2 x 1 ( k ) 4 x 2 ( k ) + λ ( ( x 2 ( k ) ) 2 x 2 ( k ) 2 x 1 ( k ) ) + μ ( ( x 1 ( k ) ) 2 ( x 2 ( k ) ) 2 ) + η ( x 2 ( k ) ) , s . t 2 x 1 ( k ) 1 2 x 2 ( k ) 4 = λ 1 ( x 2 ( k ) ) 2 x 2 ( k ) 2 x 1 ( k ) 2 x 2 ( k ) 1 2 ( x 2 ( k ) ) 2 x 2 ( k ) 2 x 1 ( k ) + μ 2 x 1 ( k ) 2 x 2 ( k ) + η 0 1 .
When λ = 0 , μ = 0.75 , η = 2.5 , the value of the objective function is 1.625 > 0 . So the Lorenz cone is the positive invariant set of this nonlinear discrete system.
Example 5.
Lorenz cone is S L = { ( x 1 ( k ) ) 2 + ( x 2 ( k ) ) 2 ( x 3 ( k ) ) 2 0 , ( x 3 ( k ) ) 0 } , linear discrete time system is represented by x k + 1 = A x k , where A = [ 0.5 , 0 , 0 ; 0 , 0.5 , 0 ; 0 , 0 , 1 ] .
In method 1, apply (33) in Theorem 10 is applied to verify, then the sufficient and necessary condition for the Lorenz cone to be a positive invariant set of this linear discrete-time system is that the optimal value of the following optimization problem is nonnegative, i.e
min x R n x T A T P A x , s . t x T A T P u n 0 x T P x 0 x T P u n 0 .
Where
A = 0.5 0 0 0 0.5 0 0 0 1 , P = 1 0 0 0 1 0 0 0 1 , u n = 0 0 1
Substituting the values of A , P , u n , into the optimization framework yields the optimal value of 0, which is non-negative, then the Lorenz cone is a positive invariant set of this linear discrete system.
In method 2, apply (37) in Theorem 12 to determine whether the Lorenz cone is a positive invariant set of this linear discrete system. We need to find the parameter λ , μ , η 0 such that the optimal value of the optimization problem is non-negative.
max λ , μ , η 0 min x R n x T A T P A x + λ ( x T A T P u n ) + μ ( x T P x ) + η ( x T P u n )
For the inner optimization function, substituting A , P , u n , and simplifying it yields
min x g ( x 1 ( k ) , x 2 ( k ) , x 3 ( k ) ) = min x ( μ 0.25 ) ( x 1 ( k ) ) 2 + ( μ 0.25 ) ( x 2 ( k ) ) 2 + ( 1 μ ) ( x 3 ( k ) ) 2 ( λ + η ) x 3 ( k )
Taking the partial derivatives of each of the variables in the function g ( x 1 ( k ) , x 2 ( k ) , x 3 ( k ) ) and making them equal to zero, i.e.
g x 1 ( k ) = 2 ( μ 0.25 ) x 1 ( k ) = 0 , g x 2 ( k ) = 2 ( μ 0.25 ) x 2 ( k ) = 0 , g x 1 ( k ) = 2 ( 1 μ ) x 3 ( k ) ( λ + η ) = 0 .
We get μ = 0.25 and x 3 ( k ) = 2 3 ( λ + η ) . Substituting it into the inner optimization function, we obtain
max λ 0 , η 0 1 3 ( λ + η ) 2
Solution to the optimal value is zero, so the Lorenz cone is invariant set is linear discrete system.
When using Wolfe duality, it is necessary to determine whether the original problem is convex optimization. In this case, the objective function is not convex, so the Wolfe dual cannot be used.

6. Conclusions

In this paper, the sufficient and necessary conditions for determining the ellipsoidal set and Lorenz cone as positive invariant sets for discrete time dynamic systems are given by virtue of the optimization and the dual optimization method. The positive invariance condition of ellipsoidal set and Lorenz cone is formulated as an optimization problem. In particular, for ellipsoid sets, we propose an invariant condition derived from the induction norm and then formulate as an optimization problem. On this basis, a novel optimization model is proposed to determine that convex sets of quadratic form are positive invariant sets of discrete time systems. The equivalent invariance condition is obtained by using Lagrange duality and Wolfe duality. It is also interesting that the invariance conditions obtained in this paper relate algebraic problems to optimization problems and provide more alternative methods for the calculation of positive invariance sets of ellipsoids and Lorenz cones for nonlinear and linear dynamic systems.

Author Contributions

Conceptualization, Yang.H.; Formal analysis, Lei.Y.; Investigation, Lei.Y.; Supervision, Yang.H. and Ivanov.G.I.; Writing—original draft, Lei.Y.; Writing—review and editing, Yang.H. and Ivanov.G.I.. All authors have read and agreed to the published version of the manuscript.

Funding

This paper is partly financial support by The National Statistical science research project granted 2021LY083 and National Natural Science Foundation of China granted 62176140.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Acknowledgments

The authors are thankful to the respected reviewers for their valuable comments and constructive suggestions towards the improvement of the original paper.

Conflicts of Interest

The authors declare that there are no conflict of interest regarding the publication of this paper.

References

  1. Bitsoris, G.; Gravalou, E. Design techniques for the control of discrete-time systems subject to state and control constraints. IEEE Transactions on Automatic Control. 1999, 44(5), 1057–1061. [Google Scholar] [CrossRef]
  2. Si, X.; Yang, H. Constrained regulation problem for continuous-time stochastic systems under state and control constraints. J.vib.Control. 2022, 28(21-22), 3218–3230. [Google Scholar] [CrossRef]
  3. Huff, D.D.; Fiacchini, M.; da Silva, J.M.G. Stability and Stabilization of Sampled-data Systems Subject to Control Input Saturation: a Set Invariant Approach. IEEE Transactions on Automatic Control. 2021, 67(3), 1423–1429. [Google Scholar] [CrossRef]
  4. Si, X.; Yang, H.; Ivanov, I.G. Conditions and a computation method of the constrained regulation problem for a class of fractional-order nonlinear continuous-time systems. International Journal of Applied Mathematics and Computer Science. 2021, 31(1), 17–28. [Google Scholar]
  5. Alikakos, N.D.; Phillips, D. A remark on positively invariant regions for parabolic systems with an application arising in superconductivity. Q.Appl.Mathematics 1987, 45(1), 75–80. [Google Scholar] [CrossRef]
  6. Bitsoris, G. On the positive invariance of polyhedral sets for discrete-time systems. Systems & Control Letters 1988, 11(3), 243–248. [Google Scholar]
  7. Lin, Z.; Saberi, A.; Stoorvogel, A.A. Semiglobal stabilization of linear discrete-time systems subject to input saturation, via linear feedback-an ARE-based approach. IEEE Transactions on Automatic Control. 1996, 41(8), 1203–1207. [Google Scholar]
  8. Riah, R.; Fiacchini, M. New condition for invariance of ellipsoidal sets for discrete-time saturated systems. IEEE Conference on Control Applications 2015, 1856–1861. [Google Scholar]
  9. Zhou, B.; Duan, G.R.; Lin, Z. Approximation and Monotonicity of the Maximal Invariant Ellipsoid for Discrete-Time Systems by Bounded Controls. Transactions on Automatic Control 2010, 55(2), 440–446. [Google Scholar] [CrossRef]
  10. Song, Y. Construction of lorenz cone with invariant cone using dikin ellipsoid for dynamical systems. Arx.Prepr.Arx. 2022, 2206.11957. [Google Scholar]
  11. Li, D.; Lu, J.; Wu, X.; Chen, G. Estimating the ultimate bound and positively invariant set for the Lorenz system and a unified chaotic system. Journal of Mathematical Analysis and Applications. 2006, 323(2), 844–853. [Google Scholar] [CrossRef]
  12. Liao, X.; Fu, Y.; Xie, S. On the new results of global attractive set and positive invariant set of the Lorenz chaotic system and the applications to chaos control and synchronization. Science in China Series F: Information Sciences. 2005, 48, 304–321. [Google Scholar] [CrossRef]
  13. Cheng, G.; Mu, X. Finite-time stability with respect to a closed invariant set for a class of discontinuous systems. Applied Mathematics and Mechanics. 2009, 30(8), 1069–1075. [Google Scholar] [CrossRef]
  14. Blanchini, F. Set invariance in control. Automatica 1999, 35(11), 1747–1767. [Google Scholar] [CrossRef]
  15. Ren, Y.; Er, M.J.; Sun, G. Switched systems with average dwell time: Computation of the robust positive invariant set. Automatica 2017, 85, 306–313. [Google Scholar] [CrossRef]
  16. Bitsoris, G.; Truffet, L. Positive invariance, monotonicity and comparison of nonlinear systems. Systems & Control Letters 2011, 60(12), 960–966. [Google Scholar]
  17. Hu, T.; Lin, Z. On the tightness of a recent set invariance condition under actuator saturation. Systems & control letters 2003, 49(5), 389–399. [Google Scholar]
  18. Rami, M.A.; Ayad, H.; Mesquine, F. Enlarging ellipsoidal invariant sets for constrained linear systems. International Journal of Innovative Computing, Information and Control 2007, 3(5), 1097–1108. [Google Scholar]
  19. Horváth, Z.; Song, Y.; Terlaky, T. A novel unified approach to invariance conditions for a linear dynamical system. Applied Mathematics and Computation. 2017, 298, 351–367. [Google Scholar] [CrossRef]
  20. Grossmann, I.E.; Kravanja, Z. Mixed-integer nonlinear programming techniques for process systems engineering. Computers & chemical engineering 1995, 19, 189–204. [Google Scholar]
  21. Mai, T.; Mortari, D. Theory of functional connections applied to quadratic and nonlinear programming under equality constraints. Journal of Computational and Applied Mathematics 2022, 406, 113912. [Google Scholar] [CrossRef]
  22. Xue, B.; Zhan, N. Robust Invariant Sets Computation for Discrete-Time Perturbed Nonlinear Systems. IEEE Transactions on Automatic Control 2021, 99. [Google Scholar] [CrossRef]
  23. Si, X.; Yang, H. Optimization approach to the constrained regulation problem for linear continuous-time fractional-order systems. International Journal of Nonlinear Sciences and Numerical Simulation 2021, 22(7-8), 827–842. [Google Scholar] [CrossRef]
  24. Lei, Y.; Yang, H. Dual optimization approach to set invariance conditions for discrete-time dynamic systems. Optimization and Engineering 2023, 1–18. [Google Scholar] [CrossRef]
  25. Song, Y. Positive Invariance Condition for Continuous Dynamical Systems Based on Nagumo Theorem. Arx.Prepr.Arx. 2022. [Google Scholar]
  26. Crema, A.; Loreto, M.; Raydan, M. Spectral projected subgradient with a momentum term for the Lagrangean dual approach. Computers & Operations Research 2007, 34(10), 3174–3186. [Google Scholar]
  27. Wolfe, P. A duality theorem for non-linear programming. Q.Appl.Mathematics 1961, 19(3), 239–244. [Google Scholar] [CrossRef]
  28. Bazraa, M.S.; Sherali, H.D.; Shetty, C.M. Nonlinear programming theory and algorithms. TranSnav J. 1993. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.
Prerpints.org logo

Preprints.org is a free preprint server supported by MDPI in Basel, Switzerland.

Subscribe

Disclaimer

Terms of Use

Privacy Policy

Privacy Settings

© 2025 MDPI (Basel, Switzerland) unless otherwise stated