Submitted:
17 April 2024
Posted:
18 April 2024
Read the latest preprint version here
Abstract
Optimal control has emerged as an indispensable tool in the domain of mechanical robotic systems. The dynamic processes under consideration in this paper are characterized by differential equations with an unknown coefficient. The problem addressed is time-optimal and exhibits bilinear characteristics. To investigate this inverse optimal problem, the classical method has been employed alongside Pontryagin’s Maximum Principle (PMP). This article aims to provide an exact piecewise function for controlling trajectories, specifically accounting for viscous friction. The goal is to determine the reachability set and to find the minimal process time. Notably, no simplifying assumptions were made during the analytical transformations.
Keywords:
inverse problems
; optimal control
; maximum principle
; viscous friction
; reachibility set
1. Introduction
This paper delves into time-optimal control, a fundamental component crucial to a wide array of fields such as robotics and economic systems. It explores the application of Pontryagin’s Maximum Principle (PMP) [1,2,3,4], offering foundational knowledge essential for grasping the concepts and applications of time-optimal control. The referenced resources encompass both theoretical frameworks and practical applications, shedding light on the challenges and solutions associated with optimizing control strategies to improve time efficiency. The focus of the current study is time-optimal control in mechanical systems described by the differential equation:
where m denotes the system’s mass, the coefficient of viscous friction, the variable stiffness coefficient, and the force vector’s projection. The research scrutinizes oscillations under the condition that the external force is nullified, spotlighting the system’s natural response and intrinsic control challenges.
Incorporating the damping term, denoted as , significantly increases the complexity of solving the optimal problem and understanding the dynamics of the system. Despite this complexity, including the damping term is vital for developing methods to experimentally determine modal characteristics, such as eigenmodes, eigenfrequencies, and generalized masses. The cited references [5,6,7] specifically address the behavior of the damped system for computational and, more importantly, for experimental analysis purposes.
Minimal damping leads to prolonged oscillations until equilibrium is reached. Adjusting the control coefficient, can expedite the damping process. Time-optimal control problems, known for their inverse characteristics, are prone to instability [8], which challenges traditional analytical approaches and necessitates regularization of solutions. To complement complex analytical solutions, numerical methods are employed, offering a tangible presentation of results. This research unveils an analytical solution for the control function and the optimal duration of the process across a wide range of parameters. It also introduces bang-bang relay type controls and defines the system’s reachability set. Moreover, the paper underscores the critical role of time-optimal control in contemporary industrial and technological realms, stressing the urgency for durable solutions where time efficiency is pivotal to the sustainability of robot-technical systems [9]. Within the sphere of optimal control, the time-varying harmonic oscillator garners particular interest for its ability to reach designated energy levels effectively. Systems that are linear with respect to their variables and exhibit bounded control from the right side (1) often resort to a bang-bang control strategy. This approach toggles the system’s excitation between two extremities at precisely calculated switching intervals, which are essential as they mark the instances of control adjustments. These intervals are visually represented by a switching curve within the state space, directing the oscillator’s management for any given state combination (position and velocity). An extensive examination of time-optimality for both undamped and damped harmonic oscillators, including simulations that illustrate their practicality, is detailed in references [10,11]. Given that the present investigation focuses on the optimal control of the coefficient , the issue assumes a bilinear form. The driving questions for this research were to ascertain if the optimal process exhibits periodicity and if the control function demonstrates symmetry across the period. The findings confirm the former and negate the latter. The focus on the coefficient opens new avenues for inquiry, particularly regarding the periodicity of the optimal process and the shape of the control function, leading to insights that are both affirming and challenging established presumptions.
2. Problem Statement
Let’s consider the optimal control problem of a mechanical system
where is the coordinate, is the unknown frequency of the external controlling action, subject to determination. The minimum in the problem is sought in the class of piecewise-continuous functions . is the coefficient of viscous friction, where . If this condition is violated, subsequent analysis is also possible, but we have not investigated it, as we believe it does not arouse interest from a technical point of view. The case leads to a consideration of a change in the sign of the variable .
In this setting, the problem is not symmetric with respect to time inversion because of friction.
3. General Properties of the Problem
With any permissible control , it is observed that the trajectory of the controlled system in (2) oscillates around the starting coordinate with successive intervals of monotonic increase and decrease (Figure 1). The amplitude and duration of each oscillation can vary, based on the chosen control function (typically discontinuous). Indeed if the conditions and are satisfied at some moment in time , it can be derived from the differential equation of problem (2) that . Given that the functions and are continuous, the sign of the second derivative will match the sign of in a small vicinity of point , except possibly at a finite number of discontinuity points of the function . This implies that for the trajectory will have a point of local maximum, and for a point of local minimum.
From the boundary conditions, it is understood that the speeds and at the initial and final moments of time equal zero, a situation that occurs only at the extreme points of the oscillatory process. These moments in time are denoted as (Figure 1), and the time intervals are referred to as semi-oscillations. From this point, it is inferred that the optimal trajectory comprises a whole number of semi-oscillations N, being an even number when , and an odd number when .
To investigate the total optimal control problem, let’s divide the trajectory into separate semi-oscillations and first solve the problem for one semi-oscillation . We will denote (, ). It leads to the following N subproblems for :
Utilizing the linearity and homogeneity of the differential equation allows for the normalization of the variable by dividing it by its initial value . It’s also taken into account that the coefficient of friction is independent of time t, meaning the initial moment in time can be considered as zero. This approach transforms all subproblems (3) for into a unified auxiliary mini-problem of optimal control
Given probem (2) and knowing the numbers and , the equation for optimal time in task (4) will be accurately represented by , and the optimal trajectories and control in the auxiliary task (4) will coincide with the optimal trajectories and control in task (2) over the interval [1] . It will be demonstrated below that the optimal process is broken down into individual equal time intervals, calculated using analytical formulas.
Furthermore, for convenience in solving (4), instead of and , the notations x and will be used.
4. Solution of the Optimal Control Problem for a Single Semi-Oscillation
In the previous section, it was demonstrated how to resolve the initial problem (2) by first solving an auxiliary problem
and find the dependency of the optimal time T on the terminal value C.
Here the condition denotes the monotonicity of the trajectory , which corresponds to one semi-oscillation.
First, the question of controllability will be examined, and the range of values for C for which problem (5) has a solution will be defined.
The following notations will be introduced
The largest value can be attained with the control
because with such control, acceleration is maximized when and deceleration is minimized when .
Similarly, the smallest value can be reached analogously with the control
Solving the differential equation with the boundary conditions from system (5) and with control (6) or (7), it is obtained
where
To apply PMP [1] introduce the notation and rewrite (5) in the form of a system of first-order differential equations
Now let the terminal value C satisfy condition (8), which ensures the controllability of the system.
Write the Pontryagin function
and denote its upper boundary
If , , and constitute a solution to the optimal control problem (10), then the following three conditions are satisfied:
I) There exist continuous functions and , which never simultaneously become zero and are solutions to the adjoint system.
II) For any , the maximum condition is satisfied
III) For any , a specific inequality is occured
Let us show that the case of singular control in formula (13), specifically when over a non-zero length interval of time is impossible, assuming the opposite. This means considering the existence of a time interval during which . In such an interval, determining the value of optimal control from the maximum condition would not be feasible.
Given the continuity of the functions and , it is possible either for over some interval or for over a certain time period.
If , then must also be identically zero. However, this conclusion, derived from the second equation of the adjoint system (11), implies that , contradicting the maximum principle’s condition I).
In the scenario where , it follows that . Such a case is deemed impossible, as the controlled system cannot stay in a zero state under any control value, given that the term of the system’s differential equation (5), which includes the control, would also equate to zero.
This reasoning leads to the formulation of a statement:
Lemma 1.
Optimal control is limited to only two values, 1 and , dictated by the sign of the product . Considering the case where this product equals zero as non-existent is justified by the fact that the control value at a single point or a finite number of points lacks any impact on the trajectory of the controlled system.
Now, consider condition III. It represents the greatest interest at values and .
At , the condition is expressed as
At , the condition becomes
Given the boundary conditions that , and considering the control value is always positive, with and , the following additional conditions are derived from (14) and (15)
Now, exploring the potential form of optimal control and the number of switches. It is already known that the value of optimal control is determined by the sign of the product .
The trajectory , due to its monotonic nature, crosses zero only once. This moment in time is denoted as .
Thus, control may only change its value at the point and at points where the sign of the adjoint variable changes. If at point , both and change their signs simultaneously, then the control value remains unchanged.
Firstly, consider an interval of time where control . Then, the general solution of the differential equation from system (4) and from the adjoint system (5) will take a specific form
where constants , , , must be determined from the boundary conditions on the interval of constant control. The value of the adjoint variable is not of interest, as it does not enter into formula (13).
Now, consider an interval of time during which control . Similarly, it is obtained that
where constants , , , are also to be determined from the boundary conditions.
It’s now proposed that the adjoint variable turns to zero at most twice within the interval , either in . For instance, let , where . Then, within the interval , the control value does not change, and this leads to a contradiction with formulas (17), (18) because the distance between zeros of the function (for example for formulas (17)) exceeds the maximum length of an interval of constancy of sign and monotonicity of the function (for example or ).
Thus, it is proven that
Lemma 2.
In problem 5, optimal control can have no more than one switch in each of the intervals and
The function has a continuous derivative (as the right-hand side of the second equation of the adjoint system (11) is continuous) and turns to zero no more than twice within the interval . Moreover, these zeros cannot both lie within the same subinterval or . This leads to 10 different cases (Figure 2) of sign changes for the function over the interval . Dashed gray lines on the graph indicate scenarios that contradict the PMP, while solid red lines indicate cases with no contradiction with PMP found. A detailed analysis of these cases is provided.
If , then for , leading to cases 1) and 2). In case 1), a constant control equal to 1 is maintained throughout the entire time interval. Case 2) is not possible, as and does not satisfy condition (16).
If turns to zero twice within the interval , there exist and such that and , leading to cases 3) and 4). These cases contradict condition (16) since and have the same sign.
If turns to zero once at a point and does not equal zero within the interval , cases 5) and 6) are obtained. Case 5) is impossible because .
If turns to zero once at a point and does not equal zero within the interval , cases 7) and 8) emerge. Case 8) is not feasible, as .
Finally, if does not turn to zero within the interval , cases 9) and 10) are considered. Case 9) is possible if . Case 10) is possible if .
After analyzing cases 1)-10), it is determined that the following statement holds
Lemma 3.
It is noted that all types of control satisfying the maximum principle (illustrated in Figure 3) differ in the length of the segment where the control value equals , and its placement respectively to the point .
Introducing the parameter , the values of and T can be distinctly determined from the equation and three boundary conditions (excluding the condition ) of problem (5) by substituting the corresponding control. This results in the determination of the end time and the terminal value as functions of the unknown parameter s.
For control type 3 (illustrated in Figure 3), corresponds, and for control type 1, the smallest value . For control type 5 the largest value is obtained as the longest possible duration of motion under constant control , that is , with the moments of time and T derived from formula (18) and the conditions , , , , aiming to minimize . Similarly, from formula (18), the smallest value of is obtained. Controls of type 2 and 4 correspond to intermediate values of s within intervals and .
Knowing the switching moment of control and having an analytical solution (formulas 17-18), the end time T and the terminal trajectory value can be explicitly calculated as functions of the parameter s.
Let us consider , then for , and from formula (17) and the initial condition it’s found , leading to and .
Subsequently, for , and from formula (18) and the continuity of at , similarly, .
Finally, for , and from formula (17) and the continuity of at , it’s found
where .
From formula (19) and the condition , the end moment of time
Conducting analogous calculations for the case , one obtains
Noting that formulas (21)-(22) parametrically define a certain curve depicting the dependency of the end time on the terminal value C when utilizing controls that satisfy the maximum principle. The parametric formulation of the function allows for the calculation of the first two derivatives of as functions of the variable C. Thus, the following properties of the function are established
Lemma 4.
- Uniquely determine the function , defined for .
- The function is continuous for .
- The function is differentiable for . At the endpoints of the interval, the derivative equals infinity, while at the point corresponding to the parameter , the derivative equals zero. Let be denoted.
- The function decreases on the interval and increases on the interval .
- The second derivative of the function is negative on the intervals . This condition signifies that the function is concave down for .
Remark 1.
Note that the constancy of the sign of the second derivative was established by calculations via symbolic mathematics by Wolfram.
Investigating the properties of the function , it was found that each permissible terminal value C corresponds to a unique control that satisfies the PMP. Therefore the statement is following
Considering an example with given parameters , , it’s calculated that , . From (21), it’s found that . Figure 4 would illustrate the graph of the function , demonstrating how the optimal time varies with different terminal values C within the specified range.
It has been demonstrated that each value of s unequivocally corresponds to a specific optimal control and an optimal trajectory, leading to a particular terminal point . Different optimal trajectories, corresponding to various types of controls, are presented in Figure 5. Controls of types 1 and 5 correspond to trajectories reaching the extreme points of the reachability set. Control of type 2 corresponds to the upper branch of the curve (left branch on Figure 4). Control of type 3, which has no switches, corresponds to the trajectory with the minimum possible time. Control of type 4 corresponds to the lower branch of the curve (right branch on Figure 4).
Trajectories are constructed for the given parameter values on the Figure 4, but the general character of the drawing does not change with different parameter values.
5. Solution to the General Timing Optimal Problem
Applying the results of the previous section to solve the original problem (2). Let’s first explore the question of controllability and determine under what boundary conditions A and B the system is controllable.
Thus, the lemma is following.
Lemma 6.
The system is controllable if and only if there exists an even natural number N (for ) or an odd natural number N (for ), such that
Since and , it follows that and as .
Therefore, the system will be controllable for any non-zero values of A and B provided that
Utilizing formula (9), this inequality can be expressed as follows
Having resolved the question of controllability, we now return to the original problem of optimal control (2). Given the solution of the optimal control problem (2), let’s consider two consecutive semi-oscillations . This segment of the optimal trajectory satisfies the boundary conditions of the original problem and must itself be optimal. Using the results of the previous section and normalizing variable , the time for this segment can be expressed by the formula
Fixing and (noting that they have the same sign) and finding the minimum of the last expression by the variable . Denoting and introducing a new variable , the time can be expressed by the function
where parametrically defined using formulas (21), (22). Let q and belong to the domain of definition of the function . We find the first derivative of the function
It’s easy to notice that this derivative becomes zero at the point . Let’s compute the second derivative at the point .
Given that , the function decreases and is concave downwards. Therefore, all terms in the above expression are positive, and the found point is a point of minimum. At the boundary points of the domain of definition, the function is not differentiable, but in this case, there exists a unique control (either equation (6) or (7)), leading the controlled system to its extreme position. For the remaining values of , the positivity of the above expression (26) follows from complex algebraic manipulations using the parametric setting of the function with the help of formulas (21)–(22).
We have shown that the numbers , , form a geometric progression. Applying this reasoning to the entire trajectory, we obtain the following statement
Lemma 7.
The numbers for the optimal process satisfy the condition
where the number of semi-oscillations is determined as the smallest N satisfying Lemma 6.
Since the ratio is constant for the optimal trajectory, the optimal control on each segment will be the same. Hence, if the number of semi-oscillations required to reach the end point is more than one, then the optimal control is a periodic function, where the period is one semi-oscillation.
To summarize the steps based on the details provided.
Procedure for obtaining the solution to problem (2)
-
Calculate the denominator of the geometric progression using formulaThis value determines how much the amplitude changes over one semi-oscillation.
-
Using the parametric setting (21)-(22) of the function and the value found in the previous step, calculate the value of the parameter as the solution of the equation and the duration of one semi-oscillation .The optimal time for rapid action in problem (2) is then
-
The value uniquely determines the type of optimal control for one semi-oscillation (Figure 3) and allows determining the number and position of switching points for one semi-oscillation.In the case of we have optimal control of the type 4 or 5. In this case within one semi-oscillation we calculate the moment of the first switching . Then if the second switching moment is calculated using formula .In the case of there is no switching moment (it is optimal control of type 3).In the case of the optimal control of the type 1 or 2 is considered. Here first, the the second switching moment is calculated, then the first switching moment is found.Subsequently, control values for each semi-oscillation periodically repeat. Thus, we find the optimal control and optimal trajectory over the entire segment .
6. Examples
Example 1. Applying the obtained algorithm, find the optimal control and trajectory for the parameter values , , , .
From equation (9), it follows and . From (21) . It’s also noted that since , the problem will have a solution for any boundary conditions given the specific values of and .
From (24), it’s determined that the end point is reachable within semi-oscillations. Further, according to the formula (27) the value is . This value of corresponds to formulas (22) and optimal control of type 2, from which we find , and . Second switching moment and the first switching moment is . The optimal trajectory and phase portrait are shown on Figure 6.
Example 2. Using the obtained result about the periodicity of optimal control, we can construct the reachability set and optimal trajectories for the case when the endpoint is reachable within no more than three semi-oscillations (Figure 7). It’s important to note the discontinuity in the curve of optimal time in the case of more than one semi-oscillation.
7. Conclusion
In conclusion, this study presents an insightful examination of a bilinear optimal control problem, with particular emphasis on the coefficient modulation. Through rigorous analysis, it has been established that the optimal process exhibits periodic characteristics. Furthermore, it was determined that while the optimal process itself is indeed periodic, the control function does not retain symmetry within a single period.
The implications of these findings extend to the broader realm of control theory and its applications in engineering and physics, offering a new perspective on the nature of bilinear control systems. The periodicity of the optimal process suggests potential for efficient energy usage and system stabilization in various applications, from mechanical systems to electrical circuits.
However, the lack of symmetry in the control function within the period underscores the complexity of bilinear control systems and indicates that intuition alone may not be sufficient to predict the system behavior. Future research may explore the nuances of this asymmetry and its impact on system performance.
The analytical solution obtained in the paper allows for the precise determination of the switching moments, as well as the amplitudes and the total optimal time of the process.This paper contributes to the ongoing discourse in control theory, providing a foundation for subsequent studies to build upon. The results underscore the necessity for a nuanced approach to control strategy development, especially in systems where time-optimality is a paramount consideration. The methodologies and findings herein have practical implications for designing more efficient and robust control systems in the future.
Author Contributions
Conceptualization, V.T.; Investigation, D.K. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Data Availability Statement
Data supporting the results of this study are available from the corresponding authors upon request.
Conflicts of Interest
The authors declare that they have no known competing financial interests of personal relationships that could have appeared to influence the work reported in this paper.
References
- Pontryagin, L.S.; Boltyanskii, V.G.; Gamkrelidze, R.V.; Mishchenko, E.F. The Mathematical Theory of Optimal Processes, Interscience Publishers (division of John Wiley and Sons, Inc.): New York, NY, USA; London, UK, 1962; 360 p.
- Lewis, F.L.; Vrabie, D.; Syrmos, V.L. Optimal Control, John Wiley and Sons, Inc.: Hoboken, NJ, USA, 2012; 540 p.
- Kirk, D.E. Optimal Control Theory: An Introduction, Dover Publications, Inc.: New York, NY, USA, 2004; 464 p.
- Bryson, A.E.; Ho, Y.C. Applied Optimal Control: Optimization, Estimation, and Control, Taylor & Francis Group: New York, NY, USA, 1975; 496 p. [Google Scholar]
- Geradin, M.; Rixen, D. Mechanical Vibrations: Theory and Application to Structural Dynamics, John Wiley & Sons, Ltd: Chichester, West Sussex, UK, 2015; 598 p. [Google Scholar]
- Lavrovskii, E.K.; Formal’skii, A.M. Optimal control of the pumping and damping of a swing. Journal of Applied Mathematics and Mechanics 1993, 57, 311–320. [Google Scholar] [CrossRef]
- Golubev, Y.F. Brachistochrone with dry and arbitrary viscous friction. J. Comput. Syst. Sci. Int. 2012, 51, 22–37. [Google Scholar] [CrossRef]
- Matveev, A. S. The Instability of Optimal Control Problems to Time Delay. SIAM Journal on Control and Optimization 2005, 43(5), 1757–1786. [Google Scholar] [CrossRef]
- Hao, L.; Pagani, R.; Beschi, M.; Legnani, G. Dynamic and Friction Parameters of an Industrial Robot: Identification, Comparison and Repetitiveness Analysis. Robotics 2021, 10, 49. [Google Scholar]
- Scaramozzino, S.; Listmann, K.D.; Gebhardt, J. Time-optimal control of harmonic oscillators at resonance. In Proceedings of the European Control Conference (ECC), Linz, Austria, 15-17 July 2015; pp. 1955–1961. [Google Scholar]
- Hatvani, L. On the parametrically excited pendulum equation with a step function coefficient. International Journal of Non-Linear Mechanics 2015, 77, 172–182. [Google Scholar] [CrossRef]
Figure 1.
An example of the trajectory of the controlled system (2) under the action of bang-bang control for the case , .
Figure 1.
An example of the trajectory of the controlled system (2) under the action of bang-bang control for the case , .

Figure 2.
Cases 1)-10) of sign changes in the function . The dashed gray line represents situations that do not satisfy the PMP. The solid red line represents cases that do not contradict the PMP.
Figure 2.
Cases 1)-10) of sign changes in the function . The dashed gray line represents situations that do not satisfy the PMP. The solid red line represents cases that do not contradict the PMP.

Figure 3.
All possible variants of optimal control encountered in problem (10).
Figure 3.
All possible variants of optimal control encountered in problem (10).

Figure 4.
Optimal time curve in problem (5) for the case of , .
Figure 4.
Optimal time curve in problem (5) for the case of , .

Figure 5.
The reachability set of optimal trajectories and control switching points for various values of C in the case of a single oscillation. , .
Figure 5.
The reachability set of optimal trajectories and control switching points for various values of C in the case of a single oscillation. , .

Figure 6.
Optimal trajectory , control , and phase portrait for , .

Figure 7.
The reachability set of optimal trajectories and control switching points for various values of C in the case of no more than 3 oscillations. , .
Figure 7.
The reachability set of optimal trajectories and control switching points for various values of C in the case of no more than 3 oscillations. , .

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.