Improve the quality of Industrial Robot Control Using an Iterative Learning Method with Online Optimal Learning and Intelligent Online Learning Function Parameters

1. Introduction

Robots have been widely used in many industrial fields, so countless robot control methods have been researched and applied, helping robots achieve accurate trajectory tracking. However, these methods are all built based on the mathematical model describing the robot, and they are classified depending on the level of accuracy of that mathematical model. The Euler - Lagrange model is a form of mathematical model often used for developing and synthesizing controllers, and it is impacted by external input noise d(t) as follows:

$$\underset{\_}{u}+\underset{\_}{d}=M(\underset{\_}{q},\underset{¯}{\theta })\ddot{\underset{\_}{q}}+C(\underset{\_}{q},\dot{\underset{\_}{q}},\underset{¯}{\theta })\dot{\underset{\_}{q}}+G(\underset{\_}{q},\underset{¯}{\theta })+F(\underset{\_}{\dot{q}},\underset{¯}{\theta })$$

(1)

In which $\underset{\_}{q}$ is the vector of joint variables; $\underset{\_}{\theta }$is the vector of uncertain parameters; $M(\underset{\_}{q},\underset{\_}{\theta })$is the inertia matrix that is always positive definite symmetry; $C(\underset{\_}{q},\dot{\underset{\_}{q}},\underset{\_}{\theta })$ is the vector of Coriolis and centrifugal components; $F(\underset{\_}{\dot{q}},\underset{\_}{\theta })$describes the effect of friction; $G(\underset{\_}{q},\underset{\_}{\theta })$ is the vector gravity; $\underset{\_}{d}(t)$is the noise vector in the actuator and you is the control signal.

With the matching variables equal to the number of input signals, such a robot system has enough actuators. The robot control task is to build a feedback controller so that the output is the joint variables $\underset{\_}{q}$ that follow the desired trajectory $\underset{\_}{r}(t)$and the tracking quality does not depend on uncertain parameters and components and external noise$\underset{\_}{d}(t)$. Over time, due to many objective factors, such as equipment wear and tear from environmental impacts, the initially set design quality is no longer guaranteed. In this case, it is common to rebuild the controller. As we know, to design an industrial robot motion control system using the traditional method, one thing that cannot be changed is to always clearly understand the control object, which means the control object must be controlled and expressed in modeling in the form of some mathematical model that accurately describes the object, which here can be a transfer function and can also be a state model in the form of a system of differential equations-highest classification. At the same time, when building and designing a motion control system, it is necessary to anticipate objective factors that will not impact the system as expected, such as external interference, etc., leading to damage to the system. The control is no longer as effective as before, and one must redefine the mathematical model of the control object, re-evaluate the rules of unwanted effects, bring objectivity into the system, Rebuild the controller, or at least redefine the parameters for the controller. There have been many control methods to solve the above problem, for example, the exact linearization method [1]. If the external noise component $\underset{\_}{q}$passes, but the indeterminate constant parameter still exists, we have the inverse control method of the model [2]. In cases where both external noise components and uncertain constant parameters exist, there is a sliding control method [3]. However, the disadvantage of the sliding control method is the phenomenon of chattering when the system slides on the sliding surface at a high frequency. To improve this vibration phenomenon, there is also a high-order sliding control method [4], but it still requires an estimated value of the maximum standard deviation of the model caused by and$\underset{\_}{d}(t)$and cannot eliminate it. Due to vibration, there is still a risk of premature failure of robot mechanical equipment components. To overcome the above disadvantages, intelligent control methods can be used, such as the control trend of not using the robot's dynamic model (1), so the control quality is not affected. by components $\underset{\_}{q}(t)$) and $\underset{\_}{d}(t)$.The intelligent control method mainly applied to robots mentioned in the article is the iterative learning method [5]. This integrated control method with cyclic working systems requires the same state. At the same time, the parameters $\underset{\_}{q}(t)$) and $\underset{\_}{d}(t)$are also required to be periodic and have the exact change period as the working cycle of industrial robots. The primary iterative learning control method is only sometimes applied to meet the desired control quality. There have been many improvements to iterative learning to improve control quality and expand the scope of practical applications. The first improvement is the improvement of combining iterative learning with traditional control methods, often called indirect iterative learning or direct transmission iterative learning. These improvements include [6] when the friction component alone cannot be determined, [7] when that is not possible, or [8] when the learning function parameters cannot be found, as well as when the learning function parameters need to be changed. Change during work cycles. A control trend for a class of robotic systems is model matching control, including [9]. This control method requires the mathematical model (1), which will encounter problems and disadvantages of previous traditional control methods. The next improvement is to use model-based control but almost entirely not use the mathematical model (1) of the robot, applicable to both cases where $\underset{\_}{q}(t)$) and $\underset{\_}{d}(t)$ are dependent. It depends on time and does not require periodicity, so it can be considered an intelligent model-matching control method. This method is based on theoretical results on optimal control of each segment on the time axis available in [10] and applying disturbance estimation to control self-balancing two-wheeled vehicles [11].

The main content of the article is to analyze and evaluate additional improvements to essential iterative learning to improve the quality of motion control of robot systems and expand the scope of practical applications, specifically, Intelligent control based on model matching (model matching) almost wholly does not need to use the mathematical model of the robot system, applicable to the case where $\underset{\_}{q}(t)$) and $\underset{\_}{d}(t)$depends on time, no need for circulation for the robot system. The content of the article includes six parts. Part 1 is the problem of researching iterative learning for robot systems. Part 2 presents the results of the 2-DOF robot dynamic equation; Part 3 presents two robot control structures using iterative learning; Part 4: The first structure controls the robot using iterative learning; Part 5 and part 6: The second structure controls the robot using iterative learning; Part 7 is conclusions and future research directions.

2. Robot planar dynamic model

A 2-DOF planar robot arm is shown in Figure 1, where ${\theta }_{\mathrm{i}},l_{\mathrm{i}} \mathrm{and} m_{\mathrm{i}}$ are respectively.

The dynamic equations for this system can be found using the Lagrange Euler formulation [1]. The dynamic model of the two-DOF:

$$\underset{\_}{u}=M(\underset{\_}{q},\underset{\_}{\theta })\ddot{\underset{\_}{q}}+H(\underset{\_}{q},\dot{\underset{\_}{q}},\underset{\_}{\theta })+G(\underset{\_}{q},\underset{\_}{\theta })$$

(2)

with the following results:

$$\begin{array}{l}\left\{\begin{array}{cc}{M}_{11}=& m_1{l}_{C1}^2+I_1+m_2\left(l_1^2+l_{C2}^2+2l_1{l}_{C2}c\mathrm{os}{\theta }_2\right)+I_2\\ M_{12}=& m_2(l_{C2}^2+l_1{l}_{C2}c\mathrm{os}{\theta }_2)+I_2\\ \begin{array}{c}{M}_{21}=\\ M_{22}=\end{array}& \begin{array}{c}{m}_2(l_{C2}^2+l_1{l}_{C2}c\mathrm{os}{\theta }_2)+I_2\\ m_2{l}_{C2}^2+I_2\end{array}\end{array}\right.\\ \left\{\begin{array}{cc}{H}_{11}=& -m_2{l}_1{l}_{C2}\sin {\theta }_2(2{\dot{\theta }}_1^{ }{\dot{\theta }}_2+{\dot{\theta }}_2^2)\\ H_{12}=& m_2{l}_1{l}_{C2}\left({\dot{\theta }}^2{ }_1+{\dot{\theta }}_1{\dot{\theta }}_2\right)\sin {\dot{\theta }}_2-m_2{l}_1{l}_{C2}\sin {\theta }_2{\dot{\theta }}_1{\dot{\theta }}_2\end{array}\right.\\ \left\{\begin{array}{cc}\hspace{1em}\hspace{1em}\hspace{1em}\hspace{1em}\hspace{1em}{G}_{11}=& m_{2}g\left(l_{1}c\mathrm{os}{\theta }_1+l_{C2}c\mathrm{os}({\theta }_1+{\theta }_2)\right)\\ \hspace{1em}\hspace{1em}\hspace{1em}\hspace{1em}\hspace{1em}{G}_{12}=& m_{2}g{l}_{C2}^{ }c\mathrm{os}({\theta }_1+{\theta }_2)\end{array}\right.+m_1{l}_{C1}^{ }c\mathrm{os}{\theta }_1\end{array}$$

(3)

Problems that arise in working in real-time, factors that cannot be ignored include the impact of interference on the system and unwanted changes to model parameters. The control problem is the signal tracking control for the industrial robot motion system. The most comprehensive solution would be the method of using iterative learning control. This method can be added to a traditional control system to compensate for system errors, or it can also be applied immediately to robots without a conventional controller. The content of the article proposes 02 solutions to control industrial robots by iterative learning using innovative online learning parameters presented explicitly in sections 4, 5, and section 6.

3. Two structure diagrams for robot control using iterative learning method

The content of the article proposes 02 solutions to control industrial robots by iterative learning using innovative online learning parameters Figure 2 and Figure 3.

These two solutions are different because we need to add an intermediate controller in the inner loop with the first solution, but we do not with the second solution. The task of this medium inner-loop controller is to make the industrial robot system adapt to the iterative learning control principle later because the iterative learning controller often requires the control object to be stable (possibly no need for asymptotic stabilization). We need the mathematical model (1) of the industrial robot system to design an intermediate controller as a stable system. In the second solution, the uncertainty estimation block, in addition to the pure task of estimating the function uncertainty components to perform input compensation, must also carry out the additional function of making a stable system. If we apply the "smart" estimation principle introduced in part 5 to design the uncertainty estimation block, then with the second solution, we do not need the industrial robot system's mathematical model (1). However, the price for this is that the processing speed of the second solution will be much slower than the first solution. According to the simulation results obtained, it's about 140 times slower. In addition, since both of these solutions use an uncertainty estimation block for compensation control, they will be applicable for adaptive control of industrial robot systems with additional noise in the input, i.e., applying the method described by (4), (15). This is also a difference from the original model (1) because interference in the actuators is unavoidable. Furthermore, it is possible to assume that this input disturbance can contain matched model uncertainties. In that case, both control solutions are adaptive to the trouble and robustness of model bias.

4. Structure the first diagram for robot control the iterative learning method

4.1. Algorithm content according to the first control diagram

The mathematical model (1) and assume that $C(\underset{\_}{q},\underset{\_}{\dot{q}}),G(\underset{\_}{q})$ is undetermined. Then we have:

$$M(\underset{\_}{q})\underset{\_}{\ddot{q}}=\underset{\_}{u}+\underset{\_}{d}$$

(4)

With the sum of all the functional uncertainty components of the model:

$$\underset{\_}{d}=\underset{\_}{n}(\underset{\_}{q},\underset{\_}{\dot{q}},\underset{\_}{\ddot{q}},t)-C(\underset{\_}{q},\underset{\_}{\dot{q}})\underset{\_}{\dot{q}}-G(\underset{\_}{q})$$

(5)

It can be seen immediately that when used:

$$\underset{\_}{u}=M(\underset{\_}{q})[\upsilon -g_1\underset{\_}{q}-g_2\underset{\_}{\dot{q}}]$$

(6)

With $g_1,g_2$being two properly chosen matrices, the system becomes:

$$\underset{\_}{\ddot{q}}=\underset{\_}{v}-g_1\underset{\_}{q}-g_2\underset{\_}{\dot{q}}+\underset{\_}{d}\iff \left(\begin{array}{c}\underset{\_}{\dot{q}}\\ \underset{\_}{\ddot{q}}\end{array}\right)=\left(\begin{array}{cc}{0}_n& I_n\\ -g_1& -g_2\end{array}\right)\left(\begin{array}{c}\underset{\_}{q}\\ \underset{\_}{\dot{q}}\end{array}\right)+\left(\begin{array}{c}{0}_n\\ I_n\end{array}\right)\left[\underset{\_}{v}+\underset{\_}{d}\right]$$

(7)

where $\underset{\_}{d}=M{(\underset{\_}{q})}^{-1}\underset{\_}{d}$ is an uncertain component of system (7).

$$x=\left(\begin{array}{c}\underset{\_}{q}\\ \underset{\_}{\dot{q}}\end{array}\right),G=\left(\begin{array}{cc}{0}_n& I_n\\ -g_1& -g_2\end{array}\right),B=\left(\begin{array}{c}{0}_n\\ I_n\end{array}\right)$$

(8)

The model (7) will have the canonical form:

$$\underset{\_}{\dot{x}}=G\underset{\_}{x}+B\left[\underset{\_}{v}+d\right]$$

(9)

In addition, for system (9) to be stable, that is, to have a Hurwitz matrix A, we must choose two matrices so that the eigenvalues of A given in (7) lie to the left of the imaginary axis. The simplest way is to choose them according to the method of assigning pole points using Matlab's place(.) command, and these pole points should be selected as accurate (negative) numbers to eliminate fluctuations during transitions.

And then the system output:

$$y=\underset{\_}{q}=\left(I_n,0_n\right)\underset{\_}{x}$$

(10)

Follow the given periodic $\underset{\_}{r}(t)$ pattern trajectory

Now we use notation: ${\left|{ }_{t=i{T}_S},{\underset{\_}{y}}_k(i)={\underset{\_}{y}}_k(t)\right|}_{t=i{T}_s};{\underset{\_}{v}}_k(i)={\underset{\_}{v}}_k(t)\left|{ }_{t=i{T}_S}\right|$Give the input and output of systems (9) (10), respectively $i{T}_s$at the time in the k test, with $T_s$being the sample extraction cycle. Then the P-type learning function, standard to all update time i at the k time, will be:

$${\underset{\_}{v}}_{k+1}={\underset{\_}{v}}_k+K{\underset{\_}{e}}_k$$

(11)

Where:

$$\begin{array}{l}{\underset{\_}{v}}_k=col({\underset{\_}{v}}_k(0),{\underset{\_}{\upsilon }}_k(1),\mathrm{...},{\underset{\_}{v}}_k(s-1));{\underset{\_}{e}}_k=\underset{\_}{\vartheta }-{\underset{\_}{\omega }}_k;{\underset{\_}{\omega }}_k=col({\underset{\_}{r}}_r(0),{\underset{\_}{r}}_k(1),\mathrm{...},{\underset{\_}{r}}_k(s-1)),\\ {\underset{\_}{v}}_k=col({\underset{\_}{r}}_k(0),{\underset{\_}{r}}_k(1),\mathrm{...},{\underset{\_}{r}}_k(s-1)).\end{array}$$

(12)

$$K=\left(\begin{array}{cc}\begin{array}{l}K\\ ⋮\end{array}& \begin{array}{l}{0}_{nxn}\\ ⋮\end{array}\\ 0_{nxn}& K\end{array}\right)\in {ℝ}^{\mathrm{nSxnS}} \mathrm{and} K\in {ℝ}^{nxn}$$

K is the matrix of learning functions that must be chosen so that the learning function converges.

The uncertainty component of the system, in general, can be estimated and explicitly compensated as follows: First, we must approximate model (9) at time i in the k time, then when paid by $\underset{\_}{\widehat{d}}{}_k(i-1)$, becomes:

$$\frac{{\underset{\_}{x}}_k(i)-{\underset{\_}{x}}_k(i-1)}{T_s}\approx G{\underset{\_}{x}}_k(i)+B\left[{\underset{\_}{v}}_k(i)-{\underset{\_}{\widehat{d}}}_k(i)+{\underset{\_}{d}}_k(i)\right]$$

Hence, $G{\underset{\_}{x}}_k(i)\approx {\underset{\_}{x}}_k(i-1)+B\left[{\underset{\_}{v}}_k(i)-{\underset{\_}{\widehat{d}}}_k(i)+{\underset{\_}{d}}_k(i)\right]\iff \widehat{B}{\underset{\_}{d}}_k(i)\approx {\underset{\_}{h}}_k(i)$In which: $\widehat{G}=\left(I_{2n}-T_{s}G\right),\stackrel{⌢}{B}=T_{s}B,{\underset{\_}{h}}_k(i)=\widehat{G}{\underset{\_}{x}}_k(i)-{\underset{\_}{x}}_k(i-1)-B\left[{\underset{\_}{v}}_k(i)-{\widehat{\underset{\_}{d}}}_k(i-1)\right]$So from ${\widehat{B}}^T\widehat{B}=T_s^2{I}_n$, we have the estimated value${\underset{\_}{\widehat{d}}}_k(i)\approx {\underset{\_}{d}}_k(i)$for the next offset at time i+1 as:

$$\begin{array}{l}{\underset{\_}{d}}_k(i)={({\widehat{B}}^T\widehat{B})}^{-1}{\widehat{B}}^T{\underset{\_}{h}}_k(i)=\frac{1}{T_s^2}{\widehat{B}}^T{\underset{\_}{h}}_k(i)=\frac{1}{T_s^{ }}{B}^T{\underset{\_}{h}}_k(i)\\ =\frac{1}{T_s^{ }}(0_n,I_n)\left\{\widehat{G}{\underset{\_}{x}}_k(i)-{\underset{\_}{x}}_k(i-1)-B\left[{\underset{\_}{v}}_k(i)-{\underset{\_}{d}}_k(i-1)\right]\right\}\\ =\frac{1}{T_s^{ }}{B}^T\left\{[\widehat{G}{\underset{\_}{x}}_k(i)-{\underset{\_}{x}}_k(i-1)]-{\underset{\_}{v}}_k(i)+{\underset{\_}{d}}_k(i-1)\right\}\end{array}$$

(13)

The structure of the intelligent control system for industrial robots is shown in Figure 2.

Below is the algorithm describing the steps to calculate an iterative learning controller, combined with identifying and compensating uncertain components (no need repetitive) for industrial robots after accurate linearization; several tries k is continuous along with the control process and only ends when the control stops.

Algorithm 1: structure the first for robot control the iterative learning method is with function parameters smart online learning

1	Assign $t=0,\underset{\_}{\widehat{d}}=0.$Choose $T_s>0$ ; Calcutate $\widehat{G},S$ . Choose K; Assign small value $x_0=0,\underset{\_}{\widehat{d}}=0,v=col(v(0),\mathrm{...},v(s-1)),r=col(r(0),\mathrm{...},r(s-1))$.
2	while continue the control do
3	for$i=0,1,\mathrm{...},M-1$do
4	Send $\underset{\_}{u}=\underset{\_}{v}(i)-\widehat{d}$to into uncertain control (9) and determine $x=x(t+i{T}_s)$.
5	Calcutate $\underset{\_}{\widehat{d}}\leftarrow B^T(\widehat{G}\underset{¯}{x}-\underset{¯}{x_0^{ }})/T_s-\underset{¯}{v_h}(i)+\underset{\_}{\widehat{d}}$.
6	Establish $\underset{¯}{y}\left(i\right)=(I_n,0_n)\underset{¯}{x}$ and calcutate $\underset{\_}{e}(i)=\underset{\_}{r}(i)-y(i)$.
7	end for
8	Set up the sum vector. $\underset{\_}{\epsilon }$ từ $\underset{\_}{e}(i)$, $\mathrm{i}=0,1\mathrm{...},\mathrm{S}-1$ theo (11)
9	Update vector $\underset{\_}{v}$ from its existing value according to (10) that is, calculate the values.$\underset{\_}{v}(i)$, $i=0,1,\mathrm{...},S-1$
10	Set $t\leftarrow t+T$
11	end while

4.2. Applied to robot control

For the simulation, there are assigned:

$$G_1=\left[\begin{array}{cc}30& 0\\ 0& 12\end{array}\right],G_2=\left[\begin{array}{cc}11& 0\\ 0& 7\end{array}\right],K=\left[\begin{array}{cc}2.9& 0\\ 0& 1.8\end{array}\right],T_s=0.05s,T=20s$$

The orbits are set as two periodic functions of period T as follows:

$$r_1(t)=\left\{\begin{array}{c}\min \left\{T_{s}t/2,1.5\right\}khit\le \raisebox{1ex}{$T$}\!\left/ \!\raisebox{-1ex}{$2$}\right.\\ r_2(T-t)khi\frac{T}{2}<t\le T\end{array}\right.;r_2(t)=\sin (\raisebox{1ex}{$2\pi t$}\!\left/ \!\raisebox{-1ex}{$T$}\right.)$$

We obtain the simulation results in Figure 4, Figure 5, Figure 6 and Figure 7.

The simulation results in Figure 4 and Figure 5 show that, when combined with the identification and noise compensation stages of the traditional controller (13), the iterative learning controller (11) has achieved good signal tracking quality. The preset error with tracking error after 60 trials is small enough and acceptable: $-0.03\le e_1(t)\le 0.065 \mathrm{and} -0.017\le e_2(t)\le 0.02$. The residual error $e_1(t)$ in the simulation results is due to the non-smooth trapezoidal signal set $r_1(t)$ at $t_0=0;t_1=1.5T_s;t_2=T-1.5T_s;t_3=T$. It also affects the tracking error $e_2(t)$ due to channel interleaving in the system.

5. The structure of the second iterative learning controller with model-free determination of optimal learning parameters for industrial robot

To stabilize the system without using traditional control methods. This makes it possible to apply iterative learning control to even unstable systems without using a mathematical model of the system.

Tool: Estimate the derivative using Taylor series analysis.

5.1. Algorithm content according to the first control diagram

$$\ddot{\underset{\_}{q}}=-A_1\underset{\_}{q}-A_2\dot{\underset{\_}{q}}+\underset{\_}{u}+\underset{\_}{\eta }$$

(14)

where $A_1,A_2$ are two arbitrarity chosen matrices and

$$\underset{\_}{\eta }=\underset{\_}{d}+\left[I_n-M(\underset{\_}{q},\underset{\_}{\theta })\right]\ddot{\underset{\_}{q}}-\left[C(\underset{\_}{q},\dot{\underset{\_}{q}},\underset{\_}{\theta })-A_2\right]\dot{\underset{\_}{q}}-\left[G(\underset{\_}{q},\underset{\_}{\theta })-A_1\underset{\_}{q}\right]$$

(15)

From (15) we see that the route cost calculation of model (1) is contained in this vector$\underset{\_}{\eta }$. Based on the equivalent model (14), the proposed intelligent controller for the robot is as follows:

First, the estimation errors of the new unknown function vector $\underset{\_}{\eta }$will be adjusted, as shown below.

$$-\widehat{\underset{\_}{\eta }}+\underset{\_}{v}=\underset{\_}{u}$$

(16)

With the estimation of bias $\underset{¯}{\delta }$ as (17) system (14) will become linear:

$$\dot{\underset{\_}{x}}=A\underset{¯}{x}+B\left[\underset{¯}{v}+\underset{¯}{\delta }\right],\underset{¯}{y}=\underset{¯}{q}=\left({\mathrm{I}}_n,0_n\right)\underset{¯}{x}$$

(17)

$$\mathrm{With}\hspace{1em}\hspace{1em}\underset{¯}{\dot{x}}=\left(\begin{array}{c}\underset{¯}{q}\\ \underset{¯}{\dot{q}}\end{array}\right),A=\left(\begin{array}{cc}{0}_n& {\mathrm{I}}_n\\ -A_1& -A_2\end{array}\right),B=\left(\begin{array}{c}{0}_n\\ {\mathrm{I}}_n\end{array}\right),\underset{¯}{\delta }=\underset{¯}{\eta }-\underset{¯}{\stackrel{⌢}{\eta }}$$

(18)

and $0_n$, $I_n$ are $nxn$ square matrices with zero

Secondly, control the compensation system in equation (17) so that its output $\underset{¯}{y}(t)$ will converge to a desired reference value $\underset{¯}{x}(t)$.

5.2. Feedback linearization for internal loop control using model-free disturbance compensation

Returning to the compensator ${\underset{¯}{v}}_k$ in equation (16) and designating as the present working period i.e. with $t=kT+\tau ,0\le \tau <T \mathrm{and} {\underset{¯}{v}}_k={\underset{¯}{v}}_k(\tau ),{\underset{¯}{x}}_k={\underset{¯}{x}}_k(\tau ),$then (17) is rewritten as:

$${\underset{¯}{\dot{x}}}_k(\tau )=A{\underset{¯}{x}}_k(\tau )+B\left[{\underset{¯}{v}}_k(\tau )-{\underset{¯}{\widehat{\eta }}}_k(\tau )+{\underset{¯}{\eta }}_k(\tau )\right]$$

(19)

The automatic mode – free feedback linearization block (Figure 2) aims to estimate $\underset{¯}{\stackrel{⌢}{\eta }}$ from the measured values of ${\underset{¯}{x}}_k(\tau )$ at two times $\tau =i{T}_s$ and $\tau -T_s=(i-1)T_s$ for each corresponding ${\underset{¯}{x}}_k(i{T}_s),{\underset{¯}{x}}_k(i-1)T_s$ value. With $0<T_s<<1$ being an arbitrarily chosen constant small value, then we expand the Taylor function of the function ${\underset{¯}{x}}_k(\tau )$ around $(i-1)T_s$ as follows,

$${\underset{¯}{x}}_k\left((i-1)T_s\right)={\underset{¯}{x}}_k(i{T}_s)-T_s{\underset{¯}{\dot{x}}}_k(i{T}_s)+\frac{T_s{ }^2}{2}{\underset{¯}{\ddot{x}}}_k\left(\varsigma \right)$$

(20)

Where $(i-1)T_s\le \varsigma \le i{T}_s,or$

$${\underset{¯}{\dot{x}}}_k(i{T}_s)\approx \frac{{\underset{¯}{x}}_k(i{T}_s)-{\underset{¯}{x}}_k\left((i-1)T_s\right)}{T_s}$$

(21)

Assuming the last term of expression (20) is very small and can be ignored, the expression ${\underset{¯}{\widehat{\eta }}}_k(i{T}_s)$ will be used to approximate equation (19) by replacing the signs “$\approx$”and ${\underset{¯}{\eta }}_k(i{T}_s)$ in (10) with "=" and ${\underset{¯}{\stackrel{⌢}{\eta }}}_k(i{T}_s)$

$$\frac{{\underset{¯}{x}}_k(i{T}_s)-{\underset{¯}{x}}_k\left((i-1)T_s\right)}{T_s}\approx A{\underset{¯}{x}}_k(i{T}_s)+B\left[{\underset{¯}{v}}_k(i{T}_s)-{\underset{¯}{\widehat{\eta }}}_k\left((i-1)T_s\right)+{\underset{¯}{\eta }}_k(i{T}_s)\right]$$

(22)

Then, calculate

$$B{\underset{¯}{\widehat{\eta }}}_k(i{T}_s)=\frac{{\underset{¯}{x}}_k(i{T}_s)-{\underset{¯}{x}}_k\left((i-1)T_s\right)}{T_s}-A{\underset{¯}{x}}_k(i{T}_s)-B\left[{\underset{¯}{v}}_k(i{T}_s)-{\underset{¯}{\widehat{\eta }}}_k\left((i-1)T_s\right)\right]$$

which yields

$${\underset{¯}{\widehat{\eta }}}_k(i{T}_s)=B^T\left[\frac{{\underset{¯}{x}}_k(i{T}_s)-{\underset{¯}{x}}_k\left((i-1)T_s\right)}{T_s}-A{\underset{¯}{x}}_k(i{T}_s)\right]-\left[{\underset{¯}{v}}_k(i{T}_s)-{\underset{¯}{\widehat{\eta }}}_k\left((i-1)T_s\right)\right]$$

(23)

Theorem 1: The value ${\underset{¯}{\widehat{\eta }}}_k(i{T}_s)$calculated in equation (23) causes the approximation error of expression (22) to decrease.

Proof: Error in expression (22) $\underset{¯}{\epsilon }$ will be calculated:

$$\begin{array}{l}\underset{¯}{\epsilon }=A{\underset{¯}{x}}_k(i{T}_s)+B\left[{\underset{¯}{v}}_k(i{T}_s)-{\underset{¯}{\underset{¯}{\widehat{\eta }}}}_k\left((i-1)T_s\right)+{\underset{¯}{\eta }}_k(i{T}_s)\right]-\frac{{\underset{¯}{x}}_k(i{T}_s)-{\underset{¯}{x}}_k\left((i-1)T_s\right)}{T_s}\\ =B{\underset{¯}{\eta }}_k(i{T}_s)+\underset{¯}{\lambda }\end{array}$$

where

$$\underset{¯}{\lambda }=A{\underset{¯}{x}}_k(i{T}_s)+B\left[{\underset{¯}{v}}_k(i{T}_s)-{\underset{¯}{\stackrel{⌢}{\eta }}}_k\left((i-1)T_s\right)\right]-\frac{{\underset{¯}{x}}_k(i{T}_s)-{\underset{¯}{x}}_k\left((i-1)T_s\right)}{T_s}$$

And the estimated value will also be calculated according to expression (22) as follows:

$$\frac{{\underset{¯}{x}}_k(i{T}_s)-{\underset{¯}{x}}_k\left((i-1)T_s\right)}{T_s}=A{\underset{¯}{x}}_k(i{T}_s)+B\left[{\underset{¯}{v}}_k(i{T}_s)-{\underset{¯}{\stackrel{⌢}{\eta }}}_k\left((i-1)T_s\right)+{\underset{¯}{\eta }}_k(i{T}_s)\right]$$

The optimization problem would then be written:

$$\begin{array}{l}{\eta }^{*}=\underset{{\underset{¯}{\eta }}_k}{\arg \min }{‖{\underset{¯}{\epsilon }}_k‖}^2=\underset{{\underset{¯}{\eta }}_k}{\arg \min }{‖B{\underset{¯}{\eta }}_k+\underset{¯}{\lambda }‖}^2=\underset{{\underset{¯}{\eta }}_k}{\arg \min }{‖B{\underset{¯}{\eta }}_k+\underset{¯}{\lambda }‖}^T‖B{\underset{¯}{\eta }}_k+\underset{¯}{\lambda }‖\\ =\underset{{\underset{¯}{\eta }}_k}{\arg \min }{‖{\underset{¯}{\eta }}_k^T{\underset{¯}{\eta }}_k+\underset{¯}{2{\lambda }^{T}B{\underset{¯}{\eta }}_k+{\lambda }^T\lambda }‖}^T\end{array}$$

has a unique solution

$${\eta }^{*}=-B^T\underset{¯}{\lambda }$$

which coincides with ${\underset{¯}{\widehat{\eta }}}_k(i{T}_s)$ given in (23).

From (23) we see that the estimation tool created to compensate for noise and uncertainty in the vector model $\underset{¯}{\eta }$ does not use the mathematical model (1). Therefore, the noise compensator (16) with $\underset{¯}{\stackrel{⌢}{\eta }}$ obtained from expression (23) will be model–free.

5.3. Outer loop control is by iterative learning controller design.

Expression (17) describes the system (14) that becomes LTI by compensating the $\underset{¯}{\eta }$ synthetic disturbances in (15) by the compensator (16), and it is rewritten in ILC language for iterative learning systems as after:

$$\left\{\begin{array}{c}{\underset{¯}{x}}_k(i+1)=\widehat{A}{\underset{¯}{x}}_k(i)+\widehat{B}\left[{\underset{¯}{v}}_k(i)+{\underset{¯}{\delta }}_k(i)\right]\\ {\underset{¯}{y}}_k(i)=\widehat{C}{\underset{¯}{x}}_k(i)\end{array}\right\}$$

(24)

where $i=0,1,\mathrm{.....},N=T/T_s,{\underset{¯}{x}}_k(N)={\underset{¯}{x}}_{k+1}(0), \mathrm{and}$

$$\widehat{A}=\exp (A{T}_s),\widehat{B}={\displaystyle \underset{0}{\overset{T_s}{\int }}{\mathrm{e}}^{At}Bdt{ \mathrm{and} \mathrm{C}^=(\mathrm{I}}_n,\mathrm{O}{}_n)}$$

(25)

The control objective at this point is to choose the proper learning parameter K for the update rule P-Type, assuming we have identified two matrices that make the matrix A provided in equation (6).

$${\underset{¯}{v}}_{k+1}\left(i\right)={\underset{¯}{v}}_k\left(i\right)+K{\underset{¯}{e}}_k,with{\underset{¯}{e}}_k(i)={\underset{¯}{r}}_k(i)+{\underset{¯}{y}}_k(i)$$

(26)

In order to satisfy the required convergence $‖{\underset{¯}{e}}_k(i)‖\to 0$ for all i , or at least as close as possible to the orgin.

The value ${\underset{¯}{v}}_k$ given by ILC (26) is partially constant, so the discrete time model in equation (24) obtained is equivalent to the continuous time model in equation (17). In expression (24), no information about the system model (1) is used either. Therefore (24) can be applied to all robot controllers. From (24), it is obtained with the assumption ${\underset{¯}{\delta }}_k(i)=\underset{¯}{0}$.

$${\underset{¯}{y}}_{k+1}(i)=C{\widehat{A}}^i{\underset{¯}{x}}_{k+1}(0)+{\displaystyle \sum _{j=0}^{i-1}C{\widehat{A}}^{i-i-1}\widehat{B}}{v}_{k+1}(j),$$

This results from (24) and the clear demonstration of repeatable ability ${\underset{¯}{x}}_k(0)={\underset{¯}{x}}_{k+1}(0),\forall k$

$\begin{array}{l}{\underset{¯}{e}}_{k+1}(i)=\underset{¯}{r}(i)-{\underset{¯}{y}}_{k+1}(i)=\underset{¯}{r}(i)-\left[C{\widehat{A}}^i{\underset{¯}{x}}_{k+1}(0)+{\displaystyle \sum _{j=0}^{i-1}C{\widehat{A}}^{i-i-1}}+(v_k(j)+K{\underset{¯}{e}}_k(j))\right]\\ =\underset{¯}{r}(i)-{\underset{¯}{y}}_k(i)-{\displaystyle \sum _{j=0}^{i-1}C{\widehat{A}}^{i-j-1}\widehat{B}}K{\underset{¯}{e}}_k(j)=(I-C\widehat{B}K){\underset{¯}{e}}_k(i)-{\displaystyle \sum _{j=0}^{i-2}C{\widehat{A}}^{i-j-1}\widehat{B}}K{e}_k(j)\end{array}$

Hence,

$${\underset{¯}{e}}_{k+1}=\Phi {\underset{¯}{e}}_k$$

(27)

Where

$${\underset{¯}{e}}_k=\left(\begin{array}{c}{\underset{¯}{e}}_k(0)\\ {\underset{¯}{e}}_k(1)\\ ⋮\\ {\underset{¯}{e}}_k(N-1)\end{array}\right) \mathrm{and} \Phi =\left(\begin{array}{cccc}I-C\stackrel{⏜}{B}K& 0& \cdots & 0\\ -C\widehat{A}\widehat{B}K& I-C\widehat{B}K& \cdots & 0\\ ⋮& ⋮& ⋮& ⋮\\ C{\widehat{A}}^{N-2}\widehat{B}K& -C{\widehat{A}}^{N-2}\widehat{B}K& \cdots & I-C\widehat{B}K\end{array}\right)$$

(28)

Theorem 2: For the scenario${\underset{¯}{\delta }}_k(i)=0\hspace{0.17em}\hspace{0.17em}$, all requirements$‖{\underset{¯}{e}}_k(j)‖\to 0$for all$i=0,1,\mathrm{.....},N-1$will only be satisfied if and when the P-Type learning parameter K is selected in a way that makes the value supplied in (16) Schur.

Proof: For the autonomous system (27) the proof is comprehensive as it is clear that it is stable if and only if it is Schur.

5.4. Control algorithm and performance of closed – loop system

The following algorithm is established to implement the proposed model-free controller (16) where the $\underset{¯}{v}$ and $\underset{¯}{\eta }$ values are obtained from expressions (26) and (13), respectively. In this control algorithm, the working time T of the robots is repeatedly tested by each While loop.

In fig. 2 illustrates the output tracking performance of the closed-loop system with the output scenario ${\underset{¯}{\delta }}_k(i)\ne \underset{¯}{0}$.

Theorem 3:The proposed mode-free control framework in Fig. 1 (which includes the feedback linearization block via disturbance compensator (16), (23) and the ILC block (26), drives the robot manipulators' (1) output tracking error$\left|{\underset{¯}{e}}_k(\tau )\right|$to a$T_s$dependent neighborhood$O$of origin if d is limited and continuous. If a smaller $T_s$is selected, a smaller$O$will be.

Proof: Because noise$\underset{¯}{d}$is continuous and bounded, the total noise$\underset{¯}{\eta }$and component$\underset{¯}{\delta }\hspace{0.17em}$are also continuous and bounded. The upper limit of$O$is$\Delta$and this limit can be reduced arbitrarily by reducing$T_s$according to theorem 1

The validity of Theorem 2 was confirmed by

$$\underset{¯}{\dot{\omega }}=A\underset{¯}{\omega }+B\underset{¯}{v}\hspace{0.17em}\hspace{0.17em}\hspace{0.17em}\mathrm{with}\hspace{0.17em}\hspace{0.17em}\underset{¯}{\omega }=vec(\underset{¯}{r},\underset{¯}{\dot{r}})$$

(29)

The subtraction (29) from (17) yields

$$\underset{¯}{\dot{\epsilon }}=A\underset{¯}{\epsilon }-B\underset{¯}{\delta }\hspace{0.17em}\hspace{0.17em}\mathrm{w}here\hspace{0.17em}\hspace{0.17em}\underset{¯}{\epsilon }=vec(\underset{¯}{e},\underset{¯}{\dot{e}})$$

(30)

Lyapaunov equation $A^{T}P+PA=-Q$ with optional positive definite matrix Q we always have positive definite P because A is Hurwitz. From the positive definite function $V(\underset{¯}{\epsilon })={\underset{¯}{\epsilon }}^{T}P\underset{¯}{\epsilon }$ we have the result:

$$\begin{array}{l}\dot{V}={(A\underset{¯}{\epsilon }-B\underset{¯}{\delta })}^T+{\underset{¯}{\epsilon }}^{T}P(A\underset{¯}{\epsilon }-B\underset{¯}{\delta })\\ ={\underset{¯}{\epsilon }}^T(A^{T}P+PA)\underset{¯}{\epsilon }-2{\underset{¯}{\epsilon }}^{T}PB\underset{¯}{\delta }=-{\underset{¯}{\epsilon }}^{T}Q\underset{¯}{\epsilon }-2{\underset{¯}{\epsilon }}^{T}PB\underset{¯}{\delta }\\ =\le -{\lambda }_{\max }(Q){‖\underset{¯}{\epsilon }‖}^2+2‖PB‖\Delta ‖\underset{¯}{\epsilon }‖=‖\underset{¯}{\epsilon }‖\left[-{\lambda }_{\max }(Q)‖\underset{¯}{\epsilon }‖+2‖PB‖\Delta \right]\end{array}$$

(31)

with ${\lambda }_{\max }(Q)$ is is the maximum value of the Q matrix.

Since $\dot{V}(\underset{¯}{\epsilon })<0$as long as

$$2‖PB‖\Delta <{\lambda }_{\max }(Q)‖\underset{¯}{\epsilon }‖\hspace{0.17em}\mathrm{or}\hspace{0.17em}\hspace{0.17em}\frac{2‖PB‖\Delta }{{\lambda }_{\max }(Q)}<‖\underset{¯}{\epsilon }‖\hspace{0.17em}$$

(32)

The orbital error vector tends to the origin

$$O=\left\{\underset{¯}{\epsilon }\in R^{2n}\left|\hspace{0.17em}‖\underset{¯}{\epsilon }‖\le \hspace{0.17em}\frac{2‖PB‖\Delta }{{\lambda }_{\max }(Q)}\right.\right\}$$

(33)

This control algorithm contains all the necessary calculations and has the following structure:

Algroithm 2: The structure of the second iterative learning controller with model-free determination of optimal learning parameters for industrial robot

1	Choose two matrices $A_1$,$A_2$, given in (25) become Hurwitz . Determine $\widehat{A},\widehat{B},\widehat{C}$given in (25) and $\Phi$given in (28). Choose $0<T_s<<1$. Calculate $S=T/T_s$. Determine $D_1^T=\raisebox{1ex}{$1$}\!\left/ \!\raisebox{-1ex}{$T_s$}\right.;D_0^T=-D_1^T$ given in (23) Choose learning $\widehat{\eta }$ and tracking error $e_0$. Assign $\underset{¯}{\mathrm{v}}\left(\mathrm{i}\right)=\underset{¯}{\mathrm{r}}\left(\mathrm{i}\right),\mathrm{w}ith\mathrm{i}=0,1,\mathrm{...},\mathrm{S}-1 \mathrm{and} \mathrm{z}\_=0\_$. Choose learning parameter K so that Φ of (16) becomes Schur.
2	while continue the control do
3	for$i=0,1,\mathrm{...},S-1$do
4	Send $\underset{\_}{u}=A_1\underset{\_}{q}-A_2\dot{\underset{\_}{q}}-\stackrel{⌢}{\underset{\_}{\eta }}$ to robot for a whilr of $T_s$.       measure $\hspace{0.17em}\hspace{0.17em}\underset{¯}{x}=vec(\underset{¯}{e},\underset{¯}{\dot{e}})$,$\hspace{0.17em}\hspace{0.17em}\underset{¯}{y}(i)=\hspace{0.17em}\underset{¯}{q}$ .
5	calculate ${\underset{¯}{\stackrel{⌢}{\eta }}}_k\leftarrow B^T\left[\frac{\underset{¯}{x}-\underset{¯}{z}}{T_s}-A\underset{¯}{x}\right]-(\underset{¯}{v}(i)-\underset{¯}{\stackrel{⌢}{\eta }}).Set\underset{¯}{z}\leftarrow \underset{¯}{x}$.
6	end for
7	establish $\hspace{0.17em}\hspace{0.17em}\underset{¯}{v}=vec(\underset{¯}{v}(0),\mathrm{.....},\underset{¯}{v}(N-1)),\underset{¯}{e}=vec(\underset{¯}{e}(0),\mathrm{.....},\underset{¯}{e}(N-1))$.
8	calculate $\hspace{0.17em}K=\underset{a\le K\le b}{\arg \min }‖\left(I-\Phi K\right)e‖$ and $\underset{¯}{v}\leftarrow \underset{¯}{v}+K\underset{¯}{e};{\underset{¯}{e}}_0\leftarrow e;$
9	end while

Thus, each while - do loop represents one working cycle (one attempt) in this algorithm. In addition, it can be seen that the above control algorithm does not use model (1) of the robot at all, so it is also an intelligent algorithm.

5.5. Applied to robot control

The robot is repetitive with $T=0.02s$ and disturbed by:

$$\underset{\_}{d}\left(t\right)=\left(\begin{array}{c}{\theta }_{11}\sin {\theta }_{12}t\\ {\theta }_{13}\sin {\theta }_{14}t\end{array}\right)$$

(34)

The parameters ${\theta }_i,i=1÷14$ are random. The robot is assumed to have an period cycle: $T=10s$; The control signal update time is selected: ${\mathrm{T}}_{\mathrm{s}}=0.02\mathrm{s}$. A robot with 2 degrees of freedom has the following parameters (Fig 1):$l_1=0.4,l_2=0.6,g=9.81$Assigned:

$$r_1(t)=\left\{\begin{array}{c}\min \left\{T_{s}t/2,1.5\right\}khit\le \raisebox{1ex}{$T$}\!\left/ \!\raisebox{-1ex}{$2$}\right.\\ r_2(T-t)khi\raisebox{1ex}{$T$}\!\left/ \!\raisebox{-1ex}{$2$}\right.<t\le T\end{array}\right.;r_2(t)=\sin (\raisebox{1ex}{$2\pi t$}\!\left/ \!\raisebox{-1ex}{$T$}\right.)$$

$$A_1=\left[\begin{array}{cc}31& 0\\ 0& 12\end{array}\right],A_2=\left[\begin{array}{cc}12& 0\\ 0& 8\end{array}\right],K=\left[\begin{array}{cc}0.8& 0\\ 0& 0.3\end{array}\right],T_s=0.02$$

Simulation results to verify the above algorithm are shown in Figure 8 and Figure 9.

These visual tracking results demonstrate the convergence of both joint variables to the required references. Over the course of the working day, the highest tracking error value is around 250 $\max \left|{\underset{¯}{e}}_{250}(1)\right|\approx 0.03$for the first joint variable and $\max \left|{\underset{¯}{e}}_{250}(2)\right|\approx 0.02$ for the second joint variable, respectively. Furthermore, they confirmed that the tracking error will decrease with the number of trials conducted. Therefore, these simulation findings fully validate all of the above-mentioned theoretical claims.

6. The structure of the second iterative learning controller with model-free determination of online learning parameters for industrial robot

The structure of two control loop circuits is still used, as shown in Figure 3.

6.1. Control the inner loop

Next is the inner loop. This loop uses Taylor series analysis to estimate $\underset{¯}{\stackrel{⌢}{\eta }}$ at time $\tau =kT+i{T}_s$, the previously measured value of ${\underset{\_}{q}}_k(j),{\dot{\underset{\_}{q}}}_k(j),$with $j=i;i-1.$This estimation formula is given in (35).

The remarkable thing is that while the iterative learning controller works in a cyclic cycle T, the inner loop controller is not cyclic. In other words, the internal loop controller also estimates the non-periodic functional uncertainty component. It can be seen that neither control loop uses the mathematical model (1) of the robot at all, and that is their intelligent feature.

6.2. Outer loop control is by iterative learning controller design.

This is a loop circuit that uses cybernetics P-style iteration with diagonal learning function parameter matrix

$$\hspace{0.17em}{K}_k=diag\left(K_k^{(j)}\right),j=1,2,\mathrm{...},n$$

(35)

The number of elements equals the number of joint variables $\hspace{0.17em}\underset{\_}{q}\in R^n$ (output) and the input variable $\hspace{0.17em}\underset{\_}{u}$ because robot (1) is a sufficient actuator. Each $K_k^{(j)}$ elementis determined according to:

$$\hspace{0.17em}K={\underset{\_}{a}}_k\underset{0\le z\le 1}{.\arg \min }‖z{\underset{\_}{e}}_k\left(1-z\right)\underset{\_}{e}{}_{k-1} ‖\mathrm{or}\hspace{0.17em}K={\underset{\_}{a}}_k\underset{0\le z\le 1}{.\arg \min }‖{\underset{\_}{e}}_k\left(1-z\right)+z\underset{\_}{e}{}_{k-1} ‖$$

This loop generates the control signal.

$$\underset{\_}{u}=-A_1\underset{\_}{q}-A_2\dot{\underset{\_}{q}}-\widehat{\underset{\_}{\eta }}$$

(36)

where choose two matrices $A_1$,$A_2$in (6), which become Hurwitz and a sufficiently small constant $0<T_s<<1$, $\underset{\_}{v}\in R^n$is obtained from the iterative learning controller $\underset{\_}{v}(t)={\underset{\_}{v}}_k(\tau )$ piecewise constant form, i.e.

${\underset{\_}{v}}_k(\tau )={\underset{\_}{v}}_k(i)$when $iT<\tau <<\left(i+1\right)T_s$with $\tau <<i{T}_s,i=0,1,\mathrm{...},N-1$and ${\underset{\_}{v}}_{k+1}(\tau )={\underset{\_}{v}}_k+K_k{e}_k$with $\hspace{0.17em}\hspace{0.17em}\underset{¯}{v}=\underset{¯}{e}=vec(\underset{¯}{e}(0),\mathrm{.....},\underset{¯}{e}(N-1)) \mathrm{and} \mathrm{vec}ec(\underset{¯}{v}(0),\mathrm{.....},\underset{¯}{v}(N-1))$The remaining component m in (3.39) is the estimated value of m given in (3.18), including input uncertainty $\underset{\_}{d}$and model bias, i.e

$$\underset{\_}{\eta }=\underset{\_}{d}+\left[I_n-M(\underset{\_}{q},\underset{\_}{\theta })\right]\ddot{\underset{\_}{q}}-C(\underset{\_}{q},\dot{\underset{\_}{q}},\underset{\_}{\theta })\dot{\underset{\_}{q}}-G(\underset{\_}{q},\underset{\_}{\theta })-F(\underset{\_}{\theta })\dot{\underset{\_}{q}}$$

(37)

at time $\tau =kT+i{T}_s$. The inner loop controller determines it.

To facilitate installation, the following algorithm summarizes the calculations for implementing the controller (16) proposed above.

Algroithm 3: the structure of the second iterative learning controller with model-free determination of online learning parameters for industrial robot

1	Choose two matrices $A_1$,$A_2$, in (6), which become Hurwitz and a sufficiently small constant $0<T_s<<1$. Calculate $N=T/T_s$. Determine $D_1^T=\raisebox{1ex}{$1$}\!\left/ \!\raisebox{-1ex}{$T_s$}\right.;D_0^T=-D_1^T;$ Choose learning $\widehat{\eta }$ and tracking error $e_0$. Assign the robot's initial state and initial output to the outer loop controller (iterative learning controller) $\underset{¯}{\mathrm{v}}\left(\mathrm{i}\right)=\underset{¯}{\mathrm{r}}\left(\mathrm{i}\right),\mathrm{i}=0,1,\mathrm{...},\mathrm{S}-1 \mathrm{and} \mathrm{z}\_=0\_$
2	while keeping the controls in place
3	for $i=0,1,\mathrm{...},S-1$do
4	send $\underset{\_}{u}=A_1\underset{\_}{q}-A_2\dot{\underset{\_}{q}}-\widehat{\underset{\_}{\eta }}$ to robot for a while of $T_s$.      measure $\hspace{0.17em}\hspace{0.17em}\underset{¯}{y}(i)=\hspace{0.17em}\underset{¯}{q}$ and $\hspace{0.17em}\hspace{0.17em}\underset{¯}{x}=vec(\underset{¯}{e},\underset{¯}{\dot{e}})$.      determine ${\underset{¯}{e}}_k\left(i\right)=\underset{¯}{r}\left(i\right)-\underset{¯}{y}\left(i\right)$.
5	Calculate ${\underset{¯}{\stackrel{⌢}{\eta }}}_k\leftarrow (\Theta ,I)\left[\underset{¯}{z}{D}_0^T+\underset{¯}{x}{D}_1^T-A\underset{¯}{x}\right]-(\underset{¯}{v}(i)-\underset{¯}{\stackrel{⌢}{\eta }}).Set\underset{¯}{z}\leftarrow \underset{¯}{x}$.
6	end for
7	establish $\hspace{0.17em}\hspace{0.17em}\underset{¯}{v}=vec(\underset{¯}{v}(0),\mathrm{.....},\underset{¯}{v}(S-1)) \mathrm{and} \underset{¯}{e}=vec(\underset{¯}{e}(0),\mathrm{.....},\underset{¯}{e}(S-1))$.
8	Calculate $\hspace{0.17em}K={\underset{\_}{a}}_k\underset{0\le z\le 1}{.\arg \min }‖z{\underset{\_}{e}}_k\left(1-z\right)\underset{\_}{e}{}_{k-1} ‖$ or $\hspace{0.17em}K={\underset{\_}{a}}_k\underset{0\le z\le 1}{.\arg \min }‖{\underset{\_}{e}}_k\left(1-z\right)+z\underset{\_}{e}{}_{k-1} ‖$      and $\underset{¯}{v}\leftarrow \underset{¯}{v}+K\underset{¯}{e};{\underset{¯}{e}}_0\leftarrow e;$
9	end while

6.3. Applied to robot control

Evaluate and verify the quality of the control algorithm for a two-DOF planar robot with the following data:

Friction components:

$$F(\underset{\_}{q},\underset{\_}{\dot{q}},\underset{\_}{\theta })\underset{\_}{\dot{q}}=\left(\begin{array}{c}{\theta }_{11}{f}_1\\ {\theta }_{21}{f}_2\end{array}\right);f_1={\theta }_{11}{\dot{q}}_1+{\theta }_{12}{q}_{1}t \mathrm{and} {\dot{q}}_1;f_2={\theta }_{21}{\dot{q}}_2+{\theta }_{22}{q}_{2}tanh{\dot{q}}_2$$

With input noise assumed as follows:

$$\underset{\_}{d}(t)=\left(\begin{array}{c}{\theta }_{31}\sin (2.3\pi t)\\ {\theta }_{32}\sin (0.85\pi t)\end{array}\right)$$

(38)

Instead of using the controller design, the parameters (20) and disturbances (21) will be employed to simulate the robot dynamics as in model (1). The parameter ${\theta }_i,i=1÷14$ is chosen randomly.

A robot with 2 degrees of freedom has the following parameters:

$${\mathrm{l}}_1=0.4;l_2=0.6;g=9.81$$

The robot is assumed to have a duty cycle $T=10s$. The time to update the control signal (and also to measure the output) is chosen as $T=0.02s$. The signal given to the two channels is two periodic functions of period T as follows:

$$r_1(t)=r_2(T-t)khi\raisebox{1ex}{$T$}\!\left/ \!\raisebox{-1ex}{$2$}\right.;r_2(t)=\sin (\raisebox{1ex}{$2\pi t$}\!\left/ \!\raisebox{-1ex}{$T$}\right.)$$

$$A_1=\left[\begin{array}{cc}31& 0\\ 0& 12\end{array}\right],A_2=\left[\begin{array}{cc}12& 0\\ 0& 8\end{array}\right]$$

We obtain the simulation results in Figures 10, 11,12, 13, 14,15,16 and Fig 17.

Comment:Figure 10 and Figure 11 are the results of two output channels, respectively, after 20 and 300 trials when the controller learns iteratively using the formula.

$$\hspace{0.17em}K={\underset{\_}{a}}_k\underset{0\le z\le 1}{.\arg \min }‖z{\underset{\_}{e}}_k\left(1-z\right)\underset{\_}{e}{}_{k-1} ‖$$

(39)

$$\hspace{0.17em}K={\underset{\_}{a}}_k\underset{0\le z\le 1}{.\arg \min }‖{\underset{\_}{e}}_k\left(1-z\right)+z\underset{\_}{e}{}_{k-1} ‖$$

(40)

Figure 13. Meets the position of the second joint when used (40).

Figure 13. Meets the position of the second joint when used (40).

For "Smart" determination, the learning function parameter is $\hspace{0.17em}{K}_k=diag\left(K_k^{(j)}\right),j=1,2,\mathrm{...},n$ the input/output signal pair index $\hspace{0.17em}{u}_j\mapsto q_j$. This result shows that the controller has provided the required tracking quality, and after 300 trials, the output signal has tracked the password set in both channels.

When using formula (40) to determine the intelligent learning parameter in the iterative learning controller instead of (39), the quality of tracking the set signal is unchanged. The difference now is only the appropriate change. The results of the two learning parameters $\hspace{0.17em}{K}_k^1,K_k^2$are shown in Figure 14, Figure 15, Figure 16, and Figure 17.

7. Conclusions

Propose a two-loop control structure for the robot, in which the inner loop is an uncertain function component estimator to compensate for the robot's input, and the outer circle is an iterative learning controller (Figure 2). The Taylor series analysis method was used to create an inner loop controller. This method does not necessitate the creation of a mathematical model of the robot. For estimating, it simply takes measured signal values from previous systems. Develop two options for installing an iterative learning controller in the outer loop. The difference between these two options lies in the online determination of learning function parameters. The two proposed control circuits have been installed into the control algorithm and simulated with the planar robot to evaluate the quality. The correctness of the above-mentioned solutions has been demonstrated by theory and validated by simulation - Create a control algorithm based on the concepts above for controlling two items that work in batch processes in industry robots. These control algorithms are all distinguished because they do not (or only very infrequently) employ the mathematical model of the control object. The quality of these control algorithms has also been verified through a 2-DOF robot simulation. However, there are still disadvantages when building methods to determine convergence parameter sets for nonlinear learning functions with known structures. The problem of constrained control by iterative learning still needs to be solved. These will be the following research directions.