Dynamic Event-triggered Approximate Optimal Control Strategy for Nonlinear Systems

다국어 초록 (Multilingual Abstract)

This work proposes a novel dynamic event-triggered approximate optimal control strategy for nonlinear continuous-time systems. By employing the dynamic event-triggered control scheme, the purposes of maintaining system stability, approximatly minimizing the cost function, and saving communication as well as computation resources can be achieved simultaneously. Firstly, to obtain the solution of the optimal control problem, we propose the Hamiltonian-Jacobian-Bellman (HJB) equation. A critic network is involved to approximate the optimal discounted cost function. A weight matrix update scheme using gradient descent method is designed to realize the weight calculation of the neural network. Secondly, a dynamic event-triggered condition has been presented to derive a near optimal event-triggered controller, which is more efficient in resource utilization than that of existing results. By using the Lyapunov method, it is proven that the states in the closed-loop system are uniformly ultimately bounded. Finally, numerical results and some comparison with the static ETM and time-triggered systems have been provided to illustrate the effectiveness of the proposed dynamic event-triggered mechanisms (ETM).

참고문헌 (Reference)

1 Y. Fan, "Virtual neighbor based connectivity preserving of multi-agent systems with bounded control inputs in the presence of unreliable communication links" 49 (49): 1261-1267, 2013

2 B. Igelnik, "Stochastic choice of basis functions in adaptive function approximation and the functional-link net" 6 (6): 1320-1329, 1995

3 A. Heydari, "Stability analysis of optimal adaptive control under value iteration using a stabilizing initial policy" 29 (29): 4522-4527, 2018

4 X. Wang, "Self-triggered feedback control systems with finite-gain stability" 54 (54): 452-467, 2009

5 Y. Fan, "Sampling-based eventtriggered consensus for multi-agent systems" 191 : 141-147, 2016

6 X. Liu, "Quasisynchronization of heterogeneous networks with a generalized markovian topology and event-triggered communication" 50 (50): 4200-4213, 2020

7 K. Vamvoudakis, "Online actor critic algorithm to solve the continuous-time infinite horizon optimal control problem" 3180-3187, 2009

8 Y. Shen, "Observer design for single-link robot arm systems based on sampled and delayed output" 45-48, 2016

9 X. Yang, "Neural-network-based online optimal control for uncertain non-linear continuoustime systems with control constraints" 7 (7): 2037-2047, 2013

10 K. Rajagopal, "Neural network-based solutions for stochastic optimal control using path integrals" 28 (28): 534-545, 2017

11 Yong-Feng Gao ; Liu Liu, "Lyapunov-based Triggering Mechanisms for Event-triggered Control" 제어·로봇·시스템학회 18 (18): 1392-1398, 2020

12 P. Tabuada, "Event-triggered real-time scheduling of stabilizing control tasks" 52 (52): 1680-1685, 2007

13 X. Yang, "Event-triggered optimal neuro-controller design with reinforcement learning for uknown nonlinear systems" 49 (49): 1866-1878, 2019

14 K. Vamvoudakis, "Event-triggered optimal adaptive control algorithm for continuous-time nonlinear systems" 1 (1): 282-293, 2014

15 D. Xie, "Event-triggered consensus control for second-order multi-agent systems" 9 (9): 667-680, 2015

16 X. Chen, "Event-triggered average consensus control for discrete-time multi-agent systems" 6 (6): 2493-2498, 2012

17 L. Dong, "Event-triggered adaptive dynamic programming for continuous-time systems with control constraints" 28 (28): 1941-1952, 2017

18 Yuan Fan ; Jun Chen ; Cheng Song ; Yong Wang, "Event-triggered Coordination Control for Multi-agent Systems with Connectivity Preservation" 제어·로봇·시스템학회 18 (18): 966-979, 2020

19 A. Girard, "Dynamic triggering mechanisms for eventtriggered control" 60 (60): 1992-1997, 2015

20 V. Dolk, "Dynamic eventtriggered control: Tradeoffs between transmission intervals and performance" 2764-2769, 2014

21 X. Ge, "Dynamic event-triggered distributed coordination control and its applications: A survey of trends and techniques" 50 (50): 3112-3125, 2020

22 X. Yi, "Dynamic event-triggered and self-triggered control for multiagent systems" 64 (64): 3300-3307, 2019

23 R. Bellman, "Dynamic Programming" 2013

24 Y. Fan, "Distributed reactive power sharing control for microgrids with event-triggered communication" 25 (25): 118-128, 2017

25 M. Velasco, "Control-driven tasks:Modeling and analysis" 280-290, 2008

26 L. Ding, "An overview of recent advances in event-triggered consensus of multiagent systems" 48 (48): 1110-1123, 2018

27 W. Heemels, "An introduction to event-triggered and self-triggered control" 3270-3285, 2012

28 M. Manuel, "An ISS self-triggered implementation of linear controllers" 46 (46): 1310-1314, 2010