Fast reinforcement learning based distributed optimal flocking control and network co-design for uncertain networked multi-UAV system

Hao Xu; L. R. G. Carrillo

doi:10.1117/12.2262877

5 May 2017 Fast reinforcement learning based distributed optimal flocking control and network co-design for uncertain networked multi-UAV system

Hao Xu, L. R. G. Carrillo

Author Affiliations +

Proceedings Volume 10195, Unmanned Systems Technology XIX; 1019511 (2017) https://doi.org/10.1117/12.2262877
Event: SPIE Defense + Security, 2017, Anaheim, CA, United States

Abstract

Military applications require networked multi-UAV system to perform practically, optimally and reliably under changing mission requirements. Lacking the effective control and communication algorithms is impeding the development of multi-UAV systems significantly. In this paper, distributed optimal flocking control and network co-design problem has been investigated for networked multi-UAV system in presence of uncertain harsh environment and unknown dynamics. First, the mathematical interaction between network imperfections and practical wireless network channel performance has been investigate. Then, a novel co-model has been developed for networked multi-UAV combining effects from physical system and network channel model effectively. Then, adopting neuro dynamics programming (NDP) technique and actor-critic-identifier (ACI) design architecture, a novel online finite horizon optimal flocking control and network co-design has been proposed. The developed algorithm cannot merely obtain the distributed optimal co-design within finite time, but also relax the stringent requirement about physical UAV system and network dynamics. In addition, developed novel co-design can satisfy the practical constraints, e.g. transmit power constraint etc. The Lyapunov stability analysis is used to validate the effectiveness of developed scheme. With the proper NN weight update law, proposed co-design can ensure all closed-loop signals and NN weights are uniformly ultimately bounded (UUB). Furthermore, simulation results have been provided to demonstrate the effectiveness of the developed scheme.

Conference Presentation

Citation Download Citation

Hao Xu and L. R. G. Carrillo "Fast reinforcement learning based distributed optimal flocking control and network co-design for uncertain networked multi-UAV system", Proc. SPIE 10195, Unmanned Systems Technology XIX, 1019511 (5 May 2017); https://doi.org/10.1117/12.2262877

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available