Reinforcement Learning For Optimal Feedback Control: A Lyapunov Based Approach

Reinforcement Learning for Optimal Feedback Control develops model-based and data-driven reinforcement learning methods for solving optimal control problems in nonlinear deterministic dynamical systems. In order to achieve learning under uncertainty, data-driven methods for identifying system models in real-time are also developed. The book illustrates the advantages gained from the use of a model and the use of previous experience in the form of recorded data through simulations and experiments. The book’s focus on deterministic systems allows for an in-depth Lyapunov-based analysis of the performance of the methods described during the learning phase and during execution.

Reinforcement Learning for Optimal Feedback Control develops model-based and data-driven reinforcement learning methods for solving optimal control problems in nonlinear deterministic dynamical systems. In order to achieve learning under uncertainty, data-driven methods for identifying system models in real-time are also developed. The book illustrates the advantages gained from the use of a model and the use of previous experience in the form of recorded data through simulations and experiments. The book’s focus on deterministic systems allows for an in-depth Lyapunov-based analysis of the performance of the methods described during the learning phase and during execution.

This book presents powerful modern control techniques based on the parallelism and adaptive capabilities of biological nervous systems. The book builds systematically from actuator nonlinearities and strict feedback in nonlinear systems to nonstrict feedback, system identification, model reference adaptive control, and novel optimal control using the Hamilton-Jacobi-Bellman formulation. The author concludes by developing a framework for implementing intelligent control in actual industrial systems using embedded hardware.