Introduction to Stochastic Control Theory

This book provides an introduction to the theory of linear systems and control for students in business mathematics, econometrics, computer science, and engineering. The focus is on discrete time systems, which are the most relevant in business applications, as opposed to continuous time systems, requiring less mathematical preliminaries. The subjects treated are among the central topics of deterministic linear system theory: controllability, observability, realization theory, stability and stabilization by feedback, LQ-optimal control theory. Kalman filtering and LQC-control of stochastic systems are also discussed, as are modeling, time series analysis and model specification, along with model validation.

This research monograph develops the Hamilton-Jacobi-Bellman (HJB) theory through dynamic programming principle for a class of optimal control problems for stochastic hereditary differential systems. It is driven by a standard Brownian motion and with a bounded memory or an infinite but fading memory.