Introduction to Stochastic Control Theory

Introduction to Stochastic Search and Optimization provides comprehensive, current information on methods for real-world problem solving, including stochastic gradient and non-gradient techniques, as well as relatively recent innovations such as simulated annealing, genetic algorithms, and MCMC. It is written to be read and understood by graduate students, industrial practitioners, and experienced researchers in the field. Web links to software and data sets, and an extensive list of references of the book allows the reader to explore deeper into certain topic areas. I also found the index to be very comprehensive and carefully done. The appendices are as a refresher and summary of much of the prerequisite material. The book is somewhat unique in providing a balanced discussion of algorithms, including both their strengths and weaknesses. The book is among very few books that have integrated essential parts of statistical fields with optimization and decision making. The book's inclusion of a chapter on optimal experimental design is an example of such integration. The approaches discussed in the book could be used for financial decision making, forecasting, and quality improvement, among many other areas

This book provides an introduction to the theory of linear systems and control for students in business mathematics, econometrics, computer science, and engineering. The focus is on discrete time systems, which are the most relevant in business applications, as opposed to continuous time systems, requiring less mathematical preliminaries. The subjects treated are among the central topics of deterministic linear system theory: controllability, observability, realization theory, stability and stabilization by feedback, LQ-optimal control theory. Kalman filtering and LQC-control of stochastic systems are also discussed, as are modeling, time series analysis and model specification, along with model validation.