scientific article; zbMATH DE number 1016965
The book concerns not only the ``optimal control as it is suggested by its title but also the control theory understood in the wider sense of the control of any dynamic system (e.g., communication, distribution, production, financial, economic), in general stochastic and imperfectly observed. In connection with this the dynamic system models and related problems like controllability, observability, stability and feedback are also considered. The author takes this wider view and so covers general techniques of optimization based mainly on dynamic programming and the maximum principle, but also, e.g., on Lagrange multipliers. Both, discrete-time and continuous-time systems and related problems are considered in parallel over the whole book. The contents of the book is composed of two subtitles; the first of them, ``Basics, contains the standard material concerning dynamic system models and optimization techniques; the second, ``Beyond, contains some more advanced problems related with recent results. The material of the subtitle ``Basics occupying over 60\% of the volume is composed of two parts. Part 1 entitled ``Deterministic Models is successively described in Chapters 2-7 concerning the following problems. Deterministic models and their optimization; An infinite horizon behaviour; The classic formulation of the control problem: operators, filters, feedback; State space deterministic models: controllability, observability stability; Stationary rules and direct optimization of the LQ model; The Pontryagin maximum principle. Part 2 entitled ``Stochastic Models described in Chapters 8-15 contains the following problems. Stochastic dynamic programming; Stochastic dynamics in continuous time; Some stochastic examples; Policy improvement: stochastic versions; The LQG model with imperfect information; Stationary processes -- spectral theory; Optimal allocation; Imperfect state observation. The second subtitle ``Beyond is divided into further three parts. Part 3 entitled ``Risk-sensitive and \(H_\infty\) Criteria contains Chapters 16 and 17 with the problems: Risk-sensitivity; The \(H_\infty\) formulation. Part 4 entitled ``Time-integral Methods and Optimal Stationary Policies is composed of Chapters 18-21 with the following problems. The time-integral formalism; Optimal stationary LQG policies-perfect observation; Optimal stationary LQG policies-imperfect observation; The risk sensitive version. Part 5 entitled ``Near-determinism and Large Deviation Theory contains the Chapters 22-25 with the following problems. The essentials of large deviation theory; Control optimization in the large deviation limit; Controlled first passage; Imperfect observation -- nonlinear filtering. The advantage of the book is an original material presentation basing on many examples taken from different fields, which introduce the reader to not simple problems of optimal control. From the other side, the author avoids the derivations of the formulas and the shortcuts appearing in the considerations need proficiency of the reader in using basic mathematics. The results of considerations are usually presented in the form of theorems with explanations and without proofs which are only outlined. The advantage of this approach consists on a compact presentation of the main results. However, the reader may be not convinced that he is able to prove the theorems. Reading this book need some appropriate preparation.
- Performance optimization of a class of discrete event dynamic systems using calculus of variations techniques
- Improving project cost estimation by taking into account managerial flexibility
- Routing jobs with deadlines to heterogeneous parallel servers
- Index policies for the maintenance of a collection of machines by a set of repairmen
- Reverse-time modeling, optimal control and large deviations
- On the Whittle index of Markov modulated restless bandits
- Reference points and learning
- Multi-machine preventive maintenance scheduling with imperfect interventions: a restless bandit approach
- Exit time risk-sensitive control for systems of cooperative agents
- Control theory in physics and other fields of science. Concepts, tools, and applications
- Last in line
- Dynamic routing in distinguishable parallel queues: an application of product returns for remanufacturing
- A clipped-optimal control algorithm for semi-active vehicle suspensions: theory and experimental evaluation
- Zero-sum risk-sensitive stochastic games on a countable state space
- Dynamic routing to heterogeneous collections of unreliable servers
- scientific article; zbMATH DE number 1601817 (Why is no real title available?)
- Adaptive optimal control without weight transport
- Index policies for the routing of background jobs
- Are spectral estimators useful for long-run restrictions in SVARs?
- DYNAMIC ROUTING OF CUSTOMERS WITH GENERAL DELAY COSTS IN A MULTISERVER QUEUING SYSTEM
- scientific article; zbMATH DE number 3685307 (Why is no real title available?)
- scientific article; zbMATH DE number 1014841 (Why is no real title available?)
- Uncertainty quantification and optimal decisions
- OPTIMAL FLUCTUATIONS AND THE CONTROL OF CHAOS
- Robust control and hot spots in spatiotemporal economic systems
- Monotone policies and indexability for bidirectional restless bandits
- Derivative-free methods for policy optimization: guarantees for linear quadratic systems
- A verification theorem for threshold-indexability of real-state discounted restless bandits
- Nonzero-sum risk-sensitive stochastic games on a countable state space
- Outsourcing warranty repairs: Dynamic allocation
- Some indexable families of restless bandit problems
- Convergence of Discount Time Series Dynamic Linear Models
- Recursive formulas for design sensitivity analysis of mechanical systems
- Configuration design sensitivity analysis of dynamics for constrained mechanical systems
- On terminating Markov decision processes with a risk-averse objective function
- Bellman filtering and smoothing for state-space models
- An Introduction to Optimal Control Theory
- The fluctuational transition mechanism of non-hyperbolic chaotic invariant sets
- Probabilistic control and majorisation of optimal control
- Leveraging probabilistic optimal control for efficient trajectory optimization
- Dynamic priority allocation via restless bandit marginal productivity indices
- Robust portfolios: contributions from operations research and finance
This page was built for publication:
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4339077)
