Dynamic programming and stochastic control (Q800282)

From MaRDI portal
scientific article
Language Label Description Also known as
English
Dynamic programming and stochastic control
scientific article

    Statements

    Dynamic programming and stochastic control (English)
    0 references
    1976
    0 references
    The basic objective of the book is to provide a unified framework for sequential decision making under uncertainty and to stress the few fundamental concepts underlying the treatment of uncertainty and the technique of dynamic programming. These concepts (risk, feedback, sufficient statistics, adaptivity, contraction mappings, and the principle of optimality) are emphasized and developed in a framework that is devoid, to the extent possible, of structural assumptions on the problem considered. This is accomplished by considering general dynamic systems defined over arbitrary state and control spaces. Thus our formulation allows the simultaneous treatment of several important classes of problems, such as stochastic control problems (popular in modern control theory) as well as problems of control of finite state Markov chains (popular in operations research and statistics).
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    sequential decision making
    0 references
    uncertainty
    0 references
    finite state Markov chains
    0 references