Publication:3862198

From MaRDI portal


zbMath0426.60063MaRDI QIDQ3862198

E. B. Dykin, Alexander A. Yushkevich

Publication date: 1979



62M05: Markov processes: estimation; hidden Markov models

90C47: Minimax problems in mathematical programming

93B99: Controllability, observability, and system structure

60Jxx: Markov processes

93Exx: Stochastic systems and control


Related Items

Sufficiency of Deterministic Policies for Atomless Discounted and Uniformly Absorbing MDPs with Multiple Criteria, Note on discounted continuous-time Markov decision processes with a lower bounding function, Unnamed Item, Ergodicity Conditions for Controlled Stochastic Nonlinear Systems under Information Constraints: A Volume Growth Approach, Stability Estimation of Transient Markov Decision Processes, Von Neumann–Gale model, market frictions and capital growth, Markov Decision Processes with Incomplete Information and Semiuniform Feller Transition Probabilities, On the time discretization of stochastic optimal control problems: The dynamic programming approach, A Universal Dynamic Program and Refined Existence Results for Decentralized Stochastic Control, Average Cost Optimality Inequality for Markov Decision Processes with Borel Spaces and Universally Measurable Policies, Average Cost Markov Decision Processes with Semi-Uniform Feller Transition Probabilities, Estimation of Equilibria in an Advertising Game with Unknown Distribution of the Response to Advertising Efforts, On an Approach to Evaluation of Health Care Programme by Markov Decision Model, Time-varying Markov decision processes with state-action-dependent discount factors and unbounded costs, Robustness to Incorrect Priors in Partially Observed Stochastic Control, Constrained Markov Decision Processes with Expected Total Reward Criteria, Gittins Index for Simple Family of Markov Bandit Processes with Switching Cost and No Discounting, Partially observable Markov decision processes with partially observable random discount factors, Formalization of methods for the development of autonomous artificial intelligence systems, Semi-uniform Feller stochastic kernels, Equivalent conditions for weak continuity of nonlinear filters, Some advances on constrained Markov decision processes in Borel spaces with random state-dependent discount factors, Turnpikes in Finite Markov Decision Processes and Random Walk, Extreme Occupation Measures in Markov Decision Processes with an Absorbing State, Nash equilibria for total expected reward absorbing Markov games: the constrained and unconstrained cases, Absorbing Markov decision processes, Perspectives of approximate dynamic programming, Examples concerning Abel and Cesàro limits, Towards the optimal control of Markov chains with constraints, On maximizing the average time at a goal, Optimum portfolio diversification in a general continuous-time model, A semimartingale characterization of average optimal stationary policies for Markov decision processes, Markov control models with unknown random state-action-dependent discount factors, An expected average reward criterion, Nonparametric adaptive control of discrete-time partially observable stochastic systems, Finite state Markov decision models with average reward criteria, Weak conditions for average optimality in Markov control processes, A note on the Ross-Taylor theorem, Exercising control when confronted by a (Brownian) spider, Zero-sum Markov games with random state-actions-dependent discount factors: existence of optimal strategies, Vector-valued Markov decision processes and the systems of linear inequalities, Markov-achievable payoffs for finite-horizon decision models., Linear programming approach to optimal impulse control problems with functional constraints, A mean field absorbing control model for interacting objects systems, MDPs with setwise continuous transition probabilities, A mean field approach for discounted zero-sum games in a class of systems of interacting objects, On structural properties of optimal average cost functions in Markov decision processes with Borel spaces and universally measurable policies, Convex analytic method revisited: further optimality results and performance of deterministic policies in average cost stochastic control, Approximation and mean field control of systems of large populations, An evolutionary finance model with short selling and endogenous asset supply, Geometry of information structures, strategic measures and associated stochastic control topologies, Von Neumann-Gale dynamics and capital growth in financial markets with frictions, Constrained discounted Markov decision processes with Borel state spaces, Reduction of total-cost and average-cost MDPs with weakly continuous transition probabilities to discounted mdps, Strong polynomiality of policy iterations for average-cost MDPs modeling replacement and maintenance problems, Sample-path optimality and variance-maximization for Markov decision processes, On the existence of stationary optimal policies for partially observed MDPs under the long-run average cost criterion, On the evaluation of bidding strategies in sequential auctions, Asymptotic optimality and rates of convergence of quantized stationary policies in continuous-time Markov decision processes, Strong Uniform Value in Gambling Houses and Partially Observable Markov Decision Processes, Convex Analysis in Decentralized Stochastic Control, Strategic Measures, and Optimal Solutions, On the reduction of total‐cost and average‐cost MDPs to discounted MDPs, Unnamed Item