scientific article; zbMATH DE number 3361677
From MaRDI portal
zbMath0227.90031MaRDI QIDQ5635252
Publication date: 1971
Title: zbMATH Open Web Interface contents unavailable due to conflicting licenses.
Dynamic programming (90C39) Markov and semi-Markov decision processes (90C40) Introductory exposition (textbooks, tutorial papers, etc.) pertaining to operations research and mathematical programming (90-01) Applications of Markov renewal processes (reliability, queueing networks, etc.) (60K20)
Related Items
Investigating some attributes of periodicity in DNA sequences via semi-Markov modelling, Discrete Time Reward Models for Homogeneous Semi-Markov Systems, Economic Rewards in Non-homogeneous Semi-Markov Systems, Numerical Treatment of Homogeneous and Non-homogeneous Semi-Markov Reliability Models, Conditional failure occurrence rates for semi-Markov chains, Does competition for food imply skewness?, Natural spanning trees of \({\mathbb{Z}}^ d\) are recurrent, Simple random walks on trees, Asymptotic behavior of nonhomogeneous semi-Markov systems, Discrete-Time Semi-Markov Model for Reliability and Survival Analysis, Determining overflow level in a producer-consumer communication model, The Augmented Semi-Markov System in Continuous Time, Exponential and gamma form for tail expansions of first-passage distributions in semi-markov processes, Filtering hidden semi-Markov chains, A survey of algorithmic methods for partially observed Markov decision processes, Markov modulated Bernoulli process, Optimal Stopping of Seasonal Observations and Projection of a Markov Chain, Evolution of Open Quantum Systems: Time Scales, Stochastic and Continuous Processes, An algebra-based method to associate rewards with EMPA terms, Signal-flow-based analysis of wireless security protocols, Adaptive control in the presence of markovian parameter jumps, Abstraction and approximate decision-theoretic planning., Asymptotic behaviour of the survival probabilities in an inhomogeneous semi-Markov model for the migration process in credit risk, Reconciling real and stochastic time: the need for probabilistic refinement, The occurrence of sequence patterns in repeated experiments and hitting times in a Markov chain, Controlling the GI/M/1 queue by conditional acceptance of customers, Time aggregated Markov decision processes via standard dynamic programming, Sooner and later waiting time problems for Bernoulli trials: Frequency and run quotas, Discounted semi-Markov decision processes: linear programming and policy iteration, Earthquakes occurrences estimation through a parametric semi-Markov approach, First hitting probabilities for semi-Markov chains and estimation, Optimal dynamic routing in flexible manufacturing systems with limited buffers, Probability and Flow Graphs, Random walks on the hexagon, A multi-cluster time aggregation approach for Markov chains, Fuzzy semi-Markov migration process in credit risk, Semi-Markov migration process in a stochastic market in credit risk, The first-passage times of phase semi-Markov processes, Simultaneous determination of production and maintenance schedules using in‐line equipment condition and yield information, Optimal control of variable rate coding with incomplete observation in integrated voice/data packet networks, On the tradeoff between compositionality and exactness in weak bisimilarity for integrated-time Markovian process calculi, Optimal maintenance and replacement via a semi-Markov decision model, A single server priority queue with server failures and queue flushing, Prediction of small, noncoding RNAs in bacteria using heterogeneous data, A continuous time version and a generalization of a Markov-recapture model for trapping experiments, A NON-HOMOGENEOUS SEMI-MARKOV REWARD MODEL FOR THE CREDIT SPREAD COMPUTATION, Empirical estimation for discrete-time semi-Markov processes with applications in reliability, Markov decision processes, A stochastic model for the HIV/AIDS dynamic evolution, Separable routing: A scheme for state-dependent routing of circuit switched telephone traffic, Specification techniques for Markov reward models, Optimal control of semi-Markov processes with a backward stochastic differential equations approach, A Markovian model of consumer buying behavior and optimal advertising pulsing policy, Deliberation scheduling using GSMDPs in stochastic asynchronous domains, Markov Systems in a General State Space, Hidden Semi-Markov Modeling for the Estimation of Earthquake Occurrence Rates, Flexibility in manufacturing systems: a relational and a dynamic approach., A customer's utility measure based on the reliability of multi-state systems, Analysis of operating policies for manufacturing cells, Decentralized optimization for distributed-lag models of discrete systems, Continuous time control of Markov processes on an arbitrary state space: average return criterion, A semi-markovian availability model for a system subject to block testing, Continued fractions and the origins of the Perron-Frobenius theorem, Time operator of Markov chains and mixing times. Applications to financial data, Semi-Markov decision models for real-time scheduling, Completitud esencial de la clase de controles basados en un proceso suficiente, Modelling large timescale and small timescale service variability, Mixing logics and rewards for the component-oriented specification of performance measures, Hardware simulation of semi-Markov and related processes. I: A versatile generator, Exact MLE and asymptotic properties for nonparametric semi-Markov models, Statistical probabilistic model checking with a focus on time-bounded properties, Irrfahrten auf \(F_2\), Multi-scenario modelling of uncertainty in stochastic chemical systems, Probabilistic analysis of a two-unit standby redundant system with repair efficiency and imperfect switch-over, Empirical Dynamic Programming, A semi-markovian game of economic survival, Stochastic behaviour of a two-unit standby system with contact failure and intermittently available repair facility, On Discrete Time Semi-Markov Chains and Applications in Words Occurrences, Risk Analysis of Changing and Evolving Systems Using CORAS, A formal approach to the integration of performance aspects in the modeling and analysis of concurrent systems, Multiple perspective dynamic decision making, Linear programming in tector criterion markov and semi-Markov decision processes, Nonparametric estimation of interval reliability for discrete-time semi-Markov systems, Semi-Markov reliability models with recurrence times and credit rating applications, Regression analysis of stochastic fatigue crack growth model in a martingale difference framework, Predicting duration of stay in a pediatric intensive care unit: A Markovian approach, Extending Timed Process Algebra with Discrete Stochastic Time, Unnamed Item, Estimation of the intensity of the hitting time for semi-Markov chains and hidden Markov renewal chains, Performance measure sensitive congruences for Markovian process algebras, Discrete time generative-reactive probabilistic processes with different advancing speeds, Some Results on Modeling Biological Sequences and Web Navigation with a Semi Markov Chain, An algorithm for the numerical inversion of a tridiagonal matrix, Nonparametric Estimation of the Stationary Distribution of a Discrete-Time Semi-Markov Process, Optimal maintenance, repair, and replacement for Great Lakes marine diesels, Production control problem with semi-Markov jump under stochastic demands and deteriorating inventories, Analysis and design of rate-based congestion control of high speed networks. I: Stochastic fluid models, access regulation, Modeling a dynamic and uncertain world. I: Symbolic and probabilistic reasoning about change, Homogeneous semi-Markov reliability models for credit risk management, Timed Petri net: An expeditious tool for modelling and analysis of manufacturing systems
