scientific article; zbMATH DE number 3361677
From MaRDI portal
Publication:5635252
zbMath0227.90031MaRDI QIDQ5635252
Publication date: 1971
Title: zbMATH Open Web Interface contents unavailable due to conflicting licenses.
Dynamic programming (90C39) Markov and semi-Markov decision processes (90C40) Introductory exposition (textbooks, tutorial papers, etc.) pertaining to operations research and mathematical programming (90-01) Applications of Markov renewal processes (reliability, queueing networks, etc.) (60K20)
Related Items (only showing first 100 items - show all)
Investigating some attributes of periodicity in DNA sequences via semi-Markov modelling ⋮ Discrete Time Reward Models for Homogeneous Semi-Markov Systems ⋮ Economic Rewards in Non-homogeneous Semi-Markov Systems ⋮ Numerical Treatment of Homogeneous and Non-homogeneous Semi-Markov Reliability Models ⋮ Conditional failure occurrence rates for semi-Markov chains ⋮ Does competition for food imply skewness? ⋮ Natural spanning trees of \({\mathbb{Z}}^ d\) are recurrent ⋮ Simple random walks on trees ⋮ Asymptotic behavior of nonhomogeneous semi-Markov systems ⋮ Discrete-Time Semi-Markov Model for Reliability and Survival Analysis ⋮ Determining overflow level in a producer-consumer communication model ⋮ The Augmented Semi-Markov System in Continuous Time ⋮ Exponential and gamma form for tail expansions of first-passage distributions in semi-markov processes ⋮ Filtering hidden semi-Markov chains ⋮ A survey of algorithmic methods for partially observed Markov decision processes ⋮ Markov modulated Bernoulli process ⋮ Optimal Stopping of Seasonal Observations and Projection of a Markov Chain ⋮ Evolution of Open Quantum Systems: Time Scales, Stochastic and Continuous Processes ⋮ An algebra-based method to associate rewards with EMPA terms ⋮ Signal-flow-based analysis of wireless security protocols ⋮ Adaptive control in the presence of markovian parameter jumps ⋮ Abstraction and approximate decision-theoretic planning. ⋮ Asymptotic behaviour of the survival probabilities in an inhomogeneous semi-Markov model for the migration process in credit risk ⋮ Reconciling real and stochastic time: the need for probabilistic refinement ⋮ The occurrence of sequence patterns in repeated experiments and hitting times in a Markov chain ⋮ Controlling the GI/M/1 queue by conditional acceptance of customers ⋮ Time aggregated Markov decision processes via standard dynamic programming ⋮ Sooner and later waiting time problems for Bernoulli trials: Frequency and run quotas ⋮ Discounted semi-Markov decision processes: linear programming and policy iteration ⋮ Earthquakes occurrences estimation through a parametric semi-Markov approach ⋮ First hitting probabilities for semi-Markov chains and estimation ⋮ Optimal dynamic routing in flexible manufacturing systems with limited buffers ⋮ Probability and Flow Graphs ⋮ Random walks on the hexagon ⋮ A multi-cluster time aggregation approach for Markov chains ⋮ Fuzzy semi-Markov migration process in credit risk ⋮ Semi-Markov migration process in a stochastic market in credit risk ⋮ The first-passage times of phase semi-Markov processes ⋮ Simultaneous determination of production and maintenance schedules using in‐line equipment condition and yield information ⋮ Optimal control of variable rate coding with incomplete observation in integrated voice/data packet networks ⋮ On the tradeoff between compositionality and exactness in weak bisimilarity for integrated-time Markovian process calculi ⋮ Optimal maintenance and replacement via a semi-Markov decision model ⋮ A single server priority queue with server failures and queue flushing ⋮ Prediction of small, noncoding RNAs in bacteria using heterogeneous data ⋮ A continuous time version and a generalization of a Markov-recapture model for trapping experiments ⋮ A NON-HOMOGENEOUS SEMI-MARKOV REWARD MODEL FOR THE CREDIT SPREAD COMPUTATION ⋮ Empirical estimation for discrete-time semi-Markov processes with applications in reliability ⋮ Markov decision processes ⋮ A stochastic model for the HIV/AIDS dynamic evolution ⋮ Separable routing: A scheme for state-dependent routing of circuit switched telephone traffic ⋮ Specification techniques for Markov reward models ⋮ Optimal control of semi-Markov processes with a backward stochastic differential equations approach ⋮ A Markovian model of consumer buying behavior and optimal advertising pulsing policy ⋮ Deliberation scheduling using GSMDPs in stochastic asynchronous domains ⋮ Markov Systems in a General State Space ⋮ Hidden Semi-Markov Modeling for the Estimation of Earthquake Occurrence Rates ⋮ Flexibility in manufacturing systems: a relational and a dynamic approach. ⋮ A customer's utility measure based on the reliability of multi-state systems ⋮ Analysis of operating policies for manufacturing cells ⋮ Decentralized optimization for distributed-lag models of discrete systems ⋮ Continuous time control of Markov processes on an arbitrary state space: average return criterion ⋮ A semi-markovian availability model for a system subject to block testing ⋮ Continued fractions and the origins of the Perron-Frobenius theorem ⋮ Time operator of Markov chains and mixing times. Applications to financial data ⋮ Semi-Markov decision models for real-time scheduling ⋮ Completitud esencial de la clase de controles basados en un proceso suficiente ⋮ Modelling large timescale and small timescale service variability ⋮ Mixing logics and rewards for the component-oriented specification of performance measures ⋮ Hardware simulation of semi-Markov and related processes. I: A versatile generator ⋮ Exact MLE and asymptotic properties for nonparametric semi-Markov models ⋮ Statistical probabilistic model checking with a focus on time-bounded properties ⋮ Irrfahrten auf \(F_2\) ⋮ Multi-scenario modelling of uncertainty in stochastic chemical systems ⋮ Probabilistic analysis of a two-unit standby redundant system with repair efficiency and imperfect switch-over ⋮ Empirical Dynamic Programming ⋮ A semi-markovian game of economic survival ⋮ Stochastic behaviour of a two-unit standby system with contact failure and intermittently available repair facility ⋮ On Discrete Time Semi-Markov Chains and Applications in Words Occurrences ⋮ Risk Analysis of Changing and Evolving Systems Using CORAS ⋮ A formal approach to the integration of performance aspects in the modeling and analysis of concurrent systems ⋮ Multiple perspective dynamic decision making ⋮ Linear programming in tector criterion markov and semi-Markov decision processes ⋮ Nonparametric estimation of interval reliability for discrete-time semi-Markov systems ⋮ Semi-Markov reliability models with recurrence times and credit rating applications ⋮ Regression analysis of stochastic fatigue crack growth model in a martingale difference framework ⋮ Predicting duration of stay in a pediatric intensive care unit: A Markovian approach ⋮ Extending Timed Process Algebra with Discrete Stochastic Time ⋮ Unnamed Item ⋮ Estimation of the intensity of the hitting time for semi-Markov chains and hidden Markov renewal chains ⋮ Performance measure sensitive congruences for Markovian process algebras ⋮ Discrete time generative-reactive probabilistic processes with different advancing speeds ⋮ Some Results on Modeling Biological Sequences and Web Navigation with a Semi Markov Chain ⋮ An algorithm for the numerical inversion of a tridiagonal matrix ⋮ Nonparametric Estimation of the Stationary Distribution of a Discrete-Time Semi-Markov Process ⋮ Optimal maintenance, repair, and replacement for Great Lakes marine diesels ⋮ Production control problem with semi-Markov jump under stochastic demands and deteriorating inventories ⋮ Analysis and design of rate-based congestion control of high speed networks. I: Stochastic fluid models, access regulation ⋮ Modeling a dynamic and uncertain world. I: Symbolic and probabilistic reasoning about change ⋮ Homogeneous semi-Markov reliability models for credit risk management ⋮ Timed Petri net: An expeditious tool for modelling and analysis of manufacturing systems
This page was built for publication:
