scientific article; zbMATH DE number 729460

Publication date: 2 March 1995

Title: zbMATH Open Web Interface contents unavailable due to conflicting licenses.

Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Research exposition (monographs, survey articles) pertaining to numerical analysis (65-02) Research exposition (monographs, survey articles) pertaining to probability theory (60-02) Probabilistic methods, stochastic differential equations (65C99)

Related Items

A note on local and global convergence analysis of iterative aggregation-disaggregation methods. ⋮ A weak semantic approach to bisimulation metrics in models with nondeterminism and continuous state spaces ⋮ Abstraction-guided truncations for stationary distributions of Markov population models ⋮ Queues with Markovian arrivals, phase type services, breakdowns, and repairs ⋮ Timed process calculi with deterministic or stochastic delays: commuting between durational and durationless actions ⋮ Lumping and reversed processes in cooperating automata ⋮ A multi-server queueing model with server consultations ⋮ State space truncation with quantified errors for accurate solutions to discrete chemical master equation ⋮ An iterative aggregation and disaggregation method for the steady state solution of large scale continuous systems ⋮ Reliability prediction of repairable redundant system with imperfect switching and repair ⋮ A parallel solver for large-scale Markov chains ⋮ A note on the pagerank algorithm ⋮ Switched PIOA: parallel composition via distributed scheduling ⋮ An Arnoldi-type algorithm for computing Page Rank ⋮ A compositional model to reason about end-to-end QoS in stochastic Reo connectors ⋮ Modeling and optimization of a product-service system with additional service capacity and impatient customers ⋮ Optimal decisions for continuous time Markov decision processes over finite planning horizons ⋮ A relaxed two-step splitting iteration method for computing PageRank ⋮ Parallel computation of polynomial GCD and some related parallel computations over abstract fields ⋮ Local convergence analysis of iterative aggregation--disaggregation methods with polynomial correction ⋮ The Kronecker product and stochastic automata networks ⋮ A cost-effective smoothed multigrid with modified neighborhood-based aggregation for Markov chains ⋮ A multi-server synchronous vacation model with thresholds and a probabilistic decision rule ⋮ SOS specifications for uniformly continuous operators ⋮ A uniform framework for modeling nondeterministic, probabilistic, stochastic, or mixed processes and their behavioral equivalences ⋮ Numerical analysis of continuous time Markov decision processes over finite horizons ⋮ A solver for the stochastic master equation applied to gene regulatory networks ⋮ Security screening queues with impatient applicants: a new model with a case study ⋮ An analytical formula for variance of output from a series-parallel production system with no interstation buffers and time-dependent failures ⋮ \textsc{ULTraS} at work: compositionality metaresults for bisimulation and trace semantics ⋮ Random walks and diffusion on networks ⋮ Multiphase until formulas over Markov reward models: an algebraic approach ⋮ On the use of MTBDDs for performability analysis and verification of stochastic systems. ⋮ Model-checking large structured Markov chains. ⋮ Block-tridiagonal state-space realization of chemical master equations: a tool to compute explicit solutions ⋮ The Rayleigh-Ritz method, refinement and Arnoldi process for periodic matrix pairs ⋮ Rapid, efficient analysis of the \(\lambda(n)/C_{k}/r/N\) queue, with application to decomposition of closed queuing networks. ⋮ Exploring gate-limited analytical models for high-performance network storage servers ⋮ Boundary value methods for transient solutions of queueing networks with variant vacation policy ⋮ Convergence of multi-level iterative aggregation-disaggregation methods ⋮ Spectral clustering for non-reversible Markov chains ⋮ A multi-cluster time aggregation approach for Markov chains ⋮ Top-level acceleration of adaptive algebraic multilevel methods for steady-state solution to Markov chains ⋮ The theory of elementary landscapes ⋮ The extrapolation-accelerated multilevel aggregation method in PageRank computation ⋮ Performance analysis of a kitting process as a paired queue ⋮ A QBD approach to evolutionary game theory ⋮ A direct projection method for Markov chains ⋮ Algebraic Schwarz methods for the numerical solution of Markov chains ⋮ Block SOR for Kronecker structured representations ⋮ Aggregation of stochastic automata networks with replicas ⋮ Symbolic state-space exploration and numerical analysis of state-sharing composed models ⋮ Algorithms for an irreducible and lumpable strong stochastic bound ⋮ Rate-tilting for fast simulation of level/phase processes ⋮ On the exact simulation of functionals of stationary Markov chains ⋮ Approximate mean value analysis based on Markov chain aggregation by composition ⋮ On the tradeoff between compositionality and exactness in weak bisimilarity for integrated-time Markovian process calculi ⋮ Measuring security in IoT communications ⋮ Analysis of a \(k\)-out-of-\(N\) system with spares, repairs, and a probabilistic rule ⋮ Opinion influence and evolution in social networks: a Markovian agents model ⋮ Applications of an expressive statistical model checking approach to the analysis of genetic circuits ⋮ Performance analysis of two-loop closed production systems ⋮ Models of perishable queueing-inventory systems with server vacations ⋮ Entrywise relative perturbation bounds for exponentials of essentially non-negative matrices ⋮ Inexact GMRES for singular linear systems ⋮ Steady state analysis of level dependent quasi-birth-and-death processes with catastrophes ⋮ The influence of delivery times on repairable \(k\)-out-of-\(N\) systems with spares ⋮ Query-based verification of qualitative trends and oscillations in biochemical systems ⋮ Exact algorithms for singular tridiagonal systems with applications to Markov chains ⋮ IDD-based model validation of biochemical networks ⋮ Componentwise bounds for nearly completely decomposable Markov chains using stochastic comparison and reordering ⋮ Aggregation/disaggregation method for safety models. ⋮ Aggregation/disaggregation iterative methods applied to Leontev systems and Markov chains. ⋮ A decision support model for warranty servicing of repairable items ⋮ An algorithm approach to bounding aggregations of multidimensional Markov chains ⋮ Multigrid algorithm from cyclic reduction for Markovian queueing networks ⋮ Analysis of assembly systems controlled with kanbans ⋮ Mixing logics and rewards for the component-oriented specification of performance measures ⋮ Quotient convergence and multi-splitting methods for solving singular linear equations ⋮ Convergence and quotient convergence of iterative methods for solving singular linear equations with index one ⋮ Discrete-time stochastic modeling and simulation of biochemical networks ⋮ Modelling spatio-temporal movement of tourists using finite Markov chains ⋮ Simplification of irreversible Markov chains by removal of states with fast leaving rates ⋮ Learning the structure of dynamic Bayesian networks from time series and steady state measurements ⋮ A formal approach to the integration of performance aspects in the modeling and analysis of concurrent systems ⋮ Krylov and steady-state techniques for the solution of the chemical master equation for the mitogen-activated protein kinase cascade ⋮ Finite optimal control for time-bounded reachability in CTMDPs and continuous-time Markov games ⋮ A computational analysis of localized \(\text{Ca}^{2+}\)-dynamics generated by heterogeneous release sites ⋮ Exact performance equivalence: An equivalence relation for stochastic automata ⋮ Alternating two-stage methods for consistent linear systems with applications to the parallel solution of Markov chains ⋮ Analysis of a versatile multi-class delay-loss system with a superimposed Markovian arrival process ⋮ Uniform acceleration expansions for Markov chains with time-varying rates ⋮ Countable state Markov process bootstrap ⋮ Comparison theorems for the convergence factor of iterative methods for singular matrices ⋮ A note on the extended convergence of SOR for two-periodic Markov chains ⋮ Iterative methods based on splittings for stochastic automata networks ⋮ Solution of infinite linear systems by automatic adaptive iterations ⋮ Algorithmic analysis of a multiserver Markovian queue with primary and secondary services ⋮ An adaptive aggregation/disaggregation algorithm for hierarchical Markovian models ⋮ Accurate calculations of stationary distributions and mean first passage times in Markov renewal processes and Markov chains ⋮ Reverse bisimilarity vs. forward bisimilarity ⋮ A new key performance indicator oriented industrial process monitoring and operating performance assessment method based on improved Hessian locally linear embedding ⋮ A uniformisation-driven algorithm for inference-related estimation of a phase-type ageing model ⋮ Action and State Based Computation Tree Measurement Language and Algorithms ⋮ Bridging Causal Reversibility and Time Reversibility: A Stochastic Process Algebraic Approach ⋮ Influence of CAVs platoon characteristics on fundamental diagram of mixed traffic flow ⋮ Estimating the transition of individuals between life stages ⋮ The Spacey Random Walk: A Stochastic Process for Higher-Order Data ⋮ Convergence theory of exact interpolation scheme for computing several eigenvectors ⋮ Performance-Oriented Comparison of Web Services Via Client-Specific Testing Preorders ⋮ Filtering and the EM-Algorithm for the Markovian Arrival Process ⋮ Process algebra for performance evaluation ⋮ On Decision Problems for Probabilistic Büchi Automata ⋮ AnRG-Factorization Approach for a BMAP/M/1 Generalized Processor-Sharing Queue ⋮ An Aggregation/Disaggregation Algorithm for Stochastic Automata Networks ⋮ Building mean field ODE models using the generalized linear chain trick & Markov chain theory ⋮ Quasi-birth-and-death processes, level-geometric distributions. An aggregation/disaggregation approach ⋮ Iterative aggregation/disaggregation methods for computing some characteristics of Markov chains. II: Fast convergence ⋮ Towards Bridging Time and Causal Reversibility ⋮ Graph coarsening: from scientific computing to machine learning ⋮ Stochastic modeling on M/M/1/N inventory system with queue-dependent service rate and retrial facility ⋮ Numerical method for discrete-time finite-buffer queues with some regenerative structure ⋮ The group inverse of finite homogeneous QBD processes ⋮ On Vector-Kronecker Product Multiplication with Rectangular Factors ⋮ Unnamed Item ⋮ Accurate Chemical Master Equation Solution Using Multi-Finite Buffers ⋮ Discrete reachability of hybrid systems ⋮ Stochastic dynamics and stable equilibrium of evolutionary optional public goods game in finite populations ⋮ Comparative branching-time semantics for Markov chains ⋮ A preorder relation for Markov reward processes ⋮ A disaster queue with Markovian arrivals and impatient customers ⋮ The effect of increasing returns to scale in public goods investment on threshold values of cooperation under social exclusion mechanism ⋮ Precisely deciding CSL formulas through approximate model checking for CTMCs ⋮ Applying Reversibility Theory for the Performance Evaluation of Reversible Computations ⋮ Computing Behavioral Relations for Probabilistic Concurrent Systems ⋮ Quantitative Analysis of Concurrent Reversible Computations ⋮ Twenty years of rewriting logic ⋮ Recursive blocked algorithms for linear systems with Kronecker product structure ⋮ CARTESIAN PRODUCT PARTITIONING OF MULTI-DIMENSIONAL REACHABLE STATE SPACES ⋮ Approximation of the non-stationary \(M(t)/M(t)/c(t)\)-queue using stationary queueing models: The stationary backlog-carryover approach ⋮ Block-accelerated aggregation multigrid for Markov chains with application to PageRank problems ⋮ Matrix Structures in Queuing Models ⋮ Interval Type-2 Fuzzy Markov Chains ⋮ Sequences of lower and upper bounds for the spectral radius of a nonnegative matrix ⋮ Computing branching distances with quantitative games ⋮ Analysis of Markov Influence Graphs ⋮ Time-bounded termination analysis for probabilistic programs with delays ⋮ Heuristic Hill-Climbing as a Markov Process ⋮ Bounds and approximations for continuous-time Markovian transition probabilities and large systems ⋮ Reachability analysis based on structured representations ⋮ Unnamed Item ⋮ Statistical Verification of Probabilistic Properties with Unbounded Until ⋮ Fixation in haploid populations exhibiting density dependence. I: The non-neutral case ⋮ Bounding reward measures of Markov models using the Markov decision processes ⋮ Fast multilevel methods for Markov chains ⋮ Restricted additive Schwarz methods for Markov chains ⋮ Physiology and pathology of iterative aggregation–disaggregation methods ⋮ Revisiting the matrix‐free solution of Markov regenerative processes ⋮ Long-Run Rewards for Markov Automata ⋮ Kronecker-Based Infinite Level-Dependent QBD Processes ⋮ Towards general axiomatizations for bisimilarity and trace semantics ⋮ Aggregation of Markov flows I: theory ⋮ Analysing Biochemical Oscillation through Probabilistic Model Checking ⋮ Perturbed Markov chains with damping component ⋮ Automata-Based CSL Model Checking ⋮ Probabilistic Model Checking of the PDGF Signaling Pathway ⋮ Adaptive solution of infinite linear systems by Krylov subspace methods ⋮ Birth and Death (BDP) Process Models with Applications ⋮ Unnamed Item ⋮ The jump start power method: a new approach for computing the ergodic projector of a finite Markov chain ⋮ Computing Stationary Expectations in Level-Dependent QBD Processes ⋮ Reliability Bounds for Fault-Tolerant Systems with Deferred Repair using Bounding Split Regenerative Randomization ⋮ Bisimulation relations for weighted automata ⋮ Algorithmic analysis of the \(Geo/Geo/c\) retrial queue ⋮ Supply disruptions with time-dependent parameters ⋮ Markov property for a function of a Markov chain: A linear algebra approach ⋮ A periodic Krylov-Schur algorithm for large matrix products ⋮ Kronecker representation and decompositional analysis of closed queueing networks with phase-type service distributions and arbitrary buffer sizes ⋮ The periodic QR algorithm is a disguised QR algorithm ⋮ Stochastic and substochastic solutions for infinite-state Markov chains with applications to matrix-analytic methods ⋮ Two-layer symbolic representation for stochastic models with phase-type distributed events ⋮ Attribute-Based Signatures for Circuits from Bilinear Map ⋮ A MARKOV-PROCESS INSPIRED CA MODEL OF HIGHWAY TRAFFIC ⋮ Calcium-dependent inactivation and the dynamics of calcium puffs and sparks ⋮ Survey on Directed Model Checking ⋮ Iterant recombination with one-norm minimization for multilevel Markov chain algorithms via the ellipsoid method ⋮ Computation tree measurement language (CTML) ⋮ A RETRIAL QUEUEING MODEL WITH MAP ARRIVALS, CATASTROPHIC FAILURES WITH REPAIRS, AND CUSTOMER IMPATIENCE ⋮ PageRank Beyond the Web ⋮ Lumpable continuous-time stochastic automata networks. ⋮ ANALYSIS OF A MULTI-SERVER QUEUE WITH MARKOVIAN ARRIVALS AND SYNCHRONOUS PHASE TYPE VACATIONS ⋮ Coupling and ergodic theorems for Markov chains with damping component ⋮ Influence of Preconditioning and Blocking on Accuracy in Solving Markovian Models ⋮ Probabilistic Time Petri Nets ⋮ Approximate optimal adaptive control for weakly coupled nonlinear systems: A neuro-inspired approach ⋮ Unnamed Item ⋮ Case for First Courses on Finite Markov Chain Modeling to Include Sojourn Time Cycle Chart ⋮ Matrix analysis for continuous-time Markov chains ⋮ Infinite level-dependent QBD processes and matrix-analytic solutions for stochastic chemical kinetics ⋮ Impact of Dampening Demand Variability in a Production/Inventory System with Multiple Retailers ⋮ Compositional weak metrics for group key update ⋮ Characterization of the conditional stationary distribution in Markov chains via systems of linear inequalities ⋮ A General Framework for Consistent Estimation of Charge Transport Properties via Random Walks in Random Environments ⋮ Parallel computing for Markov chains with islands and ports ⋮ A theory of stochastic systems. II: Process algebra ⋮ Performance measure sensitive congruences for Markovian process algebras ⋮ Parallelization of EM-Algorithms for Markovian Arrival Processes ⋮ An improved saddlepoint approximation based on the negative binomial distribution for the general birth process ⋮ Simulation of multidimensional diffusions with sticky boundaries via Markov chain approximation ⋮ Reduction of calcium release site models via fast/slow analysis and iterative aggregation/disaggregation ⋮ Stochastic Object-Based Graph Grammars ⋮ Heuristics as Markov chains ⋮ Computing the shortest reset words of synchronizing automata ⋮ A probabilistic algorithm for aggregating vastly undersampled large Markov chains ⋮ Convergence theory of some classes of iterative aggregation/disaggregation methods for computing stationary probability vectors of stochastic matrices ⋮ State reduction in a Markov decision process