| Publication | Date of Publication | Type |
|---|
| Maximizing the probability of visiting a set infinitely often for a Markov decision process with Borel state and action spaces | 2024-11-15 | Paper |
| Adaptive average control for piecewise deterministic Markov processes | 2024-11-12 | Paper |
| Absorbing Markov decision processes | 2024-02-28 | Paper |
| Nash equilibria for total expected reward absorbing Markov games: the constrained and unconstrained cases | 2024-02-08 | Paper |
| Adaptive discounted control for piecewise deterministic Markov processes | 2023-08-29 | Paper |
| Optimal Control of Piecewise Deterministic Markov Processes | 2022-11-15 | Paper |
| Hamilton-Jacobi-Bellman inequality for the average control of piecewise deterministic Markov processes | 2022-07-08 | Paper |
| Stationary Markov Nash Equilibria for Nonzero-Sum Constrained ARAT Markov Games | 2022-04-27 | Paper |
| On the equivalence of the integral and differential Bellman equations in impulse control problems | 2022-02-04 | Paper |
| Maximizing the probability of visiting a set infinitely often for a countable state space Markov decision process | 2021-10-22 | Paper |
| Integro-differential optimality equations for the risk-sensitive control of piecewise deterministic Markov processes | 2021-07-14 | Paper |
| Power-of-d-Choices with Memory: Fluid Limit and Optimality | 2021-01-08 | Paper |
| A Convex Programming Approach for Discrete-Time Markov Decision Processes under the Expected Total Reward Criterion | 2020-10-30 | Paper |
| On the expected total reward with unbounded returns for Markov decision processes | 2020-09-09 | Paper |
| Numerical approximations for discounted continuous time Markov decision processes | 2019-11-20 | Paper |
| Approximation of discounted minimax Markov control problems and zero-sum Markov games using Hausdorff and Wasserstein distances | 2019-05-03 | Paper |
| Zero-sum discounted reward criterion games for piecewise deterministic Markov processes | 2018-12-10 | Paper |
| Controlling IL-7 injections in HIV-infected patients | 2018-10-24 | Paper |
| Computable approximations for average Markov decision processes in continuous time | 2018-09-26 | Paper |
| Approximation of Infinite Horizon Discounted Cost Markov Decision Processes | 2017-11-22 | Paper |
| Partially observed optimal stopping problem for discrete-time Markov processes | 2017-11-16 | Paper |
| Almost Sure Stabilization for Feedback Controls of Regime-Switching Linear Systems With a Hidden Markov Chain | 2017-08-08 | Paper |
| Stochastic Control of Observer Trajectories in Bearings-only Tracking with Acoustic Signal Propagation Optimization | 2017-03-29 | Paper |
| Optimal strategies for impulse control of piecewise deterministic Markov processes | 2017-02-16 | Paper |
| Optimal impulsive control of piecewise deterministic Markov processes | 2016-11-25 | Paper |
| Conditions for the solvability of the linear programming formulation for constrained discounted Markov decision processes | 2016-09-23 | Paper |
| Impulsive control for continuous-time Markov decision processes: a linear programming approach | 2016-09-23 | Paper |
| Computable approximations for continuous-time Markov decision processes on Borel spaces based on empirical measures | 2016-07-04 | Paper |
| Constrained and Unconstrained Optimal Discounted Control of Piecewise Deterministic Markov Processes | 2016-06-07 | Paper |
| Optimization of a launcher integration process: a Markov decision process approach | 2016-02-04 | Paper |
| Numerical Methods for Simulation and Optimization of Piecewise Deterministic Markov Processes | 2016-01-13 | Paper |
| Approximation of average cost Markov decision processes using empirical distributions and concentration inequalities | 2015-07-29 | Paper |
| Impulsive Control for Continuous-Time Markov Decision Processes | 2015-04-17 | Paper |
| Stochastic approximations of constrained discounted Markov decision processes | 2015-03-27 | Paper |
| A linear programming formulation for constrained discounted continuous control for piecewise deterministic Markov processes | 2015-01-06 | Paper |
| Non-Parametric Estimation of the Conditional Distribution of the Interjumping Times for Piecewise-Deterministic Markov Processes | 2014-12-09 | Paper |
| Optimal stopping for partially observed piecewise-deterministic Markov processes | 2014-04-28 | Paper |
| Nonparametric estimation of the jump rate for non-homogeneous marked renewal processes | 2013-11-19 | Paper |
| The Expected Total Cost Criterion for Markov Decision Processes under Constraints | 2013-10-23 | Paper |
| Finite Linear Programming Approximations of Constrained Discounted Markov Decision Processes | 2013-07-17 | Paper |
| https://portal.mardi4nfdi.de/entity/Q4925754 | 2013-06-12 | Paper |
| Continuous Average Control of Piecewise Deterministic Markov Processes | 2013-04-08 | Paper |
| On the existence of strict optimal controls for constrained, controlled Markov processes in continuous time | 2012-11-09 | Paper |
| The Expected Total Cost Criterion for Markov Decision Processes under Constraints: A Convex Analytic Approach | 2012-11-02 | Paper |
| Average control of Markov decision processes with Feller transition probabilities and general action spaces | 2012-09-26 | Paper |
| Numerical method for impulse control of piecewise deterministic Markov processes | 2012-08-27 | Paper |
| Numerical method for expectations of piecewise deterministic Markov processes | 2012-08-15 | Paper |
| Singularly Perturbed Discounted Markov Control Processes in a General State Space | 2012-08-10 | Paper |
| Numerical Methods for the Exit Time of a Piecewise-Deterministic Markov Process | 2012-04-10 | Paper |
| Approximation of Markov decision processes with general state space | 2012-02-27 | Paper |
| Singular perturbation for the discounted continuous control of piecewise deterministic Markov processes | 2011-05-25 | Paper |
| Average Continuous Control of Piecewise Deterministic Markov Processes | 2011-03-21 | Paper |
| Multiobjective Stopping Problem for Discrete-Time Markov Processes: Convex Analytic Approach | 2011-01-13 | Paper |
| The policy iteration algorithm for average continuous control of piecewise deterministic Markov processes | 2010-11-22 | Paper |
| Numerical method for optimal stopping of piecewise deterministic Markov processes | 2010-10-04 | Paper |
| The Vanishing Discount Approach for the Average Continuous Control of Piecewise Deterministic Markov Processes | 2010-02-02 | Paper |
| Stability and Ergodicity of Piecewise Deterministic Markov Processes | 2009-03-27 | Paper |
| The Vanishing Approach for the Average Continuous Control of Piecewise Deterministic Markov Processes | 2008-12-03 | Paper |
| Almost Sure Stabilization for Adaptive Controls of Regime-switching LQ Systems with A Hidden Markov Chain | 2008-07-09 | Paper |
| Ergodic properties and ergodic decompositions of continuous-time Markov processes | 2007-08-23 | Paper |
| A sufficient condition for the existence of an invariant probability measure for Markov processes | 2006-01-26 | Paper |
| On the ergodic decomposition for a class of Markov chains | 2005-08-05 | Paper |
| On the Poisson Equation for Piecewise-Deterministic Markov Processes | 2004-01-08 | Paper |
| Necessary and sufficient conditions for non-singular invariant probability measures for Feller Markov chains | 2003-08-11 | Paper |
| https://portal.mardi4nfdi.de/entity/Q4330330 | 2002-09-02 | Paper |
| Discrete-time estimation of a Markov chain with marked point process observations. Application to Markovian jump filtering | 2002-07-21 | Paper |
| Invariant probability measures for a class of Feller Markov chains | 2001-10-16 | Paper |
| Optimal stopping with continuous control of piecewise deterministic Markov processes | 2001-08-23 | Paper |
| Filtering with discrete state observations | 2001-02-27 | Paper |
| Stability of Piecewise-Deterministic Markov Processes | 1999-11-23 | Paper |
| Adaptive control of linear systems with Markov perturbations | 1999-08-26 | Paper |
| Exact hybrid filters in discrete time | 1997-10-27 | Paper |
| The filtering problem for continuous-time linear systems with Markovian switching coefficients | 1997-02-27 | Paper |
| An image-based filter for discrete-time Markovian jump linear systems | 1996-06-05 | Paper |
| Stabilizing control law for hybrid models | 1995-11-28 | Paper |
| The filtering problem for continuous-time linear systems with Markovian switching coefficients | 1995-01-02 | Paper |
| A note on weak compactness of occupation measures for an absorbing Markov decision process | N/A | Paper |
