Publication | Date of Publication | Type |
---|
State-Space Collapse in Resource Allocation for Demand Dispatch and Its Implications for Distributed Control Design | 2024-02-29 | Paper |
Kullback–Leibler-Quadratic Optimal Control | 2023-11-14 | Paper |
Q-Learning With Uniformly Bounded Variance | 2023-09-25 | Paper |
Controlled interacting particle algorithms for simulation-based reinforcement learning | 2022-12-02 | Paper |
Fundamental design principles for reinforcement learning algorithms | 2022-10-28 | Paper |
Feature Projection for Optimal Transport | 2022-08-03 | Paper |
Control Systems and Reinforcement Learning | 2022-06-01 | Paper |
Differential Temporal Difference Learning | 2022-02-23 | Paper |
Revisiting the ODE method for recursive algorithms: fast convergence using quasi stochastic approximation | 2022-01-21 | Paper |
The Conditional Poincar\'e Inequality for Filter Stability | 2021-03-26 | Paper |
Diffusion Map-based Algorithm for Gain Function Approximation in the Feedback Particle Filter | 2020-08-31 | Paper |
Geometric ergodicity in a weighted Sobolev space | 2020-05-29 | Paper |
Variance Reduction in Simulation of Multiclass Processing Networks | 2020-05-28 | Paper |
Distributed control design for balancing the grid using flexible loads | 2019-09-18 | Paper |
What is the Lagrangian for Nonlinear Filtering? | 2019-03-26 | Paper |
Optimal Rate of Convergence for Quasi-Stochastic Approximation | 2019-03-17 | Paper |
An Approach to Duality in Nonlinear Filtering | 2018-09-27 | Paper |
Action-Constrained Markov Decision Processes With Kullback-Leibler Cost | 2018-07-26 | Paper |
Distributed Computation of Equilibria in Misspecified Convex Stochastic Nash Games | 2018-06-27 | Paper |
Ergodic theory for controlled Markov chains with stationary inputs | 2018-05-25 | Paper |
Ordinary Differential Equation Methods for Markov Decision Processes and Application to Kullback--Leibler Control Cost | 2018-02-12 | Paper |
Synchronization of Coupled Oscillators is a Game | 2017-09-08 | Paper |
Random-Time, State-Dependent Stochastic Drift for Markov Chains and Application to Stochastic Stabilization Over Erasure Channels | 2017-09-08 | Paper |
Feedback Particle Filter | 2017-09-08 | Paper |
Optimal Kullback-Leibler Aggregation via Spectral Theory of Markov Chains | 2017-08-25 | Paper |
Universal and Composite Hypothesis Testing via Mismatched Divergence | 2017-07-27 | Paper |
Minimax Robust Quickest Change Detection | 2017-07-27 | Paper |
A Random Search Framework for Convergence Analysis of Distributed Beamforming With Feedback | 2017-07-27 | Paper |
State Estimation for the Individual and the Population in Mean Field Control With Application to Demand Dispatch | 2017-07-27 | Paper |
Management of Demand-Driven Production Systems | 2017-07-12 | Paper |
Workload models for stochastic networks: value functions and performance evaluation | 2017-07-12 | Paper |
Approximating a diffusion by a finite-state hidden Markov model | 2017-06-30 | Paper |
Generalized Error Exponents for Small Sample Universal Hypothesis Testing | 2017-06-08 | Paper |
Ancillary Service to the Grid Using Intelligent Deferrable Loads | 2017-05-16 | Paper |
Learning in Mean-Field Games | 2017-05-16 | Paper |
Feedback Particle Filter for a Continuous-time Markov Chain | 2017-05-03 | Paper |
On the \(f\)-norm ergodicity of Markov processes in continuous time | 2016-12-21 | Paper |
Error Estimates for the Kernel Gain Function Approximation in the Feedback Particle Filter | 2016-12-16 | Paper |
Multivariable feedback particle filter | 2016-09-09 | Paper |
Rationally Inattentive Control of Markov Processes | 2016-04-25 | Paper |
Poisson's Equation in Nonlinear Filtering | 2015-06-02 | Paper |
On the efficiency of equilibria in mean-field oscillator games | 2015-02-03 | Paper |
Tail asymptotics for busy periods | 2014-10-07 | Paper |
Estimating Loynes' exponent | 2013-11-25 | Paper |
Oja's algorithm for graph clustering, Markov spectral decomposition, and risk sensitive control | 2013-08-28 | Paper |
Large deviations for the empirical mean of an M/M/\(1\) queue | 2013-07-05 | Paper |
Geometric ergodicity and the spectral gap of non-reversible Markov chains | 2013-01-14 | Paper |
Efficiency and marginal cost pricing in dynamic competitive markets with friction | 2010-10-01 | Paper |
On exponential ergodicity of multiclass queueing networks | 2010-06-11 | Paper |
Coding and control for communication networks | 2010-03-17 | Paper |
Stability and Asymptotic Optimality of Generalized MaxWeight Policies | 2009-11-27 | Paper |
Markov Chains and Stochastic Stability | 2009-06-04 | Paper |
Characterization and Computation of Optimal Distributions for Channel Coding | 2008-12-21 | Paper |
Robust Measurement-Based Admission Control Using Markov's Theory of Canonical Distributions | 2008-12-21 | Paper |
Computable exponential bounds for screened estimation and simulation | 2008-08-20 | Paper |
The ODE method for stability of skip-free Markov chains with applications to MCMC | 2008-04-23 | Paper |
Control Techniques for Complex Networks | 2008-02-25 | Paper |
https://portal.mardi4nfdi.de/entity/Q5424469 | 2007-11-05 | Paper |
Reliability by design in distributed power transmission networks | 2006-10-05 | Paper |
Worst-case large-deviation asymptotics with application to queueing and information theory | 2006-06-30 | Paper |
Large deviation asymptotics and control variates for simulating large functions | 2006-06-29 | Paper |
Randomized Algorithms for Semi-Infinite Programming Problems | 2006-04-18 | Paper |
Risk-Sensitive Optimal Control for Markov Decision Processes with Monotone Cost | 2005-11-11 | Paper |
Dynamic safety-stocks for asymptotic optimality in stochastic networks | 2005-11-07 | Paper |
Large deviations asymptotics and the spectral theory of multiplicatively regular Markov proces\-ses | 2005-03-08 | Paper |
Metastability of Diffusion Processes | 2005-02-11 | Paper |
Phase transitions and metastability in Markovian and molecular systems | 2004-06-10 | Paper |
Sequencing and Routing in Multiclass Queueing Networks Part II: Workload Relaxations | 2004-01-08 | Paper |
In search of sensitivity in network optimization | 2003-09-22 | Paper |
Performance evaluation and policy selection in multiclass networks | 2003-05-11 | Paper |
Spectral theory and limit theorems for geometrically ergodic Markov processes | 2003-05-06 | Paper |
Obituary: Richard Lewis Tweedie | 2003-03-20 | Paper |
https://portal.mardi4nfdi.de/entity/Q4547442 | 2002-08-21 | Paper |
Algorithms for optimization and stabilization of controlled Markov chains. | 2002-02-18 | Paper |
https://portal.mardi4nfdi.de/entity/Q4438207 | 2002-01-01 | Paper |
Sequencing and Routing in Multiclass Queueing Networks Part I: Feedback Regulation | 2001-10-29 | Paper |
Bounds on achievable performance in the identification and adaptive control of time-varying systems | 2000-10-17 | Paper |
Value iteration and optimization of multiclass queueing networks | 2000-09-10 | Paper |
The O.D.E. Method for Convergence of Stochastic Approximation and Reinforcement Learning | 2000-03-19 | Paper |
The policy iteration algorithm for average reward Markov decision processes with general state space | 1998-08-12 | Paper |
Piecewise linear test functions for stability and instability of queueing networks | 1998-07-28 | Paper |
https://portal.mardi4nfdi.de/entity/Q4354027 | 1998-01-28 | Paper |
Transience of multiclass queueing networks via fluid limit models | 1997-07-07 | Paper |
Computable exponential convergence rates for stochastically ordered Markov processes | 1997-06-10 | Paper |
A Liapounov bound for solutions of the Poisson equation | 1997-02-20 | Paper |
Duality and linear programs for stability and performance analysis of queuing networks and scheduling policies | 1996-09-15 | Paper |
Exponential and uniform ergodicity of Markov processes | 1996-07-07 | Paper |
Stability of acyclic multiclass queueing networks | 1996-06-04 | Paper |
Stability and convergence of moments for multiclass queueing networks via fluid limit models | 1996-01-07 | Paper |
Computable bounds for geometric convergence rates of Markov chains | 1995-05-14 | Paper |
Stability of queueing networks and scheduling policies | 1995-05-11 | Paper |
https://portal.mardi4nfdi.de/entity/Q4763606 | 1995-04-17 | Paper |
State-dependent criteria for convergence of Markov chains | 1995-01-03 | Paper |
Model reference adaptive control of time varying and stochastic systems | 1994-07-21 | Paper |
Stability of generalized Jackson networks | 1994-06-19 | Paper |
https://portal.mardi4nfdi.de/entity/Q4273570 | 1994-04-06 | Paper |
https://portal.mardi4nfdi.de/entity/Q4273571 | 1994-04-06 | Paper |
Stability of Markovian processes II: continuous-time processes and sampled chains | 1994-02-17 | Paper |
Stability of Markovian processes III: Foster–Lyapunov criteria for continuous-time processes | 1994-02-17 | Paper |
https://portal.mardi4nfdi.de/entity/Q3140590 | 1994-01-02 | Paper |
https://portal.mardi4nfdi.de/entity/Q3140704 | 1993-11-28 | Paper |
Markov chains and stochastic stability | 1993-11-02 | Paper |
GEOMETRIC ERGODICITY OF A DOUBLY STOCHASTIC TIME SERIES MODEL | 1993-06-29 | Paper |
Recurrence times of buffer overflows in Jackson networks | 1993-05-16 | Paper |
Stability of Markovian processes I: criteria for discrete-time Chains | 1992-10-04 | Paper |
Stability, convergence, and performance of an adaptive control algorithm applied to a randomly varying system | 1992-09-27 | Paper |
Asymptotic Behavior of Stochastic Systems Possessing Markovian Realizations | 1991-01-01 | Paper |
Adaptive control for time-varying systems: A combination of Martingale and Markov chain techniques | 1989-01-01 | Paper |
Ergodic Theorems for Discrete Time Stochastic Systems Using a Stochastic Lyapunov Function | 1989-01-01 | Paper |
https://portal.mardi4nfdi.de/entity/Q4735109 | 1989-01-01 | Paper |
A new approach to stochastic adaptive control | 1987-01-01 | Paper |
The zero divisor problem of multivariable stochastic adaptive control | 1985-01-01 | Paper |
Extremely Fast Convergence Rates for Extremum Seeking Control with Polyak-Ruppert Averaging | 0001-01-03 | Paper |
Markovian Foundations for Quasi-Stochastic Approximation with Applications to Extremum Seeking Control | 0001-01-03 | Paper |