Sensitivity analysis for the stationary distribution of reflected Brownian motion in a convex polyhedral cone

DOI10.1287/MOOR.2020.1076zbMATH Open1478.60223arXiv1907.00472OpenAlexW3128764009MaRDI QIDQ5000645FDOQ5000645

Kavita Ramanan, David Lipshutz

Publication date: 15 July 2021

Published in: Mathematics of Operations Research (Search for Journal in Brave)

Abstract: Reflected Brownian motion (RBM) in a convex polyhedral cone arises in a variety of applications ranging from the theory of stochastic networks to math finance, and under general stability conditions, it has a unique stationary distribution. In such applications, to implement a stochastic optimization algorithm or quantify robustness of a model, it is useful to characterize the dependence of stationary performance measures on model parameters. In this work we characterize parametric sensitivities of the stationary distribution of an RBM in a simple convex polyhedral cone; that is, sensitivities to perturbations of the parameters that define the RBM --- namely, the covariance matrix, drift vector and directions of reflection along the boundary of the polyhedral cone. In order to characterize these sensitivities we study the long time behavior of the joint process consisting of an RBM along with its so-called derivative process, which characterizes pathwise derivatives of RBMs on finite time intervals. We show that the joint process is positive recurrent, has a unique stationary distribution, and parametric sensitivities of the stationary distribution of an RBM can be expressed in terms of the stationary distribution of the joint process. This can be thought of as establishing an interchange of the differential operator and the limit in time. The analysis of ergodicity of the joint process is significantly more complicated than that of the RBM due to its degeneracy and the fact that the derivative process exhibits jumps that are modulated by the RBM. The proofs of our results rely on path properties of coupled RBMs and contraction properties related to the geometry of the polyhedral cone and directions of reflection along the boundary. Our results are potentially useful for developing efficient numerical algorithms for computing sensitivities of functionals of stationary RBMs.

Full work available at URL: https://arxiv.org/abs/1907.00472

Recommendations

• Reflected Brownian motion in an orthant: Numerical methods for steady- state analysis
• Multidimensional reflected Brownian motions having exponential stationary distributions
• Steady-state analysis of RBM in a rectangle: Numerical methods and a queueing application
• Rates of convergence to stationarity for reflected Brownian motion
• Reflected Brownian motion in a convex polyhedral cone: tail estimates for the stationary distribution

zbMATH Keywords

sensitivity analysisstationary distributionreflected Brownian motionSkorokhod reflection problemderivative problemderivative processasymptotic coupling methodpathwise derivatives

Mathematics Subject Classification ID

Brownian motion (60J65) Sample path properties (60G17) Stopping times; optimal stopping problems; gambling theory (60G40) Stochastic particle methods (65C35)

Cites Work

• Title not available (Why is that?)
• Stochastic simulation: Algorithms and analysis
• Title not available (Why is that?)
• On lipschitz continuity of the solution mapping to the skorokhod problem, with applications
• M-matrix characterizations. I: nonsingular M-matrices
• Open Queueing Networks in Heavy Traffic
• Title not available (Why is that?)
• Convex duality and the Skorokhod problem. I
• An invariance principle for semimartingale reflecting Brownian motions in domains with piecewise smooth boundaries
• Atlas models of equity markets
• Hybrid Atlas models
• Asymptotic coupling and a general form of Harris' theorem with applications to stochastic delay equations
• Lyapunov functions for semimartingale reflecting Brownian motions
• Simple Necessary and Sufficient Conditions for the Stability of Constrained Processes
• The heavy traffic limit of an unbalanced generalized processor sharing model
• On positive recurrence of constrained diffusion processes
• Long time asymptotics for constrained diffusions in polyhedral domains
• Stability in distribution for a class of singular diffusions
• Reflected diffusions defined via the extended Skorokhod map
• Characterization of stationary distributions of reflected diffusions
• A Skorokhod problem formulation and large deviation analysis of a processor sharing model
• A multiclass feedback queueing network with a regular Skorokhod problem
• Directional Derivatives of Oblique Reflection Maps
• Sensitivity analysis for diffusion processes constrained to an orthant
• Polyhedral sets having a least element
• A Monte Carlo Method for Sensitivity Analysis and Parametric Optimization of Nonlinear Stochastic Systems: The Ergodic Case
• A Heavy Traffic Limit Theorem for Networks of Queues with Multiple Customer Types
• A Monte Carlo Method for Estimating Sensitivities of Reflected Diffusions in Convex Polyhedral Domains
• On directional derivatives of Skorokhod maps in convex polyhedral domains
• Ergodicity of an SPDE associated with a many-server queue
• Brownian Models of Performance and Control
• Pathwise differentiability of reflected diffusions in convex polyhedral domains

Cited In (2)

• Stability and invariant measure asymptotics in a model for heavy particles in rough turbulent flows
• Efficient Steady-State Simulation of High-Dimensional Stochastic Networks

This page was built for publication: Sensitivity analysis for the stationary distribution of reflected Brownian motion in a convex polyhedral cone

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5000645)