Variational and optimal control representations of conditioned and driven processes
From MaRDI portal
Abstract: We have shown recently that a Markov process conditioned on rare events involving time-integrated random variables can be described in the long-time limit by an effective Markov process, called the driven process, which is given mathematically by a generalization of Doob's -transform. We show here that this driven process can be represented in two other ways: first, as a process satisfying various variational principles involving large deviation functions and relative entropies and, second, as an optimal stochastic control process minimizing a cost function also related to large deviation functions. These interpretations of the driven process generalize and unify many previous results on maximum entropy approaches to nonequilibrium systems, spectral characterizations of positive operators, and control approaches to large deviation theory. They also lead, as briefly discussed, to new methods for analytically or numerically approximating large deviation functions.
Recommendations
- On the variational process in optimal control theory
- OPTIMAL CONTROL OF PROBABILITY DENSITY FUNCTIONS OF STOCHASTIC PROCESSES
- Optimal control of conditioned processes with feedback controls
- A practical variational approach to stochastic optimal control via state moment equations
- A variational perspective on controllability
- The variational principle for optimal control of diffusions with partial information
- Optimal control problem of conditional mean-field stochastic differential equations
- Optimal control of an Ornstein-Uhlenbeck process
- scientific article; zbMATH DE number 47431
- Variational integrators in discrete time-dependent optimal control theory
Cites work
- A formal view on level 2.5 large deviations and fluctuation relations
- A learning algorithm for risk-sensitive cost
- A minimum principle for the principal eigenvalue for second-order linear elliptic equations with natural boundary conditions
- A new energy characterization of the smallest eigenvalue of the schrödinger equation
- A remark on the large deviations of an ergodic markov process
- A representation formula for the large deviation rate function for the empirical law of a continuous time Markov chain
- A risk-sensitive maximum principle
- A risk-sensitive maximum principle: the case of imperfect state observation
- Action principle in statistical dynamics
- Advances in filtering and optimal stochastic control. Proceedings of the IFIP-WG 7/1 Working Conference, Cocoyoc, Mexico, February 1-6, 1982
- Applications of the cross-entropy method to importance sampling and optimal control of diffusions
- ASEP on a ring conditioned on enhanced flux
- Asymptotic evaluation of certain markov process expectations for large time, I
- Asymptotic evaluation of certain markov process expectations for large time, II
- Asymptotic evaluation of certain Markov process expectations for large time—III
- Asymptotic for the principal eigenvalue and eigenfunction of a nearly first-order operator with large potential
- Conditional brownian motion and the boundary limits of harmonic functions
- Connections between stochastic control and dynamic games
- Construction of a coordinate Bethe ansatz for the asymmetric simple exclusion process with open boundaries
- Control theory in physics and other fields of science. Concepts, tools, and applications
- Controlled Markov processes and viscosity solutions
- Detailed balance has a counterpart in non-equilibrium steady states
- Dynamics of instantaneous condensation in the ZRP conditioned on an atypical current
- Equivalence and nonequivalence of ensembles: thermodynamic, macrostate, and measure levels
- Exit probabilities and optimal stochastic control
- Explicit solution of relative entropy weighted control
- First-order dynamical phase transition in models of glasses: an approach based on ensembles of histories
- Fluctuations and Irreversible Processes
- scientific article; zbMATH DE number 440541 (Why is no real title available?)
- scientific article; zbMATH DE number 3875656 (Why is no real title available?)
- scientific article; zbMATH DE number 3826915 (Why is no real title available?)
- scientific article; zbMATH DE number 3903723 (Why is no real title available?)
- scientific article; zbMATH DE number 3939236 (Why is no real title available?)
- scientific article; zbMATH DE number 107482 (Why is no real title available?)
- scientific article; zbMATH DE number 3505708 (Why is no real title available?)
- scientific article; zbMATH DE number 3543334 (Why is no real title available?)
- scientific article; zbMATH DE number 1153603 (Why is no real title available?)
- scientific article; zbMATH DE number 1158743 (Why is no real title available?)
- scientific article; zbMATH DE number 2026092 (Why is no real title available?)
- scientific article; zbMATH DE number 1515832 (Why is no real title available?)
- scientific article; zbMATH DE number 194664 (Why is no real title available?)
- Introduction to rare event simulation.
- Introduction to the mathematical theory of control processes. Vol I: Linear equations and quadratic criteria
- Large deviation principles and complete equivalence and nonequivalence results for pure and mixed ensembles
- Large deviations
- Large deviations and ensembles of trajectories in stochastic models
- Large deviations of the dynamical activity in the East model: analysing structure in biased trajectories
- Non-equilibrium steady states: fluctuations and large deviations of the density and of the current
- Non-equilibrium thermodynamics and topology of currents
- Nonequilibrium Markov processes conditioned on large deviations
- Nonequilibrium statistical physics of small systems. Fluctuation relations and beyond
- On a Variational Formula for the Principal Eigenvalue for Operators with Maximum Principle
- On large deviations theory and asymptotically efficient Monte Carlo estimation
- On quasi-stationary distributions in absorbing continuous-time finite Markov chains
- On Quasi-Stationary distributions in absorbing discrete-time finite Markov chains
- On the principal eigenvalue of second-order elliptic differential operators
- Path integrals and symmetry breaking for optimal control theory
- Performance analysis conditioned on rare events: an adaptive simulation scheme
- Physics of large deviation
- Quasi-stationary distributions. Markov chains, diffusions and dynamical systems.
- Risk-Sensitive Control on an Infinite Time Horizon
- Risk-sensitivity, large deviations and stochastic control
- Simulating rare events in dynamical processes
- Small distance behaviour in field theory and power counting
- Some estimates of the transition density of a nondegenerate diffusion Markov process
- Stochastic calculus of variations and mechanics
- Stochastic control and principal eigenvaluet†
- Stochastic Control for Small Noise Intensities
- Stochastic interacting particle systems out of equilibrium
- Stochastic optimal control as non-equilibrium statistical mechanics: calculus of variations over density and current
- Stochastic simulation: Algorithms and analysis
- Stochastic variational formula for fundamental solutions of parabolic PDE
- The Fokker-Planck equation. Methods of solutions and applications.
- Thermodynamic formalism for systems with Markov dynamics
- Transition probabilities and dynamic structure function in the ASEP conditioned on strong flux
- Variational principle in Langevin processes
Cited in
(46)- Asymptotic equivalence of probability measures and stochastic processes
- Canonical structure and orthogonality of forces and currents in irreversible Markov chains
- Adaptive sampling of large deviations
- Large deviations of empirical measures of diffusions in weighted topologies
- Large deviations at level 2.5 for Markovian open quantum systems: quantum jumps and quantum state diffusion
- Effective Hamiltonians and Lagrangians for conditioned Markov processes at large volume
- Introduction to dynamical large deviations of Markov processes
- Non-empirical weighted Langevin mechanics for the potential escape problem: parallel algorithm and application to the argon clusters
- Efficient large deviation estimation based on importance sampling
- Large deviations conditioned on large deviations. I: Markov chain and Langevin equation
- Large deviations conditioned on large deviations II: Fluctuating hydrodynamics
- Diffusions conditioned on occupation measures
- Current fluctuations and transport efficiency for general Langevin systems
- Multi-point nonequilibrium umbrella sampling and associated fluctuation relations
- Large-deviation theory for a Brownian particle on a ring: a WKB approach
- Revisiting the Ruelle thermodynamic formalism for Markov trajectories with application to the glassy phase of random trap models
- Inhomogeneous asymmetric exclusion processes between two reservoirs: large deviations for the local empirical observables in the mean-field approximation
- Large deviations for metastable states of Markov processes with absorbing states with applications to population models in stable or randomly switching environment
- Graph-combinatorial approach for large deviations of Markov chains
- An optimal control derivation of nonlinear smoothing equations
- Dynamical phase coexistence in the fredrickson-Andersen model
- Dynamical phase transitions for the activity biased Ising model in a magnetic field
- Periodically driven jump processes conditioned on large deviations
- Large deviations at various levels for run-and-tumble processes with space-dependent velocities and space-dependent switching rates
- Jump-drift and jump-diffusion processes: large deviations for the density, the current and the jump-flow and for the excursions between jumps
- Large deviations for the skew-detailed-balance lifted-Markov processes to sample the equilibrium distribution of the Curie–Weiss model
- Sampling rare events across dynamical phase transitions
- Conformal invariance in conditioned stochastic particle systems
- Large deviations and optimal control forces for hard particles in one dimension
- Large deviations for Markov processes with stochastic resetting: analysis via the empirical density and flows or via excursions between resets
- Large deviations of the Lyapunov exponent in 2D matrix Langevin dynamics with applications to one-dimensional Anderson localization models
- Landau theory for finite-time dynamical phase transitions
- Joint distribution of two local times for diffusion processes with the application to the construction of various conditioned processes
- On the Kemeny time for continuous-time reversible and irreversible Markov processes with applications to stochastic resetting and to conditioning towards forever-survival
- Revisiting boundary-driven non-equilibrium Markov dynamics in arbitrary potentials via supersymmetric quantum mechanics and via explicit large deviations at various levels
- Large deviations at level 2.5 and for trajectories observables of diffusion processes: the missing parts with respect to their random-walks counterparts
- Large deviations for the Pearson family of ergodic diffusion processes involving a quadratic diffusion coefficient and a linear force
- Large deviations for trajectory observables of diffusion processes in dimension \(d > 1\) in the double limit of large time and small diffusion coefficient
- Inverse problem in the conditioning of Markov processes on trajectory observables: what canonical conditionings can connect two given Markov generators?
- Large deviations and conditioning for chaotic non-invertible deterministic maps: analysis via the forward deterministic dynamics and the backward stochastic dynamics
- Fluctuation relations associated to an arbitrary bijection in path space
- Fluctuations and correlations in weakly asymmetric simple exclusion on a ring subject to an atypical current
- A supersymmetric quantum perspective on the explicit large deviations for reversible Markov jump processes, with applications to pure and random spin chains
- Explicit dynamical properties of the pelikan random map in the chaotic region and at the intermittent critical point towards the non-chaotic region
- Density-dependent stochastic resetting: a large deviations framework for achieving target distributions over networks
- Towards neural reinforcement learning for large deviations in non-equilibrium systems with memory
This page was built for publication: Variational and optimal control representations of conditioned and driven processes
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3302168)
