Dynamic optimization and its relation to classical and quantum constrained systems

DOI10.1016/J.PHYSA.2017.02.075MaRDI QIDQ2145555zbMATH OpenOpenAlexFDO

Authors Mauricio Contreras, Rely Pellicer, Marcelo J. Villena

Publication date 17 June 2022

Published in Physica A (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1607.01317

zbMATH Keywords

dynamic optimizationquantum mechanicsconstrained systemsDirac's method

Mathematics Subject Classification ID

Closed and approximate solutions to the Schrödinger, Dirac, Klein-Gordon and other equations of quantum mechanics (81Q05) Constrained dynamics, Dirac's theory of constraints (70H45) General quantum mechanics and problems of quantization (81Sxx)

Abstract: We study the structure of a simple dynamic optimization problem consisting of one state and one control variable, from a physicist's point of view. By using an analogy to a physical model, we study this system in the classical and quantum frameworks. Classically, the dynamic optimization problem is equivalent to a classical mechanics constrained system, so we must use the Dirac method to analyze it in a correct way. We find that there are two second-class constraints in the model: one fix the momenta associated with the control variables, and the other is a reminder of the optimal control law. The dynamic evolution of this constrained system is given by the Dirac's bracket of the canonical variables with the Hamiltonian. This dynamic results to be identical to the unconstrained one given by the Pontryagin equations, which are the correct classical equations of motion for our physical optimization problem. In the same Pontryagin scheme, by imposing a closed-loop $lambda$-strategy, the optimality condition for the action gives a consistency relation, which is associated to the Hamilton-Jacobi-Bellman equation of the dynamic programming method. A similar result is achieved by quantizing the classical model. By setting the wave function $Psi(x,t)=e^{iS(x,t)}$ in the quantum Schr"odinger equation, a non-linear partial equation is obtained for the $S$ function. For the right-hand side quantization, this is the Hamilton-Jacobi-Bellman equation, when $S(x,t)$ is identified with the optimal value function. Thus, the Hamilton-Jacobi-Bellman equation in Bellman's maximum principle, can be interpreted as the quantum approach of the optimization problem.

Recommendations

• The quantum dark side of the optimal control theory
• The analysis of the dynamic optimization problem in econophysics from the point of view of the symplectic approach for constrained systems
• Dynamic programming and quantum mechanical motion
• scientific article; zbMATH DE number 4042652
• Quasicanonical structure of optimal control in constrained discrete systems.

Cites work

• scientific article; zbMATH DE number 50791 (Why is no real title available?)
• scientific article; zbMATH DE number 2133321 (Why is no real title available?)
• A Black-Scholes Schrödinger option price: `bit' versus `qubit'
• A PATH INTEGRAL APPROACH TO DERIVATIVE SECURITY PRICING I: FORMALISM AND ANALYTICAL RESULTS
• A discussion on embedding the Black-Scholes option pricing model in a quantum physics setting
• Generalized Hamiltonian dynamics
• Multi-asset Black-Scholes model as a variable second class constrained dynamical system
• Option pricing, stochastic volatility, singular dynamics and constrained path integrals
• Path integrals in physics. Vol. 1: Stochastic processes and quantum mechanics. Vol. 2: Quantum field theory, statistical physics and other modern applications
• Path integrals in quantum mechanics, statistics, polymer physics, and financial markets.
• Quantum Finance
• Stochastic volatility models at = 1 as second class constrained Hamiltonian systems
• The path integral approach to financial modeling and options pricing
• The theory of dynamic programming

Cited in

(6)

• The analysis of the dynamic optimization problem in econophysics from the point of view of the symplectic approach for constrained systems
• Loop quantum gravity with optimal control path integral, and application to black hole tunneling
• Second class constraints and the consistency of optimal control theory in phase space
• The quantum dark side of the optimal control theory
• On One Method of Optimization of Quantum Systems Based on the Search for Fixed Points
• Dynamic programming and quantum mechanical motion

This page was built for publication: Dynamic optimization and its relation to classical and quantum constrained systems

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2145555)