Constrained Continuous-Time Markov Control Processes with Discounted Criteria (Q4799713)

From MaRDI portal

!

This is the item page for this Wikibase entity, intended for internal use and editing purposes. Please use the normal view instead:

scientific article; zbMATH DE number 1887602
Language Label Description Also known as
default for all languages
No label defined
    English
    Constrained Continuous-Time Markov Control Processes with Discounted Criteria
    scientific article; zbMATH DE number 1887602

      Statements

      Constrained Continuous-Time Markov Control Processes with Discounted Criteria (English)
      0 references
      0 references
      25 March 2003
      0 references
      continuous-time Markov processes
      0 references
      unbounded reward/cost
      0 references
      transition rates
      0 references
      discounted criteria
      0 references
      constrained-optimal policy
      0 references
      0 references
      0 references
      0 references
      0 references
      Constrained continuous-time Markov control processes (MCPs) with a denumerable state space and possibly unbounded transition and reward/cost rates are studied. The performance index to be maximized is an expected discounted reward and a constraint is imposed on expected discounted cost.Conditions for the existence of constrained-optimal policies are derived with the help of the Lagrange approach. An example of controlled queueing system is given to illustrate the obtained results. It is worth to mention that the paper is the first attempt to fill the gap between constrained discrete-time MCPs and unconstrained continuous-time ones.
      0 references

      Identifiers