The Sequential Design of Bernoulli Experiments Including Switching Costs (Q3678396)

From MaRDI portal

!

This is the item page for this Wikibase entity, intended for internal use and editing purposes. Please use the normal view instead:

scientific article; zbMATH DE number 3899869
Language Label Description Also known as
default for all languages
No label defined
    English
    The Sequential Design of Bernoulli Experiments Including Switching Costs
    scientific article; zbMATH DE number 3899869

      Statements

      The Sequential Design of Bernoulli Experiments Including Switching Costs (English)
      0 references
      0 references
      0 references
      1985
      0 references
      Bernoulli experiments
      0 references
      optimal design
      0 references
      one-armed bandit problem
      0 references
      We consider a sequence of N trials, each of which must be performed on one of two given Bernoulli experiments. We assume the success probability of one experiment is known and the other is unknown. Performing two successive trials on different experiments incurs a switching cost. The problem is to choose an experiment for each trial in order to maximize the expected number of successes minus the expected switching costs. We show that an optimal design shares some well-known monotonicity properties, such as the ''stopping-rule'' and the ''stay-on-a-winner'' rule. We also show how to use these results to derive a simple algorithm for calculating the optimal design. Since the model contains the one-armed bandit problem as a special case, we also obtain new proofs for known results.
      0 references

      Identifiers

      0 references
      0 references
      0 references
      0 references
      0 references
      0 references