Behavioral analytics for myopic agents
From MaRDI portal
Abstract: Many multi-agent systems have the structure of a single coordinator providing behavioral or financial incentives to a large number of agents. Two challenges faced by the coordinator are a finite budget from which to allocate incentives, and an initial lack of knowledge about the utility function of the agents. Here, we present a behavioral analytics approach to solve the coordinator's problem when agents make decisions by maximizing utility functions that depend on prior system states, inputs, and other parameters that are initially unknown and subject to temporal dynamics. Our behavioral analytics framework involves three steps: first, we develop a behavioral model that describes the decision-making process of an agent; second, we use data to estimate behavioral model parameters for each agent and then use these estimates to predict future decisions of each agent; and third, we use the estimated behavioral model parameters to optimize a set of costly incentives to provide to each agent. In this paper, we describe a specific set of tools, models, and approaches that fit into this framework, and that adapt models and incentives as new information is collected by repeating the second and third steps of this framework. Furthermore, we prove that incentives computed by this adaptive approach are asymptotically optimal with respect to a given loss function that describes the coordinator's objective. We optimize incentives using a decomposition scheme, where each sub-problem solves the coordinator's problem for a single agent, and the master problem is a pure integer program. We conclude with a simulation study to evaluate the effectiveness of our behavioral analytics approach in designing personalized treatment plans for a weight loss program. The results show our approach maintains efficacy of the program while reducing costs by up to 60%, while adaptive heuristics provide less savings.
Cites work
- Behavioral modeling in weight loss interventions
- Catch-up scheduling for childhood vaccination
- Decentralized Control of a Stochastic Multi-Agent Queueing System
- Dynamic forecasting and control algorithms of glaucoma progression for clinician decision support
- Dynamics on linear influence network games under stochastic environments
- Evaluation of scenario generation methods for stochastic programming
- Foundations of bilevel programming
- scientific article; zbMATH DE number 5562427 (Why is no real title available?)
- scientific article; zbMATH DE number 35514 (Why is no real title available?)
- scientific article; zbMATH DE number 2107836 (Why is no real title available?)
- scientific article; zbMATH DE number 1416629 (Why is no real title available?)
- scientific article; zbMATH DE number 6026918 (Why is no real title available?)
- Improving health outcomes through better capacity allocation in a community-based chronic care model
- Inverse combinatorial optimization: a survey on problems, methods, and results
- Inverse Optimization
- Inverse optimization with noisy data
- Mean field equilibrium in dynamic games with strategic complementarities
- Monotone Piecewise Affine Systems
- On continuous convergence and epi-convergence of random functions. II: Sufficient conditions and applications.
- On the power and limitations of affine policies in two-stage adaptive optimization
- Online decision making with high-dimensional covariates
- OR forum: A POMDP approach to personalize mammography screening decisions
- Persistence of excitation conditions and the convergence of adaptive schemes
- Provably safe and robust learning-based model predictive control
- Repeated Principal-Agent Games with Discounting
- Revenue Management for a Primary-Care Clinic in the Presence of Patient Choice
- Statistical modeling: The two cultures. (With comments and a rejoinder).
- Statistics with set-valued functions: applications to inverse approximate optimization
- Stochastic optimization for vaccine and testing kit allocation for the COVID-19 pandemic
- The big data newsvendor: practical insights from machine learning
- The Folk Theorem with Imperfect Public Information
- The Mixed Integer Linear Bilevel Programming Problem
This page was built for publication: Behavioral analytics for myopic agents
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6168502)
