Strategic experimentation with Poisson bandits

Artikel

We study a game of strategic experimentation with two-armed bandits where the risky arm distributes lump-sum payoffs according to a Poisson process. Its intensity is either high or low, and unknown to the players. We consider Markov perfect equilibria with beliefs as the state variable and show that all such equilibria exhibit an 'encouragement effect' relative to the single-agent optimum. There is no equilibrium in which all players use cut-off strategies. Owing to the encouragement effect, asymmetric equilibria in which players take turns playing the risky arm before all experimentation stops Pareto dominate the unique symmetric equilibrium. Rewarding the last experimenter with a higher continuation value increases the range of beliefs where players experiment, but may reduce the intensity of experimentation at more optimistic beliefs. This suggests that there is no equilibrium that uniformly maximizes the players' average payoff.

Object Details

• Language: Englisch

References and Relationships

• Bibliographic citation: Journal: Theoretical Economics ; ISSN: 1555-7561 ; Volume: 5 ; Year: 2010 ; Issue: 2 ; Pages: 275-311 ; New Haven, CT: The Econometric Society

Classification and Topics

• Classification: Wirtschaft ; Stochastic and Dynamic Games; Evolutionary Games; Repeated Games ; Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
• Subject: Strategic experimentation ; two-armed bandit ; Poisson process ; Bayesian learning ; piecewise deterministic process ; Markov perfect equilibrium ; differential-difference equation

Contributors, Places and Time

• Event: Geistige Schöpfung
• (who): Rady, Sven ; Keller, Godfrey
• Event: Veröffentlichung
• (who): The Econometric Society
• (where): New Haven, CT
• (when): 2010

Further information

• DOI: doi:10.3982/TE595
• Handle: http://hdl.handle.net/10419/150139
• Last update: 10.03.2025, 11:46 AM CET