Reinforcement learning from comparisons: Three alternatives are enough, two are not - HAL-SHS - Sciences de l'Homme et de la Société Accéder directement au contenu
Article Dans Une Revue The Annals of Applied Probability Année : 2017

Reinforcement learning from comparisons: Three alternatives are enough, two are not

Résumé

This paper deals with two generalizations of the Polya urn model where, instead of sampling one ball from the urn at each time, we sample two or three balls. The processes are defined on the basis of the problem of finding the best alternative using pairwise comparisons which are not necessarily transitive: they can be thought of as evolutionary processes that tend to reinforce currently efficient alternatives. The two processes exhibit different behaviors: with three balls sampled, we prove almost sure convergence towards the unique optimal solution of the comparisons problem while, in some cases, the process with two balls sampled has almost surely no limit. This is an example of a natural reinforcement model with no exchangeability whose asymptotic behavior can be precisely characterized.

Dates et versions

halshs-01630231 , version 1 (07-11-2017)

Identifiants

Citer

Benoit Laslier, Jean-François Laslier. Reinforcement learning from comparisons: Three alternatives are enough, two are not. The Annals of Applied Probability, 2017, 27 (5), pp.2907-2925. ⟨10.1214/16-AAP1271⟩. ⟨halshs-01630231⟩
179 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More