katehakis, 1987, The multiarmed bandit problem: Decomposition and computation, Mathematics of Operations Research, 12, 262, 10.1287/moor.12.2.262
gittins, 1979, Bandit processes and dynamic allocation indices, Journal of the Royal Statistical Society B, 41, 148
bertsekas, 2001, Dynamic Programming and Optimal Control
10.1109/TAC.1985.1103989
10.1109/TAC.1986.1104332
nino-mora, 1999, Restless Bandits Partial Conservation Laws and Indexability
10.1109/78.969499
10.2307/3214163
washburn, 1997, Stochastic dynamic programming for far-sighted sensor management, IRIS National Symposium on Sensor and Data Fusion, 2, 277