Stochastic dynamic programming based approaches to sensor resource management

R.B. Washburn1, M.K. Schneider1, J.J. Fox1
1Fusion Technology and Systems Division, Alpha Technologies, Inc., Burlington, USA

Tóm tắt

This paper describes a stochastic dynamic programming based approach to solve sensor resource management (SRM) problems such as occur in tracking multiple targets with electronically scanned, multi-mode radar Specifically, it formulates the SRM problem as a stochastic scheduling problem and develops approximate solutions based on the Gittins index rule. Novel results include a hybrid state stochastic model for the information dynamics of tracked targets, an exact index rule solution of the SRM problem for a simplified tracking model, and use of approximate dynamic programming to extend the index rule solution to more realistic models.

Từ khóa

#Stochastic processes #Dynamic programming #Resource management #Radar tracking #Target tracking #Sensor phenomena and characterization #Dynamic scheduling #Modems #Synthetic aperture radar #Strain control

Tài liệu tham khảo

katehakis, 1987, The multiarmed bandit problem: Decomposition and computation, Mathematics of Operations Research, 12, 262, 10.1287/moor.12.2.262 gittins, 1979, Bandit processes and dynamic allocation indices, Journal of the Royal Statistical Society B, 41, 148 bertsekas, 2001, Dynamic Programming and Optimal Control 10.1109/TAC.1985.1103989 10.1109/TAC.1986.1104332 nino-mora, 1999, Restless Bandits Partial Conservation Laws and Indexability 10.1109/78.969499 10.2307/3214163 washburn, 1997, Stochastic dynamic programming for far-sighted sensor management, IRIS National Symposium on Sensor and Data Fusion, 2, 277