Planning treatment of ischemic heart disease with partially observable Markov decision processes

Artificial Intelligence in Medicine - Tập 18 Số 3 - Trang 221-244 - 2000
Miloš Hauskrecht1, Hamish Fraser2
1Computer Science Department, Box 1910, Brown University, Providence, RI 02912, USA
2Tufts-New England Medical Center, 750 Washington Street, Boston, MA 02111, USA

Tóm tắt

Từ khóa


Tài liệu tham khảo

Anderson, 1990, Cardiovascular disease risk profiles, Am. Heart J., 121, 293, 10.1016/0002-8703(91)90861-B

Astrom, 1965, Optimal control of Markov decision processes with incomplete state estimation, J. Math. Anal. Applic., 10, 174, 10.1016/0022-247X(65)90154-X

Bellman, 1957

Bertsekas, 1995

Berzuini C, Bellazzi R, Spiegelhalter D. Bayesian networks applied to therapy monitoring. In Proceedings of the Seventh Conference on Uncertainty in Artificial Intelligence, 1991, p. 35–43.

Boutilier C, Poole D. Exploiting structure in policy construction. In Proceedings of the Thirteenth National Conference on Artificial Intelligence, 1996, p. 1168–1175.

Dean, 1989, A model for reasoning about persistence and causation, Comput. Intell., 5, 142, 10.1111/j.1467-8640.1989.tb00324.x

Drake A. Observation of a Markov Process through a Noisy Channel. PhD thesis, Massachusetts Institute of Technology, 1962.

Hauskrecht M. Incremental methods for computing bounds in partially observable Markov decision processes. In Proceedings of the Fourteenth National Conference on Artificial Intelligence, 1997, p. 734–739.

Hauskrecht M. Planning and control in stochastic domains with imperfect information. PhD thesis, Massachusetts Institute of Technology, 1997.

Hauskrecht M, Fraser H. Modeling treatment of ischemic heart disease with partially observable Markov decision processes. In Proceedings of American Medical Informatics Association anneal symposium on Computer Applications in Health Care, 1998, p. 538–542.

Hauskrecht M, Fraser H. Planning medical therapy using partially observable Markov decision processes. In Proceedings of the Ninth International Workshop on Principles of Diagnosis (DX-98), 1998, p. 182–189.

Howard, 1960

Howard RA, Matheson JE. Influence diagrams. Principles and Applications of Decision Analysis 2, 1984.

Hu, 1996, Comparison of some suboptimal control policies in medical drug therapy, Oper. Res., 44, 696, 10.1287/opre.44.5.696

Pack Kaelbling L, Littman ML, Cassandra AR. Planning and acting in partially observable stochastic domains. Artif. Intell. 1999:101.

Kjaerulff U. A computational scheme for reasoning in dynamic probabilistic networks. In Proceedings of the Eighth Conference on Uncertainty in Artificial Intelligence, 1992, p. 121–129.

Littman ML. Algorithms for sequential decision making. PhD thesis, Brown University, 1996.

Lovejoy, 1991, A survey of algorithmic methods for partially observed Markov decision processes, Ann. Oper. Res., 28, 47, 10.1007/BF02055574

Mundhenk M, Goldsmith J, Lusena C, Allender E. Encyclopaedia of complexity results for finite-horizon Markov decision process problems. Technical report, UK CS Dept TR 273-97, University of Kentucky, 1997.

Owens, 1990, Medical decision making: Probabilistic medical reasoning

Papadimitriou, 1987, The complexity of Markov decision processes, Math. Oper. Res., 12, 441, 10.1287/moor.12.3.441

Pearl, 1988

Peek, 1999, Explicit temporal models for decision-theoretic planning of clinical management, Artif. Intell. Med., 15, 135, 10.1016/S0933-3657(98)00049-9

Platzman LK. Finite memory estimation and control of finite probabilistic systems. PhD thesis, Massachusetts Institute of Technology, 1977.

Puterman, 1994

Raiffa, 1970

Smallwood, 1973, The optimal control of partially observable processes over a finite horizon, Oper. Res., 21, 1071, 10.1287/opre.21.5.1071

Sondik EJ. The optimal control of partially observable Markov decision processes. PhD thesis, Stanford University, 1971.

Tatman, 1990, Dynamic programming and influence diagrams, IEEE Trans. Syst. Man Cyber., 20, 365, 10.1109/21.52548

Wong, 1990, Myocardial revascularization for chronic stable angina, Ann. Intern. Med., 113, 852, 10.7326/0003-4819-113-11-852