A Technique for Stochastic Control Problems with Unbounded Control Set
Tóm tắt
We describe a change of time technique for stochastic control problems with unbounded control set. We demonstrate the technique on a class of maximization problems that do not have optimal controls. Given such a problem, we introduce an extended problem which has the same value function as the original problem and for which there exist optimal controls that are expressible in simple terms. This device yields a natural sequence of suboptimal controls for the original problem. By this we mean a sequence of controls for which the payoff functions approach the value function.
Tài liệu tham khảo
Beneš, V. E., Shepp, L. A., and Witsenhausen, H. S. (1980). Some solvable stochastic control problems. Stochastics 4, 39–83.
Billingsley, P. (1968). Convergence of Probability Measures, John Wiley, New York.
Bressan, A., and Rampazzo, F. (1988). On differential systems with vector-valued impulsive controls. Boll. Unione Mat. Italiana 2-B(7), 641–656.
Dorroh, J. R., and Ferreyra, G. S. (1994). A multi-state, multi-control problem with unbounded controls. SIAM J. Control and Optimization 32, 1322–1331.
Fleming, W. H., and Soner, H. M. (1993). Controlled Marker Processes and Viscosity Solutions, Appl. Math., Vol. 25, Springer-Verlag, New York.
Gihman, I. I., and Skorohod, A. V. (1972). Stochastic Differential Equations, Ergebnisse Math., Vol. 72, Springer-Verlag, New York.
Ito, K., and McKean, H. P., jr. (1965). Diffusion Processes and their Sample Paths, Grund. Math. Wiss., Vol. 125, Springer-Verlag, New York.
Karatzas, I., and Shreve, S. (1991). Brownian Motion and Stochastic Calculus, Graduate Texts in Math., Second Edition, Vol. 113, Springer-Verlag, New York.
Keilson, J., and Wellner, J. A. (1978). Oscillating Brownian Motion. J. Appl. Probab. 15, 300–310.
Knight, F. B. (1980). Essentials of Brownian Motion and Diffusion, Math. Surveys No. 18, American Math. Soc.
Krylov, N. V. (1980). Controlled Diffusion Processes, Springer-Verlag, New York.
Rogers, L. C. G., and Williams, D. (1987). Diffusions, Markov Processes, and Martingales, Vol. 2, John Wiley, New York.
Rozkosz, A., and Slominski, L. (1990). On weak convergence of solutions of one-dimensional stochastic differential equations. Stoch. and Stoch. Reports 31, 27–54.
Tapiero, C. S. (1975). On-line and adaptive optimum advertising control by a diffusion approximation, Operations Res. 23, 890–907.
Tapiero, C. S., Eliashberg, J., and Wind, Y. (1987). Risk behavior and optimum advertising with a stochastic dynamic sales response. Optima Control Appl. Methods 8, 299–304.