Hitting-time and occupation-time bounds implied by drift analysis with applications

Advances in Applied Probability - Tập 14 Số 3 - Trang 502-525 - 1982
Bruce Hajek1
1University of Illinois

Tóm tắt

Bounds of exponential type are derived for the first-hitting time and occupation times of a real-valued random sequence which has a uniform negative drift whenever the sequence is above a fixed level. The only other assumption on the random sequence is that the increments satisfy a uniform exponential decay condition. The bounds provide a flexible technique for proving stability of processes frequently encountered in the control of queues.

Two applications are given. First, exponential-type bounds are derived for a GI/G/1 queue when the service distribution is exponential type. Secondly, geometric ergodicity is established for a certain Markov chain in which arises in the decentralized control of a multi-access, packet-switched broadcast channel.

Từ khóa


Tài liệu tham khảo

Doob, 1953, Stochastic Processes.

10.1287/opre.17.6.1058

10.1016/0022-247X(60)90005-6

Kingman, 1974, A martingale inequality in the theory of queues, Proc. Camb. Phil. Soc., 59, 359

10.1214/aop/1176995527

Hajek B. and Van Loon T. (1982) Decentralized dynamic control of a multi-access broadcast channel. IEEE Trans. Automatic Control 27,

Meyer, 1966, Probability and Potentials.

10.1214/aoms/1177731235

Kingman, 1970, Inequalities in the theory of queues, J. R. Statist. Soc., B32, 102

Malysev, 1972, Classification of two-dimensional positive random walks and almost linear semimartingales, Soviet Math., 13, 136

10.1214/aop/1176995659

Breiman, 1968, Probability.

10.1214/aop/1176996503

10.1007/978-1-4684-9455-6

10.1017/S0021900200033556

10.1016/0022-247X(63)90083-0

10.1017/S0001867800042907

10.1017/S0021900200036913

10.1017/S1446788700027786

10.1007/BF00539120

10.1137/0117081

Teugels, 1967, Exponential decay in renewal theorems, Bull. Soc. Math. Belg., 19, 259