Criteria for classifying general Markov chains

Advances in Applied Probability - Tập 8 Số 4 - Trang 737-771 - 1976
Richard L. Tweedie1
1C.S.I.R.O. Division of Mathematics and Statistics, Canberra

Tóm tắt

The aim of this paper is to present a comprehensive set of criteria for classifying as recurrent, transient, null or positive the sets visited by a general state space Markov chain. When the chain is irreducible in some sense, these then provide criteria for classifying the chain itself, provided the sets considered actually reflect the status of the chain as a whole. The first part of the paper is concerned with the connections between various definitions of recurrence, transience, nullity and positivity for sets and for irreducible chains; here we also elaborate the idea of status sets for irreducible chains. In the second part we give our criteria for classifying sets. When the state space is countable, our results for recurrence, transience and positivity reduce to the classical work of Foster (1953); for continuous-valued chains they extend results of Lamperti (1960), (1963); for general spaces the positivity and recurrence criteria strengthen those of Tweedie (1975b).

Từ khóa


Tài liệu tham khảo

10.1017/S0021900200048701

10.1214/aop/1176996553

10.1016/0022-247X(71)90189-2

Tuominen P. and Tweedie R. L. (1977) Markov chains with continuous components. (Submitted for publication).

Tweedie R. L. (1976) Modes of convergence of Markov chain transition probabilities. J. Math. Anal. Appl. (To appear)

10.1214/aop/1176996552

10.1016/0304-4149(75)90033-2

10.1215/S0012-7094-58-02561-4

10.1287/opre.17.6.1058

10.1214/aoms/1177728976

Revuz, 1975, Markov Chains.

10.1112/jlms/s2-10.4.389

10.1214/aop/1176996393

10.1016/0022-247X(60)90005-6

Orey, 1971, Lecture Notes on Limit Theorems for Markov Chains on a General State Space.

10.1007/BF00533942

Laslett G. M. , Pollard D. B. and Tweedie R. L. (1976) Techniques for establishing ergodic properties of continuous-valued Markov chains. (Submitted for publication).

10.1214/aoms/1177704148

10.1287/opre.21.2.617

10.1007/BF00535963

10.1090/S0002-9904-1945-08378-5

Calton W. G. and Rogers G. S. (1976) On classifying discrete time Markov processes. (Submitted for publication).

10.1007/BF00533381

Chung, 1967, Markov Chains with Stationary Transition Probabilities

Doob, 1953, Stochastic Processes.

10.1145/321724.321735

10.1214/aop/1176996037

10.1090/S0002-9939-1957-0091564-3

Hordijk A. and Van Goethem P. (1973) A criterion for the existence of invariant probability measures in Markov processes. Mathematisch Centrum Prepublication SW 22/73.

10.1016/0022-247X(63)90083-0

10.1017/S0305004100032941

10.1007/BF00539120

Šidák, 1967, Trans. 4th Prague Conf. Inf. Theory Stat. Dec. Functions, Random Procs. 1965, 547

Tomášek L. (1971) On Superregular Functions in Markov Chains and Related Inequalities (Czech.). Unpublished Ph.D. thesis, Charles University, Prague.

10.1007/BF00533994

10.1017/S0305004100051562

10.1111/j.1467-842X.1975.tb00945.x

10.1093/biomet/48.3-4.391

Thông tin
Thông tin xuất bản

Advances in Applied Probability

Tập 8 Số 4

737-771

Thông tin tác giả