用户名: 密码: 验证码:
关于一类非齐次马氏链的强极限定理
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
对马氏链的极限理论的研究是随机过程和极限理论中重要的研究课题之一,具有重要的理论意义和应用价值。有关齐次马氏链的研究已经形成了较完整的理论体系。实际数据的统计分析表明在大多数实际问题中随机系统的演化往往是时变的,必须考虑用非齐次马氏链来刻画,因此研究非齐次马氏链的极限理论是非常必要的,然而,由于缺乏适当的数学工具,关于非齐次马氏链的极限理论的研究结果并不多。本博士论文主要研究一类特殊非齐次马氏链一可列渐近循环马氏链的极限理论,我们证明了可列渐近循环马氏链的遍历性,强大数定律和熵定理,以及任意随机变量序列关于有限循环马氏链和有限m阶渐近循环马氏链的一类小偏差定理。还研究了关于时间离散状态连续非齐次马氏链的强偏差定理。
     本博士论文共分六章。
     第一章的第一节中介绍了马氏链的直观背景以及马氏链极限问题的研究进展。因为本文所研究的渐近循环马氏链是非齐次马氏链的一种特殊类型,所以在第二节中给出了关于非齐次马氏链的一些已知结果,如遍历性、强大数定律和强偏差定理,在论文的后续章节证明渐近循环马氏链的极限性质时,还会用到这些结论。第三节介绍了近年来关于渐近循环马氏链的研究成果,但这些研究仅局限在有限状态,本文将把其中的一些结果推广到可列状态。第四节详细的讲述了本论文的研究方法和主要结果。
     第二章首先研究了可列渐近循环马氏链泛函的强大数定律,作为推论,得到一个众所周知的非齐次马氏链的强大数定律,并且得到了可列渐近循环马氏链关于状态出现频率的强大数定律。最后,给出了可列渐近循环马氏链的Shannon-McMillan定理。
     第三章的第一节讨论了关于d步转移矩阵的C-强遍历性,然后给出了在此条件下可列非齐次循环马氏链的C-强遍历性。在第二节中首先研究了在强遍历的条件下,可列循环马氏链的收敛速度,然后进一步讨论了当满足不同条件时可列渐近循环马氏链的C-强遍历性、一致C-强遍历性和一致C-强遍历的收敛速度。
     第四章用样本散度率距离作为随机变量序列相对于马氏链的差异的一种度量,通过限制此偏差,确定了概率空间的某子集,研究了在这个子集上任意随机变量序列关于有限循环马氏链的一类小偏差定理。
     第五章利用m阶非齐次马氏链极限定理的已知结果,建立了任意随机变量序列关于m阶有限渐近循环马氏链状态出现频率的小偏差定理。作为推论,得到了这种马氏链的强大数定理和渐近均分割性。
     第六章研究的对象是时间离散状态连续的非齐次马氏链,首先引入渐近对数似然比作为随机变量序列与马氏链之间偏差的度量,通过构造非负鞅,得到了时间离散状态连续非齐次马氏链的强偏差定理。
The study of limit theories for markov chain have grant significance and widely application in theory and practice.It is one of the main research projects in random process and limit theory. The research related with the homogeneous Markov chain has formed a relatively complete theoretical system. The statistical analysis of the actual data show that the evolution of a stochasis system in most practical problems are often time-varying, we must consider using a nonhomogeneous Markov Chain to describe it, so sthdy the limit theory of nonhomogeneous Markov chain is very necessary, however, because of the lack of appropriate mathematical tools, the result of the limit theory study for nonhomogeneous Markov chain is not much. This doctoral mainly studies the limit theory for a special kind of nonhomogeneous Markov chain—asymptotic circular Markov chain. We discuss the ergodic, strong law and entropy theorem of the asymptotic circular Markov chain, and a class of small deviation theorems of any random variables sequence and asymptotic circular Markov chains. We also study the strong deviation theorem for discrete-time and continuous-state nonhomogeneous Markov chains.
     This doctoral dissertation consists of six chapters.
     In the first section of chapter1, we introduce the intuitive background of Markov chains and the research progress of the limit property of Markov chains. The asymptotic circular Markov chains studied in this paper is a special type of homogeneous Markov chain, so in the second section gives some known results about nonhomogeneous Markov chains, such as ergodicity, the strong law of large numbers and the strong deviation theorem which may be used in the subsequent chapters of the paper to prove the asymptotic properties of asymptotic circular markov chains, and these conclusions may be used. In the third section, we introduced the research achievements of asymptotic circular markov chains in the recent years, but these studies are confined to the finite state, this article will extended some to the countable state. The fourth quarter presents the research methods and main results of this paper in details.
     In chapter2, we study the strong law of large numbers for the functions of countable asymptotic circular Markov chains first. As corollary, we generalize a well-known version of the strong law of large numbers for nonhomogeneous Markov chains, and the strong law of large numbers on the frequences of occurrence of states for countable asymptotic circular Markov chains. Finally, we establish the Shannon-McMillan-Breiman theorem for this Markov chains。
     The first quarter of chapter3, we discussed about the C-strong ergodicity of d-step transition matrix, and then give the C-strong ergodicity of countable nonhomogeneous circular Markov chain in terms of the C-strong ergodicity of d-step transition matrix. In the second section first studied the convergence rate of the countable circular Markov chains under the condition of strong ergodic, and then further discusses the C-strong ergodicity, the uniformly C-strong ergodicity of countable asymptotic circular Markov and the rate of convergence in Cesaro sense for countable asymptotic circular Markov under different conditions.
     In chapter4, we use the samples divergence rate as a measure of difference between the sequence of random variables and Markov chains, is introduced. By restricting the deviation, a subset of sample space is determined, and on this subset the small deviation theorems for arbitrary random variables sequence on finite circular Markov chains are obtained.
     In chapter5, we apply the known results of the limit theorem to mth-order nonhomogeneous Markov chains, the small deviation theorem on the frequencies of occurrence of states for mth-order asymptotic circular Markov chains is established. As corrally, the strong law of large numbers and asymptotic equipartition property for this Markov chain is obtained.
     In chapter6, we study the discrete-time and continuous-state nonhomogeneous Markov chains. First, we introduce the notion of asymptotic average log-likelihood ratio, as a measure of the difference between the sequence of random variables and Markov chains, and by constructing a nonnegative martingale, the strong deviation theorem for discrete-time and continuous-state nonhomogeneous Markov chains is established.
引文
[1]Algoet P, Cover T M. A sandwish proof of the Shannon-Mcmillan-Breiman theorem [J]. Annals of Probability,1988,16:899-909.
    [2]Ash R B. Real Analysis and Probability [M]. New York:Academic Press,1972.
    [3]Breiman L. The individual ergodic theorem of information theory [J].Annals of Mathematical Statistics,1957,28:629-635,809-811.
    [4]Bowerman B, David H T, Isaacson D. The convergence of Cesaro averages for certain nonsationary Markov chains [J]. Stochastic Processes and their Applications, 1977(5):221-230.
    [5]Barron A R. The strong ergodic theorem for densities:Generalized Shannon-McMillan-Breiman theorem, Annals of Probability,1985,13:1292-1303.
    [6]Billingsley P. Probability and Measure [M]. New York:Wiley,1986.
    [7]Campos V S M, Pereira A G C, Rojas Cruz J A. Modeling the genetic algorithm by a nonhomogeneous Markov Chain:weak and strong ergodicity [J]. Theory of Probability and its Applications,2013,57(1):144-U208.
    [8]Chow Y S, Teicher H.Probability Theory [M]. Springer,1988.
    [9]Chung K L. Markov chains with stationary transition probability [M]. Berlin: Springer,1967.
    [10]Chung K L. A course in probability theory [M]. New York:Academic Press,1974(中译本:钟开莱著.刘文,吴让泉译.概率论教程[M].上海:上海科学技术出版社,1989.)
    [11]Chung K L. The ergodic theorem of information theory [J]. Annals of Mathematical Statistics,1961,32:612-614.
    [12]Chen M F, Wang Y Z.Algebraic convergence of Markov chains[J]. Annals of Probability,2003,13:604-627.
    [13]Cover T M, Thomas J A. Elements of Information [M]. New York:Wiley,1991.
    [14]陈永义,傅自晦,张学显.非齐次马尔科夫链遍历性的一些结果[J].系统科学与数学,1996,16(4):311-317
    [15]Doob J L. Stochastic Processes [M]. New York:Wiley,1953.
    [16]David Freedman. Markov Chains [M]. New York:Springer-Verlag,1983.
    [17]Feller W. An introduction to Probability and its Applications (Vol.1) [M]. New York: Willey,1957.(第一卷中译本:威廉·费勒著,上册,胡迪鹤,林向清译,下册,刘文译,概率论及其应用.北京:科学出版社,1964,1979)
    [18]方舒.二重非齐次马氏链的遍历性及其应用[J].数学研究,2010,43(1):55-66.
    [19]高小燕.关于渐近循环马氏链泛函的强大数定律[J].大学数学,2013,29(1):38-41.
    [20]Halmos P R. Measure Theory [M]. New York:Springer,1974.(中译本:P. R. Halmos著.王建华译.测度论[M].北京:科学出版社,1965.)
    [21]Hall P, Heyde C C. Martingle Limit Theory and its Application [M]. New York: Academic Press,1980.
    [22]He Q, Yin G, Zhang Qing. Large deviations for two-time-scale systems driven by nonhomogeneous Markov chains and associated optimal control problems [J]. Siam Journal on Control and Optimization,2011,49(4):1737-1765.
    [23]胡迪鹤.随机过程论—基础·理论·应用[M].武汉大学出版社,2000.
    [24]Huang C C, Isaacson D, Vinograde B. The rate of convergence of certain nonsationary Markov chains [J]. Z.Wahrscheinlichkeitstheories Verw. Gebiete, 1976(35):141-146.
    [25]Isaacson D, Madsen R. Markov chains theory and application [M]. New York:Wiley, 1976.
    [26]Isaacson D, Senta E. Ergodicity for countable inhomogeneous Markov chains [J]. Linear Algebra Application,1982,48:37-44.
    [27]John G Kemeny, J Laurie Snell, Finite, Markov Chains [M], Springer-Verlag, New York Berlin Heidelberg Tokyo,1976.
    [28]姜蕾,王豹.可列m重非齐次马氏链的遍历性与熵率[J].工程数学学报,2010,27(3):446-454.
    [29]金少华.关于可列非齐次马尔科夫链的一类强极限定理[J].应用概率统计,2002,18(3):230-234.
    [30]Kieffer J C. A simple proof of the Moy-Perez generalization of the Shannon-McMillan theorem [J].Pacific Journal of Mathematics,1974,51:203-204.
    [31]Loeve M. Probability Theory [M]. New York:Springer,1977.
    [32]Laha R G, Rohatgi V K. Probability Theory [M]. New York:Springer,1979.
    [33]李芳.非齐次马氏链的收敛及收敛速度[硕士学位论文].镇江:江苏大学,2005.
    [34]林正炎,陆传荣,苏中根.概率极限理论基础[M].高等教育出版社,2001.
    [35]Liu G X, Liu W. On the strong law of large numbers for functional of countable nonhomogeneous Markov chains [J]. Stochastic Processes Application,1994, 50:375-391.
    [36]刘文.强偏差定理与分析方法[M].北京:科学出版社,2003.
    [37]Liu W. Relative entropy densities and a class of limit theorems of the sequence of m-valued random variables [J]. Annals of Probability,1990,18(2):829-839.
    [38]Liu W. A kind of strong deviation theorem for the sequences of nonnegative integer-valued random variables [J]. Statistics & Probability Letters,1997, 32:343-349.
    [39]Liu W. Some limit properties of the multivariate function sequences of discrete random variables [J]. Statistics & Probability Letters,2003,61:41-50.
    [40]Liu W, Liu G X. A class of strong laws for functional of countable nonhomogeneous Markov chains [J]. Statistics & Probability Letters,1995,22:87-96.
    [41]刘文,刘国欣,陈志刚.可列非齐次马氏链泛函的一类强大数定律[J].经济数学,1995,12(1):1-8.
    [42]刘文,刘自宽.对数似然比与整值随机变量序列的一类强律[J].1997,17(4):316-323.
    [43]刘文,王玉津.连续型随机变量序列的一类强偏差定理[J].数学物理学报,2001,21A(1):23-28.
    [44]Liu W, Yan J A, Yang W G. A limit theorem for partial sums of random variables and its applications [J]. Statistics & Probability Letters,2003(62):79-86.
    [45]Liu W, Yang W G. A limit theorem for the entropy density of nonhomogeneous Markov information source [J]. Statistics & Probability Letters,1995(22):295-301.
    [46]Liu W, Yang W G. Some limit properties of nonhomogeneous Markov information source [J]. J. of Combinatorics, Information & System Sciences (JCISS),1995(20), Nos.1-4:279-292.
    [47]Liu W, Yang W G. A Extension of Shannon-McMillam Theorem and some limit properties for nonhomogeneous Markov chains [J]. Stochastic Processes,1996,61: 129-145.
    [48]Liu W, Yang W G. The Markov approximation of the sequence of N-valued random variables and a class of small deviation theorems [J]. Stochastic Processed,2000,89: 117-130.
    [49]Liu W, Yang W G. A class of strong limit theorem for the sequence of arbitrary random variables [J]. Statistics & Probability. Letters,2003(64):121-131.
    [50]刘文,杨卫国.关于可列非齐次马氏链的若干极限定理[J].应用数学学报.1992,15(4):479-489.
    [51]刘文,杨卫国.一类可列非齐次Markov链普遍成立的强大数定律[J].科学通报,1992,37(16):1448-1451.
    [52]刘文,杨卫国.相对熵密度与任意二进信源的若干极限性质[J].应用数学学报,1994,17(1):85-99.
    [53]刘文,杨卫国.任意信源与马氏信源的比较及小偏差定理[J].数学学报,1996,1(39):22-36.
    [54]刘文,杨卫国.关于非齐次马氏信源的渐近均分割性[J].应用概率统计,1997,4(3):359-366.
    [55]吕以茜.有限渐近循环马氏链样本相对熵率存在定理和散度率[硕士学位论文].镇江:江苏大学,2011.
    [56]陆传荣,林正炎[M].混合相依随机变量的极限定理[M].北京:科学出版社,1997.
    [57]McMillan B. The basic theorems of information theory [J]. Annals of Mathematical Statistics,1953,24:196-219.
    [58]Madsen R W, Isaacson D L. Strongly ergodic behavior for non-stationary Markov processes [J]. The Annals of Probability,1973,1(2):329-335.
    [59]Meyn S P, Tweedie R L. Markov chains and Stochastic Stability. Springer-Verlag, 1993.
    [60]Mukhamedov, Farrukh. The Dobrushin ergodicity coefficient and the ergodicity of noncommutative Markov chains [J]. Journal of Mathematical analysis and applications,2013,408(1):364-373.
    [61]孟庆生.信息论[M].西安:西安交通大学出版社,1986.
    [62]Nicolaie, Alina. A generalization of a result concerning the asymptotic behavior of finite Markov chains [J]. Statistics & Probability Letters,2008,78(18):3321-3329.
    [63]Palacios, Jose Luis. A note on circular Markov chains [J]. Statistics & Probability Letters,2000,47(3):301-306.
    [64]潘恒,杨卫国.齐次树上三次循环树指标马氏链的强极限定理[J].系统科学与数学,2010,30(5):710-720.
    [65]Pulka, Malgorzata. On the mixing property and the ergodic principle for nohomogeneous Markov chains [J]. Linear Algebra and its Applications, 2011,434(6):1475-1488.
    [66]Ross S.Stochastic processes[M].John Wily&Sons, New York,1982.
    [67]Revesz P. The Strong Laws of Large Numbers [M]. New York:Academic Press,1968.
    [68]Rosenblatt R M. Some theorems concerning the strong law of large numbers for nonhomogeneous Markov chains [J]. Annals of Mathematical Statistics 1964(35):566-575.
    [69]Shannon C. A mathematical theory of communication [J]. Bell System Technical Journal,1948,27:379-423,623-656.
    [70]史及民.离散鞅及其应用[M].北京:科学出版社,1999.
    [71]施仁杰.马尔科夫链基础及应用[M].西安电子科技大学出版社,1992.
    [72]Tan C P. On the weak ergodicity of nonhomogeneous Markov chains [J]. Statisitics & Probability Letters,1996,26:293-295.
    [73]汤莹.渐近循环m阶马氏链的强极限定理[硕士学位论文].镇江:江苏大学,2010.
    [74]王蓓.时间离散状态连续非齐次马氏链的强大数定理[J].江苏大学学报(自然科学版),2008,29(1):86-88.
    [75]王育民,梁传甲.信息与编码理论[M].西安:西安电讯工程学院出版社,1986.
    [76]王梓坤.随机过程论[M].北京:科学出版社,1978.
    [77]汪嘉冈.现代概率论基础[M].上海:复旦大学出版社,1988.
    [78]汪忠志.M值随机变量序列与Markov链的比较及其强偏差定理[J].华东冶金学院学报,2000,17(1):65-69.
    [79]汪忠志,杨卫国.关于相依离散随机序列的若干强偏差定理[J].系统科学与数学,2011,31(8):932-942.
    [80]Xu Z, Han D. Rate function of large deviation for a class of nonhomogeneous markov chains on supercritical percolation network [J]. Acta Mathematica Sinica-English Series,2011,27(9):1813-1830.
    [81]严加安.测度论讲义(第二版)[M].北京:科学出版社,2004.
    [82]严士健,王秀骧,刘秀芳.概率论基础[M].北京:科学出版社,1985.
    [83]Yang W G. The asymptotic equipartition property for a nonhomogeneous Markov information source [J]. Probability in the Engineering and Information Sciences,1998, 12:509-518.
    [84]Yang W G. Convergence in the Cesaro sense and strong law of large numbers for nonhomogeneous Markov chains [J]. Linear Algebra and its Applications 2002(354):275-288.
    [85]Yang W G. Strong law of large numbers for countable nonhomogeneous Markov chains [J]. Linear Algebra and its Applications,2009(430):3009-3018.
    [86]Yang W G A Class of Strong Deviation Theorems for the Random Fields Associated with Nonhomogeneous Markov Chains Indexed by a Bethe Tree [J]. Stochastic analysis and applications,2012,30(2):220-237.
    [87]杨卫国.任意N值随机变量序列关于m阶非齐次马氏链的一类小偏差定理[J].数学物理学报,2009,29A(2):517-527.
    [88]杨卫国.关于非齐次马氏链的绝对平均遍历性及若干应用[J].数理统计与应用概率,1996(3)
    [89]杨卫国,刘开弟.可列非齐次马氏链二元泛函的强大数定律[J].应用概率统计,1998,14(4):381-385
    [90]杨卫国,梁佩佩.三重循环马氏链的强大数定律[J].江苏大学学报(自然科学版),2010,31(3):369-372.
    [91]杨卫国,刘文.关于非齐次二重马氏信源的若干极限定理[M].应用概率统计,1999,15(2):113-123.
    [92]杨卫国,刘文.关于任意随机序列的强收敛性[J].数学物理学报,2003,23A(5):565-572.
    [93]Yang W G, Liu W. The asymptotic equipartition property for mth-order nonhomogeneous Markov information sources [J]. IEEE Transactions Ransactions Ansactions on Information Theory,2004,50(12):3326-3330.
    [94]Yang W G, Wang X S. The asymptotic equipartition property for countable mth-order nonhomogeneous Markov chains [J]. Pakistan Journal of Statistics,2013,29(1):1-12.
    [95]杨卫国,叶中行.Cayley树图上奇偶马氏链场的渐近均分割性[J].应用概率统计,2006,22(1):35-42.
    [96]杨卫国,钟萍萍,梁佩佩.渐近循环马氏链的强大数定律[J].江苏大学学报(自 然科学版),2011,32(1):116-119.
    [97]朱成熹等.非齐次马氏链函数的强大数定律[J].数学学报,1988,31(4):464—74.
    [98]Zach D, Sunder S. Large deviations for a class of nonhomogeneous Markov chains [J]. Annals of Probability,2005,15:421-486.
    [99]赵静,魏杰.关于可列非齐次马氏泛函的一类强偏差定理[J].应用概率统计,2005,21(1):176-182.
    [100]Zhong P P, Yang W G, Liang P P. The asymptotic euipartiton property for asymptotic circular Markov chains [J]. Probability in the Engineering and Informational Sciences,2010(24):279-288.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700