The Recurrence and Transience of Random Walks

Authors

  • Jiachen Liu

DOI:

https://doi.org/10.54097/mdb42w42

Keywords:

Markov chain; Stirling’s formula; estimation.

Abstract

This article reviews the research history and application fields of random walks and abstracts random walks into a time-homogeneous Markov chain to study their recurrent and transient properties. For one-dimensional and two-dimensional random walks, the likelihood of returning in  steps and the probability of returning for the first time in  steps of each state are first introduced, along with their relationship. Then the Stirling's formula is given, which is utilized to estimate the probability of returning in n steps, and the convergence and divergence of infinite series is used to prove that random walk in one dimension is recurrent. Random walk in two dimension has similar properties, which is a bit more complicated by using the relation between polynomials. Higher dimensional random walks need to consider special states first, and then generalize them to other states. Finally, this paper concluded that one-dimensional and two-dimensional random walks are recurrent, and random walks with dimensions higher than two are transient.

Downloads

Download data is not yet available.

References

Pearson K. The Problem of the Random Walk. Nature, 1905, 72: 294.

Bartumeus Frederic, et al. Animal Search Strategies: A Quantitative Random-Walk Analysis. Ecology, 2005, 3078–3087.

Abbott J T, Austerweil J L, Griffiths T L. Random walks on semantic networks can resemble optimal foraging. Psychol Rev, 2015, 122(3): 558-569.

Masuda N, Porter M, Lambiotte R. Random walks and diffusion on networks. Physics Reports, 2017.

Codling Edward A, Plank Michael J, Benhamou Simon. Random walk models in biology. Soc. Interface, 2008, 5813–5834.

Fama E F. Random walks in stock market prices. Financial analysts journal, 1995, 51(1): 75-80.

Carazza B. The history of the random-walk problem: considerations on the interdisciplinarity in modern physics. Riv. Nuovo Cim, 1977, 7.

Jonathan Novak. Pólya’s Random Walk Theorem. The American Mathematical Monthly, 2014, 711–16.

Blondel Oriane,et al. Random walk on random walks: higher dimensions. Electronic Journal of Probability, 2017.

Breiman L. Probability. Society for Industrial and Applied Mathematics, 1992.

Downloads

Published

26-04-2024

How to Cite

Liu, J. (2024). The Recurrence and Transience of Random Walks. Highlights in Science, Engineering and Technology, 94, 431-436. https://doi.org/10.54097/mdb42w42