4.5 Article

Ergodicity Coefficients for Higher-Order Stochastic Processes

Journal

SIAM JOURNAL ON MATHEMATICS OF DATA SCIENCE
Volume 2, Issue 3, Pages 740-769

Publisher

SIAM PUBLICATIONS
DOI: 10.1137/19M1285214

Keywords

nonnegative tensors; stochastic tensors; higher-order Markov chain; ergodicity coefficient; Z-eigenvector; vertex-reinforced random walk; spacey random walk; multilinear PageRank

Funding

  1. INdAM-GNCS, Italy
  2. departmental research project ICON (Innovative Combinatorial Optimization in Networks), DMIF-PRID 2017, University of Udine, Italy
  3. European Union's Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie individual fellowship MAGNET [744014.]

Ask authors/readers for more resources

The use of higher-order stochastic processes such as nonlinear Markov chains or vertex-reinforced random walks is significantly growing in recent years as they are much better at modeling high dimensional data and nonlinear dynamics in numerous application settings. In many cases of practical interest, these processes are identified with a stochastic tensor, and their stationary distribution is a tensor Z-eigenvector. However, fundamental questions such as the convergence of the process towards a limiting distribution and the uniqueness of such a limit are still not well understood and are the subject of rich recent literature. Ergodicity coefficients for stochastic matrices provide a valuable and widely used tool to analyze the long-term behavior of standard, first-order, Markov processes. In this work, we extend an important class of ergodicity coefficients to the setting of stochastic tensors. We show that the proposed higher-order ergodicity coefficients provide new explicit formulas that (a) guarantee the uniqueness of Perron Z-eigenvectors of stochastic tensors, (b) provide bounds on the sensitivity of such eigenvectors with respect to changes in the tensor, and (c) ensure the convergence of different types of higher-order stochastic processes governed by cubical stochastic tensors. Moreover, we illustrate the advantages of the proposed ergodicity coefficients on several example application settings, including the analysis of PageRank vectors for triangle-based random walks and the convergence of lazy higher-order random walks.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available