Finite-State-Space Truncations for Infinite Quasi-Birth-Death Processes

For dealing numerically with the infinite-state-space Markov chains, a truncation of the state space is inevitable, that is, an approximation by a finite-state-space Markov chain has to be performed. In this paper, we consider level-dependent quasi-birth-death processes, and we focus on the computat...

Full description

Saved in:
Bibliographic Details
Main Author: Hendrik Baumann
Format: Article
Language:English
Published: Wiley 2020-01-01
Series:Journal of Applied Mathematics
Online Access:http://dx.doi.org/10.1155/2020/2678374
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:For dealing numerically with the infinite-state-space Markov chains, a truncation of the state space is inevitable, that is, an approximation by a finite-state-space Markov chain has to be performed. In this paper, we consider level-dependent quasi-birth-death processes, and we focus on the computation of stationary expectations. In previous literature, efficient methods for computing approximations to these characteristics have been suggested and established. These methods rely on truncating the process at some level N, and for N⟶∞, convergence of the approximation to the desired characteristic is guaranteed. This paper’s main goal is to quantify the speed of convergence. Under the assumption of an f-modulated drift condition, we derive terms for a lower bound and an upper bound on stationary expectations which converge quickly to the same value and which can be efficiently computed.
ISSN:1110-757X
1687-0042