BAYESIAN ANALYSIS OF DOUBLY STOCHASTIC MARKOV PROCESSES IN RELIABILITY. Issue 3 (July 2021)

• Record Type: Journal Article
• Authors: Ay, Atilla; Soyer, Refik; Landon, Joshua; Özekici, Süleyman
• Is Part Of: Probability in the engineering and informational sciences. Volume 35:Issue 3(2021)
• Page Start: 708
• Page End: 729
• Publication Date: 2021-07
• Subjects: Bayesian inference -- Bayesian reliability analysis -- hidden Markov model -- Markov modulated Markov process; Probabilities -- Periodicals; Engineering -- Statistical methods -- Periodicals; Information science -- Statistical methods -- Periodicals; 519.202462
• DOI: 10.1017/S0269964820000157
• Languages: English
• ISSNs: 0269-9648

Abstract

Abstract : Markov processes play an important role in reliability analysis and particularly in modeling the stochastic evolution of survival/failure behavior of systems. The probability law of Markov processes is described by its generator or the transition rate matrix. In this paper, we suppose that the process is doubly stochastic in the sense that the generator is also stochastic. In our model, we suppose that the entries in the generator change with respect to the changing states of yet another Markov process. This process represents the random environment that the stochastic model operates in. In fact, we have a Markov modulated Markov process which can be modeled as a bivariate Markov process that can be analyzed probabilistically using Markovian analysis. In this setting, however, we are interested in Bayesian inference on model parameters. We present a computationally tractable approach using Gibbs sampling and demonstrate it by numerical illustrations. We also discuss cases that involve complete and partial data sets on both processes.