Availability and performability analysis for a service degradation process with condition-based preventive maintenance II – estimation and simulation. (1st January 2014)

• Record Type: Journal Article
• Authors: Dohi, Tadashi
• Is Part Of: International journal of strategic engineering asset management. Volume 2 Number 1(2014)
• Page Start: 98
• Page End: 115
• Publication Date: 2014-01-01
• Subjects: software service -- service degradation -- software rejuvenation -- condition-based maintenance -- semi-Markov decision process -- statistics -- adaptive estimation -- reinforcement learning; Facility management -- Periodicals; Plant engineering -- Periodicals; 658.2005
• Languages: English
• ISSNs: 1759-9733

Abstract

The preventive maintenance is very useful to improve effectively the service availability for software systems with service degradation. In this paper, we present a stochastic model to describe an operational software, which consists of one operating system and multiple applications and provides a service in continuous time. In this paper we examine adaptive estimation problems using a reinforcement learning algorithm which is called the Q -learning. We give the Q -learning algorithms to estimate the optimal software rejuvenation policies that minimise the service availability and maximise the expected service reward per unit time, respectively. Illustrative numerical examples are presented to investigate asymptotic properties of estimators of the optimal software rejuvenation policies.