Optimal Online Transmission Schedule for Remote State Estimation over a Hidden Markovian Channel. Issue 2 (2020)

• Record Type: Journal Article
• Authors: Sun, Bowen; Cao, Xianghui; Wang, Le; Sun, Changyin
• Is Part Of: IFAC-PapersOnLine. Volume 53:Issue 2(2020)
• Page Start: 2519
• Page End: 2525
• Publication Date: 2020
• Subjects: Cyber-physical Systems -- Markov decision process -- Hidden Markov model; Automatic control -- Periodicals; 629.805
• DOI: 10.1016/j.ifacol.2020.12.228
• Languages: English
• ISSNs: 2405-8963

Abstract

Abstract: This paper investigates the optimal transmission scheduling problem in remote state estimation systems over an unreliable wireless channel where the channel state evolves as a Markov chain. However, due to inaccurate observations of the channel state, the wireless channel is modeled as a hidden Markov chain. We propose a prediction algorithm based on the Viterbi algorithm to estimate the channel state. To save the wireless sensor's energy, we consider scheduling the transmission of sensor transmissions while balancing between estimation performance and sensor energy expenditure. By jointly considering performance and energy, we formulate the scheduling problem as a Markov decision process. We prove the existence of the optimal transmission policy and derive a threshold structure of the optimal strategy. Finally, the performance of the proposed method is evaluated through simulations.