Comparison of lossless compression schemes for high rate electrical grid time series for smart grid monitoring and analysis. (October 2018)

• Record Type: Journal Article
• Authors: Jumar, Richard; Maaß, Heiko; Hagenmeyer, Veit
• Is Part Of: Computers & electrical engineering. Volume 71(2018)
• Page Start: 465
• Page End: 476
• Publication Date: 2018-10
• Subjects: Time series -- Lossless compression -- Signal representation -- Power grid monitoring -- Smart grid -- Power quality; Computer engineering -- Periodicals; Electrical engineering -- Periodicals; Electrical engineering -- Data processing -- Periodicals; Ordinateurs -- Conception et construction -- Périodiques; Électrotechnique -- Périodiques; Électrotechnique -- Informatique -- Périodiques; Computer engineering; Electrical engineering; Electrical engineering -- Data processing; Periodicals; Electronic journals; 621.302854
• DOI: 10.1016/j.compeleceng.2018.07.008
• Languages: English
• ISSNs: 0045-7906

Abstract

Abstract: The smart power grid of the future will utilize waveform level monitoring with sampling rates in the kilohertz range for detailed grid status assessment. To this end, we address the challenge of handling large raw data amount with its quasi-periodical characteristic via lossless compression. We compare different freely available algorithms and implementations with regard to compression ratio, computation time and working principle to find the most suitable compression strategy for this type of data. Algorithms from the audio domain (ALAC, ALS, APE, FLAC & TrueAudio) and general archiving schemes (LZMA, Delfate, PPMd, BZip2 & Gzip) are tested against each other. We assemble a dataset from openly available sources (UK-DALE, MIT-REDD, EDR) and establish dataset independent comparison criteria. This combination is a first detailed open benchmark to support the development of tailored lossless compression schemes and a decision support for researchers facing data intensive smart grid measurements.