A HDFS dynamic load balancing strategy using improved niche PSO algorithm in cloud storage. (7th April 2021)
- Record Type:
- Journal Article
- Title:
- A HDFS dynamic load balancing strategy using improved niche PSO algorithm in cloud storage. (7th April 2021)
- Main Title:
- A HDFS dynamic load balancing strategy using improved niche PSO algorithm in cloud storage
- Authors:
- Jian, Zhiyu
Jian, Yiwei - Abstract:
- A Hadoop distributed file system (HDFS) NameNode dynamic load balancing strategy (NDLBT) using improved niche particle swarm optimisation (PSO) is proposed, which is used to solve the load balancing problem of urban surveillance video big data. Firstly, the relationship between bandwidth consumption and the bit rate of video files, the size of data blocks and access hotspots of online video files are analysed. Then, adaptive backup is realised by dynamic multiple copies of heterogeneous nodes. The dynamic distribution of metadata is implemented to ensure the performance of metadata server clusters. Finally, we propose a new improved niche PSO algorithm to achieve load balancing scheduling. In the experimental scenario where high bandwidth consumption video files are used as service access hotspots, the proposed method, which can reduce the bandwidth peak value of bottleneck nodes in data node clusters by 20%, is superior to the original load balancing method in 90% scenarios.
- Is Part Of:
- International journal of autonomous and adaptive communications systems. Volume 14:Number 1/2(2021)
- Journal:
- International journal of autonomous and adaptive communications systems
- Issue:
- Volume 14:Number 1/2(2021)
- Issue Display:
- Volume 14, Issue 1/2 (2021)
- Year:
- 2021
- Volume:
- 14
- Issue:
- 1/2
- Issue Sort Value:
- 2021-0014-NaN-0000
- Page Start:
- 163
- Page End:
- 178
- Publication Date:
- 2021-04-07
- Subjects:
- cloud storage -- urban surveillance video -- improved niche -- PSO -- particle swarm optimisation -- dynamic load balancing -- big data -- HDFS -- Hadoop distributed file system
Adaptive computing systems -- Periodicals
Wireless communication systems -- Periodicals
Computer networks -- Periodicals
004.6 - Journal URLs:
- http://inderscience.metapress.com/content/121122 ↗
http://www.inderscience.com/ ↗ - Languages:
- English
- ISSNs:
- 1754-8632
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - BLDSS-3PM
British Library STI - ELD Digital store - Ingest File:
- 15311.xml