XtremDew: a platform for cooperative tasks and data schedulers. (28th September 2020)
- Record Type:
- Journal Article
- Title:
- XtremDew: a platform for cooperative tasks and data schedulers. (28th September 2020)
- Main Title:
- XtremDew: a platform for cooperative tasks and data schedulers
- Authors:
- Labidi, Mohamed
Lodygensky, Oleg
Fedak, Gilles
Khemakhem, Maher
Jemni, Mohamed - Abstract:
- With the emergence of big data, data scheduling is becoming an important field of research in distributed computing. Software data scheduler often relies on data management policies that can be defined by the user and provide high level features. Such advanced features become necessary nowadays to execute data intensive applications, and this implies that data and task schedulers should cooperate closely to address the large data processing issue and ensure an optimal distribution of data intensive applications. In this paper, we propose XtremDew, the data and task cooperative scheduler platform. We deal with the distribution of the optical character recognition (OCR) on large scale. We show, in particular, the benefit of the focus on data scheduling to distribute our OCR application. We build the data driven distributing platform by combining two existing middleware: BitDew, as the data scheduler, and XtremWeb-HEP, as the task scheduler. Taking advantage of both middlewares, XtremDew provides new features. To evaluate the efficiency of our approach, we compare different strategies of scheduling tasks and data and we present several scenarios that illustrate the benefits of using XtremDew to execute data-intensive applications.
- Is Part Of:
- International journal of high performance computing and networking. Volume 16:Number 1(2020)
- Journal:
- International journal of high performance computing and networking
- Issue:
- Volume 16:Number 1(2020)
- Issue Display:
- Volume 16, Issue 1 (2020)
- Year:
- 2020
- Volume:
- 16
- Issue:
- 1
- Issue Sort Value:
- 2020-0016-0001-0000
- Page Start:
- 55
- Page End:
- 66
- Publication Date:
- 2020-09-28
- Subjects:
- big data -- data intensive application -- cooperative middleware -- big data processing
High performance computing -- Periodicals
Computer networks -- Periodicals
High performance computing
Periodicals
004.05 - Journal URLs:
- http://www.inderscience.com/jhome.php?jcode=ijhpcn ↗
http://www.metapress.com/openurl.asp?genre=journal&issn=1740-0562 ↗
http://www.inderscience.com/ ↗ - Languages:
- English
- ISSNs:
- 1740-0562
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - BLDSS-3PM
British Library STI - ELD Digital store - Ingest File:
- 14037.xml