HUBzero and Pegasus: integrating scientific workflows into science gateways. (21st March 2014)

• Record Type: Journal Article
• Authors: McLennan, Michael; Clark, Steven; Deelman, Ewa; Rynge, Mats; Vahi, Karan; McKenna, Frank; Kearney, Derrick; Song, Carol; Wilkins‐Diehr, Nancy; Gesing, Sandra; Kiss, Tamas
• Is Part Of: Concurrency and computation. Volume 27:Number 2(2015:Feb.)
• Page Start: 328
• Page End: 343
• Publication Date: 2014-03-21
• Subjects: Parallel processing (Electronic computers) -- Periodicals; Parallel computers -- Periodicals; 004.35
• DOI: 10.1002/cpe.3257
• Languages: English
• ISSNs: 1532-0626

Abstract

<abstract abstract-type="main"> <title>Summary</title> <p>In this paper, we described the benefits and the challenges of integrating existing scientific workflow technologies into science gateways. Scientific workflow managers are powerful tools for handling large computational tasks. Domain scientists find it difficult to create new workflows, so many tasks that could benefit from workflow automation are often avoided or performed by hand. Two technologies have come together to bring the benefits of workflow to the masses. The Pegasus Workflow Management System can manage workflows comprised of millions of tasks, all the while recording data about the execution and intermediate results so that the provenance of the final result is clear. The HUBzero platform for scientific collaboration provides a venue for building and delivering tools to researchers and educators. With the press of a button, these tools can launch Pegasus workflows on national computing infrastructures and bring results back for plotting and visualization. As a result, the combination of Pegasus and HUBzero is bringing high‐throughput computing to a much wider audience. Copyright © 2014 John Wiley &amp; Sons, Ltd.</p> </abstract>