Journal
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE
Volume 46, Issue -, Pages 17-35Publisher
ELSEVIER
DOI: 10.1016/j.future.2014.10.008
Keywords
Scientific workflows; Workflow management system; Pegasus
Categories
Funding
- National Science Foundation under the ACI SDCI program [0722019]
- ACI S12-SSI program [1148515]
- National Science Foundation [OCI-1053575]
- US Department of Energy's Office of Science
- Southern California Earthquake Center
- NSF [EAR-1033462]
- USGS [G12AC20038]
- Direct For Computer & Info Scie & Enginr
- Office of Advanced Cyberinfrastructure (OAC) [0722019] Funding Source: National Science Foundation
Ask authors/readers for more resources
Modern science often requires the execution of large-scale, multi-stage simulation and data analysis pipelines to enable the study of complex systems. The amount of computation and data involved in these pipelines requires scalable workflow management systems that are able to reliably and efficiently coordinate and automate data movement and task execution on distributed computational resources: campus clusters, national cyberinfrastructures, and commercial and academic clouds. This paper describes the design, development and evolution of the Pegasus Workflow Management System, which maps abstract workflow descriptions onto distributed computing infrastructures. Pegasus has been used for more than twelve years by scientists in a wide variety of domains, including astronomy, seismology, bioinformatics, physics and others. This paper provides an integrated view of the Pegasus system, showing its capabilities that have been developed over time in response to application needs and to the evolution of the scientific computing platforms. The paper describes how Pegasus achieves reliable, scalable workflow execution across a wide variety of computing infrastructures. (C) 2014 Elsevier B.V. All rights reserved.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available