Performance analysis of concurrent workflows

Abstract: Automated workflows are the key concept of big data pipelines in science, engineering and enterprise applications. The performance analysis of automated workflows is an important topic of the continuous improvement process and the foundation of designing new workflows. This paper introduces the concept of process evolution functions and event reduction policies, which allow for the time resolved visualization of an unlimited number of concurrent workflows by means of aggregated task views. The visualization allows for an intuitive approach to the performance analysis of concurrent workflows. The theoretical foundation of this approach is applicable for workflows represented by directed acyclic graphs. It is explained on the basis of a simple IO-workflow model, which is typically found for distributed resource management systems utilized for many-task computing. AMS subject classification68Mxx

Keywords

Big data pipeline - High performance computing - Complex event processing - Communicating sequential processes - Continuous improvement process

Object Details

• Location: Deutsche Nationalbibliothek Frankfurt am Main
• Extent: Online-Ressource
• Language: Englisch
• Notes: Journal Of Big Data. 2 (2015), 10, DOI 10.1186/s40537-015-0017-0, issn: 2196-1115 ; IN COPYRIGHT http://rightsstatements.org/page/InC/1.0 rs

Classification and Topics

• Classification: Wirtschaft
• Keyword: Big Data ; Hochleistungsrechnen ; Datenverarbeitung ; CSP ; Kaizen

Contributors, Places and Time

• Event: Veröffentlichung
• (where): Freiburg
• (who): Universität
• (when): 2015
• Creator: Kempa-Liehr, Andreas
• Contributor: Freiburger Material-Forschungszentrum ; Albert-Ludwigs-Universität Freiburg

Further information

• DOI: 10.1186/s40537-015-0017-0
• URN: urn:nbn:de:bsz:25-freidok-125402
• Rights: Der Zugriff auf das Objekt ist unbeschränkt möglich.
• Last update: 25.03.2025, 1:55 PM CET