Volltext-Downloads (blau) und Frontdoor-Views (grau)
  • search hit 1 of 1
Back to Result List

Python Workflows on HPC Systems

  • The recent successes and wide spread application of compute intensive machine learning and data analytics methods have been boosting the usage of the Python programming language on HPC systems. While Python provides many advantages for the users, it has not been designed with a focus on multiuser environments or parallel programming - making it quite challenging to maintain stable and secureThe recent successes and wide spread application of compute intensive machine learning and data analytics methods have been boosting the usage of the Python programming language on HPC systems. While Python provides many advantages for the users, it has not been designed with a focus on multiuser environments or parallel programming - making it quite challenging to maintain stable and secure Python workflows on a HPC system. In this paper, we analyze the key problems induced by the usage of Python on HPC clusters and sketch appropriate workarounds for efficiently maintaining multi-user Python software environments, securing and restricting resources of Python jobs and containing Python processes, while focusing on Deep Learning applications running on GPU clusters.show moreshow less

Export metadata

Statistics

frontdoor_oas
Metadaten
Document Type:Conference Proceeding
Conference Type:Konferenzartikel
Zitierlink: https://opus.hs-offenburg.de/4405
Bibliografische Angaben
Title (English):Python Workflows on HPC Systems
Conference:PyHPC: Workshop on Python for High-Performance and Scientific Computing (9. : Nov. 13 2020 : GA, USA)
Author:Janis KeuperStaff MemberORCiDGND, Dominik Straßel, Philipp Reusch
Year of Publication:2020
Publisher:IEEE
First Page:32
Last Page:40
Parent Title (English):Proceedings of PYHPC 2020: 9th Workshop on Python for High-Performance and Scientific Computing
ISBN:978-0-7381-1086-8 (digital)
ISBN:978-0-7381-1087-5 (Print on Demand)
DOI:https://doi.org/10.1109/PyHPC51966.2020.00009
Language:English
Inhaltliche Informationen
Institutes:Fakultät Elektrotechnik, Medizintechnik und Informatik (EMI) (ab 04/2019)
Institutes:Bibliografie
DDC classes:000 Allgemeines, Informatik, Informationswissenschaft / 000 Allgemeines, Wissenschaft / 004 Informatik
Formale Angaben
Open Access: Closed Access 
Licence (German):License LogoUrheberrechtlich geschützt