Advanced user environment design and implementation on integrated multi-architecture supercomputers

Rory C. Kelly, Si Liu, Siddhartha S. Ghosh, Davide Del Vento, David L. Hart, Dan Nagle, B. J. Smith, Richard A. Valent

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

Scientists and engineers using supercomputer clusters should be able to focus on their scientific and technical work in- stead of worrying about operating their user environment. However, creating a convenient and effective user environment on modern supercomputers becomes more and more challenging due to the complexity of these large-scale systems. In this report, we discuss important design issues and goals in user environment that must support multiple compiler suites, various applications, and diverse libraries on heterogeneous computing architectures. We present our implementation on the latest high-performance computing system, Yellowstone, which is a powerful dedicated resource for earth system science deployed by the National Center for Atmospheric Research. Our newly designed user environment is built upon a hierarchical module structure, customized wrapper scripts, pre-defined system modules, Lmod modules implementation, and several creative tools. The resulting implementation realizes many great features including streamlined control, versioning, user customization, auto- mated documentation, etc., and accommodates both novice and experienced users. The design and implementation also minimize the effort of the administrator and support team in managing users environment. The smooth application and positive feedback from our users demonstrate that our design and implementation on the Yellowstone system have been well accepted and have facilitated thousands of users all over the world.

Original languageEnglish
Title of host publicationProceedings of the XSEDE 2015 Conference
Subtitle of host publicationScientific Advancements Enabled by Enhanced Cyberinfrastructure
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450337205
DOIs
StatePublished - Jul 26 2015
Event4th Annual Conference on Extreme Science and Engineering Discovery Environment, XSEDE 2015 - St. Louis, United States
Duration: Jul 26 2015Jul 30 2015

Publication series

NameACM International Conference Proceeding Series
Volume2015-July

Conference

Conference4th Annual Conference on Extreme Science and Engineering Discovery Environment, XSEDE 2015
Country/TerritoryUnited States
CitySt. Louis
Period07/26/1507/30/15

Keywords

  • Installation management
  • Modules
  • Software environment
  • System software
  • User environment

Fingerprint

Dive into the research topics of 'Advanced user environment design and implementation on integrated multi-architecture supercomputers'. Together they form a unique fingerprint.

Cite this