Hprc banner tamu.png

Difference between revisions of "SW:EasyBuild"

From TAMU HPRC
Jump to: navigation, search
(EasyBuild)
(EasyBuild)
Line 16: Line 16:
 
# provides automatic module create
 
# provides automatic module create
 
# provides exact dependency tracking
 
# provides exact dependency tracking
#  
+
# supports common software installation tasks like using configure/make/make install, cmake/make or python -c" setup.py build"
  
 +
HPRC is actively involved with EasyBuild.  In fact, the codes that support IBM Power were developed here on the curie cluster.  A number of the modules for the 2017b toolchain also came from here. In addition, we do regular testing and offer new modules (as time permits).
  
 
=== Using EasyBuild on HPRC clusters ===
 
=== Using EasyBuild on HPRC clusters ===
 +
The core EasyBuild module provides the basis for using EasyBuild.  This is installed via EasyBuild and is regularly updated when new versions are available.
 +
 +
For years, HPRC admins have been using an EasyBuild-<cluster> module that sets the needed EASYBUILD environment variables for deploying software on our cluster.  By default, this uses the latest version of EasyBuild installed.
  
 
(New EasyBuild-cluster-SCRATCH modules).
 
(New EasyBuild-cluster-SCRATCH modules).

Revision as of 05:06, 30 November 2018

EasyBuild

"EasyBuild is a software build and installation framework that allows you to manage (scientific) software on High Performance Computing (HPC) systems in an efficient way."

It is the primary tool we use for deploying sofware on HPRC clusters. Benefits include:

  1. allows us to deploy software to the GPFS shared filesystem instead of via RPMs which:
    1. cuts down on the compute node image size which:
      1. cuts down on deployment time when nodes are updated
      2. minimizes RPMs, and thus the overall disk image size, for compute nodes that use RAMdisk for local storage (the larger the disk image the less RAM that is available for computation)
      3. allows us to provide all nodes with updates with no further effort
  2. allows us to deploy multiple versions of software built with multiple toolchains
  3. provides automatic logging and build statistics for every software installation
  4. provides automatic module create
  5. provides exact dependency tracking
  6. supports common software installation tasks like using configure/make/make install, cmake/make or python -c" setup.py build"

HPRC is actively involved with EasyBuild. In fact, the codes that support IBM Power were developed here on the curie cluster. A number of the modules for the 2017b toolchain also came from here. In addition, we do regular testing and offer new modules (as time permits).

Using EasyBuild on HPRC clusters

The core EasyBuild module provides the basis for using EasyBuild. This is installed via EasyBuild and is regularly updated when new versions are available.

For years, HPRC admins have been using an EasyBuild-<cluster> module that sets the needed EASYBUILD environment variables for deploying software on our cluster. By default, this uses the latest version of EasyBuild installed.

(New EasyBuild-cluster-SCRATCH modules).