Performance Experiment Components

Project Overview

Performance experiments can involve multiple execution runs where parameters such as execution platform, measurement tools, methods of measurement, application parameters, and analysis techniques can vary. In order to manage the layers of complexity involved in experimental setup, execution, and post-analysis, a degree of automation is necessary at each stage of the process. A layer of abstraction is needed to hide the intricacies involved in experimental set-up and runs for varying sets of experimental parameters. This suite of software features an integrated component-based environment that automates the process of running multiple performance experiments and parameter selection of parallel scientific applications. This toolkit will enable application scientists to easily modify the experimental parameters over multiple execution runs and to selectively retrieve the data for analysis and generation of performance models.

Download

(Open-source license)

Development version (unstable) can be checked out anonymously with:

svn co https://svn.mcs.anl.gov/repos/cca/cqos-components/performance cqos-perf-components

Contact Van Bui or Boyana Norris if you wish to contribute to this project.

Software Requirements

• CCA tools (including Babel, cca-spec-babel, ccaffeine)

• CCA tools installation instructions: ​https://www.cca-forum.org/wiki/tiki-index.php?page_ref_id=3 , but use the latest cca-tools-contractor at ​https://www.cca-forum.org/download/cca-tools/nightly/cca-tools-contractor.tar.gz and make sure to specify the nightly option (in addition to other desired options) when configuring:

  ../contract.py --configure nightly=True
  

Build and Installation

• Checking out, updating, or moving the Bocca project requires a couple of bocca commands and a reconfiguration:

  ./configure
  bocca update --store
  bocca config --update
  

Presentations

• CCA Meeting, July 23, 2009 ​Using Components to Automate Performance Experiments, Van Bui and Boyana Norris, Argonne National Lab

Machine-specific notes

• Boyana's cookie setup for running experiments with both component and non-component apps:

  setenv PETSC_DIR /disks/large/soft/src/petsc-dev
  setenv PETSC_ARCH cca-debug
  setenv MPIDIR /disks/soft/mpich2-1.0.7-gfortran
  setenv PATH $MPIDIR/bin:$PATH
  setenv LD_LIBRARY_PATH $MPIDIR/lib:$PATH
  
  setenv PATH $HOME/cca/1.4.0-gfortran-nightly/bin:$PATH
  source $HOME/.openuh