<< back >>

Building CCA tools on Surveyor (GNU)

• The script called ​buildCcaToolsGNU.sh should build things automatically.

• NOTE - use the autotools supplied in /home/projects/ccatools/autotools, not the system versions (ie. /usr/bin...)
• NOTE - Like the case with IBM compilers, when running with ccafe-batch, with MPI there is a core dump. I'm not sure if it's due to code in xmlCreateURLParserCtxt of libxml. I recompiled libxml with -O0 and unlike with IBM I still get the crash.

The notes below are left for record. The script above has any recent modifications.

Please source this script for paths before building:

export PATH=/bgsys/drivers/ppcfloor/comm/bin:$PATH
export PATH=/home/projects/ccatools/autotools:$PATH
export PATH=/home/projects/ccatools/cmake/bin:$PATH
BABEL_INSTALL_GNU=/gpfs/home/projects/ccatools/install/GNU/babel
LIBTOOL_LOC_GNU=/gpfs/home/projects/ccatools/install/GNU/libtool-2.4
LIBTOOL_LOCATION_GNU=${LIBTOOL_LOC_GNU}
LIBXML2_LOC_GNU=/gpfs/home/projects/ccatools/install/GNU/libxml-2.7.3
CCA_INSTALL_DIR_GNU=/gpfs/home/projects/ccatools/install/GNU/ccatools
ZLIB_INSTALL_GNU=/gpfs/home/projects/ccatools/install/GNU/zlib-1.2.5
PYTHON_INSTALL_GNU=/bgsys/drivers/ppcfloor/gnu-linux/bin/python

The shell prompt is >>. The order of the build is summarized here.

1. (NOT FOR GNU) Libtool-2.4
2. zlib-1.2.5
3. libxml-2.7.3
   • run select regression tests
4. babel out of dev repo (build and tests here)
   • run select regression tests
5. cca-spec-babel
6. ccaffeine
7. bocca
8. Test the tool chain.

Build zlib-1.2.5

• Download source and extract:

        >>wget http://zlib.net/zlib-1.2.5.tar.gz
        >>tar xvfz zlib-1.2.5.tar.gz
        >>cd zlib-1.2.5
  

• Configure and build. I use bash so can set environment variables this way:

        >>CC=mpicc CFLAGS="-qpic" ./configure  --static --prefix=/gpfs/home/projects/ccatools/install/GNU/zlib-1.2.5
  

• Before building remove this line from the Makefile.

        170a171
        >       cp $(SHAREDLIBV) $(DESTDIR)$(sharedlibdir)
  

• No finish the build:

        >> make ; make install
  

Build libxml-2.7.3

• Download and extract source:

  >>wget http://xmlsoft.org/sources/libxml2-2.7.3.tar.gz
  >>tar xvfz libxml2-2.7.3.tar.gz
  >>cd libxml2-2.7.3/
  >>aclocal ; autoconf ; automake
  >>./configure --prefix=$LIBXML2_LOC_GNU CC=mpicc F77=mpif77 \
  --with-python=/bgsys/drivers/ppcfloor/gnu-linux/bin/python \
  --with-zlib=/gpfs/home/projects/ccatools/install/GNU/zlib-1.2.5 --enable-static \
  --disable-shared  ; \
  find . -name Makefile -exec \
      sed -i1 -e 's|PYTHON_INCLUDES =.*$|PYTHON_INCLUDES=\/bgsys\/drivers\/ppcfloor\/gnu-linux\/include\/python2.6|g' \
      {} \; -print
  >>make ; make install
  

• Test the build. These are virtually identical to the IBM instructions.

As of April 20, these are failing.

>>pwd
/home/muszala/ecloudBuild/GNU/libxml2-2.7.3
>>qsub -A cca-tools -t 5 -n 1 -O testapi --env LD_LIBRARY_PATH=$LIBXML2_LOC_GNU/lib ./testapi
>>qsub -A cca-tools -t 5 -n 1 -O runtest --env LD_LIBRARY_PATH=$LIBXML2_LOC_GNU/lib ./runtest

    * The results of testapi.output look like:
{{{
      >>tail testapi.output 
      Testing xmlsave : 4 of 10 functions ...
      Testing xmlschemas : 15 of 25 functions ...
      Testing xmlschemastypes : 26 of 34 functions ...
      Testing xmlstring : 26 of 30 functions ...
      Testing xmlunicode : 166 of 166 functions ...
      Testing xmlwriter : 51 of 79 functions ...
      Testing xpath : 30 of 38 functions ...
      Testing xpathInternals : 106 of 117 functions ...
      Testing xpointer : 17 of 21 functions ...
      Total: 1161 functions, 291335 tests, 0 errors
}}}
    * While the results of runtest.output and runtest.error look like:
{{{
      >>tail runtest.output 
      ## Path URI conversion tests
      ## Schemas regression tests
      ## Relax-NG regression tests
      ## Relax-NG streaming regression tests
      ## Pattern regression tests
      ## C14N with comments regression tests
      ## C14N without comments regression tests
      ## C14N exclusive without comments regression tests
      ## Catalog and Threads regression tests
      Total 8 tests, 2 errors, 0 leaks
      >>more runtest.error 
      failed the URL passing test for urip://example.com/a b.htmlSpecific platform thread support not detected
}}}