wiki:ccafeBgpGNU
Last modified 8 years ago Last modified on 05/18/11 05:51:15

<< back >>

Building CCA tools on Surveyor (GNU)

  • NOTE - use the autotools supplied in /home/projects/ccatools/autotools, not the system versions (ie. /usr/bin...)
  • NOTE - Like the case with IBM compilers, when running with ccafe-batch, with MPI there is a core dump. I'm not sure if it's due to code in xmlCreateURLParserCtxt of libxml. I recompiled libxml with -O0 and unlike with IBM I still get the crash.

The notes below are left for record. The script above has any recent modifications.

Please source this script for paths before building:

export PATH=/bgsys/drivers/ppcfloor/comm/bin:$PATH
export PATH=/home/projects/ccatools/autotools:$PATH
export PATH=/home/projects/ccatools/cmake/bin:$PATH
BABEL_INSTALL_GNU=/gpfs/home/projects/ccatools/install/GNU/babel
LIBTOOL_LOC_GNU=/gpfs/home/projects/ccatools/install/GNU/libtool-2.4
LIBTOOL_LOCATION_GNU=${LIBTOOL_LOC_GNU}
LIBXML2_LOC_GNU=/gpfs/home/projects/ccatools/install/GNU/libxml-2.7.3
CCA_INSTALL_DIR_GNU=/gpfs/home/projects/ccatools/install/GNU/ccatools
ZLIB_INSTALL_GNU=/gpfs/home/projects/ccatools/install/GNU/zlib-1.2.5
PYTHON_INSTALL_GNU=/bgsys/drivers/ppcfloor/gnu-linux/bin/python

The shell prompt is >>. The order of the build is summarized here.

  1. (NOT FOR GNU) Libtool-2.4
  2. zlib-1.2.5
  3. libxml-2.7.3
    • run select regression tests
  4. babel out of dev repo (build and tests here)
    • run select regression tests
  5. cca-spec-babel
  6. ccaffeine
  7. bocca
  8. Test the tool chain.

Build zlib-1.2.5

  • Download source and extract:
          >>wget http://zlib.net/zlib-1.2.5.tar.gz
          >>tar xvfz zlib-1.2.5.tar.gz
          >>cd zlib-1.2.5
    
  • Configure and build. I use bash so can set environment variables this way:
          >>CC=mpicc CFLAGS="-qpic" ./configure  --static --prefix=/gpfs/home/projects/ccatools/install/GNU/zlib-1.2.5
    
  • Before building remove this line from the Makefile.
          170a171
          >       cp $(SHAREDLIBV) $(DESTDIR)$(sharedlibdir)
    
  • No finish the build:
          >> make ; make install
    

Build libxml-2.7.3

  • Download and extract source:
    >>wget http://xmlsoft.org/sources/libxml2-2.7.3.tar.gz
    >>tar xvfz libxml2-2.7.3.tar.gz
    >>cd libxml2-2.7.3/
    >>aclocal ; autoconf ; automake
    >>./configure --prefix=$LIBXML2_LOC_GNU CC=mpicc F77=mpif77 \
    --with-python=/bgsys/drivers/ppcfloor/gnu-linux/bin/python \
    --with-zlib=/gpfs/home/projects/ccatools/install/GNU/zlib-1.2.5 --enable-static \
    --disable-shared  ; \
    find . -name Makefile -exec \
        sed -i1 -e 's|PYTHON_INCLUDES =.*$|PYTHON_INCLUDES=\/bgsys\/drivers\/ppcfloor\/gnu-linux\/include\/python2.6|g' \
        {} \; -print
    >>make ; make install
    
  • Test the build. These are virtually identical to the IBM instructions.

As of April 20, these are failing.

>>pwd
/home/muszala/ecloudBuild/GNU/libxml2-2.7.3
>>qsub -A cca-tools -t 5 -n 1 -O testapi --env LD_LIBRARY_PATH=$LIBXML2_LOC_GNU/lib ./testapi
>>qsub -A cca-tools -t 5 -n 1 -O runtest --env LD_LIBRARY_PATH=$LIBXML2_LOC_GNU/lib ./runtest
    * The results of testapi.output look like:
{{{
      >>tail testapi.output 
      Testing xmlsave : 4 of 10 functions ...
      Testing xmlschemas : 15 of 25 functions ...
      Testing xmlschemastypes : 26 of 34 functions ...
      Testing xmlstring : 26 of 30 functions ...
      Testing xmlunicode : 166 of 166 functions ...
      Testing xmlwriter : 51 of 79 functions ...
      Testing xpath : 30 of 38 functions ...
      Testing xpathInternals : 106 of 117 functions ...
      Testing xpointer : 17 of 21 functions ...
      Total: 1161 functions, 291335 tests, 0 errors
}}}
    * While the results of runtest.output and runtest.error look like:
{{{
      >>tail runtest.output 
      ## Path URI conversion tests
      ## Schemas regression tests
      ## Relax-NG regression tests
      ## Relax-NG streaming regression tests
      ## Pattern regression tests
      ## C14N with comments regression tests
      ## C14N without comments regression tests
      ## C14N exclusive without comments regression tests
      ## Catalog and Threads regression tests
      Total 8 tests, 2 errors, 0 leaks
      >>more runtest.error 
      failed the URL passing test for urip://example.com/a b.htmlSpecific platform thread support not detected
}}}