Thursday, January 19, 2012

rocks-openmpi and gridengine in 5.4.3

it is well know that rocks-openmpi come with hpc roll in rocksclusters (5.4.3 current) did not compiled with-sge.
e.g.
  • /opt/openmpi/bin/ompi_info|grep gridengine
  • return nothing
(this bugs was fix by rocks's developer the new rpm is here )



  • As an experiment, I download the latest rocks source under /export/rocks/install
    • cd rocks-5.4.3/src/roll/hpc
    • make roll
    • it generate hpc-5.4.3-0.x86_64.disk1.iso
    • mount -o loop `pwd`/hpc-5.4.3-0.x86_64.disk1.iso /mnt
    • cd /mnt/hpc/5.4.3/x86_64/RedHat/RPMS
    • rpm -e rocks-openmpi
    • rpm -iUv rocks-openmpi-1.4.3-1.x86_64.rpm
    • /opt/openmpi/bin/ompi_info|grep gridengine
      • MCA ras: gridengine (MCA v2.0 API v2.0 Component v1.4.3
    • for the new distro
      • cd /export/rocks/install
      • rocks disable roll hpc
      • rocks remove roll hpc
      • rocks add roll /export/rocks/install/rocks-5.4.3/src/roll/hpc/hpc.......iso
      • rocks enable roll hpc
      • rocks create distro
         
    • re-install the compute-0-0
      • insert-ethers --remove compute-0-0
      • insert-ethers
      • pick compute
      • pxe boot the compute-0-0

now there is version openmpi-1.4.4 to work with

In fact Centos come with openmpi-1.4-gcc-x86_64 that does compiled with-sge
the binary is located at /usr/lib64/openmpi/1.4-gcc/bin

For openmpi-1.4.4

  • download the openmpi-1.4.4.tar.bz2
  • edit version.mk change 1.4.3 to 1.4.4
  • under hpc do make roll
  • follow the steps above to replace the  old hpc roll with the old hpc roll with the new roll  re-install the compute node
  • on the frontend just add the new rocks-openmpi-1.4.4-1.x86_64.rpm 
  • download from this link







No comments:

Post a Comment