Notes for building UABgrid Files.

The base system consists of a dedicated iSCSI SAN with 6TB of storage connected to a NAS front-end that interfaces to the grid systems via GridFTP and the job staging node via NFS. The iSCSI system is an EMC dual-processor solution from Dell. The NAS front-end is a Dell 1950 running RedHat?4. Both systems are delivered installed.

Installing Globus on RedHat

Configure Nework

The IP address is easily set in /etc/sysconfig/network-scripts/ifcfg-eth1:

DEVICE=eth1
HWADDR=00:19:B9:DF:28:9B
ONBOOT=yes
TYPE=Ethernet
BOOTPROTO=none
NETMASK=255.255.0.0
IPADDR=138.26.125.63
USERCTL=no
PEERDNS=yes
GATEWAY=138.26.1.1
IPV6INIT=no

Base System Prep

You can copy and paste the commands from the BuildTheStage instructions for the following steps. Note the exceptions.

  • Remove GCJ Java
  • Install Sun JDK 1.5 update 12
  • Install Ant 1.7.0 (Note: had to go to apache.org and find a refreshed mirror.)
  • Configure /etc/profile.d
  • Configure ntp (instrux pending)

Globus Install

To simplify the initial deployment we will start with the binary Globus distribution for Globus 4.0.5. The steps for configuring this system are very similar to those for building UABgrid Stage. These steps will primarily concentrate on the specific exceptions needed from that configuration.

  • Prepare to start the container. First creating missing container certs.
    cd /etc/grid-security
    cp -p hostkey.pem containerkey.pem
    cp -p hostcert.pem containercert.pem
    chown globus.globus container*.pem
    
  • Fix the grid-mapfile (it's needed to start the container)
  • Fix the permissions on the jndi-xml file
    chown globus.globus /opt/globus/etc/globus_wsrf_rft/jndi-config.xml
    

Sanity Check Globus

The following tests are adapted from GridWay.

# GT pre-WS checks
# basic authn check
globusrun -a -r files.uabgrid.uab.edu
# job execution (stdio connects)
globus-job-run files.uabgrid.uab.edu /bin/uname -a
# file transfer
globus-url-copy file:///etc/hosts gsiftp://files.uabgrid.uab.edu/tmp/hosts1
globus-url-copy gsiftp://files.uabgrid.uab.edu/tmp/hosts1 file:///tmp/hosts2
diff /tmp/hosts2 /etc/hosts # should show no differences
# clean up
rm /tmp/hosts2
# GT WS checks
globusrun-ws -submit -F files.uabgrid.uab.edu -s -c /bin/uname -a
wsrf-query -x -s https://localhost:8443/wsrf/services/DefaultIndexService