How to run BigJob on OSG (without BJ Agent)

The following steps explain how to install and run BigJob on Open Science Grid Resources.

Attention: This guide describes how BJ can be used to submit to the OSG Condor Vanilla universe. If you want to run the BJ agent on OSG please see: BJ/Condor Guide.

Installation

SAGA + Condor Adaptor + BigJob "dev_osg" branch

BigJob for OSG

Currently, BigJob for OSG can be checked out from our git repository. Attention: the BigJob version available via PyPi (easy_install) does not work on OSG. Run this in your working directory:

git clone git@github.com:saga-project/BigJob.git bigjob_osg
cd bigjob_osg
git checkout dev_extenci

Run a Job via BigJob

This is an example of how to submit a single BFAST task to the OSG Condor pool via BigJob:

import time
from bigjob_osg import bigjob, subjob, description, state

def bigjob_osg_example_simple():
    lrms_url = "condor://localhost"
    print "Start Pilot Job/BigJob at: " + lrms_url
    bj = bigjob(None)

    ##############################
    # Start the pilot job 
    bj.start_pilot_job(lrms_url)
    print "Pilot Job/BigJob URL: " + bj.pilot_url + " State: " + str(bj.get_state())

    ##############################
    # Define a workload
    jd = description()
    jd.set_attribute        ("Executable", "/home/oweidner/software/bfast/bin/bfast")
    jd.set_vector_attribute ("Arguments", ["match", "-r", "reads.10.fastq", "-A", "1", "-f", "hg_2122.fa"])
    jd.set_attribute        ("Output", "my_out.$(Cluster).$(Process)")
    jd.set_attribute        ("Error", "my_err.$(Cluster).$(Process)")

    ##############################
    # Define input files
    input_files = ["/home/oweidner/software/bfast/data/small/reference/hg_2122.fa > hg_2122.fa",
      "/home/oweidner/software/bfast/data/small/reference/hg_2122.fa.cs.10.1.bif > hg_2122.fa.cs.10.1.bif",
      "/home/oweidner/software/bfast/data/small/reference/hg_2122.fa.cs.9.1.bif > hg_2122.fa.cs.9.1.bif",
      "/home/oweidner/software/bfast/data/small/reference/hg_2122.fa.cs.8.1.bif > hg_2122.fa.cs.8.1.bif",
      "/home/oweidner/software/bfast/data/small/reference/hg_2122.fa.cs.7.1.bif > hg_2122.fa.cs.7.1.bif",
      "/home/oweidner/software/bfast/data/small/reference/hg_2122.fa.cs.6.1.bif > hg_2122.fa.cs.6.1.bif",
      "/home/oweidner/software/bfast/data/small/reference/hg_2122.fa.cs.5.1.bif > hg_2122.fa.cs.5.1.bif",
      "/home/oweidner/software/bfast/data/small/reference/hg_2122.fa.cs.4.1.bif > hg_2122.fa.cs.4.1.bif",
      "/home/oweidner/software/bfast/data/small/reference/hg_2122.fa.cs.3.1.bif > hg_2122.fa.cs.3.1.bif",
      "/home/oweidner/software/bfast/data/small/reference/hg_2122.fa.cs.2.1.bif > hg_2122.fa.cs.2.1.bif",
      "/home/oweidner/software/bfast/data/small/reference/hg_2122.fa.cs.1.1.bif > hg_2122.fa.cs.1.1.bif",
      "/home/oweidner/software/bfast/data/small/reference/hg_2122.fa.cs.brg > hg_2122.fa.cs.brg",
      "/home/oweidner/software/bfast/data/small/reference/hg_2122.fa.nt.brg > hg_2122.fa.nt.brg",
      "/home/oweidner/software/bfast/data/small/reads_5K/reads.10.fastq > reads.10.fastq"]
    jd.set_vector_attribute("FileTransfer", input_files)

    ##############################
    # Submit the workload to the pilot job
    sj = subjob()
    sj.submit_job(bj, jd)
    while 1:
        state = str(sj.get_state())
        print "Subjob state: " + state
        if(state=="Failed" or state=="Done"):
            break
        time.sleep(5)
 
    ##############################
    # Stop the pilot job 
    bj.cancel()
    print "Pilot Job/BigJob URL: " + bj.pilot_url + " State: " + str(bj.get_state())

if __name__ == "__main__":
    bigjob_osg_example_simple()