Monitor job arrays

Use bjobs and bhist to monitor the current and past status of job arrays.

Display job array status

Procedure

To display summary information about the currently running jobs submitted from a job array, use the -A option of bjobs.

For example, a job array of 10 jobs with job ID 123:

bjobs -A 123
JOBID    ARRAY_SPEC  OWNER  NJOBS PEND DONE  RUN EXIT SSUSP USUSP PSUSP 
123      myArra[1-10]     user1     10    3    3    4    0     0     0     0

Display job array dependencies

Procedure

To display information for any job dependency information for an array, use the bjdepinfo command.

For example, a job array (with job ID 456) where you want to view the dependencies on the third element of the array:

bjdepinfo -c "456[3]"

JOBID  CHILD CHILD_STATUS CHILD_NAME LEVEL

456[3] 300   PEND         job300     1

Display current job status

Procedure

To display the status of the individual jobs submitted from a job array, specify the job array job ID with bjobs. For jobs submitted from a job array, JOBID displays the job array job ID, and JOBNAME displays the job array name and the index value of each job.

For example, to view a job array with job ID 123:

bjobs 123
JOBID  USER   STAT   QUEUE     FROM_HOST  EXEC_HOST   JOB_NAME    SUBMIT_TIME 
123    user1  DONE   default   hostA      hostC       myArray[1]  Feb 29 12:34 
123    user1  DONE   default   hostA      hostQ       myArray[2]  Feb 29 12:34 
123    user1  DONE   default   hostA      hostB       myArray[3]  Feb 29 12:34 
123    user1  RUN    default   hostA      hostC       myArray[4]  Feb 29 12:34 
123    user1  RUN    default   hostA      hostL       myArray[5]  Feb 29 12:34 
123    user1  RUN    default   hostA      hostB       myArray[6]  Feb 29 12:34 
123    user1  RUN    default   hostA      hostQ       myArray[7]  Feb 29 12:34 
123    user1  PEND   default   hostA                  myArray[8]  Feb 29 12:34 
123    user1  PEND   default   hostA                  myArray[9]  Feb 29 12:34 
123    user1  PEND   default   hostA                  myArray[10] Feb 29 12:34

Display past job status

Procedure

To display the past status of the individual jobs submitted from a job array, specify the job array job ID with bhist.

For example, to view the history of a job array with job ID 456:

bhist 456
Summary of time in seconds spent in various states: 
JOBID  USER    JOB_NAME   PEND    PSUSP   RUN     USUSP   SSUSP   UNKWN   TOTAL 
456[1] user1   *rray[1]   14      0       65      0       0       0       79 
456[2] user1   *rray[2]   74      0       25      0       0       0       99 
456[3] user1   *rray[3]   121     0       26      0       0       0       147 
456[4] user1   *rray[4]   167     0       30      0       0       0       197 
456[5] user1   *rray[5]   214     0       29      0       0       0       243 
456[6] user1   *rray[6]   250     0       35      0       0       0       285 
456[7] user1   *rray[7]   295     0       33      0       0       0       328 
456[8] user1   *rray[8]   339     0       29      0       0       0       368 
456[9] user1   *rray[9]   356     0       26      0       0       0       382 
456[10]user1   *ray[10]   375     0       24      0       0       0       399

Display the current status of a specific job

Procedure

To display the current status of a specific job submitted from a job array, specify in quotes, the job array job ID and an index value with bjobs.

For example, the status of the 5th job in a job array with job ID 123:

bjobs "123[5]"
JOBID  USER   STAT   QUEUE     FROM_HOST  EXEC_HOST   JOB_NAME    SUBMIT_TIME 
123    user1  RUN    default   hostA      hostL       myArray[5]  Feb 29 12:34

Display the past status of a specific job

Procedure

To display the past status of a specific job submitted from a job array, specify, in quotes, the job array job ID and an index value with bhist.

For example, the status of the 5th job in a job array with job ID 456:

bhist "456[5]"
Summary of time in seconds spent in various states: 
JOBID  USER    JOB_NAME   PEND    PSUSP   RUN     USUSP   SSUSP   UNKWN   TOTAL 
456[5] user1   *rray[5]   214     0       29      0       0       0       243

Performance metric information

If you enable performance metric collection, every job submitted in a job array is counted individually, except for the Job submission requests metric. The entire job array counts as just one job submission request.