Search code examples
slurmosc

No output in Slurm.out

I have submitted a Slurm job to a server, and while I can view the outputs on the terminal, there is no output being generated in the slurm.out file. Surprisingly, there are no errors reported, and the job appears to be running smoothly. However, my objective is to be able to monitor the job's output in the slurm.out file.

Is there a recommended approach or solution to ensure that the output is properly captured and recorded in the slurm.out file for monitoring purposes?

Tested with a hello world

Solution

  • I had the same issue with python scripts.

    Some tips

    1. In sbatch file
    #!/bin/bash

    #SBATCH --output=python.%j.out
    #SBATCH --error=python.%j.err
    #SBATCH -N 1
    #SBATCH --ntasks-per-node=1 

    export PYTHONUNBUFFERED=TRUE

    srun python yourscript.py

    1. Print in python

      print ("Hello World ", flush=True or
      print ("Hello World ",file=sys.stdout)

    2. Do not forget in python script import sys