Search code examples
cluster-computinggrid-computingsungridengine

Running a lot of jobs with sun grid engine


I want to run a very large number (~30000) of jobs with Sun Grid Engine.

I can theoretically, perform 30000 times the "qsub" command to submit jobs. However, I am afraid that will be too much.

Is there a better way to do it? (i.e. from a file) Or otherwise, do you think it will work nonetheless?

Thank you


Solution

  • It looks like at least some versions of SGE support Array Jobs, which sounds like what you want.

    Look at "-t" and "-tc" options in the documentation for qsub located here.

    Check out this link too, maybe it will be helpful.