[Swift-devel] Condor with coasters question

[Mihael Hategan]

On Sat, 2012-04-28 at 12:09 -0500, David Kelly wrote:
> What I am seeing is that only ~70 tasks are active at once. When I
> look at condor_q, I see there are ~70 jobs that I have submitted, no
> more, none idle. Any ideas where this limit is coming from?

Most of those jobs should be multi-node jobs (i.e. more than one worker
per job).

> 
> I thought I would be around this by setting nodeGranularity to 50. But
> when I do this, what seems to happen is that there are 50 machines
> allocated per 1 worker.pl which would make sense for an MPI job, but
> not what I want here.

Not really. It's reasonable and desirable to have multiple machines
allocated per 1 job (though that should start an instance of worker.pl
on each machine).

>  (The condor submit script sets machine_count to 50, but only queues
> 1)
> 
> I can get around this now by using the plain condor provider, but ideally would like to use coasters.
> 
> Thanks,
> David
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel