[Swift-devel] bug 53

[Ioan Raicu]

Hi,
I am still working on the new feature for Falkon to avoid submitting 
tasks to known bad nodes, and to perhaps do its own retries for failed 
jobs with certain known errors (i.e. stale NFS handle).  I should have 
that ready for next week to try out.  Once this new feature is in, we 
could try MolDyn again to see how it behaves.

About avoiding Falkon of MolDyn, I recall something about the 
scalability/policies of GRAM/PBS to handle many con current jobs, having 
to throttle job submissions to something around 1 job every 10 seconds 
(for sustained periods of time, short bursts could send faster), and the 
fact that only a few 10s of nodes would be used concurrently, even 
though the sites that it was running on had more free nodes.  I also 
think that MolDyn through GRAM/PBS was running only 1 job per node, in 
essence only using 1 processor of the 2 per node.  I think the largest 
workflow Nika was able to run over GRAM/PBS was 5 molecules, 421 jobs 
(but only 340 jobs in the large stage).  Nika, were there other problems 
you encountered?

Ioan

Mihael Hategan wrote:
> Very well Sir. I shall see to the priority of the issue being raised.
>
> On Thu, 2007-09-13 at 14:09 +0000, Ben Clifford wrote:
>   
>> I think one of the main impediments to moldyn running with GRAM directly 
>> is bug 53 which is a request for sumission rate limiting.
>>
>> It might be relatively easy to implement that and see how the MolDyn 
>> workflow behaves then.
>>
>> I'm interested to see if Falkon can be avoided for this workflow.
>>
>>     
>
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>
>   

-- 
============================================
Ioan Raicu
Ph.D. Student
============================================
Distributed Systems Laboratory
Computer Science Department
University of Chicago
1100 E. 58th Street, Ryerson Hall
Chicago, IL 60637
============================================
Email: iraicu at cs.uchicago.edu
Web:   http://www.cs.uchicago.edu/~iraicu
       http://dsl.cs.uchicago.edu/
============================================
============================================

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20070913/841185d7/attachment.html>