[Swift-devel] 0.7rc1 + local coasters + communicado

[Ioan Raicu]

The way I addressed this in Falkon is to have two asynchronous threads 
that reads both the stdout and stderr at the same time, and maybe a 
third thread that is waiting for the application thread to terminate, 
and it works quite well, other than the fact that it uses 4 threads 
instead of 1 thread. I had a similar issue as you described below, which 
prompted me to implement any application thread that the worker invokes, 
to launch these other extra threads to manage the app thread.

Ioan

Mihael Hategan wrote:
> On Tue, 2008-11-04 at 11:15 -0600, Mihael Hategan wrote:
>   
>> On Tue, 2008-11-04 at 02:32 +0000, Ben Clifford wrote:
>>     
>>> I just tried running coasters on communicado submitting locally. Several 
>>> times in a row its got stuck like this for at least 12 minutes: (with 
>>> different numbers of completed and active jobs, but around this many...)
>>>
>>>       
>>>> Progress:  Selecting site:978 Active:4 Finished successfully:18
>>>>         
>>> This is running with tests/sites/coasters/coaster-local.xml with 
>>> tests-sites/run-site modified to run 066-many.swift
>>>       
>> Heh. Worker stuck trying to write to stderr.
>>
>>     
>
> And that's because the local provider first consumes stdout and only
> then stderr, which means stderr is only dealt with after the process
> completes. Not that there isn't a comment there saying precisely that.
>
>   
>>> The same runs ok on my laptop repeatedly.
>>>       
>
> I suppose the difference is in process io buffer sizes.
>
>
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>
>   

-- 
===================================================
Ioan Raicu
Ph.D. Candidate
===================================================
Distributed Systems Laboratory
Computer Science Department
University of Chicago
1100 E. 58th Street, Ryerson Hall
Chicago, IL 60637
===================================================
Email: iraicu at cs.uchicago.edu
Web:   http://www.cs.uchicago.edu/~iraicu
http://dev.globus.org/wiki/Incubator/Falkon
http://dsl-wiki.cs.uchicago.edu/index.php/Main_Page
===================================================
===================================================

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20081104/12473527/attachment.html>