[Swift-devel] [Bug 72] Campaign for scaling wf up to 244 molecules

[Mike Wilde]

Good discussion.

I know this will take a bit of time to make a habit, but lets try to move 
discussion to the Campaign bug, when it applies. Click the link and enter a 
Comment as your reply in bugzilla. I think the Globus team is very used to doing 
this, and I believe thats a good practice and we should adopt it.

- Mike



Ioan Raicu wrote, On 6/28/2007 4:36 PM:
> There is an option to have a pool of threads work on these data 
> structures, but the pool size is set to 1.  Point is well taken, we have 
> fixed this, but I am not convinced this is where the problem was.  We'll 
> see after we do another run with all the extra logging.
> 
> Ioan
> 
> Mihael Hategan wrote:
>>>> - did Mihael discover an error in Falkon mutex code?
>>>>
>>>>   
>>>>       
>>> We are not sure, but we are adding extra synchronization in several 
>>> parts of the Falkon provider.  The reason we are saying that we are not 
>>> sure is that we stress tested (pushing 50~100 tasks/sec) both the Falkon 
>>> provider and Falkon itself over and over again, and we never encountered 
>>> this.  Now, we have a workflow that has an average of 1 task/sec, I find 
>>> it hard to beleive that a synchronization issue that never surfaced 
>>> before under stress testing is surfacing now under such a light load.
>>>     
>>
>> ?!?
>> You are mutating maps and list from concurrent threads without
>> synchronization. That is a problem regardless of any other
>> considerations.
>>
>> Mihael
>>
>>
>>
>>
>>   
> 
> -- 
> ============================================
> Ioan Raicu
> Ph.D. Student
> ============================================
> Distributed Systems Laboratory
> Computer Science Department
> University of Chicago
> 1100 E. 58th Street, Ryerson Hall
> Chicago, IL 60637
> ============================================
> Email: iraicu at cs.uchicago.edu
> Web:   http://www.cs.uchicago.edu/~iraicu
>        http://dsl.cs.uchicago.edu/
> ============================================
> ============================================
> 
> 
> ------------------------------------------------------------------------
> 
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel

-- 
Mike Wilde
Computation Institute, University of Chicago
Math & Computer Science Division
Argonne National Laboratory
Argonne, IL   60439    USA
tel 630-252-7497 fax 630-252-1997