[Swift-devel] Comparing Swift and Hadoop

[Ioan Raicu]

Hi Ketan,
We had Some preliminary work back in 2008 on this topic, we presented it as a poster. 
http://www.cs.iit.edu/~iraicu/research/publications/2008_TG08_swift+hadoop-poster.pdf

Ioan

-- 
=================================================================
Ioan Raicu, Ph.D.
Assistant Professor
=================================================================
Computer Science Department
Illinois Institute of Technology
10 W. 31st Street Chicago, IL 60616 =================================================================
Cel:   1-847-722-0876
Email: iraicu at cs.iit.edu
Web:   http://www.cs.iit.edu/~iraicu/
=================================================================
=================================================================



On May 13, 2012, at 9:27 AM, Ketan Maheshwari <ketancmaheshwari at gmail.com> wrote:

> Hi,
> 
> We are working on a project from GE Energy corporation which runs independent MonteCarlo simulations in order to find device reliability leading to a power grid wise device replacement decisions. The computation is repeated MC simulations done in parallel.
> 
> Currently, this is running under Hadoop setup on Cornell Redcloud and EC2 (10 nodes). Looking at the computation, it struck me this is a good Swift candidate. And since the performance numbers etc are already extracted for Hadoop, it might also be nice to have a comparison between Swift and Hadoop.
> 
> However, some reality check before diving in: has it been done before? Do we know how Swift fares against map-reduce? Are they even comparable? I have faced this question twice here: Why use Swift when you have Hadoop?
> 
> I could see Hadoop needs quite a bit of setup effort before getting it to run. Could we quantify usability and compare the two?
> 
> Any ideas and inputs are welcome.
> 
> Regards,
> -- 
> Ketan
> 
> 
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20120513/8cd8518e/attachment.html>