[Swift-devel] Re: [Newslab] Re: Getting all RSS data into database

[Quan Tran Pham]

I would support the idea.

That foldC-like function has been used in some other languages:
+ reduce in python (they have order from left to right, by the way)
+ reduce phase in MapReduce programming model (
http://labs.google.com/papers/mapreduce.html)

Quan

On Wed, Feb 27, 2008 at 2:32 AM, Ben Clifford <benc at hawaga.org.uk> wrote:

>
> Note: I added swift-devel to this piece of the thread because it is
> relevant there; and perhaps now not so relevant to the newslab list.
>
> On Tue, 26 Feb 2008, Quan Tran Pham wrote:
>
> > > What I think you are trying to do is merge a bunch of files into a
> single
> > big file? (which is not in itself a merge sort)
>
> > I have merge2 that merge two sorted files (contain sorted key + value)
> into
> > one big sorted file.
>
> A different way of thinking about this, which is perhaps more of interest
> to the swift development group rather than newslab directly:
>
> Define a binary operator like >+ meaning somthing like
> ordered-concatenate, which will combine two files in the appropriate
> ordered fashion.
>
>  file >+ file  -->  file
>
> This operator is commutative.
>
> Then have foldC able to fold knowing that the supplied operator is
> commutative (so it can split up in a binary fashion, or however other way
> it cares to).
>
> Now say:
>
>  file[] inputs
>  file output
>  output = foldC (>+) inputs
>
> Perhaps foldC should be provided by Swift, with >+ provided as a
> procedure.
>
> --
>



-- 
Quan Tran Pham
PhD Student
Department of Computer Science
University of Chicago
1100 E 58th Street, Chicago, IL 60637
Office: Ryerson 178
Phone: (773)702-4227
Fax: (773)702-8487
quanpt at cs.uchicago.edu
---
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20080227/1f95eb62/attachment.html>