[Swift-devel] [Bug 76] disable intermediate stageout of data

[Mihael Hategan]

On Thu, 2007-07-05 at 16:55 +0000, Ben Clifford wrote:

> So a different model of mapping (which might work better when we want data 
> that doesn't necessarily exist as discrete files or as in-memory values - 
> the two examples that I've seen talked about are 'data from an sql 
> database' and 'constants in a csv file') might be that mappers generate 
> DSHandle trees (specifically a mapper generates a DSHandle, which might 
> have descendants). Those DSHandles might have values, might have 
> filenames, might have other attributes, might have ongoing annotation 
> (which could include keeping track of where within-this-run copies have 
> been made).

However, we should keep in mind that mapping is lazy. We want that to
achieve scalability, and at least in theory, infinite arrays (for that
we would need some form of garbage collection).

On the other hand, data itself is future-like. The difference being that
everything is computed as soon as possible, but access is delayed until
data is available.

> 
> --
>