[Swift-devel] Re: Another performance comparison of DOCK

[Michael Wilde]

That might be a low rate, but its also not clear why its creating so 
many handles: I thought we only have about 6K jobs here, with 2 files in 
and 1 file out per job:

doall(params pset[])
{
   foreach p in pset {
     DockIn ifile  <single_file_mapper;
                    file=@strcat("mol-1M/",p.filename,".in")>;
     Mol2 mfile    <single_file_mapper;
                    file=@strcat("mol-1M/",p.filename,".mol2")>;
     DockOut ofile <single_file_mapper;
                    file=@strcat("mol-1M/",p.filename,".out")>;
     ofile = dock(ifile, mfile);
   }
}

I would have expected more like 18,000 datasets.

Are we calling the mapper incorrectly in this script?

On 4/13/08 3:58 PM, Ben Clifford wrote:
> On Sun, 13 Apr 2008, Ben Clifford wrote:
> 
>> There is a period of about 500s or so until stuff starts to happen; I 
>> haven't looked at it.
> 
> What happens in the log file for this period is lots of DSHandle creation 
> (vdl:new) - it creates 115596 datasets in 451 seconds, which is about 256 
> per second. That seems quite a low rate.
>