[Swift-user] Why so few nodes ?

[Xueyuan Zhou]

Hi all,

I am using swift on Teraport, in some cases, I only got 4 nodes! So it is 
extremely slow. Even slower than single machine.

I have 21 input files, each is about 26M. Computation is straightforward,

foreach ifile, i in infile{
 outfile[i] = opt(ifile, myjar);
}

In this case I only got 4 nodes.

When input files are smaller, like 1M, the computation speed, nodes, are 
pretty reasonable.(about>30 nodes, 10min)


Anyone knows why it happened ? How can I know how to optimize this ? Is it 
because my application code uses too much memory or too slow for large data 
set?


Thanks,

Xueyuan