Hello,<br><br>I have a few python scripts that chain input/output, and I was wondering what the best way to call these scripts?<br><br>Thus far, I've tried placing them into a shell script, but I'm not sure how to make the shell scripts take arguments. How would one do this?<br>
Here's what I have:<br><br><span style="font-family:courier new,monospace">type shellfile;</span><br style="font-family:courier new,monospace"><span style="font-family:courier new,monospace">type pythonfile;<br>type inputfile;<br>
</span><br><span style="font-family:courier new,monospace">app (reducefile sout) runmapreduce(shellfile shellscript, inputfile f, pythonfile map, pythonfile combine, pythonfile reduce){</span><br style="font-family:courier new,monospace">
<span style="font-family:courier new,monospace"> shell "source" @shellscript @f @map @combine @reduce stdout=@filename(sout);</span><br style="font-family:courier new,monospace"><span style="font-family:courier new,monospace">}</span><br>
<span style="font-family:courier new,monospace">shellfile mapreduce_shell_script<single_file_mapper;file="mapreduce.sh">;</span><br style="font-family:courier new,monospace"><span style="font-family:courier new,monospace">pythonfile map_fun<single_file_mapper;file="mapcount.py">;</span><br style="font-family:courier new,monospace">
<span style="font-family:courier new,monospace">pythonfile combine_fun<single_file_mapper;file="combinecount.py">;</span><br style="font-family:courier new,monospace"><span style="font-family:courier new,monospace">pythonfile reduce_fun<single_file_mapper;file="reducecount.py">;</span><span style="font-family:courier new,monospace"></span><br>
<br>The shell script doesn't take the arguments, which leads me to believe I have specified them incorrectly. Would it be better to make the python files themselves executable, and simply chain their operation within a swift app function?<br>
<br>I also was wondering if there was a way within swift to specify the node upon which a specific job was run? More specifically, I'd like to run a job on the master node that aggregates the results of the computations on the worker nodes. Would such a thing be possible in swift, or would I need to configure coasters to accommodate this?<br>
<br>Thanks,<br><br>Matt Lee<br><br>