[ExM Users] File race condition?

[Ozik, Jonathan]

Thanks Tim, this will do the trick.
I thought I was seeing that in some situations the necessary folders were being created but not in others. I could be wrong though.

Jonathan

On Apr 15, 2015, at 9:05 PM, Tim Armstrong <tim.g.armstrong at gmail.com<mailto:tim.g.armstrong at gmail.com>> wrote:

I think the problem is just that the directories the file is in isn't automatically created by write.  It probably would make sense for it to, so I'm checking in a fix to that.

As a workaround you could just do a mkdir before you use the directory:

import io;
import sys;
import files;

main
{
    string upf_file_name = argv("f"); // e.g., -f="upf.txt"
    string upf_lines[]  = file_lines(input(upf_file_name));
    foreach s,i in upf_lines
    {
      string instance_dir = strcat(strcat("instance_",fromint(i)),"/");

      my_mkdir(instance_dir) =>
      {
        file out <strcat(instance_dir,"out.txt")>;
        file err <strcat(instance_dir,"err.txt")>;
        file tmp <strcat(instance_dir,"upf.txt")> = write(s);
      }
    }
}

app (void o) my_mkdir(string dirname) {
  "mkdir" "-p" dirname;
}


On 15 April 2015 at 20:03, Ozik, Jonathan <jozik at anl.gov<mailto:jozik at anl.gov>> wrote:
Hello all,

I’m wondering if I’m seeing an unintended file I/O race condition or if I’m simply doing something wrong but I’m getting errors when trying to execute this script using trunk:

swift-t -n 4 very_simple.swift -f=upf_small_3.txt
(where upf_small_3.txt is a file with 3 lines)

##### very_simple.swift #####
import io;
import sys;
import files;

main
{
    string upf_file_name = argv("f"); // e.g., -f="upf.txt"
    string upf_lines[]  = file_lines(input(upf_file_name));
    foreach s,i in upf_lines
    {
      string instance_dir = strcat(strcat("instance_",fromint(i)),"/");

      file out <strcat(instance_dir,"out.txt")>;
      file err <strcat(instance_dir,"err.txt")>;
      file tmp <strcat(instance_dir,"upf.txt")> = write(s);
    }
}
##### very_simple.swift #####

The errors are:
couldn't open "instance_1/upf.txt": no such file or directory
    while executing
"::open [ local_file_path $local_file ] w+ "
    (procedure "turbine::file_write_local" line 3)
    invoked from within
"turbine::file_write_local v:tmp ${v:s}"
    (procedure "__entry-call_foreign-write" line 5)
    invoked from within
"__entry-call_foreign-write {2  randomSeed      1,zombieStep    0.1,humanStep   0.5,human_count 200,zombie_count        2} instance_1/upf.txt {file 7 is_mapped 1}"
Turbine worker task error in: __entry-call_foreign-write {2     randomSeed      1,zombieStep    0.1,humanStep   0.5,human_count 200,zombie_count        2} instance_1/upf.txt {file 7 is_mapped 1}
    invoked from within
"c::worker_loop $WORK_TYPE($mode) $keyword_args"
    (procedure "standard_worker" line 27)
    invoked from within
"standard_worker $rules $startup_cmd "
    (procedure "enter_mode_unchecked" line 5)
    invoked from within
"enter_mode_unchecked $rules $startup_cmd"
    (procedure "enter_mode" line 5)
    invoked from within
"enter_mode $rules $startup_cmd “

Jonathan
_______________________________________________
ExM-user mailing list
ExM-user at lists.mcs.anl.gov<mailto:ExM-user at lists.mcs.anl.gov>
https://lists.mcs.anl.gov/mailman/listinfo/exm-user

_______________________________________________
ExM-user mailing list
ExM-user at lists.mcs.anl.gov<mailto:ExM-user at lists.mcs.anl.gov>
https://lists.mcs.anl.gov/mailman/listinfo/exm-user

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/exm-user/attachments/20150416/0ff61c82/attachment-0001.html>