[Swift-devel] duplicated job submission in swift-0.92?

[Allan Espinosa]

I had this error before when two output mapper objects mapped to the same file.

$ swift bug_same.swift
Swift svn swift-r4208 cog-r3073

RunID: 20110330-1818-ygec7ppa
Progress:  time:0
The cache already contains localhost:bug_same-20110330-1818-ygec7ppa/shared/foo.

The cache already contains localhost:bug_same-20110330-1818-ygec7ppa/shared/foo.

Progress:  time:1960  Stage in:1  Finished successfully:1
The cache already contains localhost:bug_same-20110330-1818-ygec7ppa/shared/foo.

[aespinosa at communicado testing]$
[aespinosa at communicado testing]$ cat bug_same.swift
type file;

app (file out) echo(string input) {
  echo input stdout=@filename(out);
}

file a <"foo">;
file b <"foo">;

a = echo("hello world");
b = echo("foo bar");

But i think you should be using other Swift mappers that does
auto-numbering  of files by default.

-Allan

2011/3/30 Zhao Zhang <zhaozhang at uchicago.edu>:
> Hi guys,
>
> I am seeing something weird in swfit-0.92. Any idea about this?
> The swift script is very simple:
>
> zzhang at sandbox:~/workplace/Andrey> cat movies.swift
> type Pickle {}
> type History {}
> type Image {}
>
> app (History historyout) movie_graph (int rerun, int epochs, Pickle
> picklefile)
> {
>   movie_graph rerun epochs;
> }
>
> int arr[];
> iterate i
> {
>  arr[i] = i+1;
> }until(i == 1);
>
> int epochs;
> epochs = 3;
> Pickle picklefile <single_file_mapper; file="for_movies.pickled">;
> foreach a in arr{
>  History historyout <single_file_mapper; file=@strcat("output/rerun", a,
> "/histories.pickled-", a)>;
>  historyout = movie_graph(a, epochs, picklefile);
> }
>
>
>
> I ran the script with the latest 0.92 version, which is loaded as a module
> on beagle. The I saw this:
> zzhang at sandbox:~/workplace/Andrey> swift -tc.file ./tc.data movies.swift
> Variable epochs defined in scope 99878388 shadows variable of same name in
> scope 1813605401
> Variable picklefile defined in scope 99878388 shadows variable of same name
> in scope 1813605401
> Swift svn swift-r4157 cog-r3056
>
> RunID: 20110330-1636-ev8vm8gb
> Progress:
> Progress:  Selecting site:3  Active:1
> Progress:  Selecting site:3  Checking status:1
> Progress:  Selecting site:2  Stage in:1  Finished successfully:1
> Progress:  Selecting site:2  Active:1  Finished successfully:1
> Progress:  Selecting site:2  Active:1  Finished successfully:1
> Progress:  Selecting site:1  Stage in:1  Finished successfully:2
> Progress:  Selecting site:1  Active:1  Finished successfully:2
> Progress:  Selecting site:1  Checking status:1  Finished successfully:2
> The cache already contains
> localhost:movies-20110330-1636-ev8vm8gb/shared/output/rerun1/histories.pickled-1.
>
> Execution failed:
>        The cache already contains
> localhost:movies-20110330-1636-ev8vm8gb/shared/output/rerun1/histories.pickled-1.
>
>
> Then I switched to an older version, it worked well.
> zzhang at sandbox:~/workplace/Andrey> swift -tc.file ./tc.data movies.swift
> Variable epochs defined in scope 212602028 shadows variable of same name in
> scope 1538939834
> Variable picklefile defined in scope 212602028 shadows variable of same name
> in scope 1538939834
> Swift svn swift-r3291 (swift modified locally) cog-r2750 (cog modified
> locally)
>
> RunID: 20110330-1639-gmbyz1qa
> Progress:
> Progress:  Active:2
> Progress:  Active:1  Checking status:1
> Final status:  Finished successfully:2