[Swift-devel] duplicated job submission in swift-0.92?

Allan Espinosa aespinosa at cs.uchicago.edu
Wed Mar 30 18:37:40 CDT 2011


Or maybe local variables are static?  Maybe they mapped to different
files but to the same cache object?  But I have been doing local
variables in my own workflows though.

2011/3/30 Jonathan Monette <jon.monette at gmail.com>:
> Ok.  I understand this error better.  But shouldn't that be a different
> error then? Like a and b are mapped to the same file? I don't know if Swift
> can know this but looking at the explanation and error it should unless this
> cache message has a deeper meaning.
>
> On Wed, Mar 30, 2011 at 6:21 PM, Allan Espinosa <aespinosa at cs.uchicago.edu>
> wrote:
>>
>> I had this error before when two output mapper objects mapped to the same
>> file.
>>
>> $ swift bug_same.swift
>> Swift svn swift-r4208 cog-r3073
>>
>> RunID: 20110330-1818-ygec7ppa
>> Progress:  time:0
>> The cache already contains
>> localhost:bug_same-20110330-1818-ygec7ppa/shared/foo.
>>
>> The cache already contains
>> localhost:bug_same-20110330-1818-ygec7ppa/shared/foo.
>>
>> Progress:  time:1960  Stage in:1  Finished successfully:1
>> The cache already contains
>> localhost:bug_same-20110330-1818-ygec7ppa/shared/foo.
>>
>> [aespinosa at communicado testing]$
>> [aespinosa at communicado testing]$ cat bug_same.swift
>> type file;
>>
>> app (file out) echo(string input) {
>>  echo input stdout=@filename(out);
>> }
>>
>> file a <"foo">;
>> file b <"foo">;
>>
>> a = echo("hello world");
>> b = echo("foo bar");
>>
>> But i think you should be using other Swift mappers that does
>> auto-numbering  of files by default.
>>
>> -Allan
>>
>> 2011/3/30 Zhao Zhang <zhaozhang at uchicago.edu>:
>> > Hi guys,
>> >
>> > I am seeing something weird in swfit-0.92. Any idea about this?
>> > The swift script is very simple:
>> >
>> > zzhang at sandbox:~/workplace/Andrey> cat movies.swift
>> > type Pickle {}
>> > type History {}
>> > type Image {}
>> >
>> > app (History historyout) movie_graph (int rerun, int epochs, Pickle
>> > picklefile)
>> > {
>> >   movie_graph rerun epochs;
>> > }
>> >
>> > int arr[];
>> > iterate i
>> > {
>> >  arr[i] = i+1;
>> > }until(i == 1);
>> >
>> > int epochs;
>> > epochs = 3;
>> > Pickle picklefile <single_file_mapper; file="for_movies.pickled">;
>> > foreach a in arr{
>> >  History historyout <single_file_mapper; file=@strcat("output/rerun", a,
>> > "/histories.pickled-", a)>;
>> >  historyout = movie_graph(a, epochs, picklefile);
>> > }
>> >
>> >
>> >
>> > I ran the script with the latest 0.92 version, which is loaded as a
>> > module
>> > on beagle. The I saw this:
>> > zzhang at sandbox:~/workplace/Andrey> swift -tc.file ./tc.data movies.swift
>> > Variable epochs defined in scope 99878388 shadows variable of same name
>> > in
>> > scope 1813605401
>> > Variable picklefile defined in scope 99878388 shadows variable of same
>> > name
>> > in scope 1813605401
>> > Swift svn swift-r4157 cog-r3056
>> >
>> > RunID: 20110330-1636-ev8vm8gb
>> > Progress:
>> > Progress:  Selecting site:3  Active:1
>> > Progress:  Selecting site:3  Checking status:1
>> > Progress:  Selecting site:2  Stage in:1  Finished successfully:1
>> > Progress:  Selecting site:2  Active:1  Finished successfully:1
>> > Progress:  Selecting site:2  Active:1  Finished successfully:1
>> > Progress:  Selecting site:1  Stage in:1  Finished successfully:2
>> > Progress:  Selecting site:1  Active:1  Finished successfully:2
>> > Progress:  Selecting site:1  Checking status:1  Finished successfully:2
>> > The cache already contains
>> >
>> > localhost:movies-20110330-1636-ev8vm8gb/shared/output/rerun1/histories.pickled-1.
>> >
>> > Execution failed:
>> >        The cache already contains
>> >
>> > localhost:movies-20110330-1636-ev8vm8gb/shared/output/rerun1/histories.pickled-1.
>> >
>> >
>> > Then I switched to an older version, it worked well.
>> > zzhang at sandbox:~/workplace/Andrey> swift -tc.file ./tc.data movies.swift
>> > Variable epochs defined in scope 212602028 shadows variable of same name
>> > in
>> > scope 1538939834
>> > Variable picklefile defined in scope 212602028 shadows variable of same
>> > name
>> > in scope 1538939834
>> > Swift svn swift-r3291 (swift modified locally) cog-r2750 (cog modified
>> > locally)
>> >
>> > RunID: 20110330-1639-gmbyz1qa
>> > Progress:
>> > Progress:  Active:2
>> > Progress:  Active:1  Checking status:1
>> > Final status:  Finished successfully:2
>> _______________________________________________
>> Swift-devel mailing list
>> Swift-devel at ci.uchicago.edu
>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>
>



More information about the Swift-devel mailing list