[Swift-devel] duplicated job submission in swift-0.92?

Jonathan Monette jon.monette at gmail.com
Wed Mar 30 18:33:04 CDT 2011


Ok.  I understand this error better.  But shouldn't that be a different
error then? Like a and b are mapped to the same file? I don't know if Swift
can know this but looking at the explanation and error it should unless this
cache message has a deeper meaning.

On Wed, Mar 30, 2011 at 6:21 PM, Allan Espinosa
<aespinosa at cs.uchicago.edu>wrote:

> I had this error before when two output mapper objects mapped to the same
> file.
>
> $ swift bug_same.swift
> Swift svn swift-r4208 cog-r3073
>
> RunID: 20110330-1818-ygec7ppa
> Progress:  time:0
> The cache already contains
> localhost:bug_same-20110330-1818-ygec7ppa/shared/foo.
>
> The cache already contains
> localhost:bug_same-20110330-1818-ygec7ppa/shared/foo.
>
> Progress:  time:1960  Stage in:1  Finished successfully:1
> The cache already contains
> localhost:bug_same-20110330-1818-ygec7ppa/shared/foo.
>
> [aespinosa at communicado testing]$
> [aespinosa at communicado testing]$ cat bug_same.swift
> type file;
>
> app (file out) echo(string input) {
>  echo input stdout=@filename(out);
> }
>
> file a <"foo">;
> file b <"foo">;
>
> a = echo("hello world");
> b = echo("foo bar");
>
> But i think you should be using other Swift mappers that does
> auto-numbering  of files by default.
>
> -Allan
>
> 2011/3/30 Zhao Zhang <zhaozhang at uchicago.edu>:
> > Hi guys,
> >
> > I am seeing something weird in swfit-0.92. Any idea about this?
> > The swift script is very simple:
> >
> > zzhang at sandbox:~/workplace/Andrey> cat movies.swift
> > type Pickle {}
> > type History {}
> > type Image {}
> >
> > app (History historyout) movie_graph (int rerun, int epochs, Pickle
> > picklefile)
> > {
> >   movie_graph rerun epochs;
> > }
> >
> > int arr[];
> > iterate i
> > {
> >  arr[i] = i+1;
> > }until(i == 1);
> >
> > int epochs;
> > epochs = 3;
> > Pickle picklefile <single_file_mapper; file="for_movies.pickled">;
> > foreach a in arr{
> >  History historyout <single_file_mapper; file=@strcat("output/rerun", a,
> > "/histories.pickled-", a)>;
> >  historyout = movie_graph(a, epochs, picklefile);
> > }
> >
> >
> >
> > I ran the script with the latest 0.92 version, which is loaded as a
> module
> > on beagle. The I saw this:
> > zzhang at sandbox:~/workplace/Andrey> swift -tc.file ./tc.data movies.swift
> > Variable epochs defined in scope 99878388 shadows variable of same name
> in
> > scope 1813605401
> > Variable picklefile defined in scope 99878388 shadows variable of same
> name
> > in scope 1813605401
> > Swift svn swift-r4157 cog-r3056
> >
> > RunID: 20110330-1636-ev8vm8gb
> > Progress:
> > Progress:  Selecting site:3  Active:1
> > Progress:  Selecting site:3  Checking status:1
> > Progress:  Selecting site:2  Stage in:1  Finished successfully:1
> > Progress:  Selecting site:2  Active:1  Finished successfully:1
> > Progress:  Selecting site:2  Active:1  Finished successfully:1
> > Progress:  Selecting site:1  Stage in:1  Finished successfully:2
> > Progress:  Selecting site:1  Active:1  Finished successfully:2
> > Progress:  Selecting site:1  Checking status:1  Finished successfully:2
> > The cache already contains
> >
> localhost:movies-20110330-1636-ev8vm8gb/shared/output/rerun1/histories.pickled-1.
> >
> > Execution failed:
> >        The cache already contains
> >
> localhost:movies-20110330-1636-ev8vm8gb/shared/output/rerun1/histories.pickled-1.
> >
> >
> > Then I switched to an older version, it worked well.
> > zzhang at sandbox:~/workplace/Andrey> swift -tc.file ./tc.data movies.swift
> > Variable epochs defined in scope 212602028 shadows variable of same name
> in
> > scope 1538939834
> > Variable picklefile defined in scope 212602028 shadows variable of same
> name
> > in scope 1538939834
> > Swift svn swift-r3291 (swift modified locally) cog-r2750 (cog modified
> > locally)
> >
> > RunID: 20110330-1639-gmbyz1qa
> > Progress:
> > Progress:  Active:2
> > Progress:  Active:1  Checking status:1
> > Final status:  Finished successfully:2
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>



-- 
Any intelligent fool can make things bigger and more complex... It takes a
touch of genius - and a lot of courage to move in the opposite direction.
- Albert Einstein
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20110330/0fb2baa2/attachment.html>


More information about the Swift-devel mailing list