From bugzilla-daemon at mcs.anl.gov Mon Dec 3 15:59:35 2007 From: bugzilla-daemon at mcs.anl.gov (bugzilla-daemon at mcs.anl.gov) Date: Mon, 3 Dec 2007 15:59:35 -0600 (CST) Subject: [Swift-devel] [Bug 114] need to specify run directory name on remote site In-Reply-To: Message-ID: <20071203215935.2AAA4164EC@foxtrot.mcs.anl.gov> http://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=114 benc at hawaga.org.uk changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution| |FIXED ------- Comment #1 from benc at hawaga.org.uk 2007-12-03 15:59 ------- r1504 introduces a command-line parameter -runid that allows this to be set. Caution should be exercised when using this parameter to ensure an appropriate degree of uniqueness. >From the commit log: Added -runid parameter that specifies the run identifier on the command line, rather than having it automatically generated. This must be unique for every invocation of a workflow and is used in several places to keep files from different executions cleanly separated. By default, a datestamp and random number are used to generate a run identifier. When using this parameter, care should be taken to ensure that the run ID remains unique with respect to all other run IDs that might be used, irrespective of (at least) expected run location, workflow or user. -- Configure bugmail: http://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are the assignee for the bug, or are watching the assignee. From raffaele.montella at uniparthenope.it Wed Dec 5 11:40:26 2007 From: raffaele.montella at uniparthenope.it (Dr. Raffaele Montella) Date: Wed, 5 Dec 2007 11:40:26 -0600 Subject: [Swift-devel] (no subject) Message-ID: <000301c83765$ebce75a0$c36b60e0$@montella@uniparthenope.it> Hi! I'm learning how to configure swift, developing swift workflows and I hope contribute to the development as soon. I installed Swift on a machine at CI where I have certificates in order to execute on two machine at my home University in Naples. On this two machine is installed GT4.0.5 with the gatekeeper up and running. I can run jobs from floater-245.ci.uchicago.edu to data.uniparthenope.it using globus-job-run and perform gridftp operations as here: infonav at floater-245:~/swift$ globus-url-copy file:////home/infonav/swift/hostname.swift gsiftp://data.uniparthenope.it//tmp/hostname.swift infonav at floater-245:~/swift$ globus-url-copy gsiftp://data.uniparthenope.it//tmp/hostname.swift file:////tmp/hostname.swift infonav at floater-245:~/swift$ ls /tmp VMW hostname.swift hsperfdata_globus hsperfdata_infonav mc-infonav swift.log x509up_u1001 infonav at floater-245:~/swift$ globus-job-run data.uniparthenope.it /bin/hostname data.uniparthenope.it I configured my sites.xml in that way: /var/tmp /tmp /tmp And my tc.data as the following: #This is the transformation catalog. # #It comes pre-configured with a number of simple transformations with #paths that are likely to work on a linux box. However, on some systems, #the paths to these executables will be different (for example, sometimes #some of these programs are found in /usr/bin rather than in /bin) # #NOTE WELL: fields in this file must be separated by tabs, not spaces; and #there must be no trailing whitespace at the end of each line. # # sitename transformation path INSTALLED platform profiles localhost echo /bin/echo INSTALLED INTEL32::LINUX null localhost cat /bin/cat INSTALLED INTEL32::LINUX null localhost ls /bin/ls INSTALLED INTEL32::LINUX null localhost wc /bin/wc INSTALLED INTEL32::LINUX null localhost grep /bin/grep INSTALLED INTEL32::LINUX null localhost sort /bin/sort INSTALLED INTEL32::LINUX null localhost paste /bin/paste INSTALLED INTEL32::LINUX null localhost terrain /home/infonav/Germana/swift/do_terrain INSTALLED INTEL32::LINUX null data hostname /bin/hostname INSTALLED INTEL32::LINUX null dgbeobi date /bin/date INSTALLED INTEL32::LINUX null Using both the hostname.swift. type file; (file ofile)hostname() { app { hostname; } } file ofile <"hostname.txt">; ofile = hostname(); .and date.swift code. type file; (file ofile)date() { app { date; } } file ofile <"date.txt">; ofile = date(); I receive the following error in job cleanup: Swift v0.3 r1319 (modified locally) RunID: 20071204-2116-xvhkcj88 hostname started Failed to clean up job java.lang.IllegalStateException: No registered callback handler for org.globus.gsi.gssapi.GlobusGSSCredentialImpl at 11b92ef at org.globus.cog.abstraction.impl.execution.gt2.CallbackHandlerManager.decreas eUsageCount(CallbackHandlerManager.java:33) at org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.clean up(JobSubmissionTaskHandler.java:482) at org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.statu sChanged(JobSubmissionTaskHandler.java:475) at org.globus.gram.GramJob.setStatus(GramJob.java:184) at org.globus.gram.GramCallbackHandler.run(CallbackHandler.java:176) at java.lang.Thread.run(Thread.java:619) Failed to clean up job java.lang.IllegalStateException: No registered callback handler for org.globus.gsi.gssapi.GlobusGSSCredentialImpl at 11b92ef at org.globus.cog.abstraction.impl.execution.gt2.CallbackHandlerManager.decreas eUsageCount(CallbackHandlerManager.java:33) at org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.clean up(JobSubmissionTaskHandler.java:482) at org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.statu sChanged(JobSubmissionTaskHandler.java:475) at org.globus.gram.GramJob.setStatus(GramJob.java:184) at org.globus.gram.GramCallbackHandler.run(CallbackHandler.java:176) at java.lang.Thread.run(Thread.java:619) Failed to clean up job java.lang.IllegalStateException: No registered callback handler for org.globus.gsi.gssapi.GlobusGSSCredentialImpl at 11b92ef at org.globus.cog.abstraction.impl.execution.gt2.CallbackHandlerManager.decreas eUsageCount(CallbackHandlerManager.java:33) at org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.clean up(JobSubmissionTaskHandler.java:482) at org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.statu sChanged(JobSubmissionTaskHandler.java:475) at org.globus.gram.GramJob.setStatus(GramJob.java:184) at org.globus.gram.GramCallbackHandler.run(CallbackHandler.java:176) at java.lang.Thread.run(Thread.java:619) hostname failed Execution failed: Exception in hostname: Arguments: [] Host: data Directory: hostname-20071204-2116-xvhkcj88/hostname-vg2dq1li stderr.txt: stdout.txt: data.uniparthenope.it ---- Caused by: The following output files were not created by the application: hostname.txt What do you think about it? Do you have some suggestions? I attached to this mail both files on floater-245 and data. Thank you in advance. Raffaele -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: hostnameOnData.tar.gz Type: application/octet-stream Size: 3713 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: swiftOnFloater-245.tar.gz Type: application/octet-stream Size: 7840 bytes Desc: not available URL: From benc at hawaga.org.uk Wed Dec 5 11:57:49 2007 From: benc at hawaga.org.uk (Ben Clifford) Date: Wed, 5 Dec 2007 17:57:49 +0000 (GMT) Subject: [Swift-devel] (no subject) In-Reply-To: <000301c83765$ebce75a0$c36b60e0$@montella@uniparthenope.it> References: <000301c83765$ebce75a0$c36b60e0$@montella@uniparthenope.it> Message-ID: Two problems - the IllegalStateException exception you see is something that I've seen one other person get but have been unable to recreate myself. I think Mihael probably also hasn't been able to recreate it. What machine is floater-245? Is it your own personal machine? > Failed to clean up job > > java.lang.IllegalStateException: No registered callback handler for > org.globus.gsi.gssapi.GlobusGSSCredentialImpl at 11b92ef Also, you have a bug in your SwiftScript program: > (file ofile)hostname() { > > app { hostname; } > > } You need to specify that the output from hostname goes into ofile. For example, say: (file ofile)hostname() { app { hostname stdout=@filename(ofile); } } > > at > org.globus.cog.abstraction.impl.execution.gt2.CallbackHandlerManager.decreas > eUsageCount(CallbackHandlerManager.java:33) > > at > org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.clean > up(JobSubmissionTaskHandler.java:482) > > at > org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.statu > sChanged(JobSubmissionTaskHandler.java:475) > > at org.globus.gram.GramJob.setStatus(GramJob.java:184) > > at org.globus.gram.GramCallbackHandler.run(CallbackHandler.java:176) > > at java.lang.Thread.run(Thread.java:619) > > Failed to clean up job > > java.lang.IllegalStateException: No registered callback handler for > org.globus.gsi.gssapi.GlobusGSSCredentialImpl at 11b92ef > > at > org.globus.cog.abstraction.impl.execution.gt2.CallbackHandlerManager.decreas > eUsageCount(CallbackHandlerManager.java:33) > > at > org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.clean > up(JobSubmissionTaskHandler.java:482) > > at > org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.statu > sChanged(JobSubmissionTaskHandler.java:475) > > at org.globus.gram.GramJob.setStatus(GramJob.java:184) > > at org.globus.gram.GramCallbackHandler.run(CallbackHandler.java:176) > > at java.lang.Thread.run(Thread.java:619) > > Failed to clean up job > > java.lang.IllegalStateException: No registered callback handler for > org.globus.gsi.gssapi.GlobusGSSCredentialImpl at 11b92ef > > at > org.globus.cog.abstraction.impl.execution.gt2.CallbackHandlerManager.decreas > eUsageCount(CallbackHandlerManager.java:33) > > at > org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.clean > up(JobSubmissionTaskHandler.java:482) > > at > org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.statu > sChanged(JobSubmissionTaskHandler.java:475) > > at org.globus.gram.GramJob.setStatus(GramJob.java:184) > > at org.globus.gram.GramCallbackHandler.run(CallbackHandler.java:176) > > at java.lang.Thread.run(Thread.java:619) > > hostname failed > > Execution failed: > > Exception in hostname: > > Arguments: [] > > Host: data > > Directory: hostname-20071204-2116-xvhkcj88/hostname-vg2dq1li > > stderr.txt: > > stdout.txt: data.uniparthenope.it > > > > ---- > > > > Caused by: > > The following output files were not created by the application: > hostname.txt > > > > What do you think about it? > > Do you have some suggestions? > > I attached to this mail both files on floater-245 and data. > > > > Thank you in advance. > > Raffaele > > From foster at mcs.anl.gov Wed Dec 5 12:03:17 2007 From: foster at mcs.anl.gov (Ian Foster) Date: Wed, 05 Dec 2007 12:03:17 -0600 Subject: [Swift-devel] (no subject) In-Reply-To: References: <000301c83765$ebce75a0$c36b60e0$@montella@uniparthenope.it> Message-ID: <4756E7E5.8080100@mcs.anl.gov> should/could we generate warnings for such things? > > Also, you have a bug in your SwiftScript program: > > >> (file ofile)hostname() { >> >> app { hostname; } >> >> } >> > > You need to specify that the output from hostname goes into ofile. For > example, say: > > (file ofile)hostname() { > app { hostname stdout=@filename(ofile); } > } > > > > > > > > >> at >> org.globus.cog.abstraction.impl.execution.gt2.CallbackHandlerManager.decreas >> eUsageCount(CallbackHandlerManager.java:33) >> >> at >> org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.clean >> up(JobSubmissionTaskHandler.java:482) >> >> at >> org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.statu >> sChanged(JobSubmissionTaskHandler.java:475) >> >> at org.globus.gram.GramJob.setStatus(GramJob.java:184) >> >> at org.globus.gram.GramCallbackHandler.run(CallbackHandler.java:176) >> >> at java.lang.Thread.run(Thread.java:619) >> >> Failed to clean up job >> >> java.lang.IllegalStateException: No registered callback handler for >> org.globus.gsi.gssapi.GlobusGSSCredentialImpl at 11b92ef >> >> at >> org.globus.cog.abstraction.impl.execution.gt2.CallbackHandlerManager.decreas >> eUsageCount(CallbackHandlerManager.java:33) >> >> at >> org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.clean >> up(JobSubmissionTaskHandler.java:482) >> >> at >> org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.statu >> sChanged(JobSubmissionTaskHandler.java:475) >> >> at org.globus.gram.GramJob.setStatus(GramJob.java:184) >> >> at org.globus.gram.GramCallbackHandler.run(CallbackHandler.java:176) >> >> at java.lang.Thread.run(Thread.java:619) >> >> Failed to clean up job >> >> java.lang.IllegalStateException: No registered callback handler for >> org.globus.gsi.gssapi.GlobusGSSCredentialImpl at 11b92ef >> >> at >> org.globus.cog.abstraction.impl.execution.gt2.CallbackHandlerManager.decreas >> eUsageCount(CallbackHandlerManager.java:33) >> >> at >> org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.clean >> up(JobSubmissionTaskHandler.java:482) >> >> at >> org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.statu >> sChanged(JobSubmissionTaskHandler.java:475) >> >> at org.globus.gram.GramJob.setStatus(GramJob.java:184) >> >> at org.globus.gram.GramCallbackHandler.run(CallbackHandler.java:176) >> >> at java.lang.Thread.run(Thread.java:619) >> >> hostname failed >> >> Execution failed: >> >> Exception in hostname: >> >> Arguments: [] >> >> Host: data >> >> Directory: hostname-20071204-2116-xvhkcj88/hostname-vg2dq1li >> >> stderr.txt: >> >> stdout.txt: data.uniparthenope.it >> >> >> >> ---- >> >> >> >> Caused by: >> >> The following output files were not created by the application: >> hostname.txt >> >> >> >> What do you think about it? >> >> Do you have some suggestions? >> >> I attached to this mail both files on floater-245 and data. >> >> >> >> Thank you in advance. >> >> Raffaele >> >> >> > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From wilde at mcs.anl.gov Wed Dec 5 12:25:40 2007 From: wilde at mcs.anl.gov (Michael Wilde) Date: Wed, 05 Dec 2007 12:25:40 -0600 Subject: [Swift-devel] (no subject) In-Reply-To: <000301c83765$ebce75a0$c36b60e0$@montella@uniparthenope.it> References: <000301c83765$ebce75a0$c36b60e0$@montella@uniparthenope.it> Message-ID: <4756ED24.7070709@mcs.anl.gov> Im in Raphaele's office working this problem out with him. The gssapi error is what we've seen before - 0.3 running on Java 1.5. Raphaele is now building trunk which should work. We should post something on this or put out an 0.4, perhaps? The other error was the fact that he needed to designate stdout and map the filename in hist hostname() function. I showed him the example for this. - Mike On 12/5/07 11:40 AM, Dr. Raffaele Montella wrote: > Hi! > > I'm learning how to configure swift, developing swift workflows and I hope > contribute to the development as soon. > > I installed Swift on a machine at CI where I have certificates in order to > execute on two machine at my home University in Naples. > > On this two machine is installed GT4.0.5 with the gatekeeper up and running. > > I can run jobs from floater-245.ci.uchicago.edu to data.uniparthenope.it > using globus-job-run and perform gridftp operations as here: > > > > infonav at floater-245:~/swift$ globus-url-copy > file:////home/infonav/swift/hostname.swift > gsiftp://data.uniparthenope.it//tmp/hostname.swift > > infonav at floater-245:~/swift$ globus-url-copy > gsiftp://data.uniparthenope.it//tmp/hostname.swift > file:////tmp/hostname.swift > > infonav at floater-245:~/swift$ ls /tmp > > VMW hostname.swift hsperfdata_globus hsperfdata_infonav mc-infonav > swift.log x509up_u1001 > > infonav at floater-245:~/swift$ globus-job-run data.uniparthenope.it > /bin/hostname > > data.uniparthenope.it > > > > I configured my sites.xml in that way: > > > > > > > > > > > > > > > > patch="0" /> > > > > /var/tmp > > > > > > > > minor="2" patch="4"> > > > > url="data.uniparthenope.it/jobmanager-fork" major="2" minor="2" patch="4" /> > > /tmp > > > > > > > > > > major="2" minor="2" patch="4"> > > > > url="dgbeobi.uniparthenope.it/jobmanager-fork" major="2" minor="2" patch="4" > /> > > /tmp > > > > > > > > And my tc.data as the following: > > > > #This is the transformation catalog. > > # > > #It comes pre-configured with a number of simple transformations with > > #paths that are likely to work on a linux box. However, on some systems, > > #the paths to these executables will be different (for example, sometimes > > #some of these programs are found in /usr/bin rather than in /bin) > > # > > #NOTE WELL: fields in this file must be separated by tabs, not spaces; and > > #there must be no trailing whitespace at the end of each line. > > # > > # sitename transformation path INSTALLED platform profiles > > localhost echo /bin/echo INSTALLED > INTEL32::LINUX null > > localhost cat /bin/cat INSTALLED > INTEL32::LINUX null > > localhost ls /bin/ls INSTALLED > INTEL32::LINUX null > > localhost wc /bin/wc INSTALLED > INTEL32::LINUX null > > localhost grep /bin/grep INSTALLED > INTEL32::LINUX null > > localhost sort /bin/sort INSTALLED > INTEL32::LINUX null > > localhost paste /bin/paste INSTALLED > INTEL32::LINUX null > > localhost terrain /home/infonav/Germana/swift/do_terrain INSTALLED > INTEL32::LINUX null > > data hostname /bin/hostname INSTALLED > INTEL32::LINUX null > > dgbeobi date /bin/date INSTALLED > INTEL32::LINUX null > > > > Using both the hostname.swift. > > > > type file; > > > > (file ofile)hostname() { > > app { hostname; } > > } > > > > file ofile <"hostname.txt">; > > > > ofile = hostname(); > > > > .and date.swift code. > > > > type file; > > > > (file ofile)date() { > > app { date; } > > } > > > > file ofile <"date.txt">; > > > > ofile = date(); > > > > I receive the following error in job cleanup: > > > > Swift v0.3 r1319 (modified locally) > > > > RunID: 20071204-2116-xvhkcj88 > > hostname started > > Failed to clean up job > > java.lang.IllegalStateException: No registered callback handler for > org.globus.gsi.gssapi.GlobusGSSCredentialImpl at 11b92ef > > at > org.globus.cog.abstraction.impl.execution.gt2.CallbackHandlerManager.decreas > eUsageCount(CallbackHandlerManager.java:33) > > at > org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.clean > up(JobSubmissionTaskHandler.java:482) > > at > org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.statu > sChanged(JobSubmissionTaskHandler.java:475) > > at org.globus.gram.GramJob.setStatus(GramJob.java:184) > > at org.globus.gram.GramCallbackHandler.run(CallbackHandler.java:176) > > at java.lang.Thread.run(Thread.java:619) > > Failed to clean up job > > java.lang.IllegalStateException: No registered callback handler for > org.globus.gsi.gssapi.GlobusGSSCredentialImpl at 11b92ef > > at > org.globus.cog.abstraction.impl.execution.gt2.CallbackHandlerManager.decreas > eUsageCount(CallbackHandlerManager.java:33) > > at > org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.clean > up(JobSubmissionTaskHandler.java:482) > > at > org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.statu > sChanged(JobSubmissionTaskHandler.java:475) > > at org.globus.gram.GramJob.setStatus(GramJob.java:184) > > at org.globus.gram.GramCallbackHandler.run(CallbackHandler.java:176) > > at java.lang.Thread.run(Thread.java:619) > > Failed to clean up job > > java.lang.IllegalStateException: No registered callback handler for > org.globus.gsi.gssapi.GlobusGSSCredentialImpl at 11b92ef > > at > org.globus.cog.abstraction.impl.execution.gt2.CallbackHandlerManager.decreas > eUsageCount(CallbackHandlerManager.java:33) > > at > org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.clean > up(JobSubmissionTaskHandler.java:482) > > at > org.globus.cog.abstraction.impl.execution.gt2.JobSubmissionTaskHandler.statu > sChanged(JobSubmissionTaskHandler.java:475) > > at org.globus.gram.GramJob.setStatus(GramJob.java:184) > > at org.globus.gram.GramCallbackHandler.run(CallbackHandler.java:176) > > at java.lang.Thread.run(Thread.java:619) > > hostname failed > > Execution failed: > > Exception in hostname: > > Arguments: [] > > Host: data > > Directory: hostname-20071204-2116-xvhkcj88/hostname-vg2dq1li > > stderr.txt: > > stdout.txt: data.uniparthenope.it > > > > ---- > > > > Caused by: > > The following output files were not created by the application: > hostname.txt > > > > What do you think about it? > > Do you have some suggestions? > > I attached to this mail both files on floater-245 and data. > > > > Thank you in advance. > > Raffaele > > > > > ------------------------------------------------------------------------ > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel From mikekubal at yahoo.com Wed Dec 5 12:39:07 2007 From: mikekubal at yahoo.com (Mike Kubal) Date: Wed, 5 Dec 2007 10:39:07 -0800 (PST) Subject: [Swift-devel] parameter not supported error message Message-ID: <58122.23201.qm@web52304.mail.re2.yahoo.com> When Swift returns the following, to what parameter is it referring? run_fred failed The following errors have occurred: 1. Application "run_fred" failed (Parameter not supported) Arguments: "-rec 1beh.oeb.gz -dbase Marsha_lig_1.mol2 -prefix Marsha_lig_1" Host: Lear Directory: run_fred-3l1v4yauk3pz0/run_fred-98r673li STDERR: STDOUT: Thanks, Mike ____________________________________________________________________________________ Never miss a thing. Make Yahoo your home page. http://www.yahoo.com/r/hs From raffaele.montella at uniparthenope.it Wed Dec 5 14:25:10 2007 From: raffaele.montella at uniparthenope.it (Dr. Raffaele Montella) Date: Wed, 5 Dec 2007 14:25:10 -0600 Subject: [Swift-devel] Testing Swift using machine at UoNaplesParthenope (aka uniParthenope) Message-ID: <002101c8377c$ef3242a0$cd96c7e0$@montella@uniparthenope.it> Hi, I thank you because the suggestions in solving some problems about using Swift. Attached to this email the CA certificate could be installed in order to submit jobs to the grid at University of Naples Parthenope. Actually because we moved from one building to another we have just 1 server and 1 cluster, but when we come back in production we can share more than 100 cpus. This is the pool setup tested with swift. /tmp /tmp /tmp Dgbeobi is the cluster, data is a server. Both machines are installed with GT4.0.5 and gatekeeper for GT2 compatibility. I tested successfully Swift with the GT2 provider, but I don't know how to setup the url (or any other parameters) in order to use the execution service. May you suggest me how to? Feel free to use machines at uniPathenope as you wish. I'm happy about it. Raffaele PS: All machines in our grid use GT4 and Torque/PBS as local scheduler. Actually on this machine PBS is not yet configured. I'll update you on new machines availability. -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: globus_simple_ca_41e9014d_setup-0.19.tar.gz Type: application/octet-stream Size: 214599 bytes Desc: not available URL: From mikekubal at yahoo.com Wed Dec 5 14:56:52 2007 From: mikekubal at yahoo.com (Mike Kubal) Date: Wed, 5 Dec 2007 12:56:52 -0800 (PST) Subject: [Swift-devel] script that returns bad parameter error Message-ID: <753687.67764.qm@web52301.mail.re2.yahoo.com> Any thoughts on what might cause? type file {} (file score, file docked) run_fred (string ligand_prefix, file ligand_file, file receptor_file){ app { run_fred "-rec" receptor_file "-dbase" ligand_file "-prefix" ligand_prefix; } } string receptor_prefix = "1beh"; file receptor_file ; file fls[]; foreach ligand_file in fls{ string ligand_prefix = @strcut(@ligand_file,"\.\/(.*)\.mol2"); string score_file_name = @strcat(ligand_prefix,"_chemgauss3_scores.txt"); string docked_file_name = @strcat(ligand_prefix,"_chemgauss3_docked.mol2"); file score_file ; file docked_file ; (score_file,docked_file) = run_fred(ligand_prefix,ligand_file,receptor_file); } Thanks, Mike Kubal ____________________________________________________________________________________ Never miss a thing. Make Yahoo your home page. http://www.yahoo.com/r/hs From hategan at mcs.anl.gov Wed Dec 5 15:16:51 2007 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Wed, 05 Dec 2007 15:16:51 -0600 Subject: [Swift-devel] parameter not supported error message In-Reply-To: <58122.23201.qm@web52304.mail.re2.yahoo.com> References: <58122.23201.qm@web52304.mail.re2.yahoo.com> Message-ID: <1196889411.3978.5.camel@blabla.mcs.anl.gov> You probably have something in the sites file that upsets GRAM. Can you post that? On Wed, 2007-12-05 at 10:39 -0800, Mike Kubal wrote: > When Swift returns the following, to what parameter > is it referring? > > run_fred failed > The following errors have occurred: > 1. Application "run_fred" failed (Parameter not > supported) > Arguments: "-rec 1beh.oeb.gz -dbase > Marsha_lig_1.mol2 -prefix Marsha_lig_1" > Host: Lear > Directory: > run_fred-3l1v4yauk3pz0/run_fred-98r673li > STDERR: > STDOUT: > > Thanks, > > Mike > > > ____________________________________________________________________________________ > Never miss a thing. Make Yahoo your home page. > http://www.yahoo.com/r/hs > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > From benc at hawaga.org.uk Wed Dec 5 15:59:21 2007 From: benc at hawaga.org.uk (Ben Clifford) Date: Wed, 5 Dec 2007 21:59:21 +0000 (GMT) Subject: [Swift-devel] script that returns bad parameter error In-Reply-To: <753687.67764.qm@web52301.mail.re2.yahoo.com> References: <753687.67764.qm@web52301.mail.re2.yahoo.com> Message-ID: On Wed, 5 Dec 2007, Mike Kubal wrote: > run_fred "-rec" receptor_file "-dbase" > ligand_file "-prefix" ligand_prefix; In here, take the filenames of each file by saying @filenmame(receptor_file), like this: > run_fred "-rec" @filename(receptor_file) "-dbase" > @filename(ligand_file) "-prefix" ligand_prefix; -- From benc at hawaga.org.uk Wed Dec 5 16:04:15 2007 From: benc at hawaga.org.uk (Ben Clifford) Date: Wed, 5 Dec 2007 22:04:15 +0000 (GMT) Subject: [Swift-devel] (no subject) In-Reply-To: <4756ED24.7070709@mcs.anl.gov> References: <000301c83765$ebce75a0$c36b60e0$@montella@uniparthenope.it> <4756ED24.7070709@mcs.anl.gov> Message-ID: On Wed, 5 Dec 2007, Michael Wilde wrote: > The gssapi error is what we've seen before - 0.3 running on Java 1.5. > Raphaele is now building trunk which should work. We should post something on > this or put out an 0.4, perhaps? If a new release will make it better, then it would not be too bad to have a 0.4 in the next week or so. I'd like to figure out whether that helps or not though (for example, if I build it on my system, will it still break for others?). For that, better testing of the release candidate (when it appears) should probably happen by people other than me. -- From benc at hawaga.org.uk Wed Dec 5 16:09:20 2007 From: benc at hawaga.org.uk (Ben Clifford) Date: Wed, 5 Dec 2007 22:09:20 +0000 (GMT) Subject: [Swift-devel] (no subject) In-Reply-To: <4756E7E5.8080100@mcs.anl.gov> References: <000301c83765$ebce75a0$c36b60e0$@montella@uniparthenope.it> <4756E7E5.8080100@mcs.anl.gov> Message-ID: On Wed, 5 Dec 2007, Ian Foster wrote: > should/could we generate warnings for such things? I've been working on better compile-time type checking. There is probably more stuff that could happen there in this situation. -- From foster at mcs.anl.gov Wed Dec 5 16:14:47 2007 From: foster at mcs.anl.gov (Ian Foster) Date: Wed, 05 Dec 2007 16:14:47 -0600 Subject: [Swift-devel] (no subject) In-Reply-To: References: <000301c83765$ebce75a0$c36b60e0$@montella@uniparthenope.it> <4756E7E5.8080100@mcs.anl.gov> Message-ID: <475722D7.103@mcs.anl.gov> It seemed to me that this example is a case of "variable that is never assigned" -- that could perhaps be detected. Ben Clifford wrote: > > On Wed, 5 Dec 2007, Ian Foster wrote: > >> should/could we generate warnings for such things? > > I've been working on better compile-time type checking. There is probably > more stuff that could happen there in this situation. > From benc at hawaga.org.uk Wed Dec 5 16:27:49 2007 From: benc at hawaga.org.uk (Ben Clifford) Date: Wed, 5 Dec 2007 22:27:49 +0000 (GMT) Subject: [Swift-devel] (no subject) In-Reply-To: <475722D7.103@mcs.anl.gov> References: <000301c83765$ebce75a0$c36b60e0$@montella@uniparthenope.it> <4756E7E5.8080100@mcs.anl.gov> <475722D7.103@mcs.anl.gov> Message-ID: On Wed, 5 Dec 2007, Ian Foster wrote: > It seemed to me that this example is a case of "variable that is never > assigned" -- that could perhaps be detected. There are some application invocations at the moment that don't explicitly indicate file outputs, though. For example, some of the fmri apps output a .hdr file and a .img file with the same base name and take only a .hdr filename as command-line parameter - its 'good' behaviour that an output parameter isn't explicitly mentioned. There's a bunch of stuff that could be done to the application description constructs in SwiftScript. However, as it is so far work-aroundable (as in, fix the bug in your swiftscript), its automatically deprioritised. -- From mikekubal at yahoo.com Wed Dec 5 16:33:41 2007 From: mikekubal at yahoo.com (Mike Kubal) Date: Wed, 5 Dec 2007 14:33:41 -0800 (PST) Subject: [Swift-devel] script that returns bad parameter error In-Reply-To: Message-ID: <488755.34200.qm@web52304.mail.re2.yahoo.com> Unfortunately I still get the same error: run_fred failed The following errors have occurred: 1. Application "run_fred" failed (Parameter not supported) Arguments: "-rec, 1beh.oeb.gz, -dbase, Marsha_lig_1.mol2, -prefix, Marsha_lig_1" Host: Lear Directory: run_fred-2k0629rvbffz0/run_fred-r81pg3li STDERR: STDOUT: Does 'Parameter not supported' usually refer to an argument of the remote application? I wonder if it does not like the .oeb.gz file? --- Ben Clifford wrote: > > > On Wed, 5 Dec 2007, Mike Kubal wrote: > > > run_fred "-rec" receptor_file > "-dbase" > > ligand_file "-prefix" ligand_prefix; > > In here, take the filenames of each file by saying > @filenmame(receptor_file), like this: > > > run_fred "-rec" > @filename(receptor_file) "-dbase" > > @filename(ligand_file) "-prefix" ligand_prefix; > > -- > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > ____________________________________________________________________________________ Be a better friend, newshound, and know-it-all with Yahoo! Mobile. Try it now. http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ From foster at mcs.anl.gov Wed Dec 5 16:41:35 2007 From: foster at mcs.anl.gov (Ian Foster) Date: Wed, 05 Dec 2007 16:41:35 -0600 Subject: [Swift-devel] (no subject) In-Reply-To: References: <000301c83765$ebce75a0$c36b60e0$@montella@uniparthenope.it> <4756E7E5.8080100@mcs.anl.gov> <475722D7.103@mcs.anl.gov> Message-ID: <4757291F.4030307@mcs.anl.gov> makes sense! Ben Clifford wrote: > > On Wed, 5 Dec 2007, Ian Foster wrote: > >> It seemed to me that this example is a case of "variable that is never >> assigned" -- that could perhaps be detected. > > There are some application invocations at the moment that don't explicitly > indicate file outputs, though. > > For example, some of the fmri apps output a .hdr file and a .img file with > the same base name and take only a .hdr filename as command-line parameter > - its 'good' behaviour that an output parameter isn't explicitly > mentioned. > > There's a bunch of stuff that could be done to the application description > constructs in SwiftScript. However, as it is so far work-aroundable (as > in, fix the bug in your swiftscript), its automatically deprioritised. > From hategan at mcs.anl.gov Wed Dec 5 16:45:01 2007 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Wed, 05 Dec 2007 16:45:01 -0600 Subject: [Swift-devel] script that returns bad parameter error In-Reply-To: <488755.34200.qm@web52304.mail.re2.yahoo.com> References: <488755.34200.qm@web52304.mail.re2.yahoo.com> Message-ID: <1196894701.6069.0.camel@blabla.mcs.anl.gov> Post the sites file. On Wed, 2007-12-05 at 14:33 -0800, Mike Kubal wrote: > Unfortunately I still get the same error: > > run_fred failed > The following errors have occurred: > 1. Application "run_fred" failed (Parameter not > supported) > Arguments: "-rec, 1beh.oeb.gz, -dbase, > Marsha_lig_1.mol2, -prefix, Marsha_lig_1" > Host: Lear > Directory: > run_fred-2k0629rvbffz0/run_fred-r81pg3li > STDERR: > STDOUT: > > Does 'Parameter not supported' usually refer to an > argument of the remote application? I wonder if it > does not like the .oeb.gz file? > > > > --- Ben Clifford wrote: > > > > > > > On Wed, 5 Dec 2007, Mike Kubal wrote: > > > > > run_fred "-rec" receptor_file > > "-dbase" > > > ligand_file "-prefix" ligand_prefix; > > > > In here, take the filenames of each file by saying > > @filenmame(receptor_file), like this: > > > > > run_fred "-rec" > > @filename(receptor_file) "-dbase" > > > @filename(ligand_file) "-prefix" ligand_prefix; > > > > -- > > _______________________________________________ > > Swift-devel mailing list > > Swift-devel at ci.uchicago.edu > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > > > > > > ____________________________________________________________________________________ > Be a better friend, newshound, and > know-it-all with Yahoo! Mobile. Try it now. http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > From wilde at mcs.anl.gov Wed Dec 5 17:42:28 2007 From: wilde at mcs.anl.gov (Michael Wilde) Date: Wed, 05 Dec 2007 17:42:28 -0600 Subject: [Swift-devel] script that returns bad parameter error In-Reply-To: <1196894701.6069.0.camel@blabla.mcs.anl.gov> References: <488755.34200.qm@web52304.mail.re2.yahoo.com> <1196894701.6069.0.camel@blabla.mcs.anl.gov> Message-ID: <47573764.2010009@mcs.anl.gov> Mike, Mihael suspects that a bad globus parameter in your sites.xml file is causing this error message. So please send that so we can take a look. Thanks, MikeW On 12/5/07 4:45 PM, Mihael Hategan wrote: > Post the sites file. > > On Wed, 2007-12-05 at 14:33 -0800, Mike Kubal wrote: >> Unfortunately I still get the same error: >> >> run_fred failed >> The following errors have occurred: >> 1. Application "run_fred" failed (Parameter not >> supported) >> Arguments: "-rec, 1beh.oeb.gz, -dbase, >> Marsha_lig_1.mol2, -prefix, Marsha_lig_1" >> Host: Lear >> Directory: >> run_fred-2k0629rvbffz0/run_fred-r81pg3li >> STDERR: >> STDOUT: >> >> Does 'Parameter not supported' usually refer to an >> argument of the remote application? I wonder if it >> does not like the .oeb.gz file? >> >> >> >> --- Ben Clifford wrote: >> >>> >>> On Wed, 5 Dec 2007, Mike Kubal wrote: >>> >>>> run_fred "-rec" receptor_file >>> "-dbase" >>>> ligand_file "-prefix" ligand_prefix; >>> In here, take the filenames of each file by saying >>> @filenmame(receptor_file), like this: >>> >>>> run_fred "-rec" >>> @filename(receptor_file) "-dbase" >>>> @filename(ligand_file) "-prefix" ligand_prefix; >>> -- >>> _______________________________________________ >>> Swift-devel mailing list >>> Swift-devel at ci.uchicago.edu >>> >> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel >>> >> >> >> ____________________________________________________________________________________ >> Be a better friend, newshound, and >> know-it-all with Yahoo! Mobile. Try it now. http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ >> >> _______________________________________________ >> Swift-devel mailing list >> Swift-devel at ci.uchicago.edu >> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel >> > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > From hategan at mcs.anl.gov Wed Dec 5 17:45:42 2007 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Wed, 05 Dec 2007 17:45:42 -0600 Subject: [Swift-devel] script that returns bad parameter error In-Reply-To: <47573764.2010009@mcs.anl.gov> References: <488755.34200.qm@web52304.mail.re2.yahoo.com> <1196894701.6069.0.camel@blabla.mcs.anl.gov> <47573764.2010009@mcs.anl.gov> Message-ID: <1196898342.7620.0.camel@blabla.mcs.anl.gov> Sorry. My email wasn't very friendly. I was trying to type less :) On Wed, 2007-12-05 at 17:42 -0600, Michael Wilde wrote: > Mike, > > Mihael suspects that a bad globus parameter in your sites.xml file is > causing this error message. So please send that so we can take a look. > > Thanks, > > MikeW > > On 12/5/07 4:45 PM, Mihael Hategan wrote: > > Post the sites file. > > > > On Wed, 2007-12-05 at 14:33 -0800, Mike Kubal wrote: > >> Unfortunately I still get the same error: > >> > >> run_fred failed > >> The following errors have occurred: > >> 1. Application "run_fred" failed (Parameter not > >> supported) > >> Arguments: "-rec, 1beh.oeb.gz, -dbase, > >> Marsha_lig_1.mol2, -prefix, Marsha_lig_1" > >> Host: Lear > >> Directory: > >> run_fred-2k0629rvbffz0/run_fred-r81pg3li > >> STDERR: > >> STDOUT: > >> > >> Does 'Parameter not supported' usually refer to an > >> argument of the remote application? I wonder if it > >> does not like the .oeb.gz file? > >> > >> > >> > >> --- Ben Clifford wrote: > >> > >>> > >>> On Wed, 5 Dec 2007, Mike Kubal wrote: > >>> > >>>> run_fred "-rec" receptor_file > >>> "-dbase" > >>>> ligand_file "-prefix" ligand_prefix; > >>> In here, take the filenames of each file by saying > >>> @filenmame(receptor_file), like this: > >>> > >>>> run_fred "-rec" > >>> @filename(receptor_file) "-dbase" > >>>> @filename(ligand_file) "-prefix" ligand_prefix; > >>> -- > >>> _______________________________________________ > >>> Swift-devel mailing list > >>> Swift-devel at ci.uchicago.edu > >>> > >> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > >>> > >> > >> > >> ____________________________________________________________________________________ > >> Be a better friend, newshound, and > >> know-it-all with Yahoo! Mobile. Try it now. http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ > >> > >> _______________________________________________ > >> Swift-devel mailing list > >> Swift-devel at ci.uchicago.edu > >> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > >> > > > > _______________________________________________ > > Swift-devel mailing list > > Swift-devel at ci.uchicago.edu > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > > > From wilde at mcs.anl.gov Wed Dec 5 17:47:41 2007 From: wilde at mcs.anl.gov (Michael Wilde) Date: Wed, 05 Dec 2007 17:47:41 -0600 Subject: [Swift-devel] script that returns bad parameter error In-Reply-To: <753687.67764.qm@web52301.mail.re2.yahoo.com> References: <753687.67764.qm@web52301.mail.re2.yahoo.com> Message-ID: <4757389D.7030309@mcs.anl.gov> I need to take a close look later when I get a chance, but i'm a bit suspicious of the use of the file type variables receptor_file and ligand_file without the @ or @filename inside your app{} construct in run_fred(). Will check later if thats what gives this message. you want to say: app { run_fred "-rec" @receptor_file "-dbase" @ligand_file "-prefix" ligand_prefix;> } See the users guide at http://www.ci.uchicago.edu/swift/guides/userguide.php sec 2.3.1 and the tutorial example, Mike. - MikeW On 12/5/07 2:56 PM, Mike Kubal wrote: > Any thoughts on what might cause? > > type file {} > > (file score, file docked) run_fred (string > ligand_prefix, file ligand_file, file receptor_file){ > app { > run_fred "-rec" receptor_file "-dbase" > ligand_file "-prefix" ligand_prefix; > } > } > > > string receptor_prefix = "1beh"; > > file receptor_file > ; > > file > fls[]; > > foreach ligand_file in fls{ > > string ligand_prefix = > @strcut(@ligand_file,"\.\/(.*)\.mol2"); > string score_file_name = > @strcat(ligand_prefix,"_chemgauss3_scores.txt"); > string docked_file_name = > @strcat(ligand_prefix,"_chemgauss3_docked.mol2"); > file score_file > ; > file docked_file > ; > > (score_file,docked_file) = > run_fred(ligand_prefix,ligand_file,receptor_file); > > } > > > Thanks, > > Mike Kubal > > > ____________________________________________________________________________________ > Never miss a thing. Make Yahoo your home page. > http://www.yahoo.com/r/hs > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > From tiberius at ci.uchicago.edu Wed Dec 5 17:54:03 2007 From: tiberius at ci.uchicago.edu (Tiberiu Stef-Praun) Date: Wed, 5 Dec 2007 17:54:03 -0600 Subject: [Swift-devel] (no subject) In-Reply-To: References: <4756ED24.7070709@mcs.anl.gov> Message-ID: Ben, I am getting the same error as Rafaelle, and I can reproduce it Tell me what version of swift to test, to check whether the problem has been resolved Tibi On Dec 5, 2007 4:04 PM, Ben Clifford wrote: > > > On Wed, 5 Dec 2007, Michael Wilde wrote: > > > The gssapi error is what we've seen before - 0.3 running on Java 1.5. > > Raphaele is now building trunk which should work. We should post something on > > this or put out an 0.4, perhaps? > > If a new release will make it better, then it would not be too bad to have > a 0.4 in the next week or so. I'd like to figure out whether that helps or > not though (for example, if I build it on my system, will it still break > for others?). For that, better testing of the release candidate (when it > appears) should probably happen by people other than me. > > -- > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > -- Tiberiu (Tibi) Stef-Praun, PhD Research Staff, Computation Institute 5640 S. Ellis Ave, #405 University of Chicago http://www-unix.mcs.anl.gov/~tiberius/ From benc at hawaga.org.uk Wed Dec 5 17:55:48 2007 From: benc at hawaga.org.uk (Ben Clifford) Date: Wed, 5 Dec 2007 23:55:48 +0000 (GMT) Subject: [Swift-devel] (no subject) In-Reply-To: References: <4756ED24.7070709@mcs.anl.gov> Message-ID: On Wed, 5 Dec 2007, Tiberiu Stef-Praun wrote: > Ben, I am getting the same error as Rafaelle, and I can reproduce it > Tell me what version of swift to test, to check whether the problem > has been resolved What host, swift version, machine? -- From hategan at mcs.anl.gov Wed Dec 5 17:59:18 2007 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Wed, 05 Dec 2007 17:59:18 -0600 Subject: [Swift-devel] (no subject) In-Reply-To: References: <4756ED24.7070709@mcs.anl.gov> Message-ID: <1196899159.7896.0.camel@blabla.mcs.anl.gov> On Wed, 2007-12-05 at 17:54 -0600, Tiberiu Stef-Praun wrote: > Ben, I am getting the same error as Rafaelle, and I can reproduce it > Tell me what version of swift to test, to check whether the problem > has been resolved Actually I'd like to know where your version is installed. When I "fixed" it, I didn't really understand what was happening, so I want to correct that. > > Tibi > > On Dec 5, 2007 4:04 PM, Ben Clifford wrote: > > > > > > On Wed, 5 Dec 2007, Michael Wilde wrote: > > > > > The gssapi error is what we've seen before - 0.3 running on Java 1.5. > > > Raphaele is now building trunk which should work. We should post something on > > > this or put out an 0.4, perhaps? > > > > If a new release will make it better, then it would not be too bad to have > > a 0.4 in the next week or so. I'd like to figure out whether that helps or > > not though (for example, if I build it on my system, will it still break > > for others?). For that, better testing of the release candidate (when it > > appears) should probably happen by people other than me. > > > > -- > > _______________________________________________ > > Swift-devel mailing list > > Swift-devel at ci.uchicago.edu > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > > > From tiberius at ci.uchicago.edu Wed Dec 5 18:05:54 2007 From: tiberius at ci.uchicago.edu (Tiberiu Stef-Praun) Date: Wed, 5 Dec 2007 18:05:54 -0600 Subject: [Swift-devel] (no subject) In-Reply-To: <1196899159.7896.0.camel@blabla.mcs.anl.gov> References: <4756ED24.7070709@mcs.anl.gov> <1196899159.7896.0.camel@blabla.mcs.anl.gov> Message-ID: I use swift 0.3 with java 1.5 on one of the virtual machines that I use for the Econ project Luckily Mike's comment brought some light on why I could not run my workflows any more. Tibi On Dec 5, 2007 5:59 PM, Mihael Hategan wrote: > > On Wed, 2007-12-05 at 17:54 -0600, Tiberiu Stef-Praun wrote: > > Ben, I am getting the same error as Rafaelle, and I can reproduce it > > Tell me what version of swift to test, to check whether the problem > > has been resolved > > Actually I'd like to know where your version is installed. When I > "fixed" it, I didn't really understand what was happening, so I want to > correct that. > > > > > > Tibi > > > > On Dec 5, 2007 4:04 PM, Ben Clifford wrote: > > > > > > > > > On Wed, 5 Dec 2007, Michael Wilde wrote: > > > > > > > The gssapi error is what we've seen before - 0.3 running on Java 1.5. > > > > Raphaele is now building trunk which should work. We should post something on > > > > this or put out an 0.4, perhaps? > > > > > > If a new release will make it better, then it would not be too bad to have > > > a 0.4 in the next week or so. I'd like to figure out whether that helps or > > > not though (for example, if I build it on my system, will it still break > > > for others?). For that, better testing of the release candidate (when it > > > appears) should probably happen by people other than me. > > > > > > -- > > > _______________________________________________ > > > Swift-devel mailing list > > > Swift-devel at ci.uchicago.edu > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > > > > > > > > > -- Tiberiu (Tibi) Stef-Praun, PhD Research Staff, Computation Institute 5640 S. Ellis Ave, #405 University of Chicago http://www-unix.mcs.anl.gov/~tiberius/ From hategan at mcs.anl.gov Wed Dec 5 18:09:46 2007 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Wed, 05 Dec 2007 18:09:46 -0600 Subject: [Swift-devel] (no subject) In-Reply-To: References: <4756ED24.7070709@mcs.anl.gov> <1196899159.7896.0.camel@blabla.mcs.anl.gov> Message-ID: <1196899787.8155.0.camel@blabla.mcs.anl.gov> On Wed, 2007-12-05 at 18:05 -0600, Tiberiu Stef-Praun wrote: > I use swift 0.3 with java 1.5 on one of the virtual machines that I > use for the Econ project Hmm. I have a hunch. Thanks. > Luckily Mike's comment brought some light on why I could not run my > workflows any more. > > Tibi > > On Dec 5, 2007 5:59 PM, Mihael Hategan wrote: > > > > On Wed, 2007-12-05 at 17:54 -0600, Tiberiu Stef-Praun wrote: > > > Ben, I am getting the same error as Rafaelle, and I can reproduce it > > > Tell me what version of swift to test, to check whether the problem > > > has been resolved > > > > Actually I'd like to know where your version is installed. When I > > "fixed" it, I didn't really understand what was happening, so I want to > > correct that. > > > > > > > > > > Tibi > > > > > > On Dec 5, 2007 4:04 PM, Ben Clifford wrote: > > > > > > > > > > > > On Wed, 5 Dec 2007, Michael Wilde wrote: > > > > > > > > > The gssapi error is what we've seen before - 0.3 running on Java 1.5. > > > > > Raphaele is now building trunk which should work. We should post something on > > > > > this or put out an 0.4, perhaps? > > > > > > > > If a new release will make it better, then it would not be too bad to have > > > > a 0.4 in the next week or so. I'd like to figure out whether that helps or > > > > not though (for example, if I build it on my system, will it still break > > > > for others?). For that, better testing of the release candidate (when it > > > > appears) should probably happen by people other than me. > > > > > > > > -- > > > > _______________________________________________ > > > > Swift-devel mailing list > > > > Swift-devel at ci.uchicago.edu > > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > > > > > > > > > > > > > > > > > > From bugzilla-daemon at mcs.anl.gov Thu Dec 6 10:03:15 2007 From: bugzilla-daemon at mcs.anl.gov (bugzilla-daemon at mcs.anl.gov) Date: Thu, 6 Dec 2007 10:03:15 -0600 (CST) Subject: [Swift-devel] [Bug 115] New: Swift users encounter long delays waiting for random name generation Message-ID: http://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=115 Summary: Swift users encounter long delays waiting for random name generation Product: Swift Version: unspecified Platform: All OS/Version: All Status: NEW Severity: major Priority: P1 Component: SwiftScript language AssignedTo: benc at hawaga.org.uk ReportedBy: wilde at mcs.anl.gov When using swift on headless hosts (ie ones with a low level of entropy) swift users encounter length delays - 10s of seconds to many minutes) waiting for the generation of random names for files, workflows etc. -- Configure bugmail: http://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You reported the bug, or are watching the reporter. From wilde at mcs.anl.gov Thu Dec 6 10:06:32 2007 From: wilde at mcs.anl.gov (Michael Wilde) Date: Thu, 06 Dec 2007 10:06:32 -0600 Subject: [Swift-devel] Is problem of slow random name generation fixed? Message-ID: <47581E08.5050302@mcs.anl.gov> I didnt see any email or bugzilla traffic on this (may have missed it) so I filed bug 115 to track it. I think its a high prio to fix, as it had a very serious impact on our last training session, and Ive been plagued by it often myself. From bugzilla-daemon at mcs.anl.gov Thu Dec 6 10:09:32 2007 From: bugzilla-daemon at mcs.anl.gov (bugzilla-daemon at mcs.anl.gov) Date: Thu, 6 Dec 2007 10:09:32 -0600 (CST) Subject: [Swift-devel] [Bug 115] Swift users encounter long delays waiting for random name generation In-Reply-To: Message-ID: <20071206160932.B138F164EC@foxtrot.mcs.anl.gov> http://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=115 ------- Comment #1 from benc at hawaga.org.uk 2007-12-06 10:09 ------- this should have been fixed (again) in r1496 some days ago. do you see delay with >=1496? -- Configure bugmail: http://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You reported the bug, or are watching the reporter. From benc at hawaga.org.uk Thu Dec 6 10:10:49 2007 From: benc at hawaga.org.uk (Ben Clifford) Date: Thu, 6 Dec 2007 16:10:49 +0000 (GMT) Subject: [Swift-devel] Is problem of slow random name generation fixed? In-Reply-To: <47581E08.5050302@mcs.anl.gov> References: <47581E08.5050302@mcs.anl.gov> Message-ID: On Thu, 6 Dec 2007, Michael Wilde wrote: > I didnt see any email or bugzilla traffic on this (may have missed it) > so I filed bug 115 to track it. You should have seen the commit go by in the commit history though... r1496. -- From mikekubal at yahoo.com Thu Dec 6 10:15:11 2007 From: mikekubal at yahoo.com (Mike Kubal) Date: Thu, 6 Dec 2007 08:15:11 -0800 (PST) Subject: [Swift-devel] script that returns bad parameter error In-Reply-To: <1196898342.7620.0.camel@blabla.mcs.anl.gov> Message-ID: <25134.71170.qm@web52312.mail.re2.yahoo.com> Hi Mihael, No need to apologize, I appreciate your feedback. Here is the sites file. UC-MCA01S018 /autohome/u102/mkubal/SWIFT_working_dir I have also tried the condor job manager at Purdue that has the same url except that it ends in '-condor' instead of '-fork' . I get the same error. Cheers, Mike --- Mihael Hategan wrote: > Sorry. My email wasn't very friendly. I was trying > to type less :) > > On Wed, 2007-12-05 at 17:42 -0600, Michael Wilde > wrote: > > Mike, > > > > Mihael suspects that a bad globus parameter in > your sites.xml file is > > causing this error message. So please send that > so we can take a look. > > > > Thanks, > > > > MikeW > > > > On 12/5/07 4:45 PM, Mihael Hategan wrote: > > > Post the sites file. > > > > > > On Wed, 2007-12-05 at 14:33 -0800, Mike Kubal > wrote: > > >> Unfortunately I still get the same error: > > >> > > >> run_fred failed > > >> The following errors have occurred: > > >> 1. Application "run_fred" failed (Parameter not > > >> supported) > > >> Arguments: "-rec, 1beh.oeb.gz, -dbase, > > >> Marsha_lig_1.mol2, -prefix, Marsha_lig_1" > > >> Host: Lear > > >> Directory: > > >> run_fred-2k0629rvbffz0/run_fred-r81pg3li > > >> STDERR: > > >> STDOUT: > > >> > > >> Does 'Parameter not supported' usually refer to > an > > >> argument of the remote application? I wonder if > it > > >> does not like the .oeb.gz file? > > >> > > >> > > >> > > >> --- Ben Clifford wrote: > > >> > > >>> > > >>> On Wed, 5 Dec 2007, Mike Kubal wrote: > > >>> > > >>>> run_fred "-rec" receptor_file > > >>> "-dbase" > > >>>> ligand_file "-prefix" ligand_prefix; > > >>> In here, take the filenames of each file by > saying > > >>> @filenmame(receptor_file), like this: > > >>> > > >>>> run_fred "-rec" > > >>> @filename(receptor_file) "-dbase" > > >>>> @filename(ligand_file) "-prefix" > ligand_prefix; > > >>> -- > > >>> > _______________________________________________ > > >>> Swift-devel mailing list > > >>> Swift-devel at ci.uchicago.edu > > >>> > > >> > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > >>> > > >> > > >> > > >> > ____________________________________________________________________________________ > > >> Be a better friend, newshound, and > > >> know-it-all with Yahoo! Mobile. Try it now. > http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ > > > >> > > >> _______________________________________________ > > >> Swift-devel mailing list > > >> Swift-devel at ci.uchicago.edu > > >> > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > >> > > > > > > _______________________________________________ > > > Swift-devel mailing list > > > Swift-devel at ci.uchicago.edu > > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > > > > > > > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > ____________________________________________________________________________________ Looking for last minute shopping deals? Find them fast with Yahoo! Search. http://tools.search.yahoo.com/newsearch/category.php?category=shopping From hategan at mcs.anl.gov Thu Dec 6 10:30:05 2007 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Thu, 06 Dec 2007 10:30:05 -0600 Subject: [Swift-devel] script that returns bad parameter error In-Reply-To: <25134.71170.qm@web52312.mail.re2.yahoo.com> References: <25134.71170.qm@web52312.mail.re2.yahoo.com> Message-ID: <1196958605.14888.3.camel@blabla.mcs.anl.gov> I think I've seen fork complaining about "project" before. Can you try to comment that profile tag out and run with fork again? It may also be useful to post the logs since they may contain stack traces that point more accurately towards the problem. Mihael On Thu, 2007-12-06 at 08:15 -0800, Mike Kubal wrote: > Hi Mihael, > > No need to apologize, I appreciate your feedback. > > Here is the sites file. > > > xmlns="http://www.griphyn.org/chimera/GVDS-PoolConfig" > xsi:schemaLocation="http://www.griphyn.org/chimera/GVDS > http://www.griphyn.org/chimera/gvds-poolcfg-1.5.xsd" > xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" > version="1.5"> > > > url="gsiftp://gridftp.purdue.teragrid.org" > storage="/autohome/u102/mkubal/SWIFT_working_dir" > major="2" minor="2" patch="4"> > > key="project">UC-MCA01S018 > url="tg-gatekeeper.purdue.teragrid.org:2119/jobmanager-fork" > major="2" minor="0" patch="0"/> > > /autohome/u102/mkubal/SWIFT_working_dir > > > > I have also tried the condor job manager at Purdue > that has the same url except that it ends in '-condor' > instead of '-fork' . I get the same error. > > Cheers, > > Mike > > > > > > --- Mihael Hategan wrote: > > > Sorry. My email wasn't very friendly. I was trying > > to type less :) > > > > On Wed, 2007-12-05 at 17:42 -0600, Michael Wilde > > wrote: > > > Mike, > > > > > > Mihael suspects that a bad globus parameter in > > your sites.xml file is > > > causing this error message. So please send that > > so we can take a look. > > > > > > Thanks, > > > > > > MikeW > > > > > > On 12/5/07 4:45 PM, Mihael Hategan wrote: > > > > Post the sites file. > > > > > > > > On Wed, 2007-12-05 at 14:33 -0800, Mike Kubal > > wrote: > > > >> Unfortunately I still get the same error: > > > >> > > > >> run_fred failed > > > >> The following errors have occurred: > > > >> 1. Application "run_fred" failed (Parameter not > > > >> supported) > > > >> Arguments: "-rec, 1beh.oeb.gz, -dbase, > > > >> Marsha_lig_1.mol2, -prefix, Marsha_lig_1" > > > >> Host: Lear > > > >> Directory: > > > >> run_fred-2k0629rvbffz0/run_fred-r81pg3li > > > >> STDERR: > > > >> STDOUT: > > > >> > > > >> Does 'Parameter not supported' usually refer to > > an > > > >> argument of the remote application? I wonder if > > it > > > >> does not like the .oeb.gz file? > > > >> > > > >> > > > >> > > > >> --- Ben Clifford wrote: > > > >> > > > >>> > > > >>> On Wed, 5 Dec 2007, Mike Kubal wrote: > > > >>> > > > >>>> run_fred "-rec" receptor_file > > > >>> "-dbase" > > > >>>> ligand_file "-prefix" ligand_prefix; > > > >>> In here, take the filenames of each file by > > saying > > > >>> @filenmame(receptor_file), like this: > > > >>> > > > >>>> run_fred "-rec" > > > >>> @filename(receptor_file) "-dbase" > > > >>>> @filename(ligand_file) "-prefix" > > ligand_prefix; > > > >>> -- > > > >>> > > _______________________________________________ > > > >>> Swift-devel mailing list > > > >>> Swift-devel at ci.uchicago.edu > > > >>> > > > >> > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > >>> > > > >> > > > >> > > > >> > > > ____________________________________________________________________________________ > > > >> Be a better friend, newshound, and > > > >> know-it-all with Yahoo! Mobile. Try it now. > > > http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ > > > > > >> > > > >> _______________________________________________ > > > >> Swift-devel mailing list > > > >> Swift-devel at ci.uchicago.edu > > > >> > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > >> > > > > > > > > _______________________________________________ > > > > Swift-devel mailing list > > > > Swift-devel at ci.uchicago.edu > > > > > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > > > > > > > > > > > > > _______________________________________________ > > Swift-devel mailing list > > Swift-devel at ci.uchicago.edu > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > > > > > > ____________________________________________________________________________________ > Looking for last minute shopping deals? > Find them fast with Yahoo! Search. http://tools.search.yahoo.com/newsearch/category.php?category=shopping > From mikekubal at yahoo.com Thu Dec 6 11:15:45 2007 From: mikekubal at yahoo.com (Mike Kubal) Date: Thu, 6 Dec 2007 09:15:45 -0800 (PST) Subject: [Swift-devel] script that returns bad parameter error In-Reply-To: <1196958605.14888.3.camel@blabla.mcs.anl.gov> Message-ID: <782829.23701.qm@web52304.mail.re2.yahoo.com> I took out the project tag and same results. Here's the section run_fred****.log where the failure occurs: 2007-12-06 10:44:14,968 DEBUG Loader Recompilation suppressed. 2007-12-06 10:44:19,096 INFO unknown Using sites file: sites-purdue-64-gram.xml 2007-12-06 10:44:19,097 INFO unknown Using tc.data: tc-purdue.data 2007-12-06 10:44:22,303 DEBUG GetFieldValue GetFieldValue(true) 2007-12-06 10:44:22,311 DEBUG GetFieldValue GetFieldValue(true) 2007-12-06 10:44:28,408 DEBUG TaskImpl Task(type=4, identity=urn:0-0-1-0-1196959457323) setting status to Active 2007-12-06 10:44:28,502 DEBUG TaskImpl Task(type=4, identity=urn:0-0-1-0-1196959457323) setting status to Completed 2007-12-06 10:44:28,553 DEBUG TaskImpl Task(type=2, identity=urn:0-0-1-0-1196959457326) setting status to Submitted 2007-12-06 10:44:28,554 DEBUG TaskImpl Task(type=2, identity=urn:0-0-1-0-1196959457326) setting status to Active 2007-12-06 10:44:29,022 DEBUG TaskImpl Task(type=2, identity=urn:0-0-1-0-1196959457326) setting status to Completed 2007-12-06 10:44:29,026 DEBUG TaskImpl Task(type=2, identity=urn:0-0-1-0-1196959457330) setting status to Submitted 2007-12-06 10:44:29,026 DEBUG TaskImpl Task(type=2, identity=urn:0-0-1-0-1196959457330) setting status to Active 2007-12-06 10:44:29,464 DEBUG TaskImpl Task(type=2, identity=urn:0-0-1-0-1196959457330) setting status to Completed 2007-12-06 10:44:29,470 DEBUG vdl:execute2 Job run_fred-fqolp4li running in thread 0-0-1-0 run zh499u762hal2 2007-12-06 10:44:29,482 INFO vdl:execute2 Creating temporary directory run_fred-zh499u762hal2/run_fred-fqolp4li on Lear 2007-12-06 10:44:29,500 INFO vdl:createdirs Creating directory structure in run_fred-zh499u762hal2/shared (run_fred-zh499u762hal2/shared/) 2007-12-06 10:44:29,502 DEBUG TaskImpl Task(type=4, identity=urn:0-0-1-0-1196959457333) setting status to Active 2007-12-06 10:44:29,525 DEBUG TaskImpl Task(type=4, identity=urn:0-0-1-0-1196959457333) setting status to Completed 2007-12-06 10:44:29,538 DEBUG TaskImpl Task(type=4, identity=urn:0-0-1-0-2-1196959457335) setting status to Active 2007-12-06 10:44:29,540 DEBUG TaskImpl Task(type=4, identity=urn:0-0-1-0-1-1196959457338) setting status to Active 2007-12-06 10:44:29,542 DEBUG TaskImpl Task(type=4, identity=urn:0-0-1-0-2-1196959457335) setting status to Completed 2007-12-06 10:44:29,551 DEBUG TaskImpl Task(type=4, identity=urn:0-0-1-0-1-1196959457338) setting status to Completed 2007-12-06 10:44:29,566 INFO vdl:dostagein Staging in Marsha_lig_1.mol2 ( - Marsha_lig_1.mol2 to run_fred-zh499u762hal2/shared/ on Lear 2007-12-06 10:44:29,567 INFO vdl:dostagein Staging in 1beh.oeb.gz ( - 1beh.oeb.gz to run_fred-zh499u762hal2/shared/ on Lear 2007-12-06 10:44:29,570 DEBUG TaskImpl Task(type=2, identity=urn:0-0-1-0-1-1196959457342) setting status to Submitted 2007-12-06 10:44:29,571 DEBUG TaskImpl Task(type=2, identity=urn:0-0-1-0-1-1196959457342) setting status to Active 2007-12-06 10:44:29,571 DEBUG TaskImpl Task(type=2, identity=urn:0-0-1-0-2-1196959457345) setting status to Submitted 2007-12-06 10:44:29,572 DEBUG TaskImpl Task(type=2, identity=urn:0-0-1-0-2-1196959457345) setting status to Active 2007-12-06 10:44:30,005 DEBUG TaskImpl Task(type=2, identity=urn:0-0-1-0-1-1196959457342) setting status to Completed 2007-12-06 10:44:30,007 INFO vdl:dostagein Staged in Marsha_lig_1.mol2 to run_fred-zh499u762hal2/shared/ on Lear 2007-12-06 10:44:31,703 DEBUG TaskImpl Task(type=2, identity=urn:0-0-1-0-2-1196959457345) setting status to Completed 2007-12-06 10:44:31,705 INFO vdl:dostagein Staged in 1beh.oeb.gz to run_fred-zh499u762hal2/shared/ on Lear 2007-12-06 10:44:31,707 INFO vdl:execute2 Running job run_fred-fqolp4li run_fred with arguments [-rec, 1beh.oeb.gz, -dbase, Marsha_lig_1.mol2, -prefix, Marsha_li\ g_1] in run_fred-zh499u762hal2/run_fred-fqolp4li on Lear 2007-12-06 10:44:32,925 DEBUG TaskImpl Task(type=1, identity=urn:0-0-1-0-1196959457349) setting status to Failed Parameter not supported 2007-12-06 10:44:32,938 DEBUG vdl:execute2 Application exception: Parameter not supported task:execute @ vdl-int.k, line: 328 sys:sequential @ vdl-int.k, line: 316 sys:try @ vdl-int.k, line: 315 task:allocatehost @ vdl-int.k, line: 298 vdl:execute2 @ execute-default.k, line: 22 sys:restartonerror @ execute-default.k, line: 20 sys:sequential @ execute-default.k, line: 19 sys:try @ execute-default.k, line: 18 sys:if @ execute-default.k, line: 17 sys:then @ execute-default.k, line: 16 sys:if @ execute-default.k, line: 15 vdl:execute @ run_fred.kml, line: 20 run_fred @ run_fred.kml, line: 151 sys:parallel @ run_fred.kml, line: 150 sys:parallelfor @ run_fred.kml, line: 80 sys:parallel @ run_fred.kml, line: 79 vdl:mainp @ run_fred.kml, line: 78 mainp @ vdl.k, line: 141 vdl:mains @ run_fred.kml, line: 77 vdl:mains @ run_fred.kml, line: 77 rlog:restartlog @ run_fred.kml, line: 75 kernel:project @ run_fred.kml, line: 2 run_fred-zh499u762hal2 Caused by: org.globus.gram.GramException: Parameter not supported --- Mihael Hategan wrote: > I think I've seen fork complaining about "project" > before. Can you try > to comment that profile tag out and run with fork > again? > > It may also be useful to post the logs since they > may contain stack > traces that point more accurately towards the > problem. > > Mihael > > On Thu, 2007-12-06 at 08:15 -0800, Mike Kubal wrote: > > Hi Mihael, > > > > No need to apologize, I appreciate your feedback. > > > > Here is the sites file. > > > > > > > > xmlns="http://www.griphyn.org/chimera/GVDS-PoolConfig" > > > xsi:schemaLocation="http://www.griphyn.org/chimera/GVDS > > > http://www.griphyn.org/chimera/gvds-poolcfg-1.5.xsd" > > > xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" > > version="1.5"> > > > > > > > url="gsiftp://gridftp.purdue.teragrid.org" > > storage="/autohome/u102/mkubal/SWIFT_working_dir" > > major="2" minor="2" patch="4"> > > > > > key="project">UC-MCA01S018 > > > > url="tg-gatekeeper.purdue.teragrid.org:2119/jobmanager-fork" > > major="2" minor="0" patch="0"/> > > > > > /autohome/u102/mkubal/SWIFT_working_dir > > > > > > > > I have also tried the condor job manager at > Purdue > > that has the same url except that it ends in > '-condor' > > instead of '-fork' . I get the same error. > > > > Cheers, > > > > Mike > > > > > > > > > > > > --- Mihael Hategan wrote: > > > > > Sorry. My email wasn't very friendly. I was > trying > > > to type less :) > > > > > > On Wed, 2007-12-05 at 17:42 -0600, Michael Wilde > > > wrote: > > > > Mike, > > > > > > > > Mihael suspects that a bad globus parameter in > > > your sites.xml file is > > > > causing this error message. So please send > that > > > so we can take a look. > > > > > > > > Thanks, > > > > > > > > MikeW > > > > > > > > On 12/5/07 4:45 PM, Mihael Hategan wrote: > > > > > Post the sites file. > > > > > > > > > > On Wed, 2007-12-05 at 14:33 -0800, Mike > Kubal > > > wrote: > > > > >> Unfortunately I still get the same error: > > > > >> > > > > >> run_fred failed > > > > >> The following errors have occurred: > > > > >> 1. Application "run_fred" failed (Parameter > not > > > > >> supported) > > > > >> Arguments: "-rec, 1beh.oeb.gz, > -dbase, > > > > >> Marsha_lig_1.mol2, -prefix, Marsha_lig_1" > > > > >> Host: Lear > > > > >> Directory: > > > > >> run_fred-2k0629rvbffz0/run_fred-r81pg3li > > > > >> STDERR: > > > > >> STDOUT: > > > > >> > > > > >> Does 'Parameter not supported' usually > refer to > > > an > > > > >> argument of the remote application? I > wonder if > > > it > > > > >> does not like the .oeb.gz file? > > > > >> > > > > >> > > > > >> > > > > >> --- Ben Clifford > wrote: > > > > >> > > > > >>> > > > > >>> On Wed, 5 Dec 2007, Mike Kubal wrote: > > > > >>> > > > > >>>> run_fred "-rec" > receptor_file > > > > >>> "-dbase" > > > > >>>> ligand_file "-prefix" ligand_prefix; > > > > >>> In here, take the filenames of each file > by > > > saying > > > > >>> @filenmame(receptor_file), like this: > > > > >>> > > > > >>>> run_fred "-rec" > > > > >>> @filename(receptor_file) "-dbase" > > > > >>>> @filename(ligand_file) "-prefix" > > > ligand_prefix; > > > > >>> -- > > > > >>> > > > _______________________________________________ > > > > >>> Swift-devel mailing list > > > > >>> Swift-devel at ci.uchicago.edu > > > > >>> > > > > >> > > > > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > > >>> > > > > >> > > > > >> > > > > >> > > > > > > ____________________________________________________________________________________ > > > > >> Be a better friend, newshound, and > > > > >> know-it-all with Yahoo! Mobile. Try it > now. > > > > > > http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ > > > > > > > >> > > > > >> > _______________________________________________ > > > > >> Swift-devel mailing list > > > > >> Swift-devel at ci.uchicago.edu > > > > >> > > > > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > > >> > > > > > > > > > > > _______________________________________________ > > > > > Swift-devel mailing list > > > > > Swift-devel at ci.uchicago.edu > > > > > > > > > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > > > > > > > > > > > > > > > > > > _______________________________________________ > > > Swift-devel mailing list > > > Swift-devel at ci.uchicago.edu > > > > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > > > > > > > > > > > > > ____________________________________________________________________________________ > > Looking for last minute shopping deals? > > Find them fast with Yahoo! Search. > http://tools.search.yahoo.com/newsearch/category.php?category=shopping > > > > _______________________________________________ > Swift-devel mailing list > === message truncated === ____________________________________________________________________________________ Looking for last minute shopping deals? Find them fast with Yahoo! Search. http://tools.search.yahoo.com/newsearch/category.php?category=shopping From hategan at mcs.anl.gov Thu Dec 6 11:21:11 2007 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Thu, 06 Dec 2007 11:21:11 -0600 Subject: [Swift-devel] script that returns bad parameter error In-Reply-To: <782829.23701.qm@web52304.mail.re2.yahoo.com> References: <782829.23701.qm@web52304.mail.re2.yahoo.com> Message-ID: <1196961671.15996.0.camel@blabla.mcs.anl.gov> What does tc.data say? Mihael On Thu, 2007-12-06 at 09:15 -0800, Mike Kubal wrote: > I took out the project tag and same results. Here's > the section run_fred****.log where the failure occurs: > > 2007-12-06 10:44:14,968 DEBUG Loader Recompilation > suppressed. > 2007-12-06 10:44:19,096 INFO unknown Using sites > file: sites-purdue-64-gram.xml > 2007-12-06 10:44:19,097 INFO unknown Using tc.data: > tc-purdue.data > 2007-12-06 10:44:22,303 DEBUG GetFieldValue > GetFieldValue(true) > 2007-12-06 10:44:22,311 DEBUG GetFieldValue > GetFieldValue(true) > 2007-12-06 10:44:28,408 DEBUG TaskImpl Task(type=4, > identity=urn:0-0-1-0-1196959457323) setting status to > Active > 2007-12-06 10:44:28,502 DEBUG TaskImpl Task(type=4, > identity=urn:0-0-1-0-1196959457323) setting status to > Completed > 2007-12-06 10:44:28,553 DEBUG TaskImpl Task(type=2, > identity=urn:0-0-1-0-1196959457326) setting status to > Submitted > 2007-12-06 10:44:28,554 DEBUG TaskImpl Task(type=2, > identity=urn:0-0-1-0-1196959457326) setting status to > Active > 2007-12-06 10:44:29,022 DEBUG TaskImpl Task(type=2, > identity=urn:0-0-1-0-1196959457326) setting status to > Completed > 2007-12-06 10:44:29,026 DEBUG TaskImpl Task(type=2, > identity=urn:0-0-1-0-1196959457330) setting status to > Submitted > 2007-12-06 10:44:29,026 DEBUG TaskImpl Task(type=2, > identity=urn:0-0-1-0-1196959457330) setting status to > Active > 2007-12-06 10:44:29,464 DEBUG TaskImpl Task(type=2, > identity=urn:0-0-1-0-1196959457330) setting status to > Completed > 2007-12-06 10:44:29,470 DEBUG vdl:execute2 Job > run_fred-fqolp4li running in thread 0-0-1-0 run > zh499u762hal2 > 2007-12-06 10:44:29,482 INFO vdl:execute2 Creating > temporary directory > run_fred-zh499u762hal2/run_fred-fqolp4li on Lear > 2007-12-06 10:44:29,500 INFO vdl:createdirs Creating > directory structure in run_fred-zh499u762hal2/shared > (run_fred-zh499u762hal2/shared/) > 2007-12-06 10:44:29,502 DEBUG TaskImpl Task(type=4, > identity=urn:0-0-1-0-1196959457333) setting status to > Active > 2007-12-06 10:44:29,525 DEBUG TaskImpl Task(type=4, > identity=urn:0-0-1-0-1196959457333) setting status to > Completed > 2007-12-06 10:44:29,538 DEBUG TaskImpl Task(type=4, > identity=urn:0-0-1-0-2-1196959457335) setting status > to Active > 2007-12-06 10:44:29,540 DEBUG TaskImpl Task(type=4, > identity=urn:0-0-1-0-1-1196959457338) setting status > to Active > 2007-12-06 10:44:29,542 DEBUG TaskImpl Task(type=4, > identity=urn:0-0-1-0-2-1196959457335) setting status > to Completed > 2007-12-06 10:44:29,551 DEBUG TaskImpl Task(type=4, > identity=urn:0-0-1-0-1-1196959457338) setting status > to Completed > 2007-12-06 10:44:29,566 INFO vdl:dostagein Staging in > Marsha_lig_1.mol2 ( - Marsha_lig_1.mol2 to > run_fred-zh499u762hal2/shared/ on Lear > 2007-12-06 10:44:29,567 INFO vdl:dostagein Staging in > 1beh.oeb.gz ( - 1beh.oeb.gz to > run_fred-zh499u762hal2/shared/ on Lear > 2007-12-06 10:44:29,570 DEBUG TaskImpl Task(type=2, > identity=urn:0-0-1-0-1-1196959457342) setting status > to Submitted > 2007-12-06 10:44:29,571 DEBUG TaskImpl Task(type=2, > identity=urn:0-0-1-0-1-1196959457342) setting status > to Active > 2007-12-06 10:44:29,571 DEBUG TaskImpl Task(type=2, > identity=urn:0-0-1-0-2-1196959457345) setting status > to Submitted > 2007-12-06 10:44:29,572 DEBUG TaskImpl Task(type=2, > identity=urn:0-0-1-0-2-1196959457345) setting status > to Active > 2007-12-06 10:44:30,005 DEBUG TaskImpl Task(type=2, > identity=urn:0-0-1-0-1-1196959457342) setting status > to Completed > 2007-12-06 10:44:30,007 INFO vdl:dostagein Staged in > Marsha_lig_1.mol2 to run_fred-zh499u762hal2/shared/ on > Lear > 2007-12-06 10:44:31,703 DEBUG TaskImpl Task(type=2, > identity=urn:0-0-1-0-2-1196959457345) setting status > to Completed > 2007-12-06 10:44:31,705 INFO vdl:dostagein Staged in > 1beh.oeb.gz to run_fred-zh499u762hal2/shared/ on Lear > 2007-12-06 10:44:31,707 INFO vdl:execute2 Running job > run_fred-fqolp4li run_fred with arguments [-rec, > 1beh.oeb.gz, -dbase, Marsha_lig_1.mol2, -prefix, > Marsha_li\ > g_1] in run_fred-zh499u762hal2/run_fred-fqolp4li on > Lear > 2007-12-06 10:44:32,925 DEBUG TaskImpl Task(type=1, > identity=urn:0-0-1-0-1196959457349) setting status to > Failed Parameter not supported > 2007-12-06 10:44:32,938 DEBUG vdl:execute2 Application > exception: Parameter not supported > task:execute @ vdl-int.k, line: 328 > sys:sequential @ vdl-int.k, line: 316 > sys:try @ vdl-int.k, line: 315 > task:allocatehost @ vdl-int.k, line: 298 > vdl:execute2 @ execute-default.k, line: 22 > sys:restartonerror @ execute-default.k, line: > 20 > sys:sequential @ execute-default.k, line: 19 > sys:try @ execute-default.k, line: 18 > sys:if @ execute-default.k, line: 17 > sys:then @ execute-default.k, line: 16 > sys:if @ execute-default.k, line: 15 > vdl:execute @ run_fred.kml, line: 20 > run_fred @ run_fred.kml, line: 151 > sys:parallel @ run_fred.kml, line: 150 > sys:parallelfor @ run_fred.kml, line: 80 > sys:parallel @ run_fred.kml, line: 79 > vdl:mainp @ run_fred.kml, line: 78 > mainp @ vdl.k, line: 141 > vdl:mains @ run_fred.kml, line: 77 > vdl:mains @ run_fred.kml, line: 77 > rlog:restartlog @ run_fred.kml, line: 75 > kernel:project @ run_fred.kml, line: 2 > run_fred-zh499u762hal2 > Caused by: org.globus.gram.GramException: Parameter > not supported > > > --- Mihael Hategan wrote: > > > I think I've seen fork complaining about "project" > > before. Can you try > > to comment that profile tag out and run with fork > > again? > > > > It may also be useful to post the logs since they > > may contain stack > > traces that point more accurately towards the > > problem. > > > > Mihael > > > > On Thu, 2007-12-06 at 08:15 -0800, Mike Kubal wrote: > > > Hi Mihael, > > > > > > No need to apologize, I appreciate your feedback. > > > > > > Here is the sites file. > > > > > > > > > > > > > > xmlns="http://www.griphyn.org/chimera/GVDS-PoolConfig" > > > > > > xsi:schemaLocation="http://www.griphyn.org/chimera/GVDS > > > > > http://www.griphyn.org/chimera/gvds-poolcfg-1.5.xsd" > > > > > > xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" > > > version="1.5"> > > > > > > > > > > > url="gsiftp://gridftp.purdue.teragrid.org" > > > storage="/autohome/u102/mkubal/SWIFT_working_dir" > > > major="2" minor="2" patch="4"> > > > > > > > > key="project">UC-MCA01S018 > > > > > > > > url="tg-gatekeeper.purdue.teragrid.org:2119/jobmanager-fork" > > > major="2" minor="0" patch="0"/> > > > > > > > > > /autohome/u102/mkubal/SWIFT_working_dir > > > > > > > > > > > > I have also tried the condor job manager at > > Purdue > > > that has the same url except that it ends in > > '-condor' > > > instead of '-fork' . I get the same error. > > > > > > Cheers, > > > > > > Mike > > > > > > > > > > > > > > > > > > --- Mihael Hategan wrote: > > > > > > > Sorry. My email wasn't very friendly. I was > > trying > > > > to type less :) > > > > > > > > On Wed, 2007-12-05 at 17:42 -0600, Michael Wilde > > > > wrote: > > > > > Mike, > > > > > > > > > > Mihael suspects that a bad globus parameter in > > > > your sites.xml file is > > > > > causing this error message. So please send > > that > > > > so we can take a look. > > > > > > > > > > Thanks, > > > > > > > > > > MikeW > > > > > > > > > > On 12/5/07 4:45 PM, Mihael Hategan wrote: > > > > > > Post the sites file. > > > > > > > > > > > > On Wed, 2007-12-05 at 14:33 -0800, Mike > > Kubal > > > > wrote: > > > > > >> Unfortunately I still get the same error: > > > > > >> > > > > > >> run_fred failed > > > > > >> The following errors have occurred: > > > > > >> 1. Application "run_fred" failed (Parameter > > not > > > > > >> supported) > > > > > >> Arguments: "-rec, 1beh.oeb.gz, > > -dbase, > > > > > >> Marsha_lig_1.mol2, -prefix, Marsha_lig_1" > > > > > >> Host: Lear > > > > > >> Directory: > > > > > >> run_fred-2k0629rvbffz0/run_fred-r81pg3li > > > > > >> STDERR: > > > > > >> STDOUT: > > > > > >> > > > > > >> Does 'Parameter not supported' usually > > refer to > > > > an > > > > > >> argument of the remote application? I > > wonder if > > > > it > > > > > >> does not like the .oeb.gz file? > > > > > >> > > > > > >> > > > > > >> > > > > > >> --- Ben Clifford > > wrote: > > > > > >> > > > > > >>> > > > > > >>> On Wed, 5 Dec 2007, Mike Kubal wrote: > > > > > >>> > > > > > >>>> run_fred "-rec" > > receptor_file > > > > > >>> "-dbase" > > > > > >>>> ligand_file "-prefix" ligand_prefix; > > > > > >>> In here, take the filenames of each file > > by > > > > saying > > > > > >>> @filenmame(receptor_file), like this: > > > > > >>> > > > > > >>>> run_fred "-rec" > > > > > >>> @filename(receptor_file) "-dbase" > > > > > >>>> @filename(ligand_file) "-prefix" > > > > ligand_prefix; > > > > > >>> -- > > > > > >>> > > > > _______________________________________________ > > > > > >>> Swift-devel mailing list > > > > > >>> Swift-devel at ci.uchicago.edu > > > > > >>> > > > > > >> > > > > > > > > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > > > >>> > > > > > >> > > > > > >> > > > > > >> > > > > > > > > > > ____________________________________________________________________________________ > > > > > >> Be a better friend, newshound, and > > > > > >> know-it-all with Yahoo! Mobile. Try it > > now. > > > > > > > > > > http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ > > > > > > > > > >> > > > > > >> > > _______________________________________________ > > > > > >> Swift-devel mailing list > > > > > >> Swift-devel at ci.uchicago.edu > > > > > >> > > > > > > > > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > > > >> > > > > > > > > > > > > > > _______________________________________________ > > > > > > Swift-devel mailing list > > > > > > Swift-devel at ci.uchicago.edu > > > > > > > > > > > > > > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > > > > > > > > > > > > > > > > > > > > > > > _______________________________________________ > > > > Swift-devel mailing list > > > > Swift-devel at ci.uchicago.edu > > > > > > > > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > > > > > > > > > > > > > > > > > > > > > ____________________________________________________________________________________ > > > Looking for last minute shopping deals? > > > Find them fast with Yahoo! Search. > > > http://tools.search.yahoo.com/newsearch/category.php?category=shopping > > > > > > > _______________________________________________ > > Swift-devel mailing list > > > === message truncated === > > > > ____________________________________________________________________________________ > Looking for last minute shopping deals? > Find them fast with Yahoo! Search. http://tools.search.yahoo.com/newsearch/category.php?category=shopping > From wilde at mcs.anl.gov Thu Dec 6 12:42:04 2007 From: wilde at mcs.anl.gov (Michael Wilde) Date: Thu, 06 Dec 2007 12:42:04 -0600 Subject: [Swift-devel] script that returns bad parameter error In-Reply-To: <4757389D.7030309@mcs.anl.gov> References: <753687.67764.qm@web52301.mail.re2.yahoo.com> <4757389D.7030309@mcs.anl.gov> Message-ID: <4758427C.4040608@mcs.anl.gov> MikeK, did you see this message and adjust your code accordingly? I suspect this is the problem. - MikeW On 12/5/07 5:47 PM, Michael Wilde wrote: > I need to take a close look later when I get a chance, but i'm a bit > suspicious of the use of the file type variables receptor_file and > ligand_file without the @ or @filename inside your app{} construct in > run_fred(). > > Will check later if thats what gives this message. > > you want to say: > > app { > run_fred "-rec" @receptor_file "-dbase" > @ligand_file "-prefix" ligand_prefix;> } > > See the users guide at > http://www.ci.uchicago.edu/swift/guides/userguide.php > sec 2.3.1 > > and the tutorial example, Mike. > > - MikeW > > > On 12/5/07 2:56 PM, Mike Kubal wrote: >> Any thoughts on what might cause? >> type file {} >> >> (file score, file docked) run_fred (string >> ligand_prefix, file ligand_file, file receptor_file){ >> app { >> run_fred "-rec" receptor_file "-dbase" >> ligand_file "-prefix" ligand_prefix; >> } >> } >> >> >> string receptor_prefix = "1beh"; >> >> file receptor_file >> ; >> >> file >> fls[]; >> >> foreach ligand_file in fls{ >> >> string ligand_prefix = >> @strcut(@ligand_file,"\.\/(.*)\.mol2"); >> string score_file_name = >> @strcat(ligand_prefix,"_chemgauss3_scores.txt"); >> string docked_file_name = >> @strcat(ligand_prefix,"_chemgauss3_docked.mol2"); >> file score_file >> ; >> >> file docked_file >> ; >> >> >> (score_file,docked_file) = >> run_fred(ligand_prefix,ligand_file,receptor_file); >> >> } >> >> >> Thanks, >> >> Mike Kubal >> >> >> >> ____________________________________________________________________________________ >> >> Never miss a thing. Make Yahoo your home page. http://www.yahoo.com/r/hs >> _______________________________________________ >> Swift-devel mailing list >> Swift-devel at ci.uchicago.edu >> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel >> >> > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > From wilde at mcs.anl.gov Thu Dec 6 12:43:56 2007 From: wilde at mcs.anl.gov (Michael Wilde) Date: Thu, 06 Dec 2007 12:43:56 -0600 Subject: [Swift-devel] script that returns bad parameter error In-Reply-To: <488755.34200.qm@web52304.mail.re2.yahoo.com> References: <488755.34200.qm@web52304.mail.re2.yahoo.com> Message-ID: <475842EC.4090000@mcs.anl.gov> OK, sorry - I see. I missed this message. - Mike On 12/5/07 4:33 PM, Mike Kubal wrote: > Unfortunately I still get the same error: > > run_fred failed > The following errors have occurred: > 1. Application "run_fred" failed (Parameter not > supported) > Arguments: "-rec, 1beh.oeb.gz, -dbase, > Marsha_lig_1.mol2, -prefix, Marsha_lig_1" > Host: Lear > Directory: > run_fred-2k0629rvbffz0/run_fred-r81pg3li > STDERR: > STDOUT: > > Does 'Parameter not supported' usually refer to an > argument of the remote application? I wonder if it > does not like the .oeb.gz file? > > > > --- Ben Clifford wrote: > >> >> On Wed, 5 Dec 2007, Mike Kubal wrote: >> >>> run_fred "-rec" receptor_file >> "-dbase" >>> ligand_file "-prefix" ligand_prefix; >> In here, take the filenames of each file by saying >> @filenmame(receptor_file), like this: >> >>> run_fred "-rec" >> @filename(receptor_file) "-dbase" >>> @filename(ligand_file) "-prefix" ligand_prefix; >> -- >> _______________________________________________ >> Swift-devel mailing list >> Swift-devel at ci.uchicago.edu >> > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel >> > > > > ____________________________________________________________________________________ > Be a better friend, newshound, and > know-it-all with Yahoo! Mobile. Try it now. http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > From benc at hawaga.org.uk Thu Dec 6 16:22:35 2007 From: benc at hawaga.org.uk (Ben Clifford) Date: Thu, 6 Dec 2007 22:22:35 +0000 (GMT) Subject: [Swift-devel] dataset marking Message-ID: The present SwiftScript->karajan compiler contains a bunch of code to do 'dataset marking'. Its a bit tangled, as the other code has evolved around it, and my understanding of it is correspondingly tangled. So please speak out if there is a problem with the following. The purpose of the dataset marking is to identify which dataset declarations in a SwiftScript program are inputs (to the whole workflow) and mark them as such in the compiled code. A dataset is an input if it is never assigned to; if it is assigned to then it is not an input. I worked on some code that changes the way that arrays are closed, by identifying which statements write to a dataset, at compile time. This information is also what is needed, I think, to do the above mentioned dataset marking - the same code which finds out that some statements are writing to a dataset will also find out that some datasets have no statements at all writing to them. -- From hategan at mcs.anl.gov Fri Dec 7 10:50:02 2007 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Fri, 07 Dec 2007 10:50:02 -0600 Subject: [Swift-devel] dataset marking In-Reply-To: References: Message-ID: <1197046202.7260.1.camel@blabla.mcs.anl.gov> That's my understanding of it, too. There are some special cases. Static mappers. They know how many elements there are in an array, so for those the array can be closed as soon as they are mapped. But this applies to the other problem. On Thu, 2007-12-06 at 22:22 +0000, Ben Clifford wrote: > The present SwiftScript->karajan compiler contains a bunch of code to do > 'dataset marking'. > > Its a bit tangled, as the other code has evolved around it, and my > understanding of it is correspondingly tangled. So please speak out if > there is a problem with the following. > > The purpose of the dataset marking is to identify which dataset > declarations in a SwiftScript program are inputs (to the whole workflow) > and mark them as such in the compiled code. A dataset is an input if it is > never assigned to; if it is assigned to then it is not an input. > > I worked on some code that changes the way that arrays are closed, by > identifying which statements write to a dataset, at compile time. > > This information is also what is needed, I think, to do the above > mentioned dataset marking - the same code which finds out that some > statements are writing to a dataset will also find out that some datasets > have no statements at all writing to them. > From benc at hawaga.org.uk Fri Dec 7 10:54:12 2007 From: benc at hawaga.org.uk (Ben Clifford) Date: Fri, 7 Dec 2007 16:54:12 +0000 (GMT) Subject: [Swift-devel] dataset marking In-Reply-To: <1197046202.7260.1.camel@blabla.mcs.anl.gov> References: <1197046202.7260.1.camel@blabla.mcs.anl.gov> Message-ID: On Fri, 7 Dec 2007, Mihael Hategan wrote: > There are some special cases. Static mappers. They know how many > elements there are in an array, so for those the array can be closed as > soon as they are mapped. But this applies to the other problem. OK. That should be ok here still. All existing closings still happen except for the one that happened at the end of every compound procedure on the procedure outputs (which is what is replaced by the stuff I have been playing with). -- From hategan at mcs.anl.gov Fri Dec 7 12:28:41 2007 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Fri, 07 Dec 2007 12:28:41 -0600 Subject: [Swift-devel] dataset marking In-Reply-To: References: <1197046202.7260.1.camel@blabla.mcs.anl.gov> Message-ID: <1197052121.7631.0.camel@blabla.mcs.anl.gov> Sounds right then. On Fri, 2007-12-07 at 16:54 +0000, Ben Clifford wrote: > On Fri, 7 Dec 2007, Mihael Hategan wrote: > > > There are some special cases. Static mappers. They know how many > > elements there are in an array, so for those the array can be closed as > > soon as they are mapped. But this applies to the other problem. > > OK. That should be ok here still. All existing closings still happen > except for the one that happened at the end of every compound procedure on > the procedure outputs (which is what is replaced by the stuff I have been > playing with). > From raffaele.montella at uniparthenope.it Fri Dec 7 14:16:00 2007 From: raffaele.montella at uniparthenope.it (Dr. Raffaele Montella) Date: Fri, 7 Dec 2007 14:16:00 -0600 Subject: [Swift-devel] On demand weather forecast using Swift Message-ID: <002701c8390d$fc8e9560$f5abc020$@montella@uniparthenope.it> Hi, just to practicing in swift I'm porting my grid application for on demand weather forecast from a xml based workflow engine to Swift a workflow. The Swift expression capability is great. With this email here you are my (not full working) Swift code. I have few questions: 1) The most part of functions retrieves and array of files I implemented using the filesys_mapper. I hope I used the right syntax, but Swift simply does nothing. I mean, the job is not submitted to the remote machine. I have to stop it with CTRL+C. On the logfile I have this message: 2007-12-07 20:07:49,210+0000 DEBUG Loader Recompilation suppressed. 2007-12-07 20:07:52,507+0000 INFO unknown Using sites file: sites.xml 2007-12-07 20:07:52,508+0000 INFO unknown Using tc.data: tc.data 2007-12-07 20:07:54,287+0000 WARN JavaUtils Unable to find required classes (javax.activation.DataHandler and javax.mail.internet.MimeMultipart). Attachment support is disabled. 2007-12-07 20:07:56,560+0000 INFO unknown Swift v0.3-dev r1507 2007-12-07 20:07:56,563+0000 INFO unknown RunID: 20071207-2007-95unaxd2 2007-12-07 20:07:56,898+0000 INFO AbstractDataNode Adding handle listener "Open, 0 elements, no listeners" to "terrainDomains.$[]/0" 2007-12-07 20:07:56,927+0000 INFO AbstractDataNode Adding handle listener "F/terrainDomains.$[]/0" to "terrainDomains.$[]/0" 2) All modules belonging my applications want in the ./input input files and produce in ./output their results. I never reached this point because the point 1 fails, how work the file mapper in this case? I mean, if the regrid produces the regridDomains array of files mapped somewhere but ./output/REGRID_DOMAINx.gz when it is staged-in as input for the interpf where it is copied? ./output/. ? Eventually, how can I change this behavior in order to stage in in ./input what previously whas staged out from ./output? Thank you in advance, A Swift enthusiastic - Raffaele ----------------------- The Swift Workflow: // Data type definition type terrainDomainType; type initialDataType; type dataFileType; type sstFileType; type snowFileType; type regridDomainType; type mmInputDomainType; type bdyOutDomainType; type lowBdyDomainType; type mmOutputDomainType; // Terrain function (terrainDomainType terrainDomains[])terrain(string lon, string lat, int nests) { app { terrain lon lat nests @terrainDomains; } } // Pregrid function (dataFileType dataFiles[], sstFileType sstFiles[], snowFileType snowFiles[] )pregrid(string iDate, int hours, initialDataType initalData) { app { pregrid iDate hours @filename(initaialData) @dataFiles @sstFiles @snowFiles; } } // Regrid function (regridDomainType regridDomains[]) regrdi( terrainDomainType terrainDomain, dataFileType dataFiles, sstFileType sstFiles, snowFileType snowFiles) { app { regrid @terrainDomain @dataFiles @sstFIles @snowFiles @regridDomains; } } // Interpf function (mmInputDomainType mmInputDomains[], bdyOutDomainType dbyOutDomains[], lowBdyDomainType lowBdyDomains[]) interpf (regridDomainType regridDomain) { app { interpf @regridDomain @mmInputDomains @dbyOutDOmains @lowBdyDomains; } } // Mpp (parallel MM5) function (mmOutputDomainType mmOutputDomains[])mmp( terrainDomainType terrainDomains[], mmInputDomainType mmInputDomains[], bdyOutDomainType dbyOutDomains[], lowBdyDomainType lowBdyDomains[]) { app { mmp @terrainDomains @mmInputDomains @bdyOutDomains @lowBdyDomains @mmOutputDomains; } } // Terrain output terrainDomainType terrainDomains[] ; // Pregrid input data initialDataType initialData[] ; // Pregrid outputs dataFileType dataFiles[] ; sstFileType sstFiles[] ; snowFileType snowFiles[] ; // Regrid outputs regridDomainType regridDomains[] ; // Interpf outputs mmInputDomainType mmInputDomains[] ; bdyOutDomainType bdyOutDomains[] ; lowBdyDomainType lowBdyDomains[] ; // MM5 output arrays mmOutputDomainType mmOutputDomains[] ; // ---------------------------------------------------------------------------- -------- // THE WORKFLOW: on demand weather forecast // ---------------------------------------------------------------------------- -------- // Create the terrain centered on Chicago Pier (two nest levels, max ground resolution 27km) terrainDomains = terrain("-87.5992", "41.8919", 2); // Retrieve initial and boundary conditions and prepare data files for next modules //(dataFiles, sstFiles, snowFiles) = pregrid( "20071207Z00", 24, initialData); // Prepare data for each nested domain... foreach terrainDomain,i in terrainDomains { // Interpolate initial and boundary conditions over the terrain model //regridFiles[i] = regrid( terrainDomain, dataFiles, sstFiles, snowFiles); // Perform more forward interpolation and produce input data form MM5 //(mmInputDomains[i],bdyOutDomains[i],lowBdyDomains[i]) = interpf(regridFiles[i]); } // Run the model //mmOutputDomains = mpp(terrainDomains, mmInputDomains, bdyOutDomains, lowBdyDomains); -------------- next part -------------- An HTML attachment was scrubbed... URL: From benc at hawaga.org.uk Fri Dec 7 16:21:37 2007 From: benc at hawaga.org.uk (Ben Clifford) Date: Fri, 7 Dec 2007 22:21:37 +0000 (GMT) Subject: [Swift-devel] On demand weather forecast using Swift In-Reply-To: <002701c8390d$fc8e9560$f5abc020$@montella@uniparthenope.it> References: <002701c8390d$fc8e9560$f5abc020$@montella@uniparthenope.it> Message-ID: I think the below fragment of your SwiftScript is the piece that should execute before everything else. Its not clear what the command line for 'terrain' should look like - can you post an example of how to manually invoke the terrain application, including a real command line? On Fri, 7 Dec 2007, Dr. Raffaele Montella wrote: > type terrainDomainType; > // Terrain function > > (terrainDomainType terrainDomains[])terrain(string lon, string lat, int > nests) { > > app { terrain lon lat nests @terrainDomains; } > > } > terrainDomainType terrainDomains[] prefix="TERRAIN_DOMAIN", suffix=".gz">; > terrainDomains = terrain("-87.5992", "41.8919", 2); -- From raffaele.montella at uniparthenope.it Fri Dec 7 17:50:06 2007 From: raffaele.montella at uniparthenope.it (Dr. Raffaele Montella) Date: Fri, 7 Dec 2007 17:50:06 -0600 Subject: [Swift-devel] terrain example Message-ID: <000001c8392b$e55a3390$b00e9ab0$@montella@uniparthenope.it> Hi! This is the GRIDMM5_ROOT structure: GRIDMM5_ROOT ! !--bin !--data ! !--terrain ! !--data ! !--data30s !--sbin !--tars The terrain script is invoked with the following command line syntax: $GRIDMM5_ROOT/bin/terrain lon lat nests Where: (lon,lat): the earth point center of the weather forecast domain Nests: number of nested domains. For example in nests is equal to 1 is generated a digital elevation model plus landuse and water/land mask data centered in (lon,lat) and wide 91 (with a 27km edge) cells west/east ward and 91 cells north/southward (basically lon,lat is in the middle of a square domain). If nests is equal to 2 do domains are generated both centered in (lon, lat). The first as in the case of nest=1 and the second again wide 91*91 cells, but each cell is now 27/3 km wide. The terrain script invokes internally the $GRIDMM5_ROOT/sbin/do_terrain script (a most general version) filling automatically some parameters dynamically related (the current scratch directoy) and installation related (the directory where dem dan high resolution dem data are stored). The terrain script produces a TERRAIN_DOMAINx.gz file (with x=1..nests) in the ./output directory. The pregrid script is invoked with the following command line syntax: $GRIDMM5/bin/pregrid idate hours Where: Idate: is the date in the ncep format: YYYYMMDDZHH for example 20071207Z00 (Z00 means data initialized at 00 zuli) Hours: the number of hours have to be simulated, for example 24. In order to work, pregrid needs in the directory ./input the content of the directory: Gsiftp://data.uniparthenope.it//home/infonav/data/ncep/YYYYMMDD/YYYYMMDDZHH As output the script produces three gzipped files in ./output directory: FILE.gz, SST.gz and SNOW.gz that will be used in next steps. Bye and thank you, Raffaele -------------- next part -------------- An HTML attachment was scrubbed... URL: From benc at hawaga.org.uk Sun Dec 9 09:38:46 2007 From: benc at hawaga.org.uk (Ben Clifford) Date: Sun, 9 Dec 2007 15:38:46 +0000 (GMT) Subject: [Swift-devel] terrain example In-Reply-To: <000001c8392b$e55a3390$b00e9ab0$@montella@uniparthenope.it> References: <000001c8392b$e55a3390$b00e9ab0$@montella@uniparthenope.it> Message-ID: On Fri, 7 Dec 2007, Dr. Raffaele Montella wrote: > The terrain script produces a TERRAIN_DOMAINx.gz file (with x=1..nests) in > the ./output directory. At the moment, Swift cannot deal with variable numbers of output files from a program. In your code, you map this: terrainDomainType terrainDomains[] ; and then try to use this as a return value, like this: (terrainDomainType terrainDomains[])terrain(string lon, string lat, int nests) { At the moment, Swift doesn't know how to deal with that - it does not know how to deal with output files where the names are not known before invocation. You might be able to hack around in certain cases by explicitly listing the files - declare terrainDomains like this: terrainDomainType terrainDomains[] ; However, this needs to a different declaration for every different value of nests, so is not a very good solution. Better handling of this kind of situation is on the to-do list, but it won't happen soon. -- From raffaele.montella at uniparthenope.it Sun Dec 9 12:45:10 2007 From: raffaele.montella at uniparthenope.it (Dr. Raffaele Montella) Date: Sun, 9 Dec 2007 12:45:10 -0600 Subject: R: [Swift-devel] terrain example In-Reply-To: References: <000001c8392b$e55a3390$b00e9ab0$@montella@uniparthenope.it> Message-ID: <000a01c83a93$a0803760$e180a620$@montella@uniparthenope.it> Hi Ben! Thank you! I will hack around using a fixed number of nests as a better solution will be available! I'll post my code as soon as it will be working. Bye, Raffaele -----Messaggio originale----- Da: Ben Clifford [mailto:benc at hawaga.org.uk] Inviato: domenica 9 dicembre 2007 9.39 A: Dr. Raffaele Montella Cc: swift-devel at ci.uchicago.edu Oggetto: Re: [Swift-devel] terrain example On Fri, 7 Dec 2007, Dr. Raffaele Montella wrote: > The terrain script produces a TERRAIN_DOMAINx.gz file (with x=1..nests) in > the ./output directory. At the moment, Swift cannot deal with variable numbers of output files from a program. In your code, you map this: terrainDomainType terrainDomains[] ; and then try to use this as a return value, like this: (terrainDomainType terrainDomains[])terrain(string lon, string lat, int nests) { At the moment, Swift doesn't know how to deal with that - it does not know how to deal with output files where the names are not known before invocation. You might be able to hack around in certain cases by explicitly listing the files - declare terrainDomains like this: terrainDomainType terrainDomains[] ; However, this needs to a different declaration for every different value of nests, so is not a very good solution. Better handling of this kind of situation is on the to-do list, but it won't happen soon. -- From bugzilla-daemon at mcs.anl.gov Mon Dec 10 08:23:20 2007 From: bugzilla-daemon at mcs.anl.gov (bugzilla-daemon at mcs.anl.gov) Date: Mon, 10 Dec 2007 08:23:20 -0600 (CST) Subject: [Swift-devel] [Bug 116] New: simple_mapper handling of numbered files in arrays broken Message-ID: http://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=116 Summary: simple_mapper handling of numbered files in arrays broken Product: Swift Version: unspecified Platform: Macintosh OS/Version: All Status: NEW Severity: normal Priority: P2 Component: General AssignedTo: benc at hawaga.org.uk ReportedBy: benc at hawaga.org.uk CC: swift-devel at ci.uchicago.edu simple mapper is formatting numbers used to index arrays that it maps in a way that is incompatible with the filename on disk. With: $ ls *.in 1.in 2.in the declaration: file inputs[] ; correctly creates an array with two elements, having detected 1.in and 2.in on disk; however when mapping filenames for inputs[1] and inputs[2], the filenames are padded to 0001.in and 0002.in which are not the correct filenames. This causes runtime error. This is with version r1515 -- Configure bugmail: http://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is. From mikekubal at yahoo.com Mon Dec 10 17:47:00 2007 From: mikekubal at yahoo.com (Mike Kubal) Date: Mon, 10 Dec 2007 15:47:00 -0800 (PST) Subject: [Swift-devel] script that returns bad parameter error In-Reply-To: <475842EC.4090000@mcs.anl.gov> Message-ID: <176887.83362.qm@web52304.mail.re2.yahoo.com> My bad parameter error was fixed by removing the Globus node type variable from my tc.file. Thanks for everyone's help. Cheers, Mike --- Michael Wilde wrote: > OK, sorry - I see. I missed this message. > > - Mike > > On 12/5/07 4:33 PM, Mike Kubal wrote: > > Unfortunately I still get the same error: > > > > run_fred failed > > The following errors have occurred: > > 1. Application "run_fred" failed (Parameter not > > supported) > > Arguments: "-rec, 1beh.oeb.gz, -dbase, > > Marsha_lig_1.mol2, -prefix, Marsha_lig_1" > > Host: Lear > > Directory: > > run_fred-2k0629rvbffz0/run_fred-r81pg3li > > STDERR: > > STDOUT: > > > > Does 'Parameter not supported' usually refer to an > > argument of the remote application? I wonder if it > > does not like the .oeb.gz file? > > > > > > > > --- Ben Clifford wrote: > > > >> > >> On Wed, 5 Dec 2007, Mike Kubal wrote: > >> > >>> run_fred "-rec" receptor_file > >> "-dbase" > >>> ligand_file "-prefix" ligand_prefix; > >> In here, take the filenames of each file by > saying > >> @filenmame(receptor_file), like this: > >> > >>> run_fred "-rec" > >> @filename(receptor_file) "-dbase" > >>> @filename(ligand_file) "-prefix" ligand_prefix; > >> -- > >> _______________________________________________ > >> Swift-devel mailing list > >> Swift-devel at ci.uchicago.edu > >> > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > >> > > > > > > > > > ____________________________________________________________________________________ > > Be a better friend, newshound, and > > know-it-all with Yahoo! Mobile. Try it now. > http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ > > > > > _______________________________________________ > > Swift-devel mailing list > > Swift-devel at ci.uchicago.edu > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > > > ____________________________________________________________________________________ Be a better friend, newshound, and know-it-all with Yahoo! Mobile. Try it now. http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ From bugzilla-daemon at mcs.anl.gov Tue Dec 11 16:41:52 2007 From: bugzilla-daemon at mcs.anl.gov (bugzilla-daemon at mcs.anl.gov) Date: Tue, 11 Dec 2007 16:41:52 -0600 (CST) Subject: [Swift-devel] [Bug 116] simple_mapper handling of numbered files in arrays broken In-Reply-To: Message-ID: <20071211224152.8983516487@foxtrot.mcs.anl.gov> http://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=116 ------- Comment #1 from tiberius at mcs.anl.gov 2007-12-11 16:41 ------- (In reply to comment #0) Also, I am using simple mapper to generate file names use as outputs for parameter sweeps, and I am running out of the name space (4 digits for numbering is limiting) Eg: (file resultsOut[]) paramSweep (){ foreach i{ foreach j{ resultsOut[i*iSize+j] = atomicProcedure(i,j); } } } file results[]; results = paramSweep(); -- Configure bugmail: http://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is. From bugzilla-daemon at mcs.anl.gov Thu Dec 13 07:37:17 2007 From: bugzilla-daemon at mcs.anl.gov (bugzilla-daemon at mcs.anl.gov) Date: Thu, 13 Dec 2007 07:37:17 -0600 (CST) Subject: [Swift-devel] [Bug 117] New: multidimensional array support Message-ID: http://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=117 Summary: multidimensional array support Product: Swift Version: unspecified Platform: Macintosh OS/Version: Mac OS Status: NEW Severity: normal Priority: P2 Component: SwiftScript language AssignedTo: benc at hawaga.org.uk ReportedBy: benc at hawaga.org.uk CC: swift-devel at ci.uchicago.edu Add multidimensional array support (eg. be able to write a[i][j]) The main thing that needs to happen here is type system reworking, which isn't expressive enough at the moment. A small change (actually a simplification) in the parser allows multiple array access operators ( these -> []) in a row and lots of stuff related to mulidimensional arrays already works in that case (though not everything). -- Configure bugmail: http://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is. From bugzilla-daemon at mcs.anl.gov Thu Dec 13 07:38:45 2007 From: bugzilla-daemon at mcs.anl.gov (bugzilla-daemon at mcs.anl.gov) Date: Thu, 13 Dec 2007 07:38:45 -0600 (CST) Subject: [Swift-devel] [Bug 115] Swift users encounter long delays waiting for random name generation In-Reply-To: Message-ID: <20071213133845.92E6B164BB@foxtrot.mcs.anl.gov> http://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=115 benc at hawaga.org.uk changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution| |FIXED ------- Comment #2 from benc at hawaga.org.uk 2007-12-13 07:38 ------- no response to question from reporter. closing. -- Configure bugmail: http://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You reported the bug, or are watching the reporter. From bugzilla-daemon at mcs.anl.gov Fri Dec 14 07:21:26 2007 From: bugzilla-daemon at mcs.anl.gov (bugzilla-daemon at mcs.anl.gov) Date: Fri, 14 Dec 2007 07:21:26 -0600 (CST) Subject: [Swift-devel] [Bug 118] New: syntax error report when [] used incorrectly in an expression Message-ID: http://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=118 Summary: syntax error report when [] used incorrectly in an expression Product: Swift Version: unspecified Platform: Macintosh OS/Version: All Status: NEW Severity: normal Priority: P2 Component: SwiftScript language AssignedTo: benc at hawaga.org.uk ReportedBy: benc at hawaga.org.uk CC: swift-devel at ci.uchicago.edu volume brainatlas = average(aligned[]); gives error: Could not compile SwiftScript source: line 45:19: unexpected token: = pointing to the = of assignment. It would be preferable if the error is reported at the incorrect [] pair Perhaps indicate missing constant there, as that seems closest to what would be syntactically correct; although in this case the [] shouldn't have been there at all. -- Configure bugmail: http://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is. From bugzilla-daemon at mcs.anl.gov Fri Dec 14 09:05:35 2007 From: bugzilla-daemon at mcs.anl.gov (bugzilla-daemon at mcs.anl.gov) Date: Fri, 14 Dec 2007 09:05:35 -0600 (CST) Subject: [Swift-devel] [Bug 119] New: kickstart transfer errors mask underlying application errors Message-ID: http://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=119 Summary: kickstart transfer errors mask underlying application errors Product: Swift Version: unspecified Platform: Macintosh OS/Version: Mac OS Status: NEW Severity: normal Priority: P2 Component: SwiftScript language AssignedTo: benc at hawaga.org.uk ReportedBy: benc at hawaga.org.uk CC: swift-devel at ci.uchicago.edu -- Configure bugmail: http://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is. From bugzilla-daemon at mcs.anl.gov Fri Dec 14 09:07:09 2007 From: bugzilla-daemon at mcs.anl.gov (bugzilla-daemon at mcs.anl.gov) Date: Fri, 14 Dec 2007 09:07:09 -0600 (CST) Subject: [Swift-devel] [Bug 120] New: kickstart transfer errors mask underlying application errors Message-ID: http://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=120 Summary: kickstart transfer errors mask underlying application errors Product: Swift Version: unspecified Platform: Macintosh OS/Version: Mac OS Status: NEW Severity: normal Priority: P2 Component: SwiftScript language AssignedTo: benc at hawaga.org.uk ReportedBy: benc at hawaga.org.uk CC: swift-devel at ci.uchicago.edu in r1515 with kickstart enabled when an application error occurs so that no kickstart record is produced (for example, missing input file) then: the reported error on the console is a kickstart record missing error, rather than the probably more appropriate application exception. the application exception continues to appear in the log file. cat started Failed to transfer kickstart records from mfd-20071214-1503-6jtdb0e0/kickstart/z/localhostFile not found: /var/tmp/mfd-20071214-1503-6jtdb0e0/kickstart/z/cat-zkk7rhli-kickstart.xml task:transfer @ vdl-int.k, line: 326 sys:try @ vdl-int.k, line: 326 vdl:transferkickstartrec @ vdl-int.k, line: 413 sys:set @ vdl-int.k, line: 413 -- Configure bugmail: http://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is. From bugzilla-daemon at mcs.anl.gov Fri Dec 14 09:07:38 2007 From: bugzilla-daemon at mcs.anl.gov (bugzilla-daemon at mcs.anl.gov) Date: Fri, 14 Dec 2007 09:07:38 -0600 (CST) Subject: [Swift-devel] [Bug 119] kickstart transfer errors mask underlying application errors In-Reply-To: Message-ID: <20071214150738.9774C16487@foxtrot.mcs.anl.gov> http://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=119 benc at hawaga.org.uk changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution| |INVALID ------- Comment #1 from benc at hawaga.org.uk 2007-12-14 09:07 ------- submitted too early -- Configure bugmail: http://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is. From bugzilla-daemon at mcs.anl.gov Fri Dec 14 11:40:42 2007 From: bugzilla-daemon at mcs.anl.gov (bugzilla-daemon at mcs.anl.gov) Date: Fri, 14 Dec 2007 11:40:42 -0600 (CST) Subject: [Swift-devel] [Bug 118] syntax error report when [] used incorrectly in an expression In-Reply-To: Message-ID: <20071214174042.165E1164BB@foxtrot.mcs.anl.gov> http://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=118 benc at hawaga.org.uk changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution| |FIXED ------- Comment #1 from benc at hawaga.org.uk 2007-12-14 11:40 ------- r1516 has a change in the parser for this case. the example line is now reported as: Could not compile SwiftScript source: line 1:36: expecting ')', found '[' with column 36 being a closer location. -- Configure bugmail: http://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is. From bugzilla-daemon at mcs.anl.gov Sat Dec 15 09:58:04 2007 From: bugzilla-daemon at mcs.anl.gov (bugzilla-daemon at mcs.anl.gov) Date: Sat, 15 Dec 2007 09:58:04 -0600 (CST) Subject: [Swift-devel] [Bug 121] New: declarations with procedure calls do not allow declarations of arrays. Message-ID: http://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=121 Summary: declarations with procedure calls do not allow declarations of arrays. Product: Swift Version: unspecified Platform: All OS/Version: All Status: NEW Severity: normal Priority: P2 Component: SwiftScript language AssignedTo: benc at hawaga.org.uk ReportedBy: benc at hawaga.org.uk CC: swift-devel at ci.uchicago.edu In r1516, this is not permitted file g[] = p(x); but this is: file g[]; g=p(x); They should both be permitted and should both mean the same thing. -- Configure bugmail: http://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is. From benc at hawaga.org.uk Sun Dec 16 07:38:34 2007 From: benc at hawaga.org.uk (Ben Clifford) Date: Sun, 16 Dec 2007 13:38:34 +0000 (GMT) Subject: [Swift-devel] app syntax ambiguity Message-ID: Expressions have been mostly self delimiting, which is useful in the app{} block syntax where there are no delimiters between the parameters of an application. For example, given the input: 21*33 14*96 that can be parsed as two expressions, the first one 21*33 and the second one 14*96. The sequence of tokens for this coming out of the lexer is: 21 * 33 14 * 96 There's some ambiguity when it comes to unary +/- eg 21 -33 could be either a single expression (21-33) or two expressions 21 and -33. However, no one has commented on having trouble with this before. Putting in multi-dimensional array support adds more ambiguity along the same lines, this time interacting with array literals. i[1][2] might mean two parameters i[1] and an array literal [2] or it might mean one parameter accessing a multidimensional array i[1][2]. Changing the syntax used to specify array literals would resolve this, as would putting in specific delimiters in the app block. The former is probably the least intrusive in terms of already written user scripts. -- From hategan at mcs.anl.gov Sun Dec 16 11:57:20 2007 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Sun, 16 Dec 2007 11:57:20 -0600 Subject: [Swift-devel] app syntax ambiguity In-Reply-To: References: Message-ID: <1197827840.3307.7.camel@blabla.mcs.anl.gov> On Sun, 2007-12-16 at 13:38 +0000, Ben Clifford wrote: > Expressions have been mostly self delimiting, which is useful in the app{} > block syntax where there are no delimiters between the parameters of an > application. For example, given the input: 21*33 14*96 that can be parsed > as two expressions, the first one 21*33 and the second one 14*96. > > The sequence of tokens for this coming out of the lexer is: 21 * 33 14 * > 96 > > There's some ambiguity when it comes to unary +/- eg 21 -33 could be > either a single expression (21-33) or two expressions 21 and -33. Would we be ok (from an aesthetic/usability) perspective with commas as separators there? Or even with representing the args as an array? If not, then I think the unary operators should have precedence and if the user wants to have a single expression, parentheses can be used (e.g. (21-33) (14+16)) > > However, no one has commented on having trouble with this before. > > Putting in multi-dimensional array support adds more ambiguity along the > same lines, this time interacting with array literals. > > i[1][2] might mean two parameters i[1] and an array literal [2] or it > might mean one parameter accessing a multidimensional array i[1][2]. Or both? As in multidimensional arrays are arrays of arrays. What we want, I'm guessing, is the possibility to easily pass i[1] as an array parameter instead of using something like i[i, *]. > > Changing the syntax used to specify array literals would resolve this, as > would putting in specific delimiters in the app block. The former is > probably the least intrusive in terms of already written user scripts. > From benc at hawaga.org.uk Sun Dec 16 12:15:23 2007 From: benc at hawaga.org.uk (Ben Clifford) Date: Sun, 16 Dec 2007 18:15:23 +0000 (GMT) Subject: [Swift-devel] app syntax ambiguity In-Reply-To: <1197827840.3307.7.camel@blabla.mcs.anl.gov> References: <1197827840.3307.7.camel@blabla.mcs.anl.gov> Message-ID: On Sun, 16 Dec 2007, Mihael Hategan wrote: > Or both? As in multidimensional arrays are arrays of arrays. What we > want, I'm guessing, is the possibility to easily pass i[1] as an array > parameter instead of using something like i[i, *]. That's how it looks like it works out anyway. You can already say [ [ "foo", "bar" ], ["one", "two", "three" ]] in the language at the moment - the type system isn't expressive enough to represent what the type of the above expression (an array of arrays of strings) but the appropriate DSHandle is constructed if you put the above in a program (because there's no type checking on array construction). I think you get what I meant by the ambiguity, though, here: >> i[1][2] might mean two parameters i[1] and an array literal [2] or it >> might mean one parameter accessing a multidimensional array i[1][2]. If i was the above, then i[1][2] might be "bar" (a string), or it might be two expressions: the array with two strings ["foo", "bar"] and then an array with one integer member [ 2 ] In practice, I guess, the greedy-from-the-left way of parsing seems to work in all the cases that anyone has come across so far so I'll probably leave it. -- From hategan at mcs.anl.gov Sun Dec 16 14:43:25 2007 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Sun, 16 Dec 2007 14:43:25 -0600 Subject: [Swift-devel] app syntax ambiguity In-Reply-To: References: <1197827840.3307.7.camel@blabla.mcs.anl.gov> Message-ID: <1197837805.5877.5.camel@blabla.mcs.anl.gov> On Sun, 2007-12-16 at 18:15 +0000, Ben Clifford wrote: > > On Sun, 16 Dec 2007, Mihael Hategan wrote: > > > Or both? As in multidimensional arrays are arrays of arrays. What we > > want, I'm guessing, is the possibility to easily pass i[1] as an array > > parameter instead of using something like i[i, *]. > > That's how it looks like it works out anyway. You can already say > > [ [ "foo", "bar" ], ["one", "two", "three" ]] > > in the language at the moment - the type system isn't expressive enough to > represent what the type of the above expression (an array of arrays of > strings) but the appropriate DSHandle is constructed if you put the above > in a program (because there's no type checking on array construction). > > I think you get what I meant by the ambiguity, though, here: I didn't. But I do now. > > >> i[1][2] might mean two parameters i[1] and an array literal [2] or it > >> might mean one parameter accessing a multidimensional array i[1][2]. > > If i was the above, then i[1][2] might be "bar" (a string), or it might be > two expressions: > the array with two strings > ["foo", "bar"] > and then an array with one integer member > [ 2 ] > > In practice, I guess, the greedy-from-the-left way of parsing seems to > work in all the cases that anyone has come across so far so I'll probably > leave it. So let's be clear. This only applies to app{} blocks, right? The syntax is somewhat ambiguous there. But the least surprise in the context in which our multi-dimensional arrays are accessed as a[i][j]... is for i[1][2] to mean i[1, 2]. I think the distinction can be made based on whitespace between ']' and '['. I.e. i[1][2] vs. i[1] [2]. > From benc at hawaga.org.uk Sun Dec 16 14:53:16 2007 From: benc at hawaga.org.uk (Ben Clifford) Date: Sun, 16 Dec 2007 20:53:16 +0000 (GMT) Subject: [Swift-devel] app syntax ambiguity In-Reply-To: <1197837805.5877.5.camel@blabla.mcs.anl.gov> References: <1197827840.3307.7.camel@blabla.mcs.anl.gov> <1197837805.5877.5.camel@blabla.mcs.anl.gov> Message-ID: On Sun, 16 Dec 2007, Mihael Hategan wrote: > So let's be clear. This only applies to app{} blocks, right? Yes. Every other place where expressions appear has unambiguous delimination of expressions (eg end of a statement or a comma between parameters) -- From mikekubal at yahoo.com Mon Dec 17 23:15:15 2007 From: mikekubal at yahoo.com (Mike Kubal) Date: Mon, 17 Dec 2007 21:15:15 -0800 (PST) Subject: [Swift-devel] how to increment int? Message-ID: <459440.30098.qm@web52306.mail.re2.yahoo.com> In the swift code loop below I need to increment the start_job variable by 1, however I get the error that start_job is already assigned, how should I do it? thanks Mike Kubal int start_job = 10000001; while( start_job < 10000998){ string job_number = start_job; file score_file ; file docked_file ; (score_file,docked_file) = run_fred(job_number); start_job = start_job + 1; } ____________________________________________________________________________________ Be a better friend, newshound, and know-it-all with Yahoo! Mobile. Try it now. http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ From hategan at mcs.anl.gov Tue Dec 18 00:22:48 2007 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Tue, 18 Dec 2007 00:22:48 -0600 Subject: [Swift-devel] how to increment int? In-Reply-To: <459440.30098.qm@web52306.mail.re2.yahoo.com> References: <459440.30098.qm@web52306.mail.re2.yahoo.com> Message-ID: <1197958968.17591.16.camel@blabla.mcs.anl.gov> You cannot increment things in Swift. It's a data-flow like language. Variables are "virtual" nodes in a dependency graph. A variable depending on itself (i.e. x = f(x)) has no well-defined meaning, at least as far as the current model goes. But you can probably construct an array and iterate over it: int job_numbers[] = [10000001:10000998]; foreach job_number in job_numbers { ... } Mihael On Mon, 2007-12-17 at 21:15 -0800, Mike Kubal wrote: > In the swift code loop below I need to increment the > start_job variable by 1, however I get the error that > start_job is already assigned, how should I do it? > > thanks Mike Kubal > > > int start_job = 10000001; > > while( start_job < 10000998){ > string job_number = start_job; > file score_file > (job_number,"_chemgauss3_scores.txt")>; > file docked_file > ; > (score_file,docked_file) = > run_fred(job_number); > start_job = start_job + 1; > } > > > > ____________________________________________________________________________________ > Be a better friend, newshound, and > know-it-all with Yahoo! Mobile. Try it now. http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > From benc at hawaga.org.uk Tue Dec 18 06:16:27 2007 From: benc at hawaga.org.uk (Ben Clifford) Date: Tue, 18 Dec 2007 12:16:27 +0000 (GMT) Subject: [Swift-devel] how to increment int? In-Reply-To: <459440.30098.qm@web52306.mail.re2.yahoo.com> References: <459440.30098.qm@web52306.mail.re2.yahoo.com> Message-ID: > In the swift code loop below I need to increment the > start_job variable by 1, however I get the error that > start_job is already assigned, how should I do it? > while( start_job < 10000998){ Don't use while - it shouldn't even be in the language, in my opinion, given that I've never seen a successful use of it. Here are two ways of saying what I think you want: THere's an 'iterate' statement that will give you a counter for each loop. Section 2.6.4 in here: http://www.ci.uchicago.edu/swift/guides/userguide.php#id2663424 something like iterate i { int job_number = i + 10000000; [...] } until(job_number >= 1000098) You could also express it as this, which perhaps better expresses the parallelism (though I think both the iterate use above and the foreach use below will behave about the same). foreach job_number in [1000000:10000098] { [....] } -- From benc at hawaga.org.uk Tue Dec 18 06:36:04 2007 From: benc at hawaga.org.uk (Ben Clifford) Date: Tue, 18 Dec 2007 12:36:04 +0000 (GMT) Subject: [Swift-devel] remove while Message-ID: given that I've seen exactly 0 successful uses of while and no one has managed ever to come up with a non-contrived example about launching rockets or wierd stuff like that, I'm going to remove it from the language unless someone comes up with some decent justification (like a set of sensible coded examples written in SwiftScript). -- From hategan at mcs.anl.gov Tue Dec 18 07:35:19 2007 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Tue, 18 Dec 2007 07:35:19 -0600 Subject: [Swift-devel] remove while In-Reply-To: References: Message-ID: <1197984919.18225.1.camel@blabla.mcs.anl.gov> On Tue, 2007-12-18 at 12:36 +0000, Ben Clifford wrote: > given that I've seen exactly 0 successful uses of while and no one has > managed ever to come up with a non-contrived example about launching > rockets or wierd stuff like that, Hey, I did mention the rockets! > I'm going to remove it from the language > unless someone comes up with some decent justification (like a set of > sensible coded examples written in SwiftScript). > > -- > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > From mikekubal at yahoo.com Tue Dec 18 08:03:30 2007 From: mikekubal at yahoo.com (Mike Kubal) Date: Tue, 18 Dec 2007 06:03:30 -0800 (PST) Subject: [Swift-devel] how to increment int? In-Reply-To: Message-ID: <928045.71133.qm@web52301.mail.re2.yahoo.com> Thanks Ben, I tried both approaches, but I get the following errors: Could not compile SwiftScript source: line 9:11: unexpected token: { with the line: iterate i { I get a similar error Could not compile SwiftScript source: line 12:23: unexpected token: [ with the line foreach job_number in [1000000:10000098] Thanks, Mike --- Ben Clifford wrote: > > > > In the swift code loop below I need to increment > the > > start_job variable by 1, however I get the error > that > > start_job is already assigned, how should I do it? > > > > while( start_job < 10000998){ > > Don't use while - it shouldn't even be in the > language, in my opinion, > given that I've never seen a successful use of it. > > Here are two ways of saying what I think you want: > > THere's an 'iterate' statement that will give you a > counter for each loop. > > Section 2.6.4 in here: > http://www.ci.uchicago.edu/swift/guides/userguide.php#id2663424 > > something like > > iterate i { > int job_number = i + 10000000; > [...] > } until(job_number >= 1000098) > > > You could also express it as this, which perhaps > better expresses the > parallelism (though I think both the iterate use > above and the foreach use > below will behave about the same). > > foreach job_number in [1000000:10000098] { > [....] > } > > > -- > > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > ____________________________________________________________________________________ Never miss a thing. Make Yahoo your home page. http://www.yahoo.com/r/hs From benc at hawaga.org.uk Tue Dec 18 08:08:23 2007 From: benc at hawaga.org.uk (Ben Clifford) Date: Tue, 18 Dec 2007 14:08:23 +0000 (GMT) Subject: [Swift-devel] how to increment int? In-Reply-To: <928045.71133.qm@web52301.mail.re2.yahoo.com> References: <928045.71133.qm@web52301.mail.re2.yahoo.com> Message-ID: On Tue, 18 Dec 2007, Mike Kubal wrote: > I tried both approaches, but I get the following > errors: what version of swift are you using? Both of those errors look like the sort of thing I'd expect from a version earlier than v0.3. -- From bugzilla-daemon at mcs.anl.gov Tue Dec 18 14:31:05 2007 From: bugzilla-daemon at mcs.anl.gov (bugzilla-daemon at mcs.anl.gov) Date: Tue, 18 Dec 2007 14:31:05 -0600 (CST) Subject: [Swift-devel] [Bug 122] New: regexp_mapper transformation enhancements Message-ID: http://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=122 Summary: regexp_mapper transformation enhancements Product: Swift Version: unspecified Platform: Macintosh OS/Version: Mac OS Status: NEW Severity: normal Priority: P2 Component: SwiftScript language AssignedTo: benc at hawaga.org.uk ReportedBy: tiberius at mcs.anl.gov I would like to have the ability to derive the output file name from the input file name using simple arithmetic operations on the matched fields : E.g. functionality: step_0_theta_4.txt -> step_1_theta_4.txt Also, it would be good to have the regexp_mapper work on string[] and produce string[] as well -- Configure bugmail: http://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You reported the bug, or are watching the reporter. From bugzilla-daemon at mcs.anl.gov Tue Dec 18 14:37:25 2007 From: bugzilla-daemon at mcs.anl.gov (bugzilla-daemon at mcs.anl.gov) Date: Tue, 18 Dec 2007 14:37:25 -0600 (CST) Subject: [Swift-devel] [Bug 123] New: Array mappers should accept programmatically-built string[]s Message-ID: http://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=123 Summary: Array mappers should accept programmatically-built string[]s Product: Swift Version: unspecified Platform: Macintosh OS/Version: Mac OS Status: NEW Severity: normal Priority: P2 Component: SwiftScript language AssignedTo: benc at hawaga.org.uk ReportedBy: tiberius at mcs.anl.gov I expected this to work: type file{}; int rangeMax=3; int stepRange=[1:rangeMax]; string oldvalfilenames[]; foreach step in stepRange{ oldvalfilenames[step] = @strcat("step_",step,"_theta.txt"); trace(oldvalfilenames[step]); } file oldvalfile[] ; trace(@filenames(oldvalfile)); Please suggest a solution for completely customizable file names in array mappers: E.g. step_3_theta_5.txt, step_4_theta6.txt -- Configure bugmail: http://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You reported the bug, or are watching the reporter. From benc at hawaga.org.uk Fri Dec 21 10:39:51 2007 From: benc at hawaga.org.uk (Ben Clifford) Date: Fri, 21 Dec 2007 16:39:51 +0000 (GMT) Subject: [Swift-devel] multidimensional arrays Message-ID: A couple of people have talked about wanting multidimensional arrays. I've been playing with this a bit. The code is not ready to commit yet. However for people who want to play right now, here's a tarball of my development tree with the changes. http://www.ci.uchicago.edu/~benc/swift-0.3-benc-arrays.tar.gz (22mb) -- From benc at hawaga.org.uk Fri Dec 28 04:49:22 2007 From: benc at hawaga.org.uk (Ben Clifford) Date: Fri, 28 Dec 2007 10:49:22 +0000 (GMT) Subject: [Swift-devel] build dependencies Message-ID: I've been building provider-deef on my machine recently by having it listed as a dependency of swift in build.xml (a patch in my quilt stack adds that in as part of my local configuration). This seems to solve the 'provider-deef overwriting the log config file' problem for me. It might be interesting to make it possible to specify dependencies like this at build time on the commandline to ant. (this is very similar to the unix world way of saying: > ./configure --enable-ipv6 --disable-sasl > make in order to determine if you want to have dependencies or not on ipv6 and sasl (and hence corresponding features) in some software) -- From hategan at mcs.anl.gov Fri Dec 28 11:50:45 2007 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Fri, 28 Dec 2007 11:50:45 -0600 Subject: [Swift-devel] build dependencies In-Reply-To: References: Message-ID: <1198864246.25031.1.camel@blabla.mcs.anl.gov> On Fri, 2007-12-28 at 10:49 +0000, Ben Clifford wrote: > I've been building provider-deef on my machine recently by having it > listed as a dependency of swift in build.xml (a patch in my quilt stack > adds that in as part of my local configuration). This seems to solve the > 'provider-deef overwriting the log config file' problem for me. > > It might be interesting to make it possible to specify dependencies like > this at build time on the commandline to ant. > > (this is very similar to the unix world way of saying: > > > ./configure --enable-ipv6 --disable-sasl > > make > > in order to determine if you want to have dependencies or not on ipv6 and > sasl (and hence corresponding features) in some software) A similar thing can be done by passing properties to ant and then using them to drive certain parts of the build (or not). Though it looks more like -Denable-ipv6=true. > From iraicu at cs.uchicago.edu Fri Dec 28 11:54:01 2007 From: iraicu at cs.uchicago.edu (Ioan Raicu) Date: Fri, 28 Dec 2007 11:54:01 -0600 Subject: [Swift-devel] build dependencies In-Reply-To: <1198864246.25031.1.camel@blabla.mcs.anl.gov> References: <1198864246.25031.1.camel@blabla.mcs.anl.gov> Message-ID: <47753839.6070901@cs.uchicago.edu> So how can we use the patch? Do we just update Swift and do ant dist? Or what other options should we use to build the provider-deef at the same time we build swift? Thanks, Ioan Mihael Hategan wrote: > On Fri, 2007-12-28 at 10:49 +0000, Ben Clifford wrote: > >> I've been building provider-deef on my machine recently by having it >> listed as a dependency of swift in build.xml (a patch in my quilt stack >> adds that in as part of my local configuration). This seems to solve the >> 'provider-deef overwriting the log config file' problem for me. >> >> It might be interesting to make it possible to specify dependencies like >> this at build time on the commandline to ant. >> >> (this is very similar to the unix world way of saying: >> >> >>> ./configure --enable-ipv6 --disable-sasl >>> make >>> >> in order to determine if you want to have dependencies or not on ipv6 and >> sasl (and hence corresponding features) in some software) >> > > A similar thing can be done by passing properties to ant and then using > them to drive certain parts of the build (or not). Though it looks more > like -Denable-ipv6=true. > > > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > -- ================================================== Ioan Raicu Ph.D. Candidate ================================================== Distributed Systems Laboratory Computer Science Department University of Chicago 1100 E. 58th Street, Ryerson Hall Chicago, IL 60637 ================================================== Email: iraicu at cs.uchicago.edu Web: http://www.cs.uchicago.edu/~iraicu http://dev.globus.org/wiki/Incubator/Falkon http://www.ci.uchicago.edu/wiki/bin/view/VDS/DslCS ================================================== ================================================== From hategan at mcs.anl.gov Fri Dec 28 12:08:41 2007 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Fri, 28 Dec 2007 12:08:41 -0600 Subject: [Swift-devel] build dependencies In-Reply-To: <47753839.6070901@cs.uchicago.edu> References: <1198864246.25031.1.camel@blabla.mcs.anl.gov> <47753839.6070901@cs.uchicago.edu> Message-ID: <1198865321.25524.0.camel@blabla.mcs.anl.gov> There is no patch yet. On Fri, 2007-12-28 at 11:54 -0600, Ioan Raicu wrote: > So how can we use the patch? Do we just update Swift and do ant dist? > Or what other options should we use to build the provider-deef at the > same time we build swift? > Thanks, > Ioan > > Mihael Hategan wrote: > > On Fri, 2007-12-28 at 10:49 +0000, Ben Clifford wrote: > > > >> I've been building provider-deef on my machine recently by having it > >> listed as a dependency of swift in build.xml (a patch in my quilt stack > >> adds that in as part of my local configuration). This seems to solve the > >> 'provider-deef overwriting the log config file' problem for me. > >> > >> It might be interesting to make it possible to specify dependencies like > >> this at build time on the commandline to ant. > >> > >> (this is very similar to the unix world way of saying: > >> > >> > >>> ./configure --enable-ipv6 --disable-sasl > >>> make > >>> > >> in order to determine if you want to have dependencies or not on ipv6 and > >> sasl (and hence corresponding features) in some software) > >> > > > > A similar thing can be done by passing properties to ant and then using > > them to drive certain parts of the build (or not). Though it looks more > > like -Denable-ipv6=true. > > > > > > > > _______________________________________________ > > Swift-devel mailing list > > Swift-devel at ci.uchicago.edu > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > > > From hategan at mcs.anl.gov Fri Dec 28 12:50:06 2007 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Fri, 28 Dec 2007 12:50:06 -0600 Subject: [Swift-devel] build dependencies In-Reply-To: <1198865321.25524.0.camel@blabla.mcs.anl.gov> References: <1198864246.25031.1.camel@blabla.mcs.anl.gov> <47753839.6070901@cs.uchicago.edu> <1198865321.25524.0.camel@blabla.mcs.anl.gov> Message-ID: <1198867806.26481.1.camel@blabla.mcs.anl.gov> As of r1525 there is one. Use it like this: ant -Dwith-provider-deef=true dist provider-deef has to be in cog/modules. On Fri, 2007-12-28 at 12:08 -0600, Mihael Hategan wrote: > There is no patch yet. > > On Fri, 2007-12-28 at 11:54 -0600, Ioan Raicu wrote: > > So how can we use the patch? Do we just update Swift and do ant dist? > > Or what other options should we use to build the provider-deef at the > > same time we build swift? > > Thanks, > > Ioan > > > > Mihael Hategan wrote: > > > On Fri, 2007-12-28 at 10:49 +0000, Ben Clifford wrote: > > > > > >> I've been building provider-deef on my machine recently by having it > > >> listed as a dependency of swift in build.xml (a patch in my quilt stack > > >> adds that in as part of my local configuration). This seems to solve the > > >> 'provider-deef overwriting the log config file' problem for me. > > >> > > >> It might be interesting to make it possible to specify dependencies like > > >> this at build time on the commandline to ant. > > >> > > >> (this is very similar to the unix world way of saying: > > >> > > >> > > >>> ./configure --enable-ipv6 --disable-sasl > > >>> make > > >>> > > >> in order to determine if you want to have dependencies or not on ipv6 and > > >> sasl (and hence corresponding features) in some software) > > >> > > > > > > A similar thing can be done by passing properties to ant and then using > > > them to drive certain parts of the build (or not). Though it looks more > > > like -Denable-ipv6=true. > > > > > > > > > > > > _______________________________________________ > > > Swift-devel mailing list > > > Swift-devel at ci.uchicago.edu > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > > > > > > > > > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel > From iraicu at cs.uchicago.edu Fri Dec 28 12:53:03 2007 From: iraicu at cs.uchicago.edu (Ioan Raicu) Date: Fri, 28 Dec 2007 12:53:03 -0600 Subject: [Swift-devel] build dependencies In-Reply-To: <1198867806.26481.1.camel@blabla.mcs.anl.gov> References: <1198864246.25031.1.camel@blabla.mcs.anl.gov> <47753839.6070901@cs.uchicago.edu> <1198865321.25524.0.camel@blabla.mcs.anl.gov> <1198867806.26481.1.camel@blabla.mcs.anl.gov> Message-ID: <4775460F.9040003@cs.uchicago.edu> Great, thanks! We'll give it a try! Ioan Mihael Hategan wrote: > As of r1525 there is one. > > Use it like this: > > ant -Dwith-provider-deef=true dist > > provider-deef has to be in cog/modules. > > On Fri, 2007-12-28 at 12:08 -0600, Mihael Hategan wrote: > >> There is no patch yet. >> >> On Fri, 2007-12-28 at 11:54 -0600, Ioan Raicu wrote: >> >>> So how can we use the patch? Do we just update Swift and do ant dist? >>> Or what other options should we use to build the provider-deef at the >>> same time we build swift? >>> Thanks, >>> Ioan >>> >>> Mihael Hategan wrote: >>> >>>> On Fri, 2007-12-28 at 10:49 +0000, Ben Clifford wrote: >>>> >>>> >>>>> I've been building provider-deef on my machine recently by having it >>>>> listed as a dependency of swift in build.xml (a patch in my quilt stack >>>>> adds that in as part of my local configuration). This seems to solve the >>>>> 'provider-deef overwriting the log config file' problem for me. >>>>> >>>>> It might be interesting to make it possible to specify dependencies like >>>>> this at build time on the commandline to ant. >>>>> >>>>> (this is very similar to the unix world way of saying: >>>>> >>>>> >>>>> >>>>>> ./configure --enable-ipv6 --disable-sasl >>>>>> make >>>>>> >>>>>> >>>>> in order to determine if you want to have dependencies or not on ipv6 and >>>>> sasl (and hence corresponding features) in some software) >>>>> >>>>> >>>> A similar thing can be done by passing properties to ant and then using >>>> them to drive certain parts of the build (or not). Though it looks more >>>> like -Denable-ipv6=true. >>>> >>>> >>>> >>>> _______________________________________________ >>>> Swift-devel mailing list >>>> Swift-devel at ci.uchicago.edu >>>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel >>>> >>>> >>>> >> _______________________________________________ >> Swift-devel mailing list >> Swift-devel at ci.uchicago.edu >> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel >> >> > > > -- ================================================== Ioan Raicu Ph.D. Candidate ================================================== Distributed Systems Laboratory Computer Science Department University of Chicago 1100 E. 58th Street, Ryerson Hall Chicago, IL 60637 ================================================== Email: iraicu at cs.uchicago.edu Web: http://www.cs.uchicago.edu/~iraicu http://dev.globus.org/wiki/Incubator/Falkon http://www.ci.uchicago.edu/wiki/bin/view/VDS/DslCS ================================================== ==================================================