From aespinosa at cs.uchicago.edu Mon Feb 7 14:31:11 2011 From: aespinosa at cs.uchicago.edu (Allan Espinosa) Date: Mon, 7 Feb 2011 14:31:11 -0600 Subject: [Swift-user] output as an array of files Message-ID: I'm doing this type of workflow to guarantee "that common" input files in an app() function gets scheduled on a single site resource. The workflow below does not run the echo() app. With concurrent_mapper, files[] is undefined so it does not resolve to anything when invoked by @filenames(). I switched to array_mapper for explicit output file definitions but it swift looks like it's waiting for something type file; app(file out[]) echo(string s[]) { echo s @filenames(out) stdout=@filenames(out); } app(file out) single(string s[]) { echo s stdout=@filename(out); } file files[] ; files = echo(["Hello world", "foo bar"]); log entry: 2011-02-07 14:27:36,947-0600 INFO unknown RUNID id=run:20110207-1427-stmicsda 2011-02-07 14:27:36,993-0600 INFO CreateArray CREATEARRAY START array=dataset:20110207-1427-75pv6fs7:720000000013 2011-02-07 14:27:36,994-0600 INFO CreateArray CREATEARRAY START array=dataset:20110207-1427-75pv6fs7:720000000014 2011-02-07 14:27:36,995-0600 INFO CreateArray CREATEARRAY START array=dataset:20110207-1427-75pv6fs7:720000000015 2011-02-07 14:27:36,996-0600 INFO CreateArray CREATEARRAY MEMBER array=dataset:20110207-1427-75pv6fs7:720000000013 index=0 member=dataset:20110207-1427-75pv6fs7:720000000003 2011-02-07 14:27:36,996-0600 INFO CreateArray CREATEARRAY MEMBER array=dataset:20110207-1427-75pv6fs7:720000000013 index=1 member=dataset:20110207-1427-75pv6fs7:720000000007 2011-02-07 14:27:36,996-0600 INFO CreateArray CREATEARRAY COMPLETED array=dataset:20110207-1427-75pv6fs7:720000000013 2011-02-07 14:27:36,996-0600 INFO CreateArray CREATEARRAY MEMBER array=dataset:20110207-1427-75pv6fs7:720000000014 index=0 member=dataset:20110207-1427-75pv6fs7:720000000008 2011-02-07 14:27:36,996-0600 INFO CreateArray CREATEARRAY MEMBER array=dataset:20110207-1427-75pv6fs7:720000000015 index=0 member=dataset:20110207-1427-75pv6fs7:720000000001 2011-02-07 14:27:36,996-0600 INFO CreateArray CREATEARRAY MEMBER array=dataset:20110207-1427-75pv6fs7:720000000014 index=1 member=dataset:20110207-1427-75pv6fs7:720000000005 2011-02-07 14:27:36,996-0600 INFO CreateArray CREATEARRAY MEMBER array=dataset:20110207-1427-75pv6fs7:720000000015 index=1 member=dataset:20110207-1427-75pv6fs7:720000000002 2011-02-07 14:27:36,996-0600 INFO CreateArray CREATEARRAY MEMBER array=dataset:20110207-1427-75pv6fs7:720000000015 index=2 member=dataset:20110207-1427-75pv6fs7:720000000006 2011-02-07 14:27:36,996-0600 INFO CreateArray CREATEARRAY COMPLETED array=dataset:20110207-1427-75pv6fs7:720000000015 2011-02-07 14:27:36,997-0600 INFO CreateArray CREATEARRAY MEMBER array=dataset:20110207-1427-75pv6fs7:720000000014 index=2 member=dataset:20110207-1427-75pv6fs7:720000000004 2011-02-07 14:27:36,997-0600 INFO CreateArray CREATEARRAY COMPLETED array=dataset:20110207-1427-75pv6fs7:720000000014 2011-02-07 14:27:36,998-0600 DEBUG echo PROCEDURE line=3 thread=0-2 name=echo jstack trace (no deadlocks found): 2011-02-07 14:28:29 Full thread dump Java HotSpot(TM) 64-Bit Server VM (17.0-b16 mixed mode): "Attach Listener" daemon prio=10 tid=0x0000000047afa000 nid=0x1e52 waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE Locked ownable synchronizers: - None "Progress ticker" daemon prio=10 tid=0x0000000047af8000 nid=0x1e0e waiting on condition [0x0000000041b11000] java.lang.Thread.State: TIMED_WAITING (sleeping) at java.lang.Thread.sleep(Native Method) at org.griphyn.vdl.karajan.lib.RuntimeStats$ProgressTicker.run(RuntimeStats.java:137) Locked ownable synchronizers: - None "Restart Log Sync" daemon prio=10 tid=0x0000000047b03800 nid=0x1e0d in Object.wait() [0x00000000425b5000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00002aab601926f8> (a org.globus.cog.karajan.workflow.nodes.restartLog.SyncThread) at java.lang.Object.wait(Object.java:485) at org.globus.cog.karajan.workflow.nodes.restartLog.SyncThread.run(SyncThread.java:45) - locked <0x00002aab601926f8> (a org.globus.cog.karajan.workflow.nodes.restartLog.SyncThread) Locked ownable synchronizers: - None "Overloaded Host Monitor" daemon prio=10 tid=0x0000000047b48800 nid=0x1e0c waiting on condition [0x00000000424b4000] java.lang.Thread.State: TIMED_WAITING (sleeping) at java.lang.Thread.sleep(Native Method) at org.globus.cog.karajan.scheduler.OverloadedHostMonitor.run(OverloadedHostMonitor.java:47) Locked ownable synchronizers: - None "Timer-0" daemon prio=10 tid=0x0000000047b4a800 nid=0x1e0b in Object.wait() [0x00000000423b3000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00002aab5e500ee8> (a java.util.TaskQueue) at java.util.TimerThread.mainLoop(Timer.java:509) - locked <0x00002aab5e500ee8> (a java.util.TaskQueue) at java.util.TimerThread.run(Timer.java:462) Locked ownable synchronizers: - None "NBS0" daemon prio=10 tid=0x0000000047b88800 nid=0x1e0a waiting on condition [0x00000000422b2000] java.lang.Thread.State: TIMED_WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x00002aab5e4477f8> (a java.util.concurrent.SynchronousQueue$TransferStack) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) at java.lang.Thread.run(Thread.java:619) Locked ownable synchronizers: - None "pool-1-thread-4" prio=10 tid=0x0000000047a87000 nid=0x1e09 in Object.wait() [0x00000000421b1000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00002aab615a06b0> (a edu.emory.mathcs.backport.java.util.concurrent.LinkedBlockingQueue$SerializableLock) at java.lang.Object.wait(Object.java:485) at edu.emory.mathcs.backport.java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:315) - locked <0x00002aab615a06b0> (a edu.emory.mathcs.backport.java.util.concurrent.LinkedBlockingQueue$SerializableLock) at edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470) at edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:667) at java.lang.Thread.run(Thread.java:619) Locked ownable synchronizers: - None "pool-1-thread-3" prio=10 tid=0x0000000047902800 nid=0x1e08 in Object.wait() [0x00000000420b0000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00002aab615a06b0> (a edu.emory.mathcs.backport.java.util.concurrent.LinkedBlockingQueue$SerializableLock) at java.lang.Object.wait(Object.java:485) at edu.emory.mathcs.backport.java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:315) - locked <0x00002aab615a06b0> (a edu.emory.mathcs.backport.java.util.concurrent.LinkedBlockingQueue$SerializableLock) at edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470) at edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:667) at java.lang.Thread.run(Thread.java:619) Locked ownable synchronizers: - None "pool-1-thread-2" prio=10 tid=0x00000000481e0000 nid=0x1e07 in Object.wait() [0x0000000041faf000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00002aab615a06b0> (a edu.emory.mathcs.backport.java.util.concurrent.LinkedBlockingQueue$SerializableLock) at java.lang.Object.wait(Object.java:485) at edu.emory.mathcs.backport.java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:315) - locked <0x00002aab615a06b0> (a edu.emory.mathcs.backport.java.util.concurrent.LinkedBlockingQueue$SerializableLock) at edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470) at edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:667) at java.lang.Thread.run(Thread.java:619) Locked ownable synchronizers: - None "pool-1-thread-1" prio=10 tid=0x0000000047e6c000 nid=0x1e06 in Object.wait() [0x0000000040d25000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00002aab615a06b0> (a edu.emory.mathcs.backport.java.util.concurrent.LinkedBlockingQueue$SerializableLock) at java.lang.Object.wait(Object.java:485) at edu.emory.mathcs.backport.java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:315) - locked <0x00002aab615a06b0> (a edu.emory.mathcs.backport.java.util.concurrent.LinkedBlockingQueue$SerializableLock) at edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470) at edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:667) at java.lang.Thread.run(Thread.java:619) Locked ownable synchronizers: - None "Low Memory Detector" daemon prio=10 tid=0x000000004775a000 nid=0x1e01 runnable [0x0000000000000000] java.lang.Thread.State: RUNNABLE Locked ownable synchronizers: - None "CompilerThread1" daemon prio=10 tid=0x0000000047758000 nid=0x1e00 waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE Locked ownable synchronizers: - None "CompilerThread0" daemon prio=10 tid=0x0000000047752800 nid=0x1dff waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE Locked ownable synchronizers: - None "Signal Dispatcher" daemon prio=10 tid=0x0000000047750000 nid=0x1dfe runnable [0x0000000000000000] java.lang.Thread.State: RUNNABLE Locked ownable synchronizers: - None "Finalizer" daemon prio=10 tid=0x000000004772b800 nid=0x1dfd in Object.wait() [0x000000004129b000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00002aab615e8440> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118) - locked <0x00002aab615e8440> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134) at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159) Locked ownable synchronizers: - None "Reference Handler" daemon prio=10 tid=0x0000000047729800 nid=0x1dfc in Object.wait() [0x0000000041014000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00002aab615a01b0> (a java.lang.ref.Reference$Lock) at java.lang.Object.wait(Object.java:485) at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116) - locked <0x00002aab615a01b0> (a java.lang.ref.Reference$Lock) Locked ownable synchronizers: - None "main" prio=10 tid=0x00000000476c8000 nid=0x1df6 in Object.wait() [0x000000004119a000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00002aab615e8520> (a org.griphyn.vdl.karajan.VDL2ExecutionContext) at java.lang.Object.wait(Object.java:485) at org.globus.cog.karajan.workflow.ExecutionContext.waitFor(ExecutionContext.java:261) - locked <0x00002aab615e8520> (a org.griphyn.vdl.karajan.VDL2ExecutionContext) at org.griphyn.vdl.karajan.Loader.main(Loader.java:197) Locked ownable synchronizers: - None "VM Thread" prio=10 tid=0x0000000047725000 nid=0x1dfb runnable "GC task thread#0 (ParallelGC)" prio=10 tid=0x00000000476db000 nid=0x1df7 runnable "GC task thread#1 (ParallelGC)" prio=10 tid=0x00000000476dd000 nid=0x1df8 runnable "GC task thread#2 (ParallelGC)" prio=10 tid=0x00000000476de800 nid=0x1df9 runnable "GC task thread#3 (ParallelGC)" prio=10 tid=0x00000000476e0800 nid=0x1dfa runnable "VM Periodic Task Thread" prio=10 tid=0x0000000047765000 nid=0x1e02 waiting on condition JNI global references: 1407 -- Allan M. Espinosa PhD student, Computer Science University of Chicago From aespinosa at cs.uchicago.edu Wed Feb 9 16:31:24 2011 From: aespinosa at cs.uchicago.edu (Allan Espinosa) Date: Wed, 9 Feb 2011 16:31:24 -0600 Subject: [Swift-user] when is a job sent the clustering queue Message-ID: Does this occur before or after the stagein of the input files? Thanks, -Allan -- Allan M. Espinosa PhD student, Computer Science University of Chicago From aespinosa at cs.uchicago.edu Sat Feb 12 15:46:09 2011 From: aespinosa at cs.uchicago.edu (Allan Espinosa) Date: Sat, 12 Feb 2011 15:46:09 -0600 Subject: [Swift-user] fixed_array_mapper versus array_mapper on output Message-ID: For an array output data structure, the two mapper behave differently type file; app(file o[]) split(file i){ split "-l" 1 @filename(i) "seqout."; } /*file out[] ;*/ file out[] ; // Works file input <"seq.in">; out = split(input); -- Allan M. Espinosa PhD student, Computer Science University of Chicago From dwd at fnal.gov Wed Feb 16 16:54:15 2011 From: dwd at fnal.gov (Dave Dykstra) Date: Wed, 16 Feb 2011 16:54:15 -0600 Subject: [Swift-user] "Could not find valid host" on tutorial examples Message-ID: <20110216225415.GA90948@fnal.gov> I have been getting the following error on both the tutorial 3.6.1 regexp mapper and 3.6.2 fixed array mapper example: Swift svn swift-r3826 cog-r2988 RunID: 20110216-1644-pddxkqn3 Progress: Execution failed: Could not find any valid host for task "Task(type=UNKNOWN, identity=urn:cog-1297896282664)" with constraints {tr=wc, filenames=[Ljava.lang.String;@3465b738, trfqn=wc, filecache=org.griphyn.vdl.karajan.lib.cache.CacheMapAdapter at 1dfd868} For completeness, here's the fixedarray.swift that the above error was generated from, as taken directly from swift-0.91/examples/swift: type messagefile {} type countfile {} (countfile t) countwords (messagefile f) { app { wc "-w" @filename(f) stdout=@filename(t); } } string inputNames = "one.txt two.txt three.txt"; string outputNames = "one.count two.count three.count"; messagefile inputfiles[] ; countfile outputfiles[] ; outputfiles[0] = countwords(inputfiles[0]); outputfiles[1] = countwords(inputfiles[1]); outputfiles[2] = countwords(inputfiles[2]); At this stage in my experience with swift I have no idea what to do about it, can anyone here help? - Dave From dk0966 at cs.ship.edu Wed Feb 16 19:13:26 2011 From: dk0966 at cs.ship.edu (David Kelly) Date: Wed, 16 Feb 2011 20:13:26 -0500 Subject: [Swift-user] Swift Website Wishlist Message-ID: Hello, In a conference call today we started discussing some ideas on how we could improve the Swift website. What could we add that would make it more useful? If you have any ideas, please add them to the website wishlist at http://www.ci.uchicago.edu/wiki/bin/view/SWFT/WebsiteWishlist Regards, David -------------- next part -------------- An HTML attachment was scrubbed... URL: From dk0966 at cs.ship.edu Wed Feb 16 23:58:53 2011 From: dk0966 at cs.ship.edu (David Kelly) Date: Thu, 17 Feb 2011 00:58:53 -0500 Subject: [Swift-user] "Could not find valid host" on tutorial examples In-Reply-To: <20110216225415.GA90948@fnal.gov> References: <20110216225415.GA90948@fnal.gov> Message-ID: Hi Dave, Looks like you stumbled across a bug in the tutorials. I submitted fixes for these at one point, but it seems it somehow has been reintroduced in 0.91. Here is what you can do to get the tutorial scripts working. Add the following line to swift-0.91/etc/tc.data: localhost wc /usr/bin/wc INSTALLED INTEL32::LINUX null Create the required input files that the script uses (one.txt, two.txt, three.txt) in the examples directory. You can use the ones I have attached. Another problem you may run into is with a typo in regexp.script. The corrected version is attached. Hope this helps! Let me know if you run into any other issues with the tutorial scripts. Regards, David On Wed, Feb 16, 2011 at 5:54 PM, Dave Dykstra wrote: > I have been getting the following error on both the tutorial 3.6.1 regexp > mapper and 3.6.2 fixed array mapper example: > > Swift svn swift-r3826 cog-r2988 > > RunID: 20110216-1644-pddxkqn3 > Progress: > Execution failed: > Could not find any valid host for task "Task(type=UNKNOWN, > identity=urn:cog-1297896282664)" with constraints {tr=wc, > filenames=[Ljava.lang.String;@3465b738, trfqn=wc, > filecache=org.griphyn.vdl.karajan.lib.cache.CacheMapAdapter at 1dfd868} > > For completeness, here's the fixedarray.swift that the above error was > generated from, as taken directly from swift-0.91/examples/swift: > > type messagefile {} > type countfile {} > > (countfile t) countwords (messagefile f) { > app { > wc "-w" @filename(f) stdout=@filename(t); > } > } > > string inputNames = "one.txt two.txt three.txt"; > string outputNames = "one.count two.count three.count"; > > messagefile inputfiles[] ; > countfile outputfiles[] ; > > outputfiles[0] = countwords(inputfiles[0]); > outputfiles[1] = countwords(inputfiles[1]); > outputfiles[2] = countwords(inputfiles[2]); > > At this stage in my experience with swift I have no idea what to do > about it, can anyone here help? > > - Dave > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-user > -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- one -------------- next part -------------- A non-text attachment was scrubbed... Name: tc.data Type: application/octet-stream Size: 930 bytes Desc: not available URL: -------------- next part -------------- two -------------- next part -------------- three -------------- next part -------------- A non-text attachment was scrubbed... Name: regexp.swift Type: application/octet-stream Size: 303 bytes Desc: not available URL: From iraicu at cs.iit.edu Thu Feb 17 07:11:13 2011 From: iraicu at cs.iit.edu (Ioan Raicu) Date: Thu, 17 Feb 2011 07:11:13 -0600 Subject: [Swift-user] Research Assistant positions in Computer Science (Distributed Systems) at Illinois Institute of Technology in Chicago Illinois USA Message-ID: <4D5D1E71.5090906@cs.iit.edu> Research Assistantship Opportunities There are multiple opportunities for funded work opportunities in the Data-Intensive Distributed Systems Laboratory (DataSys), starting in the summer of 2011; funding is available for 5 years, but is contingent on good progress towards a PhD degree. If you think you meet the admission requirements to the PhD program in Computer Science, and have a desire to pursue research in distributed systems working on real problems on some of the worlds largest systems (e.g. IBM BlueGene/P , Cray XT5 , Sun Constelation , IBM Blue Waters , TeraGrid , Magellan , Amazon , current projects at DataSys ), please send your resume/CV and a personal statement to Ioan Raicu at iraicu at cs.iit.edu . Evaluation of applications will start on March 1st, 2011, and will continue until the positions are filled. Please make sure to use the following prefix to your email subject "[DATASYS RA]". Also, in your email body, please include the following information (even if it is redundant from the resume/CV): * Name * Research interests (<30 words) * MS Degree (if applicable), major, GPA, dates, university name, university city, university country * BS Degree, major, GPA, dates, university name, university city, university country * GRE Scores * TOEFL Scores (if applicable) * Coursework (professor's name, dates taken, grade received): o Operating Systems o Networking o Architecture o Distributed Systems o Programming Languages o Compilers o Data-Structures o Algorithms * Programming Languages (name, years of experience, numbers of line of code in the largest project worked on in each language) * Publications (posters, workshop papers, conference papers, journal papers) * Research experience: institution, mentor name, and project title * Relevant work experience (institution, position title, dates) * Names, positions, and affiliations of people providing recommendation letters * How did you hear about this position? For more information about these positions, please see http://datasys.cs.iit.edu/jobs/index.html, or contact Ioan Raicu at iraicu at cs.iit.edu. DataSys The DataSys Lab is a research lab in the CS department at IIT, being lead by Dr. Ioan Raicu. The DataSys Lab conducts research in various areas of distributed systems with an emphasis on designing, implementing, and evaluating systems, protocols, and middleware with the goal of supporting applications at extreme scales. The lab's mission is to investigate challenging, high-impact research projects to support both compute and data-intensive distributed computing on a variety of systems, from many-core systems, clusters, grids, clouds, and supercomputers. The DataSys Lab has strong ties with the Scalable Computing Software Laboratory at IIT, and the Distributed Systems Laboratory at University of Chicago and Argonne National Laboratory . Computer Science at IIT The Computer Science (CS) department at Illinois Institute of Technology (IIT) offers B.S., M.S., and Ph.D. degrees in computer science and has research strengths in distributed systems, information retrieval, computer networking, intelligent information systems and algorithms. IIT is located within 10 minutes of downtown Chicago, and is a dynamic and innovative institution. The department has strong connections to Fermi and Argonne National Laboratories , and to local industry. An interesting short video clip about IIT can be found here . The CS graduate program at IIT ranks 82 out of 126 in the latest CRA Computer Science Graduate Program Rankings. -- ================================================================= Ioan Raicu, Ph.D. Assistant Professor, Illinois Institute of Technology (IIT) Guest Research Faculty, Argonne National Laboratory (ANL) ================================================================= Data-Intensive Distributed Systems Laboratory, CS/IIT Distributed Systems Laboratory, MCS/ANL ================================================================= Cel: 1-847-722-0876 Office: 1-312-567-5704 Email: iraicu at cs.iit.edu Web: http://www.cs.iit.edu/~iraicu/ Web: http://datasys.cs.iit.edu/ ================================================================= ================================================================= -------------- next part -------------- An HTML attachment was scrubbed... URL: From dwd at fnal.gov Thu Feb 17 08:04:34 2011 From: dwd at fnal.gov (Dave Dykstra) Date: Thu, 17 Feb 2011 08:04:34 -0600 Subject: [Swift-user] "Could not find valid host" on tutorial examples In-Reply-To: References: <20110216225415.GA90948@fnal.gov> Message-ID: <20110217140434.GA98633@fnal.gov> David, Thanks. I probably should have been able to figure that out because I do now recall doing instructions last week to add 'tr' that way, but I had forgotten about it and anyway didn't really know what the consequences were for not adding it. - Dave On Thu, Feb 17, 2011 at 12:58:53AM -0500, David Kelly wrote: > Hi Dave, > > Looks like you stumbled across a bug in the tutorials. I submitted fixes for > these at one point, but it seems it somehow has been reintroduced in 0.91. > Here is what you can do to get the tutorial scripts working. > > Add the following line to swift-0.91/etc/tc.data: > localhost wc /usr/bin/wc INSTALLED INTEL32::LINUX null > > Create the required input files that the script uses (one.txt, two.txt, > three.txt) in the examples directory. You can use the ones I have attached. > > Another problem you may run into is with a typo in regexp.script. The > corrected version is attached. > > Hope this helps! Let me know if you run into any other issues with the > tutorial scripts. > > Regards, > David > > > On Wed, Feb 16, 2011 at 5:54 PM, Dave Dykstra wrote: > > > I have been getting the following error on both the tutorial 3.6.1 regexp > > mapper and 3.6.2 fixed array mapper example: > > > > Swift svn swift-r3826 cog-r2988 > > > > RunID: 20110216-1644-pddxkqn3 > > Progress: > > Execution failed: > > Could not find any valid host for task "Task(type=UNKNOWN, > > identity=urn:cog-1297896282664)" with constraints {tr=wc, > > filenames=[Ljava.lang.String;@3465b738, trfqn=wc, > > filecache=org.griphyn.vdl.karajan.lib.cache.CacheMapAdapter at 1dfd868} > > > > For completeness, here's the fixedarray.swift that the above error was > > generated from, as taken directly from swift-0.91/examples/swift: > > > > type messagefile {} > > type countfile {} > > > > (countfile t) countwords (messagefile f) { > > app { > > wc "-w" @filename(f) stdout=@filename(t); > > } > > } > > > > string inputNames = "one.txt two.txt three.txt"; > > string outputNames = "one.count two.count three.count"; > > > > messagefile inputfiles[] ; > > countfile outputfiles[] ; > > > > outputfiles[0] = countwords(inputfiles[0]); > > outputfiles[1] = countwords(inputfiles[1]); > > outputfiles[2] = countwords(inputfiles[2]); > > > > At this stage in my experience with swift I have no idea what to do > > about it, can anyone here help? > > > > - Dave > > _______________________________________________ > > Swift-user mailing list > > Swift-user at ci.uchicago.edu > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-user > > > one > two > three