[Swift-devel] ssh-pbs-coasters test case on PADS.

Ketan Maheshwari ketancmaheshwari at gmail.com
Mon Aug 8 19:08:53 CDT 2011


Alberto,

Create an auth.defaults file in your ~/.ssh directory.

Add contents of the following form:

bridled.ci.uchicago.edu.type=key
bridled.ci.uchicago.edu.username=urusername
bridled.ci.uchicago.edu.key=/path/to/your/id_rsa
bridled.ci.uchicago.edu.passphrase=yourpassphrase

The perms on this file should be: 600

Above example is for bridled. you will need to add the machine names you are
connecting from and to each.

About the wrapperlog transfer issue: do you have provider staging on in your
config?


--
Ketan


On Mon, Aug 8, 2011 at 5:14 PM, Alberto Chavez <alberto_chavez at live.com>wrote:

>  Hello,
>
> I am going through the test cases for different providers in the test suite
> directory,
> I am manually running ssh-pbs-coasters test case with the following
> command:
>
> swift 001-catsn-ssh-pbs-coasters.swift -tc.file tc.template.data
> -sites.file sites.template.xml
>
> I am getting the following output:
>
> Swift svn swift-r4861 (swift modified locally) cog-r3183
>
> RunID: 20110808-1703-mz2tcfha
> Progress:  time: Mon, 08 Aug 2011 17:03:49 -0500
> Progress:  time: Mon, 08 Aug 2011 17:03:55 -0500  Selecting site:8
>  Initializing site shared directory:1  Stage in:1
> Progress:  time: Mon, 08 Aug 2011 17:03:59 -0500  Submitted:1 Failed but
> can retry:9
> Failed to transfer wrapper log for job cat-2jvs26ek
> Progress:  time: Mon, 08 Aug 2011 17:04:02 -0500  Stage in:1 Failed but can
> retry:9
> Failed to transfer wrapper log for job cat-uivs26ek
> Failed to transfer wrapper log for job cat-xivs26ek
> Failed to transfer wrapper log for job cat-zivs26ek
> Failed to transfer wrapper log for job cat-4jvs26ek
> Failed to transfer wrapper log for job cat-0jvs26ek
> Failed to transfer wrapper log for job cat-yivs26ek
> Progress:  time: Mon, 08 Aug 2011 17:04:03 -0500  Stage in:1  Submitting:1
> Failed but can retry:8
> Failed to transfer wrapper log for job cat-vivs26ek
> Failed to transfer wrapper log for job cat-1jvs26ek
> Failed to transfer wrapper log for job cat-3jvs26ek
> Progress:  time: Mon, 08 Aug 2011 17:04:04 -0500  Stage in:1  Submitting:1
> Failed but can retry:8
> Progress:  time: Mon, 08 Aug 2011 17:04:07 -0500  Submitting:1  Submitted:1
> Failed but can retry:8
> Failed to transfer wrapper log for job cat-6jvs26ek
> Progress:  time: Mon, 08 Aug 2011 17:04:09 -0500  Stage in:1 Failed but can
> retry:9
> Failed to transfer wrapper log for job cat-8jvs26ek
> Failed to transfer wrapper log for job cat-ajvs26ek
> Failed to transfer wrapper log for job cat-cjvs26ek
> Failed to transfer wrapper log for job cat-ejvs26ek
> Failed to transfer wrapper log for job cat-gjvs26ek
> Failed to transfer wrapper log for job cat-ijvs26ek
> Progress:  time: Mon, 08 Aug 2011 17:04:10 -0500  Stage in:1  Submitting:1
> Failed but can retry:8
> Failed to transfer wrapper log for job cat-kjvs26ek
> Failed to transfer wrapper log for job cat-mjvs26ek
> Progress:  time: Mon, 08 Aug 2011 17:04:11 -0500  Stage in:1 Failed but can
> retry:9
> Failed to transfer wrapper log for job cat-ojvs26ek
> Progress:  time: Mon, 08 Aug 2011 17:04:16 -0500  Submitting:1  Submitted:1
> Failed but can retry:8
> Failed to transfer wrapper log for job cat-qjvs26ek
> Progress:  time: Mon, 08 Aug 2011 17:04:17 -0500  Failed:1 Failed but can
> retry:9
>
> these are the contents of sites.template.xml file:
>
> <config>
> <pool handle="ssh-pbs-coasters">
>   <execution jobmanager="ssh:pbs" provider="coaster" url="
> login.pads.ci.uchicago.edu" />
>   <filesystem provider="ssh" url="login.pads.ci.uchicago.edu" />
>   <profile key="maxtime" namespace="globus">3000</profile>
>   <profile key="jobsPerNode" namespace="globus">8</profile>
>   <profile key="slots" namespace="globus">1</profile>
>   <profile key="nodeGranularity" namespace="globus">1</profile>
>   <profile key="maxNodes" namespace="globus">10</profile>
>   <profile key="queue" namespace="globus">short</profile>
>   <profile key="jobThrottle" namespace="karajan">0.5</profile>
>   <profile key="initialScore" namespace="karajan">10000</profile>
>   <workdirectory>/home/achavez/swiftwork</workdirectory>
> </pool>
> </config>
>
> and this is the swiftscript that I am trying to run:
>
> type file;
>
> app (file o) cat (file i)
> {
>   cat @i stdout=@o;
> }
>
> string t =
> "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789";
> string char[] = @strsplit(t, "");
>
> file out[]<simple_mapper; location=".", prefix="catsn.",suffix=".out">;
> foreach j in [1:@toint(@arg("n","10"))] {
>   file data<"data.txt">;
>   out[j] = cat(data);
> }
>
>
> I am pretty sure the test is failing, and I guess that it's something wrong
> on my side, I just don't know what that is, so any help figuring out what
> I'm doing wrong will be strongly appreciated.
>
> Everytime I run the test, a dialog box pops up and asks me for my username
> to login on pads, and then it asks for my password,
> then it shows the messages:
> Failed to transfer wrapper log for job XXXXX
> and then asks three more times for my username and password.
>
> Thank you,
>
> Alberto.
>
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>
>


-- 
Ketan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20110808/ac19b3a5/attachment.html>


More information about the Swift-devel mailing list