[Swift-devel] ssh-pbs-coasters test case on PADS.
Ketan Maheshwari
ketancmaheshwari at gmail.com
Mon Aug 8 19:08:53 CDT 2011
Alberto,
Create an auth.defaults file in your ~/.ssh directory.
Add contents of the following form:
bridled.ci.uchicago.edu.type=key
bridled.ci.uchicago.edu.username=urusername
bridled.ci.uchicago.edu.key=/path/to/your/id_rsa
bridled.ci.uchicago.edu.passphrase=yourpassphrase
The perms on this file should be: 600
Above example is for bridled. you will need to add the machine names you are
connecting from and to each.
About the wrapperlog transfer issue: do you have provider staging on in your
config?
--
Ketan
On Mon, Aug 8, 2011 at 5:14 PM, Alberto Chavez <alberto_chavez at live.com>wrote:
> Hello,
>
> I am going through the test cases for different providers in the test suite
> directory,
> I am manually running ssh-pbs-coasters test case with the following
> command:
>
> swift 001-catsn-ssh-pbs-coasters.swift -tc.file tc.template.data
> -sites.file sites.template.xml
>
> I am getting the following output:
>
> Swift svn swift-r4861 (swift modified locally) cog-r3183
>
> RunID: 20110808-1703-mz2tcfha
> Progress: time: Mon, 08 Aug 2011 17:03:49 -0500
> Progress: time: Mon, 08 Aug 2011 17:03:55 -0500 Selecting site:8
> Initializing site shared directory:1 Stage in:1
> Progress: time: Mon, 08 Aug 2011 17:03:59 -0500 Submitted:1 Failed but
> can retry:9
> Failed to transfer wrapper log for job cat-2jvs26ek
> Progress: time: Mon, 08 Aug 2011 17:04:02 -0500 Stage in:1 Failed but can
> retry:9
> Failed to transfer wrapper log for job cat-uivs26ek
> Failed to transfer wrapper log for job cat-xivs26ek
> Failed to transfer wrapper log for job cat-zivs26ek
> Failed to transfer wrapper log for job cat-4jvs26ek
> Failed to transfer wrapper log for job cat-0jvs26ek
> Failed to transfer wrapper log for job cat-yivs26ek
> Progress: time: Mon, 08 Aug 2011 17:04:03 -0500 Stage in:1 Submitting:1
> Failed but can retry:8
> Failed to transfer wrapper log for job cat-vivs26ek
> Failed to transfer wrapper log for job cat-1jvs26ek
> Failed to transfer wrapper log for job cat-3jvs26ek
> Progress: time: Mon, 08 Aug 2011 17:04:04 -0500 Stage in:1 Submitting:1
> Failed but can retry:8
> Progress: time: Mon, 08 Aug 2011 17:04:07 -0500 Submitting:1 Submitted:1
> Failed but can retry:8
> Failed to transfer wrapper log for job cat-6jvs26ek
> Progress: time: Mon, 08 Aug 2011 17:04:09 -0500 Stage in:1 Failed but can
> retry:9
> Failed to transfer wrapper log for job cat-8jvs26ek
> Failed to transfer wrapper log for job cat-ajvs26ek
> Failed to transfer wrapper log for job cat-cjvs26ek
> Failed to transfer wrapper log for job cat-ejvs26ek
> Failed to transfer wrapper log for job cat-gjvs26ek
> Failed to transfer wrapper log for job cat-ijvs26ek
> Progress: time: Mon, 08 Aug 2011 17:04:10 -0500 Stage in:1 Submitting:1
> Failed but can retry:8
> Failed to transfer wrapper log for job cat-kjvs26ek
> Failed to transfer wrapper log for job cat-mjvs26ek
> Progress: time: Mon, 08 Aug 2011 17:04:11 -0500 Stage in:1 Failed but can
> retry:9
> Failed to transfer wrapper log for job cat-ojvs26ek
> Progress: time: Mon, 08 Aug 2011 17:04:16 -0500 Submitting:1 Submitted:1
> Failed but can retry:8
> Failed to transfer wrapper log for job cat-qjvs26ek
> Progress: time: Mon, 08 Aug 2011 17:04:17 -0500 Failed:1 Failed but can
> retry:9
>
> these are the contents of sites.template.xml file:
>
> <config>
> <pool handle="ssh-pbs-coasters">
> <execution jobmanager="ssh:pbs" provider="coaster" url="
> login.pads.ci.uchicago.edu" />
> <filesystem provider="ssh" url="login.pads.ci.uchicago.edu" />
> <profile key="maxtime" namespace="globus">3000</profile>
> <profile key="jobsPerNode" namespace="globus">8</profile>
> <profile key="slots" namespace="globus">1</profile>
> <profile key="nodeGranularity" namespace="globus">1</profile>
> <profile key="maxNodes" namespace="globus">10</profile>
> <profile key="queue" namespace="globus">short</profile>
> <profile key="jobThrottle" namespace="karajan">0.5</profile>
> <profile key="initialScore" namespace="karajan">10000</profile>
> <workdirectory>/home/achavez/swiftwork</workdirectory>
> </pool>
> </config>
>
> and this is the swiftscript that I am trying to run:
>
> type file;
>
> app (file o) cat (file i)
> {
> cat @i stdout=@o;
> }
>
> string t =
> "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789";
> string char[] = @strsplit(t, "");
>
> file out[]<simple_mapper; location=".", prefix="catsn.",suffix=".out">;
> foreach j in [1:@toint(@arg("n","10"))] {
> file data<"data.txt">;
> out[j] = cat(data);
> }
>
>
> I am pretty sure the test is failing, and I guess that it's something wrong
> on my side, I just don't know what that is, so any help figuring out what
> I'm doing wrong will be strongly appreciated.
>
> Everytime I run the test, a dialog box pops up and asks me for my username
> to login on pads, and then it asks for my password,
> then it shows the messages:
> Failed to transfer wrapper log for job XXXXX
> and then asks three more times for my username and password.
>
> Thank you,
>
> Alberto.
>
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>
>
--
Ketan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20110808/ac19b3a5/attachment.html>
More information about the Swift-devel
mailing list