[Swift-user] Fixed array vs array mapper

[Jonathan Ozik]

Thanks Mihael,

It turns out that using the trunk swift.properties file fixed this issue.

Jonathan

On May 23, 2014, at 2:21 PM, Mihael Hategan <hategan at mcs.anl.gov> wrote:

> Hi Jonathan,
> 
> The  "No 'proxy' provider or alias found" comes up when you are using
> provider staging and you are missing the staging method setting in
> sites.xml (e.g. <profile namespace="swift"
> key="stagingMethod">proxy</profile>).
> 
> Can you try to add that to the sites file and see if you still get the
> failure (or confirm that the setting is already there)?
> 
> Mihael
> 
> On Tue, 2014-05-20 at 22:48 -0500, Jonathan Ozik wrote:
>> I'm having trouble using array mappers for output files. The fixed
>> array mapper seems to work on 0.94.1 but not with trunk. I've put
>> together a minimal case that will hopefully help shed light on the
>> issue. There's a swift script and a simple bash script that creates
>> files. 
>> I've tried this both with 0.94.1 and with the trunk as of May 16.
>> 
>> 
>> Trying the array mapper:
>> With 0.94.1, the execution just hangs at:
>> *** Ready to call sum_obj
>> 
>> 
>> With the trunk version I get the error:
>> *** Ready to call sum_obj
>> 
>> 
>> 
>> 
>> Execution failed:
>> Exception in sh:
>>    Arguments: [cs.sh]
>>    Host: localhost
>>    Directory: minimal_case-run036/jobs/k/sh-kl8esxql
>> exception @ swift-int-staging.k, line: 182
>> Caused by: 
>> exception @ swift-int-staging.k, line: 178
>> Caused by: null
>> Caused by:
>> org.globus.cog.abstraction.impl.common.task.InvalidProviderException:
>> No 'proxy' provider or alias found. Available providers: [cobalt,
>> ssh-cl, gsiftp, coaster, webdav, slurm, dcache, ssh, gt2, condor,
>> http, coaster-persistent, pbs, ftp, lsf, gsiftp-old, local, sge].
>> Aliases: condor <-> condorlocal; cobalt <-> cobaltlocal; gsiftp <->
>> gridftp; pbs <-> pbslocal; gsiftp-old <-> gridftp-old; local <->
>> file; 
>> k:assign @ swift.k, line: 194
>> Caused by: Exception in sh:
>>    Arguments: [cs.sh]
>>    Host: localhost
>>    Directory: minimal_case-run036/jobs/k/sh-kl8esxql
>> exception @ swift-int-staging.k, line: 182
>> Caused by: 
>> exception @ swift-int-staging.k, line: 178
>> Caused by: null
>> Caused by:
>> org.globus.cog.abstraction.impl.common.task.InvalidProviderException:
>> No 'proxy' provider or alias found. Available providers: [cobalt,
>> ssh-cl, gsiftp, coaster, webdav, slurm, dcache, ssh, gt2, condor,
>> http, coaster-persistent, pbs, ftp, lsf, gsiftp-old, local, sge].
>> Aliases: condor <-> condorlocal; cobalt <-> cobaltlocal; gsiftp <->
>> gridftp; pbs <-> pbslocal; gsiftp-old <-> gridftp-old; local <->
>> file; 
>> 
>> 
>> 
>> 
>> If I use the fixed array mapper, the 0.94.1 works but the trunk
>> version gives:
>> *** Ready to call sum_obj
>> 
>> 
>> WARNING: duplicate mapping found:
>> fs (line 18) and fs (line 18) are both used to write to
>> file://localhost/
>> 
>> 
>> Execution failed:
>> Exception in sh:
>>    Arguments: [cs.sh]
>>    Host: localhost
>>    Directory: minimal_case-run037/jobs/y/sh-y7bosxql
>> exception @ swift-int-staging.k, line: 182
>> Caused by: 
>> exception @ swift-int-staging.k, line: 178
>> Caused by: null
>> Caused by:
>> org.globus.cog.abstraction.impl.common.task.InvalidProviderException:
>> No 'proxy' provider or alias found. Available providers: [cobalt,
>> ssh-cl, gsiftp, coaster, webdav, slurm, dcache, ssh, gt2, condor,
>> http, coaster-persistent, pbs, ftp, lsf, gsiftp-old, local, sge].
>> Aliases: condor <-> condorlocal; cobalt <-> cobaltlocal; gsiftp <->
>> gridftp; pbs <-> pbslocal; gsiftp-old <-> gridftp-old; local <->
>> file; 
>> k:assign @ swift.k, line: 194
>> Caused by: Exception in sh:
>>    Arguments: [cs.sh]
>>    Host: localhost
>>    Directory: minimal_case-run037/jobs/y/sh-y7bosxql
>> exception @ swift-int-staging.k, line: 182
>> Caused by: 
>> exception @ swift-int-staging.k, line: 178
>> Caused by: null
>> Caused by:
>> org.globus.cog.abstraction.impl.common.task.InvalidProviderException:
>> No 'proxy' provider or alias found. Available providers: [cobalt,
>> ssh-cl, gsiftp, coaster, webdav, slurm, dcache, ssh, gt2, condor,
>> http, coaster-persistent, pbs, ftp, lsf, gsiftp-old, local, sge].
>> Aliases: condor <-> condorlocal; cobalt <-> cobaltlocal; gsiftp <->
>> gridftp; pbs <-> pbslocal; gsiftp-old <-> gridftp-old; local <->
>> file; 
>> 
>> 
>> 
>> 
>> Any thoughts on what might be going wrong would be greatly
>> appreciated!
>> 
>> 
>> Jonathan
>> 
>> 
>> 
>> 
>> 
>> 
>> 
> 
>