[Swift-user] Fixed array vs array mapper

[Mihael Hategan]

Hi Jonathan,

The  "No 'proxy' provider or alias found" comes up when you are using
provider staging and you are missing the staging method setting in
sites.xml (e.g. <profile namespace="swift"
key="stagingMethod">proxy</profile>).

Can you try to add that to the sites file and see if you still get the
failure (or confirm that the setting is already there)?

Mihael

On Tue, 2014-05-20 at 22:48 -0500, Jonathan Ozik wrote:
> I'm having trouble using array mappers for output files. The fixed
> array mapper seems to work on 0.94.1 but not with trunk. I've put
> together a minimal case that will hopefully help shed light on the
> issue. There's a swift script and a simple bash script that creates
> files. 
> I've tried this both with 0.94.1 and with the trunk as of May 16.
> 
> 
> Trying the array mapper:
> With 0.94.1, the execution just hangs at:
> *** Ready to call sum_obj
> 
> 
> With the trunk version I get the error:
> *** Ready to call sum_obj
> 
> 
> 
> 
> Execution failed:
> Exception in sh:
>     Arguments: [cs.sh]
>     Host: localhost
>     Directory: minimal_case-run036/jobs/k/sh-kl8esxql
> exception @ swift-int-staging.k, line: 182
> Caused by: 
> exception @ swift-int-staging.k, line: 178
> Caused by: null
> Caused by:
> org.globus.cog.abstraction.impl.common.task.InvalidProviderException:
> No 'proxy' provider or alias found. Available providers: [cobalt,
> ssh-cl, gsiftp, coaster, webdav, slurm, dcache, ssh, gt2, condor,
> http, coaster-persistent, pbs, ftp, lsf, gsiftp-old, local, sge].
> Aliases: condor <-> condorlocal; cobalt <-> cobaltlocal; gsiftp <->
> gridftp; pbs <-> pbslocal; gsiftp-old <-> gridftp-old; local <->
> file; 
> k:assign @ swift.k, line: 194
> Caused by: Exception in sh:
>     Arguments: [cs.sh]
>     Host: localhost
>     Directory: minimal_case-run036/jobs/k/sh-kl8esxql
> exception @ swift-int-staging.k, line: 182
> Caused by: 
> exception @ swift-int-staging.k, line: 178
> Caused by: null
> Caused by:
> org.globus.cog.abstraction.impl.common.task.InvalidProviderException:
> No 'proxy' provider or alias found. Available providers: [cobalt,
> ssh-cl, gsiftp, coaster, webdav, slurm, dcache, ssh, gt2, condor,
> http, coaster-persistent, pbs, ftp, lsf, gsiftp-old, local, sge].
> Aliases: condor <-> condorlocal; cobalt <-> cobaltlocal; gsiftp <->
> gridftp; pbs <-> pbslocal; gsiftp-old <-> gridftp-old; local <->
> file; 
> 
> 
> 
> 
> If I use the fixed array mapper, the 0.94.1 works but the trunk
> version gives:
> *** Ready to call sum_obj
> 
> 
> WARNING: duplicate mapping found:
> fs (line 18) and fs (line 18) are both used to write to
> file://localhost/
> 
> 
> Execution failed:
> Exception in sh:
>     Arguments: [cs.sh]
>     Host: localhost
>     Directory: minimal_case-run037/jobs/y/sh-y7bosxql
> exception @ swift-int-staging.k, line: 182
> Caused by: 
> exception @ swift-int-staging.k, line: 178
> Caused by: null
> Caused by:
> org.globus.cog.abstraction.impl.common.task.InvalidProviderException:
> No 'proxy' provider or alias found. Available providers: [cobalt,
> ssh-cl, gsiftp, coaster, webdav, slurm, dcache, ssh, gt2, condor,
> http, coaster-persistent, pbs, ftp, lsf, gsiftp-old, local, sge].
> Aliases: condor <-> condorlocal; cobalt <-> cobaltlocal; gsiftp <->
> gridftp; pbs <-> pbslocal; gsiftp-old <-> gridftp-old; local <->
> file; 
> k:assign @ swift.k, line: 194
> Caused by: Exception in sh:
>     Arguments: [cs.sh]
>     Host: localhost
>     Directory: minimal_case-run037/jobs/y/sh-y7bosxql
> exception @ swift-int-staging.k, line: 182
> Caused by: 
> exception @ swift-int-staging.k, line: 178
> Caused by: null
> Caused by:
> org.globus.cog.abstraction.impl.common.task.InvalidProviderException:
> No 'proxy' provider or alias found. Available providers: [cobalt,
> ssh-cl, gsiftp, coaster, webdav, slurm, dcache, ssh, gt2, condor,
> http, coaster-persistent, pbs, ftp, lsf, gsiftp-old, local, sge].
> Aliases: condor <-> condorlocal; cobalt <-> cobaltlocal; gsiftp <->
> gridftp; pbs <-> pbslocal; gsiftp-old <-> gridftp-old; local <->
> file; 
> 
> 
> 
> 
> Any thoughts on what might be going wrong would be greatly
> appreciated!
> 
> 
> Jonathan
> 
> 
> 
> 
> 
> 
>