[Swift-user] Fixed array vs array mapper

Jonathan Ozik jozik at uchicago.edu
Tue May 20 22:48:54 CDT 2014


I'm having trouble using array mappers for output files. The fixed array mapper seems to work on 0.94.1 but not with trunk. I've put together a minimal case that will hopefully help shed light on the issue. There's a swift script and a simple bash script that creates files.
I've tried this both with 0.94.1 and with the trunk as of May 16.

Trying the array mapper:
With 0.94.1, the execution just hangs at:
*** Ready to call sum_obj

With the trunk version I get the error:
*** Ready to call sum_obj


Execution failed:
Exception in sh:
    Arguments: [cs.sh]
    Host: localhost
    Directory: minimal_case-run036/jobs/k/sh-kl8esxql
	exception @ swift-int-staging.k, line: 182
Caused by: 
	exception @ swift-int-staging.k, line: 178
Caused by: null
Caused by: org.globus.cog.abstraction.impl.common.task.InvalidProviderException: No 'proxy' provider or alias found. Available providers: [cobalt, ssh-cl, gsiftp, coaster, webdav, slurm, dcache, ssh, gt2, condor, http, coaster-persistent, pbs, ftp, lsf, gsiftp-old, local, sge]. Aliases: condor <-> condorlocal; cobalt <-> cobaltlocal; gsiftp <-> gridftp; pbs <-> pbslocal; gsiftp-old <-> gridftp-old; local <-> file; 
	k:assign @ swift.k, line: 194
Caused by: Exception in sh:
    Arguments: [cs.sh]
    Host: localhost
    Directory: minimal_case-run036/jobs/k/sh-kl8esxql
	exception @ swift-int-staging.k, line: 182
Caused by: 
	exception @ swift-int-staging.k, line: 178
Caused by: null
Caused by: org.globus.cog.abstraction.impl.common.task.InvalidProviderException: No 'proxy' provider or alias found. Available providers: [cobalt, ssh-cl, gsiftp, coaster, webdav, slurm, dcache, ssh, gt2, condor, http, coaster-persistent, pbs, ftp, lsf, gsiftp-old, local, sge]. Aliases: condor <-> condorlocal; cobalt <-> cobaltlocal; gsiftp <-> gridftp; pbs <-> pbslocal; gsiftp-old <-> gridftp-old; local <-> file; 


If I use the fixed array mapper, the 0.94.1 works but the trunk version gives:
*** Ready to call sum_obj

WARNING: duplicate mapping found:
	fs (line 18) and fs (line 18) are both used to write to file://localhost/

Execution failed:
Exception in sh:
    Arguments: [cs.sh]
    Host: localhost
    Directory: minimal_case-run037/jobs/y/sh-y7bosxql
	exception @ swift-int-staging.k, line: 182
Caused by: 
	exception @ swift-int-staging.k, line: 178
Caused by: null
Caused by: org.globus.cog.abstraction.impl.common.task.InvalidProviderException: No 'proxy' provider or alias found. Available providers: [cobalt, ssh-cl, gsiftp, coaster, webdav, slurm, dcache, ssh, gt2, condor, http, coaster-persistent, pbs, ftp, lsf, gsiftp-old, local, sge]. Aliases: condor <-> condorlocal; cobalt <-> cobaltlocal; gsiftp <-> gridftp; pbs <-> pbslocal; gsiftp-old <-> gridftp-old; local <-> file; 
	k:assign @ swift.k, line: 194
Caused by: Exception in sh:
    Arguments: [cs.sh]
    Host: localhost
    Directory: minimal_case-run037/jobs/y/sh-y7bosxql
	exception @ swift-int-staging.k, line: 182
Caused by: 
	exception @ swift-int-staging.k, line: 178
Caused by: null
Caused by: org.globus.cog.abstraction.impl.common.task.InvalidProviderException: No 'proxy' provider or alias found. Available providers: [cobalt, ssh-cl, gsiftp, coaster, webdav, slurm, dcache, ssh, gt2, condor, http, coaster-persistent, pbs, ftp, lsf, gsiftp-old, local, sge]. Aliases: condor <-> condorlocal; cobalt <-> cobaltlocal; gsiftp <-> gridftp; pbs <-> pbslocal; gsiftp-old <-> gridftp-old; local <-> file; 


Any thoughts on what might be going wrong would be greatly appreciated!

Jonathan


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20140520/50dc8844/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: minimal_case.swift
Type: application/octet-stream
Size: 582 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20140520/50dc8844/attachment.obj>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20140520/50dc8844/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: cs.sh
Type: application/octet-stream
Size: 91 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20140520/50dc8844/attachment-0001.obj>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20140520/50dc8844/attachment-0002.html>


More information about the Swift-user mailing list