[Swift-devel] Re: No provider specified error
Jonathan Monette
jon.monette at gmail.com
Mon Jan 24 21:28:08 CST 2011
Figured out what was wrong. I was using some properties in my sites.xml
for provider staging per Mike's suggestion. By commenting those lines
out my workflow began working again. I am assuming for provider staging
to work a 'proxy' must be set up and I do not believe I have set one
up. However I am unfamiliar with provider staging, this was a
suggestion by Mike to try next in a list of things for me to do.
On 1/24/11 7:42 PM, Jonathan Monette wrote:
> Scratch that, I do have execution provider="local" set in my
> sites.xml. I am not sure where the problem is. Still looking.
>
> On 1/24/11 7:38 PM, Jonathan Monette wrote:
>> Ok. I went searching through some of the cog code for this error
>> when I took a close look at this line from the log file:
>>
>> Caused by:
>> org.globus.cog.abstraction.impl.common.task.InvalidProviderException:
>> No 'proxy' provider or alias found. Available providers: [cobalt,
>> gsiftp, coaster, webdav, dcache, ssh, gt4, gt2, condor, http,
>> coaster-persistent, pbs, ftp, gsiftp-old, local, sge]
>>
>> I am assuming that all these providers listed are the acceptable
>> entries in the sites.xml for the execution provider entry. I notice
>> that localhost isn't an acceptable execution provider. Was localhost
>> switched to local(which is an acceptable value) in cog-r3043?
>>
>> On 1/23/11 10:18 PM, Jonathan Monette wrote:
>>> Mihael,
>>> I just updated to cog-r3043 and swift-r4031. I now get this
>>> swift error:
>>>
>>> Execution failed:
>>> No 'proxy' provider or alias found. Available providers:
>>> [cobalt, gsiftp, coaster, webdav, dcache, ssh, gt4, gt2, condor,
>>> http, coaster-persistent, pbs, ftp, gsiftp-old, local, sge].
>>> Aliases: gt4 <-> gt4.0.2, gt4.0.1, gt3.9.5, gt4.0.0; condor <->
>>> condorlocal; cobalt <-> cobaltlocal; gsiftp <-> gridftp; pbs <->
>>> pbslocal; gsiftp-old <-> gridftp-old; local <-> file;
>>>
>>> Upon inspecting the log file I got found this Java error:
>>>
>>> 2011-01-23 18:31:27,221-0600 INFO AbstractionProperties No
>>> properties for provider proxy. Using empty properties
>>> 2011-01-23 18:31:27,227-0600 INFO vdl:execute END_FAILURE
>>> thread=0-3 tr=mImgtbl
>>> 2011-01-23 18:31:27,234-0600 DEBUG VDL2ExecutionContext sys:throw @
>>> execute-default.k, line: 45: Exception in mImgtbl:
>>> Arguments: [proj_dir, images.tbl]
>>> Host: localhost
>>> Directory:
>>> rectified-20110123-1707-ptqrq9j5/jobs/3/mImgtbl-3krv2x4kTODO: outs
>>> ----
>>>
>>> Exception in mImgtbl:
>>> Arguments: [proj_dir, images.tbl]
>>> Host: localhost
>>> Directory:
>>> rectified-20110123-1707-ptqrq9j5/jobs/3/mImgtbl-3krv2x4kTODO: outs
>>> ----
>>>
>>> Caused by: No 'proxy' provider or alias found. Available providers:
>>> [cobalt, gsiftp, coaster, webdav, dcache, ssh, gt4, gt2, condor,
>>> http, coaster-persistent, pbs, ftp, gsiftp-old, local, sge].
>>> Aliases: gt4 <-> gt4.0.2, gt4.0.1, gt3.9.5, gt4.0.0; condor <->
>>> condorlocal; cobalt <-> cobaltlocal; gsiftp <-> gridftp; pbs <->
>>> pbslocal; gsiftp-old <-> gridftp-old; local <-> file;
>>> Caused by:
>>> org.globus.cog.abstraction.impl.common.task.InvalidProviderException: No
>>> 'proxy' provider or alias found. Available providers: [cobalt,
>>> gsiftp, coaster, webdav, dcache, ssh, gt4, gt2, condor, http,
>>> coaster-persistent, pbs, ftp, gsiftp-old, local, sge]. Aliases: gt4
>>> <-> gt4.0.2, gt4.0.1, gt3.9.5, gt4.0.0; condor <-> condorlocal;
>>> cobalt <-> cobaltlocal; gsiftp <-> gridftp; pbs <-> pbslocal;
>>> gsiftp-old <-> gridftp-old; local <-> file;
>>> at
>>> org.globus.cog.karajan.workflow.nodes.functions.KException.function(KException.java:29)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.functions.AbstractFunction.post(AbstractFunction.java:27)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.childCompleted(AbstractSequentialWithArguments.java:192)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.Sequential.notificationEvent(Sequential.java:32)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowNode.event(FlowNode.java:340)
>>> at
>>> org.globus.cog.karajan.workflow.events.EventBus.send(EventBus.java:173)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowNode.fireNotificationEvent(FlowNode.java:181)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:309)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.functions.AbstractFunction.post(AbstractFunction.java:28)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.Sequential.startNext(Sequential.java:50)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.Sequential.executeChildren(Sequential.java:26)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowContainer.execute(FlowContainer.java:63)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowNode.restart(FlowNode.java:238)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowNode.start(FlowNode.java:289)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowNode.controlEvent(FlowNode.java:402)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowNode.event(FlowNode.java:343)
>>> at
>>> org.globus.cog.karajan.workflow.FlowElementWrapper.event(FlowElementWrapper.java:230)
>>> at
>>> org.globus.cog.karajan.workflow.events.EventBus.send(EventBus.java:173)
>>> at
>>> org.globus.cog.karajan.workflow.events.EventTargetPair.run(EventTargetPair.java:44)
>>> at
>>> edu.emory.mathcs.backport.java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:431)
>>> at
>>> edu.emory.mathcs.backport.java.util.concurrent.FutureTask.run(FutureTask.java:166)
>>> at
>>> edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:643)
>>> at
>>> edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:668)
>>> at java.lang.Thread.run(Thread.java:662)
>>> Caused by: No 'proxy' provider or alias found. Available providers:
>>> [cobalt, gsiftp, coaster, webdav, dcache, ssh, gt4, gt2, condor,
>>> http, coaster-persistent, pbs, ftp, gsiftp-old, local, sge].
>>> Aliases: gt4 <-> gt4.0.2, gt4.0.1, gt3.9.5, gt4.0.0; condor <->
>>> condorlocal; cobalt <-> cobaltlocal; gsiftp <-> gridftp; pbs <->
>>> pbslocal; gsiftp-old <-> gridftp-old; local <-> file;
>>> Caused by:
>>> org.globus.cog.abstraction.impl.common.task.InvalidProviderException: No
>>> 'proxy' provider or alias found. Available providers: [cobalt,
>>> gsiftp, coaster, webdav, dcache, ssh, gt4, gt2, condor, http,
>>> coaster-persistent, pbs, ftp, gsiftp-old, local, sge]. Aliases: gt4
>>> <-> gt4.0.2, gt4.0.1, gt3.9.5, gt4.0.0; condor <-> condorlocal;
>>> cobalt <-> cobaltlocal; gsiftp <-> gridftp; pbs <-> pbslocal;
>>> gsiftp-old <-> gridftp-old; local <-> file;
>>> at
>>> org.globus.cog.karajan.workflow.events.FailureNotificationEvent.<init>(FailureNotificationEvent.java:36)
>>> at
>>> org.globus.cog.karajan.workflow.events.FailureNotificationEvent.<init>(FailureNotificationEvent.java:42)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowNode.failImmediately(FlowNode.java:153)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.grid.GridExec.taskFailed(GridExec.java:373)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.grid.AbstractGridNode.statusChanged(AbstractGridNode.java:276)
>>> at
>>> org.griphyn.vdl.karajan.lib.Execute.statusChanged(Execute.java:127)
>>> at
>>> org.globus.cog.karajan.scheduler.AbstractScheduler.fireJobStatusChangeEvent(AbstractScheduler.java:168)
>>> at
>>> org.globus.cog.karajan.scheduler.LateBindingScheduler.statusChanged(LateBindingScheduler.java:675)
>>> at
>>> org.globus.cog.karajan.scheduler.WeightedHostScoreScheduler.statusChanged(WeightedHostScoreScheduler.java:422)
>>> at
>>> org.griphyn.vdl.karajan.VDSAdaptiveScheduler.statusChanged(VDSAdaptiveScheduler.java:410)
>>> at
>>> org.globus.cog.abstraction.impl.common.task.TaskImpl.notifyListeners(TaskImpl.java:240)
>>> at
>>> org.globus.cog.abstraction.impl.common.task.TaskImpl.setStatus(TaskImpl.java:228)
>>> at
>>> org.globus.cog.abstraction.impl.common.AbstractDelegatedTaskHandler.failTask(AbstractDelegatedTaskHandler.java:54)
>>> at
>>> org.globus.cog.abstraction.impl.execution.local.JobSubmissionTaskHandler.run(JobSubmissionTaskHandler.java:220)
>>> at
>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
>>> at
>>> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>>> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>>> ... 1 more
>>> Caused by:
>>> org.globus.cog.abstraction.impl.common.task.InvalidProviderException: No
>>> 'proxy' provider or alias found. Available providers: [cobalt,
>>> gsiftp, coaster, webdav, dcache, ssh, gt4, gt2, condor, http,
>>> coaster-persistent, pbs, ftp, gsiftp-old, local, sge]. Aliases: gt4
>>> <-> gt4.0.2, gt4.0.1, gt3.9.5, gt4.0.0; condor <-> condorlocal;
>>> cobalt <-> cobaltlocal; gsiftp <-> gridftp; pbs <-> pbslocal;
>>> gsiftp-old <-> gridftp-old; local <-> file;
>>> at
>>> org.globus.cog.abstraction.impl.common.AbstractionProperties.getProperties(AbstractionProperties.java:138)
>>> at
>>> org.globus.cog.abstraction.impl.common.AbstractionFactory.newObject(AbstractionFactory.java:136)
>>> at
>>> org.globus.cog.abstraction.impl.common.AbstractionFactory.newFileResource(AbstractionFactory.java:112)
>>> at
>>> org.globus.cog.abstraction.impl.execution.local.JobSubmissionTaskHandler.copy(JobSubmissionTaskHandler.java:293)
>>> at
>>> org.globus.cog.abstraction.impl.execution.local.JobSubmissionTaskHandler.stage(JobSubmissionTaskHandler.java:272)
>>> at
>>> org.globus.cog.abstraction.impl.execution.local.JobSubmissionTaskHandler.stageIn(JobSubmissionTaskHandler.java:283)
>>> at
>>> org.globus.cog.abstraction.impl.execution.local.JobSubmissionTaskHandler.run(JobSubmissionTaskHandler.java:159)
>>> ... 6 more
>>> 2011-01-23 18:31:27,274-0600 INFO ExecutionContext Detailed exception:
>>> Exception in mImgtbl:
>>> Arguments: [proj_dir, images.tbl]
>>> Host: localhost
>>> Directory:
>>> rectified-20110123-1707-ptqrq9j5/jobs/3/mImgtbl-3krv2x4kTODO: outs
>>> ----
>>>
>>> Caused by: No 'proxy' provider or alias found. Available providers:
>>> [cobalt, gsiftp, coaster, webdav, dcache, ssh, gt4, gt2, condor,
>>> http, coaster-persistent, pbs, ftp, gsiftp-old, local, sge].
>>> Aliases: gt4 <-> gt4.0.2, gt4.0.1, gt3.9.5, gt4.0.0; condor <->
>>> condorlocal; cobalt <-> cobaltlocal; gsiftp <-> gridftp; pbs <->
>>> pbslocal; gsiftp-old <-> gridftp-old; local <-> file;
>>> Caused by:
>>> org.globus.cog.abstraction.impl.common.task.InvalidProviderException: No
>>> 'proxy' provider or alias found. Available providers: [cobalt,
>>> gsiftp, coaster, webdav, dcache, ssh, gt4, gt2, condor, http,
>>> coaster-persistent, pbs, ftp, gsiftp-old, local, sge]. Aliases: gt4
>>> <-> gt4.0.2, gt4.0.1, gt3.9.5, gt4.0.0; condor <-> condorlocal;
>>> cobalt <-> cobaltlocal; gsiftp <-> gridftp; pbs <-> pbslocal;
>>> gsiftp-old <-> gridftp-old; local <-> file;
>>> at
>>> org.globus.cog.karajan.workflow.nodes.functions.KException.function(KException.java:29)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.functions.AbstractFunction.post(AbstractFunction.java:27)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.childCompleted(AbstractSequentialWithArguments.java:192)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.Sequential.notificationEvent(Sequential.java:32)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowNode.event(FlowNode.java:340)
>>> at
>>> org.globus.cog.karajan.workflow.events.EventBus.send(EventBus.java:173)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowNode.fireNotificationEvent(FlowNode.java:181)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:309)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.functions.AbstractFunction.post(AbstractFunction.java:28)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.Sequential.startNext(Sequential.java:50)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.Sequential.executeChildren(Sequential.java:26)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowContainer.execute(FlowContainer.java:63)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowNode.restart(FlowNode.java:238)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowNode.start(FlowNode.java:289)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowNode.controlEvent(FlowNode.java:402)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowNode.event(FlowNode.java:343)
>>> at
>>> org.globus.cog.karajan.workflow.FlowElementWrapper.event(FlowElementWrapper.java:230)
>>> at
>>> org.globus.cog.karajan.workflow.events.EventBus.send(EventBus.java:173)
>>> at
>>> org.globus.cog.karajan.workflow.events.EventTargetPair.run(EventTargetPair.java:44)
>>> at
>>> edu.emory.mathcs.backport.java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:431)
>>> at
>>> edu.emory.mathcs.backport.java.util.concurrent.FutureTask.run(FutureTask.java:166)
>>> at
>>> edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:643)
>>> at
>>> edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:668)
>>> at java.lang.Thread.run(Thread.java:662)
>>> Caused by: No 'proxy' provider or alias found. Available providers:
>>> [cobalt, gsiftp, coaster, webdav, dcache, ssh, gt4, gt2, condor,
>>> http, coaster-persistent, pbs, ftp, gsiftp-old, local, sge].
>>> Aliases: gt4 <-> gt4.0.2, gt4.0.1, gt3.9.5, gt4.0.0; condor <->
>>> condorlocal; cobalt <-> cobaltlocal; gsiftp <-> gridftp; pbs <->
>>> pbslocal; gsiftp-old <-> gridftp-old; local <-> file;
>>> Caused by:
>>> org.globus.cog.abstraction.impl.common.task.InvalidProviderException: No
>>> 'proxy' provider or alias found. Available providers: [cobalt,
>>> gsiftp, coaster, webdav, dcache, ssh, gt4, gt2, condor, http,
>>> coaster-persistent, pbs, ftp, gsiftp-old, local, sge]. Aliases: gt4
>>> <-> gt4.0.2, gt4.0.1, gt3.9.5, gt4.0.0; condor <-> condorlocal;
>>> cobalt <-> cobaltlocal; gsiftp <-> gridftp; pbs <-> pbslocal;
>>> gsiftp-old <-> gridftp-old; local <-> file;
>>> at
>>> org.globus.cog.karajan.workflow.events.FailureNotificationEvent.<init>(FailureNotificationEvent.java:36)
>>> at
>>> org.globus.cog.karajan.workflow.events.FailureNotificationEvent.<init>(FailureNotificationEvent.java:42)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.FlowNode.failImmediately(FlowNode.java:153)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.grid.GridExec.taskFailed(GridExec.java:373)
>>> at
>>> org.globus.cog.karajan.workflow.nodes.grid.AbstractGridNode.statusChanged(AbstractGridNode.java:276)
>>> at
>>> org.griphyn.vdl.karajan.lib.Execute.statusChanged(Execute.java:127)
>>> at
>>> org.globus.cog.karajan.scheduler.AbstractScheduler.fireJobStatusChangeEvent(AbstractScheduler.java:168)
>>> at
>>> org.globus.cog.karajan.scheduler.LateBindingScheduler.statusChanged(LateBindingScheduler.java:675)
>>> at
>>> org.globus.cog.karajan.scheduler.WeightedHostScoreScheduler.statusChanged(WeightedHostScoreScheduler.java:422)
>>> at
>>> org.griphyn.vdl.karajan.VDSAdaptiveScheduler.statusChanged(VDSAdaptiveScheduler.java:410)
>>> at
>>> org.globus.cog.abstraction.impl.common.task.TaskImpl.notifyListeners(TaskImpl.java:240)
>>> at
>>> org.globus.cog.abstraction.impl.common.task.TaskImpl.setStatus(TaskImpl.java:228)
>>> at
>>> org.globus.cog.abstraction.impl.common.AbstractDelegatedTaskHandler.failTask(AbstractDelegatedTaskHandler.java:54)
>>> at
>>> org.globus.cog.abstraction.impl.execution.local.JobSubmissionTaskHandler.run(JobSubmissionTaskHandler.java:220)
>>> at
>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
>>> at
>>> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>>> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>>> ... 1 more
>>> Caused by:
>>> org.globus.cog.abstraction.impl.common.task.InvalidProviderException: No
>>> 'proxy' provider or alias found. Available providers: [cobalt,
>>> gsiftp, coaster, webdav, dcache, ssh, gt4, gt2, condor, http,
>>> coaster-persistent, pbs, ftp, gsiftp-old, local, sge]. Aliases: gt4
>>> <-> gt4.0.2, gt4.0.1, gt3.9.5, gt4.0.0; condor <-> condorlocal;
>>> cobalt <-> cobaltlocal; gsiftp <-> gridftp; pbs <-> pbslocal;
>>> gsiftp-old <-> gridftp-old; local <-> file;
>>> at
>>> org.globus.cog.abstraction.impl.common.AbstractionProperties.getProperties(AbstractionProperties.java:138)
>>> at
>>> org.globus.cog.abstraction.impl.common.AbstractionFactory.newObject(AbstractionFactory.java:136)
>>> at
>>> org.globus.cog.abstraction.impl.common.AbstractionFactory.newFileResource(AbstractionFactory.java:112)
>>> at
>>> org.globus.cog.abstraction.impl.execution.local.JobSubmissionTaskHandler.copy(JobSubmissionTaskHandler.java:293)
>>> at
>>> org.globus.cog.abstraction.impl.execution.local.JobSubmissionTaskHandler.stage(JobSubmissionTaskHandler.java:272)
>>> at
>>> org.globus.cog.abstraction.impl.execution.local.JobSubmissionTaskHandler.stageIn(JobSubmissionTaskHandler.java:283)
>>> at
>>> org.globus.cog.abstraction.impl.execution.local.JobSubmissionTaskHandler.run(JobSubmissionTaskHandler.java:159)
>>> ... 6 more
>>>
>>> I am running on PADS and here is my sites.xml file:
>>>
>>> <config>
>>> <pool handle="localhost">
>>> <execution provider="local" />
>>> <filesystem provider="local" />
>>> <profile key="jobThrottle" namespace="karajan">.05</profile>
>>> <profile key="SWIFT_GEN_SCRIPTS" namespace="env">1</profile>
>>> <workdirectory>/gpfs/pads/swift/jonmon/Swift/work/localhost</workdirectory>
>>>
>>> </pool>
>>> <pool handle="pads">
>>> <execution jobmanager="local:pbs" provider="coaster" />
>>> <filesystem provider="local" />
>>> <profile key="maxtime" namespace="globus">3600</profile>
>>> <profile key="internalhostname" namespace="globus">192.5.86.6</profile>
>>> <profile key="workersPerNode" namespace="globus">1</profile>
>>> <profile key="slots" namespace="globus">40</profile>
>>> <profile key="nodeGranularity" namespace="globus">1</profile>
>>> <profile key="maxNodes" namespace="globus">1</profile>
>>> <profile key="queue" namespace="globus">fast</profile>
>>> <profile key="jobThrottle" namespace="karajan">1</profile>
>>> <profile key="initialScore" namespace="karajan">10000</profile>
>>> <profile key="SWIFT_GEN_SCRIPTS" namespace="env">1</profile>
>>> <workdirectory>/gpfs/pads/swift/jonmon/Swift/work/pads</workdirectory>
>>> </pool>
>>> </config>
>>>
>>> Has anyone else seen this error or Mihael have you witnessed this?
More information about the Swift-devel
mailing list