[Swift-devel] Fwd: build problem with swift

Mihael Hategan hategan at mcs.anl.gov
Tue Jul 15 16:58:25 CDT 2008


On Tue, 2008-07-15 at 16:48 -0500, Mihael Hategan wrote:
> On Tue, 2008-07-15 at 16:37 -0500, Mihael Hategan wrote:
> > On Tue, 2008-07-15 at 16:18 -0500, Ragib Morshed wrote:
> > > Can we change the dependencies such that it builds up the software
> > > like in eclipse?
> > 
> > No.
> > 
> > So the solution would be to pass a data structure that is available in
> > both. Let me think a bit.
> 
> A Map adapter of course.
> 
> I'll commit one shortly.

Ok, so if you do an svn update in vdsk, there will be a CacheMapAdapter
which implements java.util.Map.

You'll use it like this:
In JobConstrains, instead of tc.addConstraint("filecache",
CacheFunction.getCache(stack)), you'd write:
tc.addConstraint("filecache", new
CacheMapAdapter(CacheFunction.getCache(stack)));

The get() method of the adapter is mapped to cache.getPaths(). So in the
scheduler code:
Map cache = (Map) t.getConstraint("filecache");
...
Collection paths = (Collection) cache.get(wh.getHost());

Though this is a bit shady anyway, given that knowledge of all that file
information is pretty Swift specific. But for the purpose of
experimenting with this it will have to do.

> 
> 
> > 
> > > 
> > > -ragib
> > > 
> > > On Tue, Jul 15, 2008 at 12:27 PM, Ben Clifford <benc at hawaga.org.uk>
> > > wrote:
> > >         
> > >         
> > >         VDLCache is in the vdsk module.
> > >         
> > >         The WeightedHost stuff is in karajan, which is a dependency.
> > >         
> > >         You can't use code from module A in module B if module A is
> > >         dependent on
> > >         module B (equivalently if if module B is a prerequisite of
> > >         module A)
> > >         
> > >         Here A = vdsk, B= karajan
> > >         
> > >         There's a subclass of the weighted host scheduler that lives
> > >         in the vdsk
> > >         module and extends the functionality in swift-specific ways:
> > >         src//org/griphyn/vdl/karajan/VDSAdaptiveScheduler.java
> > >         
> > >         You might be able to add your new functionality there.
> > >         
> > >         If its building in eclipse, that's because it enforces cog
> > >         module
> > >         dependencies differently (or not at all).
> > >         
> > >         On Tue, 15 Jul 2008, Ragib Morshed wrote:
> > >         
> > >         
> > >         
> > >         > Ben suggested forwarding this problem of mine to
> > >         swift-devel.
> > >         >
> > >         > ---------- Forwarded message ----------
> > >         > From: Ragib Morshed <ragib.morshed at gmail.com>
> > >         > Date: Tue, Jul 15, 2008 at 11:40 AM
> > >         > Subject: Fwd: build problem with swift
> > >         > To: benc at ci.uchicago.edu
> > >         >
> > >         >
> > >         > Hi Ben,
> > >         >
> > >         > I sent this email to Mihael, but he is off somewhere at a
> > >         conference I
> > >         > think, and don't know if he will get to it.
> > >         >
> > >         > I put some code in for the site-affinity thing and swift
> > >         compiles and runs
> > >         > the code fine using eclipse. Compilation/building using ant
> > >         says: *package
> > >         > org.griphyn.vdl.karajan.lib.cache does not exist. *But it is
> > >         there and
> > >         > compiles fine with eclipse.
> > >         >
> > >         > Do you have any ideas on the top of your head where the
> > >         problem might be?
> > >         >
> > >         > Thanks.
> > >         > -Ragib
> > >         >
> > >         >
> > >         > ---------- Forwarded message ----------
> > >         > From: Ragib Morshed <ragib.morshed at gmail.com>
> > >         > Date: Tue, Jul 15, 2008 at 11:25 AM
> > >         > Subject: build problem with swift
> > >         > To: Mihael Hategan <hategan at uchicago.edu>
> > >         >
> > >         >
> > >         > Hi,
> > >         >
> > >         > I have been trying to build swift with the new changes using
> > >         'ant dist', but
> > >         > it gives compilation error. It compiles and runs fine on
> > >         eclipse, but here
> > >         > it says it can't find the package
> > >         org.gridphyn.vdl.karajan.lib.cache so it
> > >         > cannot recognize the VDLFileCache type. Any ideas why?
> > >         >
> > >         > Here's the output from building it:
> > >         >
> > >         >     [javac] Compiling 540 source files to
> > >         > /autonfs/home/rmorshed/Desktop/swiftNew/cog/modules/karajan/build
> > >         >     [javac]
> > >         > /autonfs/home/rmorshed/Desktop/swiftNew/cog/modules/karajan/src/org/globus/cog/karajan/scheduler/WeightedHostScoreScheduler.java:34:
> > >         > *package org.griphyn.vdl.karajan.lib.cache does not exist*
> > >         >     [javac] import
> > >         org.griphyn.vdl.karajan.lib.cache.VDLFileCache;
> > >         >     [javac]                                          ^
> > >         >     [javac]
> > >         > /autonfs/home/rmorshed/Desktop/swiftNew/cog/modules/karajan/src/org/globus/cog/karajan/scheduler/WeightedHostScoreScheduler.java:230:
> > >         > cannot resolve symbol
> > >         >     [javac] symbol  : class VDLFileCache
> > >         >     [javac] location: class
> > >         > org.globus.cog.karajan.scheduler.WeightedHostScoreScheduler
> > >         >     [javac]             VDLFileCache fileCache =
> > >         (VDLFileCache)
> > >         > t.getConstraint("filecache");
> > >         >     [javac]                 ^
> > >         >     [javac]
> > >         > /autonfs/home/rmorshed/Desktop/swiftNew/cog/modules/karajan/src/org/globus/cog/karajan/scheduler/WeightedHostScoreScheduler.java:230:
> > >         > cannot resolve symbol
> > >         >     [javac] symbol  : class VDLFileCache
> > >         >     [javac] location: class
> > >         > org.globus.cog.karajan.scheduler.WeightedHostScoreScheduler
> > >         >     [javac]             VDLFileCache fileCache =
> > >         (VDLFileCache)
> > >         > t.getConstraint("filecache");
> > >         >     [javac]                                           ^
> > >         >     [javac] Note: Some input files use or override a
> > >         deprecated API.
> > >         >     [javac] Note: Recompile with -deprecation for details.
> > >         >     [javac] 3 errors
> > >         >
> > >         > BUILD FAILED
> > >         > /autonfs/home/rmorshed/Desktop/swiftNew/cog/modules/vdsk/build.xml:73: The
> > >         > following error occurred while executing this line:
> > >         > /autonfs/home/rmorshed/Desktop/swiftNew/cog/mbuild.xml:442:
> > >         The following
> > >         > error occurred while executing this line:
> > >         > /autonfs/home/rmorshed/Desktop/swiftNew/cog/mbuild.xml:78:
> > >         The following
> > >         > error occurred while executing this line:
> > >         > /autonfs/home/rmorshed/Desktop/swiftNew/cog/mbuild.xml:51:
> > >         The following
> > >         > error occurred while executing this line:
> > >         > /autonfs/home/rmorshed/Desktop/swiftNew/cog/modules/vdsk/dependencies.xml:4:
> > >         > The following error occurred while executing this line:
> > >         > /autonfs/home/rmorshed/Desktop/swiftNew/cog/mbuild.xml:162:
> > >         The following
> > >         > error occurred while executing this line:
> > >         > /autonfs/home/rmorshed/Desktop/swiftNew/cog/mbuild.xml:167:
> > >         The following
> > >         > error occurred while executing this line:
> > >         > /autonfs/home/rmorshed/Desktop/swiftNew/cog/modules/karajan/build.xml:59:
> > >         > The following error occurred while executing this line:
> > >         > /autonfs/home/rmorshed/Desktop/swiftNew/cog/mbuild.xml:463:
> > >         The following
> > >         > error occurred while executing this line:
> > >         > /autonfs/home/rmorshed/Desktop/swiftNew/cog/mbuild.xml:227:
> > >         Compile failed;
> > >         > see the compiler error output for details.
> > >         >
> > >         > Total time: 30 seconds
> > >         >
> > >         > -ragib
> > >         >
> > >         
> > > 
> > > 
> > > _______________________________________________
> > > Swift-devel mailing list
> > > Swift-devel at ci.uchicago.edu
> > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
> 
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel




More information about the Swift-devel mailing list