<div dir="ltr">That works,<div>Thanks,</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Feb 17, 2017 at 1:40 PM, Satish Balay <span dir="ltr"><<a href="mailto:balay@mcs.anl.gov" target="_blank">balay@mcs.anl.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Sorry - forgot the attachment..<br>
<div class="HOEnZb"><div class="h5"><br>
On Fri, 17 Feb 2017, Satish Balay wrote:<br>
<br>
> Can you try the attached patch? If it works - I'll push it to master.<br>
><br>
> BTW: why use --download-fblaslapack=1 on cray? Shouldn't you be using<br>
> one of the blas impls provied by cray? [libsci?]<br>
><br>
> Satish<br>
><br>
> On Fri, 17 Feb 2017, Mark Adams wrote:<br>
><br>
> > p4est seems to work now, but I am getting a BLAS failure. But I download<br>
> > blas....<br>
> ><br>
> > On Fri, Feb 17, 2017 at 12:48 PM, Satish Balay <<a href="mailto:balay@mcs.anl.gov">balay@mcs.anl.gov</a>> wrote:<br>
> ><br>
> > > >>><br>
> > > File "/global/u2/m/madams/petsc/<wbr>config/BuildSystem/config/<wbr>packages/p4est.py",<br>
> > > line 51, in updateGitDir<br>
> > > raise RuntimeError('Could not initialize sc submodule needed by p4est')<br>
> > > <<<<br>
> > ><br>
> > > So 'git submoudle' stuff failed. Presumably this install of git doesn't<br>
> > > support submodule?<br>
> > ><br>
> > > >>>>>><br>
> > > Checking for program /usr/common/software/git/2.9.<wbr>1/bin/git...found<br>
> > > Defined make macro "GIT" to "git"<br>
> > > Executing: git --version<br>
> > > stdout: git version 2.9.1<br>
> > > <<<<<<<<br>
> > ><br>
> > > You should be able to use the taball - if you use the patch I mentioned<br>
> > > eariler [which is already in master]<br>
> > ><br>
> > > If you want everything else to be from git - and use tarball with only<br>
> > > p4est - then do:<br>
> > ><br>
> > > --download-p4est=<a href="https://github.com/p4est/p4est.github" rel="noreferrer" target="_blank">https://<wbr>github.com/p4est/p4est.github</a>.<br>
> > > io/raw/master/release/p4est-2.<wbr>0.tar.gz<br>
> > ><br>
> > > Satish<br>
> > ><br>
> > > On Fri, 17 Feb 2017, Tobin Isaac wrote:<br>
> > ><br>
> > > > The configure.log doesn't really tell me why it is failing. Did you<br>
> > > > start with a clean git.p4est after trying to use the tarball?<br>
> > > ><br>
> > > > On Fri, Feb 17, 2017 at 12:21:50PM -0500, Mark Adams wrote:<br>
> > > > > It turns out that Cori-KNL does have git, it is just not loaded by<br>
> > > default.<br>
> > > > ><br>
> > > > > It still does not work, but the error looks different.<br>
> > > > ><br>
> > > > > ******************************<wbr>******************************<br>
> > > *******************<br>
> > > > > UNABLE to CONFIGURE with GIVEN OPTIONS (see configure.log<br>
> > > for<br>
> > > > > details):<br>
> > > > > ------------------------------<wbr>------------------------------<br>
> > > -------------------<br>
> > > > > Could not initialize sc submodule needed by p4est<br>
> > > > > ******************************<wbr>******************************<br>
> > > *******************<br>
> > > > ><br>
> > > > ><br>
> > > > > On Thu, Feb 16, 2017 at 10:20 PM, Tobin Isaac <<a href="mailto:tisaac@uchicago.edu">tisaac@uchicago.edu</a>><br>
> > > wrote:<br>
> > > > ><br>
> > > > > ><br>
> > > > > > On Thu, Feb 16, 2017 at 05:48:57PM -0600, Barry Smith wrote:<br>
> > > > > > ><br>
> > > > > > > > On Feb 16, 2017, at 5:01 PM, Tobin Isaac <<a href="mailto:tisaac@uchicago.edu">tisaac@uchicago.edu</a>><br>
> > > wrote:<br>
> > > > > > > ><br>
> > > > > > > > The bootstrap script predates/supercedes autoreconf to get the<br>
> > > > > > necessary m4 scripts and write configure. The tarballs have the m4<br>
> > > scripts<br>
> > > > > > and configure, so they should be treated as standard gnu configure<br>
> > > && make<br>
> > > > > > && make install scripts. I think that's what I accomplished in<br>
> > > p4est.py.<br>
> > > > > > I'm on my phone, when I'm at a computer I'll look at this thread's<br>
> > > history<br>
> > > > > > to see if I can figure out what's going on.<br>
> > > > > > ><br>
> > > > > > > You are confusing two errors. One is the issue you mention<br>
> > > above, we<br>
> > > > > > don't care about that. The only error we care about is that p4est<br>
> > > > > > ./configure needs to run a compiled program to gather some<br>
> > > information<br>
> > > > > > about the machine. On systems with cross-compiling this doesn't work<br>
> > > since<br>
> > > > > > after ./configure compiles the program it cannot run it because it<br>
> > > is not<br>
> > > > > > compatible with the hardware. So the question is: is there an easy<br>
> > > way to<br>
> > > > > > hack the p4est configure so that we can provide the needed<br>
> > > information<br>
> > > > > > directly and not have ./configure try to run an executable?<br>
> > > > > ><br>
> > > > > > Okay, I get it now. There should be `config.log` in<br>
> > > > > > externalpackags/git.p4est that would let me know what particular<br>
> > > check<br>
> > > > > > it was working on when cross-compilation errors cropped up, and I<br>
> > > > > > could try to help come up with a solution.<br>
> > > > > ><br>
> > > > > > ><br>
> > > > > > > Barry<br>
> > > > > > ><br>
> > > > > > > Note that this problem is common for many autoconf based build<br>
> > > systems,<br>
> > > > > > its solution depends on the details of how the particular system is<br>
> > > using<br>
> > > > > > using executables to gather information.<br>
> > > > > > ><br>
> > > > > > > ><br>
> > > > > > > > On February 16, 2017 4:34:35 PM CST, Barry Smith <<br>
> > > <a href="mailto:bsmith@mcs.anl.gov">bsmith@mcs.anl.gov</a>><br>
> > > > > > wrote:<br>
> > > > > > > >><br>
> > > > > > > >> The best long term fix is to find out what things p4est needs to<br>
> > > > > > > >> determine by a running a program and providing them some other<br>
> > > way.<br>
> > > > > > > >><br>
> > > > > > > >> Toby<br>
> > > > > > > >><br>
> > > > > > > >> So what things is p4est trying to determine by running a<br>
> > > program?<br>
> > > > > > > >><br>
> > > > > > > >> Barry<br>
> > > > > > > >><br>
> > > > > > > >><br>
> > > > > > > >><br>
> > > > > > > >>> On Feb 16, 2017, at 3:25 PM, Satish Balay <<a href="mailto:balay@mcs.anl.gov">balay@mcs.anl.gov</a>><br>
> > > wrote:<br>
> > > > > > > >>><br>
> > > > > > > >>> I don't understand autoconf well enough for cross compiling.<br>
> > > Some<br>
> > > > > > > >>> packages appear to require this - but others don't.<br>
> > > > > > > >>><br>
> > > > > > > >>><br>
> > > > > > > >> <a href="https://www.gnu.org/software/autoconf/manual/autoconf-2.69/" rel="noreferrer" target="_blank">https://www.gnu.org/software/<wbr>autoconf/manual/autoconf-2.69/</a><br>
> > > > > > html_node/Hosts-and-Cross_<wbr>002dCompilation.html<br>
> > > > > > > >>><br>
> > > > > > > >>> So one would run 'config.guess' script on the compute node -<br>
> > > and use<br>
> > > > > > > >> this value on the compile node with configure?<br>
> > > > > > > >>><br>
> > > > > > > >>> I don't know how we could automate that..<br>
> > > > > > > >>><br>
> > > > > > > >>> Satish<br>
> > > > > > > >>><br>
> > > > > > > >>> On Wed, 15 Feb 2017, Mark Adams wrote:<br>
> > > > > > > >>><br>
> > > > > > > >>>> OK, that did not work. It says something about --host now.<br>
> > > > > > > >>>><br>
> > > > > > > >>>> On Wed, Feb 15, 2017 at 5:06 PM, Mark Adams <<a href="mailto:mfadams@lbl.gov">mfadams@lbl.gov</a>><br>
> > > > > > wrote:<br>
> > > > > > > >>>><br>
> > > > > > > >>>>> I think this will work because I have git when I configure<br>
> > > on a<br>
> > > > > > > >> login node<br>
> > > > > > > >>>>> (Haswell). I build KNL by submitting a batch script (it<br>
> > > takes to<br>
> > > > > > > >> long to<br>
> > > > > > > >>>>> fit in 30 minutes of an interactive session). That fails<br>
> > > because<br>
> > > > > > > >> git is not<br>
> > > > > > > >>>>> available (can I just load the module ...) on a KNL compute<br>
> > > node.<br>
> > > > > > > >> It is<br>
> > > > > > > >>>>> reconfiguring now, I'll let you know if it fails.<br>
> > > > > > > >>>>> Thanks,<br>
> > > > > > > >>>>><br>
> > > > > > > >>>>> On Wed, Feb 15, 2017 at 4:59 PM, Satish Balay <<br>
> > > <a href="mailto:balay@mcs.anl.gov">balay@mcs.anl.gov</a>><br>
> > > > > > > >> wrote:<br>
> > > > > > > >>>>><br>
> > > > > > > >>>>>> Sorry - this won't work - as p4est appears to require git<br>
> > > > > > > >> [submodules?]..<br>
> > > > > > > >>>>>><br>
> > > > > > > >>>>>>>>>>>>>>>>>> p4est.py <<<<<<<<<<<<<<br>
> > > > > > > >>>>>> def updateGitDir(self):<br>
> > > > > > > >>>>>> config.package.GNUPackage.<wbr>updateGitDir(self)<br>
> > > > > > > >>>>>> Dir = self.getDir()<br>
> > > > > > > >>>>>> try:<br>
> > > > > > > >>>>>> libsc = self.libsc<br>
> > > > > > > >>>>>> except AttributeError:<br>
> > > > > > > >>>>>> try:<br>
> > > > > > > >>>>>> self.executeShellCommand([<wbr>self.sourceControl.git,<br>
> > > > > > > >> 'submodule',<br>
> > > > > > > >>>>>> 'update', '--init'], cwd=Dir, log=self.log)<br>
> > > > > > > >>>>>> import os<br>
> > > > > > > >>>>>> if os.path.isfile(os.path.join(<wbr>Dir,'sc','README')):<br>
> > > > > > > >>>>>> self.libsc = os.path.join(Dir,'sc')<br>
> > > > > > > >>>>>> else:<br>
> > > > > > > >>>>>> raise RuntimeError<br>
> > > > > > > >>>>>> except RuntimeError:<br>
> > > > > > > >>>>>> raise RuntimeError('Could not initialize sc submodule<br>
> > > > > > > >> needed by<br>
> > > > > > > >>>>>> p4est')<br>
> > > > > > > >>>>>> return<br>
> > > > > > > >>>>>> <<<<<<<br>
> > > > > > > >>>>>><br>
> > > > > > > >>>>>> Satish<br>
> > > > > > > >>>>>><br>
> > > > > > > >>>>>> On Wed, 15 Feb 2017, Satish Balay wrote:<br>
> > > > > > > >>>>>><br>
> > > > > > > >>>>>>> batch won't help here. its git vs tarball - and p4est<br>
> > > curently<br>
> > > > > > > >> doesn't<br>
> > > > > > > >>>>>> have a taball.<br>
> > > > > > > >>>>>>><br>
> > > > > > > >>>>>>> The following should give you a tarball - if you don't<br>
> > > have git.<br>
> > > > > > > >>>>>>><br>
> > > > > > > >>>>>>> diff --git a/config/BuildSystem/config/<wbr>packages/p4est.py<br>
> > > > > > > >>>>>> b/config/BuildSystem/config/<wbr>packages/p4est.py<br>
> > > > > > > >>>>>>> index 4735ff4..1f9507c 100644<br>
> > > > > > > >>>>>>> --- a/config/BuildSystem/config/<wbr>packages/p4est.py<br>
> > > > > > > >>>>>>> +++ b/config/BuildSystem/config/<wbr>packages/p4est.py<br>
> > > > > > > >>>>>>> @@ -4,7 +4,7 @@ class Configure(config.package.<br>
> > > GNUPackage):<br>
> > > > > > > >>>>>>> def __init__(self, framework):<br>
> > > > > > > >>>>>>> config.package.GNUPackage.__<wbr>init__(self, framework)<br>
> > > > > > > >>>>>>> self.gitcommit = 'v2.0'<br>
> > > > > > > >>>>>>> - self.download = ['git://<br>
> > > <a href="https://github.com/cbu" rel="noreferrer" target="_blank">https://github.com/cbu</a><br>
> > > > > > > >>>>>> rstedde/p4est']<br>
> > > > > > > >>>>>>> + self.download = ['git://<br>
> > > <a href="https://github.com/cbu" rel="noreferrer" target="_blank">https://github.com/cbu</a><br>
> > > > > > > >>>>>> rstedde/p4est','<a href="https://github.com/cburstedde/p4est/" rel="noreferrer" target="_blank">https://<wbr>github.com/cburstedde/p4est/</a><br>
> > > archive/<br>
> > > > > > > >>>>>> '+self.gitcommit+'.tar.gz']<br>
> > > > > > > >>>>>>> self.functions = ['p4est_init']<br>
> > > > > > > >>>>>>> self.includes = ['p4est_bits.h']<br>
> > > > > > > >>>>>>> self.liblist = [['libp4est.a', 'libsc.a']]<br>
> > > > > > > >>>>>>><br>
> > > > > > > >>>>>>> I can push this to master.<br>
> > > > > > > >>>>>>><br>
> > > > > > > >>>>>>> Satish<br>
> > > > > > > >>>>>>><br>
> > > > > > > >>>>>>> On Wed, 15 Feb 2017, Mark Adams wrote:<br>
> > > > > > > >>>>>>><br>
> > > > > > > >>>>>>>> Oh, this is because git does not work on KNL. Maybe I<br>
> > > should do<br>
> > > > > > > >>>>>>>> with-batch=1,<br>
> > > > > > > >>>>>>>><br>
> > > > > > > >>>>>>>><br>
> > > > > > > >>>>>>>> On Wed, Feb 15, 2017 at 4:36 PM, Mark Adams <<br>
> > > <a href="mailto:mfadams@lbl.gov">mfadams@lbl.gov</a>><br>
> > > > > > > >> wrote:<br>
> > > > > > > >>>>>>>><br>
> > > > > > > >>>>>>>>> I get this error on the KNL partition at NERSC. P4est<br>
> > > works on<br>
> > > > > > > >> the<br>
> > > > > > > >>>>>>>>> Haswell partition and other downloads seem to work on<br>
> > > the KNL<br>
> > > > > > > >>>>>> partition.<br>
> > > > > > > >>>>>>>>> Any ideas?<br>
> > > > > > > >>>>>>>>><br>
> > > > > > > >>>>>>>><br>
> > > > > > > >>>>>>><br>
> > > > > > > >>>>>>><br>
> > > > > > > >>>>>><br>
> > > > > > > >>>>>><br>
> > > > > > > >>>>><br>
> > > > > > > >>>><br>
> > > > > > > >>><br>
> > > > > > ><br>
> > > > > ><br>
> > > ><br>
> > > ><br>
> > > ><br>
> > ><br>
> > ><br>
> ><br>
><br>
><br>
</div></div></blockquote></div><br></div>