<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <div class="moz-cite-prefix"><br>
      I will paste this into the sites guide.  Thanks!  <br>
      <br>
      Our automated test suites will not run on systems like Raven.  You
      can launch the tests individually if desired.  <br>
      <br>
      On 04/16/2013 04:20 AM, Scott Krieder wrote:<br>
    </div>
    <blockquote
cite="mid:CABp7gVxuocHDsou5Qw+oOhoVRYLDRNY5p+w_7roptL1CBzyF2g@mail.gmail.com"
      type="cite">
      <div dir="ltr">Hi All,
        <div><br>
        </div>
        <div style="">I'm down to 1 error on the Turbine install on
          Raven:</div>
        <div style=""><span style="font-family:Arial">p01684@raven:~/exm/turbine/trunk/code>
            make test_results</span><br>
        </div>
        <div style="">
          <p style="margin-bottom:0pt;margin-top:0pt"><font face="Arial"> 
              SH<span class="" style="white-space:pre"> </span>tests/lib-turbine.result</font></p>
          <p style="margin-bottom:0pt;margin-top:0pt"><font face="Arial">make:
              *** [tests/lib-turbine.result] Error 1</font></p>
          <p style="margin-bottom:0pt;margin-top:0pt"><font face="Arial">p01684@raven:~/exm/turbine/trunk/code>
              cat tests/lib-turbine.out </font></p>
          <p style="margin-bottom:0pt;margin-top:0pt"><font face="Arial">mpiexec:
               unexpected error - no non-PBS mpiexec in PATH</font></p>
          <p style="margin-bottom:0pt;margin-top:0pt"><font face="Arial"><br>
            </font></p>
          <p style="margin-bottom:0pt;margin-top:0pt"><font face="Arial">Has
              anyone seen this error on a Cray machine before?</font></p>
        </div>
        <div><br>
        </div>
        <div style="">Other than that error I have the Turbine stack
          installed on Raven. I'm still working to install stc, which I
          still need ant to install. Here are my notes:</div>
        <div style=""><br>
        </div>
        <div style="">I used the Cray notes from here:</div>
        <div style=""><a moz-do-not-send="true"
href="https://sites.google.com/site/exmproject/development/turbine---build">https://sites.google.com/site/exmproject/development/turbine---build</a><br>
        </div>
        <div style=""><br>
        </div>
        <div style="">On Raven use:</div>
        <div style=""><span
            style="font-family:arial,sans-serif;font-size:13px">/opt/cray/mpt/</span><span
            style="font-family:arial,sans-serif;font-size:13px">default/gni/mpich2-gnu/46</span><br>
        </div>
        <div style=""><br>
        </div>
        <div style="">
          <div style="font-family:arial,sans-serif;font-size:13px">For
            ADLB:
            <div>./configure --prefix=/home/users/p01684/Public/sfw/lb
              CC=gcc
              CFLAGS=-I/opt/cray/mpt/default/gni/mpich2-gnu/46/include
              LDFLAGS="-L/opt/cray/mpt/default/gni/mpich2-gnu/46/lib
              -lmpich"
              --with-c-utils=/home/users/p01684/Public/sfw/c-utils
              --enable-mpi-2<br>
            </div>
            <div><br>
            </div>
            <div>I modified the Makefile and swapped gcc for two
              instances of mpicc.</div>
            <div><br>
            </div>
          </div>
          <div style="font-family:arial,sans-serif;font-size:13px">I
            then installed SWIG from source with the configuration:</div>
          <div style="font-family:arial,sans-serif;font-size:13px"><b
              style="font-size:medium;font-family:Times;font-weight:normal">
              <p dir="ltr"
                style="line-height:1.15;margin-top:0pt;margin-bottom:0pt"><span
style="font-size:15px;font-family:Arial;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">./configure
                  --prefix=/home/users/p01684/Public/sfw/swig
                  --without-pcre</span></p>
            </b></div>
          <div style="font-family:arial,sans-serif;font-size:13px"><br>
          </div>
          <div style="font-family:arial,sans-serif;font-size:13px">I
            configure turbine with:</div>
          <div>
            <p dir="ltr"
style="font-family:Times;font-size:medium;line-height:1.15;margin-bottom:0pt;margin-top:0pt"><span
style="font-size:15px;font-family:Arial;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">./configure
                --prefix=/home/users/p01684/Public/sfw/turbine
                --with-mpi=/opt/cray/mpt/default/gni/mpich2-gnu/46</span></p>
            <p style="margin-bottom:0pt;margin-top:0pt"><font
                face="Arial"><br>
              </font></p>
            <p style="margin-bottom:0pt;margin-top:0pt"><font
                face="Arial">-Scott</font></p>
          </div>
        </div>
        <div class="gmail_extra"><br>
          <br>
          <div class="gmail_quote">
            On Tue, Apr 16, 2013 at 5:43 AM, Michael Wilde <span
              dir="ltr"><<a moz-do-not-send="true"
                href="mailto:wilde@mcs.anl.gov" target="_blank"
                onclick="window.open('https://mail.google.com/mail/?view=cm&tf=1&to=wilde@mcs.anl.gov&cc=&bcc=&su=&body=','_blank','location=yes,menubar=yes,resizable=yes,width=800,height=600');return
                false;">wilde@mcs.anl.gov</a>></span> wrote:<br>
            <blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">Scott,<br>
              <br>
              Were you able to get Swift/T running on Raven?<br>
              <br>
              If so, which version, and do you have an install there
              that I can use for my own tests (and to help get a demo
              ready and tested for Cray?)<br>
              <br>
              Tim, Justin, can you point me to a suggested Swift/T
              toolset on Beagle?<br>
              <br>
              Thanks,<br>
              <br>
              - Mike<br>
              <div class="">
                <div class="h5"><br>
                  <br>
                  ----- Original Message -----<br>
                  > From: "Scott Krieder" <<a
                    moz-do-not-send="true"
                    href="mailto:skrieder@iit.edu"
                    onclick="window.open('https://mail.google.com/mail/?view=cm&tf=1&to=skrieder@iit.edu&cc=&bcc=&su=&body=','_blank','location=yes,menubar=yes,resizable=yes,width=800,height=600');return
                    false;">skrieder@iit.edu</a>><br>
                  > To: "Justin M Wozniak" <<a
                    moz-do-not-send="true"
                    href="mailto:wozniak@mcs.anl.gov"
                    onclick="window.open('https://mail.google.com/mail/?view=cm&tf=1&to=wozniak@mcs.anl.gov&cc=&bcc=&su=&body=','_blank','location=yes,menubar=yes,resizable=yes,width=800,height=600');return
                    false;">wozniak@mcs.anl.gov</a>><br>
                  > Cc: <a moz-do-not-send="true"
                    href="mailto:exm-user@lists.mcs.anl.gov"
                    onclick="window.open('https://mail.google.com/mail/?view=cm&tf=1&to=exm-user@lists.mcs.anl.gov&cc=&bcc=&su=&body=','_blank','location=yes,menubar=yes,resizable=yes,width=800,height=600');return
                    false;">exm-user@lists.mcs.anl.gov</a><br>
                  > Sent: Friday, April 12, 2013 3:02:04 PM<br>
                  > Subject: Re: [ExM Users] Installing Swift/T on
                  Raven<br>
                  ><br>
                  ><br>
                  ><br>
                  > Hi Justin,<br>
                  ><br>
                  ><br>
                  ><br>
                  > For ADLB it doesn't recognize --with-mpi or
                  --with-mpi-dir in the<br>
                  > configure file. So I pointed both flags to use
                  the default:<br>
                  > ./configure
                  --prefix=/home/users/p01684/Public/sfw/lb CC=gcc<br>
                  >
                  CFLAGS=-I/opt/cray/mpt/default/gni/mpich2-gnu/46/include<br>
                  >
                  LDFLAGS="-L/opt/cray/mpt/default/gni/mpich2-gnu/46/lib
                  -lmpich"<br>
                  >
                  --with-c-utils=/home/users/p01684/Public/sfw/c-utils<br>
                  ><br>
                  ><br>
                  ><br>
                  > I modified the Makefile and swapped gcc for two
                  instances of mpicc.<br>
                  ><br>
                  ><br>
                  > I then installed SWIG from source with the
                  configuration:<br>
                  ><br>
                  ><br>
                  > ./configure
                  --prefix=/home/users/p01684/Public/sfw/swig<br>
                  > --without-pcre<br>
                  ><br>
                  ><br>
                  > I configure turbine with:<br>
                  ><br>
                  ><br>
                  > ./configure
                  --prefix=/home/users/p01684/Public/sfw/turbine<br>
                  >
                  --with-mpi=/opt/cray/mpt/default/gni/mpich2-gnu/46<br>
                  ><br>
                  ><br>
                  > However on "make package" there is an error with
                  one of the blob<br>
                  > header files:<br>
                  > p01684@raven:~/exm/turbine/trunk/code> make
                  package SWIG<br>
                  > src/tcl/blob/SwiftBlob.i src/tcl/blob/blob.h:25:
                  Warning 201: Unable<br>
                  > to find 'stdbool.h'<br>
                  ><br>
                  ><br>
                  ><br>
                  > Do you know if there is a module I can load so
                  swig can find the<br>
                  > stdbool.h?<br>
                  ><br>
                  ><br>
                  > Thank you,<br>
                  > Scott<br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  > On Fri, Apr 12, 2013 at 1:44 PM, Justin M Wozniak
                  <<br>
                  > <a moz-do-not-send="true"
                    href="mailto:wozniak@mcs.anl.gov"
                    onclick="window.open('https://mail.google.com/mail/?view=cm&tf=1&to=wozniak@mcs.anl.gov&cc=&bcc=&su=&body=','_blank','location=yes,menubar=yes,resizable=yes,width=800,height=600');return
                    false;">wozniak@mcs.anl.gov</a> > wrote:<br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  > That configure line points --prefix= ... /c-utils<br>
                  ><br>
                  > Also, CFLAGS=-I... should point to an include
                  directory.<br>
                  ><br>
                  > Try setting<br>
                  ><br>
                  >
                  --with-mpi=/opt/cray/mpt/default/gni/mpich2-gnu/46<br>
                  ><br>
                  > and let me know what happens. I will try to get
                  on Raven soon to test<br>
                  > this.<br>
                  ><br>
                  ><br>
                  ><br>
                  > On 04/12/2013 12:57 PM, Scott Krieder wrote:<br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  > Hi Justin,<br>
                  ><br>
                  > This is from a tarball from my machine where
                  GeMTC and Swift are<br>
                  > working, I haven't updated past version 6770.
                  Sorry to bounce around<br>
                  > with errors but I believe I had an earlier issue
                  with the<br>
                  > c-utils/adlb install that lead to this turbine
                  issue. When<br>
                  > configuring adlb I point it at the c-utils
                  install and I get an<br>
                  > error regarding the MPI version.<br>
                  ><br>
                  > I'm running:<br>
                  > ./configure
                  --prefix=/home/users/p01684/Public/c-utils CC=gcc<br>
                  >
                  --with-c-utils=/home/users/p01684/Public/sfw/c-utils<br>
                  > CFLAGS=-I/opt/cray/mpt/default/gni/mpich2-gnu/46<br>
                  >
                  LDFLAGS="-L/opt/cray/mpt/default/gni/mpich2-gnu/46/lib
                  -lmpich"<br>
                  ><br>
                  > I noticed that there are many folders in:<br>
                  > /opt/cray/mpt/<br>
                  ><br>
                  > Is there a good way to identify which version I
                  should use within<br>
                  > /opt/cray/mpt? Or am I wrong in assuming that
                  this versioning is<br>
                  > what is causing the "Could not preprocess
                  maint/mpi_version.cpp"<br>
                  > error?<br>
                  ><br>
                  > Thanks,<br>
                  > Scott<br>
                  ><br>
                  > ==error message==<br>
                  > checking for cp that supports -u... yes<br>
                  > using MPE: no<br>
                  > checking for<br>
                  >
                  /home/users/p01684/Public/sfw/c-utils/include/c-utils.h...
                  yes<br>
                  > using ExM c-utils in
                  /home/users/p01684/Public/sfw/c-utils ...<br>
                  > checking MPI version...
                  maint/mpi_version.cpp:23:17: error: mpi.h: No<br>
                  > such file or directory<br>
                  > configure: error: Could not preprocess
                  maint/mpi_version.cpp<br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  > On Fri, Apr 12, 2013 at 11:28 AM, Justin M
                  Wozniak <<br>
                  > <a moz-do-not-send="true"
                    href="mailto:wozniak@mcs.anl.gov"
                    onclick="window.open('https://mail.google.com/mail/?view=cm&tf=1&to=wozniak@mcs.anl.gov&cc=&bcc=&su=&body=','_blank','location=yes,menubar=yes,resizable=yes,width=800,height=600');return
                    false;">wozniak@mcs.anl.gov</a> > wrote:<br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  > Hi<br>
                  ><br>
                  > Is this with trunk or with the release package?<br>
                  ><br>
                  > --with-mpi-dir may have been replaced by
                  --with-mpi<br>
                  ><br>
                  > Justin<br>
                  ><br>
                  ><br>
                  > On 04/12/2013 11:05 AM, Scott Krieder wrote:<br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  > Hi All,<br>
                  ><br>
                  ><br>
                  > I'm trying to install Swift/T on Raven. I
                  followed the notes about<br>
                  > Cray systems.<br>
                  ><br>
                  ><br>
                  > When I configure turbine with:<br>
                  > ./configure
                  --prefix=/home/users/p01684/Public/sfw/turbine<br>
                  > --enable-custom<br>
                  >
                  --with-mpi-dir=/opt/cray/mpt/default/xt/gemini/mpich2-gnu/46<br>
                  ><br>
                  ><br>
                  ><br>
                  > I get a long error about "could not find
                  directory" in reference to<br>
                  > mpicc. Is there something I should do in addition
                  to the --with-mpi<br>
                  > flag?<br>
                  ><br>
                  ><br>
                  > Thanks,<br>
                  > Scott<br>
                  ><br>
                  ><br>
                  > ==Error Message==<br>
                  ><br>
                  > checking for<br>
                  >
                  /ufs/home/users/p01684/Public/sfw/c-utils/include/c-utils.h...
                  yes<br>
                  > which: no mpicc in<br>
                  >
(/opt/pbs/10.4.0.101257/bin:/opt/cray/atp/1.6.2/bin:/opt/cray/rca/1.0.0-2.0401.38656.2.2.gem/bin:/opt/cray/pmi/4.0.1-1.0000.9421.73.3.gem/bin:/opt/toolworks/totalview.8.11.0-1/bin:/opt/totalview-support/1.1.4/bin:/opt/cray/cce/8.1.4/cray-binutils/x86_64-unknown-linux-gnu/bin:/opt/cray/cce/8.1.4/craylibs/x86-64/bin:/opt/cray/cce/8.1.4/cftn/bin:/opt/cray/cce/8.1.4/CC/bin:/opt/cray/xt-asyncpe/5.20.11/bin:/opt/cray/llm/default/bin:/opt/cray/llm/default/etc:/opt/cray/xpmem/0.1-2.0401.36790.4.3.gem/bin:/opt/cray/dmapp/3.2.1-1.0401.5983.4.5.gem/bin:/opt/cray/ugni/4.0-1.0401.5928.9.5.gem/bin:/opt/cray/udreg/2.3.2-1.0401.5929.3.3.gem/bin:/opt/cray/lustre-cray_gem_s/1.8.6_2.6.32.59_0.7.1_1.0401.6845.9.1-1.0401.38658.11.3/sbin:/opt/cray/lustre-cray_gem_s/1.8.6_2.6.32.59_0.7.1_1.0401.6845.9.1-1.0401.38658.11.3/bin:/opt/cray/MySQL/5.0.64-1.0000.5053.22.1/sbin:/opt/cray/MySQL/5.0.64-1.0000.5053.22.1/bin:/opt/cray/sdb/1.0-1.0401.38148.4.27.gem/bin:/opt/cray/nodestat/2.<br>
                  > 2-1.0401. 37252.2.1.gem /bin:/opt /modules/<br>
                  > <a moz-do-not-send="true"
href="http://3.2.6.7/bin:/usr/local/bin:/usr/bin:/bin:/usr/bin/X11:/usr/X11R6/bin:/usr/games:/usr/lib64/jvm/jre/bin:/usr/lib/mit/bin:/usr/lib/mit/sbin:.:/usr/lib/qt3/bin:/opt/cray/bin"
                    target="_blank">3.2.6.7/bin:/usr/local/bin:/usr/bin:/bin:/usr/bin/X11:/usr/X11R6/bin:/usr/games:/usr/lib64/jvm/jre/bin:/usr/lib/mit/bin:/usr/lib/mit/sbin:.:/usr/lib/qt3/bin:/opt/cray/bin</a><br>
                  > )<br>
                  ><br>
                  ><br>
                  > ./configure: line 4032: ((: ! : syntax error:
                  operand expected (error<br>
                  > token is " ")<br>
                  > checking for 0... no<br>
                  > configure: error: Could not find directory<br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  > --<br>
                  > Scott J. Krieder<br>
                  ><br>
                  ><br>
                  > C: <a moz-do-not-send="true"
                    href="tel:419-685-0410" value="+14196850410">419-685-0410</a><br>
                  ><br>
                  > E: <a moz-do-not-send="true"
                    href="mailto:skrieder@iit.edu"
                    onclick="window.open('https://mail.google.com/mail/?view=cm&tf=1&to=skrieder@iit.edu&cc=&bcc=&su=&body=','_blank','location=yes,menubar=yes,resizable=yes,width=800,height=600');return
                    false;">skrieder@iit.edu</a><br>
                  ><br>
                  > <a moz-do-not-send="true"
                    href="http://datasys.cs.iit.edu/%7Eskrieder/"
                    target="_blank">http://datasys.cs.iit.edu/~skrieder/</a><br>
                  ><br>
                  ><br>
                  > _______________________________________________<br>
                  > ExM-user mailing list <a moz-do-not-send="true"
                    href="mailto:ExM-user@lists.mcs.anl.gov"
                    onclick="window.open('https://mail.google.com/mail/?view=cm&tf=1&to=ExM-user@lists.mcs.anl.gov&cc=&bcc=&su=&body=','_blank','location=yes,menubar=yes,resizable=yes,width=800,height=600');return
                    false;">ExM-user@lists.mcs.anl.gov</a><br>
                  > <a moz-do-not-send="true"
                    href="https://lists.mcs.anl.gov/mailman/listinfo/exm-user"
                    target="_blank">https://lists.mcs.anl.gov/mailman/listinfo/exm-user</a><br>
                  ><br>
                  > --<br>
                  > Justin M Wozniak<br>
                  ><br>
                  > _______________________________________________<br>
                  > ExM-user mailing list<br>
                  > <a moz-do-not-send="true"
                    href="mailto:ExM-user@lists.mcs.anl.gov"
                    onclick="window.open('https://mail.google.com/mail/?view=cm&tf=1&to=ExM-user@lists.mcs.anl.gov&cc=&bcc=&su=&body=','_blank','location=yes,menubar=yes,resizable=yes,width=800,height=600');return
                    false;">ExM-user@lists.mcs.anl.gov</a><br>
                  > <a moz-do-not-send="true"
                    href="https://lists.mcs.anl.gov/mailman/listinfo/exm-user"
                    target="_blank">https://lists.mcs.anl.gov/mailman/listinfo/exm-user</a><br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  ><br>
                  > --<br>
                  > Scott J. Krieder<br>
                  ><br>
                  ><br>
                  > C: <a moz-do-not-send="true"
                    href="tel:419-685-0410" value="+14196850410">419-685-0410</a><br>
                  ><br>
                  > E: <a moz-do-not-send="true"
                    href="mailto:skrieder@iit.edu"
                    onclick="window.open('https://mail.google.com/mail/?view=cm&tf=1&to=skrieder@iit.edu&cc=&bcc=&su=&body=','_blank','location=yes,menubar=yes,resizable=yes,width=800,height=600');return
                    false;">skrieder@iit.edu</a><br>
                  ><br>
                  > <a moz-do-not-send="true"
                    href="http://datasys.cs.iit.edu/%7Eskrieder/"
                    target="_blank">http://datasys.cs.iit.edu/~skrieder/</a><br>
                  ><br>
                  > --<br>
                  > Justin M Wozniak<br>
                  ><br>
                  ><br>
                  ><br>
                  > --<br>
                  > Scott J. Krieder<br>
                  ><br>
                  ><br>
                  > C: <a moz-do-not-send="true"
                    href="tel:419-685-0410" value="+14196850410">419-685-0410</a><br>
                  ><br>
                  > E: <a moz-do-not-send="true"
                    href="mailto:skrieder@iit.edu"
                    onclick="window.open('https://mail.google.com/mail/?view=cm&tf=1&to=skrieder@iit.edu&cc=&bcc=&su=&body=','_blank','location=yes,menubar=yes,resizable=yes,width=800,height=600');return
                    false;">skrieder@iit.edu</a><br>
                  ><br>
                  > <a moz-do-not-send="true"
                    href="http://datasys.cs.iit.edu/%7Eskrieder/"
                    target="_blank">http://datasys.cs.iit.edu/~skrieder/</a><br>
                  > _______________________________________________<br>
                  > ExM-user mailing list<br>
                  > <a moz-do-not-send="true"
                    href="mailto:ExM-user@lists.mcs.anl.gov"
                    onclick="window.open('https://mail.google.com/mail/?view=cm&tf=1&to=ExM-user@lists.mcs.anl.gov&cc=&bcc=&su=&body=','_blank','location=yes,menubar=yes,resizable=yes,width=800,height=600');return
                    false;">ExM-user@lists.mcs.anl.gov</a><br>
                  > <a moz-do-not-send="true"
                    href="https://lists.mcs.anl.gov/mailman/listinfo/exm-user"
                    target="_blank">https://lists.mcs.anl.gov/mailman/listinfo/exm-user</a><br>
                  ><br>
                </div>
              </div>
            </blockquote>
          </div>
          <br>
          <br clear="all">
          <div><br>
          </div>
          -- <br>
          <font face="Times" size="3">Scott J. Krieder<br>
          </font>
          <div>
            <div><font face="Times" size="3">C: 419-685-0410<br>
              </font>
              <div><font face="Times" size="3">E: <a
                    moz-do-not-send="true"
                    href="mailto:skrieder@iit.edu" target="_blank"
                    onclick="window.open('https://mail.google.com/mail/?view=cm&tf=1&to=skrieder@iit.edu&cc=&bcc=&su=&body=','_blank','location=yes,menubar=yes,resizable=yes,width=800,height=600');return
                    false;">skrieder@iit.edu</a><br>
                </font>
                <div><font face="Times" size="3"><a
                      moz-do-not-send="true"
                      href="http://datasys.cs.iit.edu/%7Eskrieder/"
                      target="_blank">http://datasys.cs.iit.edu/~skrieder/</a></font></div>
              </div>
            </div>
          </div>
        </div>
      </div>
    </blockquote>
    <br>
    <br>
    <pre class="moz-signature" cols="72">-- 
Justin M Wozniak
</pre>
  </body>
</html>