<div dir="ltr"><div dir="ltr">On Mon, Mar 30, 2020 at 9:28 PM Qin Lu <<a href="mailto:lu_qin_2000@yahoo.com">lu_qin_2000@yahoo.com</a>> wrote:<br></div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div style="font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px"></div><div style="font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px">
        </div><div style="font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px" dir="ltr">Hi,</div><div style="font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px" dir="ltr"><br></div><div style="font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px" dir="ltr">I installed Intel-MPI 2019, and configured <span><span style="font:400 12pt/115% "New serif";text-align:left;color:rgb(29,34,40);text-transform:none;text-indent:0px;letter-spacing:normal;text-decoration:none;word-spacing:0px;white-space:normal;float:none;background-color:rgb(255,255,255);display:inline">petsc-3.12.4 </span></span>using --with-mpi-dir="/cygdrive/c/Program Files (x86)/IntelSWTools/mpi/2019.6.166/intel64", it didn't work. So I change to use --with-mpi-include and --with-mpi-lib, still didn't work. The config.log is attached.</div><div style="font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px" dir="ltr"><br></div><div style="font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px" dir="ltr">The following is my configuration:</div><div style="font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px" dir="ltr">===============</div><div style="font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px" dir="ltr"><span style="text-align:left;color:rgb(29,34,40);text-transform:none;text-indent:0px;letter-spacing:normal;font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px;font-style:normal;font-variant:normal;font-weight:400;text-decoration:none;word-spacing:0px;white-space:normal;float:none;background-color:rgb(255,255,255);display:inline"> 
</span><div style="text-align:left;color:rgb(29,34,40);text-transform:none;text-indent:0px;letter-spacing:normal;font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px;font-style:normal;font-variant:normal;font-weight:400;text-decoration:none;word-spacing:0px;white-space:normal">
<p><span style="font-family:"New serif";font-size:12pt;line-height:115%">./configure --with-cc='win32fe icl' --with-fc='win32fe ifort' --with-cxx='win32fe icl' --with-petsc-arch="arch-win64-release-intel-mpi"
 --prefix=/cygdrive/c/cygwin_cache/petsc-3.12.4-release-win-64bit-intel-mpi --with-blas-lapack-dir="/cygdrive/c/Program Files (x86)/IntelSWTools/compilers_and_libraries_2018.5.274/windows/mkl/lib/intel64" --<span style="background-image:none;color:black;background-repeat:repeat;background-size:auto;background-color:white">with</span>-<span style="background-image:none;color:black;background-repeat:repeat;background-size:auto;background-color:white">mpi</span>-<span style="background-image:none;color:black;background-repeat:repeat;background-size:auto;background-color:white">include</span>="/cygdrive/c/Program
 Files (x86)/IntelSWTools/mpi/2019.6.166/intel64/include" --<span style="background-image:none;color:black;background-repeat:repeat;background-size:auto;background-color:white">with</span>-<span style="background-image:none;color:black;background-repeat:repeat;background-size:auto;background-color:white">mpi</span>-<span style="background-image:none;color:black;background-repeat:repeat;background-size:auto;background-color:white">lib</span>="/cygdrive/c/Program Files (x86)/IntelSWTools/mpi/2019.6.166/intel64/lib/impicxx.lib" 
 --<span style="background-image:none;color:black;background-repeat:repeat;background-size:auto;background-color:white">with</span>-<span style="background-image:none;color:black;background-repeat:repeat;background-size:auto;background-color:white">mpi</span>-<span style="background-image:none;color:black;background-repeat:repeat;background-size:auto;background-color:white">compilers=0
</span>--with-debugging=0 --useThreads=0 --with-x=0 --with-x11=0 --with-xt=0 --with-shared-libraries=0</span></p><p><span style="font-family:"New serif";font-size:12pt;line-height:115%">=============</span></p><p dir="ltr">Thanks for any suggestions.</p></div></div></div></blockquote><div>We just cannot cope with spaces in paths. Can you use the shortened contiguous name instead of "Program File"?<br></div><div><br></div><div>  Thanks,</div><div><br></div><div>    Matt</div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div style="font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px" dir="ltr"><div style="text-align:left;color:rgb(29,34,40);text-transform:none;text-indent:0px;letter-spacing:normal;font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px;font-style:normal;font-variant:normal;font-weight:400;text-decoration:none;word-spacing:0px;white-space:normal"><p dir="ltr">Regards,</p><p dir="ltr">Qin</p><p dir="ltr"><span style="font-family:"New serif";font-size:12pt;line-height:115%"><br></span></p><p><span style="font-family:"New serif";font-size:12pt;line-height:115%"><br></span></p></div></div><b></b><i></i><u></u><sub></sub><sup></sup><strike></strike><div style="font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px" dir="ltr"><br></div><div style="font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px"><b></b><i></i><u></u><sub></sub><sup></sup><strike></strike><br></div><div style="font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px">
        
        </div><div id="gmail-m_-7680463323080173135ydpa3f38fbcyahoo_quoted_6507870957">
            <div style="font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px;color:rgb(38,40,42)">
                
                <div>
                    On Monday, March 30, 2020, 04:15:14 PM CDT, Matthew Knepley <<a href="mailto:knepley@gmail.com" target="_blank">knepley@gmail.com</a>> wrote:
                </div>
                <div><br></div>
                <div><br></div>
                <div><div id="gmail-m_-7680463323080173135ydpa3f38fbcyiv0667977723"><div><div dir="ltr"><div dir="ltr">On Mon, Mar 30, 2020 at 4:43 PM Qin Lu via petsc-users <<a href="mailto:petsc-users@mcs.anl.gov" rel="nofollow" shape="rect" target="_blank">petsc-users@mcs.anl.gov</a>> wrote:<br clear="none"></div><div><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div></div><div>
        </div><div dir="ltr">Hi Satish,</div><div dir="ltr"><br clear="none"></div><div dir="ltr">The ex2.exe works with "mpiexec -np 2" when I ran it from command line. Then I ran "which mpiexec", it actually points to Intel-MPI instead of MPICH2, probably because I have set the former's path in environment variable PATH in Win-10. I will try to reinstall Intel-MPI and build Petsc with Intel-MPI.</div><div dir="ltr"><br clear="none"></div><div dir="ltr">As for the crash of calling to <span><span style="text-align:left;color:rgb(38,40,42);text-transform:none;text-indent:0px;letter-spacing:normal">KSPSetPCSide(ksp_solver,PC_RIGHT,ierr) in my Fortran-90 program, do you have any idea what can be wrong? Can it be related to MPI?</span></span></div><div dir="ltr"><span><span style="text-align:left;color:rgb(38,40,42);text-transform:none;text-indent:0px;letter-spacing:normal"><br clear="none"></span></span></div><div dir="ltr"><span><span style="text-align:left;color:rgb(38,40,42);text-transform:none;text-indent:0px;letter-spacing:normal">I tested <span><span style="text-align:left;color:rgb(38,40,42);text-transform:none;text-indent:0px;letter-spacing:normal">config/examples/arch-ci-mswin-intel.py</span></span> as you suggested, but got the following output:</span></span></div><div dir="ltr"><span><span style="text-align:left;color:rgb(38,40,42);text-transform:none;text-indent:0px;letter-spacing:normal"><br clear="none"></span></span></div><div dir="ltr"><span><span style="text-align:left;color:rgb(38,40,42);text-transform:none;text-indent:0px;letter-spacing:normal">============</span></span></div><div style="text-align:left;color:rgb(29,34,40);text-transform:none;text-indent:0px;letter-spacing:normal" dir="ltr">python ./arch-ci-mswin-intel.py</div><div dir="ltr"><span style="text-align:left;color:rgb(29,34,40);text-transform:none;text-indent:0px;letter-spacing:normal">
</span></div><div style="text-align:left;color:rgb(29,34,40);text-transform:none;text-indent:0px;letter-spacing:normal" dir="ltr">Traceback (most recent call last):</div><div dir="ltr"><span style="text-align:left;color:rgb(29,34,40);text-transform:none;text-indent:0px;letter-spacing:normal">
</span></div><div style="text-align:left;color:rgb(29,34,40);text-transform:none;text-indent:0px;letter-spacing:normal" dir="ltr">  File "./arch-ci-mswin-intel.py", line 10, in <module></div><div dir="ltr"><span style="text-align:left;color:rgb(29,34,40);text-transform:none;text-indent:0px;letter-spacing:normal">
</span></div><div style="text-align:left;color:rgb(29,34,40);text-transform:none;text-indent:0px;letter-spacing:normal" dir="ltr">    import configure</div><div dir="ltr"><span style="text-align:left;color:rgb(29,34,40);text-transform:none;text-indent:0px;letter-spacing:normal">
</span></div><div style="text-align:left;color:rgb(29,34,40);text-transform:none;text-indent:0px;letter-spacing:normal" dir="ltr">ImportError: No module named configure</div><div dir="ltr"><span><span style="text-align:left;color:rgb(38,40,42);text-transform:none;text-indent:0px;letter-spacing:normal">============</span></span></div></div></blockquote><div><br clear="none"></div><div>You have to run those from $PETSC_DIR.</div><div><br clear="none"></div><div>  Matt</div><div id="gmail-m_-7680463323080173135ydpa3f38fbcyiv0667977723yqtfd52740"><div> </div></div><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div id="gmail-m_-7680463323080173135ydpa3f38fbcyiv0667977723yqtfd62391"><div dir="ltr"><span><span style="text-align:left;color:rgb(38,40,42);text-transform:none;text-indent:0px;letter-spacing:normal">Thanks,</span></span></div><div dir="ltr"><span><span style="text-align:left;color:rgb(38,40,42);text-transform:none;text-indent:0px;letter-spacing:normal">Qin</span></span></div><div style="font-size:13px" dir="ltr"><b></b><i></i><u></u><sub></sub><sup></sup><strike></strike><font face="Helvetica Neue,Helvetica,Arial,sans-serif"></font><font face="Helvetica Neue,Helvetica,Arial,sans-serif"></font><font color="#007600"></font><br clear="none"></div><div style="font-size:13px" dir="ltr"><font face="Helvetica Neue,Helvetica,Arial,sans-serif"></font><br clear="none"></div><div style="font-size:13px" dir="ltr"><font face="Helvetica Neue,Helvetica,Arial,sans-serif"></font><br clear="none"></div><div style="font-size:13px" dir="ltr"><font face="Helvetica Neue,Helvetica,Arial,sans-serif">I will try to use Intel-MPI and see what will happen.</font></div><div style="font-size:13px" dir="ltr"><font face="Helvetica Neue,Helvetica,Arial,sans-serif"></font><br clear="none"></div><div style="font-size:13px" dir="ltr"><font face="Helvetica Neue,Helvetica,Arial,sans-serif">Thanks,</font></div><div style="font-size:13px" dir="ltr"><font face="Helvetica Neue,Helvetica,Arial,sans-serif">Qin</font></div><div style="font-size:13px"><font face="Helvetica Neue,Helvetica,Arial,sans-serif"></font><br clear="none"></div><div style="font-size:13px">
        
        <font face="Helvetica Neue,Helvetica,Arial,sans-serif"></font></div></div><div id="gmail-m_-7680463323080173135ydpa3f38fbcyiv0667977723gmail-m_4430975532148198158ydp8203ddc2yahoo_quoted_6157009348"><div id="gmail-m_-7680463323080173135ydpa3f38fbcyiv0667977723yqtfd73305">
            </div><div><div id="gmail-m_-7680463323080173135ydpa3f38fbcyiv0667977723yqtfd58855">
                
                <div><font face="Helvetica Neue,Helvetica,Arial,sans-serif">
                    </font><font color="#b00000"></font>On Monday, March 30, 2020, 01:47:49 PM CDT, Satish Balay <<a href="mailto:balay@mcs.anl.gov" rel="nofollow" shape="rect" target="_blank">balay@mcs.anl.gov</a>> wrote:
                </div>
                <div><br clear="none"></div>
                <div><br clear="none"></div>
                </div><div><div dir="ltr"><div id="gmail-m_-7680463323080173135ydpa3f38fbcyiv0667977723yqtfd15598">Please preserve cc: to the list<br clear="none"><br clear="none">>  shared libraries: disabled<br clear="none"><br clear="none">So PETSc  is correctly built as static.<br clear="none"><br clear="none">> > C:/Program Files/mpich2x64/bin/mpiexec.exe: error while loading shared libraries: ?: cannot open shared object file: No such file or directory<br clear="none"><br clear="none">So its not clear which shared library this error is referring to. But then - this error was with petsc-3.4.2<br clear="none"><br clear="none">You can always try to run the code manually without mpiexec - and see if that works.<br clear="none"><br clear="none">cd src/ksp/ksp/examples/tutorials<br clear="none">make ex2<br clear="none">./ex2<br clear="none"><br clear="none">Wrt MSMPI - yes its free to download<br clear="none"><br clear="none">And PETSc does work with Intel-MPI. It might be a separate download/install. [so I can't say if what you have is the correct install of IntelMPI or not]<br clear="none"><br clear="none">Check the builds we use for testing - for ex: config/examples/arch-ci-mswin-*.py<br clear="none"><br clear="none">Satish<br clear="none"></div><div id="gmail-m_-7680463323080173135ydpa3f38fbcyiv0667977723gmail-m_4430975532148198158ydp8203ddc2yqtfd16568"><div id="gmail-m_-7680463323080173135ydpa3f38fbcyiv0667977723yqtfd69598"><br clear="none">On Mon, 30 Mar 2020, Qin Lu wrote:<br clear="none"><br clear="none">>  Hi Satish,<br clear="none">> The configure.log and RDict.log of  Petsc-3.12.4 build is attached.<br clear="none">> Is the MSMPI free to use in Windows-10?<br clear="none">> Does Petsc support Intel-MPI? I have it in my machine, but for some reason I only find the /mpi/intel64/bin, but not /mpi/intel64/include subdirectory of it.<br clear="none">> Thanks a lot for your help.Qin<br clear="none">>     On Monday, March 30, 2020, 12:26:09 PM CDT, Satish Balay <<a href="mailto:balay@mcs.anl.gov" rel="nofollow" shape="rect" target="_blank">balay@mcs.anl.gov</a>> wrote:  <br clear="none">>  <br clear="none">>  MPICH is unsupported - and we haven't tested with it for a long time.<br clear="none">> <br clear="none">> And petsc-3.4.2 is from 2013 - and untested with current gen os/compilers/libraries.<br clear="none">> <br clear="none">> Can you send logs from Petsc-3.12.4 build [or try latest Petsc-3.13.0]?<br clear="none">> <br clear="none">> We recommend 64bit MSMPI for windows.<br clear="none">> <br clear="none">> Satish<br clear="none">> <br clear="none">> On Mon, 30 Mar 2020, Qin Lu via petsc-users wrote:<br clear="none">> <br clear="none">> > Hello, <br clear="none">> > I am trying to build Petsc-3.4.2 in my Windows-10 workstation using Cygwin, with Intel-2018 compilers and MKL, and MPICH2. The configuration/compilation/installation seem to finish without problem, but test program (ex19) failed since it could not find a shared lib. Then I linked the libpetsc.lib with my program (in Fortran-90), but it got run time crash when it calls KSPSetPCSide(ksp_solver,PC_RIGHT,ierr) or other Petsc subroutines. Note that this package was built, tested and worked well with the same Fortran-90 program in my Windows-7 workstation. <br clear="none">> >  <br clear="none">> > Also tried Petsc-3.12.4 but got the same errors.<br clear="none">> >  <br clear="none">> > The following is my configuration:<br clear="none">> > <br clear="none">> >  <br clear="none">> > ===============<br clear="none">> >  <br clear="none">> > ./configure --with-cc='win32fe icl' --with-fc='win32fe ifort' --with-cxx='win32fe icl' --with-petsc-arch="arch-win64-release" --prefix=/cygdrive/c/cygwin_cache/petsc-3.4.2-release-win-64bit --with-blas-lapack-dir="/cygdrive/c/Program Files (x86)/IntelSWTools/compilers_and_libraries_2018.5.274/windows/mkl/lib/intel64" --with-mpi-dir="/cygdrive/c/Program Files/mpich2x64" --with-debugging=0 --useThreads=0 --with-x=0 --with-x11=0 --with-xt=0 --with-shared-libraries=0<br clear="none">> >  <br clear="none">> > ===============<br clear="none">> > <br clear="none">> >  <br clear="none">> > The error message of running ex19 is:<br clear="none">> > <br clear="none">> >  <br clear="none">> > =================<br clear="none">> >  <br clear="none">> > $ make PETSC_DIR=/cygdrive/c/cygwin_cache/petsc-3.4.2-debug-win-64bit test<br clear="none">> >  <br clear="none">> > Running test examples to verify correct installation<br clear="none">> >  <br clear="none">> > Using PETSC_DIR=/cygdrive/c/cygwin_cache/petsc-3.4.2-debug-win-64bit and PETSC_ARCH=arch-win64-debug<br clear="none">> >  <br clear="none">> > Possible error running C/C++ src/snes/examples/tutorials/ex19 with 1 MPI process<br clear="none">> >  <br clear="none">> > See <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html" rel="nofollow" shape="rect" target="_blank">http://www.mcs.anl.gov/petsc/documentation/faq.html</a><br clear="none">> >  <br clear="none">> > C:/Program Files/mpich2x64/bin/mpiexec.exe: error while loading shared libraries: ?: cannot open shared object file: No such file or directory<br clear="none">> >  <br clear="none">> > =================<br clear="none">> > <br clear="none">> >  <br clear="none">> > Thanks a lot for any suggestions.<br clear="none">> > <br clear="none">> >  <br clear="none">> > Best Regards,<br clear="none">> >  <br clear="none">> > Qin</div><br clear="none">> >  <br clear="none">> >   <br clear="none">> >  <br clear="none">> >   <br clear="none">> >      </div></div></div>
            </div>
        </div></div></blockquote></div><br clear="all"><div><br clear="none"></div>-- <br clear="none"><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div>What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br clear="none">-- Norbert Wiener</div><div><br clear="none"></div><div><a href="http://www.cse.buffalo.edu/~knepley/" rel="nofollow" shape="rect" target="_blank">https://www.cse.buffalo.edu/~knepley/</a><div id="gmail-m_-7680463323080173135ydpa3f38fbcyiv0667977723yqtfd12135"><br clear="none"></div></div></div></div></div></div></div></div></div></div></div></div>
            </div>
        </div></div></blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div>What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br>-- Norbert Wiener</div><div><br></div><div><a href="http://www.cse.buffalo.edu/~knepley/" target="_blank">https://www.cse.buffalo.edu/~knepley/</a><br></div></div></div></div></div></div></div></div>