[mpich-discuss] knight's ferry and opa

[Dave Goodell]

Hi Nick,

This issue has been fixed in more recent versions of OPA.  You might be able to cherry-pick the relevant changes into your local version.  The main commit that fixes this is r129:

http://trac.mcs.anl.gov/projects/openpa/changeset/129

However someone else took a run at it and made less efficient changes beforehand, so you will probably need to apply these patches first and then add in r129:

http://trac.mcs.anl.gov/projects/openpa/changeset/127
http://trac.mcs.anl.gov/projects/openpa/changeset/128

BTW, I don't think that the "--host" option is doing exactly what you think it's doing.  That's a cross-compile option for autoconf itself, which may or may not (probably not) have implications for what atomics implementation is selected.  The usual way to override the platform selection for OPA is to pass "--with-atomic-primitives=opa_gcc_intel_32_64_p3.h".  Obviously you can select a different header file from the src/primitives directory.

-Dave

On Feb 10, 2012, at 3:56 PM CST, Nick Radcliffe wrote:

> Hi,
> 
> Does anyone know how to compile MPICH2-1.4.1p1 so that it's possible to run MPI programs natively on the Mic co-processor (Knight's Ferry)? I'm able to compile the mpich2 library and an MPI program using the library (both using -mmic so that they can run natively on the Mic), but the program crashes in MPI_Init when I run it. In particular, it crashes during OPA_write_barrier. 
> 
> The particular instance of OPA_write_barrier being used is defined in opa_gcc_intel_32_64_p3barrier.h: 
> 
> #define OPA_write_barrier() __asm__ __volatile__ ( "sfence" ::: "memory" )
> 
> This instance of the barrier is being used because I have to use the --host option to get the configure script to run (--host=x86_64-linux, otherwise the script tries to run a program compiled for the Mic on a Xeon, and the config fails).
> 
> If anyone knows how to deal with this problem I would appreciate their advice.
> _______________________________________________
> mpich-discuss mailing list     mpich-discuss at mcs.anl.gov
> To manage subscription options or unsubscribe:
> https://lists.mcs.anl.gov/mailman/listinfo/mpich-discuss