<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META http-equiv=Content-Type content="text/html; charset=us-ascii">
<META content="MSHTML 6.00.6000.16705" name=GENERATOR>
<STYLE>@font-face {
font-family: Batang;
}
@font-face {
font-family: SimSun;
}
@font-face {
font-family: Tahoma;
}
@font-face {
font-family: Lucida Console;
}
@font-face {
font-family: @SimSun;
}
@font-face {
font-family: @Batang;
}
@page Section1 {size: 612.0pt 792.0pt; margin: 72.0pt 90.0pt 72.0pt 90.0pt; }
P.MsoNormal {
FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"
}
LI.MsoNormal {
FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"
}
DIV.MsoNormal {
FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"
}
A:link {
COLOR: blue; TEXT-DECORATION: underline
}
SPAN.MsoHyperlink {
COLOR: blue; TEXT-DECORATION: underline
}
A:visited {
COLOR: purple; TEXT-DECORATION: underline
}
SPAN.MsoHyperlinkFollowed {
COLOR: purple; TEXT-DECORATION: underline
}
SPAN.EmailStyle17 {
COLOR: navy; FONT-FAMILY: Arial
}
DIV.Section1 {
page: Section1
}
</STYLE>
<DEFANGED_META content="text/html; charset=us-ascii"
http-equiv="Content-Type"><DEFANGED_META content="MSHTML 6.00.6000.16705"
name="GENERATOR"><!-- <DEFANGED_STYLE>@font-face {
font-family: Batang;
}
@font-face {
font-family: SimSun;
}
@font-face {
font-family: Tahoma;
}
@font-face {
font-family: Lucida Console;
}
@font-face {
font-family: @Batang;
}
@font-face {
font-family: @SimSun;
}
@page Section1 {size: 612.0pt 792.0pt; margin: 72.0pt 90.0pt 72.0pt 90.0pt; }
P.MsoNormal {
FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"
}
LI.MsoNormal {
FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"
}
DIV.MsoNormal {
FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"
}
A:link {
COLOR: blue; TEXT-DECORATION: underline
}
SPAN.MsoHyperlink {
COLOR: blue; TEXT-DECORATION: underline
}
A:visited {
COLOR: purple; TEXT-DECORATION: underline
}
SPAN.MsoHyperlinkFollowed {
COLOR: purple; TEXT-DECORATION: underline
}
SPAN.EmailStyle17 {
COLOR: navy; FONT-FAMILY: Arial
}
DIV.Section1 {
page: Section1
}
OL {
MARGIN-BOTTOM: 0cm
}
UL {
MARGIN-BOTTOM: 0cm
}
--></DEFANGED_STYLE><DEFANGED_META content="text/html; charset=us-ascii"
http-equiv="Content-Type"><DEFANGED_META content="MSHTML 6.00.6000.16674"
name="GENERATOR"><!-- <DEFANGED_STYLE>@font-face {
font-family: Batang;
}
@font-face {
font-family: SimSun;
}
@font-face {
font-family: Lucida Console;
}
@font-face {
font-family: @Batang;
}
@font-face {
font-family: @SimSun;
}
@page Section1 {size: 612.0pt 792.0pt; margin: 72.0pt 90.0pt 72.0pt 90.0pt; }
P.MsoNormal {
FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"
}
LI.MsoNormal {
FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"
}
DIV.MsoNormal {
FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"
}
A:link {
COLOR: blue; TEXT-DECORATION: underline
}
SPAN.MsoHyperlink {
COLOR: blue; TEXT-DECORATION: underline
}
A:visited {
COLOR: purple; TEXT-DECORATION: underline
}
SPAN.MsoHyperlinkFollowed {
COLOR: purple; TEXT-DECORATION: underline
}
SPAN.EmailStyle17 {
COLOR: windowtext; FONT-FAMILY: Arial
}
DIV.Section1 {
page: Section1
}
OL {
MARGIN-BOTTOM: 0cm
}
UL {
MARGIN-BOTTOM: 0cm
}
--></DEFANGED_STYLE></HEAD>
<BODY lang=EN-US vLink=purple link=blue>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008>Hi,</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008> To use multiple nodes/hosts/machines to run your
MPI application,</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008></SPAN></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008>=========== SETUP =================</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008><SPAN class=475193816-27082008># Install MPICH2 on all
the machines/hosts/nodes involved.</SPAN></SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008><SPAN
class=475193816-27082008></SPAN></SPAN></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008>=========== TESTING YOUR SETUP
================</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008></SPAN></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008># Try running a non-MPI program using the
"-machinefile" option of mpiexec (List the ipaddresses/hostnames(Try ipaddresses
first) of the machines in the machinefile ). See the windows developer's guide
for details on using the "-machinefile" option.</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008></SPAN></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008> --- Try running,
</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008></SPAN></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008>
mpiexec -n 2 -machinefile my_machine_file.txt hostname</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008></SPAN></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008># If you run hostname as mentioned in the prev step
using mpiexec, you should see the hostnames of the indiv machines
listed.</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008># Now try running
cpi.exe (MPICH2\examples\cpi.exe) using the "-machinefile" option of
mpiexec.</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008></SPAN></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008>=========== RUNNING YOUR PROGRAM
=============</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008></SPAN></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008># Make your application available on all the
machines</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008></SPAN></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008> 1) You can copy your application to the
same location on all the machines (Try this first)</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008>
OR</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008></SPAN></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008> 2) You can copy your application to diff
locations in each machine and use the "-path" option in mpiexec to specify the
path in each machine (see the windows developer's guide for
details)</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008>
OR</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008></SPAN></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008> 3) Use the "-map" or "-mapall"
option of mpiexec to map the directory containing the executable on all the
machines (see the windows developer's guide for details)</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008></SPAN></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008># Run your MPI program using the "-machinefile" option
of mpiexec (List the ipaddresses/hostnames(Try ipaddresses first) of the
machines in the machinefile )</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008></SPAN></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008> Let us know if you need further
help.</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008></SPAN></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008>(PS: By the way, if you have 2 CPUs in your machine if
you run your MPI application with more than 1 process, the OS schedules the
processes to use both processors.)</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008></SPAN></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008>Regards,</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=475193816-27082008>Jayesh</SPAN></FONT></DIV><BR>
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> Hyoun-Tae [mailto:hthwang@uwaterloo.ca]
<BR><B>Sent:</B> Wednesday, August 27, 2008 11:33 AM<BR><B>To:</B> 'Jayesh
Krishna'<BR><B>Subject:</B> RE: Questions about connecting other computers
(using other CPUs)<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV class=Section1>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">HI Jayesh,
</SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial"></SPAN></FONT> </P>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">My computer has only 2
CPUs so I cannot find any advantages for using MPI application.
</SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Now I’m trying to
connect other computers to use CPUs for my MPI code. </SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial"></SPAN></FONT> </P>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Could you tell me how I
can connect with other computers and apply my MPI code?</SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Regards,
</SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial"></SPAN></FONT> </P>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Hyoun-Tae</SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial"></SPAN></FONT> </P>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial"></SPAN></FONT> </P>
<DIV>
<P class=MsoNormal><FONT face=Arial color=#999999 size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">**********************************************************************</SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=#999999 size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">Hyoun-Tae Hwang
</SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=#999999 size=3><SPAN
style="FONT-SIZE: 12pt; COLOR: #999999; FONT-FAMILY: Arial"></SPAN></FONT> </P>
<P class=MsoNormal><FONT face=Arial color=#999999 size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">#2051 EIT,
Department of Earth and Environmental Sci</SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=#999999 size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">University</SPAN></FONT><FONT
face=Arial color=#999999 size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial"> of
</SPAN></FONT><FONT face=Arial color=#999999 size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">Waterloo</SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=#999999 size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">office : (+1)
519-888-4567 (EXT.
37343)
</SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=#999999 size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">home : (+1)
519-880-9794 </SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=#999999 size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">**********************************************************************</SPAN></FONT></P></DIV>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face=Tahoma size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Tahoma">-----Original
Message-----<BR><B><SPAN style="FONT-WEIGHT: bold">From:</SPAN></B> Jayesh
Krishna [mailto:jayesh@mcs.anl.gov] <BR><B><SPAN
style="FONT-WEIGHT: bold">Sent:</SPAN></B> August 18, 2008 1:58 PM<BR><B><SPAN
style="FONT-WEIGHT: bold">To:</SPAN></B> 'Hyoun-Tae'<BR><B><SPAN
style="FONT-WEIGHT: bold">Subject:</SPAN></B> RE: Questions about MPI
application</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face="Times New Roman"
size=3><SPAN style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face=Arial color=blue
size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial">Hi,</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face=Arial color=blue
size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial"> Great! Let us
know if you need any further help.</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face="Times New Roman"
size=3><SPAN style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face=Arial color=blue
size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial">Regards,</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face=Arial color=blue
size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial">Jayesh</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face="Times New Roman"
size=3><SPAN style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<DIV class=MsoNormal style="MARGIN-LEFT: 36pt; TEXT-ALIGN: center"
align=center><FONT face="Times New Roman" size=3><SPAN style="FONT-SIZE: 12pt">
<HR align=center width="100%" SIZE=2>
</SPAN></FONT></DIV>
<P class=MsoNormal
style="MARGIN-BOTTOM: 12pt; MARGIN-LEFT: 36pt; MARGIN-RIGHT: 0cm"><B><FONT
face=Tahoma size=2><SPAN
style="FONT-WEIGHT: bold; FONT-SIZE: 10pt; FONT-FAMILY: Tahoma">From:</SPAN></FONT></B><FONT
face=Tahoma size=2><SPAN style="FONT-SIZE: 10pt; FONT-FAMILY: Tahoma"> Hyoun-Tae
[mailto:hthwang@uwaterloo.ca] <BR><B><SPAN
style="FONT-WEIGHT: bold">Sent:</SPAN></B> Monday, August 18, 2008 12:57
PM<BR><B><SPAN style="FONT-WEIGHT: bold">To:</SPAN></B> 'Jayesh
Krishna'<BR><B><SPAN style="FONT-WEIGHT: bold">Subject:</SPAN></B> RE: Questions
about MPI application</SPAN></FONT></P>
<DIV>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face=Arial color=navy
size=2><SPAN style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Hello,
</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face="Times New Roman"
size=3><SPAN style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face=Arial color=navy
size=2><SPAN style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Thanks for
your help. As you said, I debugged my code. </SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face=Arial color=navy
size=2><SPAN style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">I finally
got right results. It really works!</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face=Arial color=navy
size=2><SPAN style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">I
appreciate your help. </SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face="Times New Roman"
size=3><SPAN style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face=Arial color=navy
size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">HT</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face="Times New Roman"
size=3><SPAN style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<DIV>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face=Arial color=#999999
size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">**********************************************************************</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face=Arial color=#999999
size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">Hyoun-Tae Hwang
</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face="Times New Roman"
size=3><SPAN style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face=Arial color=#999999
size=2><SPAN style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">#2051
EIT, Department of Earth and Environmental Sci</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face=Arial color=#999999
size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">University of
Waterloo</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face=Arial color=#999999
size=2><SPAN style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">office
: (+1) 519-888-4567 (EXT.
37343)
</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face=Arial color=#999999
size=2><SPAN style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">home :
(+1) 519-880-9794 </SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face=Arial color=#999999
size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">**********************************************************************</SPAN></FONT></P></DIV>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"><FONT face="Times New Roman"
size=3><SPAN style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Tahoma size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Tahoma">-----Original
Message-----<BR><B><SPAN DEFANGED_STYLE="FONT-WEIGHT: bold"><SPAN
style="FONT-WEIGHT: bold">From:</SPAN></SPAN></B> Jayesh Krishna
[mailto:jayesh@mcs.anl.gov] <BR><B><SPAN
style="FONT-WEIGHT: bold">Sent:</SPAN></B> August 14, 2008 12:37 PM<BR><B><SPAN
style="FONT-WEIGHT: bold">To:</SPAN></B> 'Hyoun-Tae'<BR><B><SPAN
style="FONT-WEIGHT: bold">Cc:</SPAN></B> mpich-discuss@mcs.anl.gov<BR><B><SPAN
style="FONT-WEIGHT: bold">Subject:</SPAN></B> RE: Questions about MPI
application</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial color=blue size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial">Hi,</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial color=blue size=2><SPAN
DEFANGED_STYLE="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial"><SPAN
style="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial"> The error
"</SPAN></SPAN></FONT><FONT face=Arial color=red size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: red; FONT-FAMILY: Arial">Error creating mpiexec
process</SPAN></FONT><FONT face=Arial color=blue size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial">" indicates that you
have tried to run a singleton MPI process without mpiexec in the PATH. Make
sure that you have mpiexec in your PATH (more precisely the path to mpiexec in
your PATH env variable) when running an MPI process as a singleton process
(singleton process - process launched without mpiexec - when you run your MPI
process in the VS command window). To get rid of the error I would recommend
that you run your MPI application from a command window using mpiexec OR run
your MPI application from a command window without mpiexec but making sure
that path to mpiexec (typically c:\program files\mpich2\bin) is in the
PATH.</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial color=blue size=2><SPAN
DEFANGED_STYLE="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial"><SPAN
style="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial"> The error
"</SPAN></SPAN></FONT><FONT face="Lucida Console" color=red size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: red; FONT-FAMILY: 'Lucida Console'">process 0
exited without calling finalize</SPAN></FONT><FONT face=Arial color=blue
size=2><SPAN
DEFANGED_STYLE="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial"><SPAN
style="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial">" can happen due to
many reasons (Basically the error just says that the MPI process exited before
calling MPI_Finalize()). Most likely it is due to an error in the application
resulting in a segfault, aborting the job. I would recommend that, to start with
your debugging, you run your application using mpiexec from a command prompt and
try debugging the application with some debug
statements.</SPAN></SPAN></FONT></P>
<DIV>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial color=blue size=2><SPAN
DEFANGED_STYLE="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial"><SPAN
style="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial"> Let us know if
you need further assistance</SPAN></SPAN></FONT></P></DIV>
<DIV>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P></DIV>
<DIV>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial color=blue size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial">Regards,</SPAN></FONT></P></DIV>
<DIV>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial color=blue size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial">Jayesh</SPAN></FONT></P></DIV>
<DIV>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P></DIV>
<DIV>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P></DIV>
<DIV class=MsoNormal style="MARGIN-LEFT: 36pt; TEXT-ALIGN: center"
align=center><FONT face="Times New Roman" size=3><SPAN style="FONT-SIZE: 12pt">
<HR align=center width="100%" SIZE=2>
</SPAN></FONT></DIV>
<P class=MsoNormal style="MARGIN-BOTTOM: 12pt; MARGIN-LEFT: 72pt"><B><FONT
face=Tahoma size=2><SPAN
style="FONT-WEIGHT: bold; FONT-SIZE: 10pt; FONT-FAMILY: Tahoma">From:</SPAN></FONT></B><FONT
face=Tahoma size=2><SPAN
DEFANGED_STYLE="FONT-SIZE: 10pt; FONT-FAMILY: Tahoma"><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Tahoma"> Hyoun-Tae
[mailto:hthwang@uwaterloo.ca] <BR><B><SPAN
style="FONT-WEIGHT: bold">Sent:</SPAN></B> Thursday, August 14, 2008 10:47
AM<BR><B><SPAN DEFANGED_STYLE="FONT-WEIGHT: bold"><SPAN
style="FONT-WEIGHT: bold">To:</SPAN></SPAN></B> jayesh@mcs.anl.gov<BR><B><SPAN
DEFANGED_STYLE="FONT-WEIGHT: bold"><SPAN
style="FONT-WEIGHT: bold">Subject:</SPAN></SPAN></B> Questions about MPI
application</SPAN></SPAN></FONT></P>
<DIV>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">Hello Jayesh, </SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">I just make an MPI application code,
which solves non-linear PDEs. </SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">Of the code, I applied parallel
computing method only on a matrix solver, Thomas algorithm. </SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">The scheme of my program follows
as:</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 72pt; TEXT-INDENT: -18pt"><FONT
face="Times New Roman" size=3><SPAN DEFANGED_STYLE="FONT-SIZE: 12pt"><SPAN
style="FONT-SIZE: 12pt">1.</SPAN></FONT><FONT size=1><SPAN
style="FONT-SIZE: 7pt"> </SPAN></SPAN></FONT><FONT
face=Arial size=2><SPAN style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">read input
data</SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 72pt; TEXT-INDENT: -18pt"><FONT
face="Times New Roman" size=3><SPAN DEFANGED_STYLE="FONT-SIZE: 12pt"><SPAN
style="FONT-SIZE: 12pt">2.</SPAN></FONT><FONT size=1><SPAN
style="FONT-SIZE: 7pt"> </SPAN></SPAN></FONT><FONT
face=Arial size=2><SPAN style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">make a
matrix</SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 72pt; TEXT-INDENT: -18pt"><FONT
face="Times New Roman" size=3><SPAN DEFANGED_STYLE="FONT-SIZE: 12pt"><SPAN
style="FONT-SIZE: 12pt">3.</SPAN></FONT><FONT size=1><SPAN
style="FONT-SIZE: 7pt"> </SPAN></SPAN></FONT><FONT
face=Arial size=2><SPAN style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">solve the
matrix by using parallel method </SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 72pt; TEXT-INDENT: -18pt"><FONT
face="Times New Roman" size=3><SPAN DEFANGED_STYLE="FONT-SIZE: 12pt"><SPAN
style="FONT-SIZE: 12pt">4.</SPAN></FONT><FONT size=1><SPAN
style="FONT-SIZE: 7pt"> </SPAN></SPAN></FONT><FONT
face=Arial size=2><SPAN style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">print
output</SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">As mentioned before, I just
parallelized only the matrix solver. </SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">I compiled the application code by
using MS visual studio 2005 </SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">and executed the application code
with using MPIEXEC wrapper. </SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">However, I always got an error
massage like (I’m using 2 CPUs)</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Lucida Console" color=red
size=1><SPAN
style="FONT-SIZE: 9pt; COLOR: red; FONT-FAMILY: 'Lucida Console'">job
aborted:</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Lucida Console" color=red
size=1><SPAN
style="FONT-SIZE: 9pt; COLOR: red; FONT-FAMILY: 'Lucida Console'">rank: node:
exit code[: error message]</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Lucida Console" color=red
size=1><SPAN
style="FONT-SIZE: 9pt; COLOR: red; FONT-FAMILY: 'Lucida Console'">0: hthwang:
-1073741819: process 0 exited without calling finalize</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Lucida Console" color=red
size=1><SPAN
style="FONT-SIZE: 9pt; COLOR: red; FONT-FAMILY: 'Lucida Console'">1: hthwang:
-1073741819: process 1 exited without calling finalize</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">Could you tell me why I always get
the error message and how I can solve this problem?</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">When I compile the code by using MS
visual studio 2005, </SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">I also get a message on a command
window such as:</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial color=red size=2><SPAN
DEFANGED_STYLE="FONT-SIZE: 10pt; COLOR: red; FONT-FAMILY: Arial"><SPAN
style="FONT-SIZE: 10pt; COLOR: red; FONT-FAMILY: Arial">[0] Error creating
mpiexec process …2</SPAN></SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial color=red size=2><SPAN
DEFANGED_STYLE="FONT-SIZE: 10pt; COLOR: red; FONT-FAMILY: Arial"><SPAN
style="FONT-SIZE: 10pt; COLOR: red; FONT-FAMILY: Arial">[0] launchMpiexecProcess
failed</SPAN></SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial color=red size=2><SPAN
DEFANGED_STYLE="FONT-SIZE: 10pt; COLOR: red; FONT-FAMILY: Arial"><SPAN
style="FONT-SIZE: 10pt; COLOR: red; FONT-FAMILY: Arial">Fatal error in MPI_Init:
Other MPI error, error stack:</SPAN></SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial color=red size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: red; FONT-FAMILY: Arial">MPIR_Init_thread(294):
Initialization failed</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial color=red size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: red; FONT-FAMILY: Arial">MPID_Init(82)…………:
channel initialization failed</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial color=red size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: red; FONT-FAMILY: Arial">MPID_Init(383)………..:
PMI_Get_id returned 1</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">Is this error after compilation
related to MPI application error?</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">Could you tell me how I can solve
these problems?</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">I can send the MPI application code
if you need.</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">Thank you, </SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">HT</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial color=#999999 size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">**********************************************************************</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial color=#999999 size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">Hyoun-Tae Hwang
</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial color=#999999 size=2><SPAN
DEFANGED_STYLE="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial"><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">#2051 EIT,
Department of Earth and Environmental Sci</SPAN></SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial color=#999999 size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">University of
Waterloo</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial color=#999999 size=2><SPAN
DEFANGED_STYLE="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial"><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">office : (+1)
519-888-4567 (EXT.
37343)
</SPAN></SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial color=#999999 size=2><SPAN
DEFANGED_STYLE="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial"><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">home : (+1)
519-880-9794 </SPAN></SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face=Arial color=#999999 size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: #999999; FONT-FAMILY: Arial">**********************************************************************</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 36pt"
DEFANGED_STYLE="MARGIN-LEFT: 36pt"><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"></SPAN></FONT> </P></DIV></DIV></DIV></BODY></HTML>