<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body>
<div dir="auto">
<div>There is a sort of citation for the increasing use of MPI in distributed ML/DL - Torsten has a recent paper on demystifying ML with a graph based on published papers. Not the same, but interesting.
<div dir="auto"><br>
</div>
<div dir="auto">On the health of HPC, sales figures are available (along with attendance at SC) and these show HPC is healthy if not growing at unsustainable rates :)</div>
<div dir="auto"><br>
</div>
<div dir="auto">Bill</div>
<br>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Mar 19, 2019 3:45 PM, "Smith, Barry F. via petsc-dev" <petsc-dev@mcs.anl.gov> wrote:<br type="attribution">
<blockquote class="quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div><font size="2"><span style="font-size:11pt">
<div><br>
<br>
> On Mar 19, 2019, at 12:27 AM, Mills, Richard Tran via petsc-dev <petsc-dev@mcs.anl.gov> wrote:<br>
> <br>
> I've seen this quite some time ago. Others in this thread have already articulated many of the same criticisms I have with the material in this blog post, as well as some of the problems that I have with MPI, so I'll content myself by asking the following:
<br>
> <br>
> If HPC is as dying as this guy says it is, then<br>
> <br>
> * Why did DOE just announce today that they are spending $500 million on the first (there are *more* coming?) US-based exascale computing system?<br>
<br>
Why was the acronym AI used more often than HPC during the presentation?<br>
<br>
> <br>
> * Why are companies like Intel, NVIDIA, Mellanox, etc., managing to sell so much HPC hardware?<br>
<br>
Citation<br>
> <br>
> and if it is all the fault of MPI, then<br>
> <br>
> * Why have a bunch of the big machine-learning shops actually been moving towards more use of MPI?<br>
<br>
Citation<br>
<br>
> <br>
> Yeah, MPI has plenty of warts. So does Fortran -- yet that hasn't killed scientific computing.<br>
> <br>
> --Richard<br>
> <br>
> On 3/17/19 1:12 PM, Smith, Barry F. via petsc-dev wrote:<br>
>> I stubbled on this today; I should have seen it years ago.<br>
>> <br>
>> Barry<br>
>> <br>
>> <br>
> <br>
<br>
</div>
</span></font></div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</body>
</html>