<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html;charset=ISO-8859-1" http-equiv="Content-Type">
<title></title>
</head>
<body bgcolor="#ffffff" text="#000000">
I doubt its a bug in the JVM, its probably the application not closing
all the file/stream handles. For example, I ran into this problem
when I was using:<br>
<blockquote type="cite">
<pre>Process child = Runtime.getRuntime().exec(command);</pre>
</blockquote>
but not consuming and closing the stdout and stderr streams which get
created automatically when the child process gets created. Simply
setting child to null after the process exited did not close the
streams. This quickly lead to too many open file handles after a few
hundred exec() calls. I had to make a wrapper class of the Process
class that took care of consuming and closing the output streams by
default, and my problems went away.<br>
<br>
Just another idea of where to look for potential problems in the code.<br>
<br>
Ioan<br>
<br>
Mihael Hategan wrote:
<blockquote cite="mid:1203522133.2859.2.camel@blabla.mcs.anl.gov"
type="cite">
<blockquote type="cite">
<blockquote type="cite">
<pre wrap="">2. When runing a workflow which involves 1000nodes, I
encounter the following errors very frequently, but not all
the time:
</pre>
</blockquote>
<pre wrap="">[..]
</pre>
<blockquote type="cite">
<pre wrap=""> java.io.IOException: Too many open files
</pre>
</blockquote>
<pre wrap="">What machine are you running on? Have you changed any configuration
parameters? A basic 1000 job workflow should run fine with the default
settings.
On the machine you are running on, type ulimit -a and paste that here.
</pre>
</blockquote>
<pre wrap=""><!---->
There is some odd bug in the JVM. Some, and I don't remember exactly
which, classes related to time/date open time zone resource files
repeatedly and they forget to close them. If this is done fast enough
(faster than the garbage collector reaches those files which get closed
when finalized), you get this error.
It might be something else though.
_______________________________________________
Swift-user mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Swift-user@ci.uchicago.edu">Swift-user@ci.uchicago.edu</a>
<a class="moz-txt-link-freetext" href="http://mail.ci.uchicago.edu/mailman/listinfo/swift-user">http://mail.ci.uchicago.edu/mailman/listinfo/swift-user</a>
</pre>
</blockquote>
<br>
<pre class="moz-signature" cols="72">--
==================================================
Ioan Raicu
Ph.D. Candidate
==================================================
Distributed Systems Laboratory
Computer Science Department
University of Chicago
1100 E. 58th Street, Ryerson Hall
Chicago, IL 60637
==================================================
Email: <a class="moz-txt-link-abbreviated" href="mailto:iraicu@cs.uchicago.edu">iraicu@cs.uchicago.edu</a>
Web: <a class="moz-txt-link-freetext" href="http://www.cs.uchicago.edu/~iraicu">http://www.cs.uchicago.edu/~iraicu</a>
<a class="moz-txt-link-freetext" href="http://dev.globus.org/wiki/Incubator/Falkon">http://dev.globus.org/wiki/Incubator/Falkon</a>
<a class="moz-txt-link-freetext" href="http://www.ci.uchicago.edu/wiki/bin/view/VDS/DslCS">http://www.ci.uchicago.edu/wiki/bin/view/VDS/DslCS</a>
==================================================
==================================================
</pre>
</body>
</html>