<!DOCTYPE html><html><head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<style type="text/css">body { font-family:'Helvetica'; font-size:12px}</style>
</head>
<body lang="EN-US" link="blue" vlink="purple"><div>Hi,</div><div><br></div><div>I'd say it's the garbing process. The garbage collector is copying, so it first allocates a big chunk of memory then copies the non-garbage data there from the old heap. So it's always a likely suspect.</div><div><br></div><div>All other processes in the below table are waiting. So they are not running, thus not allocating memory either. Which means it's either the garbing process or one of the 31 scheduled, but since they don't use too much memory they are not likely to cause trouble.</div><div><br></div><div>Regards,</div><div>Daniel</div><div><br></div><div>On Mon, 17 Mar 2014 09:51:13 +0100, József Bérces <jozsef.berces@ericsson.com> wrote:<br></div><br><blockquote style="margin: 0 0 0.80ex; border-left: #0000FF 2px solid; padding-left: 1ex">
<div class="WordSection1">
<p class="MsoNormal">I receive the classic “eheap_alloc: Cannot allocate…” message. It wants to allocate ~1GB memory and that fails. That is fine, I am doing something wrong. So I took the crash dump and tried to find out which one of my processes is the guilty
one. </p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Unfortunately, I cannot tell it from the crash dump. </p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">The memory section says:</p>
<p class="MsoNormal">=memory</p>
<p class="MsoNormal">total: 15447352528</p>
<p class="MsoNormal">processes: 15140232809</p>
<p class="MsoNormal">processes_used: 15140005610</p>
<p class="MsoNormal">system: 307119719</p>
<p class="MsoNormal">atom: 512601</p>
<p class="MsoNormal">atom_used: 496586</p>
<p class="MsoNormal">binary: 148574400</p>
<p class="MsoNormal">code: 21228007</p>
<p class="MsoNormal">ets: 119988984</p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I have 16GB RAM, so the processes use almost all. There are 4010 processes. 1 garbing, 31 scheduled, 3978 waiting. If I sum stack+heap of all the processes then I get ~700MB. That is very far from 16GB. Here are the top 10 stack+heap processes:</p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="510" style="width:382.8pt;margin-left:-1.15pt;border-collapse:collapse">
<tbody>
<tr style="height:15.0pt">
<td width="94" nowrap="" valign="bottom" style="width:70.8pt;border:solid windowtext 1.0pt;background:#0070C0;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><b><span style="color:white">Pid </span></b></p>
</td>
<td width="146" nowrap="" valign="bottom" style="width:109.65pt;border:solid windowtext 1.0pt;border-left:none;background:#0070C0;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><b><span style="color:white">State</span></b></p>
</td>
<td width="96" nowrap="" valign="bottom" style="width:72.3pt;border:solid windowtext 1.0pt;border-left:none;background:#0070C0;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><b><span style="color:white">Reductions</span></b></p>
</td>
<td width="85" nowrap="" valign="bottom" style="width:64.05pt;border:solid windowtext 1.0pt;border-left:none;background:#0070C0;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><b><span style="color:white">Stack+heap</span></b></p>
</td>
<td width="88" nowrap="" valign="bottom" style="width:66.0pt;border:solid windowtext 1.0pt;border-left:none;background:#0070C0;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><b><span style="color:white">MsgQ Length</span></b></p>
</td>
</tr>
<tr style="height:15.0pt">
<td width="94" nowrap="" valign="bottom" style="width:70.8pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black"><0.21060.67></span></p>
</td>
<td width="146" style="width:109.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black">Garbing (limited info)</span></p>
</td>
<td width="96" style="width:72.3pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">1,508,838,180</span></p>
</td>
<td width="85" style="width:64.05pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">145,962,050</span></p>
</td>
<td width="88" style="width:66.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">1</span></p>
</td>
</tr>
<tr style="height:15.0pt">
<td width="94" nowrap="" valign="bottom" style="width:70.8pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black"><0.25689.27></span></p>
</td>
<td width="146" style="width:109.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black">Waiting</span></p>
</td>
<td width="96" style="width:72.3pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">86,670,344</span></p>
</td>
<td width="85" style="width:64.05pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">145,962,050</span></p>
</td>
<td width="88" style="width:66.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">0</span></p>
</td>
</tr>
<tr style="height:15.0pt">
<td width="94" nowrap="" valign="bottom" style="width:70.8pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black"><0.10003.68></span></p>
</td>
<td width="146" style="width:109.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black">Waiting</span></p>
</td>
<td width="96" style="width:72.3pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">1,363,039</span></p>
</td>
<td width="85" style="width:64.05pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">38,263,080</span></p>
</td>
<td width="88" style="width:66.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">0</span></p>
</td>
</tr>
<tr style="height:15.0pt">
<td width="94" nowrap="" valign="bottom" style="width:70.8pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black"><0.15943.66></span></p>
</td>
<td width="146" style="width:109.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black">Waiting</span></p>
</td>
<td width="96" style="width:72.3pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">1,882,465,380</span></p>
</td>
<td width="85" style="width:64.05pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">30,610,465</span></p>
</td>
<td width="88" style="width:66.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">0</span></p>
</td>
</tr>
<tr style="height:15.0pt">
<td width="94" nowrap="" valign="bottom" style="width:70.8pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black"><0.15879.68></span></p>
</td>
<td width="146" style="width:109.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black">Waiting</span></p>
</td>
<td width="96" style="width:72.3pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">471,549</span></p>
</td>
<td width="85" style="width:64.05pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">30,610,465</span></p>
</td>
<td width="88" style="width:66.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">0</span></p>
</td>
</tr>
<tr style="height:15.0pt">
<td width="94" nowrap="" valign="bottom" style="width:70.8pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black"><0.31854.67></span></p>
</td>
<td width="146" style="width:109.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black">Waiting</span></p>
</td>
<td width="96" style="width:72.3pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">154,500,777</span></p>
</td>
<td width="85" style="width:64.05pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">24,488,375</span></p>
</td>
<td width="88" style="width:66.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">0</span></p>
</td>
</tr>
<tr style="height:15.0pt">
<td width="94" nowrap="" valign="bottom" style="width:70.8pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black"><0.16221.68></span></p>
</td>
<td width="146" style="width:109.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black">Waiting</span></p>
</td>
<td width="96" style="width:72.3pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">262,114</span></p>
</td>
<td width="85" style="width:64.05pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">24,488,375</span></p>
</td>
<td width="88" style="width:66.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">0</span></p>
</td>
</tr>
<tr style="height:15.0pt">
<td width="94" nowrap="" valign="bottom" style="width:70.8pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black"><0.16628.68></span></p>
</td>
<td width="146" style="width:109.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black">Waiting</span></p>
</td>
<td width="96" style="width:72.3pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">117,268</span></p>
</td>
<td width="85" style="width:64.05pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">24,488,375</span></p>
</td>
<td width="88" style="width:66.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">0</span></p>
</td>
</tr>
<tr style="height:15.0pt">
<td width="94" nowrap="" valign="bottom" style="width:70.8pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black"><0.15878.68></span></p>
</td>
<td width="146" style="width:109.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black">Waiting</span></p>
</td>
<td width="96" style="width:72.3pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">453,490</span></p>
</td>
<td width="85" style="width:64.05pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">19,590,700</span></p>
</td>
<td width="88" style="width:66.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">0</span></p>
</td>
</tr>
<tr style="height:15.0pt">
<td width="94" nowrap="" valign="bottom" style="width:70.8pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black"><0.16235.68></span></p>
</td>
<td width="146" style="width:109.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal"><span style="color:black">Waiting</span></p>
</td>
<td width="96" style="width:72.3pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">181,968</span></p>
</td>
<td width="85" style="width:64.05pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">19,590,700</span></p>
</td>
<td width="88" style="width:66.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><span style="color:black">0</span></p>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Any ideas how to tell which process needs ~1GB memory?</p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thanks,</p>
<p class="MsoNormal">Jozsef</p>
</div>
</blockquote><br><br><br></body></html>