[erlang-questions] Is mnesia/erlang/ETP strong enough?

[Yang Zhang]

Hi. Ulf W.

I was facing the win2003 server memory problem whether erlang or C#. I will
check your links.

Thank you for sharing.

On Thu, Feb 12, 2009 at 5:53 AM, Ulf Wiger <ulf@REDACTED> wrote:

> If the erlang VM gets an OutOfMemoryException, it will terminate.
>
> If both Erlang and C# get an OOM exception at around 1.3G,
> perhaps you should review your settings in Windows 2003?
>
> I've not used Windows Server 2003, but it has a lot of weird
> stuff like application recycling etc, in order to protect itself against
> runaway processes.
>
>
> http://www.ironspeed.com/Designer/5.2.1/WebHelp/Part_II/Windows_2003_Application_Performance_Suggestions.htm
>
> Perhaps you have some system settings limiting the available
> memory for the application?
>
> BR,
> Ulf W
>
> 2009/2/11 Yang Zhang <getyourcontacts@REDACTED>:
> > After 2 weeks programming and running with erlang program, I got lots
> > of memory error and erl crashed more than 50 times.
> >
> > I was trying to run 400 processes + mnesia on one node. The 400
> > processes was designed to scrape data from web then save them to
> > mnesia database.
> > At first, after about 2 or 3 hours running, I found erl crashed(not
> > program). Then I restart then 2 or 3 hours erl crashed again.
> > I found the erl process consume about 1.3G memory then it crashed, I
> > start to wonder if there are some things wrong with too many
> > processes. So I minus to 200 processes and  split them to 10 nodes,
> > with run 20 processes and the main one running mnesia database.
> >
> > Things went well untill 2 days later, I found the main erl node
> > crashed again. After restart it, after 1 or 2 minutes it crashed
> > again. Eventually I found it is the table type's problem, so I changed
> > data type from disc_* to disc_only. Then problem solved.
> >
> > Then it keeps running for 4 days, everything goes well until I want to
> > check how many data I have. So I open table viewer:
> > tv:start().
> > The see there are 6M records in my table, quite happy. Then
> > double-click, both node crashed. Sign~~
> >
> > I got clever. Now I never opened that table. I choose a small one
> > which only have 120K records. Open it. No crash. Safty. The search for
> > some words, only 2K. OK. No crash. Then search for another one, the
> > number is climbing, when it hits 4K. oh My god. Both nodes crash again
> > only show me the ugly
> >
> > Crash dump was written to: erl_crash.dump
> > eheap_alloc: Cannot allocate 373662860 bytes of memory (of type "heap").
> >
> >
> > damm~~~
> >
> > I am using C#/SqlServer to develop program. I haven't seen anytime
> > sqlserver open a table with 6M table will crash itself, I even tried
> > to open a 50M records table.
> > Why erl system so volunerable?
> >
> > Is crash the better way than only ternimate the problem process? Don't
> know why.
> >
> > Also I have fell in love with erlang, but its so unstable behavior
> > make it far away from my commerial program.
> >
> > Any option?
> >
> >
> >
> http://harbork.com/Is-mnesia-erlang-ETP-strong-enough/Is-mnesia-erlang-ETP-strong-enough-4b4vyEV84t2fjviIJHLw.html
> > _______________________________________________
> > erlang-questions mailing list
> > erlang-questions@REDACTED
> > http://www.erlang.org/mailman/listinfo/erlang-questions
> >
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://erlang.org/pipermail/erlang-questions/attachments/20090212/55a5bd15/attachment.htm>