Build an erlang computer (was:Computers are fast)
Zoltan Podlovics
zoltan.podlovics@REDACTED
Thu Jan 26 12:03:28 CET 2006
James Hague wrote:
> How about parsing a 300+ megabyte XML file? I have a lean and mean
> XML parser in Erlang, one that only deals with a strict subset of XML,
> and operates entirely on binaries. On 8 or 10 megabyte files, it's
> great, but on this monster--heh. After about 30 minutes the emulator
> dies with "Abnormal Termination." I suspect it's running out of
> memory.
>
> It's interesting when these kinds of crazy problems come along :)
>
You should consider the non-extractive way of XML processing. Using
Virtual Token Descriptor ( http://vtd-xml.sf.net ) in an XML messaging
system would be a huge advantage because you can send the XML data and
the VTD (parsing information) data together in binary form.
Regards,
Zoltan
More information about the erlang-questions
mailing list