Build an erlang computer (was:Computers are fast)

Zoltan Podlovics zoltan.podlovics@REDACTED
Thu Jan 26 12:03:28 CET 2006


James Hague wrote:
> How about parsing a 300+ megabyte XML file?  I have a lean and mean
> XML parser in Erlang, one that only deals with a strict subset of XML,
> and operates entirely on binaries.  On 8 or 10 megabyte files, it's
> great, but on this monster--heh.  After about 30 minutes the emulator
> dies with "Abnormal Termination."  I suspect it's running out of
> memory.
> 
> It's interesting when these kinds of crazy problems come along :)
> 

You should consider the non-extractive way of XML processing. Using 
Virtual Token Descriptor ( http://vtd-xml.sf.net ) in an XML messaging 
system would be a huge advantage because you can send the XML data and 
the VTD (parsing information) data together in binary form.

Regards,
Zoltan



More information about the erlang-questions mailing list