[erlang-questions] Erlsom it's so close to being SAXy

Matt Harrison matt@REDACTED
Thu Jun 19 23:24:15 CEST 2008


See what I did there with the subject title :)

All

Has anyone used Erlsom for sax parsing straight from a file, i.e without 
using file:read_file to load a whole file. I can't seem to find an 
appropriate call, and the docs don't seem to cover it.

I have large files 6gb+ that I need to SAX parse, the main requirement 
being able to parse them with about 1gb of memory.

Erlsom works a treat with files that are a few 100Mb but requires the 
whole file loaded in memory, which kinda kills the main benefit of sax 
parsing in my opinion.

I am not especially bothered about speed, (it was suggested that I look 
at c parsers linked into erlang) as this is for a data import process 
that will only happen rarely (mainly for development and testing purposes).

I still don't seem to be able to find any xmerl_eventp examples so if 
you have one please let me know.

regards and thanks,

Matt

I haven't discarded the using a c library I'm just fairly new to erlang 
and would prefer an erlang solution if possible as I don't want to 
venture into ports quite yet :)



More information about the erlang-questions mailing list