Parsing big files

[Thomas Arts]

I have got a large file which consists of about 2 million lines.
The aim is to parse this file, change the format a little and
write it back to disk.

No surprise that file:read_file(FileName) helps the erlang runtime
system to get out of memory. I need a file:open, and thereafter
read the file in parts and write the changed parts to disk.

I wonder if someone already wrote a transformation program for
such large files. I want the scanner to present a scanned
line at a time, such that I can write a line at a time, but it
would be nice if I don't have to do the bookkeeping on the
byte level.

/Thomas