[erlang-questions] Large Flat file operations - optimization.

Bob Ippolito <>
Mon Jun 18 13:58:27 CEST 2012


If your use case is streaming and the files are big you might be better off
serializing with disk_log, although you won't get any compression that way.

On Monday, June 18, 2012, Max Lapshin wrote:

> I believe, that my way is fastest: import CSV once by reading it in
> chunks and store it serialized with file:write_file(Path,
> erlang:term_to_binary(Rows, [compressed]))
>
> I've promised to fix benchmark and I remember about it.
> _______________________________________________
> erlang-questions mailing list
>  <javascript:;>
> http://erlang.org/mailman/listinfo/erlang-questions
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://erlang.org/pipermail/erlang-questions/attachments/20120618/61141522/attachment.html>


More information about the erlang-questions mailing list