[erlang-questions] Speed of CSV parsing: how to read 1M of lines in 1 second

Max Lapshin max.lapshin@REDACTED
Fri Mar 23 14:10:53 CET 2012


On Fri, Mar 23, 2012 at 4:54 PM, Gordon Guthrie <gordon@REDACTED> wrote:
> Max
>
> There is a csv parser for RFC 4180 compliant csv files which is now
> being maintained by Eric Merritt:
> https://github.com/afiniate/erfc_parsers/tree/master/src
>

It is great, but:

1) it doesn't support header. Usually first line is a header
2) it is very strict to structure of CSV. It may change and it is
impossible to tie to index of column, only by its name
3) it is incredibly slow: NIF: 4812, RFC: 38371
It is 10 times slower than my code.



More information about the erlang-questions mailing list