[erlang-questions] Speed of CSV parsing: how to read 1M of lines in 1 second
Max Lapshin
max.lapshin@REDACTED
Fri Mar 23 14:10:53 CET 2012
On Fri, Mar 23, 2012 at 4:54 PM, Gordon Guthrie <gordon@REDACTED> wrote:
> Max
>
> There is a csv parser for RFC 4180 compliant csv files which is now
> being maintained by Eric Merritt:
> https://github.com/afiniate/erfc_parsers/tree/master/src
>
It is great, but:
1) it doesn't support header. Usually first line is a header
2) it is very strict to structure of CSV. It may change and it is
impossible to tie to index of column, only by its name
3) it is incredibly slow: NIF: 4812, RFC: 38371
It is 10 times slower than my code.
More information about the erlang-questions
mailing list