[erlang-questions] Speed of CSV parsing: how to read 1M of lines in 1 second

Tim Watson <>
Mon Mar 26 22:05:45 CEST 2012


Max have you seen
http://blogtrader.net/blog/tim_bray_s_erlang_exercise2. This states
"0.93 sec on 1 million lines file on my 4-core linux box" which sounds
pretty impressive and is based on pure Erlang (with some ets thrown
into the mix by the looks of things). Might be worth looking at
whether this can potentially out-perform the NIF!

On 26 March 2012 12:40, Max Lapshin <> wrote:
>
>
>>
>> And what do these numbers look like? Do they repeat? Are they short?
>
> Right as in example csv. It is trading data.
>
>
>> Or are they high-precision and varying wildly in order of magnitude,
>> and widely distributed statistically?
>
>
> They are very close to each other and vary not more than several percents.
> You think ot is a good place for optimization?
>
>
> In fact I have achieved good enough results: less than a second and thank to
> all community for it.
>
>
> _______________________________________________
> erlang-questions mailing list
> 
> http://erlang.org/mailman/listinfo/erlang-questions
>



More information about the erlang-questions mailing list