[erlang-questions] Managing a huge binary file

Jon Schneider <>
Tue Apr 30 14:21:59 CEST 2013


You shouldn't read it in as such anyway. If it were me and C and I had
stacks of RAM C I'd simply mmap it.

However you _might_ get better performance if the readahead done by the
kernel and the device is less than what you might read() using plan A.

A modernish disk should give you 100MB/s sustained (assuming no
significant fragmentation and contrary to popular belief even on SSDs
fragmentation does have a cost).

Jon


> Hello,
>
> Performance of you solution is bound on disk I/O.
> Just to validate here, are you able to consume data with desirable speed
> from the storage using other run-time e.g. C?





More information about the erlang-questions mailing list