[erlang-questions] widefinder update

[Hynek Vychodil]

On 10/29/07, Steve Vinoski <vinoski@REDACTED> wrote:
> On 10/28/07, Anders Nygren <anders.nygren@REDACTED> wrote:
> > On 10/28/07, Hynek Vychodil <vychodil.hynek@REDACTED> wrote:
> > > Hi Anders,
> > > I rewrote your code a little. I removed all remaining binary bindings
> > > and it is noticeable faster again. Try wf_pichi3.erl.
> > >
> >
> > Hynek
> > that was great, Your change brings my wfinder1_1 + wfbm4_ets1_1
> > down to
> > real    0m1.118s
> > user    0m1.640s
> > sys     0m0.368s
> > on my 1.66 GHz dual core laptop.
>
>
> And on the 8-core 2.33GHz Intel Xeon Linux box with 2 GB RAM, this version
> is extremely fast:
>
> real 0m0.567s
> user 0m2.249s
> sys 0m0.956s
>  --steve

Did you test wfinder1_1 + wfbm4_ets1_1 or wf_pichi3 + file_map_reduce
+nlt_reader +chunk_reader too? I think nlt_reader should be less
memory consuming than reader from wfinder1_1 and it can cause less sys
time and paralel block splitting can cause some speed up on 8 core,
but I can't test it.

--Hynek (Pichi) Vychodil