[erlang-questions] Performance measurement for er_zauker

Dmitry Kolesnikov dmkolesnikov@REDACTED
Thu Jul 31 17:15:18 CEST 2014


Hi,

I am using https://github.com/virtan/eep

- Dmitry


On 31 Jul 2014, at 15:02, Giovanni Giorgi <jj@REDACTED> wrote:

> Hi all,
> 
>  I am writing a code indexer called er_zaueker: it is based on erlang and redis: https://github.com/daitangio/er_zauker
> 
>  
> It is also my "erlang learning project".
> 
> I am trying to optimize it.
> 
> What are the OTP API I can use to find out where is spent much of the time?
> 
> I need an aggregate timing value to find the slowest functions.
> 
> er_zauker breaks the files in "trigram" and push them to redis. This part is done sequentially on a single file, whereas file processing is spread via a lot of processes.
> 
> The entire work is higly I/O bound, but I hope to break the 10 files per second barrier soon.
> 
> I'd like tu understang if it make sense to have more processes per single file.
> 
> To collect trigram I am using the sets module, but I think R17 maps could be even more fast.
> 
>  
> ---
> Gio's Blog http://gioorgi.com
> _______________________________________________
> erlang-questions mailing list
> erlang-questions@REDACTED
> http://erlang.org/mailman/listinfo/erlang-questions

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://erlang.org/pipermail/erlang-questions/attachments/20140731/aa87ddda/attachment.htm>


More information about the erlang-questions mailing list