[erlang-questions] How to quick calculation max Erlang's processes and scheduler can alive based on machine specs
Sat Jul 13 19:17:39 CEST 2019
The only suggestion I have is to also run a test where you use 200,000
workers i.e. a worker per row by spawning a process per row instead of
managing the partitioning.
For measuring running times you can use timer:tc/3
On Sat, Jul 13, 2019 at 9:47 AM I Gusti Ngurah Oka Prinarjaya <
> I'm a super newbie, I had done very very simple parallel processing using
> erlang. I experimenting with my database containing about hundreds of
> thousands rows. I split the rows into different offsets then assign each
> worker-processes different rows based on offsets. For each row i doing
> simple similar text calculation using binary:longest_common_prefix/1
> Let's assume my total rows is 200,000 rows of data.
> At first, i try to create 10 worker-processes, i assign 20,000 rows at
> each worker-process.
> Second, i try to create 20 worker-processes, i assign 10,000 rows at each
> Third, i try to create 40 worker-processes, i assign 5000 rows at each
> My machine specs:
> - MacBook Pro (13-inch, 2017, Four Thunderbolt 3 Ports)
> - Processor 3,1 GHz Intel Core i5 ( 2 physical cores, with HT )
> - RAM 8 GB 2133 MHz LPDDR3
> My questions is
> 1. How to quick calculation / dumb / simple calculation max Erlang's
> processes based on above machine specs?
> 2. The running time when doing similar text processing with 10 worker, or
> 20 worker or 40 worker was very blazingly fast. So i cannot feel, i cannot
> see the difference. How to measure or something like printing total minutes
> out? So i can see the difference.
> 3. How many scheduler need to active / available when i create 10
> processes? or 20 processes? 40 processes? and so on..
> Please enlightenment
> Thank you super much
> erlang-questions mailing list
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the erlang-questions