[erlang-questions] Distributed Process Spawner
Wed Sep 2 15:43:56 CEST 2015
May be you can look at the following code: https://github.com/Nekso/nkdist
"NkDIST is an library to manage Erlang processes evenly distributed in a
riak_core cluster. When you add or remove nodes from the cluster,
NkDIST-based processes automatically move to another node to rebalance the
On Wed, Sep 2, 2015 at 1:52 PM, Alex Hudich <alttagil@REDACTED> wrote:
> I am working on a piece of software which requires start of massive amount
> of workers (using spawn_link) but now I face with the limitation of one
> server for handling all the workers.
> All workers start with simple spawn_link then do their work and return
> some piece of data to a caller by sending a message.
> I wonder if I can unload master server and add some additional erlang
> nodes to perform this job. Of course I looked into pool and slave modules
> but it seems (beside of setting up ssh keys) does not support dynamic
> adding or deleting of nodes.
> Actually I want to know how to build some node supervising module that
> allows incoming connections from a new slave nodes and automatically plug
> them into some pool of nodes (including master) for spawning processes.
> Also it has to exclude down nodes and load balancing workers amongst nodes
> (so it has to collect some load statistics from nodes)
> Could you guys help me to find such component or give me advice how to
> build such thing?
> Thank you.
> erlang-questions mailing list
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the erlang-questions