[erlang-questions] Sending a large Erlang content to a set of remote nodes
Thu Mar 28 18:58:11 CET 2013
On Thu, Mar 28, 2013 at 10:44 AM, Joe Armstrong <erlang@REDACTED> wrote:
> On Wed, Mar 27, 2013 at 5:48 PM, Olivier BOUDEVILLE <
> olivier.boudeville@REDACTED> wrote:
>> I would have a potentially large number of Erlang terms to send to a set
>> of remote VMs. Currently it is a matter of a few megabytes, but it could be
>> up to a few gigabytes in the future; and the exact same content may have to
>> be sent to typically a dozen of other nodes.
> How big is the set of remote VMs (how many dozens?) -
> Is the communication bandwidth between machines symmetric.
> Once two machines have got a copy they could *both* send the data to a
> Machine one sends the first half, machine two the second. Now three
> machines have a copy
> Now three machines can send a copy to a fourth, the first can send the
> first third, ...
> and so on.
> Lookup epidemic gossip protocols.
> This is a very nice exercise in parallel programming.
You may even be able to repurpose etorrent for this kind of purpose, I'm
sure it'd make it easier to put together a great prototype if nothing else.
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the erlang-questions