[erlang-questions] Sending a large Erlang content to a set of remote nodes

Bob Ippolito bob@REDACTED
Thu Mar 28 18:58:11 CET 2013

On Thu, Mar 28, 2013 at 10:44 AM, Joe Armstrong <erlang@REDACTED> wrote:

> On Wed, Mar 27, 2013 at 5:48 PM, Olivier BOUDEVILLE <
> olivier.boudeville@REDACTED> wrote:
>> Hi,
>> I would have a potentially large number of Erlang terms to send to a set
>> of remote VMs. Currently it is a matter of a few megabytes, but it could be
>> up to a few gigabytes in the future; and the exact same content may have to
>> be sent to typically a dozen of other nodes.
> How big is the set of remote VMs (how many dozens?) -
> Is the communication bandwidth between machines symmetric.
> Once two machines have got a copy they could *both* send the data to a
> third.
> Machine one sends the first half, machine two the second. Now three
> machines have a copy
> Now three machines can send a copy to a fourth, the first can send the
> first third, ...
> and so on.
> Lookup epidemic gossip protocols.
> This is a very nice exercise in parallel programming.

You may even be able to repurpose etorrent for this kind of purpose, I'm
sure it'd make it easier to put together a great prototype if nothing else.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://erlang.org/pipermail/erlang-questions/attachments/20130328/494056f4/attachment.htm>

More information about the erlang-questions mailing list