[erlang-questions] Sending a large Erlang content to a set of remote nodes

[Bob Ippolito]

On Thu, Mar 28, 2013 at 10:44 AM, Joe Armstrong <erlang@REDACTED> wrote:

>
>
> On Wed, Mar 27, 2013 at 5:48 PM, Olivier BOUDEVILLE <
> olivier.boudeville@REDACTED> wrote:
>
>>
>> Hi,
>>
>> I would have a potentially large number of Erlang terms to send to a set
>> of remote VMs. Currently it is a matter of a few megabytes, but it could be
>> up to a few gigabytes in the future; and the exact same content may have to
>> be sent to typically a dozen of other nodes.
>>
>
> How big is the set of remote VMs (how many dozens?) -
> Is the communication bandwidth between machines symmetric.
>
> Once two machines have got a copy they could *both* send the data to a
> third.
> Machine one sends the first half, machine two the second. Now three
> machines have a copy
>
> Now three machines can send a copy to a fourth, the first can send the
> first third, ...
> and so on.
>
> Lookup epidemic gossip protocols.
>
> This is a very nice exercise in parallel programming.
>

You may even be able to repurpose etorrent for this kind of purpose, I'm
sure it'd make it easier to put together a great prototype if nothing else.

-bob
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://erlang.org/pipermail/erlang-questions/attachments/20130328/494056f4/attachment.htm>