[erlang-questions] Rough thought on a P2P package distribution model for Erlang
jm
jeffm@REDACTED
Fri Sep 23 06:35:00 CEST 2011
You assume speed is the only reason to use P2P. I'm more concerned with
maintaining up to date package repositories, redundancy, and security.
MIrrors that use ftp/http/rsync/etc have a tendency to fall out of date
if not well maintained. These mirrors also require that up to date lists
be maintained so the users (human or machine) can find active ones and
how do you distribute those? CDNs do this through things like
redirection and dynamic DNS records. The method that is used behind the
scenes to distribute content would vary from provider to provider. P2P
is just one possible technology (and that is all I'm claiming). Most
likely, these providers use a mix of technologies or a hybrid approach
for internal content distribution.
For example,
http://goanna.cs.rmit.edu.au/~xiaodong/mbc/Theses/jaison-minorThesis.pdf
mentions P2P as one technology.
and page 340 and page 341 of this paper has tables which list uses of
P2P one sub table is devoted to "Content Publishing and Storage Systems"
A Survey of Peer-to-Peer Content Distribution Technologies
STEPHANOS ANDROUTSELLIS-THEOTOKIS AND DIOMIDIS SPINELLIS
Athens University of Economics and Business
Jeff.
On 21/09/11 10:25 PM, Jesper Louis Andersen wrote:
> Mainly because there is no need to do it.
>
> Data distribution systems like BitTorrent has the specific distinct
> advantage that it can transfer data at high bandwidths, even if the
> initial source is highly bandwidth constrained in its upstream.
> Upstream bandwidth scales with demand in a BT network. Hence, the
> applicability of BitTorrent (and like) protocols hinges on a need to
> thwart an upstream bandwidth constraint. Example: You are Facebook and
> need a 1 gigabyte image distributed quickly to 50.000 nodes from a
> single deploy machine.
>
> But as soon as there is demand for a package distribution, and the
> demand is high enough, mirrors form and mirrors have ample amounts of
> upstream bandwidth available. Far more than what is needed. Thus, the
> additional complexity of adding BitTorrent into the mix isn't needed.
>
> Add that HTTP transport is well-known and simple. You can say it is a
> locally extreme value which is currently good enough. The proof is
> Content Delivery Networks (CDNs) which does not use BitTorrent to
> distribute content.
>
>
More information about the erlang-questions
mailing list