1-to-1 connections & possibly hidden nodes

Roberto Ostinelli ostinelli@REDACTED
Mon Jul 12 20:27:35 CEST 2021


...And of course the diagram would be (without the copy-pasta issues):

<NODE A in cluster> --------- <NODE C in cluster>
        \                     /
         \                   /
          \                 /
          <NODE B in cluster>
           *       *       *
          *        *        *
         *         *         *
      <NODE B1> <NODE B2> <NODE B3>


On Mon, Jul 12, 2021 at 8:24 PM Roberto Ostinelli <ostinelli@REDACTED>
wrote:

> All,
> Is it possible to have a 1-to-1 connection from a node in a cluster to a
> single Erlang node which does _not_ connect to the mesh, but only to a very
> specific Erlang node?
>
> I've go a very CPU-heavy application and am trying to find ways to offload
> the CPU computations to Erlang nodes (tha don't need to be in a cluster,
> except for a single box they refer to).
>
> Basically something like this:
>
> <NODE A in cluster> --------- <NODE B in cluster>
>         \                     /
>          \                   /
>           \                 /
>           <NODE B in cluster>
>            *       *       *
>           *        *        *
>          *         *         *
>       <NODE B1> <NODE B2> <NODE B>
>
> The distributed cluster is composed of nodes A, B and C, but nodes B1, B2
> and B3 can communicate directly with node B and that node only. Node B can
> offload CPU computations to B1, B2, B3 by sending erlang messages to them
> and receive results back.
>
> Every node in the cluster needs ~50x the CPU power, therefore I'm trying
> to avoid having the standard cluster grow so big that it would be
> generating way too much noise in a full mesh network (especially since it
> really isn't needed).
>
> I can of course use a simple custom TCP binary channel, but was wandering
> if something already exists that I could leverage. I've seen that hidden
> nodes "Hidden nodes always establish hidden connections to all other nodes
> except for nodes in the same global group" [1] so if I understand this
> correctly nodes B1-3 would still connect to A and B, even though the
> cluster wouldn't know about them.
>
> Thank you for any considerations you might have,
> r.
>
>  [1] http://erlang.org/doc/man/erl.html
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://erlang.org/pipermail/erlang-questions/attachments/20210712/7898b4b3/attachment.htm>


More information about the erlang-questions mailing list