[erlang-questions] Distributed Process Registry

[Ulf Wiger]

> On 08 Feb 2015, at 23:57, Michael Truog <mjtruog@REDACTED> wrote:
> 
> Due to this lack of consistency it is incorrect to say global or gproc are partition tolerant.  Yes, they can handle a netsplit occurring, but they do not tolerate the failure in a consistent way. 

This is an interesting definition of ‘tolerant’. So you’re saying that because global and gproc offer a choice of methods to handle a netsplit, they are _less_ tolerant than if they had only one method? Perhaps I misunderstood.

I agree that it can be a problem in a given system that different components automatically try to resolve an inconsistency using potentially different strategies. For this reason, I’ve long argued that one should have one master arbiter; the other systems need to be able to adapt. Otherwise, the different conflict resolution decisions can actually _cause_ inconsistencies from a system perspective.

I should note that gproc really only does ordered conflict resolution in the uw-locks_leader branch (and I just spotted a bug in it).

But again, I don’t think one should compare distributed group membership solutions with gproc’s unique names. They are not the same, just as comparing a transaction-based DBMS with an dynamo-style KV-store is an apples-to-oranges comparison.

If you really need to keep one unique instance of something in a distributed system, you will have a consistency challenge whether you want it or not. There will be tradeoffs, and as far as I know, there is no single tradeoff that is the best option for every situation. Thus, different options for different use cases.

But properties in gproc are not unique. In the local case, you don’t even need to involve the central gproc server when registering a property (except to ensure monitoring). When merging data after a netsplit, the node when a process resides is considered the authority on what properties exist for the process. This is safe, since only the process itself can register properties.

Thus, a process group will be all processes that share a given property. There is no tricky conflict resolution after netsplit in that case.

BR,
Ulf W

Ulf Wiger, Co-founder & Developer Advocate, Feuerlabs Inc.
http://feuerlabs.com