2013-01-14 14:09:53 +01:00
|
|
|
.. _cluster-singleton:
|
|
|
|
|
|
|
|
|
|
Cluster Singleton Pattern
|
|
|
|
|
=========================
|
|
|
|
|
|
|
|
|
|
For some use cases it is convenient and sometimes also mandatory to ensure that
|
|
|
|
|
you have exactly one actor of a certain type running somewhere in the cluster.
|
|
|
|
|
|
|
|
|
|
Some examples:
|
|
|
|
|
|
|
|
|
|
* single point of responsibility for certain cluster-wide consistent decisions, or
|
|
|
|
|
coordination of actions across the cluster system
|
|
|
|
|
* single entry point to an external system
|
|
|
|
|
* single master, many workers
|
|
|
|
|
* centralized naming service, or routing logic
|
|
|
|
|
|
2013-03-26 18:17:50 +01:00
|
|
|
Using a singleton should not be the first design choice. It has several drawbacks,
|
|
|
|
|
such as single-point of bottleneck. Single-point of failure is also a relevant concern,
|
|
|
|
|
but for some cases this feature takes care of that by making sure that another singleton
|
2013-01-14 14:09:53 +01:00
|
|
|
instance will eventually be started.
|
|
|
|
|
|
2013-03-14 20:32:43 +01:00
|
|
|
The cluster singleton pattern is implemented by ``akka.contrib.pattern.ClusterSingletonManager``.
|
2013-03-26 18:17:50 +01:00
|
|
|
It manages singleton actor instance among all cluster nodes or a group of nodes tagged with
|
2013-03-14 20:32:43 +01:00
|
|
|
a specific role. ``ClusterSingletonManager`` is an actor that is supposed to be started on
|
2013-03-26 18:17:50 +01:00
|
|
|
all nodes, or all nodes with specified role, in the cluster. The actual singleton actor is
|
2013-03-14 20:32:43 +01:00
|
|
|
started by the ``ClusterSingletonManager`` on the leader node by creating a child actor from
|
|
|
|
|
supplied ``Props``. ``ClusterSingletonManager`` makes sure that at most one singleton instance
|
|
|
|
|
is running at any point in time.
|
2013-01-14 14:09:53 +01:00
|
|
|
|
2013-03-26 18:17:50 +01:00
|
|
|
The singleton actor is always running on the leader member, which is nothing more than
|
|
|
|
|
the address currently sorted first in the member ring. This can change when adding
|
|
|
|
|
or removing members. A graceful hand over can normally be performed when joining a new
|
|
|
|
|
node that becomes leader or removing current leader node. Be aware that there is a short
|
2013-01-14 14:09:53 +01:00
|
|
|
time period when there is no active singleton during the hand over process.
|
|
|
|
|
|
2013-03-26 18:17:50 +01:00
|
|
|
The cluster failure detector will notice when a leader node becomes unreachable due to
|
|
|
|
|
things like JVM crash, hard shut down, or network failure. Then a new leader node will
|
|
|
|
|
take over and a new singleton actor is created. For these failure scenarios there will
|
|
|
|
|
not be a graceful hand-over, but more than one active singletons is prevented by all
|
2013-01-14 14:09:53 +01:00
|
|
|
reasonable means. Some corner cases are eventually resolved by configurable timeouts.
|
|
|
|
|
|
2013-03-26 18:17:50 +01:00
|
|
|
You access the singleton actor with ``actorSelection`` using the names you have specified when
|
2013-03-14 20:32:43 +01:00
|
|
|
creating the ClusterSingletonManager. You can subscribe to cluster ``LeaderChanged`` or
|
|
|
|
|
``RoleLeaderChanged`` events to keep track of which node it is supposed to be running on.
|
|
|
|
|
Alternatively the singleton actor may broadcast its existence when it is started.
|
2013-01-14 14:09:53 +01:00
|
|
|
|
|
|
|
|
An Example
|
|
|
|
|
----------
|
|
|
|
|
|
2013-03-26 18:17:50 +01:00
|
|
|
Assume that we need one single entry point to an external system. An actor that
|
|
|
|
|
receives messages from a JMS queue with the strict requirement that only one
|
2013-01-14 14:09:53 +01:00
|
|
|
JMS consumer must exist to be make sure that the messages are processed in order.
|
|
|
|
|
That is perhaps not how one would like to design things, but a typical real-world
|
|
|
|
|
scenario when integrating with external systems.
|
|
|
|
|
|
2013-03-26 18:17:50 +01:00
|
|
|
On each node in the cluster you need to start the ``ClusterSingletonManager`` and
|
2013-01-14 14:09:53 +01:00
|
|
|
supply the ``Props`` of the singleton actor, in this case the JMS queue consumer.
|
|
|
|
|
|
|
|
|
|
.. includecode:: @contribSrc@/src/multi-jvm/scala/akka/contrib/pattern/ClusterSingletonManagerSpec.scala#create-singleton-manager
|
|
|
|
|
|
2013-03-14 20:32:43 +01:00
|
|
|
Here we limit the singleton to nodes tagged with the ``"worker"`` role, but all nodes, independent of
|
|
|
|
|
role, can be used by specifying ``None`` as ``role`` parameter.
|
|
|
|
|
|
2013-01-14 14:09:53 +01:00
|
|
|
The corresponding Java API for the ``singeltonProps`` function is ``akka.contrib.pattern.ClusterSingletonPropsFactory``.
|
2013-03-14 20:32:43 +01:00
|
|
|
The Java API constructor takes a plain String for the role parameter and ``null`` means that all nodes, independent of
|
|
|
|
|
role, are used.
|
2013-01-14 14:09:53 +01:00
|
|
|
|
|
|
|
|
Here we use an application specific ``terminationMessage`` to be able to close the
|
2013-03-26 18:17:50 +01:00
|
|
|
resources before actually stopping the singleton actor. Note that ``PoisonPill`` is a
|
2013-01-14 14:09:53 +01:00
|
|
|
perfectly fine ``terminationMessage`` if you only need to stop the actor.
|
|
|
|
|
|
|
|
|
|
Here is how the singleton actor handles the ``terminationMessage`` in this example.
|
|
|
|
|
|
|
|
|
|
.. includecode:: @contribSrc@/src/multi-jvm/scala/akka/contrib/pattern/ClusterSingletonManagerSpec.scala#consumer-end
|
|
|
|
|
|
|
|
|
|
Note that you can send back current state to the ``ClusterSingletonManager`` before terminating.
|
|
|
|
|
This message will be sent over to the ``ClusterSingletonManager`` at the new leader node and it
|
|
|
|
|
will be passed to the ``singletonProps`` factory when creating the new singleton instance.
|
|
|
|
|
|
2013-03-26 18:17:50 +01:00
|
|
|
With the names given above the path of singleton actor can be constructed by subscribing to
|
|
|
|
|
``RoleLeaderChanged`` cluster event and the actor reference is then looked up using ``actorSelection``:
|
2013-03-14 20:32:43 +01:00
|
|
|
|
|
|
|
|
.. includecode:: @contribSrc@/src/multi-jvm/scala/akka/contrib/pattern/ClusterSingletonManagerSpec.scala#singleton-proxy2
|
2013-01-14 14:09:53 +01:00
|
|
|
|
2013-03-14 20:32:43 +01:00
|
|
|
Subscribe to ``LeaderChanged`` instead of ``RoleLeaderChanged`` if you don't limit the singleton to
|
|
|
|
|
the group of members tagged with a specific role.
|
2013-01-14 14:09:53 +01:00
|
|
|
|
2013-03-26 18:17:50 +01:00
|
|
|
Note that the hand-over might still be in progress and the singleton actor might not be started yet
|
2013-03-14 20:32:43 +01:00
|
|
|
when you receive the ``LeaderChanged`` / ``RoleLeaderChanged`` event.
|
2013-01-28 08:47:52 +01:00
|
|
|
|
2013-03-26 18:17:50 +01:00
|
|
|
To test scenarios where the cluster leader node is removed or shut down you can use :ref:`multi-node-testing` and
|
2013-01-28 08:47:52 +01:00
|
|
|
utilize the fact that the leader is supposed to be the first member when sorted by member address.
|
|
|
|
|
|
|
|
|
|
.. includecode:: @contribSrc@/src/multi-jvm/scala/akka/contrib/pattern/ClusterSingletonManagerSpec.scala#sort-cluster-roles
|
|
|
|
|
|
|
|
|
|
.. includecode:: @contribSrc@/src/multi-jvm/scala/akka/contrib/pattern/ClusterSingletonManagerSpec.scala#test-leave
|
|
|
|
|
|
2013-03-26 18:17:50 +01:00
|
|
|
Also, make sure that you don't shut down the first role, which is running the test conductor controller.
|
2013-01-28 08:47:52 +01:00
|
|
|
Use a dedicated role for the controller, which is not a cluster member.
|
2013-01-14 14:09:53 +01:00
|
|
|
|
|
|
|
|
.. note:: The singleton pattern will be simplified, perhaps provided out-of-the-box, when the cluster handles automatic actor partitioning.
|