Commit graph

173 commits

Author SHA1 Message Date
promanski
05282b59c9 Handle a negative value returned by Math.abs() #25034 2018-05-05 13:49:20 +02:00
Christopher Batey
23373565db
Fix typed cluster singleton cross dc proxies (#24936)
* Fix typed cluster singleton cross dc proxies
* Adds first multi-jvm test for typed cluster
2018-04-27 12:44:44 +01:00
Christopher Batey
a3e52078df Enable header plugin for the MultiJVM configuration (#24974)
Seems when did the changes for 2018 it intro introduced a space in all
after, hence so many changes.
2018-04-25 00:03:55 +09:00
Christopher Batey
4d20b2a660 Reduce size of jenkins logs
Each build is now over 40mb logs.

A lot of DEBUG logging was left on for test failures that have been
fixed. Added an issue # for ones that are still valid or if if it on
as the test verifies debug
2018-04-24 08:49:41 +01:00
Justin Heyes-Jones
577b38ce7b Fix typo in ShardRegion code 2018-04-16 15:27:21 +02:00
Jimin Hsieh
2c2b8ba001 Remove some of Unused import warning (#24650) 2018-03-16 12:08:29 +01:00
Konrad `ktoso` Malawski
563c7fbcf0 Issue 24594: Integration with sbt-headers and initial header population 2018-03-13 15:45:55 +01:00
Patrik Nordwall
a13f5cab00 ClusterSharding: automatically choose start or startProxy by a node role (#23934) (#24669) 2018-03-07 13:17:56 +09:00
Renato Cavalcanti
c83e4adfea Rolling update config checker, #24009
* adds config compatibility check
* doc'ed what happens when joining a cluster not supporting this feature
* added extra docs over sensitive paths
2018-02-20 15:47:09 +01:00
Roman Filonenko
a4e9881a6f typed Cluster.sharding.spawn fail fast #23708
* fail fast if Typed Cluster.sharding.spawn is called several times with different parameters 
* fix a bug in ClusterShardingImpl.spawnWithMessageExtractor - actually use allocationStrategy param
2018-02-20 14:55:30 +01:00
Patrik Nordwall
ff05671422 separate scaladsl/javadsl and avoid overloaded spawn, #24470
* copy and amend scaladoc for ClusterSharding extension
2018-02-02 10:10:52 +01:00
Patrik Nordwall
2cd1187e7b entityId => Behavior in ClusterSharding API, #24470
* spawn with String => Behavior since the entityId is often needed
* some type inference is lost, and completely breaks down with overloads
2018-02-02 08:43:11 +01:00
Patrik Nordwall
0cc9785d73 fix Sharding StartEntity, #23679
* previous solution didn't work becuse the untyped StartEntity
  message is sent by untyped sharding itself without the typed envelope
  and null was a bit of a hack
2018-02-02 08:42:59 +01:00
Johannes Rudolph
f1aa12daf2 Port WithLogCapturing + Silence TLSSpec (#24476)
* =tkt port WithLogCapturing from akka-http

* =str use WithLogCapturing for very noisy TLSSpec

* =sha use WithLogCapturing to silence noisy CoordinatedShutdownShardingSpec
2018-02-02 09:50:28 +09:00
Patrik Nordwall
9e8c10b5a6 harden CoordinatedShutdownShardingSpec, #24113
* There might be one case when the singleton coordinator
  hand over might start before the gracful stop of the
  region is completed on other node.
* I think this is rare enough to just accept that message
  might be sent to wrong location (we don't guarantee anything
  more than best effort anyway).
* Safe rolling upgrade should keep the coordinator (oldest)
  until last to avoid such races
2018-01-16 07:40:45 +01:00
Christopher Batey
45c7303d3f Cluster typed examples in scala and java 2018-01-11 18:17:15 +09:00
Patrik Nordwall
d30464c452 Reply to GetShardHome requests after rebalance, #24191
* Some GetShardHome requests were ignored (by design) during
  rebalance and they would be retried later.
* This optimization keeps tracks of such requests and reply
  to them immediately after rebalance has been completed and
  thereby the buffered messages in the region don't have to
  wait for next retry tick.
* use regionTerminationInProgress also during the update since
  all GetShardHome requests are not stashed
2018-01-09 20:12:45 +01:00
Patrik Nordwall
0eedd714e8 reply to known shard locations immediately when waitingForUpdate, #24064 2018-01-09 13:51:35 +01:00
Christopher Batey
0380cc517a Cluster singleton manager: don't send member events to FSM during shutdown (#24236)
There exists a race where a cluter node that is being downed seens its
self as the oldest node (as it has had the other nodes removed) and it
takes over the singleton manager sending the real oldest node to go into
the End state meaning that cluster singletons never work again.

This fix simply prevents Member events being given to the Cluster
Manager FSM during a shut down, instread relying on SelfExiting.

This also hardens the test by not downing the node that the current
sharding coordinator is running on as well as fixing a bug in the
probes.
2018-01-05 09:47:43 +01:00
Christopher Batey
009214ae07
Update copyright to 2018 (#24241) 2018-01-04 17:26:29 +00:00
Christopher Batey
bd2a3de88a
Typed async testkit (#24203)
* Typed async testkit
* Pull out useful parts from internal TypedSpec into a public TestKit
* Port internal tests to use the external testkit
2018-01-04 15:09:38 +00:00
Patrik Nordwall
d2fd897926 tmp fix failing CoordinatedShutdownShardingSpec, #24113 (#24163)
* The real issue that should be fixed is that there seems to be a race
  between the CS and the ClusterSingleton observing OldestChanged
  and terminating coordinator singleton before the graceful sharding stop is done
2017-12-15 10:43:26 +01:00
Johan Andrén
582f6a4836
Revert source incompatible sharding changes (#24126)
* Revert "fix entityPropsFactory id param, #21809"
This reverts commit cd7eae28f6.
* Revert "Merge pull request #24058 from talpr/talpr-24053-add-entity-id-to-sharding-props"
This reverts commit 8417e70460, reversing
changes made to 22e85f869d.
2017-12-07 17:49:29 +01:00
Patrik Nordwall
cd7eae28f6 fix entityPropsFactory id param, #21809 2017-12-07 13:17:04 +01:00
Patrik Nordwall
8417e70460
Merge pull request #24058 from talpr/talpr-24053-add-entity-id-to-sharding-props
Add entity id to sharding props (#24053)
2017-12-06 07:35:28 +01:00
Tal Pressman
a8e5f48f36 add entity id to sharding props (#24053) 2017-12-05 16:49:05 +02:00
Patrik Nordwall
774bfee074
Merge pull request #24049 from akka/wip-24048-coordinated-downing-patriknw
Run all CoordinatedShutdown phases also when downing, #24048
2017-12-05 13:01:43 +01:00
Christopher Batey
76b2cfa676 Add common multi jvm config to cluster tests (#23974) 2017-12-04 15:23:55 +01:00
Patrik Nordwall
fa3da328be Run all CoordinatedShutdown phases also when downing, #24048 2017-12-04 11:05:22 +01:00
Christopher Batey
99511a0027 Fix race in ClusterShardingFailureSpec
AFAICT there was nothing ensuring the order of messages when sent to the
shard and the region so first checkthat the passivation has happened
before sending another add in the test

Refs #24013
2017-11-20 16:35:47 +00:00
Christopher Batey
1eb3abb27e
Fix lookup of coordinator for sharding proxies (#23995) 2017-11-15 13:03:48 +00:00
Unknown
6587d9e522 Separate sharding regions and proxies, #23472 2017-11-14 11:42:13 +01:00
Daniel Schröter
f2e9b52699 Provide access to known shard types add test #23912 2017-11-11 00:53:54 +01:00
danischroeter
e7bbbdf8ed Provide access to known shard types #23912 (#23913)
* Provide access to known shard types #23912

* applied format
2017-11-11 08:25:33 +09:00
Patrik Nordwall
436668687a Move coordinated-shutdown config from test/resources, #23879
* looks like the ActorSystem is shutdown when leaving
* Included in MultiNodeSpec, i.e. all multi-node tests:
  akka.coordinated-shutdown.terminate-actor-system = off
  akka.oordinated-shutdown.run-by-jvm-shutdown-hook = off
2017-11-07 15:38:35 +01:00
Sergiy Prydatchenko
f2ebe60b95 Fix excessive rebalance in LeastShardAllocationStrategy (#23830) (#23834)
* Having maxSimultaneousRebalance > rebalanceThreshold in LeastShardAllocationStrategy caused shards "flapping" (deallocation of excessive shards followed by their immediate allocation on the same node)
2017-10-31 19:28:36 +09:00
Christopher Batey
83a97256cc Turn on gossip logging for flaky test + improve test error msg (#23868) 2017-10-30 14:52:58 +01:00
Arnout Engelen
b1df13d4d4 Update scalariform (#23778) (#23783) 2017-10-06 10:30:28 +02:00
Patrik Nordwall
0ed5bc1835 add mima filters 2017-08-31 11:29:49 +02:00
Patrik Nordwall
6ed3295acd Merge branch 'master' into wip-multi-dc-merge-master-patriknw 2017-08-31 10:51:12 +02:00
Patrik Nordwall
6bfb7c9262 increase timeout in MultiDcSplitBrainSpec
* due to handshake timeout

reduce handshake timeout

fourth might generate UnreachableDataCenter in unsplit

MultiDcClusterSharding
2017-08-31 10:26:23 +02:00
Martynas Mickevičius
bc0f2ee26d Load MiMa filters from file (#23083) 2017-07-27 12:33:14 +02:00
Johan Andrén
9c7e8d027a Renamed/moved the self data center setting #23312 (#23344) 2017-07-12 11:47:32 +01:00
Patrik Nordwall
87d74f1510 Docs for multi-DC features 2017-07-07 16:55:22 +02:00
Arnout Engelen
dd71f5759f Add some more imports to cluster sharding doc examples (#23305) 2017-07-06 08:05:48 -07:00
Patrik Nordwall
a7ed5ce6b0 fix copy-pasta mistake in ShardRegion 2017-07-06 11:02:49 +02:00
Patrik Nordwall
0b1ce7223d fix usage of the the leader sorted set in Replicator
* since the ordering can change based on the member's status
  it's not possible to use ordinary - for removal
* similar issue at a few places where ageOrdering was used
2017-07-05 14:56:12 +02:00
Patrik Nordwall
bb9549263e Rename team to data center, #23275 2017-07-04 17:11:21 +02:00
Patrik Nordwall
e0fe0bc49e Make cluster sharding DC aware, #23231
* Sharding only within own team (coordinator is singleton)
* the ddata Replicator used by Sharding must also be only within own team
* added support for Set of roles in ddata Replicator so that can be used
  by sharding to specify role + team
* Sharding proxy can route to sharding in another team
2017-07-04 15:04:43 +02:00
Patrik Nordwall
9835c08779 harden ClusterShardingRememberEntitiesSpecNewExtractorSpec 2017-05-23 13:44:24 +02:00