Commit graph

21161 commits

Author SHA1 Message Date
Patrik Nordwall
e3aada5016 Connect the dots for cross-dc reachability, #23377
* the crossDcFailureDetector was not connected to the reachability table
* additional test by listen for {Reachable/Unreachable}DataCenter events in split spec
* missing Java API for getUnreachableDataCenters in CurrentClusterState
2017-08-22 15:05:40 +02:00
Patrik Nordwall
eefe6474c3 Merge pull request #23529 from akka/wip-23371-CrossDcHeartbeatSender-patriknw
Missing become after CurrentClusterState in CrossDcHeartbeatSender, #23371
2017-08-22 15:04:48 +02:00
Patrik Nordwall
659b28e4eb Missing become after CurrentClusterState in CrossDcHeartbeatSender, #23371
* and a few other small things
* one can see in the failed test log that there is no ACTIVE log line on the failing node
2017-08-22 14:10:45 +02:00
Johan Andrén
cff43a16f7 Data center reachability in cluster state (#23359)
* Manual case-declassing of CurrentClusterState #23347

* Unreachable data centers set in CurrentClusterState #23347
2017-08-22 13:04:39 +02:00
Johan Andrén
b86b10c477 Elminate race in MultiDcHeartbeatTakingOverSpec #23371 (#23373) 2017-07-19 11:48:27 +09:00
Martynas Mickevičius
83d8816085 Merge pull request #23355 from ktoso/wip-beat-only-others-not-yourself-nor-your-friends-ktoso
=clu,dc #23354 do not heartbeat to yourself (cross-dc)
2017-07-14 12:24:18 +03:00
Konrad `ktoso` Malawski
c728098b3d
=clu,dc #23354 do not heartbeat to yourself (cross-dc) 2017-07-14 13:00:45 +09:00
Konrad `ktoso` Malawski
eb24033cc0 =clu,dc #23340 additional test to see a node take over monitoring of remote DC (#23342) 2017-07-13 12:50:28 +02:00
Martynas Mickevičius
73d3c5db5d DC reachability events #23245 2017-07-12 13:48:15 +01:00
Johan Andrén
9c7e8d027a Renamed/moved the self data center setting #23312 (#23344) 2017-07-12 11:47:32 +01:00
Johan Andrén
be5a0207bb Prune version clocks based on merged tombstones when merging #23318 2017-07-11 16:29:32 +01:00
Johan Andrén
a15e459922 Merging did not prune vector clocks for tombstoned nodes #23318 2017-07-10 13:01:06 +01:00
Johan Andrén
9f4da87840 =clu #23286 filter emitted reachability event by DC 2017-07-07 16:50:36 +01:00
Patrik Nordwall
a85e4b056c Merge pull request #23256 from akka/wip-team-docs-patriknw
Docs for multi-DC features
2017-07-07 17:25:45 +02:00
Patrik Nordwall
87d74f1510 Docs for multi-DC features 2017-07-07 16:55:22 +02:00
Johan Andrén
3be504dd00 Unbreak MultiDcSunnyWeatherSpec #23310 2017-07-07 15:11:58 +01:00
Johan Andrén
c0d439eac3 limit cross dc gossip #23282 2017-07-07 13:19:10 +01:00
Konrad `ktoso` Malawski
b568975acc =clu #23229 multi-dc heartbeating, only N nodes perform monitoring 2017-07-07 12:17:41 +01:00
Patrik Nordwall
b3c372eada Merge pull request #23301 from akka/wip-ordering2-patriknw
fix copy-pasta mistake in ShardRegion
2017-07-06 11:41:54 +02:00
Patrik Nordwall
a7ed5ce6b0 fix copy-pasta mistake in ShardRegion 2017-07-06 11:02:49 +02:00
Patrik Nordwall
084f17ce82 Merge pull request #23295 from johanandren/wip-23288-multi-dc-split-brain-test-wrong-johanandren
Multi dc split brain test incorrect
2017-07-05 17:03:31 +02:00
Patrik Nordwall
268be61b0f Merge pull request #23297 from akka/wip-ordering-patriknw
fix usage of the the leader sorted set in Replicator
2017-07-05 17:02:37 +02:00
Patrik Nordwall
0b1ce7223d fix usage of the the leader sorted set in Replicator
* since the ordering can change based on the member's status
  it's not possible to use ordinary - for removal
* similar issue at a few places where ageOrdering was used
2017-07-05 14:56:12 +02:00
Johan Andrén
ab3efff3bd MultiDcSplitBrainSpec fixed #23288 2017-07-05 13:50:10 +02:00
Patrik Nordwall
f5a40bfcb2 Merge pull request #23291 from akka/wip-23290-gossip-refactoring-patriknw
Refactoring of Gossip class, #23290
2017-07-05 13:42:43 +02:00
Patrik Nordwall
867cc97bdd Refactoring of Gossip class, #23290
* move methods that depends on selfUniqueAddress and selfDc
  to a separate MembershipState class, which also holds the
  latest gossip
* this removes the need to pass in the parameters from everywhere and
  makes it easier to cache some results
* makes it clear that those parameters are always selfUniqueAddress
  and selfDc, instead of some arbitary node/dc
2017-07-05 08:47:32 +02:00
Patrik Nordwall
dee14c5b20 Merge pull request #23289 from akka/wip-23275-refactoring-patriknw
Rename team to data center, #23275
2017-07-04 17:57:26 +02:00
Patrik Nordwall
bb9549263e Rename team to data center, #23275 2017-07-04 17:11:21 +02:00
Patrik Nordwall
4ce1cccb89 Merge pull request #23240 from akka/wip-23231-sharding-dc-patriknw
Make cluster sharding DC aware, #23231
2017-07-04 17:04:12 +02:00
Patrik Nordwall
e0fe0bc49e Make cluster sharding DC aware, #23231
* Sharding only within own team (coordinator is singleton)
* the ddata Replicator used by Sharding must also be only within own team
* added support for Set of roles in ddata Replicator so that can be used
  by sharding to specify role + team
* Sharding proxy can route to sharding in another team
2017-07-04 15:04:43 +02:00
Patrik Nordwall
e37243f471 Merge pull request #23285 from jrudolph/jr/w/introduce-internal-reachability-event
Some additional Reachability comments / documentation
2017-07-04 14:55:32 +02:00
Arnout Engelen
58db22ca1e Introduce missing team role if necessary (#23276)
* Introduce missing team role if necessary (#23243)

When receiving gossip from a node that did not contain any team
information (such as gossip from a node running a previous version of
Akka), add the default team role during deserialization.

* Simpler implementation of adding default role

* More efficient `rolesFromProto`

Now actually outperforms the previous implementation. Still room for
improvement as this probably checks for duplicates in the set on each add,
but creating our own array-backed set here is probably going overboard :).

* Fixes following rebase
2017-07-04 14:52:03 +02:00
Patrik Nordwall
165831b064 Merge pull request #23235 from akka/wip-23230-singleton-dc-patriknw
Make cluster singleton DC aware, #23230
2017-07-04 14:45:16 +02:00
Johannes Rudolph
8fc21cb530 =clu fix Reachability.equals wrt versions 2017-07-04 12:58:31 +02:00
Johannes Rudolph
0251886111 =clu add comments for Reachability methods 2017-07-04 12:58:28 +02:00
Patrik Nordwall
2044c1712b Support cross team in ClusterSingletonProxy, #23230 2017-07-04 10:47:45 +02:00
Arnout Engelen
ccea5a0eac Make cluster singleton DC aware, #23230 2017-07-04 10:21:27 +02:00
Johan Andrén
164387a89e [WIP] one leader per cluster team (#23239)
* Guarantee no sneaky type puts more teams in the role list

* Leader per team and initial tests

* MiMa filters

* Second iteration (not working though)

* Verbose gossip logging etc.

* Gossip to team-nodes even if there is inter-team unreachability

* More work ...

* Marking removed nodes with tombstones in Gossip

* More test coverage for Gossip.remove

* Bug failing other multi-node tests squashed

* Multi-node test for team-split

* Review fixes - only prune tombstones on leader ticks

* Clean code is happy code.

* All I want is for MiMa to be my friend

* These constants are internal

* Making the formatting gods happy

* I used the wrong reachability for ignoring gossip :/

* Still hadn't quite gotten how reachability was supposed to work

* Review feedback applied

* Cross-team downing should still work

* Actually prune tombstones in the prune tombstones method ...

* Another round against reachability. Reachability leading with 15 - 2 so far.
2017-07-04 10:09:40 +02:00
Arnout Engelen
0115d5fdda Less abbreviations, more reliable test
(cherry picked from commit 61e289b276f410654c1b063c33648e0d7ea88e50)
2017-07-03 10:47:21 +02:00
Arnout Engelen
2f11ec6f25 Introduce cluster 'team' setting and add to Member
Introduced cluster-team.md so we can grow the documentation with each
PR, but did not add it to the ToC yet.

(cherry picked from commit a06badaa03fa9f3c9a942b1468090f758c74a869)
2017-07-03 10:47:14 +02:00
Patrik Nordwall
a7dc938188 Revert "Introduce cluster 'team' setting and add to Member"
This reverts commit a06badaa03fa9f3c9a942b1468090f758c74a869.
2017-07-03 10:44:36 +02:00
Patrik Nordwall
bd6afb8952 Revert "Less abbreviations, more reliable test"
This reverts commit 61e289b276f410654c1b063c33648e0d7ea88e50.
2017-07-03 10:44:24 +02:00
Nafer Sanabria
9bd27a2459 merge content of stream-io.md (#23236) 2017-07-01 09:33:45 -07:00
Richard Imaoka
afe349b6cd Fix typo getStageActorRef to getStageActor (#23259) 2017-06-30 03:07:30 -07:00
Rafael Avila
c8a7347355 Typos (#23260)
In Device Group section there are 2 occurrences of contains word and a mismatch type in the section about removing device actor when stopped.
2017-06-30 01:38:50 -07:00
Martynas Mickevičius
ba9e63215d Merge pull request #23255 from dwijnand/use-less-project-apply
Use less of Project.apply
2017-06-29 13:36:21 +03:00
Dale Wijnand
177ac666da
Use less of Project.apply
In sbt 1 Project.apply will only take 2 parameters.
2017-06-29 11:01:40 +01:00
Martynas Mickevičius
5fb44e2c18 Merge pull request #23238 from ktoso/wip-bump-jmh
=pro update sbt-jmh (readying up for sbt 1.0)
2017-06-29 12:42:48 +03:00
Martynas Mickevičius
453a95f978 Merge pull request #23242 from richard-imaoka/doc-stream-buffer-backpressure-imaoka
Correct the backpressure API comment for buffer
2017-06-29 11:23:03 +03:00
Konrad `ktoso` Malawski
1f05659346 =str #23119 improve docs of SourceQueue.watchTermination (#23208) 2017-06-28 06:11:33 -07:00