Commit graph

21138 commits

Author SHA1 Message Date
Patrik Nordwall
0b1ce7223d fix usage of the the leader sorted set in Replicator
* since the ordering can change based on the member's status
  it's not possible to use ordinary - for removal
* similar issue at a few places where ageOrdering was used
2017-07-05 14:56:12 +02:00
Patrik Nordwall
f5a40bfcb2 Merge pull request #23291 from akka/wip-23290-gossip-refactoring-patriknw
Refactoring of Gossip class, #23290
2017-07-05 13:42:43 +02:00
Patrik Nordwall
867cc97bdd Refactoring of Gossip class, #23290
* move methods that depends on selfUniqueAddress and selfDc
  to a separate MembershipState class, which also holds the
  latest gossip
* this removes the need to pass in the parameters from everywhere and
  makes it easier to cache some results
* makes it clear that those parameters are always selfUniqueAddress
  and selfDc, instead of some arbitary node/dc
2017-07-05 08:47:32 +02:00
Patrik Nordwall
dee14c5b20 Merge pull request #23289 from akka/wip-23275-refactoring-patriknw
Rename team to data center, #23275
2017-07-04 17:57:26 +02:00
Patrik Nordwall
bb9549263e Rename team to data center, #23275 2017-07-04 17:11:21 +02:00
Patrik Nordwall
4ce1cccb89 Merge pull request #23240 from akka/wip-23231-sharding-dc-patriknw
Make cluster sharding DC aware, #23231
2017-07-04 17:04:12 +02:00
Patrik Nordwall
e0fe0bc49e Make cluster sharding DC aware, #23231
* Sharding only within own team (coordinator is singleton)
* the ddata Replicator used by Sharding must also be only within own team
* added support for Set of roles in ddata Replicator so that can be used
  by sharding to specify role + team
* Sharding proxy can route to sharding in another team
2017-07-04 15:04:43 +02:00
Patrik Nordwall
e37243f471 Merge pull request #23285 from jrudolph/jr/w/introduce-internal-reachability-event
Some additional Reachability comments / documentation
2017-07-04 14:55:32 +02:00
Arnout Engelen
58db22ca1e Introduce missing team role if necessary (#23276)
* Introduce missing team role if necessary (#23243)

When receiving gossip from a node that did not contain any team
information (such as gossip from a node running a previous version of
Akka), add the default team role during deserialization.

* Simpler implementation of adding default role

* More efficient `rolesFromProto`

Now actually outperforms the previous implementation. Still room for
improvement as this probably checks for duplicates in the set on each add,
but creating our own array-backed set here is probably going overboard :).

* Fixes following rebase
2017-07-04 14:52:03 +02:00
Patrik Nordwall
165831b064 Merge pull request #23235 from akka/wip-23230-singleton-dc-patriknw
Make cluster singleton DC aware, #23230
2017-07-04 14:45:16 +02:00
Johannes Rudolph
8fc21cb530 =clu fix Reachability.equals wrt versions 2017-07-04 12:58:31 +02:00
Johannes Rudolph
0251886111 =clu add comments for Reachability methods 2017-07-04 12:58:28 +02:00
Patrik Nordwall
2044c1712b Support cross team in ClusterSingletonProxy, #23230 2017-07-04 10:47:45 +02:00
Arnout Engelen
ccea5a0eac Make cluster singleton DC aware, #23230 2017-07-04 10:21:27 +02:00
Johan Andrén
164387a89e [WIP] one leader per cluster team (#23239)
* Guarantee no sneaky type puts more teams in the role list

* Leader per team and initial tests

* MiMa filters

* Second iteration (not working though)

* Verbose gossip logging etc.

* Gossip to team-nodes even if there is inter-team unreachability

* More work ...

* Marking removed nodes with tombstones in Gossip

* More test coverage for Gossip.remove

* Bug failing other multi-node tests squashed

* Multi-node test for team-split

* Review fixes - only prune tombstones on leader ticks

* Clean code is happy code.

* All I want is for MiMa to be my friend

* These constants are internal

* Making the formatting gods happy

* I used the wrong reachability for ignoring gossip :/

* Still hadn't quite gotten how reachability was supposed to work

* Review feedback applied

* Cross-team downing should still work

* Actually prune tombstones in the prune tombstones method ...

* Another round against reachability. Reachability leading with 15 - 2 so far.
2017-07-04 10:09:40 +02:00
Arnout Engelen
0115d5fdda Less abbreviations, more reliable test
(cherry picked from commit 61e289b276f410654c1b063c33648e0d7ea88e50)
2017-07-03 10:47:21 +02:00
Arnout Engelen
2f11ec6f25 Introduce cluster 'team' setting and add to Member
Introduced cluster-team.md so we can grow the documentation with each
PR, but did not add it to the ToC yet.

(cherry picked from commit a06badaa03fa9f3c9a942b1468090f758c74a869)
2017-07-03 10:47:14 +02:00
Patrik Nordwall
a7dc938188 Revert "Introduce cluster 'team' setting and add to Member"
This reverts commit a06badaa03fa9f3c9a942b1468090f758c74a869.
2017-07-03 10:44:36 +02:00
Patrik Nordwall
bd6afb8952 Revert "Less abbreviations, more reliable test"
This reverts commit 61e289b276f410654c1b063c33648e0d7ea88e50.
2017-07-03 10:44:24 +02:00
Nafer Sanabria
9bd27a2459 merge content of stream-io.md (#23236) 2017-07-01 09:33:45 -07:00
Richard Imaoka
afe349b6cd Fix typo getStageActorRef to getStageActor (#23259) 2017-06-30 03:07:30 -07:00
Rafael Avila
c8a7347355 Typos (#23260)
In Device Group section there are 2 occurrences of contains word and a mismatch type in the section about removing device actor when stopped.
2017-06-30 01:38:50 -07:00
Martynas Mickevičius
ba9e63215d Merge pull request #23255 from dwijnand/use-less-project-apply
Use less of Project.apply
2017-06-29 13:36:21 +03:00
Dale Wijnand
177ac666da
Use less of Project.apply
In sbt 1 Project.apply will only take 2 parameters.
2017-06-29 11:01:40 +01:00
Martynas Mickevičius
5fb44e2c18 Merge pull request #23238 from ktoso/wip-bump-jmh
=pro update sbt-jmh (readying up for sbt 1.0)
2017-06-29 12:42:48 +03:00
Martynas Mickevičius
453a95f978 Merge pull request #23242 from richard-imaoka/doc-stream-buffer-backpressure-imaoka
Correct the backpressure API comment for buffer
2017-06-29 11:23:03 +03:00
Konrad `ktoso` Malawski
1f05659346 =str #23119 improve docs of SourceQueue.watchTermination (#23208) 2017-06-28 06:11:33 -07:00
Arpan Chaudhury
bfb8f168f4 Can merging of multiple sources be prioritized? (#22864)
* Adding MergePrioritized graph stage

* Adding MergePrioritized in akka docs

* Adding suggested documentation of MergePrioritized in akka docs

* Adding thread safe random number generator ThreadLocalRandom

* fixing documentation for MergePrioritized

* Refactoring selectNextElement() in MergePrioritized for less memory allocations

* Removing extra parameter in MergePrioritized and using SplittableRandom

* Refactoring GraphMergePrioritizedSpec

* Changes for paradox migration

* Optimized a few methods in MergePrioritized (#22864)

* increased no of elements in source in GraphMergePrioritizedSpec (#22864)
2017-06-28 12:45:46 +02:00
Richard Imaoka
4f10d45376 Correct the backpressure API comment for buffer 2017-06-28 00:07:19 +09:00
Richard Imaoka
c636f3540f Correct the backpressure API comment for throttle (Fixes #22791) (#23225) 2017-06-27 05:32:53 -07:00
Arnout Engelen
8bea7b4ace Make the 'other modules' doc sections (#23233)
So they show up in the ToC
2017-06-27 12:51:50 +01:00
Konrad `ktoso` Malawski
5f22f8e552
=pro update sbt-jmh (readying up for sbt 1.0) 2017-06-27 18:49:19 +09:00
Richard Imaoka
1b1b825865 =tes Add parameter scaladocs to expectTerminated (#23227)
* Add API parameter comments to expectTerminated (Fixes #23091)

* Clarify that expectTerminated requires watch(target) beforehand
2017-06-27 18:45:37 +09:00
Arnout Engelen
403702d19f Move 'java 8 compatibility' under 'utilities' (#23232)
Doesn't really deserve a top-level section IMO
2017-06-26 23:53:11 -07:00
Patrik Nordwall
5ad217b338 debug logging in RemoteRestartedQuarantinedSpec, #17314 (#23237) 2017-06-26 23:51:49 -07:00
Arnout Engelen
9f78cd12c4 Introduce cluster 'team' setting and add to Member (#23234)
* Introduce cluster 'team' setting and add to Member

Introduced cluster-team.md so we can grow the documentation with each
PR, but did not add it to the ToC yet.

* Less abbreviations, more reliable test
2017-06-26 16:28:06 +02:00
Nafer Sanabria
f591bedfbb merge content of stream-testkit.md (#23213) 2017-06-26 02:55:18 -07:00
Nafer Sanabria
9856e2f378 merge content in stream-quickstart.md (#23212) 2017-06-26 02:52:36 -07:00
Richard Imaoka
f0fba394ea Merge paradox/scala/fault-tolerance.md and java/fault-tolerance.md (#23172) 2017-06-26 02:48:19 -07:00
Richard Imaoka
4c76424c3b Merge paradox/scala/io-tcp.md and java/io-tcp.md (#23163) 2017-06-26 02:45:59 -07:00
Josep Prat
0649f0c142 =doc Add dependency for Akka Typed #23222 (#23223) 2017-06-26 02:28:20 -07:00
Richard Imaoka
bfc055b297 Merge paradox/scala/persistence.md and java/persistence.md (#23226) 2017-06-26 02:15:43 -07:00
László van den Hoek
e4077cc14f fix typo (mather -> matter) (#23221) 2017-06-23 03:07:07 -07:00
László van den Hoek
2caf86b706 remove duplicate recoverWithRetries entry (#23220) 2017-06-23 02:45:12 -07:00
László van den Hoek
2772236d19 fix unbalanced quotes that mess up formatting (#23219) 2017-06-23 02:04:20 -07:00
Nafer Sanabria
8865691231 merge content of stream-rate.md (#23218) 2017-06-23 01:43:34 -07:00
Patrik Nordwall
6536553e00 Merge pull request #23214 from akka/wip-22082-DurableDataSpec2-patriknw
slow init of lmdb in DurableDataSpe, #22082
2017-06-22 22:46:18 +02:00
Patrik Nordwall
1a732fba71 slow init of lmdb in DurableDataSpe, #22082 2017-06-22 15:08:37 +02:00
Patrik Nordwall
49cf7afc68 Merge pull request #23209 from akka/wip-22082-debug-DurableDataSpec-patriknw
enable debug logging in DurableDataSpec, #22082
2017-06-20 21:12:11 +02:00
Patrik Nordwall
0d890e6364 enable debug logging in DurableDataSpec, #22082 2017-06-20 20:50:28 +02:00