Commit graph

36 commits

Author SHA1 Message Date
Christopher Batey
dba6eec460
Migration from persistent shard coordinator to ddata with eventsource… (#29058)
* Migration from persistent shard coordinator to ddata with eventsourced remembered entities

* Fix bin compat in typed sharding

* Add log capturing

* Java API for nested case objects in typed sharding settings

* Starting some docs for remembering entities store

* Snapshot and marker to detect going back to persistence mode

* Review feedback

* Unused imports
2020-05-13 10:38:11 +01:00
Johan Andrén
6f8f44b3df
Coordinator ddata state store with persistent remember entities (#29043)
* WIP

* Test and config update

* Multi-jvm tests updated to cover ddata state + persistent remember entities
2020-05-11 11:17:29 +01:00
Johan Andrén
722b68e7cc
Refactor remember entitites in shards (#28776)
* DData and Persistence based remember entitites refactored
* Order methods in the order of init in the shard.
* Some bad isolation between test cases causing problems
* Test coverage for remember entities store failures
* WithLogCapturing where applicable
* MiMa filters
* Timeouts from config for persistent remember entities
* Single method for deliver, less utf-8 encoding
* Include detail on write failure
* Don't send message to dead letter if it is actually handled in BackOffSupervisor
* Back off supervisor log format plus use warning for hitting max restarts
* actor/message based spi
* Missing assert that node had joined cluster
2020-04-03 14:57:49 +02:00
Helena Edelson
6bf20f4117 Update all copyright headers to 2020 after new year's #27881 (#28434) 2020-01-02 13:24:59 +01:00
Helena Edelson
ef09dca732 Consolidated passivation check on settings used in region and shard (#27738) 2019-09-19 13:23:27 +02:00
Helena Edelson
186b2bbc70
[Only] Deprecate Persistent mode of Cluster Sharding (#27585) 2019-08-30 07:25:29 -07:00
Helena Edelson
3bc627ad42
Cluster Sharding: make askAllShards not a hard coded timeout #27273 (#27274) 2019-07-08 08:00:08 -07:00
Patrik Nordwall
8757e35b7e Don't passivate idle for remembering entities (#27177) 2019-06-21 04:40:25 -07:00
Christopher Batey
3888de23ed Remove ApiMayChange from coordination module (#27026)
Note that it will be fully stable in 2.6.0 so no guarantees for milestones before that.

* remove api may change from sharding lease settings
* mima
* Remove settings from module
2019-05-29 15:41:16 +02:00
Patrik Nordwall
a5e9741d35 replace unicode arrows again (#26732) 2019-04-15 15:40:26 +00:00
Arnout Engelen
a39ac61265 Move Lease usage settings inside akka-coordination (#26637) 2019-03-29 14:27:08 +01:00
Christopher Batey
65ccada280 Lease API + use in cluster singleton and sharding, #26480 (#26629)
* lease api
* Cluster singleton manager with lease
* Refactor OldestData to use option for actor reference
* Sharding with lease
* Docs for singleton and sharding lease + config for sharding lease
* Have ddata shard wait until lease is acquired before getting state
2019-03-28 13:31:56 +01:00
Auto Format
75579bed17 format source with scalafmt, #26511 2019-03-15 10:23:46 +01:00
Auto Format
ce404e4f53 format source with scalafmt 2019-03-11 16:58:55 +01:00
kerr
bdc90052aa Update headers from 2018 to 2019 once for all. (#26165)
* Add CopyrightHeader support for sbt-boilerplate plugin.
* Add CopyrightHeader support for `*.proto` files.
* Add regex match for both `–` and `-` for CopyrightHeader.
* Add CopyrightHeader support for sbt build files.
* Update copyright from 2018 to 2019.
2019-01-02 11:55:26 +01:00
Johan Andrén
133c41375f Automatic passivation for typed sharding, #25512 2018-11-06 19:15:23 +01:00
kerr
fafc59b19d update headers to regular comment (#25807) 2018-10-29 05:19:37 -04:00
Konrad `ktoso` Malawski
563c7fbcf0 Issue 24594: Integration with sbt-headers and initial header population 2018-03-13 15:45:55 +01:00
Patrik Nordwall
a13f5cab00 ClusterSharding: automatically choose start or startProxy by a node role (#23934) (#24669) 2018-03-07 13:17:56 +09:00
Christopher Batey
009214ae07
Update copyright to 2018 (#24241) 2018-01-04 17:26:29 +00:00
Kirill Plyashkevich
c5ba0a3565 #21725 cluster-sharding doesn't delete snapshots and messages (#21777)
* #21725 cluster-sharding doesn't delete snapshots and messages
Fixes #21725
Without deleting messages those pollute persistence with not needed anymore messages. Naive and bullet proof flow is snapshot -> delete messges -> delete snapshots.

# Пожалуйста, введите сообщение коммита для ваших изменений. Строки,
# начинающиеся с «#» будут оставлены; вы можете удалить их вручную,
# если хотите. Пустое сообщение отменяет процесс коммита.
#
# Дата:      Mon Oct 31 23:24:37 2016 +0300
#
# интерактивное перемещение в процессе; над 432b53c
# Последняя команда выполнена (1 команда выполнена):
#    edit f86b015 21725 cluster-sharding doesn't delete snapshots and messages Fixes #21725 Without deleting messages those pollute persistence with not needed anymore messages. Naive and bullet proof flow is snapshot -> delete messges -> delete snapshots.
# Следующая команда для выполнения (1 команда осталась):
#    pick 56adb40 #21725 keeping N number of batches (messages and snapshot) using N from configuration
# Вы сейчас редактируете коммит при перемещении ветки  «fix-21725-delete-messages-after-snapshot» над «432b53c».
#
# Изменения, которые будут включены в коммит:
#	изменено:      akka-cluster-sharding/src/main/scala/akka/cluster/sharding/Shard.scala
#	изменено:      akka-cluster-sharding/src/main/scala/akka/cluster/sharding/ShardCoordinator.scala
#

* #21725 keeping N number of batches (messages and snapshot) using N from configuration
2017-02-21 14:17:19 +01:00
Patrik Nordwall
37679d307e rememberingEntities with ddata mode, #22154
* one Replicator per configured role
* log LMDB directory at startup
* clarify the imporantce of the LMDB directory
* use more than one key to support many entities
2017-01-23 11:57:52 +01:00
Philippus Baalman
6c7085252a extended copyright into 2017 2017-01-04 17:37:15 +01:00
Patrik Nordwall
141318e60a shard coordinator should wait until min-members regions registered, #21194 2016-10-28 15:49:21 +02:00
Peter Barron
1f9c374bd9 Cluster Sharding with remember-entity enabled fails to recover after restart #20744 2016-08-01 10:46:09 +02:00
Björn Antonsson
c66ce62d63 Update to a working version of Scalariform 2016-06-02 22:12:36 +02:00
jsuchenia
e4127c3af6 Improve documentation and configuration API when using together: sharding and distibuted data (#20215)
* Missing setter for stateStoreMode in ClusterShardingSettings

* Improve Sharding documentation regarding Distributed Data Storage
2016-04-18 11:37:56 +02:00
Johan Andrén
62e30b3c08 Update copyrights and links to the new company name #19851 2016-02-23 12:58:39 +01:00
Prayag Verma
b7783968a0 =pro #19068 All copyrights ranges and single years updated to a range ending in 2016 2016-01-25 10:20:30 +01:00
Patrik Nordwall
d44120b726 =cls Clarify the sharding role setting 2015-12-18 11:15:06 +01:00
Patrik Nordwall
50d7b1553a =cls #17846 Use provided scope for the distributed-data dependency 2015-08-21 14:36:52 +02:00
Ostapenko Evgeniy
6814d08ef1 =cls #17846 Use CRDTs instead of PersistentActor to remember the state of the ShardCoordinator #17871 2015-08-20 13:36:37 +03:00
Patrik Nordwall
70024298ac !cls #16422 Rename Entry to Entity in sharding 2015-06-11 10:00:43 +02:00
Patrik Nordwall
8276420a89 =cls #15619 Use event counting instead of time based snapshot in sharding 2015-06-11 10:00:42 +02:00
Patrik Nordwall
294659e2fe =cls #15330 Enable configuration of coordinator singleton 2015-06-11 10:00:42 +02:00
Patrik Nordwall
8de24f38ca !cls #17158 Add configuration of sharding journal
* Use same type of settings object as in cluster-tools
* These settings can be different for different entity types
2015-06-11 10:00:41 +02:00