Derek Collison 7e38ebcb6e Allow assets such as streams and their associated consumers to migrate between clusters. ...

The system will allow an update to a stream, and subsequently all attached consumers, to be placed in another cluster either directly or via tag placement.
The meta layer will scale the underlying peerset appropriately to straddle the two clusters for both the stream and consumers, taking into account the consumer type.
Control will then pass to the current leaders of the assets who will monitor the catchup status of the new peers.
(Note we can optimize this later to only traverse once across a GW for any given asset, but for now this is simpler)
Once the original leaders have determined the assets are synched it will pass leadership to a member of the new peerset.
Once the new leader has been elected, it will forward a request for the meta layer to shrink the peerset by removing the old peers.

Signed-off-by: Derek Collison <derek@nats.io>

2022-04-04 18:28:36 -07:00

..

configs

[fixed] tls timeout now accepts units

2021-07-19 11:42:28 -04:00

pse

Travis updates

2021-11-15 17:23:08 -07:00

sysmem

Travis updates

2021-11-15 17:23:08 -07:00

accounts_test.go

improve mapping template regex to allow for some extra spaces and associated test upgrade

2022-03-10 11:30:51 -08:00

accounts.go

added max_ack_pending setting to js account limits (#2982)

2022-03-31 14:17:16 -04:00

auth_test.go

Reset authSet state

2022-01-21 11:03:19 -08:00

auth.go

Fixed #2810. Do not warn about password for internally generated no auth user when just system account assigned to non-default.

2022-01-21 10:09:10 -08:00

ciphersuites.go

Add TLS 1.3 (and new ciphers) in the tlsVersion output

2020-03-18 10:09:23 -06:00

client_test.go

[FIXED] A slow consumer could cause the publisher to block

2021-11-09 17:22:15 -07:00

client.go

Some changes based on review

2022-04-01 17:55:33 -06:00

closed_conns_test.go

System Account on by default.

2020-05-29 17:56:45 -07:00

config_check_test.go

[CHANGED] Duplicates in authorization{} and accounts{} now detected

2022-03-21 19:50:16 -06:00

const.go

Updated snapshot default chunk size and window size

2022-03-31 16:14:18 -06:00

consumer.go

Allow assets such as streams and their associated consumers to migrate between clusters.

2022-04-04 18:28:36 -07:00

dirstore_test.go

In Merge validate nkey and subsequent saveIfNewer error on invalid jwt (#2985)

2022-03-31 14:25:25 -04:00

dirstore.go

In Merge validate nkey and subsequent saveIfNewer error on invalid jwt (#2985)

2022-03-31 14:25:25 -04:00

disk_avail_openbsd.go

Travis updates

2021-11-15 17:23:08 -07:00

disk_avail_windows.go

Travis updates

2021-11-15 17:23:08 -07:00

disk_avail.go

Travis updates

2021-11-15 17:23:08 -07:00

errors_gen.go

fix error code for JSStreamHeaderExceedsMaximumErr

2021-09-15 09:01:03 +02:00

errors_test.go

Renaming IsErr to ErrorIs

2020-02-25 19:53:09 -05:00

errors.go

Merge pull request #2890 from nats-io/jnm/partition_mapping

2022-03-25 11:30:24 -07:00

errors.json

Allow assets such as streams and their associated consumers to migrate between clusters.

2022-04-04 18:28:36 -07:00

events_test.go

[FIXED] Check for no_auth_user

2021-12-14 10:00:54 -07:00

events.go

Allow assets such as streams and their associated consumers to migrate between clusters.

2022-04-04 18:28:36 -07:00

filestore_test.go

Fixed data race and some flappers

2022-03-31 10:05:34 -06:00

filestore.go

Improved consumer snapshot logic in clustered mode and disk usage.

2022-03-29 18:02:49 -07:00

fuzz.go

Travis updates

2021-11-15 17:23:08 -07:00

gateway_test.go

Fixed some data race and some flappers

2022-03-29 19:02:41 -06:00

gateway.go

Fixed some data race and some flappers

2022-03-29 19:02:41 -06:00

ipqueue_test.go

Changes to IPQueues

2022-03-17 17:53:06 -06:00

ipqueue.go

Changes to IPQueues

2022-03-17 17:53:06 -06:00

jetstream_api.go

Allow assets such as streams and their associated consumers to migrate between clusters.

2022-04-04 18:28:36 -07:00

jetstream_cluster_test.go

Allow assets such as streams and their associated consumers to migrate between clusters.

2022-04-04 18:28:36 -07:00

jetstream_cluster.go

Allow assets such as streams and their associated consumers to migrate between clusters.

2022-04-04 18:28:36 -07:00

jetstream_errors_generated.go

Allow assets such as streams and their associated consumers to migrate between clusters.

2022-04-04 18:28:36 -07:00

jetstream_errors_test.go

attempt to improve UX of the error system

2021-08-10 16:08:28 +02:00

jetstream_errors.go

attempt to improve UX of the error system

2021-08-10 16:08:28 +02:00

jetstream_events.go

add domain in JS advisories

2021-05-07 19:35:46 +02:00

jetstream_test.go

Not allowing streams to be created meant we could not recover on server restart.

2022-04-01 06:41:22 -07:00

jetstream.go

fix crash on shutdown with meta being nil (#2999)

2022-04-04 17:40:19 -04:00

jwt_test.go

Add a config modification callback to createJetStreamCluster (#2998)

2022-04-04 17:39:58 -04:00

jwt.go

Remove dynamic account behaviors.

2022-02-04 13:32:18 -08:00

leafnode_test.go

Fix some flappers

2022-03-25 18:24:17 -06:00

leafnode.go

Adding denies $KV.>/$OBJ.> along leaf connections on differing domain (#2916)

2022-03-09 13:17:59 -05:00

log_test.go

Ensure file path is correct during stream restore

2022-03-09 13:31:51 -07:00

log.go

Some changes based on review

2022-04-01 17:55:33 -06:00

memstore_test.go

Improve memory usage through JetStream storage layer.

2022-03-24 17:45:15 -06:00

memstore.go

Improve memory usage through JetStream storage layer.

2022-03-24 17:45:15 -06:00

monitor_sort_opts.go

lint updates

2019-05-06 15:41:38 -07:00

monitor_test.go

[ADDED] Monitoring: MQTT and Websocket blocks in /varz endpoint

2022-04-04 10:11:55 -06:00

monitor.go

[ADDED] Monitoring: MQTT and Websocket blocks in /varz endpoint

2022-04-04 10:11:55 -06:00

mqtt_test.go

[ADDED] Tiered limits and fix limit issues on updates (#2945)

2022-03-28 20:47:54 -04:00

mqtt.go

Changes to IPQueues

2022-03-17 17:53:06 -06:00

nkey_test.go

support always presenting a nonce to clients

2021-11-17 15:19:00 +01:00

nkey.go

support always presenting a nonce to clients

2021-11-17 15:19:00 +01:00

norace_test.go

OrderedConsumer was very conservative with slow start and small max outstanding bytes. This is increasing perf for longer rtt.

2022-03-30 05:08:36 -07:00

ocsp.go

Add support for designated OCSP responders

2021-11-16 13:33:44 -08:00

opts_test.go

Update test to capture accounts{} and single u/p or token

2022-03-22 10:29:11 -06:00

opts.go

added max_ack_pending setting to js account limits (#2982)

2022-03-31 14:17:16 -04:00

parser_test.go

[CHANGED] Enforce max_control_line for client connections only

2021-01-26 15:33:39 -07:00

parser.go

Reset authSet state

2022-01-21 11:03:19 -08:00

ping_test.go

Fixed TestPing test

2020-06-12 10:03:47 -06:00

raft_test.go

[FIXED] Corrupted headers receiving from consumer with meta-only

2021-12-01 10:50:15 -07:00

raft.go

Allow assets such as streams and their associated consumers to migrate between clusters.

2022-04-04 18:28:36 -07:00

rate_counter_test.go

[ADDED] TLS connection rate limiter

2022-01-11 16:57:19 +02:00

rate_counter.go

[ADDED] TLS connection rate limiter

2022-01-11 16:57:19 +02:00

reload_test.go

Ensure file path is correct during stream restore

2022-03-09 13:31:51 -07:00

reload.go

We were not accounting for some newer internal clients (JETSTREAM, ACCOUNT, etc) when reloading authorization, etc.

2022-03-30 19:12:18 -07:00

ring_test.go

…

ring.go

Adding an option to include subscription details in monitoring responses.

2020-03-23 12:25:51 -04:00

route.go

[CHANGED] Gateway: Detect duplicate names between clusters

2022-03-15 15:00:13 -06:00

routes_test.go

Ensure file path is correct during stream restore

2022-03-09 13:31:51 -07:00

sendq.go

Changes to IPQueues

2022-03-17 17:53:06 -06:00

server_test.go

[CHANGED] Rate limit similar warnings

2022-04-01 15:24:03 -06:00

server.go

Some changes based on review

2022-04-01 17:55:33 -06:00

service_test.go

Travis updates

2021-11-15 17:23:08 -07:00

service_windows.go

Shutdown on Ctrl+C

2019-11-14 20:05:32 -07:00

service.go

Travis updates

2021-11-15 17:23:08 -07:00

signal_test.go

Travis updates

2021-11-15 17:23:08 -07:00

signal_windows.go

Handle SIGTERM on windows

2021-09-01 14:55:26 -07:00

signal.go

Travis updates

2021-11-15 17:23:08 -07:00

split_test.go

Refactor async client tests

2019-12-12 11:58:24 -07:00

store.go

[ADDED] Tiered limits and fix limit issues on updates (#2945)

2022-03-28 20:47:54 -04:00

stream.go

Allow assets such as streams and their associated consumers to migrate between clusters.

2022-04-04 18:28:36 -07:00

sublist_test.go

Js leaf deny (#2693)

2021-12-16 16:53:20 -05:00

sublist.go

fixed queue group memory leak

2021-09-13 15:22:05 +03:00

test_test.go

[ADDED] Allow certain consumer attributes to be updated #2670, #2603

2021-11-04 13:43:11 -07:00

trust_test.go

Check errors when removing test directories and files

2021-04-07 11:09:47 -07:00

util_test.go

[FIXED] Server version check

2022-03-25 12:11:55 -06:00

util.go

[FIXED] Server version check

2022-03-25 12:11:55 -06:00

websocket_test.go

Add X-Forwarded-For IP to the client's remote address

2022-01-03 11:56:12 -07:00

websocket.go

[ADDED] MQTT: Support for Websocket

2021-12-06 16:13:13 -07:00