Derek Collison
ee92cc9a5b
Properly print when a stream is doing out of band catchup. Print node banner consistently
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-14 07:29:36 -07:00
Derek Collison
299f44cddf
This changes our behaviors for streams and peer removals in several ways.
...
First we no longer try to auto-remap stream assignments on peer removals from the system.
We also now can always respond to stream info requests if at least a member is running.
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-11 06:52:28 -05:00
Ivan Kozlovic
84fbcdcd34
Remove internal retries for mirrors and sources
...
We let the go routine do it.
Signed-off-by: Ivan Kozlovic <ivan@synadia.com >
2021-03-10 15:47:19 -07:00
Ivan Kozlovic
27f51d4028
Fix ephemeral consumer delete in single cluster
...
Also remove retry of sources/mirror in the setSourceConsumer() itself
when not getting a response.
Signed-off-by: Ivan Kozlovic <ivan@synadia.com >
2021-03-10 15:16:31 -07:00
Derek Collison
263f4452c3
Delete no longer needed
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-10 07:15:58 -05:00
Derek Collison
f95b6481d2
Make source and mirror consumers direct, meaning they are not mapped by the metaleader.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-10 07:12:48 -05:00
Ivan Kozlovic
52c4ab60f6
Merge pull request #1982 from nats-io/fix_idle_hbs_and_js_remote_unsubs
...
Fixed consumer idle hearbeats and JS route/GWs unsubscribes
2021-03-09 13:23:25 -07:00
Ivan Kozlovic
ccec4a6ab1
Fixed consumer idle hearbeats and JS route/GWs unsubscribes
...
Signed-off-by: Ivan Kozlovic <ivan@synadia.com >
2021-03-09 12:08:47 -07:00
Waldemar Quevedo
86a64fbc46
Updates to JS consumer errors
...
Signed-off-by: Waldemar Quevedo <wally@synadia.com >
2021-03-09 09:46:28 -08:00
Derek Collison
ea9abc5ef8
Wait longer for response
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-09 05:41:00 -06:00
Derek Collison
e5e8205fac
Need to make sure order of clseq as stamped also make it to the propose chan.
...
However we do not want to hold the actual stream lock.
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-09 00:34:33 -06:00
Ivan Kozlovic
57af977548
Stabilized stream sources under restart
...
Signed-off-by: Ivan Kozlovic <ivan@synadia.com >
2021-03-08 16:41:02 -07:00
Derek Collison
467614ea87
Make sure to check for old messages during processsing.
...
Also changed the way we detect old messages.
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-08 15:42:03 -06:00
Derek Collison
673543c180
Modified flow control for clustered mode.
...
Set channels into and out of RAFT layers to block.
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-08 12:58:57 -06:00
Derek Collison
5fe9ba5e94
Switched to fast state
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-06 09:00:15 -08:00
Derek Collison
0b3c686430
Fixes for data races and some locking.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-05 17:19:51 -08:00
Derek Collison
ff98984358
Reworked internal consumers used for sources and mirrors.
...
Now use ephemerals and heartbeats and flowcontrol.
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-05 14:32:57 -08:00
Derek Collison
dd8acb1a99
Fixed a bug where we were not determing clustered state so were straight processing msgs from routes.
...
Cleaned up lseq and clseq code.
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-05 12:00:19 -08:00
Derek Collison
75b0455e0b
Enable opt-in flow control for push based consumers.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-05 08:48:12 -08:00
Derek Collison
4bfd6485f6
Can't remove based on interest directly
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-04 19:11:24 -08:00
Derek Collison
207ebd3b3d
Changed stream sendq to linked list outq.
...
Made consumer share streams outq.
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-04 17:19:50 -08:00
Derek Collison
e70e46ea4a
Updates based on PR feedback
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-04 16:16:28 -08:00
Derek Collison
bfb8e3432e
Move RAFT comms off internal sendq.
...
Move route and gateway msgs our of fast path for inbound stream msgs.
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-04 14:45:34 -08:00
Derek Collison
d7201a110b
Better handling on out of disk.
...
Suppress some stream and consumer bad results since they delete the asset.
Allow rehup to re-enable JetStream.
Various bug fixes and improvements.
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-03 20:12:10 -08:00
Derek Collison
4f7fbefc7c
In clustered JetStream we need to move API calls out of routes/gateways/leafnodes path.
...
This moves from explicit imports and subscriptions to one wildcard subscription and a single wildcard export.
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-02 17:54:41 -08:00
Derek Collison
49cd38c064
Enable cross account behaviors for mirrors and sources.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-02 06:36:57 -08:00
Derek Collison
2d70429f83
More conservative in replay
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-01 14:22:27 -08:00
Derek Collison
8cfc56f8b0
Enable support for changing config on stream restore.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-02-28 10:01:01 -08:00
Derek Collison
b9e1a921ff
Use internal wildcard inbox for stream and consumer info requests.
...
More gateway friendly but suffers from no echo, so added new client based internal send.
Signed-off-by: Derek Collison <derek@nats.io >
2021-02-28 10:01:01 -08:00
Derek Collison
9fc7561c40
Support updating sources via stream update.
...
Tweaked internal consumers and flow logic for sources and mirrors.
Signed-off-by: Derek Collison <derek@nats.io >
2021-02-28 05:17:17 -08:00
Derek Collison
7c670e4eae
Allow sources and mirrors to not be pre-defined.
...
Will keep trying to establish contact.
Fixed bug where double source headers for sourced messages were causing issues.
Signed-off-by: Derek Collison <derek@nats.io >
2021-02-26 07:32:29 -08:00
Derek Collison
752f67acee
Explicit on async and sync settings
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-02-25 17:08:14 -08:00
Derek Collison
36a2cbeff7
Cross account pull consumers would not work correctly due to reply subject rewrite.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-02-24 13:33:24 -08:00
Derek Collison
20d250c7cf
Move storage type to own variable for unlocked access, can't change
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-02-23 17:20:12 -08:00
Derek Collison
09e3d26fa3
Add in support for stream mirrors and sources.
...
Add in proper support for stream updates in clustered mode.
Don't send API updates without subjects, caused GW parser errors.
Stream internal loops use their own clients now.
Signed-off-by: Derek Collison <derek@nats.io >
2021-02-23 10:57:27 -08:00
Ivan Kozlovic
61bd1b8d86
MQTT clustering
...
Signed-off-by: Ivan Kozlovic <ivan@synadia.com >
2021-02-19 08:50:00 -07:00
Derek Collison
d803189eca
Changes needed to properly support multi-layer service imports for system services like JS.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-02-12 17:01:32 -08:00
Derek Collison
579737a5e1
General fixes, stability improvements
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-02-11 18:13:24 -08:00
Derek Collison
fa8a95a06a
Improved snapshots and compactions.
...
Various bug fixes and stability improvements.
Signed-off-by: Derek Collison <derek@nats.io >
2021-02-11 11:16:00 -08:00
Derek Collison
c16f6e193d
Move JetStream direct APIs to private.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-02-07 15:19:22 -08:00
Derek Collison
42e3210265
Shutdown JetStream on failed stream msg store in clustered mode
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-02-07 11:52:52 -08:00
Derek Collison
6d32c307ef
Remove pretty indent for json.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-02-06 20:09:44 -08:00
Derek Collison
a1e0f7dc1a
First pass at supercluster enablement.
...
This allows metacontrollers to span superclusters. Also includes placement directives for streams. By default they select the request origin cluster.
Signed-off-by: Derek Collison <derek@nats.io >
2021-02-03 17:28:13 -08:00
Derek Collison
e5c1d65fff
Added in JS disable per server on reload. Also removing peerw from a stream and leader stepdown for streams and consumers.
...
Various bug fixes, stability improvments.
Signed-off-by: Derek Collison <derek@nats.io >
2021-02-01 19:39:08 -08:00
Derek Collison
095a83bc2a
Make sure to suppress duplicate create/delete audit events
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-01-31 09:16:16 -08:00
Derek Collison
5490c4969b
Fixed a bug that on restore of single streams in clustered mode would subscribe to the stream subjects twice.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-01-29 19:37:30 -08:00
Derek Collison
457ca3b9cf
Suppress additional advisories on server restart and leadership changes.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-01-29 15:08:22 -08:00
Derek Collison
d2a92221fb
Duplicate leader elect and lost advisories to the system account as well.
...
Also suppress lost quorums to at most once every 10 secs.
Signed-off-by: Derek Collison <derek@nats.io >
2021-01-29 08:51:20 -08:00
Derek Collison
277483b386
Change over last to active and a duration
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-01-22 12:34:21 -08:00
Derek Collison
227901a56b
More cleanup and stabilization for consumers and failing when sending messages.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-01-22 10:09:30 -08:00