Commit Graph

2341 Commits

Author SHA1 Message Date
Derek Collison
4759560e29 Fixed raft bug on catchup logic with external snapshots
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-12 19:58:02 -08:00
Derek Collison
7facbc995b More robust key detection per feedback
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-12 18:23:16 -08:00
Derek Collison
d803189eca Changes needed to properly support multi-layer service imports for system services like JS.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-12 17:01:32 -08:00
Derek Collison
eadb801d0d Bump Version
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-11 22:13:01 -08:00
Derek Collison
e07cf84985 Merge pull request #1906 from nats-io/snapshots
Snapshot and Compaction Improvements
2021-02-11 22:44:36 -07:00
Derek Collison
5ef4d138cb Interest based retention did not work correctly with wildcards or multiple subjects and filtered consumers.
This allows that to work properly, needed for MQTT.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-11 20:59:20 -08:00
Derek Collison
d70ae1fb97 Fix for interest policy based retention for streams in clusters.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-11 18:52:37 -08:00
Derek Collison
579737a5e1 General fixes, stability improvements
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-11 18:13:24 -08:00
Derek Collison
49c3729abd Detect closed state
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-11 13:37:16 -08:00
Derek Collison
6c2ccaa30b go vet error
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-11 11:24:35 -08:00
Derek Collison
55886616b7 Fix for index mismatch on first seq
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-11 11:16:00 -08:00
Derek Collison
fa8a95a06a Improved snapshots and compactions.
Various bug fixes and stability improvements.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-11 11:16:00 -08:00
R.I.Pienaar
369f604589 track per server stats rather than cluster stats
Signed-off-by: R.I.Pienaar <rip@devco.net>
2021-02-11 16:20:14 +01:00
R.I.Pienaar
b36abc0f31 skip responses from non leaders in jsz
Adds an error type and a check to avoid sending them
to clients

Signed-off-by: R.I.Pienaar <rip@devco.net>
2021-02-09 17:34:29 +01:00
Matthias Hanel
c67f1526e4 fix jsz when server is not started in cluster mode and fix landing page (#1901)
Signed-off-by: Matthias Hanel <mh@synadia.com>
2021-02-08 21:10:20 -05:00
Derek Collison
aeef06b677 Merge pull request #1900 from nats-io/stepdown
Allow meta leader stepdown.
2021-02-08 17:01:48 -07:00
Derek Collison
fc71f5b1e8 Account for reload with autosetup
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-08 15:39:51 -08:00
Derek Collison
08fcc3646e Report any stepdown errors
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-08 15:15:29 -08:00
Derek Collison
ad0f10fb5c Allow metaleader stepdown.
Allow easy way to put authorization on system account and still use $G.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-08 15:01:23 -08:00
Ivan Kozlovic
264148ead2 Merge pull request #1899 from nats-io/si_subj_remap
Remap subject only for service imports
2021-02-08 15:54:36 -07:00
Matthias Hanel
0cae6ab4e7 [added] support for jwt based account mappings (#1897)
support for jwt based account mappings

Signed-off-by: Matthias Hanel <mh@synadia.com>
2021-02-08 17:25:14 -05:00
Ivan Kozlovic
8af8cf4e67 Remap subject only for service imports
Also optimized a test that was taking too long to run.

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-02-08 14:41:33 -07:00
Matthias Hanel
10154c5388 [added] system_account to varz/accounts and is_system to accountz (#1898)
Signed-off-by: Matthias Hanel <mh@synadia.com>
2021-02-08 15:58:53 -05:00
Jaime Piña
71b842520b Prevent non-exported messages from leaking into importer account (#1891)
* Add account isolation tests config & jwt

* Set the shadow subscription static subject
2021-02-08 14:07:18 -05:00
Derek Collison
b25055bbf6 Added leader only response for jsz.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-08 10:40:33 -08:00
Derek Collison
d4cc658c35 Bump version [ci skip]
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-08 07:43:14 -08:00
Derek Collison
c99608fa65 Fix for some test flappers
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-08 07:00:52 -08:00
Derek Collison
7ae8d66c6d Do ramp down on server stats on startup
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-08 06:46:57 -08:00
Derek Collison
594defa11b Fix for crash in test
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-08 06:32:05 -08:00
Derek Collison
15355d783b For larger superclusters we send out our server information after a short delay on startup.
For determing leaderless make sure the raft node has been running for long enough.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-08 06:26:33 -08:00
Derek Collison
c16f6e193d Move JetStream direct APIs to private.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-07 15:19:22 -08:00
Derek Collison
42e3210265 Shutdown JetStream on failed stream msg store in clustered mode
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-07 11:52:52 -08:00
Ivan Kozlovic
d732c8fe82 Fixed bug that would prevent queue subs to ack messages
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-02-07 11:26:54 -07:00
Derek Collison
92d64c2bcc Reset WAL on mismatch catchup regardless, condition ok
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-07 09:30:13 -08:00
Derek Collison
a16affedca Always reset election timeout on vote request
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-07 08:09:01 -08:00
Derek Collison
f209c60123 Send our own serverinfo when we receive an update from a new server
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-07 06:53:07 -08:00
Derek Collison
c11a733502 Broken test for non MarshalIndent
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-07 05:08:22 -08:00
Derek Collison
74a4c531c9 Stability improvements.
Changes to catchup logic, peer tracking, and vote responses.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-06 20:13:18 -08:00
Derek Collison
716da693e4 Track peers differently, react to removal entries
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-06 20:11:30 -08:00
Derek Collison
1c79d96de8 user single node info struct
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-06 20:10:29 -08:00
Derek Collison
6d32c307ef Remove pretty indent for json.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-06 20:09:44 -08:00
Derek Collison
b358773ddf Force filestore to flush in place by default.
Track lost data and truncate message blocks when detecting failures or write errors.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-06 20:04:47 -08:00
Derek Collison
1622c2b60e Send serverInfo on remote shutdown and remove mapping entries
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-05 17:21:55 -08:00
Matthias Hanel
7b7543d298 [added] jsz nats and http monitoring endpoint for jetstream (#1881)
The new endpoints are /jsz on http and "$SYS.REQ.SERVER.PING.JSZ" and "$SYS.REQ.SERVER.%s.JSZ".
$SYS.REQ.ACCOUNT.%s.JSZ will only return info for the particular account

Signed-off-by: Matthias Hanel <mh@synadia.com>
2021-02-05 18:46:04 -05:00
Derek Collison
f500527d12 Make peer reassigment supercluster aware.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-05 07:21:00 -08:00
Derek Collison
78f549b35b Make direct message retrieval from stream cluster aware
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-05 06:37:49 -08:00
Derek Collison
493425e8b2 Noticed stream snapshots were being processed on recovery causing high cpu usage and memory usage.
Also made consumer Created() UTC.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-04 12:29:07 -08:00
Derek Collison
74b1e1f72c Change the way we decide to compact on purge op replay
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-04 09:45:51 -08:00
Derek Collison
483b07a794 Make sure old purge did what it was supposed to
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-04 07:49:30 -08:00
Derek Collison
c49e3247bb Purge operations would be replayed on restart regardless if they had already been processed.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-04 07:04:50 -08:00