Commit Graph

3009 Commits

Author SHA1 Message Date
Ivan Kozlovic
216c3d01ed Merge pull request #2304 from nats-io/clamp_max_subs_errors
[CHANGED] Reduce print for an account subs limit to every 2 sec
2021-06-22 11:39:57 -06:00
Derek Collison
2da8718a96 2.3.0-beta.14
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-22 10:36:07 -07:00
Derek Collison
7739eae45a Merge pull request #2302 from nats-io/js-encryption
JetStream Encryption at Rest
2021-06-22 10:35:02 -07:00
Ivan Kozlovic
1d3cddfa7c [CHANGED] Reduce print for an account subs limit to every 2 sec
We could make it for all limits by having a map of error types
instead of applying just to max subs.

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-06-22 11:00:41 -06:00
Ivan Kozlovic
364d9600a6 Merge pull request #2301 from nats-io/fix_2282
[FIXED] Clients disconnected on reload when only $SYS account configured
2021-06-22 09:29:56 -06:00
Derek Collison
3185658f42 Merge pull request #2299 from ripienaar/slow_purge
test to show slow purges
2021-06-22 07:43:52 -07:00
Derek Collison
2e145196b8 Fix for extended purge by sequence.
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-22 07:38:30 -07:00
R.I.Pienaar
c6b85fd101 update for review
Signed-off-by: R.I.Pienaar <rip@devco.net>
2021-06-22 08:47:08 +02:00
Derek Collison
bf6335dff9 Add in ability to have encrypted JetStream filestores.
This supports XChaChaPoly1305 for Seal and Open and ChaCha20 for our message blocks which use highway hashes and sequence numbers for authenticity.
We support snapshot and restore as well.

Signed-off-by: Derek Collison <derek@nats.io>
2021-06-21 19:28:10 -07:00
Ivan Kozlovic
a39b549513 [FIXED] Clients disconnected on reload when only $SYS account configured
This was introduced by PR#1900 by detecting that a single system
account was configured. A "fake" user name was created and added
to the list of users and set as a no_auth_user.
However, on config reload, a new fake user was created, which
would cause existing connected clients to be disconnected.

Resolves #2282

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-06-21 14:03:42 -06:00
Ivan Kozlovic
189336417f [FIXED] Websocket compression/decompression issue with continuation frames
For compression, continuation frames had the compress bit set, which is
wrong since only the first frame should.
For decompression, continuation frames were decompressed individually
instead of assembling the full payload and then decompressing.

Resolves #2287

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-06-21 11:09:19 -06:00
R.I.Pienaar
c9bf329a99 test to show slow purges
Signed-off-by: R.I.Pienaar <rip@devco.net>
2021-06-21 17:01:49 +02:00
Derek Collison
6129562b63 2.3.0-beta.12
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-20 11:00:42 -07:00
Derek Collison
5fcd9c5564 Add test for sequence only
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-20 10:42:35 -07:00
Derek Collison
89d930fd0f Updates and fixes to PurgeEx
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-20 10:34:27 -07:00
Derek Collison
9398c3ca28 Allow for more advanced purge operations that filter by subject, specify the sequence or number of messages to keep.
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-19 07:04:44 -07:00
R.I.Pienaar
53ae604403 further tagged error confusion cleanups
Signed-off-by: R.I.Pienaar <rip@devco.net>
2021-06-18 21:35:26 +02:00
R.I.Pienaar
a0fcf0bb65 further tagged error confusion cleanups
Signed-off-by: R.I.Pienaar <rip@devco.net>
2021-06-18 20:11:09 +02:00
Derek Collison
e7fd6961d6 Fix data race condition
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-18 07:47:19 -07:00
Derek Collison
36f2dbed8b Merge pull request #2292 from dtest11/js_config_check
remove config !nil check,beacuse the if branch is always not nil
2021-06-18 07:36:30 -07:00
Derek Collison
c75d97a0d3 Fix for #2290
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-18 07:03:51 -07:00
dtest11
a268905cd5 remove config !nil check,beacuse the if branch is always not nil 2021-06-18 18:02:45 +08:00
Matthias Hanel
9f6ba90d3e [fixing] leafnode missing retry and service export interest propagation (#2288)
* [fixing] leafnode missing retry and service export interest propagation

A missing account on initial connect attempt caused the leaf node
connection to never be established.

An account service import subscription was not propagated along leaf
node connections.

Signed-off-by: Matthias Hanel <mh@synadia.com>
2021-06-17 19:10:05 -04:00
Derek Collison
0069f752b6 2.3.0-beta.10
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-15 10:20:38 -07:00
Derek Collison
6219f0381d Test rename for no race versions
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-15 09:41:11 -07:00
Derek Collison
d9a0ff904c Bump timeout threshold
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-15 08:53:11 -07:00
Derek Collison
d0ac1a40ca Added in per subject limits for streams.
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-15 06:36:34 -07:00
Derek Collison
08cdb2d2ea Make filtered consumers in large mixed streams more efficient.
Allow wider scoped filtered subjects.

We introduce a per subject information tracking to filestore to optimize for large mux'd streams and more efficient filtered consumers.

Signed-off-by: Derek Collison <derek@nats.io>
2021-06-15 04:44:05 -07:00
Derek Collison
f4e34092c6 2.3.0-beta.8
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-12 11:18:31 -07:00
Derek Collison
81f8e1afda Merge pull request #2281 from nats-io/account_limits
[FIXED] Dynamic account limits would limit based on single server limits.
2021-06-12 10:44:53 -07:00
Derek Collison
ceebc3ae07 When checking limits we would check total ask against the server limits if limits were not set.
We were also dynamically setting account limits based on a single server limit.

Signed-off-by: Derek Collison <derek@nats.io>
2021-06-12 10:27:43 -07:00
Derek Collison
5ec0f291a6 When we got into certain situations where we are catching up but the first entry matches the index but not the term, we would not update term.
This would cause CPU spikes and catchup cycles that could spin.

Signed-off-by: Derek Collison <derek@nats.io>
2021-06-11 15:02:46 -07:00
Derek Collison
ecc2545e6d 2.3.0-beta.6
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-11 06:20:59 -07:00
Derek Collison
4912c8b8f7 Make sure leader ready
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-10 21:29:03 -07:00
Derek Collison
326a377b3e When leader changes happened to streams that mirrored or sourced other streams we could continue to try to create consumers.
This could get excessive on a stream that has sourced many upstream origin streams and had several leader changes.

Signed-off-by: Derek Collison <derek@nats.io>
2021-06-10 19:47:46 -07:00
Derek Collison
ae1202903c 2.3.0-beta.4
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-10 14:51:06 -07:00
Derek Collison
afbb8bf4c8 Merge pull request #2278 from nats-io/gr_hdrs
[FIXED] Headers were lost from a response across a GW and through a route.
2021-06-10 14:50:16 -07:00
Derek Collison
1270977322 When receiving a response across a gateway that has headers and a globally routed subject (_GR_) we were dropping header information.
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-10 14:29:33 -07:00
Waldemar Quevedo
9013527024 Merge pull request #2277 from nats-io/ocsp-more-config
ocsp: add more config options to customize OCSP
2021-06-10 11:43:23 -07:00
Waldemar Quevedo
60499e2749 ocsp: add more config options to customize ocsp stapling
Signed-off-by: Waldemar Quevedo <wally@synadia.com>
2021-06-10 10:48:51 -07:00
Derek Collison
637973a1c7 fomatting
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-10 10:04:41 -07:00
Derek Collison
4965a5c494 Merge branch 'master' into active_servers 2021-06-10 09:57:55 -07:00
Matthias Hanel
83389db226 [fixed] hanging leaf node connection when account can't be found (#2267)
* [fixed] hanging leaf node connection when account can't be found

as a result of the issue, the leaf node connection never got created,
even after the account can be found.

Also tracing account id and name (when available)

Signed-off-by: Matthias Hanel <mh@synadia.com>
2021-06-10 11:55:16 -04:00
Matthias Hanel
2caf2303f2 [adding] jetstream info to statsz (#2269)
* [adding] jetstream info to statsz

Signed-off-by: Matthias Hanel <mh@synadia.com>
2021-06-10 11:54:56 -04:00
Derek Collison
cc63915f54 Added active servers to statsz.
This is generally useful but will also help with cli actions since we know from first response how many total responses are expected.

Signed-off-by: Derek Collison <derek@nats.io>
2021-06-09 19:14:37 -07:00
Derek Collison
be9fb5f6f2 2.3.0-beta.2
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-09 17:08:33 -07:00
Derek Collison
3626668025 Merge pull request #2275 from nats-io/pull_gw
[FIXED] Handling of subject rewrites for subjects to a globally routed subject.
2021-06-09 17:07:43 -07:00
Derek Collison
e238512285 Handling of rewrites for subjects to a globally routed subject was not properly handling c.pa.deliver or reply rewrite.
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-09 15:34:47 -07:00
Ivan Kozlovic
c45f4f0353 [FIXED] LeafNode config reload failed without any change made
Issuing a configuration reload for a leafnode that has remotes
defined with remotes having more than 1 url could lead to a failure.
This is because we have introduced shuffling of remote urls but
that was done in the server's options object, which then would
cause the DeepEqual when diff'ing options to fail.
We move the suffling to the private list of urls.

The other issue was that the "old" remote option may not have
had a local account and it was not set to "$G", which could make
the DeepEqual fail.

Resolves #2273

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-06-09 16:12:39 -06:00
Derek Collison
eec9cb849e Bump version
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-09 08:15:02 -07:00