Commit Graph

3054 Commits

Author SHA1 Message Date
R.I.Pienaar
4ec7931726 remove duplicate error
Signed-off-by: R.I.Pienaar <rip@devco.net>
2021-07-08 18:14:03 +02:00
Matthias Hanel
c68ffe5ad5 [adding] kind and client_type to account connect/disconnect events (#2351)
* [adding] kind and client_type to client info. specifically account connect/disconnect events

Kind is Client/Leafnode but can take the value of Router/Gateway/JetStream/Account/System in the future.
When kind is Client, then client_type is set to mqtt/websocket/nats
This fixes #2291

Signed-off-by: Matthias Hanel <mh@synadia.com>
2021-07-07 17:43:50 -04:00
Ivan Kozlovic
988d12b24a Release v2.3.2
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-07-06 15:05:19 -06:00
Matthias Hanel
fcb3382f4b [fixed] CONNS system endpoint which had issues with header and empty msg
Signed-off-by: Matthias Hanel <mh@synadia.com>
2021-07-06 16:46:36 -04:00
Ivan Kozlovic
315e658a5f Merge pull request #2347 from nats-io/econsumer
Make requirement for interest on creation of ephemerals soft vs hard.
2021-07-06 14:44:11 -06:00
Ivan Kozlovic
b582b13a96 Fixed another flapper
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-07-06 14:20:16 -06:00
Ivan Kozlovic
df3eccbd69 Fix yet another flapper
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-07-06 13:55:28 -06:00
Ivan Kozlovic
710d0c3a1f Fixed another flapper
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-07-06 12:44:08 -06:00
Ivan Kozlovic
d5f5a74438 Fixed some tests
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-07-06 12:20:03 -06:00
Derek Collison
57cfba0964 Make requirement for interest on creation of ephemerals soft vs hard.
Will start the cleanup timer if no interest but allow creation.

Signed-off-by: Derek Collison <derek@nats.io>
2021-07-06 10:48:07 -07:00
Derek Collison
6eef31c0fc Fixed peer info reports that had large last active values.
Also put in safety for lag going upside down as well.

Signed-off-by: Derek Collison <derek@nats.io>
2021-07-06 10:14:43 -07:00
Derek Collison
960c45df81 Use of sync.Pool for filestore could cause msg corruption.
Signed-off-by: Derek Collison <derek@nats.io>
2021-07-06 08:41:01 -07:00
R.I.Pienaar
709e256d64 Add error codes for all consumer creation errors
I wanted to supress some logging of consumer create
errors that just isn't needed and would be really
annoying on large networks, so I added many constants
and updated all errors.

I think only JSConsumerStoreFailedErrF is worth logging
on large networks else there would be quite a lot of
logs generated that one just cannot act on

Signed-off-by: R.I.Pienaar <rip@devco.net>
2021-07-06 14:51:03 +02:00
Matthias Hanel
dc27c360aa Merge pull request #2338 from nats-io/sys-export
[fixed] header handling in system services
2021-07-01 19:15:24 -04:00
Matthias Hanel
a72ca8a9bf [fixed] header handling in system services
On export/import a header was inserted which broke parsing of the
message.
Fixed unit test broken by .beta in version

Signed-off-by: Matthias Hanel <mh@synadia.com>
2021-07-01 19:00:52 -04:00
Ivan Kozlovic
4e6fe87c06 Fix version
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-07-01 16:55:00 -06:00
Derek Collison
9b73fae5bd We should not sit in place here, no measurable effect on latency in tests
Signed-off-by: Derek Collison <derek@nats.io>
2021-07-01 14:29:09 -07:00
Derek Collison
fd9e9480da Merge pull request #2333 from nats-io/srace
Check not really needed here, so removed
2021-07-01 06:19:46 -07:00
Derek Collison
ad4685c84f Fix for crash in test run
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-30 19:30:37 -07:00
Derek Collison
c2c146c9f2 Fix for #2329.
When we created a filestore we would figure out if we should track by subject based on stream config.
This would cause bad results when a stream was updated to multiple subjects or wildcards.
This change tightens when and what we track but turns it on all the time now.

Signed-off-by: Derek Collison <derek@nats.io>
2021-06-30 19:10:31 -07:00
Derek Collison
617f061084 Check not really needed here, so removed
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-30 15:08:56 -07:00
Ivan Kozlovic
13334c227d Release v2.3.1
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-06-29 13:51:32 -06:00
Derek Collison
35f6be2056 If dirty flag set always write state out
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-29 12:25:28 -07:00
Derek Collison
a78f155733 2.3.1-RC.1
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-29 08:36:00 -07:00
Derek Collison
26e63a14a6 Merge pull request #2324 from nats-io/large-r1
Improvements to large numbers of JetStream R1 consumers per stream.
2021-06-29 08:35:17 -07:00
Derek Collison
3c16f776dc Protect account prand, use faster Uint64 variant
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-29 06:13:41 -07:00
Derek Collison
99fed910f0 Improvements to large numbers of JetStream R1 consumers per stream.
1. We were holding open FDs longer than we should for consumers causing issues with open FD limits. We now do not hold them open and cap updates a bit better.

2. When doing a stream delete, consumer delete was repeating alot of work that was not necessary, causing longer delays. This has been optimized a bit, still more improvements to be made.

3. We cover all JS under a single export, but that was also trapping GetNext for pull based consumers, and since this was a no-op (is handled at user account level) we were creating alot of garbage service import responses and reverse map entries that had to be garbage collected. We have a fix in to avoind this but still looking for a better one.

4. Still had some lingering references to all exports vs single JS export.

Signed-off-by: Derek Collison <derek@nats.io>
2021-06-29 05:45:55 -07:00
Derek Collison
bb84ef7d91 Added ability to match based on last expected sequence per subject.
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-28 10:57:50 -07:00
R.I.Pienaar
0d71d35e43 do not log at Error level for some store failures
Some of these are quite generic errors that can happen a lot
in normal circumstances so no need to be too noisy about them

Fixes one missed old style Api Error

Signed-off-by: R.I.Pienaar <rip@devco.net>
2021-06-28 10:18:16 +02:00
Derek Collison
cbb97a4f4a Fix for Go client behavior change
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-27 10:52:03 -07:00
Derek Collison
63479ff8fd Bump threshold
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-27 08:33:46 -07:00
Derek Collison
146c249d55 2.3.1-beta.1
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-25 13:57:16 -07:00
Derek Collison
545230bd9e FIXED Clustered streams can become broken with seq mismatch state on low level store failures.
We can account for high level failure properly but were not properly accounting for low level store failures.

Signed-off-by: Derek Collison <derek@nats.io>
2021-06-25 13:46:40 -07:00
Derek Collison
08197de9e0 FIXED max consumers was not enforced when set on stream
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-25 11:45:36 -07:00
Derek Collison
b596eb0a40 Bump to 2.3.1
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-24 14:04:20 -07:00
Derek Collison
c0e47966ab Added in Stream get last message by subject.
This is to aid in K/V overlay for simple Get ops vs creating a full blown consumer.

Signed-off-by: Derek Collison <derek@nats.io>
2021-06-24 13:21:39 -07:00
Derek Collison
a27f198b83 Skip for now, covermode blows up memory and latency thresholds
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-23 13:50:14 -07:00
Ivan Kozlovic
f9cc49a610 Release v2.3.0
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-06-23 12:50:19 -06:00
Derek Collison
225c8b4a85 Bump threshold
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-22 17:44:19 -07:00
Derek Collison
1fcb7cc695 Bump to 2.3.0-RC.1
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-22 16:14:24 -07:00
Derek Collison
87f44ad333 Merge pull request #2306 from nats-io/fspm
Improvements to filtered purge and general memory usage for filestore.
2021-06-22 16:13:38 -07:00
Derek Collison
6bbc29281c Make sure to return tmp bufs to pool when we can
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-22 16:11:21 -07:00
Derek Collison
b3753aba1b Improvements to filtered purge and general memory use for filestore.
We optimized the filtered purge to skip msgBlks that are not in play.
Also optimized msgBlock buffer usage by using two sync.Pools to enhance reuse.

Signed-off-by: Derek Collison <derek@nats.io>
2021-06-22 15:47:26 -07:00
Ivan Kozlovic
d7933631a9 [FIXED] Failed route TLS handshake would leave failed conn's lock, locked
This is a regression introduced in v2.2.6.

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-06-22 14:05:43 -06:00
Ivan Kozlovic
23ec1daab5 Bump to beta 16 and ran go mod tidy
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-06-22 11:42:43 -06:00
Ivan Kozlovic
216c3d01ed Merge pull request #2304 from nats-io/clamp_max_subs_errors
[CHANGED] Reduce print for an account subs limit to every 2 sec
2021-06-22 11:39:57 -06:00
Derek Collison
2da8718a96 2.3.0-beta.14
Signed-off-by: Derek Collison <derek@nats.io>
2021-06-22 10:36:07 -07:00
Derek Collison
7739eae45a Merge pull request #2302 from nats-io/js-encryption
JetStream Encryption at Rest
2021-06-22 10:35:02 -07:00
Ivan Kozlovic
1d3cddfa7c [CHANGED] Reduce print for an account subs limit to every 2 sec
We could make it for all limits by having a map of error types
instead of applying just to max subs.

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-06-22 11:00:41 -06:00
Ivan Kozlovic
364d9600a6 Merge pull request #2301 from nats-io/fix_2282
[FIXED] Clients disconnected on reload when only $SYS account configured
2021-06-22 09:29:56 -06:00