Derek Collison
df2147bc7c
Fix for rollups and filtered purge
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-10-04 10:01:36 -07:00
Ivan Kozlovic
d34b8fdd7d
[FIXED] JetStream: data race on shutdown
...
Replaced use of eventsEnabled() with EventsEnabled() that will
check under server lock. Also found another reference when
creating templates.
Resolves #2588
Signed-off-by: Ivan Kozlovic <ivan@synadia.com >
2021-09-30 11:17:12 -06:00
Derek Collison
c062190b0a
Rollup functionality.
...
Messages published with the rollup header will place the new message onto the stream and purge all others based on subject, or the complete stream.
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-29 18:59:21 -07:00
Derek Collison
1338a167e3
Merge pull request #2584 from nats-io/sealed-stream
...
Allow streams to be sealed through a stream update.
2021-09-29 16:02:58 -07:00
Derek Collison
5fc2cc5754
Allow streams to be sealed through a stream update.
...
Sealed streams can not accept new messages, allow you to delete or purge messages, or have messages expire due to age.
Sealed stream can not be unsealed through an update.
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-29 15:25:38 -07:00
R.I.Pienaar
98ef6cb03c
fixes the msg get audit event
...
We resused msg variable for both the request
and later the data loaded from the stream.
The data thus replaces the request and the audit
had the data as both request and response
Signed-off-by: R.I.Pienaar <rip@devco.net >
2021-09-29 17:36:38 +02:00
Matthias Hanel
377a46eedd
Merge pull request #2580 from nats-io/hdr-ping
...
[fixed] missing support for header in some request handler
2021-09-28 17:41:15 -04:00
Matthias Hanel
9c01794f5f
Merge pull request #2581 from nats-io/src-mirror-ln-3way
...
added unit test to test stream source/mirror cross different domains
2021-09-28 17:41:04 -04:00
Matthias Hanel
11bf8505cf
added unit test to test stream source/mirror cross different domains
...
Signed-off-by: Matthias Hanel <mh@synadia.com >
2021-09-28 16:20:37 -04:00
Matthias Hanel
3379b3b612
[fixed] missing support for header in some request handler
...
Signed-off-by: Matthias Hanel <mh@synadia.com >
2021-09-28 14:28:03 -04:00
Derek Collison
de83307e8d
Log when we adjust the peer set size
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-28 11:02:53 -07:00
Derek Collison
f4177bacbc
Bump version
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-27 19:59:05 -07:00
Derek Collison
74e2034aed
Only adjust downward if we have a total >= original estimate
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-27 18:39:37 -07:00
Derek Collison
8223275c44
On cold start in mixed mode if the js servers were not > non-js we could stall.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-27 16:59:42 -07:00
Ivan Kozlovic
6400c8cabf
Release v2.6.1
...
Signed-off-by: Ivan Kozlovic <ivan@synadia.com >
2021-09-23 17:47:47 -06:00
Ivan Kozlovic
812ba157ba
Merge pull request #2568 from nats-io/js-conn-cnt
...
[FIXED] Internal connections were counted toward account's max connections (client or leaf)
2021-09-23 17:45:00 -06:00
Derek Collison
15fb253c7c
Revert back to old subject, don't suppress updates on non client/leaf
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-23 16:07:35 -07:00
Derek Collison
3740a707f6
Do not count non client or leafnode connections for account limit reporting.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-23 15:43:07 -07:00
Derek Collison
77eb639b2c
Merge pull request #2569 from nats-io/catchup
...
Improve handling when exceeding account resources.
2021-09-23 14:48:20 -07:00
Derek Collison
7340dde408
Improve handling when exceeding account resources and trying to catch up streams, etc.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-23 14:21:14 -07:00
Ivan Kozlovic
7b25755980
Adjust timing
...
Signed-off-by: Ivan Kozlovic <ivan@synadia.com >
2021-09-23 09:56:42 -06:00
Matthias Hanel
6fe3939ca4
NO COMMIT, demonstrate JS conn count
...
Signed-off-by: Matthias Hanel <mh@synadia.com >
2021-09-23 11:53:34 -04:00
Ivan Kozlovic
23e8dc9902
Fix corrupt wal test that was flapping
...
Signed-off-by: Ivan Kozlovic <ivan@synadia.com >
2021-09-23 09:36:46 -06:00
Ivan Kozlovic
7d389169d5
Update version to beta until ready to release
...
Signed-off-by: Ivan Kozlovic <ivan@synadia.com >
2021-09-23 09:08:54 -06:00
Ivan Kozlovic
d58b2a106f
Merge pull request #2563 from nats-io/mixed_enablement_js
...
[FIXED] Storage limit of 0, which means disabled, was not always enforced
2021-09-22 17:52:05 -06:00
Ivan Kozlovic
93dc39dcda
Fixed other MQTT test that was setting JWT mem but not disk limits
...
Signed-off-by: Ivan Kozlovic <ivan@synadia.com >
2021-09-22 17:24:33 -06:00
Ivan Kozlovic
a3be36fcd4
Moving 2 new tests to jetstream test file
...
Signed-off-by: Ivan Kozlovic <ivan@synadia.com >
2021-09-22 17:02:29 -06:00
Ivan Kozlovic
b0d487fe68
Fix MQTT test that was not setting MaxStore
...
Signed-off-by: Ivan Kozlovic <ivan@synadia.com >
2021-09-22 16:51:34 -06:00
Derek Collison
f6f5d6d4b2
Merge pull request #2564 from nats-io/max-consumers
...
Direct consumers used for mirroring should not be affected by max consumers limits
2021-09-22 15:29:28 -07:00
Derek Collison
944b90d4a3
Fix for no storage limits
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-22 15:28:43 -07:00
Derek Collison
ebb24006c2
Direct consumers used for mirroring should not be affected by max consumer limits
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-22 15:01:51 -07:00
Derek Collison
075e8c9070
Make sure wp is > len(cache.buf)
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-22 14:46:31 -07:00
Matthias Hanel
060beff99f
NO COMMIT, unit test to show issue with mixed enablement of js storage
...
Signed-off-by: Matthias Hanel <mh@synadia.com >
2021-09-22 17:20:14 -04:00
Derek Collison
eab45b404a
Fix for deadlock with stream mirrors or sources where origin is interest or workqueue policy.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-22 10:59:02 -07:00
Ivan Kozlovic
f34156e411
Release v2.6.0
...
Signed-off-by: Ivan Kozlovic <ivan@synadia.com >
2021-09-21 16:17:27 -06:00
Matthias Hanel
29a6367889
incorporating review comments.
...
Signed-off-by: Matthias Hanel <mh@synadia.com >
2021-09-21 17:13:53 -04:00
Matthias Hanel
9911b37b0c
[added] value to JS stats showing memory used from accounts with reservations
...
[fixed] reservations accounting issue on reload introduced by:
commit: bfb726e8e9
clearResources appeared to have been a workaround and broke
reload for non global accounts
Signed-off-by: Matthias Hanel <mh@synadia.com >
2021-09-21 16:35:24 -04:00
Derek Collison
29037a4f5c
Merge pull request #2554 from nats-io/issue-2551
...
[FIXED] #2551
2021-09-21 09:15:23 -07:00
Derek Collison
9534372113
Fix for #2551
...
When a mirror would be processed before the origin stream we would not recover the consumers due to failure on looking up source's subjects.
This change processes all streams first then does all consumers.
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-21 08:53:12 -07:00
Derek Collison
052bb7ca54
Merge to fix conflicts
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-21 08:16:51 -07:00
Derek Collison
de851e513f
Fix for #2548
...
Replicated durable consumers that were backed by a memory store were bypassing snapshotting which also did compaction of the raft WAL.
This change adapts for memory store backed consumers by compacting the raft WAL directly on snapshot logic.
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-21 08:02:11 -07:00
Derek Collison
63c242843c
Avoid panic if WAL was truncated out from underneath of us.
...
If we were leader stepdown as well.
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-21 07:26:03 -07:00
Derek Collison
12bb46032c
Fix RAFT WAL repair.
...
When we stored a message in the raft layer in a wrong position (state corrupt), we would panic, leaving the message there.
On restart we would truncate the WAL and try to repair, but we truncated to the wrong index of the bad entry.
This change also includes additional changes to truncateWAL and also reduces the conditional for panic on storeMsg.
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-20 18:41:37 -07:00
Matthias Hanel
cf6715bc19
Merge pull request #2539 from nats-io/reserved_memory
...
Exposing reserved memory in jsz/varz
2021-09-20 12:55:07 -04:00
R.I.Pienaar
3be0b23a3e
Merge pull request #2546 from ripienaar/negative_dupe_window_protection
...
protect against negative dupe window via negative max age
2021-09-20 18:09:19 +02:00
R.I.Pienaar
34b5a11e20
protect against negative dupe window via negative max age
...
Signed-off-by: R.I.Pienaar <rip@devco.net >
2021-09-20 17:34:48 +02:00
Derek Collison
c764da328c
Make sure to set last sequence on recovery, check for ddloaded on last msg id
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-20 07:11:15 -07:00
Derek Collison
edac5992b8
Bump version
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-19 14:02:00 -07:00
Derek Collison
cecb6246f2
Test tweaks
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-19 13:28:37 -07:00
Derek Collison
cfb69bbd1f
Only rebuild dedupe state as needed versus always on startup.
...
Was penalizing large non-dedupe streams on startup.
Signed-off-by: Derek Collison <derek@nats.io >
2021-09-19 13:27:26 -07:00