Commit Graph

5406 Commits

Author SHA1 Message Date
Derek Collison
fb15dfd9b7 Allow replica updates during stream update.
Also add in HAAssets count to Jsz.

Signed-off-by: Derek Collison <derek@nats.io>
2022-02-13 19:33:46 -08:00
Derek Collison
7f985e350c Merge pull request #2865 from nats-io/pull_consumer_hb
Allow pull requests to specify a heartbeat
2022-02-11 11:18:02 -08:00
Derek Collison
5a93b0e9d8 Allow pull requests to specify a heartbeat when idle to detect when a request is invalidated.
Signed-off-by: Derek Collison <derek@nats.io>
2022-02-11 09:51:51 -08:00
Derek Collison
c0dafb1d05 Merge pull request #2864 from ripienaar/npe_restore_failure
avoid seg fault when stream restore fails
2022-02-11 06:49:34 -08:00
R.I.Pienaar
6bb0861eb7 avoid seg fault when stream restore fails
Signed-off-by: R.I.Pienaar <rip@devco.net>
2022-02-11 10:45:09 +01:00
Ivan Kozlovic
4aaf76e20d Merge pull request #2863 from nats-io/fix_cons_dc_count
Fixed consumer dlv count and num pending wrong due to redeliveries
2022-02-10 18:24:51 -07:00
Ivan Kozlovic
55ffde7251 Fixed consumer dlv count and num pending wrong due to redeliveries
Introduced by #2848, so should not have impacted existing releases.

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2022-02-10 17:33:53 -07:00
Derek Collison
9010f3542a Bump to 2.7.3-beta
Signed-off-by: Derek Collison <derek@nats.io>
2022-02-09 17:36:15 -08:00
Derek Collison
6fcd87935c Merge pull request #2859 from nats-io/fss_cleanup
Remove fss files from a snapshot when a block is removed.
2022-02-09 17:33:29 -08:00
Derek Collison
68104d7cf3 During a filestore snapshot we generate the fss files but were not cleaning them up if the block was deleted before a server restart.
https://gist.github.com/nekufa/010185dfb59261f222a0042d3a7d2a1c

Signed-off-by: Derek Collison <derek@nats.io>
2022-02-09 17:12:08 -08:00
Derek Collison
ecfe42630a Merge pull request #2858 from nats-io/add_consumer_with_info
Make sure we snapshot initial consumer info during consumer creation.
2022-02-09 17:05:01 -08:00
Derek Collison
da9046b2e6 Snapshot initial consumer info when needed.
Signed-off-by: Derek Collison <derek@nats.io>
2022-02-09 15:23:53 -08:00
Derek Collison
096f5e5249 Merge pull request #2857 from nats-io/issue_2850
A stream name is tied to its identity and can not be changed on a restore.
2022-02-09 13:09:04 -08:00
Derek Collison
0cc7302be9 A stream name is tied to its identity and can not be changed on a restore.
Signed-off-by: Derek Collison <derek@nats.io>
2022-02-09 12:38:45 -08:00
Derek Collison
3fe94b1a70 Merge pull request #2856 from nats-io/jsdir
Removed JetStream directory
2022-02-09 08:58:06 -08:00
Derek Collison
0659cd6692 Removed JetStream directory
Signed-off-by: Derek Collison <derek@nats.io>
2022-02-09 08:32:49 -08:00
Ivan Kozlovic
3dcf0246c6 [FIXED] Adding a consumer could return inaccurate consumer info
The issue is that the consumer info returned by the consumer create
API is gathered after the consumer is added and possibly after
starting to deliver pending messages.

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2022-02-09 09:04:16 -07:00
Derek Collison
e997252b9a Merge pull request #2848 from nats-io/sparse_consumers
Improved sparse consumers replay time.
2022-02-08 14:44:12 -08:00
Derek Collison
c13a84cf44 Fixed a bug that would calculate the first sequence of a filteredPending incorrectly.
Also added in more optimized version to select the first matching message in a message block for LoadNextMsg.

Signed-off-by: Derek Collison <derek@nats.io>
2022-02-08 13:29:38 -08:00
Derek Collison
d50febeeff Improved sparse consumers replay time.
When a stream has multiple subjects and a consumer filters the stream to a small and spread out list of messages the logic would do a linear scan looking for the next message for the filtered consumer.
This CL allows the store layer to utilize the per subject info to improve the times.

Signed-off-by: Derek Collison <derek@nats.io>
2022-02-07 17:26:32 -08:00
Derek Collison
d71bb63e1b Merge pull request #2847 from nats-io/fc_stall
Fixed flow control stall under specific conditions of message size.
2022-02-07 09:28:17 -08:00
Derek Collison
55b7f11c9a Fixed flow control stall under specific conditions of message size.
Signed-off-by: Derek Collison <derek@nats.io>
2022-02-05 20:15:48 -08:00
Ivan Kozlovic
135475babb Merge pull request #2841 from nats-io/release_2_7_2
Release v2.7.2
2022-02-04 14:56:58 -07:00
Ivan Kozlovic
6d92051696 Release v2.7.2
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2022-02-04 14:49:39 -07:00
Derek Collison
664e8b92b6 Merge pull request #2840 from nats-io/dyn_acc
Remove dynamic account behaviors.
2022-02-04 13:36:54 -08:00
Derek Collison
a0a2e32185 Remove dynamic account behaviors.
We used these in tests and for experimenting with sandboxed environments like the demo network.

Signed-off-by: Derek Collison <derek@nats.io>
2022-02-04 13:32:18 -08:00
Derek Collison
d3f78deaaf Merge pull request #2833 from nats-io/si_subjects
Added in ability to get per subject details via StreamInfo.
2022-02-02 09:13:32 -08:00
Derek Collison
5da0453964 Add in NumSubjects to StreamInfo
Signed-off-by: Derek Collison <derek@nats.io>
2022-02-02 08:51:13 -08:00
Derek Collison
6a3cf0f71e Added in ability to get number of subjects from StreamInfo, and optionally details per subject on how many messages each subject has.
This can also be filtered, meaning you can filter out the subjects when asking for details.

Signed-off-by: Derek Collison <derek@nats.io>
2022-02-02 08:51:13 -08:00
Derek Collison
2ed7a812d8 Merge pull request #2838 from nats-io/issue_2836
FIXED #2836
2022-02-01 14:22:09 -08:00
Derek Collison
12f5ea3655 When a consumer had not filtered subject and was attached to a interest policy retention stream we could incorrectly drop messages.
Signed-off-by: Derek Collison <derek@nats.io>
2022-02-01 14:21:05 -08:00
Derek Collison
a55efc48c8 Merge pull request #2837 from nats-io/corrupt_flapper
Fix flapping test - TestNoRaceJetStreamClusterCorruptWAL
2022-02-01 13:41:24 -08:00
Derek Collison
6b5332249b This test was using fetch and failing if the complete batch was not filled.
This has nothing to do with the test, we just want to make sure the leader steps down and there were no low level errors on the fetch.

Signed-off-by: Derek Collison <derek@nats.io>
2022-02-01 13:34:00 -08:00
Derek Collison
d97968e5a5 Merge pull request #2835 from nats-io/consumer_pending_bug
Consumer pending gets stuck.
2022-02-01 13:14:44 -08:00
Derek Collison
8fce45dfa7 Under certain scenarios the pending for a consumer could appear to get stuck.
Under the covers we were calculating pending per msg block incorrectly when a single message existed beyond the requested sequence.

Signed-off-by: Derek Collison <derek@nats.io>
2022-02-01 12:17:08 -08:00
Ivan Kozlovic
b23ed77868 Merge pull request #2834 from nats-io/fix_backoff
[FIXED] JetStream: BackOff redeliveries would always use first in list
2022-01-31 17:48:47 -07:00
Ivan Kozlovic
30c431a9a3 [FIXED] JetStream: BackOff redeliveries would always use first in list
If the consumer's sequence was not the same than the stream's sequence,
then the redelivery would always use the first duration from the
BackOff list.

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2022-01-31 17:44:08 -07:00
Derek Collison
0d158728d1 Merge pull request #2824 from nats-io/fix-nodeinfo
Store JetStream Config in node info map
2022-01-31 13:58:12 -08:00
Derek Collison
74c0fdc3bb Merge pull request #2831 from nats-io/discard_new_kv
Fixed behavior for when MaxMsgsPerSubject is set and DiscardNew is also set.
2022-01-31 09:13:38 -08:00
Derek Collison
fa814f7cee Fixed behavior for when MaxMsgsPerSubject is set and DiscardNew is also set.
Signed-off-by: Derek Collison <derek@nats.io>
2022-01-31 08:36:37 -08:00
Derek Collison
6b690bd5b6 Bump to 2.7.2-beta
Signed-off-by: Derek Collison <derek@nats.io>
2022-01-30 15:24:07 -08:00
Derek Collison
fd407ba708 Merge pull request #2832 from nats-io/nak-nowait
A true no wait pull request was not considering redeliveries.
2022-01-30 15:23:01 -08:00
Derek Collison
8815072e34 Fix flapping test
Signed-off-by: Derek Collison <derek@nats.io>
2022-01-30 14:54:24 -08:00
Derek Collison
b38ced51b2 A true no wait pull request was not considering redeliveries.
Signed-off-by: Derek Collison <derek@nats.io>
2022-01-30 11:52:35 -08:00
Derek Collison
2e6904e6f1 Merge pull request #2830 from nats-io/issue-2828
FIXES #2828.
2022-01-30 09:47:05 -08:00
Derek Collison
275d42628b Fix for #2828. The original design of the consumer and the subsequent store did not allow updates.
Now that we do, we need to store the new config into our storage layer.

Signed-off-by: Derek Collison <derek@nats.io>
2022-01-30 09:45:05 -08:00
Derek Collison
617e1fb76e Merge pull request #2829 from nats-io/consumer_update
Updating a push consumer to be pull should fail.
2022-01-28 16:58:48 -08:00
Derek Collison
a57bd96def Updating a push consumer to be pull would succeed but cause a panic if used.
This disallows that upgrade. We had a check in place for pull to push, but not the reverse.

Signed-off-by: Derek Collison <derek@nats.io>
2022-01-28 13:11:58 -08:00
Jaime Piña
ae8eedb88e Store JetStream Config in node info map 2022-01-27 14:46:41 -08:00
Ivan Kozlovic
26b692ee73 Merge pull request #2823 from nats-io/fix_nightly_2
Nightly: set Go version to 1.17 and use latest goreleaser
2022-01-26 15:44:53 -07:00