Commit Graph

6893 Commits

Author SHA1 Message Date
Derek Collison
4744ff3478 Bump to 2.9.12-RC.3
Signed-off-by: Derek Collison <derek@nats.io>
2023-02-01 22:46:25 -07:00
Derek Collison
73d389e41c Merge pull request #3837 from nats-io/snapshot-fix
[FIXED] Do not let !NeedSnapshot() avoid snapshots and compaction.
2023-02-01 21:44:10 -08:00
Derek Collison
e9a983c802 Do not let !NeedSnapshot() avoid snapshots and compaction.
Signed-off-by: Derek Collison <derek@nats.io>
2023-02-01 22:05:25 -07:00
Waldemar Quevedo
d40c4c6fb3 Merge pull request #3835 from nats-io/go-1.19.5
Bump to Go 1.19.5
2023-01-31 15:30:24 -06:00
Byron Ruth
163743ab3f Bump to Go 1.19.5
Signed-off-by: Byron Ruth <byron@nats.io>
2023-01-31 15:43:16 -05:00
Derek Collison
cb743aef87 Merge pull request #3834 from nats-io/pkg-updates
[UPDATED] Package updates
2023-01-31 10:05:00 -08:00
Derek Collison
390fd02918 Updates to tests for updated Go client changes
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-31 09:47:36 -08:00
Derek Collison
12a49859e9 Update pkg dependencies
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-31 09:33:01 -08:00
Derek Collison
1252653c16 Merge pull request #3829 from nats-io/jarema/fix-message-after-update
Fix Consumer not getting messages after filter update
2023-01-30 19:59:32 -08:00
Derek Collison
d9aa69c332 Bump to 2.9.12-RC.2
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-30 19:56:53 -08:00
Derek Collison
e0798d26eb Merge pull request #3831 from nats-io/snapshots
Minor fixes and optimizations for snapshots.
2023-01-30 19:53:22 -08:00
Derek Collison
740ec2f85e Merge pull request #3832 from nats-io/deadlock-fix
[FIXED] Deadlock on dataloss when holding mb lock.
2023-01-30 19:49:51 -08:00
Derek Collison
598e27243f Fix possible deadlock on dataloss
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-30 19:10:19 -08:00
Derek Collison
6058056e3b Minor fixes and optimizations for snapshots.
We were snappshotting more then needed, so double check that we should be doing this at the stream and consumer level.
At the raft level, we should have always been compacting the WAL to last+1, so made that consistent. Also fixed bug that would not skip last if more items behind the snapshot.

Signed-off-by: Derek Collison <derek@nats.io>
2023-01-30 17:54:18 -08:00
Derek Collison
e7d7313640 Merge pull request #3830 from nats-io/shutdown-fix
Fix for isGroupLeaderless when JS not available (due to shutdown)
2023-01-30 17:18:33 -08:00
Waldemar Quevedo
13372508e2 Fix for isGroupLeaderless when JS not available (due to shutdown)
Signed-off-by: Waldemar Quevedo <wally@nats.io>
2023-01-30 15:29:42 -08:00
Tomasz Pietrek
836848ca64 Fix Consumer not getting messages after filter update
Signed-off-by: Tomasz Pietrek <tomasz@nats.io>
2023-01-30 20:47:17 +01:00
Derek Collison
fd371781b2 Merge pull request #3828 from nats-io/kv-opt
A few small optimizations
2023-01-30 08:13:57 -08:00
Derek Collison
52a78c0352 Small optimizations.
1. Only snapshot with minSnap time window like consumers and meta. Make it consistent for all to 5s.
2. Only snapshot at the end of processing all entries pending vs inside the loop.
3. Use fast state when calculating sync request, do not need deleted details there.

Signed-off-by: Derek Collison <derek@nats.io>
2023-01-29 10:58:00 -08:00
Derek Collison
e1a2da8d85 Small optimizations
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-28 11:45:47 -08:00
Derek Collison
bf49f23bb1 Only hold on to so many pending in memory, will fetch from WAL
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-28 11:34:55 -08:00
Derek Collison
9fff931f25 Merge pull request #3825 from nats-io/source-cycle
[FIXED] Sourced streams that do not overlap subjects reported as a cycle.
2023-01-27 13:41:30 -08:00
Derek Collison
64096e5ef5 Fix for flapping test
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-27 13:19:44 -08:00
Derek Collison
f4e6481ce7 Allow report cycles between source streams if subjects truly form a cycle.
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-27 13:03:24 -08:00
Derek Collison
7682eaa389 Merge pull request #3804 from madper/dragonflybsd
Add support for dragonfly bsd.
2023-01-27 08:35:42 -08:00
Chengjun Xie
6cbca6b783 Add support for dragonfly bsd.
Simply copy the pse implementation for openbsd.
2023-01-27 10:43:30 +08:00
Derek Collison
ad0a8403bb Merge pull request #3812 from nats-io/neil/lintprintf
Lint warnings on `fmt.Print`, `fmt.Printf`, `fmt.Println`
2023-01-26 10:29:43 -08:00
Derek Collison
8a40326a70 Bump to 2.9.12-RC.1
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-26 10:07:30 -08:00
Derek Collison
c7a75c5a6d Merge pull request #3817 from nats-io/force-consumer-replicas
[FIXED] Force consumer replicas to match for interest policy streams
2023-01-26 09:39:15 -08:00
Derek Collison
c09ea405d6 Merge pull request #3794 from nats-io/neil/rafthealthz
Add small tolerance in stream health check
2023-01-26 09:17:03 -08:00
Derek Collison
3d78459ad1 Fixup for bad merge
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-26 09:09:30 -08:00
Neil Twigg
83932b4be6 Don't mark a clustered stream as unhealthy if making forward progress, add TestJetStreamClusterCurrentVsHealth 2023-01-26 16:57:34 +00:00
Derek Collison
d0a7a8169a Merge branch 'main' into force-consumer-replicas 2023-01-26 08:35:49 -08:00
Derek Collison
461aad17a5 Merge pull request #3820 from nats-io/issue-3791
[FIXED] Select consumer peer(s) from active peers only.
2023-01-26 08:27:11 -08:00
Derek Collison
b238323b0c Merge pull request #3818 from nats-io/issue-3636-2
[FIXED] Properly process updates on a stream on restart.
2023-01-26 08:26:07 -08:00
Derek Collison
e15eb22ca6 When we create a consumer with less replicas then the stream, make sure to select from online peers.
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-25 20:08:04 -08:00
Derek Collison
a5cbd0b029 Fixed a bug that would not properly process updates on a stream on restart.
During restart if the stream existed but was also in a meta-snapshot delivered by the leader we would not process the update properly.

Signed-off-by: Derek Collison <derek@nats.io>
2023-01-25 18:16:33 -08:00
Derek Collison
4a3c27a251 Fix MQTT test for consumer replica override.
This was ill-advised by me, not understanding that the messages stream for MQTT was interested policy based.
Interest policy based streams require consumers to match the replica count.

Signed-off-by: Derek Collison <derek@nats.io>
2023-01-25 17:58:57 -08:00
Neil Twigg
7ae243352a Lint warnings on fmt.Print, fmt.Printf, fmt.Println 2023-01-24 16:10:13 +00:00
Derek Collison
bcd53ba53a Merge pull request #3808 from nats-io/jarema/fix-not-assigning-sig-sub
Assign signal subscription to consumer when created
2023-01-24 07:12:53 -08:00
Tomasz Pietrek
c89883b6aa Fix assigning signal subscription to consumer
Signed-off-by: Tomasz Pietrek <tomasz@nats.io>
2023-01-24 12:26:22 +01:00
Derek Collison
f62d929018 Consumer must match replica of parent stream if interest based policy.
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-23 20:16:42 -08:00
Derek Collison
3380fe1c74 Merge pull request #3806 from nats-io/direct-gets
[FIXED] Updating a stream to direct gets would fail direct gets.
2023-01-23 17:29:36 -08:00
Derek Collison
f4ee6530a0 When updating a stream to Direct Gets we were not spinning up subscription endpoint properly.
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-23 16:51:07 -08:00
Derek Collison
185a1f373c Merge pull request #3805 from nats-io/move_test_to_no_race
Move test to "norace_test.go"
2023-01-23 16:31:21 -08:00
Ivan Kozlovic
79ca0c1787 Move test to "norace_test.go"
The test TestJetStreamClusterConsumerListPaging was in the
jetstream_cluster_3_test.go and because of `-race` flag would
take more than 440 seconds (7+ minutes) as seen here:

https://app.travis-ci.com/github/nats-io/nats-server/jobs/593984385#L335

Without the `-race` flag, this test takes ~17 seconds.

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2023-01-23 17:05:18 -07:00
Derek Collison
4d43bbb3d1 Merge pull request #3801 from nats-io/filtered-deleted
[FIXED] Filtered state for all subjects when the first seqs are deleted.
2023-01-23 13:10:09 -08:00
Derek Collison
68b4570226 Fix for filtered state for all subjects when the first sequence(s) are deleted.
Discovered doing the optimizations for interior deletes.

Signed-off-by: Derek Collison <derek@nats.io>
2023-01-21 16:01:44 -08:00
Derek Collison
f836b75efe Merge pull request #3796 from nats-io/issue-3793
Update snapshots to numCores and maxProcs after maxrocs.Set()
2023-01-20 13:28:18 -08:00
Derek Collison
2aeb5e2c5a Update snapshots to numCores and maxProcs after maxrocs.Set()
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-20 11:30:43 -08:00