Commit Graph

4611 Commits

Author SHA1 Message Date
Derek Collison
42cdc4e39d Merge branch 'main' into dev 2023-01-31 10:10:29 -08:00
Derek Collison
390fd02918 Updates to tests for updated Go client changes
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-31 09:47:36 -08:00
Derek Collison
7607b17844 Fix for test
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-30 20:14:39 -08:00
Derek Collison
2d6b316efd Merge branch 'main' into dev 2023-01-30 20:07:26 -08:00
Derek Collison
1252653c16 Merge pull request #3829 from nats-io/jarema/fix-message-after-update
Fix Consumer not getting messages after filter update
2023-01-30 19:59:32 -08:00
Derek Collison
d9aa69c332 Bump to 2.9.12-RC.2
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-30 19:56:53 -08:00
Derek Collison
aaacca8549 Merge branch 'main' into dev 2023-01-30 19:54:37 -08:00
Derek Collison
e0798d26eb Merge pull request #3831 from nats-io/snapshots
Minor fixes and optimizations for snapshots.
2023-01-30 19:53:22 -08:00
Derek Collison
598e27243f Fix possible deadlock on dataloss
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-30 19:10:19 -08:00
Derek Collison
6058056e3b Minor fixes and optimizations for snapshots.
We were snappshotting more then needed, so double check that we should be doing this at the stream and consumer level.
At the raft level, we should have always been compacting the WAL to last+1, so made that consistent. Also fixed bug that would not skip last if more items behind the snapshot.

Signed-off-by: Derek Collison <derek@nats.io>
2023-01-30 17:54:18 -08:00
Waldemar Quevedo
13372508e2 Fix for isGroupLeaderless when JS not available (due to shutdown)
Signed-off-by: Waldemar Quevedo <wally@nats.io>
2023-01-30 15:29:42 -08:00
Tomasz Pietrek
836848ca64 Fix Consumer not getting messages after filter update
Signed-off-by: Tomasz Pietrek <tomasz@nats.io>
2023-01-30 20:47:17 +01:00
Derek Collison
52a78c0352 Small optimizations.
1. Only snapshot with minSnap time window like consumers and meta. Make it consistent for all to 5s.
2. Only snapshot at the end of processing all entries pending vs inside the loop.
3. Use fast state when calculating sync request, do not need deleted details there.

Signed-off-by: Derek Collison <derek@nats.io>
2023-01-29 10:58:00 -08:00
Jean-Noël Moyne
3518c9460a Small formatting improvements 2023-01-28 12:59:36 -08:00
Derek Collison
e1a2da8d85 Small optimizations
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-28 11:45:47 -08:00
Derek Collison
bf49f23bb1 Only hold on to so many pending in memory, will fetch from WAL
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-28 11:34:55 -08:00
Jean-Noël Moyne
ccc492bdce Improve checking that subject filters and destination transforms are valid subjects.
Improve error messages when bad filters/transforms are encountered.
Cover all cases of updating an existing stream's subject transform or sources
2023-01-27 17:54:37 -08:00
Derek Collison
11ffd69575 Merge branch 'main' into dev 2023-01-27 13:41:48 -08:00
Derek Collison
4eed8ba566 Merge pull request #3824 from nats-io/process-connect-fix
Check if connection name was already set when storing it
2023-01-27 13:41:18 -08:00
Derek Collison
64096e5ef5 Fix for flapping test
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-27 13:19:44 -08:00
Derek Collison
f4e6481ce7 Allow report cycles between source streams if subjects truly form a cycle.
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-27 13:03:24 -08:00
Waldemar Quevedo
c6e263f910 Check if connection name was already set when storing it
Signed-off-by: Waldemar Quevedo <wally@nats.io>
2023-01-27 11:04:38 -08:00
Derek Collison
12d49a87c8 Merge branch 'main' into dev 2023-01-27 08:35:59 -08:00
Derek Collison
7682eaa389 Merge pull request #3804 from madper/dragonflybsd
Add support for dragonfly bsd.
2023-01-27 08:35:42 -08:00
Derek Collison
b9f220ec80 Merge pull request #3823 from ripienaar/mappings_breaking_changes
Mappings breaking changes
2023-01-27 07:48:04 -08:00
R.I.Pienaar
348c84a469 restore public APIs and fix breaking interface renames
Signed-off-by: R.I.Pienaar <rip@devco.net>
2023-01-27 12:36:15 +01:00
Tomasz Pietrek
9ab52d4ba9 Add metadata to StreamConfig and ConsumerConfig
Signed-off-by: Tomasz Pietrek <tomasz@nats.io>
2023-01-27 07:27:25 +01:00
Chengjun Xie
6cbca6b783 Add support for dragonfly bsd.
Simply copy the pse implementation for openbsd.
2023-01-27 10:43:30 +08:00
Tomasz Pietrek
69aa55a0e7 Merge pull request #3822 from nats-io/jarema/add-batch-completed
Add batch completed status to Pull Consumers
2023-01-26 23:43:00 +01:00
Tomasz Pietrek
34be180875 Add batch completed status to Pull Consumers
Signed-off-by: Tomasz Pietrek <tomasz@nats.io>
2023-01-26 23:23:49 +01:00
Derek Collison
c2d3d9c467 Merge pull request #3814 from nats-io/jnm/streamsourcetransform
[ADDED] Stream subject mapping transforms
2023-01-26 14:09:52 -08:00
Jean-Noël Moyne
ddce3ce037 Rename StreamConfig's InputSubjectTransform (and therefore StreamSource's SubjectTransform) 2023-01-26 12:26:34 -08:00
Derek Collison
7c0c85e41b Merge branch 'main' into dev 2023-01-26 10:30:55 -08:00
Derek Collison
8a40326a70 Bump to 2.9.12-RC.1
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-26 10:07:30 -08:00
Derek Collison
dcf9f1a87f Merge pull request #3802 from nats-io/wincert
certstore feature with windows credential manager
2023-01-26 09:43:40 -08:00
Derek Collison
469116deae Merge branch 'main' into dev 2023-01-26 09:39:32 -08:00
Derek Collison
c7a75c5a6d Merge pull request #3817 from nats-io/force-consumer-replicas
[FIXED] Force consumer replicas to match for interest policy streams
2023-01-26 09:39:15 -08:00
Derek Collison
3d78459ad1 Fixup for bad merge
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-26 09:09:30 -08:00
Neil Twigg
83932b4be6 Don't mark a clustered stream as unhealthy if making forward progress, add TestJetStreamClusterCurrentVsHealth 2023-01-26 16:57:34 +00:00
Derek Collison
d0a7a8169a Merge branch 'main' into force-consumer-replicas 2023-01-26 08:35:49 -08:00
Derek Collison
cea6fc5957 Merge branch 'main' into dev 2023-01-26 08:28:27 -08:00
Derek Collison
461aad17a5 Merge pull request #3820 from nats-io/issue-3791
[FIXED] Select consumer peer(s) from active peers only.
2023-01-26 08:27:11 -08:00
Jean-Noël Moyne
4fbe13ec1b Change test to use require_NoError instead of explicitly checking err and calling Fatalf throughout all the tests in the file
Improvements to readability
2023-01-26 00:31:17 -08:00
Todd Beets
e1fd61778f certstore feature with windows credential manager 2023-01-25 21:22:20 -08:00
Derek Collison
e15eb22ca6 When we create a consumer with less replicas then the stream, make sure to select from online peers.
Signed-off-by: Derek Collison <derek@nats.io>
2023-01-25 20:08:04 -08:00
Derek Collison
a5cbd0b029 Fixed a bug that would not properly process updates on a stream on restart.
During restart if the stream existed but was also in a meta-snapshot delivered by the leader we would not process the update properly.

Signed-off-by: Derek Collison <derek@nats.io>
2023-01-25 18:16:33 -08:00
Derek Collison
4a3c27a251 Fix MQTT test for consumer replica override.
This was ill-advised by me, not understanding that the messages stream for MQTT was interested policy based.
Interest policy based streams require consumers to match the replica count.

Signed-off-by: Derek Collison <derek@nats.io>
2023-01-25 17:58:57 -08:00
Jean-Noël Moyne
e2561a6d54 rebase fix 2023-01-25 12:30:26 -08:00
Jean-Noël Moyne
a953e84437 Add stream input subject transform functionality
Extract subject transformation code out of accounts.go
Stream sources can now have a subject mapping transform
You can source the same stream more than once
Remove limitation that the subject filter for a source, mirror or consumer must have an overlap with the sourced/mirrored's stream or the stream's subjects
2023-01-25 12:25:51 -08:00
Derek Collison
a929f86fae Merge pull request #3811 from nats-io/neil/cfgrepublish
Allow editing `RePublish` on an existing stream
2023-01-25 09:11:03 -08:00