Commit Graph

  • aea4a4115d Stream migration update (#4104) Derek Collison 2023-04-26 08:14:46 -07:00
  • 83293f86ff Reduce threshold for compressing messages during a catchup Derek Collison 2023-04-25 19:01:06 -07:00
  • 3c964a12d7 Migration could be delayed due to transferring leadership while the new leader was still paused. Also check quicker but slow down if the state we need to have is not there yet. Derek Collison 2023-04-25 18:58:49 -07:00
  • 08d341801f Restore outbound queue coalescing (#4093) Neil 2023-04-25 15:53:00 +01:00
  • 70b635e337 Test that makes sure that assets can change be scaled after a cluster change. (#4101) Derek Collison 2023-04-25 07:45:46 -07:00
  • 2206f9e468 Re-add coalescing to outbound queues Neil Twigg 2023-04-24 09:44:51 +01:00
  • e25f89dc4d Do not fail healthz in single server mode on failed snapshot restore. (#4100) Derek Collison 2023-04-24 22:49:55 -07:00
  • 47c6bfded4 Update server/jetstream_test.go Derek Collison 2023-04-24 22:29:05 -07:00
  • 3340179b97 Fix flapper Derek Collison 2023-04-24 22:22:27 -07:00
  • c2649beded fix some comments (#4099) Derek Collison 2023-04-24 22:17:30 -07:00
  • cae91b8cad In single server mode healthz could mistake a snapshot staging directory during a restore as an account. Derek Collison 2023-04-24 22:14:04 -07:00
  • f1f5a59e9b fix some comments cui fliter 2023-04-25 11:28:59 +08:00
  • c0f5b71a8f Test that makes sure that assets that have been created under a certain cluster can be upgraded to a new cluster. Derek Collison 2023-04-24 20:06:20 -07:00
  • b0d98df759 fix formatting of raft debug log (#4090) Derek Collison 2023-04-21 22:33:08 -07:00
  • d9cc8b0363 fix formatting of raft debug log Waldemar Quevedo 2023-04-22 07:07:08 +02:00
  • ec07c73b9d Merge branch 'main' into dev Derek Collison 2023-04-21 14:37:50 -07:00
  • 0e2eccd188 Update to the compress lib (#4088) Derek Collison 2023-04-21 14:36:26 -07:00
  • acc8e69f23 Update to the compress lib Derek Collison 2023-04-21 14:18:54 -07:00
  • 1de9a1cf3b Merge branch 'main' into dev Derek Collison 2023-04-21 14:09:35 -07:00
  • 04908962a1 Swap out flate from std library for faster one from compress. (#4087) Derek Collison 2023-04-21 14:02:43 -07:00
  • 50522f117d New version of flate needed more payload at best speed to kick in Derek Collison 2023-04-21 13:18:25 -07:00
  • f9f4bf5c40 Run a check for ack floor drift. (#4086) Derek Collison 2023-04-21 12:56:53 -07:00
  • da9a17fd68 Spelling Derek Collison 2023-04-21 12:40:19 -07:00
  • 57d06abbc9 Swap out flate from std for faster one Derek Collison 2023-04-21 12:12:16 -07:00
  • 8b7c2d12aa Run a check for ack floor drift when taking over as a leader and the ack go routine is spun up. Also periodically check. If all normal will be very cheap. Derek Collison 2023-04-21 11:38:28 -07:00
  • 01041ca1a6 Outbound queue improvements (#4084) Derek Collison 2023-04-21 10:06:39 -07:00
  • 5f884349db Remove TestClientOutboundQueueCoalesce as no longer needed Neil Twigg 2023-04-21 15:40:49 +01:00
  • 2ece00b08f Buffer re-use in WebSocket code, fix race conditions Neil Twigg 2023-04-21 15:15:09 +01:00
  • bf286744dd Remove coalescing as it races with the writev syscall Neil Twigg 2023-04-20 23:29:36 +01:00
  • a93fd080f0 Merge branch 'main' into dev Derek Collison 2023-04-19 08:53:09 -07:00
  • 4f8e7bb77c Ability to set the minimum value for a seqset if known. (#4075) Derek Collison 2023-04-19 08:52:33 -07:00
  • e96ae0bf79 A simpler stream state to detect change for snapshots. (#4074) Derek Collison 2023-04-19 07:16:20 -07:00
  • 4000f8bbeb Apply stream compression from file store config (#4072) Neil 2023-04-19 10:40:33 +01:00
  • a45c7106b8 Only set minimum when removing first item Derek Collison 2023-04-18 22:50:57 -07:00
  • aa66c87d53 Make sure to set node count to 1 Derek Collison 2023-04-18 22:34:13 -07:00
  • a744e1d5c9 Added ability to set initial minimum value for seqset when known. We know the minimum value when creating a new filestore msgBlk. Derek Collison 2023-04-18 22:23:11 -07:00
  • f6195a5ee3 A stream could have a complicated state with interior deletes. This is a simpler way to determine if we need to consider a snapshot that involves much less time and CPU and memory. Derek Collison 2023-04-18 19:11:49 -07:00
  • c43c216415 Bump to 2.9.17-beta.1 Derek Collison 2023-04-18 18:55:13 -07:00
  • 85923c4342 Apply stream compression from file store config Neil Twigg 2023-04-11 17:08:33 +01:00
  • 1a329c73fa Use AVL tree for consumer redeliver map (#4071) Neil 2023-04-18 16:23:41 +01:00
  • 57d888eec4 Use AVL tree for consumer redeliver map Neil Twigg 2023-04-18 12:52:25 +01:00
  • f3e0d6b070 AVL trees and sequence sets for interior delete optimizations. (#4070) Derek Collison 2023-04-18 07:48:13 -07:00
  • 333d684c86 Use encoding of avl seqset for writeIndexInfo's delete map. Derek Collison 2023-04-17 19:29:13 -07:00
  • 1a24e955d0 Add size to preamble, check capacity instead of length when encoding Neil Twigg 2023-02-24 14:57:08 +00:00
  • 9b9159ab70 Basic swap out of the old dmap (map[uint64]struct{}) for new avl.SequenceSet. No other optimizations yet. Derek Collison 2023-01-21 09:03:11 -08:00
  • 1f6aa94405 SequenceSet is an AVL tree with variable bitmask nodes to contain large delete maps for streams. Derek Collison 2023-01-17 20:12:43 -08:00
  • 09afcee9d9 Merge branch 'main' into dev Derek Collison 2023-04-17 08:43:08 -07:00
  • f84ca24fcc 2.9.16 release (#4065) Waldemar Quevedo 2023-04-17 07:50:08 -07:00
  • 202d49d069 2.9.16 release Byron Ruth 2023-04-17 08:07:11 -04:00
  • d8389ec4d3 [FIX] Data race when setting up service import subscriptions. (#4068) Derek Collison 2023-04-17 06:57:27 -07:00
  • 9a3e0b783c Fix for a data race when setting up service import subscriptions. Derek Collison 2023-04-17 06:40:09 -07:00
  • 7709780987 Bump version to 2.9.16-RC.9 (#4067) Neil 2023-04-17 13:54:06 +01:00
  • a9aa280d06 Bump version to 2.9.16-RC.9 Neil Twigg 2023-04-17 13:38:06 +01:00
  • d62ccc7737 Fix nsc in nightly (#4063) Waldemar Quevedo 2023-04-17 00:59:56 -07:00
  • dea7fc04f3 Fix nsc in nightly Waldemar Quevedo 2023-04-17 00:07:01 -07:00
  • 33f23be103 Update package dependencies (#4060) Derek Collison 2023-04-16 16:54:11 -07:00
  • a6029a090c Update pkg dependencies Derek Collison 2023-04-16 14:25:33 -07:00
  • 6215ed9bc3 Update to Go 1.19.8 (#4059) Derek Collison 2023-04-16 13:08:44 -07:00
  • dea68595fd Update to Go 1.19.8 Byron Ruth 2023-04-16 15:33:13 -04:00
  • 3b3fac297a Merge branch 'main' into dev Derek Collison 2023-04-15 14:21:39 -07:00
  • 670da9f7a3 [IMPROVED] Recover on boundary conditions that could cause RAFT layer to spin. (#4058) Derek Collison 2023-04-15 14:19:59 -07:00
  • a5f5603645 Reset our WAL on edge conditions instead of trying to recover. Also if we are timing out and trying to become a candidate but are doing a catchup check if we are stalled. Derek Collison 2023-04-15 12:23:44 -07:00
  • 3f27b67791 Merge branch 'main' into dev Derek Collison 2023-04-15 10:47:29 -07:00
  • 2ee73f8a38 [FIXED] Fix for a regression in behavior. (#4057) Derek Collison 2023-04-15 10:47:13 -07:00
  • 034975e767 Fix for a regression in behavior, needed to make sure when we went back to 1 entry for a subject we cleared firstNeedsUpdate. Derek Collison 2023-04-15 10:00:44 -07:00
  • 8375ab5cde Merge branch 'main' into dev Derek Collison 2023-04-14 16:44:25 -07:00
  • 816cd82fc3 [FIXED] Do not spin on multi-leader with same term. (#4056) Derek Collison 2023-04-14 16:43:50 -07:00
  • 66ca46e145 If we see another leader with same term we should step down Derek Collison 2023-04-14 16:21:40 -07:00
  • b3e1961821 Merge branch 'main' into dev (#4055) Derek Collison 2023-04-14 16:02:27 -07:00
  • 82220d9103 Merge branch 'main' into dev Tomasz Pietrek 2023-04-14 21:45:32 +02:00
  • 94e62cc30b Add server name / remote server name to routez (#4054) Derek Collison 2023-04-14 13:09:43 -07:00
  • d12152c48f Add server name / remote server name to routez Waldemar Quevedo 2023-04-14 12:47:00 -07:00
  • 2699465596 Fix stream sourcing & mirroring overlap errors (#4052) Derek Collison 2023-04-14 12:18:04 -07:00
  • a66c67baa5 Fix stream sourcing & mirroring overlap errors Tomasz Pietrek 2023-04-14 12:10:15 +02:00
  • c3c4c8f1f5 Merge branch 'main' into dev Derek Collison 2023-04-14 11:47:15 -07:00
  • e881656683 [IMPROVED] Use new server read locks. (#4053) Derek Collison 2023-04-14 10:37:14 -07:00
  • 0fe48fe91e Use new server read locks now that we have them Derek Collison 2023-04-14 10:11:40 -07:00
  • 89fc7e3203 Bump to 2.9.16-RC.8 Derek Collison 2023-04-13 21:04:33 -07:00
  • a319d24345 Merge branch 'main' into dev Derek Collison 2023-04-13 21:03:05 -07:00
  • 89f6a5c547 [FIXED] The meta layer should snapshot if any outstanding entries are present. (#4050) Derek Collison 2023-04-13 20:59:00 -07:00
  • 093564f7e0 The meta layer should snapshot if any oustanding entries are present, regardless of hash. Derek Collison 2023-04-13 20:37:00 -07:00
  • be4999a281 [IMPROVED] Consumer updates (#4049) Derek Collison 2023-04-13 19:18:11 -07:00
  • cc77d662bb Make sure to process consumer entries on recovery in case state was not committed. Also sync other consumers when taking over as leader but no need to process snapshots when we are in fact the leader. Derek Collison 2023-04-13 18:22:13 -07:00
  • a77884e4ec Do not let the redelivered count go down on re-applying on restarts Derek Collison 2023-04-13 18:20:13 -07:00
  • bafd585ce4 Fix data race Derek Collison 2023-04-13 18:19:28 -07:00
  • 3f8fc5c5b1 [FIXED] #4043 (#4048) Derek Collison 2023-04-13 17:31:49 -07:00
  • 3602b3882a Fix raft log debug reloading (#4047) Waldemar Quevedo 2023-04-13 16:21:53 -07:00
  • b597485102 Improve performance on storing msgs when multiple subjects exists with multiple messages and we have store limits that are being hit. Derek Collison 2023-04-13 15:27:34 -07:00
  • a4833d0889 Fix raft log debug reloading Waldemar Quevedo 2023-04-13 14:57:04 -07:00
  • 96fe933846 Limit filestore block size to 2MB when encryption is enabled (#4046) Neil 2023-04-13 17:24:30 +01:00
  • fc9b9004eb Limit filestore block size to 2MB when encryption is enabled Neil Twigg 2023-04-13 16:45:41 +01:00
  • 69b427bc94 [FIXES/IMPROVED] Raft and filestore logic (#4045) Derek Collison 2023-04-13 07:53:13 -07:00
  • e6eaed425f Make sure we have a correct next first after expiring on startup Derek Collison 2023-04-12 14:43:44 -07:00
  • 2f4677d29e Delay a bit longer if we are not the actual leader, helpful for very large stream reports to avoid possible dupes Derek Collison 2023-04-12 12:36:47 -07:00
  • 808a2e8c90 On failure to send snapshot to follower, also reset, and on reset make sure to reset term Derek Collison 2023-04-12 11:47:57 -07:00
  • a92bb9fe61 Fix bad unlock which could cause crash Derek Collison 2023-04-11 12:54:55 -07:00
  • f41e5d86e1 Add in raft test helper Derek Collison 2023-04-09 19:34:35 -07:00
  • 340fcc90bc Basic raft tests Derek Collison 2023-04-09 19:22:33 -07:00
  • 4fcc2ff418 Fix FirstSeq not being updated with filestore when purging subject (#4042) Derek Collison 2023-04-12 11:43:50 -07:00
  • 2a03d9dff7 Fix consumer reply subject escaping (#4040) Tomasz Pietrek 2023-04-12 13:27:52 +02:00