Commit Graph

2456 Commits

Author SHA1 Message Date
Derek Collison
d084853aff Actually need to wait to accumulate, make sure we get at least 8.
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-02 18:33:22 -08:00
Derek Collison
df02e0be71 Consumers would process next message batches inline.
In clustered mode this could block a route or gateway processor.

Signed-off-by: Derek Collison <derek@nats.io>
2021-03-02 18:28:17 -08:00
Derek Collison
04634d3358 One less api call
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-02 18:28:06 -08:00
Derek Collison
479176d26c Adjustments for change in actual JSApi subs
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-02 18:08:08 -08:00
Derek Collison
c39a2d6bd0 If capturing calls with no dispatch just return
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-02 17:58:34 -08:00
Derek Collison
4f7fbefc7c In clustered JetStream we need to move API calls out of routes/gateways/leafnodes path.
This moves from explicit imports and subscriptions to one wildcard subscription and a single wildcard export.

Signed-off-by: Derek Collison <derek@nats.io>
2021-03-02 17:54:41 -08:00
Derek Collison
0b8c070d8e Bump Version
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-02 07:31:45 -08:00
Derek Collison
a3c526a0eb Merge pull request #1951 from nats-io/xmirrors
Enable cross account behaviors for mirrors and sources.
2021-03-02 08:30:48 -07:00
Derek Collison
27090975d9 Fix for leaked subs on non-leader change
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-02 07:19:18 -08:00
R.I.Pienaar
84f4b0fc44 Merge pull request #1950 from ripienaar/meta_peer_remove_id
update api types, remove meta peer by id
2021-03-02 16:14:28 +01:00
Derek Collison
2e7fdf2ef8 Only updateDelivered needs to be suppressed for leaders
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-02 07:03:32 -08:00
Derek Collison
49cd38c064 Enable cross account behaviors for mirrors and sources.
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-02 06:36:57 -08:00
R.I.Pienaar
a9ed69a2df update api types, remove meta peer by id
Signed-off-by: R.I.Pienaar <rip@devco.net>
2021-03-02 15:35:02 +01:00
Derek Collison
d4a8baf030 Stabilize test, wait a bit for migration
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-02 05:28:55 -08:00
Derek Collison
29421bde67 Bump to RC2
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-01 20:00:06 -08:00
Derek Collison
9e181b8d0d Consumers were double processing as leaders
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-01 18:37:35 -08:00
Derek Collison
e817ecfb80 Wait for consumer migration
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-01 17:10:10 -08:00
Derek Collison
22749fb1e2 Fix data race, stabilize usage test
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-01 16:47:19 -08:00
Derek Collison
c8e2ad6248 Make sure trailing usage updates accounted for eventually
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-01 14:23:06 -08:00
Derek Collison
2d70429f83 More conservative in replay
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-01 14:22:27 -08:00
Derek Collison
e0353479ad Progress updates could potentially block on channels, this cleans that up.
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-01 13:52:49 -08:00
Derek Collison
f16d9c6ea8 Don't forget last message
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-01 12:52:54 -08:00
Derek Collison
c0729a1309 Move processing of append entry response out of route path.
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-01 05:57:15 -08:00
Derek Collison
84d042c4e2 Make sending account usage updates more efficient
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-01 04:42:50 -08:00
Derek Collison
a8db1d7322 Write snapshots without lock held
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-01 04:42:11 -08:00
Derek Collison
0dcdb9fb1c RC1
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-28 19:54:26 -08:00
Derek Collison
fbc492fef7 Use .Equal
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-28 19:11:55 -08:00
Derek Collison
74b416afa1 Moved back to channel handling of append entry to avoid inline processing with disk IO in route path.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-28 18:34:24 -08:00
Derek Collison
0a6958b98c Fix some flapping tests
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-28 17:35:09 -08:00
Derek Collison
df77724aa4 Make ephemeral consumers R=1 and provide optimistic migration on peer removal or server shutdown.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-28 16:50:25 -08:00
Derek Collison
03954eedc6 Enable cluster server removal API.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-28 14:14:36 -08:00
Derek Collison
e0d08e1a22 Check for stream updates and disallow changes to mirrors and replicas for now.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-28 12:04:40 -08:00
Derek Collison
8cfc56f8b0 Enable support for changing config on stream restore.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-28 10:01:01 -08:00
Derek Collison
b9e1a921ff Use internal wildcard inbox for stream and consumer info requests.
More gateway friendly but suffers from no echo, so added new client based internal send.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-28 10:01:01 -08:00
Derek Collison
57a6599777 Test updates
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-28 05:19:45 -08:00
Derek Collison
ef4567f24a Changes for sources and mirrors improvements.
Better handling of messages on restart from a WAL.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-28 05:18:48 -08:00
Derek Collison
9fc7561c40 Support updating sources via stream update.
Tweaked internal consumers and flow logic for sources and mirrors.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-28 05:17:17 -08:00
Derek Collison
0d29b0761a Tweaked buffered channels, moved locks for snapshots.
Also placed debug for inline processing of append entries.
This is for removal of that inline.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-28 05:16:04 -08:00
Derek Collison
09467bd9ae Prep for restore config override
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-28 05:15:38 -08:00
Derek Collison
f5cbd55b46 Fixed data corruption bug, optimized Compact().
Also trim fs.blks slice appropriately to avoid unbound growth.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-28 05:14:25 -08:00
Derek Collison
6a03ab9629 Inline flow in clustered mode was flaky, removed that path.
Changed up accounting.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-28 05:11:59 -08:00
Matthias Hanel
c73d3b21eb changing NEXT expires field from time to duration in nanoseconds
Signed-off-by: Matthias Hanel <mh@synadia.com>
2021-02-26 20:45:44 -05:00
Derek Collison
48d9e1cdb0 Bump Version
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-26 07:53:48 -08:00
R.I.Pienaar
89f6bdbe09 Merge pull request #1941 from ripienaar/oos_advisory
extend the out of space advisory
2021-02-26 16:53:07 +01:00
Derek Collison
7c670e4eae Allow sources and mirrors to not be pre-defined.
Will keep trying to establish contact.

Fixed bug where double source headers for sourced messages were causing issues.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-26 07:32:29 -08:00
R.I.Pienaar
a4817bd7b6 extend the out of space advisory
Signed-off-by: R.I.Pienaar <rip@devco.net>
2021-02-26 11:10:05 +01:00
Derek Collison
1f43c8b718 Bump version
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-25 20:15:41 -08:00
Derek Collison
c6672260af Merge pull request #1937 from nats-io/wio
[FIXED] Bug where followers would not snapshot/compact WAL.
2021-02-25 21:14:52 -07:00
Derek Collison
69ffff2278 Skip test for now
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-25 20:02:06 -08:00
Derek Collison
98f98e214b Properly support memory based WALs
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-25 19:49:54 -08:00