Commit Graph

3876 Commits

Author SHA1 Message Date
Derek Collison
c6672260af Merge pull request #1937 from nats-io/wio
[FIXED] Bug where followers would not snapshot/compact WAL.
2021-02-25 21:14:52 -07:00
Derek Collison
69ffff2278 Skip test for now
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-25 20:02:06 -08:00
Derek Collison
98f98e214b Properly support memory based WALs
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-25 19:49:54 -08:00
Derek Collison
7ea5a8a64b Reverse the flag for fip
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-25 19:02:58 -08:00
Derek Collison
0f69e48511 Bug check err, check for out of space on catchup
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-25 18:25:16 -08:00
Derek Collison
e5c8774172 Handle out of space situations, general stability enhancements
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-25 17:54:29 -08:00
Derek Collison
b13ef6b9ec Track write errors. Fixed a few bugs.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-25 17:53:20 -08:00
Derek Collison
44b08c538a Pass deliver, don't remap
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-25 17:42:03 -08:00
Derek Collison
752f67acee Explicit on async and sync settings
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-25 17:08:14 -08:00
Derek Collison
a9ab41f13b Fix lock bug, capture write errors and report better
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-25 15:01:47 -08:00
R.I.Pienaar
504652a16f Merge pull request #1940 from ripienaar/always_store_filter
always store the filter subject
2021-02-25 20:20:10 +01:00
R.I.Pienaar
45a42864f6 always store the filter subject
This avoids a situation where a consumer asks for
ORDERS.new today on a stream of ORDERS.new but later
someone makes the same stream ORDERS.* and the new
consumer would then get messages for other purposes
as well

Signed-off-by: R.I.Pienaar <rip@devco.net>
2021-02-25 18:29:21 +01:00
R.I.Pienaar
b4c5125ae5 Merge pull request #1938 from ripienaar/replication_info
ensure sources and mirror info is in stream list
2021-02-25 15:32:21 +01:00
Derek Collison
7ef3e5b629 Remove slow advisory checks
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-25 04:17:56 -08:00
Derek Collison
a862cc75cc Suppress raft campaigns on restart. Extend election timeout interval.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-25 04:14:14 -08:00
R.I.Pienaar
157d92daf7 ensure sources and mirror info is in clustered stream list
Signed-off-by: R.I.Pienaar <rip@devco.net>
2021-02-25 12:57:41 +01:00
Derek Collison
c7d203db6d Fixed bug where followers WAL would not snapshot/compact.
Tweaked write and sync params.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-24 20:51:28 -08:00
Derek Collison
b7a5587b0c spelling
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-24 20:50:00 -08:00
Derek Collison
73ba2d0b2f File writes to term and vote and peerstate were in the direct route path and could cause delays.
This moves the actual writes to a separate Go routine and also allows multiple writes to
be compressed into one write under load. We only want latest.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-24 20:47:31 -08:00
Derek Collison
2d24571e17 Change default sync to 60s
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-24 20:44:05 -08:00
Derek Collison
cc038a6d95 Merge pull request #1936 from nats-io/xacc2
Properly handle local deliver subjects
2021-02-24 21:25:23 -07:00
Derek Collison
57403b1903 When pulling consumer messages if the consumer and the client were on the same server we needed to process local deliver subject.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-24 19:28:46 -08:00
Derek Collison
954aea16f6 Merge pull request #1935 from nats-io/xacc
Cross account JetStream pull consumers.
2021-02-24 18:52:28 -07:00
Derek Collison
3def02a459 check for '\n' at beginning og key
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-24 17:46:30 -08:00
Derek Collison
75fbcffedb Make sure it's the exact key
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-24 14:56:44 -08:00
Derek Collison
36a2cbeff7 Cross account pull consumers would not work correctly due to reply subject rewrite.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-24 13:33:24 -08:00
R.I.Pienaar
15fa5e21b8 Merge pull request #1934 from ripienaar/nightly_nats_version
add version strings to the nightly builds of nats cli
2021-02-24 20:58:33 +01:00
R.I.Pienaar
693f9959a2 add version strings to the nightly builds of nats cli
Signed-off-by: R.I.Pienaar <rip@devco.net>
2021-02-24 20:12:47 +01:00
Derek Collison
338e017dbe Merge pull request #1933 from nats-io/stable
General stability improvements.
2021-02-24 10:26:32 -07:00
Derek Collison
23d7725104 Removed this one due to slow timing now
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-24 09:16:50 -08:00
Derek Collison
84321f6697 These are slower so need to wait longer
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-24 08:55:58 -08:00
Derek Collison
78bdc34637 General stability improvements. Fixes to subscription state not cleaning up.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-24 08:44:34 -08:00
Derek Collison
bec42c040b Merge pull request #1932 from nats-io/mirrors2
Stream Mirrors, Sources and Updates Support
2021-02-23 19:39:16 -07:00
Ivan Kozlovic
1652fe62ef Updates to when do snapshot
Remove panic on runAsLeader when not able to subscribe (which happens
on shutdown)
Gateway name access does not need lock since it is immutable. Will
prevent deadlocks in some situations.

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-02-23 19:06:07 -07:00
Derek Collison
bb58d455f6 Revert switching to interest only mode
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-23 18:00:47 -08:00
Derek Collison
ebd522d732 Test cleanup
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-23 17:20:30 -08:00
Derek Collison
20d250c7cf Move storage type to own variable for unlocked access, can't change
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-23 17:20:12 -08:00
Derek Collison
8fe8b835fe Fixes for flapping tests
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-23 14:08:17 -08:00
Derek Collison
09e3d26fa3 Add in support for stream mirrors and sources.
Add in proper support for stream updates in clustered mode.
Don't send API updates without subjects, caused GW parser errors.
Stream internal loops use their own clients now.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-23 10:57:27 -08:00
Derek Collison
dd19f620a9 Does not need receiver
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-23 10:57:18 -08:00
Derek Collison
6d6a6c07ff Don't send empty subjects, always put system account in interest only
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-23 10:57:12 -08:00
Derek Collison
6444038660 Make sure this is GW and leafnode friendly
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-23 10:57:10 -08:00
Derek Collison
c39641c263 Tweak hb and election times, fix unsubscribe leak
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-23 10:57:05 -08:00
Derek Collison
0487ce48a4 Spelling
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-23 10:57:00 -08:00
Derek Collison
a9394d7692 Handle JetStream subjects across GWs
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-23 10:56:24 -08:00
Matthias Hanel
a26436411a Merge pull request #1930 from nats-io/crash-no-sys-acc-js
[fixes] crash in checkJetStreamExports when there is no system account
2021-02-23 11:50:04 -05:00
Matthias Hanel
2e4a892c8d [fixes] crash in checkJetStreamExports when there is no system account
Signed-off-by: Matthias Hanel <mh@synadia.com>
2021-02-23 00:42:31 -05:00
Derek Collison
7486b2681d Merge pull request #1927 from nats-io/metamove
Allow placement directives for meta controllers
2021-02-19 12:25:39 -07:00
Derek Collison
2047b46e54 Updates based on feedback
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-19 11:07:31 -08:00
Derek Collison
fa8a74ceb5 Allow placement directives for metacontroller stepdown to allow placement to new clusters.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-19 10:55:22 -08:00