Ivan Kozlovic
552cc737f1
[FIXED] MQTT: asset placement in origin cluster
...
In a setup with shared system account and a cluster of leaf nodes,
the JS requests did not contain the origin cluster, which caused
assets to possibly be created in the HUB. With this change, the
assets will be created in the origin cluster.
Also, removed use of acc.JetStreamEnabled() but instead fail
start of the server if mqtt is enabled in standalone mode and JS
is not enabled. If JS is enabled, we will get proper error if
account has no JS enabled.
Signed-off-by: Ivan Kozlovic <ivan@synadia.com >
2021-04-28 19:28:00 -06:00
Matthias Hanel
ae4374fcd0
fix unit test crashing when leader was nil caused by quorum reformation
...
Signed-off-by: Matthias Hanel <mh@synadia.com >
2021-04-22 20:35:00 -04:00
Derek Collison
50fabe261d
Check for overlapping subjects on stream update.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-21 15:38:38 -07:00
Derek Collison
9f1bc5882c
Make sure to return no consumer if we are still waiting on a leader to be elected.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-21 12:13:10 -07:00
Derek Collison
a301d3a892
Check direct consumers directly, stream state back to previous behavior
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-21 09:40:04 -07:00
Derek Collison
b5521053e6
Make sure to clean up ephemerals across a Gateway.
...
Also report direct consumers in num consumers in stream info.
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-21 08:47:55 -07:00
Derek Collison
a3f66508dd
Merge pull request #2138 from nats-io/ports
...
Use lower ports to not collide with -1s
2021-04-20 20:15:24 -07:00
Derek Collison
e31361e6a2
Use lower ports to not collide with -1s
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-20 20:10:29 -07:00
Derek Collison
518ff9be14
Concurrent multiple durable subscribers would cause unpredictable behaviors.
...
Upgraded to current Go client.
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-20 19:50:24 -07:00
Derek Collison
5707c1132c
Move to dynamic ports
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-20 17:08:47 -07:00
Derek Collison
0a3e54c88a
Fix subscription leaks for mirrors and sources for streams as well as flow control subjects for consumers.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-20 12:13:07 -07:00
Derek Collison
fe3537d429
Check err
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-20 07:08:10 -07:00
Derek Collison
2da264c1ec
Randomize cluster and gateway ports
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-19 20:24:25 -07:00
Derek Collison
68ddd519d2
Process upstream missing messages for mirrors better.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-19 20:15:21 -07:00
Derek Collison
c41c89ad75
Help with flapping tests
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-18 18:35:29 -07:00
Derek Collison
d84af39f16
Make sure source consumers work properly after expiration/purge
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-16 17:28:04 -07:00
Derek Collison
2117d7750a
Use higher timeout for deleting consumer
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-16 14:18:04 -07:00
Derek Collison
d7641b9d38
Move test to norace
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-16 14:00:11 -07:00
Ivan Kozlovic
6e1205b660
Cleanup some tests + GetTLSConnectionState() race fix
...
Missing defers
Signed-off-by: Ivan Kozlovic <ivan@synadia.com >
2021-04-15 11:37:43 -06:00
Derek Collison
f3f04e6442
Fix flapper
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-15 06:34:12 -07:00
Derek Collison
cf34514f9f
Do not limit expansion of new peers
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-14 18:47:11 -07:00
Jaime Piña
1ccb5572ba
Fix calling FailNow in parent test
...
Currently, TestJetStreamClusterMirrorExpirationAndMissingSequences calls
FailNow from the parent test when a subtest fails. This causes an error.
This change calls FailNow to fail the subtest from the subtest itself.
2021-04-14 14:45:11 -07:00
Derek Collison
6ca6db70b2
Add in more extensive test on extending hubs with leafnode clusters
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-13 19:55:41 -07:00
Derek Collison
f6a82a7c98
When messages were no longer available in an upstream stream a mirror could wedge and not resolve.
...
This fixes that scenario by detecting the situation and inserting skip msgs to catch up.
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-13 11:46:03 -07:00
Derek Collison
90989d57d6
Change to report total deleted by default for stream info.
...
Allow deleted details if requested.
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-12 18:10:11 -07:00
Derek Collison
755ef74855
When a cluser of leafnodes connects to a cluster or supercluster hub and they share the system account make the leafnode servers observers.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-12 17:00:55 -07:00
Derek Collison
f893345b40
Pull based consumers when deleted were not removing messages from an interest based stream.
...
Fix for #2097 .
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-12 11:16:31 -07:00
Derek Collison
66b0c5c216
Merge pull request #2100 from nats-io/csz
...
Only adjust cluster size when we have heard from all peers.
2021-04-12 08:52:07 -07:00
Derek Collison
0cee993e3b
When checking cluster size we need to make sure we have heard from all peers before making adjustments.
...
Also check back periodically.
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-10 15:55:51 -07:00
Derek Collison
833279388b
Add mixedmode test back in
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-10 10:10:37 -07:00
Jaime Piña
27e9628c3a
Run gofmt -s to simplify code
2021-04-09 15:18:06 -07:00
Derek Collison
3c051d461c
Fix flappers
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-08 18:03:14 -07:00
Derek Collison
deb015ec73
Fix for #2083 to release ack pending when messages expire or hit max redeliveries.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-08 11:47:59 -07:00
Derek Collison
16941c78a0
Merge pull request #2076 from nats-io/account_load
...
Report an error if we fail to load an account on a stream assignment.
2021-04-07 14:40:27 -07:00
Derek Collison
1ea4a430da
If we fail to load an account while processing a stream assignment, send error back to metaleader.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-04-07 14:23:12 -07:00
Jaime Piña
d929ee1348
Check errors when removing test directories and files
...
Currently in tests, we have calls to os.Remove and os.RemoveAll where we
don't check the returned error. This hides useful error messages when
tests fail to run, such as "too many open files".
This change checks for more filesystem related errors and calls t.Fatal
if there is an error.
2021-04-07 11:09:47 -07:00
Jaime Piña
e44275b963
Consolidate temporary test files and directories
...
Currently, temporary test files and directories are written in lots of
different paths within the OS's temp dir. This makes it hard to know
which files are from nats-server and which are unrelated. This in turn
makes it hard to clean up nats-server test files.
2021-04-06 10:42:55 -07:00
Derek Collison
0650b772a9
Fix test, needed prefix
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-30 13:46:03 -07:00
Jaime Piña
6941bb3ade
Update Go client in tests
2021-03-30 13:17:34 -07:00
Derek Collison
bb7a8a5f79
Introduced default max ack pending for ack explicit.
...
Fixed a bug that would introduce performance degradation for durable consumers R>1.
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-30 11:47:24 -07:00
Derek Collison
5a48369b4b
Make sure to not delete streams on bad updates.
...
If an update was asssigned but failed at the stream group server we would send back the result which would always delete the stream.
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-29 07:35:30 -07:00
Matthias Hanel
03aee09847
[Added] error when mirror/source stream prefix overlaps with stream subs ( #2041 )
...
* [Added] error when mirror/source stream prefix overlaps with stream subs
Signed-off-by: Matthias Hanel <mh@synadia.com >
2021-03-27 14:01:51 -04:00
Derek Collison
0f71c260fb
Durable consumers with R>1 had performance challenges.
...
This code changes the way we handle raft based proposals for consumers.
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-26 12:53:49 -07:00
Derek Collison
5d5de5925f
Introduce a previous leader state in the raft layer to allow quicker responses when leaderless.
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-25 17:08:29 -07:00
Derek Collison
e53caee5e8
Enforce server limits even when dynamic limits for accounts in play.
...
We were not properly enforcing server limits. This commit will allow a server to enforce limits but still remain functional even at the JetStream level.
Also fixed a bug for RAFT replay that could cause instability.
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-25 16:06:27 -07:00
Derek Collison
a75e8f8c80
Fix for an issue with multiple restarts that showed stalled and sometimes lost streams.
...
The issue was when a state was removed from a server and restarted it would catch up properly.
However upon cluster restart the system could exhibit strange behaviors. This was due to on
catchup not properly creating a meta snapshot when one was received, leaving no meta state to recover.
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-22 20:06:38 -07:00
Derek Collison
022c5b4ab2
Fix for bad behavior with flow control and multiple sources streams.
...
Allow chaining of sources and mirrors with filtered consumers.
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-22 11:13:51 -07:00
Derek Collison
7284756a8e
Update to use Go client
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-21 09:31:17 -07:00
Derek Collison
0f548edcc6
Reduce sliding window for direct consumers and catchup stream windows.
...
Remove another possible wire blocking operation in raft.
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-21 09:24:27 -07:00
Derek Collison
fcd4d0b75f
Removed un-needed check in test
...
Signed-off-by: Derek Collison <derek@nats.io >
2021-03-20 17:11:58 -07:00