Commit Graph

2546 Commits

Author SHA1 Message Date
Ivan Kozlovic
4af86becc7 Merge pull request #1993 from nats-io/remove-peer
Lost quorum changes for streams
2021-03-11 08:20:03 -07:00
Derek Collison
d5ab019abb RC8
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-11 07:43:56 -05:00
Derek Collison
2b2a776411 Disable flaky tests for now
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-11 07:11:05 -05:00
Derek Collison
299f44cddf This changes our behaviors for streams and peer removals in several ways.
First we no longer try to auto-remap stream assignments on peer removals from the system.
We also now can always respond to stream info requests if at least a member is running.

Signed-off-by: Derek Collison <derek@nats.io>
2021-03-11 06:52:28 -05:00
Derek Collison
b757214ea6 Merge pull request #1991 from nats-io/js-test-timeout-4
Increasing test timeout
2021-03-10 21:50:19 -06:00
Ivan Kozlovic
6600c223bb Merge pull request #1989 from nats-io/sources
Make source and mirror consumers direct.
2021-03-10 20:39:54 -07:00
Derek Collison
01404b3dc9 Protect against cluster and meta being gone
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-10 22:33:39 -05:00
Ivan Kozlovic
738527a37c Bump version
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-03-10 19:36:49 -07:00
Ivan Kozlovic
84fbcdcd34 Remove internal retries for mirrors and sources
We let the go routine do it.

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-03-10 15:47:19 -07:00
Derek Collison
c783bf1bed Tweak flow control and slow start
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-10 17:30:25 -05:00
Ivan Kozlovic
27f51d4028 Fix ephemeral consumer delete in single cluster
Also remove retry of sources/mirror in the setSourceConsumer() itself
when not getting a response.

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-03-10 15:16:31 -07:00
Matthias Hanel
cab415cf61 Increasing test timeout
Signed-off-by: Matthias Hanel <mh@synadia.com>
2021-03-10 11:52:21 -05:00
Derek Collison
709335f1c2 Bump to RC7.4 2021-03-10 07:18:43 -05:00
Derek Collison
263f4452c3 Delete no longer needed
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-10 07:15:58 -05:00
Derek Collison
f95b6481d2 Make source and mirror consumers direct, meaning they are not mapped by the metaleader.
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-10 07:12:48 -05:00
Waldemar Quevedo
a295be12d4 Merge pull request #1987 from nats-io/js-restart
Disable JS on restart if on invalid state
2021-03-10 02:18:19 -08:00
Waldemar Quevedo
d338e9ae30 Disable JS on restart if on invalid state
Signed-off-by: Waldemar Quevedo <wally@synadia.com>
2021-03-10 01:40:32 -08:00
Matthias Hanel
5a3c5720b1 Merge pull request #1984 from nats-io/fix-connect-flapper
Fix unit test that received an extra connect message
2021-03-09 20:51:35 -05:00
Matthias Hanel
32c686d77d Merge pull request #1986 from nats-io/js-test-timeout-3
Increasing test timeout
2021-03-09 20:51:25 -05:00
Matthias Hanel
e554d54b87 Increasing test timeout
Signed-off-by: Matthias Hanel <mh@synadia.com>
2021-03-09 19:44:15 -05:00
Matthias Hanel
137e450137 Increasing the timeout of waitOnClusterReady
Signed-off-by: Matthias Hanel <mh@synadia.com>
2021-03-09 18:37:11 -05:00
Matthias Hanel
9bfea58bd2 Fix unit test that received an extra connect message
Signed-off-by: Matthias Hanel <mh@synadia.com>
2021-03-09 15:52:31 -05:00
Ivan Kozlovic
52c4ab60f6 Merge pull request #1982 from nats-io/fix_idle_hbs_and_js_remote_unsubs
Fixed consumer idle hearbeats and JS route/GWs unsubscribes
2021-03-09 13:23:25 -07:00
Ivan Kozlovic
ccec4a6ab1 Fixed consumer idle hearbeats and JS route/GWs unsubscribes
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-03-09 12:08:47 -07:00
Waldemar Quevedo
86a64fbc46 Updates to JS consumer errors
Signed-off-by: Waldemar Quevedo <wally@synadia.com>
2021-03-09 09:46:28 -08:00
Waldemar Quevedo
5656ce5ace Merge pull request #1958 from nats-io/consumer-ack-pending-pull
Prevent pull batch larger than max ack pending
2021-03-09 07:50:01 -08:00
Derek Collison
ea9abc5ef8 Wait longer for response
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-09 05:41:00 -06:00
Derek Collison
e5e8205fac Need to make sure order of clseq as stamped also make it to the propose chan.
However we do not want to hold the actual stream lock.

Signed-off-by: Derek Collison <derek@nats.io>
2021-03-09 00:34:33 -06:00
Derek Collison
2a48cb17b0 Merge pull request #1979 from nats-io/waitOnStreamCurrent-timeout
Increasing unit test timeout for waitOnStreamCurrent from 10 to 30 sec
2021-03-08 20:05:53 -07:00
Matthias Hanel
bea37b089c fixing crash when disabling already shut down client
Signed-off-by: Matthias Hanel <mh@synadia.com>
2021-03-08 19:57:18 -05:00
Matthias Hanel
fdcebf5c3a Increasing unit test timeout for waitOnStreamCurrent from 10 to 30 sec
Signed-off-by: Matthias Hanel <mh@synadia.com>
2021-03-08 19:17:36 -05:00
Ivan Kozlovic
4d1fc3a449 Merge pull request #1974 from nats-io/pae
Memory cache for commits and WAL size constraints.
2021-03-08 16:43:20 -07:00
Ivan Kozlovic
57af977548 Stabilized stream sources under restart
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-03-08 16:41:02 -07:00
Derek Collison
513cb061e3 Bump Version 2021-03-08 15:43:15 -06:00
Derek Collison
467614ea87 Make sure to check for old messages during processsing.
Also changed the way we detect old messages.

Signed-off-by: Derek Collison <derek@nats.io>
2021-03-08 15:42:03 -06:00
Derek Collison
673543c180 Modified flow control for clustered mode.
Set channels into and out of RAFT layers to block.

Signed-off-by: Derek Collison <derek@nats.io>
2021-03-08 12:58:57 -06:00
Waldemar Quevedo
3e61c2e5b1 Prevent pull batch size larger than max ack pending
Signed-off-by: Waldemar Quevedo <wally@synadia.com>
2021-03-08 08:55:47 -08:00
Waldemar Quevedo
278c0efc8a Fix check from next request msg
Signed-off-by: Waldemar Quevedo <wally@synadia.com>
2021-03-07 00:12:31 -08:00
Derek Collison
c22627d4c1 Make sure to look in the WAL if not found in pae
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-06 18:01:00 -06:00
Derek Collison
5fe9ba5e94 Switched to fast state
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-06 09:00:15 -08:00
Derek Collison
31df41700b Protect against divzero
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-06 08:54:19 -08:00
Derek Collison
d31fda5dac Added code to constrain size of WAL under most scenarios.
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-06 08:38:56 -08:00
Derek Collison
63b620972d Under heavy load retreiving the append entry from the WAL
while trying to also send new append entries was causing contention.

Signed-off-by: Derek Collison <derek@nats.io>
2021-03-06 07:50:11 -08:00
Waldemar Quevedo
4448989091 Skip TERM signal during lame duck mode
Signed-off-by: Waldemar Quevedo <wally@synadia.com>
2021-03-06 00:16:58 -08:00
Ivan Kozlovic
4e3b79f62b monitorConsumer perform snapshot similar to monitorStream
Changed the stream min size default value back to 32MB and removed
the one for consumer since we don't use it anymore but set the
count size same than for stream (8192).

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-03-05 19:02:41 -07:00
Derek Collison
0b3c686430 Fixes for data races and some locking.
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-05 17:19:51 -08:00
Derek Collison
ff98984358 Reworked internal consumers used for sources and mirrors.
Now use ephemerals and heartbeats and flowcontrol.

Signed-off-by: Derek Collison <derek@nats.io>
2021-03-05 14:32:57 -08:00
Derek Collison
dd8acb1a99 Fixed a bug where we were not determing clustered state so were straight processing msgs from routes.
Cleaned up lseq and clseq code.

Signed-off-by: Derek Collison <derek@nats.io>
2021-03-05 12:00:19 -08:00
Derek Collison
9813ae3f79 Most tooling, Docker and Kubernetes send SIGTERM, so do graceful shutdown on the signal.
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-05 09:21:01 -08:00
Derek Collison
507eb25dc1 Fix for not placing checksum back properly on manual check restore
Signed-off-by: Derek Collison <derek@nats.io>
2021-03-05 09:18:20 -08:00