Commit Graph

3757 Commits

Author SHA1 Message Date
Ivan Kozlovic
8af8cf4e67 Remap subject only for service imports
Also optimized a test that was taking too long to run.

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-02-08 14:41:33 -07:00
Jaime Piña
71b842520b Prevent non-exported messages from leaking into importer account (#1891)
* Add account isolation tests config & jwt

* Set the shadow subscription static subject
2021-02-08 14:07:18 -05:00
Derek Collison
20778b96d9 Merge pull request #1896 from nats-io/jsz-leader
Added leader only response for jsz.
2021-02-08 11:42:14 -07:00
Derek Collison
b25055bbf6 Added leader only response for jsz.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-08 10:40:33 -08:00
Derek Collison
d4cc658c35 Bump version [ci skip]
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-08 07:43:14 -08:00
Derek Collison
7da6529feb Merge pull request #1895 from nats-io/startfix
Fixes for supercluster startup and JetStream clustering.
2021-02-08 08:02:25 -07:00
Derek Collison
c99608fa65 Fix for some test flappers
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-08 07:00:52 -08:00
Derek Collison
7ae8d66c6d Do ramp down on server stats on startup
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-08 06:46:57 -08:00
Derek Collison
594defa11b Fix for crash in test
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-08 06:32:05 -08:00
Derek Collison
15355d783b For larger superclusters we send out our server information after a short delay on startup.
For determing leaderless make sure the raft node has been running for long enough.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-08 06:26:33 -08:00
Derek Collison
b79a4afcbe Merge pull request #1894 from nats-io/jsprivate
Move JetStream direct APIs to private.
2021-02-07 16:33:04 -07:00
Derek Collison
c16f6e193d Move JetStream direct APIs to private.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-07 15:19:22 -08:00
Derek Collison
cfedc3efd7 Merge pull request #1892 from nats-io/jsc-updates
JetStream updates and improvments
2021-02-07 13:12:02 -07:00
Derek Collison
42e3210265 Shutdown JetStream on failed stream msg store in clustered mode
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-07 11:52:52 -08:00
Ivan Kozlovic
d732c8fe82 Fixed bug that would prevent queue subs to ack messages
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-02-07 11:26:54 -07:00
Derek Collison
92d64c2bcc Reset WAL on mismatch catchup regardless, condition ok
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-07 09:30:13 -08:00
Derek Collison
a16affedca Always reset election timeout on vote request
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-07 08:09:01 -08:00
Derek Collison
f209c60123 Send our own serverinfo when we receive an update from a new server
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-07 06:53:07 -08:00
Derek Collison
6ac7b238b0 Test fix for delay in lost quorum adv
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-07 05:52:10 -08:00
Derek Collison
c11a733502 Broken test for non MarshalIndent
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-07 05:08:22 -08:00
Derek Collison
38267d5110 Stability improvements
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-06 20:15:32 -08:00
Derek Collison
74a4c531c9 Stability improvements.
Changes to catchup logic, peer tracking, and vote responses.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-06 20:13:18 -08:00
Derek Collison
716da693e4 Track peers differently, react to removal entries
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-06 20:11:30 -08:00
Derek Collison
1c79d96de8 user single node info struct
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-06 20:10:29 -08:00
Derek Collison
6d32c307ef Remove pretty indent for json.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-06 20:09:44 -08:00
Derek Collison
b358773ddf Force filestore to flush in place by default.
Track lost data and truncate message blocks when detecting failures or write errors.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-06 20:04:47 -08:00
Derek Collison
1622c2b60e Send serverInfo on remote shutdown and remove mapping entries
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-05 17:21:55 -08:00
Matthias Hanel
7b7543d298 [added] jsz nats and http monitoring endpoint for jetstream (#1881)
The new endpoints are /jsz on http and "$SYS.REQ.SERVER.PING.JSZ" and "$SYS.REQ.SERVER.%s.JSZ".
$SYS.REQ.ACCOUNT.%s.JSZ will only return info for the particular account

Signed-off-by: Matthias Hanel <mh@synadia.com>
2021-02-05 18:46:04 -05:00
Derek Collison
f7ab27f7da Merge pull request #1889 from nats-io/sc-reassign
Make peer reassignment supercluster aware.
2021-02-05 08:48:25 -07:00
Derek Collison
f500527d12 Make peer reassigment supercluster aware.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-05 07:21:00 -08:00
Derek Collison
73d30c615f Merge pull request #1888 from nats-io/getmsg
Make direct message retrieval from stream cluster aware.
2021-02-05 07:42:08 -07:00
Derek Collison
78f549b35b Make direct message retrieval from stream cluster aware
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-05 06:37:49 -08:00
Derek Collison
04c8fac8f6 Merge pull request #1887 from nats-io/fixes
Noticed stream snapshots were being processed on recovery
2021-02-04 13:47:56 -07:00
Derek Collison
493425e8b2 Noticed stream snapshots were being processed on recovery causing high cpu usage and memory usage.
Also made consumer Created() UTC.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-04 12:29:07 -08:00
Derek Collison
0ee93b4976 Merge pull request #1886 from nats-io/double_purge
Purge operation replay on restart
2021-02-04 11:37:44 -07:00
Derek Collison
74b1e1f72c Change the way we decide to compact on purge op replay
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-04 09:45:51 -08:00
Derek Collison
483b07a794 Make sure old purge did what it was supposed to
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-04 07:49:30 -08:00
Derek Collison
c49e3247bb Purge operations would be replayed on restart regardless if they had already been processed.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-04 07:04:50 -08:00
Derek Collison
d71c845a92 Bump Version [ci skip]
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-03 20:14:13 -08:00
Ivan Kozlovic
226638a49d Merge pull request #1884 from nats-io/jsc_del_cons_fix
Fixed some issues with JS consumers
2021-02-03 20:43:02 -07:00
Ivan Kozlovic
6eeb9d2361 Fixed some issues with JS consumers
- Should check if there is interest at top of deleteNotActive timer
callback.
- Use RLock/RUnlock for no interest check
- Remove some checks in cluster mode regarding internal stream/consumers

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2021-02-03 20:12:06 -07:00
Derek Collison
01ad02ccae Merge pull request #1883 from nats-io/supercluster
First pass at supercluster enablement.
2021-02-03 19:56:36 -07:00
Derek Collison
0b27d174f5 Merge pull request #1882 from nats-io/stream-delete
Stream Message delete and purge
2021-02-03 18:29:54 -07:00
Derek Collison
a1e0f7dc1a First pass at supercluster enablement.
This allows metacontrollers to span superclusters. Also includes placement directives for streams. By default they select the request origin cluster.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-03 17:28:13 -08:00
Derek Collison
dba22d9855 Test for restart after delete
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-03 16:49:38 -08:00
Derek Collison
625e6859a3 Only respond for delete and purge if leader and not recovering.
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-03 16:36:32 -08:00
Derek Collison
1c9258f91c Handle msg delete and stream purge for R=1
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-03 16:30:03 -08:00
Derek Collison
0dfac6b52f Merge pull request #1880 from nats-io/erase-bug
[FIXED] Bug with erased messages and re-indexing the message block cache.
2021-02-03 15:13:51 -07:00
Derek Collison
6baf69889f Allow NoErase option to deleting a message through the formal API
Signed-off-by: Derek Collison <derek@nats.io>
2021-02-03 14:12:27 -08:00
Derek Collison
eb429022e8 There was a bug when a messages was erased and we expired the cache we would not properly re-index.
We need to clear the erase bit to properly set fseq in the cache structure.

Signed-off-by: Derek Collison <derek@nats.io>
2021-02-03 13:58:13 -08:00