gogrlx/nats-server
1
0
Fork 0
mirror of https://github.com/gogrlx/nats-server.git synced 2026-04-02 11:48:43 -07:00
Code Issues Packages Projects Releases Wiki Activity
4,255 Commits 30 Branches 48 Tags
http-hdr-case
Commit Graph

127 Commits

Author SHA1 Message Date
Derek Collison
c0e8590c0f During startup each filtered consumer could do a linear scan of the stream 
to determine number of messages pending. This improves that with a startup cache.

Signed-off-by: Derek Collison <derek@nats.io>
 2021-04-07 09:15:01 -07:00
Derek Collison
c05ff97d09 Fixes based on PR feedback 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-25 18:09:35 -07:00
Derek Collison
da7b7f9f85 Make sure to configure global account for reload 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-25 18:06:14 -07:00
Derek Collison
e53caee5e8 Enforce server limits even when dynamic limits for accounts in play. 
We were not properly enforcing server limits. This commit will allow a server to enforce limits but still remain functional even at the JetStream level.
Also fixed a bug for RAFT replay that could cause instability.

Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-25 16:06:27 -07:00
Derek Collison
2ed53035ed Reworked flow control for sources and mirrors. 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-24 07:07:33 -07:00
Derek Collison
d9b78b8bc4 Update info status for JetStream when disabling and restarting 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-20 09:07:47 -07:00
Derek Collison
cfe2f448ad Fix for when gateways were dropped and we did not detect interest returning. 
Fix for leaked subscription when retrying the source consumers.
Better suppression of old messages from old direct consumers.

Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-20 08:44:18 -07:00
Derek Collison
61771e88f8 In operator mode with JetStream we want to load accounts that have stable storage. 
Also if an account was registered but not JetStream enabled, update it vs error.

Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-20 06:53:13 -07:00
Derek Collison
8eefff2b3b Make sure the jetstream accounts use the name as the key to the map. 
This prevents possible double adds under reload or restart scenarios.

Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-18 17:29:26 -07:00
R.I.Pienaar
ac70abdcf3 update banner url 
Signed-off-by: R.I.Pienaar <rip@devco.net>
 2021-03-17 16:39:24 +01:00
Derek Collison
2e9ae92bb5 Fix for #2011 and atomics on 32bit systems. 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-16 13:57:28 -07:00
Derek Collison
e530c98ebe We no longer force remove our peer on out of space. 
We also delay restarting JetStream to make sure accounts are enabled.

Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-14 17:01:38 -07:00
Waldemar Quevedo
775afd01e7 Fix for JS reload and exports 
Signed-off-by: Waldemar Quevedo <wally@synadia.com>
 2021-03-14 15:16:56 -07:00
Derek Collison
e74eaa02c4 Suppress multiple out of space warnings 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-13 16:30:57 -05:00
Derek Collison
a3a35c0ddb Updated raft processing and dealing with remove peer. 
Made sure to not remove us if we were remapped after the peer removal.
Fixed some raft behaviors.

Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-13 16:28:24 -05:00
Derek Collison
be3514bfdc Do not auto remap 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-13 16:26:26 -05:00
Waldemar Quevedo
93fd0f60f5 reload: Allow re-enabling JS after it was disabled 
Signed-off-by: Waldemar Quevedo <wally@synadia.com>
 2021-03-12 17:19:34 -08:00
Waldemar Quevedo
d338e9ae30 Disable JS on restart if on invalid state 
Signed-off-by: Waldemar Quevedo <wally@synadia.com>
 2021-03-10 01:40:32 -08:00
Matthias Hanel
bea37b089c fixing crash when disabling already shut down client 
Signed-off-by: Matthias Hanel <mh@synadia.com>
 2021-03-08 19:57:18 -05:00
Ivan Kozlovic
57af977548 Stabilized stream sources under restart 
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
 2021-03-08 16:41:02 -07:00
Derek Collison
5fe9ba5e94 Switched to fast state 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-06 09:00:15 -08:00
Derek Collison
0b3c686430 Fixes for data races and some locking. 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-05 17:19:51 -08:00
Derek Collison
ff98984358 Reworked internal consumers used for sources and mirrors. 
Now use ephemerals and heartbeats and flowcontrol.

Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-05 14:32:57 -08:00
Derek Collison
d7201a110b Better handling on out of disk. 
Suppress some stream and consumer bad results since they delete the asset.
Allow rehup to re-enable JetStream.
Various bug fixes and improvements.

Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-03 20:12:10 -08:00
Ivan Kozlovic
e7e756034a Switch Gateway JS accounts to interest-only mode + some other fixes 
- Fixed the close of a TLS connection which starting Go 1.16
set the deadline to 5 seconds.

- Fixed an issue with setHeader that was causing these error messages
```
=== RUN   TestServiceImportReplyMatchCycleMultiHops
nats: message could not decode headers on connection [4] for subscription on "foo"
--- PASS: TestServiceImportReplyMatchCycleMultiHops (0.04s)
```

- Fixed names of tests in norace_test.go since they must start with
TestNoRace in order to make sure that we execute them in Travis:
```
go test -v -run=TestNoRace --failfast -p=1 ./...
```

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
 2021-03-03 19:15:28 -07:00
Derek Collison
e8029094e3 Cleanup export and import processing 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-03 06:35:52 -08:00
Derek Collison
00a49ce329 Test for existing service import 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-02 20:38:16 -08:00
Derek Collison
4f7fbefc7c In clustered JetStream we need to move API calls out of routes/gateways/leafnodes path. 
This moves from explicit imports and subscriptions to one wildcard subscription and a single wildcard export.

Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-02 17:54:41 -08:00
Derek Collison
d4a8baf030 Stabilize test, wait a bit for migration 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-02 05:28:55 -08:00
Derek Collison
22749fb1e2 Fix data race, stabilize usage test 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-01 16:47:19 -08:00
Derek Collison
c8e2ad6248 Make sure trailing usage updates accounted for eventually 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-01 14:23:06 -08:00
Derek Collison
84d042c4e2 Make sending account usage updates more efficient 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-03-01 04:42:50 -08:00
Derek Collison
df77724aa4 Make ephemeral consumers R=1 and provide optimistic migration on peer removal or server shutdown. 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-02-28 16:50:25 -08:00
R.I.Pienaar
a4817bd7b6 extend the out of space advisory 
Signed-off-by: R.I.Pienaar <rip@devco.net>
 2021-02-26 11:10:05 +01:00
Derek Collison
e5c8774172 Handle out of space situations, general stability enhancements 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-02-25 17:54:29 -08:00
Derek Collison
78bdc34637 General stability improvements. Fixes to subscription state not cleaning up. 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-02-24 08:44:34 -08:00
Derek Collison
bb58d455f6 Revert switching to interest only mode 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-02-23 18:00:47 -08:00
Derek Collison
09e3d26fa3 Add in support for stream mirrors and sources. 
Add in proper support for stream updates in clustered mode.
Don't send API updates without subjects, caused GW parser errors.
Stream internal loops use their own clients now.

Signed-off-by: Derek Collison <derek@nats.io>
 2021-02-23 10:57:27 -08:00
Matthias Hanel
2e4a892c8d [fixes] crash in checkJetStreamExports when there is no system account 
Signed-off-by: Matthias Hanel <mh@synadia.com>
 2021-02-23 00:42:31 -05:00
Derek Collison
d803189eca Changes needed to properly support multi-layer service imports for system services like JS. 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-02-12 17:01:32 -08:00
Derek Collison
579737a5e1 General fixes, stability improvements 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-02-11 18:13:24 -08:00
Derek Collison
c16f6e193d Move JetStream direct APIs to private. 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-02-07 15:19:22 -08:00
Derek Collison
c9e1cbd571 Modified jetstream varz information 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-02-02 08:35:35 -08:00
Derek Collison
e5c1d65fff Added in JS disable per server on reload. Also removing peerw from a stream and leader stepdown for streams and consumers. 
Various bug fixes, stability improvments.

Signed-off-by: Derek Collison <derek@nats.io>
 2021-02-01 19:39:08 -08:00
Derek Collison
095a83bc2a Make sure to suppress duplicate create/delete audit events 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-01-31 09:16:16 -08:00
Derek Collison
8bd290c77a Fix for #1864. 
When trying to make sure we properly created all subs for service imports we would check the internal client to see if we should process.
With JS enabled on the server we would place system imports that would break that check and orphan other service imports.

Signed-off-by: Derek Collison <derek@nats.io>
 2021-01-29 17:51:14 -08:00
Derek Collison
c889321a83 Change to API.Total and API.Errors 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-01-29 09:42:20 -08:00
Derek Collison
0a3124e27d Track API calls per account. Track success and errors. 
These tracking data are ephemeral per server. so on restart they reset.
That should be ok since these will most likely be used more for rates.

Signed-off-by: Derek Collison <derek@nats.io>
 2021-01-28 17:16:50 -08:00
Derek Collison
6f2b50a374 Added support for clustered account info and limit enforcement 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-01-21 18:47:21 -08:00
Derek Collison
55d750733b Fix based on feedback from Ivan 
Signed-off-by: Derek Collison <derek@nats.io>
 2021-01-20 11:58:31 -08:00