Commit Graph

3341 Commits

Author SHA1 Message Date
Derek Collison
5ff28b6087 Allow stream lookup by subject.
Allow an API endpoint and public API to lookup a stream by subject. The subject needs to be an exact match or a subset. If the subject is considered a filtered subject for the stream that will also be returned.

Signed-off-by: Derek Collison <derek@nats.io>
2020-11-14 13:35:05 -08:00
Derek Collison
c851b39b79 Merge pull request #1709 from nats-io/removebug
Fix bug when removing the same message from a stream.
2020-11-13 18:24:16 -08:00
Derek Collison
28cb4e8c34 Fix bug when removing the same message from a stream.
We would release locks and call into upper layers when removing a message. The upper layers may call back into the lower layers to get more information, such as the subject.
This fix has the storage updates optionally supply the subject for filtered consumers and fixes the bug of double deletes.

Signed-off-by: Derek Collison <derek@nats.io>
2020-11-13 17:05:24 -08:00
Derek Collison
e57f6c9dee Larger AckWait to prevent flapping
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-13 08:06:43 -08:00
Derek Collison
3a6411ab5c Merge pull request #1707 from nats-io/fsfix
Fixed bug and a race condition
2020-11-12 14:02:24 -08:00
Derek Collison
2696749bb2 fix
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-12 13:58:34 -08:00
Derek Collison
cd03482ccb Fixed bug when returning wrong error from LoadMsg and a race condition
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-12 13:38:08 -08:00
Derek Collison
1a1aca0c30 Merge pull request #1705 from nats-io/interest
Make interest notifications explicit match only
2020-11-12 08:29:28 -08:00
Derek Collison
e6797efde7 Make interest notifications explicit match only
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-12 07:10:47 -08:00
Derek Collison
958c04840c Merge pull request #1703 from nats-io/fix
Fix flapper, be pedantic about signaling on delivery subject update
2020-11-11 18:11:11 -08:00
Derek Collison
a733c12086 Fix flapper, be pedantic about signaling on delivery subject update
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-11 18:07:51 -08:00
Derek Collison
c6e2aa0ba6 Merge pull request #1702 from nats-io/split
Remove conditional and broadcast for signalling consumers
2020-11-11 14:02:56 -08:00
Derek Collison
e31001a782 Remove conditional and broadcast for signalling consumers
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-11 13:53:45 -08:00
Derek Collison
39638edfb4 Bumped beta version 2020-11-11 12:05:11 -08:00
Derek Collison
65909c3e2d Merge pull request #1697 from nats-io/consumer
Updates to consumer store to support delta updates.
2020-11-11 11:29:54 -08:00
Scott Fauerbach
9b13150b83 Clarify HPUB and HMSG examples (#1695) 2020-11-11 11:12:44 -08:00
Derek Collison
164f9fdf2b Updates to consumer store to support delta updates.
In preparation for clustering we need to have the consumer filestore update state with deltas vs original design.

Signed-off-by: Derek Collison <derek@nats.io>
2020-11-10 19:16:55 -08:00
Derek Collison
84591c1e16 Bumped version
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-10 17:43:54 -08:00
Derek Collison
11e6df0ca0 Merge pull request #1699 from nats-io/idx_bug2
Updates to index cache handling for message blocks.
2020-11-10 12:49:26 -08:00
Derek Collison
21a35546c1 Updates to index cache handling for message blocks.
We can have partial caches and we can also remove the idx cache. This was causing a bug where we would get the wrong slotInfo from the cache.idx. This code fixes the bug and detects idx partials.

Signed-off-by: Derek Collison <derek@nats.io>
2020-11-10 12:49:00 -08:00
Derek Collison
55419c291b Merge pull request #1489 from nats-io/gcolliso-patch-1
Update GOVERNANCE.md
2020-11-10 09:08:17 -08:00
Ginger Collison
109c53a437 Update GOVERNANCE.md 2020-11-10 10:40:28 -06:00
Derek Collison
398ef78aac Fix flappers
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-05 18:10:52 -08:00
Derek Collison
dc40ba6197 Merge pull request #1694 from nats-io/consumer_update
Redeliver pending
2020-11-05 15:01:22 -08:00
Derek Collison
a4abbea0d2 Make sure to set timer for additional redeliveries
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-05 14:07:17 -08:00
Derek Collison
4a26b1f514 Redeliver pending right away on change of delivery subject for a consumer.
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-05 13:20:27 -08:00
Derek Collison
34a6aa8814 Bumped beta version 2020-11-05 07:35:57 -08:00
Derek Collison
8b56ea3b9a Merge pull request #1693 from nats-io/pcache_bug
Partial filestore cache bug
2020-11-05 07:30:51 -08:00
Derek Collison
67b1a33401 Fix for partial cache overwrite bug.
When we moved to a write through cache architecture we also moved the cache write to offset based instead of APPEND.
We were inadvertently clearing our offset from our cache when we would clear which meant if the next operation was another write we would have the wrong offset and overwrite previous messages.

Signed-off-by: Derek Collison <derek@nats.io>
2020-11-04 20:01:53 -08:00
Ivan Kozlovic
5a6bb37564 Test that shows message disappear from filestore
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2020-11-04 15:37:38 -07:00
Ivan Kozlovic
0965a20b51 Merge pull request #1692 from nats-io/gw_pings
[CHANGED] Gateway connections now always send PINGs
2020-11-03 14:31:11 -07:00
Ivan Kozlovic
ffd476357e [CHANGED] Gateway connections now always send PINGs
Connections normally suppress sending PINGs if there was some
activity. We now force GATEWAY connections to send PINGs at the
configured interval or 15 seconds, whichever is the smallest.

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2020-11-03 13:13:09 -07:00
Ivan Kozlovic
d5c6d84626 Update latest release URL in README [ci skip]
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2020-11-02 14:19:32 -07:00
Derek Collison
d737ccef55 Merge pull request #1685 from nats-io/fs
Update to write architecture and bug fixes and stability improvements.
2020-11-02 08:59:28 -08:00
R.I.Pienaar
db44ebd5d5 Merge pull request #1689 from ripienaar/acknxt_struct
support next structure in acknxt
2020-11-02 17:58:46 +01:00
R.I.Pienaar
c0f031cc39 support next structure in acknxt
Signed-off-by: R.I.Pienaar <rip@devco.net>
2020-11-02 17:47:19 +01:00
Derek Collison
d80dd43e88 Set in flusher state inside spinup function
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-02 08:37:02 -08:00
Derek Collison
248c2e7d80 Merge pull request #1686 from nats-io/available
Separate out disk available for Windows
2020-11-02 07:38:38 -08:00
Derek Collison
debf474a3a Merge pull request #1688 from nats-io/fix2
Flush after purge too
2020-11-01 13:37:15 -08:00
Derek Collison
d729beb24c Flush after purge too
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-01 13:21:53 -08:00
Derek Collison
e0c79edec4 Merge pull request #1687 from nats-io/acktest
Fix for flapper and additional consumer perf test
2020-11-01 12:38:09 -08:00
Derek Collison
65caff18c3 Fix for flapper and additional consumer perf test
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-01 12:06:45 -08:00
Derek Collison
1f8ec6c964 Separate out disk available for Windows
Signed-off-by: Derek Collison <derek@nats.io>
2020-10-31 12:56:27 -07:00
Derek Collison
93ebcafca1 Update to write architecture and bug fixes and stability improvements.
We had a left over artifact from the shared write buffer architecture
where the filestore was still controlling the flush loop for the special
last message block. This changes it such that each message block is running
their own flush loop.

Signed-off-by: Derek Collison <derek@nats.io>
2020-10-31 12:08:55 -07:00
Derek Collison
c5657d750b Bumped version. 2020-10-31 12:06:20 -07:00
R.I.Pienaar
96c53b77f5 Merge pull request #1683 from ripienaar/bare_acknxt
ensure bare AckNxt requesting >1 is supported
2020-10-30 16:15:20 +01:00
R.I.Pienaar
bf68068fa6 address review
Signed-off-by: R.I.Pienaar <rip@devco.net>
2020-10-30 15:27:42 +01:00
R.I.Pienaar
0e9ca7614f ensure bare AckNxt requesting >1 is supported
Signed-off-by: R.I.Pienaar <rip@devco.net>
2020-10-30 14:46:39 +01:00
Derek Collison
5270f2da46 Merge pull request #1682 from nats-io/filter_interest
Would not properly handle wildcard streams with interest retention and filtered consumers
2020-10-29 14:08:14 -07:00
Derek Collison
6232e4b150 Lock access updates.
Signed-off-by: Derek Collison <derek@nats.io>
2020-10-29 14:04:28 -07:00