Commit Graph

3328 Commits

Author SHA1 Message Date
Derek Collison
39638edfb4 Bumped beta version 2020-11-11 12:05:11 -08:00
Derek Collison
65909c3e2d Merge pull request #1697 from nats-io/consumer
Updates to consumer store to support delta updates.
2020-11-11 11:29:54 -08:00
Scott Fauerbach
9b13150b83 Clarify HPUB and HMSG examples (#1695) 2020-11-11 11:12:44 -08:00
Derek Collison
164f9fdf2b Updates to consumer store to support delta updates.
In preparation for clustering we need to have the consumer filestore update state with deltas vs original design.

Signed-off-by: Derek Collison <derek@nats.io>
2020-11-10 19:16:55 -08:00
Derek Collison
84591c1e16 Bumped version
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-10 17:43:54 -08:00
Derek Collison
11e6df0ca0 Merge pull request #1699 from nats-io/idx_bug2
Updates to index cache handling for message blocks.
2020-11-10 12:49:26 -08:00
Derek Collison
21a35546c1 Updates to index cache handling for message blocks.
We can have partial caches and we can also remove the idx cache. This was causing a bug where we would get the wrong slotInfo from the cache.idx. This code fixes the bug and detects idx partials.

Signed-off-by: Derek Collison <derek@nats.io>
2020-11-10 12:49:00 -08:00
Derek Collison
55419c291b Merge pull request #1489 from nats-io/gcolliso-patch-1
Update GOVERNANCE.md
2020-11-10 09:08:17 -08:00
Ginger Collison
109c53a437 Update GOVERNANCE.md 2020-11-10 10:40:28 -06:00
Derek Collison
398ef78aac Fix flappers
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-05 18:10:52 -08:00
Derek Collison
dc40ba6197 Merge pull request #1694 from nats-io/consumer_update
Redeliver pending
2020-11-05 15:01:22 -08:00
Derek Collison
a4abbea0d2 Make sure to set timer for additional redeliveries
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-05 14:07:17 -08:00
Derek Collison
4a26b1f514 Redeliver pending right away on change of delivery subject for a consumer.
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-05 13:20:27 -08:00
Derek Collison
34a6aa8814 Bumped beta version 2020-11-05 07:35:57 -08:00
Derek Collison
8b56ea3b9a Merge pull request #1693 from nats-io/pcache_bug
Partial filestore cache bug
2020-11-05 07:30:51 -08:00
Derek Collison
67b1a33401 Fix for partial cache overwrite bug.
When we moved to a write through cache architecture we also moved the cache write to offset based instead of APPEND.
We were inadvertently clearing our offset from our cache when we would clear which meant if the next operation was another write we would have the wrong offset and overwrite previous messages.

Signed-off-by: Derek Collison <derek@nats.io>
2020-11-04 20:01:53 -08:00
Ivan Kozlovic
5a6bb37564 Test that shows message disappear from filestore
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2020-11-04 15:37:38 -07:00
Ivan Kozlovic
0965a20b51 Merge pull request #1692 from nats-io/gw_pings
[CHANGED] Gateway connections now always send PINGs
2020-11-03 14:31:11 -07:00
Ivan Kozlovic
ffd476357e [CHANGED] Gateway connections now always send PINGs
Connections normally suppress sending PINGs if there was some
activity. We now force GATEWAY connections to send PINGs at the
configured interval or 15 seconds, whichever is the smallest.

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2020-11-03 13:13:09 -07:00
Ivan Kozlovic
d5c6d84626 Update latest release URL in README [ci skip]
Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2020-11-02 14:19:32 -07:00
Derek Collison
d737ccef55 Merge pull request #1685 from nats-io/fs
Update to write architecture and bug fixes and stability improvements.
2020-11-02 08:59:28 -08:00
R.I.Pienaar
db44ebd5d5 Merge pull request #1689 from ripienaar/acknxt_struct
support next structure in acknxt
2020-11-02 17:58:46 +01:00
R.I.Pienaar
c0f031cc39 support next structure in acknxt
Signed-off-by: R.I.Pienaar <rip@devco.net>
2020-11-02 17:47:19 +01:00
Derek Collison
d80dd43e88 Set in flusher state inside spinup function
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-02 08:37:02 -08:00
Derek Collison
248c2e7d80 Merge pull request #1686 from nats-io/available
Separate out disk available for Windows
2020-11-02 07:38:38 -08:00
Derek Collison
debf474a3a Merge pull request #1688 from nats-io/fix2
Flush after purge too
2020-11-01 13:37:15 -08:00
Derek Collison
d729beb24c Flush after purge too
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-01 13:21:53 -08:00
Derek Collison
e0c79edec4 Merge pull request #1687 from nats-io/acktest
Fix for flapper and additional consumer perf test
2020-11-01 12:38:09 -08:00
Derek Collison
65caff18c3 Fix for flapper and additional consumer perf test
Signed-off-by: Derek Collison <derek@nats.io>
2020-11-01 12:06:45 -08:00
Derek Collison
1f8ec6c964 Separate out disk available for Windows
Signed-off-by: Derek Collison <derek@nats.io>
2020-10-31 12:56:27 -07:00
Derek Collison
93ebcafca1 Update to write architecture and bug fixes and stability improvements.
We had a left over artifact from the shared write buffer architecture
where the filestore was still controlling the flush loop for the special
last message block. This changes it such that each message block is running
their own flush loop.

Signed-off-by: Derek Collison <derek@nats.io>
2020-10-31 12:08:55 -07:00
Derek Collison
c5657d750b Bumped version. 2020-10-31 12:06:20 -07:00
R.I.Pienaar
96c53b77f5 Merge pull request #1683 from ripienaar/bare_acknxt
ensure bare AckNxt requesting >1 is supported
2020-10-30 16:15:20 +01:00
R.I.Pienaar
bf68068fa6 address review
Signed-off-by: R.I.Pienaar <rip@devco.net>
2020-10-30 15:27:42 +01:00
R.I.Pienaar
0e9ca7614f ensure bare AckNxt requesting >1 is supported
Signed-off-by: R.I.Pienaar <rip@devco.net>
2020-10-30 14:46:39 +01:00
Derek Collison
5270f2da46 Merge pull request #1682 from nats-io/filter_interest
Would not properly handle wildcard streams with interest retention and filtered consumers
2020-10-29 14:08:14 -07:00
Derek Collison
6232e4b150 Lock access updates.
Signed-off-by: Derek Collison <derek@nats.io>
2020-10-29 14:04:28 -07:00
Derek Collison
cce7195a2c Fixed bug that would not properly handle wildcard streams with interest retention and filtered consumers.
Signed-off-by: Derek Collison <derek@nats.io>
2020-10-29 13:14:17 -07:00
Ivan Kozlovic
3f433ab8f0 Merge pull request #1681 from nats-io/fix_js_ebit
JetStream: clear erased bit when reading sequence number
2020-10-29 13:34:13 -06:00
Ivan Kozlovic
04450f2d99 JetStream: clear erased bit when reading sequence number
Also changed the link to travis-ci.com instead of .org

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
2020-10-29 13:17:21 -06:00
Derek Collison
5adce5c01c Merge pull request #1679 from nats-io/si-units-go-fmt
Run go fmt on tests
2020-10-28 20:51:48 -07:00
Waldemar Quevedo
c9ff9c45a4 Run go fmt on tests
Signed-off-by: Waldemar Quevedo <wally@synadia.com>
2020-10-28 20:49:47 -07:00
Derek Collison
0f22e99601 Merge pull request #1675 from nats-io/filestore
Stability and performance updates for filestore.
2020-10-28 19:16:44 -07:00
Derek Collison
283c632d8b Updates based on PR feedback and fix for merge regression with pending PR
Signed-off-by: Derek Collison <derek@nats.io>
2020-10-28 18:58:42 -07:00
Derek Collison
8fede04064 Merge pull request #1678 from nats-io/si-units
Add support for base2 units in NATS config
2020-10-28 18:23:58 -07:00
Waldemar Quevedo
2047ed4537 Add support for base2 units in NATS config
Signed-off-by: Waldemar Quevedo <wally@synadia.com>
2020-10-28 13:52:35 -07:00
Derek Collison
225e22667c Make flush channel buffered since we do non-blocking kicks
Signed-off-by: Derek Collison <derek@nats.io>
2020-10-28 12:42:31 -07:00
Derek Collison
ad452190e3 Make sure flushLoop is running before returning from constructor.
We had a situation in constrained events where the flusher was not
started running fast enough and flush events were missed and caches
became stale.

Signed-off-by: Derek Collison <derek@nats.io>
2020-10-28 11:35:57 -07:00
Derek Collison
3e5d484fc8 Merge pull request #1677 from ripienaar/rename_consumer_pending
rename consumer pending fields for clarity
2020-10-28 08:39:21 -07:00
Derek Collison
ebae9f452c Always return with no cache, optionally reset timer
Signed-off-by: Derek Collison <derek@nats.io>
2020-10-28 08:30:52 -07:00