gogrlx/nats-server
1
0
Fork 0
mirror of https://github.com/gogrlx/nats-server.git synced 2026-04-17 03:24:40 -07:00
Code Issues Packages Projects Releases Wiki Activity
3,210 Commits 30 Branches 48 Tags
pdp/socket-data
Commit Graph

34 Commits

Author SHA1 Message Date
Derek Collison
120402241a Fix for #1486 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-06-18 21:04:34 -07:00
Derek Collison
a13402cd01 Run expiration only once at a time and double check cache, fixes #1482 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-06-18 12:14:25 -07:00
Derek Collison
8e9462dea4 Make arg order same for Snapshot 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-06-02 06:24:46 -07:00
Derek Collison
0d2ca9ba54 Fix race, can't clear direct memory since shared 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-06-02 06:19:04 -07:00
Derek Collison
e584d4efee Merge pull request #1435 from nats-io/js-hdrs 
First pass header support for JetStream
 2020-05-31 06:01:01 -07:00
Derek Collison
9156fa6c03 Merge pull request #1432 from nats-io/snapshot-check 
Allow snapshots to optionally check all message checksums
 2020-05-30 12:53:40 -07:00
Derek Collison
eca04c6fce First pass header support for JetStream 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-30 10:04:23 -07:00
Ivan Kozlovic
44e78a1fb6 Fixed some tests 
- A race test may have consumed a lot of fds going in TIME_WAIT
that could cause some issues for other tests
- Missing defer filestore.Stop() that would leave flushLoop()
routines
- A defer for the from server in a LeafNode test
- Rework [Re]ConnectErrorReports that was failing often for me
locally (probably due to exhaustion of fds - too many TIME_WAIT).

Signed-off-by: Ivan Kozlovic <ivan@synadia.com>
 2020-05-29 17:47:08 -06:00
Derek Collison
e12907ffa6 Allow snapshots to optionally check all message checksums 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-29 09:57:33 -07:00
Derek Collison
0a206b4c64 Snapshot performance tweaks 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-29 08:07:31 -07:00
Derek Collison
fa59cff105 Add in snapshot and restore JSApi 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-27 20:01:30 -07:00
Derek Collison
8727315eb9 Updated snapshots, added restore, generic hashes 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-26 19:53:16 -07:00
Derek Collison
3e5d0c343d Fix for test failure when racing against double deletes 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-20 15:23:39 -07:00
R.I.Pienaar
fb37c121d1 expose the arrival timestamp in the message metadata 
Signed-off-by: R.I.Pienaar <rip@devco.net>
 2020-05-19 14:21:27 -07:00
Derek Collison
1394a7118d Breaking change to upgrade ConsumerConfig for consumer creation. 
This is a breaking change and will not be able to restore consumer's from a filestore when upgraded.
We are getting close to settling on the API an once that happens we will not be introducnig any
breaking changes.

Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:20:02 -07:00
Derek Collison
4774d41f9d Fixes for filestore consistency on server restarts under heavy load with purge operations 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:18:34 -07:00
Derek Collison
323b3d0b11 Beginning basics for stream and consumer snapshotting 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:18:34 -07:00
Derek Collison
f2ece0515c Increased purge performance for very large streams 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:18:34 -07:00
Derek Collison
4a46a92cea Redesigned file storage engine. 
The old engine was a simple design to get us started but had a single lock and held that lock around I/O.
This design allows message blocks to have the own RW locks and operate independently and to also not hold
locks while doing most I/O.

Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:16:03 -07:00
Derek Collison
47c28b2fb0 JetStream major refactor for name changes. 
MsgSet -> Stream
Observable -> Consumer

Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:16:03 -07:00
Derek Collison
a7d7b6ff56 Fix for writing messages after restart and delivery count suppression on max 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:16:03 -07:00
Derek Collison
1028798d3a Move Subject to FilterSubject 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:16:03 -07:00
Derek Collison
e127039622 More API impls, tests for DeleteMsg 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:13:22 -07:00
Derek Collison
3c074ace4b Changed Partition -> Subject 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:13:22 -07:00
Derek Collison
68860b39c3 metadata and checksum storage 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:12:28 -07:00
Derek Collison
81704d285b Plugin filestore to jetstream tests 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:12:28 -07:00
Derek Collison
c3a5df135f Observable state storage 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:12:28 -07:00
Derek Collison
fa99ffa176 Read cache expiration 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:12:28 -07:00
Derek Collison
5cf03fd074 Remove performance, dmap collapse logic 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:12:28 -07:00
Derek Collison
613d65c58c Erased msg recovery, bug fix on linux for idx file, LoadMsg vs Lookup 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:12:28 -07:00
Derek Collison
e8f465eaf3 Filestore read perf, secure delete for stores 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:12:28 -07:00
Derek Collison
4afdfafd89 Bitrot protection and tests 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:12:28 -07:00
Derek Collison
62fcfcd84d filestore updates 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:12:28 -07:00
Derek Collison
39aba7de92 filestore first pass 
Signed-off-by: Derek Collison <derek@nats.io>
 2020-05-19 14:12:28 -07:00