R.I.Pienaar
200ebbd47e
proposed schemas for events
...
This is a proposal to add schema, timestamps and unique ids to
events. For now just JS ones but I propose to do these for all
events the server sends that might be end user consumed.
These exist to help the user identify a message even if it was
sent to a 3rd party system, the schema will be translatable to
a well known url like https://nats.io/schames/jetstream/event/v1/obs_ack.json
or to another wll known identifier like a NATS subject name
We'd publish JSON schema documents at these well known locations
describing each key and so forth
2020-05-19 14:16:03 -07:00
R.I.Pienaar
c9da1ca64a
fix purge export subject
2020-05-19 14:16:03 -07:00
Derek Collison
47c28b2fb0
JetStream major refactor for name changes.
...
MsgSet -> Stream
Observable -> Consumer
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
Derek Collison
23da0b08ac
Pulled out K/V support for now
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
Derek Collison
d836769cab
Added in basic K/V scenario
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
Derek Collison
2237915c97
Added in template support
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
Derek Collison
e3be6f45c4
Add in delete for observables for filestore impl
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
Derek Collison
b3739f9bbf
MaxMsgSize for MsgSets, -ERR api cleanup
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
R.I.Pienaar
1d4f6402ba
unexported import of Comma function from humanize
2020-05-19 14:16:03 -07:00
R.I.Pienaar
fab4d00141
de-humanize
...
Signed-off-by: R.I.Pienaar <rip@devco.net >
2020-05-19 14:16:03 -07:00
R.I.Pienaar
aa2fe462ba
elevate some logging to improve visibility into corruption
...
Signed-off-by: R.I.Pienaar <rip@devco.net >
2020-05-19 14:15:11 -07:00
Derek Collison
58d98d42cb
Allow notifications for literal subjects.
...
This allows us to register for notifications on subjects to determine when interest comes and goes.
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
R.I.Pienaar
a01698bcf7
also track delivery counts and msg set
2020-05-19 14:15:11 -07:00
R.I.Pienaar
e8bd543c54
support sampling time to ack messages in explicit ack mode
...
This allows an observable to have a sampling frequency and will
publish ack times regularly
2020-05-19 14:15:11 -07:00
Derek Collison
a1e802c04b
Flush state on shutdown and re-initialize pending checks on restore to do redelivery
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
Derek Collison
cfc31f7a15
Allow direct lookup of message from msgset
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
Derek Collison
b3b2feebc5
Include config in info for msgset
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
Derek Collison
bbdb61a4e1
Add ability to set storage directory
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
Derek Collison
c650b1bca3
API fix and rebase fix
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
Derek Collison
0d44a6150a
More debug info on startup and restore
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
Derek Collison
e127039622
More API impls, tests for DeleteMsg
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:13:22 -07:00
Derek Collison
6b34d4e700
Remove deadlock, balance filestore perf
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:13:22 -07:00
Derek Collison
0c2d539b06
Remote request API
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:13:22 -07:00
Derek Collison
ec2161ad53
State recovery and server shutdown
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:12:28 -07:00
Derek Collison
68860b39c3
metadata and checksum storage
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:12:28 -07:00
Derek Collison
81704d285b
Plugin filestore to jetstream tests
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:12:28 -07:00
Derek Collison
fa99ffa176
Read cache expiration
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:12:28 -07:00
Derek Collison
39aba7de92
filestore first pass
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:12:28 -07:00
Derek Collison
75908f80a4
API cleanup
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:07:02 -07:00
Derek Collison
da7838368d
Tracking usage and limits
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:07:02 -07:00
Derek Collison
b7b98df4ee
Server limits and account reservations
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:07:02 -07:00
Derek Collison
d327a91143
Working ACK indicator
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:07:02 -07:00
Derek Collison
5d5d5cbd60
Add AckNext and batch size for worker pull mode
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:07:02 -07:00
Derek Collison
98b78d06c4
First pass pull mode, e.g. worker
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:07:02 -07:00
Derek Collison
dd116fcfd4
JetStream first pass basics.
...
This is the first checkin for JetStream. Has some rudimentary basics working.
TODO
1. Push vs pull mode for observables. (work queues)
2. Disk/File store, memory only for now.
3. clustering code - design shaping up well.
4. Finalize account import semantics.
5. Lots of other little things.
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:06:29 -07:00