R.I.Pienaar
200ebbd47e
proposed schemas for events
...
This is a proposal to add schema, timestamps and unique ids to
events. For now just JS ones but I propose to do these for all
events the server sends that might be end user consumed.
These exist to help the user identify a message even if it was
sent to a 3rd party system, the schema will be translatable to
a well known url like https://nats.io/schames/jetstream/event/v1/obs_ack.json
or to another wll known identifier like a NATS subject name
We'd publish JSON schema documents at these well known locations
describing each key and so forth
2020-05-19 14:16:03 -07:00
R.I.Pienaar
c9da1ca64a
fix purge export subject
2020-05-19 14:16:03 -07:00
Derek Collison
47c28b2fb0
JetStream major refactor for name changes.
...
MsgSet -> Stream
Observable -> Consumer
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
Derek Collison
23da0b08ac
Pulled out K/V support for now
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
Derek Collison
119c48ee53
Do not allow overlapping message sets for now
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
R.I.Pienaar
7a1cf096ec
npe guard around mset access when sampling acks
2020-05-19 14:16:03 -07:00
Derek Collison
d836769cab
Added in basic K/V scenario
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
Derek Collison
2237915c97
Added in template support
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
Derek Collison
d4c3c481bd
Allow ephemeral observables on work queue message sets
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
Derek Collison
f211546b3e
Check for store errors
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
Derek Collison
f1a81454b5
Added in error for Delete and Stop for store
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
Derek Collison
a7d7b6ff56
Fix for writing messages after restart and delivery count suppression on max
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
Derek Collison
e3be6f45c4
Add in delete for observables for filestore impl
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
Derek Collison
1028798d3a
Move Subject to FilterSubject
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
Derek Collison
89ff13a5be
Add MaxDeliver for observables
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
Derek Collison
b3739f9bbf
MaxMsgSize for MsgSets, -ERR api cleanup
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
Derek Collison
7e8c74fdbd
Pull-based observables must be durable
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
R.I.Pienaar
1d4f6402ba
unexported import of Comma function from humanize
2020-05-19 14:16:03 -07:00
Derek Collison
1c939d5cc8
Adjust delivered for obs info via -1
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:16:03 -07:00
R.I.Pienaar
fab4d00141
de-humanize
...
Signed-off-by: R.I.Pienaar <rip@devco.net >
2020-05-19 14:16:03 -07:00
Derek Collison
37be43ee5a
Make sure purge works with redeliveries pending
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
Derek Collison
f78efe2d91
Add Name to Observable info
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
R.I.Pienaar
aa2fe462ba
elevate some logging to improve visibility into corruption
...
Signed-off-by: R.I.Pienaar <rip@devco.net >
2020-05-19 14:15:11 -07:00
Derek Collison
5efdf63625
Fix case where request for next msg times out
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
R.I.Pienaar
05ca8f4346
adds json tags to StoredMsg
...
This gets sent as response to JetStreamMsgBySeqPre
Signed-off-by: R.I.Pienaar <rip@devco.net >
2020-05-19 14:15:11 -07:00
Derek Collison
54e2de912f
Update observables on purge
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
R.I.Pienaar
cd8cd3a9eb
fix MsgSetInfo json keys
...
Signed-off-by: R.I.Pienaar <rip@devco.net >
2020-05-19 14:15:11 -07:00
Derek Collison
58d98d42cb
Allow notifications for literal subjects.
...
This allows us to register for notifications on subjects to determine when interest comes and goes.
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
R.I.Pienaar
423e017724
update readme to point to new CLI and updated guide
2020-05-19 14:15:11 -07:00
R.I.Pienaar
d828daa697
adjust ack event json field names for consistency
2020-05-19 14:15:11 -07:00
R.I.Pienaar
a01698bcf7
also track delivery counts and msg set
2020-05-19 14:15:11 -07:00
R.I.Pienaar
e8bd543c54
support sampling time to ack messages in explicit ack mode
...
This allows an observable to have a sampling frequency and will
publish ack times regularly
2020-05-19 14:15:11 -07:00
Derek Collison
a1e802c04b
Flush state on shutdown and re-initialize pending checks on restore to do redelivery
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
R.I.Pienaar
92f00b31b1
correctly name pending and redelivery
2020-05-19 14:15:11 -07:00
R.I.Pienaar
e2a1b18de6
report observable config and observables count on message sets
2020-05-19 14:15:11 -07:00
Derek Collison
cfc31f7a15
Allow direct lookup of message from msgset
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
Derek Collison
b3b2feebc5
Include config in info for msgset
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
Zhenbang Wei
de781a291f
Fixed Memory() for Windows
2020-05-19 14:15:11 -07:00
Derek Collison
d5676e502c
Add ability to use remote servers
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
Derek Collison
ca5b58e27f
Bug fix for original replay with no initial interest, README updates
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
Derek Collison
bbdb61a4e1
Add ability to set storage directory
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
Derek Collison
c650b1bca3
API fix and rebase fix
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
Heine Andersen
543b304b3f
add long version to toggle on jetstream
2020-05-19 14:15:11 -07:00
Derek Collison
0d44a6150a
More debug info on startup and restore
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:15:11 -07:00
Derek Collison
e127039622
More API impls, tests for DeleteMsg
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:13:22 -07:00
Derek Collison
582282725d
bytes limit accounting
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:13:22 -07:00
Derek Collison
6b34d4e700
Remove deadlock, balance filestore perf
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:13:22 -07:00
Derek Collison
0c2d539b06
Remote request API
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:13:22 -07:00
Derek Collison
3c074ace4b
Changed Partition -> Subject
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:13:22 -07:00
Derek Collison
79b85ae385
Optimize for concurrent pub/sub
...
Signed-off-by: Derek Collison <derek@nats.io >
2020-05-19 14:13:22 -07:00