71dcfb7efc
Fix server not exiting due to infinite `read_buf` loop
2 years ago
c065ed61e3
Add complete query parsing impl
2 years ago
c2ddb9b2db
Add more `read_usize` tests
2 years ago
dec82cd400
Add `read_line_pedantic` for non-empty lines
2 years ago
3731143831
Add tests with excess bytes
2 years ago
7f3d3cb05e
Add `usize` parsing
2 years ago
59c681e787
Fix `read_line` impl and tests
2 years ago
55a01b172c
Add tests for `read_until`
2 years ago
400ca13d10
Add tests for `not_exhausted`
2 years ago
a17d77bf9e
Fix tests
2 years ago
2c2a236501
Add parserv2 basic impl
2 years ago
7ab9bbe8e0
Upgrade deps
2 years ago
c984bd2e1b
Ensure Windows entity names are sanitized
3 years ago
df994cf4f7
Add `sys metric storage` for checking on-disk storage usage
3 years ago
d201c74150
Remove PID file just before exit
...
Also upgrade GHA caching dep and fix imports that rustfmt
messed up.
3 years ago
7a354a9acb
Improve server shutdown heuristic and fix Windows path evaluation
3 years ago
72304195d1
Use proc macro for correct compile-time response generation
3 years ago
2c6768dc12
Ensure snapshot overwrite protection if host time is incorrect
3 years ago
0e10f2cb5f
Fix remote snapshots with same names being overwritten
3 years ago
076282df2b
Add tests for snapshot directory structure
3 years ago
e5909eb1f9
Use separate flag for tree cleanup
3 years ago
9374404551
Add persist tests for keyspace creation/deletion
3 years ago
08cffa1d3f
Fix bug causing bgsave/termsig flush failure if a snapshot flushed it
...
I came across an interesting scenario that led to the discovery of this bug:
if a keyspace is created before a snapshot cycle and before termsig/bgsave,
and then the snapshot cycle runs, then the subsequent runs of bgsave/termsig
would fail. The reason behind this interesting bug turns out to be rather
trivial.
Since the `flush_full` routine, regardless of storage targets would untrip
the PRELOAD switch, the snapshot target as expected untrips the switch. Now,
this means that a tree re-init is not run by BGSAVE or save on termsig.
As a consequence, while attempting to run bgsave/save on termsig, the new
keyspace directories are not found, resulting in flush failure. This commit
fixes it my simply checking if the target should untrip the switch or not.
Tests for the same were added
3 years ago
c4eaf3d182
Bump version [skip ci]
3 years ago
5002fed675
Fix pipeline with pedantic execution for stages
3 years ago
5054adc33c
Add sys action tests
3 years ago
832da79e9d
Add sys actions
3 years ago
0283d91f67
Fix panic resulting from corrupted metadata in `PARTMAP`
3 years ago
0b17f7b0e4
Fix new instance detection
3 years ago
0e7340c965
Fix LF check in protocol impl
3 years ago
d57b0d98cf
Improve error reporting infrastructure
...
This commit greatly improves the error reporting infrastructure
all across the `skyd` crate. Now, every error has far more
context making it easier to debug and test while also providing
helpful feedback to users. This feedback can be extremely helpful
to find out offending files and fix them; for example, by being
specific about which file is corrupted or has bad metadata.
3 years ago
f9b997c1f1
Avoid verbose logging in test harness
3 years ago
cc6a1b7f27
Enable pushing multiple elements into list at once
3 years ago
14d9eb4bac
Clean up code
...
Fixed Windows tests and also applied recent clippy suggestions
3 years ago
cd1accd646
Simplify command assembly
3 years ago
6234018077
Wait for servers to start/shut down instead of waiting blindly
3 years ago
f40c1d00e5
Add `auth whoami`
3 years ago
82420e2013
Enable inspecting the current table
3 years ago
ced5e75182
Enable inspecting current keyspace
3 years ago
b099dd1825
Add missing respcode output impls
3 years ago
b057de94e6
Bump version to 0.7.4
3 years ago
90ef10a56d
Fix snapshot engine init failure
3 years ago
c80d929cf9
Ensure `AuthID`s are ASCII-only and add actiondoc for `listuser`
3 years ago
ad2f87de7a
Add `auth listuser` subaction
3 years ago
37ba222428
Upgrade deps
3 years ago
c7ae4b69e5
Add auth persistence tests
3 years ago
f446feaac6
Add persistence tests for lists
3 years ago
1dbba0c06e
Add persistence suite for keymap string table types
...
Also fixed persistence bug with tables in the `system` keyspace
3 years ago
14966f6972
Fix missing `system` ks on second boot of server
3 years ago
369f7b89ed
Enable table access using partial entity syntax
3 years ago
d30bc38fbe
Enable `auth restore` for anonymous users and add tests
3 years ago
482f4009db
Enable regenerating tokens and fix panic on wrong length `AuthID`
3 years ago
7dedb37a12
Fix auth error respstring lengths
3 years ago
97112c4b51
Add actiondoc for auth
3 years ago
5681e5ec53
Simplify `KVEngine` impl
3 years ago
3cbe7c981c
Ensure TLS-only mode in prod when authn is enabled
...
Also updated configuration template
3 years ago
426948f8d5
Upgrade deps
3 years ago
88955b62c6
Add changelog and remove unused code
3 years ago
f7a4281ed5
Add `auth` syntax checks
3 years ago
58b3f0dda7
Add authn tests
3 years ago
3c14501913
Simplify tests
3 years ago
f67057dfb5
Add authn tests
3 years ago
ade5b2a105
Enable authentication in dbtest tests
3 years ago
4a075422de
Enable using TLS on dbtest tests
3 years ago
e62fb74e81
Simplify dbtest macros
3 years ago
bb978e5a84
Simplify uninit array generation
...
The previous method used was a dirty hack due to limitations with
expressions in constant contexts, but the latest `rustc` lets
us greatly simplify this impl.
3 years ago
68e5e07450
Fix length checks in auth subactions
3 years ago
ff8bb08ab9
Fix `auth login` and `auth claim` impls for unauth connections
3 years ago
6db1667420
Enable auth to be configured
3 years ago
d70a42fd10
Fix tests
3 years ago
d6fed47eae
Implement `login`, `logout`, `claim` and `adduser` for `auth`
3 years ago
473f435638
Enable users to authenticate
3 years ago
2a91eab273
Add `ActionError` impls for `AuthError`
3 years ago
720764f5d2
Move system tables into separate namespace
3 years ago
21d0e0a2b6
Version gate the storage engine
3 years ago
ffce889c00
Improve bytemark save/restore tests
3 years ago
339e43928f
Add table restoration tests using bytemark
3 years ago
2cf4ec5e87
Fix unflush for volatile tables
3 years ago
380ba67cc6
Make unflush routines generic over keyspaces and tables
3 years ago
8a1bf4b400
Optimize table flush/unflush routines
3 years ago
6832c92775
Make flushing of keyspaces and tables generic over types
3 years ago
fa74a149b4
Fix tests
3 years ago
8d7126994d
Fix `LocalSnapshot` and `RemoteSnapshot` implementations
3 years ago
39726177cd
Simplify flush routines using `StorageTarget`
3 years ago
652ae8d2f0
Reduce duplication in strong action test impls
3 years ago
d5e53eede0
Reduce duplication in `DdlError` handling
3 years ago
750d054144
Don't unnecessarily obtain arc clones
3 years ago
5d9ef41c31
Fix length checks
...
Also improve panic messages in `dbtest` tests.
3 years ago
4c46ff3c2b
Simplify action error propagation
3 years ago
b59243eec1
Fix try_from_slice impl
3 years ago
31d4cbb34d
Enable login and add login tests
3 years ago
2fc77e0393
Use smaller size for random bytes
...
A sample space of 40 provides enough randomness so that the
likelihood of two tokens being the same is almost entirely
ruled out. And even if they are, it shouldn't be a problem
since they correspond to different accounts, although the
possibility itself is as good as impossible due to the
possible number of permutations being 8.560685103E+94, so
we can safely ignore this "risk".
40 is a sensible balance between what clients have to send
and the level of security we're expecting to provide, than
64 bytes.
3 years ago
c8ccfca09b
Implement `AuthProvider`
3 years ago
3a6083b3f1
Add `AuthProvider` definition
3 years ago
7285d63908
Simplify `Once` implementation
3 years ago
6ed994fe19
Add `Once` implementation
3 years ago
53d4c2b529
Use `TcpBackoff` in `SslListener` as well
3 years ago
d2e297e367
Use dedicated backoff algorithm for busy loops
...
Also use `util::exit_error` whenever possible to reduce
duplication.
3 years ago
57f05e9788
Simplify TCP backoff impl
3 years ago
96f817d31e
Simplify `resp` impls
...
The `RespCode` impl is no longer used, so it was removed.
3 years ago
e9620d0a8c
Release 0.7.3 ( #238 )
...
* Bump version
* Upgrade deps
3 years ago
49fae295d1
Simplify termination signal handling
...
Yeah, signal handling is not one of the best things to do, and it
definitely is one of the messiest things to do. This commit
simplifies the way we handle "termination signals" which can be
SIGTERM or SIGINT on POSIX-compliant systems or can be Ctrl+C
or Ctrl+Break on Windows systems; whenever we receive any of these,
we'll attempt to terminate the database server.
Now, instead of waiting for multiple futures to complete, we create
a different `TerminationSignal` type that is a `Future`, which on
polling checks whether either of the signals have been received
or closed. We return the poll state for either.
3 years ago
ed66e4f291
Decrement threshold on first call
3 years ago
0b87452b97
Listen to SIGTERM while in save-on-termsig retry loop
3 years ago
2d6d776edc
Cleanup code and ensure strong_count of `Corestore` is 1
...
I suppressed some lints, but all of them will be removed very
soon. (use a TODO finder or something to see what all need to
be removed)
3 years ago
33b0693fcb
Fix infinite loop on save failure during termination
3 years ago
9b296cbf9b
Bump version
3 years ago
c961548b01
Upgrade deps and bump version
3 years ago
e9369a40ef
Simplify recipes
3 years ago
0b54ea1cb3
Bump up version
3 years ago
b52f0d42ca
Fix tests
...
Also remove certs that were incorrectly added
3 years ago
2340a0239e
Add tests for list's range
3 years ago
4186eda627
Add range to lists
3 years ago
84134ed240
Remove `upgrade` subcommand and log on restore
...
The `upgrade` subcommand from `skyd` which was removed in 0.7, but was
erroneously accepted in the CLI parameters has been removed. This
was silently ignored.
3 years ago
36b02e9099
Fix backup restoration and simplify `arbiter::run`
3 years ago
d550e0d7a7
Expect `noart` in production mode
...
This might make one think that we are being outrageously strict,
but at the end of the day, it can help investigate crashes
or inspect logs without artwork all over the place.
Following some discussions, the `user` mode was renamed to `dev`
mode.
This commit also upgrades some deps, other than clap which has
deprecated yaml support (we will continue to use 2.x).
Finally, the CHANGELOG was updated.
3 years ago
46c048f855
Fix rlimit check on Windows
...
Windows (obviously) doesn't have libc's rlimit so simply avoid
any references to it
3 years ago
d121fa96fb
Enable config evaluation for prod mode
3 years ago
0d2a143e12
Fix warningstack_fmt test
3 years ago
d2d96e745e
Improve maxcon diagnostic
3 years ago
481509d927
Fix rlimit impl for 32-bit
3 years ago
6b54217fb2
Add production-mode setting evaluation
3 years ago
4325cf9065
Add method to check number of open files on unix-based systems
3 years ago
857e05529a
Add CLI config tests and improve diagnostic tests
3 years ago
59a67ba0c5
Add cfg file tests
3 years ago
53218ee98a
Add tests for types that implement `TryFromConfigSource`
3 years ago
647d6ce05c
Add tests for config impl
3 years ago
ce7d7bef25
Fix config change checks and error messages
3 years ago
86b9ac3dee
Switch to using new config framework
3 years ago
b46a5ac13f
Add method for chaining configuration sets
3 years ago
d820ef910d
Add config file impl using new config impl
3 years ago
afcd8031c2
Fix missing checks for server.noart and server.maxcon for CLI config
3 years ago
a48b3fd423
Rewrite CLI config using new config impl
3 years ago
3861a32c2e
Rewrite `cfgenv` using new config impl
3 years ago
d46d73301b
Add config impls for `bgsave`, `snapshot` and `ssl`
3 years ago
09afcd3e74
Add new config impl for server section
3 years ago
bd56ee2db5
Add `FeedbackStack`, `ErrorStack` and `WarningStack`
3 years ago
0b1ed6af6e
Add `ErrorStack` definition
3 years ago
85e789a1ee
Upgrade deps
3 years ago
2cdabfc43e
Automatically package Debian packages on release ( #235 )
...
* Add debian package generation
* Install cargo-deb on `make deb`
* Reload systemd daemon on postinst
* Add auto upload for Debian packages
* Consider using runner.os for simplicity
3 years ago
88a8095f42
Upgrade deps
3 years ago
c68d3ea3f4
Upgrade deps
...
All deps except for `clap` has been upgraded. Due to the removal of
the `args` field in `ArgMatches` in v3, and our dependence on the
field, we cannot upgrade to the latest version.
A PR has been created and once it is merged or a workaround
suggested, we can upgrade. (see clap-rs/clap#3265 )
3 years ago
1c16e43d3d
Upgrade deps
3 years ago
7c9058a02e
Upgrade deps
3 years ago
6800b5eb0a
Use native endian for testing
...
Add changelog
3 years ago
87f260d6b2
Support writing in native endian
3 years ago
c0497e4339
Support reading data from a different endian
3 years ago
50eb183f46
Upgrade deps
3 years ago
93d1004c80
Add changelog and switch to using rustc edition 2021
3 years ago
769378f7ce
Fix tests for `whereami`
3 years ago
1deac63fb9
Use typed non-null array for `whereami`
3 years ago
76f493753b
Add the `whereami` action ( #232 )
...
* Move macros into module
* Add the `whereami` action to identify the current entity
* Show entity group in the skysh prompt
* Add tests and actiondoc for `whereami`
* Add changelog entry
* Upgrade deps
3 years ago
ce8b6e2340
Disable caching on ARM64 CI
...
Caching only adds latency to the entire workflow, so we'll disable
it until GitHub fixes the issue with their caching on IPv6.
3 years ago
b63d90fa58
Add benches for skyd::protocol
...
This was added under the 'nightly' feature gate
3 years ago
9656d7d9f6
Upgrade deps
...
Also added changelog entry
3 years ago
cac9a9225f
Add a sanity test for errors in pipelines
3 years ago
048e79df2c
Fix pipeline impl and add basic pipeline tests
...
The pipeline impl had a bug which caused a parse error; this happened
because we directly wrote the length as an integer (with the tsymbol)
when we were supposed to only write the integer in its string form
to the stream. This was fixed.
Also, some preliminary tests were added for pipelines.
3 years ago
12db246725
Implement basic pipelines
...
Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
3 years ago
9b132f4351
Upgrade deps
...
Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
3 years ago
2814bdb151
Bump up version to 0.7.1
...
Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
3 years ago
90276e3ead
Upgrade deps
...
Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
3 years ago
18a0f557a0
Merge branch 'config/env' into next
3 years ago
374ba57133
Add support for environment variable configuration
...
Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
3 years ago
2387103c5c
Fix missing check for durations in config
...
Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
3 years ago
468b1460e4
Fix conflict check tests
...
Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
3 years ago
ef652befc9
Add env var `ConfigError` variant and rename ident
...
The `ParsedConfig` struct was renamed to `ConfigurationSet` because it
is more clear in contexts as parsing can be an ambiguous term in several
places.
Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
3 years ago
29a154f70e
Add tests for configuration conflict
...
Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
3 years ago
f56610123e
Fix check of host and port values in config file
...
43bef62a
3 years ago
9a6bf82408
Simplify configuration handling
...
The previous configuration handling was rather messed up,
which however is something that this commit attempts to
simplify.
The check for configuration conflict was resolved with a far
more feasible approach and the handling of CLI/config file
configuration was also simplified greatly.
Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
3 years ago
43bef62a9e
Simplify config generation from cfg file
...
Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
3 years ago
788b3073c0
Remove unnecessary use of `Box`
...
Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
3 years ago
b5a0e02091
Move config file de into module
...
This really helps us reduce the grand clutter we created earlier.
Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
3 years ago
a43e1183b3
Bump up version
3 years ago
eb037fcd62
Add basic `env` config module
3 years ago
4dbcce6e04
Upgrade deps
3 years ago
f85effc1c0
Fix empty list tests
3 years ago
2ee227a5dc
Add `lget last` and `lget first` tests
3 years ago
b368db2407
Add methods `FIRST` and `LAST`
3 years ago
b9c60b4cc7
Use ptr offsets for accesses to reduce bloat
3 years ago
ee78f9b1ce
Avoid excessive const inlining
...
Also removed unnecessary assembly bloat resulting from the generic index
accesses through (unck get)
3 years ago
c3d977c703
Simplify `lmod clear` return
3 years ago
a41fd7fa7f
Fix `lmod` bug resulting in return of wrong rcode
3 years ago
c34f241f2e
Fix encoding check in list actions
3 years ago
c5a58dec3d
Fix `is_empty` impl for `AnyArrayIter`
...
The impl was erroneously checking the base boxed slice for its length
when what we actually needed was the iter len (remainder).
3 years ago
e1ee9314f5
Add `is_empty` to `AnyArrayIter` for specificity
3 years ago
b34d059cd5
Add `Sync` trait bounds for ease with manual afns
3 years ago
f6b3f8dc5c
Simplify encoding checks across actions
...
This commit also removes the forceful `__private` module naming for the
`dbtest` proc macro. Supplied modules can now have any name.
3 years ago
c298f55b23
Use primitive casts to reduce jumps
3 years ago
f4fbdcae16
Fix encoding check correctness in actions
3 years ago
6fe3f53aa9
Use ptr offsets instead of index
3 years ago
947327f379
Simplify response writing/handling ( #222 )
...
* Use `BoolTable` to simplify resps
* Fix inversion of table
* Use BLUT and NLUT wherever possible
3 years ago
48ff6003af
Remove `keylen` and add `exists` and `del` tests
...
`keylen` checks the length of value for a given key. This cannot work
with listmaps
3 years ago
b930c5d31b
Add listmap compatibility to `keylen` and `lskeys`
3 years ago
68b9c9b81f
Add listmap compatibility with `exists`
3 years ago
8ba3cb8028
Add `del` compatibility with listmaps
3 years ago
ca77ca9f80
Add sanity tests for wrong-model error string
3 years ago
7246b14115
Add `lmod insert` tests
3 years ago
ed01c2fa82
Add `lmod remove` tests and fix `lget` tests
...
The error string length was incorrectly set causing the `lget` test to
fail
3 years ago
d0ee66ac4c
Add remaining `lget` tests and add `lmod` tests
3 years ago
ce99e974b9
Fix array extend impl ptr eq check
...
The end of allocation is reached when curptr > endptr
3 years ago
Sayan Nandan