852 Commits (8bd886fad68bdaa4820b5fb32aa9bab98095b88a)

Author SHA1 Message Date
Sayan Nandan 3731143831
Add tests with excess bytes 2 years ago
Sayan Nandan 7f3d3cb05e
Add `usize` parsing 2 years ago
Sayan Nandan 59c681e787
Fix `read_line` impl and tests 2 years ago
Sayan Nandan 55a01b172c
Add tests for `read_until` 2 years ago
Sayan Nandan 400ca13d10
Add tests for `not_exhausted` 2 years ago
Sayan Nandan a17d77bf9e
Fix tests 2 years ago
Sayan Nandan 2c2a236501
Add parserv2 basic impl 2 years ago
Sayan Nandan 7ab9bbe8e0
Upgrade deps 2 years ago
Sayan Nandan c984bd2e1b
Ensure Windows entity names are sanitized 3 years ago
Sayan Nandan df994cf4f7
Add `sys metric storage` for checking on-disk storage usage 3 years ago
Sayan Nandan d201c74150
Remove PID file just before exit
Also upgrade GHA caching dep and fix imports that rustfmt
messed up.
3 years ago
Sayan Nandan 7a354a9acb
Improve server shutdown heuristic and fix Windows path evaluation 3 years ago
Sayan Nandan 72304195d1
Use proc macro for correct compile-time response generation 3 years ago
Sayan Nandan 2c6768dc12
Ensure snapshot overwrite protection if host time is incorrect 3 years ago
Sayan Nandan 0e10f2cb5f
Fix remote snapshots with same names being overwritten 3 years ago
Sayan Nandan 076282df2b
Add tests for snapshot directory structure 3 years ago
Sayan Nandan e5909eb1f9
Use separate flag for tree cleanup 3 years ago
Sayan Nandan 9374404551
Add persist tests for keyspace creation/deletion 3 years ago
Sayan Nandan 08cffa1d3f
Fix bug causing bgsave/termsig flush failure if a snapshot flushed it
I came across an interesting scenario that led to the discovery of this bug:
if a keyspace is created before a snapshot cycle and before termsig/bgsave,
and then the snapshot cycle runs, then the subsequent runs of bgsave/termsig
would fail. The reason behind this interesting bug turns out to be rather
trivial.

Since the `flush_full` routine, regardless of storage targets would untrip
the PRELOAD switch, the snapshot target as expected untrips the switch. Now,
this means that a tree re-init is not run by BGSAVE or save on termsig.
As a consequence, while attempting to run bgsave/save on termsig, the new
keyspace directories are not found, resulting in flush failure. This commit
fixes it my simply checking if the target should untrip the switch or not.

Tests for the same were added
3 years ago
Sayan Nandan c4eaf3d182
Bump version [skip ci] 3 years ago
Sayan Nandan 5002fed675
Fix pipeline with pedantic execution for stages 3 years ago
Sayan Nandan 5054adc33c
Add sys action tests 3 years ago
Sayan Nandan 832da79e9d
Add sys actions 3 years ago
Sayan Nandan 0283d91f67
Fix panic resulting from corrupted metadata in `PARTMAP` 3 years ago
Sayan Nandan 0b17f7b0e4
Fix new instance detection 3 years ago
Sayan Nandan 0e7340c965
Fix LF check in protocol impl 3 years ago
Sayan Nandan d57b0d98cf
Improve error reporting infrastructure
This commit greatly improves the error reporting infrastructure
all across the `skyd` crate. Now, every error has far more
context making it easier to debug and test while also providing
helpful feedback to users. This feedback can be extremely helpful
to find out offending files and fix them; for example, by being
specific about which file is corrupted or has bad metadata.
3 years ago
Sayan Nandan f9b997c1f1
Avoid verbose logging in test harness 3 years ago
Sayan Nandan cc6a1b7f27
Enable pushing multiple elements into list at once 3 years ago
Sayan Nandan 14d9eb4bac
Clean up code
Fixed Windows tests and also applied recent clippy suggestions
3 years ago
Sayan Nandan cd1accd646
Simplify command assembly 3 years ago
Sayan Nandan 6234018077
Wait for servers to start/shut down instead of waiting blindly 3 years ago
Sayan Nandan f40c1d00e5
Add `auth whoami` 3 years ago
Sayan Nandan 82420e2013
Enable inspecting the current table 3 years ago
Sayan Nandan ced5e75182
Enable inspecting current keyspace 3 years ago
Sayan Nandan b099dd1825
Add missing respcode output impls 3 years ago
Sayan Nandan b057de94e6
Bump version to 0.7.4 3 years ago
Sayan Nandan 90ef10a56d
Fix snapshot engine init failure 3 years ago
Sayan Nandan c80d929cf9
Ensure `AuthID`s are ASCII-only and add actiondoc for `listuser` 3 years ago
Sayan Nandan ad2f87de7a
Add `auth listuser` subaction 3 years ago
Sayan Nandan 37ba222428
Upgrade deps 3 years ago
Sayan Nandan c7ae4b69e5
Add auth persistence tests 3 years ago
Sayan Nandan f446feaac6
Add persistence tests for lists 3 years ago
Sayan Nandan 1dbba0c06e
Add persistence suite for keymap string table types
Also fixed persistence bug with tables in the `system` keyspace
3 years ago
Sayan Nandan 14966f6972
Fix missing `system` ks on second boot of server 3 years ago
Sayan Nandan 369f7b89ed
Enable table access using partial entity syntax 3 years ago
Sayan Nandan d30bc38fbe
Enable `auth restore` for anonymous users and add tests 3 years ago
Sayan Nandan 482f4009db
Enable regenerating tokens and fix panic on wrong length `AuthID` 3 years ago
Sayan Nandan 7dedb37a12
Fix auth error respstring lengths 3 years ago
Sayan Nandan 97112c4b51
Add actiondoc for auth 3 years ago
Sayan Nandan 5681e5ec53
Simplify `KVEngine` impl 3 years ago
Sayan Nandan 3cbe7c981c
Ensure TLS-only mode in prod when authn is enabled
Also updated configuration template
3 years ago
Sayan Nandan 426948f8d5
Upgrade deps 3 years ago
Sayan Nandan 88955b62c6
Add changelog and remove unused code 3 years ago
Sayan Nandan f7a4281ed5
Add `auth` syntax checks 3 years ago
Sayan Nandan 58b3f0dda7
Add authn tests 3 years ago
Sayan Nandan 3c14501913
Simplify tests 3 years ago
Sayan Nandan f67057dfb5
Add authn tests 3 years ago
Sayan Nandan ade5b2a105
Enable authentication in dbtest tests 3 years ago
Sayan Nandan 4a075422de
Enable using TLS on dbtest tests 3 years ago
Sayan Nandan e62fb74e81
Simplify dbtest macros 3 years ago
Sayan Nandan bb978e5a84
Simplify uninit array generation
The previous method used was a dirty hack due to limitations with
expressions in constant contexts, but the latest `rustc` lets
us greatly simplify this impl.
3 years ago
Sayan Nandan 68e5e07450
Fix length checks in auth subactions 3 years ago
Sayan Nandan ff8bb08ab9
Fix `auth login` and `auth claim` impls for unauth connections 3 years ago
Sayan Nandan 6db1667420
Enable auth to be configured 3 years ago
Sayan Nandan d70a42fd10
Fix tests 3 years ago
Sayan Nandan d6fed47eae
Implement `login`, `logout`, `claim` and `adduser` for `auth` 3 years ago
Sayan Nandan 473f435638
Enable users to authenticate 3 years ago
Sayan Nandan 2a91eab273
Add `ActionError` impls for `AuthError` 3 years ago
Sayan Nandan 720764f5d2
Move system tables into separate namespace 3 years ago
Sayan Nandan 21d0e0a2b6
Version gate the storage engine 3 years ago
Sayan Nandan ffce889c00
Improve bytemark save/restore tests 3 years ago
Sayan Nandan 339e43928f
Add table restoration tests using bytemark 3 years ago
Sayan Nandan 2cf4ec5e87
Fix unflush for volatile tables 3 years ago
Sayan Nandan 380ba67cc6
Make unflush routines generic over keyspaces and tables 3 years ago
Sayan Nandan 8a1bf4b400
Optimize table flush/unflush routines 3 years ago
Sayan Nandan 6832c92775
Make flushing of keyspaces and tables generic over types 3 years ago
Sayan Nandan fa74a149b4
Fix tests 3 years ago
Sayan Nandan 8d7126994d
Fix `LocalSnapshot` and `RemoteSnapshot` implementations 3 years ago
Sayan Nandan 39726177cd
Simplify flush routines using `StorageTarget` 3 years ago
Sayan Nandan 652ae8d2f0
Reduce duplication in strong action test impls 3 years ago
Sayan Nandan d5e53eede0
Reduce duplication in `DdlError` handling 3 years ago
Sayan Nandan 750d054144
Don't unnecessarily obtain arc clones 3 years ago
Sayan Nandan 5d9ef41c31
Fix length checks
Also improve panic messages in `dbtest` tests.
3 years ago
Sayan Nandan 4c46ff3c2b
Simplify action error propagation 3 years ago
Sayan Nandan b59243eec1
Fix try_from_slice impl 3 years ago
Sayan Nandan 31d4cbb34d
Enable login and add login tests 3 years ago
Sayan Nandan 2fc77e0393
Use smaller size for random bytes
A sample space of 40 provides enough randomness so that the
likelihood of two tokens being the same is almost entirely
ruled out. And even if they are, it shouldn't be a problem
since they correspond to different accounts, although the
possibility itself is as good as impossible due to the
possible number of permutations being 8.560685103E+94, so
we can safely ignore this "risk".

40 is a sensible balance between what clients have to send
and the level of security we're expecting to provide, than
64 bytes.
3 years ago
Sayan Nandan c8ccfca09b
Implement `AuthProvider` 3 years ago
Sayan Nandan 3a6083b3f1
Add `AuthProvider` definition 3 years ago
Sayan Nandan 7285d63908
Simplify `Once` implementation 3 years ago
Sayan Nandan 6ed994fe19
Add `Once` implementation 3 years ago
Sayan Nandan 53d4c2b529
Use `TcpBackoff` in `SslListener` as well 3 years ago
Sayan Nandan d2e297e367
Use dedicated backoff algorithm for busy loops
Also use `util::exit_error` whenever possible to reduce
duplication.
3 years ago
Sayan Nandan 57f05e9788
Simplify TCP backoff impl 3 years ago
Sayan Nandan 96f817d31e
Simplify `resp` impls
The `RespCode` impl is no longer used, so it was removed.
3 years ago
Sayan e9620d0a8c
Release 0.7.3 (#238)
* Bump version

* Upgrade deps
3 years ago
Sayan Nandan 49fae295d1
Simplify termination signal handling
Yeah, signal handling is not one of the best things to do, and it
definitely is one of the messiest things to do. This commit
simplifies the way we handle "termination signals" which can be
SIGTERM or SIGINT on POSIX-compliant systems or can be Ctrl+C
or Ctrl+Break on Windows systems; whenever we receive any of these,
we'll attempt to terminate the database server.

Now, instead of waiting for multiple futures to complete, we create
a different `TerminationSignal` type that is a `Future`, which on
polling checks whether either of the signals have been received
or closed. We return the poll state for either.
3 years ago
Sayan Nandan ed66e4f291
Decrement threshold on first call 3 years ago
Sayan Nandan 0b87452b97
Listen to SIGTERM while in save-on-termsig retry loop 3 years ago