917 Commits (7ecec7ffa67337270b835d2765a1f3688dd13c7e)

Author SHA1 Message Date
Sayan Nandan 9c15e100c8
Add metaframe methods to `ProtocolWrite` 2 years ago
Sayan Nandan 2bb7555e4e
Add `ProtocolWrite` trait for writing data according to `ProtocolSpec` 2 years ago
Sayan Nandan d31fc5855d
Add memory safety assertions 2 years ago
Sayan Nandan 02a3e9b4e9
Make connections generic over protocols 2 years ago
Sayan Nandan b2e130626f
Simplify types 2 years ago
Sayan Nandan 0e432e8761
Upgrade deps 2 years ago
Sayan Nandan 3b97c9528f
Remove redundant methods 2 years ago
Sayan Nandan 879e20f6ca
Upgrade all interfaces to use the new protocol 2 years ago
Sayan Nandan a018b76f40
Ensure empty payload is allowed
Bump Skytable driver git revision to ensure builds don't fail
(possibly a force push).
2 years ago
Sayan Nandan ec24b2caad
Fix segfault due to uninitialized elements in heap array 2 years ago
Sayan Nandan 3b918ff828
Add more tests 2 years ago
Sayan Nandan 71dcfb7efc
Fix server not exiting due to infinite `read_buf` loop 2 years ago
Sayan Nandan c065ed61e3
Add complete query parsing impl 2 years ago
Sayan Nandan c2ddb9b2db
Add more `read_usize` tests 2 years ago
Sayan Nandan dec82cd400
Add `read_line_pedantic` for non-empty lines 2 years ago
Sayan Nandan 3731143831
Add tests with excess bytes 2 years ago
Sayan Nandan 7f3d3cb05e
Add `usize` parsing 2 years ago
Sayan Nandan 59c681e787
Fix `read_line` impl and tests 2 years ago
Sayan Nandan 55a01b172c
Add tests for `read_until` 2 years ago
Sayan Nandan 400ca13d10
Add tests for `not_exhausted` 2 years ago
Sayan Nandan a17d77bf9e
Fix tests 2 years ago
Sayan Nandan 2c2a236501
Add parserv2 basic impl 2 years ago
Sayan Nandan 7ab9bbe8e0
Upgrade deps 2 years ago
Sayan Nandan c984bd2e1b
Ensure Windows entity names are sanitized 3 years ago
Sayan Nandan df994cf4f7
Add `sys metric storage` for checking on-disk storage usage 3 years ago
Sayan Nandan d201c74150
Remove PID file just before exit
Also upgrade GHA caching dep and fix imports that rustfmt
messed up.
3 years ago
Sayan Nandan 7a354a9acb
Improve server shutdown heuristic and fix Windows path evaluation 3 years ago
Sayan Nandan 72304195d1
Use proc macro for correct compile-time response generation 3 years ago
Sayan Nandan 2c6768dc12
Ensure snapshot overwrite protection if host time is incorrect 3 years ago
Sayan Nandan 0e10f2cb5f
Fix remote snapshots with same names being overwritten 3 years ago
Sayan Nandan 076282df2b
Add tests for snapshot directory structure 3 years ago
Sayan Nandan e5909eb1f9
Use separate flag for tree cleanup 3 years ago
Sayan Nandan 9374404551
Add persist tests for keyspace creation/deletion 3 years ago
Sayan Nandan 08cffa1d3f
Fix bug causing bgsave/termsig flush failure if a snapshot flushed it
I came across an interesting scenario that led to the discovery of this bug:
if a keyspace is created before a snapshot cycle and before termsig/bgsave,
and then the snapshot cycle runs, then the subsequent runs of bgsave/termsig
would fail. The reason behind this interesting bug turns out to be rather
trivial.

Since the `flush_full` routine, regardless of storage targets would untrip
the PRELOAD switch, the snapshot target as expected untrips the switch. Now,
this means that a tree re-init is not run by BGSAVE or save on termsig.
As a consequence, while attempting to run bgsave/save on termsig, the new
keyspace directories are not found, resulting in flush failure. This commit
fixes it my simply checking if the target should untrip the switch or not.

Tests for the same were added
3 years ago
Sayan Nandan c4eaf3d182
Bump version [skip ci] 3 years ago
Sayan Nandan 5002fed675
Fix pipeline with pedantic execution for stages 3 years ago
Sayan Nandan 5054adc33c
Add sys action tests 3 years ago
Sayan Nandan 832da79e9d
Add sys actions 3 years ago
Sayan Nandan 0283d91f67
Fix panic resulting from corrupted metadata in `PARTMAP` 3 years ago
Sayan Nandan 0b17f7b0e4
Fix new instance detection 3 years ago
Sayan Nandan 0e7340c965
Fix LF check in protocol impl 3 years ago
Sayan Nandan d57b0d98cf
Improve error reporting infrastructure
This commit greatly improves the error reporting infrastructure
all across the `skyd` crate. Now, every error has far more
context making it easier to debug and test while also providing
helpful feedback to users. This feedback can be extremely helpful
to find out offending files and fix them; for example, by being
specific about which file is corrupted or has bad metadata.
3 years ago
Sayan Nandan f9b997c1f1
Avoid verbose logging in test harness 3 years ago
Sayan Nandan cc6a1b7f27
Enable pushing multiple elements into list at once 3 years ago
Sayan Nandan 14d9eb4bac
Clean up code
Fixed Windows tests and also applied recent clippy suggestions
3 years ago
Sayan Nandan cd1accd646
Simplify command assembly 3 years ago
Sayan Nandan 6234018077
Wait for servers to start/shut down instead of waiting blindly 3 years ago
Sayan Nandan f40c1d00e5
Add `auth whoami` 3 years ago
Sayan Nandan 82420e2013
Enable inspecting the current table 3 years ago
Sayan Nandan ced5e75182
Enable inspecting current keyspace 3 years ago
Sayan Nandan b099dd1825
Add missing respcode output impls 3 years ago
Sayan Nandan b057de94e6
Bump version to 0.7.4 3 years ago
Sayan Nandan 90ef10a56d
Fix snapshot engine init failure 3 years ago
Sayan Nandan c80d929cf9
Ensure `AuthID`s are ASCII-only and add actiondoc for `listuser` 3 years ago
Sayan Nandan ad2f87de7a
Add `auth listuser` subaction 3 years ago
Sayan Nandan 37ba222428
Upgrade deps 3 years ago
Sayan Nandan c7ae4b69e5
Add auth persistence tests 3 years ago
Sayan Nandan f446feaac6
Add persistence tests for lists 3 years ago
Sayan Nandan 1dbba0c06e
Add persistence suite for keymap string table types
Also fixed persistence bug with tables in the `system` keyspace
3 years ago
Sayan Nandan 14966f6972
Fix missing `system` ks on second boot of server 3 years ago
Sayan Nandan 369f7b89ed
Enable table access using partial entity syntax 3 years ago
Sayan Nandan d30bc38fbe
Enable `auth restore` for anonymous users and add tests 3 years ago
Sayan Nandan 482f4009db
Enable regenerating tokens and fix panic on wrong length `AuthID` 3 years ago
Sayan Nandan 7dedb37a12
Fix auth error respstring lengths 3 years ago
Sayan Nandan 97112c4b51
Add actiondoc for auth 3 years ago
Sayan Nandan 5681e5ec53
Simplify `KVEngine` impl 3 years ago
Sayan Nandan 3cbe7c981c
Ensure TLS-only mode in prod when authn is enabled
Also updated configuration template
3 years ago
Sayan Nandan 426948f8d5
Upgrade deps 3 years ago
Sayan Nandan 88955b62c6
Add changelog and remove unused code 3 years ago
Sayan Nandan f7a4281ed5
Add `auth` syntax checks 3 years ago
Sayan Nandan 58b3f0dda7
Add authn tests 3 years ago
Sayan Nandan 3c14501913
Simplify tests 3 years ago
Sayan Nandan f67057dfb5
Add authn tests 3 years ago
Sayan Nandan ade5b2a105
Enable authentication in dbtest tests 3 years ago
Sayan Nandan 4a075422de
Enable using TLS on dbtest tests 3 years ago
Sayan Nandan e62fb74e81
Simplify dbtest macros 3 years ago
Sayan Nandan bb978e5a84
Simplify uninit array generation
The previous method used was a dirty hack due to limitations with
expressions in constant contexts, but the latest `rustc` lets
us greatly simplify this impl.
3 years ago
Sayan Nandan 68e5e07450
Fix length checks in auth subactions 3 years ago
Sayan Nandan ff8bb08ab9
Fix `auth login` and `auth claim` impls for unauth connections 3 years ago
Sayan Nandan 6db1667420
Enable auth to be configured 3 years ago
Sayan Nandan d70a42fd10
Fix tests 3 years ago
Sayan Nandan d6fed47eae
Implement `login`, `logout`, `claim` and `adduser` for `auth` 3 years ago
Sayan Nandan 473f435638
Enable users to authenticate 3 years ago
Sayan Nandan 2a91eab273
Add `ActionError` impls for `AuthError` 3 years ago
Sayan Nandan 720764f5d2
Move system tables into separate namespace 3 years ago
Sayan Nandan 21d0e0a2b6
Version gate the storage engine 3 years ago
Sayan Nandan ffce889c00
Improve bytemark save/restore tests 3 years ago
Sayan Nandan 339e43928f
Add table restoration tests using bytemark 3 years ago
Sayan Nandan 2cf4ec5e87
Fix unflush for volatile tables 3 years ago
Sayan Nandan 380ba67cc6
Make unflush routines generic over keyspaces and tables 3 years ago
Sayan Nandan 8a1bf4b400
Optimize table flush/unflush routines 3 years ago
Sayan Nandan 6832c92775
Make flushing of keyspaces and tables generic over types 3 years ago
Sayan Nandan fa74a149b4
Fix tests 3 years ago
Sayan Nandan 8d7126994d
Fix `LocalSnapshot` and `RemoteSnapshot` implementations 3 years ago
Sayan Nandan 39726177cd
Simplify flush routines using `StorageTarget` 3 years ago
Sayan Nandan 652ae8d2f0
Reduce duplication in strong action test impls 3 years ago
Sayan Nandan d5e53eede0
Reduce duplication in `DdlError` handling 3 years ago
Sayan Nandan 750d054144
Don't unnecessarily obtain arc clones 3 years ago
Sayan Nandan 5d9ef41c31
Fix length checks
Also improve panic messages in `dbtest` tests.
3 years ago
Sayan Nandan 4c46ff3c2b
Simplify action error propagation 3 years ago
Sayan Nandan b59243eec1
Fix try_from_slice impl 3 years ago
Sayan Nandan 31d4cbb34d
Enable login and add login tests 3 years ago
Sayan Nandan 2fc77e0393
Use smaller size for random bytes
A sample space of 40 provides enough randomness so that the
likelihood of two tokens being the same is almost entirely
ruled out. And even if they are, it shouldn't be a problem
since they correspond to different accounts, although the
possibility itself is as good as impossible due to the
possible number of permutations being 8.560685103E+94, so
we can safely ignore this "risk".

40 is a sensible balance between what clients have to send
and the level of security we're expecting to provide, than
64 bytes.
3 years ago
Sayan Nandan c8ccfca09b
Implement `AuthProvider` 3 years ago
Sayan Nandan 3a6083b3f1
Add `AuthProvider` definition 3 years ago
Sayan Nandan 7285d63908
Simplify `Once` implementation 3 years ago
Sayan Nandan 6ed994fe19
Add `Once` implementation 3 years ago
Sayan Nandan 53d4c2b529
Use `TcpBackoff` in `SslListener` as well 3 years ago
Sayan Nandan d2e297e367
Use dedicated backoff algorithm for busy loops
Also use `util::exit_error` whenever possible to reduce
duplication.
3 years ago
Sayan Nandan 57f05e9788
Simplify TCP backoff impl 3 years ago
Sayan Nandan 96f817d31e
Simplify `resp` impls
The `RespCode` impl is no longer used, so it was removed.
3 years ago
Sayan e9620d0a8c
Release 0.7.3 (#238)
* Bump version

* Upgrade deps
3 years ago
Sayan Nandan 49fae295d1
Simplify termination signal handling
Yeah, signal handling is not one of the best things to do, and it
definitely is one of the messiest things to do. This commit
simplifies the way we handle "termination signals" which can be
SIGTERM or SIGINT on POSIX-compliant systems or can be Ctrl+C
or Ctrl+Break on Windows systems; whenever we receive any of these,
we'll attempt to terminate the database server.

Now, instead of waiting for multiple futures to complete, we create
a different `TerminationSignal` type that is a `Future`, which on
polling checks whether either of the signals have been received
or closed. We return the poll state for either.
3 years ago
Sayan Nandan ed66e4f291
Decrement threshold on first call 3 years ago
Sayan Nandan 0b87452b97
Listen to SIGTERM while in save-on-termsig retry loop 3 years ago
Sayan Nandan 2d6d776edc
Cleanup code and ensure strong_count of `Corestore` is 1
I suppressed some lints, but all of them will be removed very
soon. (use a TODO finder or something to see what all need to
be removed)
3 years ago
Sayan Nandan 33b0693fcb
Fix infinite loop on save failure during termination 3 years ago
Sayan Nandan 9b296cbf9b
Bump version 3 years ago
Sayan Nandan c961548b01
Upgrade deps and bump version 3 years ago
Sayan Nandan e9369a40ef
Simplify recipes 3 years ago
Sayan Nandan 0b54ea1cb3
Bump up version 3 years ago
Sayan Nandan b52f0d42ca
Fix tests
Also remove certs that were incorrectly added
3 years ago
Sayan Nandan 2340a0239e
Add tests for list's range 3 years ago
Sayan Nandan 4186eda627
Add range to lists 3 years ago
Sayan Nandan 84134ed240
Remove `upgrade` subcommand and log on restore
The `upgrade` subcommand from `skyd` which was removed in 0.7, but was
erroneously accepted in the CLI parameters has been removed. This
was silently ignored.
3 years ago
Sayan Nandan 36b02e9099
Fix backup restoration and simplify `arbiter::run` 3 years ago
Sayan Nandan d550e0d7a7
Expect `noart` in production mode
This might make one think that we are being outrageously strict,
but at the end of the day, it can help investigate crashes
or inspect logs without artwork all over the place.

Following some discussions, the `user` mode was renamed to `dev`
mode.

This commit also upgrades some deps, other than clap which has
deprecated yaml support (we will continue to use 2.x).

Finally, the CHANGELOG was updated.
3 years ago
Sayan Nandan 46c048f855
Fix rlimit check on Windows
Windows (obviously) doesn't have libc's rlimit so simply avoid
any references to it
3 years ago
Sayan Nandan d121fa96fb
Enable config evaluation for prod mode 3 years ago
Sayan Nandan 0d2a143e12
Fix warningstack_fmt test 3 years ago
Sayan Nandan d2d96e745e
Improve maxcon diagnostic 3 years ago
Sayan Nandan 481509d927
Fix rlimit impl for 32-bit 3 years ago
Sayan Nandan 6b54217fb2
Add production-mode setting evaluation 3 years ago
Sayan Nandan 4325cf9065
Add method to check number of open files on unix-based systems 3 years ago
Sayan Nandan 857e05529a
Add CLI config tests and improve diagnostic tests 3 years ago
Sayan Nandan 59a67ba0c5
Add cfg file tests 3 years ago
Sayan Nandan 53218ee98a
Add tests for types that implement `TryFromConfigSource` 3 years ago
Sayan Nandan 647d6ce05c
Add tests for config impl 3 years ago
Sayan Nandan ce7d7bef25
Fix config change checks and error messages 3 years ago
Sayan Nandan 86b9ac3dee
Switch to using new config framework 3 years ago
Sayan Nandan b46a5ac13f
Add method for chaining configuration sets 3 years ago
Sayan Nandan d820ef910d
Add config file impl using new config impl 3 years ago
Sayan Nandan afcd8031c2
Fix missing checks for server.noart and server.maxcon for CLI config 3 years ago
Sayan Nandan a48b3fd423
Rewrite CLI config using new config impl 3 years ago
Sayan Nandan 3861a32c2e
Rewrite `cfgenv` using new config impl 3 years ago
Sayan Nandan d46d73301b
Add config impls for `bgsave`, `snapshot` and `ssl` 3 years ago
Sayan Nandan 09afcd3e74
Add new config impl for server section 3 years ago
Sayan Nandan bd56ee2db5
Add `FeedbackStack`, `ErrorStack` and `WarningStack` 3 years ago
Sayan Nandan 0b1ed6af6e
Add `ErrorStack` definition 3 years ago
Sayan Nandan 85e789a1ee
Upgrade deps 3 years ago