42 Commits (d626f9a302b76ee7d49693d612cc84215864a45c)

Author SHA1 Message Date
Sayan Nandan e4836fd7b3
Skip saving artifacts [skip ci]
This wastes unnecessary space on our current plan
2 years ago
Sayan Nandan d201c74150
Remove PID file just before exit
Also upgrade GHA caching dep and fix imports that rustfmt
messed up.
3 years ago
Sayan Nandan 6234018077
Wait for servers to start/shut down instead of waiting blindly 3 years ago
Sayan Nandan bf3b62c077
Switch to Windows Server 2019
This might have been causing issues

Also, avoid path expansion on msys
3 years ago
Sayan Nandan 5bdcd0eb12
Move ARM64 CI entirely to drone 3 years ago
Sayan Nandan ce8b6e2340
Disable caching on ARM64 CI
Caching only adds latency to the entire workflow, so we'll disable
it until GitHub fixes the issue with their caching on IPv6.
3 years ago
Sayan Nandan 18e8f74f0a Add new actiondoc
Also moved actiondoc rebuild to separate workflow
3 years ago
Sayan Nandan 0ee25814ea Enable colored output on CI
This greatly improves readability of the otherwise dull logs
3 years ago
Sayan Nandan 7b26488c38 Ensure that we install the required perl modules 3 years ago
Sayan Nandan bdfaf6ec4d Ensure that perl doesn't error 3 years ago
Sayan 3f0fc340c7
Add automated builds for ARM (#179)
* Move arm64 tests into test workflow

* Archive artifacts for arm64

* Fix missing target

* Add upload assets step

* Simplify packaging

* Use caching on ARM runners and remove is_md_file

Since GH now supports `skip ci`, we don't need this anymore

* Save artifacts for ARM64

* Simplify hashing condition

* Fix caching condition

* Use IPv6 for wget

* Don't use https for wget

* Add automatic release for ARM64
3 years ago
Sayan c2030d676e
Auto install any dependencies (#174) 3 years ago
Sayan 8bed8c9c2a
Use Makefile for builds (#172)
* Add makefile

* Use makefile for builds

* Fix start_server command on Windows

* Use `&` for backgrounding

Since mingw on Windows provides a bash shell, we can just use this

* Use `cmd` as shell for Windows builds

* Use `start` for backgrounding on Windows

* No need for chmod

* Specify target for server to start up

* Sleep to let the server start up

* Update build docs
3 years ago
Sayan 790558d2c7
Improve reliability, simplicity and recoverability of BGSAVE (#153)
* Create a new file on writing to flock-ed file

This fix is a very important one in two ways. Say we have an user A.
They go ahead and launch skyd. skyd creates a data.bin file. Now A just
deletes the data.bin file for fun. Funny enough, this never causes flock
to error!
Why? Well because the descriptor/handle is still valid and was just
unlinked from the current directory. But this might seem silly since
the user exits with a 'successfully saved notice' only to find that the
file never existed and all of their data was lost. That's bad.
There's a hidden problem in our current approach too, apart from this.
Our writing process begins by truncating the old file and then writing
to it by placing the cursor at 0. Nice, but what if this operation just
crashes. So we lost the current data AND the old data. Not good.

This commit does a better thing: it creates a new temporary file, locks
it before writing and then flushes the current data to the temporary
file. Once that succeeds, it replaces the old data.bin file with the
newly created file.

This solves both the problems mentioned here for us:
1. No more of the silly error
2. If BGSAVE crashes in between, we can be sure that at least the last
data.bin file is in proper shape and not half truncated or so.

This commit further moves the background services into their
own module(s) for easy management.

* Fix CI scripts

Fixes:
1. Our custom runner (drone/.ci.yml) was modified to kill the skyd
process once done since this pipeline is not ephemeral.
2. GHA for some reason ignores any error in the test step and proceeds
to kill the skyd process without erroring. Since GHA runners are
ephemeral, we don't need to do this manually.
3 years ago
Sayan Nandan 8d3d878b81 Build binary before attempting to run it
The background process may or may not complete before the testing begins
3 years ago
Sayan Nandan 34134aa29b Fix using old binary for testing on Windows 3 years ago
Sayan Nandan 53a0082890 Make sure skyd is killed after testing on Windows 3 years ago
Sayan Nandan 6b47279b1b Fix CI script and improve terminal artwork 3 years ago
Sayan Nandan bcca83c7ff Use single thread for all tests 3 years ago
Sayan Nandan 5d617eae84 Start the database server before running the tests 3 years ago
Sayan Nandan 3699cc4720
Add support for MUSL x86_64 and fix CI scripts (#145) 3 years ago
Sayan Nandan 379660f14c
Add testing for new Tier 1 targets (#135)
* Add support for new T1 platforms

This commit adds support for the following Tier-1 (T1) platforms:
- i686-unknown-linux-gnu
- i686-pc-windows-msvc

* Fix channel and add explicit target in cargo test

* Use `target add` to add $matrix.rust target

* Use actions-rs/toolchain to install rust

* Install musl-tools to test musl

* Simplify matrix

* Add 32-bit targets and refactor workflow

* Fix build matrix

* Explicitly specify target in cargo test

* Use rustup to install toolchain

* Install 32 bit tools on Linux

* Remove ports in [49000,50000] on Windows
3 years ago
Sayan Nandan f379807365 Disable high port blocking 3 years ago
Sayan Nandan f151927f8a Add crt-static to RUSTFLAGS for Windows 3 years ago
Sayan Nandan 70ca5c143c Enable artifact generation on every commit 3 years ago
Sayan Nandan 32f76e3964
Update usage of `add-path` to use $GITHUB_PATH
Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
4 years ago
Sayan Nandan 9543ac3a1e
Use GNU tar instead of BSD tar for macOS caching
The discussion from #115 should explain a few things

Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
4 years ago
Sayan Nandan 740ba03ecc
Upgrade deps and remove caching on macOS again
Closes #113 and closes #114

Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
4 years ago
Sayan Nandan a9f3d082b9
Restore caching on macOS runners
Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
4 years ago
Sayan Nandan d7fbf0e10e
Perl setup is no longer required
As per the runner docs Perl is already installed on the runners.
This is why explicit setup is not required.

Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
4 years ago
Sayan Nandan ce46e318f1
Fix Windows builds by defaulting to `cmd` (#104)
Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
4 years ago
Sayan Nandan f68b8f26a2
Skip builds on pushes to tags
There's no point of running tests on tags since we only create tags
after the build for the corresponding commit has succeeded.

Signed-off-by: Sayan Nandan <nandansayan@outlook.com>
4 years ago
Sayan Nandan 3d1dd04b0d
Improved testing to use custom compiler macros
Also, multi-threaded tests were re-enabled
4 years ago
Sayan 16304cc4f7 Use bash as the default shell in `test-push` 4 years ago
Sayan Nandan 2a9fa9ffcf Fix script to skip builds iff md files are changed
In previous commits, we ignored the fact that bools are strings in bash
This caused the workflow to proceed wrongly and this commit fixes that
Also, auto builds for actions docs were added
4 years ago
Sayan Nandan 336115e493
Fix builds on macOS 4 years ago
Sayan Nandan 0468d0d921
Fix environment variables 4 years ago
Sayan d3e37cfa55
Fix CI script 4 years ago
Sayan Nandan 207b5e58d1
Fix push script 4 years ago
Sayan Nandan f5b91fdc18
Fix `test-push` script 4 years ago
Sayan Nandan 8c678a58e3
Skip builds iff markdown files are modified 4 years ago
Sayan Nandan 896b04e665
Use separate actions for PR and Push
This will enable us to use automation for builds in the future
With separate jobs for a PR and a push, we can avoid insecure operations
These operations may be triggered by malicious users sending 'bad' PRs
4 years ago