1
0
Fork 0

386 Commits (248c66f251cbea10094c2074c6623a7955deb63f)

Author SHA1 Message Date
Mauri de Souza Meneguzzo 69933cbe35 aws: reuse session and S3 manager
The AWS session and s3 manager are concurrent safe, it should be reused
whenever possible:

    Sessions are safe to use concurrently as long as the Session is not
    being modified. Sessions should be cached when possible, because
    creating a new Session will load all configuration values from the
    environment, and config files each time the Session is created.

See https://pkg.go.dev/github.com/aws/aws-sdk-go/aws/session

Currently, an aws session and s3 client/manager are created every time a
call to Upload, CurrentID or Download is made. I changed it so it creates
one session and S3 manager during app startup and reuse it afterwards.
8 months ago
Philip O'Toole 4bb5e4b506 Remove superfluous log message 8 months ago
Philip O'Toole 45b03b4d54 Simpler help 8 months ago
Philip O'Toole ab5d37ac41 Help output 8 months ago
Philip O'Toole 9d2c698910 Initial implementation of automatic VACUUM 8 months ago
Philip O'Toole 78f4653b5b Change Raft default log level to WARN 8 months ago
Philip O'Toole 82e4b2cfe8 Minor cleanups 8 months ago
Philip O'Toole b27c3595b6 Add new Signal handling file 8 months ago
Philip O'Toole 6c19733b15 Handle signals early
https://app.circleci.com/pipelines/github/rqlite/rqlite/4318/workflows/8d25fe80-26d8-44ad-938c-bd470bb22f80/jobs/37210
8 months ago
Philip O'Toole aa2cf2dd46 Configure Store Provider 8 months ago
Philip O'Toole 0896e6e76d Only run auto-backups on Leader 9 months ago
Philip O'Toole dda26e2648
Merge pull request #1563 from jtackaberry/s3-path-style
Allow configurable S3 path style for auto backups
9 months ago
Philip O'Toole d5ea88d785 Final check for non-empty node 9 months ago
Jason Tackaberry e60a0b54fc
Allow configurable S3 path style for auto backups
AWS has deprecated the path-style URLs but it's required for some
S3-like alternatives such as Minio.
9 months ago
Philip O'Toole 26716d17e9 Dry up a suffrage variable 9 months ago
Philip O'Toole 81fda2aa26 Don't hardcode suffrage when joining 9 months ago
Philip O'Toole e700b03291 Push in read-only status
Similar to DNS autoclustering, the Store doesn't know its intended
read-only state.
9 months ago
Philip O'Toole 2cb7c19087 Correctly support read-only nodes with KV disco 9 months ago
Philip O'Toole b7892539ac E2E testing of DNS clustering with non-voters 9 months ago
Philip O'Toole 8e39b07eaf Tweak rqlited help message 9 months ago
Philip O'Toole 6fbd8627ff
Make the default WAL snap threshold 4MB
Bring this into line with standard SQLite WAL checkpoint threshold.

See https://www.sqlite.org/wal.html

"By default, SQLite does a checkpoint automatically when the WAL file reaches a threshold size of 1000 pages."
9 months ago
Philip O'Toole 914e0acd32 Reduce Raft snap check time to 10 seconds
With Raft snapping also triggerable by WAL size, I think it makes more
sense to check for the 16MB (default) WAL size more regularly.
9 months ago
Philip O'Toole 7c97fc4347 Support snaphotting on WAL size 9 months ago
Philip O'Toole fa90bb9187 Better log 9 months ago
Philip O'Toole 81e4e0c5ae Don't log join-checking unless necessary 9 months ago
Philip O'Toole c8edfa93dc Use new types with Joiner 9 months ago
Philip O'Toole 27710bab7e Bootstapper explicitly supports Voting nodes 9 months ago
Philip O'Toole 46bcdb7f23 Disco mode not supported when explicitly joining 9 months ago
Philip O'Toole 4c56c8299a Merge remote-tracking branch 'origin' into download-to-restore 9 months ago
Philip O'Toole 882f19df00 Move some downloading code to restore package 9 months ago
Philip O'Toole eda7496763 Better log message 9 months ago
Philip O'Toole 65ab53f23f Refactor some code out of main 9 months ago
Philip O'Toole 0155ef8aa0 Fix system testing 9 months ago
Philip O'Toole 3f658a7cd8 Cluster service just needs a net.Listener 9 months ago
Philip O'Toole 59467c232a Fix a log message related to mutual TLS 9 months ago
Philip O'Toole 6342460f9b Fix order of variables passed to rtls
If these had been typed, would have all been good.
9 months ago
Philip O'Toole ad916270d2 Bring go mod import path into compliance 9 months ago
Philip O'Toole f74ce18998 Correct help message related to joining 9 months ago
Philip O'Toole 551518be52 Remove http-no-verify command-line flag
It's been obsolete and ignored since 8.0 was released, because nodes now
join using the Raft port.
9 months ago
Philip O'Toole 58d6f1a260 More client-only use for ServerName 9 months ago
Philip O'Toole f41fb5de9e Node client comms only 9 months ago
Philip O'Toole 6dc05a99df Thread it through 9 months ago
Philip O'Toole e8edfd3186 Add command line flag -node-verify-server-name 9 months ago
Philip O'Toole 57342f8658 Log Join address checks
The log messages about "unsupported protocols" confused me, so this
should prevent it in the future.
9 months ago
Philip O'Toole 7e05f42fe3 Possible fix for racy uploader test
See https://app.circleci.com/pipelines/github/rqlite/rqlite/3648/workflows/d1235267-093d-4ac7-8d8d-061bc2ac9744/jobs/26157
9 months ago
Philip O'Toole 2eb5bc8344 Backup Raft snapshot threshold
Let's not make changes that haven't been fully tested.
10 months ago
Philip O'Toole b674d1a829 Reduce Raft threshold to 2048
This can now go lower, since Raft snapshotting is more efficient. The
upside is that few logs will need be replayed when a node restarts,
which will result in shorter startup times. We may be able to go even
lower -- Consul defaults to 1024.

The downside is more Snapshotting, which pauses the system during that
time. But the pause times should be very short.
10 months ago
Philip O'Toole dfb8a60c17 Move Store Provide to a distinct type 10 months ago
Philip O'Toole d45e1b0e6e Set credentials on Remover 10 months ago
Philip O'Toole 87ccc1f21a End-to-end testing of auth join 10 months ago