4b5987a085
Fix logic
2 years ago
cf3fa8eedb
Clearer runQueue logic
2 years ago
1877bcc7ff
Support keyed fetches of expvar information
2 years ago
98575d727b
Start adding remote remove node
...
More testing, including unit testing, required.
2 years ago
f9b46165f9
Comments
2 years ago
038812b4cb
Use standard library redaction functionality
2 years ago
9c68b13868
Better error from /nodes when Store is not open
2 years ago
5141eff5fc
test: use `T.TempDir` to create temporary test directory
...
This commit replaces `ioutil.TempDir` with `t.TempDir` in tests. The
directory created by `t.TempDir` is automatically removed when the test
and all its subtests complete.
Prior to this commit, temporary directory created using `ioutil.TempDir`
needs to be removed manually by calling `os.RemoveAll`, which is omitted
in some tests. The error handling boilerplate e.g.
defer func() {
if err := os.RemoveAll(dir); err != nil {
t.Fatal(err)
}
}
is also tedious, but `t.TempDir` handles this for us nicely.
Reference: https://pkg.go.dev/testing#T.TempDir
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2 years ago
3a261ce16e
Unit test remote load error handling
2 years ago
d6b8390658
Handle remote backup errors correctly
2 years ago
65cd556549
Fix remote-load error handling
...
Error from remote node was being dropped.
2 years ago
5a3c639164
Fix HTTP unit tests
2 years ago
5f33bffa0f
More logging and resolution checks
2 years ago
06e098e41a
Mostly better logging
2 years ago
eee9541545
Merge remote-tracking branch 'origin' into resolve-notifier
2 years ago
b0f17b86c7
Notified node checks address resolution
...
If a non-resolvable address is passed to the Store, and then Store then
adds that to the config, it can result in a cluster that seems to have
insufficient members (since the remote node can't be contacted). This
may trigger a new leader election.
2 years ago
9d9ffba7e2
Restoring via follower should have same response
2 years ago
b978e3857d
More HTTP-level testing of Load
2 years ago
27587634c6
Hook in HTTP layer
2 years ago
8a69aa53aa
HTTP-level unit testing of remote backup
2 years ago
31bba4c577
Move to Backup proto model
2 years ago
2d762202b3
Flatten some if blocks
2 years ago
221907f8a9
Support nil as paramterized values
2 years ago
95dfead226
Integrate SQL rewrite with rqlite for RANDOM ( #1046 )
2 years ago
7ccfbd93b2
Move to top-level use of cluster.Credentials
2 years ago
01c78ea8d0
Better remote auth fail HTTP messages
2 years ago
3afa2ce80a
Stick with simple proto
...
The proto was not well designed in the first place, but it's better to
deal with it as-is, and wait until another major release to fix it.
2 years ago
e4a810d7ea
Treat error from rpc response as a first class object, delineate error types a bit, use this data to check auth when forward from http
2 years ago
c0b1b6c762
write some tests, make them pass
2 years ago
19740954f6
Handle http responses for unauthorized in the same way as is currently done
2 years ago
79f631f6f0
Handle case where error is nil properly
2 years ago
2226083273
Implement handling of error unauthorized by client forwarding request to remote tcp service. Bubble this up as a 401 to the caller
2 years ago
7cceb822a4
First things
2 years ago
ae1f9b464f
No magic strings
2 years ago
d9b2e0b2fa
WIP creds forwarding
2 years ago
24786d2803
More Join unit tests
2 years ago
b703bc26ce
Unit test read-only join permission enforcement
2 years ago
c59adee7cb
Add Read-only join permission
2 years ago
66df343e85
Fix up Credential Store mock
2 years ago
0928d3ecad
Interfaces have to be checked for nil
2 years ago
ae27f5aee2
Copy nil credential store behaviour
2 years ago
d289da5feb
Refactor auth checking
2 years ago
288d97b241
Move Perm constants to auth package
...
Makes it cleaner to re-use them outside of HTTP package.
2 years ago
17a159cb88
Remove unnecessary interface call
2 years ago
d3bf2d719e
Use a single Response type for HTTP
2 years ago
bfe4f7fe68
Count number of queued waits
2 years ago
53f44f47e6
More testing
2 years ago
71b0a5a3bf
Support statement-less queue waits
2 years ago
05df9fa015
Fix lint issue
2 years ago
ecb640abff
Check that queue and transactions work
2 years ago
a7f5bafaca
Track queue sequence number at HTTP layer
2 years ago
0b47dff0b0
Godoc comments
2 years ago
3cfdc8b689
Support "wait" param on queued writes
2 years ago
64f7e05b0e
Support transactions from write queue
2 years ago
5e24af2636
Better API shape for queued Executes
2 years ago
5d047e7236
Fix copy 'n' paste errors
2 years ago
00874ebb44
Add queue stats
2 years ago
523f11ac0f
Fix more races
2 years ago
5c7aeda86b
Cluster-level test of queued writes
2 years ago
78657d1ce1
Fix race
2 years ago
24757559ca
Single-node system testing of queued writes
2 years ago
0e7f2bced3
Don't close closed channels
2 years ago
5e9cf86de8
Main queue configurable
2 years ago
88ec76398c
More robust HTTP shutdown
2 years ago
13b1444a8d
Configurable queue
2 years ago
02b8776c29
Start hooking in queuing to HTTP layer
2 years ago
e03cfd836d
Add Queue to HTTP layer
2 years ago
fd2eabc55d
Check length of SQLite file before offsetting
2 years ago
a6ac6bccfc
Autodetect data format during load operation
2 years ago
c8b9fd72da
Sanity check supplied SQLite data
2 years ago
89b132ac26
Fix Store-level unit tests
2 years ago
304124952c
Add Store level changes
...
Needs unit testing, and HTTP testing won't compile.
2 years ago
2dcf0169b3
Count number of /readyz and /status
3 years ago
33a69c8485
Merge branch 'master' of github.com:rqlite/rqlite into noleader-readyz
3 years ago
2a87de9b90
/readyz can skip leader check
3 years ago
cf2ad114fe
Add current time to status output
3 years ago
4c597e4f02
Better ready response
3 years ago
e4a0a5ecca
Possible help for racy (?) end-to-end test
3 years ago
e4fed0cee3
Add bootstrap-expect ( #974 )
...
Add cluster-boostrap
3 years ago
8f0f5f9ebc
Improve HTTP unit test
3 years ago
6b5cad6117
Remove useless comment
3 years ago
bc59144d2d
Fix HTTP unit test
3 years ago
3ad2b73155
Return a clearer response if no DB results
...
This shouldn't happen, but it might, this will allow the underlying
error to be returned to the caller. The body of the response will now
look something like:
{
"results": [],
"error": "some error",
"time": 0.021976516
}
3 years ago
860999951d
Enhance Authentication and Authorization system ( #940 )
3 years ago
3bfcbffc37
Fix typos and Grammar issues
3 years ago
4e7f202306
Fix up unit tests
3 years ago
cfe938412f
Better error codes
3 years ago
f440eedbe0
Use better function
3 years ago
a9748acdee
Help with better testing
3 years ago
cafbd02f0d
Simple named param parser unit test
3 years ago
7fc50b7b67
Add "name" support to command parameter
3 years ago
1a1f859b9a
Redirect HTTP / to /status
3 years ago
c14a918de5
Use better name for interface
3 years ago
2e7bf1c881
Even friendlier log message when start-up is done
3 years ago
e78e462ca5
ABL
3 years ago
83f02eecf3
Updates to readyz permission checking
3 years ago
5d88769e1e
Unit test readyz/ handler
3 years ago
1b915325f6
Add basic readyz handler
3 years ago
38f52694a0
nodes/ endpoint supports timeout
3 years ago
38eef8ee82
Merge pull request #890 from rqlite/more-abl
...
ABL
3 years ago
dd71c07c73
ABL
3 years ago
4e065872a1
Add OS state to status/ output
3 years ago
875c09d9ca
More improved responses on HTTP 500
3 years ago
0e50ab255d
Better HTTP logging during end-to-end tests
3 years ago
a74c182425
Add missing returns after HTTP errors
3 years ago
0b5df4b81d
HTTP layer uses timeout for GetNodeAPIAddr calls
3 years ago
0b5d80c604
Add Error information to nodes/ output
3 years ago
d45bdfed7f
System-level testing of nodes/
...
Fails right now because there is no way to actually shutdown the node
from answering cluster requests.
3 years ago
b58615fda8
Add response times to nodes/ output
3 years ago
9aecafedbe
Cluster client resolves advertised local address
...
Also, improve HTTP stats.
3 years ago
9130ed8b1f
Fix HTTP unit tests
3 years ago
a8d436e944
Improve stats
3 years ago
f1a7e7e8ec
Use locally-enabled cluster client in HTTP service
3 years ago
132c1809fe
Fix race condition
3 years ago
5613edd887
Fix connection pool stats
...
Also HTTP should read its own Raft address locally.
3 years ago
eee3a2e785
Fix code path that could cause panic
3 years ago
e6532bd11e
Add HTTP-level redirect and forward testing
3 years ago
6e17295913
Group network-related params together
3 years ago
4a28b311f1
Support cluster injection in HTTP unit tests
3 years ago
b01b10e4ce
Add convenience function for query params
3 years ago
0b8beb6a5d
Implmenet Request Forwarding timeout support
3 years ago
c017d11c22
Enable transparent request forwarding
3 years ago
d20c1ba311
Use correct variables in Query handler
3 years ago
1c6a7b49aa
Add support, but disable, request forwarding
...
Execute and Query only for now.
3 years ago
7c4f42d032
Fix HTTP unit tests
3 years ago
cc7cdb20d7
HTTP expects remote database calls
3 years ago
adc39168f2
Test for invalid Response
3 years ago
b50b14bdd5
Unit test Reponse JSON marshal
3 years ago
79ebb9a44a
Single-node tests pass
3 years ago
fd98114839
HTTP-level testing passes
3 years ago
503825dbaf
Remove Abort functionality
...
No longer relevant since each Exec and Query gets its own connection.
3 years ago
edc9f717e4
Always include "reachable" status
3 years ago
b6e0f46f30
Support non-voting nodes optionally in nodes/
3 years ago
58b567c27a
Only check non-voting nodes by default
3 years ago
a098f677c7
Tweaks and docs
3 years ago
4cff27f91f
Fix bugs in Goroutine logic
...
Testing never fails to produce results.
3 years ago
7218a40ed1
Cluster system test for nodes/
...
It's failing however.
3 years ago
0cca0dc603
Merge branch 'master' of github.com:rqlite/rqlite into other-node-status
3 years ago
dbd1c0a254
Remove 'redirect' from HTTP status
...
Getting the redirect information requires accessing other nodes, which
could block if those nodes are not up.
3 years ago
f4e04e5bc5
Check nodes reachable in parallel
3 years ago
805074f8f5
Start supporting /nodes endpoint
3 years ago
f939d33fe5
Remove Metadata concept from system
...
System testing passes.
3 years ago
78f39a082e
Fix HTTP unit tests
...
Add missing stub.
3 years ago
2cef5679b7
rqlited starts and stops fine
3 years ago
6a48068d78
Integrate Cluster service with HTTP service
3 years ago
f5cbc18a16
Add auth-ok and auth-fail events to stats
4 years ago
c4ee9cafd9
Disable TLS v1.0 and v1.1 by default
4 years ago
d560356d8d
Fix spelling mistakes
4 years ago
ab2338733c
Include more information with HTTP 500
4 years ago
f81d7e29d7
Enable http/2.0 support for TLS
...
As per https://blog.cloudflare.com/exposing-go-on-the-internet/
4 years ago
56cb9321d2
End-to-end test of idempotent join
4 years ago
e948d7410a
ABL
4 years ago
6575de779d
Use Protobuf for encoding Raft Log commands
...
This PR changes Raft Log Entry encoding from JSON to Protobuf. Furthermore, larger Raft commands (which can result from batching SQL statements, or individually long SQL statements) are compressed before encoding.
This primary reason for this change is to reduce IO load since that is one of the largest performance bottlenecks. It will also reduce internode traffic.
Legacy JSON-encoded commands are still handled by this code, so this change is backwards-compatible with previous releases in the v5 series.
4 years ago
1a3d46994d
Fix potential panic during request parsing
4 years ago
b4867713e4
Better variable name, Query -> SQL
4 years ago
7bb3b8850d
Support logging from writeResponse()
4 years ago
8c2ecb046d
Prepare some unit test for mixed params
4 years ago
9e1cb231b5
Unit test /backup returns redirect
4 years ago
d473e64246
Unit test backup/ endpoint
4 years ago
76358485a7
Explicitly handle "no leader" during backup
4 years ago
ee9f929735
ABL
4 years ago
f961bb4e44
Fix typos and comments
4 years ago
142180bbe6
Fix load API
...
It uses plain text, not JSON.
4 years ago
ac862e4091
Add system test for parameterized statements
...
Fix some bugs along the way too.
4 years ago
6e6f12fdd6
HTTP API now supports multi-format
...
If now supports an array of strings, as before, and also supports arrays
of arrays, where each inner array contains a statement, and parameters
for binding to that statement.
4 years ago
69cc93646d
More support for empty parsing
4 years ago
c9940ca9cf
Add Parser for multi-format HTTP requests
4 years ago
bbc8681b4d
Fix variable naming
4 years ago
b8ecc1b18e
go fmt
4 years ago
0d85f00b63
Test LeaderAPIAddr and LeaderAPIProto
...
To do this these functions needed to be made public.
4 years ago
031fcbbde1
Correct comment
4 years ago
fbdbee3e25
Include API proto in node meta
4 years ago
c6419cc62e
Check local HTTPS cert to enable HTTPS redirect
...
This assumes that if this node is using HTTPS, then all other nodes are.
This is required as per the documentation.
4 years ago
188981005f
Split out Queryable interface at Service level
4 years ago
e073a5f54f
Fix comment
5 years ago
cb0f88a022
Factor out credential check ( #624 )
5 years ago
abb7772105
Support leader freshness with None consistency
...
This change allows the read request to specify the maximum time the node
receiving the request may have last heard from the cluster leader. It
only applies to a read consistency selection of None.
5 years ago
81f5f6faf1
Add support for non-voting nodes
...
A non-voting node doesn't participate in Raft consensus, but does
subscribe to the committed log entries originating with the leader.
This means a non-voting node keeps up-to-date with the state machine,
without impacting write-latency. These non-voting nodes can provide
read scalability for the cluster.
5 years ago
1ffc3d566e
Add varadic functions to auth store
5 years ago
a23af88235
Write backup and dump files to a writer
...
This avoids making an extra copy in RAM. Port of original PR at
https://github.com/rqlite/rqlite/pull/461/ .
5 years ago
c69ef51790
Remove debug line
5 years ago
f57ace7da2
Broadcast Store meta via standard consensus
...
With this change the cluster metadata (arbitrary key-value data associated with each node) is now broadcast across the cluster using the standard consensus mechanism. Specifically the use case for this metadata is to allow all nodes know the HTTP API address of all other nodes, for the purpose of redirecting requests to the leader.
This change removed the need for multiplexing two logical connections
over the single Raft TCP connection, which greatly simplifies the
networking code generally.
Original PR https://github.com/rqlite/rqlite/pull/434
5 years ago
a6f8f060fb
Update CHANGELOG
5 years ago
e376812907
Add method to Store that returns leader ID
...
With the advent of Raft IDs, this distinction matters.
5 years ago
8a0e1ce8f0
Move to Hashicorp Raft v1
5 years ago
0e69be3949
Store layer supports generating SQL format backups
...
Port PR453.
5 years ago
0471877f26
Abort transaction if load operation fails
5 years ago
33f6f6bf8e
Move EnsureHTTPS into http module
5 years ago
de379a883c
When joining try HTTPS if HTTP fails
5 years ago
f01e6b1b0a
Server -http-ca-cert and -node-ca-cert options
...
The -http-ca-cert and -node-ca-cert options allow the user to specify
trusted X.509 root CA certificates as an alternative to the
-http-no-verify and -node-no-verify options. This behavior is analogous
to the rqlite client -ca-cert option.
5 years ago
efec4d4e42
Return redirect if remove on follower
...
Fixes issue #391 .
7 years ago
00d24ce06d
Reduce cyclo complexity
7 years ago
a0bf158111
Test 404 returned when Expvar and Pprof disabled
7 years ago
272792fbef
"status" permission required for Go runtime info
7 years ago
2a1b6c65c3
New QueryRequest and ExecuteRequest types
...
The Query() and Execute() functions on the Store now take a complex type
that encapsulates the statements, and associated parameters. This will
make it easier to add more control parameters when making requests.
7 years ago
9d480c17c3
Make read consistency param case-insensitive
7 years ago
0ae3347345
Unit test redirect
7 years ago
346e11cd88
Include query params with 301 redirect URL
7 years ago
5a6f344a7d
Don't always set Content-Type as JSON ( #334 )
...
Set Content-type for backup endpoint to "application/octet-stream".
7 years ago
d753a8f7be
HTTP service now supports registered statuses
...
Mux is first service to register status for serving.
7 years ago
Philip O'Toole
Eng Zer Jun
Neal Harrington
chermehdi
Zac Medico