a7f5bafaca
Track queue sequence number at HTTP layer
2 years ago
0b47dff0b0
Godoc comments
2 years ago
3cfdc8b689
Support "wait" param on queued writes
2 years ago
64f7e05b0e
Support transactions from write queue
2 years ago
5e24af2636
Better API shape for queued Executes
2 years ago
5d047e7236
Fix copy 'n' paste errors
2 years ago
00874ebb44
Add queue stats
2 years ago
523f11ac0f
Fix more races
2 years ago
5c7aeda86b
Cluster-level test of queued writes
2 years ago
78657d1ce1
Fix race
2 years ago
24757559ca
Single-node system testing of queued writes
2 years ago
0e7f2bced3
Don't close closed channels
2 years ago
5e9cf86de8
Main queue configurable
2 years ago
88ec76398c
More robust HTTP shutdown
2 years ago
13b1444a8d
Configurable queue
2 years ago
02b8776c29
Start hooking in queuing to HTTP layer
2 years ago
e03cfd836d
Add Queue to HTTP layer
2 years ago
fd2eabc55d
Check length of SQLite file before offsetting
2 years ago
a6ac6bccfc
Autodetect data format during load operation
2 years ago
c8b9fd72da
Sanity check supplied SQLite data
2 years ago
89b132ac26
Fix Store-level unit tests
2 years ago
304124952c
Add Store level changes
...
Needs unit testing, and HTTP testing won't compile.
2 years ago
2dcf0169b3
Count number of /readyz and /status
3 years ago
33a69c8485
Merge branch 'master' of github.com:rqlite/rqlite into noleader-readyz
3 years ago
2a87de9b90
/readyz can skip leader check
3 years ago
cf2ad114fe
Add current time to status output
3 years ago
4c597e4f02
Better ready response
3 years ago
e4a0a5ecca
Possible help for racy (?) end-to-end test
3 years ago
e4fed0cee3
Add bootstrap-expect ( #974 )
...
Add cluster-boostrap
3 years ago
8f0f5f9ebc
Improve HTTP unit test
3 years ago
6b5cad6117
Remove useless comment
3 years ago
bc59144d2d
Fix HTTP unit test
3 years ago
3ad2b73155
Return a clearer response if no DB results
...
This shouldn't happen, but it might, this will allow the underlying
error to be returned to the caller. The body of the response will now
look something like:
{
"results": [],
"error": "some error",
"time": 0.021976516
}
3 years ago
860999951d
Enhance Authentication and Authorization system ( #940 )
3 years ago
3bfcbffc37
Fix typos and Grammar issues
3 years ago
4e7f202306
Fix up unit tests
3 years ago
cfe938412f
Better error codes
3 years ago
f440eedbe0
Use better function
3 years ago
a9748acdee
Help with better testing
3 years ago
cafbd02f0d
Simple named param parser unit test
3 years ago
7fc50b7b67
Add "name" support to command parameter
3 years ago
1a1f859b9a
Redirect HTTP / to /status
3 years ago
c14a918de5
Use better name for interface
3 years ago
2e7bf1c881
Even friendlier log message when start-up is done
3 years ago
e78e462ca5
ABL
3 years ago
83f02eecf3
Updates to readyz permission checking
3 years ago
5d88769e1e
Unit test readyz/ handler
3 years ago
1b915325f6
Add basic readyz handler
3 years ago
38f52694a0
nodes/ endpoint supports timeout
3 years ago
38eef8ee82
Merge pull request #890 from rqlite/more-abl
...
ABL
3 years ago
dd71c07c73
ABL
3 years ago
4e065872a1
Add OS state to status/ output
3 years ago
875c09d9ca
More improved responses on HTTP 500
3 years ago
0e50ab255d
Better HTTP logging during end-to-end tests
3 years ago
a74c182425
Add missing returns after HTTP errors
3 years ago
0b5df4b81d
HTTP layer uses timeout for GetNodeAPIAddr calls
3 years ago
0b5d80c604
Add Error information to nodes/ output
3 years ago
d45bdfed7f
System-level testing of nodes/
...
Fails right now because there is no way to actually shutdown the node
from answering cluster requests.
3 years ago
b58615fda8
Add response times to nodes/ output
3 years ago
9aecafedbe
Cluster client resolves advertised local address
...
Also, improve HTTP stats.
3 years ago
9130ed8b1f
Fix HTTP unit tests
3 years ago
a8d436e944
Improve stats
3 years ago
f1a7e7e8ec
Use locally-enabled cluster client in HTTP service
3 years ago
132c1809fe
Fix race condition
3 years ago
5613edd887
Fix connection pool stats
...
Also HTTP should read its own Raft address locally.
3 years ago
eee3a2e785
Fix code path that could cause panic
3 years ago
e6532bd11e
Add HTTP-level redirect and forward testing
3 years ago
6e17295913
Group network-related params together
3 years ago
4a28b311f1
Support cluster injection in HTTP unit tests
3 years ago
b01b10e4ce
Add convenience function for query params
3 years ago
0b8beb6a5d
Implmenet Request Forwarding timeout support
3 years ago
c017d11c22
Enable transparent request forwarding
3 years ago
d20c1ba311
Use correct variables in Query handler
3 years ago
1c6a7b49aa
Add support, but disable, request forwarding
...
Execute and Query only for now.
3 years ago
7c4f42d032
Fix HTTP unit tests
3 years ago
cc7cdb20d7
HTTP expects remote database calls
3 years ago
adc39168f2
Test for invalid Response
3 years ago
b50b14bdd5
Unit test Reponse JSON marshal
3 years ago
79ebb9a44a
Single-node tests pass
3 years ago
fd98114839
HTTP-level testing passes
3 years ago
503825dbaf
Remove Abort functionality
...
No longer relevant since each Exec and Query gets its own connection.
3 years ago
edc9f717e4
Always include "reachable" status
3 years ago
b6e0f46f30
Support non-voting nodes optionally in nodes/
3 years ago
58b567c27a
Only check non-voting nodes by default
3 years ago
a098f677c7
Tweaks and docs
3 years ago
4cff27f91f
Fix bugs in Goroutine logic
...
Testing never fails to produce results.
3 years ago
7218a40ed1
Cluster system test for nodes/
...
It's failing however.
3 years ago
0cca0dc603
Merge branch 'master' of github.com:rqlite/rqlite into other-node-status
3 years ago
dbd1c0a254
Remove 'redirect' from HTTP status
...
Getting the redirect information requires accessing other nodes, which
could block if those nodes are not up.
3 years ago
f4e04e5bc5
Check nodes reachable in parallel
3 years ago
805074f8f5
Start supporting /nodes endpoint
3 years ago
f939d33fe5
Remove Metadata concept from system
...
System testing passes.
3 years ago
78f39a082e
Fix HTTP unit tests
...
Add missing stub.
3 years ago
2cef5679b7
rqlited starts and stops fine
3 years ago
6a48068d78
Integrate Cluster service with HTTP service
3 years ago
f5cbc18a16
Add auth-ok and auth-fail events to stats
4 years ago
c4ee9cafd9
Disable TLS v1.0 and v1.1 by default
4 years ago
d560356d8d
Fix spelling mistakes
4 years ago
ab2338733c
Include more information with HTTP 500
4 years ago
f81d7e29d7
Enable http/2.0 support for TLS
...
As per https://blog.cloudflare.com/exposing-go-on-the-internet/
4 years ago
56cb9321d2
End-to-end test of idempotent join
4 years ago
e948d7410a
ABL
4 years ago
6575de779d
Use Protobuf for encoding Raft Log commands
...
This PR changes Raft Log Entry encoding from JSON to Protobuf. Furthermore, larger Raft commands (which can result from batching SQL statements, or individually long SQL statements) are compressed before encoding.
This primary reason for this change is to reduce IO load since that is one of the largest performance bottlenecks. It will also reduce internode traffic.
Legacy JSON-encoded commands are still handled by this code, so this change is backwards-compatible with previous releases in the v5 series.
4 years ago
1a3d46994d
Fix potential panic during request parsing
4 years ago
b4867713e4
Better variable name, Query -> SQL
4 years ago
7bb3b8850d
Support logging from writeResponse()
4 years ago
8c2ecb046d
Prepare some unit test for mixed params
4 years ago
9e1cb231b5
Unit test /backup returns redirect
4 years ago
d473e64246
Unit test backup/ endpoint
4 years ago
76358485a7
Explicitly handle "no leader" during backup
4 years ago
ee9f929735
ABL
4 years ago
f961bb4e44
Fix typos and comments
4 years ago
142180bbe6
Fix load API
...
It uses plain text, not JSON.
4 years ago
ac862e4091
Add system test for parameterized statements
...
Fix some bugs along the way too.
4 years ago
6e6f12fdd6
HTTP API now supports multi-format
...
If now supports an array of strings, as before, and also supports arrays
of arrays, where each inner array contains a statement, and parameters
for binding to that statement.
4 years ago
69cc93646d
More support for empty parsing
4 years ago
c9940ca9cf
Add Parser for multi-format HTTP requests
4 years ago
bbc8681b4d
Fix variable naming
4 years ago
b8ecc1b18e
go fmt
4 years ago
0d85f00b63
Test LeaderAPIAddr and LeaderAPIProto
...
To do this these functions needed to be made public.
4 years ago
031fcbbde1
Correct comment
4 years ago
fbdbee3e25
Include API proto in node meta
4 years ago
c6419cc62e
Check local HTTPS cert to enable HTTPS redirect
...
This assumes that if this node is using HTTPS, then all other nodes are.
This is required as per the documentation.
4 years ago
188981005f
Split out Queryable interface at Service level
4 years ago
e073a5f54f
Fix comment
5 years ago
cb0f88a022
Factor out credential check ( #624 )
5 years ago
abb7772105
Support leader freshness with None consistency
...
This change allows the read request to specify the maximum time the node
receiving the request may have last heard from the cluster leader. It
only applies to a read consistency selection of None.
5 years ago
81f5f6faf1
Add support for non-voting nodes
...
A non-voting node doesn't participate in Raft consensus, but does
subscribe to the committed log entries originating with the leader.
This means a non-voting node keeps up-to-date with the state machine,
without impacting write-latency. These non-voting nodes can provide
read scalability for the cluster.
5 years ago
1ffc3d566e
Add varadic functions to auth store
5 years ago
a23af88235
Write backup and dump files to a writer
...
This avoids making an extra copy in RAM. Port of original PR at
https://github.com/rqlite/rqlite/pull/461/ .
5 years ago
c69ef51790
Remove debug line
5 years ago
f57ace7da2
Broadcast Store meta via standard consensus
...
With this change the cluster metadata (arbitrary key-value data associated with each node) is now broadcast across the cluster using the standard consensus mechanism. Specifically the use case for this metadata is to allow all nodes know the HTTP API address of all other nodes, for the purpose of redirecting requests to the leader.
This change removed the need for multiplexing two logical connections
over the single Raft TCP connection, which greatly simplifies the
networking code generally.
Original PR https://github.com/rqlite/rqlite/pull/434
5 years ago
a6f8f060fb
Update CHANGELOG
5 years ago
e376812907
Add method to Store that returns leader ID
...
With the advent of Raft IDs, this distinction matters.
5 years ago
8a0e1ce8f0
Move to Hashicorp Raft v1
5 years ago
0e69be3949
Store layer supports generating SQL format backups
...
Port PR453.
5 years ago
0471877f26
Abort transaction if load operation fails
5 years ago
33f6f6bf8e
Move EnsureHTTPS into http module
5 years ago
de379a883c
When joining try HTTPS if HTTP fails
5 years ago
f01e6b1b0a
Server -http-ca-cert and -node-ca-cert options
...
The -http-ca-cert and -node-ca-cert options allow the user to specify
trusted X.509 root CA certificates as an alternative to the
-http-no-verify and -node-no-verify options. This behavior is analogous
to the rqlite client -ca-cert option.
5 years ago
efec4d4e42
Return redirect if remove on follower
...
Fixes issue #391 .
7 years ago
00d24ce06d
Reduce cyclo complexity
7 years ago
a0bf158111
Test 404 returned when Expvar and Pprof disabled
7 years ago
272792fbef
"status" permission required for Go runtime info
7 years ago
2a1b6c65c3
New QueryRequest and ExecuteRequest types
...
The Query() and Execute() functions on the Store now take a complex type
that encapsulates the statements, and associated parameters. This will
make it easier to add more control parameters when making requests.
7 years ago
9d480c17c3
Make read consistency param case-insensitive
7 years ago
0ae3347345
Unit test redirect
7 years ago
346e11cd88
Include query params with 301 redirect URL
7 years ago
5a6f344a7d
Don't always set Content-Type as JSON ( #334 )
...
Set Content-type for backup endpoint to "application/octet-stream".
7 years ago
d753a8f7be
HTTP service now supports registered statuses
...
Mux is first service to register status for serving.
7 years ago
982fa54030
Not all queries begin with SELECT so pull check
...
Common Table Expressions can begin with WITH. This check was always dubious.
8 years ago
e6f428fcd8
Convert magic string to const
8 years ago
2c8922b50b
Standardize load endpoint processing
8 years ago
9e87a3ba30
Add new perm for loading SQLite dump file
...
This was missed in previous releases.
8 years ago
5ed6ef0ae8
Covert dumps to queries in HTTP service
...
There is no need for special logic at the Store level.
8 years ago
210367b51b
Fix call to Load()
8 years ago
36368d6786
Start removing batch load
8 years ago
68793cfcbb
Use a transaction for loaded batch
...
Bump the batch size to 1000 too.
8 years ago
6270744584
Correct batch size variable name
8 years ago
12482c682d
const out loader batch size
8 years ago
88eb56e431
Service now uses load batch of 100
8 years ago
31560160a1
Check FK state before load
8 years ago
3286bf064d
Start adding load-from-dump
8 years ago
4d36690eea
Unit test "Content-type" HTTP header
8 years ago
5b4b1e3567
Set Content-type "application/json" on responses
8 years ago
729221bf57
join endpoint returns HTTP 301 if necessary
8 years ago
0198e31cbf
Refactor adding build version to HTTP response
8 years ago
1152886216
Reduce Go cyclo complexity
8 years ago
54cbd025e1
'go lint' fixes
8 years ago
354c9588b9
Remove useless comment
8 years ago
bc60aa755d
At least log any failure from HTTP Serve()
8 years ago
9a0b9bcafe
Update service.go
8 years ago
4b36f313ec
Check unknown version support in HTTP
8 years ago
1b6bdffd33
Add rqlite version to each HTTP response
8 years ago
6f4814a4c3
Support pprof information over HTTP
8 years ago
918a3200dd
Correct method for removal of node
8 years ago
45427e82ad
More Service route unit tests
8 years ago
0aff83dea8
Ensure the correct HTTP methods on endpoints
8 years ago
de6cc9ce12
Log full error on join failure
8 years ago
37195abcf4
Expose /remove endpoint on HTTPD service
8 years ago
3f467c6590
Merge pull request #129 from rqlite/force_select
...
Check that queries begin with SELECT
8 years ago
9a36f4867a
Check if queries start with SELECT
8 years ago
8d7644f55a
More 'go lint' fixes
8 years ago
bf2047b45b
'go lint' fixes
8 years ago
349300b743
Add Go runtime info to status output
9 years ago
315439cc7f
Fill our API peers lookups ( #111 )
...
* Fill our API peers lookups
* Complete leader-redirection
* Handle no leader for redirect
9 years ago
c04ff92d7a
Fill our API peers lookups ( #110 )
9 years ago
434116a704
Move to permanent redirects for leaders
9 years ago
78f652fcc2
Enable leader redirection
...
Not quite complete.
9 years ago
fac48629bc
Start initial integration of mux ( #109 )
...
Integrate TCP mux with cluster and store
This change allows any node, including followers, to use the Raft log to make changes to a cluster-wide state.
9 years ago
5aefda9983
Move to new rqlite org
9 years ago
75ee23bdd9
Move URL normalization to http package
...
This function may be useful for leader-redirection.
9 years ago
659be46190
Add build time to status output
9 years ago
24b326685d
Unit test 401 logic
9 years ago
bc6275a759
Tweak comment for New HTTPD service
9 years ago
ad0b6f3b4d
GoDoc fixes
9 years ago
4c36f8345c
Create standalone auth module
9 years ago
6b339284f8
Fix GoDoc typos
9 years ago
511d2039c3
Fix "auth enabled" status logic
9 years ago
559472cd9f
Add "auth" state to status output
9 years ago
5a01ffcda9
Return if username and password are invalid
9 years ago
5cbeecddf5
'go fmt' fixes
9 years ago
c1ad8c8ec1
Allow auth config to be set at command line
9 years ago
817cc2abc7
Integrate perms with HTTP service
9 years ago
473d6e1979
'go fmt' fixes
9 years ago
1262244b6a
'go vet' fixes
9 years ago
e638efe9cf
HasPermRequest added
9 years ago
d92126a861
Add CredentialStore GoDoc
9 years ago
49baa83ceb
CredentialStore now stores perms
9 years ago
90b5a79720
Check BasicAuth if enabled
9 years ago
58887947c5
Credentials store can directly check a request
9 years ago
3bfadcfbe7
Add simple credentials store
9 years ago
f23cd8ef9c
Support HTTPS API
...
API can now be secured with X.509 certficate and key.
9 years ago
196e5c405f
Comment corrections
9 years ago
fa8c9b20c2
Add build information to status output
9 years ago
5f5a666a06
Move to "weak" and "strong" for consistency levels
9 years ago
ec3af02ba5
Basic HTTP stats to expvar
9 years ago
076a996a8b
Support expvar data
9 years ago
7bf9b32425
Removed unused isExplain()
9 years ago
8433c2ef2f
Fix http unit tests
9 years ago
db1fb33fd3
Allow timing control
...
Fixes issue #75 .
9 years ago
11c18cd769
Service and store support consistency levels
...
Fix issue #5 .
9 years ago
959ceaecfa
Use 'timings' instead of 'verbose'
9 years ago
62c17291b4
More diagnostic information
9 years ago
ddad80be8c
Start adding 'verbose' query param
9 years ago
4524d014eb
Leader redirection almost complete
9 years ago
f28b315a8d
'go fmt' fixes
9 years ago
68719955e0
Prep for extensive service unit tests
9 years ago
6c12e39809
Require Store to expose Leader()
9 years ago
77141ff193
Correct comment
9 years ago
e88f97ed06
Support cluster-level leader checks for queries
9 years ago
d294012814
Fix HTTP unit tests after new status route
9 years ago
0607a69382
Only show backup time if it has occurred
9 years ago
92329628cf
More /status functionality
9 years ago
59cdb6856c
Rename 'statistics' route as 'status'.
9 years ago
f1963221ca
Small fixes and formatting
9 years ago
cc73f0abbc
Default to leader check before backup
9 years ago
947cd053be
Don't set content-type header for backup
...
It was getting prepended to the body of the request, and corrupting
the database. It's set automatically anyway.
Backup now appears functional.
9 years ago
a754448b25
Fix 'noLeader' query param
9 years ago
b058458a0f
Start adding multi-node tests
9 years ago
0ce450fed6
More nodes on queries and leadership
9 years ago
81a3af3b7e
Allow leader check for queries
9 years ago
a7ade520e4
Clean up HTTP routing
...
Start adding unit tests for HTTP service.
9 years ago
3ffed779f8
Move to POST for bulk queries
...
Backup endpoint also added, but not fully-functional.
9 years ago
fac68c3cdd
Return time in seconds
9 years ago
f33ffc2936
Measure time per statement
9 years ago
7286790968
Finalize 'time' in responses
9 years ago
77852d8647
Enhance top-level of response
9 years ago
da128dae3f
Correct URL param for transactions
9 years ago
a8c19788a3
Tighten up HTTP error responses
9 years ago
Philip O'Toole
chermehdi
Zac Medico