967bd410ae
No need to cast indicces
...
GPT4 spotted this
10 months ago
ab3671d66c
Make it clearer why checksum checks not needed
10 months ago
4c31c480f5
Better name
10 months ago
5a8a2744ff
Support skipping verifying frame data
...
This halves the Compacting Scan time, and doesn't seem necessary since
rqlite is the only system writing the WAL files.
10 months ago
1b0dfe6942
Check WAL frame header checksum earlier
10 months ago
bb12489e9d
Linting
10 months ago
aaf85461e7
Minor updates
10 months ago
10546281c3
Remove unneeded testdata
10 months ago
b68bb9a0d2
Remove invalid test
10 months ago
d36d31d0c4
Check Writer and Compactor
10 months ago
d690993cff
Comments
10 months ago
93c1b2c435
Add Compacting tests with 0 commit frames
10 months ago
797bb90f75
Basic unit test for Compacting Scanner
10 months ago
22832edce0
More type rename
10 months ago
6ec424a6b4
Rename types
10 months ago
f1dc1acbf8
Fine renames
10 months ago
ee83091741
Add Compacting Scanner
...
Not tested, just builds.
10 months ago
285a985e51
Unit test FullWALScanner
10 months ago
e8ad9f43ac
Full WAL writer passes test
10 months ago
f2102db9bb
Full WAL writer -- not tested
10 months ago
4a7a9fc362
Add full WAL Scanner
10 months ago
40bdc8d692
No compactor right now
10 months ago
a6c6371fef
Move constants
10 months ago
b3e57dd280
Add TODO XXXX
10 months ago
10a20237ca
Complete compaction?
10 months ago
e7fe5abe7e
Remove unused type
10 months ago
ae55b98f15
Add GPT-generated compaction
...
Not tested.
10 months ago
6e30f1476c
Merge remote-tracking branch 'origin' into litefs-snapshotting
10 months ago
a210a00cd1
Close right DB
10 months ago
cd3dbe94fe
Test Dump by reloading it into new database
...
String compare may be brittle. See: https://ci.appveyor.com/project/otoolep/rqlite/builds/48587534
10 months ago
41c59ea531
Add initial skeleton of WAL Compactor
1 year ago
0c0c6cd757
Fix output
1 year ago
b238b6c2fb
Add simple tool for examining WAL files
1 year ago
f3f6611eb6
Add WAL-related code from litefs
...
Many thanks to the authors of litefs.
1 year ago
53b432a391
More DB and Snapshot stats
1 year ago
4869a2be35
1 RW DB connection only!
...
Connections where coming from the pool, and if they were new, they had
autocheckpointing set back to 1000!
1 year ago
ffe9688dcd
Still just setting pragmas on RW conn
1 year ago
3030226ab1
Comment
1 year ago
c737e73eb2
Fix up test
1 year ago
fbbe282670
Test that databases open with checkpoint disabled
1 year ago
0fe26d35d7
Actually disable automatic checkpointing
1 year ago
3b6c988dd9
Do some syncing and closing
1 year ago
cb989d09a2
Some changes from PR v2
1 year ago
1a24557c19
Merge remote-tracking branch 'origin' into wal-snapshot-store-v3
1 year ago
208fc20659
Fix more uses of random
1 year ago
54713b63f4
Merge remote-tracking branch 'origin' into wal-snapshot-store-v3
1 year ago
c1a8b4a13a
Use global, sync'ed random source
...
Almost unbelievably it appears tests on AppVeyor get the same value when
seeding the random generator. See https://ci.appveyor.com/project/otoolep/rqlite/builds/47853399
1 year ago
c44d020c11
Only attempt to checkpoint once
1 year ago
0589233362
More Windows-triggered fixes
1 year ago
eed11dee8c
Comment
1 year ago
d4aab33163
More testing of DB checkpointing
1 year ago
8d6d31649f
ABL
1 year ago
cacc03199e
Add DB WAL Path and test
1 year ago
b85e431972
Upgrade SQLite so that we pull in FTS5
1 year ago
85eb2cca84
Unit test creation of FTS3, FTS4, and FTS5 tables
1 year ago
1b14eaf6df
Fix error checking
...
https://github.com/rqlite/rqlite/pull/1317#discussion_r1286866112
1 year ago
b95442d0fe
Remove empty files
1 year ago
13fce2fac2
Remove in-memory support from DB layer
1 year ago
c7b00f039c
Make operation of checkpoint clearer
1 year ago
b57011336f
DB can run an integrity check
1 year ago
166f0d92a9
Update old comments with correct function name
1 year ago
1107690c52
Migrate HTTP layer to chunked loading
1 year ago
8edb5c9967
Add DB-level tests of using "COLLATE"
1 year ago
370688730f
Better name for test
1 year ago
722c40f77f
Test use of NUMERIC type
1 year ago
f22dff319b
Ensure invalid expression is handled
1 year ago
61b2e10b2e
Fix db-level unit tests
1 year ago
70a3c38b82
Only do a one-shot empty types check
1 year ago
316ee52b4c
Fill in empty types using actual queried data
1 year ago
36fa7f2afd
Detect DB stats error and log
1 year ago
c552dba575
Record how long checkpointing takes
1 year ago
b64efbdee1
Better testing
1 year ago
539e578227
Add WAL-validity checking functions
1 year ago
d940779045
More unit testing of WAL-replay
1 year ago
50fbdc73fd
Tigther code
1 year ago
a9796eeb36
Better testing
1 year ago
6cd8d30749
Fix Store-level database-backup test
1 year ago
ca67ee4cff
Remove debug statement
1 year ago
68fc185c76
More WAL DB open testing
1 year ago
19d83ff1ca
More enforcement of DELETE mode in-and-out
1 year ago
0463a92fde
Fix Serialize() to work with WAL mode
...
This function is even more resource (disk, RAM) intensive, but it's goal
is to be correct, not efficient.
1 year ago
4e639d4f17
Add more detail to comments
...
Serialize() is problematic with WAL mode databases. It needs close study
and may have to be retired before enabling WAL mode. For example
Serialize() is called by Snapshotting. Snapshotting would need to move
to Backup, at for on-disk mode.
1 year ago
33b56af639
Fix Backup for WAL mode
1 year ago
3f462eecfa
Remove all on-disk SQLite files on startup
1 year ago
26ad4913c9
Correct comment
1 year ago
6b32b7f4d2
Add function which returns size of WAL
1 year ago
7e1b8d12d7
Add full WAL support to DB layer
1 year ago
df33a4aa42
DB layer supports enabling WAL mode
1 year ago
da11903312
Correct test failure error
1 year ago
67941699b6
Add some WAL-related control code
...
Not actually called yet.
1 year ago
5e37ff9c55
Fix typo in variable name
1 year ago
f58bd0cf7b
Add some important PRAGMA state to DB stats
1 year ago
dd9b3f2695
PRAGMA synchronous=OFF for on-disk databases
1 year ago
4a7ac2850f
rqlite doesn't (yet) support WAL mode SQLite data
1 year ago
98a356504e
Fix import cycle
1 year ago
ca12df38ce
Test cleanup
1 year ago
2fd62f3f64
Isolation testing only applies to on-disk
1 year ago
d8f3a72365
Common DB-layer tests
1 year ago
ca6f071fb5
Split up DB-level unit testing
1 year ago
5ff28d354f
Set Error on correct field
1 year ago
9924fe75f5
Some small improvements
1 year ago
3058d3e9fc
Fix transaction handling in db.Request()
1 year ago
59786e818b
Initial unit tests for db.Requests()
...
Seems to work well.
1 year ago
4cbb541e9b
DB Request code-complete except for transactions
1 year ago
fe176a9752
Merge branch 'query-exec-stmt-with-conn' into unified-endpoint
1 year ago
497c6b3340
Elevate queryer type
1 year ago
3d652d929e
More factoring of DB query layer
1 year ago
de70664bf1
More code in db.Request()
1 year ago
6fcf85ef40
Flag major issue
1 year ago
1987f9b07b
Flesh out db.Request
...
Needs full unit testing.
1 year ago
b2b0b188e9
Factor out functions
1 year ago
014559bb06
Another DB read-only test
1 year ago
f84b258f99
Better variable name
1 year ago
c3e7044945
Final read-only test
1 year ago
2af5fc26aa
Move comment
1 year ago
8f45c4c8c9
Factor out read-only check
1 year ago
bb868595c1
Start prepping DB layer
1 year ago
92a604c4ec
Move SQLite validity checks to db module
1 year ago
fb1e5e3903
Use correct errors (thanks GPT!)
1 year ago
95a689b3cf
Some improvements thanks to ChatGPT 4
1 year ago
c1ba9157c2
More unit test of nil parameters
2 years ago
41bf265b02
Fix more handling of nil named values
2 years ago
053bde0ed6
Upgrade to latest SQLite driver
2 years ago
3d555a73cb
Add unit test showing malformed database issue
...
https://github.com/rqlite/rqlite/issues/1103
2 years ago
0702e39ace
Add ResetStats
2 years ago
e3cc4eb5d0
go mod updates ( #1120 )
...
* go mod updates
* CHANGELOG
2 years ago
e74bfc182a
Use new Encoder everywhere
2 years ago
0071867e34
Don't call t.Fatal() from goroutine
...
It wouldn't abort the test anyway, so just log.
2 years ago
5141eff5fc
test: use `T.TempDir` to create temporary test directory
...
This commit replaces `ioutil.TempDir` with `t.TempDir` in tests. The
directory created by `t.TempDir` is automatically removed when the test
and all its subtests complete.
Prior to this commit, temporary directory created using `ioutil.TempDir`
needs to be removed manually by calling `os.RemoveAll`, which is omitted
in some tests. The error handling boilerplate e.g.
defer func() {
if err := os.RemoveAll(dir); err != nil {
t.Fatal(err)
}
}
is also tedious, but `t.TempDir` handles this for us nicely.
Reference: https://pkg.go.dev/testing#T.TempDir
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2 years ago
54aec1ca33
Tighten up backup code
2 years ago
221907f8a9
Support nil as paramterized values
2 years ago
c8b9fd72da
Sanity check supplied SQLite data
2 years ago
c91ca45ba4
Expose more DB attributes
2 years ago
a6a3567a4d
DB layer returns in-memory status
2 years ago
d84fb85f01
Don't HTML escape JSON output
3 years ago
869f3547b7
Update to SQLite 3.38
3 years ago
ebb2ff32c2
Send rand() once in DB layer
3 years ago
24a5dc8c4b
Much better random file names
3 years ago
3bfcbffc37
Fix typos and Grammar issues
3 years ago
7038b86dcb
One final named params unit test
3 years ago
01849e77d5
Add db-level support for named paremeters
3 years ago
239cdc04b5
Don't run heavy memory tests in parallel
...
Let's see if this helps these tests run faster, especially with -race,
and prevent CircleCI timeouts.
3 years ago
eab9183acd
Better comment in DB code
3 years ago
51bb54488b
Explicitly handle column type nil (null)
3 years ago
c639f21cde
Return time types in RFC3339 format
3 years ago
28063bfa0d
Support timestamp field
3 years ago
53e4b9ae3d
ABL
3 years ago
437d76bc1c
Update db.go
3 years ago
bed9dc2a49
Update db_test.go
3 years ago
393a1c67a0
Fix unit tests
3 years ago
Philip O'Toole
Bjorn Pagen
Eng Zer Jun
chermehdi