Philip O'Toole
f72a398190
Unit test Swappable DB
8 months ago
Philip O'Toole
0281178111
Call functions
8 months ago
Philip O'Toole
7feabe6c8b
GoDoc
8 months ago
Philip O'Toole
3ed29b5c31
Introduce a synchronized, swappable DB
...
Type prevents races between queries and operations (such as auto-vacuum)
which change the DB object out.
8 months ago
Philip O'Toole
2dac279c83
Add VacuumInto to database layer
8 months ago
Philip O'Toole
e4d2b4cddb
Improve comments
8 months ago
Philip O'Toole
fa2034b42e
Try shorter time
8 months ago
Philip O'Toole
af4b14b639
Try a sleep
8 months ago
Philip O'Toole
ba3b3f1b60
Change DB modified times
8 months ago
Philip O'Toole
cbd50a5d9a
See if opening WR will fix Windows
8 months ago
Philip O'Toole
1f5e95a5d9
Unit test Sums
8 months ago
Philip O'Toole
9ad7b1d94e
Fully handle "file does not exist" error
8 months ago
Philip O'Toole
39a882d9d6
Test VACUUM changes via sums
...
Seems like mtime is not precise enough in CircleCI.
8 months ago
Philip O'Toole
10c2a143cd
Test using an MD5 sum compare of WALs
8 months ago
Philip O'Toole
a6c839829a
DRY up code
8 months ago
Philip O'Toole
45f5386153
Fix comments
8 months ago
Philip O'Toole
5a27dac7b2
Run integrity check at end of test
8 months ago
Philip O'Toole
6398eac6d5
Fix test
8 months ago
Philip O'Toole
8f98fd4d1c
Actually, WAL should be copied after VACUUM!
8 months ago
Philip O'Toole
8f8612d6da
Comment test
8 months ago
Philip O'Toole
4cd3c438f4
Add more involved WAL checkpoint unit test
...
This test passes, but if VACUUM is performed, the dst database becomes
corrupt. This shows that VACUUM introduces issues which warrant a full
snapshot after any proposed auto-vacuum.
https://github.com/rqlite/rqlite/issues/1609
8 months ago
Philip O'Toole
cfefc090b0
Remove use of deprecated ioutil
8 months ago
Philip O'Toole
3684e12257
Re-enable SYNC off mode
8 months ago
Philip O'Toole
1833417fce
Minor refactoring of DB code
8 months ago
Philip O'Toole
36ff916a6e
Enhance DB checkpoint unit test
8 months ago
Philip O'Toole
ac1af31a08
Move standalone functions into own file
8 months ago
Philip O'Toole
ceab400720
Refactor DB open
8 months ago
Philip O'Toole
212aedbfb2
Provider Check unit tests
9 months ago
Philip O'Toole
bedfaeded8
Add "last modified" to DB stats
9 months ago
Philip O'Toole
3b761d9aac
More testing
9 months ago
Philip O'Toole
14858a37d4
Use last DB mod time in Provider
9 months ago
Philip O'Toole
a087d509ac
Upload Provider uses Snapshot-locking backup
9 months ago
Philip O'Toole
5c5b226303
Working
9 months ago
Philip O'Toole
6c1d328e46
Humanize database sizes
9 months ago
Philip O'Toole
504dd3cd65
Friendlier log message
9 months ago
Philip O'Toole
4d605ac9eb
Store WAL path in store, to avoid races
...
https://app.circleci.com/pipelines/github/rqlite/rqlite/3966/workflows/a460ab69-2827-4a72-9a79-1aceda68ee7d/jobs/31288
9 months ago
Philip O'Toole
ad916270d2
Bring go mod import path into compliance
9 months ago
Philip O'Toole
fc7b9901f6
Add DB-level unit test of WAL removal on close
9 months ago
Philip O'Toole
e48031b6f5
Small tweaks
9 months ago
Philip O'Toole
ff7a6bc872
Warn for 1GB SQLite files (and larger)
9 months ago
Philip O'Toole
bf1b6ea5de
Open a non-existent database file should work
9 months ago
Philip O'Toole
4988c29951
Log at DB level if open times are higher
9 months ago
Philip O'Toole
140f106acc
Add ReadFrom to Store
9 months ago
Philip O'Toole
cdf7cbdea1
Handle snapshots for empty WALs
9 months ago
Philip O'Toole
62dcb881fc
More DB and Checkpoint tests
9 months ago
Philip O'Toole
a0bf10b021
Move VACUUM to DB layer
10 months ago
Philip O'Toole
817998396f
Add VACUUM to database code
10 months ago
Philip O'Toole
11c5c86c4b
Merge pull request #1449 from rqlite/otoolep-remove-unneeded-header-fetch
...
Remove unneeded refetch of the header
10 months ago
Philip O'Toole
c0061aca06
Add missing update
10 months ago
Philip O'Toole
fd01909415
Update writer.go
10 months ago
Philip O'Toole
967bd410ae
No need to cast indicces
...
GPT4 spotted this
10 months ago
Philip O'Toole
ab3671d66c
Make it clearer why checksum checks not needed
10 months ago
Philip O'Toole
4c31c480f5
Better name
10 months ago
Philip O'Toole
5a8a2744ff
Support skipping verifying frame data
...
This halves the Compacting Scan time, and doesn't seem necessary since
rqlite is the only system writing the WAL files.
10 months ago
Philip O'Toole
1b0dfe6942
Check WAL frame header checksum earlier
10 months ago
Philip O'Toole
bb12489e9d
Linting
10 months ago
Philip O'Toole
aaf85461e7
Minor updates
10 months ago
Philip O'Toole
10546281c3
Remove unneeded testdata
10 months ago
Philip O'Toole
b68bb9a0d2
Remove invalid test
10 months ago
Philip O'Toole
d36d31d0c4
Check Writer and Compactor
10 months ago
Philip O'Toole
d690993cff
Comments
10 months ago
Philip O'Toole
93c1b2c435
Add Compacting tests with 0 commit frames
10 months ago
Philip O'Toole
797bb90f75
Basic unit test for Compacting Scanner
10 months ago
Philip O'Toole
22832edce0
More type rename
10 months ago
Philip O'Toole
6ec424a6b4
Rename types
10 months ago
Philip O'Toole
f1dc1acbf8
Fine renames
10 months ago
Philip O'Toole
ee83091741
Add Compacting Scanner
...
Not tested, just builds.
10 months ago
Philip O'Toole
285a985e51
Unit test FullWALScanner
10 months ago
Philip O'Toole
e8ad9f43ac
Full WAL writer passes test
10 months ago
Philip O'Toole
f2102db9bb
Full WAL writer -- not tested
10 months ago
Philip O'Toole
4a7a9fc362
Add full WAL Scanner
10 months ago
Philip O'Toole
40bdc8d692
No compactor right now
10 months ago
Philip O'Toole
a6c6371fef
Move constants
10 months ago
Philip O'Toole
b3e57dd280
Add TODO XXXX
10 months ago
Philip O'Toole
10a20237ca
Complete compaction?
10 months ago
Philip O'Toole
e7fe5abe7e
Remove unused type
10 months ago
Philip O'Toole
ae55b98f15
Add GPT-generated compaction
...
Not tested.
10 months ago
Philip O'Toole
6e30f1476c
Merge remote-tracking branch 'origin' into litefs-snapshotting
10 months ago
Philip O'Toole
a210a00cd1
Close right DB
10 months ago
Philip O'Toole
cd3dbe94fe
Test Dump by reloading it into new database
...
String compare may be brittle. See: https://ci.appveyor.com/project/otoolep/rqlite/builds/48587534
10 months ago
Philip O'Toole
41c59ea531
Add initial skeleton of WAL Compactor
1 year ago
Philip O'Toole
0c0c6cd757
Fix output
1 year ago
Philip O'Toole
b238b6c2fb
Add simple tool for examining WAL files
1 year ago
Philip O'Toole
f3f6611eb6
Add WAL-related code from litefs
...
Many thanks to the authors of litefs.
1 year ago
Philip O'Toole
53b432a391
More DB and Snapshot stats
1 year ago
Philip O'Toole
4869a2be35
1 RW DB connection only!
...
Connections where coming from the pool, and if they were new, they had
autocheckpointing set back to 1000!
1 year ago
Philip O'Toole
ffe9688dcd
Still just setting pragmas on RW conn
1 year ago
Philip O'Toole
3030226ab1
Comment
1 year ago
Philip O'Toole
c737e73eb2
Fix up test
1 year ago
Philip O'Toole
fbbe282670
Test that databases open with checkpoint disabled
1 year ago
Philip O'Toole
0fe26d35d7
Actually disable automatic checkpointing
1 year ago
Philip O'Toole
3b6c988dd9
Do some syncing and closing
1 year ago
Philip O'Toole
cb989d09a2
Some changes from PR v2
1 year ago
Philip O'Toole
1a24557c19
Merge remote-tracking branch 'origin' into wal-snapshot-store-v3
1 year ago
Philip O'Toole
208fc20659
Fix more uses of random
1 year ago
Philip O'Toole
54713b63f4
Merge remote-tracking branch 'origin' into wal-snapshot-store-v3
1 year ago
Philip O'Toole
c1a8b4a13a
Use global, sync'ed random source
...
Almost unbelievably it appears tests on AppVeyor get the same value when
seeding the random generator. See https://ci.appveyor.com/project/otoolep/rqlite/builds/47853399
1 year ago
Philip O'Toole
c44d020c11
Only attempt to checkpoint once
1 year ago
Philip O'Toole
0589233362
More Windows-triggered fixes
1 year ago
Philip O'Toole
eed11dee8c
Comment
1 year ago