Mauri de Souza Meneguzzo
69933cbe35
aws: reuse session and S3 manager
...
The AWS session and s3 manager are concurrent safe, it should be reused
whenever possible:
Sessions are safe to use concurrently as long as the Session is not
being modified. Sessions should be cached when possible, because
creating a new Session will load all configuration values from the
environment, and config files each time the Session is created.
See https://pkg.go.dev/github.com/aws/aws-sdk-go/aws/session
Currently, an aws session and s3 client/manager are created every time a
call to Upload, CurrentID or Download is made. I changed it so it creates
one session and S3 manager during app startup and reuse it afterwards.
8 months ago
Philip O'Toole
68521d34a2
Fix AWS client and Store Provider
8 months ago
Philip O'Toole
9ad21b8565
S3 unit test update
8 months ago
Philip O'Toole
5f1d98a0e2
Use Canonical Header keys for AWS metadata
8 months ago
Philip O'Toole
7c11295863
End-to-end test for skipped uploads due to sum
8 months ago
Philip O'Toole
c8e29c2269
Simpler cloud sum check logic
8 months ago
Philip O'Toole
f3c1109325
More comments
8 months ago
Philip O'Toole
0d81e6f438
Fetch sums from S3 and compare
8 months ago
Philip O'Toole
58fbe3ee81
Initial framework for setting sums
8 months ago
Jason Tackaberry
0993f9d835
Don't require static credentials for S3 access
9 months ago
Jason Tackaberry
5dc7ecac65
Fix error messages S3Client String() test cases
9 months ago
Jason Tackaberry
354ce80c35
Adapt tests to S3Client API changes
9 months ago
Jason Tackaberry
8525b0bf7c
Support non-AWS S3 URL formats in S3Client
9 months ago
Jason Tackaberry
e60a0b54fc
Allow configurable S3 path style for auto backups
...
AWS has deprecated the path-style URLs but it's required for some
S3-like alternatives such as Minio.
9 months ago
Philip O'Toole
ea23906180
Add support for custom S3 endpoint
1 year ago
Philip O'Toole
a9151ec299
Move S3 config to aws module
1 year ago
Philip O'Toole
0e420c0da7
Simpler comments
1 year ago
Philip O'Toole
bf14cefb03
Complete AWS S3 downloader
1 year ago
Philip O'Toole
b92d0a41ea
Improve S3 upload unit test
1 year ago
Philip O'Toole
27dc5e51da
Minor readability improvements
1 year ago
Philip O'Toole
d534c85699
Add simple Download function to S3 client
1 year ago
Philip O'Toole
d1befd8a78
Better error message
1 year ago
Philip O'Toole
726957fb1e
Remove superfluous blank line
1 year ago
Philip O'Toole
2e7c635fff
Test S3 client via dependency injection
1 year ago
Philip O'Toole
3125fb5e8a
Add initial S3 upload client
1 year ago
Philip O'Toole
3fa26a879c
Remove unused AWS code
1 year ago
Philip O'Toole
7bd54944f3
More package-level GoDoc
7 years ago
Philip O'Toole
cf84a38504
Fix GoDoc comment
8 years ago
Philip O'Toole
8ff3c7695b
GoDoc comments
8 years ago
Philip O'Toole
2f9c768040
Add simple client for fetching AWS EC2 metadata
8 years ago