infrastructure/k8s-csi-s3
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages1 Wiki Activity
167 commits 4 branches 33 tags 23 MiB
Commit graph

49 commits

Author SHA1 Message Date
Vitaliy Filippov
051957c015 Delete objects in parallel when deleting auto-created volumes 2021-07-27 13:10:45 +03:00
Vitaliy Filippov
0bb71bb573 Add 3 FIXMEs 2021-07-26 21:11:32 +03:00
Vitaliy Filippov
07c3e2eb6e Do not store additional metadata in .metadata.json in the bucket itself 2021-07-26 21:11:32 +03:00
Vitaliy Filippov
c8f6d347a3 Remove additional FSPath prefix 2021-07-19 15:41:45 +03:00
Vitaliy Filippov
08408625bd Add mount options support 2021-07-16 16:12:57 +03:00
boxjan
e4cdb54679 Although get a EOF error, we should still know it 2021-04-09 21:45:52 +08:00
boxjan
e4116a33da fix problem: log format; fs meta; 2021-04-08 22:35:31 +08:00
boxjan
dc98732919 fix problem 
* rclone use 1.54.1
* add EnsureFSMetaExist func
* fix removeObjects have err check
* add removeObjectsOneByOne, when removeObjects failed, will try to use it
* fix repeat in yaml
 2021-04-08 00:06:56 +08:00
Cyrill Troxler
8c44fcf214 Only delete bucket if the volume is the alone user 2021-04-06 19:24:09 +02:00
Cyrill Troxler
9ee2e2c977 Use volume ID as a prefix if the bucket is fixed in the storage class 
With this, each volume will get its own prefix within the bucket if it
is configured in the storage class. This also ensures backwards
compatibility with older volumes that have been created in earlier
versions of csi-s3.
 2021-04-05 15:07:16 +02:00
Cyrill Troxler
39ebd7e830 Rename packages 
Create separate packages for driver, s3 client and mounters.
 2021-04-05 12:10:20 +02:00
Lin Yiming
35ad044d95 If bucket is not created by csi-s3, it will not be deleted by csi-s3 automatically 2021-01-22 10:15:21 +08:00
Lin Yiming
f45f381103 Do not create fs prefix for existing bucket 2021-01-22 10:15:21 +08:00
Lin Yiming
534617548a mount existed bucket 2021-01-22 10:15:21 +08:00
Lin Yiming
1a16c12f4f upgrade minio-go library to v7 2021-01-22 10:15:21 +08:00
Carl Lange
d14624744e Use NewWithRegion not minio's region resolution 2019-06-30 16:32:59 +01:00
Cyrill Troxler
fb4387aef9 Release new version 2019-05-18 11:55:37 +02:00
Cyrill Troxler
4aa27ddcdf Clean up old references to encryptionKey 2019-05-16 18:15:45 +02:00
Cyrill Troxler
ca9f3b5bd0 Remove s3ql 
s3ql does not work very well in a dynamic environment like k8s.
Also as it needs a ton of dependencies just to get it built makes
it hard to maintain.
 2019-05-15 21:06:28 +02:00
Cyrill Troxler
ed56293477 Do not use sigv2 with s3fs 2019-05-15 21:00:16 +02:00
Cyrill Troxler
5e727dbb05 Add log message when mounting 2019-05-15 21:00:16 +02:00
Cyrill Troxler
f12bc09bdf Update README and deployment, split up dockerfile 2019-05-15 21:00:16 +02:00
Cyrill Troxler
6663621a25 Upgrade csi-spec, fix tests 2019-05-15 21:00:16 +02:00
Cyrill Troxler
a670d7fb4d Supply credentials using volume secrets instead of cli config 2019-05-15 21:00:02 +02:00
Cyrill Troxler
59fd15b628 Add rclone mounter () 2019-03-07 20:27:02 +01:00
Cyrill Troxler
4995b00f57 Revert capabilites to only allow RWO () 2019-02-28 21:09:56 +01:00
Lennard
e326d607d0 Feature/update to csi 1.0 () 
* updated all image to v1.0.1 csi

* Updated golang code to csi 1.0 compatible names

* added comment
 2019-02-28 19:34:03 +01:00
Cyrill Troxler
1709545db6 Sanitize the volumeID before creation 
* Bucket names cannot contain upper case letters
* Bucket names cannot be longer than 63 chars
 2019-02-06 20:02:28 +01:00
Cyrill Troxler
dc45abfa98 Fix s3backer with AWS 
If we set baseURL with AWS s3backer will fail to authenticate.
 2019-01-19 14:43:54 +01:00
Cyrill Troxler
6feb8b58c8 Set correct vendor version and display it on launch 2019-01-19 14:40:58 +01:00
Cyrill Troxler
c7f9953e35 Improve bucket error messages 2019-01-19 14:39:33 +01:00
Cyrill Troxler
82e4a865da Add ci pipeline with GitLab () 
* Add automated testing
* Create loop device while staging s3backer
 2018-08-03 20:30:46 +02:00
Cyrill Troxler
59e93b70d0 Improve bucket error messages 2018-07-29 16:19:26 +02:00
Cyrill Troxler
ea2ff584a1 Rename to just csi-s3 2018-07-29 14:49:35 +02:00
Cyrill Troxler
74eca7e00b Allow configuring mounter via storageclass parameter 2018-07-29 14:36:13 +02:00
Cyrill Troxler
2341274393 Add fs prefix (directory) 
This ensures the fs root is clean and does not mess with
the metadata. Also in the future this will allow for multiple
filesystems to be created in one bucket.
 2018-07-27 21:37:32 +02:00
Cyrill Troxler
1caf469966 Implement a metadata file and correct sizing 
As the controller does not mount/create the fs we have to store the capacity somewhere so the node knows about it.
 2018-07-27 13:28:52 +02:00
Cyrill Troxler
0010066fe3 Implement stage/unstage 
This helps the reliability of s3backer as the fuse mount
is done on NodeStageVolume and only once per volume per
node.
 2018-07-26 22:43:51 +02:00
Cyrill Troxler
1fe218a568 Format using nodeserver, not controller 2018-07-26 20:13:40 +02:00
Cyrill Troxler
f8bd74afb9 Fix log output 2018-07-23 20:58:25 +02:00
Cyrill Troxler
a468d955bc Check for defunct process before waiting for it 2018-07-23 20:58:25 +02:00
Cyrill Troxler
82ab4b0983 Add experimental s3backer mounter 
This also adds some generic handling of stale umounts.
Fuse returns immediately and does not indicate that
the mounter has finished writing to the backend.
The process finding is sort of hacky as I could not
find a better way to get to the PID from a fuse mount.
 2018-07-23 20:58:25 +02:00
Cyrill Troxler
b412e81977 Fix s3ql unmount 2018-07-22 12:41:37 +02:00
Cyrill Troxler
8cd8f6b6cd Mounter can now only be specified through flag 2018-07-22 12:41:37 +02:00
Cyrill Troxler
9d5d84ebfb Refactor all mounters to use the mounter interface 2018-07-22 12:41:37 +02:00
Cyrill Troxler
093c5bf500 Use ginkgo test suite to test all mounters 2018-07-22 12:41:37 +02:00
Cyrill Troxler
13eba47da6 Add experimental s3ql mounter 2018-07-22 12:39:54 +02:00
Cyrill Troxler
360d9bfe69 Rename credentials to config 2018-07-16 20:24:54 +02:00
Cyrill Troxler
419e3e6312 Initial commit 2018-07-14 10:48:22 +02:00