infrastructure/k8s-csi-s3
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages1 Wiki Activity
52 commits 4 branches 33 tags 23 MiB
Commit graph

52 commits

Author SHA1 Message Date
Cyrill Troxler
b5377b4504 Merge pull request from ctrox/secrets 
Supply credentials using volume secrets instead of cli config
 2019-05-15 21:23:43 +02:00
Cyrill Troxler
af7b022329 Update README 2019-05-15 21:14:18 +02:00
Cyrill Troxler
ca9f3b5bd0 Remove s3ql 
s3ql does not work very well in a dynamic environment like k8s.
Also as it needs a ton of dependencies just to get it built makes
it hard to maintain.
 2019-05-15 21:06:28 +02:00
Cyrill Troxler
ed56293477 Do not use sigv2 with s3fs 2019-05-15 21:00:16 +02:00
Cyrill Troxler
5e727dbb05 Add log message when mounting 2019-05-15 21:00:16 +02:00
Cyrill Troxler
f12bc09bdf Update README and deployment, split up dockerfile 2019-05-15 21:00:16 +02:00
Cyrill Troxler
6663621a25 Upgrade csi-spec, fix tests 2019-05-15 21:00:16 +02:00
Cyrill Troxler
a670d7fb4d Supply credentials using volume secrets instead of cli config 2019-05-15 21:00:02 +02:00
Cyrill Troxler
59fd15b628 Add rclone mounter () 2019-03-07 20:27:02 +01:00
Cyrill Troxler
577f229ef7 Switch to go modules () 2019-03-02 11:03:07 +01:00
Cyrill Troxler
4995b00f57 Revert capabilites to only allow RWO () 2019-02-28 21:09:56 +01:00
Lennard
e326d607d0 Feature/update to csi 1.0 () 
* updated all image to v1.0.1 csi

* Updated golang code to csi 1.0 compatible names

* added comment
 2019-02-28 19:34:03 +01:00
Cyrill Troxler
1709545db6 Sanitize the volumeID before creation 
* Bucket names cannot contain upper case letters
* Bucket names cannot be longer than 63 chars
 2019-02-06 20:02:28 +01:00
Cyrill Troxler
dc45abfa98 Fix s3backer with AWS 
If we set baseURL with AWS s3backer will fail to authenticate.
 2019-01-19 14:43:54 +01:00
Cyrill Troxler
6feb8b58c8 Set correct vendor version and display it on launch 2019-01-19 14:40:58 +01:00
Cyrill Troxler
c7f9953e35 Improve bucket error messages 2019-01-19 14:39:33 +01:00
Cyrill Troxler
b5403a45bb Update README 2018-08-06 19:27:24 +02:00
Cyrill Troxler
ac4456a089 Increase version for release 2018-08-04 14:14:45 +02:00
Cyrill Troxler
82e4a865da Add ci pipeline with GitLab () 
* Add automated testing
* Create loop device while staging s3backer
 2018-08-03 20:30:46 +02:00
Cyrill Troxler
02cde15691 Increase version for release 2018-07-29 16:26:02 +02:00
Cyrill Troxler
d43cb143fd Add comment about AWS endpoint URL 2018-07-29 16:19:40 +02:00
Cyrill Troxler
59e93b70d0 Improve bucket error messages 2018-07-29 16:19:26 +02:00
Cyrill Troxler
715d9d5137 Update README 2018-07-29 14:54:28 +02:00
Cyrill Troxler
ea2ff584a1 Rename to just csi-s3 2018-07-29 14:49:35 +02:00
Cyrill Troxler
0d2e5902ed Put everything into one docker container 2018-07-29 14:36:41 +02:00
Cyrill Troxler
74eca7e00b Allow configuring mounter via storageclass parameter 2018-07-29 14:36:13 +02:00
Cyrill Troxler
ad1bfbafde Merge pull request from CTrox/bucket_prefix 
Add fs prefix (directory)
 2018-07-29 09:21:32 +02:00
Cyrill Troxler
2341274393 Add fs prefix (directory) 
This ensures the fs root is clean and does not mess with
the metadata. Also in the future this will allow for multiple
filesystems to be created in one bucket.
 2018-07-27 21:37:32 +02:00
Cyrill Troxler
e995487c45 Merge pull request from CTrox/s3backer_mounter 
Add s3backer mounter
 2018-07-27 21:32:17 +02:00
Cyrill Troxler
87da8c6d21 Add section about s3backer to README 2018-07-27 13:34:24 +02:00
Cyrill Troxler
59481b756a Set s3backer Dockerfile as default 2018-07-27 13:29:02 +02:00
Cyrill Troxler
1caf469966 Implement a metadata file and correct sizing 
As the controller does not mount/create the fs we have to store the capacity somewhere so the node knows about it.
 2018-07-27 13:28:52 +02:00
Cyrill Troxler
db0fbf77dd Update kubernetes deployment 2018-07-26 22:47:36 +02:00
Cyrill Troxler
3f83f7fe36 Add s3fs to Dockerfile.s3backer 2018-07-26 22:46:30 +02:00
Cyrill Troxler
0010066fe3 Implement stage/unstage 
This helps the reliability of s3backer as the fuse mount
is done on NodeStageVolume and only once per volume per
node.
 2018-07-26 22:43:51 +02:00
Cyrill Troxler
1fe218a568 Format using nodeserver, not controller 2018-07-26 20:13:40 +02:00
Cyrill Troxler
f8bd74afb9 Fix log output 2018-07-23 20:58:25 +02:00
Cyrill Troxler
a468d955bc Check for defunct process before waiting for it 2018-07-23 20:58:25 +02:00
Cyrill Troxler
82ab4b0983 Add experimental s3backer mounter 
This also adds some generic handling of stale umounts.
Fuse returns immediately and does not indicate that
the mounter has finished writing to the backend.
The process finding is sort of hacky as I could not
find a better way to get to the PID from a fuse mount.
 2018-07-23 20:58:25 +02:00
Cyrill Troxler
108364fb88 Merge branch 's3ql_mounter' 2018-07-22 13:00:14 +02:00
Cyrill Troxler
626f451184 Update README 2018-07-22 12:59:30 +02:00
Cyrill Troxler
c4880a2bdc Add ps util to container 2018-07-22 12:41:37 +02:00
Cyrill Troxler
b412e81977 Fix s3ql unmount 2018-07-22 12:41:37 +02:00
Cyrill Troxler
8cd8f6b6cd Mounter can now only be specified through flag 2018-07-22 12:41:37 +02:00
Cyrill Troxler
9d5d84ebfb Refactor all mounters to use the mounter interface 2018-07-22 12:41:37 +02:00
Cyrill Troxler
093c5bf500 Use ginkgo test suite to test all mounters 2018-07-22 12:41:37 +02:00
Cyrill Troxler
0bd6f9b7cc Use new csi-test release 2018-07-22 12:41:37 +02:00
Cyrill Troxler
13eba47da6 Add experimental s3ql mounter 2018-07-22 12:39:54 +02:00
Cyrill Troxler
a165937559 Upgrade to csi 0.3.0 2018-07-16 21:32:00 +02:00
Cyrill Troxler
360d9bfe69 Rename credentials to config 2018-07-16 20:24:54 +02:00