infrastructure/k8s-csi-s3
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity
201 commits 4 branches 33 tags 23 MiB
Commit graph

201 commits

This branch
This branch
All branches
Author SHA1 Message Date
Cyrill Troxler
2d3c8be65b Update README 2019-05-15 21:14:18 +02:00
Cyrill Troxler
f80104f215 Remove s3ql 
s3ql does not work very well in a dynamic environment like k8s.
Also as it needs a ton of dependencies just to get it built makes
it hard to maintain.
 2019-05-15 21:06:28 +02:00
Cyrill Troxler
76fc704c31 Do not use sigv2 with s3fs 2019-05-15 21:00:16 +02:00
Cyrill Troxler
cc38b81678 Add log message when mounting 2019-05-15 21:00:16 +02:00
Cyrill Troxler
152eeb1d14 Update README and deployment, split up dockerfile 2019-05-15 21:00:16 +02:00
Cyrill Troxler
c6b3b5199d Upgrade csi-spec, fix tests 2019-05-15 21:00:16 +02:00
Cyrill Troxler
4e8bbf0126 Supply credentials using volume secrets instead of cli config 2019-05-15 21:00:02 +02:00
Cyrill Troxler
ea4022e9c6
Add rclone mounter (#15) 2019-03-07 20:27:02 +01:00
Cyrill Troxler
9eeb6021a4
Switch to go modules (#13) 2019-03-02 11:03:07 +01:00
Cyrill Troxler
95d7e48328
Revert capabilites to only allow RWO (#12) 2019-02-28 21:09:56 +01:00
Lennard
83723f4be0 Feature/update to csi 1.0 (#9) 
* updated all image to v1.0.1 csi

* Updated golang code to csi 1.0 compatible names

* added comment
 2019-02-28 19:34:03 +01:00
Cyrill Troxler
58912e4734 Sanitize the volumeID before creation 
* Bucket names cannot contain upper case letters
* Bucket names cannot be longer than 63 chars
 2019-02-06 20:02:28 +01:00
Cyrill Troxler
728ef7d7e7 Fix s3backer with AWS 
If we set baseURL with AWS s3backer will fail to authenticate.
 2019-01-19 14:43:54 +01:00
Cyrill Troxler
709162c21b Set correct vendor version and display it on launch 2019-01-19 14:40:58 +01:00
Cyrill Troxler
d8f966a3de Improve bucket error messages 2019-01-19 14:39:33 +01:00
Cyrill Troxler
6989c5b01f Update README 2018-08-06 19:27:24 +02:00
Cyrill Troxler
90101de40a Increase version for release 2018-08-04 14:14:45 +02:00
Cyrill Troxler
9291d09baa
Add ci pipeline with GitLab (#3) 
* Add automated testing
* Create loop device while staging s3backer
 2018-08-03 20:30:46 +02:00
Cyrill Troxler
f603d84fc5 Increase version for release 2018-07-29 16:26:02 +02:00
Cyrill Troxler
59baca136c Add comment about AWS endpoint URL 2018-07-29 16:19:40 +02:00
Cyrill Troxler
8a31ac89c9 Improve bucket error messages 2018-07-29 16:19:26 +02:00
Cyrill Troxler
c90763940a Update README 2018-07-29 14:54:28 +02:00
Cyrill Troxler
df04f577d2 Rename to just csi-s3 2018-07-29 14:49:35 +02:00
Cyrill Troxler
165b9d795f Put everything into one docker container 2018-07-29 14:36:41 +02:00
Cyrill Troxler
c7abe28ade Allow configuring mounter via storageclass parameter 2018-07-29 14:36:13 +02:00
Cyrill Troxler
4b82c93978
Merge pull request #2 from CTrox/bucket_prefix 
Add fs prefix (directory)
 2018-07-29 09:21:32 +02:00
Cyrill Troxler
e46440d1fa Add fs prefix (directory) 
This ensures the fs root is clean and does not mess with
the metadata. Also in the future this will allow for multiple
filesystems to be created in one bucket.
 2018-07-27 21:37:32 +02:00
Cyrill Troxler
66390f76b7
Merge pull request #1 from CTrox/s3backer_mounter 
Add s3backer mounter
 2018-07-27 21:32:17 +02:00
Cyrill Troxler
87da8c6d21 Add section about s3backer to README 2018-07-27 13:34:24 +02:00
Cyrill Troxler
59481b756a Set s3backer Dockerfile as default 2018-07-27 13:29:02 +02:00
Cyrill Troxler
1caf469966 Implement a metadata file and correct sizing 
As the controller does not mount/create the fs we have to store the capacity somewhere so the node knows about it.
 2018-07-27 13:28:52 +02:00
Cyrill Troxler
db0fbf77dd Update kubernetes deployment 2018-07-26 22:47:36 +02:00
Cyrill Troxler
3f83f7fe36 Add s3fs to Dockerfile.s3backer 2018-07-26 22:46:30 +02:00
Cyrill Troxler
0010066fe3 Implement stage/unstage 
This helps the reliability of s3backer as the fuse mount
is done on NodeStageVolume and only once per volume per
node.
 2018-07-26 22:43:51 +02:00
Cyrill Troxler
1fe218a568 Format using nodeserver, not controller 2018-07-26 20:13:40 +02:00
Cyrill Troxler
f8bd74afb9 Fix log output 2018-07-23 20:58:25 +02:00
Cyrill Troxler
a468d955bc Check for defunct process before waiting for it 2018-07-23 20:58:25 +02:00
Cyrill Troxler
82ab4b0983 Add experimental s3backer mounter 
This also adds some generic handling of stale umounts.
Fuse returns immediately and does not indicate that
the mounter has finished writing to the backend.
The process finding is sort of hacky as I could not
find a better way to get to the PID from a fuse mount.
 2018-07-23 20:58:25 +02:00
Cyrill Troxler
108364fb88 Merge branch 's3ql_mounter' 2018-07-22 13:00:14 +02:00
Cyrill Troxler
626f451184 Update README 2018-07-22 12:59:30 +02:00
Cyrill Troxler
c4880a2bdc Add ps util to container 2018-07-22 12:41:37 +02:00
Cyrill Troxler
b412e81977 Fix s3ql unmount 2018-07-22 12:41:37 +02:00
Cyrill Troxler
8cd8f6b6cd Mounter can now only be specified through flag 2018-07-22 12:41:37 +02:00
Cyrill Troxler
9d5d84ebfb Refactor all mounters to use the mounter interface 2018-07-22 12:41:37 +02:00
Cyrill Troxler
093c5bf500 Use ginkgo test suite to test all mounters 2018-07-22 12:41:37 +02:00
Cyrill Troxler
0bd6f9b7cc Use new csi-test release 2018-07-22 12:41:37 +02:00
Cyrill Troxler
13eba47da6 Add experimental s3ql mounter 2018-07-22 12:39:54 +02:00
Cyrill Troxler
a165937559 Upgrade to csi 0.3.0 2018-07-16 21:32:00 +02:00
Cyrill Troxler
360d9bfe69 Rename credentials to config 2018-07-16 20:24:54 +02:00
Cyrill Troxler
f16c868b2a Update README 2018-07-14 10:52:55 +02:00