infrastructure/k8s-csi-s3
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity
210 commits 4 branches 33 tags 23 MiB
Commit graph

210 commits

This branch
This branch
All branches
Author SHA1 Message Date
Ching Yi, Chan
bafce00b3d Migrate to StatefulSet app/v1 
Signed-off-by: Ching Yi, Chan <qrtt1@infuseai.io>
 2020-06-03 12:05:20 +08:00
Andrew Gaul
09e4e0b3ec Remove incorrect s3fs limitation 
Source: https://github.com/s3fs-fuse/s3fs-fuse#features
 2020-02-24 18:18:13 +09:00
Cyrill Troxler
6a23dbae72
Merge pull request #22 from CarlQLange/new-with-region 
Use NewWithRegion not minio's region resolution
 2019-07-26 02:56:09 +02:00
Carl Lange
95962c2412
Use NewWithRegion not minio's region resolution 2019-06-30 16:32:59 +01:00
Cyrill Troxler
fb6584d7e4 Release new version 2019-05-18 11:55:37 +02:00
Cyrill Troxler
29c10b9418
Merge pull request #19 from ctrox/cleanup 
Clean up old references to encryptionKey and fix up deployment
 2019-05-18 11:51:26 +02:00
Cyrill Troxler
a0902d86a0 Deploy to kube-system by default 2019-05-18 11:43:12 +02:00
Cyrill Troxler
e133baaba1 Clean up old references to encryptionKey 2019-05-16 18:15:45 +02:00
Cyrill Troxler
b59a7f2185
Merge pull request #18 from ctrox/secrets 
Supply credentials using volume secrets instead of cli config
 2019-05-15 21:23:43 +02:00
Cyrill Troxler
2d3c8be65b Update README 2019-05-15 21:14:18 +02:00
Cyrill Troxler
f80104f215 Remove s3ql 
s3ql does not work very well in a dynamic environment like k8s.
Also as it needs a ton of dependencies just to get it built makes
it hard to maintain.
 2019-05-15 21:06:28 +02:00
Cyrill Troxler
76fc704c31 Do not use sigv2 with s3fs 2019-05-15 21:00:16 +02:00
Cyrill Troxler
cc38b81678 Add log message when mounting 2019-05-15 21:00:16 +02:00
Cyrill Troxler
152eeb1d14 Update README and deployment, split up dockerfile 2019-05-15 21:00:16 +02:00
Cyrill Troxler
c6b3b5199d Upgrade csi-spec, fix tests 2019-05-15 21:00:16 +02:00
Cyrill Troxler
4e8bbf0126 Supply credentials using volume secrets instead of cli config 2019-05-15 21:00:02 +02:00
Cyrill Troxler
ea4022e9c6
Add rclone mounter (#15) 2019-03-07 20:27:02 +01:00
Cyrill Troxler
9eeb6021a4
Switch to go modules (#13) 2019-03-02 11:03:07 +01:00
Cyrill Troxler
95d7e48328
Revert capabilites to only allow RWO (#12) 2019-02-28 21:09:56 +01:00
Lennard
83723f4be0 Feature/update to csi 1.0 (#9) 
* updated all image to v1.0.1 csi

* Updated golang code to csi 1.0 compatible names

* added comment
 2019-02-28 19:34:03 +01:00
Cyrill Troxler
58912e4734 Sanitize the volumeID before creation 
* Bucket names cannot contain upper case letters
* Bucket names cannot be longer than 63 chars
 2019-02-06 20:02:28 +01:00
Cyrill Troxler
728ef7d7e7 Fix s3backer with AWS 
If we set baseURL with AWS s3backer will fail to authenticate.
 2019-01-19 14:43:54 +01:00
Cyrill Troxler
709162c21b Set correct vendor version and display it on launch 2019-01-19 14:40:58 +01:00
Cyrill Troxler
d8f966a3de Improve bucket error messages 2019-01-19 14:39:33 +01:00
Cyrill Troxler
6989c5b01f Update README 2018-08-06 19:27:24 +02:00
Cyrill Troxler
90101de40a Increase version for release 2018-08-04 14:14:45 +02:00
Cyrill Troxler
9291d09baa
Add ci pipeline with GitLab (#3) 
* Add automated testing
* Create loop device while staging s3backer
 2018-08-03 20:30:46 +02:00
Cyrill Troxler
f603d84fc5 Increase version for release 2018-07-29 16:26:02 +02:00
Cyrill Troxler
59baca136c Add comment about AWS endpoint URL 2018-07-29 16:19:40 +02:00
Cyrill Troxler
8a31ac89c9 Improve bucket error messages 2018-07-29 16:19:26 +02:00
Cyrill Troxler
c90763940a Update README 2018-07-29 14:54:28 +02:00
Cyrill Troxler
df04f577d2 Rename to just csi-s3 2018-07-29 14:49:35 +02:00
Cyrill Troxler
165b9d795f Put everything into one docker container 2018-07-29 14:36:41 +02:00
Cyrill Troxler
c7abe28ade Allow configuring mounter via storageclass parameter 2018-07-29 14:36:13 +02:00
Cyrill Troxler
4b82c93978
Merge pull request #2 from CTrox/bucket_prefix 
Add fs prefix (directory)
 2018-07-29 09:21:32 +02:00
Cyrill Troxler
e46440d1fa Add fs prefix (directory) 
This ensures the fs root is clean and does not mess with
the metadata. Also in the future this will allow for multiple
filesystems to be created in one bucket.
 2018-07-27 21:37:32 +02:00
Cyrill Troxler
66390f76b7
Merge pull request #1 from CTrox/s3backer_mounter 
Add s3backer mounter
 2018-07-27 21:32:17 +02:00
Cyrill Troxler
87da8c6d21 Add section about s3backer to README 2018-07-27 13:34:24 +02:00
Cyrill Troxler
59481b756a Set s3backer Dockerfile as default 2018-07-27 13:29:02 +02:00
Cyrill Troxler
1caf469966 Implement a metadata file and correct sizing 
As the controller does not mount/create the fs we have to store the capacity somewhere so the node knows about it.
 2018-07-27 13:28:52 +02:00
Cyrill Troxler
db0fbf77dd Update kubernetes deployment 2018-07-26 22:47:36 +02:00
Cyrill Troxler
3f83f7fe36 Add s3fs to Dockerfile.s3backer 2018-07-26 22:46:30 +02:00
Cyrill Troxler
0010066fe3 Implement stage/unstage 
This helps the reliability of s3backer as the fuse mount
is done on NodeStageVolume and only once per volume per
node.
 2018-07-26 22:43:51 +02:00
Cyrill Troxler
1fe218a568 Format using nodeserver, not controller 2018-07-26 20:13:40 +02:00
Cyrill Troxler
f8bd74afb9 Fix log output 2018-07-23 20:58:25 +02:00
Cyrill Troxler
a468d955bc Check for defunct process before waiting for it 2018-07-23 20:58:25 +02:00
Cyrill Troxler
82ab4b0983 Add experimental s3backer mounter 
This also adds some generic handling of stale umounts.
Fuse returns immediately and does not indicate that
the mounter has finished writing to the backend.
The process finding is sort of hacky as I could not
find a better way to get to the PID from a fuse mount.
 2018-07-23 20:58:25 +02:00
Cyrill Troxler
108364fb88 Merge branch 's3ql_mounter' 2018-07-22 13:00:14 +02:00
Cyrill Troxler
626f451184 Update README 2018-07-22 12:59:30 +02:00
Cyrill Troxler
c4880a2bdc Add ps util to container 2018-07-22 12:41:37 +02:00