infrastructure/k8s-csi-s3
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity
218 commits 4 branches 33 tags 23 MiB
Commit graph

218 commits

This branch
This branch
All branches
Author SHA1 Message Date
Alexander Narsudinov
6a7b88e788 Increase the buffer size of objects channel in removeObjectsOneByOne 
I guess this is pretty reasonable to have the working queue with the same
size as the maximum number of workers.
 2023-10-27 20:47:25 +02:00
Alexander Narsudinov
d3e89f164b Use atomics to make writing of results safe in removeObjectsOneByOne 
Previous implementation didn't have any synchronization mechanism for
goroutines that does the work.

There are multiple approaches to make it work correctly, let's start with
the simplest - atomics.
 2023-10-27 20:05:02 +02:00
Alexander Narsudinov
da3638eb56 Fix the goroutine variable capturing in removeObjectsOneByOne 
This patch fixes classic golang for-loop variable capturing issue that
leeds to incorrect results in goroutines.

This is fixed in latest versions of golang, but this project uses go 1.15,
so it won't work as expected by an author.
 2023-10-27 19:59:03 +02:00
Vitaliy Filippov
25401592e1 Bump version to 0.38.3, following GeeseFS 
- Make long directory listings faster (remove O(N^2))
- Fix long directory listings where some files could be skipped due to inode expiration
- Remove extra empty COPY requests when metadata is not changed
- Add --fsync-on-close option for synchronous s3fs-like mode
- Fix --disable-xattr error code
- Do not try to switch between STANDARD and COLD based on the object size
 2023-09-28 11:45:36 +03:00
Vitaliy Filippov
8d1ad692e5 Add github pages helm chart URL 2023-09-13 16:53:02 +03:00
Vitaliy Filippov
16c6c0ee13
Merge pull request #70 from kopytov/mime-types 
Add /etc/mime.types to csi-s3 image
 2023-08-30 16:40:06 +03:00
Vitaliy Filippov
227e1cf2dd Publish helm chart to github pages 2023-08-28 18:41:38 +03:00
Vitaliy Filippov
40086c1ffa Bump version to 0.37.4 
- Update GeeseFS (now it also limits metadata memory usage)
- Return s3fs-fuse & rclone packages back because they are now fixed in Alpine
- Do not use hostNetwork: true for mounter... but it won't help much because GeeseFS is now started on host :)
- Publish helm chart to github pages
 2023-08-28 18:40:53 +03:00
Dmitry Kopytov
6cfd3ebbb6 Add mailcap installation to Dockerfile 2023-08-25 12:20:47 +03:00
Vitaliy Filippov
195829887a Return s3fs-fuse & rclone back, fix #68 (README) 2023-08-15 13:37:25 +03:00
Vitaliy Filippov
f7e3c21a87 Remove hostNetwork: true (#58) 2023-07-27 19:08:03 +03:00
Vitaliy Filippov
06d059bfd1 Update descriptions in the Marketplace manifest 2023-07-26 16:25:29 +03:00
Vitaliy Filippov
b630faefa7 Bump version to 0.36.2 
- Update GeeseFS
- Add CSIDriver and remove external-attacher
- Add missing mounts to Helm chart
- Allow to configure mounter in Helm chart
- Allow to configure kubelet path in Helm chart
- Add nodeSelector for provisioner in Helm chart
- Do not use os.Setenv to pass keys
- Fix minio client constructor argument
 2023-07-19 16:07:29 +03:00
Vitaliy Filippov
4af9636d19 Add missing systemd-control and stage-dir to Helm chart (fixes #62) 2023-07-19 15:59:36 +03:00
Vitaliy Filippov
44511523e2 Slightly improve property names 2023-07-06 11:36:11 +03:00
Vitaliy Filippov
dd0c0b68d5
Merge pull request #63 from ksrt12/feat-nodeSelector 
feat: add nodeSelector for provisioner
 2023-06-28 20:15:18 +03:00
Stepan Kazakov
59a7605ad8
feat: add nodeSelector for provisioner 2023-06-26 00:09:58 +03:00
Vitaliy Filippov
5a3a517315 Note about deleting attacher 2023-06-20 20:45:59 +03:00
x.zhou
6b72154ebc deploy: add CSIDriver object and remove attacher 2023-06-20 20:40:17 +03:00
Vitaliy Filippov
a43867a307 Fix perms after merging 2023-06-20 14:03:48 +03:00
Vitaliy Filippov
e334aedd0c
Merge pull request #11 from nuwang/add_mounter_and_optional_secrets 
Add support for optional secrets
 2023-06-20 13:19:38 +03:00
Vitaliy Filippov
9a04d5a6eb
Merge pull request #20 from nuwang/add_configurable_mounter 
Make mounter configurable
 2023-06-20 13:18:26 +03:00
Vitaliy Filippov
874dedcd3b
Merge pull request #34 from amonhuang/pvc-manual-options 
add manual pvc mount options
 2023-06-15 19:17:36 +03:00
Vitaliy Filippov
c7e066396b
Merge pull request #54 from NiklasRosenstein/add-helm-kubeletPath-option 
add a `kubeletPath` option to `values.yaml`
 2023-06-15 19:11:30 +03:00
Vitaliy Filippov
8539ff0a48
Merge pull request #60 from zjx20/fix/wrong-arg 
Fix the wrong argument for credentials.NewStaticV4()
 2023-06-15 16:01:47 +03:00
Niklas Rosenstein
0fb81f07e7
Update deploy/helm/values.yaml 
Co-authored-by: Kashemir001 <14910998+Kashemir001@users.noreply.github.com>
 2023-06-14 11:09:55 +02:00
x.zhou
37c35c788a fix compilation 2023-06-09 16:44:40 +08:00
x.zhou
680a649a21 Fix the wrong argument for credentials.NewStaticV4() 2023-06-09 16:10:33 +08:00
Vitaliy Filippov
519c4f0bd7
Merge pull request #57 from zjx20/fix-env 
Don't call os.Setenv()
 2023-06-05 18:49:19 +03:00
x.zhou
8ea6111b0d Don't call os.Setenv() 2023-06-03 15:36:03 +08:00
Vitaliy Filippov
4e410df6e1 Bump version to 0.35.5 2023-05-23 14:59:44 +03:00
Vitaliy Filippov
7a415ae6ab Recheck and revive staged mount when mounting it to the real path 2023-05-23 14:58:01 +03:00
Vitaliy Filippov
96818e563a Cleanup mounts after stopping them using systemd 2023-05-23 14:40:53 +03:00
Niklas Rosenstein
5dbebd01bd add a kubeletPath option to values.yaml 2023-05-18 09:40:51 +00:00
Vitaliy Filippov
3b38d545ab Bump version to 0.35.4, following GeeseFS 2023-04-26 22:57:37 +03:00
Vitaliy Filippov
259c9ca561 Remove broken test workflow 2023-04-26 22:57:37 +03:00
Vitaliy Filippov
64a443a5e2 Bump version to 0.35.3 2023-04-26 12:04:40 +03:00
Vitaliy Filippov
701c86fa4d Filter out unsafe options 2023-04-26 12:04:40 +03:00
Vitaliy Filippov
ede57438c0 Cache downloaded Go modules in Docker build, use alpine 3.17 2023-04-26 12:04:31 +03:00
Vitaliy Filippov
2927c733fb Bump version to 0.35.2, following GeeseFS 2023-04-18 16:08:38 +03:00
Vitaliy Filippov
c31204b8e4 Bump version to 0.35.1, following GeeseFS 2023-04-05 14:15:34 +03:00
Vitaliy Filippov
8ac6bd58e4 Bump version to 0.35.0 2023-03-29 13:56:05 +03:00
Vitaliy Filippov
fe02df610f #46 - Remove unneeded permissions from csi-s3 in k8s manifests 2023-03-27 18:16:16 +03:00
Vitaliy Filippov
c4031bcbc6
Merge pull request #46 from Kirillovap/remove_excess_permissions 
Remove excess permissions of csi-s3 account
 2023-03-27 18:14:55 +03:00
kirillovap
5c78b9b69d Remove excess permissions of csi-s3 account 2023-03-27 15:05:14 +03:00
Vitaliy Filippov
f4d01e12c7 Fix stage-dir - it is different on some installations which leads to csi-s3 malfunction 2023-03-15 12:04:19 +03:00
Vitaliy Filippov
c6af9556d7 Bump version to 0.34.7 
It's larger than GeeseFS version and may collide with it, but screw it,
we can invent a new versioning scheme later %)
 2023-03-07 12:47:56 +03:00
Vitaliy Filippov
ecf1031dfc Implement mounting via stage directory 
Previously, multiple containers with the same mounted volume resulted in multiple
FUSE processes. This behaviour was breaking parallel modifications from different
containers, consumed extra resources, and after mounting via systemd was introduced,
led to the total inability to mount the same volume into multiple containers on
the same host.

Now only one FUSE process is started per volume, per host.
 2023-03-07 00:49:12 +03:00
Vitaliy Filippov
1305b20bae Bump version to 0.34.6 2023-03-04 13:09:49 +03:00
Vitaliy Filippov
2ad5d21714 Drop geesefs root privileges 2023-03-04 13:04:03 +03:00