Support clusters using third-party S3-like services

[ehsan310]

/feature

Is your feature request related to a problem? Please describe.
It is not possible to use S3 clusters out of AWS

Describe the solution you'd like in detail
It would be nice to support S3 Compatible interfaces for locally deployed clusters like Ceph

Describe alternatives you've considered
Had to run a sidecar container along with deployment and use s3fs instead.

[dannycjones]

Hey @ehsan310, thanks for opening an issue.

While we don't provide support for S3-like services, we do welcome contributions of minor compatibility fixes or performance improvements for these services if the changes can be tested against Amazon S3. We had a similar issue over on the Mountpoint repository awslabs/mountpoint-s3#144 where you can read more.

I'm aware of some features not supported by some S3-like services such as additional checksums. Mountpoint uses CRC32C by default but where the S3-like service doesn't support it, it is possible to disable using --upload-checksums off. This was added partly for this issue: awslabs/mountpoint-s3#853.

If you can identity why the mount is failing from the logs, that may be useful for those coming across this issue in future. Information on logging in Mountpoint with the CSI driver can be found in our docs: https://github.com/awslabs/mountpoint-s3-csi-driver/blob/main/docs/LOGGING.md.