COSBench - Cloud Object Storage Benchmark

COSBench is a benchmarking tool to measure the performance of Cloud Object Storage services. Object storage is an emerging technology that is different from traditional file systems (e.g., NFS) or block device systems (e.g., iSCSI). Amazon S3 and Openstack* swift are well-known object storage solutions.

COSBench now supports SineIO*, OpenStack* Swift, Amazon* S3, OpenIO*, Amplidata v2.3, 2.5 and 3.1, Scality*, Ceph, CDMI, Google* Cloud Storage, Aliyun OSS as well as custom adaptors.

Announcement

Because of In Maintenance Mode as of July 31, 2024 and End-of-Support on December 31, 2025, so the milestone version of cosbench-sineio (v0.6.0.0 released at 2024.8.31) changed as follows:

1. sio renamed to siov1, and will not be maintained.
2. siov2 renamed to sio, as a LTS Storage.

LTS

• AWS SDK version will be updated monthly for SineIO if needed.

COSBench Storages Comparision

1. SineIO is S3 storage and hardware can be 'fullstack' (NVMe, SSD, HDD, Tape, Disc, etc.)
2. sio and siov1: Usage, please refer to conf/sio-config-sample.xml

Work/Operations/Features/SDK version	Storage type: s3	Storage type: siov1	Storage type: sio
init	✔️	✔️	✔️
prepare	✔️	✔️	✔️
⭐[New Work]: mprepare	❌	✔️	✔️
write	✔️	✔️	✔️
⭐[New Operation]: mwrite	❌	✔️	✔️
read	✔️	✔️	✔️
filewrite	✔️	✔️	✔️
⭐[New Operation]: mfilewrite	❌	✔️	✔️
⭐[New Operation]: restore	❌	✔️	✔️
⭐[New Operation]: head	❌	✔️	✔️
delete	✔️	✔️	✔️
cleanup	have 🐛	✔️	✔️
dispose	have 🐛	✔️	✔️
list	have 🐛	✔️	✔️
⭐[New Feature]: no_verify_ssl	❌	✔️	✔️
⭐[New Feature]: aws_region	no need	no need	✔️
⭐[New Feature]: s3-range-and-prefetch	❌	✔️	TODO
⭐[New Feature]: GiB, MiB, KiB	❌	✔️	✔️
⭐[New Feature]: storage_class	❌	✔️	✔️
⭐[New Feature]: restore_days	❌	✔️	✔️
⭐[SDK version]: aws-sdk-java	1.10.76	🌟1.12.767	-
⭐[SDK version]: aws-sdk-java-v2	-	-	🌟2.26.8
⭐[New Feature]: localwrite	❌	✔️	✔️

Important Notice and Contact Information

a) COSBench is not a product, and it does not have a full-time support team. Before you use this tool, please understand the need to invest enough effort to learn how to use it effectively and to address possible bugs.

b) To help COSBench develop further, please become an active member of the community and consider giving back by making contributions.

c) Tutorial, writing in Chinese with 💖: https://www.sineio.top/byte-of-cosbench/#/

d) Email: sinecelia.wang@gmail.com

e) WeChat/Twitter: SineCelia

Licensing

a) Intel source code is being released under the Apache 2.0 license.

b) SineIO source code is being released under the MIT license.

c) Additional libraries used with COSBench have their own licensing; refer to 3rd-party-licenses.pdf for details.

Distribution Packages

Please refer to "DISTRIBUTIONS.md" to get the link for distribution packages.

Installation & Usage

Please refer to "COSBenchUserGuide.pdf" for details.

🌟Version more than or equal to 0.4.7.9: should install telnet

Version less than 0.4.7.9: should install nmap-ncat

Adaptor Development

If needed, adaptors can be developed for new storage services; please refer to "COSBenchAdaptorDevGuide.pdf" for details.

Build

If a build from source code is needed, please refer to BUILD.md for details.

Resources

Wiki: (https://github.com/sine-io/cosbench-sineio/wiki)

Issue tracking: (https://github.com/sine-io/cosbench-sineio/issues)

*Other names and brands may be claimed as the property of others.

Other related projects

COSBench-Workload-Generator: (https://github.com/giteshnandre/COSBench-Workload-Generator)

COSBench-Plot: (https://github.com/icclab/cosbench-plot)

COSBench-Appliance: (https://susestudio.com/a/8Kp374/cosbench)

COSBench Ansible Playbook:

• (http://www.ksingh.co.in/blog/2016/05/29/deploy-cosbench-using-ansible/)
• (https://github.com/ksingh7/ansible-role-cosbench)
• (https://galaxy.ansible.com/ksingh7/cosbench/)

= END =