v2.0.0

Gen2 Overview

• DSS can now be deployed with gen2 mode, which utilizes RDD (RDMA Data Direct).
  • This feature enables clients to transfer object data directly from DSS targets without the need to go through the MinIO servers.
  • This allows better performance, as well as improved network and memory resource utilization in the DSS Stack.
  • This feature is integrated with DSS Client APIs and allows for seamless integration with applications using the thin DSS client library.
• To deploy DSS with gen2 mode enabled, it is required that both front-end (in tcp_ip_list) and back-end (in rocev2_ip_list) IP addresses be from RDMA-enabled network interfaces. See dss-ansible README for details.
• dss-ansible will deploy DSS in "gen2" mode simply by setting gen2=true in your Ansible inventory file. The default value is false, which will deploy DSS in gen1 mode (not using the RDD feature, does not require RDMA front-end network).

What's Changed

• Setting socket option to reuse address for socket connection to resolve TCP TIME_WAIT blocker from recent runs of Data Mover by @nsarras in #11
• Fixing payload misalignment/corruption issue by @nsarras in #14
• Added extra None message when the logger is stopped. This will break … by @grandsuri in #15
• Adding user configurable socket options by @nsarras in #17
• Added support to run DM with IPv4 or IPv6 or both. by @grandsuri in #21
• Adding Pytest Framework and initial Pytest unittests to DataMover by @nsarras in #23
• Changing logic to return payload as json in the case of any exception depending on received bytes by @nsarras in #20
• Added simple test tool to perform object upload, download, verify by @grandsuri in #12
• Fix for MIN-1312: Graceful exit of DataMover for invalid prefix by @sohomb91 in #25
• MIN-1540: Fixed the logger to use QueueHandler and RotatingFileHandler by @grandsuri in #26
• Adding NFS CLI arg options and NFS port by @nsarras in #31
• Modifying compaction option to be yes/no from either config file or CLI by @nsarras in #32
• Fixing bug in not specifying NFS CLI options by @nsarras in #41
• Fix for hanging application, Submitting on behalf of Eric by @nsarras in #39
• Add dynamic reusable workflows by @velomatt in #42
• Add stagemergeartifacts by @velomatt in #49
• Gen2 based changes for DSS Client, benchmarks etc by @grandsuri in #28
• Added the flags to link librdd_cl.so and libdss.so properly from the artifacts/repos by @grandsuri in #51
• 37 datamover add flexibility to prefix structure to work without nfs server name by @nsarras in #43
• Adding & saving progress on dss_metrics module by @nsarras in #45
• Add tests to artifact by @velomatt in #52
• Fixing metrics agent bug for parsing and populating metrics objects for all subsystems by @nsarras in #54
• Updated the s3-benchmark binary compiled with librdd_cl and libdss_client by @grandsuri in #55

New Contributors

• @grandsuri made their first contribution in #15
• @sohomb91 made their first contribution in #25

Full Changelog: v1.0.0...v2.0.0

Known Issues

• datamover - target compaction may be unintentially triggered in dry-run mode
• datamover - cache files are generated in dry-run mode causing subsequent PUTs to be skipped
  • workaround: delete the /var/log/dss/prefix_index_data.json file after dry-run