v0.1.0-beta

Major improvements

In this release, we added transaction support and the ability to reassign queues. Moreover, this release includes numerous performance improvements.

What's Changed

• feat(issues694): add sub stream size to request by @superhx in #703
• fix: make reserve-time accurate by @lizhanhui in #704
• feat(issues690): concurrent read log cache by @superhx in #701
• fix(s3stream): fix potential dangling read ahead future by @SCNieh in #705
• feat(kafka_isssues447): add command util and update version to 0.5.2 by @superhx in #709
• refactor(s3stream/wal): init the sliding window during start by @Chillax-0v0 in #708
• feat(s3stream): command utils make run to static method by @superhx in #710
• feat: add default serverless by @superhx in #711
• feat(s3stream): 0.5.4 by @superhx in #712
• feat(s3stream): dynamically adjust read ahead speed by @SCNieh in #713
• fix: #716 invoke data-store to potentially delete S3 Object prior to rollback expired prepare-records by @lizhanhui in #717
• fix(s3stream): use lazy initialization to prevent metrics missing by @SCNieh in #724
• fix: revert ZGC option as it causes OOM due to multi-mapping of heap VMA by @lizhanhui in #723
• fix: escape dollar symbol in docker-compose.xml for linux by @lizhanhui in #721
• feat: add contributing guideline by @lizhanhui in #719
• perf(s3stream/storage): remove the single main write thread by @Chillax-0v0 in #728
• fix(s3stream): update to 0.5.6 and fix serveless cmd by @superhx in #730
• feat(s3stream): optimize cache performance by adding offset index by @superhx in #731
• fix(store): fix end offset of fetch result by @ShadowySpirits in #725
• chore: add maven-source-plugin for s3stream lib by @leizhiyuan in #707
• perf(s3stream/storage): shard callback locks by stream id by @Chillax-0v0 in #729
• feat(s3stream_kafka471): support fast read option by @superhx in #732
• fix: #733 resolve class clashes by @lizhanhui in #734
• fix: handle error when open streams by @lizhanhui in #736
• chore: release helm chart when the tag starts with helm by @wangxye in #726
• fix: include node-id in close-stream-request during forwarding requests by @lizhanhui in #738
• chore: rename release action about docker build by @wangxye in #739
• feat(s3stream): adapt to new serverless cmd by @superhx in #742
• refactor: refactor cmd line in cli by @wangxye in #744
• fix(s3stream/storage): calculate the confirm offset from unordered requests by @Chillax-0v0 in #743
• fix(s3stream): serverless cmd by @superhx in #750
• fix(kafka_issues475): do not log when fast fail by @superhx in #751
• refactor: rename wal object to stream set object by @daniel-y in #749
• perf(s3storage/wal): use PriorityQueue rather than TreeSet by @Chillax-0v0 in #753
• fix: unify controller error handling while forwarding requests to leader node by @lizhanhui in #758
• chore: support nightly build in three different versions by @wangxye in #727
• chore: update helm chart to avoid invalid value by @wangxye in #741
• chore(s3stream/wal): record metrics on block polled by @Chillax-0v0 in #760
• fix(kafka_issues447): serverless cmd by @superhx in #761
• feat(distribution): update image tag in docker-compose.yaml by @ShadowySpirits in #762
• fix(proxy): remove shaded grpc dependency by @ShadowySpirits in #759
• feat(s3stream): blockCache performance optimization by @SCNieh in #766
• chore: support for e2e run on commits by @wangxye in #755
• feat(s3stream): add boringssl dependence by @superhx in #767
• feat(s3stream/wal): pre-check the real capacity of the block device by @Chillax-0v0 in #771
• fix(kafka_issues491): ignore await after scheduled task cancel by @superhx in #770
• chore: support helm chart defaults to deploy full clusters by @wangxye in #769
• feat(s3stream): block cache memory optimization by @SCNieh in #774
• feat(s3stream): optimize compaction throttle by @SCNieh in #776
• fix(s3stream): guard BlockCache OOM handle with lock by @SCNieh in #775
• fix(s3stream): fix inflight read throttle size by @SCNieh in #778
• feat(distribution): refactor helm chart by @ShadowySpirits in #777
• chore: upgrade chart version to 0.0.4 by @wangxye in #780
• feat(kafka_issues500): add pooledbuf read options by @superhx in #782
• feat(s3stream): add inflight pooled fetch request record by @superhx in #783
• fix(s3stream): add clean up on future exception for BlockCache by @SCNieh in #781
• fix(s3stream): release records that won't be returned on exception by @SCNieh in #785
• feat(s3stream): avoid copy when operator read by @superhx in #788
• chore: update helm chart deploy for e2e test by @wangxye in #789
• feat(store): refactor TimerService and implement TransactionService by @ShadowySpirits in #790
• feat(s3stream): detect fetch timeout by @superhx in #791
• fix(s3stream): fix timeout detect by @superhx in #793
• fix(s3stream): fix potential dangling cf when read not aligned with data block by @SCNieh in #795
• fix: fix non-unique instance id in the node by @wangxye in #798
• feat(cli): add ResetConsumeOffset command by @ShadowySpirits in #800
• feat(s3stream): clean up buffer on compaction exception by @SCNieh in #799
• feat(proxy): support transaction message by @ShadowySpirits in #796
• feat(proxy): add topicStats rpc by @ShadowySpirits in #801
• feat(cli): add PrintTopicStats command by @ShadowySpirits in #802
• fix(s3Stream): support aliyun oss by @mooc9988 in #804
• feat(cli): add ProducerClientConnection command by @ShadowySpirits in #806
• feat(s3stream): smooth upload wal by @superhx in #809
• chore: fix helm chart install eof by @wangxye in #794
• feat(cli): add ConsumerClientConnection command by @ShadowySpirits in #807
• feat(proxy): add relay rpc by @ShadowySpirits in #810
• refactor(proxy): refactor DeadLetterService by @ShadowySpirits in #811
• fix(s3stream/wal): check whether the file system supports direct IO by @Chillax-0v0 in #808
• fix(proxy): add PROPERTY_PRODUCER_GROUP property for transaction message by @ShadowySpirits in #803
• test(proxy): add unit test for ProxyService by @ShadowySpirits in #813
• refactor(proxy): proxy message to the node assigned to its queue by @ShadowySpirits in #812
• refactor(proxy): proxy delay message and transaction message to the node assigned to its queue by @ShadowySpirits in #815
• fix(s3stream): bugfix on fetch data block indices of StreamReader by @SCNieh in #816
• feat(controller): reassign topic by @ShadowySpirits in #818
• feat(distribution): broker in docker will print log into console by @ShadowySpirits in #817
• fix(kafka_issues529): trim index block by @superhx in #820
• feat(proxy): optimize forward message to another node by @ShadowySpirits in #821
• fix(broker): fix MetricsExporter shutdown logic by @ShadowySpirits in #822
• perf(s3stream): not use byte arrays to reduce heap mem alloc when decoding by @Chillax-0v0 in #823
• refactor(s3stream): more complex magic code in data blocks by @Chillax-0v0 in #824
• fix(controller): fix listStreamObjects interface by @ShadowySpirits in #825
• fix(s3stream): fix potential incomplete future in StreamReader by @SCNieh in #826
• fix(proxy): fix getObjects interface by @ShadowySpirits in #827
• fix(proxy): prevent the request which do not acquire the lock fall into long polling by @ShadowySpirits in #828
• fix(s3stream): add missing inflight read key on async read ahead by @SCNieh in #829
• fix(s3stream): remove future before complete it to prevent infinite r… by @SCNieh in #830
• feat(s3stream): implement s3stream metrics with Opentelemetry by @SCNieh in #819
• build(s3stream): downgrade OT version to java8 by @SCNieh in #832

Full Changelog: v0.0.3-alpha...v0.1.0-beta