Skip to content

KAFKA-17569: Rewrite TestLinearWriteSpeed by Java #17736

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
chia7712 merged 3 commits into from
Nov 26, 2024
Merged

KAFKA-17569: Rewrite TestLinearWriteSpeed by Java #17736

chia7712 merged 3 commits into from
Nov 26, 2024

Conversation

@frankvicky
Copy link
Contributor

@frankvicky frankvicky commented Nov 10, 2024

JIRA: KAFKA-17569

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@github-actions github-actions bot added core Kafka Broker performance build Gradle build or GitHub Actions labels Nov 10, 2024
@frankvicky
Copy link
Contributor Author

frankvicky commented Nov 10, 2024 •
edited
Loading

Test with --bytes 100000000 --size 10 --files 1 --channel 1

> Task :jmh-benchmarks:org.apache.kafka.jmh.log.TestLinearWriteSpeed.main()
    mb_sec	avg_latency	max_latency
    22.470	     0.000	     0.406
    22.341	     0.000	     0.124
    22.296	     0.000	     0.113
    21.921	     0.000	     0.111
22.21302268753944 MB per sec

Test with --bytes 100000000 --size 4096 --files 1 --channel 1

> Task :jmh-benchmarks:org.apache.kafka.jmh.log.TestLinearWriteSpeed.main()
    mb_sec	avg_latency	max_latency
2187.074699536301 MB per sec

@chia7712 chia7712 merged commit 0e4d8b3 into apache:trunk Nov 26, 2024
6 checks passed
chiacyu pushed a commit to chiacyu/kafka that referenced this pull request Nov 30, 2024
@frankvicky @chiacyu
KAFKA-17569 Rewrite TestLinearWriteSpeed by Java (apache#17736)
b65aa66 
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
tedyu pushed a commit to tedyu/kafka that referenced this pull request Jan 6, 2025
@frankvicky @tedyu
KAFKA-17569 Rewrite TestLinearWriteSpeed by Java (apache#17736)
b295427 
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
@see-quick see-quick mentioned this pull request Aug 13, 2025
Merged
chia7712 pushed a commit that referenced this pull request Aug 17, 2025
@see-quick
MINOR: Fix the compression arguments in TestLinearWriteSpeed (#20349)
93068b4 
This PR fixes a problem related to `TestLinearWriteSpeed`.  During my
work on KIP-780, I discovered that benchmarks for `TestLinearWriteSpeed`
do not account for compression algorithms. It always uses
`Compression.NONE` when creating records. The problem was introduced in
this PR [1].

[1] - #17736

Reviewers: Ken Huang <s7133700@gmail.com>, Mickael Maison
<mickael.maison@gmail.com>, Chia-Ping Tsai <chia7712@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@chia7712 chia7712 chia7712 approved these changes

Assignees

No one assigned

Labels

build Gradle build or GitHub Actions ci-approved core Kafka Broker performance

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@frankvicky @chia7712 @FrankYang0529