Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

The write latency experiences spikes #630

Open
Chillax-0v0 opened this issue Nov 14, 2023 · 1 comment
Open

The write latency experiences spikes #630

Chillax-0v0 opened this issue Nov 14, 2023 · 1 comment
Assignees
@Chillax-0v0
Labels
enhancement New feature or request s3stream wal the WAL of S3 stream

Comments

@Chillax-0v0
Copy link
Contributor 

ubuntu@ip-10-0-0-182:~$ sudo java -ea -cp s3stream-0.3.0-SNAPSHOT-jar-with-dependencies.jar com.automq.stream.s3.wal.benchmark.WriteBench -p /mnt/data/testfile --duration 30000 --throughput 120000000 --record-size 40960 -d 8 --threads 1
SLF4J: No SLF4J providers were found.
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See https://www.slf4j.org/codes.html#noProviders for further details.
SLF4J: Class path contains SLF4J bindings targeting slf4j-api versions 1.7.x or earlier.
SLF4J: Ignoring binding found at [jar:file:/home/ubuntu/s3stream-0.3.0-SNAPSHOT-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See https://www.slf4j.org/codes.html#ignoredBindings for an explanation.
Starting benchmark
Append task 0 started
Append task | Append Rate 2893 msg/s 115745 KB/s | Avg Latency 2.857 ms | Max Latency 40.218 ms
Append task | Append Rate 2927 msg/s 117085 KB/s | Avg Latency 2.285 ms | Max Latency 11.472 ms
Append task | Append Rate 2929 msg/s 117165 KB/s | Avg Latency 2.384 ms | Max Latency 11.595 ms
Append task | Append Rate 2926 msg/s 117071 KB/s | Avg Latency 2.066 ms | Max Latency 7.350 ms
Append task | Append Rate 2935 msg/s 117402 KB/s | Avg Latency 2.271 ms | Max Latency 7.840 ms
Append task | Append Rate 2925 msg/s 117039 KB/s | Avg Latency 2.395 ms | Max Latency 6.877 ms
Append task | Append Rate 2928 msg/s 117159 KB/s | Avg Latency 2.463 ms | Max Latency 8.468 ms
Append task | Append Rate 2930 msg/s 117201 KB/s | Avg Latency 2.392 ms | Max Latency 7.575 ms
Append task | Append Rate 2924 msg/s 116998 KB/s | Avg Latency 2.126 ms | Max Latency 10.940 ms
Append task | Append Rate 2930 msg/s 117201 KB/s | Avg Latency 2.207 ms | Max Latency 7.735 ms
Append task | Append Rate 2922 msg/s 116880 KB/s | Avg Latency 2.060 ms | Max Latency 9.226 ms
Append task | Append Rate 2931 msg/s 117277 KB/s | Avg Latency 2.044 ms | Max Latency 9.083 ms
Append task | Append Rate 2933 msg/s 117320 KB/s | Avg Latency 2.074 ms | Max Latency 7.380 ms
Append task | Append Rate 2923 msg/s 116921 KB/s | Avg Latency 2.175 ms | Max Latency 8.095 ms
Append task | Append Rate 2929 msg/s 117160 KB/s | Avg Latency 2.084 ms | Max Latency 16.531 ms
Append task | Append Rate 2933 msg/s 117324 KB/s | Avg Latency 2.171 ms | Max Latency 15.610 ms
Append task | Append Rate 2922 msg/s 116911 KB/s | Avg Latency 2.043 ms | Max Latency 9.941 ms
Append task | Append Rate 2932 msg/s 117286 KB/s | Avg Latency 2.048 ms | Max Latency 8.212 ms
Append task | Append Rate 2927 msg/s 117117 KB/s | Avg Latency 1.919 ms | Max Latency 7.609 ms
Append task | Append Rate 2928 msg/s 117120 KB/s | Avg Latency 2.052 ms | Max Latency 8.172 ms
Append task | Append Rate 2929 msg/s 117199 KB/s | Avg Latency 2.187 ms | Max Latency 8.110 ms
Append task | Append Rate 2927 msg/s 117116 KB/s | Avg Latency 1.970 ms | Max Latency 6.888 ms
Append task | Append Rate 2930 msg/s 117203 KB/s | Avg Latency 2.006 ms | Max Latency 8.027 ms
Append task | Append Rate 2927 msg/s 117119 KB/s | Avg Latency 2.119 ms | Max Latency 7.343 ms
Append task | Append Rate 2924 msg/s 116960 KB/s | Avg Latency 2.378 ms | Max Latency 9.470 ms
Append task | Append Rate 2931 msg/s 117279 KB/s | Avg Latency 2.550 ms | Max Latency 8.539 ms
Append task | Append Rate 2932 msg/s 117319 KB/s | Avg Latency 2.344 ms | Max Latency 6.545 ms
Append task | Append Rate 2923 msg/s 116947 KB/s | Avg Latency 2.353 ms | Max Latency 8.471 ms
Append task | Append Rate 2933 msg/s 117332 KB/s | Avg Latency 2.452 ms | Max Latency 9.382 ms
Append task | Append Rate 2927 msg/s 117118 KB/s | Avg Latency 2.206 ms | Max Latency 8.764 ms
Append task | Append Rate 2928 msg/s 117121 KB/s | Avg Latency 2.009 ms | Max Latency 7.264 ms
Append task | Append Rate 2931 msg/s 117243 KB/s | Avg Latency 2.010 ms | Max Latency 7.122 ms
Append task | Append Rate 2925 msg/s 117000 KB/s | Avg Latency 2.056 ms | Max Latency 8.263 ms
Append task | Append Rate 2928 msg/s 117155 KB/s | Avg Latency 2.076 ms | Max Latency 11.677 ms
Append task | Append Rate 2928 msg/s 117122 KB/s | Avg Latency 2.116 ms | Max Latency 8.071 ms
Append task | Append Rate 2928 msg/s 117122 KB/s | Avg Latency 2.115 ms | Max Latency 9.052 ms
Append task | Append Rate 2925 msg/s 117035 KB/s | Avg Latency 2.861 ms | Max Latency 30.718 ms
Append task | Append Rate 2935 msg/s 117402 KB/s | Avg Latency 2.179 ms | Max Latency 9.630 ms
Append task | Append Rate 2920 msg/s 116837 KB/s | Avg Latency 2.259 ms | Max Latency 7.382 ms
Append task | Append Rate 2938 msg/s 117522 KB/s | Avg Latency 2.285 ms | Max Latency 7.748 ms
Append task | Append Rate 2924 msg/s 116997 KB/s | Avg Latency 2.446 ms | Max Latency 17.586 ms
Append task | Append Rate 2927 msg/s 117119 KB/s | Avg Latency 2.313 ms | Max Latency 7.998 ms
Append task | Append Rate 2922 msg/s 116914 KB/s | Avg Latency 2.247 ms | Max Latency 10.906 ms
Append task | Append Rate 2930 msg/s 117206 KB/s | Avg Latency 2.411 ms | Max Latency 15.301 ms
Append task | Append Rate 2935 msg/s 117427 KB/s | Avg Latency 2.103 ms | Max Latency 7.789 ms
Append task | Append Rate 2921 msg/s 116852 KB/s | Avg Latency 2.152 ms | Max Latency 12.132 ms
Append task | Append Rate 2932 msg/s 117319 KB/s | Avg Latency 2.169 ms | Max Latency 7.857 ms
Append task | Append Rate 2932 msg/s 117319 KB/s | Avg Latency 2.105 ms | Max Latency 7.370 ms
Append task | Append Rate 2925 msg/s 117000 KB/s | Avg Latency 2.067 ms | Max Latency 10.847 ms
Append task | Append Rate 2925 msg/s 117039 KB/s | Avg Latency 2.175 ms | Max Latency 8.502 ms
Append task | Append Rate 2929 msg/s 117160 KB/s | Avg Latency 2.162 ms | Max Latency 8.337 ms
Append task | Append Rate 2933 msg/s 117320 KB/s | Avg Latency 2.282 ms | Max Latency 7.419 ms
Append task | Append Rate 2924 msg/s 116975 KB/s | Avg Latency 2.149 ms | Max Latency 6.935 ms
Append task | Append Rate 2932 msg/s 117304 KB/s | Avg Latency 2.190 ms | Max Latency 7.553 ms
Append task | Append Rate 2925 msg/s 117000 KB/s | Avg Latency 2.129 ms | Max Latency 7.824 ms
Append task | Append Rate 2930 msg/s 117220 KB/s | Avg Latency 2.058 ms | Max Latency 7.351 ms
Append task | Append Rate 2931 msg/s 117259 KB/s | Avg Latency 2.063 ms | Max Latency 7.912 ms
Append task | Append Rate 2928 msg/s 117159 KB/s | Avg Latency 1.943 ms | Max Latency 8.329 ms
Append task | Append Rate 2927 msg/s 117080 KB/s | Avg Latency 2.079 ms | Max Latency 10.369 ms
Append task | Append Rate 2926 msg/s 117079 KB/s | Avg Latency 2.120 ms | Max Latency 8.259 ms
Append task | Append Rate 2928 msg/s 117159 KB/s | Avg Latency 2.140 ms | Max Latency 9.799 ms
Append task | Append Rate 2929 msg/s 117162 KB/s | Avg Latency 2.086 ms | Max Latency 8.033 ms
Append task | Append Rate 2932 msg/s 117318 KB/s | Avg Latency 2.001 ms | Max Latency 7.526 ms
Append task | Append Rate 2923 msg/s 116920 KB/s | Avg Latency 2.025 ms | Max Latency 7.012 ms
Append task | Append Rate 2933 msg/s 117320 KB/s | Avg Latency 2.154 ms | Max Latency 10.829 ms
Append task | Append Rate 2926 msg/s 117079 KB/s | Avg Latency 3.245 ms | Max Latency 40.898 ms
Append task | Append Rate 2931 msg/s 117242 KB/s | Avg Latency 1.938 ms | Max Latency 8.371 ms
Append task | Append Rate 2928 msg/s 117158 KB/s | Avg Latency 1.925 ms | Max Latency 8.342 ms
Append task | Append Rate 2924 msg/s 116960 KB/s | Avg Latency 1.866 ms | Max Latency 6.554 ms
Append task | Append Rate 2926 msg/s 117040 KB/s | Avg Latency 2.058 ms | Max Latency 8.095 ms
Append task | Append Rate 2931 msg/s 117242 KB/s | Avg Latency 2.094 ms | Max Latency 7.268 ms
Append task | Append Rate 2933 msg/s 117342 KB/s | Avg Latency 1.994 ms | Max Latency 6.661 ms
Append task | Append Rate 2924 msg/s 116973 KB/s | Avg Latency 2.065 ms | Max Latency 7.938 ms
Append task | Append Rate 2928 msg/s 117120 KB/s | Avg Latency 2.101 ms | Max Latency 7.321 ms
Append task | Append Rate 2930 msg/s 117200 KB/s | Avg Latency 2.076 ms | Max Latency 7.418 ms
Append task | Append Rate 2925 msg/s 117038 KB/s | Avg Latency 2.158 ms | Max Latency 8.121 ms
Append task | Append Rate 2930 msg/s 117201 KB/s | Avg Latency 1.955 ms | Max Latency 7.974 ms
Append task | Append Rate 2931 msg/s 117279 KB/s | Avg Latency 2.013 ms | Max Latency 6.995 ms
Append task | Append Rate 2928 msg/s 117120 KB/s | Avg Latency 2.022 ms | Max Latency 7.848 ms
Append task | Append Rate 2927 msg/s 117119 KB/s | Avg Latency 1.922 ms | Max Latency 7.384 ms
Append task | Append Rate 2926 msg/s 117079 KB/s | Avg Latency 2.111 ms | Max Latency 8.722 ms
Append task | Append Rate 2931 msg/s 117244 KB/s | Avg Latency 2.304 ms | Max Latency 7.183 ms
Append task | Append Rate 2928 msg/s 117155 KB/s | Avg Latency 2.137 ms | Max Latency 8.283 ms
Append task | Append Rate 2926 msg/s 117040 KB/s | Avg Latency 2.283 ms | Max Latency 8.130 ms
Append task | Append Rate 2930 msg/s 117239 KB/s | Avg Latency 2.397 ms | Max Latency 8.221 ms
Append task | Append Rate 2926 msg/s 117077 KB/s | Avg Latency 2.289 ms | Max Latency 8.792 ms
Append task | Append Rate 2932 msg/s 117282 KB/s | Avg Latency 2.293 ms | Max Latency 8.386 ms
Append task | Append Rate 2927 msg/s 117119 KB/s | Avg Latency 2.331 ms | Max Latency 6.786 ms
Append task | Append Rate 2928 msg/s 117120 KB/s | Avg Latency 2.125 ms | Max Latency 7.632 ms
Append task | Append Rate 2929 msg/s 117199 KB/s | Avg Latency 1.987 ms | Max Latency 6.625 ms
Append task | Append Rate 2923 msg/s 116932 KB/s | Avg Latency 2.078 ms | Max Latency 7.791 ms
Append task | Append Rate 2934 msg/s 117387 KB/s | Avg Latency 1.981 ms | Max Latency 8.625 ms
Append task | Append Rate 2922 msg/s 116880 KB/s | Avg Latency 2.115 ms | Max Latency 9.166 ms
Append task | Append Rate 2930 msg/s 117222 KB/s | Avg Latency 2.078 ms | Max Latency 8.395 ms
Append task | Append Rate 2933 msg/s 117337 KB/s | Avg Latency 2.105 ms | Max Latency 8.095 ms
Append task | Append Rate 2922 msg/s 116919 KB/s | Avg Latency 2.027 ms | Max Latency 7.747 ms
Append task | Append Rate 2935 msg/s 117400 KB/s | Avg Latency 2.079 ms | Max Latency 8.949 ms
Append task | Append Rate 2928 msg/s 117159 KB/s | Avg Latency 2.273 ms | Max Latency 14.880 ms
Append task | Append Rate 2923 msg/s 116920 KB/s | Avg Latency 2.193 ms | Max Latency 15.042 ms
Append task | Append Rate 2932 msg/s 117280 KB/s | Avg Latency 2.104 ms | Max Latency 7.328 ms
Append task | Append Rate 2926 msg/s 117079 KB/s | Avg Latency 2.147 ms | Max Latency 6.461 ms
Append task | Append Rate 2932 msg/s 117319 KB/s | Avg Latency 2.038 ms | Max Latency 7.778 ms
Append task | Append Rate 2925 msg/s 117039 KB/s | Avg Latency 2.099 ms | Max Latency 7.223 ms
Append task | Append Rate 2930 msg/s 117200 KB/s | Avg Latency 2.047 ms | Max Latency 7.099 ms
Append task | Append Rate 2926 msg/s 117079 KB/s | Avg Latency 2.098 ms | Max Latency 8.778 ms
Append task | Append Rate 2928 msg/s 117120 KB/s | Avg Latency 2.002 ms | Max Latency 9.156 ms
Append task | Append Rate 2927 msg/s 117119 KB/s | Avg Latency 2.155 ms | Max Latency 7.812 ms
Append task | Append Rate 2929 msg/s 117160 KB/s | Avg Latency 2.134 ms | Max Latency 7.385 ms
Append task | Append Rate 2929 msg/s 117160 KB/s | Avg Latency 2.071 ms | Max Latency 9.928 ms
Append task | Append Rate 2928 msg/s 117159 KB/s | Avg Latency 2.199 ms | Max Latency 7.841 ms
Append task | Append Rate 2928 msg/s 117156 KB/s | Avg Latency 2.069 ms | Max Latency 7.998 ms
Append task | Append Rate 2928 msg/s 117123 KB/s | Avg Latency 2.175 ms | Max Latency 9.010 ms
Append task | Append Rate 2929 msg/s 117199 KB/s | Avg Latency 2.255 ms | Max Latency 7.288 ms
Append task | Append Rate 2929 msg/s 117198 KB/s | Avg Latency 2.765 ms | Max Latency 29.551 ms
Append task | Append Rate 2926 msg/s 117041 KB/s | Avg Latency 2.014 ms | Max Latency 7.739 ms
Append task | Append Rate 2929 msg/s 117160 KB/s | Avg Latency 2.062 ms | Max Latency 10.755 ms
Append task | Append Rate 2930 msg/s 117200 KB/s | Avg Latency 2.072 ms | Max Latency 8.022 ms
Append task | Append Rate 2929 msg/s 117160 KB/s | Avg Latency 1.985 ms | Max Latency 7.545 ms
Append task | Append Rate 2925 msg/s 117039 KB/s | Avg Latency 1.985 ms | Max Latency 8.824 ms
Append task | Append Rate 2933 msg/s 117320 KB/s | Avg Latency 2.080 ms | Max Latency 7.651 ms
Append task | Append Rate 2929 msg/s 117160 KB/s | Avg Latency 2.010 ms | Max Latency 7.097 ms
Append task | Append Rate 2922 msg/s 116919 KB/s | Avg Latency 2.120 ms | Max Latency 8.340 ms
Append task | Append Rate 2925 msg/s 117039 KB/s | Avg Latency 2.055 ms | Max Latency 6.840 ms
Append task | Append Rate 2930 msg/s 117201 KB/s | Avg Latency 2.220 ms | Max Latency 7.855 ms
Append task | Append Rate 2929 msg/s 117199 KB/s | Avg Latency 2.094 ms | Max Latency 8.058 ms
Append task | Append Rate 2928 msg/s 117159 KB/s | Avg Latency 2.070 ms | Max Latency 8.688 ms
Append task | Append Rate 2927 msg/s 117115 KB/s | Avg Latency 2.342 ms | Max Latency 8.413 ms
Append task | Append Rate 2929 msg/s 117161 KB/s | Avg Latency 2.396 ms | Max Latency 6.493 ms
@Chillax-0v0
Copy link
Contributor Author

Same issue when we try to write to a block device directly:

ubuntu@ip-10-0-0-167:~$ java -Dio.netty.tryReflectionSetAccessible=true --add-opens=java.base/java.nio=ALL-UNNAMED -ea -cp s3stream-0.4.2-SNAPSHOT-jar-with-dependencies.jar com.automq.stream.s3.wal.benchmark.WriteBench -p /dev/nvme1n1 --duration 86400 --throughput 110000000 --record-size 4096 -d 8 --threads 1
Resetting WAL header
SLF4J: No SLF4J providers were found.
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See https://www.slf4j.org/codes.html#noProviders for further details.
Starting benchmark
Append task 0 started
Append task | Append Rate 26645 msg/s 106582 KB/s | Avg Latency 2.198 ms | Max Latency 28.244 ms
Append task | Append Rate 26853 msg/s 107414 KB/s | Avg Latency 1.003 ms | Max Latency 2.250 ms
Append task | Append Rate 26819 msg/s 107276 KB/s | Avg Latency 0.986 ms | Max Latency 3.462 ms
Append task | Append Rate 26886 msg/s 107547 KB/s | Avg Latency 1.131 ms | Max Latency 7.957 ms
Append task | Append Rate 26861 msg/s 107447 KB/s | Avg Latency 1.000 ms | Max Latency 2.054 ms
Append task | Append Rate 26858 msg/s 107433 KB/s | Avg Latency 0.999 ms | Max Latency 3.500 ms
Append task | Append Rate 26848 msg/s 107392 KB/s | Avg Latency 1.002 ms | Max Latency 3.108 ms
Append task | Append Rate 26856 msg/s 107427 KB/s | Avg Latency 1.014 ms | Max Latency 2.169 ms
Append task | Append Rate 26852 msg/s 107409 KB/s | Avg Latency 0.995 ms | Max Latency 1.974 ms
Append task | Append Rate 26859 msg/s 107438 KB/s | Avg Latency 0.986 ms | Max Latency 2.454 ms
Append task | Append Rate 26857 msg/s 107431 KB/s | Avg Latency 0.969 ms | Max Latency 2.099 ms
Append task | Append Rate 26853 msg/s 107413 KB/s | Avg Latency 0.961 ms | Max Latency 2.034 ms
Append task | Append Rate 26855 msg/s 107422 KB/s | Avg Latency 0.955 ms | Max Latency 2.039 ms
Append task | Append Rate 26845 msg/s 107383 KB/s | Avg Latency 0.956 ms | Max Latency 1.834 ms
Append task | Append Rate 26862 msg/s 107448 KB/s | Avg Latency 0.957 ms | Max Latency 1.979 ms
Append task | Append Rate 26856 msg/s 107427 KB/s | Avg Latency 0.948 ms | Max Latency 1.860 ms
Append task | Append Rate 26843 msg/s 107372 KB/s | Avg Latency 0.972 ms | Max Latency 2.075 ms
Append task | Append Rate 26862 msg/s 107448 KB/s | Avg Latency 0.962 ms | Max Latency 2.348 ms
Append task | Append Rate 26861 msg/s 107444 KB/s | Avg Latency 0.956 ms | Max Latency 2.794 ms
Append task | Append Rate 26806 msg/s 107227 KB/s | Avg Latency 1.366 ms | Max Latency 10.198 ms
Append task | Append Rate 26898 msg/s 107593 KB/s | Avg Latency 1.244 ms | Max Latency 10.246 ms
Append task | Append Rate 26851 msg/s 107406 KB/s | Avg Latency 0.970 ms | Max Latency 3.086 ms
Append task | Append Rate 26854 msg/s 107417 KB/s | Avg Latency 1.007 ms | Max Latency 2.502 ms
Append task | Append Rate 26866 msg/s 107464 KB/s | Avg Latency 0.998 ms | Max Latency 2.505 ms
Append task | Append Rate 26845 msg/s 107380 KB/s | Avg Latency 0.977 ms | Max Latency 1.924 ms
Append task | Append Rate 26851 msg/s 107406 KB/s | Avg Latency 0.961 ms | Max Latency 1.976 ms
Append task | Append Rate 26856 msg/s 107425 KB/s | Avg Latency 0.944 ms | Max Latency 1.880 ms
Append task | Append Rate 26857 msg/s 107430 KB/s | Avg Latency 0.945 ms | Max Latency 2.012 ms
Append task | Append Rate 26854 msg/s 107417 KB/s | Avg Latency 0.967 ms | Max Latency 1.922 ms
Append task | Append Rate 26852 msg/s 107408 KB/s | Avg Latency 0.962 ms | Max Latency 1.891 ms
Append task | Append Rate 26857 msg/s 107431 KB/s | Avg Latency 0.981 ms | Max Latency 1.991 ms
Append task | Append Rate 26863 msg/s 107452 KB/s | Avg Latency 0.963 ms | Max Latency 1.970 ms
Append task | Append Rate 26847 msg/s 107391 KB/s | Avg Latency 0.990 ms | Max Latency 2.293 ms
Append task | Append Rate 26857 msg/s 107431 KB/s | Avg Latency 0.970 ms | Max Latency 2.211 ms
Append task | Append Rate 26852 msg/s 107408 KB/s | Avg Latency 0.979 ms | Max Latency 2.032 ms
Append task | Append Rate 26497 msg/s 105991 KB/s | Avg Latency 0.980 ms | Max Latency 2.025 ms
Append task | Append Rate 27213 msg/s 108855 KB/s | Avg Latency 1.167 ms | Max Latency 17.673 ms
Append task | Append Rate 26849 msg/s 107396 KB/s | Avg Latency 0.962 ms | Max Latency 1.875 ms
Append task | Append Rate 26857 msg/s 107431 KB/s | Avg Latency 0.964 ms | Max Latency 2.225 ms
Append task | Append Rate 26856 msg/s 107424 KB/s | Avg Latency 0.998 ms | Max Latency 2.174 ms
Append task | Append Rate 26857 msg/s 107431 KB/s | Avg Latency 0.964 ms | Max Latency 2.247 ms
Append task | Append Rate 26858 msg/s 107435 KB/s | Avg Latency 0.959 ms | Max Latency 1.942 ms
Append task | Append Rate 26847 msg/s 107391 KB/s | Avg Latency 0.993 ms | Max Latency 2.198 ms
Append task | Append Rate 26857 msg/s 107428 KB/s | Avg Latency 1.045 ms | Max Latency 2.482 ms
Append task | Append Rate 26856 msg/s 107424 KB/s | Avg Latency 1.022 ms | Max Latency 2.124 ms
Append task | Append Rate 26851 msg/s 107404 KB/s | Avg Latency 1.002 ms | Max Latency 3.659 ms
Append task | Append Rate 26856 msg/s 107424 KB/s | Avg Latency 1.011 ms | Max Latency 3.235 ms
Append task | Append Rate 26856 msg/s 107427 KB/s | Avg Latency 1.017 ms | Max Latency 6.339 ms
Append task | Append Rate 26853 msg/s 107412 KB/s | Avg Latency 1.026 ms | Max Latency 5.917 ms
Append task | Append Rate 26850 msg/s 107400 KB/s | Avg Latency 1.047 ms | Max Latency 2.025 ms
Append task | Append Rate 26852 msg/s 107411 KB/s | Avg Latency 1.014 ms | Max Latency 2.203 ms
Append task | Append Rate 26856 msg/s 107427 KB/s | Avg Latency 1.052 ms | Max Latency 2.163 ms
Append task | Append Rate 26862 msg/s 107448 KB/s | Avg Latency 0.984 ms | Max Latency 2.210 ms
Append task | Append Rate 26862 msg/s 107448 KB/s | Avg Latency 0.991 ms | Max Latency 2.163 ms
Append task | Append Rate 26843 msg/s 107375 KB/s | Avg Latency 1.009 ms | Max Latency 3.332 ms
Append task | Append Rate 26854 msg/s 107416 KB/s | Avg Latency 1.023 ms | Max Latency 2.205 ms
Append task | Append Rate 26854 msg/s 107419 KB/s | Avg Latency 0.995 ms | Max Latency 1.896 ms
Append task | Append Rate 26866 msg/s 107464 KB/s | Avg Latency 1.083 ms | Max Latency 8.930 ms
Append task | Append Rate 26852 msg/s 107408 KB/s | Avg Latency 1.083 ms | Max Latency 9.567 ms
Append task | Append Rate 26851 msg/s 107407 KB/s | Avg Latency 1.057 ms | Max Latency 2.321 ms
Append task | Append Rate 26852 msg/s 107408 KB/s | Avg Latency 1.059 ms | Max Latency 2.408 ms
Append task | Append Rate 26857 msg/s 107431 KB/s | Avg Latency 1.021 ms | Max Latency 2.268 ms
Append task | Append Rate 26851 msg/s 107404 KB/s | Avg Latency 1.014 ms | Max Latency 2.151 ms
Append task | Append Rate 26864 msg/s 107459 KB/s | Avg Latency 1.051 ms | Max Latency 7.812 ms
Append task | Append Rate 26851 msg/s 107404 KB/s | Avg Latency 1.018 ms | Max Latency 2.171 ms
Append task | Append Rate 26857 msg/s 107431 KB/s | Avg Latency 1.029 ms | Max Latency 2.222 ms
Append task | Append Rate 26845 msg/s 107380 KB/s | Avg Latency 1.013 ms | Max Latency 2.449 ms
Append task | Append Rate 26852 msg/s 107411 KB/s | Avg Latency 1.103 ms | Max Latency 13.183 ms
Append task | Append Rate 26866 msg/s 107467 KB/s | Avg Latency 1.088 ms | Max Latency 8.437 ms
Append task | Append Rate 26693 msg/s 106772 KB/s | Avg Latency 1.059 ms | Max Latency 6.714 ms
Append task | Append Rate 26773 msg/s 107092 KB/s | Avg Latency 1.161 ms | Max Latency 12.041 ms
Append task | Append Rate 27093 msg/s 108375 KB/s | Avg Latency 1.135 ms | Max Latency 11.020 ms
Append task | Append Rate 26852 msg/s 107408 KB/s | Avg Latency 1.070 ms | Max Latency 2.190 ms
Append task | Append Rate 26848 msg/s 107392 KB/s | Avg Latency 1.116 ms | Max Latency 2.530 ms
Append task | Append Rate 26861 msg/s 107447 KB/s | Avg Latency 1.038 ms | Max Latency 2.307 ms
Append task | Append Rate 26854 msg/s 107416 KB/s | Avg Latency 1.049 ms | Max Latency 7.454 ms
Append task | Append Rate 26856 msg/s 107427 KB/s | Avg Latency 1.059 ms | Max Latency 2.625 ms
Append task | Append Rate 26861 msg/s 107444 KB/s | Avg Latency 1.105 ms | Max Latency 2.867 ms
Append task | Append Rate 26843 msg/s 107375 KB/s | Avg Latency 1.055 ms | Max Latency 2.233 ms
Append task | Append Rate 26860 msg/s 107440 KB/s | Avg Latency 1.090 ms | Max Latency 5.057 ms
Append task | Append Rate 26853 msg/s 107415 KB/s | Avg Latency 1.074 ms | Max Latency 2.251 ms
Append task | Append Rate 26844 msg/s 107379 KB/s | Avg Latency 1.008 ms | Max Latency 2.062 ms
Append task | Append Rate 26868 msg/s 107472 KB/s | Avg Latency 1.120 ms | Max Latency 2.397 ms
Append task | Append Rate 26852 msg/s 107408 KB/s | Avg Latency 0.993 ms | Max Latency 2.075 ms
Append task | Append Rate 26844 msg/s 107376 KB/s | Avg Latency 0.994 ms | Max Latency 2.976 ms
Append task | Append Rate 26856 msg/s 107424 KB/s | Avg Latency 1.150 ms | Max Latency 2.350 ms
Append task | Append Rate 26863 msg/s 107455 KB/s | Avg Latency 1.161 ms | Max Latency 28.817 ms
Append task | Append Rate 26852 msg/s 107408 KB/s | Avg Latency 1.133 ms | Max Latency 2.301 ms
Append task | Append Rate 26868 msg/s 107472 KB/s | Avg Latency 0.971 ms | Max Latency 2.072 ms
Append task | Append Rate 26852 msg/s 107411 KB/s | Avg Latency 0.962 ms | Max Latency 1.924 ms
Append task | Append Rate 26856 msg/s 107424 KB/s | Avg Latency 0.977 ms | Max Latency 1.983 ms
Append task | Append Rate 26857 msg/s 107431 KB/s | Avg Latency 0.987 ms | Max Latency 5.820 ms
Append task | Append Rate 26844 msg/s 107376 KB/s | Avg Latency 0.956 ms | Max Latency 1.830 ms
Append task | Append Rate 26853 msg/s 107415 KB/s | Avg Latency 0.978 ms | Max Latency 1.975 ms
Append task | Append Rate 26863 msg/s 107452 KB/s | Avg Latency 0.967 ms | Max Latency 2.392 ms
Append task | Append Rate 26854 msg/s 107419 KB/s | Avg Latency 1.006 ms | Max Latency 2.175 ms
Append task | Append Rate 26848 msg/s 107392 KB/s | Avg Latency 1.124 ms | Max Latency 12.949 ms
Append task | Append Rate 26861 msg/s 107444 KB/s | Avg Latency 0.993 ms | Max Latency 2.231 ms
Append task | Append Rate 26848 msg/s 107395 KB/s | Avg Latency 1.079 ms | Max Latency 3.787 ms
Append task | Append Rate 26855 msg/s 107420 KB/s | Avg Latency 1.079 ms | Max Latency 4.434 ms
Append task | Append Rate 26850 msg/s 107403 KB/s | Avg Latency 1.062 ms | Max Latency 2.200 ms
Append task | Append Rate 26858 msg/s 107435 KB/s | Avg Latency 0.970 ms | Max Latency 2.003 ms
Append task | Append Rate 26855 msg/s 107420 KB/s | Avg Latency 0.959 ms | Max Latency 2.577 ms
Append task | Append Rate 26852 msg/s 107408 KB/s | Avg Latency 0.987 ms | Max Latency 5.397 ms
Append task | Append Rate 26858 msg/s 107432 KB/s | Avg Latency 1.002 ms | Max Latency 3.479 ms
Append task | Append Rate 26854 msg/s 107419 KB/s | Avg Latency 1.008 ms | Max Latency 4.076 ms
Append task | Append Rate 26848 msg/s 107392 KB/s | Avg Latency 1.006 ms | Max Latency 2.220 ms
Append task | Append Rate 26869 msg/s 107479 KB/s | Avg Latency 0.983 ms | Max Latency 5.255 ms
Append task | Append Rate 26849 msg/s 107399 KB/s | Avg Latency 0.951 ms | Max Latency 1.853 ms
Append task | Append Rate 26854 msg/s 107416 KB/s | Avg Latency 0.965 ms | Max Latency 3.688 ms
Append task | Append Rate 26859 msg/s 107439 KB/s | Avg Latency 0.953 ms | Max Latency 1.908 ms
Append task | Append Rate 26847 msg/s 107391 KB/s | Avg Latency 1.019 ms | Max Latency 9.782 ms
Append task | Append Rate 26855 msg/s 107420 KB/s | Avg Latency 0.951 ms | Max Latency 2.092 ms

@Chillax-0v0 Chillax-0v0 self-assigned this Nov 20, 2023
@Chillax-0v0 Chillax-0v0 added enhancement New feature or request s3stream wal the WAL of S3 stream labels Nov 20, 2023
@ShadowySpirits ShadowySpirits mentioned this issue Nov 22, 2023
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Chillax-0v0 Chillax-0v0

Labels
enhancement New feature or request s3stream wal the WAL of S3 stream
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Chillax-0v0