YCSB Results
Welcome to the Corfu-YCSB wiki!
These Results measure CorfuTable's performance in different configurations.
The results correspond to workloada (50% reads 50% writes) and use a single CorfuRuntime among 8 workers threads to execute 400000 operations while compaction runs every 2 minutes.
Setup:
Single bare metal node, 28 CPU, 252 GB Memory, 3 x 600GB SSD (in raid0 configuration).
One node comparison (in-memory vs persistent-mode-fsync vs persistent-mode-periodic-fsync):
Cluster Size comparison (with persistent+fsync):
Fsync on 3-node cluster (periodic fsync vs batch fsync):
Cost of Fsync on ramdisk:
Server Latency (from the systems POV):
LogUnit-BatchPr (17708), 1056142 events, 16.2%
syscall calls total min avg max stddev
(msec) (msec) (msec) (msec) (%)
--------------- -------- --------- --------- --------- --------- ------
fsync 63062 504993.758 0.080 8.008 18.100 0.02%
futex 65376 3665.851 0.000 0.056 364.205 10.98%
write 199681 2063.943 0.002 0.010 7.959 1.74%
lseek 199708 544.578 0.001 0.003 0.068 0.20%
openat 70 1.772 0.004 0.025 0.081 11.20%
rename 23 1.377 0.043 0.060 0.090 5.36%
read 69 0.252 0.002 0.004 0.013 6.38%
close 54 0.164 0.002 0.003 0.017 12.49%
stat 8 0.075 0.005 0.009 0.020 22.08%
mmap 3 0.039 0.013 0.013 0.014 2.22%
mprotect 5 0.037 0.003 0.007 0.011 20.75%
fstat 8 0.018 0.002 0.002 0.004 12.70%
LogUnit-1 (17826), 1035047 events, 15.8%
syscall calls total min avg max stddev
(msec) (msec) (msec) (msec) (%)
--------------- -------- --------- --------- --------- --------- ------
futex 387502 967728.133 0.000 2.497 60000.200 16.59%
write 82256 1410.249 0.003 0.017 10.363 4.14%
pread64 47100 402.085 0.002 0.009 0.137 0.23%
fsync 105 104.740 0.003 0.998 8.382 23.98%
rename 93 7.146 0.036 0.077 0.126 2.60%
unlink 4 5.840 1.342 1.460 1.647 4.71%
openat 193 5.430 0.005 0.028 0.101 5.60%
close 197 0.654 0.001 0.003 0.018 5.48%
lseek 32 0.161 0.002 0.005 0.012 10.96%
read 26 0.118 0.002 0.005 0.008 7.68%
stat 6 0.062 0.006 0.010 0.019 18.20%
getdents 2 0.058 0.004 0.029 0.054 86.70%
mmap 1 0.021 0.021 0.021 0.021 0.00%
fstat 3 0.011 0.003 0.004 0.004 8.60%
sched_yield 1 0.005 0.005 0.005 0.005 0.00%
sequencer-0 (17725), 2830989 events, 43.3%
syscall calls total min avg max stddev
(msec) (msec) (msec) (msec) (%)
--------------- -------- --------- --------- --------- --------- ------
futex 1063668 995001.793 0.000 0.935 3000.856 3.69%
write 351520 2875.863 0.002 0.008 0.053 0.06%
read 145 0.646 0.002 0.004 0.019 5.33%
lseek 145 0.638 0.001 0.004 0.019 5.49%
mmap 5 0.094 0.013 0.019 0.028 14.48%
mprotect 7 0.058 0.004 0.008 0.014 16.54%
worker-1 (17715), 91516 events, 1.4%
syscall calls total min avg max stddev
(msec) (msec) (msec) (msec) (%)
--------------- -------- --------- --------- --------- --------- ------
epoll_wait 15237 1017754.065 0.000 66.795 1000.346 2.70%
writev 7837 216.769 0.010 0.028 0.653 0.54%
read 15467 103.280 0.002 0.007 0.096 0.44%
futex 7200 85.798 0.001 0.012 18.805 27.42%
write 4 0.070 0.008 0.018 0.041 45.37%
clone 1 0.048 0.048 0.048 0.048 0.00%
mprotect 5 0.037 0.003 0.007 0.011 21.49%
epoll_ctl 3 0.017 0.002 0.006 0.008 28.88%
mmap 1 0.014 0.014 0.014 0.014 0.00%
getsockopt 1 0.006 0.006 0.006 0.006 0.00%
dup2 1 0.004 0.004 0.004 0.004 0.00%
close 1 0.003 0.003 0.003 0.003 0.00%