[2024-11-18 21:03:29.571829] Starting SPDK v25.01-pre git sha1 d47eb51c9 / DPDK 23.11.0 initialization... [2024-11-18 21:03:29.572106] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid441029 ] Set seed to 1731960209565031 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-18 21:03:29.704600] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-18 21:03:29.728133] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-18 21:03:29.728181] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 441029' to capture a snapshot of events at runtime. [2024-11-18 21:03:29.728191] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-18 21:03:29.728217] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-18 21:03:29.728225] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid441029 for offline analysis/debug. [2024-11-18 21:03:29.728769] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Nov 18 21:03:34 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/18-21:03:41 ... thread 0: (1000000,1000000) ops and (128993.8,128993.8) ops/second in (7.752313,7.752313) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 818.28 MB 18.9 0.4 0.0 0.4 1.2 0.8 0.0 1.5 37.7 119.4 10.02 4.00 10 1.002 383K 540 0.0 0.0 L1 1/1 62.83 MB 0.0 0.5 0.4 0.1 0.5 0.4 0.0 1.2 112.9 112.7 4.37 2.25 1 4.367 500K 864 0.0 0.0 L2 15/12 1.58 GB 2.2 0.2 0.0 0.2 0.2 0.0 0.4 7.0 112.3 111.9 2.18 1.15 1 2.180 35K 0 0.0 0.0 L3 51/33 3.18 GB 1.2 2.8 1.7 1.0 2.8 1.7 0.1 1.6 100.5 99.8 28.32 13.60 15 1.888 1509K 2131 0.0 0.0 L4 189/8 10.90 GB 1.1 1.9 1.4 0.5 1.8 1.4 0.0 1.3 102.5 101.7 18.61 9.03 12 1.551 565K 0 0.0 0.0 L5 1088/0 89.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1350/58 106.08 GB 0.0 5.7 3.6 2.2 6.5 4.3 0.5 8.1 92.5 104.7 63.50 30.03 39 1.628 2994K 3535 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 3.6 2.2 6.5 4.3 0.5 8.1 92.5 104.7 63.50 30.03 39 1.628 2994K 3535 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 3.6 2.2 5.7 3.5 0.0 0.0 104.2 103.6 56.32 27.56 30 1.877 2994K 3535 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 114.1 7.18 2.47 9 0.797 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.0 total, 7.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.50 GB write, 836.28 MB/s write, 5.73 GB read, 738.23 MB/s read, 63.5 seconds Interval compaction: 6.50 GB write, 857.72 MB/s write, 5.73 GB read, 757.16 MB/s read, 63.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 32, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 226850 Average: 10.5428 StdDev: 137.67 Min: 1 Median: 1.8775 Max: 8717 Percentiles: P50: 1.88 P75: 2.88 P99: 10.33 P99.9: 2382.59 P99.99: 4863.10 ------------------------------------------------------ [ 0, 1 ] 8688 3.830% 3.830% # ( 1, 2 ] 119354 52.614% 56.443% ########### ( 2, 3 ] 47691 21.023% 77.467% #### ( 3, 4 ] 20990 9.253% 86.719% ## ( 4, 6 ] 22260 9.813% 96.532% ## ( 6, 10 ] 5537 2.441% 98.973% ( 10, 15 ] 943 0.416% 99.389% ( 15, 22 ] 119 0.052% 99.441% ( 22, 34 ] 15 0.007% 99.448% ( 34, 51 ] 6 0.003% 99.450% ( 51, 76 ] 5 0.002% 99.453% ( 76, 110 ] 5 0.002% 99.455% ( 110, 170 ] 22 0.010% 99.464% ( 170, 250 ] 57 0.025% 99.490% ( 250, 380 ] 72 0.032% 99.521% ( 380, 580 ] 180 0.079% 99.601% ( 580, 870 ] 243 0.107% 99.708% ( 870, 1300 ] 222 0.098% 99.806% ( 1300, 1900 ] 149 0.066% 99.871% ( 1900, 2900 ] 135 0.060% 99.931% ( 2900, 4400 ] 128 0.056% 99.987% ( 4400, 6600 ] 30 0.013% 100.000% ( 6600, 9900 ] 5 0.002% 100.003% ** Level 1 read latency histogram (micros): Count: 65373 Average: 13.9139 StdDev: 160.36 Min: 1 Median: 1.9572 Max: 6502 Percentiles: P50: 1.96 P75: 2.96 P99: 13.17 P99.9: 2853.47 P99.99: 5415.57 ------------------------------------------------------ [ 0, 1 ] 1573 2.406% 2.406% ( 1, 2 ] 32506 49.724% 52.130% ########## ( 2, 3 ] 15516 23.735% 75.865% ##### ( 3, 4 ] 6473 9.902% 85.766% ## ( 4, 6 ] 6703 10.253% 96.020% ## ( 6, 10 ] 1770 2.708% 98.727% # ( 10, 15 ] 281 0.430% 99.157% ( 15, 22 ] 33 0.050% 99.208% ( 22, 34 ] 11 0.017% 99.224% ( 34, 51 ] 2 0.003% 99.228% ( 51, 76 ] 2 0.003% 99.231% ( 110, 170 ] 7 0.011% 99.241% ( 170, 250 ] 10 0.015% 99.257% ( 250, 380 ] 22 0.034% 99.290% ( 380, 580 ] 75 0.115% 99.405% ( 580, 870 ] 92 0.141% 99.546% ( 870, 1300 ] 104 0.159% 99.705% ( 1300, 1900 ] 79 0.121% 99.826% ( 1900, 2900 ] 51 0.078% 99.904% ( 2900, 4400 ] 50 0.076% 99.980% ( 4400, 6600 ] 14 0.021% 100.002% ** Level 2 read latency histogram (micros): Count: 543635 Average: 15.5501 StdDev: 188.46 Min: 1 Median: 2.0097 Max: 10253 Percentiles: P50: 2.01 P75: 3.11 P99: 12.91 P99.9: 2230.24 P99.99: 3266.59 ------------------------------------------------------ [ 0, 1 ] 11003 2.024% 2.024% ( 1, 2 ] 259547 47.743% 49.767% ########## ( 2, 3 ] 131044 24.105% 73.872% ##### ( 3, 4 ] 57596 10.595% 84.467% ## ( 4, 6 ] 60214 11.076% 95.543% ## ( 6, 10 ] 16908 3.110% 98.653% # ( 10, 15 ] 3239 0.596% 99.249% ( 15, 22 ] 535 0.098% 99.347% ( 22, 34 ] 74 0.014% 99.361% ( 34, 51 ] 23 0.004% 99.365% ( 51, 76 ] 26 0.005% 99.370% ( 76, 110 ] 17 0.003% 99.373% ( 110, 170 ] 40 0.007% 99.380% ( 170, 250 ] 84 0.015% 99.396% ( 250, 380 ] 197 0.036% 99.432% ( 380, 580 ] 391 0.072% 99.504% ( 580, 870 ] 637 0.117% 99.621% ( 870, 1300 ] 744 0.137% 99.758% ( 1300, 1900 ] 599 0.110% 99.868% ( 1900, 2900 ] 528 0.097% 99.965% ( 2900, 4400 ] 555 0.102% 100.067% ( 4400, 6600 ] 161 0.030% 100.097% ( 6600, 9900 ] 35 0.006% 100.103% ( 9900, 14000 ] 1 0.000% 100.104% ** Level 3 read latency histogram (micros): Count: 822376 Average: 12.5230 StdDev: 155.61 Min: 0 Median: 1.9860 Max: 14814 Percentiles: P50: 1.99 P75: 3.01 P99: 9.95 P99.9: 1065.53 P99.99: 1458.54 ------------------------------------------------------ [ 0, 1 ] 13767 1.674% 1.674% ( 1, 2 ] 403058 49.011% 50.685% ########## ( 2, 3 ] 199159 24.218% 74.903% ##### ( 3, 4 ] 87104 10.592% 85.495% ## ( 4, 6 ] 89553 10.890% 96.384% ## ( 6, 10 ] 21810 2.652% 99.036% # ( 10, 15 ] 4002 0.487% 99.523% ( 15, 22 ] 507 0.062% 99.585% ( 22, 34 ] 51 0.006% 99.591% ( 34, 51 ] 31 0.004% 99.595% ( 51, 76 ] 57 0.007% 99.602% ( 76, 110 ] 28 0.003% 99.605% ( 110, 170 ] 60 0.007% 99.612% ( 170, 250 ] 135 0.016% 99.629% ( 250, 380 ] 267 0.032% 99.661% ( 380, 580 ] 600 0.073% 99.734% ( 580, 870 ] 915 0.111% 99.845% ( 870, 1300 ] 991 0.121% 99.966% ( 1300, 1900 ] 756 0.092% 100.058% ( 1900, 2900 ] 626 0.076% 100.134% ( 2900, 4400 ] 625 0.076% 100.210% ( 4400, 6600 ] 150 0.018% 100.228% ( 6600, 9900 ] 17 0.002% 100.230% ( 9900, 14000 ] 1 0.000% 100.230% ( 14000, 22000 ] 1 0.000% 100.230% ** Level 4 read latency histogram (micros): Count: 173927 Average: 39.3310 StdDev: 319.00 Min: 1 Median: 1.9913 Max: 9698 Percentiles: P50: 1.99 P75: 3.09 P99: 1202.61 P99.9: 4064.41 P99.99: 5075.81 ------------------------------------------------------ [ 0, 1 ] 2917 1.677% 1.677% ( 1, 2 ] 84784 48.747% 50.424% ########## ( 2, 3 ] 41110 23.636% 74.060% ##### ( 3, 4 ] 18578 10.681% 84.742% ## ( 4, 6 ] 17677 10.163% 94.905% ## ( 6, 10 ] 4238 2.437% 97.342% ( 10, 15 ] 806 0.463% 97.805% ( 15, 22 ] 134 0.077% 97.882% ( 22, 34 ] 19 0.011% 97.893% ( 34, 51 ] 16 0.009% 97.903% ( 51, 76 ] 9 0.005% 97.908% ( 76, 110 ] 9 0.005% 97.913% ( 110, 170 ] 20 0.011% 97.924% ( 170, 250 ] 79 0.045% 97.970% ( 250, 380 ] 179 0.103% 98.073% ( 380, 580 ] 394 0.227% 98.299% ( 580, 870 ] 628 0.361% 98.660% ( 870, 1300 ] 765 0.440% 99.100% ( 1300, 1900 ] 556 0.320% 99.420% ( 1900, 2900 ] 472 0.271% 99.691% ( 2900, 4400 ] 469 0.270% 99.961% ( 4400, 6600 ] 168 0.097% 100.057% ( 6600, 9900 ] 38 0.022% 100.079% ** Level 5 read latency histogram (micros): Count: 12346 Average: 1788.2612 StdDev: 1547.62 Min: 88 Median: 1196.3786 Max: 12338 Percentiles: P50: 1196.38 P75: 2579.21 P99: 7107.73 P99.9: 9726.84 P99.99: 12338.00 ------------------------------------------------------ ( 76, 110 ] 13 0.105% 0.105% ( 110, 170 ] 73 0.591% 0.697% ( 170, 250 ] 221 1.790% 2.487% ( 250, 380 ] 644 5.216% 7.703% # ( 380, 580 ] 1361 11.024% 18.727% ## ( 580, 870 ] 2157 17.471% 36.198% ### ( 870, 1300 ] 2245 18.184% 54.382% #### ( 1300, 1900 ] 1562 12.652% 67.034% ### ( 1900, 2900 ] 1448 11.728% 78.762% ## ( 2900, 4400 ] 1689 13.681% 92.443% ### ( 4400, 6600 ] 788 6.383% 98.826% # ( 6600, 9900 ] 140 1.134% 99.960% ( 9900, 14000 ] 5 0.040% 100.000% ** DB Stats ** Uptime(secs): 8.0 total, 7.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 123.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.788 H:M:S, 47.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 126.90 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.788 H:M:S, 48.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/18-21:03:48 ... thread 0: (1000000,2000000) ops and (146199.7,137058.9) ops/second in (6.839957,14.592270) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 1.17 GB 12.6 1.0 0.0 1.0 2.8 1.8 0.0 1.6 51.6 139.5 20.76 9.67 24 0.865 1087K 1434 0.0 0.0 L1 6/6 337.70 MB 0.0 1.2 1.0 0.1 1.2 1.0 0.0 1.1 120.2 119.9 9.86 5.52 2 4.930 1203K 2502 0.0 0.0 L2 5/4 412.86 MB 0.8 0.2 0.0 0.2 0.2 0.0 0.7 7.0 112.3 111.9 2.18 1.15 1 2.180 35K 0 0.0 0.0 L3 35/21 2.18 GB 0.9 6.7 3.2 3.5 6.7 3.2 0.1 2.1 107.9 107.3 64.03 32.94 22 2.911 4179K 8028 0.0 0.0 L4 180/0 9.72 GB 1.0 5.3 3.6 1.7 5.2 3.5 0.3 1.5 111.4 110.2 48.75 25.53 35 1.393 2866K 849 0.0 0.0 L5 1132/0 93.20 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1366/37 107.01 GB 0.0 14.5 7.9 6.6 16.2 9.6 4.8 9.1 101.9 113.8 145.58 74.82 84 1.733 9371K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.5 7.9 6.6 16.2 9.6 4.8 9.1 101.9 113.8 145.58 74.82 84 1.733 9371K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.5 7.9 6.6 14.4 7.8 0.0 0.0 112.7 111.9 131.64 69.52 63 2.089 9371K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 131.0 13.94 5.29 21 0.664 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.8 total, 14.6 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.18 GB write, 1119.69 MB/s write, 14.49 GB read, 1003.12 MB/s read, 145.6 seconds Interval compaction: 16.18 GB write, 1134.94 MB/s write, 14.49 GB read, 1016.78 MB/s read, 145.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 55, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 55, interval: 55 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 542774 Average: 11.6277 StdDev: 146.23 Min: 1 Median: 1.8737 Max: 19942 Percentiles: P50: 1.87 P75: 2.86 P99: 11.62 P99.9: 2187.42 P99.99: 4119.18 ------------------------------------------------------ [ 0, 1 ] 20533 3.783% 3.783% # ( 1, 2 ] 287118 52.898% 56.681% ########### ( 2, 3 ] 115008 21.189% 77.870% #### ( 3, 4 ] 50120 9.234% 87.104% ## ( 4, 6 ] 51875 9.557% 96.662% ## ( 6, 10 ] 12011 2.213% 98.874% ( 10, 15 ] 2101 0.387% 99.262% ( 15, 22 ] 257 0.047% 99.309% ( 22, 34 ] 27 0.005% 99.314% ( 34, 51 ] 23 0.004% 99.318% ( 51, 76 ] 26 0.005% 99.323% ( 76, 110 ] 15 0.003% 99.326% ( 110, 170 ] 96 0.018% 99.343% ( 170, 250 ] 197 0.036% 99.380% ( 250, 380 ] 296 0.055% 99.434% ( 380, 580 ] 554 0.102% 99.536% ( 580, 870 ] 775 0.143% 99.679% ( 870, 1300 ] 661 0.122% 99.801% ( 1300, 1900 ] 453 0.083% 99.884% ( 1900, 2900 ] 300 0.055% 99.940% ( 2900, 4400 ] 338 0.062% 100.002% ( 4400, 6600 ] 67 0.012% 100.014% ( 6600, 9900 ] 12 0.002% 100.016% ( 14000, 22000 ] 2 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 161166 Average: 16.6204 StdDev: 200.61 Min: 1 Median: 1.9738 Max: 29193 Percentiles: P50: 1.97 P75: 2.97 P99: 44.40 P99.9: 3012.85 P99.99: 5106.58 ------------------------------------------------------ [ 0, 1 ] 3285 2.038% 2.038% ( 1, 2 ] 79382 49.255% 51.293% ########## ( 2, 3 ] 39435 24.469% 75.762% ##### ( 3, 4 ] 15665 9.720% 85.481% ## ( 4, 6 ] 16525 10.253% 95.735% ## ( 6, 10 ] 4421 2.743% 98.478% # ( 10, 15 ] 722 0.448% 98.926% ( 15, 22 ] 98 0.061% 98.987% ( 22, 34 ] 15 0.009% 98.996% ( 34, 51 ] 12 0.007% 99.004% ( 51, 76 ] 9 0.006% 99.009% ( 76, 110 ] 5 0.003% 99.012% ( 110, 170 ] 32 0.020% 99.032% ( 170, 250 ] 53 0.033% 99.065% ( 250, 380 ] 104 0.065% 99.129% ( 380, 580 ] 244 0.151% 99.281% ( 580, 870 ] 311 0.193% 99.474% ( 870, 1300 ] 315 0.195% 99.669% ( 1300, 1900 ] 208 0.129% 99.798% ( 1900, 2900 ] 154 0.096% 99.894% ( 2900, 4400 ] 144 0.089% 99.983% ( 4400, 6600 ] 37 0.023% 100.006% ( 6600, 9900 ] 5 0.003% 100.009% ( 22000, 33000 ] 2 0.001% 100.011% ** Level 2 read latency histogram (micros): Count: 647822 Average: 14.8723 StdDev: 183.46 Min: 1 Median: 2.0044 Max: 15374 Percentiles: P50: 2.00 P75: 3.08 P99: 12.55 P99.9: 2267.48 P99.99: 3402.12 ------------------------------------------------------ [ 0, 1 ] 12028 1.857% 1.857% ( 1, 2 ] 311188 48.036% 49.893% ########## ( 2, 3 ] 157026 24.239% 74.132% ##### ( 3, 4 ] 68205 10.528% 84.660% ## ( 4, 6 ] 71335 11.012% 95.672% ## ( 6, 10 ] 19680 3.038% 98.710% # ( 10, 15 ] 3688 0.569% 99.279% ( 15, 22 ] 584 0.090% 99.369% ( 22, 34 ] 77 0.012% 99.381% ( 34, 51 ] 32 0.005% 99.386% ( 51, 76 ] 36 0.006% 99.391% ( 76, 110 ] 18 0.003% 99.394% ( 110, 170 ] 48 0.007% 99.402% ( 170, 250 ] 90 0.014% 99.415% ( 250, 380 ] 216 0.033% 99.449% ( 380, 580 ] 446 0.069% 99.518% ( 580, 870 ] 731 0.113% 99.630% ( 870, 1300 ] 860 0.133% 99.763% ( 1300, 1900 ] 669 0.103% 99.866% ( 1900, 2900 ] 591 0.091% 99.958% ( 2900, 4400 ] 625 0.096% 100.054% ( 4400, 6600 ] 180 0.028% 100.082% ( 6600, 9900 ] 39 0.006% 100.088% ( 9900, 14000 ] 1 0.000% 100.088% ( 14000, 22000 ] 1 0.000% 100.088% ** Level 3 read latency histogram (micros): Count: 1940756 Average: 12.0823 StdDev: 156.52 Min: 0 Median: 1.9818 Max: 35175 Percentiles: P50: 1.98 P75: 2.98 P99: 9.80 P99.9: 823.43 P99.99: 1124.80 ------------------------------------------------------ [ 0, 1 ] 26041 1.342% 1.342% ( 1, 2 ] 961829 49.560% 50.901% ########## ( 2, 3 ] 477546 24.606% 75.507% ##### ( 3, 4 ] 201161 10.365% 85.873% ## ( 4, 6 ] 206578 10.644% 96.517% ## ( 6, 10 ] 50758 2.615% 99.132% # ( 10, 15 ] 9020 0.465% 99.597% ( 15, 22 ] 1062 0.055% 99.652% ( 22, 34 ] 91 0.005% 99.656% ( 34, 51 ] 103 0.005% 99.662% ( 51, 76 ] 195 0.010% 99.672% ( 76, 110 ] 54 0.003% 99.674% ( 110, 170 ] 140 0.007% 99.682% ( 170, 250 ] 310 0.016% 99.698% ( 250, 380 ] 643 0.033% 99.731% ( 380, 580 ] 1432 0.074% 99.805% ( 580, 870 ] 2209 0.114% 99.918% ( 870, 1300 ] 2349 0.121% 100.039% ( 1300, 1900 ] 1537 0.079% 100.119% ( 1900, 2900 ] 1327 0.068% 100.187% ( 2900, 4400 ] 1417 0.073% 100.260% ( 4400, 6600 ] 340 0.018% 100.278% ( 6600, 9900 ] 53 0.003% 100.280% ( 9900, 14000 ] 2 0.000% 100.280% ( 14000, 22000 ] 2 0.000% 100.280% ( 33000, 50000 ] 2 0.000% 100.281% ** Level 4 read latency histogram (micros): Count: 447228 Average: 30.8061 StdDev: 275.68 Min: 1 Median: 1.9663 Max: 34729 Percentiles: P50: 1.97 P75: 3.03 P99: 900.89 P99.9: 3465.40 P99.99: 4174.87 ------------------------------------------------------ [ 0, 1 ] 8638 1.931% 1.931% ( 1, 2 ] 222469 49.744% 51.675% ########## ( 2, 3 ] 103034 23.038% 74.714% ##### ( 3, 4 ] 46445 10.385% 85.099% ## ( 4, 6 ] 45123 10.089% 95.188% ## ( 6, 10 ] 11256 2.517% 97.705% # ( 10, 15 ] 1905 0.426% 98.131% ( 15, 22 ] 249 0.056% 98.187% ( 22, 34 ] 36 0.008% 98.195% ( 34, 51 ] 34 0.008% 98.202% ( 51, 76 ] 30 0.007% 98.209% ( 76, 110 ] 20 0.004% 98.214% ( 110, 170 ] 94 0.021% 98.235% ( 170, 250 ] 235 0.053% 98.287% ( 250, 380 ] 458 0.102% 98.390% ( 380, 580 ] 1024 0.229% 98.619% ( 580, 870 ] 1577 0.353% 98.971% ( 870, 1300 ] 1792 0.401% 99.372% ( 1300, 1900 ] 1146 0.256% 99.628% ( 1900, 2900 ] 895 0.200% 99.828% ( 2900, 4400 ] 851 0.190% 100.019% ( 4400, 6600 ] 251 0.056% 100.075% ( 6600, 9900 ] 58 0.013% 100.088% ( 9900, 14000 ] 1 0.000% 100.088% ( 33000, 50000 ] 2 0.000% 100.088% ** Level 5 read latency histogram (micros): Count: 29215 Average: 1455.8665 StdDev: 1348.65 Min: 82 Median: 986.6497 Max: 30168 Percentiles: P50: 986.65 P75: 1818.13 P99: 6379.90 P99.9: 9509.89 P99.99: 13015.23 ------------------------------------------------------ ( 76, 110 ] 46 0.157% 0.157% ( 110, 170 ] 352 1.205% 1.362% ( 170, 250 ] 841 2.879% 4.241% # ( 250, 380 ] 1967 6.733% 10.974% # ( 380, 580 ] 3926 13.438% 24.412% ### ( 580, 870 ] 5901 20.199% 44.611% #### ( 870, 1300 ] 5804 19.867% 64.477% #### ( 1300, 1900 ] 3560 12.186% 76.663% ## ( 1900, 2900 ] 2630 9.002% 85.665% ## ( 2900, 4400 ] 2887 9.882% 95.547% ## ( 4400, 6600 ] 1121 3.837% 99.384% # ( 6600, 9900 ] 171 0.585% 99.969% ( 9900, 14000 ] 8 0.027% 99.997% ( 22000, 33000 ] 2 0.007% 100.003% ** DB Stats ** Uptime(secs): 14.8 total, 6.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 133.06 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.756 H:M:S, 45.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 143.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.968 H:M:S, 43.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/11/18-21:03:54 ... thread 0: (1000000,3000000) ops and (169738.0,146457.9) ops/second in (5.891431,20.483701) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/6 2.15 GB 113.3 1.9 0.0 1.9 4.7 2.8 0.0 1.7 64.2 157.2 30.43 16.03 40 0.761 1982K 2433 0.0 0.0 L1 6/6 337.70 MB 0.0 1.2 1.0 0.1 1.2 1.0 0.0 1.1 120.2 119.9 9.86 5.52 2 4.930 1203K 2502 0.0 0.0 L2 1/0 76.26 MB 0.8 0.2 0.0 0.2 0.2 0.0 0.7 7.0 112.3 111.9 2.18 1.15 1 2.180 35K 0 0.0 0.0 L3 15/0 931.35 MB 0.9 8.4 3.6 4.8 8.3 3.5 0.1 2.3 114.2 113.5 74.87 40.60 26 2.880 5849K 22K 0.0 0.0 L4 179/0 9.57 GB 1.0 8.8 5.2 3.6 8.6 5.0 0.3 1.7 117.9 116.0 76.06 42.28 58 1.311 4692K 1062 0.0 0.0 L5 1152/0 94.86 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1365/12 107.89 GB 0.0 20.4 9.8 10.6 23.0 12.4 6.4 8.3 108.1 121.7 193.41 105.59 127 1.523 13M 28K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.4 9.8 10.6 23.0 12.4 6.4 8.3 108.1 121.7 193.41 105.59 127 1.523 13M 28K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.4 9.8 10.6 20.2 9.6 0.0 0.0 120.2 119.0 173.92 97.47 93 1.870 13M 28K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 145.4 19.49 8.12 34 0.573 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.7 total, 20.5 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.98 GB write, 1137.72 MB/s write, 20.41 GB read, 1010.51 MB/s read, 193.4 seconds Interval compaction: 22.98 GB write, 1148.76 MB/s write, 20.41 GB read, 1020.31 MB/s read, 193.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 73, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 73, interval: 73 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 950646 Average: 10.9796 StdDev: 143.35 Min: 1 Median: 1.8480 Max: 35898 Percentiles: P50: 1.85 P75: 2.81 P99: 12.36 P99.9: 1708.33 P99.99: 3556.43 ------------------------------------------------------ [ 0, 1 ] 42476 4.468% 4.468% # ( 1, 2 ] 510419 53.692% 58.160% ########### ( 2, 3 ] 196663 20.687% 78.847% #### ( 3, 4 ] 85279 8.971% 87.818% ## ( 4, 6 ] 86028 9.049% 96.867% ## ( 6, 10 ] 18835 1.981% 98.849% ( 10, 15 ] 3054 0.321% 99.170% ( 15, 22 ] 409 0.043% 99.213% ( 22, 34 ] 49 0.005% 99.218% ( 34, 51 ] 42 0.004% 99.222% ( 51, 76 ] 39 0.004% 99.227% ( 76, 110 ] 132 0.014% 99.240% ( 110, 170 ] 701 0.074% 99.314% ( 170, 250 ] 746 0.078% 99.393% ( 250, 380 ] 779 0.082% 99.475% ( 380, 580 ] 1157 0.122% 99.596% ( 580, 870 ] 1369 0.144% 99.740% ( 870, 1300 ] 1076 0.113% 99.853% ( 1300, 1900 ] 650 0.068% 99.922% ( 1900, 2900 ] 430 0.045% 99.967% ( 2900, 4400 ] 498 0.052% 100.019% ( 4400, 6600 ] 106 0.011% 100.031% ( 6600, 9900 ] 19 0.002% 100.033% ( 14000, 22000 ] 3 0.000% 100.033% ( 22000, 33000 ] 1 0.000% 100.033% ( 33000, 50000 ] 1 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 245158 Average: 14.0183 StdDev: 175.37 Min: 1 Median: 1.9604 Max: 29193 Percentiles: P50: 1.96 P75: 2.95 P99: 14.29 P99.9: 2365.40 P99.99: 4000.74 ------------------------------------------------------ [ 0, 1 ] 4884 1.992% 1.992% ( 1, 2 ] 122545 49.986% 51.978% ########## ( 2, 3 ] 59461 24.254% 76.232% ##### ( 3, 4 ] 23609 9.630% 85.863% ## ( 4, 6 ] 24757 10.098% 95.961% ## ( 6, 10 ] 6595 2.690% 98.651% # ( 10, 15 ] 997 0.407% 99.058% ( 15, 22 ] 133 0.054% 99.112% ( 22, 34 ] 17 0.007% 99.119% ( 34, 51 ] 25 0.010% 99.129% ( 51, 76 ] 20 0.008% 99.137% ( 76, 110 ] 16 0.007% 99.144% ( 110, 170 ] 69 0.028% 99.172% ( 170, 250 ] 112 0.046% 99.218% ( 250, 380 ] 192 0.078% 99.296% ( 380, 580 ] 330 0.135% 99.431% ( 580, 870 ] 440 0.179% 99.610% ( 870, 1300 ] 387 0.158% 99.768% ( 1300, 1900 ] 241 0.098% 99.866% ( 1900, 2900 ] 178 0.073% 99.939% ( 2900, 4400 ] 171 0.070% 100.009% ( 4400, 6600 ] 45 0.018% 100.027% ( 6600, 9900 ] 6 0.002% 100.029% ( 22000, 33000 ] 2 0.001% 100.030% ** Level 2 read latency histogram (micros): Count: 647849 Average: 14.9047 StdDev: 183.69 Min: 1 Median: 2.0045 Max: 15374 Percentiles: P50: 2.00 P75: 3.08 P99: 12.58 P99.9: 2272.51 P99.99: 3406.88 ------------------------------------------------------ [ 0, 1 ] 12028 1.857% 1.857% ( 1, 2 ] 311194 48.035% 49.892% ########## ( 2, 3 ] 157027 24.238% 74.130% ##### ( 3, 4 ] 68205 10.528% 84.658% ## ( 4, 6 ] 71335 11.011% 95.669% ## ( 6, 10 ] 19682 3.038% 98.707% # ( 10, 15 ] 3688 0.569% 99.276% ( 15, 22 ] 584 0.090% 99.366% ( 22, 34 ] 77 0.012% 99.378% ( 34, 51 ] 32 0.005% 99.383% ( 51, 76 ] 36 0.006% 99.389% ( 76, 110 ] 19 0.003% 99.392% ( 110, 170 ] 48 0.007% 99.399% ( 170, 250 ] 92 0.014% 99.413% ( 250, 380 ] 218 0.034% 99.447% ( 380, 580 ] 449 0.069% 99.516% ( 580, 870 ] 735 0.113% 99.630% ( 870, 1300 ] 862 0.133% 99.763% ( 1300, 1900 ] 670 0.103% 99.866% ( 1900, 2900 ] 591 0.091% 99.957% ( 2900, 4400 ] 628 0.097% 100.054% ( 4400, 6600 ] 180 0.028% 100.082% ( 6600, 9900 ] 39 0.006% 100.088% ( 9900, 14000 ] 1 0.000% 100.088% ( 14000, 22000 ] 1 0.000% 100.088% ** Level 3 read latency histogram (micros): Count: 2524221 Average: 11.3197 StdDev: 159.03 Min: 0 Median: 1.9750 Max: 45120 Percentiles: P50: 1.98 P75: 2.97 P99: 9.72 P99.9: 747.60 P99.99: 1042.03 ------------------------------------------------------ [ 0, 1 ] 36027 1.427% 1.427% ( 1, 2 ] 1257505 49.818% 51.245% ########## ( 2, 3 ] 615098 24.368% 75.613% ##### ( 3, 4 ] 260504 10.320% 85.933% ## ( 4, 6 ] 268948 10.655% 96.588% ## ( 6, 10 ] 65498 2.595% 99.182% # ( 10, 15 ] 11018 0.436% 99.619% ( 15, 22 ] 1315 0.052% 99.671% ( 22, 34 ] 112 0.004% 99.675% ( 34, 51 ] 156 0.006% 99.681% ( 51, 76 ] 257 0.010% 99.692% ( 76, 110 ] 97 0.004% 99.696% ( 110, 170 ] 281 0.011% 99.707% ( 170, 250 ] 493 0.020% 99.726% ( 250, 380 ] 931 0.037% 99.763% ( 380, 580 ] 1864 0.074% 99.837% ( 580, 870 ] 2756 0.109% 99.946% ( 870, 1300 ] 2771 0.110% 100.056% ( 1300, 1900 ] 1760 0.070% 100.126% ( 1900, 2900 ] 1497 0.059% 100.185% ( 2900, 4400 ] 1634 0.065% 100.250% ( 4400, 6600 ] 387 0.015% 100.265% ( 6600, 9900 ] 66 0.003% 100.268% ( 9900, 14000 ] 8 0.000% 100.268% ( 14000, 22000 ] 11 0.000% 100.268% ( 22000, 33000 ] 1 0.000% 100.268% ( 33000, 50000 ] 5 0.000% 100.269% ** Level 4 read latency histogram (micros): Count: 934524 Average: 24.3680 StdDev: 252.26 Min: 1 Median: 1.9524 Max: 43053 Percentiles: P50: 1.95 P75: 2.99 P99: 570.76 P99.9: 2552.34 P99.99: 3338.17 ------------------------------------------------------ [ 0, 1 ] 18360 1.965% 1.965% ( 1, 2 ] 471358 50.438% 52.403% ########## ( 2, 3 ] 213267 22.821% 75.224% ##### ( 3, 4 ] 95232 10.190% 85.414% ## ( 4, 6 ] 93804 10.038% 95.452% ## ( 6, 10 ] 24255 2.595% 98.047% # ( 10, 15 ] 3759 0.402% 98.450% ( 15, 22 ] 468 0.050% 98.500% ( 22, 34 ] 67 0.007% 98.507% ( 34, 51 ] 68 0.007% 98.514% ( 51, 76 ] 92 0.010% 98.524% ( 76, 110 ] 115 0.012% 98.536% ( 110, 170 ] 536 0.057% 98.594% ( 170, 250 ] 736 0.079% 98.672% ( 250, 380 ] 1117 0.120% 98.792% ( 380, 580 ] 2040 0.218% 99.010% ( 580, 870 ] 2863 0.306% 99.317% ( 870, 1300 ] 2893 0.310% 99.626% ( 1300, 1900 ] 1702 0.182% 99.808% ( 1900, 2900 ] 1316 0.141% 99.949% ( 2900, 4400 ] 1313 0.140% 100.090% ( 4400, 6600 ] 375 0.040% 100.130% ( 6600, 9900 ] 79 0.008% 100.138% ( 9900, 14000 ] 6 0.001% 100.139% ( 14000, 22000 ] 6 0.001% 100.139% ( 22000, 33000 ] 1 0.000% 100.140% ( 33000, 50000 ] 6 0.001% 100.140% ** Level 5 read latency histogram (micros): Count: 49727 Average: 1197.1314 StdDev: 1301.93 Min: 76 Median: 784.7899 Max: 39543 Percentiles: P50: 784.79 P75: 1433.49 P99: 6134.49 P99.9: 9455.50 P99.99: 25716.72 ------------------------------------------------------ ( 51, 76 ] 1 0.002% 0.002% ( 76, 110 ] 528 1.062% 1.064% ( 110, 170 ] 2863 5.757% 6.821% # ( 170, 250 ] 3180 6.395% 13.216% # ( 250, 380 ] 4370 8.788% 22.004% ## ( 380, 580 ] 7251 14.582% 36.586% ### ( 580, 870 ] 9446 18.996% 55.581% #### ( 870, 1300 ] 8569 17.232% 72.814% ### ( 1300, 1900 ] 4887 9.828% 82.641% ## ( 1900, 2900 ] 3400 6.837% 89.479% # ( 2900, 4400 ] 3683 7.406% 96.885% # ( 4400, 6600 ] 1334 2.683% 99.568% # ( 6600, 9900 ] 191 0.384% 99.952% ( 9900, 14000 ] 10 0.020% 99.972% ( 14000, 22000 ] 7 0.014% 99.986% ( 22000, 33000 ] 6 0.012% 99.998% ( 33000, 50000 ] 3 0.006% 100.004% ** DB Stats ** Uptime(secs): 20.7 total, 5.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 142.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.710 H:M:S, 42.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 167.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.954 H:M:S, 33.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/18-21:03:58 ... thread 0: (1000000,4000000) ops and (282284.6,166484.7) ops/second in (3.542524,24.026225) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/10 3.13 GB 188.8 2.6 0.0 2.6 6.4 3.7 0.0 1.7 73.6 178.0 36.78 21.87 59 0.623 2750K 3191 0.0 0.0 L1 6/6 337.70 MB 0.0 1.2 1.0 0.1 1.2 1.0 0.0 1.1 120.2 119.9 9.86 5.52 2 4.930 1203K 2502 0.0 0.0 L2 1/0 76.26 MB 0.8 0.2 0.0 0.2 0.2 0.0 0.7 7.0 112.3 111.9 2.18 1.15 1 2.180 35K 0 0.0 0.0 L3 15/0 931.35 MB 0.9 8.4 3.6 4.8 8.3 3.5 0.1 2.3 114.2 113.5 74.87 40.60 26 2.880 5849K 22K 0.0 0.0 L4 179/0 9.57 GB 1.0 8.8 5.2 3.6 8.6 5.0 0.3 1.7 117.9 116.0 76.06 42.28 58 1.311 4692K 1062 0.0 0.0 L5 1152/0 94.86 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1372/16 108.88 GB 0.0 21.2 9.8 11.3 24.7 13.4 6.4 6.6 108.4 126.6 199.76 111.42 146 1.368 14M 29K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.2 9.8 11.3 24.7 13.4 6.4 6.6 108.4 126.6 199.76 111.42 146 1.368 14M 29K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.2 9.8 11.3 21.0 9.6 0.0 0.0 122.5 121.3 176.85 100.35 96 1.842 14M 29K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 167.7 22.91 11.08 50 0.458 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.2 total, 24.0 interval Flush(GB): cumulative 3.752, interval 3.752 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.70 GB write, 1044.13 MB/s write, 21.15 GB read, 893.95 MB/s read, 199.8 seconds Interval compaction: 24.70 GB write, 1052.77 MB/s write, 21.15 GB read, 901.35 MB/s read, 199.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 73, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 73, interval: 74 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1210052 Average: 12.1561 StdDev: 130.94 Min: 0 Median: 1.7624 Max: 35898 Percentiles: P50: 1.76 P75: 2.69 P99: 197.93 P99.9: 1349.58 P99.99: 3006.08 ------------------------------------------------------ [ 0, 1 ] 111307 9.199% 9.199% ## ( 1, 2 ] 647601 53.518% 62.717% ########### ( 2, 3 ] 216475 17.890% 80.607% #### ( 3, 4 ] 93703 7.744% 88.350% ## ( 4, 6 ] 91204 7.537% 95.888% ## ( 6, 10 ] 19859 1.641% 97.529% ( 10, 15 ] 3285 0.271% 97.800% ( 15, 22 ] 469 0.039% 97.839% ( 22, 34 ] 69 0.006% 97.845% ( 34, 51 ] 45 0.004% 97.848% ( 51, 76 ] 40 0.003% 97.852% ( 76, 110 ] 2348 0.194% 98.046% ( 110, 170 ] 9849 0.814% 98.860% ( 170, 250 ] 4865 0.402% 99.262% ( 250, 380 ] 2392 0.198% 99.459% ( 380, 580 ] 2398 0.198% 99.658% ( 580, 870 ] 1745 0.144% 99.802% ( 870, 1300 ] 1134 0.094% 99.896% ( 1300, 1900 ] 665 0.055% 99.950% ( 1900, 2900 ] 443 0.037% 99.987% ( 2900, 4400 ] 509 0.042% 100.029% ( 4400, 6600 ] 106 0.009% 100.038% ( 6600, 9900 ] 19 0.002% 100.040% ( 14000, 22000 ] 3 0.000% 100.040% ( 22000, 33000 ] 1 0.000% 100.040% ( 33000, 50000 ] 1 0.000% 100.040% ** Level 1 read latency histogram (micros): Count: 249207 Average: 14.2928 StdDev: 174.24 Min: 1 Median: 1.9759 Max: 29193 Percentiles: P50: 1.98 P75: 2.99 P99: 126.15 P99.9: 2342.66 P99.99: 3997.19 ------------------------------------------------------ [ 0, 1 ] 4889 1.962% 1.962% ( 1, 2 ] 122675 49.226% 51.188% ########## ( 2, 3 ] 59700 23.956% 75.144% ##### ( 3, 4 ] 24273 9.740% 84.884% ## ( 4, 6 ] 26675 10.704% 95.588% ## ( 6, 10 ] 7019 2.817% 98.405% # ( 10, 15 ] 1071 0.430% 98.834% ( 15, 22 ] 187 0.075% 98.909% ( 22, 34 ] 20 0.008% 98.917% ( 34, 51 ] 25 0.010% 98.927% ( 51, 76 ] 20 0.008% 98.935% ( 76, 110 ] 67 0.027% 98.962% ( 110, 170 ] 349 0.140% 99.102% ( 170, 250 ] 226 0.091% 99.193% ( 250, 380 ] 241 0.097% 99.290% ( 380, 580 ] 362 0.145% 99.435% ( 580, 870 ] 452 0.181% 99.616% ( 870, 1300 ] 387 0.155% 99.772% ( 1300, 1900 ] 241 0.097% 99.868% ( 1900, 2900 ] 178 0.071% 99.940% ( 2900, 4400 ] 171 0.069% 100.008% ( 4400, 6600 ] 45 0.018% 100.026% ( 6600, 9900 ] 6 0.002% 100.029% ( 22000, 33000 ] 2 0.001% 100.030% ** Level 2 read latency histogram (micros): Count: 647875 Average: 14.9115 StdDev: 183.69 Min: 1 Median: 2.0046 Max: 15374 Percentiles: P50: 2.00 P75: 3.08 P99: 12.61 P99.9: 2272.46 P99.99: 3406.88 ------------------------------------------------------ [ 0, 1 ] 12028 1.857% 1.857% ( 1, 2 ] 311194 48.033% 49.890% ########## ( 2, 3 ] 157027 24.237% 74.127% ##### ( 3, 4 ] 68205 10.527% 84.654% ## ( 4, 6 ] 71335 11.011% 95.665% ## ( 6, 10 ] 19682 3.038% 98.703% # ( 10, 15 ] 3688 0.569% 99.272% ( 15, 22 ] 584 0.090% 99.362% ( 22, 34 ] 77 0.012% 99.374% ( 34, 51 ] 32 0.005% 99.379% ( 51, 76 ] 36 0.006% 99.385% ( 76, 110 ] 21 0.003% 99.388% ( 110, 170 ] 64 0.010% 99.398% ( 170, 250 ] 98 0.015% 99.413% ( 250, 380 ] 219 0.034% 99.447% ( 380, 580 ] 450 0.069% 99.516% ( 580, 870 ] 735 0.113% 99.630% ( 870, 1300 ] 862 0.133% 99.763% ( 1300, 1900 ] 670 0.103% 99.866% ( 1900, 2900 ] 591 0.091% 99.957% ( 2900, 4400 ] 628 0.097% 100.054% ( 4400, 6600 ] 180 0.028% 100.082% ( 6600, 9900 ] 39 0.006% 100.088% ( 9900, 14000 ] 1 0.000% 100.088% ( 14000, 22000 ] 1 0.000% 100.088% ** Level 3 read latency histogram (micros): Count: 2525059 Average: 11.3833 StdDev: 159.06 Min: 0 Median: 1.9753 Max: 45120 Percentiles: P50: 1.98 P75: 2.98 P99: 9.77 P99.9: 748.66 P99.99: 1042.36 ------------------------------------------------------ [ 0, 1 ] 36027 1.427% 1.427% ( 1, 2 ] 1257505 49.801% 51.228% ########## ( 2, 3 ] 615098 24.360% 75.588% ##### ( 3, 4 ] 260504 10.317% 85.904% ## ( 4, 6 ] 268948 10.651% 96.555% ## ( 6, 10 ] 65498 2.594% 99.149% # ( 10, 15 ] 11018 0.436% 99.586% ( 15, 22 ] 1315 0.052% 99.638% ( 22, 34 ] 112 0.004% 99.642% ( 34, 51 ] 156 0.006% 99.648% ( 51, 76 ] 257 0.010% 99.659% ( 76, 110 ] 216 0.009% 99.667% ( 110, 170 ] 691 0.027% 99.695% ( 170, 250 ] 645 0.026% 99.720% ( 250, 380 ] 1003 0.040% 99.760% ( 380, 580 ] 1927 0.076% 99.836% ( 580, 870 ] 2775 0.110% 99.946% ( 870, 1300 ] 2773 0.110% 100.056% ( 1300, 1900 ] 1761 0.070% 100.126% ( 1900, 2900 ] 1497 0.059% 100.185% ( 2900, 4400 ] 1634 0.065% 100.250% ( 4400, 6600 ] 387 0.015% 100.265% ( 6600, 9900 ] 66 0.003% 100.267% ( 9900, 14000 ] 8 0.000% 100.268% ( 14000, 22000 ] 11 0.000% 100.268% ( 22000, 33000 ] 1 0.000% 100.268% ( 33000, 50000 ] 5 0.000% 100.268% ** Level 4 read latency histogram (micros): Count: 942114 Average: 25.5588 StdDev: 251.93 Min: 1 Median: 1.9603 Max: 43053 Percentiles: P50: 1.96 P75: 3.04 P99: 577.95 P99.9: 2547.60 P99.99: 3338.11 ------------------------------------------------------ [ 0, 1 ] 18360 1.949% 1.949% ( 1, 2 ] 471389 50.035% 51.984% ########## ( 2, 3 ] 213360 22.647% 74.631% ##### ( 3, 4 ] 95463 10.133% 84.764% ## ( 4, 6 ] 94300 10.009% 94.773% ## ( 6, 10 ] 24313 2.581% 97.354% # ( 10, 15 ] 3783 0.402% 97.755% ( 15, 22 ] 471 0.050% 97.805% ( 22, 34 ] 67 0.007% 97.813% ( 34, 51 ] 68 0.007% 97.820% ( 51, 76 ] 92 0.010% 97.830% ( 76, 110 ] 919 0.098% 97.927% ( 110, 170 ] 3884 0.412% 98.339% ( 170, 250 ] 2168 0.230% 98.569% ( 250, 380 ] 1633 0.173% 98.743% ( 380, 580 ] 2448 0.260% 99.003% ( 580, 870 ] 2978 0.316% 99.319% ( 870, 1300 ] 2914 0.309% 99.628% ( 1300, 1900 ] 1709 0.181% 99.809% ( 1900, 2900 ] 1317 0.140% 99.949% ( 2900, 4400 ] 1314 0.139% 100.089% ( 4400, 6600 ] 375 0.040% 100.129% ( 6600, 9900 ] 79 0.008% 100.137% ( 9900, 14000 ] 6 0.001% 100.138% ( 14000, 22000 ] 6 0.001% 100.138% ( 22000, 33000 ] 1 0.000% 100.138% ( 33000, 50000 ] 6 0.001% 100.139% ** Level 5 read latency histogram (micros): Count: 91724 Average: 739.5647 StdDev: 1084.64 Min: 75 Median: 322.0592 Max: 39543 Percentiles: P50: 322.06 P75: 851.79 P99: 5433.64 P99.9: 8643.51 P99.99: 13929.32 ------------------------------------------------------ ( 51, 76 ] 2 0.002% 0.002% ( 76, 110 ] 5491 5.986% 5.989% # ( 110, 170 ] 23969 26.132% 32.120% ##### ( 170, 250 ] 12128 13.222% 45.343% ### ( 250, 380 ] 7707 8.402% 53.745% ## ( 380, 580 ] 9897 10.790% 64.535% ## ( 580, 870 ] 10242 11.166% 75.701% ## ( 870, 1300 ] 8707 9.493% 85.194% ## ( 1300, 1900 ] 4930 5.375% 90.568% # ( 1900, 2900 ] 3418 3.726% 94.295% # ( 2900, 4400 ] 3689 4.022% 98.317% # ( 4400, 6600 ] 1334 1.454% 99.771% ( 6600, 9900 ] 191 0.208% 99.979% ( 9900, 14000 ] 10 0.011% 99.990% ( 14000, 22000 ] 7 0.008% 99.998% ( 22000, 33000 ] 6 0.007% 100.004% ( 33000, 50000 ] 3 0.003% 100.008% ** DB Stats ** Uptime(secs): 24.2 total, 3.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 162.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.793 H:M:S, 36.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 277.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.083 H:M:S, 2.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-21:04:09 ... thread 0: (1000000,5000000) ops and (90780.7,142686.8) ops/second in (11.015552,35.041777) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/10 4.11 GB 288.4 5.2 0.0 5.2 9.9 4.7 0.0 2.1 106.3 203.4 49.79 34.31 80 0.622 5371K 14K 0.0 0.0 L1 6/6 337.70 MB 0.0 1.2 1.0 0.1 1.2 1.0 0.0 1.1 120.2 119.9 9.86 5.52 2 4.930 1203K 2502 0.0 0.0 L2 1/0 76.26 MB 0.8 0.2 0.0 0.2 0.2 0.0 0.7 7.0 112.3 111.9 2.18 1.15 1 2.180 35K 0 0.0 0.0 L3 15/0 931.35 MB 0.9 8.4 3.6 4.8 8.3 3.5 0.1 2.3 114.2 113.5 74.87 40.60 26 2.880 5849K 22K 0.0 0.0 L4 179/0 9.57 GB 1.0 8.8 5.2 3.6 8.6 5.0 0.3 1.7 117.9 116.0 76.06 42.28 58 1.311 4692K 1062 0.0 0.0 L5 1152/0 94.86 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1370/16 109.85 GB 0.0 23.7 9.8 13.9 28.2 14.3 6.4 6.0 113.9 135.7 212.76 123.86 167 1.274 17M 41K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.7 9.8 13.9 28.2 14.3 6.4 6.0 113.9 135.7 212.76 123.86 167 1.274 17M 41K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.7 9.8 13.9 23.5 9.6 0.0 0.0 129.9 128.8 186.57 109.92 101 1.847 17M 41K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 185.2 26.19 13.94 66 0.397 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.2 total, 35.0 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.20 GB write, 819.29 MB/s write, 23.67 GB read, 687.78 MB/s read, 212.8 seconds Interval compaction: 28.20 GB write, 823.94 MB/s write, 23.67 GB read, 691.68 MB/s read, 212.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 73, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 73, interval: 84 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1935666 Average: 14.2129 StdDev: 110.46 Min: 0 Median: 1.6384 Max: 35898 Percentiles: P50: 1.64 P75: 2.46 P99: 230.66 P99.9: 925.43 P99.99: 1928.16 ------------------------------------------------------ [ 0, 1 ] 325059 16.793% 16.793% ### ( 1, 2 ] 1006792 52.013% 68.806% ########## ( 2, 3 ] 263235 13.599% 82.405% ### ( 3, 4 ] 115603 5.972% 88.377% # ( 4, 6 ] 106127 5.483% 93.860% # ( 6, 10 ] 22147 1.144% 95.004% ( 10, 15 ] 3988 0.206% 95.210% ( 15, 22 ] 572 0.030% 95.240% ( 22, 34 ] 80 0.004% 95.244% ( 34, 51 ] 49 0.003% 95.246% ( 51, 76 ] 47 0.002% 95.249% ( 76, 110 ] 12349 0.638% 95.887% ( 110, 170 ] 47618 2.460% 98.347% ( 170, 250 ] 16673 0.861% 99.208% ( 250, 380 ] 5894 0.304% 99.513% ( 380, 580 ] 4933 0.255% 99.768% ( 580, 870 ] 2409 0.124% 99.892% ( 870, 1300 ] 1205 0.062% 99.954% ( 1300, 1900 ] 679 0.035% 99.989% ( 1900, 2900 ] 477 0.025% 100.014% ( 2900, 4400 ] 528 0.027% 100.041% ( 4400, 6600 ] 109 0.006% 100.047% ( 6600, 9900 ] 19 0.001% 100.048% ( 14000, 22000 ] 3 0.000% 100.048% ( 22000, 33000 ] 1 0.000% 100.048% ( 33000, 50000 ] 1 0.000% 100.048% ** Level 1 read latency histogram (micros): Count: 295083 Average: 14.0192 StdDev: 160.85 Min: 1 Median: 2.3212 Max: 29193 Percentiles: P50: 2.32 P75: 3.91 P99: 163.18 P99.9: 2084.93 P99.99: 3956.94 ------------------------------------------------------ [ 0, 1 ] 4897 1.660% 1.660% ( 1, 2 ] 122915 41.654% 43.314% ######## ( 2, 3 ] 61425 20.816% 64.130% #### ( 3, 4 ] 35190 11.925% 76.056% ## ( 4, 6 ] 52478 17.784% 93.840% #### ( 6, 10 ] 10677 3.618% 97.458% # ( 10, 15 ] 1871 0.634% 98.092% ( 15, 22 ] 857 0.290% 98.382% ( 22, 34 ] 56 0.019% 98.401% ( 34, 51 ] 27 0.009% 98.411% ( 51, 76 ] 20 0.007% 98.417% ( 76, 110 ] 357 0.121% 98.538% ( 110, 170 ] 1537 0.521% 99.059% ( 170, 250 ] 569 0.193% 99.252% ( 250, 380 ] 347 0.118% 99.370% ( 380, 580 ] 435 0.147% 99.517% ( 580, 870 ] 469 0.159% 99.676% ( 870, 1300 ] 387 0.131% 99.807% ( 1300, 1900 ] 241 0.082% 99.889% ( 1900, 2900 ] 178 0.060% 99.949% ( 2900, 4400 ] 171 0.058% 100.007% ( 4400, 6600 ] 45 0.015% 100.022% ( 6600, 9900 ] 6 0.002% 100.024% ( 22000, 33000 ] 2 0.001% 100.025% ** Level 2 read latency histogram (micros): Count: 647997 Average: 14.9387 StdDev: 183.69 Min: 1 Median: 2.0049 Max: 15374 Percentiles: P50: 2.00 P75: 3.08 P99: 12.77 P99.9: 2272.26 P99.99: 3406.85 ------------------------------------------------------ [ 0, 1 ] 12028 1.856% 1.856% ( 1, 2 ] 311194 48.024% 49.880% ########## ( 2, 3 ] 157027 24.233% 74.113% ##### ( 3, 4 ] 68205 10.526% 84.638% ## ( 4, 6 ] 71335 11.009% 95.647% ## ( 6, 10 ] 19682 3.037% 98.684% # ( 10, 15 ] 3688 0.569% 99.253% ( 15, 22 ] 584 0.090% 99.344% ( 22, 34 ] 77 0.012% 99.355% ( 34, 51 ] 32 0.005% 99.360% ( 51, 76 ] 36 0.006% 99.366% ( 76, 110 ] 39 0.006% 99.372% ( 110, 170 ] 141 0.022% 99.394% ( 170, 250 ] 118 0.018% 99.412% ( 250, 380 ] 221 0.034% 99.446% ( 380, 580 ] 454 0.070% 99.516% ( 580, 870 ] 736 0.114% 99.630% ( 870, 1300 ] 862 0.133% 99.763% ( 1300, 1900 ] 670 0.103% 99.866% ( 1900, 2900 ] 591 0.091% 99.957% ( 2900, 4400 ] 628 0.097% 100.054% ( 4400, 6600 ] 180 0.028% 100.082% ( 6600, 9900 ] 39 0.006% 100.088% ( 9900, 14000 ] 1 0.000% 100.088% ( 14000, 22000 ] 1 0.000% 100.088% ** Level 3 read latency histogram (micros): Count: 2528070 Average: 11.5770 StdDev: 159.12 Min: 0 Median: 1.9765 Max: 45120 Percentiles: P50: 1.98 P75: 2.98 P99: 9.95 P99.9: 750.44 P99.99: 1043.05 ------------------------------------------------------ [ 0, 1 ] 36027 1.425% 1.425% ( 1, 2 ] 1257505 49.742% 51.167% ########## ( 2, 3 ] 615098 24.331% 75.498% ##### ( 3, 4 ] 260504 10.304% 85.802% ## ( 4, 6 ] 268948 10.638% 96.440% ## ( 6, 10 ] 65498 2.591% 99.031% # ( 10, 15 ] 11018 0.436% 99.467% ( 15, 22 ] 1315 0.052% 99.519% ( 22, 34 ] 112 0.004% 99.524% ( 34, 51 ] 156 0.006% 99.530% ( 51, 76 ] 257 0.010% 99.540% ( 76, 110 ] 703 0.028% 99.568% ( 110, 170 ] 2385 0.094% 99.662% ( 170, 250 ] 1156 0.046% 99.708% ( 250, 380 ] 1164 0.046% 99.754% ( 380, 580 ] 2045 0.081% 99.835% ( 580, 870 ] 2809 0.111% 99.946% ( 870, 1300 ] 2776 0.110% 100.056% ( 1300, 1900 ] 1761 0.070% 100.125% ( 1900, 2900 ] 1500 0.059% 100.185% ( 2900, 4400 ] 1634 0.065% 100.249% ( 4400, 6600 ] 387 0.015% 100.265% ( 6600, 9900 ] 66 0.003% 100.267% ( 9900, 14000 ] 8 0.000% 100.267% ( 14000, 22000 ] 11 0.000% 100.268% ( 22000, 33000 ] 1 0.000% 100.268% ( 33000, 50000 ] 5 0.000% 100.268% ** Level 4 read latency histogram (micros): Count: 969098 Average: 29.4264 StdDev: 250.16 Min: 1 Median: 1.9889 Max: 43053 Percentiles: P50: 1.99 P75: 3.25 P99: 580.36 P99.9: 2529.36 P99.99: 3334.37 ------------------------------------------------------ [ 0, 1 ] 18360 1.895% 1.895% ( 1, 2 ] 471398 48.643% 50.538% ########## ( 2, 3 ] 213388 22.019% 72.557% #### ( 3, 4 ] 95797 9.885% 82.442% ## ( 4, 6 ] 94869 9.789% 92.231% ## ( 6, 10 ] 24356 2.513% 94.745% # ( 10, 15 ] 3802 0.392% 95.137% ( 15, 22 ] 472 0.049% 95.186% ( 22, 34 ] 67 0.007% 95.193% ( 34, 51 ] 68 0.007% 95.200% ( 51, 76 ] 92 0.009% 95.209% ( 76, 110 ] 5014 0.517% 95.726% ( 110, 170 ] 18956 1.956% 97.682% ( 170, 250 ] 6423 0.663% 98.345% ( 250, 380 ] 2941 0.303% 98.649% ( 380, 580 ] 3400 0.351% 99.000% ( 580, 870 ] 3221 0.332% 99.332% ( 870, 1300 ] 2953 0.305% 99.637% ( 1300, 1900 ] 1718 0.177% 99.814% ( 1900, 2900 ] 1325 0.137% 99.951% ( 2900, 4400 ] 1316 0.136% 100.086% ( 4400, 6600 ] 375 0.039% 100.125% ( 6600, 9900 ] 79 0.008% 100.133% ( 9900, 14000 ] 6 0.001% 100.134% ( 14000, 22000 ] 6 0.001% 100.135% ( 22000, 33000 ] 1 0.000% 100.135% ( 33000, 50000 ] 6 0.001% 100.135% ** Level 5 read latency histogram (micros): Count: 241357 Average: 385.8416 StdDev: 728.61 Min: 75 Median: 159.3441 Max: 39543 Percentiles: P50: 159.34 P75: 284.04 P99: 4046.73 P99.9: 6541.73 P99.99: 9742.16 ------------------------------------------------------ ( 51, 76 ] 4 0.002% 0.002% ( 76, 110 ] 29633 12.278% 12.279% ## ( 110, 170 ] 110702 45.866% 58.146% ######### ( 170, 250 ] 36779 15.238% 73.384% ### ( 250, 380 ] 14892 6.170% 79.554% # ( 380, 580 ] 15251 6.319% 85.873% # ( 580, 870 ] 11597 4.805% 90.678% # ( 870, 1300 ] 8843 3.664% 94.342% # ( 1300, 1900 ] 4963 2.056% 96.398% ( 1900, 2900 ] 3447 1.428% 97.826% ( 2900, 4400 ] 3705 1.535% 99.362% ( 4400, 6600 ] 1335 0.553% 99.915% ( 6600, 9900 ] 191 0.079% 99.994% ( 9900, 14000 ] 10 0.004% 99.998% ( 14000, 22000 ] 7 0.003% 100.001% ( 22000, 33000 ] 6 0.002% 100.003% ( 33000, 50000 ] 3 0.001% 100.005% ** DB Stats ** Uptime(secs): 35.2 total, 11.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 139.63 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.925 H:M:S, 45.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 89.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.132 H:M:S, 64.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 298.101 micros/op 13405 ops/sec 60.124 seconds 805996 operations; 13.0 MB/s (201999 of 201999 found) Microseconds per read: Count: 805996 Average: 298.1049 StdDev: 885.08 Min: 2 Median: 192.9371 Max: 79037 Percentiles: P50: 192.94 P75: 242.91 P99: 2373.14 P99.9: 14156.93 P99.99: 32595.75 ------------------------------------------------------ ( 1, 2 ] 1 0.000% 0.000% ( 2, 3 ] 2 0.000% 0.000% ( 3, 4 ] 2 0.000% 0.001% ( 4, 6 ] 65 0.008% 0.009% ( 6, 10 ] 212 0.026% 0.035% ( 10, 15 ] 127 0.016% 0.051% ( 15, 22 ] 374 0.046% 0.097% ( 22, 34 ] 9784 1.214% 1.311% ( 34, 51 ] 3797 0.471% 1.782% ( 51, 76 ] 481 0.060% 1.842% ( 76, 110 ] 330 0.041% 1.883% ( 110, 170 ] 295343 36.643% 38.526% ####### ( 170, 250 ] 322552 40.019% 78.545% ######## ( 250, 380 ] 86964 10.790% 89.335% ## ( 380, 580 ] 39273 4.873% 94.207% # ( 580, 870 ] 19611 2.433% 96.640% ( 870, 1300 ] 11433 1.418% 98.059% ( 1300, 1900 ] 5824 0.723% 98.782% ( 1900, 2900 ] 3722 0.462% 99.243% ( 2900, 4400 ] 3417 0.424% 99.667% ( 4400, 6600 ] 1155 0.143% 99.811% ( 6600, 9900 ] 329 0.041% 99.851% ( 9900, 14000 ] 382 0.047% 99.899% ( 14000, 22000 ] 510 0.063% 99.962% ( 22000, 33000 ] 234 0.029% 99.991% ( 33000, 50000 ] 55 0.007% 99.998% ( 50000, 75000 ] 16 0.002% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 13403049 rocksdb.bloom.filter.full.positive COUNT : 935929 rocksdb.bloom.filter.full.true.positive COUNT : 805583 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 413 rocksdb.memtable.miss COUNT : 805583 rocksdb.l0.hit COUNT : 29682 rocksdb.l1.hit COUNT : 7332 rocksdb.l2andup.hit COUNT : 768569 rocksdb.compaction.key.drop.new COUNT : 243088 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5706018 rocksdb.number.keys.read COUNT : 805996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5888610576 rocksdb.bytes.read COUNT : 805996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1766 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 37467021 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 28428336074 rocksdb.compact.write.bytes COUNT : 28174689203 rocksdb.flush.write.bytes COUNT : 5878923421 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 36 rocksdb.number.superversion_acquires COUNT : 1185 rocksdb.number.superversion_releases COUNT : 1151 rocksdb.number.superversion_cleanups COUNT : 297 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 391 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5831656448 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2394112 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 32101029533 rocksdb.non.last.level.read.count COUNT : 7614765 rocksdb.block.checksum.compute.count COUNT : 7830916 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 191.605871 P95 : 673.020998 P99 : 2372.449583 P100 : 79033.000000 COUNT : 805996 SUM : 239365169 rocksdb.db.write.micros P50 : 1.561131 P95 : 4.817366 P99 : 10.021193 P100 : 849261.000000 COUNT : 5706018 SUM : 52426206 rocksdb.compaction.times.micros P50 : 1490425.531915 P95 : 5478571.428571 P99 : 9635000.000000 P100 : 25069368.000000 COUNT : 105 SUM : 214575067 rocksdb.compaction.times.cpu_micros P50 : 835377.358491 P95 : 2858333.333333 P99 : 6445000.000000 P100 : 11325941.000000 COUNT : 105 SUM : 124109383 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 860.333333 P95 : 63750.000000 P99 : 278600.000000 P100 : 282231.000000 COUNT : 78 SUM : 955827 rocksdb.compaction.outfile.sync.micros P50 : 30773.809524 P95 : 200888.888889 P99 : 323450.000000 P100 : 993292.000000 COUNT : 361 SUM : 21092420 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 733.529412 P95 : 4085.714286 P99 : 6124.800000 P100 : 31663.000000 COUNT : 208 SUM : 284933 rocksdb.table.open.io.micros P50 : 8893.995381 P95 : 20757.046980 P99 : 28374.761905 P100 : 28892.000000 COUNT : 1766 SUM : 16290165 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.251055 P95 : 9.959152 P99 : 175.123154 P100 : 45124.000000 COUNT : 6884031 SUM : 108888111 rocksdb.read.block.get.micros P50 : 143.734350 P95 : 546.521894 P99 : 2145.026153 P100 : 39548.000000 COUNT : 945142 SUM : 202075093 rocksdb.write.raw.block.micros P50 : 0.542077 P95 : 1.513088 P99 : 4.099525 P100 : 37729.000000 COUNT : 8248179 SUM : 27610794 rocksdb.numfiles.in.singlecompaction P50 : 2.850000 P95 : 7.960000 P99 : 14.483333 P100 : 26.000000 COUNT : 131 SUM : 497 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.572777 P95 : 1183.879987 P99 : 2443.940464 P100 : 849094.000000 COUNT : 183182 SUM : 37488534 rocksdb.sst.read.micros P50 : 2.064354 P95 : 158.726551 P99 : 536.672094 P100 : 45120.000000 COUNT : 7614856 SUM : 289122160 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 805996 SUM : 805996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5706018 SUM : 5888610576 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 235000.000000 P95 : 1010571.428571 P99 : 1098322.000000 P100 : 1098322.000000 COUNT : 78 SUM : 28720294 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 392 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0