[2024-07-13 17:29:00.069602] Starting SPDK v24.09-pre git sha1 719d03c6a / DPDK 23.11.0 initialization... [2024-07-13 17:29:00.069910] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3907675 ] Set seed to 1720884540063148 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-13 17:29:00.178102] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-13 17:29:00.219026] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-13 17:29:00.219078] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3907675' to capture a snapshot of events at runtime. [2024-07-13 17:29:00.219089] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-13 17:29:00.219103] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-13 17:29:00.219111] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3907675 for offline analysis/debug. [2024-07-13 17:29:00.219197] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Jul 13 17:29:04 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/13-17:29:07 ... thread 0: (1000000,1000000) ops and (350339.4,350339.4) ops/second in (2.854375,2.854375) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.01 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 353.3 2.32 2.09 12 0.193 0 0 0.0 0.0 L2 3/2 251.75 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 253.7 253.5 1.49 1.44 2 0.745 383K 199 0.0 0.0 L3 12/0 993.14 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1180/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 99.2 314.3 3.81 3.53 14 0.272 383K 199 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.1 1.5 99.2 314.3 3.81 3.53 14 0.272 383K 199 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 253.7 253.5 1.49 1.44 2 0.745 383K 199 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 353.3 2.32 2.09 12 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 390.58 MB/s write, 0.37 GB read, 123.35 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 419.06 MB/s write, 0.37 GB read, 132.34 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 106621 Average: 1.9157 StdDev: 18.19 Min: 1 Median: 1.2500 Max: 3134 Percentiles: P50: 1.25 P75: 1.68 P99: 3.91 P99.9: 8.98 P99.99: 264.64 ------------------------------------------------------ [ 0, 1 ] 37682 35.342% 35.342% ####### ( 1, 2 ] 62528 58.645% 93.987% ############ ( 2, 3 ] 3992 3.744% 97.731% # ( 3, 4 ] 1492 1.399% 99.131% ( 4, 6 ] 656 0.615% 99.746% ( 6, 10 ] 223 0.209% 99.955% ( 10, 15 ] 16 0.015% 99.970% ( 15, 22 ] 7 0.007% 99.977% ( 22, 34 ] 1 0.001% 99.977% ( 51, 76 ] 2 0.002% 99.979% ( 110, 170 ] 9 0.008% 99.988% ( 170, 250 ] 4 0.004% 99.992% ( 250, 380 ] 3 0.003% 99.994% ( 580, 870 ] 2 0.002% 99.996% ( 870, 1300 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ( 2900, 4400 ] 2 0.002% 100.002% ** Level 2 read latency histogram (micros): Count: 53761 Average: 2.0852 StdDev: 17.56 Min: 1 Median: 1.2988 Max: 2110 Percentiles: P50: 1.30 P75: 1.72 P99: 5.13 P99.9: 10.32 P99.99: 851.82 ------------------------------------------------------ [ 0, 1 ] 17245 32.077% 32.077% ###### ( 1, 2 ] 32248 59.984% 92.061% ############ ( 2, 3 ] 2291 4.261% 96.323% # ( 3, 4 ] 1081 2.011% 98.333% ( 4, 6 ] 637 1.185% 99.518% ( 6, 10 ] 204 0.379% 99.898% ( 10, 15 ] 35 0.065% 99.963% ( 15, 22 ] 2 0.004% 99.967% ( 22, 34 ] 2 0.004% 99.970% ( 34, 51 ] 1 0.002% 99.972% ( 51, 76 ] 1 0.002% 99.974% ( 250, 380 ] 2 0.004% 99.978% ( 380, 580 ] 2 0.004% 99.981% ( 580, 870 ] 6 0.011% 99.993% ( 870, 1300 ] 3 0.006% 99.998% ( 1900, 2900 ] 2 0.004% 100.002% ** Level 3 read latency histogram (micros): Count: 50 Average: 1822.5600 StdDev: 1590.43 Min: 115 Median: 1085.0000 Max: 5838 Percentiles: P50: 1085.00 P75: 2622.22 P99: 5838.00 P99.9: 5838.00 P99.99: 5838.00 ------------------------------------------------------ ( 110, 170 ] 2 4.000% 4.000% # ( 250, 380 ] 3 6.000% 10.000% # ( 380, 580 ] 3 6.000% 16.000% # ( 580, 870 ] 12 24.000% 40.000% ##### ( 870, 1300 ] 10 20.000% 60.000% #### ( 1300, 1900 ] 1 2.000% 62.000% ( 1900, 2900 ] 9 18.000% 80.000% #### ( 2900, 4400 ] 5 10.000% 90.000% ## ( 4400, 6600 ] 5 10.000% 100.000% ## ** Level 4 read latency histogram (micros): Count: 20 Average: 1729.8500 StdDev: 1646.41 Min: 244 Median: 1085.0000 Max: 5567 Percentiles: P50: 1085.00 P75: 2400.00 P99: 5567.00 P99.9: 5567.00 P99.99: 5567.00 ------------------------------------------------------ ( 170, 250 ] 1 5.000% 5.000% # ( 250, 380 ] 3 15.000% 20.000% ### ( 380, 580 ] 1 5.000% 25.000% # ( 580, 870 ] 3 15.000% 40.000% ### ( 870, 1300 ] 4 20.000% 60.000% #### ( 1300, 1900 ] 1 5.000% 65.000% # ( 1900, 2900 ] 4 20.000% 85.000% #### ( 4400, 6600 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 321.20 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.181 H:M:S, 5.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 344.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.181 H:M:S, 6.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/13-17:29:10 ... thread 0: (1000000,2000000) ops and (320660.9,334843.8) ops/second in (3.118559,5.972934) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 1.17 GB 18.9 0.2 0.0 0.2 2.0 1.8 0.0 1.1 40.6 334.5 6.21 5.63 27 0.230 255K 234 0.0 0.0 L1 5/5 377.36 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 241.7 241.3 1.56 1.51 1 1.564 383K 607 0.0 0.0 L2 1/0 2.57 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 253.7 253.5 1.49 1.44 2 0.745 383K 199 0.0 0.0 L3 15/0 639.95 MB 0.6 0.2 0.2 0.0 0.2 0.2 0.1 1.0 233.5 233.5 1.07 1.00 1 1.067 253K 0 0.0 0.0 L4 169/0 9.45 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 164.3 164.4 1.37 1.03 1 1.366 227K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1252/17 97.92 GB 0.0 1.4 1.0 0.4 3.2 2.8 1.5 1.8 126.6 282.7 11.70 10.61 32 0.366 1504K 1040 0.0 0.0 Int 0/0 0.00 KB 0.0 1.4 1.0 0.4 3.2 2.8 1.4 1.8 126.6 282.7 11.70 10.61 32 0.366 1504K 1040 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.4 1.0 0.4 1.4 1.0 0.0 0.0 229.6 229.5 6.45 5.92 6 1.075 1504K 1040 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 348.1 5.25 4.69 26 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.23 GB write, 534.97 MB/s write, 1.45 GB read, 239.64 MB/s read, 11.7 seconds Interval compaction: 3.23 GB write, 553.61 MB/s write, 1.45 GB read, 247.99 MB/s read, 11.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 331979 Average: 2.1625 StdDev: 13.91 Min: 0 Median: 1.4619 Max: 3134 Percentiles: P50: 1.46 P75: 1.85 P99: 5.42 P99.9: 9.82 P99.99: 14.78 ------------------------------------------------------ [ 0, 1 ] 67444 20.316% 20.316% #### ( 1, 2 ] 213359 64.269% 84.585% ############# ( 2, 3 ] 33290 10.028% 94.612% ## ( 3, 4 ] 10238 3.084% 97.696% # ( 4, 6 ] 6078 1.831% 99.527% ( 6, 10 ] 1296 0.390% 99.917% ( 10, 15 ] 253 0.076% 99.994% ( 15, 22 ] 20 0.006% 100.000% ( 22, 34 ] 3 0.001% 100.001% ( 34, 51 ] 3 0.001% 100.002% ( 51, 76 ] 4 0.001% 100.003% ( 110, 170 ] 16 0.005% 100.008% ( 170, 250 ] 12 0.004% 100.011% ( 250, 380 ] 6 0.002% 100.013% ( 380, 580 ] 1 0.000% 100.013% ( 580, 870 ] 4 0.001% 100.014% ( 870, 1300 ] 7 0.002% 100.017% ( 1300, 1900 ] 1 0.000% 100.017% ( 1900, 2900 ] 4 0.001% 100.018% ( 2900, 4400 ] 3 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 29413 Average: 2.2239 StdDev: 11.26 Min: 1 Median: 1.4922 Max: 1372 Percentiles: P50: 1.49 P75: 1.87 P99: 5.23 P99.9: 10.56 P99.99: 597.02 ------------------------------------------------------ [ 0, 1 ] 5043 17.145% 17.145% ### ( 1, 2 ] 19632 66.746% 83.891% ############# ( 2, 3 ] 3316 11.274% 95.165% ## ( 3, 4 ] 862 2.931% 98.096% # ( 4, 6 ] 433 1.472% 99.568% ( 6, 10 ] 95 0.323% 99.891% ( 10, 15 ] 23 0.078% 99.969% ( 15, 22 ] 1 0.003% 99.973% ( 110, 170 ] 1 0.003% 99.976% ( 170, 250 ] 1 0.003% 99.980% ( 250, 380 ] 3 0.010% 99.990% ( 580, 870 ] 1 0.003% 99.993% ( 870, 1300 ] 1 0.003% 99.997% ( 1300, 1900 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 95268 Average: 2.1907 StdDev: 13.21 Min: 1 Median: 1.4453 Max: 2110 Percentiles: P50: 1.45 P75: 1.84 P99: 5.63 P99.9: 11.47 P99.99: 651.20 ------------------------------------------------------ [ 0, 1 ] 20729 21.759% 21.759% #### ( 1, 2 ] 60418 63.419% 85.178% ############# ( 2, 3 ] 8202 8.609% 93.787% ## ( 3, 4 ] 3165 3.322% 97.109% # ( 4, 6 ] 2208 2.318% 99.427% ( 6, 10 ] 421 0.442% 99.869% ( 10, 15 ] 101 0.106% 99.975% ( 15, 22 ] 5 0.005% 99.980% ( 22, 34 ] 2 0.002% 99.982% ( 34, 51 ] 1 0.001% 99.983% ( 51, 76 ] 1 0.001% 99.984% ( 250, 380 ] 2 0.002% 99.986% ( 380, 580 ] 2 0.002% 99.988% ( 580, 870 ] 6 0.006% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57067 Average: 3.7345 StdDev: 71.78 Min: 0 Median: 1.4829 Max: 5838 Percentiles: P50: 1.48 P75: 1.87 P99: 5.73 P99.9: 20.76 P99.99: 4187.99 ------------------------------------------------------ [ 0, 1 ] 10753 18.843% 18.843% #### ( 1, 2 ] 36817 64.515% 83.358% ############# ( 2, 3 ] 6312 11.061% 94.419% ## ( 3, 4 ] 1591 2.788% 97.207% # ( 4, 6 ] 1181 2.069% 99.276% ( 6, 10 ] 288 0.505% 99.781% ( 10, 15 ] 63 0.110% 99.891% ( 15, 22 ] 6 0.011% 99.902% ( 110, 170 ] 2 0.004% 99.905% ( 250, 380 ] 6 0.011% 99.916% ( 380, 580 ] 4 0.007% 99.923% ( 580, 870 ] 13 0.023% 99.946% ( 870, 1300 ] 11 0.019% 99.965% ( 1300, 1900 ] 1 0.002% 99.967% ( 1900, 2900 ] 9 0.016% 99.982% ( 2900, 4400 ] 5 0.009% 99.991% ( 4400, 6600 ] 5 0.009% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 119.9574 StdDev: 600.20 Min: 0 Median: 1.6188 Max: 5567 Percentiles: P50: 1.62 P75: 4.96 P99: 2887.50 P99.9: 5567.00 P99.99: 5567.00 ------------------------------------------------------ [ 0, 1 ] 90 29.508% 29.508% ###### ( 1, 2 ] 101 33.115% 62.623% ####### ( 2, 3 ] 29 9.508% 72.131% ## ( 3, 4 ] 2 0.656% 72.787% ( 4, 6 ] 14 4.590% 77.377% # ( 6, 10 ] 9 2.951% 80.328% # ( 10, 15 ] 19 6.230% 86.557% # ( 15, 22 ] 15 4.918% 91.475% # ( 22, 34 ] 1 0.328% 91.803% ( 51, 76 ] 1 0.328% 92.131% ( 110, 170 ] 1 0.328% 92.459% ( 170, 250 ] 3 0.984% 93.443% ( 250, 380 ] 4 1.311% 94.754% ( 380, 580 ] 1 0.328% 95.082% ( 580, 870 ] 3 0.984% 96.066% ( 870, 1300 ] 4 1.311% 97.377% ( 1300, 1900 ] 1 0.328% 97.705% ( 1900, 2900 ] 4 1.311% 99.016% ( 4400, 6600 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 756.7750 StdDev: 895.29 Min: 74 Median: 315.0000 Max: 3152 Percentiles: P50: 315.00 P75: 977.50 P99: 3152.00 P99.9: 3152.00 P99.99: 3152.00 ------------------------------------------------------ ( 51, 76 ] 2 5.000% 5.000% # ( 76, 110 ] 5 12.500% 17.500% ### ( 110, 170 ] 4 10.000% 27.500% ## ( 170, 250 ] 8 20.000% 47.500% #### ( 250, 380 ] 2 5.000% 52.500% # ( 380, 580 ] 5 12.500% 65.000% ### ( 580, 870 ] 3 7.500% 72.500% ## ( 870, 1300 ] 4 10.000% 82.500% ## ( 1300, 1900 ] 2 5.000% 87.500% # ( 1900, 2900 ] 3 7.500% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.2 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 318.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.554 H:M:S, 9.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 315.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.374 H:M:S, 12.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/13-17:29:13 ... thread 0: (1000000,3000000) ops and (308936.3,325738.3) ops/second in (3.236913,9.209847) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 2.21 GB 125.9 1.3 0.0 1.3 4.1 2.8 0.0 1.5 99.5 317.3 13.30 12.29 47 0.283 1343K 1346 0.0 0.0 L1 5/5 377.36 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 241.7 241.3 1.56 1.51 1 1.564 383K 607 0.0 0.0 L2 1/0 2.57 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 253.7 253.5 1.49 1.44 2 0.745 383K 199 0.0 0.0 L3 15/0 639.95 MB 0.6 0.2 0.2 0.0 0.2 0.2 0.1 1.0 233.5 233.5 1.07 1.00 1 1.067 253K 0 0.0 0.0 L4 169/0 9.45 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 164.3 164.4 1.37 1.03 1 1.366 227K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/17 98.96 GB 0.0 2.5 1.0 1.5 5.3 3.8 1.5 1.9 135.9 290.0 18.79 17.26 52 0.361 2591K 2152 0.0 0.0 Int 0/0 0.00 KB 0.0 2.5 1.0 1.5 5.3 3.8 1.4 1.9 135.9 290.0 18.79 17.26 52 0.361 2591K 2152 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.5 1.0 1.5 2.5 1.0 0.0 0.0 242.9 242.7 10.51 9.89 10 1.051 2591K 2152 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 350.1 8.28 7.37 42 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.4 total, 9.2 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.32 GB write, 578.41 MB/s write, 2.49 GB read, 270.99 MB/s read, 18.8 seconds Interval compaction: 5.32 GB write, 591.48 MB/s write, 2.49 GB read, 277.12 MB/s read, 18.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 7, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 699773 Average: 2.2040 StdDev: 12.57 Min: 0 Median: 1.5047 Max: 3564 Percentiles: P50: 1.50 P75: 1.88 P99: 5.49 P99.9: 9.94 P99.99: 14.39 ------------------------------------------------------ [ 0, 1 ] 116110 16.593% 16.593% ### ( 1, 2 ] 463173 66.189% 82.782% ############# ( 2, 3 ] 80075 11.443% 94.225% ## ( 3, 4 ] 23119 3.304% 97.528% # ( 4, 6 ] 13820 1.975% 99.503% ( 6, 10 ] 2822 0.403% 99.907% ( 10, 15 ] 668 0.095% 100.002% ( 15, 22 ] 47 0.007% 100.009% ( 22, 34 ] 5 0.001% 100.009% ( 34, 51 ] 8 0.001% 100.011% ( 51, 76 ] 8 0.001% 100.012% ( 110, 170 ] 21 0.003% 100.015% ( 170, 250 ] 23 0.003% 100.018% ( 250, 380 ] 13 0.002% 100.020% ( 380, 580 ] 6 0.001% 100.021% ( 580, 870 ] 9 0.001% 100.022% ( 870, 1300 ] 11 0.002% 100.024% ( 1300, 1900 ] 1 0.000% 100.024% ( 1900, 2900 ] 6 0.001% 100.025% ( 2900, 4400 ] 5 0.001% 100.025% ** Level 1 read latency histogram (micros): Count: 93174 Average: 2.1886 StdDev: 6.37 Min: 1 Median: 1.5330 Max: 1372 Percentiles: P50: 1.53 P75: 1.90 P99: 5.38 P99.9: 10.59 P99.99: 30.19 ------------------------------------------------------ [ 0, 1 ] 12655 13.582% 13.582% ### ( 1, 2 ] 63669 68.333% 81.916% ############## ( 2, 3 ] 11800 12.664% 94.580% ### ( 3, 4 ] 2925 3.139% 97.719% # ( 4, 6 ] 1733 1.860% 99.579% ( 6, 10 ] 289 0.310% 99.889% ( 10, 15 ] 91 0.098% 99.987% ( 15, 22 ] 3 0.003% 99.990% ( 22, 34 ] 1 0.001% 99.991% ( 51, 76 ] 1 0.001% 99.992% ( 110, 170 ] 1 0.001% 99.994% ( 170, 250 ] 1 0.001% 99.995% ( 250, 380 ] 3 0.003% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ( 1300, 1900 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 95268 Average: 2.1907 StdDev: 13.21 Min: 1 Median: 1.4453 Max: 2110 Percentiles: P50: 1.45 P75: 1.84 P99: 5.63 P99.9: 11.47 P99.99: 651.20 ------------------------------------------------------ [ 0, 1 ] 20729 21.759% 21.759% #### ( 1, 2 ] 60418 63.419% 85.178% ############# ( 2, 3 ] 8202 8.609% 93.787% ## ( 3, 4 ] 3165 3.322% 97.109% # ( 4, 6 ] 2208 2.318% 99.427% ( 6, 10 ] 421 0.442% 99.869% ( 10, 15 ] 101 0.106% 99.975% ( 15, 22 ] 5 0.005% 99.980% ( 22, 34 ] 2 0.002% 99.982% ( 34, 51 ] 1 0.001% 99.983% ( 51, 76 ] 1 0.001% 99.984% ( 250, 380 ] 2 0.002% 99.986% ( 380, 580 ] 2 0.002% 99.988% ( 580, 870 ] 6 0.006% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57067 Average: 3.7345 StdDev: 71.78 Min: 0 Median: 1.4829 Max: 5838 Percentiles: P50: 1.48 P75: 1.87 P99: 5.73 P99.9: 20.76 P99.99: 4187.99 ------------------------------------------------------ [ 0, 1 ] 10753 18.843% 18.843% #### ( 1, 2 ] 36817 64.515% 83.358% ############# ( 2, 3 ] 6312 11.061% 94.419% ## ( 3, 4 ] 1591 2.788% 97.207% # ( 4, 6 ] 1181 2.069% 99.276% ( 6, 10 ] 288 0.505% 99.781% ( 10, 15 ] 63 0.110% 99.891% ( 15, 22 ] 6 0.011% 99.902% ( 110, 170 ] 2 0.004% 99.905% ( 250, 380 ] 6 0.011% 99.916% ( 380, 580 ] 4 0.007% 99.923% ( 580, 870 ] 13 0.023% 99.946% ( 870, 1300 ] 11 0.019% 99.965% ( 1300, 1900 ] 1 0.002% 99.967% ( 1900, 2900 ] 9 0.016% 99.982% ( 2900, 4400 ] 5 0.009% 99.991% ( 4400, 6600 ] 5 0.009% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 119.9574 StdDev: 600.20 Min: 0 Median: 1.6188 Max: 5567 Percentiles: P50: 1.62 P75: 4.96 P99: 2887.50 P99.9: 5567.00 P99.99: 5567.00 ------------------------------------------------------ [ 0, 1 ] 90 29.508% 29.508% ###### ( 1, 2 ] 101 33.115% 62.623% ####### ( 2, 3 ] 29 9.508% 72.131% ## ( 3, 4 ] 2 0.656% 72.787% ( 4, 6 ] 14 4.590% 77.377% # ( 6, 10 ] 9 2.951% 80.328% # ( 10, 15 ] 19 6.230% 86.557% # ( 15, 22 ] 15 4.918% 91.475% # ( 22, 34 ] 1 0.328% 91.803% ( 51, 76 ] 1 0.328% 92.131% ( 110, 170 ] 1 0.328% 92.459% ( 170, 250 ] 3 0.984% 93.443% ( 250, 380 ] 4 1.311% 94.754% ( 380, 580 ] 1 0.328% 95.082% ( 580, 870 ] 3 0.984% 96.066% ( 870, 1300 ] 4 1.311% 97.377% ( 1300, 1900 ] 1 0.328% 97.705% ( 1900, 2900 ] 4 1.311% 99.016% ( 4400, 6600 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 756.7750 StdDev: 895.29 Min: 74 Median: 315.0000 Max: 3152 Percentiles: P50: 315.00 P75: 977.50 P99: 3152.00 P99.9: 3152.00 P99.99: 3152.00 ------------------------------------------------------ ( 51, 76 ] 2 5.000% 5.000% # ( 76, 110 ] 5 12.500% 17.500% ### ( 110, 170 ] 4 10.000% 27.500% ## ( 170, 250 ] 8 20.000% 47.500% #### ( 250, 380 ] 2 5.000% 52.500% # ( 380, 580 ] 5 12.500% 65.000% ### ( 580, 870 ] 3 7.500% 72.500% ## ( 870, 1300 ] 4 10.000% 82.500% ## ( 1300, 1900 ] 2 5.000% 87.500% # ( 1900, 2900 ] 3 7.500% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.4 total, 3.2 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 313.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.069 H:M:S, 11.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 304.05 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.515 H:M:S, 15.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/07/13-17:29:16 ... thread 0: (1000000,4000000) ops and (349863.2,331452.1) ops/second in (2.858260,12.068107) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/11 2.40 GB 31.5 2.0 0.0 2.0 5.8 3.8 0.0 1.5 111.4 317.2 18.66 17.33 64 0.292 2110K 2144 0.0 0.0 L1 10/10 1.10 GB 0.0 1.5 1.1 0.4 1.5 1.1 0.2 1.3 232.2 231.3 6.51 6.30 2 3.253 1534K 5986 0.0 0.0 L2 1/0 2.57 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 253.7 253.5 1.49 1.44 2 0.745 383K 199 0.0 0.0 L3 15/0 639.95 MB 0.6 0.2 0.2 0.0 0.2 0.2 0.1 1.0 233.5 233.5 1.07 1.00 1 1.067 253K 0 0.0 0.0 L4 169/0 9.45 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 164.3 164.4 1.37 1.03 1 1.366 227K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1258/21 99.88 GB 0.0 4.3 1.8 2.6 8.1 5.5 1.5 2.2 152.7 284.5 29.09 27.09 70 0.416 4509K 8329 0.0 0.0 Int 0/0 0.00 KB 0.0 4.3 1.8 2.6 8.1 5.5 1.4 2.2 152.7 284.5 29.09 27.09 70 0.416 4509K 8329 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.3 1.8 2.6 4.3 1.7 0.0 0.0 243.6 243.1 18.24 17.40 14 1.303 4509K 8329 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 354.0 10.86 9.69 56 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.08 GB write, 674.07 MB/s write, 4.34 GB read, 361.77 MB/s read, 29.1 seconds Interval compaction: 8.08 GB write, 685.70 MB/s write, 4.34 GB read, 368.01 MB/s read, 29.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 10, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 901460 Average: 2.1381 StdDev: 12.08 Min: 0 Median: 1.4617 Max: 3564 Percentiles: P50: 1.46 P75: 1.84 P99: 5.38 P99.9: 9.97 P99.99: 14.77 ------------------------------------------------------ [ 0, 1 ] 178986 19.855% 19.855% #### ( 1, 2 ] 588522 65.285% 85.141% ############# ( 2, 3 ] 88256 9.790% 94.931% ## ( 3, 4 ] 26179 2.904% 97.835% # ( 4, 6 ] 15246 1.691% 99.526% ( 6, 10 ] 3398 0.377% 99.903% ( 10, 15 ] 820 0.091% 99.994% ( 15, 22 ] 65 0.007% 100.001% ( 22, 34 ] 6 0.001% 100.002% ( 34, 51 ] 9 0.001% 100.003% ( 51, 76 ] 12 0.001% 100.004% ( 76, 110 ] 4 0.000% 100.005% ( 110, 170 ] 39 0.004% 100.009% ( 170, 250 ] 32 0.004% 100.013% ( 250, 380 ] 19 0.002% 100.015% ( 380, 580 ] 9 0.001% 100.016% ( 580, 870 ] 17 0.002% 100.018% ( 870, 1300 ] 12 0.001% 100.019% ( 1300, 1900 ] 3 0.000% 100.019% ( 1900, 2900 ] 6 0.001% 100.020% ( 2900, 4400 ] 6 0.001% 100.021% ** Level 1 read latency histogram (micros): Count: 107571 Average: 2.3801 StdDev: 14.15 Min: 1 Median: 1.5112 Max: 1832 Percentiles: P50: 1.51 P75: 1.88 P99: 5.50 P99.9: 14.48 P99.99: 700.15 ------------------------------------------------------ [ 0, 1 ] 16569 15.403% 15.403% ### ( 1, 2 ] 72797 67.673% 83.076% ############## ( 2, 3 ] 12511 11.630% 94.707% ## ( 3, 4 ] 3212 2.986% 97.693% # ( 4, 6 ] 1869 1.737% 99.430% ( 6, 10 ] 414 0.385% 99.815% ( 10, 15 ] 102 0.095% 99.910% ( 15, 22 ] 5 0.005% 99.914% ( 22, 34 ] 1 0.001% 99.915% ( 51, 76 ] 1 0.001% 99.916% ( 76, 110 ] 2 0.002% 99.918% ( 110, 170 ] 55 0.051% 99.969% ( 170, 250 ] 6 0.006% 99.975% ( 250, 380 ] 9 0.008% 99.983% ( 380, 580 ] 6 0.006% 99.989% ( 580, 870 ] 3 0.003% 99.992% ( 870, 1300 ] 3 0.003% 99.994% ( 1300, 1900 ] 6 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 95268 Average: 2.1907 StdDev: 13.21 Min: 1 Median: 1.4453 Max: 2110 Percentiles: P50: 1.45 P75: 1.84 P99: 5.63 P99.9: 11.47 P99.99: 651.20 ------------------------------------------------------ [ 0, 1 ] 20729 21.759% 21.759% #### ( 1, 2 ] 60418 63.419% 85.178% ############# ( 2, 3 ] 8202 8.609% 93.787% ## ( 3, 4 ] 3165 3.322% 97.109% # ( 4, 6 ] 2208 2.318% 99.427% ( 6, 10 ] 421 0.442% 99.869% ( 10, 15 ] 101 0.106% 99.975% ( 15, 22 ] 5 0.005% 99.980% ( 22, 34 ] 2 0.002% 99.982% ( 34, 51 ] 1 0.001% 99.983% ( 51, 76 ] 1 0.001% 99.984% ( 250, 380 ] 2 0.002% 99.986% ( 380, 580 ] 2 0.002% 99.988% ( 580, 870 ] 6 0.006% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57067 Average: 3.7345 StdDev: 71.78 Min: 0 Median: 1.4829 Max: 5838 Percentiles: P50: 1.48 P75: 1.87 P99: 5.73 P99.9: 20.76 P99.99: 4187.99 ------------------------------------------------------ [ 0, 1 ] 10753 18.843% 18.843% #### ( 1, 2 ] 36817 64.515% 83.358% ############# ( 2, 3 ] 6312 11.061% 94.419% ## ( 3, 4 ] 1591 2.788% 97.207% # ( 4, 6 ] 1181 2.069% 99.276% ( 6, 10 ] 288 0.505% 99.781% ( 10, 15 ] 63 0.110% 99.891% ( 15, 22 ] 6 0.011% 99.902% ( 110, 170 ] 2 0.004% 99.905% ( 250, 380 ] 6 0.011% 99.916% ( 380, 580 ] 4 0.007% 99.923% ( 580, 870 ] 13 0.023% 99.946% ( 870, 1300 ] 11 0.019% 99.965% ( 1300, 1900 ] 1 0.002% 99.967% ( 1900, 2900 ] 9 0.016% 99.982% ( 2900, 4400 ] 5 0.009% 99.991% ( 4400, 6600 ] 5 0.009% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 119.9574 StdDev: 600.20 Min: 0 Median: 1.6188 Max: 5567 Percentiles: P50: 1.62 P75: 4.96 P99: 2887.50 P99.9: 5567.00 P99.99: 5567.00 ------------------------------------------------------ [ 0, 1 ] 90 29.508% 29.508% ###### ( 1, 2 ] 101 33.115% 62.623% ####### ( 2, 3 ] 29 9.508% 72.131% ## ( 3, 4 ] 2 0.656% 72.787% ( 4, 6 ] 14 4.590% 77.377% # ( 6, 10 ] 9 2.951% 80.328% # ( 10, 15 ] 19 6.230% 86.557% # ( 15, 22 ] 15 4.918% 91.475% # ( 22, 34 ] 1 0.328% 91.803% ( 51, 76 ] 1 0.328% 92.131% ( 110, 170 ] 1 0.328% 92.459% ( 170, 250 ] 3 0.984% 93.443% ( 250, 380 ] 4 1.311% 94.754% ( 380, 580 ] 1 0.328% 95.082% ( 580, 870 ] 3 0.984% 96.066% ( 870, 1300 ] 4 1.311% 97.377% ( 1300, 1900 ] 1 0.328% 97.705% ( 1900, 2900 ] 4 1.311% 99.016% ( 4400, 6600 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 756.7750 StdDev: 895.29 Min: 74 Median: 315.0000 Max: 3152 Percentiles: P50: 315.00 P75: 977.50 P99: 3152.00 P99.9: 3152.00 P99.99: 3152.00 ------------------------------------------------------ ( 51, 76 ] 2 5.000% 5.000% # ( 76, 110 ] 5 12.500% 17.500% ### ( 110, 170 ] 4 10.000% 27.500% ## ( 170, 250 ] 8 20.000% 47.500% #### ( 250, 380 ] 2 5.000% 52.500% # ( 380, 580 ] 5 12.500% 65.000% ### ( 580, 870 ] 3 7.500% 72.500% ## ( 870, 1300 ] 4 10.000% 82.500% ## ( 1300, 1900 ] 2 5.000% 87.500% # ( 1900, 2900 ] 3 7.500% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.3 total, 2.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 320.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.262 H:M:S, 10.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 344.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.193 H:M:S, 6.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/13-17:29:20 ... thread 0: (1000000,5000000) ops and (239278.5,307742.7) ops/second in (4.179230,16.247337) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 3.32 GB 125.9 3.0 0.0 3.0 7.7 4.7 0.0 1.6 123.2 314.3 25.05 23.37 83 0.302 3134K 3101 0.0 0.0 L1 10/10 1.10 GB 0.0 1.5 1.1 0.4 1.5 1.1 0.2 1.3 232.2 231.3 6.51 6.30 2 3.253 1534K 5986 0.0 0.0 L2 1/0 2.57 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 253.7 253.5 1.49 1.44 2 0.745 383K 199 0.0 0.0 L3 15/0 639.95 MB 0.6 0.2 0.2 0.0 0.2 0.2 0.1 1.0 233.5 233.5 1.07 1.00 1 1.067 253K 0 0.0 0.0 L4 169/0 9.45 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 164.3 164.4 1.37 1.03 1 1.366 227K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1261/21 100.80 GB 0.0 5.3 1.8 3.6 10.0 6.4 1.5 2.1 153.6 288.3 35.48 33.13 89 0.399 5533K 9286 0.0 0.0 Int 0/0 0.00 KB 0.0 5.3 1.8 3.6 10.0 6.4 1.4 2.1 153.6 288.3 35.48 33.13 89 0.399 5533K 9286 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.3 1.8 3.6 5.3 1.7 0.0 0.0 248.2 247.8 21.95 21.07 18 1.220 5533K 9286 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 354.0 13.52 12.06 71 0.190 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.5 total, 16.2 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.99 GB write, 621.50 MB/s write, 5.32 GB read, 331.15 MB/s read, 35.5 seconds Interval compaction: 9.99 GB write, 629.47 MB/s write, 5.32 GB read, 335.40 MB/s read, 35.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 10, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1318017 Average: 2.1570 StdDev: 10.88 Min: 0 Median: 1.4777 Max: 3564 Percentiles: P50: 1.48 P75: 1.86 P99: 5.40 P99.9: 9.96 P99.99: 14.85 ------------------------------------------------------ [ 0, 1 ] 242102 18.369% 18.369% #### ( 1, 2 ] 872661 66.210% 84.579% ############# ( 2, 3 ] 135525 10.282% 94.861% ## ( 3, 4 ] 39034 2.962% 97.823% # ( 4, 6 ] 22095 1.676% 99.499% ( 6, 10 ] 5340 0.405% 99.904% ( 10, 15 ] 1162 0.088% 99.993% ( 15, 22 ] 87 0.007% 99.999% ( 22, 34 ] 15 0.001% 100.000% ( 34, 51 ] 9 0.001% 100.001% ( 51, 76 ] 15 0.001% 100.002% ( 76, 110 ] 41 0.003% 100.005% ( 110, 170 ] 66 0.005% 100.010% ( 170, 250 ] 51 0.004% 100.014% ( 250, 380 ] 37 0.003% 100.017% ( 380, 580 ] 19 0.001% 100.018% ( 580, 870 ] 27 0.002% 100.020% ( 870, 1300 ] 17 0.001% 100.022% ( 1300, 1900 ] 3 0.000% 100.022% ( 1900, 2900 ] 7 0.001% 100.022% ( 2900, 4400 ] 6 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 192340 Average: 2.3934 StdDev: 12.15 Min: 1 Median: 1.5152 Max: 1832 Percentiles: P50: 1.52 P75: 1.88 P99: 6.11 P99.9: 85.89 P99.99: 527.07 ------------------------------------------------------ [ 0, 1 ] 29112 15.136% 15.136% ### ( 1, 2 ] 130150 67.667% 82.802% ############## ( 2, 3 ] 22117 11.499% 94.301% ## ( 3, 4 ] 5550 2.886% 97.187% # ( 4, 6 ] 3444 1.791% 98.977% ( 6, 10 ] 1555 0.808% 99.786% ( 10, 15 ] 176 0.092% 99.877% ( 15, 22 ] 16 0.008% 99.886% ( 22, 34 ] 2 0.001% 99.887% ( 51, 76 ] 6 0.003% 99.890% ( 76, 110 ] 71 0.037% 99.927% ( 110, 170 ] 82 0.043% 99.969% ( 170, 250 ] 15 0.008% 99.977% ( 250, 380 ] 14 0.007% 99.984% ( 380, 580 ] 16 0.008% 99.993% ( 580, 870 ] 5 0.003% 99.995% ( 870, 1300 ] 3 0.002% 99.997% ( 1300, 1900 ] 7 0.004% 100.001% ** Level 2 read latency histogram (micros): Count: 95268 Average: 2.1907 StdDev: 13.21 Min: 1 Median: 1.4453 Max: 2110 Percentiles: P50: 1.45 P75: 1.84 P99: 5.63 P99.9: 11.47 P99.99: 651.20 ------------------------------------------------------ [ 0, 1 ] 20729 21.759% 21.759% #### ( 1, 2 ] 60418 63.419% 85.178% ############# ( 2, 3 ] 8202 8.609% 93.787% ## ( 3, 4 ] 3165 3.322% 97.109% # ( 4, 6 ] 2208 2.318% 99.427% ( 6, 10 ] 421 0.442% 99.869% ( 10, 15 ] 101 0.106% 99.975% ( 15, 22 ] 5 0.005% 99.980% ( 22, 34 ] 2 0.002% 99.982% ( 34, 51 ] 1 0.001% 99.983% ( 51, 76 ] 1 0.001% 99.984% ( 250, 380 ] 2 0.002% 99.986% ( 380, 580 ] 2 0.002% 99.988% ( 580, 870 ] 6 0.006% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57067 Average: 3.7345 StdDev: 71.78 Min: 0 Median: 1.4829 Max: 5838 Percentiles: P50: 1.48 P75: 1.87 P99: 5.73 P99.9: 20.76 P99.99: 4187.99 ------------------------------------------------------ [ 0, 1 ] 10753 18.843% 18.843% #### ( 1, 2 ] 36817 64.515% 83.358% ############# ( 2, 3 ] 6312 11.061% 94.419% ## ( 3, 4 ] 1591 2.788% 97.207% # ( 4, 6 ] 1181 2.069% 99.276% ( 6, 10 ] 288 0.505% 99.781% ( 10, 15 ] 63 0.110% 99.891% ( 15, 22 ] 6 0.011% 99.902% ( 110, 170 ] 2 0.004% 99.905% ( 250, 380 ] 6 0.011% 99.916% ( 380, 580 ] 4 0.007% 99.923% ( 580, 870 ] 13 0.023% 99.946% ( 870, 1300 ] 11 0.019% 99.965% ( 1300, 1900 ] 1 0.002% 99.967% ( 1900, 2900 ] 9 0.016% 99.982% ( 2900, 4400 ] 5 0.009% 99.991% ( 4400, 6600 ] 5 0.009% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 119.9574 StdDev: 600.20 Min: 0 Median: 1.6188 Max: 5567 Percentiles: P50: 1.62 P75: 4.96 P99: 2887.50 P99.9: 5567.00 P99.99: 5567.00 ------------------------------------------------------ [ 0, 1 ] 90 29.508% 29.508% ###### ( 1, 2 ] 101 33.115% 62.623% ####### ( 2, 3 ] 29 9.508% 72.131% ## ( 3, 4 ] 2 0.656% 72.787% ( 4, 6 ] 14 4.590% 77.377% # ( 6, 10 ] 9 2.951% 80.328% # ( 10, 15 ] 19 6.230% 86.557% # ( 15, 22 ] 15 4.918% 91.475% # ( 22, 34 ] 1 0.328% 91.803% ( 51, 76 ] 1 0.328% 92.131% ( 110, 170 ] 1 0.328% 92.459% ( 170, 250 ] 3 0.984% 93.443% ( 250, 380 ] 4 1.311% 94.754% ( 380, 580 ] 1 0.328% 95.082% ( 580, 870 ] 3 0.984% 96.066% ( 870, 1300 ] 4 1.311% 97.377% ( 1300, 1900 ] 1 0.328% 97.705% ( 1900, 2900 ] 4 1.311% 99.016% ( 4400, 6600 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 756.7750 StdDev: 895.29 Min: 74 Median: 315.0000 Max: 3152 Percentiles: P50: 315.00 P75: 977.50 P99: 3152.00 P99.9: 3152.00 P99.99: 3152.00 ------------------------------------------------------ ( 51, 76 ] 2 5.000% 5.000% # ( 76, 110 ] 5 12.500% 17.500% ### ( 110, 170 ] 4 10.000% 27.500% ## ( 170, 250 ] 8 20.000% 47.500% #### ( 250, 380 ] 2 5.000% 52.500% # ( 380, 580 ] 5 12.500% 65.000% ### ( 580, 870 ] 3 7.500% 72.500% ## ( 870, 1300 ] 4 10.000% 82.500% ## ( 1300, 1900 ] 2 5.000% 87.500% # ( 1900, 2900 ] 3 7.500% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 16.5 total, 4.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 299.02 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.725 H:M:S, 16.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 235.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.463 H:M:S, 35.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/13-17:29:30 ... thread 0: (1000000,6000000) ops and (107199.0,234596.9) ops/second in (9.328445,25.575782) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 4.29 GB 200.5 5.2 0.0 5.2 10.8 5.6 0.0 1.9 144.6 302.6 36.59 34.10 103 0.355 5372K 12K 0.0 0.0 L1 10/10 1.10 GB 0.0 1.5 1.1 0.4 1.5 1.1 0.2 1.3 232.2 231.3 6.51 6.30 2 3.253 1534K 5986 0.0 0.0 L2 1/0 2.57 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 253.7 253.5 1.49 1.44 2 0.745 383K 199 0.0 0.0 L3 15/0 639.95 MB 0.6 0.2 0.2 0.0 0.2 0.2 0.1 1.0 233.5 233.5 1.07 1.00 1 1.067 253K 0 0.0 0.0 L4 169/0 9.45 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 164.3 164.4 1.37 1.03 1 1.366 227K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1262/25 101.78 GB 0.0 7.5 1.8 5.7 13.1 7.4 1.5 2.3 162.8 285.6 47.02 43.86 109 0.431 7771K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.5 1.8 5.7 13.1 7.4 1.4 2.3 162.8 285.6 47.02 43.86 109 0.431 7771K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.5 1.8 5.7 7.5 1.7 0.0 0.0 250.3 249.6 30.58 29.20 22 1.390 7771K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 352.6 16.44 14.66 87 0.189 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.8 total, 25.6 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.12 GB write, 520.84 MB/s write, 7.47 GB read, 296.82 MB/s read, 47.0 seconds Interval compaction: 13.12 GB write, 525.08 MB/s write, 7.47 GB read, 299.23 MB/s read, 47.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 10, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2246706 Average: 2.5885 StdDev: 13.84 Min: 0 Median: 1.4975 Max: 4767 Percentiles: P50: 1.50 P75: 1.87 P99: 5.95 P99.9: 135.38 P99.99: 254.50 ------------------------------------------------------ [ 0, 1 ] 377854 16.818% 16.818% ### ( 1, 2 ] 1498547 66.700% 83.518% ############# ( 2, 3 ] 239365 10.654% 94.172% ## ( 3, 4 ] 70032 3.117% 97.289% # ( 4, 6 ] 39409 1.754% 99.043% ( 6, 10 ] 13063 0.581% 99.625% ( 10, 15 ] 2196 0.098% 99.722% ( 15, 22 ] 201 0.009% 99.731% ( 22, 34 ] 20 0.001% 99.732% ( 34, 51 ] 11 0.000% 99.733% ( 51, 76 ] 32 0.001% 99.734% ( 76, 110 ] 2642 0.118% 99.852% ( 110, 170 ] 2570 0.114% 99.966% ( 170, 250 ] 526 0.023% 99.989% ( 250, 380 ] 385 0.017% 100.007% ( 380, 580 ] 259 0.012% 100.018% ( 580, 870 ] 100 0.004% 100.023% ( 870, 1300 ] 27 0.001% 100.024% ( 1300, 1900 ] 6 0.000% 100.024% ( 1900, 2900 ] 10 0.000% 100.024% ( 2900, 4400 ] 7 0.000% 100.025% ( 4400, 6600 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 368960 Average: 2.6273 StdDev: 12.60 Min: 1 Median: 1.5338 Max: 1832 Percentiles: P50: 1.53 P75: 1.90 P99: 7.61 P99.9: 145.57 P99.99: 538.62 ------------------------------------------------------ [ 0, 1 ] 50997 13.822% 13.822% ### ( 1, 2 ] 250075 67.778% 81.600% ############## ( 2, 3 ] 43190 11.706% 93.306% ## ( 3, 4 ] 11650 3.158% 96.464% # ( 4, 6 ] 7759 2.103% 98.567% ( 6, 10 ] 3968 1.075% 99.642% ( 10, 15 ] 335 0.091% 99.733% ( 15, 22 ] 42 0.011% 99.744% ( 22, 34 ] 3 0.001% 99.745% ( 51, 76 ] 8 0.002% 99.747% ( 76, 110 ] 334 0.091% 99.838% ( 110, 170 ] 388 0.105% 99.943% ( 170, 250 ] 80 0.022% 99.964% ( 250, 380 ] 60 0.016% 99.981% ( 380, 580 ] 43 0.012% 99.992% ( 580, 870 ] 14 0.004% 99.996% ( 870, 1300 ] 6 0.002% 99.998% ( 1300, 1900 ] 8 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 95268 Average: 2.1907 StdDev: 13.21 Min: 1 Median: 1.4453 Max: 2110 Percentiles: P50: 1.45 P75: 1.84 P99: 5.63 P99.9: 11.47 P99.99: 651.20 ------------------------------------------------------ [ 0, 1 ] 20729 21.759% 21.759% #### ( 1, 2 ] 60418 63.419% 85.178% ############# ( 2, 3 ] 8202 8.609% 93.787% ## ( 3, 4 ] 3165 3.322% 97.109% # ( 4, 6 ] 2208 2.318% 99.427% ( 6, 10 ] 421 0.442% 99.869% ( 10, 15 ] 101 0.106% 99.975% ( 15, 22 ] 5 0.005% 99.980% ( 22, 34 ] 2 0.002% 99.982% ( 34, 51 ] 1 0.001% 99.983% ( 51, 76 ] 1 0.001% 99.984% ( 250, 380 ] 2 0.002% 99.986% ( 380, 580 ] 2 0.002% 99.988% ( 580, 870 ] 6 0.006% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57067 Average: 3.7345 StdDev: 71.78 Min: 0 Median: 1.4829 Max: 5838 Percentiles: P50: 1.48 P75: 1.87 P99: 5.73 P99.9: 20.76 P99.99: 4187.99 ------------------------------------------------------ [ 0, 1 ] 10753 18.843% 18.843% #### ( 1, 2 ] 36817 64.515% 83.358% ############# ( 2, 3 ] 6312 11.061% 94.419% ## ( 3, 4 ] 1591 2.788% 97.207% # ( 4, 6 ] 1181 2.069% 99.276% ( 6, 10 ] 288 0.505% 99.781% ( 10, 15 ] 63 0.110% 99.891% ( 15, 22 ] 6 0.011% 99.902% ( 110, 170 ] 2 0.004% 99.905% ( 250, 380 ] 6 0.011% 99.916% ( 380, 580 ] 4 0.007% 99.923% ( 580, 870 ] 13 0.023% 99.946% ( 870, 1300 ] 11 0.019% 99.965% ( 1300, 1900 ] 1 0.002% 99.967% ( 1900, 2900 ] 9 0.016% 99.982% ( 2900, 4400 ] 5 0.009% 99.991% ( 4400, 6600 ] 5 0.009% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 119.9574 StdDev: 600.20 Min: 0 Median: 1.6188 Max: 5567 Percentiles: P50: 1.62 P75: 4.96 P99: 2887.50 P99.9: 5567.00 P99.99: 5567.00 ------------------------------------------------------ [ 0, 1 ] 90 29.508% 29.508% ###### ( 1, 2 ] 101 33.115% 62.623% ####### ( 2, 3 ] 29 9.508% 72.131% ## ( 3, 4 ] 2 0.656% 72.787% ( 4, 6 ] 14 4.590% 77.377% # ( 6, 10 ] 9 2.951% 80.328% # ( 10, 15 ] 19 6.230% 86.557% # ( 15, 22 ] 15 4.918% 91.475% # ( 22, 34 ] 1 0.328% 91.803% ( 51, 76 ] 1 0.328% 92.131% ( 110, 170 ] 1 0.328% 92.459% ( 170, 250 ] 3 0.984% 93.443% ( 250, 380 ] 4 1.311% 94.754% ( 380, 580 ] 1 0.328% 95.082% ( 580, 870 ] 3 0.984% 96.066% ( 870, 1300 ] 4 1.311% 97.377% ( 1300, 1900 ] 1 0.328% 97.705% ( 1900, 2900 ] 4 1.311% 99.016% ( 4400, 6600 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 756.7750 StdDev: 895.29 Min: 74 Median: 315.0000 Max: 3152 Percentiles: P50: 315.00 P75: 977.50 P99: 3152.00 P99.9: 3152.00 P99.99: 3152.00 ------------------------------------------------------ ( 51, 76 ] 2 5.000% 5.000% # ( 76, 110 ] 5 12.500% 17.500% ### ( 110, 170 ] 4 10.000% 27.500% ## ( 170, 250 ] 8 20.000% 47.500% #### ( 250, 380 ] 2 5.000% 52.500% # ( 380, 580 ] 5 12.500% 65.000% ### ( 580, 870 ] 3 7.500% 72.500% ## ( 870, 1300 ] 4 10.000% 82.500% ## ( 1300, 1900 ] 2 5.000% 87.500% # ( 1900, 2900 ] 3 7.500% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 25.8 total, 9.3 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 229.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.201 H:M:S, 35.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 105.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.476 H:M:S, 69.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/13-17:29:33 ... thread 0: (1000000,7000000) ops and (310654.8,243099.5) ops/second in (3.219007,28.794789) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/13 3.13 GB 0.0 5.9 0.0 5.9 12.5 6.6 0.0 1.9 143.8 303.8 42.05 39.21 120 0.350 6139K 13K 0.0 0.0 L1 18/18 2.14 GB 0.0 4.7 3.2 1.5 4.6 3.1 0.2 1.4 223.6 221.2 21.37 20.20 3 7.123 4852K 51K 0.0 0.0 L2 1/0 2.57 MB 0.0 0.4 0.2 0.2 0.4 0.2 1.1 2.0 253.7 253.5 1.49 1.44 2 0.745 383K 199 0.0 0.0 L3 14/0 926.23 MB 0.9 0.2 0.2 0.0 0.2 0.2 1.1 1.0 233.5 233.5 1.07 1.00 1 1.067 253K 0 0.0 0.0 L4 169/0 9.56 GB 1.0 0.4 0.3 0.0 0.4 0.3 1.0 1.0 179.4 179.2 2.03 1.62 2 1.017 370K 340 0.0 0.0 L5 1056/0 86.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/31 102.65 GB 0.0 11.5 4.0 7.6 18.1 10.5 4.7 2.7 173.8 271.9 68.01 63.46 128 0.531 11M 65K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.5 4.0 7.6 18.1 10.5 4.6 2.7 173.8 271.9 68.01 63.46 128 0.531 11M 65K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.5 4.0 7.6 11.5 3.9 0.0 0.0 241.6 240.3 48.91 46.43 27 1.811 11M 65K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 353.0 19.10 17.03 101 0.189 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.0 total, 28.8 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.06 GB write, 637.56 MB/s write, 11.54 GB read, 407.43 MB/s read, 68.0 seconds Interval compaction: 18.06 GB write, 642.16 MB/s write, 11.54 GB read, 410.38 MB/s read, 68.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 20, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 20, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 12, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2482029 Average: 2.5736 StdDev: 14.19 Min: 0 Median: 1.4893 Max: 4767 Percentiles: P50: 1.49 P75: 1.86 P99: 5.93 P99.9: 135.79 P99.99: 265.80 ------------------------------------------------------ [ 0, 1 ] 432732 17.435% 17.435% ### ( 1, 2 ] 1651944 66.556% 83.991% ############# ( 2, 3 ] 256351 10.328% 94.319% ## ( 3, 4 ] 75340 3.035% 97.355% # ( 4, 6 ] 42362 1.707% 99.061% ( 6, 10 ] 14124 0.569% 99.630% ( 10, 15 ] 2441 0.098% 99.729% ( 15, 22 ] 242 0.010% 99.738% ( 22, 34 ] 27 0.001% 99.739% ( 34, 51 ] 12 0.000% 99.740% ( 51, 76 ] 34 0.001% 99.741% ( 76, 110 ] 2749 0.111% 99.852% ( 110, 170 ] 2768 0.112% 99.964% ( 170, 250 ] 605 0.024% 99.988% ( 250, 380 ] 418 0.017% 100.005% ( 380, 580 ] 294 0.012% 100.017% ( 580, 870 ] 117 0.005% 100.021% ( 870, 1300 ] 28 0.001% 100.023% ( 1300, 1900 ] 9 0.000% 100.023% ( 1900, 2900 ] 13 0.001% 100.023% ( 2900, 4400 ] 9 0.000% 100.024% ( 4400, 6600 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 415011 Average: 2.7832 StdDev: 19.40 Min: 1 Median: 1.5371 Max: 4141 Percentiles: P50: 1.54 P75: 1.91 P99: 7.85 P99.9: 154.43 P99.99: 935.41 ------------------------------------------------------ [ 0, 1 ] 56934 13.719% 13.719% ### ( 1, 2 ] 280345 67.551% 81.270% ############## ( 2, 3 ] 49545 11.938% 93.208% ## ( 3, 4 ] 13100 3.157% 96.365% # ( 4, 6 ] 8782 2.116% 98.481% ( 6, 10 ] 4664 1.124% 99.605% ( 10, 15 ] 446 0.107% 99.712% ( 15, 22 ] 52 0.013% 99.725% ( 22, 34 ] 3 0.001% 99.725% ( 34, 51 ] 1 0.000% 99.726% ( 51, 76 ] 8 0.002% 99.727% ( 76, 110 ] 365 0.088% 99.815% ( 110, 170 ] 474 0.114% 99.930% ( 170, 250 ] 94 0.023% 99.952% ( 250, 380 ] 70 0.017% 99.969% ( 380, 580 ] 51 0.012% 99.981% ( 580, 870 ] 32 0.008% 99.989% ( 870, 1300 ] 23 0.006% 99.995% ( 1300, 1900 ] 18 0.004% 99.999% ( 1900, 2900 ] 2 0.000% 100.000% ( 2900, 4400 ] 2 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 95268 Average: 2.1907 StdDev: 13.21 Min: 1 Median: 1.4453 Max: 2110 Percentiles: P50: 1.45 P75: 1.84 P99: 5.63 P99.9: 11.47 P99.99: 651.20 ------------------------------------------------------ [ 0, 1 ] 20729 21.759% 21.759% #### ( 1, 2 ] 60418 63.419% 85.178% ############# ( 2, 3 ] 8202 8.609% 93.787% ## ( 3, 4 ] 3165 3.322% 97.109% # ( 4, 6 ] 2208 2.318% 99.427% ( 6, 10 ] 421 0.442% 99.869% ( 10, 15 ] 101 0.106% 99.975% ( 15, 22 ] 5 0.005% 99.980% ( 22, 34 ] 2 0.002% 99.982% ( 34, 51 ] 1 0.001% 99.983% ( 51, 76 ] 1 0.001% 99.984% ( 250, 380 ] 2 0.002% 99.986% ( 380, 580 ] 2 0.002% 99.988% ( 580, 870 ] 6 0.006% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57067 Average: 3.7345 StdDev: 71.78 Min: 0 Median: 1.4829 Max: 5838 Percentiles: P50: 1.48 P75: 1.87 P99: 5.73 P99.9: 20.76 P99.99: 4187.99 ------------------------------------------------------ [ 0, 1 ] 10753 18.843% 18.843% #### ( 1, 2 ] 36817 64.515% 83.358% ############# ( 2, 3 ] 6312 11.061% 94.419% ## ( 3, 4 ] 1591 2.788% 97.207% # ( 4, 6 ] 1181 2.069% 99.276% ( 6, 10 ] 288 0.505% 99.781% ( 10, 15 ] 63 0.110% 99.891% ( 15, 22 ] 6 0.011% 99.902% ( 110, 170 ] 2 0.004% 99.905% ( 250, 380 ] 6 0.011% 99.916% ( 380, 580 ] 4 0.007% 99.923% ( 580, 870 ] 13 0.023% 99.946% ( 870, 1300 ] 11 0.019% 99.965% ( 1300, 1900 ] 1 0.002% 99.967% ( 1900, 2900 ] 9 0.016% 99.982% ( 2900, 4400 ] 5 0.009% 99.991% ( 4400, 6600 ] 5 0.009% 100.000% ** Level 4 read latency histogram (micros): Count: 3253 Average: 25.8137 StdDev: 197.27 Min: 0 Median: 1.5939 Max: 5567 Percentiles: P50: 1.59 P75: 2.11 P99: 505.83 P99.9: 2836.75 P99.99: 5567.00 ------------------------------------------------------ [ 0, 1 ] 501 15.401% 15.401% ### ( 1, 2 ] 1895 58.254% 73.655% ############ ( 2, 3 ] 400 12.296% 85.951% ## ( 3, 4 ] 78 2.398% 88.349% ( 4, 6 ] 62 1.906% 90.255% ( 6, 10 ] 48 1.476% 91.731% ( 10, 15 ] 30 0.922% 92.653% ( 15, 22 ] 15 0.461% 93.114% ( 22, 34 ] 1 0.031% 93.145% ( 51, 76 ] 1 0.031% 93.176% ( 76, 110 ] 70 2.152% 95.327% ( 110, 170 ] 54 1.660% 96.987% ( 170, 250 ] 30 0.922% 97.910% ( 250, 380 ] 21 0.646% 98.555% ( 380, 580 ] 23 0.707% 99.262% ( 580, 870 ] 11 0.338% 99.600% ( 870, 1300 ] 5 0.154% 99.754% ( 1300, 1900 ] 1 0.031% 99.785% ( 1900, 2900 ] 4 0.123% 99.908% ( 4400, 6600 ] 3 0.092% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 756.9000 StdDev: 810.58 Min: 74 Median: 434.5455 Max: 3152 Percentiles: P50: 434.55 P75: 941.67 P99: 3152.00 P99.9: 3152.00 P99.99: 3152.00 ------------------------------------------------------ ( 51, 76 ] 2 2.500% 2.500% # ( 76, 110 ] 5 6.250% 8.750% # ( 110, 170 ] 13 16.250% 25.000% ### ( 170, 250 ] 11 13.750% 38.750% ### ( 250, 380 ] 6 7.500% 46.250% ## ( 380, 580 ] 11 13.750% 60.000% ### ( 580, 870 ] 11 13.750% 73.750% ### ( 870, 1300 ] 6 7.500% 81.250% ## ( 1300, 1900 ] 5 6.250% 87.500% # ( 1900, 2900 ] 8 10.000% 97.500% ## ( 2900, 4400 ] 2 2.500% 100.000% # ** DB Stats ** Uptime(secs): 29.0 total, 3.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 237.53 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.694 H:M:S, 33.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 305.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.493 H:M:S, 15.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/13-17:30:01 ... thread 0: (1000000,8000000) ops and (35610.3,140655.6) ops/second in (28.081735,56.876524) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/6 1.23 GB 37.7 6.8 0.0 6.8 14.3 7.6 0.0 1.9 131.5 278.2 52.70 45.39 135 0.390 7035K 14K 0.0 0.0 L1 5/4 407.69 MB 0.0 9.7 6.1 3.6 9.5 5.9 0.2 1.6 227.1 223.7 43.67 40.69 4 10.918 9417K 51K 0.0 0.0 L2 2/1 257.55 MB 1.3 0.4 0.2 0.2 0.4 0.2 5.6 2.0 253.7 253.5 1.49 1.44 2 0.745 383K 199 0.0 0.0 L3 31/12 2.17 GB 1.2 2.3 1.2 1.1 2.3 1.2 4.4 1.9 130.2 129.2 18.45 10.75 8 2.306 2178K 18K 0.0 0.0 L4 197/15 12.54 GB 1.3 3.8 3.5 0.3 3.7 3.5 1.0 1.1 112.8 112.6 34.09 17.81 32 1.065 3399K 3767 0.0 0.0 L5 1056/0 86.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1298/38 103.52 GB 0.0 22.9 11.0 11.9 30.3 18.4 12.5 4.0 156.1 206.3 150.41 116.08 181 0.831 22M 88K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.9 11.0 11.9 30.3 18.4 12.4 4.0 156.1 206.3 150.41 116.08 181 0.831 22M 88K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.9 11.0 11.9 22.7 10.8 0.0 0.0 188.2 186.6 124.77 96.26 68 1.835 22M 88K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 302.3 25.64 19.82 113 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.1 total, 56.9 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.30 GB write, 543.59 MB/s write, 22.93 GB read, 411.23 MB/s read, 150.4 seconds Interval compaction: 30.30 GB write, 545.58 MB/s write, 22.93 GB read, 412.73 MB/s read, 150.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 20, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 20, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 42, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 30, total-stops: 42, interval: 72 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3532542 Average: 2.9964 StdDev: 29.71 Min: 0 Median: 1.4825 Max: 11031 Percentiles: P50: 1.48 P75: 1.87 P99: 7.29 P99.9: 160.84 P99.99: 472.28 ------------------------------------------------------ [ 0, 1 ] 654712 18.534% 18.534% #### ( 1, 2 ] 2303931 65.220% 83.754% ############# ( 2, 3 ] 339264 9.604% 93.358% ## ( 3, 4 ] 112789 3.193% 96.551% # ( 4, 6 ] 79324 2.246% 98.796% ( 6, 10 ] 22348 0.633% 99.429% ( 10, 15 ] 4128 0.117% 99.546% ( 15, 22 ] 663 0.019% 99.565% ( 22, 34 ] 38 0.001% 99.566% ( 34, 51 ] 48 0.001% 99.567% ( 51, 76 ] 362 0.010% 99.577% ( 76, 110 ] 6562 0.186% 99.763% ( 110, 170 ] 5713 0.162% 99.925% ( 170, 250 ] 1133 0.032% 99.957% ( 250, 380 ] 842 0.024% 99.981% ( 380, 580 ] 719 0.020% 100.001% ( 580, 870 ] 293 0.008% 100.009% ( 870, 1300 ] 122 0.003% 100.013% ( 1300, 1900 ] 49 0.001% 100.014% ( 1900, 2900 ] 63 0.002% 100.016% ( 2900, 4400 ] 66 0.002% 100.018% ( 4400, 6600 ] 27 0.001% 100.019% ( 6600, 9900 ] 4 0.000% 100.019% ( 9900, 14000 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 2125915 Average: 6.7228 StdDev: 112.89 Min: 0 Median: 1.6974 Max: 11365 Percentiles: P50: 1.70 P75: 2.52 P99: 9.14 P99.9: 135.77 P99.99: 394.95 ------------------------------------------------------ [ 0, 1 ] 277007 13.030% 13.030% ### ( 1, 2 ] 1126996 53.012% 66.042% ########### ( 2, 3 ] 367061 17.266% 83.308% ### ( 3, 4 ] 152918 7.193% 90.501% # ( 4, 6 ] 151396 7.121% 97.623% # ( 6, 10 ] 37289 1.754% 99.377% ( 10, 15 ] 6922 0.326% 99.702% ( 15, 22 ] 1197 0.056% 99.759% ( 22, 34 ] 75 0.004% 99.762% ( 34, 51 ] 19 0.001% 99.763% ( 51, 76 ] 278 0.013% 99.776% ( 76, 110 ] 1891 0.089% 99.865% ( 110, 170 ] 1723 0.081% 99.946% ( 170, 250 ] 380 0.018% 99.964% ( 250, 380 ] 501 0.024% 99.988% ( 380, 580 ] 661 0.031% 100.019% ( 580, 870 ] 769 0.036% 100.055% ( 870, 1300 ] 613 0.029% 100.084% ( 1300, 1900 ] 404 0.019% 100.103% ( 1900, 2900 ] 620 0.029% 100.132% ( 2900, 4400 ] 756 0.036% 100.168% ( 4400, 6600 ] 267 0.013% 100.180% ( 6600, 9900 ] 73 0.003% 100.183% ( 9900, 14000 ] 3 0.000% 100.184% ** Level 2 read latency histogram (micros): Count: 95268 Average: 2.1907 StdDev: 13.21 Min: 1 Median: 1.4453 Max: 2110 Percentiles: P50: 1.45 P75: 1.84 P99: 5.63 P99.9: 11.47 P99.99: 651.20 ------------------------------------------------------ [ 0, 1 ] 20729 21.759% 21.759% #### ( 1, 2 ] 60418 63.419% 85.178% ############# ( 2, 3 ] 8202 8.609% 93.787% ## ( 3, 4 ] 3165 3.322% 97.109% # ( 4, 6 ] 2208 2.318% 99.427% ( 6, 10 ] 421 0.442% 99.869% ( 10, 15 ] 101 0.106% 99.975% ( 15, 22 ] 5 0.005% 99.980% ( 22, 34 ] 2 0.002% 99.982% ( 34, 51 ] 1 0.001% 99.983% ( 51, 76 ] 1 0.001% 99.984% ( 250, 380 ] 2 0.002% 99.986% ( 380, 580 ] 2 0.002% 99.988% ( 580, 870 ] 6 0.006% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 480734 Average: 8.5346 StdDev: 121.10 Min: 0 Median: 1.9823 Max: 8858 Percentiles: P50: 1.98 P75: 2.97 P99: 9.47 P99.9: 611.03 P99.99: 983.05 ------------------------------------------------------ [ 0, 1 ] 14133 2.940% 2.940% # ( 1, 2 ] 230302 47.906% 50.846% ########## ( 2, 3 ] 119197 24.795% 75.641% ##### ( 3, 4 ] 52392 10.898% 86.539% ## ( 4, 6 ] 51393 10.691% 97.230% ## ( 6, 10 ] 9803 2.039% 99.269% ( 10, 15 ] 2198 0.457% 99.726% ( 15, 22 ] 235 0.049% 99.775% ( 22, 34 ] 22 0.005% 99.780% ( 34, 51 ] 8 0.002% 99.781% ( 51, 76 ] 5 0.001% 99.782% ( 76, 110 ] 10 0.002% 99.784% ( 110, 170 ] 32 0.007% 99.791% ( 170, 250 ] 85 0.018% 99.809% ( 250, 380 ] 149 0.031% 99.840% ( 380, 580 ] 247 0.051% 99.891% ( 580, 870 ] 395 0.082% 99.973% ( 870, 1300 ] 304 0.063% 100.037% ( 1300, 1900 ] 161 0.033% 100.070% ( 1900, 2900 ] 209 0.043% 100.114% ( 2900, 4400 ] 237 0.049% 100.163% ( 4400, 6600 ] 44 0.009% 100.172% ( 6600, 9900 ] 12 0.002% 100.175% ** Level 4 read latency histogram (micros): Count: 94474 Average: 42.5203 StdDev: 295.87 Min: 0 Median: 1.9902 Max: 8271 Percentiles: P50: 1.99 P75: 3.03 P99: 1188.26 P99.9: 4184.46 P99.99: 6075.59 ------------------------------------------------------ [ 0, 1 ] 2258 2.390% 2.390% ( 1, 2 ] 45423 48.080% 50.470% ########## ( 2, 3 ] 22839 24.175% 74.645% ##### ( 3, 4 ] 10827 11.460% 86.105% ## ( 4, 6 ] 7315 7.743% 93.848% ## ( 6, 10 ] 1882 1.992% 95.840% ( 10, 15 ] 409 0.433% 96.273% ( 15, 22 ] 73 0.077% 96.350% ( 22, 34 ] 17 0.018% 96.368% ( 34, 51 ] 6 0.006% 96.375% ( 51, 76 ] 4 0.004% 96.379% ( 76, 110 ] 99 0.105% 96.484% ( 110, 170 ] 167 0.177% 96.660% ( 170, 250 ] 214 0.227% 96.887% ( 250, 380 ] 305 0.323% 97.210% ( 380, 580 ] 538 0.569% 97.779% ( 580, 870 ] 741 0.784% 98.564% ( 870, 1300 ] 557 0.590% 99.153% ( 1300, 1900 ] 285 0.302% 99.455% ( 1900, 2900 ] 227 0.240% 99.695% ( 2900, 4400 ] 226 0.239% 99.934% ( 4400, 6600 ] 69 0.073% 100.007% ( 6600, 9900 ] 10 0.011% 100.018% ** Level 5 read latency histogram (micros): Count: 80 Average: 756.9000 StdDev: 810.58 Min: 74 Median: 434.5455 Max: 3152 Percentiles: P50: 434.55 P75: 941.67 P99: 3152.00 P99.9: 3152.00 P99.99: 3152.00 ------------------------------------------------------ ( 51, 76 ] 2 2.500% 2.500% # ( 76, 110 ] 5 6.250% 8.750% # ( 110, 170 ] 13 16.250% 25.000% ### ( 170, 250 ] 11 13.750% 38.750% ### ( 250, 380 ] 6 7.500% 46.250% ## ( 380, 580 ] 11 13.750% 60.000% ### ( 580, 870 ] 11 13.750% 73.750% ### ( 870, 1300 ] 6 7.500% 81.250% ## ( 1300, 1900 ] 5 6.250% 87.500% # ( 1900, 2900 ] 8 10.000% 97.500% ## ( 2900, 4400 ] 2 2.500% 100.000% # ** DB Stats ** Uptime(secs): 57.1 total, 28.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 137.92 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:34.045 H:M:S, 59.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 35.05 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:24.351 H:M:S, 86.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.927 micros/op 144364 ops/sec 60.001 seconds 8661999 operations; 139.9 MB/s Microseconds per write: Count: 8661999 Average: 6.9269 StdDev: 615.19 Min: 1 Median: 1.8219 Max: 867279 Percentiles: P50: 1.82 P75: 2.84 P99: 9.46 P99.9: 1232.93 P99.99: 2768.62 ------------------------------------------------------ [ 0, 1 ] 729330 8.420% 8.420% ## ( 1, 2 ] 4382066 50.590% 59.009% ########## ( 2, 3 ] 1648725 19.034% 78.043% #### ( 3, 4 ] 1245071 14.374% 92.417% ### ( 4, 6 ] 473823 5.470% 97.888% # ( 6, 10 ] 111311 1.285% 99.173% ( 10, 15 ] 32666 0.377% 99.550% ( 15, 22 ] 7132 0.082% 99.632% ( 22, 34 ] 1597 0.018% 99.650% ( 34, 51 ] 177 0.002% 99.652% ( 51, 76 ] 24 0.000% 99.653% ( 76, 110 ] 6317 0.073% 99.726% ( 110, 170 ] 2123 0.025% 99.750% ( 170, 250 ] 221 0.003% 99.753% ( 250, 380 ] 128 0.001% 99.754% ( 380, 580 ] 12 0.000% 99.754% ( 580, 870 ] 27 0.000% 99.755% ( 870, 1300 ] 14913 0.172% 99.927% ( 1300, 1900 ] 27 0.000% 99.927% ( 1900, 2900 ] 6266 0.072% 100.000% ( 2900, 4400 ] 20 0.000% 100.000% ( 4400, 6600 ] 3 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 9 0.000% 100.000% ( 380000, 570000 ] 2 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 209200 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 8661999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 8939182968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 560 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 35249925 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 29669446068 rocksdb.compact.write.bytes COUNT : 29449813556 rocksdb.flush.write.bytes COUNT : 8785778448 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 76 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 300 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 8714734592 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3198976 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29767714977 rocksdb.non.last.level.read.count COUNT : 7187709 rocksdb.block.checksum.compute.count COUNT : 7186665 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.522359 P95 : 3.940280 P99 : 8.228033 P100 : 867276.000000 COUNT : 8661999 SUM : 56000618 rocksdb.compaction.times.micros P50 : 1148484.848485 P95 : 4960000.000000 P99 : 22303276.000000 P100 : 22303276.000000 COUNT : 88 SUM : 155834160 rocksdb.compaction.times.cpu_micros P50 : 860000.000000 P95 : 3740000.000000 P99 : 14960000.000000 P100 : 20497529.000000 COUNT : 88 SUM : 116323609 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 701.544118 P95 : 12565.000000 P99 : 163700.000000 P100 : 234268.000000 COUNT : 121 SUM : 754593 rocksdb.compaction.outfile.sync.micros P50 : 1327.272727 P95 : 152882.352941 P99 : 238581.818182 P100 : 314132.000000 COUNT : 357 SUM : 9494224 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 131.290323 P95 : 2585.714286 P99 : 4034.000000 P100 : 4182.000000 COUNT : 244 SUM : 118438 rocksdb.table.open.io.micros P50 : 1657.303371 P95 : 9632.432432 P99 : 13687.619048 P100 : 21323.000000 COUNT : 560 SUM : 1497414 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.700323 P95 : 8.127442 P99 : 12.717862 P100 : 14797.000000 COUNT : 7185044 SUM : 55939103 rocksdb.read.block.get.micros P50 : 510.612245 P95 : 4042.857143 P99 : 6053.333333 P100 : 9937.000000 COUNT : 1120 SUM : 1195312 rocksdb.write.raw.block.micros P50 : 0.514078 P95 : 0.976748 P99 : 2.831306 P100 : 14917.000000 COUNT : 9266074 SUM : 20659605 rocksdb.numfiles.in.singlecompaction P50 : 3.131579 P95 : 4.400000 P99 : 18.640000 P100 : 27.000000 COUNT : 148 SUM : 541 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.569964 P95 : 1231.516062 P99 : 2626.465228 P100 : 867091.000000 COUNT : 173196 SUM : 35266371 rocksdb.sst.read.micros P50 : 1.624378 P95 : 4.871010 P99 : 9.223338 P100 : 11365.000000 COUNT : 7187913 SUM : 41112219 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 8661999 SUM : 8939182968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 210487.804878 P95 : 568100.000000 P99 : 1042047.000000 P100 : 1042047.000000 COUNT : 121 SUM : 28531144 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 335 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0