[2024-11-20 10:59:28.265865] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 23.11.0 initialization... [2024-11-20 10:59:28.266004] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1505697 ] Set seed to 1732096768262664 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 10:59:28.388231] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 10:59:28.427203] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 10:59:28.427255] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1505697' to capture a snapshot of events at runtime. [2024-11-20 10:59:28.427268] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 10:59:28.427281] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 10:59:28.427291] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1505697 for offline analysis/debug. [2024-11-20 10:59:28.427396] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 10:59:32 2024 CPU: 112 * Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz CPUCache: 39424 KB 2024/11/20-10:59:35 ... thread 0: (1000000,1000000) ops and (346049.1,346049.1) ops/second in (2.889763,2.889763) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 378.02 MB 12.6 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 346.5 2.36 2.14 12 0.197 0 0 0.0 0.0 L1 4/0 251.70 MB 25.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 260.0 259.7 0.97 0.93 1 0.969 255K 269 0.0 0.0 L2 3/2 188.87 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 254.2 254.1 0.74 0.72 1 0.743 191K 97 0.0 0.0 L3 12/0 993.19 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1064/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1205/6 96.94 GB 0.0 0.4 0.4 0.1 1.2 1.2 0.5 1.5 108.2 309.0 4.08 3.79 14 0.291 447K 366 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.2 1.2 0.4 1.5 108.2 309.0 4.08 3.79 14 0.291 447K 366 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 257.5 257.3 1.71 1.65 2 0.856 447K 366 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 346.5 2.36 2.14 12 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 410.18 MB/s write, 0.43 GB read, 143.60 MB/s read, 4.1 seconds Interval compaction: 1.23 GB write, 435.57 MB/s write, 0.43 GB read, 152.49 MB/s read, 4.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 147448 Average: 1.8904 StdDev: 6.56 Min: 0 Median: 1.2695 Max: 1462 Percentiles: P50: 1.27 P75: 1.72 P99: 5.30 P99.9: 9.76 P99.99: 29.81 ------------------------------------------------------ [ 0, 1 ] 51538 34.953% 34.953% ####### ( 1, 2 ] 82329 55.836% 90.789% ########### ( 2, 3 ] 8004 5.428% 96.218% # ( 3, 4 ] 3056 2.073% 98.290% ( 4, 6 ] 1612 1.093% 99.384% ( 6, 10 ] 810 0.549% 99.933% ( 10, 15 ] 67 0.045% 99.978% ( 15, 22 ] 14 0.009% 99.988% ( 22, 34 ] 5 0.003% 99.991% ( 34, 51 ] 1 0.001% 99.992% ( 51, 76 ] 2 0.001% 99.993% ( 170, 250 ] 9 0.006% 99.999% ( 250, 380 ] 4 0.003% 100.002% ( 380, 580 ] 7 0.005% 100.007% ( 580, 870 ] 2 0.001% 100.008% ( 870, 1300 ] 1 0.001% 100.009% ( 1300, 1900 ] 1 0.001% 100.009% ** Level 1 read latency histogram (micros): Count: 25 Average: 294.4000 StdDev: 567.33 Min: 1 Median: 2.5000 Max: 2574 Percentiles: P50: 2.50 P75: 417.50 P99: 2574.00 P99.9: 2574.00 P99.99: 2574.00 ------------------------------------------------------ [ 0, 1 ] 5 20.000% 20.000% #### ( 1, 2 ] 7 28.000% 48.000% ###### ( 2, 3 ] 1 4.000% 52.000% # ( 3, 4 ] 1 4.000% 56.000% # ( 110, 170 ] 2 8.000% 64.000% ## ( 170, 250 ] 1 4.000% 68.000% # ( 250, 380 ] 1 4.000% 72.000% # ( 380, 580 ] 4 16.000% 88.000% ### ( 580, 870 ] 1 4.000% 92.000% # ( 1300, 1900 ] 1 4.000% 96.000% # ( 1900, 2900 ] 1 4.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 32702 Average: 2.2895 StdDev: 5.29 Min: 0 Median: 1.5429 Max: 703 Percentiles: P50: 1.54 P75: 1.91 P99: 6.95 P99.9: 13.33 P99.99: 228.38 ------------------------------------------------------ [ 0, 1 ] 4365 13.348% 13.348% ### ( 1, 2 ] 22079 67.516% 80.864% ############## ( 2, 3 ] 3432 10.495% 91.358% ## ( 3, 4 ] 1574 4.813% 96.171% # ( 4, 6 ] 849 2.596% 98.768% # ( 6, 10 ] 321 0.982% 99.749% ( 10, 15 ] 74 0.226% 99.976% ( 15, 22 ] 2 0.006% 99.982% ( 34, 51 ] 2 0.006% 99.988% ( 170, 250 ] 1 0.003% 99.991% ( 380, 580 ] 2 0.006% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 55 Average: 1643.3091 StdDev: 1218.77 Min: 143 Median: 1390.0000 Max: 4727 Percentiles: P50: 1390.00 P75: 2425.00 P99: 4727.00 P99.9: 4727.00 P99.99: 4727.00 ------------------------------------------------------ ( 110, 170 ] 1 1.818% 1.818% ( 250, 380 ] 6 10.909% 12.727% ## ( 380, 580 ] 8 14.545% 27.273% ### ( 580, 870 ] 5 9.091% 36.364% ## ( 870, 1300 ] 6 10.909% 47.273% ## ( 1300, 1900 ] 10 18.182% 65.455% #### ( 1900, 2900 ] 10 18.182% 83.636% #### ( 2900, 4400 ] 6 10.909% 94.545% ## ( 4400, 6600 ] 3 5.455% 100.000% # ** Level 4 read latency histogram (micros): Count: 20 Average: 1418.9500 StdDev: 1187.55 Min: 62 Median: 1300.0000 Max: 4317 Percentiles: P50: 1300.00 P75: 1900.00 P99: 4300.00 P99.9: 4317.00 P99.99: 4317.00 ------------------------------------------------------ ( 51, 76 ] 1 5.000% 5.000% # ( 76, 110 ] 1 5.000% 10.000% # ( 170, 250 ] 1 5.000% 15.000% # ( 250, 380 ] 2 10.000% 25.000% ## ( 380, 580 ] 3 15.000% 40.000% ### ( 870, 1300 ] 2 10.000% 50.000% ## ( 1300, 1900 ] 5 25.000% 75.000% ##### ( 1900, 2900 ] 2 10.000% 85.000% ## ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 320.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.250 H:M:S, 8.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 340.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.250 H:M:S, 8.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-10:59:38 ... thread 0: (1000000,2000000) ops and (321944.4,333561.9) ops/second in (3.106126,5.995889) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 1.35 GB 18.9 0.5 0.0 0.5 2.3 1.8 0.0 1.3 72.0 332.9 7.00 6.43 28 0.250 511K 495 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 260.0 259.7 0.97 0.93 1 0.969 255K 269 0.0 0.0 L2 2/1 82.40 MB 0.8 0.2 0.1 0.1 0.2 0.1 0.4 1.5 247.1 247.0 0.78 0.75 2 0.391 196K 101 0.0 0.0 L3 17/8 868.22 MB 0.2 0.2 0.2 0.0 0.2 0.2 0.3 1.0 226.0 226.0 0.83 0.75 1 0.827 189K 0 0.0 0.0 L4 173/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 137.1 137.2 1.23 0.88 1 1.226 170K 0 0.0 0.0 L5 1068/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1274/21 97.92 GB 0.0 1.3 0.7 0.6 3.1 2.5 1.5 1.7 120.7 289.7 10.81 9.74 33 0.327 1324K 865 0.0 0.0 Int 0/0 0.00 KB 0.0 1.3 0.7 0.6 3.1 2.5 1.4 1.7 120.7 289.7 10.81 9.74 33 0.327 1324K 865 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.3 0.7 0.6 1.3 0.7 0.0 0.0 231.1 231.0 5.64 5.11 7 0.806 1324K 865 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.9 5.16 4.63 26 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.06 GB write, 506.83 MB/s write, 1.27 GB read, 211.21 MB/s read, 10.8 seconds Interval compaction: 3.06 GB write, 521.96 MB/s write, 1.27 GB read, 217.51 MB/s read, 10.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 386150 Average: 2.1536 StdDev: 7.16 Min: 0 Median: 1.4691 Max: 1795 Percentiles: P50: 1.47 P75: 1.87 P99: 5.70 P99.9: 9.97 P99.99: 14.99 ------------------------------------------------------ [ 0, 1 ] 79426 20.569% 20.569% #### ( 1, 2 ] 242255 62.736% 83.305% ############# ( 2, 3 ] 39042 10.111% 93.415% ## ( 3, 4 ] 14673 3.800% 97.215% # ( 4, 6 ] 8113 2.101% 99.316% ( 6, 10 ] 2270 0.588% 99.904% ( 10, 15 ] 333 0.086% 99.990% ( 15, 22 ] 32 0.008% 99.998% ( 22, 34 ] 7 0.002% 100.000% ( 34, 51 ] 1 0.000% 100.001% ( 51, 76 ] 3 0.001% 100.001% ( 170, 250 ] 19 0.005% 100.006% ( 250, 380 ] 7 0.002% 100.008% ( 380, 580 ] 16 0.004% 100.012% ( 580, 870 ] 7 0.002% 100.014% ( 870, 1300 ] 4 0.001% 100.015% ( 1300, 1900 ] 3 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 21650 Average: 3.4304 StdDev: 26.08 Min: 1 Median: 1.6896 Max: 2574 Percentiles: P50: 1.69 P75: 2.30 P99: 9.25 P99.9: 306.21 P99.99: 1229.05 ------------------------------------------------------ [ 0, 1 ] 1273 5.880% 5.880% # ( 1, 2 ] 13851 63.977% 69.857% ############# ( 2, 3 ] 3683 17.012% 86.868% ### ( 3, 4 ] 1375 6.351% 93.219% # ( 4, 6 ] 892 4.120% 97.339% # ( 6, 10 ] 442 2.042% 99.381% ( 10, 15 ] 47 0.217% 99.598% ( 15, 22 ] 10 0.046% 99.644% ( 22, 34 ] 1 0.005% 99.649% ( 51, 76 ] 24 0.111% 99.760% ( 76, 110 ] 5 0.023% 99.783% ( 110, 170 ] 9 0.042% 99.824% ( 170, 250 ] 9 0.042% 99.866% ( 250, 380 ] 17 0.079% 99.945% ( 380, 580 ] 8 0.037% 99.982% ( 580, 870 ] 1 0.005% 99.986% ( 870, 1300 ] 1 0.005% 99.991% ( 1300, 1900 ] 1 0.005% 99.995% ( 1900, 2900 ] 1 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 49065 Average: 2.2933 StdDev: 4.37 Min: 0 Median: 1.5610 Max: 703 Percentiles: P50: 1.56 P75: 1.94 P99: 6.68 P99.9: 13.57 P99.99: 34.79 ------------------------------------------------------ [ 0, 1 ] 6244 12.726% 12.726% ### ( 1, 2 ] 32600 66.442% 79.168% ############# ( 2, 3 ] 6036 12.302% 91.470% ## ( 3, 4 ] 2318 4.724% 96.195% # ( 4, 6 ] 1303 2.656% 98.851% # ( 6, 10 ] 430 0.876% 99.727% ( 10, 15 ] 119 0.243% 99.969% ( 15, 22 ] 7 0.014% 99.984% ( 22, 34 ] 3 0.006% 99.990% ( 34, 51 ] 2 0.004% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 380, 580 ] 2 0.004% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 186655 Average: 3.4656 StdDev: 38.30 Min: 1 Median: 1.6510 Max: 4727 Percentiles: P50: 1.65 P75: 2.22 P99: 9.10 P99.9: 201.16 P99.99: 460.71 ------------------------------------------------------ [ 0, 1 ] 19680 10.544% 10.544% ## ( 1, 2 ] 113125 60.606% 71.150% ############ ( 2, 3 ] 32043 17.167% 88.317% ### ( 3, 4 ] 10636 5.698% 94.015% # ( 4, 6 ] 6667 3.572% 97.587% # ( 6, 10 ] 3402 1.823% 99.410% ( 10, 15 ] 458 0.245% 99.655% ( 15, 22 ] 82 0.044% 99.699% ( 22, 34 ] 77 0.041% 99.740% ( 34, 51 ] 11 0.006% 99.746% ( 51, 76 ] 120 0.064% 99.810% ( 76, 110 ] 42 0.023% 99.833% ( 110, 170 ] 86 0.046% 99.879% ( 170, 250 ] 101 0.054% 99.933% ( 250, 380 ] 91 0.049% 99.982% ( 380, 580 ] 38 0.020% 100.002% ( 580, 870 ] 16 0.009% 100.011% ( 870, 1300 ] 7 0.004% 100.014% ( 1300, 1900 ] 12 0.006% 100.021% ( 1900, 2900 ] 12 0.006% 100.027% ( 2900, 4400 ] 6 0.003% 100.031% ( 4400, 6600 ] 3 0.002% 100.032% ** Level 4 read latency histogram (micros): Count: 305 Average: 98.0689 StdDev: 464.13 Min: 0 Median: 1.6167 Max: 4317 Percentiles: P50: 1.62 P75: 3.99 P99: 2875.00 P99.9: 4247.50 P99.99: 4317.00 ------------------------------------------------------ [ 0, 1 ] 97 31.803% 31.803% ###### ( 1, 2 ] 90 29.508% 61.311% ###### ( 2, 3 ] 24 7.869% 69.180% ## ( 3, 4 ] 18 5.902% 75.082% # ( 4, 6 ] 8 2.623% 77.705% # ( 6, 10 ] 31 10.164% 87.869% ## ( 10, 15 ] 13 4.262% 92.131% # ( 15, 22 ] 1 0.328% 92.459% ( 51, 76 ] 1 0.328% 92.787% ( 76, 110 ] 2 0.656% 93.443% ( 170, 250 ] 2 0.656% 94.098% ( 250, 380 ] 3 0.984% 95.082% ( 380, 580 ] 3 0.984% 96.066% ( 870, 1300 ] 2 0.656% 96.721% ( 1300, 1900 ] 5 1.639% 98.361% ( 1900, 2900 ] 2 0.656% 99.016% ( 2900, 4400 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 557.6000 StdDev: 546.52 Min: 58 Median: 250.0000 Max: 1763 Percentiles: P50: 250.00 P75: 870.00 P99: 1763.00 P99.9: 1763.00 P99.99: 1763.00 ------------------------------------------------------ ( 51, 76 ] 3 15.000% 15.000% ### ( 76, 110 ] 2 10.000% 25.000% ## ( 110, 170 ] 1 5.000% 30.000% # ( 170, 250 ] 4 20.000% 50.000% #### ( 250, 380 ] 1 5.000% 55.000% # ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 3 15.000% 75.000% ### ( 870, 1300 ] 2 10.000% 85.000% ## ( 1300, 1900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 6.2 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 318.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.662 H:M:S, 10.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 316.86 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.413 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/20-10:59:41 ... thread 0: (1000000,3000000) ops and (351462.3,339322.6) ops/second in (2.845255,8.841144) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.35 GB 81.8 1.3 0.0 1.3 4.0 2.7 0.0 1.5 104.8 324.4 12.62 11.70 45 0.280 1343K 1342 0.0 0.0 L1 5/0 459.69 MB 46.0 1.2 1.2 0.0 1.2 1.2 0.2 1.0 243.2 242.4 4.92 4.77 2 2.460 1214K 4018 0.0 0.0 L2 5/5 558.79 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.9 1.5 247.1 247.0 0.78 0.75 2 0.391 196K 101 0.0 0.0 L3 15/8 869.67 MB 0.7 0.8 0.2 0.7 0.8 0.2 0.3 4.5 233.9 233.1 3.72 3.45 2 1.859 883K 3048 0.0 0.0 L4 173/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 137.1 137.2 1.23 0.88 1 1.226 170K 0 0.0 0.0 L5 1068/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1277/21 98.84 GB 0.0 3.7 1.6 2.0 6.4 4.3 2.0 2.3 161.2 280.0 23.26 21.55 52 0.447 3808K 8509 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 1.6 2.0 6.4 4.3 1.8 2.3 161.2 280.0 23.26 21.55 52 0.447 3808K 8509 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 1.6 2.0 3.7 1.6 0.0 0.0 241.8 241.2 15.51 14.60 12 1.293 3808K 8509 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 357.6 7.75 6.95 40 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.36 GB write, 721.99 MB/s write, 3.66 GB read, 415.72 MB/s read, 23.3 seconds Interval compaction: 6.36 GB write, 736.61 MB/s write, 3.66 GB read, 424.14 MB/s read, 23.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 766293 Average: 2.1752 StdDev: 6.18 Min: 0 Median: 1.4984 Max: 1795 Percentiles: P50: 1.50 P75: 1.88 P99: 5.67 P99.9: 9.94 P99.99: 14.41 ------------------------------------------------------ [ 0, 1 ] 135483 17.680% 17.680% #### ( 1, 2 ] 496941 64.850% 82.530% ############# ( 2, 3 ] 82995 10.831% 93.361% ## ( 3, 4 ] 29746 3.882% 97.243% # ( 4, 6 ] 16108 2.102% 99.345% ( 6, 10 ] 4324 0.564% 99.909% ( 10, 15 ] 703 0.092% 100.001% ( 15, 22 ] 54 0.007% 100.008% ( 22, 34 ] 17 0.002% 100.010% ( 34, 51 ] 1 0.000% 100.010% ( 51, 76 ] 4 0.001% 100.011% ( 76, 110 ] 1 0.000% 100.011% ( 170, 250 ] 32 0.004% 100.015% ( 250, 380 ] 9 0.001% 100.016% ( 380, 580 ] 27 0.004% 100.020% ( 580, 870 ] 12 0.002% 100.021% ( 870, 1300 ] 7 0.001% 100.022% ( 1300, 1900 ] 3 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 45912 Average: 3.8504 StdDev: 25.94 Min: 0 Median: 1.7402 Max: 2574 Percentiles: P50: 1.74 P75: 2.51 P99: 9.80 P99.9: 306.96 P99.99: 535.27 ------------------------------------------------------ [ 0, 1 ] 2204 4.800% 4.800% # ( 1, 2 ] 28036 61.065% 65.865% ############ ( 2, 3 ] 8144 17.738% 83.603% #### ( 3, 4 ] 3377 7.355% 90.959% # ( 4, 6 ] 2665 5.805% 96.763% # ( 6, 10 ] 1082 2.357% 99.120% ( 10, 15 ] 163 0.355% 99.475% ( 15, 22 ] 24 0.052% 99.527% ( 22, 34 ] 9 0.020% 99.547% ( 34, 51 ] 3 0.007% 99.553% ( 51, 76 ] 52 0.113% 99.667% ( 76, 110 ] 15 0.033% 99.699% ( 110, 170 ] 34 0.074% 99.773% ( 170, 250 ] 43 0.094% 99.867% ( 250, 380 ] 39 0.085% 99.952% ( 380, 580 ] 25 0.054% 100.007% ( 580, 870 ] 6 0.013% 100.020% ( 870, 1300 ] 3 0.007% 100.026% ( 1300, 1900 ] 1 0.002% 100.028% ( 1900, 2900 ] 2 0.004% 100.033% ** Level 2 read latency histogram (micros): Count: 49096 Average: 2.2935 StdDev: 4.37 Min: 0 Median: 1.5611 Max: 703 Percentiles: P50: 1.56 P75: 1.94 P99: 6.69 P99.9: 13.57 P99.99: 34.77 ------------------------------------------------------ [ 0, 1 ] 6245 12.720% 12.720% ### ( 1, 2 ] 32619 66.439% 79.159% ############# ( 2, 3 ] 6042 12.307% 91.466% ## ( 3, 4 ] 2321 4.727% 96.193% # ( 4, 6 ] 1304 2.656% 98.849% # ( 6, 10 ] 431 0.878% 99.727% ( 10, 15 ] 119 0.242% 99.969% ( 15, 22 ] 7 0.014% 99.984% ( 22, 34 ] 3 0.006% 99.990% ( 34, 51 ] 2 0.004% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 380, 580 ] 2 0.004% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 186686 Average: 3.5019 StdDev: 38.62 Min: 1 Median: 1.6510 Max: 4727 Percentiles: P50: 1.65 P75: 2.22 P99: 9.11 P99.9: 209.85 P99.99: 497.82 ------------------------------------------------------ [ 0, 1 ] 19692 10.548% 10.548% ## ( 1, 2 ] 113131 60.600% 71.148% ############ ( 2, 3 ] 32044 17.165% 88.312% ### ( 3, 4 ] 10636 5.697% 94.010% # ( 4, 6 ] 6667 3.571% 97.581% # ( 6, 10 ] 3402 1.822% 99.403% ( 10, 15 ] 458 0.245% 99.649% ( 15, 22 ] 82 0.044% 99.693% ( 22, 34 ] 77 0.041% 99.734% ( 34, 51 ] 11 0.006% 99.740% ( 51, 76 ] 120 0.064% 99.804% ( 76, 110 ] 42 0.022% 99.826% ( 110, 170 ] 87 0.047% 99.873% ( 170, 250 ] 101 0.054% 99.927% ( 250, 380 ] 92 0.049% 99.976% ( 380, 580 ] 43 0.023% 99.999% ( 580, 870 ] 20 0.011% 100.010% ( 870, 1300 ] 8 0.004% 100.014% ( 1300, 1900 ] 12 0.006% 100.021% ( 1900, 2900 ] 12 0.006% 100.027% ( 2900, 4400 ] 6 0.003% 100.031% ( 4400, 6600 ] 3 0.002% 100.032% ** Level 4 read latency histogram (micros): Count: 305 Average: 98.0689 StdDev: 464.13 Min: 0 Median: 1.6167 Max: 4317 Percentiles: P50: 1.62 P75: 3.99 P99: 2875.00 P99.9: 4247.50 P99.99: 4317.00 ------------------------------------------------------ [ 0, 1 ] 97 31.803% 31.803% ###### ( 1, 2 ] 90 29.508% 61.311% ###### ( 2, 3 ] 24 7.869% 69.180% ## ( 3, 4 ] 18 5.902% 75.082% # ( 4, 6 ] 8 2.623% 77.705% # ( 6, 10 ] 31 10.164% 87.869% ## ( 10, 15 ] 13 4.262% 92.131% # ( 15, 22 ] 1 0.328% 92.459% ( 51, 76 ] 1 0.328% 92.787% ( 76, 110 ] 2 0.656% 93.443% ( 170, 250 ] 2 0.656% 94.098% ( 250, 380 ] 3 0.984% 95.082% ( 380, 580 ] 3 0.984% 96.066% ( 870, 1300 ] 2 0.656% 96.721% ( 1300, 1900 ] 5 1.639% 98.361% ( 1900, 2900 ] 2 0.656% 99.016% ( 2900, 4400 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 557.6000 StdDev: 546.52 Min: 58 Median: 250.0000 Max: 1763 Percentiles: P50: 250.00 P75: 870.00 P99: 1763.00 P99.9: 1763.00 P99.99: 1763.00 ------------------------------------------------------ ( 51, 76 ] 3 15.000% 15.000% ### ( 76, 110 ] 2 10.000% 25.000% ## ( 110, 170 ] 1 5.000% 30.000% # ( 170, 250 ] 4 20.000% 50.000% #### ( 250, 380 ] 1 5.000% 55.000% # ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 3 15.000% 75.000% ### ( 870, 1300 ] 2 10.000% 85.000% ## ( 1300, 1900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 9.0 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 327.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.845 H:M:S, 9.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 345.90 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.183 H:M:S, 6.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/20-10:59:44 ... thread 0: (1000000,4000000) ops and (326696.6,336075.5) ops/second in (3.060944,11.902088) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/12 2.34 GB 44.1 2.1 0.0 2.1 5.8 3.7 0.0 1.6 116.0 320.6 18.46 17.17 62 0.298 2174K 2185 0.0 0.0 L1 5/5 459.69 MB 0.0 1.2 1.2 0.0 1.2 1.2 0.2 1.0 243.2 242.4 4.92 4.77 2 2.460 1214K 4018 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.9 1.5 247.1 247.0 0.78 0.75 2 0.391 196K 101 0.0 0.0 L3 21/0 912.06 MB 0.9 1.5 0.7 0.8 1.5 0.7 0.3 2.1 228.4 227.8 6.90 6.34 4 1.725 1600K 4299 0.0 0.0 L4 169/0 9.53 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 137.1 137.2 1.23 0.88 1 1.226 170K 0 0.0 0.0 L5 1076/0 86.62 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1287/17 99.82 GB 0.0 5.2 2.2 3.0 8.8 5.9 3.1 2.4 163.4 280.1 32.29 29.90 71 0.455 5357K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.2 2.2 3.0 8.8 5.9 3.0 2.4 163.4 280.1 32.29 29.90 71 0.455 5357K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.2 2.2 3.0 5.1 2.2 0.0 0.0 242.7 242.2 21.74 20.46 17 1.279 5357K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 358.3 10.55 9.44 54 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.83 GB write, 748.57 MB/s write, 5.15 GB read, 436.65 MB/s read, 32.3 seconds Interval compaction: 8.83 GB write, 759.83 MB/s write, 5.15 GB read, 443.22 MB/s read, 32.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1083662 Average: 2.2317 StdDev: 7.08 Min: 0 Median: 1.5221 Max: 1795 Percentiles: P50: 1.52 P75: 1.90 P99: 5.75 P99.9: 10.46 P99.99: 14.72 ------------------------------------------------------ [ 0, 1 ] 171168 15.795% 15.795% ### ( 1, 2 ] 710002 65.519% 81.314% ############# ( 2, 3 ] 125048 11.539% 92.853% ## ( 3, 4 ] 44885 4.142% 96.995% # ( 4, 6 ] 24817 2.290% 99.286% ( 6, 10 ] 6554 0.605% 99.890% ( 10, 15 ] 1144 0.106% 99.996% ( 15, 22 ] 77 0.007% 100.003% ( 22, 34 ] 20 0.002% 100.005% ( 34, 51 ] 1 0.000% 100.005% ( 51, 76 ] 6 0.001% 100.006% ( 76, 110 ] 4 0.000% 100.006% ( 110, 170 ] 3 0.000% 100.006% ( 170, 250 ] 59 0.005% 100.012% ( 250, 380 ] 24 0.002% 100.014% ( 380, 580 ] 43 0.004% 100.018% ( 580, 870 ] 18 0.002% 100.019% ( 870, 1300 ] 12 0.001% 100.021% ( 1300, 1900 ] 7 0.001% 100.021% ** Level 1 read latency histogram (micros): Count: 203500 Average: 2.6980 StdDev: 12.38 Min: 0 Median: 1.6479 Max: 2574 Percentiles: P50: 1.65 P75: 2.14 P99: 8.04 P99.9: 31.00 P99.99: 358.83 ------------------------------------------------------ [ 0, 1 ] 16109 7.916% 7.916% ## ( 1, 2 ] 132176 64.951% 72.867% ############# ( 2, 3 ] 32068 15.758% 88.626% ### ( 3, 4 ] 11610 5.705% 94.331% # ( 4, 6 ] 8166 4.013% 98.343% # ( 6, 10 ] 2621 1.288% 99.631% ( 10, 15 ] 493 0.242% 99.874% ( 15, 22 ] 46 0.023% 99.896% ( 22, 34 ] 10 0.005% 99.901% ( 34, 51 ] 3 0.001% 99.903% ( 51, 76 ] 52 0.026% 99.928% ( 76, 110 ] 15 0.007% 99.936% ( 110, 170 ] 34 0.017% 99.952% ( 170, 250 ] 44 0.022% 99.974% ( 250, 380 ] 39 0.019% 99.993% ( 380, 580 ] 25 0.012% 100.005% ( 580, 870 ] 6 0.003% 100.008% ( 870, 1300 ] 3 0.001% 100.010% ( 1300, 1900 ] 1 0.000% 100.010% ( 1900, 2900 ] 2 0.001% 100.011% ** Level 2 read latency histogram (micros): Count: 49096 Average: 2.2935 StdDev: 4.37 Min: 0 Median: 1.5611 Max: 703 Percentiles: P50: 1.56 P75: 1.94 P99: 6.69 P99.9: 13.57 P99.99: 34.77 ------------------------------------------------------ [ 0, 1 ] 6245 12.720% 12.720% ### ( 1, 2 ] 32619 66.439% 79.159% ############# ( 2, 3 ] 6042 12.307% 91.466% ## ( 3, 4 ] 2321 4.727% 96.193% # ( 4, 6 ] 1304 2.656% 98.849% # ( 6, 10 ] 431 0.878% 99.727% ( 10, 15 ] 119 0.242% 99.969% ( 15, 22 ] 7 0.014% 99.984% ( 22, 34 ] 3 0.006% 99.990% ( 34, 51 ] 2 0.004% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 380, 580 ] 2 0.004% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 191556 Average: 4.1832 StdDev: 42.76 Min: 1 Median: 1.6547 Max: 4727 Percentiles: P50: 1.65 P75: 2.24 P99: 9.65 P99.9: 341.56 P99.99: 609.46 ------------------------------------------------------ [ 0, 1 ] 19950 10.415% 10.415% ## ( 1, 2 ] 115819 60.462% 70.877% ############ ( 2, 3 ] 32912 17.181% 88.058% ### ( 3, 4 ] 10908 5.694% 93.753% # ( 4, 6 ] 6867 3.585% 97.338% # ( 6, 10 ] 3486 1.820% 99.157% ( 10, 15 ] 484 0.253% 99.410% ( 15, 22 ] 82 0.043% 99.453% ( 22, 34 ] 77 0.040% 99.493% ( 34, 51 ] 11 0.006% 99.499% ( 51, 76 ] 160 0.084% 99.582% ( 76, 110 ] 65 0.034% 99.616% ( 110, 170 ] 146 0.076% 99.693% ( 170, 250 ] 227 0.119% 99.811% ( 250, 380 ] 242 0.126% 99.937% ( 380, 580 ] 98 0.051% 99.989% ( 580, 870 ] 28 0.015% 100.003% ( 870, 1300 ] 12 0.006% 100.009% ( 1300, 1900 ] 18 0.009% 100.019% ( 1900, 2900 ] 15 0.008% 100.027% ( 2900, 4400 ] 6 0.003% 100.030% ( 4400, 6600 ] 3 0.002% 100.031% ** Level 4 read latency histogram (micros): Count: 305 Average: 98.0689 StdDev: 464.13 Min: 0 Median: 1.6167 Max: 4317 Percentiles: P50: 1.62 P75: 3.99 P99: 2875.00 P99.9: 4247.50 P99.99: 4317.00 ------------------------------------------------------ [ 0, 1 ] 97 31.803% 31.803% ###### ( 1, 2 ] 90 29.508% 61.311% ###### ( 2, 3 ] 24 7.869% 69.180% ## ( 3, 4 ] 18 5.902% 75.082% # ( 4, 6 ] 8 2.623% 77.705% # ( 6, 10 ] 31 10.164% 87.869% ## ( 10, 15 ] 13 4.262% 92.131% # ( 15, 22 ] 1 0.328% 92.459% ( 51, 76 ] 1 0.328% 92.787% ( 76, 110 ] 2 0.656% 93.443% ( 170, 250 ] 2 0.656% 94.098% ( 250, 380 ] 3 0.984% 95.082% ( 380, 580 ] 3 0.984% 96.066% ( 870, 1300 ] 2 0.656% 96.721% ( 1300, 1900 ] 5 1.639% 98.361% ( 1900, 2900 ] 2 0.656% 99.016% ( 2900, 4400 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 616.6167 StdDev: 585.81 Min: 55 Median: 402.2222 Max: 2086 Percentiles: P50: 402.22 P75: 941.67 P99: 2086.00 P99.9: 2086.00 P99.99: 2086.00 ------------------------------------------------------ ( 51, 76 ] 6 10.000% 10.000% ## ( 76, 110 ] 4 6.667% 16.667% # ( 110, 170 ] 6 10.000% 26.667% ## ( 170, 250 ] 7 11.667% 38.333% ## ( 250, 380 ] 6 10.000% 48.333% ## ( 380, 580 ] 9 15.000% 63.333% ### ( 580, 870 ] 6 10.000% 73.333% ## ( 870, 1300 ] 6 10.000% 83.333% ## ( 1300, 1900 ] 8 13.333% 96.667% ### ( 1900, 2900 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 325.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.232 H:M:S, 10.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.387 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-10:59:48 ... thread 0: (1000000,5000000) ops and (280211.3,323189.0) ops/second in (3.568735,15.470823) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 3.32 GB 151.0 3.2 0.0 3.2 7.9 4.7 0.0 1.7 129.2 317.9 25.35 23.70 80 0.317 3326K 3370 0.0 0.0 L1 5/5 459.69 MB 0.0 1.2 1.2 0.0 1.2 1.2 0.2 1.0 243.2 242.4 4.92 4.77 2 2.460 1214K 4018 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.9 1.5 247.1 247.0 0.78 0.75 2 0.391 196K 101 0.0 0.0 L3 21/0 912.06 MB 0.9 1.5 0.7 0.8 1.5 0.7 0.3 2.1 228.4 227.8 6.90 6.34 4 1.725 1600K 4299 0.0 0.0 L4 169/0 9.53 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 137.1 137.2 1.23 0.88 1 1.226 170K 0 0.0 0.0 L5 1076/0 86.62 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1289/17 100.80 GB 0.0 6.3 2.2 4.1 10.9 6.9 3.1 2.3 163.6 285.5 39.18 36.43 89 0.440 6508K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.3 2.2 4.1 10.9 6.9 3.0 2.3 163.6 285.5 39.18 36.43 89 0.440 6508K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.3 2.2 4.1 6.2 2.2 0.0 0.0 247.7 247.2 25.88 24.52 21 1.232 6508K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 359.9 13.30 11.91 68 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.7 total, 15.5 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.92 GB write, 714.65 MB/s write, 6.26 GB read, 409.54 MB/s read, 39.2 seconds Interval compaction: 10.92 GB write, 722.92 MB/s write, 6.26 GB read, 414.28 MB/s read, 39.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 12, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1527940 Average: 2.2561 StdDev: 7.35 Min: 0 Median: 1.5242 Max: 1795 Percentiles: P50: 1.52 P75: 1.90 P99: 5.82 P99.9: 11.16 P99.99: 18.42 ------------------------------------------------------ [ 0, 1 ] 235195 15.393% 15.393% ### ( 1, 2 ] 1008689 66.016% 81.409% ############# ( 2, 3 ] 175067 11.458% 92.867% ## ( 3, 4 ] 62352 4.081% 96.948% # ( 4, 6 ] 34502 2.258% 99.206% ( 6, 10 ] 10209 0.668% 99.874% ( 10, 15 ] 1721 0.113% 99.987% ( 15, 22 ] 111 0.007% 99.994% ( 22, 34 ] 28 0.002% 99.996% ( 34, 51 ] 3 0.000% 99.996% ( 51, 76 ] 58 0.004% 100.000% ( 76, 110 ] 33 0.002% 100.002% ( 110, 170 ] 49 0.003% 100.005% ( 170, 250 ] 127 0.008% 100.013% ( 250, 380 ] 55 0.004% 100.017% ( 380, 580 ] 67 0.004% 100.021% ( 580, 870 ] 23 0.002% 100.023% ( 870, 1300 ] 21 0.001% 100.024% ( 1300, 1900 ] 9 0.001% 100.025% ** Level 1 read latency histogram (micros): Count: 255626 Average: 2.7041 StdDev: 12.78 Min: 0 Median: 1.6284 Max: 2574 Percentiles: P50: 1.63 P75: 2.04 P99: 8.08 P99.9: 71.65 P99.99: 374.54 ------------------------------------------------------ [ 0, 1 ] 22464 8.788% 8.788% ## ( 1, 2 ] 167642 65.581% 74.369% ############# ( 2, 3 ] 38246 14.962% 89.331% ### ( 3, 4 ] 13525 5.291% 94.621% # ( 4, 6 ] 9429 3.689% 98.310% # ( 6, 10 ] 3392 1.327% 99.637% ( 10, 15 ] 542 0.212% 99.849% ( 15, 22 ] 48 0.019% 99.868% ( 22, 34 ] 11 0.004% 99.872% ( 34, 51 ] 3 0.001% 99.873% ( 51, 76 ] 84 0.033% 99.906% ( 76, 110 ] 25 0.010% 99.916% ( 110, 170 ] 60 0.023% 99.939% ( 170, 250 ] 72 0.028% 99.968% ( 250, 380 ] 61 0.024% 99.991% ( 380, 580 ] 31 0.012% 100.004% ( 580, 870 ] 7 0.003% 100.006% ( 870, 1300 ] 3 0.001% 100.007% ( 1300, 1900 ] 3 0.001% 100.009% ( 1900, 2900 ] 2 0.001% 100.009% ** Level 2 read latency histogram (micros): Count: 49096 Average: 2.2935 StdDev: 4.37 Min: 0 Median: 1.5611 Max: 703 Percentiles: P50: 1.56 P75: 1.94 P99: 6.69 P99.9: 13.57 P99.99: 34.77 ------------------------------------------------------ [ 0, 1 ] 6245 12.720% 12.720% ### ( 1, 2 ] 32619 66.439% 79.159% ############# ( 2, 3 ] 6042 12.307% 91.466% ## ( 3, 4 ] 2321 4.727% 96.193% # ( 4, 6 ] 1304 2.656% 98.849% # ( 6, 10 ] 431 0.878% 99.727% ( 10, 15 ] 119 0.242% 99.969% ( 15, 22 ] 7 0.014% 99.984% ( 22, 34 ] 3 0.006% 99.990% ( 34, 51 ] 2 0.004% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 380, 580 ] 2 0.004% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 191556 Average: 4.1832 StdDev: 42.76 Min: 1 Median: 1.6547 Max: 4727 Percentiles: P50: 1.65 P75: 2.24 P99: 9.65 P99.9: 341.56 P99.99: 609.46 ------------------------------------------------------ [ 0, 1 ] 19950 10.415% 10.415% ## ( 1, 2 ] 115819 60.462% 70.877% ############ ( 2, 3 ] 32912 17.181% 88.058% ### ( 3, 4 ] 10908 5.694% 93.753% # ( 4, 6 ] 6867 3.585% 97.338% # ( 6, 10 ] 3486 1.820% 99.157% ( 10, 15 ] 484 0.253% 99.410% ( 15, 22 ] 82 0.043% 99.453% ( 22, 34 ] 77 0.040% 99.493% ( 34, 51 ] 11 0.006% 99.499% ( 51, 76 ] 160 0.084% 99.582% ( 76, 110 ] 65 0.034% 99.616% ( 110, 170 ] 146 0.076% 99.693% ( 170, 250 ] 227 0.119% 99.811% ( 250, 380 ] 242 0.126% 99.937% ( 380, 580 ] 98 0.051% 99.989% ( 580, 870 ] 28 0.015% 100.003% ( 870, 1300 ] 12 0.006% 100.009% ( 1300, 1900 ] 18 0.009% 100.019% ( 1900, 2900 ] 15 0.008% 100.027% ( 2900, 4400 ] 6 0.003% 100.030% ( 4400, 6600 ] 3 0.002% 100.031% ** Level 4 read latency histogram (micros): Count: 305 Average: 98.0689 StdDev: 464.13 Min: 0 Median: 1.6167 Max: 4317 Percentiles: P50: 1.62 P75: 3.99 P99: 2875.00 P99.9: 4247.50 P99.99: 4317.00 ------------------------------------------------------ [ 0, 1 ] 97 31.803% 31.803% ###### ( 1, 2 ] 90 29.508% 61.311% ###### ( 2, 3 ] 24 7.869% 69.180% ## ( 3, 4 ] 18 5.902% 75.082% # ( 4, 6 ] 8 2.623% 77.705% # ( 6, 10 ] 31 10.164% 87.869% ## ( 10, 15 ] 13 4.262% 92.131% # ( 15, 22 ] 1 0.328% 92.459% ( 51, 76 ] 1 0.328% 92.787% ( 76, 110 ] 2 0.656% 93.443% ( 170, 250 ] 2 0.656% 94.098% ( 250, 380 ] 3 0.984% 95.082% ( 380, 580 ] 3 0.984% 96.066% ( 870, 1300 ] 2 0.656% 96.721% ( 1300, 1900 ] 5 1.639% 98.361% ( 1900, 2900 ] 2 0.656% 99.016% ( 2900, 4400 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 616.6167 StdDev: 585.81 Min: 55 Median: 402.2222 Max: 2086 Percentiles: P50: 402.22 P75: 941.67 P99: 2086.00 P99.9: 2086.00 P99.99: 2086.00 ------------------------------------------------------ ( 51, 76 ] 6 10.000% 10.000% ## ( 76, 110 ] 4 6.667% 16.667% # ( 110, 170 ] 6 10.000% 26.667% ## ( 170, 250 ] 7 11.667% 38.333% ## ( 250, 380 ] 6 10.000% 48.333% ## ( 380, 580 ] 9 15.000% 63.333% ### ( 580, 870 ] 6 10.000% 73.333% ## ( 870, 1300 ] 6 10.000% 83.333% ## ( 1300, 1900 ] 8 13.333% 96.667% ### ( 1900, 2900 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 15.7 total, 3.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 314.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.154 H:M:S, 13.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 275.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.921 H:M:S, 25.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-10:59:52 ... thread 0: (1000000,6000000) ops and (231741.2,303245.0) ops/second in (4.315159,19.785982) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/14 2.64 GB 12.6 3.9 0.0 3.9 9.5 5.6 0.0 1.7 131.2 317.7 30.72 28.75 98 0.313 4093K 4103 0.0 0.0 L1 17/17 2.03 GB 0.0 3.2 2.8 0.4 3.2 2.7 0.2 1.2 241.0 239.3 13.66 13.20 3 4.554 3343K 23K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.9 1.5 247.1 247.0 0.78 0.75 2 0.391 196K 101 0.0 0.0 L3 21/0 912.06 MB 0.9 1.5 0.7 0.8 1.5 0.7 0.3 2.1 228.4 227.8 6.90 6.34 4 1.725 1600K 4299 0.0 0.0 L4 169/0 9.53 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 137.1 137.2 1.23 0.88 1 1.226 170K 0 0.0 0.0 L5 1076/0 86.62 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1299/31 101.70 GB 0.0 9.0 3.8 5.3 14.6 9.4 3.1 2.6 173.8 280.8 53.29 49.91 108 0.493 9405K 31K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.0 3.8 5.3 14.6 9.4 3.0 2.6 173.8 280.8 53.29 49.91 108 0.493 9405K 31K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.0 3.8 5.3 9.0 3.8 0.0 0.0 247.7 246.8 37.39 35.65 25 1.496 9405K 31K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 360.5 15.90 14.26 83 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.0 total, 19.8 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.61 GB write, 749.36 MB/s write, 9.04 GB read, 463.87 MB/s read, 53.3 seconds Interval compaction: 14.61 GB write, 756.14 MB/s write, 9.04 GB read, 468.07 MB/s read, 53.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 12, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1875983 Average: 2.2532 StdDev: 7.50 Min: 0 Median: 1.5098 Max: 1795 Percentiles: P50: 1.51 P75: 1.89 P99: 5.81 P99.9: 11.91 P99.99: 117.22 ------------------------------------------------------ [ 0, 1 ] 306370 16.331% 16.331% ### ( 1, 2 ] 1238981 66.044% 82.376% ############# ( 2, 3 ] 203936 10.871% 93.246% ## ( 3, 4 ] 72414 3.860% 97.106% # ( 4, 6 ] 39220 2.091% 99.197% ( 6, 10 ] 12420 0.662% 99.859% ( 10, 15 ] 2005 0.107% 99.966% ( 15, 22 ] 152 0.008% 99.974% ( 22, 34 ] 37 0.002% 99.976% ( 34, 51 ] 3 0.000% 99.976% ( 51, 76 ] 157 0.008% 99.985% ( 76, 110 ] 82 0.004% 99.989% ( 110, 170 ] 153 0.008% 99.997% ( 170, 250 ] 207 0.011% 100.008% ( 250, 380 ] 93 0.005% 100.013% ( 380, 580 ] 91 0.005% 100.018% ( 580, 870 ] 36 0.002% 100.020% ( 870, 1300 ] 22 0.001% 100.021% ( 1300, 1900 ] 9 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 352635 Average: 2.6653 StdDev: 13.25 Min: 0 Median: 1.5742 Max: 2574 Percentiles: P50: 1.57 P75: 1.96 P99: 7.96 P99.9: 124.93 P99.99: 470.94 ------------------------------------------------------ [ 0, 1 ] 44501 12.620% 12.620% ### ( 1, 2 ] 229549 65.095% 77.715% ############# ( 2, 3 ] 45599 12.931% 90.646% ### ( 3, 4 ] 16234 4.604% 95.249% # ( 4, 6 ] 11039 3.130% 98.380% # ( 6, 10 ] 4455 1.263% 99.643% ( 10, 15 ] 627 0.178% 99.821% ( 15, 22 ] 55 0.016% 99.837% ( 22, 34 ] 11 0.003% 99.840% ( 34, 51 ] 4 0.001% 99.841% ( 51, 76 ] 137 0.039% 99.880% ( 76, 110 ] 43 0.012% 99.892% ( 110, 170 ] 114 0.032% 99.924% ( 170, 250 ] 119 0.034% 99.958% ( 250, 380 ] 85 0.024% 99.982% ( 380, 580 ] 61 0.017% 99.999% ( 580, 870 ] 14 0.004% 100.003% ( 870, 1300 ] 5 0.001% 100.005% ( 1300, 1900 ] 4 0.001% 100.006% ( 1900, 2900 ] 2 0.001% 100.007% ** Level 2 read latency histogram (micros): Count: 49096 Average: 2.2935 StdDev: 4.37 Min: 0 Median: 1.5611 Max: 703 Percentiles: P50: 1.56 P75: 1.94 P99: 6.69 P99.9: 13.57 P99.99: 34.77 ------------------------------------------------------ [ 0, 1 ] 6245 12.720% 12.720% ### ( 1, 2 ] 32619 66.439% 79.159% ############# ( 2, 3 ] 6042 12.307% 91.466% ## ( 3, 4 ] 2321 4.727% 96.193% # ( 4, 6 ] 1304 2.656% 98.849% # ( 6, 10 ] 431 0.878% 99.727% ( 10, 15 ] 119 0.242% 99.969% ( 15, 22 ] 7 0.014% 99.984% ( 22, 34 ] 3 0.006% 99.990% ( 34, 51 ] 2 0.004% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 380, 580 ] 2 0.004% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 191556 Average: 4.1832 StdDev: 42.76 Min: 1 Median: 1.6547 Max: 4727 Percentiles: P50: 1.65 P75: 2.24 P99: 9.65 P99.9: 341.56 P99.99: 609.46 ------------------------------------------------------ [ 0, 1 ] 19950 10.415% 10.415% ## ( 1, 2 ] 115819 60.462% 70.877% ############ ( 2, 3 ] 32912 17.181% 88.058% ### ( 3, 4 ] 10908 5.694% 93.753% # ( 4, 6 ] 6867 3.585% 97.338% # ( 6, 10 ] 3486 1.820% 99.157% ( 10, 15 ] 484 0.253% 99.410% ( 15, 22 ] 82 0.043% 99.453% ( 22, 34 ] 77 0.040% 99.493% ( 34, 51 ] 11 0.006% 99.499% ( 51, 76 ] 160 0.084% 99.582% ( 76, 110 ] 65 0.034% 99.616% ( 110, 170 ] 146 0.076% 99.693% ( 170, 250 ] 227 0.119% 99.811% ( 250, 380 ] 242 0.126% 99.937% ( 380, 580 ] 98 0.051% 99.989% ( 580, 870 ] 28 0.015% 100.003% ( 870, 1300 ] 12 0.006% 100.009% ( 1300, 1900 ] 18 0.009% 100.019% ( 1900, 2900 ] 15 0.008% 100.027% ( 2900, 4400 ] 6 0.003% 100.030% ( 4400, 6600 ] 3 0.002% 100.031% ** Level 4 read latency histogram (micros): Count: 305 Average: 98.0689 StdDev: 464.13 Min: 0 Median: 1.6167 Max: 4317 Percentiles: P50: 1.62 P75: 3.99 P99: 2875.00 P99.9: 4247.50 P99.99: 4317.00 ------------------------------------------------------ [ 0, 1 ] 97 31.803% 31.803% ###### ( 1, 2 ] 90 29.508% 61.311% ###### ( 2, 3 ] 24 7.869% 69.180% ## ( 3, 4 ] 18 5.902% 75.082% # ( 4, 6 ] 8 2.623% 77.705% # ( 6, 10 ] 31 10.164% 87.869% ## ( 10, 15 ] 13 4.262% 92.131% # ( 15, 22 ] 1 0.328% 92.459% ( 51, 76 ] 1 0.328% 92.787% ( 76, 110 ] 2 0.656% 93.443% ( 170, 250 ] 2 0.656% 94.098% ( 250, 380 ] 3 0.984% 95.082% ( 380, 580 ] 3 0.984% 96.066% ( 870, 1300 ] 2 0.656% 96.721% ( 1300, 1900 ] 5 1.639% 98.361% ( 1900, 2900 ] 2 0.656% 99.016% ( 2900, 4400 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 616.6167 StdDev: 585.81 Min: 55 Median: 402.2222 Max: 2086 Percentiles: P50: 402.22 P75: 941.67 P99: 2086.00 P99.9: 2086.00 P99.99: 2086.00 ------------------------------------------------------ ( 51, 76 ] 6 10.000% 10.000% ## ( 76, 110 ] 4 6.667% 16.667% # ( 110, 170 ] 6 10.000% 26.667% ## ( 170, 250 ] 7 11.667% 38.333% ## ( 250, 380 ] 6 10.000% 48.333% ## ( 380, 580 ] 9 15.000% 63.333% ### ( 580, 870 ] 6 10.000% 73.333% ## ( 870, 1300 ] 6 10.000% 83.333% ## ( 1300, 1900 ] 8 13.333% 96.667% ### ( 1900, 2900 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 20.0 total, 4.3 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 295.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.850 H:M:S, 19.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 228.08 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.697 H:M:S, 39.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-10:59:56 ... thread 0: (1000000,7000000) ops and (267695.5,297599.2) ops/second in (3.735588,23.521570) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 3.69 GB 119.6 5.0 0.0 5.0 11.6 6.6 0.0 1.7 136.1 317.4 37.50 35.17 117 0.320 5181K 5237 0.0 0.0 L1 17/17 2.03 GB 0.0 3.2 2.8 0.4 3.2 2.7 0.2 1.2 241.0 239.3 13.66 13.20 3 4.554 3343K 23K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.9 1.5 247.1 247.0 0.78 0.75 2 0.391 196K 101 0.0 0.0 L3 21/0 912.06 MB 0.9 1.5 0.7 0.8 1.5 0.7 0.3 2.1 228.4 227.8 6.90 6.34 4 1.725 1600K 4299 0.0 0.0 L4 169/0 9.53 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 137.1 137.2 1.23 0.88 1 1.226 170K 0 0.0 0.0 L5 1076/0 86.62 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1302/31 102.75 GB 0.0 10.1 3.8 6.3 16.7 10.4 3.1 2.5 172.0 284.7 60.07 56.32 127 0.473 10M 32K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.1 3.8 6.3 16.7 10.4 3.0 2.5 172.0 284.7 60.07 56.32 127 0.473 10M 32K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.1 3.8 6.3 10.1 3.8 0.0 0.0 250.4 249.6 41.26 39.44 29 1.423 10M 32K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 361.7 18.81 16.89 98 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.7 total, 23.5 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.70 GB write, 721.57 MB/s write, 10.09 GB read, 435.95 MB/s read, 60.1 seconds Interval compaction: 16.70 GB write, 727.06 MB/s write, 10.09 GB read, 439.26 MB/s read, 60.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 15, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2238719 Average: 2.2435 StdDev: 7.43 Min: 0 Median: 1.5073 Max: 1795 Percentiles: P50: 1.51 P75: 1.88 P99: 5.80 P99.9: 11.91 P99.99: 122.83 ------------------------------------------------------ [ 0, 1 ] 367409 16.412% 16.412% ### ( 1, 2 ] 1482265 66.210% 82.622% ############# ( 2, 3 ] 241910 10.806% 93.428% ## ( 3, 4 ] 84709 3.784% 97.212% # ( 4, 6 ] 44528 1.989% 99.201% ( 6, 10 ] 14745 0.659% 99.859% ( 10, 15 ] 2400 0.107% 99.966% ( 15, 22 ] 180 0.008% 99.974% ( 22, 34 ] 44 0.002% 99.976% ( 34, 51 ] 5 0.000% 99.977% ( 51, 76 ] 176 0.008% 99.984% ( 76, 110 ] 90 0.004% 99.988% ( 110, 170 ] 169 0.008% 99.996% ( 170, 250 ] 241 0.011% 100.007% ( 250, 380 ] 104 0.005% 100.011% ( 380, 580 ] 105 0.005% 100.016% ( 580, 870 ] 45 0.002% 100.018% ( 870, 1300 ] 28 0.001% 100.019% ( 1300, 1900 ] 9 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 442249 Average: 2.6399 StdDev: 12.67 Min: 0 Median: 1.5613 Max: 2574 Percentiles: P50: 1.56 P75: 1.94 P99: 8.05 P99.9: 128.57 P99.99: 458.11 ------------------------------------------------------ [ 0, 1 ] 58648 13.261% 13.261% ### ( 1, 2 ] 289486 65.458% 78.719% ############# ( 2, 3 ] 54819 12.396% 91.115% ## ( 3, 4 ] 19190 4.339% 95.454% # ( 4, 6 ] 12687 2.869% 98.322% # ( 6, 10 ] 5847 1.322% 99.645% ( 10, 15 ] 681 0.154% 99.799% ( 15, 22 ] 59 0.013% 99.812% ( 22, 34 ] 11 0.002% 99.814% ( 34, 51 ] 4 0.001% 99.815% ( 51, 76 ] 235 0.053% 99.868% ( 76, 110 ] 89 0.020% 99.889% ( 110, 170 ] 164 0.037% 99.926% ( 170, 250 ] 156 0.035% 99.961% ( 250, 380 ] 103 0.023% 99.984% ( 380, 580 ] 66 0.015% 99.999% ( 580, 870 ] 15 0.003% 100.002% ( 870, 1300 ] 5 0.001% 100.004% ( 1300, 1900 ] 5 0.001% 100.005% ( 1900, 2900 ] 2 0.000% 100.005% ** Level 2 read latency histogram (micros): Count: 49096 Average: 2.2935 StdDev: 4.37 Min: 0 Median: 1.5611 Max: 703 Percentiles: P50: 1.56 P75: 1.94 P99: 6.69 P99.9: 13.57 P99.99: 34.77 ------------------------------------------------------ [ 0, 1 ] 6245 12.720% 12.720% ### ( 1, 2 ] 32619 66.439% 79.159% ############# ( 2, 3 ] 6042 12.307% 91.466% ## ( 3, 4 ] 2321 4.727% 96.193% # ( 4, 6 ] 1304 2.656% 98.849% # ( 6, 10 ] 431 0.878% 99.727% ( 10, 15 ] 119 0.242% 99.969% ( 15, 22 ] 7 0.014% 99.984% ( 22, 34 ] 3 0.006% 99.990% ( 34, 51 ] 2 0.004% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 380, 580 ] 2 0.004% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 191556 Average: 4.1832 StdDev: 42.76 Min: 1 Median: 1.6547 Max: 4727 Percentiles: P50: 1.65 P75: 2.24 P99: 9.65 P99.9: 341.56 P99.99: 609.46 ------------------------------------------------------ [ 0, 1 ] 19950 10.415% 10.415% ## ( 1, 2 ] 115819 60.462% 70.877% ############ ( 2, 3 ] 32912 17.181% 88.058% ### ( 3, 4 ] 10908 5.694% 93.753% # ( 4, 6 ] 6867 3.585% 97.338% # ( 6, 10 ] 3486 1.820% 99.157% ( 10, 15 ] 484 0.253% 99.410% ( 15, 22 ] 82 0.043% 99.453% ( 22, 34 ] 77 0.040% 99.493% ( 34, 51 ] 11 0.006% 99.499% ( 51, 76 ] 160 0.084% 99.582% ( 76, 110 ] 65 0.034% 99.616% ( 110, 170 ] 146 0.076% 99.693% ( 170, 250 ] 227 0.119% 99.811% ( 250, 380 ] 242 0.126% 99.937% ( 380, 580 ] 98 0.051% 99.989% ( 580, 870 ] 28 0.015% 100.003% ( 870, 1300 ] 12 0.006% 100.009% ( 1300, 1900 ] 18 0.009% 100.019% ( 1900, 2900 ] 15 0.008% 100.027% ( 2900, 4400 ] 6 0.003% 100.030% ( 4400, 6600 ] 3 0.002% 100.031% ** Level 4 read latency histogram (micros): Count: 305 Average: 98.0689 StdDev: 464.13 Min: 0 Median: 1.6167 Max: 4317 Percentiles: P50: 1.62 P75: 3.99 P99: 2875.00 P99.9: 4247.50 P99.99: 4317.00 ------------------------------------------------------ [ 0, 1 ] 97 31.803% 31.803% ###### ( 1, 2 ] 90 29.508% 61.311% ###### ( 2, 3 ] 24 7.869% 69.180% ## ( 3, 4 ] 18 5.902% 75.082% # ( 4, 6 ] 8 2.623% 77.705% # ( 6, 10 ] 31 10.164% 87.869% ## ( 10, 15 ] 13 4.262% 92.131% # ( 15, 22 ] 1 0.328% 92.459% ( 51, 76 ] 1 0.328% 92.787% ( 76, 110 ] 2 0.656% 93.443% ( 170, 250 ] 2 0.656% 94.098% ( 250, 380 ] 3 0.984% 95.082% ( 380, 580 ] 3 0.984% 96.066% ( 870, 1300 ] 2 0.656% 96.721% ( 1300, 1900 ] 5 1.639% 98.361% ( 1900, 2900 ] 2 0.656% 99.016% ( 2900, 4400 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 616.6167 StdDev: 585.81 Min: 55 Median: 402.2222 Max: 2086 Percentiles: P50: 402.22 P75: 941.67 P99: 2086.00 P99.9: 2086.00 P99.99: 2086.00 ------------------------------------------------------ ( 51, 76 ] 6 10.000% 10.000% ## ( 76, 110 ] 4 6.667% 16.667% # ( 110, 170 ] 6 10.000% 26.667% ## ( 170, 250 ] 7 11.667% 38.333% ## ( 250, 380 ] 6 10.000% 48.333% ## ( 380, 580 ] 9 15.000% 63.333% ### ( 580, 870 ] 6 10.000% 73.333% ## ( 870, 1300 ] 6 10.000% 83.333% ## ( 1300, 1900 ] 8 13.333% 96.667% ### ( 1900, 2900 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 23.7 total, 3.7 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 290.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.919 H:M:S, 20.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 263.46 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.069 H:M:S, 28.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-11:00:17 ... thread 0: (1000000,8000000) ops and (47209.7,178956.3) ops/second in (21.182076,44.703646) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/7 2.39 GB 18.9 7.1 0.0 7.1 14.7 7.6 0.0 1.9 144.6 298.8 50.54 45.82 135 0.374 7418K 14K 0.0 0.0 L1 8/8 497.84 MB 0.0 7.5 5.0 2.5 7.4 4.9 0.2 1.5 230.0 227.1 33.46 31.25 4 8.366 7817K 97K 0.0 0.0 L2 9/9 1.13 GB 0.0 0.2 0.1 0.1 0.2 0.1 4.6 1.5 247.1 247.0 0.78 0.75 2 0.391 196K 101 0.0 0.0 L3 21/3 1.12 GB 1.0 4.8 3.3 1.4 4.8 3.3 0.3 1.4 150.4 149.5 32.58 21.42 16 2.036 4529K 28K 0.0 0.0 L4 172/0 9.61 GB 1.0 2.6 2.5 0.1 2.6 2.5 0.8 1.0 143.0 142.8 18.46 11.85 31 0.596 2631K 1997 0.0 0.0 L5 1104/0 88.89 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1323/27 103.62 GB 0.0 22.2 11.0 11.2 29.7 18.5 9.2 3.9 167.4 223.8 135.83 111.09 188 0.723 22M 142K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.2 11.0 11.2 29.7 18.5 9.1 3.9 167.4 223.8 135.83 111.09 188 0.723 22M 142K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.2 11.0 11.2 22.1 10.9 0.0 0.0 200.6 199.3 113.39 91.67 76 1.492 22M 142K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 348.0 22.45 19.42 112 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 44.9 total, 44.7 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.69 GB write, 677.39 MB/s write, 22.21 GB read, 506.63 MB/s read, 135.8 seconds Interval compaction: 29.69 GB write, 680.10 MB/s write, 22.21 GB read, 508.65 MB/s read, 135.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 27, pending-compaction-bytes-stops: 0, total-delays: 44, total-stops: 27, interval: 71 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3378476 Average: 2.8581 StdDev: 22.35 Min: 0 Median: 1.5155 Max: 10034 Percentiles: P50: 1.52 P75: 1.91 P99: 7.69 P99.9: 181.66 P99.99: 369.95 ------------------------------------------------------ [ 0, 1 ] 586750 17.367% 17.367% ### ( 1, 2 ] 2138573 63.300% 80.667% ############# ( 2, 3 ] 366747 10.855% 91.523% ## ( 3, 4 ] 140713 4.165% 95.688% # ( 4, 6 ] 99211 2.937% 98.624% # ( 6, 10 ] 30018 0.889% 99.513% ( 10, 15 ] 4326 0.128% 99.641% ( 15, 22 ] 420 0.012% 99.653% ( 22, 34 ] 59 0.002% 99.655% ( 34, 51 ] 39 0.001% 99.656% ( 51, 76 ] 3047 0.090% 99.746% ( 76, 110 ] 1296 0.038% 99.785% ( 110, 170 ] 3537 0.105% 99.889% ( 170, 250 ] 2514 0.074% 99.964% ( 250, 380 ] 968 0.029% 99.992% ( 380, 580 ] 451 0.013% 100.006% ( 580, 870 ] 171 0.005% 100.011% ( 870, 1300 ] 91 0.003% 100.013% ( 1300, 1900 ] 28 0.001% 100.014% ( 1900, 2900 ] 35 0.001% 100.015% ( 2900, 4400 ] 26 0.001% 100.016% ( 4400, 6600 ] 8 0.000% 100.016% ( 6600, 9900 ] 3 0.000% 100.016% ( 9900, 14000 ] 1 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 1726685 Average: 5.9582 StdDev: 101.09 Min: 0 Median: 1.7204 Max: 12057 Percentiles: P50: 1.72 P75: 2.62 P99: 9.30 P99.9: 180.78 P99.99: 462.92 ------------------------------------------------------ [ 0, 1 ] 206157 11.939% 11.939% ## ( 1, 2 ] 912204 52.830% 64.769% ########### ( 2, 3 ] 284883 16.499% 81.268% ### ( 3, 4 ] 138321 8.011% 89.279% ## ( 4, 6 ] 136706 7.917% 97.196% ## ( 6, 10 ] 37793 2.189% 99.385% ( 10, 15 ] 5720 0.331% 99.716% ( 15, 22 ] 591 0.034% 99.750% ( 22, 34 ] 46 0.003% 99.753% ( 34, 51 ] 23 0.001% 99.754% ( 51, 76 ] 1236 0.072% 99.826% ( 76, 110 ] 441 0.026% 99.852% ( 110, 170 ] 748 0.043% 99.895% ( 170, 250 ] 670 0.039% 99.934% ( 250, 380 ] 675 0.039% 99.973% ( 380, 580 ] 722 0.042% 100.015% ( 580, 870 ] 511 0.030% 100.044% ( 870, 1300 ] 346 0.020% 100.064% ( 1300, 1900 ] 158 0.009% 100.073% ( 1900, 2900 ] 323 0.019% 100.092% ( 2900, 4400 ] 500 0.029% 100.121% ( 4400, 6600 ] 179 0.010% 100.131% ( 6600, 9900 ] 50 0.003% 100.134% ( 9900, 14000 ] 4 0.000% 100.134% ** Level 2 read latency histogram (micros): Count: 49096 Average: 2.2935 StdDev: 4.37 Min: 0 Median: 1.5611 Max: 703 Percentiles: P50: 1.56 P75: 1.94 P99: 6.69 P99.9: 13.57 P99.99: 34.77 ------------------------------------------------------ [ 0, 1 ] 6245 12.720% 12.720% ### ( 1, 2 ] 32619 66.439% 79.159% ############# ( 2, 3 ] 6042 12.307% 91.466% ## ( 3, 4 ] 2321 4.727% 96.193% # ( 4, 6 ] 1304 2.656% 98.849% # ( 6, 10 ] 431 0.878% 99.727% ( 10, 15 ] 119 0.242% 99.969% ( 15, 22 ] 7 0.014% 99.984% ( 22, 34 ] 3 0.006% 99.990% ( 34, 51 ] 2 0.004% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 380, 580 ] 2 0.004% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 969258 Average: 5.0805 StdDev: 69.28 Min: 1 Median: 1.9787 Max: 11328 Percentiles: P50: 1.98 P75: 3.09 P99: 9.22 P99.9: 54.82 P99.99: 249.37 ------------------------------------------------------ [ 0, 1 ] 25976 2.680% 2.680% # ( 1, 2 ] 468644 48.351% 51.031% ########## ( 2, 3 ] 222653 22.971% 74.002% ##### ( 3, 4 ] 113751 11.736% 85.738% ## ( 4, 6 ] 110300 11.380% 97.118% ## ( 6, 10 ] 22674 2.339% 99.457% ( 10, 15 ] 3815 0.394% 99.851% ( 15, 22 ] 320 0.033% 99.884% ( 22, 34 ] 100 0.010% 99.894% ( 34, 51 ] 26 0.003% 99.897% ( 51, 76 ] 201 0.021% 99.918% ( 76, 110 ] 102 0.011% 99.928% ( 110, 170 ] 231 0.024% 99.952% ( 170, 250 ] 372 0.038% 99.990% ( 250, 380 ] 547 0.056% 100.047% ( 380, 580 ] 443 0.046% 100.093% ( 580, 870 ] 297 0.031% 100.123% ( 870, 1300 ] 201 0.021% 100.144% ( 1300, 1900 ] 105 0.011% 100.155% ( 1900, 2900 ] 99 0.010% 100.165% ( 2900, 4400 ] 131 0.014% 100.178% ( 4400, 6600 ] 33 0.003% 100.182% ( 6600, 9900 ] 10 0.001% 100.183% ( 9900, 14000 ] 1 0.000% 100.183% ** Level 4 read latency histogram (micros): Count: 23267 Average: 92.5150 StdDev: 417.26 Min: 0 Median: 2.1766 Max: 9970 Percentiles: P50: 2.18 P75: 3.52 P99: 2126.50 P99.9: 4929.02 P99.99: 6574.33 ------------------------------------------------------ [ 0, 1 ] 484 2.080% 2.080% ( 1, 2 ] 10220 43.925% 46.005% ######### ( 2, 3 ] 5263 22.620% 68.625% ##### ( 3, 4 ] 2874 12.352% 80.977% ## ( 4, 6 ] 1698 7.298% 88.275% # ( 6, 10 ] 590 2.536% 90.811% # ( 10, 15 ] 85 0.365% 91.176% ( 15, 22 ] 7 0.030% 91.206% ( 22, 34 ] 25 0.107% 91.314% ( 34, 51 ] 2 0.009% 91.322% ( 51, 76 ] 6 0.026% 91.348% ( 76, 110 ] 5 0.021% 91.370% ( 110, 170 ] 25 0.107% 91.477% ( 170, 250 ] 102 0.438% 91.916% ( 250, 380 ] 223 0.958% 92.874% ( 380, 580 ] 431 1.852% 94.726% ( 580, 870 ] 497 2.136% 96.863% ( 870, 1300 ] 316 1.358% 98.221% ( 1300, 1900 ] 158 0.679% 98.900% ( 1900, 2900 ] 103 0.443% 99.342% ( 2900, 4400 ] 123 0.529% 99.871% ( 4400, 6600 ] 28 0.120% 99.991% ( 6600, 9900 ] 3 0.013% 100.004% ( 9900, 14000 ] 1 0.004% 100.009% ** Level 5 read latency histogram (micros): Count: 200 Average: 937.5550 StdDev: 824.65 Min: 55 Median: 643.4375 Max: 5162 Percentiles: P50: 643.44 P75: 1356.25 P99: 4150.00 P99.9: 5162.00 P99.99: 5162.00 ------------------------------------------------------ ( 51, 76 ] 6 3.000% 3.000% # ( 76, 110 ] 4 2.000% 5.000% ( 110, 170 ] 6 3.000% 8.000% # ( 170, 250 ] 10 5.000% 13.000% # ( 250, 380 ] 28 14.000% 27.000% ### ( 380, 580 ] 39 19.500% 46.500% #### ( 580, 870 ] 32 16.000% 62.500% ### ( 870, 1300 ] 22 11.000% 73.500% ## ( 1300, 1900 ] 32 16.000% 89.500% ### ( 1900, 2900 ] 14 7.000% 96.500% # ( 2900, 4400 ] 6 3.000% 99.500% # ( 4400, 6600 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 44.9 total, 21.2 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 175.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.817 H:M:S, 50.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 46.46 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:17.899 H:M:S, 84.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/20-11:00:20 ... thread 0: (1000000,9000000) ops and (272170.3,186035.7) ops/second in (3.674170,48.377816) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/7 3.25 GB 107.0 8.1 0.0 8.1 16.6 8.5 0.0 1.9 142.8 294.1 57.76 51.83 151 0.383 8378K 15K 0.0 0.0 L1 8/8 497.84 MB 0.0 7.5 5.0 2.5 7.4 4.9 0.2 1.5 230.0 227.1 33.46 31.25 4 8.366 7817K 97K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 4.6 1.5 247.1 247.0 0.78 0.75 2 0.391 196K 101 0.0 0.0 L3 17/0 956.62 MB 1.0 6.1 4.5 1.6 6.0 4.4 0.3 1.4 154.4 153.6 40.31 27.13 18 2.240 5350K 28K 0.0 0.0 L4 174/0 9.56 GB 1.0 3.9 3.8 0.1 3.9 3.8 0.9 1.0 143.0 142.7 27.92 17.90 48 0.582 3957K 2159 0.0 0.0 L5 1120/0 90.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1331/15 104.48 GB 0.0 25.7 13.4 12.3 34.1 21.8 10.6 4.0 164.5 218.2 160.24 128.87 223 0.719 25M 144K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.7 13.4 12.3 34.1 21.8 10.5 4.0 164.5 218.2 160.24 128.87 223 0.719 25M 144K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.7 13.4 12.3 25.6 13.3 0.0 0.0 195.9 194.8 134.52 107.07 98 1.373 25M 144K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 340.4 25.72 21.80 125 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.6 total, 48.4 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.14 GB write, 719.99 MB/s write, 25.74 GB read, 542.83 MB/s read, 160.2 seconds Interval compaction: 34.14 GB write, 722.65 MB/s write, 25.74 GB read, 544.84 MB/s read, 160.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 41, pending-compaction-bytes-delays: 27, pending-compaction-bytes-stops: 0, total-delays: 44, total-stops: 41, interval: 85 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3786003 Average: 2.8731 StdDev: 23.23 Min: 0 Median: 1.5403 Max: 10034 Percentiles: P50: 1.54 P75: 1.94 P99: 7.80 P99.9: 168.70 P99.99: 353.82 ------------------------------------------------------ [ 0, 1 ] 608230 16.065% 16.065% ### ( 1, 2 ] 2377675 62.802% 78.867% ############# ( 2, 3 ] 446166 11.785% 90.652% ## ( 3, 4 ] 171389 4.527% 95.178% # ( 4, 6 ] 127994 3.381% 98.559% # ( 6, 10 ] 37073 0.979% 99.538% ( 10, 15 ] 5261 0.139% 99.677% ( 15, 22 ] 478 0.013% 99.690% ( 22, 34 ] 69 0.002% 99.692% ( 34, 51 ] 41 0.001% 99.693% ( 51, 76 ] 3056 0.081% 99.774% ( 76, 110 ] 1305 0.034% 99.808% ( 110, 170 ] 3558 0.094% 99.902% ( 170, 250 ] 2539 0.067% 99.969% ( 250, 380 ] 991 0.026% 99.995% ( 380, 580 ] 477 0.013% 100.008% ( 580, 870 ] 179 0.005% 100.013% ( 870, 1300 ] 97 0.003% 100.015% ( 1300, 1900 ] 43 0.001% 100.016% ( 1900, 2900 ] 44 0.001% 100.017% ( 2900, 4400 ] 35 0.001% 100.018% ( 4400, 6600 ] 12 0.000% 100.019% ( 6600, 9900 ] 3 0.000% 100.019% ( 9900, 14000 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 1827714 Average: 5.8123 StdDev: 98.37 Min: 0 Median: 1.7253 Max: 12057 Percentiles: P50: 1.73 P75: 2.62 P99: 9.29 P99.9: 183.86 P99.99: 468.45 ------------------------------------------------------ [ 0, 1 ] 208226 11.393% 11.393% ## ( 1, 2 ] 972931 53.232% 64.625% ########### ( 2, 3 ] 306092 16.747% 81.372% ### ( 3, 4 ] 146214 8.000% 89.372% ## ( 4, 6 ] 142941 7.821% 97.193% ## ( 6, 10 ] 40124 2.195% 99.388% ( 10, 15 ] 6065 0.332% 99.720% ( 15, 22 ] 610 0.033% 99.753% ( 22, 34 ] 48 0.003% 99.756% ( 34, 51 ] 23 0.001% 99.757% ( 51, 76 ] 1259 0.069% 99.826% ( 76, 110 ] 457 0.025% 99.851% ( 110, 170 ] 774 0.042% 99.893% ( 170, 250 ] 706 0.039% 99.932% ( 250, 380 ] 730 0.040% 99.972% ( 380, 580 ] 749 0.041% 100.013% ( 580, 870 ] 518 0.028% 100.041% ( 870, 1300 ] 348 0.019% 100.060% ( 1300, 1900 ] 161 0.009% 100.069% ( 1900, 2900 ] 326 0.018% 100.087% ( 2900, 4400 ] 500 0.027% 100.114% ( 4400, 6600 ] 179 0.010% 100.124% ( 6600, 9900 ] 50 0.003% 100.127% ( 9900, 14000 ] 4 0.000% 100.127% ** Level 2 read latency histogram (micros): Count: 49096 Average: 2.2935 StdDev: 4.37 Min: 0 Median: 1.5611 Max: 703 Percentiles: P50: 1.56 P75: 1.94 P99: 6.69 P99.9: 13.57 P99.99: 34.77 ------------------------------------------------------ [ 0, 1 ] 6245 12.720% 12.720% ### ( 1, 2 ] 32619 66.439% 79.159% ############# ( 2, 3 ] 6042 12.307% 91.466% ## ( 3, 4 ] 2321 4.727% 96.193% # ( 4, 6 ] 1304 2.656% 98.849% # ( 6, 10 ] 431 0.878% 99.727% ( 10, 15 ] 119 0.242% 99.969% ( 15, 22 ] 7 0.014% 99.984% ( 22, 34 ] 3 0.006% 99.990% ( 34, 51 ] 2 0.004% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 380, 580 ] 2 0.004% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 1318539 Average: 5.3164 StdDev: 75.25 Min: 0 Median: 1.9881 Max: 11328 Percentiles: P50: 1.99 P75: 3.09 P99: 9.11 P99.9: 17.48 P99.99: 211.44 ------------------------------------------------------ [ 0, 1 ] 28688 2.176% 2.176% ( 1, 2 ] 638165 48.399% 50.575% ########## ( 2, 3 ] 307521 23.323% 73.898% ##### ( 3, 4 ] 157326 11.932% 85.830% ## ( 4, 6 ] 150477 11.412% 97.242% ## ( 6, 10 ] 29791 2.259% 99.502% ( 10, 15 ] 5102 0.387% 99.889% ( 15, 22 ] 424 0.032% 99.921% ( 22, 34 ] 124 0.009% 99.930% ( 34, 51 ] 36 0.003% 99.933% ( 51, 76 ] 205 0.016% 99.948% ( 76, 110 ] 105 0.008% 99.956% ( 110, 170 ] 237 0.018% 99.974% ( 170, 250 ] 398 0.030% 100.005% ( 250, 380 ] 632 0.048% 100.052% ( 380, 580 ] 575 0.044% 100.096% ( 580, 870 ] 441 0.033% 100.130% ( 870, 1300 ] 287 0.022% 100.151% ( 1300, 1900 ] 152 0.012% 100.163% ( 1900, 2900 ] 192 0.015% 100.177% ( 2900, 4400 ] 222 0.017% 100.194% ( 4400, 6600 ] 50 0.004% 100.198% ( 6600, 9900 ] 15 0.001% 100.199% ( 9900, 14000 ] 1 0.000% 100.199% ** Level 4 read latency histogram (micros): Count: 35904 Average: 92.2909 StdDev: 417.01 Min: 0 Median: 2.1637 Max: 9970 Percentiles: P50: 2.16 P75: 3.50 P99: 2189.70 P99.9: 4928.84 P99.99: 6870.34 ------------------------------------------------------ [ 0, 1 ] 731 2.036% 2.036% ( 1, 2 ] 15884 44.240% 46.276% ######### ( 2, 3 ] 8167 22.747% 69.023% ##### ( 3, 4 ] 4317 12.024% 81.047% ## ( 4, 6 ] 2618 7.292% 88.338% # ( 6, 10 ] 849 2.365% 90.703% ( 10, 15 ] 129 0.359% 91.062% ( 15, 22 ] 15 0.042% 91.104% ( 22, 34 ] 38 0.106% 91.210% ( 34, 51 ] 4 0.011% 91.221% ( 51, 76 ] 9 0.025% 91.246% ( 76, 110 ] 6 0.017% 91.263% ( 110, 170 ] 50 0.139% 91.402% ( 170, 250 ] 204 0.568% 91.970% ( 250, 380 ] 397 1.106% 93.076% ( 380, 580 ] 662 1.844% 94.920% ( 580, 870 ] 703 1.958% 96.878% ( 870, 1300 ] 459 1.278% 98.156% ( 1300, 1900 ] 254 0.707% 98.864% ( 1900, 2900 ] 169 0.471% 99.334% ( 2900, 4400 ] 193 0.538% 99.872% ( 4400, 6600 ] 42 0.117% 99.989% ( 6600, 9900 ] 5 0.014% 100.003% ( 9900, 14000 ] 1 0.003% 100.006% ** Level 5 read latency histogram (micros): Count: 280 Average: 910.2536 StdDev: 873.76 Min: 55 Median: 606.3636 Max: 7309 Percentiles: P50: 606.36 P75: 1260.91 P99: 4250.00 P99.9: 7309.00 P99.99: 7309.00 ------------------------------------------------------ ( 51, 76 ] 7 2.500% 2.500% # ( 76, 110 ] 5 1.786% 4.286% ( 110, 170 ] 9 3.214% 7.500% # ( 170, 250 ] 20 7.143% 14.643% # ( 250, 380 ] 46 16.429% 31.071% ### ( 380, 580 ] 49 17.500% 48.571% #### ( 580, 870 ] 44 15.714% 64.286% ### ( 870, 1300 ] 33 11.786% 76.071% ## ( 1300, 1900 ] 41 14.643% 90.714% ### ( 1900, 2900 ] 16 5.714% 96.429% # ( 2900, 4400 ] 8 2.857% 99.286% # ( 4400, 6600 ] 1 0.357% 99.643% ( 6600, 9900 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 48.6 total, 3.7 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 182.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.668 H:M:S, 48.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 267.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.850 H:M:S, 23.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-11:00:24 ... thread 0: (1000000,10000000) ops and (325513.9,194363.9) ops/second in (3.072065,51.449881) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/3 4.23 GB 239.1 9.2 0.0 9.2 18.6 9.5 0.0 2.0 144.9 294.4 64.77 58.40 168 0.386 9529K 17K 0.0 0.0 L1 8/8 497.84 MB 0.0 7.5 5.0 2.5 7.4 4.9 0.2 1.5 230.0 227.1 33.46 31.25 4 8.366 7817K 97K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 4.6 1.5 247.1 247.0 0.78 0.75 2 0.391 196K 101 0.0 0.0 L3 17/0 956.62 MB 1.0 6.1 4.5 1.6 6.0 4.4 0.3 1.4 154.4 153.6 40.31 27.13 18 2.240 5350K 28K 0.0 0.0 L4 174/0 9.56 GB 1.0 3.9 3.8 0.1 3.9 3.8 0.9 1.0 143.0 142.7 27.92 17.90 48 0.582 3957K 2159 0.0 0.0 L5 1120/0 90.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1333/11 105.46 GB 0.0 26.8 13.4 13.4 36.2 22.7 10.6 3.8 164.4 221.5 167.25 135.44 240 0.697 26M 145K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.8 13.4 13.4 36.2 22.7 10.5 3.8 164.4 221.5 167.25 135.44 240 0.697 26M 145K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.8 13.4 13.4 26.7 13.3 0.0 0.0 198.0 196.9 138.83 111.26 102 1.361 26M 145K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 341.4 28.42 24.18 138 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 51.6 total, 51.5 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 36.17 GB write, 717.39 MB/s write, 26.85 GB read, 532.50 MB/s read, 167.2 seconds Interval compaction: 36.17 GB write, 719.89 MB/s write, 26.85 GB read, 534.35 MB/s read, 167.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 27, pending-compaction-bytes-stops: 0, total-delays: 44, total-stops: 44, interval: 88 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4189665 Average: 2.8290 StdDev: 22.20 Min: 0 Median: 1.5465 Max: 10034 Percentiles: P50: 1.55 P75: 1.94 P99: 7.72 P99.9: 160.99 P99.99: 333.27 ------------------------------------------------------ [ 0, 1 ] 650409 15.524% 15.524% ### ( 1, 2 ] 2642950 63.083% 78.607% ############# ( 2, 3 ] 506848 12.098% 90.704% ## ( 3, 4 ] 189496 4.523% 95.227% # ( 4, 6 ] 140153 3.345% 98.572% # ( 6, 10 ] 41576 0.992% 99.565% ( 10, 15 ] 5974 0.143% 99.707% ( 15, 22 ] 504 0.012% 99.719% ( 22, 34 ] 73 0.002% 99.721% ( 34, 51 ] 45 0.001% 99.722% ( 51, 76 ] 3091 0.074% 99.796% ( 76, 110 ] 1312 0.031% 99.827% ( 110, 170 ] 3582 0.085% 99.913% ( 170, 250 ] 2588 0.062% 99.975% ( 250, 380 ] 1007 0.024% 99.999% ( 380, 580 ] 489 0.012% 100.010% ( 580, 870 ] 186 0.004% 100.015% ( 870, 1300 ] 105 0.003% 100.017% ( 1300, 1900 ] 43 0.001% 100.018% ( 1900, 2900 ] 44 0.001% 100.019% ( 2900, 4400 ] 35 0.001% 100.020% ( 4400, 6600 ] 12 0.000% 100.020% ( 6600, 9900 ] 3 0.000% 100.021% ( 9900, 14000 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1848531 Average: 5.7748 StdDev: 97.82 Min: 0 Median: 1.7219 Max: 12057 Percentiles: P50: 1.72 P75: 2.61 P99: 9.29 P99.9: 182.62 P99.99: 468.19 ------------------------------------------------------ [ 0, 1 ] 212084 11.473% 11.473% ## ( 1, 2 ] 986561 53.370% 64.843% ########### ( 2, 3 ] 308022 16.663% 81.506% ### ( 3, 4 ] 146833 7.943% 89.449% ## ( 4, 6 ] 143334 7.754% 97.203% ## ( 6, 10 ] 40427 2.187% 99.390% ( 10, 15 ] 6084 0.329% 99.719% ( 15, 22 ] 611 0.033% 99.753% ( 22, 34 ] 48 0.003% 99.755% ( 34, 51 ] 24 0.001% 99.756% ( 51, 76 ] 1283 0.069% 99.826% ( 76, 110 ] 465 0.025% 99.851% ( 110, 170 ] 794 0.043% 99.894% ( 170, 250 ] 713 0.039% 99.932% ( 250, 380 ] 732 0.040% 99.972% ( 380, 580 ] 751 0.041% 100.013% ( 580, 870 ] 518 0.028% 100.041% ( 870, 1300 ] 348 0.019% 100.060% ( 1300, 1900 ] 161 0.009% 100.068% ( 1900, 2900 ] 326 0.018% 100.086% ( 2900, 4400 ] 500 0.027% 100.113% ( 4400, 6600 ] 179 0.010% 100.123% ( 6600, 9900 ] 50 0.003% 100.125% ( 9900, 14000 ] 4 0.000% 100.126% ** Level 2 read latency histogram (micros): Count: 49096 Average: 2.2935 StdDev: 4.37 Min: 0 Median: 1.5611 Max: 703 Percentiles: P50: 1.56 P75: 1.94 P99: 6.69 P99.9: 13.57 P99.99: 34.77 ------------------------------------------------------ [ 0, 1 ] 6245 12.720% 12.720% ### ( 1, 2 ] 32619 66.439% 79.159% ############# ( 2, 3 ] 6042 12.307% 91.466% ## ( 3, 4 ] 2321 4.727% 96.193% # ( 4, 6 ] 1304 2.656% 98.849% # ( 6, 10 ] 431 0.878% 99.727% ( 10, 15 ] 119 0.242% 99.969% ( 15, 22 ] 7 0.014% 99.984% ( 22, 34 ] 3 0.006% 99.990% ( 34, 51 ] 2 0.004% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 380, 580 ] 2 0.004% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 1318539 Average: 5.3164 StdDev: 75.25 Min: 0 Median: 1.9881 Max: 11328 Percentiles: P50: 1.99 P75: 3.09 P99: 9.11 P99.9: 17.48 P99.99: 211.44 ------------------------------------------------------ [ 0, 1 ] 28688 2.176% 2.176% ( 1, 2 ] 638165 48.399% 50.575% ########## ( 2, 3 ] 307521 23.323% 73.898% ##### ( 3, 4 ] 157326 11.932% 85.830% ## ( 4, 6 ] 150477 11.412% 97.242% ## ( 6, 10 ] 29791 2.259% 99.502% ( 10, 15 ] 5102 0.387% 99.889% ( 15, 22 ] 424 0.032% 99.921% ( 22, 34 ] 124 0.009% 99.930% ( 34, 51 ] 36 0.003% 99.933% ( 51, 76 ] 205 0.016% 99.948% ( 76, 110 ] 105 0.008% 99.956% ( 110, 170 ] 237 0.018% 99.974% ( 170, 250 ] 398 0.030% 100.005% ( 250, 380 ] 632 0.048% 100.052% ( 380, 580 ] 575 0.044% 100.096% ( 580, 870 ] 441 0.033% 100.130% ( 870, 1300 ] 287 0.022% 100.151% ( 1300, 1900 ] 152 0.012% 100.163% ( 1900, 2900 ] 192 0.015% 100.177% ( 2900, 4400 ] 222 0.017% 100.194% ( 4400, 6600 ] 50 0.004% 100.198% ( 6600, 9900 ] 15 0.001% 100.199% ( 9900, 14000 ] 1 0.000% 100.199% ** Level 4 read latency histogram (micros): Count: 35904 Average: 92.2909 StdDev: 417.01 Min: 0 Median: 2.1637 Max: 9970 Percentiles: P50: 2.16 P75: 3.50 P99: 2189.70 P99.9: 4928.84 P99.99: 6870.34 ------------------------------------------------------ [ 0, 1 ] 731 2.036% 2.036% ( 1, 2 ] 15884 44.240% 46.276% ######### ( 2, 3 ] 8167 22.747% 69.023% ##### ( 3, 4 ] 4317 12.024% 81.047% ## ( 4, 6 ] 2618 7.292% 88.338% # ( 6, 10 ] 849 2.365% 90.703% ( 10, 15 ] 129 0.359% 91.062% ( 15, 22 ] 15 0.042% 91.104% ( 22, 34 ] 38 0.106% 91.210% ( 34, 51 ] 4 0.011% 91.221% ( 51, 76 ] 9 0.025% 91.246% ( 76, 110 ] 6 0.017% 91.263% ( 110, 170 ] 50 0.139% 91.402% ( 170, 250 ] 204 0.568% 91.970% ( 250, 380 ] 397 1.106% 93.076% ( 380, 580 ] 662 1.844% 94.920% ( 580, 870 ] 703 1.958% 96.878% ( 870, 1300 ] 459 1.278% 98.156% ( 1300, 1900 ] 254 0.707% 98.864% ( 1900, 2900 ] 169 0.471% 99.334% ( 2900, 4400 ] 193 0.538% 99.872% ( 4400, 6600 ] 42 0.117% 99.989% ( 6600, 9900 ] 5 0.014% 100.003% ( 9900, 14000 ] 1 0.003% 100.006% ** Level 5 read latency histogram (micros): Count: 280 Average: 910.2536 StdDev: 873.76 Min: 55 Median: 606.3636 Max: 7309 Percentiles: P50: 606.36 P75: 1260.91 P99: 4250.00 P99.9: 7309.00 P99.99: 7309.00 ------------------------------------------------------ ( 51, 76 ] 7 2.500% 2.500% # ( 76, 110 ] 5 1.786% 4.286% ( 110, 170 ] 9 3.214% 7.500% # ( 170, 250 ] 20 7.143% 14.643% # ( 250, 380 ] 46 16.429% 31.071% ### ( 380, 580 ] 49 17.500% 48.571% #### ( 580, 870 ] 44 15.714% 64.286% ### ( 870, 1300 ] 33 11.786% 76.071% ## ( 1300, 1900 ] 41 14.643% 90.714% ### ( 1900, 2900 ] 16 5.714% 96.429% # ( 2900, 4400 ] 8 2.857% 99.286% # ( 4400, 6600 ] 1 0.357% 99.643% ( 6600, 9900 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 51.6 total, 3.1 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 190.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.039 H:M:S, 46.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.372 H:M:S, 12.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-11:00:27 ... thread 0: (1000000,11000000) ops and (315005.6,201375.1) ops/second in (3.174547,54.624428) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/4 3.26 GB 308.3 10.0 0.0 10.0 20.3 10.4 0.0 2.0 144.9 295.7 70.44 63.71 185 0.381 10M 18K 0.0 0.0 L1 28/0 2.37 GB 242.2 9.9 6.9 3.0 9.8 6.8 0.2 1.4 226.3 223.7 44.80 41.39 5 8.960 9789K 97K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 4.6 1.5 247.1 247.0 0.78 0.75 2 0.391 196K 101 0.0 0.0 L3 17/0 956.62 MB 1.0 6.1 4.5 1.6 6.0 4.4 0.3 1.4 154.4 153.6 40.31 27.13 18 2.240 5350K 28K 0.0 0.0 L4 174/0 9.56 GB 1.0 3.9 3.8 0.1 3.9 3.8 0.9 1.0 143.0 142.7 27.92 17.90 48 0.582 3957K 2159 0.0 0.0 L5 1120/0 90.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1355/4 106.36 GB 0.0 30.0 15.3 14.7 40.3 25.5 10.6 3.9 166.9 223.7 184.26 150.88 258 0.714 29M 146K 0.0 0.0 Int 0/0 0.00 KB 0.0 30.0 15.3 14.7 40.3 25.5 10.5 3.9 166.9 223.7 184.26 150.88 258 0.714 29M 146K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 30.0 15.3 14.7 29.9 15.1 0.0 0.0 200.8 199.6 153.19 124.36 106 1.445 29M 146K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.4 10.4 0.0 0.0 0.0 342.6 31.07 26.53 152 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.8 total, 54.6 interval Flush(GB): cumulative 10.397, interval 10.397 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 40.26 GB write, 752.20 MB/s write, 30.03 GB read, 561.12 MB/s read, 184.3 seconds Interval compaction: 40.26 GB write, 754.66 MB/s write, 30.03 GB read, 562.95 MB/s read, 184.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 45, pending-compaction-bytes-delays: 27, pending-compaction-bytes-stops: 0, total-delays: 46, total-stops: 45, interval: 91 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4467846 Average: 2.7896 StdDev: 21.64 Min: 0 Median: 1.5432 Max: 10034 Percentiles: P50: 1.54 P75: 1.94 P99: 7.59 P99.9: 156.03 P99.99: 325.91 ------------------------------------------------------ [ 0, 1 ] 699200 15.650% 15.650% ### ( 1, 2 ] 2825181 63.234% 78.883% ############# ( 2, 3 ] 536399 12.006% 90.889% ## ( 3, 4 ] 199583 4.467% 95.356% # ( 4, 6 ] 145546 3.258% 98.614% # ( 6, 10 ] 43392 0.971% 99.585% ( 10, 15 ] 6283 0.141% 99.726% ( 15, 22 ] 520 0.012% 99.737% ( 22, 34 ] 75 0.002% 99.739% ( 34, 51 ] 48 0.001% 99.740% ( 51, 76 ] 3092 0.069% 99.809% ( 76, 110 ] 1312 0.029% 99.839% ( 110, 170 ] 3582 0.080% 99.919% ( 170, 250 ] 2598 0.058% 99.977% ( 250, 380 ] 1009 0.023% 99.999% ( 380, 580 ] 498 0.011% 100.011% ( 580, 870 ] 191 0.004% 100.015% ( 870, 1300 ] 109 0.002% 100.017% ( 1300, 1900 ] 46 0.001% 100.018% ( 1900, 2900 ] 44 0.001% 100.019% ( 2900, 4400 ] 36 0.001% 100.020% ( 4400, 6600 ] 12 0.000% 100.020% ( 6600, 9900 ] 3 0.000% 100.020% ( 9900, 14000 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1954278 Average: 5.6377 StdDev: 95.27 Min: 0 Median: 1.7107 Max: 12057 Percentiles: P50: 1.71 P75: 2.57 P99: 9.28 P99.9: 193.09 P99.99: 475.57 ------------------------------------------------------ [ 0, 1 ] 226252 11.577% 11.577% ## ( 1, 2 ] 1056537 54.063% 65.640% ########### ( 2, 3 ] 320784 16.414% 82.054% ### ( 3, 4 ] 150773 7.715% 89.770% ## ( 4, 6 ] 145805 7.461% 97.230% # ( 6, 10 ] 42188 2.159% 99.389% ( 10, 15 ] 6217 0.318% 99.707% ( 15, 22 ] 625 0.032% 99.739% ( 22, 34 ] 48 0.002% 99.742% ( 34, 51 ] 29 0.001% 99.743% ( 51, 76 ] 1421 0.073% 99.816% ( 76, 110 ] 518 0.027% 99.842% ( 110, 170 ] 890 0.046% 99.888% ( 170, 250 ] 820 0.042% 99.930% ( 250, 380 ] 800 0.041% 99.971% ( 380, 580 ] 786 0.040% 100.011% ( 580, 870 ] 528 0.027% 100.038% ( 870, 1300 ] 350 0.018% 100.056% ( 1300, 1900 ] 168 0.009% 100.065% ( 1900, 2900 ] 327 0.017% 100.081% ( 2900, 4400 ] 500 0.026% 100.107% ( 4400, 6600 ] 179 0.009% 100.116% ( 6600, 9900 ] 50 0.003% 100.119% ( 9900, 14000 ] 4 0.000% 100.119% ** Level 2 read latency histogram (micros): Count: 49096 Average: 2.2935 StdDev: 4.37 Min: 0 Median: 1.5611 Max: 703 Percentiles: P50: 1.56 P75: 1.94 P99: 6.69 P99.9: 13.57 P99.99: 34.77 ------------------------------------------------------ [ 0, 1 ] 6245 12.720% 12.720% ### ( 1, 2 ] 32619 66.439% 79.159% ############# ( 2, 3 ] 6042 12.307% 91.466% ## ( 3, 4 ] 2321 4.727% 96.193% # ( 4, 6 ] 1304 2.656% 98.849% # ( 6, 10 ] 431 0.878% 99.727% ( 10, 15 ] 119 0.242% 99.969% ( 15, 22 ] 7 0.014% 99.984% ( 22, 34 ] 3 0.006% 99.990% ( 34, 51 ] 2 0.004% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 380, 580 ] 2 0.004% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 1318539 Average: 5.3164 StdDev: 75.25 Min: 0 Median: 1.9881 Max: 11328 Percentiles: P50: 1.99 P75: 3.09 P99: 9.11 P99.9: 17.48 P99.99: 211.44 ------------------------------------------------------ [ 0, 1 ] 28688 2.176% 2.176% ( 1, 2 ] 638165 48.399% 50.575% ########## ( 2, 3 ] 307521 23.323% 73.898% ##### ( 3, 4 ] 157326 11.932% 85.830% ## ( 4, 6 ] 150477 11.412% 97.242% ## ( 6, 10 ] 29791 2.259% 99.502% ( 10, 15 ] 5102 0.387% 99.889% ( 15, 22 ] 424 0.032% 99.921% ( 22, 34 ] 124 0.009% 99.930% ( 34, 51 ] 36 0.003% 99.933% ( 51, 76 ] 205 0.016% 99.948% ( 76, 110 ] 105 0.008% 99.956% ( 110, 170 ] 237 0.018% 99.974% ( 170, 250 ] 398 0.030% 100.005% ( 250, 380 ] 632 0.048% 100.052% ( 380, 580 ] 575 0.044% 100.096% ( 580, 870 ] 441 0.033% 100.130% ( 870, 1300 ] 287 0.022% 100.151% ( 1300, 1900 ] 152 0.012% 100.163% ( 1900, 2900 ] 192 0.015% 100.177% ( 2900, 4400 ] 222 0.017% 100.194% ( 4400, 6600 ] 50 0.004% 100.198% ( 6600, 9900 ] 15 0.001% 100.199% ( 9900, 14000 ] 1 0.000% 100.199% ** Level 4 read latency histogram (micros): Count: 35904 Average: 92.2909 StdDev: 417.01 Min: 0 Median: 2.1637 Max: 9970 Percentiles: P50: 2.16 P75: 3.50 P99: 2189.70 P99.9: 4928.84 P99.99: 6870.34 ------------------------------------------------------ [ 0, 1 ] 731 2.036% 2.036% ( 1, 2 ] 15884 44.240% 46.276% ######### ( 2, 3 ] 8167 22.747% 69.023% ##### ( 3, 4 ] 4317 12.024% 81.047% ## ( 4, 6 ] 2618 7.292% 88.338% # ( 6, 10 ] 849 2.365% 90.703% ( 10, 15 ] 129 0.359% 91.062% ( 15, 22 ] 15 0.042% 91.104% ( 22, 34 ] 38 0.106% 91.210% ( 34, 51 ] 4 0.011% 91.221% ( 51, 76 ] 9 0.025% 91.246% ( 76, 110 ] 6 0.017% 91.263% ( 110, 170 ] 50 0.139% 91.402% ( 170, 250 ] 204 0.568% 91.970% ( 250, 380 ] 397 1.106% 93.076% ( 380, 580 ] 662 1.844% 94.920% ( 580, 870 ] 703 1.958% 96.878% ( 870, 1300 ] 459 1.278% 98.156% ( 1300, 1900 ] 254 0.707% 98.864% ( 1900, 2900 ] 169 0.471% 99.334% ( 2900, 4400 ] 193 0.538% 99.872% ( 4400, 6600 ] 42 0.117% 99.989% ( 6600, 9900 ] 5 0.014% 100.003% ( 9900, 14000 ] 1 0.003% 100.006% ** Level 5 read latency histogram (micros): Count: 280 Average: 910.2536 StdDev: 873.76 Min: 55 Median: 606.3636 Max: 7309 Percentiles: P50: 606.36 P75: 1260.91 P99: 4250.00 P99.9: 7309.00 P99.99: 7309.00 ------------------------------------------------------ ( 51, 76 ] 7 2.500% 2.500% # ( 76, 110 ] 5 1.786% 4.286% ( 110, 170 ] 9 3.214% 7.500% # ( 170, 250 ] 20 7.143% 14.643% # ( 250, 380 ] 46 16.429% 31.071% ### ( 380, 580 ] 49 17.500% 48.571% #### ( 580, 870 ] 44 15.714% 64.286% ### ( 870, 1300 ] 33 11.786% 76.071% ## ( 1300, 1900 ] 41 14.643% 90.714% ### ( 1900, 2900 ] 16 5.714% 96.429% # ( 2900, 4400 ] 8 2.857% 99.286% # ( 4400, 6600 ] 1 0.357% 99.643% ( 6600, 9900 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 54.8 total, 3.2 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 197.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.525 H:M:S, 44.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 310.03 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.485 H:M:S, 15.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.417 micros/op 184605 ops/sec 60.150 seconds 11103999 operations; 178.9 MB/s Microseconds per write: Count: 11103999 Average: 5.4170 StdDev: 323.58 Min: 0 Median: 1.6849 Max: 589105 Percentiles: P50: 1.68 P75: 2.87 P99: 8.83 P99.9: 1108.52 P99.99: 2731.54 ------------------------------------------------------ [ 0, 1 ] 1935451 17.430% 17.430% ### ( 1, 2 ] 5280736 47.557% 64.987% ########## ( 2, 3 ] 1284528 11.568% 76.555% ## ( 3, 4 ] 1574472 14.179% 90.735% ### ( 4, 6 ] 836511 7.533% 98.268% ## ( 6, 10 ] 114884 1.035% 99.303% ( 10, 15 ] 33596 0.303% 99.605% ( 15, 22 ] 10588 0.095% 99.701% ( 22, 34 ] 3232 0.029% 99.730% ( 34, 51 ] 397 0.004% 99.733% ( 51, 76 ] 68 0.001% 99.734% ( 76, 110 ] 31 0.000% 99.734% ( 110, 170 ] 10444 0.094% 99.828% ( 170, 250 ] 612 0.006% 99.834% ( 250, 380 ] 183 0.002% 99.836% ( 380, 580 ] 21 0.000% 99.836% ( 580, 870 ] 27 0.000% 99.836% ( 870, 1300 ] 12825 0.115% 99.951% ( 1300, 1900 ] 90 0.001% 99.952% ( 1900, 2900 ] 5042 0.045% 99.998% ( 2900, 4400 ] 175 0.002% 99.999% ( 4400, 6600 ] 42 0.000% 100.000% ( 6600, 9900 ] 19 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 202631 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11103999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11459326968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 611 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 29532335 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 33791889732 rocksdb.compact.write.bytes COUNT : 33585171799 rocksdb.flush.write.bytes COUNT : 11427904970 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 64 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 376 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11335727104 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4376576 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 33898132359 rocksdb.non.last.level.read.count COUNT : 8186863 rocksdb.block.checksum.compute.count COUNT : 8185705 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.300484 P95 : 4.386945 P99 : 7.418817 P100 : 589103.000000 COUNT : 11103999 SUM : 55337174 rocksdb.compaction.times.micros P50 : 888333.333333 P95 : 5015000.000000 P99 : 13706000.000000 P100 : 19801634.000000 COUNT : 107 SUM : 154066572 rocksdb.compaction.times.cpu_micros P50 : 871860.465116 P95 : 4055000.000000 P99 : 13706000.000000 P100 : 18054751.000000 COUNT : 107 SUM : 125224926 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 684.722222 P95 : 1199.218750 P99 : 6196.666667 P100 : 12576.000000 COUNT : 155 SUM : 129713 rocksdb.compaction.outfile.sync.micros P50 : 1009.750000 P95 : 82736.842105 P99 : 125600.000000 P100 : 471943.000000 COUNT : 396 SUM : 5545976 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 99.375000 P95 : 785.900000 P99 : 2955.000000 P100 : 3931.000000 COUNT : 289 SUM : 66218 rocksdb.table.open.io.micros P50 : 1205.730769 P95 : 5791.923077 P99 : 9671.062500 P100 : 16428.000000 COUNT : 611 SUM : 1088389 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.593444 P95 : 7.907365 P99 : 11.711193 P100 : 23257.000000 COUNT : 8183867 SUM : 51394819 rocksdb.read.block.get.micros P50 : 476.296296 P95 : 2141.463415 P99 : 4112.272727 P100 : 11438.000000 COUNT : 1222 SUM : 849125 rocksdb.write.raw.block.micros P50 : 0.513908 P95 : 0.976425 P99 : 3.352297 P100 : 10898.000000 COUNT : 10901921 SUM : 20791969 rocksdb.numfiles.in.singlecompaction P50 : 2.916667 P95 : 7.440000 P99 : 28.720000 P100 : 43.000000 COUNT : 144 SUM : 536 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558026 P95 : 1184.097008 P99 : 2594.402703 P100 : 588926.000000 COUNT : 175546 SUM : 29545810 rocksdb.sst.read.micros P50 : 1.627934 P95 : 4.925578 P99 : 8.851336 P100 : 12057.000000 COUNT : 8186946 SUM : 35017627 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11103999 SUM : 11459326968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 201555.555556 P95 : 366617.647059 P99 : 549100.000000 P100 : 814590.000000 COUNT : 155 SUM : 31734397 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 379 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0