[2024-11-02 19:17:16.771730] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... [2024-11-02 19:17:16.771879] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3225967 ] Set seed to 1730571436768270 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-02 19:17:16.862883] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-02 19:17:16.899294] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-02 19:17:16.899343] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3225967' to capture a snapshot of events at runtime. [2024-11-02 19:17:16.899357] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3225967 for offline analysis/debug. [2024-11-02 19:17:16.899386] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Nov 2 19:17:21 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/02-19:17:23 ... thread 0: (1000000,1000000) ops and (354596.3,354596.3) ops/second in (2.820108,2.820108) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.02 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 354.4 2.31 2.08 12 0.193 0 0 0.0 0.0 L2 3/2 251.71 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 246.6 246.4 1.53 1.48 2 0.766 383K 221 0.0 0.0 L3 9/0 741.18 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 98.3 311.4 3.84 3.55 14 0.275 383K 221 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.1 1.5 98.3 311.4 3.84 3.55 14 0.275 383K 221 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 246.6 246.4 1.53 1.48 2 0.766 383K 221 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 354.4 2.31 2.08 12 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 398.48 MB/s write, 0.37 GB read, 125.84 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 424.11 MB/s write, 0.37 GB read, 133.93 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 102483 Average: 1.8557 StdDev: 19.67 Min: 0 Median: 1.1398 Max: 2893 Percentiles: P50: 1.14 P75: 1.61 P99: 3.71 P99.9: 9.24 P99.99: 339.43 ------------------------------------------------------ [ 0, 1 ] 43679 42.621% 42.621% ######### ( 1, 2 ] 54112 52.801% 95.422% ########### ( 2, 3 ] 2873 2.803% 98.225% # ( 3, 4 ] 1130 1.103% 99.328% ( 4, 6 ] 456 0.445% 99.773% ( 6, 10 ] 165 0.161% 99.934% ( 10, 15 ] 36 0.035% 99.969% ( 15, 22 ] 5 0.005% 99.974% ( 22, 34 ] 2 0.002% 99.976% ( 51, 76 ] 2 0.002% 99.978% ( 76, 110 ] 1 0.001% 99.979% ( 110, 170 ] 6 0.006% 99.984% ( 170, 250 ] 6 0.006% 99.990% ( 250, 380 ] 4 0.004% 99.994% ( 580, 870 ] 2 0.002% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 5 0.005% 100.003% ** Level 2 read latency histogram (micros): Count: 54205 Average: 1.8433 StdDev: 11.66 Min: 0 Median: 1.2017 Max: 2063 Percentiles: P50: 1.20 P75: 1.65 P99: 4.35 P99.9: 9.66 P99.99: 437.95 ------------------------------------------------------ [ 0, 1 ] 21016 38.771% 38.771% ######## ( 1, 2 ] 30182 55.681% 94.453% ########### ( 2, 3 ] 1603 2.957% 97.410% # ( 3, 4 ] 792 1.461% 98.871% ( 4, 6 ] 405 0.747% 99.618% ( 6, 10 ] 167 0.308% 99.926% ( 10, 15 ] 25 0.046% 99.972% ( 15, 22 ] 3 0.006% 99.978% ( 51, 76 ] 2 0.004% 99.982% ( 76, 110 ] 1 0.002% 99.983% ( 170, 250 ] 1 0.002% 99.985% ( 250, 380 ] 2 0.004% 99.989% ( 380, 580 ] 2 0.004% 99.993% ( 580, 870 ] 2 0.004% 99.996% ( 870, 1300 ] 1 0.002% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 40 Average: 1473.5000 StdDev: 971.06 Min: 198 Median: 1042.0000 Max: 3588 Percentiles: P50: 1042.00 P75: 2275.00 P99: 3588.00 P99.9: 3588.00 P99.99: 3588.00 ------------------------------------------------------ ( 170, 250 ] 2 5.000% 5.000% # ( 380, 580 ] 2 5.000% 10.000% # ( 580, 870 ] 12 30.000% 40.000% ###### ( 870, 1300 ] 10 25.000% 65.000% ##### ( 1300, 1900 ] 1 2.500% 67.500% # ( 1900, 2900 ] 8 20.000% 87.500% #### ( 2900, 4400 ] 5 12.500% 100.000% ### ** Level 4 read latency histogram (micros): Count: 35 Average: 1849.8571 StdDev: 1712.87 Min: 215 Median: 1171.0000 Max: 6476 Percentiles: P50: 1171.00 P75: 2525.00 P99: 6446.00 P99.9: 6476.00 P99.99: 6476.00 ------------------------------------------------------ ( 170, 250 ] 2 5.714% 5.714% # ( 250, 380 ] 2 5.714% 11.429% # ( 380, 580 ] 2 5.714% 17.143% # ( 580, 870 ] 8 22.857% 40.000% ##### ( 870, 1300 ] 5 14.286% 54.286% ### ( 1300, 1900 ] 6 17.143% 71.429% ### ( 1900, 2900 ] 2 5.714% 77.143% # ( 2900, 4400 ] 3 8.571% 85.714% ## ( 4400, 6600 ] 5 14.286% 100.000% ### ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 327.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.218 H:M:S, 7.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 348.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.218 H:M:S, 7.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/02-19:17:27 ... thread 0: (1000000,2000000) ops and (324184.9,338709.4) ops/second in (3.084659,5.904767) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/4 1.17 GB 88.1 0.8 0.0 0.8 2.6 1.8 0.0 1.4 97.9 316.1 8.37 7.72 29 0.289 831K 820 0.0 0.0 L1 1/0 2.82 MB 0.3 0.4 0.4 0.0 0.4 0.4 0.2 1.0 245.4 244.9 1.54 1.50 1 1.540 383K 624 0.0 0.0 L2 2/0 55.27 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.4 2.0 246.6 246.4 1.53 1.48 2 0.766 383K 221 0.0 0.0 L3 42/0 997.66 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 203.5 203.3 3.91 3.42 3 1.304 808K 809 0.0 0.0 L4 144/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1245/4 97.92 GB 0.0 2.3 1.1 1.2 4.1 2.9 1.4 2.3 154.4 273.3 15.35 14.11 35 0.439 2407K 2474 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 1.1 1.2 4.1 2.9 1.3 2.3 154.4 273.3 15.35 14.11 35 0.439 2407K 2474 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 1.1 1.2 2.3 1.1 0.0 0.0 233.7 233.5 10.14 9.49 9 1.127 2407K 2474 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 350.7 5.21 4.62 26 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.10 GB write, 689.16 MB/s write, 2.32 GB read, 389.49 MB/s read, 15.4 seconds Interval compaction: 4.10 GB write, 710.34 MB/s write, 2.32 GB read, 401.46 MB/s read, 15.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 386307 Average: 2.0847 StdDev: 15.62 Min: 0 Median: 1.3784 Max: 3650 Percentiles: P50: 1.38 P75: 1.79 P99: 5.49 P99.9: 9.90 P99.99: 16.54 ------------------------------------------------------ [ 0, 1 ] 105101 27.207% 27.207% ##### ( 1, 2 ] 232724 60.243% 87.450% ############ ( 2, 3 ] 25550 6.614% 94.064% # ( 3, 4 ] 13234 3.426% 97.490% # ( 4, 6 ] 7806 2.021% 99.510% ( 6, 10 ] 1544 0.400% 99.910% ( 10, 15 ] 303 0.078% 99.988% ( 15, 22 ] 29 0.008% 99.996% ( 22, 34 ] 8 0.002% 99.998% ( 51, 76 ] 5 0.001% 99.999% ( 76, 110 ] 1 0.000% 99.999% ( 110, 170 ] 8 0.002% 100.002% ( 170, 250 ] 17 0.004% 100.006% ( 250, 380 ] 10 0.003% 100.009% ( 380, 580 ] 1 0.000% 100.009% ( 580, 870 ] 7 0.002% 100.011% ( 870, 1300 ] 2 0.001% 100.011% ( 1300, 1900 ] 5 0.001% 100.012% ( 1900, 2900 ] 6 0.002% 100.014% ( 2900, 4400 ] 3 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 81513 Average: 2.3223 StdDev: 4.86 Min: 1 Median: 1.5702 Max: 900 Percentiles: P50: 1.57 P75: 1.95 P99: 5.94 P99.9: 10.72 P99.99: 18.39 ------------------------------------------------------ [ 0, 1 ] 10524 12.911% 12.911% ### ( 1, 2 ] 53025 65.051% 77.962% ############# ( 2, 3 ] 9600 11.777% 89.739% ## ( 3, 4 ] 4320 5.300% 95.039% # ( 4, 6 ] 3328 4.083% 99.122% # ( 6, 10 ] 623 0.764% 99.886% ( 10, 15 ] 80 0.098% 99.984% ( 15, 22 ] 10 0.012% 99.996% ( 22, 34 ] 2 0.002% 99.999% ( 34, 51 ] 1 0.001% 100.000% ( 110, 170 ] 2 0.002% 100.002% ( 170, 250 ] 1 0.001% 100.004% ( 250, 380 ] 2 0.002% 100.006% ( 380, 580 ] 1 0.001% 100.007% ( 580, 870 ] 1 0.001% 100.009% ( 870, 1300 ] 1 0.001% 100.010% ** Level 2 read latency histogram (micros): Count: 95436 Average: 1.9567 StdDev: 8.81 Min: 0 Median: 1.3323 Max: 2063 Percentiles: P50: 1.33 P75: 1.75 P99: 5.25 P99.9: 9.51 P99.99: 91.52 ------------------------------------------------------ [ 0, 1 ] 28845 30.224% 30.224% ###### ( 1, 2 ] 56796 59.512% 89.737% ############ ( 2, 3 ] 5027 5.267% 95.004% # ( 3, 4 ] 2868 3.005% 98.009% # ( 4, 6 ] 1514 1.586% 99.596% ( 6, 10 ] 331 0.347% 99.942% ( 10, 15 ] 36 0.038% 99.980% ( 15, 22 ] 7 0.007% 99.987% ( 51, 76 ] 2 0.002% 99.990% ( 76, 110 ] 1 0.001% 99.991% ( 170, 250 ] 1 0.001% 99.992% ( 250, 380 ] 2 0.002% 99.994% ( 380, 580 ] 2 0.002% 99.996% ( 580, 870 ] 2 0.002% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 57538 Average: 3.4428 StdDev: 47.48 Min: 0 Median: 1.5644 Max: 3588 Percentiles: P50: 1.56 P75: 1.95 P99: 6.39 P99.9: 33.87 P99.99: 2430.77 ------------------------------------------------------ [ 0, 1 ] 7974 13.859% 13.859% ### ( 1, 2 ] 36843 64.032% 77.891% ############# ( 2, 3 ] 6822 11.857% 89.748% ## ( 3, 4 ] 2924 5.082% 94.830% # ( 4, 6 ] 2356 4.095% 98.924% # ( 6, 10 ] 451 0.784% 99.708% ( 10, 15 ] 50 0.087% 99.795% ( 15, 22 ] 10 0.017% 99.812% ( 22, 34 ] 51 0.089% 99.901% ( 51, 76 ] 1 0.002% 99.903% ( 110, 170 ] 3 0.005% 99.908% ( 170, 250 ] 6 0.010% 99.918% ( 250, 380 ] 8 0.014% 99.932% ( 380, 580 ] 4 0.007% 99.939% ( 580, 870 ] 13 0.023% 99.962% ( 870, 1300 ] 10 0.017% 99.979% ( 1300, 1900 ] 2 0.003% 99.983% ( 1900, 2900 ] 8 0.014% 99.997% ( 2900, 4400 ] 5 0.009% 100.005% ** Level 4 read latency histogram (micros): Count: 35 Average: 1849.8571 StdDev: 1712.87 Min: 215 Median: 1171.0000 Max: 6476 Percentiles: P50: 1171.00 P75: 2525.00 P99: 6446.00 P99.9: 6476.00 P99.99: 6476.00 ------------------------------------------------------ ( 170, 250 ] 2 5.714% 5.714% # ( 250, 380 ] 2 5.714% 11.429% # ( 380, 580 ] 2 5.714% 17.143% # ( 580, 870 ] 8 22.857% 40.000% ##### ( 870, 1300 ] 5 14.286% 54.286% ### ( 1300, 1900 ] 6 17.143% 71.429% ### ( 1900, 2900 ] 2 5.714% 77.143% # ( 2900, 4400 ] 3 8.571% 85.714% ## ( 4400, 6600 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 747.5500 StdDev: 1034.66 Min: 80 Median: 293.3333 Max: 4148 Percentiles: P50: 293.33 P75: 580.00 P99: 4100.00 P99.9: 4148.00 P99.99: 4148.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 2 10.000% 35.000% ## ( 170, 250 ] 2 10.000% 45.000% ## ( 250, 380 ] 3 15.000% 60.000% ### ( 380, 580 ] 3 15.000% 75.000% ### ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 323.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.589 H:M:S, 9.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.05 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.370 H:M:S, 12.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/02-19:17:29 ... thread 0: (1000000,3000000) ops and (338061.7,338493.2) ops/second in (2.958040,8.862807) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.15 GB 195.1 1.7 0.0 1.7 4.4 2.8 0.0 1.6 117.7 313.7 14.46 13.46 46 0.314 1727K 1772 0.0 0.0 L1 1/0 2.82 MB 0.3 0.4 0.4 0.0 0.4 0.4 0.2 1.0 245.4 244.9 1.54 1.50 1 1.540 383K 624 0.0 0.0 L2 2/0 55.27 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.4 2.0 246.6 246.4 1.53 1.48 2 0.766 383K 221 0.0 0.0 L3 42/0 997.66 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 203.5 203.3 3.91 3.42 3 1.304 808K 809 0.0 0.0 L4 144/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/4 98.90 GB 0.0 3.2 1.1 2.1 5.9 3.9 1.4 2.1 151.7 283.8 21.44 19.85 52 0.412 3303K 3426 0.0 0.0 Int 0/0 0.00 KB 0.0 3.2 1.1 2.1 5.9 3.9 1.3 2.1 151.7 283.8 21.44 19.85 52 0.412 3303K 3426 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.2 1.1 2.1 3.2 1.1 0.0 0.0 241.0 240.7 13.50 12.78 12 1.125 3303K 3426 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 356.9 7.94 7.07 40 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.94 GB write, 672.61 MB/s write, 3.18 GB read, 359.62 MB/s read, 21.4 seconds Interval compaction: 5.94 GB write, 686.38 MB/s write, 3.18 GB read, 366.98 MB/s read, 21.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 649726 Average: 1.9960 StdDev: 14.58 Min: 0 Median: 1.3371 Max: 4633 Percentiles: P50: 1.34 P75: 1.75 P99: 5.20 P99.9: 9.67 P99.99: 17.24 ------------------------------------------------------ [ 0, 1 ] 193200 29.736% 29.736% ###### ( 1, 2 ] 390627 60.122% 89.857% ############ ( 2, 3 ] 35745 5.502% 95.359% # ( 3, 4 ] 17869 2.750% 98.109% # ( 4, 6 ] 9681 1.490% 99.599% ( 6, 10 ] 2130 0.328% 99.927% ( 10, 15 ] 393 0.060% 99.988% ( 15, 22 ] 50 0.008% 99.995% ( 22, 34 ] 8 0.001% 99.996% ( 34, 51 ] 2 0.000% 99.997% ( 51, 76 ] 8 0.001% 99.998% ( 76, 110 ] 2 0.000% 99.998% ( 110, 170 ] 13 0.002% 100.000% ( 170, 250 ] 24 0.004% 100.004% ( 250, 380 ] 18 0.003% 100.007% ( 380, 580 ] 5 0.001% 100.008% ( 580, 870 ] 10 0.002% 100.009% ( 870, 1300 ] 5 0.001% 100.010% ( 1300, 1900 ] 7 0.001% 100.011% ( 1900, 2900 ] 6 0.001% 100.012% ( 2900, 4400 ] 4 0.001% 100.012% ( 4400, 6600 ] 1 0.000% 100.013% ** Level 1 read latency histogram (micros): Count: 81513 Average: 2.3223 StdDev: 4.86 Min: 1 Median: 1.5702 Max: 900 Percentiles: P50: 1.57 P75: 1.95 P99: 5.94 P99.9: 10.72 P99.99: 18.39 ------------------------------------------------------ [ 0, 1 ] 10524 12.911% 12.911% ### ( 1, 2 ] 53025 65.051% 77.962% ############# ( 2, 3 ] 9600 11.777% 89.739% ## ( 3, 4 ] 4320 5.300% 95.039% # ( 4, 6 ] 3328 4.083% 99.122% # ( 6, 10 ] 623 0.764% 99.886% ( 10, 15 ] 80 0.098% 99.984% ( 15, 22 ] 10 0.012% 99.996% ( 22, 34 ] 2 0.002% 99.999% ( 34, 51 ] 1 0.001% 100.000% ( 110, 170 ] 2 0.002% 100.002% ( 170, 250 ] 1 0.001% 100.004% ( 250, 380 ] 2 0.002% 100.006% ( 380, 580 ] 1 0.001% 100.007% ( 580, 870 ] 1 0.001% 100.009% ( 870, 1300 ] 1 0.001% 100.010% ** Level 2 read latency histogram (micros): Count: 95436 Average: 1.9567 StdDev: 8.81 Min: 0 Median: 1.3323 Max: 2063 Percentiles: P50: 1.33 P75: 1.75 P99: 5.25 P99.9: 9.51 P99.99: 91.52 ------------------------------------------------------ [ 0, 1 ] 28845 30.224% 30.224% ###### ( 1, 2 ] 56796 59.512% 89.737% ############ ( 2, 3 ] 5027 5.267% 95.004% # ( 3, 4 ] 2868 3.005% 98.009% # ( 4, 6 ] 1514 1.586% 99.596% ( 6, 10 ] 331 0.347% 99.942% ( 10, 15 ] 36 0.038% 99.980% ( 15, 22 ] 7 0.007% 99.987% ( 51, 76 ] 2 0.002% 99.990% ( 76, 110 ] 1 0.001% 99.991% ( 170, 250 ] 1 0.001% 99.992% ( 250, 380 ] 2 0.002% 99.994% ( 380, 580 ] 2 0.002% 99.996% ( 580, 870 ] 2 0.002% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 57538 Average: 3.4428 StdDev: 47.48 Min: 0 Median: 1.5644 Max: 3588 Percentiles: P50: 1.56 P75: 1.95 P99: 6.39 P99.9: 33.87 P99.99: 2430.77 ------------------------------------------------------ [ 0, 1 ] 7974 13.859% 13.859% ### ( 1, 2 ] 36843 64.032% 77.891% ############# ( 2, 3 ] 6822 11.857% 89.748% ## ( 3, 4 ] 2924 5.082% 94.830% # ( 4, 6 ] 2356 4.095% 98.924% # ( 6, 10 ] 451 0.784% 99.708% ( 10, 15 ] 50 0.087% 99.795% ( 15, 22 ] 10 0.017% 99.812% ( 22, 34 ] 51 0.089% 99.901% ( 51, 76 ] 1 0.002% 99.903% ( 110, 170 ] 3 0.005% 99.908% ( 170, 250 ] 6 0.010% 99.918% ( 250, 380 ] 8 0.014% 99.932% ( 380, 580 ] 4 0.007% 99.939% ( 580, 870 ] 13 0.023% 99.962% ( 870, 1300 ] 10 0.017% 99.979% ( 1300, 1900 ] 2 0.003% 99.983% ( 1900, 2900 ] 8 0.014% 99.997% ( 2900, 4400 ] 5 0.009% 100.005% ** Level 4 read latency histogram (micros): Count: 35 Average: 1849.8571 StdDev: 1712.87 Min: 215 Median: 1171.0000 Max: 6476 Percentiles: P50: 1171.00 P75: 2525.00 P99: 6446.00 P99.9: 6476.00 P99.99: 6476.00 ------------------------------------------------------ ( 170, 250 ] 2 5.714% 5.714% # ( 250, 380 ] 2 5.714% 11.429% # ( 380, 580 ] 2 5.714% 17.143% # ( 580, 870 ] 8 22.857% 40.000% ##### ( 870, 1300 ] 5 14.286% 54.286% ### ( 1300, 1900 ] 6 17.143% 71.429% ### ( 1900, 2900 ] 2 5.714% 77.143% # ( 2900, 4400 ] 3 8.571% 85.714% ## ( 4400, 6600 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 747.5500 StdDev: 1034.66 Min: 80 Median: 293.3333 Max: 4148 Percentiles: P50: 293.33 P75: 580.00 P99: 4100.00 P99.9: 4148.00 P99.99: 4148.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 2 10.000% 35.000% ## ( 170, 250 ] 2 10.000% 45.000% ## ( 250, 380 ] 3 15.000% 60.000% ### ( 380, 580 ] 3 15.000% 75.000% ### ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 326.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.923 H:M:S, 10.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.72 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.334 H:M:S, 11.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/02-19:17:33 ... thread 0: (1000000,4000000) ops and (308856.7,330563.4) ops/second in (3.237747,12.100554) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 3.13 GB 69.2 2.5 0.0 2.5 6.2 3.7 0.0 1.7 124.0 313.0 20.32 18.96 63 0.322 2558K 2660 0.0 0.0 L1 1/1 2.82 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 245.4 244.9 1.54 1.50 1 1.540 383K 624 0.0 0.0 L2 2/0 55.27 MB 0.6 0.4 0.2 0.2 0.4 0.2 0.4 2.0 246.6 246.4 1.53 1.48 2 0.766 383K 221 0.0 0.0 L3 42/0 997.66 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 203.5 203.3 3.91 3.42 3 1.304 808K 809 0.0 0.0 L4 144/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/16 99.88 GB 0.0 4.0 1.1 2.9 7.7 4.9 1.4 2.1 149.2 289.7 27.30 25.35 69 0.396 4134K 4314 0.0 0.0 Int 0/0 0.00 KB 0.0 4.0 1.1 2.9 7.7 4.9 1.3 2.1 149.2 289.7 27.30 25.35 69 0.396 4134K 4314 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.0 1.1 2.9 4.0 1.1 0.0 0.0 246.5 246.3 16.52 15.75 15 1.101 4134K 4314 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 356.4 10.78 9.60 54 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.72 GB write, 643.97 MB/s write, 3.98 GB read, 331.50 MB/s read, 27.3 seconds Interval compaction: 7.72 GB write, 653.62 MB/s write, 3.98 GB read, 336.47 MB/s read, 27.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 13, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1023378 Average: 2.0276 StdDev: 12.82 Min: 0 Median: 1.3722 Max: 4633 Percentiles: P50: 1.37 P75: 1.77 P99: 5.20 P99.9: 9.50 P99.99: 14.67 ------------------------------------------------------ [ 0, 1 ] 273916 26.766% 26.766% ##### ( 1, 2 ] 638749 62.416% 89.182% ############ ( 2, 3 ] 61775 6.036% 95.218% # ( 3, 4 ] 29439 2.877% 98.095% # ( 4, 6 ] 15471 1.512% 99.606% ( 6, 10 ] 3437 0.336% 99.942% ( 10, 15 ] 524 0.051% 99.993% ( 15, 22 ] 68 0.007% 100.000% ( 22, 34 ] 12 0.001% 100.001% ( 34, 51 ] 3 0.000% 100.002% ( 51, 76 ] 9 0.001% 100.002% ( 76, 110 ] 9 0.001% 100.003% ( 110, 170 ] 52 0.005% 100.008% ( 170, 250 ] 38 0.004% 100.012% ( 250, 380 ] 32 0.003% 100.015% ( 380, 580 ] 14 0.001% 100.017% ( 580, 870 ] 17 0.002% 100.018% ( 870, 1300 ] 9 0.001% 100.019% ( 1300, 1900 ] 8 0.001% 100.020% ( 1900, 2900 ] 9 0.001% 100.021% ( 2900, 4400 ] 4 0.000% 100.021% ( 4400, 6600 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 81514 Average: 2.3223 StdDev: 4.86 Min: 1 Median: 1.5702 Max: 900 Percentiles: P50: 1.57 P75: 1.95 P99: 5.94 P99.9: 10.72 P99.99: 18.39 ------------------------------------------------------ [ 0, 1 ] 10524 12.911% 12.911% ### ( 1, 2 ] 53025 65.050% 77.961% ############# ( 2, 3 ] 9601 11.778% 89.739% ## ( 3, 4 ] 4320 5.300% 95.039% # ( 4, 6 ] 3328 4.083% 99.122% # ( 6, 10 ] 623 0.764% 99.886% ( 10, 15 ] 80 0.098% 99.984% ( 15, 22 ] 10 0.012% 99.996% ( 22, 34 ] 2 0.002% 99.999% ( 34, 51 ] 1 0.001% 100.000% ( 110, 170 ] 2 0.002% 100.002% ( 170, 250 ] 1 0.001% 100.004% ( 250, 380 ] 2 0.002% 100.006% ( 380, 580 ] 1 0.001% 100.007% ( 580, 870 ] 1 0.001% 100.009% ( 870, 1300 ] 1 0.001% 100.010% ** Level 2 read latency histogram (micros): Count: 95436 Average: 1.9567 StdDev: 8.81 Min: 0 Median: 1.3323 Max: 2063 Percentiles: P50: 1.33 P75: 1.75 P99: 5.25 P99.9: 9.51 P99.99: 91.52 ------------------------------------------------------ [ 0, 1 ] 28845 30.224% 30.224% ###### ( 1, 2 ] 56796 59.512% 89.737% ############ ( 2, 3 ] 5027 5.267% 95.004% # ( 3, 4 ] 2868 3.005% 98.009% # ( 4, 6 ] 1514 1.586% 99.596% ( 6, 10 ] 331 0.347% 99.942% ( 10, 15 ] 36 0.038% 99.980% ( 15, 22 ] 7 0.007% 99.987% ( 51, 76 ] 2 0.002% 99.990% ( 76, 110 ] 1 0.001% 99.991% ( 170, 250 ] 1 0.001% 99.992% ( 250, 380 ] 2 0.002% 99.994% ( 380, 580 ] 2 0.002% 99.996% ( 580, 870 ] 2 0.002% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 57538 Average: 3.4428 StdDev: 47.48 Min: 0 Median: 1.5644 Max: 3588 Percentiles: P50: 1.56 P75: 1.95 P99: 6.39 P99.9: 33.87 P99.99: 2430.77 ------------------------------------------------------ [ 0, 1 ] 7974 13.859% 13.859% ### ( 1, 2 ] 36843 64.032% 77.891% ############# ( 2, 3 ] 6822 11.857% 89.748% ## ( 3, 4 ] 2924 5.082% 94.830% # ( 4, 6 ] 2356 4.095% 98.924% # ( 6, 10 ] 451 0.784% 99.708% ( 10, 15 ] 50 0.087% 99.795% ( 15, 22 ] 10 0.017% 99.812% ( 22, 34 ] 51 0.089% 99.901% ( 51, 76 ] 1 0.002% 99.903% ( 110, 170 ] 3 0.005% 99.908% ( 170, 250 ] 6 0.010% 99.918% ( 250, 380 ] 8 0.014% 99.932% ( 380, 580 ] 4 0.007% 99.939% ( 580, 870 ] 13 0.023% 99.962% ( 870, 1300 ] 10 0.017% 99.979% ( 1300, 1900 ] 2 0.003% 99.983% ( 1900, 2900 ] 8 0.014% 99.997% ( 2900, 4400 ] 5 0.009% 100.005% ** Level 4 read latency histogram (micros): Count: 35 Average: 1849.8571 StdDev: 1712.87 Min: 215 Median: 1171.0000 Max: 6476 Percentiles: P50: 1171.00 P75: 2525.00 P99: 6446.00 P99.9: 6476.00 P99.99: 6476.00 ------------------------------------------------------ ( 170, 250 ] 2 5.714% 5.714% # ( 250, 380 ] 2 5.714% 11.429% # ( 380, 580 ] 2 5.714% 17.143% # ( 580, 870 ] 8 22.857% 40.000% ##### ( 870, 1300 ] 5 14.286% 54.286% ### ( 1300, 1900 ] 6 17.143% 71.429% ### ( 1900, 2900 ] 2 5.714% 77.143% # ( 2900, 4400 ] 3 8.571% 85.714% ## ( 4400, 6600 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 747.5500 StdDev: 1034.66 Min: 80 Median: 293.3333 Max: 4148 Percentiles: P50: 293.33 P75: 580.00 P99: 4100.00 P99.9: 4148.00 P99.99: 4148.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 2 10.000% 35.000% ## ( 170, 250 ] 2 10.000% 45.000% ## ( 250, 380 ] 3 15.000% 60.000% ### ( 380, 580 ] 3 15.000% 75.000% ### ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.3 total, 3.2 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 320.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.494 H:M:S, 12.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 303.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.571 H:M:S, 17.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/02-19:17:40 ... thread 0: (1000000,5000000) ops and (141881.2,261114.3) ops/second in (7.048150,19.148704) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/7 1.90 GB 6.3 4.1 0.0 4.1 8.9 4.7 0.0 1.9 143.1 307.4 29.49 27.74 84 0.351 4285K 5327 0.0 0.0 L1 11/11 1.19 GB 0.0 2.6 2.6 0.0 2.6 2.6 0.2 1.0 232.7 230.5 11.37 10.99 2 5.687 2687K 24K 0.0 0.0 L2 2/0 55.27 MB 0.6 0.4 0.2 0.2 0.4 0.2 1.4 2.0 246.6 246.4 1.53 1.48 2 0.766 383K 221 0.0 0.0 L3 15/1 1.03 GB 0.9 0.8 0.6 0.2 0.8 0.6 1.1 1.4 203.5 203.3 3.91 3.42 3 1.304 808K 809 0.0 0.0 L4 167/4 9.50 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1263/23 100.84 GB 0.0 7.9 3.3 4.5 12.6 8.0 5.3 2.7 173.6 277.7 46.31 43.63 91 0.509 8164K 30K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.9 3.3 4.5 12.6 8.0 5.2 2.7 173.6 277.7 46.31 43.63 91 0.509 8164K 30K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.9 3.3 4.5 7.8 3.3 0.0 0.0 246.3 245.3 32.65 31.45 21 1.555 8164K 30K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 355.2 13.66 12.18 70 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.3 total, 19.2 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.56 GB write, 665.25 MB/s write, 7.85 GB read, 415.95 MB/s read, 46.3 seconds Interval compaction: 12.56 GB write, 671.55 MB/s write, 7.85 GB read, 419.89 MB/s read, 46.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 13, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1814230 Average: 2.0976 StdDev: 11.98 Min: 0 Median: 1.3870 Max: 4633 Percentiles: P50: 1.39 P75: 1.78 P99: 5.35 P99.9: 9.87 P99.99: 141.53 ------------------------------------------------------ [ 0, 1 ] 456828 25.180% 25.180% ##### ( 1, 2 ] 1163527 64.133% 89.314% ############# ( 2, 3 ] 107753 5.939% 95.253% # ( 3, 4 ] 50987 2.810% 98.063% # ( 4, 6 ] 25172 1.387% 99.451% ( 6, 10 ] 8424 0.464% 99.915% ( 10, 15 ] 790 0.044% 99.959% ( 15, 22 ] 115 0.006% 99.965% ( 22, 34 ] 19 0.001% 99.966% ( 34, 51 ] 4 0.000% 99.966% ( 51, 76 ] 13 0.001% 99.967% ( 76, 110 ] 241 0.013% 99.980% ( 110, 170 ] 336 0.019% 99.999% ( 170, 250 ] 143 0.008% 100.007% ( 250, 380 ] 97 0.005% 100.012% ( 380, 580 ] 71 0.004% 100.016% ( 580, 870 ] 61 0.003% 100.019% ( 870, 1300 ] 17 0.001% 100.020% ( 1300, 1900 ] 11 0.001% 100.021% ( 1900, 2900 ] 12 0.001% 100.022% ( 2900, 4400 ] 5 0.000% 100.022% ( 4400, 6600 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 92771 Average: 2.6703 StdDev: 17.88 Min: 0 Median: 1.5490 Max: 1665 Percentiles: P50: 1.55 P75: 1.93 P99: 5.95 P99.9: 88.93 P99.99: 843.20 ------------------------------------------------------ [ 0, 1 ] 13378 14.420% 14.420% ### ( 1, 2 ] 60128 64.813% 79.234% ############# ( 2, 3 ] 10441 11.255% 90.488% ## ( 3, 4 ] 4537 4.891% 95.379% # ( 4, 6 ] 3440 3.708% 99.087% # ( 6, 10 ] 653 0.704% 99.791% ( 10, 15 ] 82 0.088% 99.879% ( 15, 22 ] 10 0.011% 99.890% ( 22, 34 ] 2 0.002% 99.892% ( 34, 51 ] 1 0.001% 99.893% ( 76, 110 ] 19 0.020% 99.914% ( 110, 170 ] 35 0.038% 99.951% ( 170, 250 ] 5 0.005% 99.957% ( 250, 380 ] 16 0.017% 99.974% ( 380, 580 ] 13 0.014% 99.988% ( 580, 870 ] 3 0.003% 99.991% ( 870, 1300 ] 13 0.014% 100.005% ( 1300, 1900 ] 4 0.004% 100.010% ** Level 2 read latency histogram (micros): Count: 95436 Average: 1.9567 StdDev: 8.81 Min: 0 Median: 1.3323 Max: 2063 Percentiles: P50: 1.33 P75: 1.75 P99: 5.25 P99.9: 9.51 P99.99: 91.52 ------------------------------------------------------ [ 0, 1 ] 28845 30.224% 30.224% ###### ( 1, 2 ] 56796 59.512% 89.737% ############ ( 2, 3 ] 5027 5.267% 95.004% # ( 3, 4 ] 2868 3.005% 98.009% # ( 4, 6 ] 1514 1.586% 99.596% ( 6, 10 ] 331 0.347% 99.942% ( 10, 15 ] 36 0.038% 99.980% ( 15, 22 ] 7 0.007% 99.987% ( 51, 76 ] 2 0.002% 99.990% ( 76, 110 ] 1 0.001% 99.991% ( 170, 250 ] 1 0.001% 99.992% ( 250, 380 ] 2 0.002% 99.994% ( 380, 580 ] 2 0.002% 99.996% ( 580, 870 ] 2 0.002% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 60419 Average: 3.7656 StdDev: 47.89 Min: 0 Median: 1.5537 Max: 3588 Percentiles: P50: 1.55 P75: 1.95 P99: 7.54 P99.9: 333.64 P99.99: 2394.76 ------------------------------------------------------ [ 0, 1 ] 8942 14.800% 14.800% ### ( 1, 2 ] 38410 63.573% 78.373% ############# ( 2, 3 ] 6932 11.473% 89.846% ## ( 3, 4 ] 2969 4.914% 94.760% # ( 4, 6 ] 2371 3.924% 98.684% # ( 6, 10 ] 495 0.819% 99.503% ( 10, 15 ] 54 0.089% 99.593% ( 15, 22 ] 10 0.017% 99.609% ( 22, 34 ] 51 0.084% 99.694% ( 51, 76 ] 1 0.002% 99.695% ( 76, 110 ] 46 0.076% 99.772% ( 110, 170 ] 45 0.074% 99.846% ( 170, 250 ] 21 0.035% 99.881% ( 250, 380 ] 18 0.030% 99.911% ( 380, 580 ] 17 0.028% 99.939% ( 580, 870 ] 14 0.023% 99.962% ( 870, 1300 ] 10 0.017% 99.978% ( 1300, 1900 ] 3 0.005% 99.983% ( 1900, 2900 ] 8 0.013% 99.997% ( 2900, 4400 ] 5 0.008% 100.005% ** Level 4 read latency histogram (micros): Count: 35 Average: 1849.8571 StdDev: 1712.87 Min: 215 Median: 1171.0000 Max: 6476 Percentiles: P50: 1171.00 P75: 2525.00 P99: 6446.00 P99.9: 6476.00 P99.99: 6476.00 ------------------------------------------------------ ( 170, 250 ] 2 5.714% 5.714% # ( 250, 380 ] 2 5.714% 11.429% # ( 380, 580 ] 2 5.714% 17.143% # ( 580, 870 ] 8 22.857% 40.000% ##### ( 870, 1300 ] 5 14.286% 54.286% ### ( 1300, 1900 ] 6 17.143% 71.429% ### ( 1900, 2900 ] 2 5.714% 77.143% # ( 2900, 4400 ] 3 8.571% 85.714% ## ( 4400, 6600 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 80 Average: 626.0125 StdDev: 820.07 Min: 75 Median: 183.3333 Max: 4148 Percentiles: P50: 183.33 P75: 941.67 P99: 3200.00 P99.9: 4148.00 P99.99: 4148.00 ------------------------------------------------------ ( 51, 76 ] 1 1.250% 1.250% ( 76, 110 ] 16 20.000% 21.250% #### ( 110, 170 ] 22 27.500% 48.750% ###### ( 170, 250 ] 6 7.500% 56.250% ## ( 250, 380 ] 5 6.250% 62.500% # ( 380, 580 ] 5 6.250% 68.750% # ( 580, 870 ] 4 5.000% 73.750% # ( 870, 1300 ] 6 7.500% 81.250% ## ( 1300, 1900 ] 6 7.500% 88.750% ## ( 1900, 2900 ] 8 10.000% 98.750% ## ( 2900, 4400 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 19.3 total, 7.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 254.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.666 H:M:S, 29.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 139.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.172 H:M:S, 59.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/02-19:17:43 ... thread 0: (1000000,6000000) ops and (327482.9,270242.3) ops/second in (3.053595,22.202299) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/11 2.83 GB 75.5 4.7 0.0 4.7 10.3 5.7 0.0 1.8 139.4 308.0 34.33 32.25 99 0.347 4860K 5934 0.0 0.0 L1 11/11 1.19 GB 0.0 2.6 2.6 0.0 2.6 2.6 0.2 1.0 232.7 230.5 11.37 10.99 2 5.687 2687K 24K 0.0 0.0 L2 2/0 55.27 MB 0.6 0.4 0.2 0.2 0.4 0.2 1.4 2.0 246.6 246.4 1.53 1.48 2 0.766 383K 221 0.0 0.0 L3 14/0 926.11 MB 0.9 0.8 0.6 0.2 0.8 0.6 1.1 1.4 203.5 203.3 3.91 3.42 3 1.304 808K 809 0.0 0.0 L4 167/0 9.62 GB 1.0 0.2 0.1 0.0 0.2 0.1 1.3 1.3 208.0 207.0 0.81 0.73 1 0.805 170K 837 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/22 101.76 GB 0.0 8.6 3.4 5.1 14.2 9.1 5.3 2.5 168.9 279.8 51.96 48.87 107 0.486 8910K 32K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.6 3.4 5.1 14.2 9.1 5.2 2.5 168.9 279.8 51.96 48.87 107 0.486 8910K 32K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.6 3.4 5.1 8.5 3.4 0.0 0.0 246.4 245.4 35.62 34.31 24 1.484 8910K 32K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 354.8 16.34 14.56 83 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.4 total, 22.2 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.20 GB write, 649.45 MB/s write, 8.57 GB read, 392.02 MB/s read, 52.0 seconds Interval compaction: 14.20 GB write, 654.76 MB/s write, 8.57 GB read, 395.22 MB/s read, 52.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 16, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2186511 Average: 2.1045 StdDev: 11.90 Min: 0 Median: 1.4010 Max: 4633 Percentiles: P50: 1.40 P75: 1.79 P99: 5.45 P99.9: 9.81 P99.99: 110.24 ------------------------------------------------------ [ 0, 1 ] 526429 24.076% 24.076% ##### ( 1, 2 ] 1413696 64.655% 88.732% ############# ( 2, 3 ] 137274 6.278% 95.010% # ( 3, 4 ] 64071 2.930% 97.940% # ( 4, 6 ] 32070 1.467% 99.407% ( 6, 10 ] 11315 0.517% 99.924% ( 10, 15 ] 1016 0.046% 99.971% ( 15, 22 ] 136 0.006% 99.977% ( 22, 34 ] 21 0.001% 99.978% ( 34, 51 ] 7 0.000% 99.978% ( 51, 76 ] 16 0.001% 99.979% ( 76, 110 ] 241 0.011% 99.990% ( 110, 170 ] 339 0.016% 100.005% ( 170, 250 ] 150 0.007% 100.012% ( 250, 380 ] 104 0.005% 100.017% ( 380, 580 ] 73 0.003% 100.020% ( 580, 870 ] 65 0.003% 100.023% ( 870, 1300 ] 20 0.001% 100.024% ( 1300, 1900 ] 11 0.001% 100.025% ( 1900, 2900 ] 14 0.001% 100.025% ( 2900, 4400 ] 7 0.000% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 115026 Average: 2.5503 StdDev: 16.06 Min: 0 Median: 1.5345 Max: 1665 Percentiles: P50: 1.53 P75: 1.92 P99: 5.87 P99.9: 14.94 P99.99: 628.08 ------------------------------------------------------ [ 0, 1 ] 17136 14.898% 14.898% ### ( 1, 2 ] 75538 65.670% 80.568% ############# ( 2, 3 ] 12389 10.771% 91.338% ## ( 3, 4 ] 5253 4.567% 95.905% # ( 4, 6 ] 3812 3.314% 99.219% # ( 6, 10 ] 700 0.609% 99.828% ( 10, 15 ] 84 0.073% 99.901% ( 15, 22 ] 10 0.009% 99.910% ( 22, 34 ] 3 0.003% 99.912% ( 34, 51 ] 1 0.001% 99.913% ( 76, 110 ] 19 0.017% 99.930% ( 110, 170 ] 35 0.030% 99.960% ( 170, 250 ] 5 0.004% 99.964% ( 250, 380 ] 16 0.014% 99.978% ( 380, 580 ] 13 0.011% 99.990% ( 580, 870 ] 3 0.003% 99.992% ( 870, 1300 ] 13 0.011% 100.003% ( 1300, 1900 ] 4 0.003% 100.007% ** Level 2 read latency histogram (micros): Count: 95436 Average: 1.9567 StdDev: 8.81 Min: 0 Median: 1.3323 Max: 2063 Percentiles: P50: 1.33 P75: 1.75 P99: 5.25 P99.9: 9.51 P99.99: 91.52 ------------------------------------------------------ [ 0, 1 ] 28845 30.224% 30.224% ###### ( 1, 2 ] 56796 59.512% 89.737% ############ ( 2, 3 ] 5027 5.267% 95.004% # ( 3, 4 ] 2868 3.005% 98.009% # ( 4, 6 ] 1514 1.586% 99.596% ( 6, 10 ] 331 0.347% 99.942% ( 10, 15 ] 36 0.038% 99.980% ( 15, 22 ] 7 0.007% 99.987% ( 51, 76 ] 2 0.002% 99.990% ( 76, 110 ] 1 0.001% 99.991% ( 170, 250 ] 1 0.001% 99.992% ( 250, 380 ] 2 0.002% 99.994% ( 380, 580 ] 2 0.002% 99.996% ( 580, 870 ] 2 0.002% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 67365 Average: 3.9300 StdDev: 46.46 Min: 0 Median: 1.5374 Max: 3588 Percentiles: P50: 1.54 P75: 1.93 P99: 8.40 P99.9: 374.28 P99.99: 2307.94 ------------------------------------------------------ [ 0, 1 ] 10787 16.013% 16.013% ### ( 1, 2 ] 42605 63.245% 79.258% ############# ( 2, 3 ] 7342 10.899% 90.157% ## ( 3, 4 ] 3166 4.700% 94.856% # ( 4, 6 ] 2433 3.612% 98.468% # ( 6, 10 ] 598 0.888% 99.356% ( 10, 15 ] 60 0.089% 99.445% ( 15, 22 ] 10 0.015% 99.460% ( 22, 34 ] 51 0.076% 99.535% ( 51, 76 ] 1 0.001% 99.537% ( 76, 110 ] 91 0.135% 99.672% ( 110, 170 ] 83 0.123% 99.795% ( 170, 250 ] 41 0.061% 99.856% ( 250, 380 ] 31 0.046% 99.902% ( 380, 580 ] 25 0.037% 99.939% ( 580, 870 ] 17 0.025% 99.964% ( 870, 1300 ] 11 0.016% 99.981% ( 1300, 1900 ] 3 0.004% 99.985% ( 1900, 2900 ] 8 0.012% 99.997% ( 2900, 4400 ] 5 0.007% 100.004% ** Level 4 read latency histogram (micros): Count: 55 Average: 1211.2909 StdDev: 1609.43 Min: 1 Median: 660.5556 Max: 6476 Percentiles: P50: 660.56 P75: 1525.00 P99: 6358.00 P99.9: 6476.00 P99.99: 6476.00 ------------------------------------------------------ [ 0, 1 ] 7 12.727% 12.727% ### ( 1, 2 ] 3 5.455% 18.182% # ( 2, 3 ] 2 3.636% 21.818% # ( 34, 51 ] 1 1.818% 23.636% ( 110, 170 ] 4 7.273% 30.909% # ( 170, 250 ] 2 3.636% 34.545% # ( 250, 380 ] 4 7.273% 41.818% # ( 380, 580 ] 2 3.636% 45.455% # ( 580, 870 ] 9 16.364% 61.818% ### ( 870, 1300 ] 5 9.091% 70.909% ## ( 1300, 1900 ] 6 10.909% 81.818% ## ( 1900, 2900 ] 2 3.636% 85.455% # ( 2900, 4400 ] 3 5.455% 90.909% # ( 4400, 6600 ] 5 9.091% 100.000% ## ** Level 5 read latency histogram (micros): Count: 80 Average: 626.0125 StdDev: 820.07 Min: 75 Median: 183.3333 Max: 4148 Percentiles: P50: 183.33 P75: 941.67 P99: 3200.00 P99.9: 4148.00 P99.99: 4148.00 ------------------------------------------------------ ( 51, 76 ] 1 1.250% 1.250% ( 76, 110 ] 16 20.000% 21.250% #### ( 110, 170 ] 22 27.500% 48.750% ###### ( 170, 250 ] 6 7.500% 56.250% ## ( 250, 380 ] 5 6.250% 62.500% # ( 380, 580 ] 5 6.250% 68.750% # ( 580, 870 ] 4 5.000% 73.750% # ( 870, 1300 ] 6 7.500% 81.250% ## ( 1300, 1900 ] 6 7.500% 88.750% ## ( 1900, 2900 ] 8 10.000% 98.750% ## ( 2900, 4400 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 22.4 total, 3.1 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 263.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.039 H:M:S, 27.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.31 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.372 H:M:S, 12.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/02-19:17:46 ... thread 0: (1000000,7000000) ops and (287052.9,272522.2) ops/second in (3.483678,25.685977) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 3.81 GB 176.2 5.7 0.0 5.7 12.4 6.6 0.0 1.9 142.0 306.7 41.26 38.78 118 0.350 5948K 7078 0.0 0.0 L1 11/11 1.19 GB 0.0 2.6 2.6 0.0 2.6 2.6 0.2 1.0 232.7 230.5 11.37 10.99 2 5.687 2687K 24K 0.0 0.0 L2 2/0 55.27 MB 0.6 0.4 0.2 0.2 0.4 0.2 1.4 2.0 246.6 246.4 1.53 1.48 2 0.766 383K 221 0.0 0.0 L3 14/0 926.11 MB 0.9 0.8 0.6 0.2 0.8 0.6 1.1 1.4 203.5 203.3 3.91 3.42 3 1.304 808K 809 0.0 0.0 L4 167/0 9.62 GB 1.0 0.2 0.1 0.0 0.2 0.1 1.3 1.3 208.0 207.0 0.81 0.73 1 0.805 170K 837 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1272/22 102.75 GB 0.0 9.6 3.4 6.2 16.2 10.1 5.3 2.4 167.2 282.2 58.88 55.40 126 0.467 9997K 33K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.6 3.4 6.2 16.2 10.1 5.2 2.4 167.2 282.2 58.88 55.40 126 0.467 9997K 33K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.6 3.4 6.2 9.6 3.4 0.0 0.0 248.3 247.4 39.66 38.29 28 1.416 9997K 33K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 354.0 19.22 17.11 98 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.9 total, 25.7 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.23 GB write, 642.31 MB/s write, 9.62 GB read, 380.62 MB/s read, 58.9 seconds Interval compaction: 16.23 GB write, 646.85 MB/s write, 9.62 GB read, 383.31 MB/s read, 58.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 18, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2531090 Average: 2.1164 StdDev: 11.65 Min: 0 Median: 1.4065 Max: 4633 Percentiles: P50: 1.41 P75: 1.79 P99: 5.47 P99.9: 9.83 P99.99: 114.47 ------------------------------------------------------ [ 0, 1 ] 597212 23.595% 23.595% ##### ( 1, 2 ] 1644034 64.954% 88.549% ############# ( 2, 3 ] 161647 6.386% 94.935% # ( 3, 4 ] 75046 2.965% 97.900% # ( 4, 6 ] 37784 1.493% 99.393% ( 6, 10 ] 13420 0.530% 99.923% ( 10, 15 ] 1200 0.047% 99.970% ( 15, 22 ] 145 0.006% 99.976% ( 22, 34 ] 26 0.001% 99.977% ( 34, 51 ] 8 0.000% 99.978% ( 51, 76 ] 19 0.001% 99.978% ( 76, 110 ] 268 0.011% 99.989% ( 110, 170 ] 388 0.015% 100.004% ( 170, 250 ] 193 0.008% 100.012% ( 250, 380 ] 129 0.005% 100.017% ( 380, 580 ] 100 0.004% 100.021% ( 580, 870 ] 79 0.003% 100.024% ( 870, 1300 ] 25 0.001% 100.025% ( 1300, 1900 ] 13 0.001% 100.026% ( 1900, 2900 ] 15 0.001% 100.026% ( 2900, 4400 ] 7 0.000% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 207170 Average: 2.5387 StdDev: 13.98 Min: 0 Median: 1.5152 Max: 1665 Percentiles: P50: 1.52 P75: 1.89 P99: 7.04 P99.9: 110.45 P99.99: 552.47 ------------------------------------------------------ [ 0, 1 ] 31941 15.418% 15.418% ### ( 1, 2 ] 139066 67.127% 82.544% ############# ( 2, 3 ] 19659 9.489% 92.034% ## ( 3, 4 ] 8292 4.003% 96.036% # ( 4, 6 ] 5572 2.690% 98.726% # ( 6, 10 ] 2192 1.058% 99.784% ( 10, 15 ] 133 0.064% 99.848% ( 15, 22 ] 19 0.009% 99.857% ( 22, 34 ] 4 0.002% 99.859% ( 34, 51 ] 1 0.000% 99.860% ( 51, 76 ] 2 0.001% 99.861% ( 76, 110 ] 81 0.039% 99.900% ( 110, 170 ] 111 0.054% 99.953% ( 170, 250 ] 22 0.011% 99.964% ( 250, 380 ] 31 0.015% 99.979% ( 380, 580 ] 27 0.013% 99.992% ( 580, 870 ] 7 0.003% 99.995% ( 870, 1300 ] 14 0.007% 100.002% ( 1300, 1900 ] 4 0.002% 100.004% ** Level 2 read latency histogram (micros): Count: 95436 Average: 1.9567 StdDev: 8.81 Min: 0 Median: 1.3323 Max: 2063 Percentiles: P50: 1.33 P75: 1.75 P99: 5.25 P99.9: 9.51 P99.99: 91.52 ------------------------------------------------------ [ 0, 1 ] 28845 30.224% 30.224% ###### ( 1, 2 ] 56796 59.512% 89.737% ############ ( 2, 3 ] 5027 5.267% 95.004% # ( 3, 4 ] 2868 3.005% 98.009% # ( 4, 6 ] 1514 1.586% 99.596% ( 6, 10 ] 331 0.347% 99.942% ( 10, 15 ] 36 0.038% 99.980% ( 15, 22 ] 7 0.007% 99.987% ( 51, 76 ] 2 0.002% 99.990% ( 76, 110 ] 1 0.001% 99.991% ( 170, 250 ] 1 0.001% 99.992% ( 250, 380 ] 2 0.002% 99.994% ( 380, 580 ] 2 0.002% 99.996% ( 580, 870 ] 2 0.002% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 67365 Average: 3.9300 StdDev: 46.46 Min: 0 Median: 1.5374 Max: 3588 Percentiles: P50: 1.54 P75: 1.93 P99: 8.40 P99.9: 374.28 P99.99: 2307.94 ------------------------------------------------------ [ 0, 1 ] 10787 16.013% 16.013% ### ( 1, 2 ] 42605 63.245% 79.258% ############# ( 2, 3 ] 7342 10.899% 90.157% ## ( 3, 4 ] 3166 4.700% 94.856% # ( 4, 6 ] 2433 3.612% 98.468% # ( 6, 10 ] 598 0.888% 99.356% ( 10, 15 ] 60 0.089% 99.445% ( 15, 22 ] 10 0.015% 99.460% ( 22, 34 ] 51 0.076% 99.535% ( 51, 76 ] 1 0.001% 99.537% ( 76, 110 ] 91 0.135% 99.672% ( 110, 170 ] 83 0.123% 99.795% ( 170, 250 ] 41 0.061% 99.856% ( 250, 380 ] 31 0.046% 99.902% ( 380, 580 ] 25 0.037% 99.939% ( 580, 870 ] 17 0.025% 99.964% ( 870, 1300 ] 11 0.016% 99.981% ( 1300, 1900 ] 3 0.004% 99.985% ( 1900, 2900 ] 8 0.012% 99.997% ( 2900, 4400 ] 5 0.007% 100.004% ** Level 4 read latency histogram (micros): Count: 55 Average: 1211.2909 StdDev: 1609.43 Min: 1 Median: 660.5556 Max: 6476 Percentiles: P50: 660.56 P75: 1525.00 P99: 6358.00 P99.9: 6476.00 P99.99: 6476.00 ------------------------------------------------------ [ 0, 1 ] 7 12.727% 12.727% ### ( 1, 2 ] 3 5.455% 18.182% # ( 2, 3 ] 2 3.636% 21.818% # ( 34, 51 ] 1 1.818% 23.636% ( 110, 170 ] 4 7.273% 30.909% # ( 170, 250 ] 2 3.636% 34.545% # ( 250, 380 ] 4 7.273% 41.818% # ( 380, 580 ] 2 3.636% 45.455% # ( 580, 870 ] 9 16.364% 61.818% ### ( 870, 1300 ] 5 9.091% 70.909% ## ( 1300, 1900 ] 6 10.909% 81.818% ## ( 1900, 2900 ] 2 3.636% 85.455% # ( 2900, 4400 ] 3 5.455% 90.909% # ( 4400, 6600 ] 5 9.091% 100.000% ## ** Level 5 read latency histogram (micros): Count: 80 Average: 626.0125 StdDev: 820.07 Min: 75 Median: 183.3333 Max: 4148 Percentiles: P50: 183.33 P75: 941.67 P99: 3200.00 P99.9: 4148.00 P99.99: 4148.00 ------------------------------------------------------ ( 51, 76 ] 1 1.250% 1.250% ( 76, 110 ] 16 20.000% 21.250% #### ( 110, 170 ] 22 27.500% 48.750% ###### ( 170, 250 ] 6 7.500% 56.250% ## ( 250, 380 ] 5 6.250% 62.500% # ( 380, 580 ] 5 6.250% 68.750% # ( 580, 870 ] 4 5.000% 73.750% # ( 870, 1300 ] 6 7.500% 81.250% ## ( 1300, 1900 ] 6 7.500% 88.750% ## ( 1900, 2900 ] 8 10.000% 98.750% ## ( 2900, 4400 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 25.9 total, 3.5 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 266.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.816 H:M:S, 26.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 282.51 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.777 H:M:S, 22.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/02-19:17:58 ... thread 0: (1000000,8000000) ops and (86124.9,214494.3) ops/second in (11.611050,37.297027) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/8 2.89 GB 107.0 7.0 0.0 7.0 14.6 7.6 0.0 1.9 139.8 290.5 51.36 46.22 133 0.386 7290K 9973 0.0 0.0 L1 6/0 615.92 MB 61.6 5.6 4.4 1.2 5.6 4.4 0.2 1.3 230.4 227.9 24.95 24.03 3 8.316 5836K 62K 0.0 0.0 L2 3/3 386.33 MB 0.0 0.4 0.2 0.2 0.4 0.2 3.8 2.0 246.6 246.4 1.53 1.48 2 0.766 383K 221 0.0 0.0 L3 24/8 1.22 GB 0.9 2.1 1.1 1.0 2.1 1.1 2.6 1.9 136.3 135.7 15.86 9.89 8 1.982 2195K 9360 0.0 0.0 L4 165/0 9.69 GB 1.0 2.3 1.9 0.4 2.3 1.9 1.3 1.2 117.8 117.2 19.76 10.76 21 0.941 2315K 10K 0.0 0.0 L5 1080/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1292/19 103.61 GB 0.0 17.4 7.6 9.8 24.9 15.1 10.9 3.3 156.8 224.3 113.46 92.39 167 0.679 18M 92K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.4 7.6 9.8 24.9 15.1 10.8 3.3 156.8 224.3 113.46 92.39 167 0.679 18M 92K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.4 7.6 9.8 17.3 7.5 0.0 0.0 199.8 198.8 89.06 72.66 57 1.562 18M 92K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 317.5 24.41 19.73 110 0.222 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 37.5 total, 37.3 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.85 GB write, 679.02 MB/s write, 17.38 GB read, 474.82 MB/s read, 113.5 seconds Interval compaction: 24.85 GB write, 682.33 MB/s write, 17.38 GB read, 477.13 MB/s read, 113.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 44, interval: 67 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3506110 Average: 2.3536 StdDev: 25.81 Min: 0 Median: 1.4374 Max: 9824 Percentiles: P50: 1.44 P75: 1.83 P99: 5.89 P99.9: 11.99 P99.99: 156.37 ------------------------------------------------------ [ 0, 1 ] 767178 21.881% 21.881% #### ( 1, 2 ] 2253921 64.286% 86.167% ############# ( 2, 3 ] 251364 7.169% 93.336% # ( 3, 4 ] 124639 3.555% 96.891% # ( 4, 6 ] 78102 2.228% 99.119% ( 6, 10 ] 26270 0.749% 99.868% ( 10, 15 ] 2835 0.081% 99.949% ( 15, 22 ] 348 0.010% 99.959% ( 22, 34 ] 39 0.001% 99.960% ( 34, 51 ] 12 0.000% 99.960% ( 51, 76 ] 24 0.001% 99.961% ( 76, 110 ] 506 0.014% 99.975% ( 110, 170 ] 676 0.019% 99.994% ( 170, 250 ] 285 0.008% 100.003% ( 250, 380 ] 212 0.006% 100.009% ( 380, 580 ] 181 0.005% 100.014% ( 580, 870 ] 154 0.004% 100.018% ( 870, 1300 ] 67 0.002% 100.020% ( 1300, 1900 ] 37 0.001% 100.021% ( 1900, 2900 ] 54 0.002% 100.023% ( 2900, 4400 ] 58 0.002% 100.024% ( 4400, 6600 ] 19 0.001% 100.025% ( 6600, 9900 ] 6 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1098290 Average: 5.2507 StdDev: 87.29 Min: 0 Median: 1.7132 Max: 11405 Percentiles: P50: 1.71 P75: 2.54 P99: 9.17 P99.9: 82.83 P99.99: 295.51 ------------------------------------------------------ [ 0, 1 ] 93535 8.516% 8.516% ## ( 1, 2 ] 638838 58.167% 66.683% ############ ( 2, 3 ] 168988 15.386% 82.069% ### ( 3, 4 ] 84989 7.738% 89.808% ## ( 4, 6 ] 82338 7.497% 97.305% # ( 6, 10 ] 23497 2.139% 99.444% ( 10, 15 ] 4280 0.390% 99.834% ( 15, 22 ] 539 0.049% 99.883% ( 22, 34 ] 51 0.005% 99.888% ( 34, 51 ] 16 0.001% 99.889% ( 51, 76 ] 47 0.004% 99.893% ( 76, 110 ] 372 0.034% 99.927% ( 110, 170 ] 371 0.034% 99.961% ( 170, 250 ] 191 0.017% 99.978% ( 250, 380 ] 369 0.034% 100.012% ( 380, 580 ] 388 0.035% 100.047% ( 580, 870 ] 352 0.032% 100.079% ( 870, 1300 ] 233 0.021% 100.101% ( 1300, 1900 ] 156 0.014% 100.115% ( 1900, 2900 ] 145 0.013% 100.128% ( 2900, 4400 ] 208 0.019% 100.147% ( 4400, 6600 ] 77 0.007% 100.154% ( 6600, 9900 ] 28 0.003% 100.156% ( 9900, 14000 ] 2 0.000% 100.157% ** Level 2 read latency histogram (micros): Count: 95436 Average: 1.9567 StdDev: 8.81 Min: 0 Median: 1.3323 Max: 2063 Percentiles: P50: 1.33 P75: 1.75 P99: 5.25 P99.9: 9.51 P99.99: 91.52 ------------------------------------------------------ [ 0, 1 ] 28845 30.224% 30.224% ###### ( 1, 2 ] 56796 59.512% 89.737% ############ ( 2, 3 ] 5027 5.267% 95.004% # ( 3, 4 ] 2868 3.005% 98.009% # ( 4, 6 ] 1514 1.586% 99.596% ( 6, 10 ] 331 0.347% 99.942% ( 10, 15 ] 36 0.038% 99.980% ( 15, 22 ] 7 0.007% 99.987% ( 51, 76 ] 2 0.002% 99.990% ( 76, 110 ] 1 0.001% 99.991% ( 170, 250 ] 1 0.001% 99.992% ( 250, 380 ] 2 0.002% 99.994% ( 380, 580 ] 2 0.002% 99.996% ( 580, 870 ] 2 0.002% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 405249 Average: 11.5082 StdDev: 141.59 Min: 0 Median: 1.8223 Max: 11139 Percentiles: P50: 1.82 P75: 2.86 P99: 12.03 P99.9: 1191.84 P99.99: 1935.97 ------------------------------------------------------ [ 0, 1 ] 25318 6.248% 6.248% # ( 1, 2 ] 215635 53.210% 59.458% ########### ( 2, 3 ] 73148 18.050% 77.508% #### ( 3, 4 ] 40856 10.082% 87.590% ## ( 4, 6 ] 38136 9.411% 97.000% ## ( 6, 10 ] 7543 1.861% 98.862% ( 10, 15 ] 1385 0.342% 99.203% ( 15, 22 ] 148 0.037% 99.240% ( 22, 34 ] 67 0.017% 99.257% ( 34, 51 ] 4 0.001% 99.257% ( 51, 76 ] 5 0.001% 99.259% ( 76, 110 ] 104 0.026% 99.284% ( 110, 170 ] 193 0.048% 99.332% ( 170, 250 ] 246 0.061% 99.393% ( 250, 380 ] 384 0.095% 99.487% ( 380, 580 ] 607 0.150% 99.637% ( 580, 870 ] 699 0.172% 99.810% ( 870, 1300 ] 490 0.121% 99.931% ( 1300, 1900 ] 235 0.058% 99.989% ( 1900, 2900 ] 180 0.044% 100.033% ( 2900, 4400 ] 216 0.053% 100.086% ( 4400, 6600 ] 77 0.019% 100.105% ( 6600, 9900 ] 11 0.003% 100.108% ( 9900, 14000 ] 1 0.000% 100.108% ** Level 4 read latency histogram (micros): Count: 7837 Average: 20.9241 StdDev: 228.61 Min: 1 Median: 1.8266 Max: 6476 Percentiles: P50: 1.83 P75: 2.82 P99: 308.99 P99.9: 4684.29 P99.99: 6408.43 ------------------------------------------------------ [ 0, 1 ] 404 5.155% 5.155% # ( 1, 2 ] 4252 54.255% 59.410% ########### ( 2, 3 ] 1490 19.012% 78.423% #### ( 3, 4 ] 788 10.055% 88.478% ## ( 4, 6 ] 636 8.115% 96.593% ## ( 6, 10 ] 111 1.416% 98.009% ( 10, 15 ] 19 0.242% 98.252% ( 15, 22 ] 5 0.064% 98.316% ( 22, 34 ] 3 0.038% 98.354% ( 34, 51 ] 9 0.115% 98.469% ( 76, 110 ] 2 0.026% 98.494% ( 110, 170 ] 12 0.153% 98.647% ( 170, 250 ] 24 0.306% 98.954% ( 250, 380 ] 8 0.102% 99.056% ( 380, 580 ] 8 0.102% 99.158% ( 580, 870 ] 15 0.191% 99.349% ( 870, 1300 ] 18 0.230% 99.579% ( 1300, 1900 ] 12 0.153% 99.732% ( 1900, 2900 ] 7 0.089% 99.821% ( 2900, 4400 ] 5 0.064% 99.885% ( 4400, 6600 ] 9 0.115% 100.000% ** Level 5 read latency histogram (micros): Count: 180 Average: 1253.1000 StdDev: 1506.84 Min: 75 Median: 619.5455 Max: 9354 Percentiles: P50: 619.55 P75: 1723.53 P99: 6424.00 P99.9: 9306.00 P99.99: 9354.00 ------------------------------------------------------ ( 51, 76 ] 1 0.556% 0.556% ( 76, 110 ] 16 8.889% 9.444% ## ( 110, 170 ] 24 13.333% 22.778% ### ( 170, 250 ] 7 3.889% 26.667% # ( 250, 380 ] 13 7.222% 33.889% # ( 380, 580 ] 26 14.444% 48.333% ### ( 580, 870 ] 22 12.222% 60.556% ## ( 870, 1300 ] 14 7.778% 68.333% ## ( 1300, 1900 ] 17 9.444% 77.778% ## ( 1900, 2900 ] 15 8.333% 86.111% ## ( 2900, 4400 ] 14 7.778% 93.889% ## ( 4400, 6600 ] 10 5.556% 99.444% # ( 6600, 9900 ] 1 0.556% 100.000% ** DB Stats ** Uptime(secs): 37.5 total, 11.6 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 210.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.132 H:M:S, 40.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 84.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:8.316 H:M:S, 71.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/11/02-19:18:01 ... thread 0: (1000000,9000000) ops and (306969.7,221922.6) ops/second in (3.257650,40.554677) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/11 3.86 GB 12.6 9.7 0.0 9.7 18.2 8.5 0.0 2.1 150.0 281.8 66.30 59.48 152 0.436 10M 18K 0.0 0.0 L1 6/6 615.92 MB 0.0 5.6 4.4 1.2 5.6 4.4 0.2 1.3 230.4 227.9 24.95 24.03 3 8.316 5836K 62K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 3.8 2.0 246.6 246.4 1.53 1.48 2 0.766 383K 221 0.0 0.0 L3 17/0 917.15 MB 0.9 2.8 1.5 1.3 2.8 1.5 2.6 1.9 143.5 142.8 20.09 13.21 11 1.827 2929K 14K 0.0 0.0 L4 160/0 9.40 GB 1.0 3.1 2.6 0.5 3.1 2.5 1.3 1.2 129.8 129.2 24.48 14.66 31 0.790 3168K 14K 0.0 0.0 L5 1092/0 89.81 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1288/17 104.58 GB 0.0 21.6 8.7 13.0 30.1 17.1 11.9 3.5 161.2 224.1 137.36 112.87 199 0.690 22M 110K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.6 8.7 13.0 30.1 17.1 11.8 3.5 161.2 224.1 137.36 112.87 199 0.690 22M 110K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.6 8.7 13.0 21.5 8.6 0.0 0.0 201.5 200.4 109.88 90.62 75 1.465 22M 110K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 318.7 27.48 22.25 124 0.222 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 40.7 total, 40.6 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.06 GB write, 755.57 MB/s write, 21.62 GB read, 543.40 MB/s read, 137.4 seconds Interval compaction: 30.06 GB write, 758.95 MB/s write, 21.62 GB read, 545.83 MB/s read, 137.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 54, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 54, interval: 77 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3744580 Average: 2.3716 StdDev: 25.83 Min: 0 Median: 1.4376 Max: 9824 Percentiles: P50: 1.44 P75: 1.83 P99: 5.89 P99.9: 12.49 P99.99: 167.41 ------------------------------------------------------ [ 0, 1 ] 822478 21.964% 21.964% #### ( 1, 2 ] 2398933 64.064% 86.029% ############# ( 2, 3 ] 269788 7.205% 93.233% # ( 3, 4 ] 135097 3.608% 96.841% # ( 4, 6 ] 85528 2.284% 99.125% ( 6, 10 ] 27499 0.734% 99.860% ( 10, 15 ] 3038 0.081% 99.941% ( 15, 22 ] 378 0.010% 99.951% ( 22, 34 ] 42 0.001% 99.952% ( 34, 51 ] 12 0.000% 99.952% ( 51, 76 ] 26 0.001% 99.953% ( 76, 110 ] 600 0.016% 99.969% ( 110, 170 ] 822 0.022% 99.991% ( 170, 250 ] 326 0.009% 100.000% ( 250, 380 ] 254 0.007% 100.006% ( 380, 580 ] 218 0.006% 100.012% ( 580, 870 ] 175 0.005% 100.017% ( 870, 1300 ] 79 0.002% 100.019% ( 1300, 1900 ] 40 0.001% 100.020% ( 1900, 2900 ] 57 0.002% 100.022% ( 2900, 4400 ] 65 0.002% 100.023% ( 4400, 6600 ] 20 0.001% 100.024% ( 6600, 9900 ] 6 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1152594 Average: 5.1467 StdDev: 85.34 Min: 0 Median: 1.7112 Max: 11405 Percentiles: P50: 1.71 P75: 2.53 P99: 9.16 P99.9: 84.28 P99.99: 300.60 ------------------------------------------------------ [ 0, 1 ] 97698 8.476% 8.476% ## ( 1, 2 ] 672914 58.383% 66.859% ############ ( 2, 3 ] 177303 15.383% 82.242% ### ( 3, 4 ] 88317 7.662% 89.904% ## ( 4, 6 ] 85333 7.404% 97.308% # ( 6, 10 ] 24652 2.139% 99.447% ( 10, 15 ] 4453 0.386% 99.833% ( 15, 22 ] 554 0.048% 99.881% ( 22, 34 ] 55 0.005% 99.886% ( 34, 51 ] 17 0.001% 99.887% ( 51, 76 ] 47 0.004% 99.891% ( 76, 110 ] 404 0.035% 99.927% ( 110, 170 ] 386 0.033% 99.960% ( 170, 250 ] 199 0.017% 99.977% ( 250, 380 ] 377 0.033% 100.010% ( 380, 580 ] 391 0.034% 100.044% ( 580, 870 ] 357 0.031% 100.075% ( 870, 1300 ] 240 0.021% 100.096% ( 1300, 1900 ] 158 0.014% 100.109% ( 1900, 2900 ] 146 0.013% 100.122% ( 2900, 4400 ] 208 0.018% 100.140% ( 4400, 6600 ] 77 0.007% 100.147% ( 6600, 9900 ] 28 0.002% 100.149% ( 9900, 14000 ] 2 0.000% 100.149% ** Level 2 read latency histogram (micros): Count: 95436 Average: 1.9567 StdDev: 8.81 Min: 0 Median: 1.3323 Max: 2063 Percentiles: P50: 1.33 P75: 1.75 P99: 5.25 P99.9: 9.51 P99.99: 91.52 ------------------------------------------------------ [ 0, 1 ] 28845 30.224% 30.224% ###### ( 1, 2 ] 56796 59.512% 89.737% ############ ( 2, 3 ] 5027 5.267% 95.004% # ( 3, 4 ] 2868 3.005% 98.009% # ( 4, 6 ] 1514 1.586% 99.596% ( 6, 10 ] 331 0.347% 99.942% ( 10, 15 ] 36 0.038% 99.980% ( 15, 22 ] 7 0.007% 99.987% ( 51, 76 ] 2 0.002% 99.990% ( 76, 110 ] 1 0.001% 99.991% ( 170, 250 ] 1 0.001% 99.992% ( 250, 380 ] 2 0.002% 99.994% ( 380, 580 ] 2 0.002% 99.996% ( 580, 870 ] 2 0.002% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 611529 Average: 9.6022 StdDev: 127.52 Min: 0 Median: 1.8222 Max: 13360 Percentiles: P50: 1.82 P75: 2.85 P99: 9.80 P99.9: 829.42 P99.99: 1173.63 ------------------------------------------------------ [ 0, 1 ] 34101 5.576% 5.576% # ( 1, 2 ] 330407 54.030% 59.606% ########### ( 2, 3 ] 110746 18.110% 77.716% #### ( 3, 4 ] 61866 10.117% 87.832% ## ( 4, 6 ] 57791 9.450% 97.283% ## ( 6, 10 ] 11058 1.808% 99.091% ( 10, 15 ] 1900 0.311% 99.402% ( 15, 22 ] 203 0.033% 99.435% ( 22, 34 ] 77 0.013% 99.447% ( 34, 51 ] 5 0.001% 99.448% ( 51, 76 ] 6 0.001% 99.449% ( 76, 110 ] 135 0.022% 99.471% ( 110, 170 ] 264 0.043% 99.514% ( 170, 250 ] 360 0.059% 99.573% ( 250, 380 ] 496 0.081% 99.654% ( 380, 580 ] 780 0.128% 99.782% ( 580, 870 ] 840 0.137% 99.919% ( 870, 1300 ] 613 0.100% 100.019% ( 1300, 1900 ] 264 0.043% 100.063% ( 1900, 2900 ] 202 0.033% 100.096% ( 2900, 4400 ] 228 0.037% 100.133% ( 4400, 6600 ] 82 0.013% 100.146% ( 6600, 9900 ] 15 0.002% 100.149% ( 9900, 14000 ] 7 0.001% 100.150% ** Level 4 read latency histogram (micros): Count: 16257 Average: 15.5337 StdDev: 177.66 Min: 1 Median: 1.7308 Max: 6476 Percentiles: P50: 1.73 P75: 2.62 P99: 228.71 P99.9: 3357.17 P99.99: 6242.35 ------------------------------------------------------ [ 0, 1 ] 1364 8.390% 8.390% ## ( 1, 2 ] 9256 56.935% 65.326% ########### ( 2, 3 ] 2534 15.587% 80.913% ### ( 3, 4 ] 1394 8.575% 89.488% ## ( 4, 6 ] 1109 6.822% 96.309% # ( 6, 10 ] 265 1.630% 97.939% ( 10, 15 ] 27 0.166% 98.105% ( 15, 22 ] 10 0.062% 98.167% ( 22, 34 ] 7 0.043% 98.210% ( 34, 51 ] 11 0.068% 98.278% ( 76, 110 ] 41 0.252% 98.530% ( 110, 170 ] 39 0.240% 98.770% ( 170, 250 ] 51 0.314% 99.083% ( 250, 380 ] 31 0.191% 99.274% ( 380, 580 ] 28 0.172% 99.446% ( 580, 870 ] 27 0.166% 99.612% ( 870, 1300 ] 20 0.123% 99.735% ( 1300, 1900 ] 14 0.086% 99.822% ( 1900, 2900 ] 10 0.062% 99.883% ( 2900, 4400 ] 9 0.055% 99.938% ( 4400, 6600 ] 10 0.062% 100.000% ** Level 5 read latency histogram (micros): Count: 240 Average: 1175.8833 StdDev: 1422.04 Min: 75 Median: 589.6667 Max: 9354 Percentiles: P50: 589.67 P75: 1627.27 P99: 6320.00 P99.9: 9108.00 P99.99: 9354.00 ------------------------------------------------------ ( 51, 76 ] 1 0.417% 0.417% ( 76, 110 ] 19 7.917% 8.333% ## ( 110, 170 ] 36 15.000% 23.333% ### ( 170, 250 ] 12 5.000% 28.333% # ( 250, 380 ] 21 8.750% 37.083% ## ( 380, 580 ] 30 12.500% 49.583% ### ( 580, 870 ] 30 12.500% 62.083% ### ( 870, 1300 ] 19 7.917% 70.000% ## ( 1300, 1900 ] 22 9.167% 79.167% ## ( 1900, 2900 ] 20 8.333% 87.500% ## ( 2900, 4400 ] 18 7.500% 95.000% ## ( 4400, 6600 ] 11 4.583% 99.583% # ( 6600, 9900 ] 1 0.417% 100.000% ** DB Stats ** Uptime(secs): 40.7 total, 3.3 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 217.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.712 H:M:S, 38.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 302.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.580 H:M:S, 17.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/02-19:18:04 ... thread 0: (1000000,10000000) ops and (304430.9,228104.8) ops/second in (3.284818,43.839495) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 4.85 GB 113.3 10.5 0.0 10.5 20.0 9.5 0.0 2.1 149.0 283.8 72.26 65.07 169 0.428 10M 19K 0.0 0.0 L1 6/6 615.92 MB 0.0 5.6 4.4 1.2 5.6 4.4 0.2 1.3 230.4 227.9 24.95 24.03 3 8.316 5836K 62K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 3.8 2.0 246.6 246.4 1.53 1.48 2 0.766 383K 221 0.0 0.0 L3 17/0 917.15 MB 0.9 2.8 1.5 1.3 2.8 1.5 2.6 1.9 143.5 142.8 20.09 13.21 11 1.827 2929K 14K 0.0 0.0 L4 160/0 9.40 GB 1.0 3.1 2.6 0.5 3.1 2.5 1.3 1.2 129.8 129.2 24.48 14.66 31 0.790 3168K 14K 0.0 0.0 L5 1092/0 89.81 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1293/17 105.56 GB 0.0 22.4 8.7 13.8 31.8 18.1 11.9 3.3 160.2 227.5 143.32 118.46 216 0.664 23M 110K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.4 8.7 13.8 31.8 18.1 11.8 3.3 160.2 227.5 143.32 118.46 216 0.664 23M 110K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.4 8.7 13.8 22.3 8.6 0.0 0.0 203.2 202.2 112.98 93.67 78 1.448 23M 110K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 321.9 30.34 24.79 138 0.220 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 44.0 total, 43.8 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.84 GB write, 740.67 MB/s write, 22.42 GB read, 521.45 MB/s read, 143.3 seconds Interval compaction: 31.84 GB write, 743.73 MB/s write, 22.42 GB read, 523.61 MB/s read, 143.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 22, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 22, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 57, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 26, total-stops: 57, interval: 83 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4142700 Average: 2.3506 StdDev: 24.76 Min: 0 Median: 1.4412 Max: 9824 Percentiles: P50: 1.44 P75: 1.83 P99: 5.88 P99.9: 11.97 P99.99: 157.47 ------------------------------------------------------ [ 0, 1 ] 894494 21.592% 21.592% #### ( 1, 2 ] 2667186 64.383% 85.975% ############# ( 2, 3 ] 303845 7.334% 93.309% # ( 3, 4 ] 148455 3.584% 96.893% # ( 4, 6 ] 92968 2.244% 99.137% ( 6, 10 ] 30329 0.732% 99.869% ( 10, 15 ] 3253 0.079% 99.948% ( 15, 22 ] 400 0.010% 99.957% ( 22, 34 ] 44 0.001% 99.958% ( 34, 51 ] 15 0.000% 99.959% ( 51, 76 ] 30 0.001% 99.959% ( 76, 110 ] 604 0.015% 99.974% ( 110, 170 ] 839 0.020% 99.994% ( 170, 250 ] 335 0.008% 100.002% ( 250, 380 ] 261 0.006% 100.009% ( 380, 580 ] 230 0.006% 100.014% ( 580, 870 ] 178 0.004% 100.018% ( 870, 1300 ] 83 0.002% 100.020% ( 1300, 1900 ] 42 0.001% 100.022% ( 1900, 2900 ] 57 0.001% 100.023% ( 2900, 4400 ] 67 0.002% 100.025% ( 4400, 6600 ] 20 0.000% 100.025% ( 6600, 9900 ] 6 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1152594 Average: 5.1467 StdDev: 85.34 Min: 0 Median: 1.7112 Max: 11405 Percentiles: P50: 1.71 P75: 2.53 P99: 9.16 P99.9: 84.28 P99.99: 300.60 ------------------------------------------------------ [ 0, 1 ] 97698 8.476% 8.476% ## ( 1, 2 ] 672914 58.383% 66.859% ############ ( 2, 3 ] 177303 15.383% 82.242% ### ( 3, 4 ] 88317 7.662% 89.904% ## ( 4, 6 ] 85333 7.404% 97.308% # ( 6, 10 ] 24652 2.139% 99.447% ( 10, 15 ] 4453 0.386% 99.833% ( 15, 22 ] 554 0.048% 99.881% ( 22, 34 ] 55 0.005% 99.886% ( 34, 51 ] 17 0.001% 99.887% ( 51, 76 ] 47 0.004% 99.891% ( 76, 110 ] 404 0.035% 99.927% ( 110, 170 ] 386 0.033% 99.960% ( 170, 250 ] 199 0.017% 99.977% ( 250, 380 ] 377 0.033% 100.010% ( 380, 580 ] 391 0.034% 100.044% ( 580, 870 ] 357 0.031% 100.075% ( 870, 1300 ] 240 0.021% 100.096% ( 1300, 1900 ] 158 0.014% 100.109% ( 1900, 2900 ] 146 0.013% 100.122% ( 2900, 4400 ] 208 0.018% 100.140% ( 4400, 6600 ] 77 0.007% 100.147% ( 6600, 9900 ] 28 0.002% 100.149% ( 9900, 14000 ] 2 0.000% 100.149% ** Level 2 read latency histogram (micros): Count: 95436 Average: 1.9567 StdDev: 8.81 Min: 0 Median: 1.3323 Max: 2063 Percentiles: P50: 1.33 P75: 1.75 P99: 5.25 P99.9: 9.51 P99.99: 91.52 ------------------------------------------------------ [ 0, 1 ] 28845 30.224% 30.224% ###### ( 1, 2 ] 56796 59.512% 89.737% ############ ( 2, 3 ] 5027 5.267% 95.004% # ( 3, 4 ] 2868 3.005% 98.009% # ( 4, 6 ] 1514 1.586% 99.596% ( 6, 10 ] 331 0.347% 99.942% ( 10, 15 ] 36 0.038% 99.980% ( 15, 22 ] 7 0.007% 99.987% ( 51, 76 ] 2 0.002% 99.990% ( 76, 110 ] 1 0.001% 99.991% ( 170, 250 ] 1 0.001% 99.992% ( 250, 380 ] 2 0.002% 99.994% ( 380, 580 ] 2 0.002% 99.996% ( 580, 870 ] 2 0.002% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 611529 Average: 9.6022 StdDev: 127.52 Min: 0 Median: 1.8222 Max: 13360 Percentiles: P50: 1.82 P75: 2.85 P99: 9.80 P99.9: 829.42 P99.99: 1173.63 ------------------------------------------------------ [ 0, 1 ] 34101 5.576% 5.576% # ( 1, 2 ] 330407 54.030% 59.606% ########### ( 2, 3 ] 110746 18.110% 77.716% #### ( 3, 4 ] 61866 10.117% 87.832% ## ( 4, 6 ] 57791 9.450% 97.283% ## ( 6, 10 ] 11058 1.808% 99.091% ( 10, 15 ] 1900 0.311% 99.402% ( 15, 22 ] 203 0.033% 99.435% ( 22, 34 ] 77 0.013% 99.447% ( 34, 51 ] 5 0.001% 99.448% ( 51, 76 ] 6 0.001% 99.449% ( 76, 110 ] 135 0.022% 99.471% ( 110, 170 ] 264 0.043% 99.514% ( 170, 250 ] 360 0.059% 99.573% ( 250, 380 ] 496 0.081% 99.654% ( 380, 580 ] 780 0.128% 99.782% ( 580, 870 ] 840 0.137% 99.919% ( 870, 1300 ] 613 0.100% 100.019% ( 1300, 1900 ] 264 0.043% 100.063% ( 1900, 2900 ] 202 0.033% 100.096% ( 2900, 4400 ] 228 0.037% 100.133% ( 4400, 6600 ] 82 0.013% 100.146% ( 6600, 9900 ] 15 0.002% 100.149% ( 9900, 14000 ] 7 0.001% 100.150% ** Level 4 read latency histogram (micros): Count: 16257 Average: 15.5337 StdDev: 177.66 Min: 1 Median: 1.7308 Max: 6476 Percentiles: P50: 1.73 P75: 2.62 P99: 228.71 P99.9: 3357.17 P99.99: 6242.35 ------------------------------------------------------ [ 0, 1 ] 1364 8.390% 8.390% ## ( 1, 2 ] 9256 56.935% 65.326% ########### ( 2, 3 ] 2534 15.587% 80.913% ### ( 3, 4 ] 1394 8.575% 89.488% ## ( 4, 6 ] 1109 6.822% 96.309% # ( 6, 10 ] 265 1.630% 97.939% ( 10, 15 ] 27 0.166% 98.105% ( 15, 22 ] 10 0.062% 98.167% ( 22, 34 ] 7 0.043% 98.210% ( 34, 51 ] 11 0.068% 98.278% ( 76, 110 ] 41 0.252% 98.530% ( 110, 170 ] 39 0.240% 98.770% ( 170, 250 ] 51 0.314% 99.083% ( 250, 380 ] 31 0.191% 99.274% ( 380, 580 ] 28 0.172% 99.446% ( 580, 870 ] 27 0.166% 99.612% ( 870, 1300 ] 20 0.123% 99.735% ( 1300, 1900 ] 14 0.086% 99.822% ( 1900, 2900 ] 10 0.062% 99.883% ( 2900, 4400 ] 9 0.055% 99.938% ( 4400, 6600 ] 10 0.062% 100.000% ** Level 5 read latency histogram (micros): Count: 240 Average: 1175.8833 StdDev: 1422.04 Min: 75 Median: 589.6667 Max: 9354 Percentiles: P50: 589.67 P75: 1627.27 P99: 6320.00 P99.9: 9108.00 P99.99: 9354.00 ------------------------------------------------------ ( 51, 76 ] 1 0.417% 0.417% ( 76, 110 ] 19 7.917% 8.333% ## ( 110, 170 ] 36 15.000% 23.333% ### ( 170, 250 ] 12 5.000% 28.333% # ( 250, 380 ] 21 8.750% 37.083% ## ( 380, 580 ] 30 12.500% 49.583% ### ( 580, 870 ] 30 12.500% 62.083% ### ( 870, 1300 ] 19 7.917% 70.000% ## ( 1300, 1900 ] 22 9.167% 79.167% ## ( 1900, 2900 ] 20 8.333% 87.500% ## ( 2900, 4400 ] 18 7.500% 95.000% ## ( 4400, 6600 ] 11 4.583% 99.583% # ( 6600, 9900 ] 1 0.417% 100.000% ** DB Stats ** Uptime(secs): 44.0 total, 3.3 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 223.56 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.353 H:M:S, 37.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 299.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.641 H:M:S, 19.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.665 micros/op 176536 ops/sec 60.095 seconds 10608999 operations; 171.1 MB/s Microseconds per write: Count: 10608999 Average: 5.6646 StdDev: 447.43 Min: 1 Median: 1.7512 Max: 917538 Percentiles: P50: 1.75 P75: 2.77 P99: 8.93 P99.9: 1128.93 P99.99: 2657.90 ------------------------------------------------------ [ 0, 1 ] 1301322 12.266% 12.266% ## ( 1, 2 ] 5329374 50.234% 62.501% ########## ( 2, 3 ] 1720515 16.218% 78.718% ### ( 3, 4 ] 1474272 13.896% 92.615% ### ( 4, 6 ] 595406 5.612% 98.227% # ( 6, 10 ] 112163 1.057% 99.284% ( 10, 15 ] 32951 0.311% 99.595% ( 15, 22 ] 9500 0.090% 99.684% ( 22, 34 ] 2104 0.020% 99.704% ( 34, 51 ] 215 0.002% 99.706% ( 51, 76 ] 118 0.001% 99.707% ( 76, 110 ] 7070 0.067% 99.774% ( 110, 170 ] 3199 0.030% 99.804% ( 170, 250 ] 349 0.003% 99.807% ( 250, 380 ] 136 0.001% 99.809% ( 380, 580 ] 28 0.000% 99.809% ( 580, 870 ] 19 0.000% 99.809% ( 870, 1300 ] 16024 0.151% 99.960% ( 1300, 1900 ] 21 0.000% 99.960% ( 1900, 2900 ] 4159 0.039% 99.999% ( 2900, 4400 ] 25 0.000% 100.000% ( 4400, 6600 ] 5 0.000% 100.000% ( 6600, 9900 ] 2 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 11 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 198479 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10608999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10948486968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 492 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30808254 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31448134750 rocksdb.compact.write.bytes COUNT : 31262992344 rocksdb.flush.write.bytes COUNT : 10899378859 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 59 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 278 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10811588608 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4299776 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31546809824 rocksdb.non.last.level.read.count COUNT : 7622522 rocksdb.block.checksum.compute.count COUNT : 7621597 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.405472 P95 : 3.908793 P99 : 7.335518 P100 : 917535.000000 COUNT : 10608999 SUM : 55114761 rocksdb.compaction.times.micros P50 : 1076896.551724 P95 : 4230000.000000 P99 : 12257000.000000 P100 : 13573759.000000 COUNT : 83 SUM : 124716483 rocksdb.compaction.times.cpu_micros P50 : 945000.000000 P95 : 4090000.000000 P99 : 10514000.000000 P100 : 13042509.000000 COUNT : 83 SUM : 104707979 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 663.424658 P95 : 1288.533333 P99 : 155600.000000 P100 : 570333.000000 COUNT : 148 SUM : 995462 rocksdb.compaction.outfile.sync.micros P50 : 1045.071429 P95 : 142100.000000 P99 : 278275.000000 P100 : 278315.000000 COUNT : 313 SUM : 6401865 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 100.219178 P95 : 1557.142857 P99 : 4175.000000 P100 : 8532.000000 COUNT : 260 SUM : 85665 rocksdb.table.open.io.micros P50 : 1396.296296 P95 : 7892.500000 P99 : 12214.222222 P100 : 26499.000000 COUNT : 492 SUM : 1042490 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.531042 P95 : 7.069894 P99 : 10.482819 P100 : 13365.000000 COUNT : 7620138 SUM : 43105712 rocksdb.read.block.get.micros P50 : 392.844037 P95 : 3643.181818 P99 : 5910.080000 P100 : 9426.000000 COUNT : 984 SUM : 861337 rocksdb.write.raw.block.micros P50 : 0.512548 P95 : 0.973842 P99 : 2.811498 P100 : 19047.000000 COUNT : 10210925 SUM : 20106878 rocksdb.numfiles.in.singlecompaction P50 : 3.292683 P95 : 4.920000 P99 : 17.310000 P100 : 18.000000 COUNT : 134 SUM : 498 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558660 P95 : 1153.392010 P99 : 2441.040462 P100 : 917339.000000 COUNT : 192960 SUM : 30823073 rocksdb.sst.read.micros P50 : 1.503357 P95 : 4.064766 P99 : 8.131902 P100 : 13360.000000 COUNT : 7622640 SUM : 27711055 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10608999 SUM : 10948486968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 208431.372549 P95 : 376285.714286 P99 : 790400.000000 P100 : 1131566.000000 COUNT : 148 SUM : 32151276 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 312 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0