[2024-11-16 19:52:18.131945] Starting SPDK v25.01-pre git sha1 83e8405e4 / DPDK 24.03.0 initialization... [2024-11-16 19:52:18.132048] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1688140 ] Set seed to 1731783138129549 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-16 19:52:18.243967] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-16 19:52:18.350657] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-16 19:52:18.350702] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1688140' to capture a snapshot of events at runtime. [2024-11-16 19:52:18.350712] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-16 19:52:18.350723] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-16 19:52:18.350731] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1688140 for offline analysis/debug. [2024-11-16 19:52:18.351982] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Nov 16 19:52:26 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/16-19:52:29 ... thread 0: (1000000,1000000) ops and (342041.5,342041.5) ops/second in (2.923622,2.923622) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 440.98 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 352.8 2.50 2.24 12 0.208 0 0 0.0 0.0 L1 4/0 314.58 MB 31.5 0.3 0.2 0.1 0.3 0.2 0.2 1.2 258.7 258.4 1.22 1.18 1 1.218 319K 367 0.0 0.0 L2 1/0 959.89 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 257.0 256.9 0.49 0.47 1 0.490 127K 46 0.0 0.0 L3 17/0 866.57 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 229.3 229.3 0.55 0.49 1 0.545 126K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1188/4 97.00 GB 0.0 0.6 0.4 0.1 1.4 1.3 0.5 1.6 119.1 304.5 4.75 4.38 15 0.317 574K 413 0.0 0.0 Int 0/0 0.00 KB 0.0 0.6 0.4 0.1 1.4 1.3 0.4 1.6 119.1 304.5 4.75 4.38 15 0.317 574K 413 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.6 0.4 0.1 0.6 0.4 0.0 0.0 251.2 251.0 2.25 2.14 3 0.751 574K 413 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 352.8 2.50 2.24 12 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 2.9 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.41 GB write, 459.38 MB/s write, 0.55 GB read, 179.62 MB/s read, 4.8 seconds Interval compaction: 1.41 GB write, 494.81 MB/s write, 0.55 GB read, 193.47 MB/s read, 4.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 144016 Average: 2.0057 StdDev: 18.30 Min: 0 Median: 1.3681 Max: 6329 Percentiles: P50: 1.37 P75: 1.75 P99: 4.75 P99.9: 9.85 P99.99: 19.35 ------------------------------------------------------ [ 0, 1 ] 37316 25.911% 25.911% ##### ( 1, 2 ] 94241 65.438% 91.349% ############# ( 2, 3 ] 8025 5.572% 96.921% # ( 3, 4 ] 2475 1.719% 98.640% ( 4, 6 ] 1388 0.964% 99.604% ( 6, 10 ] 446 0.310% 99.913% ( 10, 15 ] 107 0.074% 99.988% ( 15, 22 ] 9 0.006% 99.994% ( 34, 51 ] 1 0.001% 99.994% ( 110, 170 ] 5 0.003% 99.998% ( 170, 250 ] 4 0.003% 100.001% ( 250, 380 ] 5 0.003% 100.004% ( 380, 580 ] 4 0.003% 100.007% ( 870, 1300 ] 4 0.003% 100.010% ( 1300, 1900 ] 1 0.001% 100.010% ( 4400, 6600 ] 1 0.001% 100.011% ** Level 1 read latency histogram (micros): Count: 25 Average: 552.5200 StdDev: 1299.74 Min: 1 Median: 1.9167 Max: 5630 Percentiles: P50: 1.92 P75: 325.83 P99: 5630.00 P99.9: 5630.00 P99.99: 5630.00 ------------------------------------------------------ [ 0, 1 ] 7 28.000% 28.000% ###### ( 1, 2 ] 6 24.000% 52.000% ##### ( 4, 6 ] 1 4.000% 56.000% # ( 110, 170 ] 2 8.000% 64.000% ## ( 170, 250 ] 1 4.000% 68.000% # ( 250, 380 ] 3 12.000% 80.000% ## ( 380, 580 ] 1 4.000% 84.000% # ( 870, 1300 ] 2 8.000% 92.000% ## ( 2900, 4400 ] 1 4.000% 96.000% # ( 4400, 6600 ] 1 4.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 31745 Average: 1.7979 StdDev: 9.93 Min: 0 Median: 1.2538 Max: 1733 Percentiles: P50: 1.25 P75: 1.66 P99: 3.72 P99.9: 8.91 P99.99: 20.78 ------------------------------------------------------ [ 0, 1 ] 10912 34.374% 34.374% ####### ( 1, 2 ] 19548 61.578% 95.952% ############ ( 2, 3 ] 734 2.312% 98.264% ( 3, 4 ] 324 1.021% 99.285% ( 4, 6 ] 148 0.466% 99.751% ( 6, 10 ] 65 0.205% 99.956% ( 10, 15 ] 10 0.032% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 1300, 1900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 1478.7125 StdDev: 2185.17 Min: 1 Median: 170.0000 Max: 7424 Percentiles: P50: 170.00 P75: 1900.00 P99: 7424.00 P99.9: 7424.00 P99.99: 7424.00 ------------------------------------------------------ [ 0, 1 ] 25 31.250% 31.250% ###### ( 1, 2 ] 4 5.000% 36.250% # ( 2, 3 ] 4 5.000% 41.250% # ( 3, 4 ] 1 1.250% 42.500% ( 4, 6 ] 3 3.750% 46.250% # ( 6, 10 ] 1 1.250% 47.500% ( 110, 170 ] 2 2.500% 50.000% # ( 170, 250 ] 1 1.250% 51.250% ( 250, 380 ] 3 3.750% 55.000% # ( 380, 580 ] 4 5.000% 60.000% # ( 580, 870 ] 2 2.500% 62.500% # ( 870, 1300 ] 7 8.750% 71.250% ## ( 1300, 1900 ] 3 3.750% 75.000% # ( 1900, 2900 ] 1 1.250% 76.250% ( 2900, 4400 ] 4 5.000% 81.250% # ( 4400, 6600 ] 12 15.000% 96.250% ### ( 6600, 9900 ] 3 3.750% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 3876.5714 StdDev: 1853.54 Min: 266 Median: 4175.0000 Max: 8099 Percentiles: P50: 4175.00 P75: 5539.29 P99: 8099.00 P99.9: 8099.00 P99.99: 8099.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 1 2.857% 5.714% # ( 870, 1300 ] 3 8.571% 14.286% ## ( 1300, 1900 ] 2 5.714% 20.000% # ( 1900, 2900 ] 2 5.714% 25.714% # ( 2900, 4400 ] 10 28.571% 54.286% ###### ( 4400, 6600 ] 14 40.000% 94.286% ######## ( 6600, 9900 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 312.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.388 H:M:S, 12.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 336.32 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.388 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/16-19:52:32 ... thread 0: (1000000,2000000) ops and (336506.1,339251.2) ops/second in (2.971714,5.895336) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 1.41 GB 56.6 0.8 0.0 0.8 2.6 1.8 0.0 1.4 98.2 324.8 8.34 7.72 29 0.287 831K 821 0.0 0.0 L1 4/4 314.58 MB 0.0 0.3 0.2 0.1 0.3 0.2 0.2 1.2 258.7 258.4 1.22 1.18 1 1.218 319K 367 0.0 0.0 L2 1/0 959.89 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 257.0 256.9 0.49 0.47 1 0.490 127K 46 0.0 0.0 L3 17/0 866.57 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 229.3 229.3 0.55 0.49 1 0.545 126K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1193/13 97.98 GB 0.0 1.4 0.4 0.9 3.2 2.3 0.5 1.7 130.8 309.1 10.59 9.86 32 0.331 1406K 1234 0.0 0.0 Int 0/0 0.00 KB 0.0 1.4 0.4 0.9 3.2 2.3 0.4 1.7 130.8 309.1 10.59 9.86 32 0.331 1406K 1234 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.4 0.4 0.9 1.4 0.4 0.0 0.0 260.8 260.6 5.31 5.14 6 0.885 1406K 1234 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 358.0 5.28 4.72 26 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.20 GB write, 534.66 MB/s write, 1.35 GB read, 226.21 MB/s read, 10.6 seconds Interval compaction: 3.20 GB write, 555.11 MB/s write, 1.35 GB read, 234.86 MB/s read, 10.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 419553 Average: 2.1502 StdDev: 14.37 Min: 0 Median: 1.4690 Max: 6329 Percentiles: P50: 1.47 P75: 1.84 P99: 5.40 P99.9: 9.98 P99.99: 14.41 ------------------------------------------------------ [ 0, 1 ] 78601 18.734% 18.734% #### ( 1, 2 ] 279678 66.661% 85.395% ############# ( 2, 3 ] 41319 9.848% 95.244% ## ( 3, 4 ] 10932 2.606% 97.849% # ( 4, 6 ] 6877 1.639% 99.489% ( 6, 10 ] 1737 0.414% 99.903% ( 10, 15 ] 417 0.099% 100.002% ( 15, 22 ] 27 0.006% 100.008% ( 22, 34 ] 3 0.001% 100.009% ( 34, 51 ] 7 0.002% 100.011% ( 51, 76 ] 1 0.000% 100.011% ( 110, 170 ] 8 0.002% 100.013% ( 170, 250 ] 13 0.003% 100.016% ( 250, 380 ] 8 0.002% 100.018% ( 380, 580 ] 10 0.002% 100.020% ( 580, 870 ] 5 0.001% 100.021% ( 870, 1300 ] 7 0.002% 100.023% ( 1300, 1900 ] 3 0.001% 100.024% ( 1900, 2900 ] 2 0.000% 100.024% ( 2900, 4400 ] 1 0.000% 100.025% ( 4400, 6600 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 54252 Average: 2.3724 StdDev: 30.31 Min: 1 Median: 1.5212 Max: 5630 Percentiles: P50: 1.52 P75: 1.89 P99: 5.38 P99.9: 9.51 P99.99: 361.57 ------------------------------------------------------ [ 0, 1 ] 8038 14.816% 14.816% ### ( 1, 2 ] 36623 67.505% 82.321% ############## ( 2, 3 ] 6802 12.538% 94.859% ### ( 3, 4 ] 1513 2.789% 97.648% # ( 4, 6 ] 1063 1.959% 99.607% ( 6, 10 ] 181 0.334% 99.941% ( 10, 15 ] 19 0.035% 99.976% ( 15, 22 ] 1 0.002% 99.978% ( 22, 34 ] 1 0.002% 99.980% ( 110, 170 ] 2 0.004% 99.983% ( 170, 250 ] 1 0.002% 99.985% ( 250, 380 ] 3 0.006% 99.991% ( 380, 580 ] 1 0.002% 99.993% ( 870, 1300 ] 2 0.004% 99.996% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 31745 Average: 1.7979 StdDev: 9.93 Min: 0 Median: 1.2538 Max: 1733 Percentiles: P50: 1.25 P75: 1.66 P99: 3.72 P99.9: 8.91 P99.99: 20.78 ------------------------------------------------------ [ 0, 1 ] 10912 34.374% 34.374% ####### ( 1, 2 ] 19548 61.578% 95.952% ############ ( 2, 3 ] 734 2.312% 98.264% ( 3, 4 ] 324 1.021% 99.285% ( 4, 6 ] 148 0.466% 99.751% ( 6, 10 ] 65 0.205% 99.956% ( 10, 15 ] 10 0.032% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 1300, 1900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 1478.7125 StdDev: 2185.17 Min: 1 Median: 170.0000 Max: 7424 Percentiles: P50: 170.00 P75: 1900.00 P99: 7424.00 P99.9: 7424.00 P99.99: 7424.00 ------------------------------------------------------ [ 0, 1 ] 25 31.250% 31.250% ###### ( 1, 2 ] 4 5.000% 36.250% # ( 2, 3 ] 4 5.000% 41.250% # ( 3, 4 ] 1 1.250% 42.500% ( 4, 6 ] 3 3.750% 46.250% # ( 6, 10 ] 1 1.250% 47.500% ( 110, 170 ] 2 2.500% 50.000% # ( 170, 250 ] 1 1.250% 51.250% ( 250, 380 ] 3 3.750% 55.000% # ( 380, 580 ] 4 5.000% 60.000% # ( 580, 870 ] 2 2.500% 62.500% # ( 870, 1300 ] 7 8.750% 71.250% ## ( 1300, 1900 ] 3 3.750% 75.000% # ( 1900, 2900 ] 1 1.250% 76.250% ( 2900, 4400 ] 4 5.000% 81.250% # ( 4400, 6600 ] 12 15.000% 96.250% ### ( 6600, 9900 ] 3 3.750% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 3876.5714 StdDev: 1853.54 Min: 266 Median: 4175.0000 Max: 8099 Percentiles: P50: 4175.00 P75: 5539.29 P99: 8099.00 P99.9: 8099.00 P99.99: 8099.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 1 2.857% 5.714% # ( 870, 1300 ] 3 8.571% 14.286% ## ( 1300, 1900 ] 2 5.714% 20.000% # ( 1900, 2900 ] 2 5.714% 25.714% # ( 2900, 4400 ] 10 28.571% 54.286% ###### ( 4400, 6600 ] 14 40.000% 94.286% ######## ( 6600, 9900 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 321.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.778 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.390 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/16-19:52:35 ... thread 0: (1000000,3000000) ops and (336969.8,338487.3) ops/second in (2.967625,8.862961) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.78 GB 157.3 1.7 0.0 1.7 4.4 2.8 0.0 1.6 119.2 317.7 14.27 13.30 45 0.317 1727K 1769 0.0 0.0 L1 8/0 878.06 MB 87.8 1.2 0.8 0.4 1.2 0.8 0.2 1.5 242.8 242.1 4.93 4.81 2 2.464 1214K 3466 0.0 0.0 L2 1/0 959.89 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 257.0 256.9 0.49 0.47 1 0.490 127K 46 0.0 0.0 L3 17/0 866.57 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 229.3 229.3 0.55 0.49 1 0.545 126K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1196/4 98.90 GB 0.0 3.1 1.0 2.1 5.8 3.7 0.5 2.1 155.6 295.4 20.23 19.07 49 0.413 3196K 5281 0.0 0.0 Int 0/0 0.00 KB 0.0 3.1 1.0 2.1 5.8 3.7 0.4 2.1 155.6 295.4 20.23 19.07 49 0.413 3196K 5281 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.1 1.0 2.1 3.1 1.0 0.0 0.0 255.6 255.1 12.32 12.00 10 1.232 3196K 5281 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 358.1 7.92 7.07 39 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.84 GB write, 657.56 MB/s write, 3.07 GB read, 346.32 MB/s read, 20.2 seconds Interval compaction: 5.84 GB write, 674.30 MB/s write, 3.07 GB read, 355.14 MB/s read, 20.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 719865 Average: 2.1660 StdDev: 14.52 Min: 0 Median: 1.4798 Max: 6329 Percentiles: P50: 1.48 P75: 1.85 P99: 5.42 P99.9: 9.89 P99.99: 14.24 ------------------------------------------------------ [ 0, 1 ] 129243 17.954% 17.954% #### ( 1, 2 ] 480807 66.791% 84.745% ############# ( 2, 3 ] 74538 10.354% 95.099% ## ( 3, 4 ] 19178 2.664% 97.764% # ( 4, 6 ] 12552 1.744% 99.507% ( 6, 10 ] 2909 0.404% 99.911% ( 10, 15 ] 667 0.093% 100.004% ( 15, 22 ] 50 0.007% 100.011% ( 22, 34 ] 8 0.001% 100.012% ( 34, 51 ] 9 0.001% 100.013% ( 51, 76 ] 1 0.000% 100.013% ( 110, 170 ] 9 0.001% 100.015% ( 170, 250 ] 23 0.003% 100.018% ( 250, 380 ] 10 0.001% 100.019% ( 380, 580 ] 14 0.002% 100.021% ( 580, 870 ] 10 0.001% 100.023% ( 870, 1300 ] 11 0.002% 100.024% ( 1300, 1900 ] 4 0.001% 100.025% ( 1900, 2900 ] 3 0.000% 100.025% ( 2900, 4400 ] 5 0.001% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 79928 Average: 2.4876 StdDev: 28.17 Min: 1 Median: 1.5550 Max: 5630 Percentiles: P50: 1.56 P75: 1.93 P99: 5.48 P99.9: 9.79 P99.99: 1042.62 ------------------------------------------------------ [ 0, 1 ] 9988 12.496% 12.496% ## ( 1, 2 ] 54008 67.571% 80.067% ############## ( 2, 3 ] 11349 14.199% 94.266% ### ( 3, 4 ] 2443 3.057% 97.323% # ( 4, 6 ] 1814 2.270% 99.592% ( 6, 10 ] 260 0.325% 99.917% ( 10, 15 ] 39 0.049% 99.966% ( 15, 22 ] 1 0.001% 99.967% ( 22, 34 ] 1 0.001% 99.969% ( 110, 170 ] 2 0.003% 99.971% ( 170, 250 ] 1 0.001% 99.972% ( 250, 380 ] 8 0.010% 99.982% ( 380, 580 ] 4 0.005% 99.987% ( 870, 1300 ] 5 0.006% 99.994% ( 1300, 1900 ] 2 0.003% 99.996% ( 1900, 2900 ] 1 0.001% 99.997% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31745 Average: 1.7979 StdDev: 9.93 Min: 0 Median: 1.2538 Max: 1733 Percentiles: P50: 1.25 P75: 1.66 P99: 3.72 P99.9: 8.91 P99.99: 20.78 ------------------------------------------------------ [ 0, 1 ] 10912 34.374% 34.374% ####### ( 1, 2 ] 19548 61.578% 95.952% ############ ( 2, 3 ] 734 2.312% 98.264% ( 3, 4 ] 324 1.021% 99.285% ( 4, 6 ] 148 0.466% 99.751% ( 6, 10 ] 65 0.205% 99.956% ( 10, 15 ] 10 0.032% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 1300, 1900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 1478.7125 StdDev: 2185.17 Min: 1 Median: 170.0000 Max: 7424 Percentiles: P50: 170.00 P75: 1900.00 P99: 7424.00 P99.9: 7424.00 P99.99: 7424.00 ------------------------------------------------------ [ 0, 1 ] 25 31.250% 31.250% ###### ( 1, 2 ] 4 5.000% 36.250% # ( 2, 3 ] 4 5.000% 41.250% # ( 3, 4 ] 1 1.250% 42.500% ( 4, 6 ] 3 3.750% 46.250% # ( 6, 10 ] 1 1.250% 47.500% ( 110, 170 ] 2 2.500% 50.000% # ( 170, 250 ] 1 1.250% 51.250% ( 250, 380 ] 3 3.750% 55.000% # ( 380, 580 ] 4 5.000% 60.000% # ( 580, 870 ] 2 2.500% 62.500% # ( 870, 1300 ] 7 8.750% 71.250% ## ( 1300, 1900 ] 3 3.750% 75.000% # ( 1900, 2900 ] 1 1.250% 76.250% ( 2900, 4400 ] 4 5.000% 81.250% # ( 4400, 6600 ] 12 15.000% 96.250% ### ( 6600, 9900 ] 3 3.750% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 3876.5714 StdDev: 1853.54 Min: 266 Median: 4175.0000 Max: 8099 Percentiles: P50: 4175.00 P75: 5539.29 P99: 8099.00 P99.9: 8099.00 P99.99: 8099.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 1 2.857% 5.714% # ( 870, 1300 ] 3 8.571% 14.286% ## ( 1300, 1900 ] 2 5.714% 20.000% # ( 1900, 2900 ] 2 5.714% 25.714% # ( 2900, 4400 ] 10 28.571% 54.286% ###### ( 4400, 6600 ] 14 40.000% 94.286% ######## ( 6600, 9900 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 324.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.150 H:M:S, 12.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.371 H:M:S, 12.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/16-19:52:38 ... thread 0: (1000000,4000000) ops and (332990.6,337096.2) ops/second in (3.003088,11.866049) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 2.77 GB 56.6 2.2 0.0 2.2 6.0 3.8 0.0 1.6 117.8 317.3 19.25 17.92 61 0.316 2302K 2397 0.0 0.0 L1 8/8 878.06 MB 0.0 1.2 0.8 0.4 1.2 0.8 0.2 1.5 242.8 242.1 4.93 4.81 2 2.464 1214K 3466 0.0 0.0 L2 1/0 959.89 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 257.0 256.9 0.49 0.47 1 0.490 127K 46 0.0 0.0 L3 17/0 866.57 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 229.3 229.3 0.55 0.49 1 0.545 126K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1204/22 99.88 GB 0.0 3.6 1.0 2.6 7.4 4.7 0.5 2.0 147.3 299.5 25.22 23.69 65 0.388 3772K 5909 0.0 0.0 Int 0/0 0.00 KB 0.0 3.6 1.0 2.6 7.4 4.7 0.4 2.0 147.3 299.5 25.22 23.69 65 0.388 3772K 5909 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.6 1.0 2.6 3.6 1.0 0.0 0.0 256.6 256.2 14.48 14.12 12 1.206 3772K 5909 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 357.8 10.74 9.57 53 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.37 GB write, 624.44 MB/s write, 3.63 GB read, 307.20 MB/s read, 25.2 seconds Interval compaction: 7.37 GB write, 636.31 MB/s write, 3.63 GB read, 313.04 MB/s read, 25.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 987353 Average: 2.1975 StdDev: 14.58 Min: 0 Median: 1.4944 Max: 6329 Percentiles: P50: 1.49 P75: 1.87 P99: 5.45 P99.9: 9.87 P99.99: 14.39 ------------------------------------------------------ [ 0, 1 ] 167245 16.939% 16.939% ### ( 1, 2 ] 660319 66.878% 83.816% ############# ( 2, 3 ] 109389 11.079% 94.895% ## ( 3, 4 ] 27309 2.766% 97.661% # ( 4, 6 ] 18291 1.853% 99.514% ( 6, 10 ] 3939 0.399% 99.913% ( 10, 15 ] 869 0.088% 100.001% ( 15, 22 ] 70 0.007% 100.008% ( 22, 34 ] 15 0.002% 100.009% ( 34, 51 ] 10 0.001% 100.010% ( 51, 76 ] 1 0.000% 100.011% ( 110, 170 ] 23 0.002% 100.013% ( 170, 250 ] 41 0.004% 100.017% ( 250, 380 ] 16 0.002% 100.019% ( 380, 580 ] 24 0.002% 100.021% ( 580, 870 ] 12 0.001% 100.022% ( 870, 1300 ] 15 0.002% 100.024% ( 1300, 1900 ] 9 0.001% 100.025% ( 1900, 2900 ] 4 0.000% 100.025% ( 2900, 4400 ] 7 0.001% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 124533 Average: 2.5153 StdDev: 23.59 Min: 1 Median: 1.5479 Max: 5630 Percentiles: P50: 1.55 P75: 1.92 P99: 5.78 P99.9: 16.47 P99.99: 764.64 ------------------------------------------------------ [ 0, 1 ] 16482 13.235% 13.235% ### ( 1, 2 ] 83564 67.102% 80.337% ############# ( 2, 3 ] 17200 13.812% 94.149% ### ( 3, 4 ] 3663 2.941% 97.090% # ( 4, 6 ] 2676 2.149% 99.239% ( 6, 10 ] 749 0.601% 99.840% ( 10, 15 ] 73 0.059% 99.899% ( 15, 22 ] 7 0.006% 99.904% ( 22, 34 ] 1 0.001% 99.905% ( 76, 110 ] 42 0.034% 99.939% ( 110, 170 ] 25 0.020% 99.959% ( 170, 250 ] 11 0.009% 99.968% ( 250, 380 ] 14 0.011% 99.979% ( 380, 580 ] 11 0.009% 99.988% ( 580, 870 ] 4 0.003% 99.991% ( 870, 1300 ] 6 0.005% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31745 Average: 1.7979 StdDev: 9.93 Min: 0 Median: 1.2538 Max: 1733 Percentiles: P50: 1.25 P75: 1.66 P99: 3.72 P99.9: 8.91 P99.99: 20.78 ------------------------------------------------------ [ 0, 1 ] 10912 34.374% 34.374% ####### ( 1, 2 ] 19548 61.578% 95.952% ############ ( 2, 3 ] 734 2.312% 98.264% ( 3, 4 ] 324 1.021% 99.285% ( 4, 6 ] 148 0.466% 99.751% ( 6, 10 ] 65 0.205% 99.956% ( 10, 15 ] 10 0.032% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 1300, 1900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 1478.7125 StdDev: 2185.17 Min: 1 Median: 170.0000 Max: 7424 Percentiles: P50: 170.00 P75: 1900.00 P99: 7424.00 P99.9: 7424.00 P99.99: 7424.00 ------------------------------------------------------ [ 0, 1 ] 25 31.250% 31.250% ###### ( 1, 2 ] 4 5.000% 36.250% # ( 2, 3 ] 4 5.000% 41.250% # ( 3, 4 ] 1 1.250% 42.500% ( 4, 6 ] 3 3.750% 46.250% # ( 6, 10 ] 1 1.250% 47.500% ( 110, 170 ] 2 2.500% 50.000% # ( 170, 250 ] 1 1.250% 51.250% ( 250, 380 ] 3 3.750% 55.000% # ( 380, 580 ] 4 5.000% 60.000% # ( 580, 870 ] 2 2.500% 62.500% # ( 870, 1300 ] 7 8.750% 71.250% ## ( 1300, 1900 ] 3 3.750% 75.000% # ( 1900, 2900 ] 1 1.250% 76.250% ( 2900, 4400 ] 4 5.000% 81.250% # ( 4400, 6600 ] 12 15.000% 96.250% ### ( 6600, 9900 ] 3 3.750% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 3876.5714 StdDev: 1853.54 Min: 266 Median: 4175.0000 Max: 8099 Percentiles: P50: 4175.00 P75: 5539.29 P99: 8099.00 P99.9: 8099.00 P99.99: 8099.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 1 2.857% 5.714% # ( 870, 1300 ] 3 8.571% 14.286% ## ( 1300, 1900 ] 2 5.714% 20.000% # ( 1900, 2900 ] 2 5.714% 25.714% # ( 2900, 4400 ] 10 28.571% 54.286% ###### ( 4400, 6600 ] 14 40.000% 94.286% ######## ( 6600, 9900 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 325.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.573 H:M:S, 13.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.424 H:M:S, 14.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/16-19:52:43 ... thread 0: (1000000,5000000) ops and (224711.3,306443.8) ops/second in (4.450155,16.316204) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 3.75 GB 182.5 3.6 0.0 3.6 8.3 4.7 0.0 1.8 133.4 310.3 27.39 25.61 81 0.338 3709K 3822 0.0 0.0 L1 8/8 878.06 MB 0.0 1.2 0.8 0.4 1.2 0.8 0.2 1.5 242.8 242.1 4.93 4.81 2 2.464 1214K 3466 0.0 0.0 L2 1/0 959.89 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 257.0 256.9 0.49 0.47 1 0.490 127K 46 0.0 0.0 L3 17/0 866.57 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 229.3 229.3 0.55 0.49 1 0.545 126K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1204/18 100.87 GB 0.0 5.0 1.0 4.0 9.7 5.7 0.5 2.1 152.9 298.1 33.35 31.37 85 0.392 5179K 7334 0.0 0.0 Int 0/0 0.00 KB 0.0 5.0 1.0 4.0 9.7 5.7 0.4 2.1 152.9 298.1 33.35 31.37 85 0.392 5179K 7334 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.0 1.0 4.0 5.0 1.0 0.0 0.0 259.1 258.7 19.69 19.23 17 1.158 5179K 7334 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 355.0 13.66 12.15 68 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.5 total, 16.3 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.71 GB write, 601.08 MB/s write, 4.98 GB read, 308.34 MB/s read, 33.4 seconds Interval compaction: 9.71 GB write, 609.39 MB/s write, 4.98 GB read, 312.61 MB/s read, 33.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 19, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1461725 Average: 2.2668 StdDev: 14.21 Min: 0 Median: 1.5158 Max: 6329 Percentiles: P50: 1.52 P75: 1.89 P99: 5.58 P99.9: 10.15 P99.99: 45.54 ------------------------------------------------------ [ 0, 1 ] 222663 15.233% 15.233% ### ( 1, 2 ] 985180 67.398% 82.631% ############# ( 2, 3 ] 175345 11.996% 94.627% ## ( 3, 4 ] 41469 2.837% 97.464% # ( 4, 6 ] 28426 1.945% 99.409% ( 6, 10 ] 7145 0.489% 99.898% ( 10, 15 ] 1210 0.083% 99.980% ( 15, 22 ] 113 0.008% 99.988% ( 22, 34 ] 21 0.001% 99.990% ( 34, 51 ] 13 0.001% 99.990% ( 51, 76 ] 4 0.000% 99.991% ( 76, 110 ] 98 0.007% 99.997% ( 110, 170 ] 134 0.009% 100.007% ( 170, 250 ] 91 0.006% 100.013% ( 250, 380 ] 60 0.004% 100.017% ( 380, 580 ] 64 0.004% 100.021% ( 580, 870 ] 27 0.002% 100.023% ( 870, 1300 ] 21 0.001% 100.025% ( 1300, 1900 ] 12 0.001% 100.025% ( 1900, 2900 ] 6 0.000% 100.026% ( 2900, 4400 ] 8 0.001% 100.026% ( 4400, 6600 ] 2 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 201678 Average: 2.5251 StdDev: 19.09 Min: 1 Median: 1.5661 Max: 5630 Percentiles: P50: 1.57 P75: 1.94 P99: 6.71 P99.9: 89.70 P99.99: 530.97 ------------------------------------------------------ [ 0, 1 ] 24222 12.010% 12.010% ## ( 1, 2 ] 135350 67.112% 79.122% ############# ( 2, 3 ] 29377 14.566% 93.688% ### ( 3, 4 ] 5853 2.902% 96.591% # ( 4, 6 ] 4514 2.238% 98.829% ( 6, 10 ] 1947 0.965% 99.794% ( 10, 15 ] 152 0.075% 99.870% ( 15, 22 ] 15 0.007% 99.877% ( 22, 34 ] 2 0.001% 99.878% ( 76, 110 ] 110 0.055% 99.933% ( 110, 170 ] 60 0.030% 99.962% ( 170, 250 ] 21 0.010% 99.973% ( 250, 380 ] 22 0.011% 99.984% ( 380, 580 ] 17 0.008% 99.992% ( 580, 870 ] 5 0.002% 99.995% ( 870, 1300 ] 6 0.003% 99.998% ( 1300, 1900 ] 2 0.001% 99.999% ( 1900, 2900 ] 1 0.000% 99.999% ( 2900, 4400 ] 1 0.000% 100.000% ( 4400, 6600 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 31745 Average: 1.7979 StdDev: 9.93 Min: 0 Median: 1.2538 Max: 1733 Percentiles: P50: 1.25 P75: 1.66 P99: 3.72 P99.9: 8.91 P99.99: 20.78 ------------------------------------------------------ [ 0, 1 ] 10912 34.374% 34.374% ####### ( 1, 2 ] 19548 61.578% 95.952% ############ ( 2, 3 ] 734 2.312% 98.264% ( 3, 4 ] 324 1.021% 99.285% ( 4, 6 ] 148 0.466% 99.751% ( 6, 10 ] 65 0.205% 99.956% ( 10, 15 ] 10 0.032% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 1300, 1900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 1478.7125 StdDev: 2185.17 Min: 1 Median: 170.0000 Max: 7424 Percentiles: P50: 170.00 P75: 1900.00 P99: 7424.00 P99.9: 7424.00 P99.99: 7424.00 ------------------------------------------------------ [ 0, 1 ] 25 31.250% 31.250% ###### ( 1, 2 ] 4 5.000% 36.250% # ( 2, 3 ] 4 5.000% 41.250% # ( 3, 4 ] 1 1.250% 42.500% ( 4, 6 ] 3 3.750% 46.250% # ( 6, 10 ] 1 1.250% 47.500% ( 110, 170 ] 2 2.500% 50.000% # ( 170, 250 ] 1 1.250% 51.250% ( 250, 380 ] 3 3.750% 55.000% # ( 380, 580 ] 4 5.000% 60.000% # ( 580, 870 ] 2 2.500% 62.500% # ( 870, 1300 ] 7 8.750% 71.250% ## ( 1300, 1900 ] 3 3.750% 75.000% # ( 1900, 2900 ] 1 1.250% 76.250% ( 2900, 4400 ] 4 5.000% 81.250% # ( 4400, 6600 ] 12 15.000% 96.250% ### ( 6600, 9900 ] 3 3.750% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 3876.5714 StdDev: 1853.54 Min: 266 Median: 4175.0000 Max: 8099 Percentiles: P50: 4175.00 P75: 5539.29 P99: 8099.00 P99.9: 8099.00 P99.99: 8099.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 1 2.857% 5.714% # ( 870, 1300 ] 3 8.571% 14.286% ## ( 1300, 1900 ] 2 5.714% 20.000% # ( 1900, 2900 ] 2 5.714% 25.714% # ( 2900, 4400 ] 10 28.571% 54.286% ###### ( 4400, 6600 ] 14 40.000% 94.286% ######## ( 6600, 9900 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 16.5 total, 4.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 297.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.311 H:M:S, 20.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 221.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.738 H:M:S, 39.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/16-19:52:52 ... thread 0: (1000000,6000000) ops and (107108.0,233894.7) ops/second in (9.336370,25.652574) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 2.76 GB 37.8 5.2 0.0 5.2 10.9 5.7 0.0 1.9 145.4 306.3 36.38 34.10 100 0.364 5372K 7161 0.0 0.0 L1 19/19 2.29 GB 0.0 4.0 2.8 1.2 4.0 2.7 0.2 1.4 229.6 227.3 17.81 17.13 3 5.936 4151K 39K 0.0 0.0 L2 1/0 959.89 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.7 2.0 257.0 256.9 0.49 0.47 1 0.490 127K 46 0.0 0.0 L3 62/0 843.45 MB 0.8 0.7 0.6 0.1 0.7 0.6 0.1 1.2 198.7 198.5 3.79 3.30 2 1.894 764K 634 0.0 0.0 L4 124/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1265/28 101.81 GB 0.0 10.0 3.5 6.6 15.7 9.1 1.8 2.7 175.5 274.8 58.47 55.00 106 0.552 10M 47K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.0 3.5 6.6 15.7 9.1 1.7 2.7 175.5 274.8 58.47 55.00 106 0.552 10M 47K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.0 3.5 6.6 10.0 3.4 0.0 0.0 244.4 243.3 41.96 40.34 23 1.825 10M 47K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 355.0 16.50 14.66 83 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.9 total, 25.7 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.69 GB write, 620.90 MB/s write, 10.02 GB read, 396.37 MB/s read, 58.5 seconds Interval compaction: 15.69 GB write, 626.36 MB/s write, 10.02 GB read, 399.86 MB/s read, 58.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 20, interval: 38 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2258739 Average: 2.4107 StdDev: 14.17 Min: 0 Median: 1.5312 Max: 6329 Percentiles: P50: 1.53 P75: 1.90 P99: 5.84 P99.9: 14.60 P99.99: 189.46 ------------------------------------------------------ [ 0, 1 ] 316307 14.004% 14.004% ### ( 1, 2 ] 1530640 67.765% 81.769% ############## ( 2, 3 ] 281211 12.450% 94.219% ## ( 3, 4 ] 65622 2.905% 97.124% # ( 4, 6 ] 45999 2.036% 99.161% ( 6, 10 ] 14890 0.659% 99.820% ( 10, 15 ] 1967 0.087% 99.907% ( 15, 22 ] 207 0.009% 99.916% ( 22, 34 ] 24 0.001% 99.917% ( 34, 51 ] 15 0.001% 99.918% ( 51, 76 ] 6 0.000% 99.918% ( 76, 110 ] 604 0.027% 99.945% ( 110, 170 ] 936 0.041% 99.986% ( 170, 250 ] 350 0.015% 100.002% ( 250, 380 ] 200 0.009% 100.011% ( 380, 580 ] 182 0.008% 100.019% ( 580, 870 ] 63 0.003% 100.021% ( 870, 1300 ] 39 0.002% 100.023% ( 1300, 1900 ] 12 0.001% 100.024% ( 1900, 2900 ] 12 0.001% 100.024% ( 2900, 4400 ] 10 0.000% 100.025% ( 4400, 6600 ] 2 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 477151 Average: 2.7942 StdDev: 19.95 Min: 1 Median: 1.5924 Max: 5630 Percentiles: P50: 1.59 P75: 1.97 P99: 8.07 P99.9: 138.58 P99.99: 812.72 ------------------------------------------------------ [ 0, 1 ] 50862 10.660% 10.660% ## ( 1, 2 ] 316868 66.408% 77.068% ############# ( 2, 3 ] 75013 15.721% 92.789% ### ( 3, 4 ] 14446 3.028% 95.816% # ( 4, 6 ] 11907 2.495% 98.312% ( 6, 10 ] 6354 1.332% 99.644% ( 10, 15 ] 609 0.128% 99.771% ( 15, 22 ] 75 0.016% 99.787% ( 22, 34 ] 11 0.002% 99.789% ( 34, 51 ] 2 0.000% 99.790% ( 51, 76 ] 5 0.001% 99.791% ( 76, 110 ] 378 0.079% 99.870% ( 110, 170 ] 302 0.063% 99.933% ( 170, 250 ] 109 0.023% 99.956% ( 250, 380 ] 73 0.015% 99.971% ( 380, 580 ] 62 0.013% 99.984% ( 580, 870 ] 34 0.007% 99.991% ( 870, 1300 ] 34 0.007% 99.999% ( 1300, 1900 ] 9 0.002% 100.000% ( 1900, 2900 ] 3 0.001% 100.001% ( 2900, 4400 ] 2 0.000% 100.001% ( 4400, 6600 ] 1 0.000% 100.002% ** Level 2 read latency histogram (micros): Count: 31745 Average: 1.7979 StdDev: 9.93 Min: 0 Median: 1.2538 Max: 1733 Percentiles: P50: 1.25 P75: 1.66 P99: 3.72 P99.9: 8.91 P99.99: 20.78 ------------------------------------------------------ [ 0, 1 ] 10912 34.374% 34.374% ####### ( 1, 2 ] 19548 61.578% 95.952% ############ ( 2, 3 ] 734 2.312% 98.264% ( 3, 4 ] 324 1.021% 99.285% ( 4, 6 ] 148 0.466% 99.751% ( 6, 10 ] 65 0.205% 99.956% ( 10, 15 ] 10 0.032% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 1300, 1900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28961 Average: 7.3175 StdDev: 139.36 Min: 1 Median: 1.7730 Max: 7424 Percentiles: P50: 1.77 P75: 2.41 P99: 9.30 P99.9: 933.82 P99.99: 6714.29 ------------------------------------------------------ [ 0, 1 ] 1465 5.059% 5.059% # ( 1, 2 ] 16838 58.140% 63.199% ############ ( 2, 3 ] 8294 28.639% 91.837% ###### ( 3, 4 ] 766 2.645% 94.482% # ( 4, 6 ] 868 2.997% 97.479% # ( 6, 10 ] 534 1.844% 99.323% ( 10, 15 ] 60 0.207% 99.530% ( 15, 22 ] 6 0.021% 99.551% ( 34, 51 ] 1 0.003% 99.555% ( 76, 110 ] 9 0.031% 99.586% ( 110, 170 ] 38 0.131% 99.717% ( 170, 250 ] 11 0.038% 99.755% ( 250, 380 ] 19 0.066% 99.820% ( 380, 580 ] 18 0.062% 99.883% ( 580, 870 ] 4 0.014% 99.896% ( 870, 1300 ] 7 0.024% 99.921% ( 1300, 1900 ] 3 0.010% 99.931% ( 1900, 2900 ] 1 0.003% 99.934% ( 2900, 4400 ] 4 0.014% 99.948% ( 4400, 6600 ] 12 0.041% 99.990% ( 6600, 9900 ] 3 0.010% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 3876.5714 StdDev: 1853.54 Min: 266 Median: 4175.0000 Max: 8099 Percentiles: P50: 4175.00 P75: 5539.29 P99: 8099.00 P99.9: 8099.00 P99.99: 8099.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 1 2.857% 5.714% # ( 870, 1300 ] 3 8.571% 14.286% ## ( 1300, 1900 ] 2 5.714% 20.000% # ( 1900, 2900 ] 2 5.714% 25.714% # ( 2900, 4400 ] 10 28.571% 54.286% ###### ( 4400, 6600 ] 14 40.000% 94.286% ######## ( 6600, 9900 ] 2 5.714% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 692.2500 StdDev: 836.47 Min: 86 Median: 162.5000 Max: 2684 Percentiles: P50: 162.50 P75: 1085.00 P99: 2684.00 P99.9: 2684.00 P99.99: 2684.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 8 40.000% 55.000% ######## ( 170, 250 ] 1 5.000% 60.000% # ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 2 10.000% 80.000% ## ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 25.9 total, 9.3 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 228.17 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.809 H:M:S, 37.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 105.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.499 H:M:S, 69.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/11/16-19:53:14 ... thread 0: (1000000,7000000) ops and (44854.2,145994.4) ops/second in (22.294478,47.947052) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/7 1.23 GB 6.3 5.7 0.0 5.7 12.2 6.6 0.0 1.9 134.8 291.5 42.98 38.32 114 0.377 5884K 7667 0.0 0.0 L1 7/7 665.25 MB 0.0 8.7 5.2 3.5 8.6 5.0 0.2 1.7 224.1 221.0 39.63 37.13 4 9.908 8734K 39K 0.0 0.0 L2 9/7 1.01 GB 1.3 0.1 0.1 0.1 0.1 0.1 4.6 2.0 257.0 256.9 0.49 0.47 1 0.490 127K 46 0.0 0.0 L3 69/21 3.00 GB 2.5 3.8 3.1 0.6 3.8 3.1 0.5 1.2 126.4 126.3 30.42 17.76 22 1.383 2929K 1081 0.0 0.0 L4 140/0 10.52 GB 1.1 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1281/42 102.59 GB 0.0 18.2 8.4 9.8 24.7 14.8 6.9 3.7 164.3 222.5 113.52 93.68 141 0.805 17M 48K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.2 8.4 9.8 24.7 14.8 6.8 3.7 164.3 222.5 113.52 93.68 141 0.805 17M 48K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.2 8.4 9.8 18.1 8.2 0.0 0.0 201.6 200.1 92.50 76.66 46 2.011 17M 48K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 320.7 21.02 17.02 95 0.221 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.2 total, 47.9 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.66 GB write, 524.18 MB/s write, 18.21 GB read, 387.07 MB/s read, 113.5 seconds Interval compaction: 24.66 GB write, 526.65 MB/s write, 18.21 GB read, 388.90 MB/s read, 113.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 39, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 28, total-stops: 39, interval: 67 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3015523 Average: 2.9415 StdDev: 25.16 Min: 0 Median: 1.5243 Max: 7302 Percentiles: P50: 1.52 P75: 1.90 P99: 7.23 P99.9: 158.88 P99.99: 419.28 ------------------------------------------------------ [ 0, 1 ] 461110 15.291% 15.291% ### ( 1, 2 ] 1996287 66.200% 81.492% ############# ( 2, 3 ] 352823 11.700% 93.192% ## ( 3, 4 ] 93445 3.099% 96.291% # ( 4, 6 ] 74655 2.476% 98.766% ( 6, 10 ] 22913 0.760% 99.526% ( 10, 15 ] 3208 0.106% 99.633% ( 15, 22 ] 544 0.018% 99.651% ( 22, 34 ] 31 0.001% 99.652% ( 34, 51 ] 17 0.001% 99.652% ( 51, 76 ] 99 0.003% 99.655% ( 76, 110 ] 3316 0.110% 99.765% ( 110, 170 ] 4984 0.165% 99.931% ( 170, 250 ] 1024 0.034% 99.965% ( 250, 380 ] 660 0.022% 99.987% ( 380, 580 ] 542 0.018% 100.004% ( 580, 870 ] 218 0.007% 100.012% ( 870, 1300 ] 118 0.004% 100.016% ( 1300, 1900 ] 50 0.002% 100.017% ( 1900, 2900 ] 48 0.002% 100.019% ( 2900, 4400 ] 48 0.002% 100.020% ( 4400, 6600 ] 9 0.000% 100.021% ( 6600, 9900 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1799989 Average: 5.4838 StdDev: 86.26 Min: 1 Median: 1.7133 Max: 9565 Percentiles: P50: 1.71 P75: 2.51 P99: 9.08 P99.9: 131.60 P99.99: 310.46 ------------------------------------------------------ [ 0, 1 ] 213064 11.837% 11.837% ## ( 1, 2 ] 963027 53.502% 65.339% ########### ( 2, 3 ] 342914 19.051% 84.390% #### ( 3, 4 ] 116132 6.452% 90.841% # ( 4, 6 ] 123222 6.846% 97.687% # ( 6, 10 ] 30698 1.705% 99.393% ( 10, 15 ] 6048 0.336% 99.729% ( 15, 22 ] 906 0.050% 99.779% ( 22, 34 ] 63 0.004% 99.782% ( 34, 51 ] 13 0.001% 99.783% ( 51, 76 ] 15 0.001% 99.784% ( 76, 110 ] 1485 0.083% 99.867% ( 110, 170 ] 1678 0.093% 99.960% ( 170, 250 ] 373 0.021% 99.980% ( 250, 380 ] 372 0.021% 100.001% ( 380, 580 ] 484 0.027% 100.028% ( 580, 870 ] 495 0.028% 100.056% ( 870, 1300 ] 408 0.023% 100.078% ( 1300, 1900 ] 302 0.017% 100.095% ( 1900, 2900 ] 440 0.024% 100.119% ( 2900, 4400 ] 429 0.024% 100.143% ( 4400, 6600 ] 111 0.006% 100.149% ( 6600, 9900 ] 15 0.001% 100.150% ** Level 2 read latency histogram (micros): Count: 31745 Average: 1.7979 StdDev: 9.93 Min: 0 Median: 1.2538 Max: 1733 Percentiles: P50: 1.25 P75: 1.66 P99: 3.72 P99.9: 8.91 P99.99: 20.78 ------------------------------------------------------ [ 0, 1 ] 10912 34.374% 34.374% ####### ( 1, 2 ] 19548 61.578% 95.952% ############ ( 2, 3 ] 734 2.312% 98.264% ( 3, 4 ] 324 1.021% 99.285% ( 4, 6 ] 148 0.466% 99.751% ( 6, 10 ] 65 0.205% 99.956% ( 10, 15 ] 10 0.032% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 1300, 1900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 190081 Average: 24.3482 StdDev: 236.15 Min: 1 Median: 2.1961 Max: 7986 Percentiles: P50: 2.20 P75: 3.05 P99: 531.73 P99.9: 3103.72 P99.99: 3915.78 ------------------------------------------------------ [ 0, 1 ] 2069 1.088% 1.088% ( 1, 2 ] 81651 42.956% 44.044% ######### ( 2, 3 ] 57733 30.373% 74.417% ###### ( 3, 4 ] 20284 10.671% 85.088% ## ( 4, 6 ] 21159 11.132% 96.220% ## ( 6, 10 ] 3552 1.869% 98.089% ( 10, 15 ] 695 0.366% 98.454% ( 15, 22 ] 85 0.045% 98.499% ( 22, 34 ] 13 0.007% 98.506% ( 34, 51 ] 4 0.002% 98.508% ( 51, 76 ] 3 0.002% 98.510% ( 76, 110 ] 14 0.007% 98.517% ( 110, 170 ] 113 0.059% 98.576% ( 170, 250 ] 213 0.112% 98.688% ( 250, 380 ] 270 0.142% 98.830% ( 380, 580 ] 426 0.224% 99.055% ( 580, 870 ] 532 0.280% 99.334% ( 870, 1300 ] 455 0.239% 99.574% ( 1300, 1900 ] 296 0.156% 99.730% ( 1900, 2900 ] 282 0.148% 99.878% ( 2900, 4400 ] 316 0.166% 100.044% ( 4400, 6600 ] 91 0.048% 100.092% ( 6600, 9900 ] 21 0.011% 100.103% ** Level 4 read latency histogram (micros): Count: 35 Average: 3876.5714 StdDev: 1853.54 Min: 266 Median: 4175.0000 Max: 8099 Percentiles: P50: 4175.00 P75: 5539.29 P99: 8099.00 P99.9: 8099.00 P99.99: 8099.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 1 2.857% 5.714% # ( 870, 1300 ] 3 8.571% 14.286% ## ( 1300, 1900 ] 2 5.714% 20.000% # ( 1900, 2900 ] 2 5.714% 25.714% # ( 2900, 4400 ] 10 28.571% 54.286% ###### ( 4400, 6600 ] 14 40.000% 94.286% ######## ( 6600, 9900 ] 2 5.714% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 692.2500 StdDev: 836.47 Min: 86 Median: 162.5000 Max: 2684 Percentiles: P50: 162.50 P75: 1085.00 P99: 2684.00 P99.9: 2684.00 P99.99: 2684.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 8 40.000% 55.000% ######## ( 170, 250 ] 1 5.000% 60.000% # ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 2 10.000% 80.000% ## ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 48.2 total, 22.3 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 143.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.981 H:M:S, 60.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 44.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:19.172 H:M:S, 86.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/16-19:53:18 ... thread 0: (1000000,8000000) ops and (276583.4,155151.2) ops/second in (3.615546,51.562598) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/7 2.21 GB 119.5 6.6 0.0 6.6 14.2 7.6 0.0 1.9 135.1 288.8 50.35 44.80 130 0.387 6907K 8917 0.0 0.0 L1 7/7 665.25 MB 0.0 8.7 5.2 3.5 8.6 5.0 0.2 1.7 224.1 221.0 39.63 37.13 4 9.908 8734K 39K 0.0 0.0 L2 1/0 959.89 KB 0.0 0.1 0.1 0.1 0.1 0.1 4.6 2.0 257.0 256.9 0.49 0.47 1 0.490 127K 46 0.0 0.0 L3 15/0 948.09 MB 0.9 4.8 3.9 0.9 4.8 3.9 0.8 1.2 128.2 128.1 38.68 22.92 28 1.382 3923K 1434 0.0 0.0 L4 154/0 9.66 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1285/14 103.57 GB 0.0 20.3 9.1 11.2 27.7 16.5 14.2 3.7 160.8 219.7 129.16 105.32 163 0.792 19M 49K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.3 9.1 11.2 27.7 16.5 14.1 3.7 160.8 219.7 129.16 105.32 163 0.792 19M 49K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.3 9.1 11.2 20.1 9.0 0.0 0.0 198.0 196.6 104.92 85.69 55 1.908 19M 49K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 319.8 24.23 19.63 108 0.224 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 51.8 total, 51.6 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.72 GB write, 548.00 MB/s write, 20.28 GB read, 401.05 MB/s read, 129.2 seconds Interval compaction: 27.72 GB write, 550.40 MB/s write, 20.28 GB read, 402.80 MB/s read, 129.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 51, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 28, total-stops: 51, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3366882 Average: 2.9088 StdDev: 24.41 Min: 0 Median: 1.5391 Max: 7302 Percentiles: P50: 1.54 P75: 1.92 P99: 7.15 P99.9: 154.39 P99.99: 379.29 ------------------------------------------------------ [ 0, 1 ] 487020 14.465% 14.465% ### ( 1, 2 ] 2219449 65.920% 80.385% ############# ( 2, 3 ] 418176 12.420% 92.805% ## ( 3, 4 ] 111087 3.299% 96.105% # ( 4, 6 ] 89892 2.670% 98.775% # ( 6, 10 ] 26369 0.783% 99.558% ( 10, 15 ] 3726 0.111% 99.668% ( 15, 22 ] 605 0.018% 99.686% ( 22, 34 ] 35 0.001% 99.687% ( 34, 51 ] 20 0.001% 99.688% ( 51, 76 ] 101 0.003% 99.691% ( 76, 110 ] 3320 0.099% 99.790% ( 110, 170 ] 5023 0.149% 99.939% ( 170, 250 ] 1049 0.031% 99.970% ( 250, 380 ] 678 0.020% 99.990% ( 380, 580 ] 563 0.017% 100.007% ( 580, 870 ] 231 0.007% 100.014% ( 870, 1300 ] 127 0.004% 100.017% ( 1300, 1900 ] 53 0.002% 100.019% ( 1900, 2900 ] 51 0.002% 100.021% ( 2900, 4400 ] 52 0.002% 100.022% ( 4400, 6600 ] 9 0.000% 100.022% ( 6600, 9900 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 2003323 Average: 5.3492 StdDev: 83.18 Min: 1 Median: 1.7257 Max: 9565 Percentiles: P50: 1.73 P75: 2.52 P99: 9.07 P99.9: 133.36 P99.99: 344.24 ------------------------------------------------------ [ 0, 1 ] 220086 10.986% 10.986% ## ( 1, 2 ] 1077021 53.762% 64.748% ########### ( 2, 3 ] 395200 19.727% 84.475% #### ( 3, 4 ] 128277 6.403% 90.878% # ( 4, 6 ] 135722 6.775% 97.653% # ( 6, 10 ] 35135 1.754% 99.407% ( 10, 15 ] 6517 0.325% 99.732% ( 15, 22 ] 973 0.049% 99.781% ( 22, 34 ] 66 0.003% 99.784% ( 34, 51 ] 13 0.001% 99.785% ( 51, 76 ] 15 0.001% 99.785% ( 76, 110 ] 1607 0.080% 99.866% ( 110, 170 ] 1766 0.088% 99.954% ( 170, 250 ] 426 0.021% 99.975% ( 250, 380 ] 412 0.021% 99.996% ( 380, 580 ] 526 0.026% 100.022% ( 580, 870 ] 544 0.027% 100.049% ( 870, 1300 ] 468 0.023% 100.072% ( 1300, 1900 ] 327 0.016% 100.089% ( 1900, 2900 ] 464 0.023% 100.112% ( 2900, 4400 ] 436 0.022% 100.134% ( 4400, 6600 ] 113 0.006% 100.139% ( 6600, 9900 ] 16 0.001% 100.140% ** Level 2 read latency histogram (micros): Count: 31745 Average: 1.7979 StdDev: 9.93 Min: 0 Median: 1.2538 Max: 1733 Percentiles: P50: 1.25 P75: 1.66 P99: 3.72 P99.9: 8.91 P99.99: 20.78 ------------------------------------------------------ [ 0, 1 ] 10912 34.374% 34.374% ####### ( 1, 2 ] 19548 61.578% 95.952% ############ ( 2, 3 ] 734 2.312% 98.264% ( 3, 4 ] 324 1.021% 99.285% ( 4, 6 ] 148 0.466% 99.751% ( 6, 10 ] 65 0.205% 99.956% ( 10, 15 ] 10 0.032% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 1300, 1900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 247079 Average: 20.1915 StdDev: 209.31 Min: 1 Median: 2.1918 Max: 7986 Percentiles: P50: 2.19 P75: 3.00 P99: 332.70 P99.9: 2692.83 P99.99: 3663.13 ------------------------------------------------------ [ 0, 1 ] 2304 0.932% 0.932% ( 1, 2 ] 106536 43.118% 44.051% ######### ( 2, 3 ] 76642 31.019% 75.070% ###### ( 3, 4 ] 25651 10.382% 85.452% ## ( 4, 6 ] 26827 10.858% 96.309% ## ( 6, 10 ] 4971 2.012% 98.321% ( 10, 15 ] 977 0.395% 98.717% ( 15, 22 ] 117 0.047% 98.764% ( 22, 34 ] 15 0.006% 98.770% ( 34, 51 ] 5 0.002% 98.772% ( 51, 76 ] 4 0.002% 98.774% ( 76, 110 ] 15 0.006% 98.780% ( 110, 170 ] 119 0.048% 98.828% ( 170, 250 ] 242 0.098% 98.926% ( 250, 380 ] 288 0.117% 99.042% ( 380, 580 ] 478 0.193% 99.236% ( 580, 870 ] 592 0.240% 99.475% ( 870, 1300 ] 505 0.204% 99.680% ( 1300, 1900 ] 314 0.127% 99.807% ( 1900, 2900 ] 290 0.117% 99.924% ( 2900, 4400 ] 319 0.129% 100.053% ( 4400, 6600 ] 91 0.037% 100.090% ( 6600, 9900 ] 21 0.008% 100.099% ** Level 4 read latency histogram (micros): Count: 35 Average: 3876.5714 StdDev: 1853.54 Min: 266 Median: 4175.0000 Max: 8099 Percentiles: P50: 4175.00 P75: 5539.29 P99: 8099.00 P99.9: 8099.00 P99.99: 8099.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 1 2.857% 5.714% # ( 870, 1300 ] 3 8.571% 14.286% ## ( 1300, 1900 ] 2 5.714% 20.000% # ( 1900, 2900 ] 2 5.714% 25.714% # ( 2900, 4400 ] 10 28.571% 54.286% ###### ( 4400, 6600 ] 14 40.000% 94.286% ######## ( 6600, 9900 ] 2 5.714% 100.000% # ** Level 5 read latency histogram (micros): Count: 260 Average: 1522.1731 StdDev: 1460.57 Min: 86 Median: 870.0000 Max: 6561 Percentiles: P50: 870.00 P75: 2385.71 P99: 6263.53 P99.9: 6561.00 P99.99: 6561.00 ------------------------------------------------------ ( 76, 110 ] 5 1.923% 1.923% ( 110, 170 ] 14 5.385% 7.308% # ( 170, 250 ] 14 5.385% 12.692% # ( 250, 380 ] 36 13.846% 26.538% ### ( 380, 580 ] 28 10.769% 37.308% ## ( 580, 870 ] 33 12.692% 50.000% ### ( 870, 1300 ] 26 10.000% 60.000% ## ( 1300, 1900 ] 22 8.462% 68.462% ## ( 1900, 2900 ] 35 13.462% 81.923% ### ( 2900, 4400 ] 30 11.538% 93.462% ## ( 4400, 6600 ] 17 6.538% 100.000% # ** DB Stats ** Uptime(secs): 51.8 total, 3.6 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 152.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.908 H:M:S, 57.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 272.21 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.927 H:M:S, 25.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/16-19:53:21 ... thread 0: (1000000,9000000) ops and (323046.6,164659.9) ops/second in (3.095529,54.658127) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 2.40 GB 6.3 7.8 0.0 7.8 16.3 8.5 0.0 1.9 137.6 289.3 57.66 51.68 148 0.390 8058K 10K 0.0 0.0 L1 16/16 1.22 GB 0.0 10.1 6.0 4.2 10.0 5.8 0.2 1.7 217.2 214.4 47.72 43.62 5 9.545 9564K 39K 0.0 0.0 L2 2/0 57.72 MB 0.6 0.1 0.1 0.1 0.1 0.1 4.8 2.0 257.0 256.9 0.49 0.47 1 0.490 127K 46 0.0 0.0 L3 18/0 871.25 MB 0.9 5.3 4.0 1.3 5.3 4.0 0.8 1.3 132.6 132.4 40.73 24.79 30 1.358 4369K 4251 0.0 0.0 L4 155/0 9.59 GB 1.0 0.2 0.1 0.0 0.2 0.1 4.5 1.3 219.2 219.2 0.74 0.69 1 0.743 165K 22 0.0 0.0 L5 1100/0 90.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1302/26 104.54 GB 0.0 23.4 10.1 13.3 31.8 18.6 14.9 3.7 162.8 221.2 147.35 121.24 185 0.797 22M 54K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.4 10.1 13.3 31.8 18.6 14.8 3.7 162.8 221.2 147.35 121.24 185 0.797 22M 54K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.4 10.1 13.3 23.3 10.0 0.0 0.0 199.6 198.4 120.18 99.03 63 1.908 22M 54K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 322.2 27.18 22.21 122 0.223 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.9 total, 54.7 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.83 GB write, 593.89 MB/s write, 23.43 GB read, 437.08 MB/s read, 147.4 seconds Interval compaction: 31.83 GB write, 596.34 MB/s write, 23.43 GB read, 438.89 MB/s read, 147.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 55, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 28, total-stops: 55, interval: 83 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3610975 Average: 2.8762 StdDev: 23.82 Min: 0 Median: 1.5425 Max: 7302 Percentiles: P50: 1.54 P75: 1.92 P99: 6.94 P99.9: 152.24 P99.99: 376.23 ------------------------------------------------------ [ 0, 1 ] 512327 14.188% 14.188% ### ( 1, 2 ] 2383903 66.018% 80.206% ############# ( 2, 3 ] 454962 12.599% 92.806% ### ( 3, 4 ] 120573 3.339% 96.145% # ( 4, 6 ] 96658 2.677% 98.822% # ( 6, 10 ] 27393 0.759% 99.580% ( 10, 15 ] 3876 0.107% 99.688% ( 15, 22 ] 623 0.017% 99.705% ( 22, 34 ] 36 0.001% 99.706% ( 34, 51 ] 21 0.001% 99.706% ( 51, 76 ] 102 0.003% 99.709% ( 76, 110 ] 3327 0.092% 99.801% ( 110, 170 ] 5061 0.140% 99.941% ( 170, 250 ] 1079 0.030% 99.971% ( 250, 380 ] 693 0.019% 99.991% ( 380, 580 ] 582 0.016% 100.007% ( 580, 870 ] 236 0.007% 100.013% ( 870, 1300 ] 133 0.004% 100.017% ( 1300, 1900 ] 55 0.002% 100.018% ( 1900, 2900 ] 52 0.001% 100.020% ( 2900, 4400 ] 53 0.001% 100.021% ( 4400, 6600 ] 9 0.000% 100.022% ( 6600, 9900 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 2152894 Average: 5.2300 StdDev: 80.50 Min: 1 Median: 1.7271 Max: 9565 Percentiles: P50: 1.73 P75: 2.51 P99: 9.07 P99.9: 140.81 P99.99: 375.77 ------------------------------------------------------ [ 0, 1 ] 226782 10.534% 10.534% ## ( 1, 2 ] 1168506 54.276% 64.810% ########### ( 2, 3 ] 429912 19.969% 84.779% #### ( 3, 4 ] 134873 6.265% 91.044% # ( 4, 6 ] 142117 6.601% 97.645% # ( 6, 10 ] 38061 1.768% 99.413% ( 10, 15 ] 6786 0.315% 99.728% ( 15, 22 ] 1007 0.047% 99.775% ( 22, 34 ] 69 0.003% 99.778% ( 34, 51 ] 13 0.001% 99.779% ( 51, 76 ] 18 0.001% 99.779% ( 76, 110 ] 1623 0.075% 99.855% ( 110, 170 ] 1897 0.088% 99.943% ( 170, 250 ] 530 0.025% 99.967% ( 250, 380 ] 501 0.023% 99.991% ( 380, 580 ] 584 0.027% 100.018% ( 580, 870 ] 595 0.028% 100.046% ( 870, 1300 ] 485 0.023% 100.068% ( 1300, 1900 ] 336 0.016% 100.084% ( 1900, 2900 ] 464 0.022% 100.105% ( 2900, 4400 ] 436 0.020% 100.125% ( 4400, 6600 ] 113 0.005% 100.131% ( 6600, 9900 ] 16 0.001% 100.131% ** Level 2 read latency histogram (micros): Count: 31745 Average: 1.7979 StdDev: 9.93 Min: 0 Median: 1.2538 Max: 1733 Percentiles: P50: 1.25 P75: 1.66 P99: 3.72 P99.9: 8.91 P99.99: 20.78 ------------------------------------------------------ [ 0, 1 ] 10912 34.374% 34.374% ####### ( 1, 2 ] 19548 61.578% 95.952% ############ ( 2, 3 ] 734 2.312% 98.264% ( 3, 4 ] 324 1.021% 99.285% ( 4, 6 ] 148 0.466% 99.751% ( 6, 10 ] 65 0.205% 99.956% ( 10, 15 ] 10 0.032% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 1300, 1900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 288475 Average: 17.7708 StdDev: 193.92 Min: 1 Median: 2.0894 Max: 7986 Percentiles: P50: 2.09 P75: 2.92 P99: 192.85 P99.9: 2550.09 P99.99: 3643.66 ------------------------------------------------------ [ 0, 1 ] 4275 1.482% 1.482% ( 1, 2 ] 132216 45.833% 47.315% ######### ( 2, 3 ] 86694 30.053% 77.367% ###### ( 3, 4 ] 27008 9.362% 86.730% ## ( 4, 6 ] 28227 9.785% 96.514% ## ( 6, 10 ] 5696 1.975% 98.489% ( 10, 15 ] 1034 0.358% 98.847% ( 15, 22 ] 121 0.042% 98.889% ( 22, 34 ] 15 0.005% 98.895% ( 34, 51 ] 5 0.002% 98.896% ( 51, 76 ] 4 0.001% 98.898% ( 76, 110 ] 51 0.018% 98.915% ( 110, 170 ] 168 0.058% 98.974% ( 170, 250 ] 267 0.093% 99.066% ( 250, 380 ] 301 0.104% 99.170% ( 380, 580 ] 496 0.172% 99.342% ( 580, 870 ] 599 0.208% 99.550% ( 870, 1300 ] 507 0.176% 99.726% ( 1300, 1900 ] 314 0.109% 99.835% ( 1900, 2900 ] 290 0.101% 99.935% ( 2900, 4400 ] 319 0.111% 100.046% ( 4400, 6600 ] 91 0.032% 100.077% ( 6600, 9900 ] 21 0.007% 100.085% ** Level 4 read latency histogram (micros): Count: 50 Average: 2755.0400 StdDev: 2313.69 Min: 0 Median: 3050.0000 Max: 8099 Percentiles: P50: 3050.00 P75: 4950.00 P99: 8099.00 P99.9: 8099.00 P99.99: 8099.00 ------------------------------------------------------ [ 0, 1 ] 6 12.000% 12.000% ## ( 1, 2 ] 3 6.000% 18.000% # ( 110, 170 ] 1 2.000% 20.000% ( 170, 250 ] 2 4.000% 24.000% # ( 250, 380 ] 1 2.000% 26.000% ( 380, 580 ] 3 6.000% 32.000% # ( 580, 870 ] 1 2.000% 34.000% ( 870, 1300 ] 3 6.000% 40.000% # ( 1300, 1900 ] 2 4.000% 44.000% # ( 1900, 2900 ] 2 4.000% 48.000% # ( 2900, 4400 ] 10 20.000% 68.000% #### ( 4400, 6600 ] 14 28.000% 96.000% ###### ( 6600, 9900 ] 2 4.000% 100.000% # ** Level 5 read latency histogram (micros): Count: 280 Average: 1465.6929 StdDev: 1441.92 Min: 86 Median: 828.5714 Max: 6561 Percentiles: P50: 828.57 P75: 2305.41 P99: 6237.65 P99.9: 6561.00 P99.99: 6561.00 ------------------------------------------------------ ( 76, 110 ] 5 1.786% 1.786% ( 110, 170 ] 23 8.214% 10.000% ## ( 170, 250 ] 15 5.357% 15.357% # ( 250, 380 ] 38 13.571% 28.929% ### ( 380, 580 ] 29 10.357% 39.286% ## ( 580, 870 ] 35 12.500% 51.786% ### ( 870, 1300 ] 27 9.643% 61.429% ## ( 1300, 1900 ] 23 8.214% 69.643% ## ( 1900, 2900 ] 37 13.214% 82.857% ### ( 2900, 4400 ] 31 11.071% 93.929% ## ( 4400, 6600 ] 17 6.071% 100.000% # ** DB Stats ** Uptime(secs): 54.9 total, 3.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 161.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:30.375 H:M:S, 55.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.467 H:M:S, 15.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/16-19:53:24 ... thread 0: (1000000,10000000) ops and (318127.0,173005.8) ops/second in (3.143399,57.801526) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 3.32 GB 75.5 8.3 0.0 8.3 17.8 9.5 0.0 1.9 135.9 290.8 62.56 56.23 163 0.384 8634K 10K 0.0 0.0 L1 16/16 1.22 GB 0.0 10.1 6.0 4.2 10.0 5.8 0.2 1.7 217.2 214.4 47.72 43.62 5 9.545 9564K 39K 0.0 0.0 L2 2/0 57.72 MB 0.6 0.1 0.1 0.1 0.1 0.1 4.8 2.0 257.0 256.9 0.49 0.47 1 0.490 127K 46 0.0 0.0 L3 18/0 871.25 MB 0.9 5.3 4.0 1.3 5.3 4.0 0.8 1.3 132.6 132.4 40.73 24.79 30 1.358 4369K 4251 0.0 0.0 L4 155/0 9.59 GB 1.0 0.2 0.1 0.0 0.2 0.1 4.5 1.3 219.2 219.2 0.74 0.69 1 0.743 165K 22 0.0 0.0 L5 1100/0 90.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1309/30 105.46 GB 0.0 24.0 10.1 13.8 33.3 19.5 14.9 3.5 161.3 224.0 152.25 125.79 200 0.761 22M 54K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.0 10.1 13.8 33.3 19.5 14.8 3.5 161.3 224.0 152.25 125.79 200 0.761 22M 54K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.0 10.1 13.8 23.8 10.0 0.0 0.0 200.7 199.5 122.36 101.16 65 1.882 22M 54K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 324.6 29.89 24.63 135 0.221 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 58.0 total, 57.8 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.31 GB write, 587.76 MB/s write, 23.98 GB read, 423.18 MB/s read, 152.3 seconds Interval compaction: 33.31 GB write, 590.05 MB/s write, 23.98 GB read, 424.83 MB/s read, 152.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 58, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 30, total-stops: 58, interval: 88 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3985742 Average: 2.8281 StdDev: 22.94 Min: 0 Median: 1.5454 Max: 7302 Percentiles: P50: 1.55 P75: 1.92 P99: 6.71 P99.9: 147.11 P99.99: 343.96 ------------------------------------------------------ [ 0, 1 ] 554312 13.907% 13.907% ### ( 1, 2 ] 2637815 66.181% 80.089% ############# ( 2, 3 ] 510132 12.799% 92.888% ### ( 3, 4 ] 132510 3.325% 96.212% # ( 4, 6 ] 105800 2.654% 98.867% # ( 6, 10 ] 29744 0.746% 99.613% ( 10, 15 ] 4080 0.102% 99.715% ( 15, 22 ] 659 0.017% 99.732% ( 22, 34 ] 38 0.001% 99.733% ( 34, 51 ] 22 0.001% 99.733% ( 51, 76 ] 104 0.003% 99.736% ( 76, 110 ] 3370 0.085% 99.820% ( 110, 170 ] 5127 0.129% 99.949% ( 170, 250 ] 1119 0.028% 99.977% ( 250, 380 ] 709 0.018% 99.995% ( 380, 580 ] 592 0.015% 100.010% ( 580, 870 ] 242 0.006% 100.016% ( 870, 1300 ] 140 0.004% 100.019% ( 1300, 1900 ] 56 0.001% 100.021% ( 1900, 2900 ] 54 0.001% 100.022% ( 2900, 4400 ] 55 0.001% 100.024% ( 4400, 6600 ] 9 0.000% 100.024% ( 6600, 9900 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 2156223 Average: 5.2306 StdDev: 80.45 Min: 1 Median: 1.7270 Max: 9565 Percentiles: P50: 1.73 P75: 2.51 P99: 9.07 P99.9: 141.56 P99.99: 376.76 ------------------------------------------------------ [ 0, 1 ] 227007 10.528% 10.528% ## ( 1, 2 ] 1170712 54.295% 64.823% ########### ( 2, 3 ] 430514 19.966% 84.789% #### ( 3, 4 ] 134957 6.259% 91.048% # ( 4, 6 ] 142207 6.595% 97.643% # ( 6, 10 ] 38118 1.768% 99.411% ( 10, 15 ] 6788 0.315% 99.725% ( 15, 22 ] 1007 0.047% 99.772% ( 22, 34 ] 69 0.003% 99.775% ( 34, 51 ] 13 0.001% 99.776% ( 51, 76 ] 18 0.001% 99.777% ( 76, 110 ] 1649 0.076% 99.853% ( 110, 170 ] 1916 0.089% 99.942% ( 170, 250 ] 539 0.025% 99.967% ( 250, 380 ] 506 0.023% 99.991% ( 380, 580 ] 586 0.027% 100.018% ( 580, 870 ] 596 0.028% 100.045% ( 870, 1300 ] 486 0.023% 100.068% ( 1300, 1900 ] 336 0.016% 100.084% ( 1900, 2900 ] 464 0.022% 100.105% ( 2900, 4400 ] 436 0.020% 100.125% ( 4400, 6600 ] 113 0.005% 100.131% ( 6600, 9900 ] 16 0.001% 100.131% ** Level 2 read latency histogram (micros): Count: 31745 Average: 1.7979 StdDev: 9.93 Min: 0 Median: 1.2538 Max: 1733 Percentiles: P50: 1.25 P75: 1.66 P99: 3.72 P99.9: 8.91 P99.99: 20.78 ------------------------------------------------------ [ 0, 1 ] 10912 34.374% 34.374% ####### ( 1, 2 ] 19548 61.578% 95.952% ############ ( 2, 3 ] 734 2.312% 98.264% ( 3, 4 ] 324 1.021% 99.285% ( 4, 6 ] 148 0.466% 99.751% ( 6, 10 ] 65 0.205% 99.956% ( 10, 15 ] 10 0.032% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 1300, 1900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 288475 Average: 17.7708 StdDev: 193.92 Min: 1 Median: 2.0894 Max: 7986 Percentiles: P50: 2.09 P75: 2.92 P99: 192.85 P99.9: 2550.09 P99.99: 3643.66 ------------------------------------------------------ [ 0, 1 ] 4275 1.482% 1.482% ( 1, 2 ] 132216 45.833% 47.315% ######### ( 2, 3 ] 86694 30.053% 77.367% ###### ( 3, 4 ] 27008 9.362% 86.730% ## ( 4, 6 ] 28227 9.785% 96.514% ## ( 6, 10 ] 5696 1.975% 98.489% ( 10, 15 ] 1034 0.358% 98.847% ( 15, 22 ] 121 0.042% 98.889% ( 22, 34 ] 15 0.005% 98.895% ( 34, 51 ] 5 0.002% 98.896% ( 51, 76 ] 4 0.001% 98.898% ( 76, 110 ] 51 0.018% 98.915% ( 110, 170 ] 168 0.058% 98.974% ( 170, 250 ] 267 0.093% 99.066% ( 250, 380 ] 301 0.104% 99.170% ( 380, 580 ] 496 0.172% 99.342% ( 580, 870 ] 599 0.208% 99.550% ( 870, 1300 ] 507 0.176% 99.726% ( 1300, 1900 ] 314 0.109% 99.835% ( 1900, 2900 ] 290 0.101% 99.935% ( 2900, 4400 ] 319 0.111% 100.046% ( 4400, 6600 ] 91 0.032% 100.077% ( 6600, 9900 ] 21 0.007% 100.085% ** Level 4 read latency histogram (micros): Count: 50 Average: 2755.0400 StdDev: 2313.69 Min: 0 Median: 3050.0000 Max: 8099 Percentiles: P50: 3050.00 P75: 4950.00 P99: 8099.00 P99.9: 8099.00 P99.99: 8099.00 ------------------------------------------------------ [ 0, 1 ] 6 12.000% 12.000% ## ( 1, 2 ] 3 6.000% 18.000% # ( 110, 170 ] 1 2.000% 20.000% ( 170, 250 ] 2 4.000% 24.000% # ( 250, 380 ] 1 2.000% 26.000% ( 380, 580 ] 3 6.000% 32.000% # ( 580, 870 ] 1 2.000% 34.000% ( 870, 1300 ] 3 6.000% 40.000% # ( 1300, 1900 ] 2 4.000% 44.000% # ( 1900, 2900 ] 2 4.000% 48.000% # ( 2900, 4400 ] 10 20.000% 68.000% #### ( 4400, 6600 ] 14 28.000% 96.000% ###### ( 6600, 9900 ] 2 4.000% 100.000% # ** Level 5 read latency histogram (micros): Count: 280 Average: 1465.6929 StdDev: 1441.92 Min: 86 Median: 828.5714 Max: 6561 Percentiles: P50: 828.57 P75: 2305.41 P99: 6237.65 P99.9: 6561.00 P99.99: 6561.00 ------------------------------------------------------ ( 76, 110 ] 5 1.786% 1.786% ( 110, 170 ] 23 8.214% 10.000% ## ( 170, 250 ] 15 5.357% 15.357% # ( 250, 380 ] 38 13.571% 28.929% ### ( 380, 580 ] 29 10.357% 39.286% ## ( 580, 870 ] 35 12.500% 51.786% ### ( 870, 1300 ] 27 9.643% 61.429% ## ( 1300, 1900 ] 23 8.214% 69.643% ## ( 1900, 2900 ] 37 13.214% 82.857% ### ( 2900, 4400 ] 31 11.071% 93.929% ## ( 4400, 6600 ] 17 6.071% 100.000% # ** DB Stats ** Uptime(secs): 58.0 total, 3.1 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 169.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:30.881 H:M:S, 53.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 313.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.506 H:M:S, 16.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.718 micros/op 174881 ops/sec 60.149 seconds 10518999 operations; 169.4 MB/s Microseconds per write: Count: 10518999 Average: 5.7181 StdDev: 452.99 Min: 0 Median: 1.7179 Max: 844856 Percentiles: P50: 1.72 P75: 2.69 P99: 8.61 P99.9: 1152.19 P99.99: 2747.49 ------------------------------------------------------ [ 0, 1 ] 1494911 14.212% 14.212% ### ( 1, 2 ] 5244020 49.853% 64.064% ########## ( 2, 3 ] 1659364 15.775% 79.839% ### ( 3, 4 ] 1428402 13.579% 93.419% ### ( 4, 6 ] 522643 4.969% 98.387% # ( 6, 10 ] 98948 0.941% 99.328% ( 10, 15 ] 31803 0.302% 99.630% ( 15, 22 ] 8563 0.081% 99.712% ( 22, 34 ] 1591 0.015% 99.727% ( 34, 51 ] 205 0.002% 99.729% ( 51, 76 ] 36 0.000% 99.729% ( 76, 110 ] 7505 0.071% 99.800% ( 110, 170 ] 2725 0.026% 99.826% ( 170, 250 ] 290 0.003% 99.829% ( 250, 380 ] 129 0.001% 99.830% ( 380, 580 ] 26 0.000% 99.830% ( 580, 870 ] 24 0.000% 99.831% ( 870, 1300 ] 11116 0.106% 99.936% ( 1300, 1900 ] 23 0.000% 99.937% ( 1900, 2900 ] 6635 0.063% 100.000% ( 2900, 4400 ] 7 0.000% 100.000% ( 4400, 6600 ] 3 0.000% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 17 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 166903 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10518999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10855606968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 510 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31862840 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 27755623889 rocksdb.compact.write.bytes COUNT : 27585683853 rocksdb.flush.write.bytes COUNT : 10833310951 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 67 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 280 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10746083328 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4284416 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 27857870713 rocksdb.non.last.level.read.count COUNT : 6724935 rocksdb.block.checksum.compute.count COUNT : 6723982 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.358757 P95 : 3.847576 P99 : 6.881792 P100 : 844854.000000 COUNT : 10518999 SUM : 55371142 rocksdb.compaction.times.micros P50 : 1146571.428571 P95 : 4136666.666667 P99 : 16640000.000000 P100 : 21822465.000000 COUNT : 67 SUM : 124239032 rocksdb.compaction.times.cpu_micros P50 : 995128.205128 P95 : 4055000.000000 P99 : 16640000.000000 P100 : 19996165.000000 COUNT : 67 SUM : 103012953 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 703.820225 P95 : 1293.857143 P99 : 46260.000000 P100 : 318304.000000 COUNT : 144 SUM : 516769 rocksdb.compaction.outfile.sync.micros P50 : 1011.285714 P95 : 87600.000000 P99 : 200430.000000 P100 : 200430.000000 COUNT : 304 SUM : 4604264 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 101.079208 P95 : 1843.750000 P99 : 4730.000000 P100 : 5387.000000 COUNT : 255 SUM : 92397 rocksdb.table.open.io.micros P50 : 1721.621622 P95 : 10373.076923 P99 : 20472.727273 P100 : 22457.000000 COUNT : 510 SUM : 1422470 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.663843 P95 : 7.489762 P99 : 10.937836 P100 : 9570.000000 COUNT : 6722758 SUM : 42202049 rocksdb.read.block.get.micros P50 : 580.000000 P95 : 4182.258065 P99 : 6343.333333 P100 : 8181.000000 COUNT : 1020 SUM : 1113111 rocksdb.write.raw.block.micros P50 : 0.512620 P95 : 0.973977 P99 : 2.768749 P100 : 16854.000000 COUNT : 9305436 SUM : 18947509 rocksdb.numfiles.in.singlecompaction P50 : 3.331461 P95 : 3.993820 P99 : 26.140000 P100 : 28.000000 COUNT : 131 SUM : 527 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.563769 P95 : 1251.955286 P99 : 2665.999698 P100 : 844665.000000 COUNT : 158038 SUM : 31876298 rocksdb.sst.read.micros P50 : 1.612560 P95 : 4.430840 P99 : 8.425280 P100 : 9565.000000 COUNT : 6725526 SUM : 28993986 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10518999 SUM : 10855606968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 213428.571429 P95 : 378470.588235 P99 : 796200.000000 P100 : 985380.000000 COUNT : 144 SUM : 31656405 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 297 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0