[2024-11-18 18:19:41.498270] Starting SPDK v25.01-pre git sha1 d47eb51c9 / DPDK 24.03.0 initialization... [2024-11-18 18:19:41.498536] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1701972 ] Set seed to 1731950381491499 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-18 18:19:41.625677] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-18 18:19:41.732723] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-18 18:19:41.732767] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1701972' to capture a snapshot of events at runtime. [2024-11-18 18:19:41.732777] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-18 18:19:41.732787] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-18 18:19:41.732795] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1701972 for offline analysis/debug. [2024-11-18 18:19:41.734146] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Nov 18 18:19:50 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/18-18:19:53 ... thread 0: (1000000,1000000) ops and (334467.6,334467.6) ops/second in (2.989826,2.989826) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 693.00 MB 6.3 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 344.3 2.56 2.29 12 0.213 0 0 0.0 0.0 L2 3/2 237.04 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 257.0 256.9 1.36 1.29 2 0.678 353K 183 0.0 0.0 L3 10/0 881.92 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 112/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1032/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1167/11 97.00 GB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 89.0 314.1 3.92 3.58 14 0.280 353K 183 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 89.0 314.1 3.92 3.58 14 0.280 353K 183 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 257.0 256.9 1.36 1.29 2 0.678 353K 183 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 344.3 2.56 2.29 12 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.20 GB write, 388.48 MB/s write, 0.34 GB read, 110.04 MB/s read, 3.9 seconds Interval compaction: 1.20 GB write, 411.31 MB/s write, 0.34 GB read, 116.51 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 134981 Average: 2.0498 StdDev: 15.28 Min: 1 Median: 1.3802 Max: 3920 Percentiles: P50: 1.38 P75: 1.78 P99: 4.99 P99.9: 9.34 P99.99: 17.72 ------------------------------------------------------ [ 0, 1 ] 35008 25.936% 25.936% ##### ( 1, 2 ] 85434 63.293% 89.229% ############# ( 2, 3 ] 9160 6.786% 96.015% # ( 3, 4 ] 3169 2.348% 98.363% ( 4, 6 ] 1735 1.285% 99.648% ( 6, 10 ] 408 0.302% 99.950% ( 10, 15 ] 51 0.038% 99.988% ( 15, 22 ] 9 0.007% 99.995% ( 110, 170 ] 5 0.004% 99.999% ( 170, 250 ] 4 0.003% 100.001% ( 250, 380 ] 6 0.004% 100.006% ( 380, 580 ] 1 0.001% 100.007% ( 580, 870 ] 1 0.001% 100.007% ( 870, 1300 ] 2 0.001% 100.009% ( 1300, 1900 ] 3 0.002% 100.011% ( 1900, 2900 ] 1 0.001% 100.012% ( 2900, 4400 ] 1 0.001% 100.013% ** Level 2 read latency histogram (micros): Count: 87858 Average: 2.3139 StdDev: 29.36 Min: 0 Median: 1.3788 Max: 5495 Percentiles: P50: 1.38 P75: 1.78 P99: 5.53 P99.9: 18.91 P99.99: 740.53 ------------------------------------------------------ [ 0, 1 ] 22930 26.099% 26.099% ##### ( 1, 2 ] 55437 63.098% 89.197% ############# ( 2, 3 ] 5743 6.537% 95.734% # ( 3, 4 ] 1930 2.197% 97.931% ( 4, 6 ] 1232 1.402% 99.333% ( 6, 10 ] 426 0.485% 99.818% ( 10, 15 ] 67 0.076% 99.894% ( 15, 22 ] 11 0.013% 99.907% ( 22, 34 ] 3 0.003% 99.910% ( 34, 51 ] 1 0.001% 99.911% ( 51, 76 ] 32 0.036% 99.948% ( 76, 110 ] 5 0.006% 99.953% ( 110, 170 ] 6 0.007% 99.960% ( 170, 250 ] 14 0.016% 99.976% ( 250, 380 ] 8 0.009% 99.985% ( 380, 580 ] 3 0.003% 99.989% ( 580, 870 ] 4 0.005% 99.993% ( 1300, 1900 ] 2 0.002% 99.995% ( 1900, 2900 ] 3 0.003% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ( 4400, 6600 ] 1 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 50 Average: 2660.2200 StdDev: 2205.49 Min: 102 Median: 2471.4286 Max: 7780 Percentiles: P50: 2471.43 P75: 4087.50 P99: 7780.00 P99.9: 7780.00 P99.99: 7780.00 ------------------------------------------------------ ( 76, 110 ] 1 2.000% 2.000% ( 110, 170 ] 4 8.000% 10.000% ## ( 170, 250 ] 5 10.000% 20.000% ## ( 250, 380 ] 2 4.000% 24.000% # ( 380, 580 ] 1 2.000% 26.000% ( 580, 870 ] 5 10.000% 36.000% ## ( 870, 1300 ] 1 2.000% 38.000% ( 1300, 1900 ] 2 4.000% 42.000% # ( 1900, 2900 ] 7 14.000% 56.000% ### ( 2900, 4400 ] 12 24.000% 80.000% ##### ( 4400, 6600 ] 6 12.000% 92.000% ## ( 6600, 9900 ] 4 8.000% 100.000% ## ** Level 4 read latency histogram (micros): Count: 25 Average: 3966.8800 StdDev: 2426.18 Min: 141 Median: 3350.0000 Max: 8845 Percentiles: P50: 3350.00 P75: 5610.00 P99: 8845.00 P99.9: 8845.00 P99.99: 8845.00 ------------------------------------------------------ ( 110, 170 ] 1 4.000% 4.000% # ( 870, 1300 ] 1 4.000% 8.000% # ( 1300, 1900 ] 1 4.000% 12.000% # ( 1900, 2900 ] 8 32.000% 44.000% ###### ( 2900, 4400 ] 5 20.000% 64.000% #### ( 4400, 6600 ] 5 20.000% 84.000% #### ( 6600, 9900 ] 4 16.000% 100.000% ### ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 310.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.412 H:M:S, 13.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.412 H:M:S, 13.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/18-18:19:56 ... thread 0: (1000000,2000000) ops and (327881.0,331141.6) ops/second in (3.049887,6.039713) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 1.29 GB 25.2 0.6 0.0 0.6 2.3 1.8 0.0 1.3 77.0 325.1 7.36 6.73 27 0.273 575K 658 0.0 0.0 L1 1/1 2.95 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 243.9 243.5 1.29 1.25 1 1.292 319K 428 0.0 0.0 L2 2/1 146.20 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.3 1.8 257.0 256.9 1.36 1.29 2 0.678 353K 183 0.0 0.0 L3 19/10 1.09 GB 0.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 227.6 227.6 0.82 0.77 1 0.822 189K 0 0.0 0.0 L4 169/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 132.7 132.8 1.27 0.89 1 1.267 170K 0 0.0 0.0 L5 1032/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1235/21 97.92 GB 0.0 1.5 0.8 0.7 3.3 2.6 0.7 1.9 131.1 282.0 12.10 10.92 32 0.378 1610K 1269 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.8 0.7 3.3 2.6 0.7 1.9 131.1 282.0 12.10 10.92 32 0.378 1610K 1269 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.8 0.7 1.5 0.8 0.0 0.0 231.8 231.6 6.84 6.25 7 0.977 1610K 1269 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 347.4 5.26 4.66 25 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.33 GB write, 548.73 MB/s write, 1.55 GB read, 255.08 MB/s read, 12.1 seconds Interval compaction: 3.33 GB write, 564.69 MB/s write, 1.55 GB read, 262.50 MB/s read, 12.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 424672 Average: 2.2652 StdDev: 12.27 Min: 1 Median: 1.5407 Max: 3920 Percentiles: P50: 1.54 P75: 1.92 P99: 5.60 P99.9: 9.59 P99.99: 13.38 ------------------------------------------------------ [ 0, 1 ] 61358 14.448% 14.448% ### ( 1, 2 ] 279220 65.750% 80.198% ############# ( 2, 3 ] 55429 13.052% 93.250% ### ( 3, 4 ] 15977 3.762% 97.012% # ( 4, 6 ] 10573 2.490% 99.502% ( 6, 10 ] 1888 0.445% 99.947% ( 10, 15 ] 276 0.065% 100.012% ( 15, 22 ] 27 0.006% 100.018% ( 22, 34 ] 2 0.000% 100.018% ( 34, 51 ] 2 0.000% 100.019% ( 110, 170 ] 9 0.002% 100.021% ( 170, 250 ] 11 0.003% 100.024% ( 250, 380 ] 8 0.002% 100.025% ( 380, 580 ] 5 0.001% 100.027% ( 580, 870 ] 7 0.002% 100.028% ( 870, 1300 ] 4 0.001% 100.029% ( 1300, 1900 ] 6 0.001% 100.031% ( 1900, 2900 ] 1 0.000% 100.031% ( 2900, 4400 ] 3 0.001% 100.032% ** Level 1 read latency histogram (micros): Count: 21 Average: 149.0476 StdDev: 289.41 Min: 1 Median: 1.9000 Max: 1065 Percentiles: P50: 1.90 P75: 230.00 P99: 1065.00 P99.9: 1065.00 P99.99: 1065.00 ------------------------------------------------------ [ 0, 1 ] 6 28.571% 28.571% ###### ( 1, 2 ] 5 23.810% 52.381% ##### ( 2, 3 ] 3 14.286% 66.667% ### ( 6, 10 ] 1 4.762% 71.429% # ( 170, 250 ] 1 4.762% 76.190% # ( 250, 380 ] 2 9.524% 85.714% ## ( 380, 580 ] 1 4.762% 90.476% # ( 580, 870 ] 1 4.762% 95.238% # ( 870, 1300 ] 1 4.762% 100.000% # ** Level 2 read latency histogram (micros): Count: 88328 Average: 2.3168 StdDev: 29.28 Min: 0 Median: 1.3818 Max: 5495 Percentiles: P50: 1.38 P75: 1.78 P99: 5.53 P99.9: 18.61 P99.99: 737.12 ------------------------------------------------------ [ 0, 1 ] 22931 25.961% 25.961% ##### ( 1, 2 ] 55614 62.963% 88.924% ############# ( 2, 3 ] 5974 6.763% 95.688% # ( 3, 4 ] 1965 2.225% 97.912% ( 4, 6 ] 1253 1.419% 99.331% ( 6, 10 ] 429 0.486% 99.817% ( 10, 15 ] 68 0.077% 99.894% ( 15, 22 ] 11 0.012% 99.906% ( 22, 34 ] 3 0.003% 99.909% ( 34, 51 ] 1 0.001% 99.911% ( 51, 76 ] 32 0.036% 99.947% ( 76, 110 ] 5 0.006% 99.952% ( 110, 170 ] 6 0.007% 99.959% ( 170, 250 ] 14 0.016% 99.975% ( 250, 380 ] 8 0.009% 99.984% ( 380, 580 ] 3 0.003% 99.988% ( 580, 870 ] 4 0.005% 99.992% ( 1300, 1900 ] 2 0.002% 99.994% ( 1900, 2900 ] 3 0.003% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 197253 Average: 3.7619 StdDev: 57.92 Min: 1 Median: 1.6584 Max: 7780 Percentiles: P50: 1.66 P75: 2.20 P99: 8.92 P99.9: 189.53 P99.99: 625.91 ------------------------------------------------------ [ 0, 1 ] 16692 8.462% 8.462% ## ( 1, 2 ] 124451 63.092% 71.554% ############# ( 2, 3 ] 34515 17.498% 89.052% ### ( 3, 4 ] 9811 4.974% 94.026% # ( 4, 6 ] 7325 3.714% 97.739% # ( 6, 10 ] 3407 1.727% 99.467% ( 10, 15 ] 414 0.210% 99.677% ( 15, 22 ] 53 0.027% 99.703% ( 22, 34 ] 10 0.005% 99.708% ( 34, 51 ] 2 0.001% 99.710% ( 51, 76 ] 1 0.001% 99.710% ( 76, 110 ] 121 0.061% 99.771% ( 110, 170 ] 234 0.119% 99.890% ( 170, 250 ] 85 0.043% 99.933% ( 250, 380 ] 75 0.038% 99.971% ( 380, 580 ] 34 0.017% 99.988% ( 580, 870 ] 27 0.014% 100.002% ( 870, 1300 ] 6 0.003% 100.005% ( 1300, 1900 ] 5 0.003% 100.008% ( 1900, 2900 ] 7 0.004% 100.011% ( 2900, 4400 ] 14 0.007% 100.018% ( 4400, 6600 ] 6 0.003% 100.021% ( 6600, 9900 ] 4 0.002% 100.023% ** Level 4 read latency histogram (micros): Count: 310 Average: 326.8000 StdDev: 1279.93 Min: 0 Median: 1.6452 Max: 8845 Percentiles: P50: 1.65 P75: 6.24 P99: 7342.50 P99.9: 8845.00 P99.99: 8845.00 ------------------------------------------------------ [ 0, 1 ] 75 24.194% 24.194% ##### ( 1, 2 ] 124 40.000% 64.194% ######## ( 2, 3 ] 19 6.129% 70.323% # ( 3, 4 ] 4 1.290% 71.613% ( 4, 6 ] 8 2.581% 74.194% # ( 6, 10 ] 41 13.226% 87.419% ### ( 10, 15 ] 9 2.903% 90.323% # ( 110, 170 ] 3 0.968% 91.290% ( 170, 250 ] 2 0.645% 91.935% ( 380, 580 ] 1 0.323% 92.258% ( 870, 1300 ] 1 0.323% 92.581% ( 1300, 1900 ] 1 0.323% 92.903% ( 1900, 2900 ] 8 2.581% 95.484% # ( 2900, 4400 ] 5 1.613% 97.097% ( 4400, 6600 ] 5 1.613% 98.710% ( 6600, 9900 ] 4 1.290% 100.000% ** DB Stats ** Uptime(secs): 6.2 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 316.61 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.827 H:M:S, 13.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.415 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/18-18:19:59 ... thread 0: (1000000,3000000) ops and (327779.0,330013.1) ops/second in (3.050836,9.090549) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 1.48 GB 119.6 1.6 0.0 1.6 4.4 2.8 0.0 1.6 113.6 310.1 14.42 13.34 45 0.320 1663K 1731 0.0 0.0 L1 4/0 303.44 MB 30.3 1.1 1.1 0.0 1.1 1.1 0.2 1.0 237.7 237.1 4.78 4.66 2 2.390 1153K 2978 0.0 0.0 L2 3/2 386.31 MB 1.3 0.3 0.2 0.2 0.3 0.2 0.8 1.8 257.0 256.9 1.36 1.29 2 0.678 353K 183 0.0 0.0 L3 19/1 873.74 MB 0.7 1.4 0.5 1.0 1.4 0.4 0.2 3.1 227.7 227.4 6.36 5.79 4 1.591 1472K 2251 0.0 0.0 L4 169/0 9.46 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 132.7 132.8 1.27 0.89 1 1.267 170K 0 0.0 0.0 L5 1040/0 86.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1244/7 98.90 GB 0.0 4.6 1.9 2.7 7.4 4.7 2.4 2.7 168.2 268.5 28.18 25.96 54 0.522 4813K 7143 0.0 0.0 Int 0/0 0.00 KB 0.0 4.6 1.9 2.7 7.4 4.7 2.4 2.7 168.2 268.5 28.18 25.96 54 0.522 4813K 7143 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.6 1.9 2.7 4.6 1.9 0.0 0.0 236.1 235.8 20.07 18.80 15 1.338 4813K 7143 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 349.6 8.11 7.16 39 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.3 total, 9.1 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.39 GB write, 816.58 MB/s write, 4.63 GB read, 511.49 MB/s read, 28.2 seconds Interval compaction: 7.39 GB write, 832.37 MB/s write, 4.63 GB read, 521.38 MB/s read, 28.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 757101 Average: 2.3521 StdDev: 10.56 Min: 1 Median: 1.5922 Max: 3920 Percentiles: P50: 1.59 P75: 1.98 P99: 5.77 P99.9: 9.90 P99.99: 13.72 ------------------------------------------------------ [ 0, 1 ] 85764 11.328% 11.328% ## ( 1, 2 ] 494419 65.304% 76.632% ############# ( 2, 3 ] 114714 15.152% 91.784% ### ( 3, 4 ] 33332 4.403% 96.187% # ( 4, 6 ] 24019 3.172% 99.359% # ( 6, 10 ] 4197 0.554% 99.913% ( 10, 15 ] 781 0.103% 100.017% ( 15, 22 ] 65 0.009% 100.025% ( 22, 34 ] 7 0.001% 100.026% ( 34, 51 ] 6 0.001% 100.027% ( 51, 76 ] 1 0.000% 100.027% ( 110, 170 ] 11 0.001% 100.028% ( 170, 250 ] 20 0.003% 100.031% ( 250, 380 ] 11 0.001% 100.032% ( 380, 580 ] 11 0.001% 100.034% ( 580, 870 ] 11 0.001% 100.035% ( 870, 1300 ] 15 0.002% 100.037% ( 1300, 1900 ] 6 0.001% 100.038% ( 1900, 2900 ] 2 0.000% 100.038% ( 2900, 4400 ] 3 0.000% 100.039% ** Level 1 read latency histogram (micros): Count: 137787 Average: 3.2141 StdDev: 16.39 Min: 1 Median: 1.8571 Max: 2011 Percentiles: P50: 1.86 P75: 2.68 P99: 8.66 P99.9: 14.67 P99.99: 129.86 ------------------------------------------------------ [ 0, 1 ] 3321 2.410% 2.410% ( 1, 2 ] 76503 55.523% 57.933% ########### ( 2, 3 ] 34705 25.187% 83.120% ##### ( 3, 4 ] 10333 7.499% 90.620% # ( 4, 6 ] 10038 7.285% 97.905% # ( 6, 10 ] 2266 1.645% 99.549% ( 10, 15 ] 517 0.375% 99.925% ( 15, 22 ] 58 0.042% 99.967% ( 22, 34 ] 3 0.002% 99.969% ( 34, 51 ] 2 0.001% 99.970% ( 51, 76 ] 1 0.001% 99.971% ( 76, 110 ] 10 0.007% 99.978% ( 110, 170 ] 49 0.036% 100.014% ( 170, 250 ] 34 0.025% 100.038% ( 250, 380 ] 32 0.023% 100.062% ( 380, 580 ] 35 0.025% 100.087% ( 580, 870 ] 9 0.007% 100.094% ( 870, 1300 ] 10 0.007% 100.101% ( 1300, 1900 ] 2 0.001% 100.102% ( 1900, 2900 ] 1 0.001% 100.103% ** Level 2 read latency histogram (micros): Count: 100720 Average: 2.3373 StdDev: 27.42 Min: 0 Median: 1.4219 Max: 5495 Percentiles: P50: 1.42 P75: 1.82 P99: 5.67 P99.9: 14.83 P99.99: 647.28 ------------------------------------------------------ [ 0, 1 ] 23607 23.438% 23.438% ##### ( 1, 2 ] 63417 62.964% 86.402% ############# ( 2, 3 ] 8409 8.349% 94.751% ## ( 3, 4 ] 2689 2.670% 97.421% # ( 4, 6 ] 1901 1.887% 99.308% ( 6, 10 ] 517 0.513% 99.821% ( 10, 15 ] 82 0.081% 99.903% ( 15, 22 ] 14 0.014% 99.917% ( 22, 34 ] 4 0.004% 99.921% ( 34, 51 ] 1 0.001% 99.922% ( 51, 76 ] 32 0.032% 99.953% ( 76, 110 ] 5 0.005% 99.958% ( 110, 170 ] 6 0.006% 99.964% ( 170, 250 ] 14 0.014% 99.978% ( 250, 380 ] 8 0.008% 99.986% ( 380, 580 ] 3 0.003% 99.989% ( 580, 870 ] 4 0.004% 99.993% ( 1300, 1900 ] 2 0.002% 99.995% ( 1900, 2900 ] 3 0.003% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 271592 Average: 4.0721 StdDev: 52.99 Min: 1 Median: 1.6546 Max: 7780 Percentiles: P50: 1.65 P75: 2.17 P99: 9.24 P99.9: 321.31 P99.99: 861.18 ------------------------------------------------------ [ 0, 1 ] 22322 8.219% 8.219% ## ( 1, 2 ] 173342 63.824% 72.043% ############# ( 2, 3 ] 46164 16.998% 89.041% ### ( 3, 4 ] 13480 4.963% 94.004% # ( 4, 6 ] 9730 3.583% 97.587% # ( 6, 10 ] 4733 1.743% 99.330% ( 10, 15 ] 542 0.200% 99.529% ( 15, 22 ] 68 0.025% 99.554% ( 22, 34 ] 12 0.004% 99.559% ( 34, 51 ] 3 0.001% 99.560% ( 51, 76 ] 1 0.000% 99.560% ( 76, 110 ] 194 0.071% 99.631% ( 110, 170 ] 419 0.154% 99.786% ( 170, 250 ] 221 0.081% 99.867% ( 250, 380 ] 163 0.060% 99.927% ( 380, 580 ] 102 0.038% 99.965% ( 580, 870 ] 71 0.026% 99.991% ( 870, 1300 ] 29 0.011% 100.001% ( 1300, 1900 ] 8 0.003% 100.004% ( 1900, 2900 ] 9 0.003% 100.008% ( 2900, 4400 ] 14 0.005% 100.013% ( 4400, 6600 ] 6 0.002% 100.015% ( 6600, 9900 ] 4 0.001% 100.017% ** Level 4 read latency histogram (micros): Count: 310 Average: 326.8000 StdDev: 1279.93 Min: 0 Median: 1.6452 Max: 8845 Percentiles: P50: 1.65 P75: 6.24 P99: 7342.50 P99.9: 8845.00 P99.99: 8845.00 ------------------------------------------------------ [ 0, 1 ] 75 24.194% 24.194% ##### ( 1, 2 ] 124 40.000% 64.194% ######## ( 2, 3 ] 19 6.129% 70.323% # ( 3, 4 ] 4 1.290% 71.613% ( 4, 6 ] 8 2.581% 74.194% # ( 6, 10 ] 41 13.226% 87.419% ### ( 10, 15 ] 9 2.903% 90.323% # ( 110, 170 ] 3 0.968% 91.290% ( 170, 250 ] 2 0.645% 91.935% ( 380, 580 ] 1 0.323% 92.258% ( 870, 1300 ] 1 0.323% 92.581% ( 1300, 1900 ] 1 0.323% 92.903% ( 1900, 2900 ] 8 2.581% 95.484% # ( 2900, 4400 ] 5 1.613% 97.097% ( 4400, 6600 ] 5 1.613% 98.710% ( 6600, 9900 ] 4 1.290% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 871.9250 StdDev: 1040.26 Min: 87 Median: 315.0000 Max: 4322 Percentiles: P50: 315.00 P75: 1600.00 P99: 4100.00 P99.9: 4322.00 P99.99: 4322.00 ------------------------------------------------------ ( 76, 110 ] 5 12.500% 12.500% ### ( 110, 170 ] 11 27.500% 40.000% ###### ( 170, 250 ] 3 7.500% 47.500% ## ( 250, 380 ] 2 5.000% 52.500% # ( 380, 580 ] 3 7.500% 60.000% ## ( 580, 870 ] 4 10.000% 70.000% ## ( 1300, 1900 ] 4 10.000% 80.000% ## ( 1900, 2900 ] 6 15.000% 95.000% ### ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.3 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 318.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.226 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.400 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-18:20:02 ... thread 0: (1000000,4000000) ops and (335341.7,331329.3) ops/second in (2.982033,12.072582) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/14 2.40 GB 12.6 2.2 0.0 2.2 5.8 3.7 0.0 1.6 114.1 309.4 19.33 17.90 60 0.322 2238K 2362 0.0 0.0 L1 4/4 303.44 MB 0.0 1.1 1.1 0.0 1.1 1.1 0.2 1.0 237.7 237.1 4.78 4.66 2 2.390 1153K 2978 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.8 1.8 257.0 256.9 1.36 1.29 2 0.678 353K 183 0.0 0.0 L3 21/0 843.67 MB 0.8 2.0 0.8 1.2 2.0 0.8 0.2 2.5 227.0 226.6 9.18 8.47 6 1.531 2116K 3541 0.0 0.0 L4 172/0 9.56 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.9 1.0 132.7 132.8 1.27 0.89 1 1.267 170K 0 0.0 0.0 L5 1044/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/18 99.82 GB 0.0 5.8 2.3 3.5 9.5 6.0 3.1 2.6 165.4 270.4 35.92 33.20 71 0.506 6034K 9064 0.0 0.0 Int 0/0 0.00 KB 0.0 5.8 2.3 3.5 9.5 6.0 3.1 2.6 165.4 270.4 35.92 33.20 71 0.506 6034K 9064 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.8 2.3 3.5 5.8 2.3 0.0 0.0 236.8 236.5 25.09 23.63 19 1.321 6034K 9064 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 349.1 10.83 9.57 52 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.1 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.48 GB write, 792.89 MB/s write, 5.80 GB read, 485.09 MB/s read, 35.9 seconds Interval compaction: 9.48 GB write, 804.43 MB/s write, 5.80 GB read, 492.15 MB/s read, 35.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1005728 Average: 2.3412 StdDev: 10.84 Min: 0 Median: 1.5748 Max: 4072 Percentiles: P50: 1.57 P75: 1.95 P99: 5.75 P99.9: 10.16 P99.99: 14.58 ------------------------------------------------------ [ 0, 1 ] 121772 12.108% 12.108% ## ( 1, 2 ] 663049 65.927% 78.035% ############# ( 2, 3 ] 144470 14.365% 92.400% ### ( 3, 4 ] 40953 4.072% 96.472% # ( 4, 6 ] 29100 2.893% 99.365% # ( 6, 10 ] 5348 0.532% 99.897% ( 10, 15 ] 1023 0.102% 99.999% ( 15, 22 ] 95 0.009% 100.008% ( 22, 34 ] 9 0.001% 100.009% ( 34, 51 ] 6 0.001% 100.010% ( 51, 76 ] 1 0.000% 100.010% ( 76, 110 ] 36 0.004% 100.013% ( 110, 170 ] 70 0.007% 100.020% ( 170, 250 ] 49 0.005% 100.025% ( 250, 380 ] 26 0.003% 100.028% ( 380, 580 ] 22 0.002% 100.030% ( 580, 870 ] 18 0.002% 100.032% ( 870, 1300 ] 20 0.002% 100.034% ( 1300, 1900 ] 7 0.001% 100.034% ( 1900, 2900 ] 2 0.000% 100.035% ( 2900, 4400 ] 4 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 210388 Average: 2.9296 StdDev: 13.55 Min: 1 Median: 1.7699 Max: 2011 Percentiles: P50: 1.77 P75: 2.50 P99: 8.13 P99.9: 14.32 P99.99: 137.89 ------------------------------------------------------ [ 0, 1 ] 8926 4.243% 4.243% # ( 1, 2 ] 125041 59.434% 63.676% ############ ( 2, 3 ] 47841 22.739% 86.416% ##### ( 3, 4 ] 12722 6.047% 92.462% # ( 4, 6 ] 12179 5.789% 98.251% # ( 6, 10 ] 2964 1.409% 99.660% ( 10, 15 ] 584 0.278% 99.938% ( 15, 22 ] 65 0.031% 99.969% ( 22, 34 ] 4 0.002% 99.971% ( 34, 51 ] 2 0.001% 99.971% ( 51, 76 ] 2 0.001% 99.972% ( 76, 110 ] 10 0.005% 99.977% ( 110, 170 ] 58 0.028% 100.005% ( 170, 250 ] 39 0.019% 100.023% ( 250, 380 ] 33 0.016% 100.039% ( 380, 580 ] 37 0.018% 100.057% ( 580, 870 ] 10 0.005% 100.061% ( 870, 1300 ] 10 0.005% 100.066% ( 1300, 1900 ] 2 0.001% 100.067% ( 1900, 2900 ] 1 0.000% 100.067% ** Level 2 read latency histogram (micros): Count: 100720 Average: 2.3373 StdDev: 27.42 Min: 0 Median: 1.4219 Max: 5495 Percentiles: P50: 1.42 P75: 1.82 P99: 5.67 P99.9: 14.83 P99.99: 647.28 ------------------------------------------------------ [ 0, 1 ] 23607 23.438% 23.438% ##### ( 1, 2 ] 63417 62.964% 86.402% ############# ( 2, 3 ] 8409 8.349% 94.751% ## ( 3, 4 ] 2689 2.670% 97.421% # ( 4, 6 ] 1901 1.887% 99.308% ( 6, 10 ] 517 0.513% 99.821% ( 10, 15 ] 82 0.081% 99.903% ( 15, 22 ] 14 0.014% 99.917% ( 22, 34 ] 4 0.004% 99.921% ( 34, 51 ] 1 0.001% 99.922% ( 51, 76 ] 32 0.032% 99.953% ( 76, 110 ] 5 0.005% 99.958% ( 110, 170 ] 6 0.006% 99.964% ( 170, 250 ] 14 0.014% 99.978% ( 250, 380 ] 8 0.008% 99.986% ( 380, 580 ] 3 0.003% 99.989% ( 580, 870 ] 4 0.004% 99.993% ( 1300, 1900 ] 2 0.002% 99.995% ( 1900, 2900 ] 3 0.003% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 302067 Average: 3.9215 StdDev: 50.35 Min: 1 Median: 1.6531 Max: 7780 Percentiles: P50: 1.65 P75: 2.17 P99: 9.08 P99.9: 304.77 P99.99: 849.32 ------------------------------------------------------ [ 0, 1 ] 24957 8.262% 8.262% ## ( 1, 2 ] 193041 63.907% 72.169% ############# ( 2, 3 ] 51802 17.149% 89.318% ### ( 3, 4 ] 14665 4.855% 94.173% # ( 4, 6 ] 10771 3.566% 97.739% # ( 6, 10 ] 4945 1.637% 99.376% ( 10, 15 ] 577 0.191% 99.567% ( 15, 22 ] 72 0.024% 99.590% ( 22, 34 ] 15 0.005% 99.595% ( 34, 51 ] 3 0.001% 99.596% ( 51, 76 ] 1 0.000% 99.597% ( 76, 110 ] 194 0.064% 99.661% ( 110, 170 ] 426 0.141% 99.802% ( 170, 250 ] 226 0.075% 99.877% ( 250, 380 ] 166 0.055% 99.932% ( 380, 580 ] 108 0.036% 99.968% ( 580, 870 ] 73 0.024% 99.992% ( 870, 1300 ] 29 0.010% 100.001% ( 1300, 1900 ] 8 0.003% 100.004% ( 1900, 2900 ] 9 0.003% 100.007% ( 2900, 4400 ] 14 0.005% 100.012% ( 4400, 6600 ] 6 0.002% 100.014% ( 6600, 9900 ] 4 0.001% 100.015% ** Level 4 read latency histogram (micros): Count: 310 Average: 326.8000 StdDev: 1279.93 Min: 0 Median: 1.6452 Max: 8845 Percentiles: P50: 1.65 P75: 6.24 P99: 7342.50 P99.9: 8845.00 P99.99: 8845.00 ------------------------------------------------------ [ 0, 1 ] 75 24.194% 24.194% ##### ( 1, 2 ] 124 40.000% 64.194% ######## ( 2, 3 ] 19 6.129% 70.323% # ( 3, 4 ] 4 1.290% 71.613% ( 4, 6 ] 8 2.581% 74.194% # ( 6, 10 ] 41 13.226% 87.419% ### ( 10, 15 ] 9 2.903% 90.323% # ( 110, 170 ] 3 0.968% 91.290% ( 170, 250 ] 2 0.645% 91.935% ( 380, 580 ] 1 0.323% 92.258% ( 870, 1300 ] 1 0.323% 92.581% ( 1300, 1900 ] 1 0.323% 92.903% ( 1900, 2900 ] 8 2.581% 95.484% # ( 2900, 4400 ] 5 1.613% 97.097% ( 4400, 6600 ] 5 1.613% 98.710% ( 6600, 9900 ] 4 1.290% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 841.4333 StdDev: 972.39 Min: 84 Median: 380.0000 Max: 4322 Percentiles: P50: 380.00 P75: 1420.00 P99: 3950.00 P99.9: 4322.00 P99.99: 4322.00 ------------------------------------------------------ ( 76, 110 ] 10 16.667% 16.667% ### ( 110, 170 ] 13 21.667% 38.333% #### ( 170, 250 ] 5 8.333% 46.667% ## ( 250, 380 ] 2 3.333% 50.000% # ( 380, 580 ] 5 8.333% 58.333% ## ( 580, 870 ] 6 10.000% 68.333% ## ( 870, 1300 ] 3 5.000% 73.333% # ( 1300, 1900 ] 5 8.333% 81.667% ## ( 1900, 2900 ] 9 15.000% 96.667% ### ( 2900, 4400 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 12.2 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 321.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.642 H:M:S, 13.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.04 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.416 H:M:S, 13.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-18:20:05 ... thread 0: (1000000,5000000) ops and (258056.6,313524.8) ops/second in (3.875119,15.947701) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 3.38 GB 144.8 3.2 0.0 3.2 7.9 4.7 0.0 1.7 125.1 307.7 26.19 24.38 78 0.336 3326K 3489 0.0 0.0 L1 4/4 303.44 MB 0.0 1.1 1.1 0.0 1.1 1.1 0.2 1.0 237.7 237.1 4.78 4.66 2 2.390 1153K 2978 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.8 1.8 257.0 256.9 1.36 1.29 2 0.678 353K 183 0.0 0.0 L3 21/0 843.67 MB 0.8 2.0 0.8 1.2 2.0 0.8 0.2 2.5 227.0 226.6 9.18 8.47 6 1.531 2116K 3541 0.0 0.0 L4 172/0 9.56 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.9 1.0 132.7 132.8 1.27 0.89 1 1.267 170K 0 0.0 0.0 L5 1044/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1259/14 100.80 GB 0.0 6.8 2.3 4.6 11.5 6.9 3.1 2.5 163.9 275.6 42.78 39.69 89 0.481 7121K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.8 2.3 4.6 11.5 6.9 3.1 2.5 163.9 275.6 42.78 39.69 89 0.481 7121K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.8 2.3 4.6 6.8 2.3 0.0 0.0 240.9 240.5 29.12 27.59 23 1.266 7121K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 350.4 13.66 12.10 66 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.1 total, 15.9 interval Flush(GB): cumulative 4.675, interval 4.675 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.51 GB write, 731.19 MB/s write, 6.85 GB read, 434.93 MB/s read, 42.8 seconds Interval compaction: 11.51 GB write, 739.25 MB/s write, 6.85 GB read, 439.72 MB/s read, 42.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 18, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1471101 Average: 2.3251 StdDev: 11.12 Min: 0 Median: 1.5635 Max: 4072 Percentiles: P50: 1.56 P75: 1.94 P99: 5.75 P99.9: 9.99 P99.99: 14.61 ------------------------------------------------------ [ 0, 1 ] 184385 12.534% 12.534% ### ( 1, 2 ] 978055 66.485% 79.018% ############# ( 2, 3 ] 204723 13.916% 92.935% ### ( 3, 4 ] 54859 3.729% 96.664% # ( 4, 6 ] 39282 2.670% 99.334% # ( 6, 10 ] 8342 0.567% 99.901% ( 10, 15 ] 1420 0.097% 99.998% ( 15, 22 ] 126 0.009% 100.006% ( 22, 34 ] 16 0.001% 100.007% ( 34, 51 ] 8 0.001% 100.008% ( 51, 76 ] 3 0.000% 100.008% ( 76, 110 ] 57 0.004% 100.012% ( 110, 170 ] 117 0.008% 100.020% ( 170, 250 ] 87 0.006% 100.026% ( 250, 380 ] 36 0.002% 100.028% ( 380, 580 ] 41 0.003% 100.031% ( 580, 870 ] 27 0.002% 100.033% ( 870, 1300 ] 21 0.001% 100.034% ( 1300, 1900 ] 10 0.001% 100.035% ( 1900, 2900 ] 6 0.000% 100.035% ( 2900, 4400 ] 6 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 210388 Average: 2.9296 StdDev: 13.55 Min: 1 Median: 1.7699 Max: 2011 Percentiles: P50: 1.77 P75: 2.50 P99: 8.13 P99.9: 14.32 P99.99: 137.89 ------------------------------------------------------ [ 0, 1 ] 8926 4.243% 4.243% # ( 1, 2 ] 125041 59.434% 63.676% ############ ( 2, 3 ] 47841 22.739% 86.416% ##### ( 3, 4 ] 12722 6.047% 92.462% # ( 4, 6 ] 12179 5.789% 98.251% # ( 6, 10 ] 2964 1.409% 99.660% ( 10, 15 ] 584 0.278% 99.938% ( 15, 22 ] 65 0.031% 99.969% ( 22, 34 ] 4 0.002% 99.971% ( 34, 51 ] 2 0.001% 99.971% ( 51, 76 ] 2 0.001% 99.972% ( 76, 110 ] 10 0.005% 99.977% ( 110, 170 ] 58 0.028% 100.005% ( 170, 250 ] 39 0.019% 100.023% ( 250, 380 ] 33 0.016% 100.039% ( 380, 580 ] 37 0.018% 100.057% ( 580, 870 ] 10 0.005% 100.061% ( 870, 1300 ] 10 0.005% 100.066% ( 1300, 1900 ] 2 0.001% 100.067% ( 1900, 2900 ] 1 0.000% 100.067% ** Level 2 read latency histogram (micros): Count: 100720 Average: 2.3373 StdDev: 27.42 Min: 0 Median: 1.4219 Max: 5495 Percentiles: P50: 1.42 P75: 1.82 P99: 5.67 P99.9: 14.83 P99.99: 647.28 ------------------------------------------------------ [ 0, 1 ] 23607 23.438% 23.438% ##### ( 1, 2 ] 63417 62.964% 86.402% ############# ( 2, 3 ] 8409 8.349% 94.751% ## ( 3, 4 ] 2689 2.670% 97.421% # ( 4, 6 ] 1901 1.887% 99.308% ( 6, 10 ] 517 0.513% 99.821% ( 10, 15 ] 82 0.081% 99.903% ( 15, 22 ] 14 0.014% 99.917% ( 22, 34 ] 4 0.004% 99.921% ( 34, 51 ] 1 0.001% 99.922% ( 51, 76 ] 32 0.032% 99.953% ( 76, 110 ] 5 0.005% 99.958% ( 110, 170 ] 6 0.006% 99.964% ( 170, 250 ] 14 0.014% 99.978% ( 250, 380 ] 8 0.008% 99.986% ( 380, 580 ] 3 0.003% 99.989% ( 580, 870 ] 4 0.004% 99.993% ( 1300, 1900 ] 2 0.002% 99.995% ( 1900, 2900 ] 3 0.003% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 302067 Average: 3.9215 StdDev: 50.35 Min: 1 Median: 1.6531 Max: 7780 Percentiles: P50: 1.65 P75: 2.17 P99: 9.08 P99.9: 304.77 P99.99: 849.32 ------------------------------------------------------ [ 0, 1 ] 24957 8.262% 8.262% ## ( 1, 2 ] 193041 63.907% 72.169% ############# ( 2, 3 ] 51802 17.149% 89.318% ### ( 3, 4 ] 14665 4.855% 94.173% # ( 4, 6 ] 10771 3.566% 97.739% # ( 6, 10 ] 4945 1.637% 99.376% ( 10, 15 ] 577 0.191% 99.567% ( 15, 22 ] 72 0.024% 99.590% ( 22, 34 ] 15 0.005% 99.595% ( 34, 51 ] 3 0.001% 99.596% ( 51, 76 ] 1 0.000% 99.597% ( 76, 110 ] 194 0.064% 99.661% ( 110, 170 ] 426 0.141% 99.802% ( 170, 250 ] 226 0.075% 99.877% ( 250, 380 ] 166 0.055% 99.932% ( 380, 580 ] 108 0.036% 99.968% ( 580, 870 ] 73 0.024% 99.992% ( 870, 1300 ] 29 0.010% 100.001% ( 1300, 1900 ] 8 0.003% 100.004% ( 1900, 2900 ] 9 0.003% 100.007% ( 2900, 4400 ] 14 0.005% 100.012% ( 4400, 6600 ] 6 0.002% 100.014% ( 6600, 9900 ] 4 0.001% 100.015% ** Level 4 read latency histogram (micros): Count: 310 Average: 326.8000 StdDev: 1279.93 Min: 0 Median: 1.6452 Max: 8845 Percentiles: P50: 1.65 P75: 6.24 P99: 7342.50 P99.9: 8845.00 P99.99: 8845.00 ------------------------------------------------------ [ 0, 1 ] 75 24.194% 24.194% ##### ( 1, 2 ] 124 40.000% 64.194% ######## ( 2, 3 ] 19 6.129% 70.323% # ( 3, 4 ] 4 1.290% 71.613% ( 4, 6 ] 8 2.581% 74.194% # ( 6, 10 ] 41 13.226% 87.419% ### ( 10, 15 ] 9 2.903% 90.323% # ( 110, 170 ] 3 0.968% 91.290% ( 170, 250 ] 2 0.645% 91.935% ( 380, 580 ] 1 0.323% 92.258% ( 870, 1300 ] 1 0.323% 92.581% ( 1300, 1900 ] 1 0.323% 92.903% ( 1900, 2900 ] 8 2.581% 95.484% # ( 2900, 4400 ] 5 1.613% 97.097% ( 4400, 6600 ] 5 1.613% 98.710% ( 6600, 9900 ] 4 1.290% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 841.4333 StdDev: 972.39 Min: 84 Median: 380.0000 Max: 4322 Percentiles: P50: 380.00 P75: 1420.00 P99: 3950.00 P99.9: 4322.00 P99.99: 4322.00 ------------------------------------------------------ ( 76, 110 ] 10 16.667% 16.667% ### ( 110, 170 ] 13 21.667% 38.333% #### ( 170, 250 ] 5 8.333% 46.667% ## ( 250, 380 ] 2 3.333% 50.000% # ( 380, 580 ] 5 8.333% 58.333% ## ( 580, 870 ] 6 10.000% 68.333% ## ( 870, 1300 ] 3 5.000% 73.333% # ( 1300, 1900 ] 5 8.333% 81.667% ## ( 1900, 2900 ] 9 15.000% 96.667% ### ( 2900, 4400 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 16.1 total, 3.9 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 305.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.945 H:M:S, 18.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 253.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.303 H:M:S, 33.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/18-18:20:12 ... thread 0: (1000000,6000000) ops and (153334.0,267029.7) ops/second in (6.521710,22.469411) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 2.40 GB 18.9 4.4 0.0 4.4 10.0 5.7 0.0 1.8 133.4 306.1 33.52 31.33 96 0.349 4541K 5757 0.0 0.0 L1 15/15 1.74 GB 0.0 3.4 3.1 0.3 3.3 3.0 0.2 1.1 232.9 231.0 14.83 14.32 3 4.943 3506K 27K 0.0 0.0 L2 2/1 257.55 MB 1.3 0.3 0.2 0.2 0.3 0.2 1.3 1.8 257.0 256.9 1.36 1.29 2 0.678 353K 183 0.0 0.0 L3 26/2 1.02 GB 1.0 2.5 1.1 1.4 2.5 1.1 0.2 2.3 224.4 223.8 11.45 10.59 8 1.431 2609K 6581 0.0 0.0 L4 173/0 9.61 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.9 1.0 140.6 140.5 1.57 1.16 2 0.786 224K 87 0.0 0.0 L5 1044/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1274/30 101.76 GB 0.0 10.8 4.6 6.3 16.4 10.2 3.6 2.9 176.4 268.1 62.73 58.69 111 0.565 11M 40K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.8 4.6 6.3 16.4 10.2 3.6 2.9 176.4 268.1 62.73 58.69 111 0.565 11M 40K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.8 4.6 6.3 10.8 4.5 0.0 0.0 239.7 238.9 46.15 44.00 30 1.538 11M 40K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 349.5 16.58 14.69 81 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.6 total, 22.5 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.43 GB write, 742.70 MB/s write, 10.81 GB read, 488.59 MB/s read, 62.7 seconds Interval compaction: 16.43 GB write, 748.51 MB/s write, 10.81 GB read, 492.41 MB/s read, 62.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 20, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2112397 Average: 2.3886 StdDev: 11.70 Min: 0 Median: 1.5627 Max: 4072 Percentiles: P50: 1.56 P75: 1.94 P99: 5.83 P99.9: 11.53 P99.99: 122.29 ------------------------------------------------------ [ 0, 1 ] 263857 12.491% 12.491% ## ( 1, 2 ] 1408207 66.664% 79.155% ############# ( 2, 3 ] 290979 13.775% 92.930% ### ( 3, 4 ] 77260 3.657% 96.587% # ( 4, 6 ] 55691 2.636% 99.223% # ( 6, 10 ] 13680 0.648% 99.871% ( 10, 15 ] 2006 0.095% 99.966% ( 15, 22 ] 191 0.009% 99.975% ( 22, 34 ] 21 0.001% 99.976% ( 34, 51 ] 11 0.001% 99.977% ( 51, 76 ] 9 0.000% 99.977% ( 76, 110 ] 202 0.010% 99.987% ( 110, 170 ] 365 0.017% 100.004% ( 170, 250 ] 226 0.011% 100.015% ( 250, 380 ] 110 0.005% 100.020% ( 380, 580 ] 133 0.006% 100.026% ( 580, 870 ] 65 0.003% 100.029% ( 870, 1300 ] 36 0.002% 100.031% ( 1300, 1900 ] 16 0.001% 100.032% ( 1900, 2900 ] 10 0.000% 100.032% ( 2900, 4400 ] 6 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 368741 Average: 2.9480 StdDev: 17.18 Min: 1 Median: 1.7141 Max: 3021 Percentiles: P50: 1.71 P75: 2.36 P99: 8.02 P99.9: 83.99 P99.99: 234.94 ------------------------------------------------------ [ 0, 1 ] 21495 5.829% 5.829% # ( 1, 2 ] 228085 61.855% 67.684% ############ ( 2, 3 ] 75935 20.593% 88.277% #### ( 3, 4 ] 19134 5.189% 93.466% # ( 4, 6 ] 17917 4.859% 98.325% # ( 6, 10 ] 4932 1.338% 99.663% ( 10, 15 ] 754 0.204% 99.867% ( 15, 22 ] 81 0.022% 99.889% ( 22, 34 ] 4 0.001% 99.890% ( 34, 51 ] 3 0.001% 99.891% ( 51, 76 ] 2 0.001% 99.892% ( 76, 110 ] 133 0.036% 99.928% ( 110, 170 ] 166 0.045% 99.973% ( 170, 250 ] 79 0.021% 99.994% ( 250, 380 ] 56 0.015% 100.009% ( 380, 580 ] 71 0.019% 100.029% ( 580, 870 ] 20 0.005% 100.034% ( 870, 1300 ] 23 0.006% 100.040% ( 1300, 1900 ] 6 0.002% 100.042% ( 1900, 2900 ] 2 0.001% 100.043% ( 2900, 4400 ] 2 0.001% 100.043% ** Level 2 read latency histogram (micros): Count: 100720 Average: 2.3373 StdDev: 27.42 Min: 0 Median: 1.4219 Max: 5495 Percentiles: P50: 1.42 P75: 1.82 P99: 5.67 P99.9: 14.83 P99.99: 647.28 ------------------------------------------------------ [ 0, 1 ] 23607 23.438% 23.438% ##### ( 1, 2 ] 63417 62.964% 86.402% ############# ( 2, 3 ] 8409 8.349% 94.751% ## ( 3, 4 ] 2689 2.670% 97.421% # ( 4, 6 ] 1901 1.887% 99.308% ( 6, 10 ] 517 0.513% 99.821% ( 10, 15 ] 82 0.081% 99.903% ( 15, 22 ] 14 0.014% 99.917% ( 22, 34 ] 4 0.004% 99.921% ( 34, 51 ] 1 0.001% 99.922% ( 51, 76 ] 32 0.032% 99.953% ( 76, 110 ] 5 0.005% 99.958% ( 110, 170 ] 6 0.006% 99.964% ( 170, 250 ] 14 0.014% 99.978% ( 250, 380 ] 8 0.008% 99.986% ( 380, 580 ] 3 0.003% 99.989% ( 580, 870 ] 4 0.004% 99.993% ( 1300, 1900 ] 2 0.002% 99.995% ( 1900, 2900 ] 3 0.003% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 383064 Average: 3.8716 StdDev: 45.54 Min: 1 Median: 1.6878 Max: 7780 Percentiles: P50: 1.69 P75: 2.30 P99: 9.18 P99.9: 285.06 P99.99: 765.65 ------------------------------------------------------ [ 0, 1 ] 27501 7.179% 7.179% # ( 1, 2 ] 238489 62.258% 69.437% ############ ( 2, 3 ] 71866 18.761% 88.198% #### ( 3, 4 ] 20247 5.286% 93.484% # ( 4, 6 ] 15915 4.155% 97.639% # ( 6, 10 ] 6554 1.711% 99.349% ( 10, 15 ] 834 0.218% 99.567% ( 15, 22 ] 103 0.027% 99.594% ( 22, 34 ] 16 0.004% 99.598% ( 34, 51 ] 5 0.001% 99.600% ( 51, 76 ] 1 0.000% 99.600% ( 76, 110 ] 237 0.062% 99.662% ( 110, 170 ] 565 0.147% 99.809% ( 170, 250 ] 294 0.077% 99.886% ( 250, 380 ] 200 0.052% 99.938% ( 380, 580 ] 143 0.037% 99.975% ( 580, 870 ] 87 0.023% 99.998% ( 870, 1300 ] 35 0.009% 100.007% ( 1300, 1900 ] 8 0.002% 100.009% ( 1900, 2900 ] 9 0.002% 100.012% ( 2900, 4400 ] 14 0.004% 100.015% ( 4400, 6600 ] 6 0.002% 100.017% ( 6600, 9900 ] 4 0.001% 100.018% ** Level 4 read latency histogram (micros): Count: 1069 Average: 114.2123 StdDev: 707.39 Min: 0 Median: 1.8483 Max: 8845 Percentiles: P50: 1.85 P75: 2.97 P99: 3893.00 P99.9: 8845.00 P99.99: 8845.00 ------------------------------------------------------ [ 0, 1 ] 101 9.448% 9.448% ## ( 1, 2 ] 511 47.802% 57.250% ########## ( 2, 3 ] 195 18.241% 75.491% #### ( 3, 4 ] 61 5.706% 81.197% # ( 4, 6 ] 41 3.835% 85.033% # ( 6, 10 ] 55 5.145% 90.178% # ( 10, 15 ] 9 0.842% 91.020% ( 76, 110 ] 4 0.374% 91.394% ( 110, 170 ] 23 2.152% 93.545% ( 170, 250 ] 18 1.684% 95.229% ( 250, 380 ] 9 0.842% 96.071% ( 380, 580 ] 12 1.123% 97.194% ( 580, 870 ] 5 0.468% 97.661% ( 870, 1300 ] 2 0.187% 97.848% ( 1300, 1900 ] 1 0.094% 97.942% ( 1900, 2900 ] 8 0.748% 98.690% ( 2900, 4400 ] 5 0.468% 99.158% ( 4400, 6600 ] 5 0.468% 99.626% ( 6600, 9900 ] 4 0.374% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 841.4333 StdDev: 972.39 Min: 84 Median: 380.0000 Max: 4322 Percentiles: P50: 380.00 P75: 1420.00 P99: 3950.00 P99.9: 4322.00 P99.99: 4322.00 ------------------------------------------------------ ( 76, 110 ] 10 16.667% 16.667% ### ( 110, 170 ] 13 21.667% 38.333% #### ( 170, 250 ] 5 8.333% 46.667% ## ( 250, 380 ] 2 3.333% 50.000% # ( 380, 580 ] 5 8.333% 58.333% ## ( 580, 870 ] 6 10.000% 68.333% ## ( 870, 1300 ] 3 5.000% 73.333% # ( 1300, 1900 ] 5 8.333% 81.667% ## ( 1900, 2900 ] 9 15.000% 96.667% ### ( 2900, 4400 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 22.6 total, 6.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 260.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.793 H:M:S, 30.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 150.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.848 H:M:S, 59.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/18-18:20:15 ... thread 0: (1000000,7000000) ops and (311674.1,272608.1) ops/second in (3.208480,25.677891) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 3.32 GB 113.3 5.2 0.0 5.2 11.8 6.6 0.0 1.8 134.1 302.7 39.93 37.12 112 0.357 5436K 6725 0.0 0.0 L1 15/15 1.74 GB 0.0 3.4 3.1 0.3 3.3 3.0 0.2 1.1 232.9 231.0 14.83 14.32 3 4.943 3506K 27K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 1.3 1.8 257.0 256.9 1.36 1.29 2 0.678 353K 183 0.0 0.0 L3 25/0 968.41 MB 1.0 3.0 1.3 1.7 3.0 1.3 0.2 2.3 223.2 222.5 13.80 12.77 10 1.380 3127K 9456 0.0 0.0 L4 175/0 9.57 GB 1.0 0.6 0.5 0.0 0.6 0.5 0.9 1.0 145.3 145.1 3.96 2.80 9 0.440 584K 684 0.0 0.0 L5 1048/0 87.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1281/27 102.67 GB 0.0 12.5 5.1 7.4 19.0 11.7 4.0 2.9 173.4 264.0 73.88 68.30 136 0.543 13M 44K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.5 5.1 7.4 19.0 11.7 4.0 2.9 173.4 264.0 73.88 68.30 136 0.543 13M 44K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.5 5.1 7.4 12.5 5.1 0.0 0.0 235.5 234.7 54.40 51.23 42 1.295 13M 44K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 346.1 19.48 17.07 94 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.9 total, 25.7 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.05 GB write, 754.47 MB/s write, 12.51 GB read, 495.52 MB/s read, 73.9 seconds Interval compaction: 19.05 GB write, 759.64 MB/s write, 12.51 GB read, 498.91 MB/s read, 73.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 32, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2458095 Average: 2.4352 StdDev: 12.93 Min: 0 Median: 1.5786 Max: 4072 Percentiles: P50: 1.58 P75: 1.96 P99: 5.88 P99.9: 12.06 P99.99: 125.27 ------------------------------------------------------ [ 0, 1 ] 286484 11.655% 11.655% ## ( 1, 2 ] 1628953 66.269% 77.924% ############# ( 2, 3 ] 356014 14.483% 92.407% ### ( 3, 4 ] 95989 3.905% 96.312% # ( 4, 6 ] 70175 2.855% 99.167% # ( 6, 10 ] 16936 0.689% 99.856% ( 10, 15 ] 2638 0.107% 99.963% ( 15, 22 ] 238 0.010% 99.973% ( 22, 34 ] 29 0.001% 99.974% ( 34, 51 ] 13 0.001% 99.975% ( 51, 76 ] 11 0.000% 99.975% ( 76, 110 ] 248 0.010% 99.985% ( 110, 170 ] 480 0.020% 100.005% ( 170, 250 ] 286 0.012% 100.016% ( 250, 380 ] 133 0.005% 100.022% ( 380, 580 ] 163 0.007% 100.028% ( 580, 870 ] 78 0.003% 100.031% ( 870, 1300 ] 44 0.002% 100.033% ( 1300, 1900 ] 17 0.001% 100.034% ( 1900, 2900 ] 11 0.000% 100.034% ( 2900, 4400 ] 12 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 478067 Average: 3.0512 StdDev: 23.21 Min: 1 Median: 1.7217 Max: 7648 Percentiles: P50: 1.72 P75: 2.38 P99: 8.24 P99.9: 102.66 P99.99: 343.29 ------------------------------------------------------ [ 0, 1 ] 25998 5.438% 5.438% # ( 1, 2 ] 295193 61.747% 67.185% ############ ( 2, 3 ] 99616 20.837% 88.023% #### ( 3, 4 ] 25347 5.302% 93.325% # ( 4, 6 ] 23156 4.844% 98.168% # ( 6, 10 ] 7085 1.482% 99.650% ( 10, 15 ] 969 0.203% 99.853% ( 15, 22 ] 100 0.021% 99.874% ( 22, 34 ] 5 0.001% 99.875% ( 34, 51 ] 5 0.001% 99.876% ( 51, 76 ] 2 0.000% 99.876% ( 76, 110 ] 144 0.030% 99.906% ( 110, 170 ] 211 0.044% 99.951% ( 170, 250 ] 115 0.024% 99.975% ( 250, 380 ] 102 0.021% 99.996% ( 380, 580 ] 99 0.021% 100.017% ( 580, 870 ] 39 0.008% 100.025% ( 870, 1300 ] 28 0.006% 100.031% ( 1300, 1900 ] 10 0.002% 100.033% ( 1900, 2900 ] 2 0.000% 100.033% ( 2900, 4400 ] 6 0.001% 100.035% ( 6600, 9900 ] 1 0.000% 100.035% ** Level 2 read latency histogram (micros): Count: 100720 Average: 2.3373 StdDev: 27.42 Min: 0 Median: 1.4219 Max: 5495 Percentiles: P50: 1.42 P75: 1.82 P99: 5.67 P99.9: 14.83 P99.99: 647.28 ------------------------------------------------------ [ 0, 1 ] 23607 23.438% 23.438% ##### ( 1, 2 ] 63417 62.964% 86.402% ############# ( 2, 3 ] 8409 8.349% 94.751% ## ( 3, 4 ] 2689 2.670% 97.421% # ( 4, 6 ] 1901 1.887% 99.308% ( 6, 10 ] 517 0.513% 99.821% ( 10, 15 ] 82 0.081% 99.903% ( 15, 22 ] 14 0.014% 99.917% ( 22, 34 ] 4 0.004% 99.921% ( 34, 51 ] 1 0.001% 99.922% ( 51, 76 ] 32 0.032% 99.953% ( 76, 110 ] 5 0.005% 99.958% ( 110, 170 ] 6 0.006% 99.964% ( 170, 250 ] 14 0.014% 99.978% ( 250, 380 ] 8 0.008% 99.986% ( 380, 580 ] 3 0.003% 99.989% ( 580, 870 ] 4 0.004% 99.993% ( 1300, 1900 ] 2 0.002% 99.995% ( 1900, 2900 ] 3 0.003% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 521090 Average: 3.7221 StdDev: 42.57 Min: 1 Median: 1.7492 Max: 7780 Percentiles: P50: 1.75 P75: 2.48 P99: 8.89 P99.9: 179.01 P99.99: 370.03 ------------------------------------------------------ [ 0, 1 ] 29768 5.713% 5.713% # ( 1, 2 ] 308036 59.114% 64.826% ############ ( 2, 3 ] 109849 21.081% 85.907% #### ( 3, 4 ] 33328 6.396% 92.303% # ( 4, 6 ] 28653 5.499% 97.802% # ( 6, 10 ] 8658 1.662% 99.463% ( 10, 15 ] 1241 0.238% 99.701% ( 15, 22 ] 137 0.026% 99.727% ( 22, 34 ] 17 0.003% 99.731% ( 34, 51 ] 8 0.002% 99.732% ( 51, 76 ] 2 0.000% 99.733% ( 76, 110 ] 248 0.048% 99.780% ( 110, 170 ] 589 0.113% 99.893% ( 170, 250 ] 310 0.059% 99.953% ( 250, 380 ] 210 0.040% 99.993% ( 380, 580 ] 157 0.030% 100.023% ( 580, 870 ] 96 0.018% 100.042% ( 870, 1300 ] 37 0.007% 100.049% ( 1300, 1900 ] 9 0.002% 100.050% ( 1900, 2900 ] 12 0.002% 100.053% ( 2900, 4400 ] 19 0.004% 100.056% ( 4400, 6600 ] 7 0.001% 100.058% ( 6600, 9900 ] 4 0.001% 100.059% ** Level 4 read latency histogram (micros): Count: 6211 Average: 56.6941 StdDev: 335.42 Min: 0 Median: 2.0931 Max: 8845 Percentiles: P50: 2.09 P75: 3.38 P99: 1083.69 P99.9: 5627.16 P99.99: 8845.00 ------------------------------------------------------ [ 0, 1 ] 202 3.252% 3.252% # ( 1, 2 ] 2769 44.582% 47.834% ######### ( 2, 3 ] 1444 23.249% 71.084% ##### ( 3, 4 ] 639 10.288% 81.372% ## ( 4, 6 ] 389 6.263% 87.635% # ( 6, 10 ] 173 2.785% 90.420% # ( 10, 15 ] 35 0.564% 90.984% ( 15, 22 ] 1 0.016% 91.000% ( 34, 51 ] 1 0.016% 91.016% ( 76, 110 ] 9 0.145% 91.161% ( 110, 170 ] 105 1.691% 92.851% ( 170, 250 ] 89 1.433% 94.284% ( 250, 380 ] 93 1.497% 95.782% ( 380, 580 ] 108 1.739% 97.521% ( 580, 870 ] 74 1.191% 98.712% ( 870, 1300 ] 36 0.580% 99.292% ( 1300, 1900 ] 17 0.274% 99.565% ( 1900, 2900 ] 12 0.193% 99.758% ( 2900, 4400 ] 6 0.097% 99.855% ( 4400, 6600 ] 5 0.081% 99.936% ( 6600, 9900 ] 4 0.064% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 854.4125 StdDev: 999.53 Min: 84 Median: 315.0000 Max: 4322 Percentiles: P50: 315.00 P75: 1300.00 P99: 4160.00 P99.9: 4322.00 P99.99: 4322.00 ------------------------------------------------------ ( 76, 110 ] 12 15.000% 15.000% ### ( 110, 170 ] 19 23.750% 38.750% ##### ( 170, 250 ] 8 10.000% 48.750% ## ( 250, 380 ] 2 2.500% 51.250% # ( 380, 580 ] 5 6.250% 57.500% # ( 580, 870 ] 7 8.750% 66.250% ## ( 870, 1300 ] 7 8.750% 75.000% ## ( 1300, 1900 ] 6 7.500% 82.500% ## ( 1900, 2900 ] 9 11.250% 93.750% ## ( 2900, 4400 ] 5 6.250% 100.000% # ** DB Stats ** Uptime(secs): 25.9 total, 3.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 266.46 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.263 H:M:S, 28.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 306.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.471 H:M:S, 14.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-18:20:32 ... thread 0: (1000000,8000000) ops and (60660.6,189739.5) ops/second in (16.485171,42.163062) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 2.40 GB 88.1 7.1 0.0 7.1 14.8 7.6 0.0 1.9 145.5 300.8 50.23 46.93 134 0.375 7419K 9636 0.0 0.0 L1 6/0 646.95 MB 64.7 7.1 5.0 2.0 7.0 5.0 0.2 1.4 228.9 226.4 31.64 30.22 4 7.910 7355K 80K 0.0 0.0 L2 12/11 1.51 GB 1.3 0.3 0.2 0.2 0.3 0.2 4.3 1.8 257.0 256.9 1.36 1.29 2 0.678 353K 183 0.0 0.0 L3 38/17 1.90 GB 1.0 5.4 2.8 2.5 5.4 2.8 0.2 1.9 168.3 167.5 32.79 24.00 21 1.561 5604K 26K 0.0 0.0 L4 178/1 9.74 GB 1.0 1.1 1.1 0.0 1.1 1.1 0.9 1.0 139.0 138.8 8.25 5.39 16 0.516 1146K 830 0.0 0.0 L5 1052/0 87.48 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1294/34 103.65 GB 0.0 21.1 9.1 11.9 28.6 16.7 7.4 3.7 173.5 235.4 124.26 107.83 177 0.702 21M 117K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.1 9.1 11.9 28.6 16.7 7.4 3.7 173.5 235.4 124.26 107.83 177 0.702 21M 117K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.1 9.1 11.9 20.9 9.0 0.0 0.0 211.9 210.7 101.76 88.07 67 1.519 21M 117K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 347.1 22.50 19.76 110 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 42.3 total, 42.2 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.57 GB write, 690.97 MB/s write, 21.06 GB read, 509.29 MB/s read, 124.3 seconds Interval compaction: 28.57 GB write, 693.85 MB/s write, 21.06 GB read, 511.41 MB/s read, 124.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 33, pending-compaction-bytes-delays: 24, pending-compaction-bytes-stops: 0, total-delays: 40, total-stops: 33, interval: 73 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3573860 Average: 2.5464 StdDev: 17.15 Min: 0 Median: 1.5780 Max: 4474 Percentiles: P50: 1.58 P75: 1.96 P99: 6.24 P99.9: 14.52 P99.99: 168.77 ------------------------------------------------------ [ 0, 1 ] 435126 12.175% 12.175% ## ( 1, 2 ] 2338709 65.439% 77.615% ############# ( 2, 3 ] 502248 14.053% 91.668% ### ( 3, 4 ] 145930 4.083% 95.751% # ( 4, 6 ] 114329 3.199% 98.950% # ( 6, 10 ] 29976 0.839% 99.789% ( 10, 15 ] 4392 0.123% 99.912% ( 15, 22 ] 506 0.014% 99.926% ( 22, 34 ] 41 0.001% 99.927% ( 34, 51 ] 18 0.001% 99.928% ( 51, 76 ] 36 0.001% 99.929% ( 76, 110 ] 832 0.023% 99.952% ( 110, 170 ] 1389 0.039% 99.991% ( 170, 250 ] 490 0.014% 100.005% ( 250, 380 ] 253 0.007% 100.012% ( 380, 580 ] 257 0.007% 100.019% ( 580, 870 ] 134 0.004% 100.023% ( 870, 1300 ] 81 0.002% 100.025% ( 1300, 1900 ] 31 0.001% 100.026% ( 1900, 2900 ] 28 0.001% 100.026% ( 2900, 4400 ] 37 0.001% 100.028% ( 4400, 6600 ] 2 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 1533711 Average: 4.5312 StdDev: 61.19 Min: 1 Median: 1.8063 Max: 7883 Percentiles: P50: 1.81 P75: 2.68 P99: 9.02 P99.9: 118.18 P99.99: 429.14 ------------------------------------------------------ [ 0, 1 ] 102986 6.715% 6.715% # ( 1, 2 ] 823321 53.682% 60.396% ########### ( 2, 3 ] 329396 21.477% 81.874% #### ( 3, 4 ] 116490 7.595% 89.469% ## ( 4, 6 ] 121931 7.950% 97.419% ## ( 6, 10 ] 32111 2.094% 99.513% ( 10, 15 ] 4640 0.303% 99.815% ( 15, 22 ] 554 0.036% 99.851% ( 22, 34 ] 35 0.002% 99.853% ( 34, 51 ] 13 0.001% 99.854% ( 51, 76 ] 70 0.005% 99.859% ( 76, 110 ] 542 0.035% 99.894% ( 110, 170 ] 655 0.043% 99.937% ( 170, 250 ] 302 0.020% 99.957% ( 250, 380 ] 391 0.025% 99.982% ( 380, 580 ] 495 0.032% 100.014% ( 580, 870 ] 506 0.033% 100.047% ( 870, 1300 ] 400 0.026% 100.073% ( 1300, 1900 ] 170 0.011% 100.085% ( 1900, 2900 ] 131 0.009% 100.093% ( 2900, 4400 ] 176 0.011% 100.105% ( 4400, 6600 ] 34 0.002% 100.107% ( 6600, 9900 ] 12 0.001% 100.108% ** Level 2 read latency histogram (micros): Count: 100720 Average: 2.3373 StdDev: 27.42 Min: 0 Median: 1.4219 Max: 5495 Percentiles: P50: 1.42 P75: 1.82 P99: 5.67 P99.9: 14.83 P99.99: 647.28 ------------------------------------------------------ [ 0, 1 ] 23607 23.438% 23.438% ##### ( 1, 2 ] 63417 62.964% 86.402% ############# ( 2, 3 ] 8409 8.349% 94.751% ## ( 3, 4 ] 2689 2.670% 97.421% # ( 4, 6 ] 1901 1.887% 99.308% ( 6, 10 ] 517 0.513% 99.821% ( 10, 15 ] 82 0.081% 99.903% ( 15, 22 ] 14 0.014% 99.917% ( 22, 34 ] 4 0.004% 99.921% ( 34, 51 ] 1 0.001% 99.922% ( 51, 76 ] 32 0.032% 99.953% ( 76, 110 ] 5 0.005% 99.958% ( 110, 170 ] 6 0.006% 99.964% ( 170, 250 ] 14 0.014% 99.978% ( 250, 380 ] 8 0.008% 99.986% ( 380, 580 ] 3 0.003% 99.989% ( 580, 870 ] 4 0.004% 99.993% ( 1300, 1900 ] 2 0.002% 99.995% ( 1900, 2900 ] 3 0.003% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1044736 Average: 5.0195 StdDev: 61.38 Min: 1 Median: 1.9459 Max: 7780 Percentiles: P50: 1.95 P75: 2.88 P99: 9.22 P99.9: 213.47 P99.99: 477.58 ------------------------------------------------------ [ 0, 1 ] 32335 3.095% 3.095% # ( 1, 2 ] 518051 49.587% 52.682% ########## ( 2, 3 ] 263831 25.253% 77.935% ##### ( 3, 4 ] 99540 9.528% 87.463% ## ( 4, 6 ] 102694 9.830% 97.293% ## ( 6, 10 ] 22160 2.121% 99.414% ( 10, 15 ] 3444 0.330% 99.743% ( 15, 22 ] 365 0.035% 99.778% ( 22, 34 ] 33 0.003% 99.781% ( 34, 51 ] 16 0.002% 99.783% ( 51, 76 ] 49 0.005% 99.788% ( 76, 110 ] 280 0.027% 99.814% ( 110, 170 ] 653 0.063% 99.877% ( 170, 250 ] 444 0.042% 99.920% ( 250, 380 ] 456 0.044% 99.963% ( 380, 580 ] 577 0.055% 100.018% ( 580, 870 ] 474 0.045% 100.064% ( 870, 1300 ] 315 0.030% 100.094% ( 1300, 1900 ] 140 0.013% 100.107% ( 1900, 2900 ] 86 0.008% 100.116% ( 2900, 4400 ] 87 0.008% 100.124% ( 4400, 6600 ] 26 0.002% 100.126% ( 6600, 9900 ] 8 0.001% 100.127% ** Level 4 read latency histogram (micros): Count: 11997 Average: 85.1455 StdDev: 407.97 Min: 0 Median: 2.2511 Max: 8845 Percentiles: P50: 2.25 P75: 3.51 P99: 1828.46 P99.9: 5610.33 P99.99: 8085.25 ------------------------------------------------------ [ 0, 1 ] 247 2.059% 2.059% ( 1, 2 ] 4980 41.510% 43.569% ######## ( 2, 3 ] 3072 25.606% 69.176% ##### ( 3, 4 ] 1364 11.370% 80.545% ## ( 4, 6 ] 876 7.302% 87.847% # ( 6, 10 ] 303 2.526% 90.373% # ( 10, 15 ] 58 0.483% 90.856% ( 15, 22 ] 2 0.017% 90.873% ( 22, 34 ] 7 0.058% 90.931% ( 34, 51 ] 3 0.025% 90.956% ( 76, 110 ] 10 0.083% 91.039% ( 110, 170 ] 107 0.892% 91.931% ( 170, 250 ] 100 0.834% 92.765% ( 250, 380 ] 134 1.117% 93.882% ( 380, 580 ] 191 1.592% 95.474% ( 580, 870 ] 187 1.559% 97.033% ( 870, 1300 ] 155 1.292% 98.325% ( 1300, 1900 ] 92 0.767% 99.091% ( 1900, 2900 ] 44 0.367% 99.458% ( 2900, 4400 ] 42 0.350% 99.808% ( 4400, 6600 ] 20 0.167% 99.975% ( 6600, 9900 ] 4 0.033% 100.008% ** Level 5 read latency histogram (micros): Count: 100 Average: 1111.3400 StdDev: 1296.55 Min: 84 Median: 609.0000 Max: 5848 Percentiles: P50: 609.00 P75: 1600.00 P99: 5848.00 P99.9: 5848.00 P99.99: 5848.00 ------------------------------------------------------ ( 76, 110 ] 12 12.000% 12.000% ## ( 110, 170 ] 19 19.000% 31.000% #### ( 170, 250 ] 8 8.000% 39.000% ## ( 250, 380 ] 2 2.000% 41.000% ( 380, 580 ] 8 8.000% 49.000% ## ( 580, 870 ] 10 10.000% 59.000% ## ( 870, 1300 ] 12 12.000% 71.000% ## ( 1300, 1900 ] 8 8.000% 79.000% ## ( 1900, 2900 ] 9 9.000% 88.000% ## ( 2900, 4400 ] 8 8.000% 96.000% ## ( 4400, 6600 ] 4 4.000% 100.000% # ** DB Stats ** Uptime(secs): 42.3 total, 16.5 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 185.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:20.846 H:M:S, 49.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 59.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:13.583 H:M:S, 82.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/11/18-18:20:36 ... thread 0: (1000000,9000000) ops and (224527.1,193063.2) ops/second in (4.453806,46.616868) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 3.25 GB 31.5 9.0 0.0 9.0 17.5 8.5 0.0 2.0 144.8 282.4 63.49 56.97 148 0.429 9335K 19K 0.0 0.0 L1 6/6 646.95 MB 0.0 7.1 5.0 2.0 7.0 5.0 0.2 1.4 228.9 226.4 31.64 30.22 4 7.910 7355K 80K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 4.3 1.8 257.0 256.9 1.36 1.29 2 0.678 353K 183 0.0 0.0 L3 20/0 998.23 MB 1.0 7.9 4.3 3.6 7.9 4.3 0.2 1.8 159.0 158.2 51.18 36.08 28 1.828 8265K 38K 0.0 0.0 L4 178/0 9.51 GB 1.0 3.6 3.5 0.1 3.6 3.5 0.9 1.0 144.7 144.5 25.65 17.17 47 0.546 3679K 1886 0.0 0.0 L5 1084/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1300/17 104.48 GB 0.0 28.0 13.1 14.9 36.4 21.5 10.0 4.3 165.2 214.9 173.33 141.73 229 0.757 28M 140K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.0 13.1 14.9 36.4 21.5 10.0 4.3 165.2 214.9 173.33 141.73 229 0.757 28M 140K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.0 13.1 14.9 27.8 12.9 0.0 0.0 195.2 194.2 146.70 119.46 107 1.371 28M 140K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 328.9 26.63 22.28 122 0.218 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 46.8 total, 46.6 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 36.37 GB write, 795.97 MB/s write, 27.96 GB read, 611.95 MB/s read, 173.3 seconds Interval compaction: 36.37 GB write, 798.97 MB/s write, 27.96 GB read, 614.26 MB/s read, 173.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 24, pending-compaction-bytes-stops: 0, total-delays: 40, total-stops: 62, interval: 102 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3837717 Average: 2.6525 StdDev: 22.08 Min: 0 Median: 1.5947 Max: 12195 Percentiles: P50: 1.59 P75: 1.98 P99: 6.59 P99.9: 14.74 P99.99: 201.27 ------------------------------------------------------ [ 0, 1 ] 443897 11.567% 11.567% ## ( 1, 2 ] 2480317 64.630% 76.197% ############# ( 2, 3 ] 569706 14.845% 91.042% ### ( 3, 4 ] 165105 4.302% 95.344% # ( 4, 6 ] 135161 3.522% 98.866% # ( 6, 10 ] 34909 0.910% 99.775% ( 10, 15 ] 5051 0.132% 99.907% ( 15, 22 ] 566 0.015% 99.922% ( 22, 34 ] 44 0.001% 99.923% ( 34, 51 ] 20 0.001% 99.923% ( 51, 76 ] 37 0.001% 99.924% ( 76, 110 ] 856 0.022% 99.947% ( 110, 170 ] 1450 0.038% 99.984% ( 170, 250 ] 548 0.014% 99.999% ( 250, 380 ] 306 0.008% 100.007% ( 380, 580 ] 345 0.009% 100.016% ( 580, 870 ] 196 0.005% 100.021% ( 870, 1300 ] 126 0.003% 100.024% ( 1300, 1900 ] 48 0.001% 100.025% ( 1900, 2900 ] 47 0.001% 100.027% ( 2900, 4400 ] 51 0.001% 100.028% ( 4400, 6600 ] 10 0.000% 100.028% ( 9900, 14000 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 1651102 Average: 4.8788 StdDev: 71.67 Min: 1 Median: 1.8220 Max: 8479 Percentiles: P50: 1.82 P75: 2.71 P99: 9.09 P99.9: 136.77 P99.99: 518.56 ------------------------------------------------------ [ 0, 1 ] 104368 6.321% 6.321% # ( 1, 2 ] 877386 53.139% 59.461% ########### ( 2, 3 ] 363203 21.998% 81.458% #### ( 3, 4 ] 128005 7.753% 89.211% ## ( 4, 6 ] 134323 8.135% 97.346% ## ( 6, 10 ] 35307 2.138% 99.485% ( 10, 15 ] 5244 0.318% 99.802% ( 15, 22 ] 633 0.038% 99.841% ( 22, 34 ] 40 0.002% 99.843% ( 34, 51 ] 15 0.001% 99.844% ( 51, 76 ] 73 0.004% 99.848% ( 76, 110 ] 551 0.033% 99.882% ( 110, 170 ] 679 0.041% 99.923% ( 170, 250 ] 320 0.019% 99.942% ( 250, 380 ] 422 0.026% 99.968% ( 380, 580 ] 531 0.032% 100.000% ( 580, 870 ] 539 0.033% 100.033% ( 870, 1300 ] 441 0.027% 100.059% ( 1300, 1900 ] 207 0.013% 100.072% ( 1900, 2900 ] 174 0.011% 100.082% ( 2900, 4400 ] 247 0.015% 100.097% ( 4400, 6600 ] 62 0.004% 100.101% ( 6600, 9900 ] 23 0.001% 100.102% ** Level 2 read latency histogram (micros): Count: 100720 Average: 2.3373 StdDev: 27.42 Min: 0 Median: 1.4219 Max: 5495 Percentiles: P50: 1.42 P75: 1.82 P99: 5.67 P99.9: 14.83 P99.99: 647.28 ------------------------------------------------------ [ 0, 1 ] 23607 23.438% 23.438% ##### ( 1, 2 ] 63417 62.964% 86.402% ############# ( 2, 3 ] 8409 8.349% 94.751% ## ( 3, 4 ] 2689 2.670% 97.421% # ( 4, 6 ] 1901 1.887% 99.308% ( 6, 10 ] 517 0.513% 99.821% ( 10, 15 ] 82 0.081% 99.903% ( 15, 22 ] 14 0.014% 99.917% ( 22, 34 ] 4 0.004% 99.921% ( 34, 51 ] 1 0.001% 99.922% ( 51, 76 ] 32 0.032% 99.953% ( 76, 110 ] 5 0.005% 99.958% ( 110, 170 ] 6 0.006% 99.964% ( 170, 250 ] 14 0.014% 99.978% ( 250, 380 ] 8 0.008% 99.986% ( 380, 580 ] 3 0.003% 99.989% ( 580, 870 ] 4 0.004% 99.993% ( 1300, 1900 ] 2 0.002% 99.995% ( 1900, 2900 ] 3 0.003% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1781469 Average: 5.1447 StdDev: 71.04 Min: 0 Median: 2.0364 Max: 9971 Percentiles: P50: 2.04 P75: 2.94 P99: 8.94 P99.9: 17.42 P99.99: 175.66 ------------------------------------------------------ [ 0, 1 ] 35550 1.996% 1.996% ( 1, 2 ] 837333 47.002% 48.998% ######### ( 2, 3 ] 491092 27.567% 76.565% ###### ( 3, 4 ] 183306 10.290% 86.854% ## ( 4, 6 ] 189760 10.652% 97.506% ## ( 6, 10 ] 36268 2.036% 99.542% ( 10, 15 ] 6151 0.345% 99.887% ( 15, 22 ] 659 0.037% 99.924% ( 22, 34 ] 60 0.003% 99.928% ( 34, 51 ] 21 0.001% 99.929% ( 51, 76 ] 57 0.003% 99.932% ( 76, 110 ] 302 0.017% 99.949% ( 110, 170 ] 696 0.039% 99.988% ( 170, 250 ] 507 0.028% 100.016% ( 250, 380 ] 560 0.031% 100.048% ( 380, 580 ] 721 0.040% 100.088% ( 580, 870 ] 654 0.037% 100.125% ( 870, 1300 ] 466 0.026% 100.151% ( 1300, 1900 ] 239 0.013% 100.165% ( 1900, 2900 ] 196 0.011% 100.176% ( 2900, 4400 ] 227 0.013% 100.188% ( 4400, 6600 ] 73 0.004% 100.192% ( 6600, 9900 ] 20 0.001% 100.194% ( 9900, 14000 ] 1 0.000% 100.194% ** Level 4 read latency histogram (micros): Count: 35350 Average: 97.4765 StdDev: 447.56 Min: 0 Median: 2.2221 Max: 9173 Percentiles: P50: 2.22 P75: 3.43 P99: 2315.87 P99.9: 5625.07 P99.99: 6583.88 ------------------------------------------------------ [ 0, 1 ] 563 1.593% 1.593% ( 1, 2 ] 15076 42.648% 44.240% ######### ( 2, 3 ] 9169 25.938% 70.178% ##### ( 3, 4 ] 3959 11.199% 81.378% ## ( 4, 6 ] 2467 6.979% 88.356% # ( 6, 10 ] 820 2.320% 90.676% ( 10, 15 ] 157 0.444% 91.120% ( 15, 22 ] 20 0.057% 91.177% ( 22, 34 ] 28 0.079% 91.256% ( 34, 51 ] 8 0.023% 91.279% ( 51, 76 ] 6 0.017% 91.296% ( 76, 110 ] 24 0.068% 91.364% ( 110, 170 ] 154 0.436% 91.799% ( 170, 250 ] 219 0.620% 92.419% ( 250, 380 ] 308 0.871% 93.290% ( 380, 580 ] 486 1.375% 94.665% ( 580, 870 ] 615 1.740% 96.405% ( 870, 1300 ] 516 1.460% 97.864% ( 1300, 1900 ] 315 0.891% 98.755% ( 1900, 2900 ] 208 0.588% 99.344% ( 2900, 4400 ] 156 0.441% 99.785% ( 4400, 6600 ] 73 0.207% 99.992% ( 6600, 9900 ] 8 0.023% 100.014% ** Level 5 read latency histogram (micros): Count: 260 Average: 1288.7308 StdDev: 1354.12 Min: 79 Median: 776.7857 Max: 6625 Percentiles: P50: 776.79 P75: 1938.46 P99: 6097.14 P99.9: 6625.00 P99.99: 6625.00 ------------------------------------------------------ ( 76, 110 ] 18 6.923% 6.923% # ( 110, 170 ] 39 15.000% 21.923% ### ( 170, 250 ] 16 6.154% 28.077% # ( 250, 380 ] 18 6.923% 35.000% # ( 380, 580 ] 20 7.692% 42.692% ## ( 580, 870 ] 28 10.769% 53.462% ## ( 870, 1300 ] 29 11.154% 64.615% ## ( 1300, 1900 ] 26 10.000% 74.615% ## ( 1900, 2900 ] 26 10.000% 84.615% ## ( 2900, 4400 ] 32 12.308% 96.923% ## ( 4400, 6600 ] 7 2.692% 99.615% # ( 6600, 9900 ] 1 0.385% 100.000% ** DB Stats ** Uptime(secs): 46.8 total, 4.5 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 189.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.453 H:M:S, 48.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 220.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.607 H:M:S, 36.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-18:20:39 ... thread 0: (1000000,10000000) ops and (330476.9,201439.1) ops/second in (3.025930,49.642798) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/11 4.23 GB 132.2 9.8 0.0 9.8 19.3 9.5 0.0 2.0 144.8 284.0 69.56 62.67 164 0.424 10M 20K 0.0 0.0 L1 6/6 646.95 MB 0.0 7.1 5.0 2.0 7.0 5.0 0.2 1.4 228.9 226.4 31.64 30.22 4 7.910 7355K 80K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 4.3 1.8 257.0 256.9 1.36 1.29 2 0.678 353K 183 0.0 0.0 L3 20/0 998.23 MB 1.0 7.9 4.3 3.6 7.9 4.3 0.2 1.8 159.0 158.2 51.18 36.08 28 1.828 8265K 38K 0.0 0.0 L4 178/0 9.51 GB 1.0 3.6 3.5 0.1 3.6 3.5 0.9 1.0 144.7 144.5 25.65 17.17 47 0.546 3679K 1886 0.0 0.0 L5 1084/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1305/17 105.47 GB 0.0 28.8 13.1 15.8 38.2 22.4 10.0 4.0 164.5 217.8 179.39 147.43 245 0.732 29M 141K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.8 13.1 15.8 38.2 22.4 10.0 4.0 164.5 217.8 179.39 147.43 245 0.732 29M 141K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.8 13.1 15.8 28.7 12.9 0.0 0.0 196.7 195.7 150.07 122.76 110 1.364 29M 141K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 330.8 29.32 24.68 135 0.217 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.8 total, 49.6 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 38.16 GB write, 784.28 MB/s write, 28.83 GB read, 592.49 MB/s read, 179.4 seconds Interval compaction: 38.16 GB write, 787.05 MB/s write, 28.83 GB read, 594.59 MB/s read, 179.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 66, pending-compaction-bytes-delays: 24, pending-compaction-bytes-stops: 0, total-delays: 40, total-stops: 66, interval: 106 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4251889 Average: 2.6328 StdDev: 21.22 Min: 0 Median: 1.5973 Max: 12195 Percentiles: P50: 1.60 P75: 1.98 P99: 6.56 P99.9: 14.41 P99.99: 178.22 ------------------------------------------------------ [ 0, 1 ] 480287 11.296% 11.296% ## ( 1, 2 ] 2755356 64.803% 76.099% ############# ( 2, 3 ] 642330 15.107% 91.206% ### ( 3, 4 ] 179628 4.225% 95.431% # ( 4, 6 ] 146369 3.442% 98.873% # ( 6, 10 ] 38793 0.912% 99.785% ( 10, 15 ] 5532 0.130% 99.915% ( 15, 22 ] 600 0.014% 99.930% ( 22, 34 ] 50 0.001% 99.931% ( 34, 51 ] 22 0.001% 99.931% ( 51, 76 ] 39 0.001% 99.932% ( 76, 110 ] 896 0.021% 99.953% ( 110, 170 ] 1502 0.035% 99.989% ( 170, 250 ] 592 0.014% 100.003% ( 250, 380 ] 333 0.008% 100.010% ( 380, 580 ] 364 0.009% 100.019% ( 580, 870 ] 202 0.005% 100.024% ( 870, 1300 ] 133 0.003% 100.027% ( 1300, 1900 ] 50 0.001% 100.028% ( 1900, 2900 ] 48 0.001% 100.029% ( 2900, 4400 ] 52 0.001% 100.030% ( 4400, 6600 ] 10 0.000% 100.031% ( 9900, 14000 ] 1 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 1651102 Average: 4.8788 StdDev: 71.67 Min: 1 Median: 1.8220 Max: 8479 Percentiles: P50: 1.82 P75: 2.71 P99: 9.09 P99.9: 136.77 P99.99: 518.56 ------------------------------------------------------ [ 0, 1 ] 104368 6.321% 6.321% # ( 1, 2 ] 877386 53.139% 59.461% ########### ( 2, 3 ] 363203 21.998% 81.458% #### ( 3, 4 ] 128005 7.753% 89.211% ## ( 4, 6 ] 134323 8.135% 97.346% ## ( 6, 10 ] 35307 2.138% 99.485% ( 10, 15 ] 5244 0.318% 99.802% ( 15, 22 ] 633 0.038% 99.841% ( 22, 34 ] 40 0.002% 99.843% ( 34, 51 ] 15 0.001% 99.844% ( 51, 76 ] 73 0.004% 99.848% ( 76, 110 ] 551 0.033% 99.882% ( 110, 170 ] 679 0.041% 99.923% ( 170, 250 ] 320 0.019% 99.942% ( 250, 380 ] 422 0.026% 99.968% ( 380, 580 ] 531 0.032% 100.000% ( 580, 870 ] 539 0.033% 100.033% ( 870, 1300 ] 441 0.027% 100.059% ( 1300, 1900 ] 207 0.013% 100.072% ( 1900, 2900 ] 174 0.011% 100.082% ( 2900, 4400 ] 247 0.015% 100.097% ( 4400, 6600 ] 62 0.004% 100.101% ( 6600, 9900 ] 23 0.001% 100.102% ** Level 2 read latency histogram (micros): Count: 100720 Average: 2.3373 StdDev: 27.42 Min: 0 Median: 1.4219 Max: 5495 Percentiles: P50: 1.42 P75: 1.82 P99: 5.67 P99.9: 14.83 P99.99: 647.28 ------------------------------------------------------ [ 0, 1 ] 23607 23.438% 23.438% ##### ( 1, 2 ] 63417 62.964% 86.402% ############# ( 2, 3 ] 8409 8.349% 94.751% ## ( 3, 4 ] 2689 2.670% 97.421% # ( 4, 6 ] 1901 1.887% 99.308% ( 6, 10 ] 517 0.513% 99.821% ( 10, 15 ] 82 0.081% 99.903% ( 15, 22 ] 14 0.014% 99.917% ( 22, 34 ] 4 0.004% 99.921% ( 34, 51 ] 1 0.001% 99.922% ( 51, 76 ] 32 0.032% 99.953% ( 76, 110 ] 5 0.005% 99.958% ( 110, 170 ] 6 0.006% 99.964% ( 170, 250 ] 14 0.014% 99.978% ( 250, 380 ] 8 0.008% 99.986% ( 380, 580 ] 3 0.003% 99.989% ( 580, 870 ] 4 0.004% 99.993% ( 1300, 1900 ] 2 0.002% 99.995% ( 1900, 2900 ] 3 0.003% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1781469 Average: 5.1447 StdDev: 71.04 Min: 0 Median: 2.0364 Max: 9971 Percentiles: P50: 2.04 P75: 2.94 P99: 8.94 P99.9: 17.42 P99.99: 175.66 ------------------------------------------------------ [ 0, 1 ] 35550 1.996% 1.996% ( 1, 2 ] 837333 47.002% 48.998% ######### ( 2, 3 ] 491092 27.567% 76.565% ###### ( 3, 4 ] 183306 10.290% 86.854% ## ( 4, 6 ] 189760 10.652% 97.506% ## ( 6, 10 ] 36268 2.036% 99.542% ( 10, 15 ] 6151 0.345% 99.887% ( 15, 22 ] 659 0.037% 99.924% ( 22, 34 ] 60 0.003% 99.928% ( 34, 51 ] 21 0.001% 99.929% ( 51, 76 ] 57 0.003% 99.932% ( 76, 110 ] 302 0.017% 99.949% ( 110, 170 ] 696 0.039% 99.988% ( 170, 250 ] 507 0.028% 100.016% ( 250, 380 ] 560 0.031% 100.048% ( 380, 580 ] 721 0.040% 100.088% ( 580, 870 ] 654 0.037% 100.125% ( 870, 1300 ] 466 0.026% 100.151% ( 1300, 1900 ] 239 0.013% 100.165% ( 1900, 2900 ] 196 0.011% 100.176% ( 2900, 4400 ] 227 0.013% 100.188% ( 4400, 6600 ] 73 0.004% 100.192% ( 6600, 9900 ] 20 0.001% 100.194% ( 9900, 14000 ] 1 0.000% 100.194% ** Level 4 read latency histogram (micros): Count: 35350 Average: 97.4765 StdDev: 447.56 Min: 0 Median: 2.2221 Max: 9173 Percentiles: P50: 2.22 P75: 3.43 P99: 2315.87 P99.9: 5625.07 P99.99: 6583.88 ------------------------------------------------------ [ 0, 1 ] 563 1.593% 1.593% ( 1, 2 ] 15076 42.648% 44.240% ######### ( 2, 3 ] 9169 25.938% 70.178% ##### ( 3, 4 ] 3959 11.199% 81.378% ## ( 4, 6 ] 2467 6.979% 88.356% # ( 6, 10 ] 820 2.320% 90.676% ( 10, 15 ] 157 0.444% 91.120% ( 15, 22 ] 20 0.057% 91.177% ( 22, 34 ] 28 0.079% 91.256% ( 34, 51 ] 8 0.023% 91.279% ( 51, 76 ] 6 0.017% 91.296% ( 76, 110 ] 24 0.068% 91.364% ( 110, 170 ] 154 0.436% 91.799% ( 170, 250 ] 219 0.620% 92.419% ( 250, 380 ] 308 0.871% 93.290% ( 380, 580 ] 486 1.375% 94.665% ( 580, 870 ] 615 1.740% 96.405% ( 870, 1300 ] 516 1.460% 97.864% ( 1300, 1900 ] 315 0.891% 98.755% ( 1900, 2900 ] 208 0.588% 99.344% ( 2900, 4400 ] 156 0.441% 99.785% ( 4400, 6600 ] 73 0.207% 99.992% ( 6600, 9900 ] 8 0.023% 100.014% ** Level 5 read latency histogram (micros): Count: 260 Average: 1288.7308 StdDev: 1354.12 Min: 79 Median: 776.7857 Max: 6625 Percentiles: P50: 776.79 P75: 1938.46 P99: 6097.14 P99.9: 6625.00 P99.99: 6625.00 ------------------------------------------------------ ( 76, 110 ] 18 6.923% 6.923% # ( 110, 170 ] 39 15.000% 21.923% ### ( 170, 250 ] 16 6.154% 28.077% # ( 250, 380 ] 18 6.923% 35.000% # ( 380, 580 ] 20 7.692% 42.692% ## ( 580, 870 ] 28 10.769% 53.462% ## ( 870, 1300 ] 29 11.154% 64.615% ## ( 1300, 1900 ] 26 10.000% 74.615% ## ( 1900, 2900 ] 26 10.000% 84.615% ## ( 2900, 4400 ] 32 12.308% 96.923% ## ( 4400, 6600 ] 7 2.692% 99.615% # ( 6600, 9900 ] 1 0.385% 100.000% ** DB Stats ** Uptime(secs): 49.8 total, 3.0 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 197.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.886 H:M:S, 45.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.433 H:M:S, 14.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-18:20:47 ... thread 0: (1000000,11000000) ops and (128174.2,191488.6) ops/second in (7.801884,57.444682) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/7 5.27 GB 270.6 11.2 0.0 11.2 21.7 10.5 0.0 2.1 147.1 285.1 77.90 70.54 185 0.421 11M 21K 0.0 0.0 L1 6/6 646.95 MB 0.0 7.1 5.0 2.0 7.0 5.0 0.2 1.4 228.9 226.4 31.64 30.22 4 7.910 7355K 80K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 4.3 1.8 257.0 256.9 1.36 1.29 2 0.678 353K 183 0.0 0.0 L3 20/0 998.23 MB 1.0 7.9 4.3 3.6 7.9 4.3 0.2 1.8 159.0 158.2 51.18 36.08 28 1.828 8265K 38K 0.0 0.0 L4 178/0 9.51 GB 1.0 3.6 3.5 0.1 3.6 3.5 0.9 1.0 144.7 144.5 25.65 17.17 47 0.546 3679K 1886 0.0 0.0 L5 1084/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1306/13 106.51 GB 0.0 30.2 13.1 17.1 40.6 23.4 10.0 3.9 164.6 221.2 187.74 155.30 266 0.706 31M 143K 0.0 0.0 Int 0/0 0.00 KB 0.0 30.2 13.1 17.1 40.6 23.4 10.0 3.9 164.6 221.2 187.74 155.30 266 0.706 31M 143K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 30.2 13.1 17.1 30.0 12.9 0.0 0.0 199.0 198.0 155.33 127.91 115 1.351 31M 143K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 332.4 32.41 27.39 151 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.6 total, 57.4 interval Flush(GB): cumulative 10.520, interval 10.520 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 40.55 GB write, 720.70 MB/s write, 30.18 GB read, 536.32 MB/s read, 187.7 seconds Interval compaction: 40.55 GB write, 722.90 MB/s write, 30.18 GB read, 537.96 MB/s read, 187.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 68, pending-compaction-bytes-delays: 25, pending-compaction-bytes-stops: 0, total-delays: 49, total-stops: 68, interval: 117 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4921622 Average: 2.5926 StdDev: 19.94 Min: 0 Median: 1.5931 Max: 12195 Percentiles: P50: 1.59 P75: 1.98 P99: 6.52 P99.9: 14.07 P99.99: 165.53 ------------------------------------------------------ [ 0, 1 ] 561122 11.401% 11.401% ## ( 1, 2 ] 3202724 65.075% 76.476% ############# ( 2, 3 ] 739376 15.023% 91.499% ### ( 3, 4 ] 200400 4.072% 95.571% # ( 4, 6 ] 162926 3.310% 98.881% # ( 6, 10 ] 44977 0.914% 99.795% ( 10, 15 ] 6358 0.129% 99.924% ( 15, 22 ] 684 0.014% 99.938% ( 22, 34 ] 51 0.001% 99.939% ( 34, 51 ] 29 0.001% 99.940% ( 51, 76 ] 40 0.001% 99.940% ( 76, 110 ] 974 0.020% 99.960% ( 110, 170 ] 1587 0.032% 99.992% ( 170, 250 ] 629 0.013% 100.005% ( 250, 380 ] 348 0.007% 100.012% ( 380, 580 ] 391 0.008% 100.020% ( 580, 870 ] 216 0.004% 100.025% ( 870, 1300 ] 145 0.003% 100.028% ( 1300, 1900 ] 51 0.001% 100.029% ( 1900, 2900 ] 50 0.001% 100.030% ( 2900, 4400 ] 52 0.001% 100.031% ( 4400, 6600 ] 10 0.000% 100.031% ( 9900, 14000 ] 1 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 1767214 Average: 4.6931 StdDev: 69.30 Min: 1 Median: 1.7791 Max: 8479 Percentiles: P50: 1.78 P75: 2.64 P99: 9.02 P99.9: 135.40 P99.99: 514.81 ------------------------------------------------------ [ 0, 1 ] 144610 8.183% 8.183% ## ( 1, 2 ] 948529 53.674% 61.857% ########### ( 2, 3 ] 363964 20.595% 82.452% #### ( 3, 4 ] 129355 7.320% 89.772% # ( 4, 6 ] 135922 7.691% 97.463% ## ( 6, 10 ] 35930 2.033% 99.496% ( 10, 15 ] 5349 0.303% 99.799% ( 15, 22 ] 666 0.038% 99.837% ( 22, 34 ] 41 0.002% 99.839% ( 34, 51 ] 15 0.001% 99.840% ( 51, 76 ] 73 0.004% 99.844% ( 76, 110 ] 638 0.036% 99.880% ( 110, 170 ] 838 0.047% 99.927% ( 170, 250 ] 325 0.018% 99.946% ( 250, 380 ] 423 0.024% 99.970% ( 380, 580 ] 533 0.030% 100.000% ( 580, 870 ] 540 0.031% 100.030% ( 870, 1300 ] 441 0.025% 100.055% ( 1300, 1900 ] 207 0.012% 100.067% ( 1900, 2900 ] 174 0.010% 100.077% ( 2900, 4400 ] 247 0.014% 100.091% ( 4400, 6600 ] 62 0.004% 100.094% ( 6600, 9900 ] 23 0.001% 100.096% ** Level 2 read latency histogram (micros): Count: 100720 Average: 2.3373 StdDev: 27.42 Min: 0 Median: 1.4219 Max: 5495 Percentiles: P50: 1.42 P75: 1.82 P99: 5.67 P99.9: 14.83 P99.99: 647.28 ------------------------------------------------------ [ 0, 1 ] 23607 23.438% 23.438% ##### ( 1, 2 ] 63417 62.964% 86.402% ############# ( 2, 3 ] 8409 8.349% 94.751% ## ( 3, 4 ] 2689 2.670% 97.421% # ( 4, 6 ] 1901 1.887% 99.308% ( 6, 10 ] 517 0.513% 99.821% ( 10, 15 ] 82 0.081% 99.903% ( 15, 22 ] 14 0.014% 99.917% ( 22, 34 ] 4 0.004% 99.921% ( 34, 51 ] 1 0.001% 99.922% ( 51, 76 ] 32 0.032% 99.953% ( 76, 110 ] 5 0.005% 99.958% ( 110, 170 ] 6 0.006% 99.964% ( 170, 250 ] 14 0.014% 99.978% ( 250, 380 ] 8 0.008% 99.986% ( 380, 580 ] 3 0.003% 99.989% ( 580, 870 ] 4 0.004% 99.993% ( 1300, 1900 ] 2 0.002% 99.995% ( 1900, 2900 ] 3 0.003% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1781469 Average: 5.1447 StdDev: 71.04 Min: 0 Median: 2.0364 Max: 9971 Percentiles: P50: 2.04 P75: 2.94 P99: 8.94 P99.9: 17.42 P99.99: 175.66 ------------------------------------------------------ [ 0, 1 ] 35550 1.996% 1.996% ( 1, 2 ] 837333 47.002% 48.998% ######### ( 2, 3 ] 491092 27.567% 76.565% ###### ( 3, 4 ] 183306 10.290% 86.854% ## ( 4, 6 ] 189760 10.652% 97.506% ## ( 6, 10 ] 36268 2.036% 99.542% ( 10, 15 ] 6151 0.345% 99.887% ( 15, 22 ] 659 0.037% 99.924% ( 22, 34 ] 60 0.003% 99.928% ( 34, 51 ] 21 0.001% 99.929% ( 51, 76 ] 57 0.003% 99.932% ( 76, 110 ] 302 0.017% 99.949% ( 110, 170 ] 696 0.039% 99.988% ( 170, 250 ] 507 0.028% 100.016% ( 250, 380 ] 560 0.031% 100.048% ( 380, 580 ] 721 0.040% 100.088% ( 580, 870 ] 654 0.037% 100.125% ( 870, 1300 ] 466 0.026% 100.151% ( 1300, 1900 ] 239 0.013% 100.165% ( 1900, 2900 ] 196 0.011% 100.176% ( 2900, 4400 ] 227 0.013% 100.188% ( 4400, 6600 ] 73 0.004% 100.192% ( 6600, 9900 ] 20 0.001% 100.194% ( 9900, 14000 ] 1 0.000% 100.194% ** Level 4 read latency histogram (micros): Count: 35350 Average: 97.4765 StdDev: 447.56 Min: 0 Median: 2.2221 Max: 9173 Percentiles: P50: 2.22 P75: 3.43 P99: 2315.87 P99.9: 5625.07 P99.99: 6583.88 ------------------------------------------------------ [ 0, 1 ] 563 1.593% 1.593% ( 1, 2 ] 15076 42.648% 44.240% ######### ( 2, 3 ] 9169 25.938% 70.178% ##### ( 3, 4 ] 3959 11.199% 81.378% ## ( 4, 6 ] 2467 6.979% 88.356% # ( 6, 10 ] 820 2.320% 90.676% ( 10, 15 ] 157 0.444% 91.120% ( 15, 22 ] 20 0.057% 91.177% ( 22, 34 ] 28 0.079% 91.256% ( 34, 51 ] 8 0.023% 91.279% ( 51, 76 ] 6 0.017% 91.296% ( 76, 110 ] 24 0.068% 91.364% ( 110, 170 ] 154 0.436% 91.799% ( 170, 250 ] 219 0.620% 92.419% ( 250, 380 ] 308 0.871% 93.290% ( 380, 580 ] 486 1.375% 94.665% ( 580, 870 ] 615 1.740% 96.405% ( 870, 1300 ] 516 1.460% 97.864% ( 1300, 1900 ] 315 0.891% 98.755% ( 1900, 2900 ] 208 0.588% 99.344% ( 2900, 4400 ] 156 0.441% 99.785% ( 4400, 6600 ] 73 0.207% 99.992% ( 6600, 9900 ] 8 0.023% 100.014% ** Level 5 read latency histogram (micros): Count: 260 Average: 1288.7308 StdDev: 1354.12 Min: 79 Median: 776.7857 Max: 6625 Percentiles: P50: 776.79 P75: 1938.46 P99: 6097.14 P99.9: 6625.00 P99.99: 6625.00 ------------------------------------------------------ ( 76, 110 ] 18 6.923% 6.923% # ( 110, 170 ] 39 15.000% 21.923% ### ( 170, 250 ] 16 6.154% 28.077% # ( 250, 380 ] 18 6.923% 35.000% # ( 380, 580 ] 20 7.692% 42.692% ## ( 580, 870 ] 28 10.769% 53.462% ## ( 870, 1300 ] 29 11.154% 64.615% ## ( 1300, 1900 ] 26 10.000% 74.615% ## ( 1900, 2900 ] 26 10.000% 84.615% ## ( 2900, 4400 ] 32 12.308% 96.923% ## ( 4400, 6600 ] 7 2.692% 99.615% # ( 6600, 9900 ] 1 0.385% 100.000% ** DB Stats ** Uptime(secs): 57.6 total, 7.8 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 187.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.050 H:M:S, 48.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 126.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.165 H:M:S, 66.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.453 micros/op 183398 ops/sec 60.088 seconds 11019999 operations; 177.7 MB/s Microseconds per write: Count: 11019999 Average: 5.4526 StdDev: 352.68 Min: 0 Median: 1.7269 Max: 591827 Percentiles: P50: 1.73 P75: 2.70 P99: 7.23 P99.9: 1112.83 P99.99: 2694.65 ------------------------------------------------------ [ 0, 1 ] 1547036 14.038% 14.038% ### ( 1, 2 ] 5451533 49.469% 63.508% ########## ( 2, 3 ] 1799113 16.326% 79.834% ### ( 3, 4 ] 1515716 13.754% 93.588% ### ( 4, 6 ] 572485 5.195% 98.783% # ( 6, 10 ] 77879 0.707% 99.490% ( 10, 15 ] 17815 0.162% 99.651% ( 15, 22 ] 6203 0.056% 99.708% ( 22, 34 ] 1365 0.012% 99.720% ( 34, 51 ] 167 0.002% 99.722% ( 51, 76 ] 43 0.000% 99.722% ( 76, 110 ] 7459 0.068% 99.790% ( 110, 170 ] 3327 0.030% 99.820% ( 170, 250 ] 325 0.003% 99.823% ( 250, 380 ] 77 0.001% 99.823% ( 380, 580 ] 41 0.000% 99.824% ( 580, 870 ] 31 0.000% 99.824% ( 870, 1300 ] 14811 0.134% 99.959% ( 1300, 1900 ] 85 0.001% 99.959% ( 1900, 2900 ] 4261 0.039% 99.998% ( 2900, 4400 ] 147 0.001% 99.999% ( 4400, 6600 ] 46 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 18 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 199700 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11019999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11372638968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 643 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30576880 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 37177162715 rocksdb.compact.write.bytes COUNT : 36968175411 rocksdb.flush.write.bytes COUNT : 11361790003 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 61 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 401 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11270263808 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4455424 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 37283846323 rocksdb.non.last.level.read.count COUNT : 9006913 rocksdb.block.checksum.compute.count COUNT : 9005688 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.372386 P95 : 3.827163 P99 : 5.928045 P100 : 591825.000000 COUNT : 11019999 SUM : 55158031 rocksdb.compaction.times.micros P50 : 958709.677419 P95 : 3670000.000000 P99 : 16810546.000000 P100 : 16810546.000000 COUNT : 118 SUM : 171337409 rocksdb.compaction.times.cpu_micros P50 : 893170.731707 P95 : 3413333.333333 P99 : 15895255.000000 P100 : 15895255.000000 COUNT : 118 SUM : 143070248 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 712.659574 P95 : 1263.789474 P99 : 7392.000000 P100 : 9154.000000 COUNT : 152 SUM : 130130 rocksdb.compaction.outfile.sync.micros P50 : 1102.731959 P95 : 132928.571429 P99 : 325887.500000 P100 : 915926.000000 COUNT : 433 SUM : 9583485 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 108.500000 P95 : 1259.388889 P99 : 2243.333333 P100 : 7223.000000 COUNT : 297 SUM : 88126 rocksdb.table.open.io.micros P50 : 1482.242991 P95 : 8060.250000 P99 : 18062.222222 P100 : 24122.000000 COUNT : 643 SUM : 1486336 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.774599 P95 : 8.107102 P99 : 11.028750 P100 : 12199.000000 COUNT : 9004374 SUM : 54455660 rocksdb.read.block.get.micros P50 : 508.767123 P95 : 3678.571429 P99 : 6422.086957 P100 : 8910.000000 COUNT : 1286 SUM : 1207575 rocksdb.write.raw.block.micros P50 : 0.513011 P95 : 0.974722 P99 : 2.899091 P100 : 13224.000000 COUNT : 11707424 SUM : 23265114 rocksdb.numfiles.in.singlecompaction P50 : 2.968750 P95 : 5.575000 P99 : 24.580000 P100 : 33.000000 COUNT : 157 SUM : 569 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.555356 P95 : 1149.208026 P99 : 2489.519321 P100 : 591645.000000 COUNT : 194208 SUM : 30587321 rocksdb.sst.read.micros P50 : 1.703568 P95 : 4.929613 P99 : 8.456827 P100 : 12195.000000 COUNT : 9007996 SUM : 36186226 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11019999 SUM : 11372638968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 215714.285714 P95 : 357714.285714 P99 : 639600.000000 P100 : 755908.000000 COUNT : 152 SUM : 32584887 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 410 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0