Invalid opts->opts_size 0 too small, please set opts_size correctly [2024-08-09 15:12:13.289984] Starting SPDK v24.09-pre git sha1 29119cdfb / DPDK 22.11.4 initialization... [2024-08-09 15:12:13.290117] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid658950 ] Set seed to 1723209133286482 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-08-09 15:12:13.379901] app.c: 910:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-08-09 15:12:13.417544] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-08-09 15:12:13.417592] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 658950' to capture a snapshot of events at runtime. [2024-08-09 15:12:13.417602] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-08-09 15:12:13.417616] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-08-09 15:12:13.417624] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid658950 for offline analysis/debug. [2024-08-09 15:12:13.417699] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Aug 9 15:12:17 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/08/09-15:12:20 ... thread 0: (1000000,1000000) ops and (359494.5,359494.5) ops/second in (2.781684,2.781684) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 503.99 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 352.7 2.32 2.09 12 0.193 0 0 0.0 0.0 L1 3/3 251.76 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 255.8 255.6 0.98 0.96 1 0.985 255K 194 0.0 0.0 L2 1/0 48.78 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 225.7 225.6 0.49 0.46 1 0.494 113K 34 0.0 0.0 L3 16/0 692.53 MB 0.7 0.1 0.1 0.0 0.1 0.1 0.0 1.0 206.0 206.0 0.30 0.25 1 0.304 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1188/8 96.94 GB 0.0 0.4 0.3 0.1 1.2 1.1 0.2 1.5 103.8 303.3 4.10 3.76 15 0.274 432K 228 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.2 1.1 0.1 1.5 103.8 303.3 4.10 3.76 15 0.274 432K 228 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 239.0 238.9 1.78 1.66 3 0.594 432K 228 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 352.7 2.32 2.09 12 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.22 GB write, 412.84 MB/s write, 0.42 GB read, 141.28 MB/s read, 4.1 seconds Interval compaction: 1.22 GB write, 447.20 MB/s write, 0.42 GB read, 153.04 MB/s read, 4.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 96917 Average: 1.7848 StdDev: 16.25 Min: 0 Median: 1.1266 Max: 3139 Percentiles: P50: 1.13 P75: 1.59 P99: 3.44 P99.9: 9.91 P99.99: 325.02 ------------------------------------------------------ [ 0, 1 ] 41888 43.220% 43.220% ######### ( 1, 2 ] 51895 53.546% 96.766% ########### ( 2, 3 ] 1841 1.900% 98.666% ( 3, 4 ] 744 0.768% 99.434% ( 4, 6 ] 289 0.298% 99.732% ( 6, 10 ] 167 0.172% 99.904% ( 10, 15 ] 57 0.059% 99.963% ( 15, 22 ] 10 0.010% 99.973% ( 34, 51 ] 1 0.001% 99.974% ( 51, 76 ] 1 0.001% 99.975% ( 110, 170 ] 8 0.008% 99.983% ( 170, 250 ] 4 0.004% 99.988% ( 250, 380 ] 4 0.004% 99.992% ( 580, 870 ] 4 0.004% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 1 read latency histogram (micros): Count: 25817 Average: 2.3459 StdDev: 21.59 Min: 1 Median: 1.1897 Max: 2367 Percentiles: P50: 1.19 P75: 1.65 P99: 5.90 P99.9: 153.66 P99.99: 959.93 ------------------------------------------------------ [ 0, 1 ] 10240 39.664% 39.664% ######## ( 1, 2 ] 14068 54.491% 94.155% ########### ( 2, 3 ] 842 3.261% 97.416% # ( 3, 4 ] 222 0.860% 98.276% ( 4, 6 ] 197 0.763% 99.039% ( 6, 10 ] 130 0.504% 99.543% ( 10, 15 ] 20 0.077% 99.620% ( 15, 22 ] 8 0.031% 99.651% ( 22, 34 ] 2 0.008% 99.659% ( 34, 51 ] 36 0.139% 99.799% ( 51, 76 ] 21 0.081% 99.880% ( 76, 110 ] 3 0.012% 99.892% ( 110, 170 ] 3 0.012% 99.903% ( 170, 250 ] 10 0.039% 99.942% ( 250, 380 ] 5 0.019% 99.961% ( 380, 580 ] 2 0.008% 99.969% ( 580, 870 ] 5 0.019% 99.988% ( 870, 1300 ] 2 0.008% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 15896 Average: 1.7823 StdDev: 9.20 Min: 1 Median: 1.1839 Max: 1106 Percentiles: P50: 1.18 P75: 1.64 P99: 3.39 P99.9: 9.42 P99.99: 226.42 ------------------------------------------------------ [ 0, 1 ] 6329 39.815% 39.815% ######## ( 1, 2 ] 8805 55.391% 95.206% ########### ( 2, 3 ] 557 3.504% 98.710% # ( 3, 4 ] 119 0.749% 99.459% ( 4, 6 ] 53 0.333% 99.792% ( 6, 10 ] 20 0.126% 99.918% ( 10, 15 ] 8 0.050% 99.969% ( 15, 22 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 870, 1300 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 650.0375 StdDev: 844.53 Min: 1 Median: 202.0000 Max: 2794 Percentiles: P50: 202.00 P75: 1108.89 P99: 2794.00 P99.9: 2794.00 P99.99: 2794.00 ------------------------------------------------------ [ 0, 1 ] 23 28.750% 28.750% ###### ( 1, 2 ] 14 17.500% 46.250% #### ( 4, 6 ] 1 1.250% 47.500% ( 170, 250 ] 5 6.250% 53.750% # ( 250, 380 ] 3 3.750% 57.500% # ( 380, 580 ] 2 2.500% 60.000% # ( 580, 870 ] 7 8.750% 68.750% ## ( 870, 1300 ] 9 11.250% 80.000% ## ( 1300, 1900 ] 5 6.250% 86.250% # ( 1900, 2900 ] 11 13.750% 100.000% ### ** Level 4 read latency histogram (micros): Count: 35 Average: 1673.7429 StdDev: 1232.96 Min: 368 Median: 1257.0000 Max: 4972 Percentiles: P50: 1257.00 P75: 2350.00 P99: 4972.00 P99.9: 4972.00 P99.99: 4972.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 9 25.714% 37.143% ##### ( 870, 1300 ] 5 14.286% 51.429% ### ( 1300, 1900 ] 6 17.143% 68.571% ### ( 1900, 2900 ] 5 14.286% 82.857% ### ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 326.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.191 H:M:S, 6.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 353.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.191 H:M:S, 6.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/08/09-15:12:23 ... thread 0: (1000000,2000000) ops and (326364.8,342129.5) ops/second in (3.064056,5.845740) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.17 GB 62.9 0.6 0.0 0.6 2.3 1.8 0.0 1.3 78.2 330.2 7.25 6.65 28 0.259 575K 562 0.0 0.0 L1 2/0 50.38 MB 5.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 246.2 245.8 3.33 3.24 2 1.663 831K 1421 0.0 0.0 L2 5/4 563.84 MB 1.3 0.1 0.1 0.0 0.1 0.1 0.6 1.8 225.7 225.6 0.49 0.46 1 0.494 113K 34 0.0 0.0 L3 16/9 692.53 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 206.0 206.0 0.30 0.25 1 0.304 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1194/21 97.92 GB 0.0 1.5 0.6 0.9 3.3 2.4 0.7 1.9 137.2 297.6 11.37 10.60 32 0.355 1583K 2017 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.6 0.9 3.3 2.4 0.6 1.9 137.2 297.6 11.37 10.60 32 0.355 1583K 2017 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.6 0.9 1.5 0.6 0.0 0.0 251.7 251.3 6.20 5.99 6 1.033 1583K 2017 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.1 5.17 4.61 26 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.31 GB write, 556.76 MB/s write, 1.52 GB read, 256.57 MB/s read, 11.4 seconds Interval compaction: 3.31 GB write, 578.82 MB/s write, 1.52 GB read, 266.74 MB/s read, 11.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 393201 Average: 2.1114 StdDev: 11.98 Min: 0 Median: 1.4337 Max: 3395 Percentiles: P50: 1.43 P75: 1.83 P99: 5.48 P99.9: 10.62 P99.99: 16.19 ------------------------------------------------------ [ 0, 1 ] 88432 22.490% 22.490% #### ( 1, 2 ] 249431 63.436% 85.926% ############# ( 2, 3 ] 33176 8.437% 94.364% ## ( 3, 4 ] 12803 3.256% 97.620% # ( 4, 6 ] 7337 1.866% 99.486% ( 6, 10 ] 1582 0.402% 99.888% ( 10, 15 ] 395 0.100% 99.989% ( 15, 22 ] 45 0.011% 100.000% ( 22, 34 ] 4 0.001% 100.001% ( 34, 51 ] 6 0.002% 100.003% ( 51, 76 ] 6 0.002% 100.004% ( 110, 170 ] 12 0.003% 100.007% ( 170, 250 ] 13 0.003% 100.010% ( 250, 380 ] 12 0.003% 100.013% ( 580, 870 ] 6 0.002% 100.015% ( 870, 1300 ] 6 0.002% 100.017% ( 1300, 1900 ] 2 0.001% 100.017% ( 1900, 2900 ] 2 0.001% 100.018% ( 2900, 4400 ] 3 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 127502 Average: 2.3660 StdDev: 12.27 Min: 1 Median: 1.5351 Max: 2367 Percentiles: P50: 1.54 P75: 1.93 P99: 5.83 P99.9: 14.80 P99.99: 529.99 ------------------------------------------------------ [ 0, 1 ] 20705 16.239% 16.239% ### ( 1, 2 ] 80450 63.097% 79.336% ############# ( 2, 3 ] 16620 13.035% 92.371% ### ( 3, 4 ] 5061 3.969% 96.340% # ( 4, 6 ] 3703 2.904% 99.245% # ( 6, 10 ] 706 0.554% 99.798% ( 10, 15 ] 136 0.107% 99.905% ( 15, 22 ] 21 0.016% 99.922% ( 22, 34 ] 3 0.002% 99.924% ( 34, 51 ] 37 0.029% 99.953% ( 51, 76 ] 21 0.016% 99.969% ( 76, 110 ] 3 0.002% 99.972% ( 110, 170 ] 4 0.003% 99.975% ( 170, 250 ] 10 0.008% 99.983% ( 250, 380 ] 8 0.006% 99.989% ( 380, 580 ] 3 0.002% 99.991% ( 580, 870 ] 5 0.004% 99.995% ( 870, 1300 ] 4 0.003% 99.998% ( 1300, 1900 ] 2 0.002% 100.000% ( 1900, 2900 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 15937 Average: 1.7858 StdDev: 9.19 Min: 1 Median: 1.1858 Max: 1106 Percentiles: P50: 1.19 P75: 1.64 P99: 3.43 P99.9: 9.61 P99.99: 226.25 ------------------------------------------------------ [ 0, 1 ] 6329 39.713% 39.713% ######## ( 1, 2 ] 8823 55.362% 95.074% ########### ( 2, 3 ] 573 3.595% 98.670% # ( 3, 4 ] 123 0.772% 99.442% ( 4, 6 ] 55 0.345% 99.787% ( 6, 10 ] 20 0.125% 99.912% ( 10, 15 ] 8 0.050% 99.962% ( 15, 22 ] 2 0.013% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 870, 1300 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 75857 Average: 4.0689 StdDev: 39.08 Min: 1 Median: 1.6960 Max: 2794 Percentiles: P50: 1.70 P75: 2.38 P99: 9.58 P99.9: 360.26 P99.99: 1641.42 ------------------------------------------------------ [ 0, 1 ] 6226 8.208% 8.208% ## ( 1, 2 ] 45548 60.045% 68.252% ############ ( 2, 3 ] 13599 17.927% 86.179% #### ( 3, 4 ] 4785 6.308% 92.487% # ( 4, 6 ] 3596 4.740% 97.228% # ( 6, 10 ] 1504 1.983% 99.210% ( 10, 15 ] 227 0.299% 99.510% ( 15, 22 ] 50 0.066% 99.576% ( 22, 34 ] 14 0.018% 99.594% ( 34, 51 ] 1 0.001% 99.595% ( 76, 110 ] 16 0.021% 99.616% ( 110, 170 ] 141 0.186% 99.802% ( 170, 250 ] 48 0.063% 99.866% ( 250, 380 ] 32 0.042% 99.908% ( 380, 580 ] 26 0.034% 99.942% ( 580, 870 ] 21 0.028% 99.970% ( 870, 1300 ] 13 0.017% 99.987% ( 1300, 1900 ] 6 0.008% 99.995% ( 1900, 2900 ] 11 0.015% 100.009% ** Level 4 read latency histogram (micros): Count: 35 Average: 1673.7429 StdDev: 1232.96 Min: 368 Median: 1257.0000 Max: 4972 Percentiles: P50: 1257.00 P75: 2350.00 P99: 4972.00 P99.9: 4972.00 P99.99: 4972.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 9 25.714% 37.143% ##### ( 870, 1300 ] 5 14.286% 51.429% ### ( 1300, 1900 ] 6 17.143% 68.571% ### ( 1900, 2900 ] 5 14.286% 82.857% ### ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 323.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.591 H:M:S, 9.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.400 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/08/09-15:12:26 ... thread 0: (1000000,3000000) ops and (322999.2,335505.8) ops/second in (3.095983,8.941723) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/12 2.15 GB 25.2 1.6 0.0 1.6 4.4 2.8 0.0 1.6 115.3 314.8 14.20 13.19 46 0.309 1663K 1709 0.0 0.0 L1 2/2 50.38 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 246.2 245.8 3.33 3.24 2 1.663 831K 1421 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 225.7 225.6 0.49 0.46 1 0.494 113K 34 0.0 0.0 L3 34/0 983.03 MB 1.0 1.3 0.6 0.7 1.3 0.6 0.0 2.1 214.7 214.6 6.23 5.50 4 1.557 1335K 662 0.0 0.0 L4 140/0 9.49 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1237/14 98.90 GB 0.0 3.8 1.2 2.6 6.6 3.9 1.2 2.4 161.1 277.8 24.25 22.40 53 0.458 3942K 3826 0.0 0.0 Int 0/0 0.00 KB 0.0 3.8 1.2 2.6 6.6 3.9 1.2 2.4 161.1 277.8 24.25 22.40 53 0.458 3942K 3826 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.8 1.2 2.6 3.8 1.2 0.0 0.0 240.8 240.5 16.22 15.26 13 1.248 3942K 3826 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 353.0 8.03 7.14 40 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.58 GB write, 734.18 MB/s write, 3.81 GB read, 425.65 MB/s read, 24.2 seconds Interval compaction: 6.58 GB write, 753.20 MB/s write, 3.81 GB read, 436.67 MB/s read, 24.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 677330 Average: 2.2255 StdDev: 13.05 Min: 0 Median: 1.4800 Max: 3395 Percentiles: P50: 1.48 P75: 1.87 P99: 5.65 P99.9: 11.88 P99.99: 81.43 ------------------------------------------------------ [ 0, 1 ] 127536 18.829% 18.829% #### ( 1, 2 ] 439839 64.937% 83.766% ############# ( 2, 3 ] 66391 9.802% 93.568% ## ( 3, 4 ] 24613 3.634% 97.202% # ( 4, 6 ] 14722 2.174% 99.376% ( 6, 10 ] 3258 0.481% 99.857% ( 10, 15 ] 786 0.116% 99.973% ( 15, 22 ] 85 0.013% 99.985% ( 22, 34 ] 11 0.002% 99.987% ( 34, 51 ] 7 0.001% 99.988% ( 51, 76 ] 11 0.002% 99.990% ( 76, 110 ] 33 0.005% 99.994% ( 110, 170 ] 55 0.008% 100.003% ( 170, 250 ] 36 0.005% 100.008% ( 250, 380 ] 22 0.003% 100.011% ( 380, 580 ] 9 0.001% 100.012% ( 580, 870 ] 16 0.002% 100.015% ( 870, 1300 ] 12 0.002% 100.017% ( 1300, 1900 ] 6 0.001% 100.017% ( 1900, 2900 ] 6 0.001% 100.018% ( 2900, 4400 ] 4 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 207023 Average: 2.3811 StdDev: 9.65 Min: 1 Median: 1.5884 Max: 2367 Percentiles: P50: 1.59 P75: 1.98 P99: 5.83 P99.9: 13.40 P99.99: 287.34 ------------------------------------------------------ [ 0, 1 ] 25587 12.359% 12.359% ## ( 1, 2 ] 132438 63.973% 76.332% ############# ( 2, 3 ] 31218 15.079% 91.412% ### ( 3, 4 ] 9371 4.527% 95.938% # ( 4, 6 ] 6925 3.345% 99.283% # ( 6, 10 ] 1120 0.541% 99.824% ( 10, 15 ] 231 0.112% 99.936% ( 15, 22 ] 29 0.014% 99.950% ( 22, 34 ] 5 0.002% 99.952% ( 34, 51 ] 37 0.018% 99.970% ( 51, 76 ] 21 0.010% 99.980% ( 76, 110 ] 4 0.002% 99.982% ( 110, 170 ] 4 0.002% 99.984% ( 170, 250 ] 10 0.005% 99.989% ( 250, 380 ] 8 0.004% 99.993% ( 380, 580 ] 3 0.001% 99.994% ( 580, 870 ] 5 0.002% 99.997% ( 870, 1300 ] 4 0.002% 99.999% ( 1300, 1900 ] 2 0.001% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28284 Average: 1.9702 StdDev: 6.93 Min: 1 Median: 1.3647 Max: 1106 Percentiles: P50: 1.36 P75: 1.77 P99: 5.03 P99.9: 9.51 P99.99: 176.86 ------------------------------------------------------ [ 0, 1 ] 7815 27.630% 27.630% ###### ( 1, 2 ] 17347 61.331% 88.962% ############ ( 2, 3 ] 1861 6.580% 95.542% # ( 3, 4 ] 773 2.733% 98.275% # ( 4, 6 ] 400 1.414% 99.689% ( 6, 10 ] 68 0.240% 99.929% ( 10, 15 ] 13 0.046% 99.975% ( 15, 22 ] 2 0.007% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 180876 Average: 3.5338 StdDev: 28.43 Min: 1 Median: 1.6572 Max: 2794 Percentiles: P50: 1.66 P75: 2.23 P99: 9.23 P99.9: 242.30 P99.99: 842.87 ------------------------------------------------------ [ 0, 1 ] 16398 9.066% 9.066% ## ( 1, 2 ] 112658 62.285% 71.351% ############ ( 2, 3 ] 29142 16.112% 87.462% ### ( 3, 4 ] 10635 5.880% 93.342% # ( 4, 6 ] 7501 4.147% 97.489% # ( 6, 10 ] 3387 1.873% 99.361% ( 10, 15 ] 407 0.225% 99.586% ( 15, 22 ] 65 0.036% 99.622% ( 22, 34 ] 37 0.020% 99.643% ( 34, 51 ] 20 0.011% 99.654% ( 51, 76 ] 3 0.002% 99.656% ( 76, 110 ] 72 0.040% 99.695% ( 110, 170 ] 268 0.148% 99.844% ( 170, 250 ] 113 0.062% 99.906% ( 250, 380 ] 70 0.039% 99.945% ( 380, 580 ] 52 0.029% 99.973% ( 580, 870 ] 33 0.018% 99.992% ( 870, 1300 ] 20 0.011% 100.003% ( 1300, 1900 ] 7 0.004% 100.007% ( 1900, 2900 ] 11 0.006% 100.013% ** Level 4 read latency histogram (micros): Count: 35 Average: 1673.7429 StdDev: 1232.96 Min: 368 Median: 1257.0000 Max: 4972 Percentiles: P50: 1257.00 P75: 2350.00 P99: 4972.00 P99.9: 4972.00 P99.99: 4972.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 9 25.714% 37.143% ##### ( 870, 1300 ] 5 14.286% 51.429% ### ( 1300, 1900 ] 6 17.143% 68.571% ### ( 1900, 2900 ] 5 14.286% 82.857% ### ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 666.3000 StdDev: 791.83 Min: 116 Median: 210.0000 Max: 2355 Percentiles: P50: 210.00 P75: 580.00 P99: 2355.00 P99.9: 2355.00 P99.99: 2355.00 ------------------------------------------------------ ( 110, 170 ] 9 45.000% 45.000% ######### ( 170, 250 ] 2 10.000% 55.000% ## ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 3 15.000% 75.000% ### ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 9.2 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 321.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.020 H:M:S, 11.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.429 H:M:S, 13.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/09-15:12:29 ... thread 0: (1000000,4000000) ops and (320775.5,331697.8) ops/second in (3.117445,12.059168) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 3.13 GB 132.2 2.5 0.0 2.5 6.2 3.7 0.0 1.7 123.5 311.7 20.40 19.01 63 0.324 2558K 2688 0.0 0.0 L1 2/2 50.38 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 246.2 245.8 3.33 3.24 2 1.663 831K 1421 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 225.7 225.6 0.49 0.46 1 0.494 113K 34 0.0 0.0 L3 34/0 983.03 MB 1.0 1.3 0.6 0.7 1.3 0.6 0.0 2.1 214.7 214.6 6.23 5.50 4 1.557 1335K 662 0.0 0.0 L4 140/0 9.49 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1242/14 99.88 GB 0.0 4.7 1.2 3.5 8.4 4.9 1.2 2.2 157.2 283.3 30.45 28.22 70 0.435 4838K 4805 0.0 0.0 Int 0/0 0.00 KB 0.0 4.7 1.2 3.5 8.4 4.9 1.2 2.2 157.2 283.3 30.45 28.22 70 0.435 4838K 4805 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.7 1.2 3.5 4.7 1.2 0.0 0.0 244.6 244.3 19.57 18.55 16 1.223 4838K 4805 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 353.5 10.87 9.67 54 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.42 GB write, 701.65 MB/s write, 4.68 GB read, 389.45 MB/s read, 30.4 seconds Interval compaction: 8.42 GB write, 715.13 MB/s write, 4.68 GB read, 396.93 MB/s read, 30.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 19, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1124639 Average: 2.2423 StdDev: 11.64 Min: 0 Median: 1.5011 Max: 3395 Percentiles: P50: 1.50 P75: 1.88 P99: 5.71 P99.9: 11.30 P99.99: 17.42 ------------------------------------------------------ [ 0, 1 ] 188646 16.774% 16.774% ### ( 1, 2 ] 745654 66.302% 83.076% ############# ( 2, 3 ] 117793 10.474% 93.549% ## ( 3, 4 ] 40861 3.633% 97.183% # ( 4, 6 ] 23879 2.123% 99.306% ( 6, 10 ] 6342 0.564% 99.870% ( 10, 15 ] 1309 0.116% 99.986% ( 15, 22 ] 123 0.011% 99.997% ( 22, 34 ] 14 0.001% 99.998% ( 34, 51 ] 10 0.001% 99.999% ( 51, 76 ] 13 0.001% 100.000% ( 76, 110 ] 65 0.006% 100.006% ( 110, 170 ] 93 0.008% 100.014% ( 170, 250 ] 58 0.005% 100.020% ( 250, 380 ] 39 0.003% 100.023% ( 380, 580 ] 27 0.002% 100.026% ( 580, 870 ] 20 0.002% 100.027% ( 870, 1300 ] 19 0.002% 100.029% ( 1300, 1900 ] 8 0.001% 100.030% ( 1900, 2900 ] 7 0.001% 100.030% ( 2900, 4400 ] 5 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 207023 Average: 2.3811 StdDev: 9.65 Min: 1 Median: 1.5884 Max: 2367 Percentiles: P50: 1.59 P75: 1.98 P99: 5.83 P99.9: 13.40 P99.99: 287.34 ------------------------------------------------------ [ 0, 1 ] 25587 12.359% 12.359% ## ( 1, 2 ] 132438 63.973% 76.332% ############# ( 2, 3 ] 31218 15.079% 91.412% ### ( 3, 4 ] 9371 4.527% 95.938% # ( 4, 6 ] 6925 3.345% 99.283% # ( 6, 10 ] 1120 0.541% 99.824% ( 10, 15 ] 231 0.112% 99.936% ( 15, 22 ] 29 0.014% 99.950% ( 22, 34 ] 5 0.002% 99.952% ( 34, 51 ] 37 0.018% 99.970% ( 51, 76 ] 21 0.010% 99.980% ( 76, 110 ] 4 0.002% 99.982% ( 110, 170 ] 4 0.002% 99.984% ( 170, 250 ] 10 0.005% 99.989% ( 250, 380 ] 8 0.004% 99.993% ( 380, 580 ] 3 0.001% 99.994% ( 580, 870 ] 5 0.002% 99.997% ( 870, 1300 ] 4 0.002% 99.999% ( 1300, 1900 ] 2 0.001% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28284 Average: 1.9702 StdDev: 6.93 Min: 1 Median: 1.3647 Max: 1106 Percentiles: P50: 1.36 P75: 1.77 P99: 5.03 P99.9: 9.51 P99.99: 176.86 ------------------------------------------------------ [ 0, 1 ] 7815 27.630% 27.630% ###### ( 1, 2 ] 17347 61.331% 88.962% ############ ( 2, 3 ] 1861 6.580% 95.542% # ( 3, 4 ] 773 2.733% 98.275% # ( 4, 6 ] 400 1.414% 99.689% ( 6, 10 ] 68 0.240% 99.929% ( 10, 15 ] 13 0.046% 99.975% ( 15, 22 ] 2 0.007% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 180876 Average: 3.5338 StdDev: 28.43 Min: 1 Median: 1.6572 Max: 2794 Percentiles: P50: 1.66 P75: 2.23 P99: 9.23 P99.9: 242.30 P99.99: 842.87 ------------------------------------------------------ [ 0, 1 ] 16398 9.066% 9.066% ## ( 1, 2 ] 112658 62.285% 71.351% ############ ( 2, 3 ] 29142 16.112% 87.462% ### ( 3, 4 ] 10635 5.880% 93.342% # ( 4, 6 ] 7501 4.147% 97.489% # ( 6, 10 ] 3387 1.873% 99.361% ( 10, 15 ] 407 0.225% 99.586% ( 15, 22 ] 65 0.036% 99.622% ( 22, 34 ] 37 0.020% 99.643% ( 34, 51 ] 20 0.011% 99.654% ( 51, 76 ] 3 0.002% 99.656% ( 76, 110 ] 72 0.040% 99.695% ( 110, 170 ] 268 0.148% 99.844% ( 170, 250 ] 113 0.062% 99.906% ( 250, 380 ] 70 0.039% 99.945% ( 380, 580 ] 52 0.029% 99.973% ( 580, 870 ] 33 0.018% 99.992% ( 870, 1300 ] 20 0.011% 100.003% ( 1300, 1900 ] 7 0.004% 100.007% ( 1900, 2900 ] 11 0.006% 100.013% ** Level 4 read latency histogram (micros): Count: 35 Average: 1673.7429 StdDev: 1232.96 Min: 368 Median: 1257.0000 Max: 4972 Percentiles: P50: 1257.00 P75: 2350.00 P99: 4972.00 P99.9: 4972.00 P99.99: 4972.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 9 25.714% 37.143% ##### ( 870, 1300 ] 5 14.286% 51.429% ### ( 1300, 1900 ] 6 17.143% 68.571% ### ( 1900, 2900 ] 5 14.286% 82.857% ### ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 666.3000 StdDev: 791.83 Min: 116 Median: 210.0000 Max: 2355 Percentiles: P50: 210.00 P75: 580.00 P99: 2355.00 P99.9: 2355.00 P99.99: 2355.00 ------------------------------------------------------ ( 110, 170 ] 9 45.000% 45.000% ######### ( 170, 250 ] 2 10.000% 55.000% ## ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 3 15.000% 75.000% ### ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 12.3 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 320.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.492 H:M:S, 12.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 315.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.473 H:M:S, 15.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/09-15:12:33 ... thread 0: (1000000,5000000) ops and (279930.0,319867.1) ops/second in (3.572322,15.631490) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/14 2.46 GB 6.3 3.3 0.0 3.3 8.0 4.7 0.0 1.7 129.3 311.2 26.31 24.56 80 0.329 3454K 3627 0.0 0.0 L1 15/15 1.63 GB 0.0 2.4 2.1 0.4 2.4 2.1 0.1 1.2 235.2 233.9 10.65 10.29 3 3.550 2544K 14K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 225.7 225.6 0.49 0.46 1 0.494 113K 34 0.0 0.0 L3 34/0 983.03 MB 1.0 1.3 0.6 0.7 1.3 0.6 0.0 2.1 214.7 214.6 6.23 5.50 4 1.557 1335K 662 0.0 0.0 L4 140/0 9.49 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1252/29 100.79 GB 0.0 7.2 2.8 4.4 11.8 7.4 1.2 2.5 168.4 277.6 43.68 40.81 88 0.496 7446K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.2 2.8 4.4 11.8 7.4 1.2 2.5 168.4 277.6 43.68 40.81 88 0.496 7446K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.2 2.8 4.4 7.2 2.7 0.0 0.0 243.9 243.3 30.16 28.80 20 1.508 7446K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 354.2 13.52 12.01 68 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.9 total, 15.6 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.84 GB write, 764.25 MB/s write, 7.18 GB read, 463.67 MB/s read, 43.7 seconds Interval compaction: 11.84 GB write, 775.57 MB/s write, 7.18 GB read, 470.54 MB/s read, 43.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 20, interval: 26 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1482695 Average: 2.2811 StdDev: 12.50 Min: 0 Median: 1.4966 Max: 3395 Percentiles: P50: 1.50 P75: 1.87 P99: 5.73 P99.9: 12.04 P99.99: 106.13 ------------------------------------------------------ [ 0, 1 ] 250701 16.908% 16.908% ### ( 1, 2 ] 987982 66.634% 83.543% ############# ( 2, 3 ] 151962 10.249% 93.792% ## ( 3, 4 ] 51830 3.496% 97.287% # ( 4, 6 ] 29326 1.978% 99.265% ( 6, 10 ] 8729 0.589% 99.854% ( 10, 15 ] 1676 0.113% 99.967% ( 15, 22 ] 160 0.011% 99.978% ( 22, 34 ] 24 0.002% 99.979% ( 34, 51 ] 12 0.001% 99.980% ( 51, 76 ] 19 0.001% 99.982% ( 76, 110 ] 143 0.010% 99.991% ( 110, 170 ] 211 0.014% 100.005% ( 170, 250 ] 119 0.008% 100.013% ( 250, 380 ] 87 0.006% 100.019% ( 380, 580 ] 80 0.005% 100.025% ( 580, 870 ] 43 0.003% 100.028% ( 870, 1300 ] 30 0.002% 100.030% ( 1300, 1900 ] 8 0.001% 100.030% ( 1900, 2900 ] 9 0.001% 100.031% ( 2900, 4400 ] 7 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 241480 Average: 2.5623 StdDev: 14.53 Min: 0 Median: 1.5639 Max: 2367 Percentiles: P50: 1.56 P75: 1.96 P99: 5.93 P99.9: 75.18 P99.99: 721.42 ------------------------------------------------------ [ 0, 1 ] 34039 14.096% 14.096% ### ( 1, 2 ] 153757 63.673% 77.769% ############# ( 2, 3 ] 33706 13.958% 91.727% ### ( 3, 4 ] 10367 4.293% 96.020% # ( 4, 6 ] 7469 3.093% 99.113% # ( 6, 10 ] 1518 0.629% 99.742% ( 10, 15 ] 262 0.108% 99.850% ( 15, 22 ] 35 0.014% 99.865% ( 22, 34 ] 5 0.002% 99.867% ( 34, 51 ] 37 0.015% 99.882% ( 51, 76 ] 45 0.019% 99.901% ( 76, 110 ] 35 0.014% 99.915% ( 110, 170 ] 84 0.035% 99.950% ( 170, 250 ] 35 0.014% 99.964% ( 250, 380 ] 33 0.014% 99.978% ( 380, 580 ] 23 0.010% 99.988% ( 580, 870 ] 12 0.005% 99.993% ( 870, 1300 ] 10 0.004% 99.997% ( 1300, 1900 ] 7 0.003% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28284 Average: 1.9702 StdDev: 6.93 Min: 1 Median: 1.3647 Max: 1106 Percentiles: P50: 1.36 P75: 1.77 P99: 5.03 P99.9: 9.51 P99.99: 176.86 ------------------------------------------------------ [ 0, 1 ] 7815 27.630% 27.630% ###### ( 1, 2 ] 17347 61.331% 88.962% ############ ( 2, 3 ] 1861 6.580% 95.542% # ( 3, 4 ] 773 2.733% 98.275% # ( 4, 6 ] 400 1.414% 99.689% ( 6, 10 ] 68 0.240% 99.929% ( 10, 15 ] 13 0.046% 99.975% ( 15, 22 ] 2 0.007% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 180876 Average: 3.5338 StdDev: 28.43 Min: 1 Median: 1.6572 Max: 2794 Percentiles: P50: 1.66 P75: 2.23 P99: 9.23 P99.9: 242.30 P99.99: 842.87 ------------------------------------------------------ [ 0, 1 ] 16398 9.066% 9.066% ## ( 1, 2 ] 112658 62.285% 71.351% ############ ( 2, 3 ] 29142 16.112% 87.462% ### ( 3, 4 ] 10635 5.880% 93.342% # ( 4, 6 ] 7501 4.147% 97.489% # ( 6, 10 ] 3387 1.873% 99.361% ( 10, 15 ] 407 0.225% 99.586% ( 15, 22 ] 65 0.036% 99.622% ( 22, 34 ] 37 0.020% 99.643% ( 34, 51 ] 20 0.011% 99.654% ( 51, 76 ] 3 0.002% 99.656% ( 76, 110 ] 72 0.040% 99.695% ( 110, 170 ] 268 0.148% 99.844% ( 170, 250 ] 113 0.062% 99.906% ( 250, 380 ] 70 0.039% 99.945% ( 380, 580 ] 52 0.029% 99.973% ( 580, 870 ] 33 0.018% 99.992% ( 870, 1300 ] 20 0.011% 100.003% ( 1300, 1900 ] 7 0.004% 100.007% ( 1900, 2900 ] 11 0.006% 100.013% ** Level 4 read latency histogram (micros): Count: 35 Average: 1673.7429 StdDev: 1232.96 Min: 368 Median: 1257.0000 Max: 4972 Percentiles: P50: 1257.00 P75: 2350.00 P99: 4972.00 P99.9: 4972.00 P99.99: 4972.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 9 25.714% 37.143% ##### ( 870, 1300 ] 5 14.286% 51.429% ### ( 1300, 1900 ] 6 17.143% 68.571% ### ( 1900, 2900 ] 5 14.286% 82.857% ### ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 666.3000 StdDev: 791.83 Min: 116 Median: 210.0000 Max: 2355 Percentiles: P50: 210.00 P75: 580.00 P99: 2355.00 P99.9: 2355.00 P99.99: 2355.00 ------------------------------------------------------ ( 110, 170 ] 9 45.000% 45.000% ######### ( 170, 250 ] 2 10.000% 55.000% ## ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 3 15.000% 75.000% ### ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 15.9 total, 3.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 310.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.470 H:M:S, 15.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 275.51 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.978 H:M:S, 27.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/09-15:12:36 ... thread 0: (1000000,6000000) ops and (329644.3,321456.2) ops/second in (3.033573,18.665063) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 3.38 GB 100.7 4.1 0.0 4.1 9.7 5.6 0.0 1.7 131.8 310.6 32.03 29.94 96 0.334 4285K 4506 0.0 0.0 L1 15/15 1.63 GB 0.0 2.4 2.1 0.4 2.4 2.1 0.1 1.2 235.2 233.9 10.65 10.29 3 3.550 2544K 14K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 225.7 225.6 0.49 0.46 1 0.494 113K 34 0.0 0.0 L3 34/0 983.03 MB 1.0 1.3 0.6 0.7 1.3 0.6 0.0 2.1 214.7 214.6 6.23 5.50 4 1.557 1335K 662 0.0 0.0 L4 140/0 9.49 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/29 101.72 GB 0.0 8.0 2.8 5.2 13.6 8.3 1.2 2.4 165.5 281.1 49.40 46.19 104 0.475 8278K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.0 2.8 5.2 13.6 8.3 1.2 2.4 165.5 281.1 49.40 46.19 104 0.475 8278K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.0 2.8 5.2 8.0 2.7 0.0 0.0 246.2 245.6 33.20 31.78 23 1.443 8278K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 353.9 16.20 14.41 81 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.9 total, 18.7 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.56 GB write, 734.86 MB/s write, 7.98 GB read, 432.58 MB/s read, 49.4 seconds Interval compaction: 13.56 GB write, 743.98 MB/s write, 7.98 GB read, 437.95 MB/s read, 49.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 24, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1797408 Average: 2.2799 StdDev: 12.55 Min: 0 Median: 1.4982 Max: 3395 Percentiles: P50: 1.50 P75: 1.87 P99: 5.73 P99.9: 12.04 P99.99: 104.46 ------------------------------------------------------ [ 0, 1 ] 299986 16.690% 16.690% ### ( 1, 2 ] 1201718 66.858% 83.548% ############# ( 2, 3 ] 185293 10.309% 93.857% ## ( 3, 4 ] 61855 3.441% 97.299% # ( 4, 6 ] 35308 1.964% 99.263% ( 6, 10 ] 10603 0.590% 99.853% ( 10, 15 ] 2080 0.116% 99.969% ( 15, 22 ] 190 0.011% 99.979% ( 22, 34 ] 29 0.002% 99.981% ( 34, 51 ] 14 0.001% 99.982% ( 51, 76 ] 21 0.001% 99.983% ( 76, 110 ] 158 0.009% 99.991% ( 110, 170 ] 252 0.014% 100.006% ( 170, 250 ] 135 0.008% 100.013% ( 250, 380 ] 105 0.006% 100.019% ( 380, 580 ] 94 0.005% 100.024% ( 580, 870 ] 48 0.003% 100.027% ( 870, 1300 ] 37 0.002% 100.029% ( 1300, 1900 ] 9 0.001% 100.029% ( 1900, 2900 ] 13 0.001% 100.030% ( 2900, 4400 ] 8 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 315864 Average: 2.5761 StdDev: 13.98 Min: 0 Median: 1.5590 Max: 2367 Percentiles: P50: 1.56 P75: 1.95 P99: 6.61 P99.9: 109.45 P99.99: 646.00 ------------------------------------------------------ [ 0, 1 ] 43837 13.878% 13.878% ### ( 1, 2 ] 204095 64.615% 78.493% ############# ( 2, 3 ] 42653 13.504% 91.997% ### ( 3, 4 ] 12615 3.994% 95.991% # ( 4, 6 ] 9097 2.880% 98.871% # ( 6, 10 ] 2694 0.853% 99.724% ( 10, 15 ] 374 0.118% 99.842% ( 15, 22 ] 44 0.014% 99.856% ( 22, 34 ] 5 0.002% 99.858% ( 34, 51 ] 37 0.012% 99.869% ( 51, 76 ] 46 0.015% 99.884% ( 76, 110 ] 53 0.017% 99.901% ( 110, 170 ] 137 0.043% 99.944% ( 170, 250 ] 53 0.017% 99.961% ( 250, 380 ] 51 0.016% 99.977% ( 380, 580 ] 39 0.012% 99.989% ( 580, 870 ] 15 0.005% 99.994% ( 870, 1300 ] 12 0.004% 99.998% ( 1300, 1900 ] 7 0.002% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28284 Average: 1.9702 StdDev: 6.93 Min: 1 Median: 1.3647 Max: 1106 Percentiles: P50: 1.36 P75: 1.77 P99: 5.03 P99.9: 9.51 P99.99: 176.86 ------------------------------------------------------ [ 0, 1 ] 7815 27.630% 27.630% ###### ( 1, 2 ] 17347 61.331% 88.962% ############ ( 2, 3 ] 1861 6.580% 95.542% # ( 3, 4 ] 773 2.733% 98.275% # ( 4, 6 ] 400 1.414% 99.689% ( 6, 10 ] 68 0.240% 99.929% ( 10, 15 ] 13 0.046% 99.975% ( 15, 22 ] 2 0.007% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 180876 Average: 3.5338 StdDev: 28.43 Min: 1 Median: 1.6572 Max: 2794 Percentiles: P50: 1.66 P75: 2.23 P99: 9.23 P99.9: 242.30 P99.99: 842.87 ------------------------------------------------------ [ 0, 1 ] 16398 9.066% 9.066% ## ( 1, 2 ] 112658 62.285% 71.351% ############ ( 2, 3 ] 29142 16.112% 87.462% ### ( 3, 4 ] 10635 5.880% 93.342% # ( 4, 6 ] 7501 4.147% 97.489% # ( 6, 10 ] 3387 1.873% 99.361% ( 10, 15 ] 407 0.225% 99.586% ( 15, 22 ] 65 0.036% 99.622% ( 22, 34 ] 37 0.020% 99.643% ( 34, 51 ] 20 0.011% 99.654% ( 51, 76 ] 3 0.002% 99.656% ( 76, 110 ] 72 0.040% 99.695% ( 110, 170 ] 268 0.148% 99.844% ( 170, 250 ] 113 0.062% 99.906% ( 250, 380 ] 70 0.039% 99.945% ( 380, 580 ] 52 0.029% 99.973% ( 580, 870 ] 33 0.018% 99.992% ( 870, 1300 ] 20 0.011% 100.003% ( 1300, 1900 ] 7 0.004% 100.007% ( 1900, 2900 ] 11 0.006% 100.013% ** Level 4 read latency histogram (micros): Count: 35 Average: 1673.7429 StdDev: 1232.96 Min: 368 Median: 1257.0000 Max: 4972 Percentiles: P50: 1257.00 P75: 2350.00 P99: 4972.00 P99.9: 4972.00 P99.99: 4972.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 9 25.714% 37.143% ##### ( 870, 1300 ] 5 14.286% 51.429% ### ( 1300, 1900 ] 6 17.143% 68.571% ### ( 1900, 2900 ] 5 14.286% 82.857% ### ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 666.3000 StdDev: 791.83 Min: 116 Median: 210.0000 Max: 2355 Percentiles: P50: 210.00 P75: 580.00 P99: 2355.00 P99.9: 2355.00 P99.99: 2355.00 ------------------------------------------------------ ( 110, 170 ] 9 45.000% 45.000% ######### ( 170, 250 ] 2 10.000% 55.000% ## ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 3 15.000% 75.000% ### ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 18.9 total, 3.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 312.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.898 H:M:S, 15.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.43 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.428 H:M:S, 14.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/09-15:12:49 ... thread 0: (1000000,7000000) ops and (74019.8,217560.5) ops/second in (13.509892,32.174955) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/6 2.33 GB 0.0 6.6 0.0 6.6 13.3 6.7 0.0 2.0 151.3 303.6 44.98 42.18 119 0.378 6907K 12K 0.0 0.0 L1 29/29 2.22 GB 0.0 6.2 4.2 2.0 6.2 4.2 0.1 1.5 228.0 225.4 27.99 26.67 4 6.998 6480K 73K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 2.1 1.8 225.7 225.6 0.49 0.46 1 0.494 113K 34 0.0 0.0 L3 23/9 1.69 GB 0.9 1.3 0.6 0.7 1.3 0.6 1.5 2.1 214.7 214.6 6.23 5.50 4 1.557 1335K 662 0.0 0.0 L4 163/23 10.27 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/67 102.76 GB 0.0 14.3 4.9 9.4 20.9 11.5 5.0 3.1 183.6 268.7 79.69 74.81 128 0.623 14M 86K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.3 4.9 9.4 20.9 11.5 5.0 3.1 183.6 268.7 79.69 74.81 128 0.623 14M 86K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.3 4.9 9.4 14.2 4.8 0.0 0.0 242.9 241.4 60.25 57.53 30 2.008 14M 86K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.7 6.7 0.0 0.0 0.0 353.3 19.44 17.28 98 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 32.4 total, 32.2 interval Flush(GB): cumulative 6.706, interval 6.706 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.91 GB write, 660.72 MB/s write, 14.29 GB read, 451.52 MB/s read, 79.7 seconds Interval compaction: 20.91 GB write, 665.48 MB/s write, 14.29 GB read, 454.78 MB/s read, 79.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 25, total-stops: 25, interval: 50 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2860164 Average: 2.4081 StdDev: 13.61 Min: 0 Median: 1.4812 Max: 3729 Percentiles: P50: 1.48 P75: 1.86 P99: 5.89 P99.9: 96.12 P99.99: 209.63 ------------------------------------------------------ [ 0, 1 ] 511214 17.874% 17.874% #### ( 1, 2 ] 1909563 66.764% 84.638% ############# ( 2, 3 ] 270728 9.465% 94.103% ## ( 3, 4 ] 90712 3.172% 97.275% # ( 4, 6 ] 52101 1.822% 99.096% ( 6, 10 ] 18205 0.637% 99.733% ( 10, 15 ] 3334 0.117% 99.849% ( 15, 22 ] 533 0.019% 99.868% ( 22, 34 ] 42 0.001% 99.870% ( 34, 51 ] 21 0.001% 99.870% ( 51, 76 ] 40 0.001% 99.872% ( 76, 110 ] 1370 0.048% 99.920% ( 110, 170 ] 1798 0.063% 99.982% ( 170, 250 ] 438 0.015% 99.998% ( 250, 380 ] 322 0.011% 100.009% ( 380, 580 ] 253 0.009% 100.018% ( 580, 870 ] 111 0.004% 100.022% ( 870, 1300 ] 51 0.002% 100.023% ( 1300, 1900 ] 14 0.000% 100.024% ( 1900, 2900 ] 19 0.001% 100.025% ( 2900, 4400 ] 13 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 645140 Average: 2.6392 StdDev: 16.07 Min: 0 Median: 1.4962 Max: 3899 Percentiles: P50: 1.50 P75: 1.88 P99: 7.35 P99.9: 150.29 P99.99: 724.91 ------------------------------------------------------ [ 0, 1 ] 116441 18.049% 18.049% #### ( 1, 2 ] 415416 64.392% 82.441% ############# ( 2, 3 ] 68834 10.670% 93.110% ## ( 3, 4 ] 20622 3.197% 96.307% # ( 4, 6 ] 15336 2.377% 98.684% ( 6, 10 ] 6052 0.938% 99.622% ( 10, 15 ] 733 0.114% 99.736% ( 15, 22 ] 149 0.023% 99.759% ( 22, 34 ] 8 0.001% 99.760% ( 34, 51 ] 39 0.006% 99.766% ( 51, 76 ] 139 0.022% 99.787% ( 76, 110 ] 417 0.065% 99.852% ( 110, 170 ] 460 0.071% 99.923% ( 170, 250 ] 158 0.024% 99.948% ( 250, 380 ] 138 0.021% 99.969% ( 380, 580 ] 112 0.017% 99.987% ( 580, 870 ] 43 0.007% 99.993% ( 870, 1300 ] 25 0.004% 99.997% ( 1300, 1900 ] 15 0.002% 100.000% ( 1900, 2900 ] 2 0.000% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28284 Average: 1.9702 StdDev: 6.93 Min: 1 Median: 1.3647 Max: 1106 Percentiles: P50: 1.36 P75: 1.77 P99: 5.03 P99.9: 9.51 P99.99: 176.86 ------------------------------------------------------ [ 0, 1 ] 7815 27.630% 27.630% ###### ( 1, 2 ] 17347 61.331% 88.962% ############ ( 2, 3 ] 1861 6.580% 95.542% # ( 3, 4 ] 773 2.733% 98.275% # ( 4, 6 ] 400 1.414% 99.689% ( 6, 10 ] 68 0.240% 99.929% ( 10, 15 ] 13 0.046% 99.975% ( 15, 22 ] 2 0.007% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 181649 Average: 4.0064 StdDev: 32.87 Min: 1 Median: 1.6595 Max: 2794 Percentiles: P50: 1.66 P75: 2.24 P99: 9.52 P99.9: 374.75 P99.99: 905.87 ------------------------------------------------------ [ 0, 1 ] 16406 9.032% 9.032% ## ( 1, 2 ] 112834 62.116% 71.148% ############ ( 2, 3 ] 29291 16.125% 87.273% ### ( 3, 4 ] 10736 5.910% 93.184% # ( 4, 6 ] 7567 4.166% 97.349% # ( 6, 10 ] 3406 1.875% 99.224% ( 10, 15 ] 411 0.226% 99.451% ( 15, 22 ] 69 0.038% 99.489% ( 22, 34 ] 37 0.020% 99.509% ( 34, 51 ] 20 0.011% 99.520% ( 51, 76 ] 3 0.002% 99.522% ( 76, 110 ] 77 0.042% 99.564% ( 110, 170 ] 307 0.169% 99.733% ( 170, 250 ] 169 0.093% 99.826% ( 250, 380 ] 140 0.077% 99.903% ( 380, 580 ] 100 0.055% 99.958% ( 580, 870 ] 56 0.031% 99.989% ( 870, 1300 ] 22 0.012% 100.001% ( 1300, 1900 ] 8 0.004% 100.006% ( 1900, 2900 ] 14 0.008% 100.013% ** Level 4 read latency histogram (micros): Count: 35 Average: 1673.7429 StdDev: 1232.96 Min: 368 Median: 1257.0000 Max: 4972 Percentiles: P50: 1257.00 P75: 2350.00 P99: 4972.00 P99.9: 4972.00 P99.99: 4972.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 9 25.714% 37.143% ##### ( 870, 1300 ] 5 14.286% 51.429% ### ( 1300, 1900 ] 6 17.143% 68.571% ### ( 1900, 2900 ] 5 14.286% 82.857% ### ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** Level 5 read latency histogram (micros): Count: 23 Average: 633.9565 StdDev: 746.01 Min: 116 Median: 236.6667 Max: 2355 Percentiles: P50: 236.67 P75: 652.50 P99: 2355.00 P99.9: 2355.00 P99.99: 2355.00 ------------------------------------------------------ ( 110, 170 ] 9 39.130% 39.130% ######## ( 170, 250 ] 3 13.043% 52.174% ### ( 250, 380 ] 1 4.348% 56.522% # ( 380, 580 ] 4 17.391% 73.913% ### ( 580, 870 ] 1 4.348% 78.261% # ( 1300, 1900 ] 2 8.696% 86.957% ## ( 1900, 2900 ] 3 13.043% 100.000% ### ** DB Stats ** Uptime(secs): 32.4 total, 13.5 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 212.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:13.672 H:M:S, 42.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 72.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:10.774 H:M:S, 79.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 0 2024/08/09-15:12:53 ... thread 0: (1000000,8000000) ops and (305612.4,225688.6) ops/second in (3.272119,35.447074) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 3.19 GB 56.6 7.2 0.0 7.2 14.8 7.6 0.0 1.9 147.7 302.7 49.91 46.52 133 0.375 7482K 13K 0.0 0.0 L1 29/29 2.22 GB 0.0 6.2 4.2 2.0 6.2 4.2 0.1 1.5 228.0 225.4 27.99 26.67 4 6.998 6480K 73K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 2.1 1.8 225.7 225.6 0.49 0.46 1 0.494 113K 34 0.0 0.0 L3 14/0 929.91 MB 0.9 1.3 0.6 0.7 1.3 0.6 1.5 2.1 214.7 214.6 6.23 5.50 4 1.557 1335K 662 0.0 0.0 L4 168/0 9.76 GB 1.0 0.9 0.8 0.1 0.9 0.8 1.0 1.2 142.5 141.9 6.64 4.44 6 1.107 932K 4182 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1287/39 103.61 GB 0.0 15.8 5.7 10.1 23.2 13.2 6.3 3.1 176.9 260.8 91.26 83.60 148 0.617 16M 91K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.8 5.7 10.1 23.2 13.2 6.3 3.1 176.9 260.8 91.26 83.60 148 0.617 16M 91K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.8 5.7 10.1 15.7 5.6 0.0 0.0 233.9 232.6 69.02 64.06 38 1.816 16M 91K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 348.4 22.24 19.54 110 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.7 total, 35.4 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.25 GB write, 667.14 MB/s write, 15.77 GB read, 452.55 MB/s read, 91.3 seconds Interval compaction: 23.25 GB write, 671.50 MB/s write, 15.77 GB read, 455.50 MB/s read, 91.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 35, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 25, total-stops: 35, interval: 60 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3186169 Average: 2.4553 StdDev: 15.96 Min: 0 Median: 1.4923 Max: 4710 Percentiles: P50: 1.49 P75: 1.87 P99: 5.95 P99.9: 91.24 P99.99: 218.71 ------------------------------------------------------ [ 0, 1 ] 548559 17.217% 17.217% ### ( 1, 2 ] 2121669 66.590% 83.807% ############# ( 2, 3 ] 318001 9.981% 93.788% ## ( 3, 4 ] 104666 3.285% 97.073% # ( 4, 6 ] 63057 1.979% 99.052% ( 6, 10 ] 21852 0.686% 99.737% ( 10, 15 ] 3874 0.122% 99.859% ( 15, 22 ] 583 0.018% 99.877% ( 22, 34 ] 43 0.001% 99.879% ( 34, 51 ] 21 0.001% 99.879% ( 51, 76 ] 42 0.001% 99.881% ( 76, 110 ] 1378 0.043% 99.924% ( 110, 170 ] 1820 0.057% 99.981% ( 170, 250 ] 472 0.015% 99.996% ( 250, 380 ] 363 0.011% 100.007% ( 380, 580 ] 303 0.010% 100.017% ( 580, 870 ] 154 0.005% 100.022% ( 870, 1300 ] 80 0.003% 100.024% ( 1300, 1900 ] 23 0.001% 100.025% ( 1900, 2900 ] 32 0.001% 100.026% ( 2900, 4400 ] 20 0.001% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 807814 Average: 3.3380 StdDev: 39.53 Min: 0 Median: 1.5697 Max: 7839 Percentiles: P50: 1.57 P75: 1.97 P99: 8.06 P99.9: 139.40 P99.99: 469.67 ------------------------------------------------------ [ 0, 1 ] 119270 14.765% 14.765% ### ( 1, 2 ] 499588 61.844% 76.609% ############ ( 2, 3 ] 108297 13.406% 90.015% ### ( 3, 4 ] 36891 4.567% 94.582% # ( 4, 6 ] 30656 3.795% 98.377% # ( 6, 10 ] 9764 1.209% 99.586% ( 10, 15 ] 1418 0.176% 99.761% ( 15, 22 ] 244 0.030% 99.791% ( 22, 34 ] 21 0.003% 99.794% ( 34, 51 ] 52 0.006% 99.800% ( 51, 76 ] 142 0.018% 99.818% ( 76, 110 ] 427 0.053% 99.871% ( 110, 170 ] 482 0.060% 99.930% ( 170, 250 ] 188 0.023% 99.954% ( 250, 380 ] 204 0.025% 99.979% ( 380, 580 ] 199 0.025% 100.004% ( 580, 870 ] 114 0.014% 100.018% ( 870, 1300 ] 79 0.010% 100.027% ( 1300, 1900 ] 56 0.007% 100.034% ( 1900, 2900 ] 64 0.008% 100.042% ( 2900, 4400 ] 33 0.004% 100.046% ( 4400, 6600 ] 1 0.000% 100.047% ( 6600, 9900 ] 1 0.000% 100.047% ** Level 2 read latency histogram (micros): Count: 28284 Average: 1.9702 StdDev: 6.93 Min: 1 Median: 1.3647 Max: 1106 Percentiles: P50: 1.36 P75: 1.77 P99: 5.03 P99.9: 9.51 P99.99: 176.86 ------------------------------------------------------ [ 0, 1 ] 7815 27.630% 27.630% ###### ( 1, 2 ] 17347 61.331% 88.962% ############ ( 2, 3 ] 1861 6.580% 95.542% # ( 3, 4 ] 773 2.733% 98.275% # ( 4, 6 ] 400 1.414% 99.689% ( 6, 10 ] 68 0.240% 99.929% ( 10, 15 ] 13 0.046% 99.975% ( 15, 22 ] 2 0.007% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 257718 Average: 7.2319 StdDev: 84.01 Min: 1 Median: 1.7180 Max: 5078 Percentiles: P50: 1.72 P75: 2.46 P99: 11.52 P99.9: 916.16 P99.99: 2174.42 ------------------------------------------------------ [ 0, 1 ] 19196 7.448% 7.448% # ( 1, 2 ] 152740 59.266% 66.715% ############ ( 2, 3 ] 46317 17.972% 84.687% #### ( 3, 4 ] 18328 7.112% 91.798% # ( 4, 6 ] 12953 5.026% 96.824% # ( 6, 10 ] 5374 2.085% 98.910% ( 10, 15 ] 764 0.296% 99.206% ( 15, 22 ] 116 0.045% 99.251% ( 22, 34 ] 44 0.017% 99.268% ( 34, 51 ] 22 0.009% 99.277% ( 51, 76 ] 5 0.002% 99.279% ( 76, 110 ] 88 0.034% 99.313% ( 110, 170 ] 362 0.140% 99.453% ( 170, 250 ] 268 0.104% 99.557% ( 250, 380 ] 288 0.112% 99.669% ( 380, 580 ] 302 0.117% 99.786% ( 580, 870 ] 276 0.107% 99.893% ( 870, 1300 ] 161 0.062% 99.956% ( 1300, 1900 ] 66 0.026% 99.981% ( 1900, 2900 ] 81 0.031% 100.013% ( 2900, 4400 ] 48 0.019% 100.031% ( 4400, 6600 ] 7 0.003% 100.034% ** Level 4 read latency histogram (micros): Count: 215 Average: 355.0326 StdDev: 823.41 Min: 0 Median: 2.7308 Max: 4972 Percentiles: P50: 2.73 P75: 214.62 P99: 4355.00 P99.9: 4972.00 P99.99: 4972.00 ------------------------------------------------------ [ 0, 1 ] 49 22.791% 22.791% ##### ( 1, 2 ] 49 22.791% 45.581% ##### ( 2, 3 ] 13 6.047% 51.628% # ( 3, 4 ] 7 3.256% 54.884% # ( 4, 6 ] 6 2.791% 57.674% # ( 6, 10 ] 6 2.791% 60.465% # ( 10, 15 ] 2 0.930% 61.395% ( 15, 22 ] 3 1.395% 62.791% ( 22, 34 ] 8 3.721% 66.512% # ( 34, 51 ] 5 2.326% 68.837% ( 76, 110 ] 1 0.465% 69.302% ( 110, 170 ] 5 2.326% 71.628% ( 170, 250 ] 13 6.047% 77.674% # ( 250, 380 ] 3 1.395% 79.070% ( 380, 580 ] 5 2.326% 81.395% ( 580, 870 ] 13 6.047% 87.442% # ( 870, 1300 ] 6 2.791% 90.233% # ( 1300, 1900 ] 9 4.186% 94.419% # ( 1900, 2900 ] 5 2.326% 96.744% ( 2900, 4400 ] 5 2.326% 99.070% ( 4400, 6600 ] 2 0.930% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 923.2700 StdDev: 1116.36 Min: 91 Median: 380.0000 Max: 4993 Percentiles: P50: 380.00 P75: 1400.00 P99: 4993.00 P99.9: 4993.00 P99.99: 4993.00 ------------------------------------------------------ ( 76, 110 ] 4 4.000% 4.000% # ( 110, 170 ] 19 19.000% 23.000% #### ( 170, 250 ] 16 16.000% 39.000% ### ( 250, 380 ] 11 11.000% 50.000% ## ( 380, 580 ] 12 12.000% 62.000% ## ( 580, 870 ] 10 10.000% 72.000% ## ( 870, 1300 ] 2 2.000% 74.000% ( 1300, 1900 ] 6 6.000% 80.000% # ( 1900, 2900 ] 11 11.000% 91.000% ## ( 2900, 4400 ] 7 7.000% 98.000% # ( 4400, 6600 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 35.7 total, 3.3 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 220.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.246 H:M:S, 39.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 300.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.574 H:M:S, 17.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/09-15:13:15 ... thread 0: (1000000,9000000) ops and (45385.8,156575.2) ops/second in (22.033301,57.480375) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/6 1.77 GB 0.0 9.5 0.0 9.5 17.9 8.5 0.0 2.1 152.8 289.3 63.49 57.63 150 0.423 9847K 22K 0.0 0.0 L1 9/9 1.01 GB 0.0 10.8 6.6 4.2 10.6 6.4 0.1 1.6 224.3 221.3 49.21 46.13 5 9.842 9414K 73K 0.0 0.0 L2 2/0 159.90 MB 1.6 0.1 0.1 0.0 0.1 0.1 5.5 1.8 225.7 225.6 0.49 0.46 1 0.494 113K 34 0.0 0.0 L3 26/8 1.95 GB 1.1 2.3 1.0 1.3 2.3 1.0 4.4 2.3 175.7 174.5 13.58 10.39 9 1.509 2401K 16K 0.0 0.0 L4 189/21 11.99 GB 1.2 3.6 3.0 0.5 3.5 3.0 1.0 1.2 131.2 130.6 27.76 16.93 27 1.028 3670K 18K 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1296/44 104.42 GB 0.0 26.2 10.7 15.6 34.5 19.0 12.7 4.1 173.9 228.8 154.53 131.54 192 0.805 25M 131K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.2 10.7 15.6 34.5 19.0 12.7 4.1 173.9 228.8 154.53 131.54 192 0.805 25M 131K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.2 10.7 15.6 26.0 10.5 0.0 0.0 209.6 208.0 128.23 109.49 69 1.858 25M 131K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 330.6 26.30 22.05 123 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.7 total, 57.5 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.54 GB write, 612.76 MB/s write, 26.25 GB read, 465.71 MB/s read, 154.5 seconds Interval compaction: 34.54 GB write, 615.23 MB/s write, 26.25 GB read, 467.59 MB/s read, 154.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 49, pending-compaction-bytes-delays: 26, pending-compaction-bytes-stops: 0, total-delays: 43, total-stops: 49, interval: 92 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4336014 Average: 2.9993 StdDev: 33.62 Min: 0 Median: 1.5010 Max: 10537 Percentiles: P50: 1.50 P75: 1.88 P99: 7.43 P99.9: 154.40 P99.99: 420.91 ------------------------------------------------------ [ 0, 1 ] 743877 17.156% 17.156% ### ( 1, 2 ] 2842407 65.553% 82.709% ############# ( 2, 3 ] 444726 10.257% 92.966% ## ( 3, 4 ] 147967 3.413% 96.378% # ( 4, 6 ] 101199 2.334% 98.712% ( 6, 10 ] 34809 0.803% 99.515% ( 10, 15 ] 5766 0.133% 99.648% ( 15, 22 ] 894 0.021% 99.669% ( 22, 34 ] 77 0.002% 99.670% ( 34, 51 ] 36 0.001% 99.671% ( 51, 76 ] 83 0.002% 99.673% ( 76, 110 ] 5481 0.126% 99.800% ( 110, 170 ] 5887 0.136% 99.935% ( 170, 250 ] 1302 0.030% 99.965% ( 250, 380 ] 917 0.021% 99.986% ( 380, 580 ] 745 0.017% 100.004% ( 580, 870 ] 376 0.009% 100.012% ( 870, 1300 ] 163 0.004% 100.016% ( 1300, 1900 ] 77 0.002% 100.018% ( 1900, 2900 ] 122 0.003% 100.021% ( 2900, 4400 ] 123 0.003% 100.024% ( 4400, 6600 ] 32 0.001% 100.024% ( 6600, 9900 ] 10 0.000% 100.024% ( 9900, 14000 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 2066411 Average: 5.2559 StdDev: 86.30 Min: 0 Median: 1.6409 Max: 13433 Percentiles: P50: 1.64 P75: 2.32 P99: 9.01 P99.9: 145.10 P99.99: 394.35 ------------------------------------------------------ [ 0, 1 ] 291808 14.121% 14.121% ### ( 1, 2 ] 1156764 55.979% 70.101% ########### ( 2, 3 ] 312825 15.139% 85.239% ### ( 3, 4 ] 134531 6.510% 91.750% # ( 4, 6 ] 125180 6.058% 97.808% # ( 6, 10 ] 32730 1.584% 99.392% ( 10, 15 ] 6146 0.297% 99.689% ( 15, 22 ] 871 0.042% 99.731% ( 22, 34 ] 66 0.003% 99.734% ( 34, 51 ] 64 0.003% 99.737% ( 51, 76 ] 385 0.019% 99.756% ( 76, 110 ] 1933 0.094% 99.850% ( 110, 170 ] 1782 0.086% 99.936% ( 170, 250 ] 518 0.025% 99.961% ( 250, 380 ] 555 0.027% 99.988% ( 380, 580 ] 660 0.032% 100.020% ( 580, 870 ] 587 0.028% 100.048% ( 870, 1300 ] 449 0.022% 100.070% ( 1300, 1900 ] 276 0.013% 100.083% ( 1900, 2900 ] 388 0.019% 100.102% ( 2900, 4400 ] 454 0.022% 100.124% ( 4400, 6600 ] 108 0.005% 100.129% ( 6600, 9900 ] 41 0.002% 100.131% ( 9900, 14000 ] 2 0.000% 100.131% ** Level 2 read latency histogram (micros): Count: 28284 Average: 1.9702 StdDev: 6.93 Min: 1 Median: 1.3647 Max: 1106 Percentiles: P50: 1.36 P75: 1.77 P99: 5.03 P99.9: 9.51 P99.99: 176.86 ------------------------------------------------------ [ 0, 1 ] 7815 27.630% 27.630% ###### ( 1, 2 ] 17347 61.331% 88.962% ############ ( 2, 3 ] 1861 6.580% 95.542% # ( 3, 4 ] 773 2.733% 98.275% # ( 4, 6 ] 400 1.414% 99.689% ( 6, 10 ] 68 0.240% 99.929% ( 10, 15 ] 13 0.046% 99.975% ( 15, 22 ] 2 0.007% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 569931 Average: 8.5644 StdDev: 112.93 Min: 1 Median: 1.8457 Max: 17124 Percentiles: P50: 1.85 P75: 2.78 P99: 9.76 P99.9: 849.89 P99.99: 1322.66 ------------------------------------------------------ [ 0, 1 ] 23657 4.151% 4.151% # ( 1, 2 ] 308974 54.213% 58.363% ########### ( 2, 3 ] 121274 21.279% 79.642% #### ( 3, 4 ] 55559 9.748% 89.390% ## ( 4, 6 ] 45148 7.922% 97.312% ## ( 6, 10 ] 10227 1.794% 99.107% ( 10, 15 ] 1813 0.318% 99.425% ( 15, 22 ] 206 0.036% 99.461% ( 22, 34 ] 50 0.009% 99.470% ( 34, 51 ] 27 0.005% 99.474% ( 51, 76 ] 5 0.001% 99.475% ( 76, 110 ] 93 0.016% 99.492% ( 110, 170 ] 389 0.068% 99.560% ( 170, 250 ] 327 0.057% 99.617% ( 250, 380 ] 463 0.081% 99.698% ( 380, 580 ] 573 0.101% 99.799% ( 580, 870 ] 619 0.109% 99.908% ( 870, 1300 ] 462 0.081% 99.989% ( 1300, 1900 ] 212 0.037% 100.026% ( 1900, 2900 ] 219 0.038% 100.064% ( 2900, 4400 ] 193 0.034% 100.098% ( 4400, 6600 ] 45 0.008% 100.106% ( 6600, 9900 ] 8 0.001% 100.107% ( 9900, 14000 ] 2 0.000% 100.108% ( 14000, 22000 ] 1 0.000% 100.108% ** Level 4 read latency histogram (micros): Count: 104538 Average: 26.1572 StdDev: 240.22 Min: 0 Median: 2.0572 Max: 8972 Percentiles: P50: 2.06 P75: 3.13 P99: 686.43 P99.9: 3331.05 P99.99: 4062.28 ------------------------------------------------------ [ 0, 1 ] 1525 1.459% 1.459% ( 1, 2 ] 49256 47.118% 48.577% ######### ( 2, 3 ] 26023 24.893% 73.470% ##### ( 3, 4 ] 12666 12.116% 85.586% ## ( 4, 6 ] 10338 9.889% 95.475% ## ( 6, 10 ] 2273 2.174% 97.650% ( 10, 15 ] 619 0.592% 98.242% ( 15, 22 ] 97 0.093% 98.335% ( 22, 34 ] 15 0.014% 98.349% ( 34, 51 ] 14 0.013% 98.362% ( 51, 76 ] 3 0.003% 98.365% ( 76, 110 ] 9 0.009% 98.374% ( 110, 170 ] 42 0.040% 98.414% ( 170, 250 ] 103 0.099% 98.513% ( 250, 380 ] 116 0.111% 98.623% ( 380, 580 ] 256 0.245% 98.868% ( 580, 870 ] 375 0.359% 99.227% ( 870, 1300 ] 297 0.284% 99.511% ( 1300, 1900 ] 174 0.166% 99.678% ( 1900, 2900 ] 177 0.169% 99.847% ( 2900, 4400 ] 193 0.185% 100.032% ( 4400, 6600 ] 46 0.044% 100.076% ( 6600, 9900 ] 6 0.006% 100.081% ** Level 5 read latency histogram (micros): Count: 100 Average: 923.2700 StdDev: 1116.36 Min: 91 Median: 380.0000 Max: 4993 Percentiles: P50: 380.00 P75: 1400.00 P99: 4993.00 P99.9: 4993.00 P99.99: 4993.00 ------------------------------------------------------ ( 76, 110 ] 4 4.000% 4.000% # ( 110, 170 ] 19 19.000% 23.000% #### ( 170, 250 ] 16 16.000% 39.000% ### ( 250, 380 ] 11 11.000% 50.000% ## ( 380, 580 ] 12 12.000% 62.000% ## ( 580, 870 ] 10 10.000% 72.000% ## ( 870, 1300 ] 2 2.000% 74.000% ( 1300, 1900 ] 6 6.000% 80.000% # ( 1900, 2900 ] 11 11.000% 91.000% ## ( 2900, 4400 ] 7 7.000% 98.000% # ( 4400, 6600 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 57.7 total, 22.0 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 153.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:32.634 H:M:S, 56.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 44.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:18.388 H:M:S, 83.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.260 micros/op 159746 ops/sec 60.001 seconds 9584999 operations; 154.8 MB/s Microseconds per write: Count: 9584999 Average: 6.2599 StdDev: 409.69 Min: 0 Median: 1.7380 Max: 657625 Percentiles: P50: 1.74 P75: 2.76 P99: 9.39 P99.9: 1184.13 P99.99: 2725.50 ------------------------------------------------------ [ 0, 1 ] 1299077 13.553% 13.553% ### ( 1, 2 ] 4733598 49.385% 62.939% ########## ( 2, 3 ] 1517339 15.830% 78.769% ### ( 3, 4 ] 1323376 13.807% 92.576% ### ( 4, 6 ] 522389 5.450% 98.026% # ( 6, 10 ] 110295 1.151% 99.177% ( 10, 15 ] 35589 0.371% 99.548% ( 15, 22 ] 8944 0.093% 99.641% ( 22, 34 ] 2014 0.021% 99.662% ( 34, 51 ] 221 0.002% 99.665% ( 51, 76 ] 32 0.000% 99.665% ( 76, 110 ] 6465 0.067% 99.732% ( 110, 170 ] 2806 0.029% 99.762% ( 170, 250 ] 301 0.003% 99.765% ( 250, 380 ] 152 0.002% 99.766% ( 380, 580 ] 23 0.000% 99.767% ( 580, 870 ] 21 0.000% 99.767% ( 870, 1300 ] 17483 0.182% 99.949% ( 1300, 1900 ] 53 0.001% 99.950% ( 1900, 2900 ] 4679 0.049% 99.999% ( 2900, 4400 ] 92 0.001% 99.999% ( 4400, 6600 ] 17 0.000% 100.000% ( 6600, 9900 ] 6 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 11 0.000% 100.000% ( 250000, 380000 ] 3 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 216175 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9584999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9891718968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 569 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33521432 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31725875504 rocksdb.compact.write.bytes COUNT : 31502928191 rocksdb.flush.write.bytes COUNT : 9710485736 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 75 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 250 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9632154624 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3702784 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31826228920 rocksdb.non.last.level.read.count COUNT : 7686475 rocksdb.block.checksum.compute.count COUNT : 7685412 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.382132 P95 : 3.923148 P99 : 7.961170 P100 : 657624.000000 COUNT : 9584999 SUM : 55507897 rocksdb.compaction.times.micros P50 : 1135675.675676 P95 : 5400000.000000 P99 : 18800000.000000 P100 : 21221419.000000 COUNT : 80 SUM : 144584332 rocksdb.compaction.times.cpu_micros P50 : 926111.111111 P95 : 5400000.000000 P99 : 18800000.000000 P100 : 19461068.000000 COUNT : 80 SUM : 119526259 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 686.842105 P95 : 1450.000000 P99 : 13385.000000 P100 : 26725.000000 COUNT : 130 SUM : 141832 rocksdb.compaction.outfile.sync.micros P50 : 1018.545455 P95 : 50500.000000 P99 : 124880.000000 P100 : 143783.000000 COUNT : 376 SUM : 3247736 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 108.559322 P95 : 1743.333333 P99 : 3659.000000 P100 : 3885.000000 COUNT : 247 SUM : 86180 rocksdb.table.open.io.micros P50 : 1571.875000 P95 : 9021.964286 P99 : 13592.411765 P100 : 20721.000000 COUNT : 569 SUM : 1351613 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.620824 P95 : 7.620683 P99 : 11.769487 P100 : 17129.000000 COUNT : 7684110 SUM : 51815993 rocksdb.read.block.get.micros P50 : 488.771930 P95 : 3628.906250 P99 : 5722.095238 P100 : 7856.000000 COUNT : 1138 SUM : 1073123 rocksdb.write.raw.block.micros P50 : 0.513258 P95 : 0.975190 P99 : 2.878311 P100 : 23595.000000 COUNT : 9995702 SUM : 20387172 rocksdb.numfiles.in.singlecompaction P50 : 3.320225 P95 : 5.966667 P99 : 29.080000 P100 : 35.000000 COUNT : 141 SUM : 578 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559499 P95 : 1159.475469 P99 : 2472.093723 P100 : 657434.000000 COUNT : 210262 SUM : 33540006 rocksdb.sst.read.micros P50 : 1.589401 P95 : 4.559920 P99 : 8.886591 P100 : 17124.000000 COUNT : 7687149 SUM : 36552256 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9584999 SUM : 9891718968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211860.465116 P95 : 376388.888889 P99 : 734333.333333 P100 : 818084.000000 COUNT : 130 SUM : 28600403 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 358 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0