[2024-10-14 06:11:54.420517] Starting SPDK v25.01-pre git sha1 bbce7a874 / DPDK 23.11.0 initialization... [2024-10-14 06:11:54.420632] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2306906 ] Set seed to 1728879114418125 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-10-14 06:11:54.518755] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-10-14 06:11:54.542007] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-10-14 06:11:54.542054] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2306906' to capture a snapshot of events at runtime. [2024-10-14 06:11:54.542065] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-10-14 06:11:54.542092] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-10-14 06:11:54.542099] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2306906 for offline analysis/debug. [2024-10-14 06:11:54.542666] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Oct 14 06:11:58 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/10/14-06:12:01 ... thread 0: (1000000,1000000) ops and (357421.3,357421.3) ops/second in (2.797819,2.797819) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 503.99 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 355.6 2.30 2.08 12 0.192 0 0 0.0 0.0 L1 3/3 251.75 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 260.4 260.2 0.97 0.94 1 0.968 255K 193 0.0 0.0 L2 1/0 48.89 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 237.7 237.6 0.47 0.44 1 0.469 113K 29 0.0 0.0 L3 16/0 755.43 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 186.9 186.9 0.33 0.27 1 0.334 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1188/8 96.94 GB 0.0 0.4 0.3 0.1 1.2 1.1 0.2 1.5 104.5 305.5 4.07 3.73 15 0.272 432K 222 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.2 1.1 0.1 1.5 104.5 305.5 4.07 3.73 15 0.272 432K 222 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 240.5 240.4 1.77 1.64 3 0.590 432K 222 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 355.6 2.30 2.08 12 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.22 GB write, 418.05 MB/s write, 0.42 GB read, 143.05 MB/s read, 4.1 seconds Interval compaction: 1.22 GB write, 444.64 MB/s write, 0.42 GB read, 152.15 MB/s read, 4.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 98366 Average: 1.8343 StdDev: 20.47 Min: 1 Median: 1.1305 Max: 3445 Percentiles: P50: 1.13 P75: 1.60 P99: 3.44 P99.9: 9.21 P99.99: 412.68 ------------------------------------------------------ [ 0, 1 ] 42284 42.986% 42.986% ######### ( 1, 2 ] 52848 53.726% 96.712% ########### ( 2, 3 ] 1891 1.922% 98.635% ( 3, 4 ] 826 0.840% 99.474% ( 4, 6 ] 284 0.289% 99.763% ( 6, 10 ] 169 0.172% 99.935% ( 10, 15 ] 29 0.029% 99.964% ( 15, 22 ] 6 0.006% 99.971% ( 22, 34 ] 4 0.004% 99.975% ( 34, 51 ] 1 0.001% 99.976% ( 51, 76 ] 1 0.001% 99.977% ( 110, 170 ] 10 0.010% 99.987% ( 170, 250 ] 1 0.001% 99.988% ( 250, 380 ] 3 0.003% 99.991% ( 380, 580 ] 1 0.001% 99.992% ( 580, 870 ] 3 0.003% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 2900, 4400 ] 2 0.002% 100.001% ** Level 1 read latency histogram (micros): Count: 26898 Average: 2.4359 StdDev: 27.52 Min: 1 Median: 1.1830 Max: 2402 Percentiles: P50: 1.18 P75: 1.65 P99: 5.98 P99.9: 128.02 P99.99: 1486.12 ------------------------------------------------------ [ 0, 1 ] 10793 40.126% 40.126% ######## ( 1, 2 ] 14513 53.956% 94.081% ########### ( 2, 3 ] 915 3.402% 97.483% # ( 3, 4 ] 232 0.863% 98.346% ( 4, 6 ] 178 0.662% 99.007% ( 6, 10 ] 147 0.547% 99.554% ( 10, 15 ] 27 0.100% 99.654% ( 15, 22 ] 10 0.037% 99.691% ( 22, 34 ] 2 0.007% 99.699% ( 34, 51 ] 27 0.100% 99.799% ( 51, 76 ] 20 0.074% 99.874% ( 76, 110 ] 5 0.019% 99.892% ( 110, 170 ] 7 0.026% 99.918% ( 170, 250 ] 7 0.026% 99.944% ( 250, 380 ] 2 0.007% 99.952% ( 380, 580 ] 4 0.015% 99.967% ( 580, 870 ] 2 0.007% 99.974% ( 870, 1300 ] 4 0.015% 99.989% ( 1300, 1900 ] 1 0.004% 99.993% ( 1900, 2900 ] 2 0.007% 100.000% ** Level 2 read latency histogram (micros): Count: 15875 Average: 1.7368 StdDev: 3.48 Min: 1 Median: 1.1810 Max: 272 Percentiles: P50: 1.18 P75: 1.64 P99: 3.65 P99.9: 9.59 P99.99: 226.50 ------------------------------------------------------ [ 0, 1 ] 6364 40.088% 40.088% ######## ( 1, 2 ] 8694 54.765% 94.854% ########### ( 2, 3 ] 566 3.565% 98.419% # ( 3, 4 ] 142 0.894% 99.313% ( 4, 6 ] 68 0.428% 99.742% ( 6, 10 ] 28 0.176% 99.918% ( 10, 15 ] 7 0.044% 99.962% ( 15, 22 ] 1 0.006% 99.969% ( 22, 34 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 250, 380 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 768.5625 StdDev: 1091.44 Min: 1 Median: 250.0000 Max: 4075 Percentiles: P50: 250.00 P75: 1013.33 P99: 4075.00 P99.9: 4075.00 P99.99: 4075.00 ------------------------------------------------------ [ 0, 1 ] 15 18.750% 18.750% #### ( 1, 2 ] 20 25.000% 43.750% ##### ( 2, 3 ] 1 1.250% 45.000% ( 4, 6 ] 1 1.250% 46.250% ( 110, 170 ] 1 1.250% 47.500% ( 170, 250 ] 2 2.500% 50.000% # ( 250, 380 ] 2 2.500% 52.500% # ( 380, 580 ] 7 8.750% 61.250% ## ( 580, 870 ] 10 12.500% 73.750% ### ( 870, 1300 ] 3 3.750% 77.500% # ( 1300, 1900 ] 3 3.750% 81.250% # ( 1900, 2900 ] 9 11.250% 92.500% ## ( 2900, 4400 ] 6 7.500% 100.000% ## ** Level 4 read latency histogram (micros): Count: 35 Average: 1769.4000 StdDev: 1224.28 Min: 202 Median: 1360.0000 Max: 4880 Percentiles: P50: 1360.00 P75: 2608.33 P99: 4880.00 P99.9: 4880.00 P99.99: 4880.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 580, 870 ] 6 17.143% 28.571% ### ( 870, 1300 ] 7 20.000% 48.571% #### ( 1300, 1900 ] 5 14.286% 62.857% ### ( 1900, 2900 ] 6 17.143% 80.000% ### ( 2900, 4400 ] 5 14.286% 94.286% ### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 330.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.167 H:M:S, 5.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 351.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.167 H:M:S, 6.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/10/14-06:12:04 ... thread 0: (1000000,2000000) ops and (321893.8,338728.5) ops/second in (3.106615,5.904434) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/4 1.17 GB 88.1 0.8 0.0 0.8 2.6 1.8 0.0 1.4 99.4 321.2 8.24 7.64 29 0.284 831K 903 0.0 0.0 L1 2/0 50.37 MB 5.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 246.3 245.9 3.32 3.23 2 1.662 831K 1443 0.0 0.0 L2 5/4 563.95 MB 1.3 0.1 0.1 0.0 0.1 0.1 0.6 1.8 237.7 237.6 0.47 0.44 1 0.469 113K 29 0.0 0.0 L3 16/9 755.43 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 186.9 186.9 0.33 0.27 1 0.334 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1191/17 97.92 GB 0.0 1.8 0.6 1.2 3.6 2.4 0.7 2.0 146.5 294.1 12.36 11.57 33 0.375 1839K 2375 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.6 1.2 3.6 2.4 0.6 2.0 146.5 294.1 12.36 11.57 33 0.375 1839K 2375 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.6 1.2 1.8 0.6 0.0 0.0 251.9 251.5 7.19 6.94 7 1.028 1839K 2375 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.4 5.17 4.63 26 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.55 GB write, 597.66 MB/s write, 1.77 GB read, 297.78 MB/s read, 12.4 seconds Interval compaction: 3.55 GB write, 615.67 MB/s write, 1.77 GB read, 306.75 MB/s read, 12.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 388678 Average: 2.1297 StdDev: 13.54 Min: 1 Median: 1.4341 Max: 3445 Percentiles: P50: 1.43 P75: 1.83 P99: 5.48 P99.9: 9.86 P99.99: 20.45 ------------------------------------------------------ [ 0, 1 ] 87098 22.409% 22.409% #### ( 1, 2 ] 247034 63.557% 85.966% ############# ( 2, 3 ] 32462 8.352% 94.318% ## ( 3, 4 ] 12629 3.249% 97.567% # ( 4, 6 ] 7503 1.930% 99.498% ( 6, 10 ] 1618 0.416% 99.914% ( 10, 15 ] 264 0.068% 99.982% ( 15, 22 ] 40 0.010% 99.992% ( 22, 34 ] 10 0.003% 99.995% ( 34, 51 ] 6 0.002% 99.996% ( 51, 76 ] 5 0.001% 99.998% ( 110, 170 ] 14 0.004% 100.001% ( 170, 250 ] 9 0.002% 100.004% ( 250, 380 ] 7 0.002% 100.005% ( 380, 580 ] 3 0.001% 100.006% ( 580, 870 ] 12 0.003% 100.009% ( 870, 1300 ] 4 0.001% 100.010% ( 1300, 1900 ] 3 0.001% 100.011% ( 1900, 2900 ] 3 0.001% 100.012% ( 2900, 4400 ] 3 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 131165 Average: 2.3495 StdDev: 13.82 Min: 1 Median: 1.5234 Max: 2402 Percentiles: P50: 1.52 P75: 1.91 P99: 5.69 P99.9: 14.31 P99.99: 574.17 ------------------------------------------------------ [ 0, 1 ] 21564 16.440% 16.440% ### ( 1, 2 ] 84109 64.125% 80.565% ############# ( 2, 3 ] 16083 12.262% 92.827% ## ( 3, 4 ] 5140 3.919% 96.745% # ( 4, 6 ] 3505 2.672% 99.418% # ( 6, 10 ] 558 0.425% 99.843% ( 10, 15 ] 88 0.067% 99.910% ( 15, 22 ] 24 0.018% 99.928% ( 22, 34 ] 2 0.002% 99.930% ( 34, 51 ] 27 0.021% 99.950% ( 51, 76 ] 21 0.016% 99.966% ( 76, 110 ] 5 0.004% 99.970% ( 110, 170 ] 8 0.006% 99.976% ( 170, 250 ] 8 0.006% 99.982% ( 250, 380 ] 7 0.005% 99.988% ( 380, 580 ] 4 0.003% 99.991% ( 580, 870 ] 3 0.002% 99.993% ( 870, 1300 ] 7 0.005% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 2 0.002% 100.001% ** Level 2 read latency histogram (micros): Count: 15928 Average: 1.7406 StdDev: 3.48 Min: 1 Median: 1.1836 Max: 272 Percentiles: P50: 1.18 P75: 1.64 P99: 3.67 P99.9: 9.72 P99.99: 226.29 ------------------------------------------------------ [ 0, 1 ] 6364 39.955% 39.955% ######## ( 1, 2 ] 8715 54.715% 94.670% ########### ( 2, 3 ] 593 3.723% 98.393% # ( 3, 4 ] 145 0.910% 99.303% ( 4, 6 ] 69 0.433% 99.736% ( 6, 10 ] 28 0.176% 99.912% ( 10, 15 ] 8 0.050% 99.962% ( 15, 22 ] 1 0.006% 99.969% ( 22, 34 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 250, 380 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 81173 Average: 4.1704 StdDev: 48.43 Min: 1 Median: 1.6511 Max: 4075 Percentiles: P50: 1.65 P75: 2.19 P99: 9.35 P99.9: 398.66 P99.99: 2088.26 ------------------------------------------------------ [ 0, 1 ] 7272 8.959% 8.959% ## ( 1, 2 ] 51167 63.035% 71.993% ############# ( 2, 3 ] 12631 15.561% 87.554% ### ( 3, 4 ] 4771 5.878% 93.431% # ( 4, 6 ] 3323 4.094% 97.525% # ( 6, 10 ] 1432 1.764% 99.289% ( 10, 15 ] 198 0.244% 99.533% ( 15, 22 ] 34 0.042% 99.575% ( 22, 34 ] 19 0.023% 99.598% ( 34, 51 ] 1 0.001% 99.600% ( 51, 76 ] 1 0.001% 99.601% ( 76, 110 ] 34 0.042% 99.643% ( 110, 170 ] 118 0.145% 99.788% ( 170, 250 ] 45 0.055% 99.844% ( 250, 380 ] 43 0.053% 99.897% ( 380, 580 ] 41 0.051% 99.947% ( 580, 870 ] 21 0.026% 99.973% ( 870, 1300 ] 8 0.010% 99.983% ( 1300, 1900 ] 5 0.006% 99.989% ( 1900, 2900 ] 10 0.012% 100.001% ( 2900, 4400 ] 7 0.009% 100.010% ** Level 4 read latency histogram (micros): Count: 35 Average: 1769.4000 StdDev: 1224.28 Min: 202 Median: 1360.0000 Max: 4880 Percentiles: P50: 1360.00 P75: 2608.33 P99: 4880.00 P99.9: 4880.00 P99.99: 4880.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 580, 870 ] 6 17.143% 28.571% ### ( 870, 1300 ] 7 20.000% 48.571% #### ( 1300, 1900 ] 5 14.286% 62.857% ### ( 1900, 2900 ] 6 17.143% 80.000% ### ( 2900, 4400 ] 5 14.286% 94.286% ### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 323.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.559 H:M:S, 9.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 316.81 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.392 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/10/14-06:12:07 ... thread 0: (1000000,3000000) ops and (346417.9,341253.4) ops/second in (2.886687,8.791121) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.09 GB 188.8 1.7 0.0 1.7 4.4 2.7 0.0 1.6 118.9 312.6 14.30 13.31 46 0.311 1727K 1903 0.0 0.0 L1 2/0 50.37 MB 5.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 246.3 245.9 3.32 3.23 2 1.662 831K 1443 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 237.7 237.6 0.47 0.44 1 0.469 113K 29 0.0 0.0 L3 27/0 964.85 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.2 214.5 214.4 6.51 5.76 4 1.627 1399K 712 0.0 0.0 L4 148/0 9.51 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1238/4 98.84 GB 0.0 3.9 1.2 2.8 6.6 3.9 1.4 2.5 163.7 276.2 24.60 22.74 53 0.464 4070K 4087 0.0 0.0 Int 0/0 0.00 KB 0.0 3.9 1.2 2.8 6.6 3.9 1.3 2.5 163.7 276.2 24.60 22.74 53 0.464 4070K 4087 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.9 1.2 2.8 3.9 1.2 0.0 0.0 239.7 239.5 16.80 15.80 13 1.292 4070K 4087 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 355.2 7.80 6.94 40 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.64 GB write, 757.47 MB/s write, 3.93 GB read, 448.95 MB/s read, 24.6 seconds Interval compaction: 6.64 GB write, 772.80 MB/s write, 3.93 GB read, 458.04 MB/s read, 24.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 642720 Average: 2.1840 StdDev: 12.34 Min: 1 Median: 1.4728 Max: 3445 Percentiles: P50: 1.47 P75: 1.86 P99: 5.59 P99.9: 9.80 P99.99: 16.83 ------------------------------------------------------ [ 0, 1 ] 126874 19.740% 19.740% #### ( 1, 2 ] 411376 64.005% 83.746% ############# ( 2, 3 ] 62103 9.663% 93.408% ## ( 3, 4 ] 23651 3.680% 97.088% # ( 4, 6 ] 15487 2.410% 99.498% ( 6, 10 ] 2723 0.424% 99.921% ( 10, 15 ] 427 0.066% 99.988% ( 15, 22 ] 60 0.009% 99.997% ( 22, 34 ] 10 0.002% 99.999% ( 34, 51 ] 8 0.001% 100.000% ( 51, 76 ] 7 0.001% 100.001% ( 110, 170 ] 18 0.003% 100.004% ( 170, 250 ] 18 0.003% 100.007% ( 250, 380 ] 12 0.002% 100.008% ( 380, 580 ] 6 0.001% 100.009% ( 580, 870 ] 17 0.003% 100.012% ( 870, 1300 ] 8 0.001% 100.013% ( 1300, 1900 ] 7 0.001% 100.014% ( 1900, 2900 ] 3 0.000% 100.015% ( 2900, 4400 ] 4 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 207030 Average: 2.4036 StdDev: 11.02 Min: 1 Median: 1.5929 Max: 2402 Percentiles: P50: 1.59 P75: 1.98 P99: 5.81 P99.9: 13.17 P99.99: 311.23 ------------------------------------------------------ [ 0, 1 ] 24719 11.940% 11.940% ## ( 1, 2 ] 132897 64.192% 76.132% ############# ( 2, 3 ] 30784 14.869% 91.001% ### ( 3, 4 ] 9797 4.732% 95.733% # ( 4, 6 ] 7484 3.615% 99.348% # ( 6, 10 ] 1028 0.497% 99.845% ( 10, 15 ] 180 0.087% 99.932% ( 15, 22 ] 41 0.020% 99.952% ( 22, 34 ] 6 0.003% 99.955% ( 34, 51 ] 27 0.013% 99.968% ( 51, 76 ] 22 0.011% 99.978% ( 76, 110 ] 5 0.002% 99.981% ( 110, 170 ] 8 0.004% 99.985% ( 170, 250 ] 8 0.004% 99.988% ( 250, 380 ] 7 0.003% 99.992% ( 380, 580 ] 4 0.002% 99.994% ( 580, 870 ] 3 0.001% 99.995% ( 870, 1300 ] 7 0.003% 99.999% ( 1300, 1900 ] 1 0.000% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28290 Average: 1.9780 StdDev: 2.71 Min: 1 Median: 1.3849 Max: 272 Percentiles: P50: 1.38 P75: 1.80 P99: 5.24 P99.9: 9.99 P99.99: 176.84 ------------------------------------------------------ [ 0, 1 ] 7517 26.571% 26.571% ##### ( 1, 2 ] 17219 60.866% 87.437% ############ ( 2, 3 ] 2132 7.536% 94.973% ## ( 3, 4 ] 854 3.019% 97.992% # ( 4, 6 ] 458 1.619% 99.611% ( 6, 10 ] 82 0.290% 99.901% ( 10, 15 ] 16 0.057% 99.958% ( 15, 22 ] 7 0.025% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 195847 Average: 3.5478 StdDev: 34.98 Min: 1 Median: 1.6330 Max: 4075 Percentiles: P50: 1.63 P75: 2.09 P99: 8.96 P99.9: 243.62 P99.99: 746.89 ------------------------------------------------------ [ 0, 1 ] 18014 9.198% 9.198% ## ( 1, 2 ] 126233 64.455% 73.653% ############# ( 2, 3 ] 28128 14.362% 88.015% ### ( 3, 4 ] 11366 5.804% 93.819% # ( 4, 6 ] 7628 3.895% 97.714% # ( 6, 10 ] 3402 1.737% 99.451% ( 10, 15 ] 353 0.180% 99.631% ( 15, 22 ] 59 0.030% 99.661% ( 22, 34 ] 30 0.015% 99.676% ( 34, 51 ] 11 0.006% 99.682% ( 51, 76 ] 3 0.002% 99.683% ( 76, 110 ] 89 0.045% 99.729% ( 110, 170 ] 233 0.119% 99.848% ( 170, 250 ] 111 0.057% 99.905% ( 250, 380 ] 82 0.042% 99.946% ( 380, 580 ] 67 0.034% 99.981% ( 580, 870 ] 32 0.016% 99.997% ( 870, 1300 ] 16 0.008% 100.005% ( 1300, 1900 ] 6 0.003% 100.008% ( 1900, 2900 ] 11 0.006% 100.014% ( 2900, 4400 ] 8 0.004% 100.018% ** Level 4 read latency histogram (micros): Count: 35 Average: 1769.4000 StdDev: 1224.28 Min: 202 Median: 1360.0000 Max: 4880 Percentiles: P50: 1360.00 P75: 2608.33 P99: 4880.00 P99.9: 4880.00 P99.99: 4880.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 580, 870 ] 6 17.143% 28.571% ### ( 870, 1300 ] 7 20.000% 48.571% #### ( 1300, 1900 ] 5 14.286% 62.857% ### ( 1900, 2900 ] 6 17.143% 80.000% ### ( 2900, 4400 ] 5 14.286% 94.286% ### ( 4400, 6600 ] 2 5.714% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 577.3000 StdDev: 484.16 Min: 95 Median: 460.0000 Max: 1751 Percentiles: P50: 460.00 P75: 773.33 P99: 1751.00 P99.9: 1751.00 P99.99: 1751.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 2 10.000% 25.000% ## ( 170, 250 ] 2 10.000% 35.000% ## ( 250, 380 ] 1 5.000% 40.000% # ( 380, 580 ] 5 25.000% 65.000% ##### ( 580, 870 ] 3 15.000% 80.000% ### ( 870, 1300 ] 1 5.000% 85.000% # ( 1300, 1900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 9.0 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 329.14 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.756 H:M:S, 8.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 340.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.197 H:M:S, 6.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/10/14-06:12:10 ... thread 0: (1000000,4000000) ops and (328254.5,337908.1) ops/second in (3.046417,11.837538) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 3.07 GB 44.1 2.4 0.0 2.4 6.1 3.7 0.0 1.6 123.4 313.2 19.90 18.56 63 0.316 2494K 2625 0.0 0.0 L1 2/2 50.37 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 246.3 245.9 3.32 3.23 2 1.662 831K 1443 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 237.7 237.6 0.47 0.44 1 0.469 113K 29 0.0 0.0 L3 27/0 964.85 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.2 214.5 214.4 6.51 5.76 4 1.627 1399K 712 0.0 0.0 L4 148/0 9.51 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1243/17 99.82 GB 0.0 4.7 1.2 3.5 8.4 4.9 1.4 2.3 158.4 283.3 30.20 27.99 70 0.431 4838K 4809 0.0 0.0 Int 0/0 0.00 KB 0.0 4.7 1.2 3.5 8.4 4.9 1.3 2.3 158.4 283.3 30.20 27.99 70 0.431 4838K 4809 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.7 1.2 3.5 4.7 1.2 0.0 0.0 244.6 244.4 19.55 18.51 16 1.222 4838K 4809 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 354.9 10.65 9.49 54 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.8 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.36 GB write, 712.16 MB/s write, 4.67 GB read, 398.05 MB/s read, 30.2 seconds Interval compaction: 8.36 GB write, 722.87 MB/s write, 4.67 GB read, 404.03 MB/s read, 30.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 929540 Average: 2.1603 StdDev: 12.49 Min: 1 Median: 1.4459 Max: 3445 Percentiles: P50: 1.45 P75: 1.83 P99: 5.50 P99.9: 9.93 P99.99: 129.48 ------------------------------------------------------ [ 0, 1 ] 197070 21.201% 21.201% #### ( 1, 2 ] 600375 64.588% 85.789% ############# ( 2, 3 ] 79389 8.541% 94.330% ## ( 3, 4 ] 29973 3.224% 97.554% # ( 4, 6 ] 17952 1.931% 99.486% ( 6, 10 ] 3924 0.422% 99.908% ( 10, 15 ] 559 0.060% 99.968% ( 15, 22 ] 80 0.009% 99.977% ( 22, 34 ] 15 0.002% 99.978% ( 34, 51 ] 12 0.001% 99.979% ( 51, 76 ] 8 0.001% 99.980% ( 76, 110 ] 54 0.006% 99.986% ( 110, 170 ] 111 0.012% 99.998% ( 170, 250 ] 47 0.005% 100.003% ( 250, 380 ] 26 0.003% 100.006% ( 380, 580 ] 13 0.001% 100.007% ( 580, 870 ] 27 0.003% 100.010% ( 870, 1300 ] 15 0.002% 100.012% ( 1300, 1900 ] 7 0.001% 100.013% ( 1900, 2900 ] 3 0.000% 100.013% ( 2900, 4400 ] 7 0.001% 100.014% ** Level 1 read latency histogram (micros): Count: 207031 Average: 2.4054 StdDev: 11.05 Min: 1 Median: 1.5929 Max: 2402 Percentiles: P50: 1.59 P75: 1.98 P99: 5.81 P99.9: 13.19 P99.99: 319.82 ------------------------------------------------------ [ 0, 1 ] 24719 11.940% 11.940% ## ( 1, 2 ] 132897 64.192% 76.132% ############# ( 2, 3 ] 30784 14.869% 91.001% ### ( 3, 4 ] 9797 4.732% 95.733% # ( 4, 6 ] 7484 3.615% 99.348% # ( 6, 10 ] 1028 0.497% 99.844% ( 10, 15 ] 180 0.087% 99.931% ( 15, 22 ] 41 0.020% 99.951% ( 22, 34 ] 6 0.003% 99.954% ( 34, 51 ] 27 0.013% 99.967% ( 51, 76 ] 22 0.011% 99.978% ( 76, 110 ] 5 0.002% 99.980% ( 110, 170 ] 8 0.004% 99.984% ( 170, 250 ] 8 0.004% 99.988% ( 250, 380 ] 8 0.004% 99.992% ( 380, 580 ] 4 0.002% 99.994% ( 580, 870 ] 3 0.001% 99.995% ( 870, 1300 ] 7 0.003% 99.999% ( 1300, 1900 ] 1 0.000% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28290 Average: 1.9780 StdDev: 2.71 Min: 1 Median: 1.3849 Max: 272 Percentiles: P50: 1.38 P75: 1.80 P99: 5.24 P99.9: 9.99 P99.99: 176.84 ------------------------------------------------------ [ 0, 1 ] 7517 26.571% 26.571% ##### ( 1, 2 ] 17219 60.866% 87.437% ############ ( 2, 3 ] 2132 7.536% 94.973% ## ( 3, 4 ] 854 3.019% 97.992% # ( 4, 6 ] 458 1.619% 99.611% ( 6, 10 ] 82 0.290% 99.901% ( 10, 15 ] 16 0.057% 99.958% ( 15, 22 ] 7 0.025% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 195847 Average: 3.5478 StdDev: 34.98 Min: 1 Median: 1.6330 Max: 4075 Percentiles: P50: 1.63 P75: 2.09 P99: 8.96 P99.9: 243.62 P99.99: 746.89 ------------------------------------------------------ [ 0, 1 ] 18014 9.198% 9.198% ## ( 1, 2 ] 126233 64.455% 73.653% ############# ( 2, 3 ] 28128 14.362% 88.015% ### ( 3, 4 ] 11366 5.804% 93.819% # ( 4, 6 ] 7628 3.895% 97.714% # ( 6, 10 ] 3402 1.737% 99.451% ( 10, 15 ] 353 0.180% 99.631% ( 15, 22 ] 59 0.030% 99.661% ( 22, 34 ] 30 0.015% 99.676% ( 34, 51 ] 11 0.006% 99.682% ( 51, 76 ] 3 0.002% 99.683% ( 76, 110 ] 89 0.045% 99.729% ( 110, 170 ] 233 0.119% 99.848% ( 170, 250 ] 111 0.057% 99.905% ( 250, 380 ] 82 0.042% 99.946% ( 380, 580 ] 67 0.034% 99.981% ( 580, 870 ] 32 0.016% 99.997% ( 870, 1300 ] 16 0.008% 100.005% ( 1300, 1900 ] 6 0.003% 100.008% ( 1900, 2900 ] 11 0.006% 100.014% ( 2900, 4400 ] 8 0.004% 100.018% ** Level 4 read latency histogram (micros): Count: 35 Average: 1769.4000 StdDev: 1224.28 Min: 202 Median: 1360.0000 Max: 4880 Percentiles: P50: 1360.00 P75: 2608.33 P99: 4880.00 P99.9: 4880.00 P99.99: 4880.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 580, 870 ] 6 17.143% 28.571% ### ( 870, 1300 ] 7 20.000% 48.571% #### ( 1300, 1900 ] 5 14.286% 62.857% ### ( 1900, 2900 ] 6 17.143% 80.000% ### ( 2900, 4400 ] 5 14.286% 94.286% ### ( 4400, 6600 ] 2 5.714% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 577.3000 StdDev: 484.16 Min: 95 Median: 460.0000 Max: 1751 Percentiles: P50: 460.00 P75: 773.33 P99: 1751.00 P99.9: 1751.00 P99.99: 1751.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 2 10.000% 25.000% ## ( 170, 250 ] 2 10.000% 35.000% ## ( 250, 380 ] 1 5.000% 40.000% # ( 380, 580 ] 5 25.000% 65.000% ##### ( 580, 870 ] 3 15.000% 80.000% ### ( 870, 1300 ] 1 5.000% 85.000% # ( 1300, 1900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 327.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.142 H:M:S, 9.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.387 H:M:S, 12.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/14-06:12:17 ... thread 0: (1000000,5000000) ops and (154778.3,273248.1) ops/second in (6.460853,18.298391) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/17 4.06 GB 25.2 3.7 0.0 3.7 8.4 4.7 0.0 1.8 135.8 309.8 27.84 26.09 84 0.331 3837K 3963 0.0 0.0 L1 2/2 50.37 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 246.3 245.9 3.32 3.23 2 1.662 831K 1443 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 237.7 237.6 0.47 0.44 1 0.469 113K 29 0.0 0.0 L3 27/0 964.85 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.2 214.5 214.4 6.51 5.76 4 1.627 1399K 712 0.0 0.0 L4 148/0 9.51 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1243/19 100.81 GB 0.0 6.0 1.2 4.8 10.7 5.9 1.4 2.3 160.1 287.1 38.14 35.52 91 0.419 6181K 6147 0.0 0.0 Int 0/0 0.00 KB 0.0 6.0 1.2 4.8 10.7 5.9 1.3 2.3 160.1 287.1 38.14 35.52 91 0.419 6181K 6147 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.0 1.2 4.8 6.0 1.2 0.0 0.0 249.7 249.4 24.45 23.33 21 1.164 6181K 6147 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 354.4 13.69 12.19 70 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.5 total, 18.3 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.69 GB write, 592.63 MB/s write, 5.96 GB read, 330.47 MB/s read, 38.1 seconds Interval compaction: 10.69 GB write, 598.40 MB/s write, 5.96 GB read, 333.68 MB/s read, 38.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 15, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1648105 Average: 2.1532 StdDev: 11.10 Min: 1 Median: 1.4438 Max: 3445 Percentiles: P50: 1.44 P75: 1.82 P99: 5.48 P99.9: 10.24 P99.99: 143.17 ------------------------------------------------------ [ 0, 1 ] 339265 20.585% 20.585% #### ( 1, 2 ] 1092389 66.282% 86.867% ############# ( 2, 3 ] 131963 8.007% 94.874% ## ( 3, 4 ] 48584 2.948% 97.821% # ( 4, 6 ] 26304 1.596% 99.418% ( 6, 10 ] 7905 0.480% 99.897% ( 10, 15 ] 963 0.058% 99.956% ( 15, 22 ] 138 0.008% 99.964% ( 22, 34 ] 20 0.001% 99.965% ( 34, 51 ] 14 0.001% 99.966% ( 51, 76 ] 21 0.001% 99.967% ( 76, 110 ] 231 0.014% 99.981% ( 110, 170 ] 259 0.016% 99.997% ( 170, 250 ] 94 0.006% 100.003% ( 250, 380 ] 62 0.004% 100.006% ( 380, 580 ] 38 0.002% 100.009% ( 580, 870 ] 49 0.003% 100.012% ( 870, 1300 ] 24 0.001% 100.013% ( 1300, 1900 ] 9 0.001% 100.014% ( 1900, 2900 ] 4 0.000% 100.014% ( 2900, 4400 ] 8 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 207031 Average: 2.4054 StdDev: 11.05 Min: 1 Median: 1.5929 Max: 2402 Percentiles: P50: 1.59 P75: 1.98 P99: 5.81 P99.9: 13.19 P99.99: 319.82 ------------------------------------------------------ [ 0, 1 ] 24719 11.940% 11.940% ## ( 1, 2 ] 132897 64.192% 76.132% ############# ( 2, 3 ] 30784 14.869% 91.001% ### ( 3, 4 ] 9797 4.732% 95.733% # ( 4, 6 ] 7484 3.615% 99.348% # ( 6, 10 ] 1028 0.497% 99.844% ( 10, 15 ] 180 0.087% 99.931% ( 15, 22 ] 41 0.020% 99.951% ( 22, 34 ] 6 0.003% 99.954% ( 34, 51 ] 27 0.013% 99.967% ( 51, 76 ] 22 0.011% 99.978% ( 76, 110 ] 5 0.002% 99.980% ( 110, 170 ] 8 0.004% 99.984% ( 170, 250 ] 8 0.004% 99.988% ( 250, 380 ] 8 0.004% 99.992% ( 380, 580 ] 4 0.002% 99.994% ( 580, 870 ] 3 0.001% 99.995% ( 870, 1300 ] 7 0.003% 99.999% ( 1300, 1900 ] 1 0.000% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28290 Average: 1.9780 StdDev: 2.71 Min: 1 Median: 1.3849 Max: 272 Percentiles: P50: 1.38 P75: 1.80 P99: 5.24 P99.9: 9.99 P99.99: 176.84 ------------------------------------------------------ [ 0, 1 ] 7517 26.571% 26.571% ##### ( 1, 2 ] 17219 60.866% 87.437% ############ ( 2, 3 ] 2132 7.536% 94.973% ## ( 3, 4 ] 854 3.019% 97.992% # ( 4, 6 ] 458 1.619% 99.611% ( 6, 10 ] 82 0.290% 99.901% ( 10, 15 ] 16 0.057% 99.958% ( 15, 22 ] 7 0.025% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 195847 Average: 3.5478 StdDev: 34.98 Min: 1 Median: 1.6330 Max: 4075 Percentiles: P50: 1.63 P75: 2.09 P99: 8.96 P99.9: 243.62 P99.99: 746.89 ------------------------------------------------------ [ 0, 1 ] 18014 9.198% 9.198% ## ( 1, 2 ] 126233 64.455% 73.653% ############# ( 2, 3 ] 28128 14.362% 88.015% ### ( 3, 4 ] 11366 5.804% 93.819% # ( 4, 6 ] 7628 3.895% 97.714% # ( 6, 10 ] 3402 1.737% 99.451% ( 10, 15 ] 353 0.180% 99.631% ( 15, 22 ] 59 0.030% 99.661% ( 22, 34 ] 30 0.015% 99.676% ( 34, 51 ] 11 0.006% 99.682% ( 51, 76 ] 3 0.002% 99.683% ( 76, 110 ] 89 0.045% 99.729% ( 110, 170 ] 233 0.119% 99.848% ( 170, 250 ] 111 0.057% 99.905% ( 250, 380 ] 82 0.042% 99.946% ( 380, 580 ] 67 0.034% 99.981% ( 580, 870 ] 32 0.016% 99.997% ( 870, 1300 ] 16 0.008% 100.005% ( 1300, 1900 ] 6 0.003% 100.008% ( 1900, 2900 ] 11 0.006% 100.014% ( 2900, 4400 ] 8 0.004% 100.018% ** Level 4 read latency histogram (micros): Count: 35 Average: 1769.4000 StdDev: 1224.28 Min: 202 Median: 1360.0000 Max: 4880 Percentiles: P50: 1360.00 P75: 2608.33 P99: 4880.00 P99.9: 4880.00 P99.99: 4880.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 580, 870 ] 6 17.143% 28.571% ### ( 870, 1300 ] 7 20.000% 48.571% #### ( 1300, 1900 ] 5 14.286% 62.857% ### ( 1900, 2900 ] 6 17.143% 80.000% ### ( 2900, 4400 ] 5 14.286% 94.286% ### ( 4400, 6600 ] 2 5.714% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 577.3000 StdDev: 484.16 Min: 95 Median: 460.0000 Max: 1751 Percentiles: P50: 460.00 P75: 773.33 P99: 1751.00 P99.9: 1751.00 P99.99: 1751.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 2 10.000% 25.000% ## ( 170, 250 ] 2 10.000% 35.000% ## ( 250, 380 ] 1 5.000% 40.000% # ( 380, 580 ] 5 25.000% 65.000% ##### ( 580, 870 ] 3 15.000% 80.000% ### ( 870, 1300 ] 1 5.000% 85.000% # ( 1300, 1900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 18.5 total, 6.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 266.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.750 H:M:S, 25.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 152.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.608 H:M:S, 55.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/14-06:12:22 ... thread 0: (1000000,6000000) ops and (170970.2,248474.3) ops/second in (5.848974,24.147365) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 2.57 GB 200.5 5.4 0.0 5.4 10.9 5.6 0.0 2.0 143.4 293.0 38.22 34.86 98 0.390 5563K 13K 0.0 0.0 L1 3/0 135.48 MB 13.5 3.2 2.9 0.4 3.2 2.9 0.1 1.1 235.1 233.0 14.13 13.60 3 4.712 3374K 30K 0.0 0.0 L2 1/0 69.88 MB 0.7 0.1 0.1 0.0 0.1 0.1 2.8 1.8 237.7 237.6 0.47 0.44 1 0.469 113K 29 0.0 0.0 L3 16/0 995.05 MB 1.0 2.4 1.5 0.9 2.4 1.5 1.3 1.6 181.0 180.6 13.82 10.76 13 1.063 2451K 4045 0.0 0.0 L4 165/0 9.72 GB 1.0 0.8 0.5 0.3 0.8 0.5 2.0 1.5 123.7 123.1 6.59 3.77 5 1.318 700K 3381 0.0 0.0 L5 1073/0 88.22 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1270/8 101.68 GB 0.0 11.9 5.0 7.0 17.5 10.5 8.6 3.1 167.0 244.6 73.23 63.43 120 0.610 12M 50K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.9 5.0 7.0 17.5 10.5 8.6 3.1 167.0 244.6 73.23 63.43 120 0.610 12M 50K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.9 5.0 7.0 11.9 4.9 0.0 0.0 217.6 216.6 56.21 48.97 38 1.479 12M 50K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 336.8 17.02 14.46 82 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.3 total, 24.1 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.49 GB write, 736.24 MB/s write, 11.94 GB read, 502.80 MB/s read, 73.2 seconds Interval compaction: 17.49 GB write, 741.67 MB/s write, 11.94 GB read, 506.51 MB/s read, 73.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 26, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 26, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2275765 Average: 2.3503 StdDev: 18.48 Min: 1 Median: 1.4837 Max: 6380 Percentiles: P50: 1.48 P75: 1.86 P99: 5.86 P99.9: 12.48 P99.99: 177.17 ------------------------------------------------------ [ 0, 1 ] 415156 18.242% 18.242% #### ( 1, 2 ] 1494155 65.655% 83.898% ############# ( 2, 3 ] 213107 9.364% 93.262% ## ( 3, 4 ] 81241 3.570% 96.832% # ( 4, 6 ] 53082 2.332% 99.164% ( 6, 10 ] 15955 0.701% 99.865% ( 10, 15 ] 1604 0.070% 99.936% ( 15, 22 ] 216 0.009% 99.945% ( 22, 34 ] 24 0.001% 99.946% ( 34, 51 ] 17 0.001% 99.947% ( 51, 76 ] 34 0.001% 99.948% ( 76, 110 ] 451 0.020% 99.968% ( 110, 170 ] 482 0.021% 99.989% ( 170, 250 ] 172 0.008% 99.997% ( 250, 380 ] 115 0.005% 100.002% ( 380, 580 ] 107 0.005% 100.007% ( 580, 870 ] 102 0.004% 100.011% ( 870, 1300 ] 64 0.003% 100.014% ( 1300, 1900 ] 31 0.001% 100.015% ( 1900, 2900 ] 12 0.001% 100.016% ( 2900, 4400 ] 22 0.001% 100.017% ( 4400, 6600 ] 6 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 578445 Average: 3.8013 StdDev: 61.60 Min: 1 Median: 1.7950 Max: 11208 Percentiles: P50: 1.80 P75: 2.66 P99: 7.73 P99.9: 13.05 P99.99: 20.46 ------------------------------------------------------ [ 0, 1 ] 33495 5.791% 5.791% # ( 1, 2 ] 321662 55.608% 61.399% ########### ( 2, 3 ] 118551 20.495% 81.893% #### ( 3, 4 ] 49015 8.474% 90.367% ## ( 4, 6 ] 46439 8.028% 98.395% ## ( 6, 10 ] 8104 1.401% 99.796% ( 10, 15 ] 983 0.170% 99.966% ( 15, 22 ] 177 0.031% 99.997% ( 22, 34 ] 25 0.004% 100.001% ( 34, 51 ] 30 0.005% 100.006% ( 51, 76 ] 26 0.004% 100.011% ( 76, 110 ] 63 0.011% 100.022% ( 110, 170 ] 107 0.018% 100.040% ( 170, 250 ] 57 0.010% 100.050% ( 250, 380 ] 77 0.013% 100.063% ( 380, 580 ] 79 0.014% 100.077% ( 580, 870 ] 53 0.009% 100.086% ( 870, 1300 ] 36 0.006% 100.092% ( 1300, 1900 ] 21 0.004% 100.096% ( 1900, 2900 ] 37 0.006% 100.102% ( 2900, 4400 ] 50 0.009% 100.111% ( 4400, 6600 ] 18 0.003% 100.114% ( 6600, 9900 ] 10 0.002% 100.116% ( 9900, 14000 ] 1 0.000% 100.116% ** Level 2 read latency histogram (micros): Count: 28290 Average: 1.9780 StdDev: 2.71 Min: 1 Median: 1.3849 Max: 272 Percentiles: P50: 1.38 P75: 1.80 P99: 5.24 P99.9: 9.99 P99.99: 176.84 ------------------------------------------------------ [ 0, 1 ] 7517 26.571% 26.571% ##### ( 1, 2 ] 17219 60.866% 87.437% ############ ( 2, 3 ] 2132 7.536% 94.973% ## ( 3, 4 ] 854 3.019% 97.992% # ( 4, 6 ] 458 1.619% 99.611% ( 6, 10 ] 82 0.290% 99.901% ( 10, 15 ] 16 0.057% 99.958% ( 15, 22 ] 7 0.025% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 291694 Average: 8.3733 StdDev: 98.13 Min: 1 Median: 1.7073 Max: 8015 Percentiles: P50: 1.71 P75: 2.43 P99: 12.60 P99.9: 1150.08 P99.99: 2718.34 ------------------------------------------------------ [ 0, 1 ] 21187 7.263% 7.263% # ( 1, 2 ] 176257 60.425% 67.689% ############ ( 2, 3 ] 49076 16.824% 84.513% ### ( 3, 4 ] 21434 7.348% 91.861% # ( 4, 6 ] 14973 5.133% 96.994% # ( 6, 10 ] 5521 1.893% 98.887% ( 10, 15 ] 632 0.217% 99.104% ( 15, 22 ] 104 0.036% 99.140% ( 22, 34 ] 36 0.012% 99.152% ( 34, 51 ] 16 0.005% 99.157% ( 51, 76 ] 6 0.002% 99.159% ( 76, 110 ] 161 0.055% 99.215% ( 110, 170 ] 436 0.149% 99.364% ( 170, 250 ] 279 0.096% 99.460% ( 250, 380 ] 308 0.106% 99.565% ( 380, 580 ] 405 0.139% 99.704% ( 580, 870 ] 400 0.137% 99.841% ( 870, 1300 ] 263 0.090% 99.931% ( 1300, 1900 ] 107 0.037% 99.968% ( 1900, 2900 ] 78 0.027% 99.995% ( 2900, 4400 ] 83 0.028% 100.023% ( 4400, 6600 ] 13 0.004% 100.028% ( 6600, 9900 ] 1 0.000% 100.028% ** Level 4 read latency histogram (micros): Count: 145 Average: 577.2828 StdDev: 1000.60 Min: 1 Median: 3.9000 Max: 4880 Percentiles: P50: 3.90 P75: 833.75 P99: 4880.00 P99.9: 4880.00 P99.99: 4880.00 ------------------------------------------------------ [ 0, 1 ] 18 12.414% 12.414% ## ( 1, 2 ] 38 26.207% 38.621% ##### ( 2, 3 ] 12 8.276% 46.897% ## ( 3, 4 ] 5 3.448% 50.345% # ( 6, 10 ] 2 1.379% 51.724% ( 10, 15 ] 1 0.690% 52.414% ( 15, 22 ] 2 1.379% 53.793% ( 76, 110 ] 1 0.690% 54.483% ( 110, 170 ] 11 7.586% 62.069% ## ( 170, 250 ] 5 3.448% 65.517% # ( 250, 380 ] 2 1.379% 66.897% ( 380, 580 ] 3 2.069% 68.966% ( 580, 870 ] 10 6.897% 75.862% # ( 870, 1300 ] 12 8.276% 84.138% ## ( 1300, 1900 ] 9 6.207% 90.345% # ( 1900, 2900 ] 6 4.138% 94.483% # ( 2900, 4400 ] 6 4.138% 98.621% # ( 4400, 6600 ] 2 1.379% 100.000% ** Level 5 read latency histogram (micros): Count: 140 Average: 1285.6857 StdDev: 1291.95 Min: 87 Median: 731.3043 Max: 5216 Percentiles: P50: 731.30 P75: 1952.63 P99: 5216.00 P99.9: 5216.00 P99.99: 5216.00 ------------------------------------------------------ ( 76, 110 ] 5 3.571% 3.571% # ( 110, 170 ] 7 5.000% 8.571% # ( 170, 250 ] 10 7.143% 15.714% # ( 250, 380 ] 13 9.286% 25.000% ## ( 380, 580 ] 23 16.429% 41.429% ### ( 580, 870 ] 23 16.429% 57.857% ### ( 870, 1300 ] 14 10.000% 67.857% ## ( 1300, 1900 ] 9 6.429% 74.286% # ( 1900, 2900 ] 19 13.571% 87.857% ### ( 2900, 4400 ] 10 7.143% 95.000% # ( 4400, 6600 ] 7 5.000% 100.000% # ** DB Stats ** Uptime(secs): 24.3 total, 5.8 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 242.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.708 H:M:S, 31.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 168.27 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.958 H:M:S, 50.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/14-06:12:25 ... thread 0: (1000000,7000000) ops and (329441.2,257515.7) ops/second in (3.035443,27.182808) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/16 3.56 GB 25.2 6.2 0.0 6.2 12.8 6.6 0.0 1.9 143.3 294.8 44.39 40.67 115 0.386 6459K 14K 0.0 0.0 L1 3/3 135.48 MB 0.0 3.2 2.9 0.4 3.2 2.9 0.1 1.1 235.1 233.0 14.13 13.60 3 4.712 3374K 30K 0.0 0.0 L2 1/0 69.88 MB 0.7 0.1 0.1 0.0 0.1 0.1 2.8 1.8 237.7 237.6 0.47 0.44 1 0.469 113K 29 0.0 0.0 L3 16/0 995.05 MB 1.0 2.4 1.5 0.9 2.4 1.5 1.3 1.6 181.0 180.6 13.82 10.76 13 1.063 2451K 4045 0.0 0.0 L4 165/0 9.72 GB 1.0 0.8 0.5 0.3 0.8 0.5 2.0 1.5 123.7 123.1 6.59 3.77 5 1.318 700K 3381 0.0 0.0 L5 1073/0 88.22 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1275/19 102.67 GB 0.0 12.8 5.0 7.8 19.3 11.5 8.6 2.9 165.1 249.3 79.40 69.24 137 0.580 13M 51K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.8 5.0 7.8 19.3 11.5 8.6 2.9 165.1 249.3 79.40 69.24 137 0.580 13M 51K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.8 5.0 7.8 12.8 4.9 0.0 0.0 220.2 219.2 59.56 52.26 41 1.453 13M 51K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 339.7 19.84 16.98 96 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.4 total, 27.2 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.33 GB write, 723.59 MB/s write, 12.81 GB read, 479.25 MB/s read, 79.4 seconds Interval compaction: 19.33 GB write, 728.33 MB/s write, 12.81 GB read, 482.39 MB/s read, 79.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 28, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2598308 Average: 2.3424 StdDev: 17.94 Min: 0 Median: 1.4839 Max: 6380 Percentiles: P50: 1.48 P75: 1.86 P99: 5.84 P99.9: 12.25 P99.99: 172.51 ------------------------------------------------------ [ 0, 1 ] 471601 18.150% 18.150% #### ( 1, 2 ] 1710132 65.817% 83.967% ############# ( 2, 3 ] 246622 9.492% 93.459% ## ( 3, 4 ] 90516 3.484% 96.943% # ( 4, 6 ] 58178 2.239% 99.182% ( 6, 10 ] 17870 0.688% 99.870% ( 10, 15 ] 1761 0.068% 99.937% ( 15, 22 ] 239 0.009% 99.947% ( 22, 34 ] 28 0.001% 99.948% ( 34, 51 ] 19 0.001% 99.948% ( 51, 76 ] 42 0.002% 99.950% ( 76, 110 ] 465 0.018% 99.968% ( 110, 170 ] 571 0.022% 99.990% ( 170, 250 ] 197 0.008% 99.997% ( 250, 380 ] 134 0.005% 100.003% ( 380, 580 ] 126 0.005% 100.007% ( 580, 870 ] 119 0.005% 100.012% ( 870, 1300 ] 74 0.003% 100.015% ( 1300, 1900 ] 33 0.001% 100.016% ( 1900, 2900 ] 13 0.001% 100.017% ( 2900, 4400 ] 24 0.001% 100.018% ( 4400, 6600 ] 6 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 578446 Average: 3.8020 StdDev: 61.60 Min: 1 Median: 1.7950 Max: 11208 Percentiles: P50: 1.80 P75: 2.66 P99: 7.73 P99.9: 13.06 P99.99: 20.50 ------------------------------------------------------ [ 0, 1 ] 33495 5.791% 5.791% # ( 1, 2 ] 321662 55.608% 61.398% ########### ( 2, 3 ] 118551 20.495% 81.893% #### ( 3, 4 ] 49015 8.474% 90.367% ## ( 4, 6 ] 46439 8.028% 98.395% ## ( 6, 10 ] 8104 1.401% 99.796% ( 10, 15 ] 983 0.170% 99.966% ( 15, 22 ] 177 0.031% 99.997% ( 22, 34 ] 25 0.004% 100.001% ( 34, 51 ] 30 0.005% 100.006% ( 51, 76 ] 26 0.004% 100.011% ( 76, 110 ] 63 0.011% 100.021% ( 110, 170 ] 107 0.018% 100.040% ( 170, 250 ] 57 0.010% 100.050% ( 250, 380 ] 77 0.013% 100.063% ( 380, 580 ] 80 0.014% 100.077% ( 580, 870 ] 53 0.009% 100.086% ( 870, 1300 ] 36 0.006% 100.092% ( 1300, 1900 ] 21 0.004% 100.096% ( 1900, 2900 ] 37 0.006% 100.102% ( 2900, 4400 ] 50 0.009% 100.111% ( 4400, 6600 ] 18 0.003% 100.114% ( 6600, 9900 ] 10 0.002% 100.116% ( 9900, 14000 ] 1 0.000% 100.116% ** Level 2 read latency histogram (micros): Count: 28290 Average: 1.9780 StdDev: 2.71 Min: 1 Median: 1.3849 Max: 272 Percentiles: P50: 1.38 P75: 1.80 P99: 5.24 P99.9: 9.99 P99.99: 176.84 ------------------------------------------------------ [ 0, 1 ] 7517 26.571% 26.571% ##### ( 1, 2 ] 17219 60.866% 87.437% ############ ( 2, 3 ] 2132 7.536% 94.973% ## ( 3, 4 ] 854 3.019% 97.992% # ( 4, 6 ] 458 1.619% 99.611% ( 6, 10 ] 82 0.290% 99.901% ( 10, 15 ] 16 0.057% 99.958% ( 15, 22 ] 7 0.025% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 291694 Average: 8.3733 StdDev: 98.13 Min: 1 Median: 1.7073 Max: 8015 Percentiles: P50: 1.71 P75: 2.43 P99: 12.60 P99.9: 1150.08 P99.99: 2718.34 ------------------------------------------------------ [ 0, 1 ] 21187 7.263% 7.263% # ( 1, 2 ] 176257 60.425% 67.689% ############ ( 2, 3 ] 49076 16.824% 84.513% ### ( 3, 4 ] 21434 7.348% 91.861% # ( 4, 6 ] 14973 5.133% 96.994% # ( 6, 10 ] 5521 1.893% 98.887% ( 10, 15 ] 632 0.217% 99.104% ( 15, 22 ] 104 0.036% 99.140% ( 22, 34 ] 36 0.012% 99.152% ( 34, 51 ] 16 0.005% 99.157% ( 51, 76 ] 6 0.002% 99.159% ( 76, 110 ] 161 0.055% 99.215% ( 110, 170 ] 436 0.149% 99.364% ( 170, 250 ] 279 0.096% 99.460% ( 250, 380 ] 308 0.106% 99.565% ( 380, 580 ] 405 0.139% 99.704% ( 580, 870 ] 400 0.137% 99.841% ( 870, 1300 ] 263 0.090% 99.931% ( 1300, 1900 ] 107 0.037% 99.968% ( 1900, 2900 ] 78 0.027% 99.995% ( 2900, 4400 ] 83 0.028% 100.023% ( 4400, 6600 ] 13 0.004% 100.028% ( 6600, 9900 ] 1 0.000% 100.028% ** Level 4 read latency histogram (micros): Count: 145 Average: 577.2828 StdDev: 1000.60 Min: 1 Median: 3.9000 Max: 4880 Percentiles: P50: 3.90 P75: 833.75 P99: 4880.00 P99.9: 4880.00 P99.99: 4880.00 ------------------------------------------------------ [ 0, 1 ] 18 12.414% 12.414% ## ( 1, 2 ] 38 26.207% 38.621% ##### ( 2, 3 ] 12 8.276% 46.897% ## ( 3, 4 ] 5 3.448% 50.345% # ( 6, 10 ] 2 1.379% 51.724% ( 10, 15 ] 1 0.690% 52.414% ( 15, 22 ] 2 1.379% 53.793% ( 76, 110 ] 1 0.690% 54.483% ( 110, 170 ] 11 7.586% 62.069% ## ( 170, 250 ] 5 3.448% 65.517% # ( 250, 380 ] 2 1.379% 66.897% ( 380, 580 ] 3 2.069% 68.966% ( 580, 870 ] 10 6.897% 75.862% # ( 870, 1300 ] 12 8.276% 84.138% ## ( 1300, 1900 ] 9 6.207% 90.345% # ( 1900, 2900 ] 6 4.138% 94.483% # ( 2900, 4400 ] 6 4.138% 98.621% # ( 4400, 6600 ] 2 1.379% 100.000% ** Level 5 read latency histogram (micros): Count: 140 Average: 1285.6857 StdDev: 1291.95 Min: 87 Median: 731.3043 Max: 5216 Percentiles: P50: 731.30 P75: 1952.63 P99: 5216.00 P99.9: 5216.00 P99.99: 5216.00 ------------------------------------------------------ ( 76, 110 ] 5 3.571% 3.571% # ( 110, 170 ] 7 5.000% 8.571% # ( 170, 250 ] 10 7.143% 15.714% # ( 250, 380 ] 13 9.286% 25.000% ## ( 380, 580 ] 23 16.429% 41.429% ### ( 580, 870 ] 23 16.429% 57.857% ### ( 870, 1300 ] 14 10.000% 67.857% ## ( 1300, 1900 ] 9 6.429% 74.286% # ( 1900, 2900 ] 19 13.571% 87.857% ### ( 2900, 4400 ] 10 7.143% 95.000% # ( 4400, 6600 ] 7 5.000% 100.000% # ** DB Stats ** Uptime(secs): 27.4 total, 3.0 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 251.78 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.095 H:M:S, 29.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.387 H:M:S, 12.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/10/14-06:12:29 ... thread 0: (1000000,8000000) ops and (272948.1,259348.6) ops/second in (3.663700,30.846508) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 4.54 GB 157.3 7.3 0.0 7.3 14.9 7.6 0.0 2.0 145.5 295.6 51.51 47.41 133 0.387 7610K 15K 0.0 0.0 L1 3/3 135.48 MB 0.0 3.2 2.9 0.4 3.2 2.9 0.1 1.1 235.1 233.0 14.13 13.60 3 4.712 3374K 30K 0.0 0.0 L2 1/0 69.88 MB 0.7 0.1 0.1 0.0 0.1 0.1 2.8 1.8 237.7 237.6 0.47 0.44 1 0.469 113K 29 0.0 0.0 L3 16/0 995.05 MB 1.0 2.4 1.5 0.9 2.4 1.5 1.3 1.6 181.0 180.6 13.82 10.76 13 1.063 2451K 4045 0.0 0.0 L4 165/0 9.72 GB 1.0 0.8 0.5 0.3 0.8 0.5 2.0 1.5 123.7 123.1 6.59 3.77 5 1.318 700K 3381 0.0 0.0 L5 1073/0 88.22 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1277/15 103.65 GB 0.0 13.9 5.0 8.9 21.4 12.5 8.6 2.8 164.7 253.6 86.53 75.98 155 0.558 14M 52K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.9 5.0 8.9 21.4 12.5 8.6 2.8 164.7 253.6 86.53 75.98 155 0.558 14M 52K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.9 5.0 8.9 13.9 4.9 0.0 0.0 223.1 222.2 63.86 56.48 45 1.419 14M 52K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 341.9 22.66 19.50 110 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.0 total, 30.8 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.43 GB write, 707.14 MB/s write, 13.91 GB read, 459.21 MB/s read, 86.5 seconds Interval compaction: 21.43 GB write, 711.22 MB/s write, 13.91 GB read, 461.86 MB/s read, 86.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 31, interval: 45 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3091836 Average: 2.3350 StdDev: 17.01 Min: 0 Median: 1.4931 Max: 6380 Percentiles: P50: 1.49 P75: 1.87 P99: 5.82 P99.9: 11.30 P99.99: 152.22 ------------------------------------------------------ [ 0, 1 ] 535293 17.313% 17.313% ### ( 1, 2 ] 2049730 66.295% 83.608% ############# ( 2, 3 ] 305185 9.871% 93.479% ## ( 3, 4 ] 108741 3.517% 96.996% # ( 4, 6 ] 68028 2.200% 99.196% ( 6, 10 ] 21256 0.687% 99.883% ( 10, 15 ] 1960 0.063% 99.947% ( 15, 22 ] 266 0.009% 99.955% ( 22, 34 ] 35 0.001% 99.957% ( 34, 51 ] 21 0.001% 99.957% ( 51, 76 ] 47 0.002% 99.959% ( 76, 110 ] 525 0.017% 99.976% ( 110, 170 ] 625 0.020% 99.996% ( 170, 250 ] 228 0.007% 100.003% ( 250, 380 ] 153 0.005% 100.008% ( 380, 580 ] 143 0.005% 100.013% ( 580, 870 ] 130 0.004% 100.017% ( 870, 1300 ] 82 0.003% 100.020% ( 1300, 1900 ] 34 0.001% 100.021% ( 1900, 2900 ] 14 0.000% 100.021% ( 2900, 4400 ] 27 0.001% 100.022% ( 4400, 6600 ] 6 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 578446 Average: 3.8020 StdDev: 61.60 Min: 1 Median: 1.7950 Max: 11208 Percentiles: P50: 1.80 P75: 2.66 P99: 7.73 P99.9: 13.06 P99.99: 20.50 ------------------------------------------------------ [ 0, 1 ] 33495 5.791% 5.791% # ( 1, 2 ] 321662 55.608% 61.398% ########### ( 2, 3 ] 118551 20.495% 81.893% #### ( 3, 4 ] 49015 8.474% 90.367% ## ( 4, 6 ] 46439 8.028% 98.395% ## ( 6, 10 ] 8104 1.401% 99.796% ( 10, 15 ] 983 0.170% 99.966% ( 15, 22 ] 177 0.031% 99.997% ( 22, 34 ] 25 0.004% 100.001% ( 34, 51 ] 30 0.005% 100.006% ( 51, 76 ] 26 0.004% 100.011% ( 76, 110 ] 63 0.011% 100.021% ( 110, 170 ] 107 0.018% 100.040% ( 170, 250 ] 57 0.010% 100.050% ( 250, 380 ] 77 0.013% 100.063% ( 380, 580 ] 80 0.014% 100.077% ( 580, 870 ] 53 0.009% 100.086% ( 870, 1300 ] 36 0.006% 100.092% ( 1300, 1900 ] 21 0.004% 100.096% ( 1900, 2900 ] 37 0.006% 100.102% ( 2900, 4400 ] 50 0.009% 100.111% ( 4400, 6600 ] 18 0.003% 100.114% ( 6600, 9900 ] 10 0.002% 100.116% ( 9900, 14000 ] 1 0.000% 100.116% ** Level 2 read latency histogram (micros): Count: 28290 Average: 1.9780 StdDev: 2.71 Min: 1 Median: 1.3849 Max: 272 Percentiles: P50: 1.38 P75: 1.80 P99: 5.24 P99.9: 9.99 P99.99: 176.84 ------------------------------------------------------ [ 0, 1 ] 7517 26.571% 26.571% ##### ( 1, 2 ] 17219 60.866% 87.437% ############ ( 2, 3 ] 2132 7.536% 94.973% ## ( 3, 4 ] 854 3.019% 97.992% # ( 4, 6 ] 458 1.619% 99.611% ( 6, 10 ] 82 0.290% 99.901% ( 10, 15 ] 16 0.057% 99.958% ( 15, 22 ] 7 0.025% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 291694 Average: 8.3733 StdDev: 98.13 Min: 1 Median: 1.7073 Max: 8015 Percentiles: P50: 1.71 P75: 2.43 P99: 12.60 P99.9: 1150.08 P99.99: 2718.34 ------------------------------------------------------ [ 0, 1 ] 21187 7.263% 7.263% # ( 1, 2 ] 176257 60.425% 67.689% ############ ( 2, 3 ] 49076 16.824% 84.513% ### ( 3, 4 ] 21434 7.348% 91.861% # ( 4, 6 ] 14973 5.133% 96.994% # ( 6, 10 ] 5521 1.893% 98.887% ( 10, 15 ] 632 0.217% 99.104% ( 15, 22 ] 104 0.036% 99.140% ( 22, 34 ] 36 0.012% 99.152% ( 34, 51 ] 16 0.005% 99.157% ( 51, 76 ] 6 0.002% 99.159% ( 76, 110 ] 161 0.055% 99.215% ( 110, 170 ] 436 0.149% 99.364% ( 170, 250 ] 279 0.096% 99.460% ( 250, 380 ] 308 0.106% 99.565% ( 380, 580 ] 405 0.139% 99.704% ( 580, 870 ] 400 0.137% 99.841% ( 870, 1300 ] 263 0.090% 99.931% ( 1300, 1900 ] 107 0.037% 99.968% ( 1900, 2900 ] 78 0.027% 99.995% ( 2900, 4400 ] 83 0.028% 100.023% ( 4400, 6600 ] 13 0.004% 100.028% ( 6600, 9900 ] 1 0.000% 100.028% ** Level 4 read latency histogram (micros): Count: 145 Average: 577.2828 StdDev: 1000.60 Min: 1 Median: 3.9000 Max: 4880 Percentiles: P50: 3.90 P75: 833.75 P99: 4880.00 P99.9: 4880.00 P99.99: 4880.00 ------------------------------------------------------ [ 0, 1 ] 18 12.414% 12.414% ## ( 1, 2 ] 38 26.207% 38.621% ##### ( 2, 3 ] 12 8.276% 46.897% ## ( 3, 4 ] 5 3.448% 50.345% # ( 6, 10 ] 2 1.379% 51.724% ( 10, 15 ] 1 0.690% 52.414% ( 15, 22 ] 2 1.379% 53.793% ( 76, 110 ] 1 0.690% 54.483% ( 110, 170 ] 11 7.586% 62.069% ## ( 170, 250 ] 5 3.448% 65.517% # ( 250, 380 ] 2 1.379% 66.897% ( 380, 580 ] 3 2.069% 68.966% ( 580, 870 ] 10 6.897% 75.862% # ( 870, 1300 ] 12 8.276% 84.138% ## ( 1300, 1900 ] 9 6.207% 90.345% # ( 1900, 2900 ] 6 4.138% 94.483% # ( 2900, 4400 ] 6 4.138% 98.621% # ( 4400, 6600 ] 2 1.379% 100.000% ** Level 5 read latency histogram (micros): Count: 140 Average: 1285.6857 StdDev: 1291.95 Min: 87 Median: 731.3043 Max: 5216 Percentiles: P50: 731.30 P75: 1952.63 P99: 5216.00 P99.9: 5216.00 P99.99: 5216.00 ------------------------------------------------------ ( 76, 110 ] 5 3.571% 3.571% # ( 110, 170 ] 7 5.000% 8.571% # ( 170, 250 ] 10 7.143% 15.714% # ( 250, 380 ] 13 9.286% 25.000% ## ( 380, 580 ] 23 16.429% 41.429% ### ( 580, 870 ] 23 16.429% 57.857% ### ( 870, 1300 ] 14 10.000% 67.857% ## ( 1300, 1900 ] 9 6.429% 74.286% # ( 1900, 2900 ] 19 13.571% 87.857% ### ( 2900, 4400 ] 10 7.143% 95.000% # ( 4400, 6600 ] 7 5.000% 100.000% # ** DB Stats ** Uptime(secs): 31.0 total, 3.7 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 253.77 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.029 H:M:S, 29.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 268.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.934 H:M:S, 25.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/14-06:12:40 ... thread 0: (1000000,9000000) ops and (92326.3,215943.0) ops/second in (10.831154,41.677662) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 2.70 GB 88.1 8.9 0.0 8.9 17.3 8.5 0.0 2.0 145.5 284.8 62.31 55.72 150 0.415 9208K 18K 0.0 0.0 L1 4/0 479.20 MB 47.9 6.1 5.6 0.5 6.1 5.6 0.1 1.1 232.4 230.0 27.03 26.06 4 6.759 6241K 30K 0.0 0.0 L2 2/1 257.56 MB 1.3 0.1 0.1 0.0 0.1 0.1 5.2 1.8 237.7 237.6 0.47 0.44 1 0.469 113K 29 0.0 0.0 L3 37/11 2.04 GB 1.4 4.5 2.8 1.8 4.5 2.7 2.3 1.6 151.5 150.7 30.64 20.67 20 1.532 4625K 22K 0.0 0.0 L4 177/9 10.83 GB 1.1 2.2 1.6 0.6 2.2 1.6 2.0 1.3 126.7 125.8 17.84 10.42 19 0.939 2166K 14K 0.0 0.0 L5 1073/0 88.22 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1305/29 104.51 GB 0.0 21.8 10.1 11.7 30.2 18.5 12.0 3.6 161.7 223.7 138.29 113.30 194 0.713 22M 85K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.8 10.1 11.7 30.2 18.5 11.9 3.6 161.7 223.7 138.29 113.30 194 0.713 22M 85K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.8 10.1 11.7 21.7 10.0 0.0 0.0 202.1 201.0 110.68 91.26 71 1.559 22M 85K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 314.9 27.61 22.04 123 0.224 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 41.9 total, 41.7 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.21 GB write, 739.12 MB/s write, 21.84 GB read, 534.31 MB/s read, 138.3 seconds Interval compaction: 30.21 GB write, 742.28 MB/s write, 21.84 GB read, 536.59 MB/s read, 138.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 50, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 50, interval: 73 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4093109 Average: 2.5179 StdDev: 30.44 Min: 0 Median: 1.5111 Max: 15299 Percentiles: P50: 1.51 P75: 1.89 P99: 5.95 P99.9: 12.49 P99.99: 169.98 ------------------------------------------------------ [ 0, 1 ] 670067 16.371% 16.371% ### ( 1, 2 ] 2693048 65.795% 82.165% ############# ( 2, 3 ] 429145 10.485% 92.650% ## ( 3, 4 ] 155977 3.811% 96.461% # ( 4, 6 ] 106658 2.606% 99.066% # ( 6, 10 ] 32638 0.797% 99.864% ( 10, 15 ] 2979 0.073% 99.937% ( 15, 22 ] 422 0.010% 99.947% ( 22, 34 ] 51 0.001% 99.948% ( 34, 51 ] 29 0.001% 99.949% ( 51, 76 ] 53 0.001% 99.950% ( 76, 110 ] 773 0.019% 99.969% ( 110, 170 ] 862 0.021% 99.990% ( 170, 250 ] 312 0.008% 99.998% ( 250, 380 ] 219 0.005% 100.003% ( 380, 580 ] 195 0.005% 100.008% ( 580, 870 ] 172 0.004% 100.012% ( 870, 1300 ] 122 0.003% 100.015% ( 1300, 1900 ] 50 0.001% 100.016% ( 1900, 2900 ] 70 0.002% 100.018% ( 2900, 4400 ] 92 0.002% 100.020% ( 4400, 6600 ] 29 0.001% 100.021% ( 6600, 9900 ] 7 0.000% 100.021% ( 9900, 14000 ] 2 0.000% 100.021% ( 14000, 22000 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1213753 Average: 5.7403 StdDev: 99.85 Min: 0 Median: 1.8837 Max: 17344 Percentiles: P50: 1.88 P75: 2.85 P99: 8.73 P99.9: 14.46 P99.99: 93.26 ------------------------------------------------------ [ 0, 1 ] 46098 3.798% 3.798% # ( 1, 2 ] 634552 52.280% 56.078% ########## ( 2, 3 ] 269273 22.185% 78.263% #### ( 3, 4 ] 118319 9.748% 88.011% ## ( 4, 6 ] 116790 9.622% 97.634% ## ( 6, 10 ] 24269 2.000% 99.633% ( 10, 15 ] 3630 0.299% 99.932% ( 15, 22 ] 505 0.042% 99.974% ( 22, 34 ] 39 0.003% 99.977% ( 34, 51 ] 47 0.004% 99.981% ( 51, 76 ] 34 0.003% 99.984% ( 76, 110 ] 149 0.012% 99.996% ( 110, 170 ] 261 0.022% 100.018% ( 170, 250 ] 182 0.015% 100.033% ( 250, 380 ] 277 0.023% 100.055% ( 380, 580 ] 371 0.031% 100.086% ( 580, 870 ] 383 0.032% 100.117% ( 870, 1300 ] 254 0.021% 100.138% ( 1300, 1900 ] 162 0.013% 100.152% ( 1900, 2900 ] 211 0.017% 100.169% ( 2900, 4400 ] 290 0.024% 100.193% ( 4400, 6600 ] 83 0.007% 100.200% ( 6600, 9900 ] 38 0.003% 100.203% ( 9900, 14000 ] 7 0.001% 100.204% ( 14000, 22000 ] 2 0.000% 100.204% ** Level 2 read latency histogram (micros): Count: 28290 Average: 1.9780 StdDev: 2.71 Min: 1 Median: 1.3849 Max: 272 Percentiles: P50: 1.38 P75: 1.80 P99: 5.24 P99.9: 9.99 P99.99: 176.84 ------------------------------------------------------ [ 0, 1 ] 7517 26.571% 26.571% ##### ( 1, 2 ] 17219 60.866% 87.437% ############ ( 2, 3 ] 2132 7.536% 94.973% ## ( 3, 4 ] 854 3.019% 97.992% # ( 4, 6 ] 458 1.619% 99.611% ( 6, 10 ] 82 0.290% 99.901% ( 10, 15 ] 16 0.057% 99.958% ( 15, 22 ] 7 0.025% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 716424 Average: 8.1634 StdDev: 112.03 Min: 1 Median: 1.8734 Max: 16238 Percentiles: P50: 1.87 P75: 2.85 P99: 9.08 P99.9: 481.35 P99.99: 725.78 ------------------------------------------------------ [ 0, 1 ] 26001 3.629% 3.629% # ( 1, 2 ] 380348 53.090% 56.719% ########### ( 2, 3 ] 153401 21.412% 78.131% #### ( 3, 4 ] 74306 10.372% 88.503% ## ( 4, 6 ] 65545 9.149% 97.652% ## ( 6, 10 ] 12547 1.751% 99.403% ( 10, 15 ] 1581 0.221% 99.624% ( 15, 22 ] 232 0.032% 99.656% ( 22, 34 ] 48 0.007% 99.663% ( 34, 51 ] 21 0.003% 99.666% ( 51, 76 ] 12 0.002% 99.668% ( 76, 110 ] 166 0.023% 99.691% ( 110, 170 ] 457 0.064% 99.754% ( 170, 250 ] 326 0.046% 99.800% ( 250, 380 ] 413 0.058% 99.858% ( 380, 580 ] 605 0.084% 99.942% ( 580, 870 ] 689 0.096% 100.038% ( 870, 1300 ] 513 0.072% 100.110% ( 1300, 1900 ] 260 0.036% 100.146% ( 1900, 2900 ] 197 0.027% 100.174% ( 2900, 4400 ] 277 0.039% 100.212% ( 4400, 6600 ] 54 0.008% 100.220% ( 6600, 9900 ] 13 0.002% 100.222% ( 9900, 14000 ] 1 0.000% 100.222% ( 14000, 22000 ] 1 0.000% 100.222% ** Level 4 read latency histogram (micros): Count: 15107 Average: 73.5208 StdDev: 461.28 Min: 1 Median: 2.3555 Max: 8676 Percentiles: P50: 2.36 P75: 3.70 P99: 2602.95 P99.9: 6227.73 P99.99: 8676.00 ------------------------------------------------------ [ 0, 1 ] 134 0.887% 0.887% ( 1, 2 ] 6030 39.915% 40.802% ######## ( 2, 3 ] 3911 25.889% 66.691% ##### ( 3, 4 ] 1783 11.802% 78.493% ## ( 4, 6 ] 2056 13.610% 92.103% ### ( 6, 10 ] 450 2.979% 95.082% # ( 10, 15 ] 66 0.437% 95.519% ( 15, 22 ] 8 0.053% 95.572% ( 22, 34 ] 1 0.007% 95.578% ( 51, 76 ] 3 0.020% 95.598% ( 76, 110 ] 3 0.020% 95.618% ( 110, 170 ] 33 0.218% 95.836% ( 170, 250 ] 29 0.192% 96.028% ( 250, 380 ] 44 0.291% 96.320% ( 380, 580 ] 66 0.437% 96.756% ( 580, 870 ] 118 0.781% 97.538% ( 870, 1300 ] 126 0.834% 98.372% ( 1300, 1900 ] 66 0.437% 98.808% ( 1900, 2900 ] 44 0.291% 99.100% ( 2900, 4400 ] 88 0.583% 99.682% ( 4400, 6600 ] 42 0.278% 99.960% ( 6600, 9900 ] 7 0.046% 100.007% ** Level 5 read latency histogram (micros): Count: 140 Average: 1285.6857 StdDev: 1291.95 Min: 87 Median: 731.3043 Max: 5216 Percentiles: P50: 731.30 P75: 1952.63 P99: 5216.00 P99.9: 5216.00 P99.99: 5216.00 ------------------------------------------------------ ( 76, 110 ] 5 3.571% 3.571% # ( 110, 170 ] 7 5.000% 8.571% # ( 170, 250 ] 10 7.143% 15.714% # ( 250, 380 ] 13 9.286% 25.000% ## ( 380, 580 ] 23 16.429% 41.429% ### ( 580, 870 ] 23 16.429% 57.857% ### ( 870, 1300 ] 14 10.000% 67.857% ## ( 1300, 1900 ] 9 6.429% 74.286% # ( 1900, 2900 ] 19 13.571% 87.857% ### ( 2900, 4400 ] 10 7.143% 95.000% # ( 4400, 6600 ] 7 5.000% 100.000% # ** DB Stats ** Uptime(secs): 41.9 total, 10.8 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 211.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.540 H:M:S, 39.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 90.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.512 H:M:S, 69.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/10/14-06:12:44 ... thread 0: (1000000,10000000) ops and (231307.5,217387.0) ops/second in (4.323250,46.000912) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 3.68 GB 18.9 11.3 0.0 11.3 20.8 9.4 0.0 2.2 147.6 270.8 78.50 68.42 167 0.470 11M 27K 0.0 0.0 L1 4/4 479.20 MB 0.0 6.1 5.6 0.5 6.1 5.6 0.1 1.1 232.4 230.0 27.03 26.06 4 6.759 6241K 30K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 5.2 1.8 237.7 237.6 0.47 0.44 1 0.469 113K 29 0.0 0.0 L3 17/0 953.36 MB 1.0 4.9 2.9 2.0 4.8 2.9 2.4 1.7 151.4 150.5 32.84 22.19 21 1.564 4959K 25K 0.0 0.0 L4 162/0 9.51 GB 1.0 4.6 3.0 1.6 4.5 3.0 2.0 1.5 131.4 130.3 35.74 21.51 39 0.916 4578K 39K 0.0 0.0 L5 1105/0 90.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1301/14 105.45 GB 0.0 27.0 11.6 15.4 36.3 20.9 14.8 3.8 158.4 213.0 174.58 138.62 232 0.753 27M 122K 0.0 0.0 Int 0/0 0.00 KB 0.0 27.0 11.6 15.4 36.3 20.9 14.7 3.8 158.4 213.0 174.58 138.62 232 0.753 27M 122K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 27.0 11.6 15.4 26.8 11.4 0.0 0.0 193.5 192.4 142.88 113.91 96 1.488 27M 122K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 306.0 31.70 24.71 136 0.233 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 46.2 total, 46.0 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 36.32 GB write, 805.29 MB/s write, 27.00 GB read, 598.68 MB/s read, 174.6 seconds Interval compaction: 36.32 GB write, 808.41 MB/s write, 27.00 GB read, 601.00 MB/s read, 174.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 67, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 67, interval: 90 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4463652 Average: 2.6321 StdDev: 33.46 Min: 0 Median: 1.5238 Max: 15299 Percentiles: P50: 1.52 P75: 1.91 P99: 6.07 P99.9: 13.39 P99.99: 227.31 ------------------------------------------------------ [ 0, 1 ] 707081 15.841% 15.841% ### ( 1, 2 ] 2911067 65.217% 81.058% ############# ( 2, 3 ] 486826 10.906% 91.964% ## ( 3, 4 ] 182800 4.095% 96.060% # ( 4, 6 ] 130601 2.926% 98.986% # ( 6, 10 ] 38257 0.857% 99.843% ( 10, 15 ] 3775 0.085% 99.927% ( 15, 22 ] 515 0.012% 99.939% ( 22, 34 ] 55 0.001% 99.940% ( 34, 51 ] 29 0.001% 99.941% ( 51, 76 ] 55 0.001% 99.942% ( 76, 110 ] 852 0.019% 99.961% ( 110, 170 ] 1020 0.023% 99.984% ( 170, 250 ] 382 0.009% 99.992% ( 250, 380 ] 283 0.006% 99.999% ( 380, 580 ] 261 0.006% 100.005% ( 580, 870 ] 248 0.006% 100.010% ( 870, 1300 ] 183 0.004% 100.014% ( 1300, 1900 ] 78 0.002% 100.016% ( 1900, 2900 ] 98 0.002% 100.018% ( 2900, 4400 ] 125 0.003% 100.021% ( 4400, 6600 ] 38 0.001% 100.022% ( 6600, 9900 ] 9 0.000% 100.022% ( 9900, 14000 ] 2 0.000% 100.022% ( 14000, 22000 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1283371 Average: 5.6771 StdDev: 97.71 Min: 0 Median: 1.8838 Max: 17344 Percentiles: P50: 1.88 P75: 2.85 P99: 8.78 P99.9: 14.63 P99.99: 121.92 ------------------------------------------------------ [ 0, 1 ] 47982 3.739% 3.739% # ( 1, 2 ] 671789 52.346% 56.084% ########## ( 2, 3 ] 285669 22.259% 78.344% #### ( 3, 4 ] 124261 9.682% 88.026% ## ( 4, 6 ] 122720 9.562% 97.588% ## ( 6, 10 ] 26061 2.031% 99.619% ( 10, 15 ] 3895 0.303% 99.923% ( 15, 22 ] 542 0.042% 99.965% ( 22, 34 ] 41 0.003% 99.968% ( 34, 51 ] 47 0.004% 99.972% ( 51, 76 ] 34 0.003% 99.974% ( 76, 110 ] 149 0.012% 99.986% ( 110, 170 ] 265 0.021% 100.007% ( 170, 250 ] 189 0.015% 100.021% ( 250, 380 ] 289 0.023% 100.044% ( 380, 580 ] 400 0.031% 100.075% ( 580, 870 ] 421 0.033% 100.108% ( 870, 1300 ] 289 0.023% 100.130% ( 1300, 1900 ] 172 0.013% 100.144% ( 1900, 2900 ] 215 0.017% 100.160% ( 2900, 4400 ] 294 0.023% 100.183% ( 4400, 6600 ] 83 0.006% 100.190% ( 6600, 9900 ] 38 0.003% 100.193% ( 9900, 14000 ] 7 0.001% 100.193% ( 14000, 22000 ] 2 0.000% 100.193% ** Level 2 read latency histogram (micros): Count: 28290 Average: 1.9780 StdDev: 2.71 Min: 1 Median: 1.3849 Max: 272 Percentiles: P50: 1.38 P75: 1.80 P99: 5.24 P99.9: 9.99 P99.99: 176.84 ------------------------------------------------------ [ 0, 1 ] 7517 26.571% 26.571% ##### ( 1, 2 ] 17219 60.866% 87.437% ############ ( 2, 3 ] 2132 7.536% 94.973% ## ( 3, 4 ] 854 3.019% 97.992% # ( 4, 6 ] 458 1.619% 99.611% ( 6, 10 ] 82 0.290% 99.901% ( 10, 15 ] 16 0.057% 99.958% ( 15, 22 ] 7 0.025% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 1080790 Average: 8.0718 StdDev: 109.86 Min: 1 Median: 1.8975 Max: 16238 Percentiles: P50: 1.90 P75: 2.88 P99: 9.19 P99.9: 457.80 P99.99: 691.81 ------------------------------------------------------ [ 0, 1 ] 32339 2.992% 2.992% # ( 1, 2 ] 566051 52.374% 55.366% ########## ( 2, 3 ] 240265 22.230% 77.596% #### ( 3, 4 ] 111456 10.312% 87.909% ## ( 4, 6 ] 103173 9.546% 97.455% ## ( 6, 10 ] 20936 1.937% 99.392% ( 10, 15 ] 2797 0.259% 99.651% ( 15, 22 ] 427 0.040% 99.690% ( 22, 34 ] 62 0.006% 99.696% ( 34, 51 ] 33 0.003% 99.699% ( 51, 76 ] 23 0.002% 99.701% ( 76, 110 ] 216 0.020% 99.721% ( 110, 170 ] 574 0.053% 99.774% ( 170, 250 ] 428 0.040% 99.814% ( 250, 380 ] 576 0.053% 99.867% ( 380, 580 ] 908 0.084% 99.951% ( 580, 870 ] 1084 0.100% 100.052% ( 870, 1300 ] 775 0.072% 100.123% ( 1300, 1900 ] 390 0.036% 100.159% ( 1900, 2900 ] 292 0.027% 100.186% ( 2900, 4400 ] 381 0.035% 100.222% ( 4400, 6600 ] 87 0.008% 100.230% ( 6600, 9900 ] 21 0.002% 100.232% ( 9900, 14000 ] 1 0.000% 100.232% ( 14000, 22000 ] 1 0.000% 100.232% ** Level 4 read latency histogram (micros): Count: 128723 Average: 16.7242 StdDev: 196.03 Min: 1 Median: 2.0497 Max: 8824 Percentiles: P50: 2.05 P75: 3.18 P99: 14.96 P99.9: 2677.11 P99.99: 4084.48 ------------------------------------------------------ [ 0, 1 ] 1793 1.393% 1.393% ( 1, 2 ] 61020 47.404% 48.797% ######### ( 2, 3 ] 31162 24.209% 73.006% ##### ( 3, 4 ] 14099 10.953% 83.959% ## ( 4, 6 ] 15219 11.823% 95.782% ## ( 6, 10 ] 3596 2.794% 98.575% # ( 10, 15 ] 551 0.428% 99.003% ( 15, 22 ] 56 0.044% 99.047% ( 22, 34 ] 7 0.005% 99.052% ( 51, 76 ] 4 0.003% 99.055% ( 76, 110 ] 10 0.008% 99.063% ( 110, 170 ] 46 0.036% 99.099% ( 170, 250 ] 78 0.061% 99.159% ( 250, 380 ] 96 0.075% 99.234% ( 380, 580 ] 186 0.144% 99.379% ( 580, 870 ] 269 0.209% 99.587% ( 870, 1300 ] 226 0.176% 99.763% ( 1300, 1900 ] 111 0.086% 99.849% ( 1900, 2900 ] 84 0.065% 99.915% ( 2900, 4400 ] 123 0.096% 100.010% ( 4400, 6600 ] 57 0.044% 100.054% ( 6600, 9900 ] 10 0.008% 100.062% ** Level 5 read latency histogram (micros): Count: 300 Average: 1361.4567 StdDev: 1339.51 Min: 87 Median: 785.1220 Max: 5858 Percentiles: P50: 785.12 P75: 2095.12 P99: 5858.00 P99.9: 5858.00 P99.99: 5858.00 ------------------------------------------------------ ( 76, 110 ] 7 2.333% 2.333% ( 110, 170 ] 13 4.333% 6.667% # ( 170, 250 ] 26 8.667% 15.333% ## ( 250, 380 ] 24 8.000% 23.333% ## ( 380, 580 ] 51 17.000% 40.333% ### ( 580, 870 ] 41 13.667% 54.000% ### ( 870, 1300 ] 37 12.333% 66.333% ## ( 1300, 1900 ] 18 6.000% 72.333% # ( 1900, 2900 ] 41 13.667% 86.000% ### ( 2900, 4400 ] 28 9.333% 95.333% ## ( 4400, 6600 ] 14 4.667% 100.000% # ** DB Stats ** Uptime(secs): 46.2 total, 4.3 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 213.12 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.038 H:M:S, 39.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 227.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.498 H:M:S, 34.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/10/14-06:12:48 ... thread 0: (1000000,11000000) ops and (274531.8,221580.0) ops/second in (3.642565,49.643477) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 4.66 GB 94.4 12.1 0.0 12.1 22.5 10.4 0.0 2.2 147.0 273.5 84.41 73.97 184 0.459 12M 28K 0.0 0.0 L1 4/4 479.20 MB 0.0 6.1 5.6 0.5 6.1 5.6 0.1 1.1 232.4 230.0 27.03 26.06 4 6.759 6241K 30K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 5.2 1.8 237.7 237.6 0.47 0.44 1 0.469 113K 29 0.0 0.0 L3 17/0 953.36 MB 1.0 4.9 2.9 2.0 4.8 2.9 2.4 1.7 151.4 150.5 32.84 22.19 21 1.564 4959K 25K 0.0 0.0 L4 162/0 9.51 GB 1.0 4.6 3.0 1.6 4.5 3.0 2.0 1.5 131.4 130.3 35.74 21.51 39 0.916 4578K 39K 0.0 0.0 L5 1105/0 90.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1306/18 106.44 GB 0.0 27.8 11.6 16.2 38.1 21.9 14.8 3.6 157.7 216.2 180.49 144.17 249 0.725 28M 123K 0.0 0.0 Int 0/0 0.00 KB 0.0 27.8 11.6 16.2 38.1 21.9 14.7 3.6 157.7 216.2 180.49 144.17 249 0.725 28M 123K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 27.8 11.6 16.2 27.6 11.4 0.0 0.0 195.0 193.9 145.96 116.93 99 1.474 28M 123K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 310.1 34.53 27.24 150 0.230 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.8 total, 49.6 interval Flush(GB): cumulative 10.458, interval 10.458 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 38.10 GB write, 783.07 MB/s write, 27.80 GB read, 571.35 MB/s read, 180.5 seconds Interval compaction: 38.10 GB write, 785.88 MB/s write, 27.80 GB read, 573.40 MB/s read, 180.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 69, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 25, total-stops: 69, interval: 94 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4924992 Average: 2.5906 StdDev: 31.91 Min: 0 Median: 1.5235 Max: 15299 Percentiles: P50: 1.52 P75: 1.91 P99: 5.99 P99.9: 12.85 P99.99: 191.07 ------------------------------------------------------ [ 0, 1 ] 772830 15.692% 15.692% ### ( 1, 2 ] 3227355 65.530% 81.222% ############# ( 2, 3 ] 538576 10.936% 92.158% ## ( 3, 4 ] 198610 4.033% 96.190% # ( 4, 6 ] 138884 2.820% 99.010% # ( 6, 10 ] 41496 0.843% 99.853% ( 10, 15 ] 4072 0.083% 99.936% ( 15, 22 ] 539 0.011% 99.947% ( 22, 34 ] 58 0.001% 99.948% ( 34, 51 ] 31 0.001% 99.948% ( 51, 76 ] 56 0.001% 99.950% ( 76, 110 ] 865 0.018% 99.967% ( 110, 170 ] 1025 0.021% 99.988% ( 170, 250 ] 393 0.008% 99.996% ( 250, 380 ] 294 0.006% 100.002% ( 380, 580 ] 266 0.005% 100.007% ( 580, 870 ] 252 0.005% 100.012% ( 870, 1300 ] 187 0.004% 100.016% ( 1300, 1900 ] 80 0.002% 100.018% ( 1900, 2900 ] 99 0.002% 100.020% ( 2900, 4400 ] 125 0.003% 100.022% ( 4400, 6600 ] 38 0.001% 100.023% ( 6600, 9900 ] 9 0.000% 100.023% ( 9900, 14000 ] 2 0.000% 100.023% ( 14000, 22000 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1283371 Average: 5.6771 StdDev: 97.71 Min: 0 Median: 1.8838 Max: 17344 Percentiles: P50: 1.88 P75: 2.85 P99: 8.78 P99.9: 14.63 P99.99: 121.92 ------------------------------------------------------ [ 0, 1 ] 47982 3.739% 3.739% # ( 1, 2 ] 671789 52.346% 56.084% ########## ( 2, 3 ] 285669 22.259% 78.344% #### ( 3, 4 ] 124261 9.682% 88.026% ## ( 4, 6 ] 122720 9.562% 97.588% ## ( 6, 10 ] 26061 2.031% 99.619% ( 10, 15 ] 3895 0.303% 99.923% ( 15, 22 ] 542 0.042% 99.965% ( 22, 34 ] 41 0.003% 99.968% ( 34, 51 ] 47 0.004% 99.972% ( 51, 76 ] 34 0.003% 99.974% ( 76, 110 ] 149 0.012% 99.986% ( 110, 170 ] 265 0.021% 100.007% ( 170, 250 ] 189 0.015% 100.021% ( 250, 380 ] 289 0.023% 100.044% ( 380, 580 ] 400 0.031% 100.075% ( 580, 870 ] 421 0.033% 100.108% ( 870, 1300 ] 289 0.023% 100.130% ( 1300, 1900 ] 172 0.013% 100.144% ( 1900, 2900 ] 215 0.017% 100.160% ( 2900, 4400 ] 294 0.023% 100.183% ( 4400, 6600 ] 83 0.006% 100.190% ( 6600, 9900 ] 38 0.003% 100.193% ( 9900, 14000 ] 7 0.001% 100.193% ( 14000, 22000 ] 2 0.000% 100.193% ** Level 2 read latency histogram (micros): Count: 28290 Average: 1.9780 StdDev: 2.71 Min: 1 Median: 1.3849 Max: 272 Percentiles: P50: 1.38 P75: 1.80 P99: 5.24 P99.9: 9.99 P99.99: 176.84 ------------------------------------------------------ [ 0, 1 ] 7517 26.571% 26.571% ##### ( 1, 2 ] 17219 60.866% 87.437% ############ ( 2, 3 ] 2132 7.536% 94.973% ## ( 3, 4 ] 854 3.019% 97.992% # ( 4, 6 ] 458 1.619% 99.611% ( 6, 10 ] 82 0.290% 99.901% ( 10, 15 ] 16 0.057% 99.958% ( 15, 22 ] 7 0.025% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 1080790 Average: 8.0718 StdDev: 109.86 Min: 1 Median: 1.8975 Max: 16238 Percentiles: P50: 1.90 P75: 2.88 P99: 9.19 P99.9: 457.80 P99.99: 691.81 ------------------------------------------------------ [ 0, 1 ] 32339 2.992% 2.992% # ( 1, 2 ] 566051 52.374% 55.366% ########## ( 2, 3 ] 240265 22.230% 77.596% #### ( 3, 4 ] 111456 10.312% 87.909% ## ( 4, 6 ] 103173 9.546% 97.455% ## ( 6, 10 ] 20936 1.937% 99.392% ( 10, 15 ] 2797 0.259% 99.651% ( 15, 22 ] 427 0.040% 99.690% ( 22, 34 ] 62 0.006% 99.696% ( 34, 51 ] 33 0.003% 99.699% ( 51, 76 ] 23 0.002% 99.701% ( 76, 110 ] 216 0.020% 99.721% ( 110, 170 ] 574 0.053% 99.774% ( 170, 250 ] 428 0.040% 99.814% ( 250, 380 ] 576 0.053% 99.867% ( 380, 580 ] 908 0.084% 99.951% ( 580, 870 ] 1084 0.100% 100.052% ( 870, 1300 ] 775 0.072% 100.123% ( 1300, 1900 ] 390 0.036% 100.159% ( 1900, 2900 ] 292 0.027% 100.186% ( 2900, 4400 ] 381 0.035% 100.222% ( 4400, 6600 ] 87 0.008% 100.230% ( 6600, 9900 ] 21 0.002% 100.232% ( 9900, 14000 ] 1 0.000% 100.232% ( 14000, 22000 ] 1 0.000% 100.232% ** Level 4 read latency histogram (micros): Count: 128723 Average: 16.7242 StdDev: 196.03 Min: 1 Median: 2.0497 Max: 8824 Percentiles: P50: 2.05 P75: 3.18 P99: 14.96 P99.9: 2677.11 P99.99: 4084.48 ------------------------------------------------------ [ 0, 1 ] 1793 1.393% 1.393% ( 1, 2 ] 61020 47.404% 48.797% ######### ( 2, 3 ] 31162 24.209% 73.006% ##### ( 3, 4 ] 14099 10.953% 83.959% ## ( 4, 6 ] 15219 11.823% 95.782% ## ( 6, 10 ] 3596 2.794% 98.575% # ( 10, 15 ] 551 0.428% 99.003% ( 15, 22 ] 56 0.044% 99.047% ( 22, 34 ] 7 0.005% 99.052% ( 51, 76 ] 4 0.003% 99.055% ( 76, 110 ] 10 0.008% 99.063% ( 110, 170 ] 46 0.036% 99.099% ( 170, 250 ] 78 0.061% 99.159% ( 250, 380 ] 96 0.075% 99.234% ( 380, 580 ] 186 0.144% 99.379% ( 580, 870 ] 269 0.209% 99.587% ( 870, 1300 ] 226 0.176% 99.763% ( 1300, 1900 ] 111 0.086% 99.849% ( 1900, 2900 ] 84 0.065% 99.915% ( 2900, 4400 ] 123 0.096% 100.010% ( 4400, 6600 ] 57 0.044% 100.054% ( 6600, 9900 ] 10 0.008% 100.062% ** Level 5 read latency histogram (micros): Count: 300 Average: 1361.4567 StdDev: 1339.51 Min: 87 Median: 785.1220 Max: 5858 Percentiles: P50: 785.12 P75: 2095.12 P99: 5858.00 P99.9: 5858.00 P99.99: 5858.00 ------------------------------------------------------ ( 76, 110 ] 7 2.333% 2.333% ( 110, 170 ] 13 4.333% 6.667% # ( 170, 250 ] 26 8.667% 15.333% ## ( 250, 380 ] 24 8.000% 23.333% ## ( 380, 580 ] 51 17.000% 40.333% ### ( 580, 870 ] 41 13.667% 54.000% ### ( 870, 1300 ] 37 12.333% 66.333% ## ( 1300, 1900 ] 18 6.000% 72.333% # ( 1900, 2900 ] 41 13.667% 86.000% ### ( 2900, 4400 ] 28 9.333% 95.333% ## ( 4400, 6600 ] 14 4.667% 100.000% # ** DB Stats ** Uptime(secs): 49.8 total, 3.6 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 217.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.976 H:M:S, 38.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 270.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.938 H:M:S, 25.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.122 micros/op 195248 ops/sec 60.021 seconds 11718999 operations; 189.2 MB/s Microseconds per write: Count: 11718999 Average: 5.1217 StdDev: 519.72 Min: 1 Median: 1.7671 Max: 847139 Percentiles: P50: 1.77 P75: 2.81 P99: 9.22 P99.9: 1016.61 P99.99: 2451.91 ------------------------------------------------------ [ 0, 1 ] 1338062 11.418% 11.418% ## ( 1, 2 ] 5894195 50.296% 61.714% ########## ( 2, 3 ] 1927607 16.449% 78.163% ### ( 3, 4 ] 1660603 14.170% 92.333% ### ( 4, 6 ] 668482 5.704% 98.037% # ( 6, 10 ] 140385 1.198% 99.235% ( 10, 15 ] 46611 0.398% 99.633% ( 15, 22 ] 11434 0.098% 99.730% ( 22, 34 ] 2738 0.023% 99.754% ( 34, 51 ] 405 0.003% 99.757% ( 51, 76 ] 47 0.000% 99.757% ( 76, 110 ] 7971 0.068% 99.825% ( 110, 170 ] 3342 0.029% 99.854% ( 170, 250 ] 393 0.003% 99.857% ( 250, 380 ] 208 0.002% 99.859% ( 380, 580 ] 27 0.000% 99.859% ( 580, 870 ] 24 0.000% 99.860% ( 870, 1300 ] 13920 0.119% 99.978% ( 1300, 1900 ] 43 0.000% 99.979% ( 1900, 2900 ] 2410 0.021% 99.999% ( 2900, 4400 ] 54 0.000% 100.000% ( 4400, 6600 ] 4 0.000% 100.000% ( 6600, 9900 ] 2 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 4 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 4 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 212247 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11718999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 12094006968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 596 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 27031746 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 35189340209 rocksdb.compact.write.bytes COUNT : 34983362826 rocksdb.flush.write.bytes COUNT : 12088348133 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 74 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 351 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11990916096 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4695040 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 35103470165 rocksdb.non.last.level.read.count COUNT : 8479607 rocksdb.block.checksum.compute.count COUNT : 8526501 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.402644 P95 : 3.917802 P99 : 7.525523 P100 : 847135.000000 COUNT : 11718999 SUM : 54139424 rocksdb.compaction.times.micros P50 : 998125.000000 P95 : 3964000.000000 P99 : 11816000.000000 P100 : 12899477.000000 COUNT : 104 SUM : 152955876 rocksdb.compaction.times.cpu_micros P50 : 908571.428571 P95 : 3460000.000000 P99 : 11816000.000000 P100 : 12463131.000000 COUNT : 104 SUM : 123682428 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 686.758242 P95 : 5335.000000 P99 : 39290.000000 P100 : 232146.000000 COUNT : 163 SUM : 470089 rocksdb.compaction.outfile.sync.micros P50 : 1196.294118 P95 : 117312.500000 P99 : 193800.000000 P100 : 341762.000000 COUNT : 381 SUM : 8084254 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 104.738095 P95 : 1292.181818 P99 : 3788.000000 P100 : 5028.000000 COUNT : 304 SUM : 97079 rocksdb.table.open.io.micros P50 : 1457.894737 P95 : 8267.368421 P99 : 11966.400000 P100 : 16517.000000 COUNT : 596 SUM : 1361811 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.654232 P95 : 7.553251 P99 : 9.945302 P100 : 18179.000000 COUNT : 8524730 SUM : 51935001 rocksdb.read.block.get.micros P50 : 427.328244 P95 : 3813.235294 P99 : 5849.250000 P100 : 8699.000000 COUNT : 1192 SUM : 1105535 rocksdb.write.raw.block.micros P50 : 0.512256 P95 : 0.973287 P99 : 2.788079 P100 : 19286.000000 COUNT : 11400268 SUM : 24387323 rocksdb.numfiles.in.singlecompaction P50 : 3.226744 P95 : 5.722222 P99 : 13.916667 P100 : 17.000000 COUNT : 165 SUM : 601 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560456 P95 : 1139.663843 P99 : 2273.595647 P100 : 846930.000000 COUNT : 152648 SUM : 27049194 rocksdb.sst.read.micros P50 : 1.606800 P95 : 4.531575 P99 : 7.853536 P100 : 17344.000000 COUNT : 8479819 SUM : 34123325 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11718999 SUM : 12094006968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211071.428571 P95 : 450300.000000 P99 : 1009039.000000 P100 : 1009039.000000 COUNT : 163 SUM : 36903764 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 382 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0