[2024-10-13 06:03:00.899361] Starting SPDK v25.01-pre git sha1 bbce7a874 / DPDK 24.03.0 initialization... [2024-10-13 06:03:00.899627] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2494335 ] Set seed to 1728792180892724 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-10-13 06:03:01.016607] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-10-13 06:03:01.128193] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-10-13 06:03:01.128233] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2494335' to capture a snapshot of events at runtime. [2024-10-13 06:03:01.128244] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-10-13 06:03:01.128255] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-10-13 06:03:01.128263] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2494335 for offline analysis/debug. [2024-10-13 06:03:01.129707] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Oct 13 06:03:09 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/10/13-06:03:12 ... thread 0: (1000000,1000000) ops and (354648.7,354648.7) ops/second in (2.819692,2.819692) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 630.03 MB 6.3 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 348.7 2.35 2.11 12 0.196 0 0 0.0 0.0 L2 3/2 237.36 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 251.2 251.1 1.39 1.34 2 0.695 354K 183 0.0 0.0 L3 11/0 944.88 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 112/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1176/11 96.94 GB 0.0 0.3 0.2 0.2 1.1 1.0 0.0 1.4 93.4 312.4 3.74 3.45 14 0.267 354K 183 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.1 1.0 0.0 1.4 93.4 312.4 3.74 3.45 14 0.267 354K 183 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 251.2 251.1 1.39 1.34 2 0.695 354K 183 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 348.7 2.35 2.11 12 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.14 GB write, 382.02 MB/s write, 0.34 GB read, 114.18 MB/s read, 3.7 seconds Interval compaction: 1.14 GB write, 413.96 MB/s write, 0.34 GB read, 123.73 MB/s read, 3.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 123362 Average: 2.0848 StdDev: 14.67 Min: 1 Median: 1.3863 Max: 3013 Percentiles: P50: 1.39 P75: 1.79 P99: 5.39 P99.9: 9.82 P99.99: 23.99 ------------------------------------------------------ [ 0, 1 ] 32125 26.041% 26.041% ##### ( 1, 2 ] 76511 62.022% 88.063% ############ ( 2, 3 ] 8796 7.130% 95.193% # ( 3, 4 ] 3225 2.614% 97.807% # ( 4, 6 ] 2120 1.719% 99.526% ( 6, 10 ] 485 0.393% 99.919% ( 10, 15 ] 76 0.062% 99.981% ( 15, 22 ] 13 0.011% 99.991% ( 22, 34 ] 4 0.003% 99.994% ( 51, 76 ] 1 0.001% 99.995% ( 110, 170 ] 7 0.006% 100.001% ( 170, 250 ] 3 0.002% 100.003% ( 250, 380 ] 3 0.002% 100.006% ( 380, 580 ] 4 0.003% 100.009% ( 870, 1300 ] 3 0.002% 100.011% ( 1300, 1900 ] 1 0.001% 100.012% ( 1900, 2900 ] 2 0.002% 100.014% ( 2900, 4400 ] 1 0.001% 100.015% ** Level 2 read latency histogram (micros): Count: 71671 Average: 2.3470 StdDev: 26.77 Min: 1 Median: 1.3940 Max: 5697 Percentiles: P50: 1.39 P75: 1.79 P99: 5.89 P99.9: 66.21 P99.99: 700.77 ------------------------------------------------------ [ 0, 1 ] 18187 25.376% 25.376% ##### ( 1, 2 ] 44790 62.494% 87.870% ############ ( 2, 3 ] 4871 6.796% 94.666% # ( 3, 4 ] 1835 2.560% 97.226% # ( 4, 6 ] 1349 1.882% 99.108% ( 6, 10 ] 449 0.626% 99.735% ( 10, 15 ] 69 0.096% 99.831% ( 15, 22 ] 13 0.018% 99.849% ( 22, 34 ] 2 0.003% 99.852% ( 34, 51 ] 11 0.015% 99.867% ( 51, 76 ] 40 0.056% 99.923% ( 76, 110 ] 17 0.024% 99.947% ( 110, 170 ] 12 0.017% 99.964% ( 170, 250 ] 9 0.013% 99.976% ( 250, 380 ] 6 0.008% 99.985% ( 380, 580 ] 4 0.006% 99.990% ( 580, 870 ] 2 0.003% 99.993% ( 870, 1300 ] 3 0.004% 99.997% ( 1900, 2900 ] 2 0.003% 100.000% ( 4400, 6600 ] 1 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 55 Average: 3107.1273 StdDev: 2672.69 Min: 100 Median: 2650.0000 Max: 8958 Percentiles: P50: 2650.00 P75: 4950.00 P99: 8958.00 P99.9: 8958.00 P99.99: 8958.00 ------------------------------------------------------ ( 76, 110 ] 1 1.818% 1.818% ( 170, 250 ] 4 7.273% 9.091% # ( 250, 380 ] 3 5.455% 14.545% # ( 380, 580 ] 7 12.727% 27.273% ### ( 580, 870 ] 3 5.455% 32.727% # ( 870, 1300 ] 1 1.818% 34.545% ( 1300, 1900 ] 7 12.727% 47.273% ### ( 1900, 2900 ] 2 3.636% 50.909% # ( 2900, 4400 ] 11 20.000% 70.909% #### ( 4400, 6600 ] 9 16.364% 87.273% ### ( 6600, 9900 ] 7 12.727% 100.000% ### ** Level 4 read latency histogram (micros): Count: 20 Average: 3401.0500 StdDev: 1978.72 Min: 150 Median: 3275.0000 Max: 7102 Percentiles: P50: 3275.00 P75: 5133.33 P99: 7102.00 P99.9: 7102.00 P99.99: 7102.00 ------------------------------------------------------ ( 110, 170 ] 1 5.000% 5.000% # ( 170, 250 ] 1 5.000% 10.000% # ( 580, 870 ] 1 5.000% 15.000% # ( 870, 1300 ] 1 5.000% 20.000% # ( 1300, 1900 ] 2 10.000% 30.000% ## ( 1900, 2900 ] 3 15.000% 45.000% ### ( 2900, 4400 ] 4 20.000% 65.000% #### ( 4400, 6600 ] 6 30.000% 95.000% ###### ( 6600, 9900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 321.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.216 H:M:S, 7.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 348.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.216 H:M:S, 7.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/10/13-06:03:15 ... thread 0: (1000000,2000000) ops and (304352.9,327581.5) ops/second in (3.285659,6.105351) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/10 1.35 GB 0.0 0.8 0.0 0.8 2.6 1.8 0.0 1.4 94.7 313.3 8.64 7.96 29 0.298 831K 851 0.0 0.0 L1 1/1 3.24 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 236.1 235.8 1.33 1.30 1 1.334 319K 387 0.0 0.0 L2 2/1 147.68 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.3 1.8 251.2 251.1 1.39 1.34 2 0.695 354K 183 0.0 0.0 L3 20/11 1.15 GB 0.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 216.4 216.4 0.86 0.79 1 0.864 189K 0 0.0 0.0 L4 170/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 124.2 124.2 1.36 0.93 1 1.357 171K 0 0.0 0.0 L5 1040/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1243/23 97.98 GB 0.0 1.8 0.8 1.0 3.6 2.7 0.7 2.0 135.3 274.2 13.59 12.32 34 0.400 1866K 1421 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.8 1.0 3.6 2.7 0.7 2.0 135.3 274.2 13.59 12.32 34 0.400 1866K 1421 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.8 1.0 1.8 0.8 0.0 0.0 225.6 225.4 8.15 7.51 8 1.019 1866K 1421 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 347.4 5.44 4.82 26 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.3 total, 6.1 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.64 GB write, 587.60 MB/s write, 1.80 GB read, 289.87 MB/s read, 13.6 seconds Interval compaction: 3.64 GB write, 610.29 MB/s write, 1.80 GB read, 301.07 MB/s read, 13.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 388676 Average: 2.3140 StdDev: 11.97 Min: 0 Median: 1.5561 Max: 3168 Percentiles: P50: 1.56 P75: 1.94 P99: 5.77 P99.9: 10.68 P99.99: 16.13 ------------------------------------------------------ [ 0, 1 ] 54514 14.026% 14.026% ### ( 1, 2 ] 251418 64.686% 78.711% ############# ( 2, 3 ] 54171 13.937% 92.649% ### ( 3, 4 ] 14758 3.797% 96.446% # ( 4, 6 ] 11243 2.893% 99.338% # ( 6, 10 ] 2131 0.548% 99.887% ( 10, 15 ] 398 0.102% 99.989% ( 15, 22 ] 38 0.010% 99.999% ( 22, 34 ] 8 0.002% 100.001% ( 51, 76 ] 2 0.001% 100.001% ( 110, 170 ] 9 0.002% 100.004% ( 170, 250 ] 12 0.003% 100.007% ( 250, 380 ] 7 0.002% 100.008% ( 380, 580 ] 8 0.002% 100.011% ( 580, 870 ] 6 0.002% 100.012% ( 870, 1300 ] 6 0.002% 100.014% ( 1300, 1900 ] 6 0.002% 100.015% ( 1900, 2900 ] 2 0.001% 100.016% ( 2900, 4400 ] 2 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 21 Average: 196.0000 StdDev: 440.70 Min: 1 Median: 1.5000 Max: 1967 Percentiles: P50: 1.50 P75: 230.00 P99: 1967.00 P99.9: 1967.00 P99.99: 1967.00 ------------------------------------------------------ [ 0, 1 ] 8 38.095% 38.095% ######## ( 1, 2 ] 5 23.810% 61.905% ##### ( 4, 6 ] 2 9.524% 71.429% ## ( 170, 250 ] 1 4.762% 76.190% # ( 250, 380 ] 1 4.762% 80.952% # ( 380, 580 ] 2 9.524% 90.476% ## ( 580, 870 ] 1 4.762% 95.238% # ( 1900, 2900 ] 1 4.762% 100.000% # ** Level 2 read latency histogram (micros): Count: 88497 Average: 2.3790 StdDev: 24.10 Min: 1 Median: 1.4594 Max: 5697 Percentiles: P50: 1.46 P75: 1.86 P99: 5.92 P99.9: 55.69 P99.99: 537.51 ------------------------------------------------------ [ 0, 1 ] 18912 21.370% 21.370% #### ( 1, 2 ] 55153 62.322% 83.692% ############ ( 2, 3 ] 8774 9.914% 93.607% ## ( 3, 4 ] 2703 3.054% 96.661% # ( 4, 6 ] 2157 2.437% 99.098% ( 6, 10 ] 562 0.635% 99.733% ( 10, 15 ] 110 0.124% 99.858% ( 15, 22 ] 17 0.019% 99.877% ( 22, 34 ] 2 0.002% 99.879% ( 34, 51 ] 11 0.012% 99.892% ( 51, 76 ] 40 0.045% 99.937% ( 76, 110 ] 17 0.019% 99.956% ( 110, 170 ] 12 0.014% 99.969% ( 170, 250 ] 9 0.010% 99.980% ( 250, 380 ] 6 0.007% 99.986% ( 380, 580 ] 4 0.005% 99.991% ( 580, 870 ] 2 0.002% 99.993% ( 870, 1300 ] 3 0.003% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 214758 Average: 3.9307 StdDev: 67.56 Min: 1 Median: 1.6799 Max: 8958 Percentiles: P50: 1.68 P75: 2.27 P99: 8.89 P99.9: 185.69 P99.99: 536.98 ------------------------------------------------------ [ 0, 1 ] 17021 7.926% 7.926% ## ( 1, 2 ] 132897 61.882% 69.808% ############ ( 2, 3 ] 41641 19.390% 89.198% #### ( 3, 4 ] 9457 4.404% 93.601% # ( 4, 6 ] 8816 4.105% 97.706% # ( 6, 10 ] 3846 1.791% 99.497% ( 10, 15 ] 392 0.183% 99.680% ( 15, 22 ] 45 0.021% 99.701% ( 22, 34 ] 7 0.003% 99.704% ( 34, 51 ] 1 0.000% 99.704% ( 51, 76 ] 1 0.000% 99.705% ( 76, 110 ] 124 0.058% 99.763% ( 110, 170 ] 277 0.129% 99.892% ( 170, 250 ] 93 0.043% 99.935% ( 250, 380 ] 73 0.034% 99.969% ( 380, 580 ] 58 0.027% 99.996% ( 580, 870 ] 29 0.014% 100.009% ( 870, 1300 ] 9 0.004% 100.014% ( 1300, 1900 ] 8 0.004% 100.017% ( 1900, 2900 ] 3 0.001% 100.019% ( 2900, 4400 ] 11 0.005% 100.024% ( 4400, 6600 ] 9 0.004% 100.028% ( 6600, 9900 ] 7 0.003% 100.031% ** Level 4 read latency histogram (micros): Count: 310 Average: 226.6290 StdDev: 973.84 Min: 1 Median: 2.7475 Max: 7102 Percentiles: P50: 2.75 P75: 6.74 P99: 5830.00 P99.9: 7102.00 P99.99: 7102.00 ------------------------------------------------------ [ 0, 1 ] 8 2.581% 2.581% # ( 1, 2 ] 73 23.548% 26.129% ##### ( 2, 3 ] 99 31.935% 58.065% ###### ( 3, 4 ] 39 12.581% 70.645% ### ( 4, 6 ] 10 3.226% 73.871% # ( 6, 10 ] 19 6.129% 80.000% # ( 10, 15 ] 23 7.419% 87.419% # ( 15, 22 ] 15 4.839% 92.258% # ( 22, 34 ] 1 0.323% 92.581% ( 76, 110 ] 1 0.323% 92.903% ( 110, 170 ] 1 0.323% 93.226% ( 170, 250 ] 1 0.323% 93.548% ( 250, 380 ] 1 0.323% 93.871% ( 380, 580 ] 1 0.323% 94.194% ( 580, 870 ] 1 0.323% 94.516% ( 870, 1300 ] 1 0.323% 94.839% ( 1300, 1900 ] 2 0.645% 95.484% ( 1900, 2900 ] 3 0.968% 96.452% ( 2900, 4400 ] 4 1.290% 97.742% ( 4400, 6600 ] 6 1.935% 99.677% ( 6600, 9900 ] 1 0.323% 100.000% ** DB Stats ** Uptime(secs): 6.3 total, 3.3 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 310.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.829 H:M:S, 13.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 299.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.613 H:M:S, 18.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/10/13-06:03:18 ... thread 0: (1000000,3000000) ops and (326043.5,327067.2) ops/second in (3.067075,9.172426) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 2.27 GB 100.7 1.7 0.0 1.7 4.4 2.8 0.0 1.6 115.2 307.0 14.77 13.73 45 0.328 1727K 1824 0.0 0.0 L1 1/1 3.24 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 236.1 235.8 1.33 1.30 1 1.334 319K 387 0.0 0.0 L2 1/0 97.28 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.3 1.8 251.2 251.1 1.39 1.34 2 0.695 354K 183 0.0 0.0 L3 21/0 968.38 MB 1.0 1.2 0.2 0.9 1.2 0.2 0.2 5.0 235.0 234.6 5.03 4.63 2 2.516 1200K 1867 0.0 0.0 L4 170/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 124.2 124.2 1.36 0.93 1 1.357 171K 0 0.0 0.0 L5 1044/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1251/11 98.90 GB 0.0 3.6 0.9 2.7 6.4 3.7 1.3 2.3 155.6 274.1 23.88 21.92 51 0.468 3773K 4261 0.0 0.0 Int 0/0 0.00 KB 0.0 3.6 0.9 2.7 6.4 3.7 1.3 2.3 155.6 274.1 23.88 21.92 51 0.468 3773K 4261 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.6 0.9 2.7 3.6 0.9 0.0 0.0 236.8 236.6 15.69 14.67 12 1.307 3773K 4261 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 346.2 8.19 7.26 39 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.4 total, 9.2 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.39 GB write, 695.68 MB/s write, 3.63 GB read, 394.88 MB/s read, 23.9 seconds Interval compaction: 6.39 GB write, 713.57 MB/s write, 3.63 GB read, 405.04 MB/s read, 23.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 819211 Average: 2.3680 StdDev: 9.95 Min: 0 Median: 1.6045 Max: 3168 Percentiles: P50: 1.60 P75: 1.99 P99: 5.79 P99.9: 9.89 P99.99: 13.78 ------------------------------------------------------ [ 0, 1 ] 87150 10.638% 10.638% ## ( 1, 2 ] 533402 65.112% 75.750% ############# ( 2, 3 ] 131413 16.041% 91.791% ### ( 3, 4 ] 34103 4.163% 95.954% # ( 4, 6 ] 27864 3.401% 99.356% # ( 6, 10 ] 4590 0.560% 99.916% ( 10, 15 ] 804 0.098% 100.014% ( 15, 22 ] 58 0.007% 100.021% ( 22, 34 ] 10 0.001% 100.022% ( 34, 51 ] 2 0.000% 100.023% ( 51, 76 ] 5 0.001% 100.023% ( 76, 110 ] 17 0.002% 100.025% ( 110, 170 ] 17 0.002% 100.027% ( 170, 250 ] 19 0.002% 100.030% ( 250, 380 ] 13 0.002% 100.031% ( 380, 580 ] 13 0.002% 100.033% ( 580, 870 ] 13 0.002% 100.034% ( 870, 1300 ] 10 0.001% 100.036% ( 1300, 1900 ] 8 0.001% 100.037% ( 1900, 2900 ] 4 0.000% 100.037% ( 2900, 4400 ] 2 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 21 Average: 196.0000 StdDev: 440.70 Min: 1 Median: 1.5000 Max: 1967 Percentiles: P50: 1.50 P75: 230.00 P99: 1967.00 P99.9: 1967.00 P99.99: 1967.00 ------------------------------------------------------ [ 0, 1 ] 8 38.095% 38.095% ######## ( 1, 2 ] 5 23.810% 61.905% ##### ( 4, 6 ] 2 9.524% 71.429% ## ( 170, 250 ] 1 4.762% 76.190% # ( 250, 380 ] 1 4.762% 80.952% # ( 380, 580 ] 2 9.524% 90.476% ## ( 580, 870 ] 1 4.762% 95.238% # ( 1900, 2900 ] 1 4.762% 100.000% # ** Level 2 read latency histogram (micros): Count: 100943 Average: 2.4288 StdDev: 22.78 Min: 1 Median: 1.4925 Max: 5697 Percentiles: P50: 1.49 P75: 1.89 P99: 6.00 P99.9: 56.66 P99.99: 525.28 ------------------------------------------------------ [ 0, 1 ] 19447 19.265% 19.265% #### ( 1, 2 ] 62989 62.401% 81.666% ############ ( 2, 3 ] 11174 11.070% 92.736% ## ( 3, 4 ] 3464 3.432% 96.167% # ( 4, 6 ] 2862 2.835% 99.002% # ( 6, 10 ] 742 0.735% 99.737% ( 10, 15 ] 122 0.121% 99.858% ( 15, 22 ] 19 0.019% 99.877% ( 22, 34 ] 2 0.002% 99.879% ( 34, 51 ] 12 0.012% 99.891% ( 51, 76 ] 40 0.040% 99.931% ( 76, 110 ] 22 0.022% 99.952% ( 110, 170 ] 16 0.016% 99.968% ( 170, 250 ] 10 0.010% 99.978% ( 250, 380 ] 9 0.009% 99.987% ( 380, 580 ] 4 0.004% 99.991% ( 580, 870 ] 3 0.003% 99.994% ( 870, 1300 ] 3 0.003% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 282773 Average: 3.7848 StdDev: 59.75 Min: 1 Median: 1.6957 Max: 8958 Percentiles: P50: 1.70 P75: 2.31 P99: 8.91 P99.9: 195.43 P99.99: 585.11 ------------------------------------------------------ [ 0, 1 ] 19767 6.990% 6.990% # ( 1, 2 ] 174823 61.825% 68.815% ############ ( 2, 3 ] 55527 19.637% 88.452% #### ( 3, 4 ] 13526 4.783% 93.235% # ( 4, 6 ] 12472 4.411% 97.645% # ( 6, 10 ] 5261 1.861% 99.506% ( 10, 15 ] 535 0.189% 99.695% ( 15, 22 ] 53 0.019% 99.714% ( 22, 34 ] 8 0.003% 99.717% ( 34, 51 ] 3 0.001% 99.718% ( 51, 76 ] 1 0.000% 99.718% ( 76, 110 ] 130 0.046% 99.764% ( 110, 170 ] 341 0.121% 99.885% ( 170, 250 ] 136 0.048% 99.933% ( 250, 380 ] 90 0.032% 99.965% ( 380, 580 ] 71 0.025% 99.990% ( 580, 870 ] 41 0.014% 100.004% ( 870, 1300 ] 15 0.005% 100.010% ( 1300, 1900 ] 9 0.003% 100.013% ( 1900, 2900 ] 4 0.001% 100.014% ( 2900, 4400 ] 11 0.004% 100.018% ( 4400, 6600 ] 9 0.003% 100.021% ( 6600, 9900 ] 7 0.002% 100.024% ** Level 4 read latency histogram (micros): Count: 310 Average: 226.6290 StdDev: 973.84 Min: 1 Median: 2.7475 Max: 7102 Percentiles: P50: 2.75 P75: 6.74 P99: 5830.00 P99.9: 7102.00 P99.99: 7102.00 ------------------------------------------------------ [ 0, 1 ] 8 2.581% 2.581% # ( 1, 2 ] 73 23.548% 26.129% ##### ( 2, 3 ] 99 31.935% 58.065% ###### ( 3, 4 ] 39 12.581% 70.645% ### ( 4, 6 ] 10 3.226% 73.871% # ( 6, 10 ] 19 6.129% 80.000% # ( 10, 15 ] 23 7.419% 87.419% # ( 15, 22 ] 15 4.839% 92.258% # ( 22, 34 ] 1 0.323% 92.581% ( 76, 110 ] 1 0.323% 92.903% ( 110, 170 ] 1 0.323% 93.226% ( 170, 250 ] 1 0.323% 93.548% ( 250, 380 ] 1 0.323% 93.871% ( 380, 580 ] 1 0.323% 94.194% ( 580, 870 ] 1 0.323% 94.516% ( 870, 1300 ] 1 0.323% 94.839% ( 1300, 1900 ] 2 0.645% 95.484% ( 1900, 2900 ] 3 0.968% 96.452% ( 2900, 4400 ] 4 1.290% 97.742% ( 4400, 6600 ] 6 1.935% 99.677% ( 6600, 9900 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 909.4000 StdDev: 1040.54 Min: 89 Median: 336.6667 Max: 3734 Percentiles: P50: 336.67 P75: 1600.00 P99: 3734.00 P99.9: 3734.00 P99.99: 3734.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 3 15.000% 30.000% ### ( 170, 250 ] 2 10.000% 40.000% ## ( 250, 380 ] 3 15.000% 55.000% ### ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.4 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 313.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.243 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.414 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/13-06:03:21 ... thread 0: (1000000,4000000) ops and (336034.4,329263.9) ops/second in (2.975886,12.148312) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.15 GB 188.8 2.5 0.0 2.5 6.2 3.7 0.0 1.7 121.1 305.6 20.81 19.41 62 0.336 2558K 2647 0.0 0.0 L1 10/0 1.04 GB 106.8 1.4 1.4 0.0 1.4 1.3 0.2 1.0 227.0 226.2 6.11 5.93 2 3.057 1409K 5019 0.0 0.0 L2 1/0 97.28 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.3 1.8 251.2 251.1 1.39 1.34 2 0.695 354K 183 0.0 0.0 L3 21/0 968.38 MB 1.0 1.2 0.2 0.9 1.2 0.2 0.2 5.0 235.0 234.6 5.03 4.63 2 2.516 1200K 1867 0.0 0.0 L4 170/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 124.2 124.2 1.36 0.93 1 1.357 171K 0 0.0 0.0 L5 1044/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1258/4 99.82 GB 0.0 5.5 1.9 3.5 9.2 5.7 1.3 2.5 161.6 272.1 34.70 32.23 69 0.503 5694K 9716 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 1.9 3.5 9.2 5.7 1.3 2.5 161.6 272.1 34.70 32.23 69 0.503 5694K 9716 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 1.9 3.5 5.5 1.9 0.0 0.0 237.4 237.0 23.62 22.37 16 1.476 5694K 9716 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 346.8 11.08 9.87 53 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.22 GB write, 762.23 MB/s write, 5.48 GB read, 452.78 MB/s read, 34.7 seconds Interval compaction: 9.22 GB write, 777.03 MB/s write, 5.48 GB read, 461.57 MB/s read, 34.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1066600 Average: 2.3079 StdDev: 10.57 Min: 0 Median: 1.5574 Max: 3168 Percentiles: P50: 1.56 P75: 1.94 P99: 5.73 P99.9: 9.97 P99.99: 14.58 ------------------------------------------------------ [ 0, 1 ] 144328 13.532% 13.532% ### ( 1, 2 ] 697804 65.423% 78.955% ############# ( 2, 3 ] 148638 13.936% 92.890% ### ( 3, 4 ] 38684 3.627% 96.517% # ( 4, 6 ] 30639 2.873% 99.390% # ( 6, 10 ] 5483 0.514% 99.904% ( 10, 15 ] 1001 0.094% 99.998% ( 15, 22 ] 86 0.008% 100.006% ( 22, 34 ] 11 0.001% 100.007% ( 34, 51 ] 2 0.000% 100.007% ( 51, 76 ] 8 0.001% 100.008% ( 76, 110 ] 38 0.004% 100.011% ( 110, 170 ] 65 0.006% 100.018% ( 170, 250 ] 35 0.003% 100.021% ( 250, 380 ] 33 0.003% 100.024% ( 380, 580 ] 23 0.002% 100.026% ( 580, 870 ] 23 0.002% 100.028% ( 870, 1300 ] 13 0.001% 100.029% ( 1300, 1900 ] 8 0.001% 100.030% ( 1900, 2900 ] 5 0.000% 100.031% ( 2900, 4400 ] 4 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 893 Average: 39.5118 StdDev: 174.84 Min: 1 Median: 1.7626 Max: 2397 Percentiles: P50: 1.76 P75: 2.68 P99: 780.10 P99.9: 2397.00 P99.99: 2397.00 ------------------------------------------------------ [ 0, 1 ] 98 10.974% 10.974% ## ( 1, 2 ] 457 51.176% 62.150% ########## ( 2, 3 ] 169 18.925% 81.075% #### ( 3, 4 ] 45 5.039% 86.114% # ( 4, 6 ] 19 2.128% 88.242% ( 6, 10 ] 13 1.456% 89.698% ( 10, 15 ] 3 0.336% 90.034% ( 76, 110 ] 10 1.120% 91.153% ( 110, 170 ] 25 2.800% 93.953% # ( 170, 250 ] 14 1.568% 95.521% ( 250, 380 ] 13 1.456% 96.976% ( 380, 580 ] 16 1.792% 98.768% ( 580, 870 ] 3 0.336% 99.104% ( 870, 1300 ] 2 0.224% 99.328% ( 1300, 1900 ] 4 0.448% 99.776% ( 1900, 2900 ] 2 0.224% 100.000% ** Level 2 read latency histogram (micros): Count: 100943 Average: 2.4288 StdDev: 22.78 Min: 1 Median: 1.4925 Max: 5697 Percentiles: P50: 1.49 P75: 1.89 P99: 6.00 P99.9: 56.66 P99.99: 525.28 ------------------------------------------------------ [ 0, 1 ] 19447 19.265% 19.265% #### ( 1, 2 ] 62989 62.401% 81.666% ############ ( 2, 3 ] 11174 11.070% 92.736% ## ( 3, 4 ] 3464 3.432% 96.167% # ( 4, 6 ] 2862 2.835% 99.002% # ( 6, 10 ] 742 0.735% 99.737% ( 10, 15 ] 122 0.121% 99.858% ( 15, 22 ] 19 0.019% 99.877% ( 22, 34 ] 2 0.002% 99.879% ( 34, 51 ] 12 0.012% 99.891% ( 51, 76 ] 40 0.040% 99.931% ( 76, 110 ] 22 0.022% 99.952% ( 110, 170 ] 16 0.016% 99.968% ( 170, 250 ] 10 0.010% 99.978% ( 250, 380 ] 9 0.009% 99.987% ( 380, 580 ] 4 0.004% 99.991% ( 580, 870 ] 3 0.003% 99.994% ( 870, 1300 ] 3 0.003% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 282773 Average: 3.7848 StdDev: 59.75 Min: 1 Median: 1.6957 Max: 8958 Percentiles: P50: 1.70 P75: 2.31 P99: 8.91 P99.9: 195.43 P99.99: 585.11 ------------------------------------------------------ [ 0, 1 ] 19767 6.990% 6.990% # ( 1, 2 ] 174823 61.825% 68.815% ############ ( 2, 3 ] 55527 19.637% 88.452% #### ( 3, 4 ] 13526 4.783% 93.235% # ( 4, 6 ] 12472 4.411% 97.645% # ( 6, 10 ] 5261 1.861% 99.506% ( 10, 15 ] 535 0.189% 99.695% ( 15, 22 ] 53 0.019% 99.714% ( 22, 34 ] 8 0.003% 99.717% ( 34, 51 ] 3 0.001% 99.718% ( 51, 76 ] 1 0.000% 99.718% ( 76, 110 ] 130 0.046% 99.764% ( 110, 170 ] 341 0.121% 99.885% ( 170, 250 ] 136 0.048% 99.933% ( 250, 380 ] 90 0.032% 99.965% ( 380, 580 ] 71 0.025% 99.990% ( 580, 870 ] 41 0.014% 100.004% ( 870, 1300 ] 15 0.005% 100.010% ( 1300, 1900 ] 9 0.003% 100.013% ( 1900, 2900 ] 4 0.001% 100.014% ( 2900, 4400 ] 11 0.004% 100.018% ( 4400, 6600 ] 9 0.003% 100.021% ( 6600, 9900 ] 7 0.002% 100.024% ** Level 4 read latency histogram (micros): Count: 310 Average: 226.6290 StdDev: 973.84 Min: 1 Median: 2.7475 Max: 7102 Percentiles: P50: 2.75 P75: 6.74 P99: 5830.00 P99.9: 7102.00 P99.99: 7102.00 ------------------------------------------------------ [ 0, 1 ] 8 2.581% 2.581% # ( 1, 2 ] 73 23.548% 26.129% ##### ( 2, 3 ] 99 31.935% 58.065% ###### ( 3, 4 ] 39 12.581% 70.645% ### ( 4, 6 ] 10 3.226% 73.871% # ( 6, 10 ] 19 6.129% 80.000% # ( 10, 15 ] 23 7.419% 87.419% # ( 15, 22 ] 15 4.839% 92.258% # ( 22, 34 ] 1 0.323% 92.581% ( 76, 110 ] 1 0.323% 92.903% ( 110, 170 ] 1 0.323% 93.226% ( 170, 250 ] 1 0.323% 93.548% ( 250, 380 ] 1 0.323% 93.871% ( 380, 580 ] 1 0.323% 94.194% ( 580, 870 ] 1 0.323% 94.516% ( 870, 1300 ] 1 0.323% 94.839% ( 1300, 1900 ] 2 0.645% 95.484% ( 1900, 2900 ] 3 0.968% 96.452% ( 2900, 4400 ] 4 1.290% 97.742% ( 4400, 6600 ] 6 1.935% 99.677% ( 6600, 9900 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 909.4000 StdDev: 1040.54 Min: 89 Median: 336.6667 Max: 3734 Percentiles: P50: 336.67 P75: 1600.00 P99: 3734.00 P99.9: 3734.00 P99.99: 3734.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 3 15.000% 30.000% ### ( 170, 250 ] 2 10.000% 40.000% ## ( 250, 380 ] 3 15.000% 55.000% ### ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.4 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 317.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.623 H:M:S, 13.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.72 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.380 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/10/13-06:03:24 ... thread 0: (1000000,5000000) ops and (333424.1,330087.6) ops/second in (2.999183,15.147495) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/16 3.13 GB 25.2 3.3 0.0 3.3 7.9 4.7 0.0 1.7 125.9 306.2 26.53 24.80 78 0.340 3390K 3463 0.0 0.0 L1 10/10 1.04 GB 0.0 1.4 1.4 0.0 1.4 1.3 0.2 1.0 227.0 226.2 6.11 5.93 2 3.057 1409K 5019 0.0 0.0 L2 1/0 97.28 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.3 1.8 251.2 251.1 1.39 1.34 2 0.695 354K 183 0.0 0.0 L3 21/0 968.38 MB 1.0 1.2 0.2 0.9 1.2 0.2 0.2 5.0 235.0 234.6 5.03 4.63 2 2.516 1200K 1867 0.0 0.0 L4 170/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 124.2 124.2 1.36 0.93 1 1.357 171K 0 0.0 0.0 L5 1044/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1263/26 100.80 GB 0.0 6.3 1.9 4.3 10.9 6.6 1.3 2.3 159.0 277.2 40.42 37.63 85 0.476 6526K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.3 1.9 4.3 10.9 6.6 1.3 2.3 159.0 277.2 40.42 37.63 85 0.476 6526K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.3 1.9 4.3 6.3 1.9 0.0 0.0 240.8 240.4 26.69 25.38 19 1.405 6526K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 348.6 13.73 12.24 66 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.4 total, 15.1 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.94 GB write, 728.23 MB/s write, 6.28 GB read, 417.75 MB/s read, 40.4 seconds Interval compaction: 10.94 GB write, 739.57 MB/s write, 6.28 GB read, 424.25 MB/s read, 40.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 21, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1318773 Average: 2.2850 StdDev: 10.76 Min: 0 Median: 1.5416 Max: 3168 Percentiles: P50: 1.54 P75: 1.92 P99: 5.68 P99.9: 10.16 P99.99: 14.96 ------------------------------------------------------ [ 0, 1 ] 189585 14.376% 14.376% ### ( 1, 2 ] 867367 65.771% 80.147% ############# ( 2, 3 ] 175307 13.293% 93.440% ### ( 3, 4 ] 44424 3.369% 96.808% # ( 4, 6 ] 34388 2.608% 99.416% # ( 6, 10 ] 6344 0.481% 99.897% ( 10, 15 ] 1236 0.094% 99.991% ( 15, 22 ] 104 0.008% 99.999% ( 22, 34 ] 15 0.001% 100.000% ( 34, 51 ] 3 0.000% 100.000% ( 51, 76 ] 12 0.001% 100.001% ( 76, 110 ] 58 0.004% 100.005% ( 110, 170 ] 101 0.008% 100.013% ( 170, 250 ] 47 0.004% 100.017% ( 250, 380 ] 38 0.003% 100.019% ( 380, 580 ] 30 0.002% 100.022% ( 580, 870 ] 32 0.002% 100.024% ( 870, 1300 ] 15 0.001% 100.025% ( 1300, 1900 ] 11 0.001% 100.026% ( 1900, 2900 ] 8 0.001% 100.027% ( 2900, 4400 ] 4 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 27426 Average: 3.7327 StdDev: 33.23 Min: 1 Median: 1.5328 Max: 2397 Percentiles: P50: 1.53 P75: 1.92 P99: 9.34 P99.9: 398.52 P99.99: 1788.61 ------------------------------------------------------ [ 0, 1 ] 4156 15.154% 15.154% ### ( 1, 2 ] 17937 65.401% 80.555% ############# ( 2, 3 ] 3508 12.791% 93.346% ### ( 3, 4 ] 702 2.560% 95.905% # ( 4, 6 ] 484 1.765% 97.670% ( 6, 10 ] 437 1.593% 99.263% ( 10, 15 ] 44 0.160% 99.424% ( 15, 22 ] 5 0.018% 99.442% ( 76, 110 ] 36 0.131% 99.573% ( 110, 170 ] 53 0.193% 99.767% ( 170, 250 ] 18 0.066% 99.832% ( 250, 380 ] 17 0.062% 99.894% ( 380, 580 ] 17 0.062% 99.956% ( 580, 870 ] 4 0.015% 99.971% ( 870, 1300 ] 2 0.007% 99.978% ( 1300, 1900 ] 4 0.015% 99.993% ( 1900, 2900 ] 2 0.007% 100.000% ** Level 2 read latency histogram (micros): Count: 100943 Average: 2.4288 StdDev: 22.78 Min: 1 Median: 1.4925 Max: 5697 Percentiles: P50: 1.49 P75: 1.89 P99: 6.00 P99.9: 56.66 P99.99: 525.28 ------------------------------------------------------ [ 0, 1 ] 19447 19.265% 19.265% #### ( 1, 2 ] 62989 62.401% 81.666% ############ ( 2, 3 ] 11174 11.070% 92.736% ## ( 3, 4 ] 3464 3.432% 96.167% # ( 4, 6 ] 2862 2.835% 99.002% # ( 6, 10 ] 742 0.735% 99.737% ( 10, 15 ] 122 0.121% 99.858% ( 15, 22 ] 19 0.019% 99.877% ( 22, 34 ] 2 0.002% 99.879% ( 34, 51 ] 12 0.012% 99.891% ( 51, 76 ] 40 0.040% 99.931% ( 76, 110 ] 22 0.022% 99.952% ( 110, 170 ] 16 0.016% 99.968% ( 170, 250 ] 10 0.010% 99.978% ( 250, 380 ] 9 0.009% 99.987% ( 380, 580 ] 4 0.004% 99.991% ( 580, 870 ] 3 0.003% 99.994% ( 870, 1300 ] 3 0.003% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 282773 Average: 3.7848 StdDev: 59.75 Min: 1 Median: 1.6957 Max: 8958 Percentiles: P50: 1.70 P75: 2.31 P99: 8.91 P99.9: 195.43 P99.99: 585.11 ------------------------------------------------------ [ 0, 1 ] 19767 6.990% 6.990% # ( 1, 2 ] 174823 61.825% 68.815% ############ ( 2, 3 ] 55527 19.637% 88.452% #### ( 3, 4 ] 13526 4.783% 93.235% # ( 4, 6 ] 12472 4.411% 97.645% # ( 6, 10 ] 5261 1.861% 99.506% ( 10, 15 ] 535 0.189% 99.695% ( 15, 22 ] 53 0.019% 99.714% ( 22, 34 ] 8 0.003% 99.717% ( 34, 51 ] 3 0.001% 99.718% ( 51, 76 ] 1 0.000% 99.718% ( 76, 110 ] 130 0.046% 99.764% ( 110, 170 ] 341 0.121% 99.885% ( 170, 250 ] 136 0.048% 99.933% ( 250, 380 ] 90 0.032% 99.965% ( 380, 580 ] 71 0.025% 99.990% ( 580, 870 ] 41 0.014% 100.004% ( 870, 1300 ] 15 0.005% 100.010% ( 1300, 1900 ] 9 0.003% 100.013% ( 1900, 2900 ] 4 0.001% 100.014% ( 2900, 4400 ] 11 0.004% 100.018% ( 4400, 6600 ] 9 0.003% 100.021% ( 6600, 9900 ] 7 0.002% 100.024% ** Level 4 read latency histogram (micros): Count: 310 Average: 226.6290 StdDev: 973.84 Min: 1 Median: 2.7475 Max: 7102 Percentiles: P50: 2.75 P75: 6.74 P99: 5830.00 P99.9: 7102.00 P99.99: 7102.00 ------------------------------------------------------ [ 0, 1 ] 8 2.581% 2.581% # ( 1, 2 ] 73 23.548% 26.129% ##### ( 2, 3 ] 99 31.935% 58.065% ###### ( 3, 4 ] 39 12.581% 70.645% ### ( 4, 6 ] 10 3.226% 73.871% # ( 6, 10 ] 19 6.129% 80.000% # ( 10, 15 ] 23 7.419% 87.419% # ( 15, 22 ] 15 4.839% 92.258% # ( 22, 34 ] 1 0.323% 92.581% ( 76, 110 ] 1 0.323% 92.903% ( 110, 170 ] 1 0.323% 93.226% ( 170, 250 ] 1 0.323% 93.548% ( 250, 380 ] 1 0.323% 93.871% ( 380, 580 ] 1 0.323% 94.194% ( 580, 870 ] 1 0.323% 94.516% ( 870, 1300 ] 1 0.323% 94.839% ( 1300, 1900 ] 2 0.645% 95.484% ( 1900, 2900 ] 3 0.968% 96.452% ( 2900, 4400 ] 4 1.290% 97.742% ( 4400, 6600 ] 6 1.935% 99.677% ( 6600, 9900 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 909.4000 StdDev: 1040.54 Min: 89 Median: 336.6667 Max: 3734 Percentiles: P50: 336.67 P75: 1600.00 P99: 3734.00 P99.9: 3734.00 P99.99: 3734.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 3 15.000% 30.000% ### ( 170, 250 ] 2 10.000% 40.000% ## ( 250, 380 ] 3 15.000% 55.000% ### ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.4 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 319.85 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.023 H:M:S, 13.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.399 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/13-06:03:32 ... thread 0: (1000000,6000000) ops and (132977.4,264695.3) ops/second in (7.520075,22.667570) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 4.12 GB 157.1 5.1 0.0 5.1 10.8 5.7 0.0 1.9 142.9 301.2 36.58 34.42 99 0.370 5308K 7047 0.0 0.0 L1 10/10 1.04 GB 0.0 1.4 1.4 0.0 1.4 1.3 0.2 1.0 227.0 226.2 6.11 5.93 2 3.057 1409K 5019 0.0 0.0 L2 1/0 97.28 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.3 1.8 251.2 251.1 1.39 1.34 2 0.695 354K 183 0.0 0.0 L3 21/0 968.38 MB 1.0 1.2 0.2 0.9 1.2 0.2 0.2 5.0 235.0 234.6 5.03 4.63 2 2.516 1200K 1867 0.0 0.0 L4 170/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 124.2 124.2 1.36 0.93 1 1.357 171K 0 0.0 0.0 L5 1044/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1264/22 101.78 GB 0.0 8.1 1.9 6.2 13.8 7.6 1.3 2.4 164.8 279.3 50.47 47.24 106 0.476 8444K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.1 1.9 6.2 13.8 7.6 1.3 2.4 164.8 279.3 50.47 47.24 106 0.476 8444K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.1 1.9 6.2 8.1 1.9 0.0 0.0 246.2 245.7 33.78 32.38 24 1.408 8444K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 347.3 16.69 14.87 82 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.9 total, 22.7 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.77 GB write, 615.47 MB/s write, 8.12 GB read, 363.07 MB/s read, 50.5 seconds Interval compaction: 13.77 GB write, 621.88 MB/s write, 8.12 GB read, 366.85 MB/s read, 50.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 21, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2095533 Average: 2.2866 StdDev: 10.33 Min: 0 Median: 1.5418 Max: 3623 Percentiles: P50: 1.54 P75: 1.92 P99: 5.69 P99.9: 10.22 P99.99: 27.49 ------------------------------------------------------ [ 0, 1 ] 289342 13.808% 13.808% ### ( 1, 2 ] 1399833 66.801% 80.608% ############# ( 2, 3 ] 277625 13.248% 93.857% ### ( 3, 4 ] 65700 3.135% 96.992% # ( 4, 6 ] 49912 2.382% 99.374% ( 6, 10 ] 10948 0.522% 99.896% ( 10, 15 ] 1795 0.086% 99.982% ( 15, 22 ] 157 0.007% 99.989% ( 22, 34 ] 25 0.001% 99.991% ( 34, 51 ] 5 0.000% 99.991% ( 51, 76 ] 15 0.001% 99.992% ( 76, 110 ] 167 0.008% 100.000% ( 110, 170 ] 228 0.011% 100.010% ( 170, 250 ] 84 0.004% 100.014% ( 250, 380 ] 64 0.003% 100.018% ( 380, 580 ] 63 0.003% 100.021% ( 580, 870 ] 56 0.003% 100.023% ( 870, 1300 ] 24 0.001% 100.024% ( 1300, 1900 ] 13 0.001% 100.025% ( 1900, 2900 ] 11 0.001% 100.025% ( 2900, 4400 ] 5 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 150091 Average: 2.7917 StdDev: 16.61 Min: 1 Median: 1.5607 Max: 2397 Percentiles: P50: 1.56 P75: 1.93 P99: 8.37 P99.9: 155.73 P99.99: 676.37 ------------------------------------------------------ [ 0, 1 ] 18391 12.253% 12.253% ## ( 1, 2 ] 101039 67.318% 79.572% ############# ( 2, 3 ] 20743 13.820% 93.392% ### ( 3, 4 ] 3858 2.570% 95.962% # ( 4, 6 ] 3234 2.155% 98.117% ( 6, 10 ] 2233 1.488% 99.605% ( 10, 15 ] 164 0.109% 99.714% ( 15, 22 ] 18 0.012% 99.726% ( 22, 34 ] 1 0.001% 99.727% ( 34, 51 ] 1 0.001% 99.727% ( 76, 110 ] 140 0.093% 99.821% ( 110, 170 ] 156 0.104% 99.925% ( 170, 250 ] 38 0.025% 99.950% ( 250, 380 ] 29 0.019% 99.969% ( 380, 580 ] 28 0.019% 99.988% ( 580, 870 ] 9 0.006% 99.994% ( 870, 1300 ] 3 0.002% 99.996% ( 1300, 1900 ] 4 0.003% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 100943 Average: 2.4288 StdDev: 22.78 Min: 1 Median: 1.4925 Max: 5697 Percentiles: P50: 1.49 P75: 1.89 P99: 6.00 P99.9: 56.66 P99.99: 525.28 ------------------------------------------------------ [ 0, 1 ] 19447 19.265% 19.265% #### ( 1, 2 ] 62989 62.401% 81.666% ############ ( 2, 3 ] 11174 11.070% 92.736% ## ( 3, 4 ] 3464 3.432% 96.167% # ( 4, 6 ] 2862 2.835% 99.002% # ( 6, 10 ] 742 0.735% 99.737% ( 10, 15 ] 122 0.121% 99.858% ( 15, 22 ] 19 0.019% 99.877% ( 22, 34 ] 2 0.002% 99.879% ( 34, 51 ] 12 0.012% 99.891% ( 51, 76 ] 40 0.040% 99.931% ( 76, 110 ] 22 0.022% 99.952% ( 110, 170 ] 16 0.016% 99.968% ( 170, 250 ] 10 0.010% 99.978% ( 250, 380 ] 9 0.009% 99.987% ( 380, 580 ] 4 0.004% 99.991% ( 580, 870 ] 3 0.003% 99.994% ( 870, 1300 ] 3 0.003% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 282773 Average: 3.7848 StdDev: 59.75 Min: 1 Median: 1.6957 Max: 8958 Percentiles: P50: 1.70 P75: 2.31 P99: 8.91 P99.9: 195.43 P99.99: 585.11 ------------------------------------------------------ [ 0, 1 ] 19767 6.990% 6.990% # ( 1, 2 ] 174823 61.825% 68.815% ############ ( 2, 3 ] 55527 19.637% 88.452% #### ( 3, 4 ] 13526 4.783% 93.235% # ( 4, 6 ] 12472 4.411% 97.645% # ( 6, 10 ] 5261 1.861% 99.506% ( 10, 15 ] 535 0.189% 99.695% ( 15, 22 ] 53 0.019% 99.714% ( 22, 34 ] 8 0.003% 99.717% ( 34, 51 ] 3 0.001% 99.718% ( 51, 76 ] 1 0.000% 99.718% ( 76, 110 ] 130 0.046% 99.764% ( 110, 170 ] 341 0.121% 99.885% ( 170, 250 ] 136 0.048% 99.933% ( 250, 380 ] 90 0.032% 99.965% ( 380, 580 ] 71 0.025% 99.990% ( 580, 870 ] 41 0.014% 100.004% ( 870, 1300 ] 15 0.005% 100.010% ( 1300, 1900 ] 9 0.003% 100.013% ( 1900, 2900 ] 4 0.001% 100.014% ( 2900, 4400 ] 11 0.004% 100.018% ( 4400, 6600 ] 9 0.003% 100.021% ( 6600, 9900 ] 7 0.002% 100.024% ** Level 4 read latency histogram (micros): Count: 310 Average: 226.6290 StdDev: 973.84 Min: 1 Median: 2.7475 Max: 7102 Percentiles: P50: 2.75 P75: 6.74 P99: 5830.00 P99.9: 7102.00 P99.99: 7102.00 ------------------------------------------------------ [ 0, 1 ] 8 2.581% 2.581% # ( 1, 2 ] 73 23.548% 26.129% ##### ( 2, 3 ] 99 31.935% 58.065% ###### ( 3, 4 ] 39 12.581% 70.645% ### ( 4, 6 ] 10 3.226% 73.871% # ( 6, 10 ] 19 6.129% 80.000% # ( 10, 15 ] 23 7.419% 87.419% # ( 15, 22 ] 15 4.839% 92.258% # ( 22, 34 ] 1 0.323% 92.581% ( 76, 110 ] 1 0.323% 92.903% ( 110, 170 ] 1 0.323% 93.226% ( 170, 250 ] 1 0.323% 93.548% ( 250, 380 ] 1 0.323% 93.871% ( 380, 580 ] 1 0.323% 94.194% ( 580, 870 ] 1 0.323% 94.516% ( 870, 1300 ] 1 0.323% 94.839% ( 1300, 1900 ] 2 0.645% 95.484% ( 1900, 2900 ] 3 0.968% 96.452% ( 2900, 4400 ] 4 1.290% 97.742% ( 4400, 6600 ] 6 1.935% 99.677% ( 6600, 9900 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 909.4000 StdDev: 1040.54 Min: 89 Median: 336.6667 Max: 3734 Percentiles: P50: 336.67 P75: 1600.00 P99: 3734.00 P99.9: 3734.00 P99.99: 3734.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 3 15.000% 30.000% ### ( 170, 250 ] 2 10.000% 40.000% ## ( 250, 380 ] 3 15.000% 55.000% ### ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 22.9 total, 7.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 257.81 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.884 H:M:S, 30.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 130.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.862 H:M:S, 64.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/10/13-06:03:45 ... thread 0: (1000000,7000000) ops and (78308.2,197530.2) ops/second in (12.770057,35.437627) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 2.46 GB 37.8 5.6 0.0 5.6 12.2 6.6 0.0 1.8 137.3 298.5 41.76 38.86 115 0.363 5820K 7564 0.0 0.0 L1 14/14 1.55 GB 0.0 5.0 3.9 1.0 4.9 3.9 0.2 1.2 219.5 216.6 23.23 21.99 3 7.744 5178K 66K 0.0 0.0 L2 7/6 901.46 MB 1.3 0.3 0.2 0.2 0.3 0.2 2.3 1.8 251.2 251.1 1.39 1.34 2 0.695 354K 183 0.0 0.0 L3 25/3 1.15 GB 1.0 2.6 1.5 1.2 2.6 1.5 0.2 1.8 217.8 217.3 12.39 11.27 6 2.064 2739K 5686 0.0 0.0 L4 175/0 9.56 GB 1.0 0.5 0.5 0.0 0.5 0.5 1.0 1.0 135.7 135.6 3.65 2.46 6 0.608 493K 237 0.0 0.0 L5 1056/0 87.05 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1291/34 102.64 GB 0.0 14.0 6.0 8.0 20.5 12.5 5.0 3.1 174.4 255.2 82.42 75.93 132 0.624 14M 80K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.0 6.0 8.0 20.5 12.5 5.0 3.1 174.4 255.2 82.42 75.93 132 0.624 14M 80K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.0 6.0 8.0 14.0 6.0 0.0 0.0 229.4 228.1 62.66 58.56 36 1.741 14M 80K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 341.2 19.76 17.36 96 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.7 total, 35.4 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.54 GB write, 589.58 MB/s write, 14.04 GB read, 402.90 MB/s read, 82.4 seconds Interval compaction: 20.54 GB write, 593.50 MB/s write, 14.04 GB read, 405.58 MB/s read, 82.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 27, interval: 49 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2790981 Average: 2.6037 StdDev: 16.07 Min: 0 Median: 1.5474 Max: 5653 Percentiles: P50: 1.55 P75: 1.93 P99: 5.98 P99.9: 111.23 P99.99: 270.71 ------------------------------------------------------ [ 0, 1 ] 392933 14.079% 14.079% ### ( 1, 2 ] 1831363 65.617% 79.696% ############# ( 2, 3 ] 368707 13.211% 92.907% ### ( 3, 4 ] 94230 3.376% 96.283% # ( 4, 6 ] 76447 2.739% 99.022% # ( 6, 10 ] 19083 0.684% 99.706% ( 10, 15 ] 3057 0.110% 99.815% ( 15, 22 ] 403 0.014% 99.830% ( 22, 34 ] 41 0.001% 99.831% ( 34, 51 ] 7 0.000% 99.831% ( 51, 76 ] 17 0.001% 99.832% ( 76, 110 ] 1861 0.067% 99.899% ( 110, 170 ] 2058 0.074% 99.972% ( 170, 250 ] 436 0.016% 99.988% ( 250, 380 ] 376 0.013% 100.001% ( 380, 580 ] 317 0.011% 100.013% ( 580, 870 ] 170 0.006% 100.019% ( 870, 1300 ] 50 0.002% 100.021% ( 1300, 1900 ] 19 0.001% 100.021% ( 1900, 2900 ] 30 0.001% 100.022% ( 2900, 4400 ] 14 0.001% 100.023% ( 4400, 6600 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 752306 Average: 3.3047 StdDev: 37.95 Min: 1 Median: 1.6601 Max: 8850 Percentiles: P50: 1.66 P75: 2.21 P99: 8.51 P99.9: 146.44 P99.99: 355.56 ------------------------------------------------------ [ 0, 1 ] 66207 8.801% 8.801% ## ( 1, 2 ] 469528 62.412% 71.212% ############ ( 2, 3 ] 136158 18.099% 89.311% #### ( 3, 4 ] 34436 4.577% 93.889% # ( 4, 6 ] 31252 4.154% 98.043% # ( 6, 10 ] 11486 1.527% 99.569% ( 10, 15 ] 1290 0.171% 99.741% ( 15, 22 ] 188 0.025% 99.766% ( 22, 34 ] 14 0.002% 99.768% ( 34, 51 ] 3 0.000% 99.768% ( 51, 76 ] 10 0.001% 99.770% ( 76, 110 ] 532 0.071% 99.840% ( 110, 170 ] 742 0.099% 99.939% ( 170, 250 ] 225 0.030% 99.969% ( 250, 380 ] 198 0.026% 99.995% ( 380, 580 ] 168 0.022% 100.017% ( 580, 870 ] 87 0.012% 100.029% ( 870, 1300 ] 51 0.007% 100.036% ( 1300, 1900 ] 18 0.002% 100.038% ( 1900, 2900 ] 12 0.002% 100.040% ( 2900, 4400 ] 21 0.003% 100.043% ( 4400, 6600 ] 7 0.001% 100.043% ( 6600, 9900 ] 5 0.001% 100.044% ** Level 2 read latency histogram (micros): Count: 100943 Average: 2.4288 StdDev: 22.78 Min: 1 Median: 1.4925 Max: 5697 Percentiles: P50: 1.49 P75: 1.89 P99: 6.00 P99.9: 56.66 P99.99: 525.28 ------------------------------------------------------ [ 0, 1 ] 19447 19.265% 19.265% #### ( 1, 2 ] 62989 62.401% 81.666% ############ ( 2, 3 ] 11174 11.070% 92.736% ## ( 3, 4 ] 3464 3.432% 96.167% # ( 4, 6 ] 2862 2.835% 99.002% # ( 6, 10 ] 742 0.735% 99.737% ( 10, 15 ] 122 0.121% 99.858% ( 15, 22 ] 19 0.019% 99.877% ( 22, 34 ] 2 0.002% 99.879% ( 34, 51 ] 12 0.012% 99.891% ( 51, 76 ] 40 0.040% 99.931% ( 76, 110 ] 22 0.022% 99.952% ( 110, 170 ] 16 0.016% 99.968% ( 170, 250 ] 10 0.010% 99.978% ( 250, 380 ] 9 0.009% 99.987% ( 380, 580 ] 4 0.004% 99.991% ( 580, 870 ] 3 0.003% 99.994% ( 870, 1300 ] 3 0.003% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 391035 Average: 4.0821 StdDev: 56.50 Min: 0 Median: 1.7897 Max: 8958 Percentiles: P50: 1.79 P75: 2.57 P99: 9.08 P99.9: 199.87 P99.99: 379.93 ------------------------------------------------------ [ 0, 1 ] 20490 5.240% 5.240% # ( 1, 2 ] 221630 56.678% 61.918% ########### ( 2, 3 ] 89272 22.830% 84.747% ##### ( 3, 4 ] 25115 6.423% 91.170% # ( 4, 6 ] 25001 6.394% 97.564% # ( 6, 10 ] 7303 1.868% 99.431% ( 10, 15 ] 977 0.250% 99.681% ( 15, 22 ] 113 0.029% 99.710% ( 22, 34 ] 13 0.003% 99.713% ( 34, 51 ] 5 0.001% 99.715% ( 51, 76 ] 2 0.001% 99.715% ( 76, 110 ] 164 0.042% 99.757% ( 110, 170 ] 464 0.119% 99.876% ( 170, 250 ] 257 0.066% 99.941% ( 250, 380 ] 191 0.049% 99.990% ( 380, 580 ] 150 0.038% 100.029% ( 580, 870 ] 86 0.022% 100.051% ( 870, 1300 ] 25 0.006% 100.057% ( 1300, 1900 ] 12 0.003% 100.060% ( 1900, 2900 ] 6 0.002% 100.062% ( 2900, 4400 ] 17 0.004% 100.066% ( 4400, 6600 ] 10 0.003% 100.069% ( 6600, 9900 ] 8 0.002% 100.071% ** Level 4 read latency histogram (micros): Count: 4105 Average: 66.2090 StdDev: 347.37 Min: 1 Median: 2.3343 Max: 7102 Percentiles: P50: 2.33 P75: 3.55 P99: 1227.62 P99.9: 5624.14 P99.99: 7102.00 ------------------------------------------------------ [ 0, 1 ] 51 1.242% 1.242% ( 1, 2 ] 1613 39.294% 40.536% ######## ( 2, 3 ] 1162 28.307% 68.843% ###### ( 3, 4 ] 461 11.230% 80.073% ## ( 4, 6 ] 297 7.235% 87.308% # ( 6, 10 ] 114 2.777% 90.085% # ( 10, 15 ] 32 0.780% 90.865% ( 15, 22 ] 20 0.487% 91.352% ( 22, 34 ] 1 0.024% 91.376% ( 76, 110 ] 5 0.122% 91.498% ( 110, 170 ] 32 0.780% 92.278% ( 170, 250 ] 48 1.169% 93.447% ( 250, 380 ] 49 1.194% 94.641% ( 380, 580 ] 76 1.851% 96.492% ( 580, 870 ] 78 1.900% 98.392% ( 870, 1300 ] 30 0.731% 99.123% ( 1300, 1900 ] 14 0.341% 99.464% ( 1900, 2900 ] 8 0.195% 99.659% ( 2900, 4400 ] 6 0.146% 99.805% ( 4400, 6600 ] 7 0.171% 99.976% ( 6600, 9900 ] 1 0.024% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 1023.0250 StdDev: 1148.20 Min: 86 Median: 437.1429 Max: 4290 Percentiles: P50: 437.14 P75: 1675.00 P99: 4228.57 P99.9: 4290.00 P99.99: 4290.00 ------------------------------------------------------ ( 76, 110 ] 9 11.250% 11.250% ## ( 110, 170 ] 10 12.500% 23.750% ### ( 170, 250 ] 11 13.750% 37.500% ### ( 250, 380 ] 8 10.000% 47.500% ## ( 380, 580 ] 7 8.750% 56.250% ## ( 580, 870 ] 5 6.250% 62.500% # ( 870, 1300 ] 5 6.250% 68.750% # ( 1300, 1900 ] 8 10.000% 78.750% ## ( 1900, 2900 ] 10 12.500% 91.250% ### ( 2900, 4400 ] 7 8.750% 100.000% ## ** DB Stats ** Uptime(secs): 35.7 total, 12.8 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 193.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.694 H:M:S, 46.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 77.07 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:9.810 H:M:S, 76.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/10/13-06:03:48 ... thread 0: (1000000,8000000) ops and (257100.6,203421.8) ops/second in (3.889528,39.327155) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 3.44 GB 138.4 6.5 0.0 6.5 14.1 7.6 0.0 1.9 135.6 292.8 49.24 45.23 131 0.376 6779K 8668 0.0 0.0 L1 14/14 1.55 GB 0.0 5.0 3.9 1.0 4.9 3.9 0.2 1.2 219.5 216.6 23.23 21.99 3 7.744 5178K 66K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 2.3 1.8 251.2 251.1 1.39 1.34 2 0.695 354K 183 0.0 0.0 L3 23/1 1.01 GB 1.0 3.8 2.3 1.5 3.8 2.3 0.2 1.6 207.3 206.8 18.79 16.70 9 2.088 3955K 8662 0.0 0.0 L4 180/1 9.53 GB 1.0 1.5 1.5 0.1 1.5 1.5 1.0 1.0 135.2 135.0 11.72 7.66 23 0.510 1586K 1686 0.0 0.0 L5 1068/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1303/27 103.62 GB 0.0 17.2 7.9 9.3 24.7 15.4 6.1 3.3 168.7 242.1 104.38 92.92 168 0.621 17M 85K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.2 7.9 9.3 24.7 15.4 6.1 3.3 168.7 242.1 104.38 92.92 168 0.621 17M 85K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.2 7.9 9.3 17.1 7.9 0.0 0.0 217.3 216.2 81.02 72.92 59 1.373 17M 85K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 331.7 23.36 20.00 109 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.6 total, 39.3 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.68 GB write, 638.63 MB/s write, 17.19 GB read, 444.99 MB/s read, 104.4 seconds Interval compaction: 24.68 GB write, 642.46 MB/s write, 17.19 GB read, 447.65 MB/s read, 104.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 44, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3125470 Average: 2.6453 StdDev: 16.40 Min: 0 Median: 1.5725 Max: 5653 Percentiles: P50: 1.57 P75: 1.96 P99: 6.13 P99.9: 107.74 P99.99: 260.26 ------------------------------------------------------ [ 0, 1 ] 404574 12.944% 12.944% ### ( 1, 2 ] 2022932 64.724% 77.669% ############# ( 2, 3 ] 447176 14.307% 91.976% ### ( 3, 4 ] 118955 3.806% 95.782% # ( 4, 6 ] 99810 3.193% 98.975% # ( 6, 10 ] 22946 0.734% 99.710% ( 10, 15 ] 3618 0.116% 99.825% ( 15, 22 ] 458 0.015% 99.840% ( 22, 34 ] 46 0.001% 99.841% ( 34, 51 ] 12 0.000% 99.842% ( 51, 76 ] 18 0.001% 99.842% ( 76, 110 ] 1930 0.062% 99.904% ( 110, 170 ] 2145 0.069% 99.973% ( 170, 250 ] 507 0.016% 99.989% ( 250, 380 ] 411 0.013% 100.002% ( 380, 580 ] 353 0.011% 100.013% ( 580, 870 ] 190 0.006% 100.020% ( 870, 1300 ] 63 0.002% 100.022% ( 1300, 1900 ] 21 0.001% 100.022% ( 1900, 2900 ] 32 0.001% 100.023% ( 2900, 4400 ] 17 0.001% 100.024% ( 4400, 6600 ] 2 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 981731 Average: 3.7488 StdDev: 49.58 Min: 1 Median: 1.7066 Max: 8850 Percentiles: P50: 1.71 P75: 2.36 P99: 8.72 P99.9: 164.19 P99.99: 551.75 ------------------------------------------------------ [ 0, 1 ] 70376 7.169% 7.169% # ( 1, 2 ] 595065 60.614% 67.782% ############ ( 2, 3 ] 196253 19.991% 87.773% #### ( 3, 4 ] 51307 5.226% 92.999% # ( 4, 6 ] 47588 4.847% 97.846% # ( 6, 10 ] 16685 1.700% 99.546% ( 10, 15 ] 1854 0.189% 99.735% ( 15, 22 ] 244 0.025% 99.760% ( 22, 34 ] 16 0.002% 99.761% ( 34, 51 ] 7 0.001% 99.762% ( 51, 76 ] 10 0.001% 99.763% ( 76, 110 ] 602 0.061% 99.824% ( 110, 170 ] 823 0.084% 99.908% ( 170, 250 ] 301 0.031% 99.939% ( 250, 380 ] 289 0.029% 99.968% ( 380, 580 ] 249 0.025% 99.994% ( 580, 870 ] 156 0.016% 100.010% ( 870, 1300 ] 108 0.011% 100.021% ( 1300, 1900 ] 36 0.004% 100.024% ( 1900, 2900 ] 46 0.005% 100.029% ( 2900, 4400 ] 70 0.007% 100.036% ( 4400, 6600 ] 18 0.002% 100.038% ( 6600, 9900 ] 6 0.001% 100.039% ** Level 2 read latency histogram (micros): Count: 100943 Average: 2.4288 StdDev: 22.78 Min: 1 Median: 1.4925 Max: 5697 Percentiles: P50: 1.49 P75: 1.89 P99: 6.00 P99.9: 56.66 P99.99: 525.28 ------------------------------------------------------ [ 0, 1 ] 19447 19.265% 19.265% #### ( 1, 2 ] 62989 62.401% 81.666% ############ ( 2, 3 ] 11174 11.070% 92.736% ## ( 3, 4 ] 3464 3.432% 96.167% # ( 4, 6 ] 2862 2.835% 99.002% # ( 6, 10 ] 742 0.735% 99.737% ( 10, 15 ] 122 0.121% 99.858% ( 15, 22 ] 19 0.019% 99.877% ( 22, 34 ] 2 0.002% 99.879% ( 34, 51 ] 12 0.012% 99.891% ( 51, 76 ] 40 0.040% 99.931% ( 76, 110 ] 22 0.022% 99.952% ( 110, 170 ] 16 0.016% 99.968% ( 170, 250 ] 10 0.010% 99.978% ( 250, 380 ] 9 0.009% 99.987% ( 380, 580 ] 4 0.004% 99.991% ( 580, 870 ] 3 0.003% 99.994% ( 870, 1300 ] 3 0.003% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 726042 Average: 5.0600 StdDev: 76.26 Min: 0 Median: 1.9143 Max: 11658 Percentiles: P50: 1.91 P75: 2.78 P99: 9.10 P99.9: 184.23 P99.99: 428.18 ------------------------------------------------------ [ 0, 1 ] 22532 3.103% 3.103% # ( 1, 2 ] 372391 51.291% 54.394% ########## ( 2, 3 ] 191503 26.376% 80.770% ##### ( 3, 4 ] 59697 8.222% 88.993% ## ( 4, 6 ] 61371 8.453% 97.445% ## ( 6, 10 ] 14577 2.008% 99.453% ( 10, 15 ] 2160 0.298% 99.751% ( 15, 22 ] 247 0.034% 99.785% ( 22, 34 ] 23 0.003% 99.788% ( 34, 51 ] 10 0.001% 99.789% ( 51, 76 ] 7 0.001% 99.790% ( 76, 110 ] 193 0.027% 99.817% ( 110, 170 ] 543 0.075% 99.891% ( 170, 250 ] 354 0.049% 99.940% ( 250, 380 ] 287 0.040% 99.980% ( 380, 580 ] 313 0.043% 100.023% ( 580, 870 ] 243 0.033% 100.056% ( 870, 1300 ] 140 0.019% 100.076% ( 1300, 1900 ] 64 0.009% 100.084% ( 1900, 2900 ] 67 0.009% 100.094% ( 2900, 4400 ] 100 0.014% 100.107% ( 4400, 6600 ] 29 0.004% 100.111% ( 6600, 9900 ] 16 0.002% 100.114% ( 9900, 14000 ] 1 0.000% 100.114% ** Level 4 read latency histogram (micros): Count: 17576 Average: 65.2264 StdDev: 294.46 Min: 0 Median: 2.2618 Max: 7102 Percentiles: P50: 2.26 P75: 3.40 P99: 1278.38 P99.9: 3962.92 P99.99: 6048.48 ------------------------------------------------------ [ 0, 1 ] 219 1.246% 1.246% ( 1, 2 ] 7284 41.443% 42.689% ######## ( 2, 3 ] 4908 27.924% 70.613% ###### ( 3, 4 ] 1938 11.026% 81.640% ## ( 4, 6 ] 1169 6.651% 88.291% # ( 6, 10 ] 413 2.350% 90.641% ( 10, 15 ] 75 0.427% 91.067% ( 15, 22 ] 30 0.171% 91.238% ( 22, 34 ] 1 0.006% 91.244% ( 76, 110 ] 22 0.125% 91.369% ( 110, 170 ] 145 0.825% 92.194% ( 170, 250 ] 179 1.018% 93.212% ( 250, 380 ] 187 1.064% 94.276% ( 380, 580 ] 320 1.821% 96.097% ( 580, 870 ] 307 1.747% 97.844% ( 870, 1300 ] 214 1.218% 99.061% ( 1300, 1900 ] 89 0.506% 99.568% ( 1900, 2900 ] 40 0.228% 99.795% ( 2900, 4400 ] 26 0.148% 99.943% ( 4400, 6600 ] 11 0.063% 100.006% ( 6600, 9900 ] 1 0.006% 100.011% ** Level 5 read latency histogram (micros): Count: 140 Average: 1030.0786 StdDev: 1165.77 Min: 86 Median: 395.3846 Max: 4350 Percentiles: P50: 395.38 P75: 1700.00 P99: 4250.00 P99.9: 4350.00 P99.99: 4350.00 ------------------------------------------------------ ( 76, 110 ] 14 10.000% 10.000% ## ( 110, 170 ] 21 15.000% 25.000% ### ( 170, 250 ] 18 12.857% 37.857% ### ( 250, 380 ] 16 11.429% 49.286% ## ( 380, 580 ] 13 9.286% 58.571% ## ( 580, 870 ] 6 4.286% 62.857% # ( 870, 1300 ] 9 6.429% 69.286% # ( 1300, 1900 ] 12 8.571% 77.857% ## ( 1900, 2900 ] 17 12.143% 90.000% ## ( 2900, 4400 ] 14 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 39.6 total, 3.9 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 199.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.688 H:M:S, 44.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 253.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.994 H:M:S, 25.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/10/13-06:04:02 ... thread 0: (1000000,9000000) ops and (74125.0,170396.8) ops/second in (13.490730,52.817885) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 2.70 GB 6.3 7.9 0.0 7.9 16.5 8.6 0.0 1.9 139.2 291.3 57.91 53.35 152 0.381 8186K 10K 0.0 0.0 L1 23/23 2.54 GB 0.0 8.3 5.7 2.6 8.2 5.6 0.2 1.4 215.5 212.7 39.51 36.91 4 9.877 7459K 66K 0.0 0.0 L2 1/0 63.69 MB 0.6 0.3 0.2 0.2 0.3 0.2 3.1 1.8 251.2 251.1 1.39 1.34 2 0.695 354K 183 0.0 0.0 L3 21/0 938.20 MB 0.9 5.0 2.8 2.2 5.0 2.8 0.4 1.8 203.0 202.3 25.33 22.45 16 1.583 5222K 16K 0.0 0.0 L4 181/0 9.68 GB 1.0 2.4 2.3 0.1 2.4 2.3 1.0 1.0 149.0 148.8 16.20 11.53 34 0.476 2404K 2246 0.0 0.0 L5 1076/0 88.71 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1314/34 104.61 GB 0.0 23.9 11.0 12.9 32.4 19.5 7.6 3.8 174.4 236.3 140.34 125.57 208 0.675 23M 95K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.9 11.0 12.9 32.4 19.5 7.6 3.8 174.4 236.3 140.34 125.57 208 0.675 23M 95K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.9 11.0 12.9 23.8 10.9 0.0 0.0 215.2 214.0 113.74 102.74 83 1.370 23M 95K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 331.6 26.60 22.83 125 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.1 total, 52.8 interval Flush(GB): cumulative 8.613, interval 8.613 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.38 GB write, 625.02 MB/s write, 23.91 GB read, 461.43 MB/s read, 140.3 seconds Interval compaction: 32.38 GB write, 627.81 MB/s write, 23.91 GB read, 463.49 MB/s read, 140.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 20, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 20, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 45, pending-compaction-bytes-delays: 36, pending-compaction-bytes-stops: 0, total-delays: 56, total-stops: 45, interval: 101 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3881626 Average: 2.6696 StdDev: 18.23 Min: 0 Median: 1.5635 Max: 5961 Percentiles: P50: 1.56 P75: 1.95 P99: 6.17 P99.9: 106.42 P99.99: 343.81 ------------------------------------------------------ [ 0, 1 ] 524830 13.521% 13.521% ### ( 1, 2 ] 2512652 64.732% 78.253% ############# ( 2, 3 ] 536665 13.826% 92.079% ### ( 3, 4 ] 144400 3.720% 95.799% # ( 4, 6 ] 123003 3.169% 98.968% # ( 6, 10 ] 29063 0.749% 99.716% ( 10, 15 ] 4521 0.116% 99.833% ( 15, 22 ] 642 0.017% 99.849% ( 22, 34 ] 56 0.001% 99.851% ( 34, 51 ] 16 0.000% 99.851% ( 51, 76 ] 32 0.001% 99.852% ( 76, 110 ] 2084 0.054% 99.906% ( 110, 170 ] 2305 0.059% 99.965% ( 170, 250 ] 590 0.015% 99.980% ( 250, 380 ] 525 0.014% 99.994% ( 380, 580 ] 483 0.012% 100.006% ( 580, 870 ] 325 0.008% 100.015% ( 870, 1300 ] 143 0.004% 100.018% ( 1300, 1900 ] 60 0.002% 100.020% ( 1900, 2900 ] 45 0.001% 100.021% ( 2900, 4400 ] 20 0.001% 100.021% ( 4400, 6600 ] 4 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1415284 Average: 3.6246 StdDev: 44.24 Min: 1 Median: 1.6659 Max: 8850 Percentiles: P50: 1.67 P75: 2.26 P99: 8.68 P99.9: 176.48 P99.99: 583.84 ------------------------------------------------------ [ 0, 1 ] 133458 9.430% 9.430% ## ( 1, 2 ] 862269 60.926% 70.355% ############ ( 2, 3 ] 256161 18.100% 88.455% #### ( 3, 4 ] 68914 4.869% 93.324% # ( 4, 6 ] 64744 4.575% 97.899% # ( 6, 10 ] 23278 1.645% 99.544% ( 10, 15 ] 2461 0.174% 99.717% ( 15, 22 ] 371 0.026% 99.744% ( 22, 34 ] 22 0.002% 99.745% ( 34, 51 ] 9 0.001% 99.746% ( 51, 76 ] 13 0.001% 99.747% ( 76, 110 ] 916 0.065% 99.811% ( 110, 170 ] 1217 0.086% 99.897% ( 170, 250 ] 453 0.032% 99.929% ( 250, 380 ] 449 0.032% 99.961% ( 380, 580 ] 405 0.029% 99.990% ( 580, 870 ] 262 0.019% 100.008% ( 870, 1300 ] 170 0.012% 100.020% ( 1300, 1900 ] 62 0.004% 100.025% ( 1900, 2900 ] 54 0.004% 100.029% ( 2900, 4400 ] 73 0.005% 100.034% ( 4400, 6600 ] 19 0.001% 100.035% ( 6600, 9900 ] 6 0.000% 100.035% ** Level 2 read latency histogram (micros): Count: 100943 Average: 2.4288 StdDev: 22.78 Min: 1 Median: 1.4925 Max: 5697 Percentiles: P50: 1.49 P75: 1.89 P99: 6.00 P99.9: 56.66 P99.99: 525.28 ------------------------------------------------------ [ 0, 1 ] 19447 19.265% 19.265% #### ( 1, 2 ] 62989 62.401% 81.666% ############ ( 2, 3 ] 11174 11.070% 92.736% ## ( 3, 4 ] 3464 3.432% 96.167% # ( 4, 6 ] 2862 2.835% 99.002% # ( 6, 10 ] 742 0.735% 99.737% ( 10, 15 ] 122 0.121% 99.858% ( 15, 22 ] 19 0.019% 99.877% ( 22, 34 ] 2 0.002% 99.879% ( 34, 51 ] 12 0.012% 99.891% ( 51, 76 ] 40 0.040% 99.931% ( 76, 110 ] 22 0.022% 99.952% ( 110, 170 ] 16 0.016% 99.968% ( 170, 250 ] 10 0.010% 99.978% ( 250, 380 ] 9 0.009% 99.987% ( 380, 580 ] 4 0.004% 99.991% ( 580, 870 ] 3 0.003% 99.994% ( 870, 1300 ] 3 0.003% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1096847 Average: 4.7188 StdDev: 64.31 Min: 0 Median: 1.9429 Max: 11658 Percentiles: P50: 1.94 P75: 2.83 P99: 9.07 P99.9: 133.93 P99.99: 255.09 ------------------------------------------------------ [ 0, 1 ] 26661 2.431% 2.431% ( 1, 2 ] 553374 50.451% 52.882% ########## ( 2, 3 ] 292273 26.647% 79.529% ##### ( 3, 4 ] 96461 8.794% 88.323% ## ( 4, 6 ] 99364 9.059% 97.382% ## ( 6, 10 ] 23147 2.110% 99.492% ( 10, 15 ] 3416 0.311% 99.804% ( 15, 22 ] 415 0.038% 99.842% ( 22, 34 ] 33 0.003% 99.845% ( 34, 51 ] 15 0.001% 99.846% ( 51, 76 ] 22 0.002% 99.848% ( 76, 110 ] 276 0.025% 99.873% ( 110, 170 ] 735 0.067% 99.940% ( 170, 250 ] 528 0.048% 99.988% ( 250, 380 ] 442 0.040% 100.029% ( 380, 580 ] 454 0.041% 100.070% ( 580, 870 ] 370 0.034% 100.104% ( 870, 1300 ] 207 0.019% 100.123% ( 1300, 1900 ] 87 0.008% 100.131% ( 1900, 2900 ] 74 0.007% 100.137% ( 2900, 4400 ] 103 0.009% 100.147% ( 4400, 6600 ] 29 0.003% 100.149% ( 6600, 9900 ] 16 0.001% 100.151% ( 9900, 14000 ] 1 0.000% 100.151% ** Level 4 read latency histogram (micros): Count: 27234 Average: 52.6526 StdDev: 247.75 Min: 0 Median: 2.2523 Max: 7102 Percentiles: P50: 2.25 P75: 3.45 P99: 1114.36 P99.9: 3353.41 P99.99: 5255.32 ------------------------------------------------------ [ 0, 1 ] 376 1.381% 1.381% ( 1, 2 ] 11404 41.874% 43.255% ######## ( 2, 3 ] 7282 26.739% 69.993% ##### ( 3, 4 ] 3054 11.214% 81.207% ## ( 4, 6 ] 1939 7.120% 88.327% # ( 6, 10 ] 682 2.504% 90.831% # ( 10, 15 ] 117 0.430% 91.261% ( 15, 22 ] 41 0.151% 91.411% ( 22, 34 ] 1 0.004% 91.415% ( 51, 76 ] 2 0.007% 91.422% ( 76, 110 ] 88 0.323% 91.746% ( 110, 170 ] 348 1.278% 93.023% ( 170, 250 ] 338 1.241% 94.265% ( 250, 380 ] 326 1.197% 95.462% ( 380, 580 ] 456 1.674% 97.136% ( 580, 870 ] 369 1.355% 98.491% ( 870, 1300 ] 244 0.896% 99.387% ( 1300, 1900 ] 91 0.334% 99.721% ( 1900, 2900 ] 40 0.147% 99.868% ( 2900, 4400 ] 29 0.106% 99.974% ( 4400, 6600 ] 11 0.040% 100.015% ( 6600, 9900 ] 1 0.004% 100.018% ** Level 5 read latency histogram (micros): Count: 180 Average: 971.2778 StdDev: 1120.11 Min: 83 Median: 380.0000 Max: 4350 Percentiles: P50: 380.00 P75: 1525.00 P99: 4231.25 P99.9: 4350.00 P99.99: 4350.00 ------------------------------------------------------ ( 76, 110 ] 21 11.667% 11.667% ## ( 110, 170 ] 29 16.111% 27.778% ### ( 170, 250 ] 22 12.222% 40.000% ## ( 250, 380 ] 18 10.000% 50.000% ## ( 380, 580 ] 17 9.444% 59.444% ## ( 580, 870 ] 9 5.000% 64.444% # ( 870, 1300 ] 13 7.222% 71.667% # ( 1300, 1900 ] 16 8.889% 80.556% ## ( 1900, 2900 ] 19 10.556% 91.111% ## ( 2900, 4400 ] 16 8.889% 100.000% ## ** DB Stats ** Uptime(secs): 53.1 total, 13.5 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 166.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.097 H:M:S, 53.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 72.96 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:10.409 H:M:S, 77.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.639 micros/op 150631 ops/sec 60.054 seconds 9045999 operations; 146.0 MB/s Microseconds per write: Count: 9045999 Average: 6.6387 StdDev: 301.56 Min: 1 Median: 1.7570 Max: 435216 Percentiles: P50: 1.76 P75: 2.78 P99: 8.75 P99.9: 1218.52 P99.99: 2742.88 ------------------------------------------------------ [ 0, 1 ] 1120087 12.382% 12.382% ## ( 1, 2 ] 4495532 49.696% 62.078% ########## ( 2, 3 ] 1499708 16.579% 78.657% ### ( 3, 4 ] 1276599 14.112% 92.769% ### ( 4, 6 ] 503088 5.561% 98.331% # ( 6, 10 ] 87961 0.972% 99.303% ( 10, 15 ] 21432 0.237% 99.540% ( 15, 22 ] 6153 0.068% 99.608% ( 22, 34 ] 1322 0.015% 99.623% ( 34, 51 ] 155 0.002% 99.625% ( 51, 76 ] 27 0.000% 99.625% ( 76, 110 ] 6309 0.070% 99.695% ( 110, 170 ] 2509 0.028% 99.722% ( 170, 250 ] 262 0.003% 99.725% ( 250, 380 ] 88 0.001% 99.726% ( 380, 580 ] 17 0.000% 99.726% ( 580, 870 ] 18 0.000% 99.727% ( 870, 1300 ] 19353 0.214% 99.941% ( 1300, 1900 ] 56 0.001% 99.941% ( 1900, 2900 ] 5242 0.058% 99.999% ( 2900, 4400 ] 49 0.001% 100.000% ( 4400, 6600 ] 8 0.000% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ( 9900, 14000 ] 4 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 192463 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9045999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9335470968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 506 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 35131075 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 28739785188 rocksdb.compact.write.bytes COUNT : 28554757469 rocksdb.flush.write.bytes COUNT : 9314032793 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 44 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 262 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9239000064 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3657728 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 28823055442 rocksdb.non.last.level.read.count COUNT : 6965621 rocksdb.block.checksum.compute.count COUNT : 6964653 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.422500 P95 : 3.899715 P99 : 7.236833 P100 : 435213.000000 COUNT : 9045999 SUM : 55930376 rocksdb.compaction.times.micros P50 : 916666.666667 P95 : 3897500.000000 P99 : 17118700.000000 P100 : 17118700.000000 COUNT : 83 SUM : 113741845 rocksdb.compaction.times.cpu_micros P50 : 866800.000000 P95 : 3763333.333333 P99 : 16065939.000000 P100 : 16065939.000000 COUNT : 83 SUM : 102737925 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 719.041096 P95 : 1293.210526 P99 : 6028.000000 P100 : 8735.000000 COUNT : 126 SUM : 104649 rocksdb.compaction.outfile.sync.micros P50 : 850.179856 P95 : 6361.666667 P99 : 20940.000000 P100 : 25254.000000 COUNT : 353 SUM : 576567 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 104.278846 P95 : 461.666667 P99 : 2590.000000 P100 : 3114.000000 COUNT : 231 SUM : 43031 rocksdb.table.open.io.micros P50 : 1233.505155 P95 : 6347.000000 P99 : 18626.666667 P100 : 21972.000000 COUNT : 506 SUM : 1050603 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.672229 P95 : 7.444712 P99 : 10.087810 P100 : 12995.000000 COUNT : 6963173 SUM : 37679443 rocksdb.read.block.get.micros P50 : 452.868217 P95 : 3260.000000 P99 : 6308.500000 P100 : 9136.000000 COUNT : 1012 SUM : 837963 rocksdb.write.raw.block.micros P50 : 0.513176 P95 : 0.975035 P99 : 2.884347 P100 : 24900.000000 COUNT : 9171801 SUM : 17661579 rocksdb.numfiles.in.singlecompaction P50 : 3.042553 P95 : 7.000000 P99 : 21.650000 P100 : 34.000000 COUNT : 110 SUM : 427 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558620 P95 : 1156.199654 P99 : 2457.337289 P100 : 431885.000000 COUNT : 235647 SUM : 35146715 rocksdb.sst.read.micros P50 : 1.616674 P95 : 4.412078 P99 : 8.026384 P100 : 11658.000000 COUNT : 6965837 SUM : 23485461 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9045999 SUM : 9335470968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 215000.000000 P95 : 350578.947368 P99 : 520600.000000 P100 : 669703.000000 COUNT : 126 SUM : 26795931 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 313 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0