[2024-08-13 16:06:17.608929] Starting SPDK v24.09-pre git sha1 7c739692e / DPDK 22.11.4 initialization... [2024-08-13 16:06:17.609048] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3503903 ] Set seed to 1723557977606534 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-08-13 16:06:17.695704] app.c: 910:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-08-13 16:06:17.737505] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-08-13 16:06:17.737549] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3503903' to capture a snapshot of events at runtime. [2024-08-13 16:06:17.737560] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-08-13 16:06:17.737570] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-08-13 16:06:17.737578] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3503903 for offline analysis/debug. [2024-08-13 16:06:17.737657] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Aug 13 16:06:21 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/08/13-16:06:24 ... thread 0: (1000000,1000000) ops and (360816.2,360816.2) ops/second in (2.771494,2.771494) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.03 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 358.2 2.29 2.07 12 0.191 0 0 0.0 0.0 L2 3/2 251.74 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 250.3 250.2 1.51 1.46 2 0.755 383K 203 0.0 0.0 L3 9/0 741.15 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.8 1.5 99.6 315.2 3.80 3.53 14 0.271 383K 203 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.4 1.5 99.6 315.2 3.80 3.53 14 0.271 383K 203 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 250.3 250.2 1.51 1.46 2 0.755 383K 203 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 358.2 2.29 2.07 12 0.191 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 398.90 MB/s write, 0.37 GB read, 125.97 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 431.46 MB/s write, 0.37 GB read, 136.25 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 99194 Average: 1.8592 StdDev: 18.51 Min: 0 Median: 1.1778 Max: 3523 Percentiles: P50: 1.18 P75: 1.64 P99: 3.86 P99.9: 9.46 P99.99: 288.64 ------------------------------------------------------ [ 0, 1 ] 40027 40.352% 40.352% ######## ( 1, 2 ] 53845 54.283% 94.635% ########### ( 2, 3 ] 3268 3.295% 97.929% # ( 3, 4 ] 1236 1.246% 99.175% ( 4, 6 ] 534 0.538% 99.714% ( 6, 10 ] 215 0.217% 99.930% ( 10, 15 ] 35 0.035% 99.966% ( 15, 22 ] 9 0.009% 99.975% ( 34, 51 ] 1 0.001% 99.976% ( 110, 170 ] 8 0.008% 99.984% ( 170, 250 ] 5 0.005% 99.989% ( 250, 380 ] 7 0.007% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 2 0.002% 100.001% ** Level 2 read latency histogram (micros): Count: 50870 Average: 2.1422 StdDev: 30.63 Min: 1 Median: 1.2260 Max: 4203 Percentiles: P50: 1.23 P75: 1.68 P99: 5.01 P99.9: 10.02 P99.99: 1066.27 ------------------------------------------------------ [ 0, 1 ] 19051 37.450% 37.450% ####### ( 1, 2 ] 28255 55.544% 92.994% ########### ( 2, 3 ] 1977 3.886% 96.880% # ( 3, 4 ] 836 1.643% 98.524% ( 4, 6 ] 480 0.944% 99.467% ( 6, 10 ] 221 0.434% 99.902% ( 10, 15 ] 28 0.055% 99.957% ( 15, 22 ] 2 0.004% 99.961% ( 22, 34 ] 4 0.008% 99.969% ( 51, 76 ] 1 0.002% 99.971% ( 110, 170 ] 1 0.002% 99.972% ( 250, 380 ] 1 0.002% 99.974% ( 380, 580 ] 5 0.010% 99.984% ( 580, 870 ] 3 0.006% 99.990% ( 870, 1300 ] 2 0.004% 99.994% ( 1300, 1900 ] 1 0.002% 99.996% ( 2900, 4400 ] 3 0.006% 100.002% ** Level 3 read latency histogram (micros): Count: 55 Average: 1792.1636 StdDev: 1618.03 Min: 72 Median: 1146.4286 Max: 6437 Percentiles: P50: 1146.43 P75: 2934.09 P99: 6196.67 P99.9: 6437.00 P99.99: 6437.00 ------------------------------------------------------ ( 51, 76 ] 1 1.818% 1.818% ( 110, 170 ] 2 3.636% 5.455% # ( 170, 250 ] 7 12.727% 18.182% ### ( 250, 380 ] 1 1.818% 20.000% ( 380, 580 ] 6 10.909% 30.909% ## ( 580, 870 ] 6 10.909% 41.818% ## ( 870, 1300 ] 7 12.727% 54.545% ### ( 1300, 1900 ] 4 7.273% 61.818% # ( 1900, 2900 ] 7 12.727% 74.545% ### ( 2900, 4400 ] 11 20.000% 94.545% #### ( 4400, 6600 ] 3 5.455% 100.000% # ** Level 4 read latency histogram (micros): Count: 15 Average: 1649.0000 StdDev: 1677.76 Min: 141 Median: 783.0000 Max: 5908 Percentiles: P50: 783.00 P75: 3368.75 P99: 5908.00 P99.9: 5908.00 P99.99: 5908.00 ------------------------------------------------------ ( 110, 170 ] 1 6.667% 6.667% # ( 170, 250 ] 2 13.333% 20.000% ### ( 250, 380 ] 1 6.667% 26.667% # ( 580, 870 ] 5 33.333% 60.000% ####### ( 870, 1300 ] 1 6.667% 66.667% # ( 2900, 4400 ] 4 26.667% 93.333% ##### ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 568.0000 StdDev: 704.61 Min: 77 Median: 152.8571 Max: 2099 Percentiles: P50: 152.86 P75: 580.00 P99: 2099.00 P99.9: 2099.00 P99.99: 2099.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 7 35.000% 60.000% ####### ( 250, 380 ] 1 5.000% 65.000% # ( 380, 580 ] 2 10.000% 75.000% ## ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 2 10.000% 90.000% ## ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 328.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.210 H:M:S, 7.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 354.77 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.210 H:M:S, 7.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/13-16:06:27 ... thread 0: (1000000,2000000) ops and (329071.2,344213.3) ops/second in (3.038856,5.810350) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 1.17 GB 12.6 0.2 0.0 0.2 2.0 1.8 0.0 1.1 41.7 344.0 6.04 5.52 27 0.224 255K 255 0.0 0.0 L1 1/1 2.87 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 238.9 238.5 1.58 1.53 1 1.582 383K 613 0.0 0.0 L2 2/0 54.21 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 250.3 250.2 1.51 1.46 2 0.755 383K 203 0.0 0.0 L3 38/0 961.79 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 203.9 203.7 3.91 3.45 3 1.302 809K 888 0.0 0.0 L4 148/0 9.51 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1251/13 97.92 GB 0.0 1.8 1.1 0.7 3.5 2.9 2.1 2.0 138.4 278.3 13.04 11.96 33 0.395 1832K 1959 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 1.1 0.7 3.5 2.9 1.7 2.0 138.4 278.3 13.04 11.96 33 0.395 1832K 1959 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 1.1 0.7 1.8 1.1 0.0 0.0 226.8 226.6 7.96 7.38 7 1.137 1832K 1959 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 359.2 5.09 4.59 26 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.54 GB write, 601.05 MB/s write, 1.76 GB read, 298.85 MB/s read, 13.0 seconds Interval compaction: 3.54 GB write, 624.46 MB/s write, 1.76 GB read, 310.49 MB/s read, 13.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 348088 Average: 2.1326 StdDev: 11.59 Min: 0 Median: 1.4520 Max: 3523 Percentiles: P50: 1.45 P75: 1.84 P99: 5.53 P99.9: 9.90 P99.99: 14.99 ------------------------------------------------------ [ 0, 1 ] 73612 21.148% 21.148% #### ( 1, 2 ] 222181 63.829% 84.977% ############# ( 2, 3 ] 32051 9.208% 94.184% ## ( 3, 4 ] 11275 3.239% 97.423% # ( 4, 6 ] 7180 2.063% 99.486% ( 6, 10 ] 1479 0.425% 99.911% ( 10, 15 ] 276 0.079% 99.990% ( 15, 22 ] 22 0.006% 99.997% ( 22, 34 ] 3 0.001% 99.997% ( 34, 51 ] 4 0.001% 99.999% ( 51, 76 ] 2 0.001% 99.999% ( 110, 170 ] 13 0.004% 100.003% ( 170, 250 ] 13 0.004% 100.007% ( 250, 380 ] 12 0.003% 100.010% ( 380, 580 ] 5 0.001% 100.011% ( 580, 870 ] 5 0.001% 100.013% ( 870, 1300 ] 1 0.000% 100.013% ( 1300, 1900 ] 2 0.001% 100.014% ( 1900, 2900 ] 2 0.001% 100.014% ( 2900, 4400 ] 2 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 81796 Average: 2.2760 StdDev: 5.90 Min: 1 Median: 1.5734 Max: 1205 Percentiles: P50: 1.57 P75: 1.95 P99: 5.69 P99.9: 10.84 P99.99: 14.93 ------------------------------------------------------ [ 0, 1 ] 9793 11.972% 11.972% ## ( 1, 2 ] 54247 66.320% 78.292% ############# ( 2, 3 ] 11882 14.526% 92.819% ### ( 3, 4 ] 3230 3.949% 96.768% # ( 4, 6 ] 2166 2.648% 99.416% # ( 6, 10 ] 381 0.466% 99.881% ( 10, 15 ] 90 0.110% 99.991% ( 15, 22 ] 6 0.007% 99.999% ( 22, 34 ] 2 0.002% 100.001% ( 51, 76 ] 1 0.001% 100.002% ( 170, 250 ] 3 0.004% 100.006% ( 250, 380 ] 1 0.001% 100.007% ( 380, 580 ] 2 0.002% 100.010% ( 580, 870 ] 1 0.001% 100.011% ( 870, 1300 ] 1 0.001% 100.012% ** Level 2 read latency histogram (micros): Count: 95429 Average: 2.2093 StdDev: 22.37 Min: 1 Median: 1.4156 Max: 4203 Percentiles: P50: 1.42 P75: 1.82 P99: 5.61 P99.9: 10.53 P99.99: 558.28 ------------------------------------------------------ [ 0, 1 ] 23356 24.475% 24.475% ##### ( 1, 2 ] 58617 61.425% 85.899% ############ ( 2, 3 ] 7856 8.232% 94.132% ## ( 3, 4 ] 3058 3.204% 97.336% # ( 4, 6 ] 1968 2.062% 99.399% ( 6, 10 ] 471 0.494% 99.892% ( 10, 15 ] 71 0.074% 99.966% ( 15, 22 ] 11 0.012% 99.978% ( 22, 34 ] 4 0.004% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 1 0.001% 99.985% ( 380, 580 ] 5 0.005% 99.991% ( 580, 870 ] 3 0.003% 99.994% ( 870, 1300 ] 2 0.002% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 2900, 4400 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 57434 Average: 4.0692 StdDev: 75.01 Min: 0 Median: 1.5692 Max: 6437 Percentiles: P50: 1.57 P75: 1.95 P99: 5.91 P99.9: 203.21 P99.99: 3616.81 ------------------------------------------------------ [ 0, 1 ] 7147 12.444% 12.444% ## ( 1, 2 ] 37897 65.984% 78.427% ############# ( 2, 3 ] 7990 13.912% 92.339% ### ( 3, 4 ] 2316 4.032% 96.371% # ( 4, 6 ] 1582 2.754% 99.126% # ( 6, 10 ] 311 0.541% 99.667% ( 10, 15 ] 65 0.113% 99.781% ( 15, 22 ] 12 0.021% 99.802% ( 22, 34 ] 24 0.042% 99.843% ( 34, 51 ] 24 0.042% 99.885% ( 51, 76 ] 1 0.002% 99.887% ( 110, 170 ] 3 0.005% 99.892% ( 170, 250 ] 11 0.019% 99.911% ( 250, 380 ] 4 0.007% 99.918% ( 380, 580 ] 8 0.014% 99.932% ( 580, 870 ] 9 0.016% 99.948% ( 870, 1300 ] 8 0.014% 99.962% ( 1300, 1900 ] 4 0.007% 99.969% ( 1900, 2900 ] 7 0.012% 99.981% ( 2900, 4400 ] 11 0.019% 100.000% ( 4400, 6600 ] 3 0.005% 100.005% ** Level 4 read latency histogram (micros): Count: 15 Average: 1649.0000 StdDev: 1677.76 Min: 141 Median: 783.0000 Max: 5908 Percentiles: P50: 783.00 P75: 3368.75 P99: 5908.00 P99.9: 5908.00 P99.99: 5908.00 ------------------------------------------------------ ( 110, 170 ] 1 6.667% 6.667% # ( 170, 250 ] 2 13.333% 20.000% ### ( 250, 380 ] 1 6.667% 26.667% # ( 580, 870 ] 5 33.333% 60.000% ####### ( 870, 1300 ] 1 6.667% 66.667% # ( 2900, 4400 ] 4 26.667% 93.333% ##### ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 718.2250 StdDev: 966.31 Min: 77 Median: 155.0000 Max: 3993 Percentiles: P50: 155.00 P75: 1156.67 P99: 3800.00 P99.9: 3993.00 P99.99: 3993.00 ------------------------------------------------------ ( 76, 110 ] 8 20.000% 20.000% #### ( 110, 170 ] 16 40.000% 60.000% ######## ( 250, 380 ] 1 2.500% 62.500% # ( 380, 580 ] 3 7.500% 70.000% ## ( 870, 1300 ] 3 7.500% 77.500% ## ( 1300, 1900 ] 2 5.000% 82.500% # ( 1900, 2900 ] 6 15.000% 97.500% ### ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 6.0 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 325.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.603 H:M:S, 10.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.393 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/13-16:06:30 ... thread 0: (1000000,3000000) ops and (330364.7,339469.9) ops/second in (3.026958,8.837308) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.41 GB 88.1 1.1 0.0 1.1 3.9 2.8 0.0 1.4 93.0 325.3 12.20 11.31 44 0.277 1151K 1253 0.0 0.0 L1 3/0 242.02 MB 24.2 1.1 1.1 0.0 1.1 1.1 0.2 1.0 236.6 235.9 4.80 4.67 2 2.402 1154K 3085 0.0 0.0 L2 2/0 54.21 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.9 2.0 250.3 250.2 1.51 1.46 2 0.755 383K 203 0.0 0.0 L3 17/0 981.36 MB 1.0 1.0 0.7 0.3 1.0 0.7 0.5 1.4 211.5 211.1 4.75 4.27 4 1.188 1020K 1504 0.0 0.0 L4 162/0 9.68 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1247/8 98.90 GB 0.0 3.6 2.0 1.6 6.3 4.7 3.8 2.3 157.1 278.7 23.26 21.71 52 0.447 3710K 6045 0.0 0.0 Int 0/0 0.00 KB 0.0 3.6 2.0 1.6 6.3 4.7 3.4 2.3 157.1 278.7 23.26 21.71 52 0.447 3710K 6045 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.6 2.0 1.6 3.6 2.0 0.0 0.0 238.6 238.2 15.31 14.56 12 1.276 3710K 6045 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 356.6 7.95 7.15 40 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.33 GB write, 715.04 MB/s write, 3.57 GB read, 403.03 MB/s read, 23.3 seconds Interval compaction: 6.33 GB write, 733.35 MB/s write, 3.57 GB read, 413.35 MB/s read, 23.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 696627 Average: 2.1408 StdDev: 9.63 Min: 0 Median: 1.4717 Max: 3523 Percentiles: P50: 1.47 P75: 1.85 P99: 5.49 P99.9: 9.74 P99.99: 14.40 ------------------------------------------------------ [ 0, 1 ] 133172 19.117% 19.117% #### ( 1, 2 ] 456095 65.472% 84.589% ############# ( 2, 3 ] 66024 9.478% 94.066% ## ( 3, 4 ] 23507 3.374% 97.441% # ( 4, 6 ] 14583 2.093% 99.534% ( 6, 10 ] 2731 0.392% 99.926% ( 10, 15 ] 509 0.073% 99.999% ( 15, 22 ] 70 0.010% 100.009% ( 22, 34 ] 14 0.002% 100.011% ( 34, 51 ] 9 0.001% 100.012% ( 51, 76 ] 5 0.001% 100.013% ( 110, 170 ] 18 0.003% 100.016% ( 170, 250 ] 21 0.003% 100.019% ( 250, 380 ] 19 0.003% 100.022% ( 380, 580 ] 6 0.001% 100.022% ( 580, 870 ] 8 0.001% 100.024% ( 870, 1300 ] 9 0.001% 100.025% ( 1300, 1900 ] 4 0.001% 100.025% ( 1900, 2900 ] 2 0.000% 100.026% ( 2900, 4400 ] 2 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 115253 Average: 2.3459 StdDev: 13.68 Min: 1 Median: 1.5680 Max: 3368 Percentiles: P50: 1.57 P75: 1.94 P99: 5.65 P99.9: 10.95 P99.99: 62.87 ------------------------------------------------------ [ 0, 1 ] 13631 11.827% 11.827% ## ( 1, 2 ] 77451 67.201% 79.028% ############# ( 2, 3 ] 16193 14.050% 93.078% ### ( 3, 4 ] 4391 3.810% 96.888% # ( 4, 6 ] 2954 2.563% 99.451% # ( 6, 10 ] 497 0.431% 99.882% ( 10, 15 ] 109 0.095% 99.977% ( 15, 22 ] 11 0.010% 99.986% ( 22, 34 ] 4 0.003% 99.990% ( 51, 76 ] 1 0.001% 99.990% ( 76, 110 ] 1 0.001% 99.991% ( 170, 250 ] 3 0.003% 99.994% ( 250, 380 ] 6 0.005% 99.999% ( 380, 580 ] 3 0.003% 100.002% ( 580, 870 ] 4 0.003% 100.005% ( 870, 1300 ] 1 0.001% 100.006% ( 1300, 1900 ] 2 0.002% 100.008% ( 2900, 4400 ] 1 0.001% 100.009% ** Level 2 read latency histogram (micros): Count: 95429 Average: 2.2093 StdDev: 22.37 Min: 1 Median: 1.4156 Max: 4203 Percentiles: P50: 1.42 P75: 1.82 P99: 5.61 P99.9: 10.53 P99.99: 558.28 ------------------------------------------------------ [ 0, 1 ] 23356 24.475% 24.475% ##### ( 1, 2 ] 58617 61.425% 85.899% ############ ( 2, 3 ] 7856 8.232% 94.132% ## ( 3, 4 ] 3058 3.204% 97.336% # ( 4, 6 ] 1968 2.062% 99.399% ( 6, 10 ] 471 0.494% 99.892% ( 10, 15 ] 71 0.074% 99.966% ( 15, 22 ] 11 0.012% 99.978% ( 22, 34 ] 4 0.004% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 1 0.001% 99.985% ( 380, 580 ] 5 0.005% 99.991% ( 580, 870 ] 3 0.003% 99.994% ( 870, 1300 ] 2 0.002% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 2900, 4400 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 77693 Average: 3.5631 StdDev: 64.62 Min: 0 Median: 1.5396 Max: 6437 Percentiles: P50: 1.54 P75: 1.91 P99: 5.79 P99.9: 45.77 P99.99: 3340.55 ------------------------------------------------------ [ 0, 1 ] 10843 13.956% 13.956% ### ( 1, 2 ] 51898 66.799% 80.755% ############# ( 2, 3 ] 9553 12.296% 93.051% ## ( 3, 4 ] 3021 3.888% 96.939% # ( 4, 6 ] 1790 2.304% 99.243% ( 6, 10 ] 377 0.485% 99.728% ( 10, 15 ] 73 0.094% 99.822% ( 15, 22 ] 18 0.023% 99.846% ( 22, 34 ] 25 0.032% 99.878% ( 34, 51 ] 25 0.032% 99.910% ( 51, 76 ] 1 0.001% 99.911% ( 110, 170 ] 3 0.004% 99.915% ( 170, 250 ] 12 0.015% 99.930% ( 250, 380 ] 5 0.006% 99.937% ( 380, 580 ] 8 0.010% 99.947% ( 580, 870 ] 11 0.014% 99.961% ( 870, 1300 ] 8 0.010% 99.972% ( 1300, 1900 ] 4 0.005% 99.977% ( 1900, 2900 ] 7 0.009% 99.986% ( 2900, 4400 ] 11 0.014% 100.000% ( 4400, 6600 ] 3 0.004% 100.004% ** Level 4 read latency histogram (micros): Count: 15 Average: 1649.0000 StdDev: 1677.76 Min: 141 Median: 783.0000 Max: 5908 Percentiles: P50: 783.00 P75: 3368.75 P99: 5908.00 P99.9: 5908.00 P99.99: 5908.00 ------------------------------------------------------ ( 110, 170 ] 1 6.667% 6.667% # ( 170, 250 ] 2 13.333% 20.000% ### ( 250, 380 ] 1 6.667% 26.667% # ( 580, 870 ] 5 33.333% 60.000% ####### ( 870, 1300 ] 1 6.667% 66.667% # ( 2900, 4400 ] 4 26.667% 93.333% ##### ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 742.3667 StdDev: 1022.88 Min: 77 Median: 161.0000 Max: 4157 Percentiles: P50: 161.00 P75: 1013.33 P99: 4100.00 P99.9: 4157.00 P99.99: 4157.00 ------------------------------------------------------ ( 76, 110 ] 13 21.667% 21.667% #### ( 110, 170 ] 20 33.333% 55.000% ####### ( 250, 380 ] 3 5.000% 60.000% # ( 380, 580 ] 6 10.000% 70.000% ## ( 580, 870 ] 2 3.333% 73.333% # ( 870, 1300 ] 3 5.000% 78.333% # ( 1300, 1900 ] 3 5.000% 83.333% # ( 1900, 2900 ] 7 11.667% 95.000% ## ( 2900, 4400 ] 3 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 325.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.995 H:M:S, 11.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.392 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/13-16:06:33 ... thread 0: (1000000,4000000) ops and (339570.7,339495.1) ops/second in (2.944895,11.782203) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.40 GB 214.0 2.2 0.0 2.2 6.0 3.8 0.0 1.6 118.7 319.7 19.10 17.87 62 0.308 2302K 2470 0.0 0.0 L1 3/0 242.02 MB 24.2 1.1 1.1 0.0 1.1 1.1 0.2 1.0 236.6 235.9 4.80 4.67 2 2.402 1154K 3085 0.0 0.0 L2 2/0 54.21 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.9 2.0 250.3 250.2 1.51 1.46 2 0.755 383K 203 0.0 0.0 L3 17/0 981.36 MB 1.0 1.0 0.7 0.3 1.0 0.7 0.5 1.4 211.5 211.1 4.75 4.27 4 1.188 1020K 1504 0.0 0.0 L4 162/0 9.68 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/4 99.88 GB 0.0 4.7 2.0 2.7 8.4 5.7 3.8 2.2 158.7 285.8 30.17 28.27 70 0.431 4861K 7262 0.0 0.0 Int 0/0 0.00 KB 0.0 4.7 2.0 2.7 8.4 5.7 3.4 2.2 158.7 285.8 30.17 28.27 70 0.431 4861K 7262 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.7 2.0 2.7 4.7 2.0 0.0 0.0 245.2 244.8 19.53 18.69 16 1.220 4861K 7262 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 361.0 10.64 9.57 54 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.8 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.42 GB write, 717.94 MB/s write, 4.68 GB read, 398.62 MB/s read, 30.2 seconds Interval compaction: 8.42 GB write, 731.74 MB/s write, 4.68 GB read, 406.28 MB/s read, 30.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 953584 Average: 2.0808 StdDev: 10.59 Min: 0 Median: 1.4301 Max: 3817 Percentiles: P50: 1.43 P75: 1.82 P99: 5.32 P99.9: 9.68 P99.99: 14.67 ------------------------------------------------------ [ 0, 1 ] 212991 22.336% 22.336% #### ( 1, 2 ] 613342 64.320% 86.656% ############# ( 2, 3 ] 78630 8.246% 94.901% ## ( 3, 4 ] 28082 2.945% 97.846% # ( 4, 6 ] 16614 1.742% 99.588% ( 6, 10 ] 3236 0.339% 99.928% ( 10, 15 ] 638 0.067% 99.995% ( 15, 22 ] 92 0.010% 100.004% ( 22, 34 ] 16 0.002% 100.006% ( 34, 51 ] 11 0.001% 100.007% ( 51, 76 ] 14 0.001% 100.009% ( 110, 170 ] 25 0.003% 100.011% ( 170, 250 ] 28 0.003% 100.014% ( 250, 380 ] 24 0.003% 100.017% ( 380, 580 ] 8 0.001% 100.018% ( 580, 870 ] 15 0.002% 100.019% ( 870, 1300 ] 13 0.001% 100.020% ( 1300, 1900 ] 6 0.001% 100.021% ( 1900, 2900 ] 2 0.000% 100.021% ( 2900, 4400 ] 4 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 115253 Average: 2.3459 StdDev: 13.68 Min: 1 Median: 1.5680 Max: 3368 Percentiles: P50: 1.57 P75: 1.94 P99: 5.65 P99.9: 10.95 P99.99: 62.87 ------------------------------------------------------ [ 0, 1 ] 13631 11.827% 11.827% ## ( 1, 2 ] 77451 67.201% 79.028% ############# ( 2, 3 ] 16193 14.050% 93.078% ### ( 3, 4 ] 4391 3.810% 96.888% # ( 4, 6 ] 2954 2.563% 99.451% # ( 6, 10 ] 497 0.431% 99.882% ( 10, 15 ] 109 0.095% 99.977% ( 15, 22 ] 11 0.010% 99.986% ( 22, 34 ] 4 0.003% 99.990% ( 51, 76 ] 1 0.001% 99.990% ( 76, 110 ] 1 0.001% 99.991% ( 170, 250 ] 3 0.003% 99.994% ( 250, 380 ] 6 0.005% 99.999% ( 380, 580 ] 3 0.003% 100.002% ( 580, 870 ] 4 0.003% 100.005% ( 870, 1300 ] 1 0.001% 100.006% ( 1300, 1900 ] 2 0.002% 100.008% ( 2900, 4400 ] 1 0.001% 100.009% ** Level 2 read latency histogram (micros): Count: 95429 Average: 2.2093 StdDev: 22.37 Min: 1 Median: 1.4156 Max: 4203 Percentiles: P50: 1.42 P75: 1.82 P99: 5.61 P99.9: 10.53 P99.99: 558.28 ------------------------------------------------------ [ 0, 1 ] 23356 24.475% 24.475% ##### ( 1, 2 ] 58617 61.425% 85.899% ############ ( 2, 3 ] 7856 8.232% 94.132% ## ( 3, 4 ] 3058 3.204% 97.336% # ( 4, 6 ] 1968 2.062% 99.399% ( 6, 10 ] 471 0.494% 99.892% ( 10, 15 ] 71 0.074% 99.966% ( 15, 22 ] 11 0.012% 99.978% ( 22, 34 ] 4 0.004% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 1 0.001% 99.985% ( 380, 580 ] 5 0.005% 99.991% ( 580, 870 ] 3 0.003% 99.994% ( 870, 1300 ] 2 0.002% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 2900, 4400 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 77693 Average: 3.5631 StdDev: 64.62 Min: 0 Median: 1.5396 Max: 6437 Percentiles: P50: 1.54 P75: 1.91 P99: 5.79 P99.9: 45.77 P99.99: 3340.55 ------------------------------------------------------ [ 0, 1 ] 10843 13.956% 13.956% ### ( 1, 2 ] 51898 66.799% 80.755% ############# ( 2, 3 ] 9553 12.296% 93.051% ## ( 3, 4 ] 3021 3.888% 96.939% # ( 4, 6 ] 1790 2.304% 99.243% ( 6, 10 ] 377 0.485% 99.728% ( 10, 15 ] 73 0.094% 99.822% ( 15, 22 ] 18 0.023% 99.846% ( 22, 34 ] 25 0.032% 99.878% ( 34, 51 ] 25 0.032% 99.910% ( 51, 76 ] 1 0.001% 99.911% ( 110, 170 ] 3 0.004% 99.915% ( 170, 250 ] 12 0.015% 99.930% ( 250, 380 ] 5 0.006% 99.937% ( 380, 580 ] 8 0.010% 99.947% ( 580, 870 ] 11 0.014% 99.961% ( 870, 1300 ] 8 0.010% 99.972% ( 1300, 1900 ] 4 0.005% 99.977% ( 1900, 2900 ] 7 0.009% 99.986% ( 2900, 4400 ] 11 0.014% 100.000% ( 4400, 6600 ] 3 0.004% 100.004% ** Level 4 read latency histogram (micros): Count: 15 Average: 1649.0000 StdDev: 1677.76 Min: 141 Median: 783.0000 Max: 5908 Percentiles: P50: 783.00 P75: 3368.75 P99: 5908.00 P99.9: 5908.00 P99.99: 5908.00 ------------------------------------------------------ ( 110, 170 ] 1 6.667% 6.667% # ( 170, 250 ] 2 13.333% 20.000% ### ( 250, 380 ] 1 6.667% 26.667% # ( 580, 870 ] 5 33.333% 60.000% ####### ( 870, 1300 ] 1 6.667% 66.667% # ( 2900, 4400 ] 4 26.667% 93.333% ##### ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 742.3667 StdDev: 1022.88 Min: 77 Median: 161.0000 Max: 4157 Percentiles: P50: 161.00 P75: 1013.33 P99: 4100.00 P99.9: 4157.00 P99.99: 4157.00 ------------------------------------------------------ ( 76, 110 ] 13 21.667% 21.667% #### ( 110, 170 ] 20 33.333% 55.000% ####### ( 250, 380 ] 3 5.000% 60.000% # ( 380, 580 ] 6 10.000% 70.000% ## ( 580, 870 ] 2 3.333% 73.333% # ( 870, 1300 ] 3 5.000% 78.333% # ( 1300, 1900 ] 3 5.000% 83.333% # ( 1900, 2900 ] 7 11.667% 95.000% ## ( 2900, 4400 ] 3 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.0 total, 2.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 327.77 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.353 H:M:S, 11.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 334.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.358 H:M:S, 12.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/08/13-16:06:36 ... thread 0: (1000000,5000000) ops and (334899.3,338565.9) ops/second in (2.985972,14.768175) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/4 3.32 GB 314.6 3.1 0.0 3.1 7.7 4.7 0.0 1.7 126.2 317.9 24.96 23.38 78 0.320 3198K 3478 0.0 0.0 L1 3/0 242.02 MB 24.2 1.1 1.1 0.0 1.1 1.1 0.2 1.0 236.6 235.9 4.80 4.67 2 2.402 1154K 3085 0.0 0.0 L2 2/0 54.21 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.9 2.0 250.3 250.2 1.51 1.46 2 0.755 383K 203 0.0 0.0 L3 17/0 981.36 MB 1.0 1.0 0.7 0.3 1.0 0.7 0.5 1.4 211.5 211.1 4.75 4.27 4 1.188 1020K 1504 0.0 0.0 L4 162/0 9.68 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1253/4 100.80 GB 0.0 5.5 2.0 3.6 10.2 6.6 3.8 2.2 157.4 290.0 36.02 33.78 86 0.419 5756K 8270 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 2.0 3.6 10.2 6.6 3.4 2.2 157.4 290.0 36.02 33.78 86 0.419 5756K 8270 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 2.0 3.6 5.5 2.0 0.0 0.0 248.9 248.6 22.78 21.88 19 1.199 5756K 8270 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 361.4 13.25 11.90 67 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.0 total, 14.8 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.20 GB write, 696.74 MB/s write, 5.54 GB read, 378.06 MB/s read, 36.0 seconds Interval compaction: 10.20 GB write, 707.42 MB/s write, 5.54 GB read, 383.86 MB/s read, 36.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1215013 Average: 2.0376 StdDev: 10.14 Min: 0 Median: 1.4039 Max: 3817 Percentiles: P50: 1.40 P75: 1.80 P99: 5.22 P99.9: 9.74 P99.99: 14.85 ------------------------------------------------------ [ 0, 1 ] 295706 24.338% 24.338% ##### ( 1, 2 ] 771969 63.536% 87.874% ############# ( 2, 3 ] 91309 7.515% 95.389% ## ( 3, 4 ] 32514 2.676% 98.065% # ( 4, 6 ] 18648 1.535% 99.599% ( 6, 10 ] 3908 0.322% 99.921% ( 10, 15 ] 865 0.071% 99.992% ( 15, 22 ] 117 0.010% 100.002% ( 22, 34 ] 18 0.001% 100.003% ( 34, 51 ] 13 0.001% 100.004% ( 51, 76 ] 17 0.001% 100.006% ( 110, 170 ] 31 0.003% 100.008% ( 170, 250 ] 35 0.003% 100.011% ( 250, 380 ] 31 0.003% 100.014% ( 380, 580 ] 10 0.001% 100.015% ( 580, 870 ] 20 0.002% 100.016% ( 870, 1300 ] 15 0.001% 100.018% ( 1300, 1900 ] 8 0.001% 100.018% ( 1900, 2900 ] 3 0.000% 100.018% ( 2900, 4400 ] 4 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 115253 Average: 2.3459 StdDev: 13.68 Min: 1 Median: 1.5680 Max: 3368 Percentiles: P50: 1.57 P75: 1.94 P99: 5.65 P99.9: 10.95 P99.99: 62.87 ------------------------------------------------------ [ 0, 1 ] 13631 11.827% 11.827% ## ( 1, 2 ] 77451 67.201% 79.028% ############# ( 2, 3 ] 16193 14.050% 93.078% ### ( 3, 4 ] 4391 3.810% 96.888% # ( 4, 6 ] 2954 2.563% 99.451% # ( 6, 10 ] 497 0.431% 99.882% ( 10, 15 ] 109 0.095% 99.977% ( 15, 22 ] 11 0.010% 99.986% ( 22, 34 ] 4 0.003% 99.990% ( 51, 76 ] 1 0.001% 99.990% ( 76, 110 ] 1 0.001% 99.991% ( 170, 250 ] 3 0.003% 99.994% ( 250, 380 ] 6 0.005% 99.999% ( 380, 580 ] 3 0.003% 100.002% ( 580, 870 ] 4 0.003% 100.005% ( 870, 1300 ] 1 0.001% 100.006% ( 1300, 1900 ] 2 0.002% 100.008% ( 2900, 4400 ] 1 0.001% 100.009% ** Level 2 read latency histogram (micros): Count: 95429 Average: 2.2093 StdDev: 22.37 Min: 1 Median: 1.4156 Max: 4203 Percentiles: P50: 1.42 P75: 1.82 P99: 5.61 P99.9: 10.53 P99.99: 558.28 ------------------------------------------------------ [ 0, 1 ] 23356 24.475% 24.475% ##### ( 1, 2 ] 58617 61.425% 85.899% ############ ( 2, 3 ] 7856 8.232% 94.132% ## ( 3, 4 ] 3058 3.204% 97.336% # ( 4, 6 ] 1968 2.062% 99.399% ( 6, 10 ] 471 0.494% 99.892% ( 10, 15 ] 71 0.074% 99.966% ( 15, 22 ] 11 0.012% 99.978% ( 22, 34 ] 4 0.004% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 1 0.001% 99.985% ( 380, 580 ] 5 0.005% 99.991% ( 580, 870 ] 3 0.003% 99.994% ( 870, 1300 ] 2 0.002% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 2900, 4400 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 77693 Average: 3.5631 StdDev: 64.62 Min: 0 Median: 1.5396 Max: 6437 Percentiles: P50: 1.54 P75: 1.91 P99: 5.79 P99.9: 45.77 P99.99: 3340.55 ------------------------------------------------------ [ 0, 1 ] 10843 13.956% 13.956% ### ( 1, 2 ] 51898 66.799% 80.755% ############# ( 2, 3 ] 9553 12.296% 93.051% ## ( 3, 4 ] 3021 3.888% 96.939% # ( 4, 6 ] 1790 2.304% 99.243% ( 6, 10 ] 377 0.485% 99.728% ( 10, 15 ] 73 0.094% 99.822% ( 15, 22 ] 18 0.023% 99.846% ( 22, 34 ] 25 0.032% 99.878% ( 34, 51 ] 25 0.032% 99.910% ( 51, 76 ] 1 0.001% 99.911% ( 110, 170 ] 3 0.004% 99.915% ( 170, 250 ] 12 0.015% 99.930% ( 250, 380 ] 5 0.006% 99.937% ( 380, 580 ] 8 0.010% 99.947% ( 580, 870 ] 11 0.014% 99.961% ( 870, 1300 ] 8 0.010% 99.972% ( 1300, 1900 ] 4 0.005% 99.977% ( 1900, 2900 ] 7 0.009% 99.986% ( 2900, 4400 ] 11 0.014% 100.000% ( 4400, 6600 ] 3 0.004% 100.004% ** Level 4 read latency histogram (micros): Count: 15 Average: 1649.0000 StdDev: 1677.76 Min: 141 Median: 783.0000 Max: 5908 Percentiles: P50: 783.00 P75: 3368.75 P99: 5908.00 P99.9: 5908.00 P99.99: 5908.00 ------------------------------------------------------ ( 110, 170 ] 1 6.667% 6.667% # ( 170, 250 ] 2 13.333% 20.000% ### ( 250, 380 ] 1 6.667% 26.667% # ( 580, 870 ] 5 33.333% 60.000% ####### ( 870, 1300 ] 1 6.667% 66.667% # ( 2900, 4400 ] 4 26.667% 93.333% ##### ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 742.3667 StdDev: 1022.88 Min: 77 Median: 161.0000 Max: 4157 Percentiles: P50: 161.00 P75: 1013.33 P99: 4100.00 P99.9: 4157.00 P99.99: 4157.00 ------------------------------------------------------ ( 76, 110 ] 13 21.667% 21.667% #### ( 110, 170 ] 20 33.333% 55.000% ####### ( 250, 380 ] 3 5.000% 60.000% # ( 380, 580 ] 6 10.000% 70.000% ## ( 580, 870 ] 2 3.333% 73.333% # ( 870, 1300 ] 3 5.000% 78.333% # ( 1300, 1900 ] 3 5.000% 83.333% # ( 1900, 2900 ] 7 11.667% 95.000% ## ( 2900, 4400 ] 3 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.0 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 328.13 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.740 H:M:S, 11.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.387 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/08/13-16:06:44 ... thread 0: (1000000,6000000) ops and (129634.5,266878.1) ops/second in (7.713997,22.482172) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 4.36 GB 106.7 5.0 0.0 5.0 10.7 5.7 0.0 1.9 145.1 311.6 35.15 33.14 99 0.355 5180K 7364 0.0 0.0 L1 3/3 242.02 MB 0.0 1.1 1.1 0.0 1.1 1.1 0.2 1.0 236.6 235.9 4.80 4.67 2 2.402 1154K 3085 0.0 0.0 L2 2/0 54.21 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.9 2.0 250.3 250.2 1.51 1.46 2 0.755 383K 203 0.0 0.0 L3 17/0 981.36 MB 1.0 1.0 0.7 0.3 1.0 0.7 0.5 1.4 211.5 211.1 4.75 4.27 4 1.188 1020K 1504 0.0 0.0 L4 162/0 9.68 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/17 101.85 GB 0.0 7.4 2.0 5.5 13.2 7.7 3.8 2.3 164.9 291.4 46.22 43.54 107 0.432 7738K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.4 2.0 5.5 13.2 7.7 3.4 2.3 164.9 291.4 46.22 43.54 107 0.432 7738K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.4 2.0 5.5 7.4 2.0 0.0 0.0 254.7 254.2 29.93 28.94 24 1.247 7738K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 359.6 16.29 14.61 83 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.7 total, 22.5 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.15 GB write, 593.01 MB/s write, 7.44 GB read, 335.60 MB/s read, 46.2 seconds Interval compaction: 13.15 GB write, 598.99 MB/s write, 7.44 GB read, 338.98 MB/s read, 46.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 14, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2105069 Average: 2.0646 StdDev: 9.78 Min: 0 Median: 1.4239 Max: 3892 Percentiles: P50: 1.42 P75: 1.81 P99: 5.22 P99.9: 9.74 P99.99: 18.81 ------------------------------------------------------ [ 0, 1 ] 468251 22.244% 22.244% #### ( 1, 2 ] 1378303 65.475% 87.719% ############# ( 2, 3 ] 161820 7.687% 95.407% ## ( 3, 4 ] 57132 2.714% 98.121% # ( 4, 6 ] 30238 1.436% 99.557% ( 6, 10 ] 7734 0.367% 99.924% ( 10, 15 ] 1285 0.061% 99.985% ( 15, 22 ] 179 0.009% 99.994% ( 22, 34 ] 21 0.001% 99.995% ( 34, 51 ] 22 0.001% 99.996% ( 51, 76 ] 30 0.001% 99.997% ( 76, 110 ] 111 0.005% 100.003% ( 110, 170 ] 115 0.005% 100.008% ( 170, 250 ] 70 0.003% 100.011% ( 250, 380 ] 55 0.003% 100.014% ( 380, 580 ] 23 0.001% 100.015% ( 580, 870 ] 32 0.002% 100.017% ( 870, 1300 ] 24 0.001% 100.018% ( 1300, 1900 ] 9 0.000% 100.018% ( 1900, 2900 ] 7 0.000% 100.019% ( 2900, 4400 ] 6 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 115254 Average: 2.3488 StdDev: 13.71 Min: 1 Median: 1.5680 Max: 3368 Percentiles: P50: 1.57 P75: 1.94 P99: 5.65 P99.9: 11.00 P99.99: 92.14 ------------------------------------------------------ [ 0, 1 ] 13631 11.827% 11.827% ## ( 1, 2 ] 77451 67.200% 79.027% ############# ( 2, 3 ] 16193 14.050% 93.077% ### ( 3, 4 ] 4391 3.810% 96.887% # ( 4, 6 ] 2954 2.563% 99.450% # ( 6, 10 ] 497 0.431% 99.881% ( 10, 15 ] 109 0.095% 99.976% ( 15, 22 ] 11 0.010% 99.985% ( 22, 34 ] 4 0.003% 99.989% ( 51, 76 ] 1 0.001% 99.990% ( 76, 110 ] 1 0.001% 99.990% ( 170, 250 ] 3 0.003% 99.993% ( 250, 380 ] 7 0.006% 99.999% ( 380, 580 ] 3 0.003% 100.002% ( 580, 870 ] 4 0.003% 100.005% ( 870, 1300 ] 1 0.001% 100.006% ( 1300, 1900 ] 2 0.002% 100.008% ( 2900, 4400 ] 1 0.001% 100.009% ** Level 2 read latency histogram (micros): Count: 95429 Average: 2.2093 StdDev: 22.37 Min: 1 Median: 1.4156 Max: 4203 Percentiles: P50: 1.42 P75: 1.82 P99: 5.61 P99.9: 10.53 P99.99: 558.28 ------------------------------------------------------ [ 0, 1 ] 23356 24.475% 24.475% ##### ( 1, 2 ] 58617 61.425% 85.899% ############ ( 2, 3 ] 7856 8.232% 94.132% ## ( 3, 4 ] 3058 3.204% 97.336% # ( 4, 6 ] 1968 2.062% 99.399% ( 6, 10 ] 471 0.494% 99.892% ( 10, 15 ] 71 0.074% 99.966% ( 15, 22 ] 11 0.012% 99.978% ( 22, 34 ] 4 0.004% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 1 0.001% 99.985% ( 380, 580 ] 5 0.005% 99.991% ( 580, 870 ] 3 0.003% 99.994% ( 870, 1300 ] 2 0.002% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 2900, 4400 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 77693 Average: 3.5631 StdDev: 64.62 Min: 0 Median: 1.5396 Max: 6437 Percentiles: P50: 1.54 P75: 1.91 P99: 5.79 P99.9: 45.77 P99.99: 3340.55 ------------------------------------------------------ [ 0, 1 ] 10843 13.956% 13.956% ### ( 1, 2 ] 51898 66.799% 80.755% ############# ( 2, 3 ] 9553 12.296% 93.051% ## ( 3, 4 ] 3021 3.888% 96.939% # ( 4, 6 ] 1790 2.304% 99.243% ( 6, 10 ] 377 0.485% 99.728% ( 10, 15 ] 73 0.094% 99.822% ( 15, 22 ] 18 0.023% 99.846% ( 22, 34 ] 25 0.032% 99.878% ( 34, 51 ] 25 0.032% 99.910% ( 51, 76 ] 1 0.001% 99.911% ( 110, 170 ] 3 0.004% 99.915% ( 170, 250 ] 12 0.015% 99.930% ( 250, 380 ] 5 0.006% 99.937% ( 380, 580 ] 8 0.010% 99.947% ( 580, 870 ] 11 0.014% 99.961% ( 870, 1300 ] 8 0.010% 99.972% ( 1300, 1900 ] 4 0.005% 99.977% ( 1900, 2900 ] 7 0.009% 99.986% ( 2900, 4400 ] 11 0.014% 100.000% ( 4400, 6600 ] 3 0.004% 100.004% ** Level 4 read latency histogram (micros): Count: 15 Average: 1649.0000 StdDev: 1677.76 Min: 141 Median: 783.0000 Max: 5908 Percentiles: P50: 783.00 P75: 3368.75 P99: 5908.00 P99.9: 5908.00 P99.99: 5908.00 ------------------------------------------------------ ( 110, 170 ] 1 6.667% 6.667% # ( 170, 250 ] 2 13.333% 20.000% ### ( 250, 380 ] 1 6.667% 26.667% # ( 580, 870 ] 5 33.333% 60.000% ####### ( 870, 1300 ] 1 6.667% 66.667% # ( 2900, 4400 ] 4 26.667% 93.333% ##### ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 742.3667 StdDev: 1022.88 Min: 77 Median: 161.0000 Max: 4157 Percentiles: P50: 161.00 P75: 1013.33 P99: 4100.00 P99.9: 4157.00 P99.99: 4157.00 ------------------------------------------------------ ( 76, 110 ] 13 21.667% 21.667% #### ( 110, 170 ] 20 33.333% 55.000% ####### ( 250, 380 ] 3 5.000% 60.000% # ( 380, 580 ] 6 10.000% 70.000% ## ( 580, 870 ] 2 3.333% 73.333% # ( 870, 1300 ] 3 5.000% 78.333% # ( 1300, 1900 ] 3 5.000% 83.333% # ( 1900, 2900 ] 7 11.667% 95.000% ## ( 2900, 4400 ] 3 5.000% 100.000% # ** DB Stats ** Uptime(secs): 22.7 total, 7.7 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 260.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.611 H:M:S, 29.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 127.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.871 H:M:S, 63.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/08/13-16:06:56 ... thread 0: (1000000,7000000) ops and (84311.0,203826.0) ops/second in (11.860846,34.343018) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/3 1.96 GB 25.2 6.5 0.0 6.5 13.2 6.6 0.0 2.0 150.5 303.6 44.36 41.44 117 0.379 6778K 10K 0.0 0.0 L1 13/13 1.48 GB 0.0 4.7 4.4 0.2 4.6 4.4 0.2 1.0 224.6 221.5 21.27 20.07 3 7.089 4850K 65K 0.0 0.0 L2 11/8 1.38 GB 3.9 0.4 0.2 0.2 0.4 0.2 2.9 2.0 250.3 250.2 1.51 1.46 2 0.755 383K 203 0.0 0.0 L3 23/6 1.40 GB 0.8 2.3 1.4 0.9 2.3 1.4 0.5 1.7 185.5 184.9 12.66 10.32 8 1.582 2385K 8782 0.0 0.0 L4 160/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 86.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/30 102.70 GB 0.0 13.8 6.0 7.9 20.4 12.5 6.3 3.1 177.7 261.9 79.80 73.28 130 0.614 14M 84K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.8 6.0 7.9 20.4 12.5 5.9 3.1 177.7 261.9 79.80 73.28 130 0.614 14M 84K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.8 6.0 7.9 13.8 5.9 0.0 0.0 234.9 233.5 60.36 56.18 33 1.829 14M 84K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 349.9 19.44 17.10 97 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.6 total, 34.3 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.41 GB write, 604.48 MB/s write, 13.85 GB read, 410.15 MB/s read, 79.8 seconds Interval compaction: 20.41 GB write, 608.47 MB/s write, 13.85 GB read, 412.86 MB/s read, 79.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 15, interval: 38 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3064577 Average: 2.4565 StdDev: 15.65 Min: 0 Median: 1.4487 Max: 4793 Percentiles: P50: 1.45 P75: 1.84 P99: 5.88 P99.9: 118.87 P99.99: 287.89 ------------------------------------------------------ [ 0, 1 ] 642594 20.968% 20.968% #### ( 1, 2 ] 1982767 64.700% 85.668% ############# ( 2, 3 ] 257178 8.392% 94.060% ## ( 3, 4 ] 94911 3.097% 97.157% # ( 4, 6 ] 60101 1.961% 99.118% ( 6, 10 ] 18209 0.594% 99.712% ( 10, 15 ] 2548 0.083% 99.795% ( 15, 22 ] 351 0.011% 99.807% ( 22, 34 ] 29 0.001% 99.808% ( 34, 51 ] 30 0.001% 99.809% ( 51, 76 ] 48 0.002% 99.810% ( 76, 110 ] 2396 0.078% 99.889% ( 110, 170 ] 2376 0.078% 99.966% ( 170, 250 ] 605 0.020% 99.986% ( 250, 380 ] 441 0.014% 100.000% ( 380, 580 ] 311 0.010% 100.010% ( 580, 870 ] 165 0.005% 100.016% ( 870, 1300 ] 60 0.002% 100.018% ( 1300, 1900 ] 18 0.001% 100.018% ( 1900, 2900 ] 16 0.001% 100.019% ( 2900, 4400 ] 18 0.001% 100.019% ( 4400, 6600 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 692340 Average: 4.0603 StdDev: 42.22 Min: 1 Median: 1.7827 Max: 5509 Percentiles: P50: 1.78 P75: 2.66 P99: 8.93 P99.9: 118.28 P99.99: 275.76 ------------------------------------------------------ [ 0, 1 ] 38021 5.492% 5.492% # ( 1, 2 ] 393676 56.862% 62.353% ########### ( 2, 3 ] 131842 19.043% 81.396% #### ( 3, 4 ] 56139 8.109% 89.505% ## ( 4, 6 ] 55714 8.047% 97.552% ## ( 6, 10 ] 13692 1.978% 99.530% ( 10, 15 ] 1893 0.273% 99.803% ( 15, 22 ] 276 0.040% 99.843% ( 22, 34 ] 19 0.003% 99.846% ( 34, 51 ] 4 0.001% 99.846% ( 51, 76 ] 8 0.001% 99.847% ( 76, 110 ] 310 0.045% 99.892% ( 110, 170 ] 396 0.057% 99.949% ( 170, 250 ] 235 0.034% 99.983% ( 250, 380 ] 236 0.034% 100.017% ( 380, 580 ] 248 0.036% 100.053% ( 580, 870 ] 233 0.034% 100.087% ( 870, 1300 ] 134 0.019% 100.106% ( 1300, 1900 ] 54 0.008% 100.114% ( 1900, 2900 ] 41 0.006% 100.120% ( 2900, 4400 ] 36 0.005% 100.125% ( 4400, 6600 ] 4 0.001% 100.126% ** Level 2 read latency histogram (micros): Count: 124164 Average: 3.3039 StdDev: 37.57 Min: 1 Median: 1.5260 Max: 5734 Percentiles: P50: 1.53 P75: 1.95 P99: 7.77 P99.9: 362.88 P99.99: 1490.03 ------------------------------------------------------ [ 0, 1 ] 23694 19.083% 19.083% #### ( 1, 2 ] 72981 58.778% 77.861% ############ ( 2, 3 ] 14536 11.707% 89.568% ## ( 3, 4 ] 6143 4.947% 94.515% # ( 4, 6 ] 4968 4.001% 98.516% # ( 6, 10 ] 1357 1.093% 99.609% ( 10, 15 ] 201 0.162% 99.771% ( 15, 22 ] 30 0.024% 99.795% ( 22, 34 ] 5 0.004% 99.799% ( 51, 76 ] 1 0.001% 99.800% ( 76, 110 ] 3 0.002% 99.803% ( 110, 170 ] 33 0.027% 99.829% ( 170, 250 ] 34 0.027% 99.857% ( 250, 380 ] 62 0.050% 99.907% ( 380, 580 ] 57 0.046% 99.952% ( 580, 870 ] 32 0.026% 99.978% ( 870, 1300 ] 13 0.010% 99.989% ( 1300, 1900 ] 5 0.004% 99.993% ( 1900, 2900 ] 3 0.002% 99.995% ( 2900, 4400 ] 5 0.004% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 193016 Average: 7.7936 StdDev: 100.69 Min: 0 Median: 1.7616 Max: 6437 Percentiles: P50: 1.76 P75: 2.62 P99: 9.79 P99.9: 1195.14 P99.99: 3518.72 ------------------------------------------------------ [ 0, 1 ] 12533 6.493% 6.493% # ( 1, 2 ] 110256 57.123% 63.616% ########### ( 2, 3 ] 35594 18.441% 82.057% #### ( 3, 4 ] 15321 7.938% 89.995% ## ( 4, 6 ] 14090 7.300% 97.295% # ( 6, 10 ] 3478 1.802% 99.096% ( 10, 15 ] 593 0.307% 99.404% ( 15, 22 ] 79 0.041% 99.445% ( 22, 34 ] 32 0.017% 99.461% ( 34, 51 ] 25 0.013% 99.474% ( 51, 76 ] 5 0.003% 99.477% ( 76, 110 ] 15 0.008% 99.484% ( 110, 170 ] 51 0.026% 99.511% ( 170, 250 ] 98 0.051% 99.562% ( 250, 380 ] 134 0.069% 99.631% ( 380, 580 ] 187 0.097% 99.728% ( 580, 870 ] 211 0.109% 99.837% ( 870, 1300 ] 160 0.083% 99.920% ( 1300, 1900 ] 51 0.026% 99.947% ( 1900, 2900 ] 54 0.028% 99.975% ( 2900, 4400 ] 72 0.037% 100.012% ( 4400, 6600 ] 9 0.005% 100.017% ** Level 4 read latency histogram (micros): Count: 15 Average: 1649.0000 StdDev: 1677.76 Min: 141 Median: 783.0000 Max: 5908 Percentiles: P50: 783.00 P75: 3368.75 P99: 5908.00 P99.9: 5908.00 P99.99: 5908.00 ------------------------------------------------------ ( 110, 170 ] 1 6.667% 6.667% # ( 170, 250 ] 2 13.333% 20.000% ### ( 250, 380 ] 1 6.667% 26.667% # ( 580, 870 ] 5 33.333% 60.000% ####### ( 870, 1300 ] 1 6.667% 66.667% # ( 2900, 4400 ] 4 26.667% 93.333% ##### ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 80 Average: 758.4000 StdDev: 990.68 Min: 77 Median: 210.0000 Max: 4157 Percentiles: P50: 210.00 P75: 1085.00 P99: 4100.00 P99.9: 4157.00 P99.99: 4157.00 ------------------------------------------------------ ( 76, 110 ] 18 22.500% 22.500% ##### ( 110, 170 ] 21 26.250% 48.750% ##### ( 170, 250 ] 2 2.500% 51.250% # ( 250, 380 ] 6 7.500% 58.750% ## ( 380, 580 ] 6 7.500% 66.250% ## ( 580, 870 ] 4 5.000% 71.250% # ( 870, 1300 ] 6 7.500% 78.750% ## ( 1300, 1900 ] 4 5.000% 83.750% # ( 1900, 2900 ] 9 11.250% 95.000% ## ( 2900, 4400 ] 4 5.000% 100.000% # ** DB Stats ** Uptime(secs): 34.6 total, 11.9 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 199.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.365 H:M:S, 44.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 82.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:8.754 H:M:S, 73.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/08/13-16:07:00 ... thread 0: (1000000,8000000) ops and (216014.3,205273.8) ops/second in (4.629324,38.972342) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/7 2.88 GB 94.4 7.2 0.0 7.2 14.8 7.6 0.0 1.9 142.0 291.1 51.90 46.64 131 0.396 7482K 11K 0.0 0.0 L1 13/13 1.48 GB 0.0 4.7 4.4 0.2 4.6 4.4 0.2 1.0 224.6 221.5 21.27 20.07 3 7.089 4850K 65K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.9 2.0 250.3 250.2 1.51 1.46 2 0.755 383K 203 0.0 0.0 L3 19/0 957.37 MB 1.0 4.2 2.7 1.5 4.2 2.7 0.5 1.5 176.6 175.8 24.55 19.17 13 1.889 4404K 19K 0.0 0.0 L4 169/0 9.41 GB 1.0 2.1 1.8 0.2 2.1 1.8 1.4 1.1 133.2 132.6 15.90 9.64 25 0.636 2141K 9460 0.0 0.0 L5 1080/0 88.89 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1293/20 103.60 GB 0.0 18.5 9.2 9.3 26.0 16.7 8.4 3.4 164.8 231.2 115.13 96.97 174 0.662 19M 106K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.5 9.2 9.3 26.0 16.7 7.9 3.4 164.8 231.2 115.13 96.97 174 0.662 19M 106K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.5 9.2 9.3 18.4 9.1 0.0 0.0 207.5 206.3 91.48 77.37 65 1.407 19M 106K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 327.6 23.65 19.60 109 0.217 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.2 total, 39.0 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.00 GB write, 679.07 MB/s write, 18.53 GB read, 484.13 MB/s read, 115.1 seconds Interval compaction: 26.00 GB write, 683.02 MB/s write, 18.53 GB read, 486.95 MB/s read, 115.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 44, interval: 67 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3449019 Average: 2.6317 StdDev: 26.74 Min: 0 Median: 1.4780 Max: 8244 Percentiles: P50: 1.48 P75: 1.87 P99: 6.06 P99.9: 115.22 P99.99: 321.38 ------------------------------------------------------ [ 0, 1 ] 668755 19.390% 19.390% #### ( 1, 2 ] 2208921 64.045% 83.435% ############# ( 2, 3 ] 324050 9.395% 92.830% ## ( 3, 4 ] 123678 3.586% 96.416% # ( 4, 6 ] 88759 2.573% 98.989% # ( 6, 10 ] 24799 0.719% 99.708% ( 10, 15 ] 3400 0.099% 99.807% ( 15, 22 ] 462 0.013% 99.820% ( 22, 34 ] 50 0.001% 99.822% ( 34, 51 ] 34 0.001% 99.823% ( 51, 76 ] 50 0.001% 99.824% ( 76, 110 ] 2403 0.070% 99.894% ( 110, 170 ] 2413 0.070% 99.964% ( 170, 250 ] 637 0.018% 99.982% ( 250, 380 ] 481 0.014% 99.996% ( 380, 580 ] 355 0.010% 100.007% ( 580, 870 ] 214 0.006% 100.013% ( 870, 1300 ] 89 0.003% 100.015% ( 1300, 1900 ] 36 0.001% 100.016% ( 1900, 2900 ] 55 0.002% 100.018% ( 2900, 4400 ] 69 0.002% 100.020% ( 4400, 6600 ] 19 0.001% 100.021% ( 6600, 9900 ] 4 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 870148 Average: 4.8687 StdDev: 75.27 Min: 1 Median: 1.7939 Max: 14500 Percentiles: P50: 1.79 P75: 2.69 P99: 9.06 P99.9: 156.77 P99.99: 463.17 ------------------------------------------------------ [ 0, 1 ] 44825 5.151% 5.151% # ( 1, 2 ] 491579 56.494% 61.645% ########### ( 2, 3 ] 168592 19.375% 81.020% #### ( 3, 4 ] 71242 8.187% 89.208% ## ( 4, 6 ] 71395 8.205% 97.413% ## ( 6, 10 ] 18075 2.077% 99.490% ( 10, 15 ] 2486 0.286% 99.775% ( 15, 22 ] 340 0.039% 99.815% ( 22, 34 ] 22 0.003% 99.817% ( 34, 51 ] 9 0.001% 99.818% ( 51, 76 ] 13 0.001% 99.820% ( 76, 110 ] 354 0.041% 99.860% ( 110, 170 ] 445 0.051% 99.911% ( 170, 250 ] 263 0.030% 99.942% ( 250, 380 ] 291 0.033% 99.975% ( 380, 580 ] 315 0.036% 100.011% ( 580, 870 ] 284 0.033% 100.044% ( 870, 1300 ] 192 0.022% 100.066% ( 1300, 1900 ] 80 0.009% 100.075% ( 1900, 2900 ] 94 0.011% 100.086% ( 2900, 4400 ] 105 0.012% 100.098% ( 4400, 6600 ] 41 0.005% 100.103% ( 6600, 9900 ] 18 0.002% 100.105% ( 9900, 14000 ] 1 0.000% 100.105% ( 14000, 22000 ] 1 0.000% 100.105% ** Level 2 read latency histogram (micros): Count: 124164 Average: 3.3039 StdDev: 37.57 Min: 1 Median: 1.5260 Max: 5734 Percentiles: P50: 1.53 P75: 1.95 P99: 7.77 P99.9: 362.88 P99.99: 1490.03 ------------------------------------------------------ [ 0, 1 ] 23694 19.083% 19.083% #### ( 1, 2 ] 72981 58.778% 77.861% ############ ( 2, 3 ] 14536 11.707% 89.568% ## ( 3, 4 ] 6143 4.947% 94.515% # ( 4, 6 ] 4968 4.001% 98.516% # ( 6, 10 ] 1357 1.093% 99.609% ( 10, 15 ] 201 0.162% 99.771% ( 15, 22 ] 30 0.024% 99.795% ( 22, 34 ] 5 0.004% 99.799% ( 51, 76 ] 1 0.001% 99.800% ( 76, 110 ] 3 0.002% 99.803% ( 110, 170 ] 33 0.027% 99.829% ( 170, 250 ] 34 0.027% 99.857% ( 250, 380 ] 62 0.050% 99.907% ( 380, 580 ] 57 0.046% 99.952% ( 580, 870 ] 32 0.026% 99.978% ( 870, 1300 ] 13 0.010% 99.989% ( 1300, 1900 ] 5 0.004% 99.993% ( 1900, 2900 ] 3 0.002% 99.995% ( 2900, 4400 ] 5 0.004% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 794537 Average: 8.6226 StdDev: 117.48 Min: 0 Median: 1.9309 Max: 8172 Percentiles: P50: 1.93 P75: 2.95 P99: 9.36 P99.9: 500.25 P99.99: 748.80 ------------------------------------------------------ [ 0, 1 ] 19698 2.479% 2.479% ( 1, 2 ] 405582 51.046% 53.526% ########## ( 2, 3 ] 180081 22.665% 76.190% ##### ( 3, 4 ] 83657 10.529% 86.719% ## ( 4, 6 ] 83969 10.568% 97.288% ## ( 6, 10 ] 16180 2.036% 99.324% ( 10, 15 ] 2859 0.360% 99.684% ( 15, 22 ] 355 0.045% 99.729% ( 22, 34 ] 49 0.006% 99.735% ( 34, 51 ] 32 0.004% 99.739% ( 51, 76 ] 18 0.002% 99.741% ( 76, 110 ] 28 0.004% 99.745% ( 110, 170 ] 114 0.014% 99.759% ( 170, 250 ] 282 0.035% 99.794% ( 250, 380 ] 429 0.054% 99.848% ( 380, 580 ] 681 0.086% 99.934% ( 580, 870 ] 762 0.096% 100.030% ( 870, 1300 ] 586 0.074% 100.104% ( 1300, 1900 ] 275 0.035% 100.138% ( 1900, 2900 ] 266 0.033% 100.172% ( 2900, 4400 ] 358 0.045% 100.217% ( 4400, 6600 ] 86 0.011% 100.228% ( 6600, 9900 ] 12 0.002% 100.229% ** Level 4 read latency histogram (micros): Count: 300 Average: 263.1367 StdDev: 715.38 Min: 1 Median: 2.8261 Max: 5908 Percentiles: P50: 2.83 P75: 172.67 P99: 3971.43 P99.9: 5908.00 P99.99: 5908.00 ------------------------------------------------------ [ 0, 1 ] 42 14.000% 14.000% ### ( 1, 2 ] 70 23.333% 37.333% ##### ( 2, 3 ] 46 15.333% 52.667% ### ( 3, 4 ] 13 4.333% 57.000% # ( 4, 6 ] 17 5.667% 62.667% # ( 6, 10 ] 6 2.000% 64.667% ( 15, 22 ] 20 6.667% 71.333% # ( 22, 34 ] 3 1.000% 72.333% ( 34, 51 ] 2 0.667% 73.000% ( 51, 76 ] 2 0.667% 73.667% ( 76, 110 ] 1 0.333% 74.000% ( 110, 170 ] 2 0.667% 74.667% ( 170, 250 ] 30 10.000% 84.667% ## ( 250, 380 ] 1 0.333% 85.000% ( 380, 580 ] 2 0.667% 85.667% ( 580, 870 ] 12 4.000% 89.667% # ( 870, 1300 ] 14 4.667% 94.333% # ( 1300, 1900 ] 6 2.000% 96.333% ( 1900, 2900 ] 3 1.000% 97.333% ( 2900, 4400 ] 7 2.333% 99.667% ( 4400, 6600 ] 1 0.333% 100.000% ** Level 5 read latency histogram (micros): Count: 200 Average: 1244.6400 StdDev: 1313.34 Min: 77 Median: 693.4783 Max: 7085 Percentiles: P50: 693.48 P75: 2112.12 P99: 6050.00 P99.9: 7085.00 P99.99: 7085.00 ------------------------------------------------------ ( 76, 110 ] 21 10.500% 10.500% ## ( 110, 170 ] 30 15.000% 25.500% ### ( 170, 250 ] 6 3.000% 28.500% # ( 250, 380 ] 17 8.500% 37.000% ## ( 380, 580 ] 17 8.500% 45.500% ## ( 580, 870 ] 23 11.500% 57.000% ## ( 870, 1300 ] 19 9.500% 66.500% ## ( 1300, 1900 ] 10 5.000% 71.500% # ( 1900, 2900 ] 33 16.500% 88.000% ### ( 2900, 4400 ] 19 9.500% 97.500% ## ( 4400, 6600 ] 4 2.000% 99.500% ( 6600, 9900 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 39.2 total, 4.6 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 200.85 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.102 H:M:S, 43.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 212.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.737 H:M:S, 37.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/13-16:07:03 ... thread 0: (1000000,9000000) ops and (330550.2,214298.0) ops/second in (3.025259,41.997601) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/3 3.81 GB 214.0 8.3 0.0 8.3 16.8 8.5 0.0 2.0 144.2 291.5 58.95 53.30 148 0.398 8633K 12K 0.0 0.0 L1 13/13 1.48 GB 0.0 4.7 4.4 0.2 4.6 4.4 0.2 1.0 224.6 221.5 21.27 20.07 3 7.089 4850K 65K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.9 2.0 250.3 250.2 1.51 1.46 2 0.755 383K 203 0.0 0.0 L3 19/0 957.37 MB 1.0 4.2 2.7 1.5 4.2 2.7 0.5 1.5 176.6 175.8 24.55 19.17 13 1.889 4404K 19K 0.0 0.0 L4 169/0 9.41 GB 1.0 2.1 1.8 0.2 2.1 1.8 1.4 1.1 133.2 132.6 15.90 9.64 25 0.636 2141K 9460 0.0 0.0 L5 1080/0 88.89 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1294/16 104.52 GB 0.0 19.6 9.2 10.4 28.0 17.6 8.4 3.3 164.6 234.9 122.18 103.64 191 0.640 20M 107K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.6 9.2 10.4 28.0 17.6 7.9 3.3 164.6 234.9 122.18 103.64 191 0.640 20M 107K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.6 9.2 10.4 19.5 9.1 0.0 0.0 209.9 208.8 95.80 81.59 69 1.388 20M 107K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 329.5 26.38 22.05 122 0.216 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 42.2 total, 42.0 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.03 GB write, 679.62 MB/s write, 19.64 GB read, 476.30 MB/s read, 122.2 seconds Interval compaction: 28.03 GB write, 683.28 MB/s write, 19.64 GB read, 478.87 MB/s read, 122.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 47, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 47, interval: 70 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3729570 Average: 2.6056 StdDev: 25.86 Min: 0 Median: 1.4816 Max: 8244 Percentiles: P50: 1.48 P75: 1.87 P99: 5.99 P99.9: 109.25 P99.99: 301.38 ------------------------------------------------------ [ 0, 1 ] 709523 19.024% 19.024% #### ( 1, 2 ] 2398686 64.315% 83.340% ############# ( 2, 3 ] 355782 9.539% 92.879% ## ( 3, 4 ] 134036 3.594% 96.473% # ( 4, 6 ] 94919 2.545% 99.018% # ( 6, 10 ] 26304 0.705% 99.723% ( 10, 15 ] 3624 0.097% 99.820% ( 15, 22 ] 467 0.013% 99.833% ( 22, 34 ] 52 0.001% 99.834% ( 34, 51 ] 34 0.001% 99.835% ( 51, 76 ] 53 0.001% 99.837% ( 76, 110 ] 2414 0.065% 99.901% ( 110, 170 ] 2454 0.066% 99.967% ( 170, 250 ] 655 0.018% 99.985% ( 250, 380 ] 491 0.013% 99.998% ( 380, 580 ] 365 0.010% 100.008% ( 580, 870 ] 221 0.006% 100.014% ( 870, 1300 ] 96 0.003% 100.016% ( 1300, 1900 ] 40 0.001% 100.017% ( 1900, 2900 ] 56 0.002% 100.019% ( 2900, 4400 ] 69 0.002% 100.021% ( 4400, 6600 ] 19 0.001% 100.021% ( 6600, 9900 ] 4 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 990093 Average: 4.6081 StdDev: 70.72 Min: 1 Median: 1.7653 Max: 14500 Percentiles: P50: 1.77 P75: 2.61 P99: 8.99 P99.9: 155.89 P99.99: 466.14 ------------------------------------------------------ [ 0, 1 ] 57418 5.799% 5.799% # ( 1, 2 ] 571842 57.756% 63.556% ############ ( 2, 3 ] 185763 18.762% 82.318% #### ( 3, 4 ] 75606 7.636% 89.954% ## ( 4, 6 ] 74659 7.541% 97.495% ## ( 6, 10 ] 19957 2.016% 99.510% ( 10, 15 ] 2624 0.265% 99.775% ( 15, 22 ] 352 0.036% 99.811% ( 22, 34 ] 22 0.002% 99.813% ( 34, 51 ] 9 0.001% 99.814% ( 51, 76 ] 14 0.001% 99.815% ( 76, 110 ] 391 0.039% 99.855% ( 110, 170 ] 583 0.059% 99.914% ( 170, 250 ] 302 0.031% 99.944% ( 250, 380 ] 309 0.031% 99.976% ( 380, 580 ] 332 0.034% 100.009% ( 580, 870 ] 289 0.029% 100.038% ( 870, 1300 ] 193 0.019% 100.058% ( 1300, 1900 ] 80 0.008% 100.066% ( 1900, 2900 ] 95 0.010% 100.075% ( 2900, 4400 ] 105 0.011% 100.086% ( 4400, 6600 ] 41 0.004% 100.090% ( 6600, 9900 ] 18 0.002% 100.092% ( 9900, 14000 ] 1 0.000% 100.092% ( 14000, 22000 ] 1 0.000% 100.092% ** Level 2 read latency histogram (micros): Count: 124164 Average: 3.3039 StdDev: 37.57 Min: 1 Median: 1.5260 Max: 5734 Percentiles: P50: 1.53 P75: 1.95 P99: 7.77 P99.9: 362.88 P99.99: 1490.03 ------------------------------------------------------ [ 0, 1 ] 23694 19.083% 19.083% #### ( 1, 2 ] 72981 58.778% 77.861% ############ ( 2, 3 ] 14536 11.707% 89.568% ## ( 3, 4 ] 6143 4.947% 94.515% # ( 4, 6 ] 4968 4.001% 98.516% # ( 6, 10 ] 1357 1.093% 99.609% ( 10, 15 ] 201 0.162% 99.771% ( 15, 22 ] 30 0.024% 99.795% ( 22, 34 ] 5 0.004% 99.799% ( 51, 76 ] 1 0.001% 99.800% ( 76, 110 ] 3 0.002% 99.803% ( 110, 170 ] 33 0.027% 99.829% ( 170, 250 ] 34 0.027% 99.857% ( 250, 380 ] 62 0.050% 99.907% ( 380, 580 ] 57 0.046% 99.952% ( 580, 870 ] 32 0.026% 99.978% ( 870, 1300 ] 13 0.010% 99.989% ( 1300, 1900 ] 5 0.004% 99.993% ( 1900, 2900 ] 3 0.002% 99.995% ( 2900, 4400 ] 5 0.004% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 794537 Average: 8.6226 StdDev: 117.48 Min: 0 Median: 1.9309 Max: 8172 Percentiles: P50: 1.93 P75: 2.95 P99: 9.36 P99.9: 500.25 P99.99: 748.80 ------------------------------------------------------ [ 0, 1 ] 19698 2.479% 2.479% ( 1, 2 ] 405582 51.046% 53.526% ########## ( 2, 3 ] 180081 22.665% 76.190% ##### ( 3, 4 ] 83657 10.529% 86.719% ## ( 4, 6 ] 83969 10.568% 97.288% ## ( 6, 10 ] 16180 2.036% 99.324% ( 10, 15 ] 2859 0.360% 99.684% ( 15, 22 ] 355 0.045% 99.729% ( 22, 34 ] 49 0.006% 99.735% ( 34, 51 ] 32 0.004% 99.739% ( 51, 76 ] 18 0.002% 99.741% ( 76, 110 ] 28 0.004% 99.745% ( 110, 170 ] 114 0.014% 99.759% ( 170, 250 ] 282 0.035% 99.794% ( 250, 380 ] 429 0.054% 99.848% ( 380, 580 ] 681 0.086% 99.934% ( 580, 870 ] 762 0.096% 100.030% ( 870, 1300 ] 586 0.074% 100.104% ( 1300, 1900 ] 275 0.035% 100.138% ( 1900, 2900 ] 266 0.033% 100.172% ( 2900, 4400 ] 358 0.045% 100.217% ( 4400, 6600 ] 86 0.011% 100.228% ( 6600, 9900 ] 12 0.002% 100.229% ** Level 4 read latency histogram (micros): Count: 300 Average: 263.1367 StdDev: 715.38 Min: 1 Median: 2.8261 Max: 5908 Percentiles: P50: 2.83 P75: 172.67 P99: 3971.43 P99.9: 5908.00 P99.99: 5908.00 ------------------------------------------------------ [ 0, 1 ] 42 14.000% 14.000% ### ( 1, 2 ] 70 23.333% 37.333% ##### ( 2, 3 ] 46 15.333% 52.667% ### ( 3, 4 ] 13 4.333% 57.000% # ( 4, 6 ] 17 5.667% 62.667% # ( 6, 10 ] 6 2.000% 64.667% ( 15, 22 ] 20 6.667% 71.333% # ( 22, 34 ] 3 1.000% 72.333% ( 34, 51 ] 2 0.667% 73.000% ( 51, 76 ] 2 0.667% 73.667% ( 76, 110 ] 1 0.333% 74.000% ( 110, 170 ] 2 0.667% 74.667% ( 170, 250 ] 30 10.000% 84.667% ## ( 250, 380 ] 1 0.333% 85.000% ( 380, 580 ] 2 0.667% 85.667% ( 580, 870 ] 12 4.000% 89.667% # ( 870, 1300 ] 14 4.667% 94.333% # ( 1300, 1900 ] 6 2.000% 96.333% ( 1900, 2900 ] 3 1.000% 97.333% ( 2900, 4400 ] 7 2.333% 99.667% ( 4400, 6600 ] 1 0.333% 100.000% ** Level 5 read latency histogram (micros): Count: 200 Average: 1244.6400 StdDev: 1313.34 Min: 77 Median: 693.4783 Max: 7085 Percentiles: P50: 693.48 P75: 2112.12 P99: 6050.00 P99.9: 7085.00 P99.99: 7085.00 ------------------------------------------------------ ( 76, 110 ] 21 10.500% 10.500% ## ( 110, 170 ] 30 15.000% 25.500% ### ( 170, 250 ] 6 3.000% 28.500% # ( 250, 380 ] 17 8.500% 37.000% ## ( 380, 580 ] 17 8.500% 45.500% ## ( 580, 870 ] 23 11.500% 57.000% ## ( 870, 1300 ] 19 9.500% 66.500% ## ( 1300, 1900 ] 10 5.000% 71.500% # ( 1900, 2900 ] 33 16.500% 88.000% ### ( 2900, 4400 ] 19 9.500% 97.500% ## ( 4400, 6600 ] 4 2.000% 99.500% ( 6600, 9900 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 42.2 total, 3.0 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 209.77 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.496 H:M:S, 41.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.32 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.394 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.150 micros/op 162614 ops/sec 60.099 seconds 9772999 operations; 157.6 MB/s Microseconds per write: Count: 9772999 Average: 6.1495 StdDev: 411.76 Min: 0 Median: 1.7344 Max: 741850 Percentiles: P50: 1.73 P75: 2.75 P99: 9.86 P99.9: 1167.20 P99.99: 2675.40 ------------------------------------------------------ [ 0, 1 ] 1338274 13.694% 13.694% ### ( 1, 2 ] 4831698 49.439% 63.133% ########## ( 2, 3 ] 1538802 15.745% 78.878% ### ( 3, 4 ] 1313059 13.436% 92.314% ### ( 4, 6 ] 521796 5.339% 97.653% # ( 6, 10 ] 136292 1.395% 99.048% ( 10, 15 ] 47942 0.491% 99.538% ( 15, 22 ] 10773 0.110% 99.648% ( 22, 34 ] 1756 0.018% 99.666% ( 34, 51 ] 240 0.002% 99.669% ( 51, 76 ] 22 0.000% 99.669% ( 76, 110 ] 6856 0.070% 99.739% ( 110, 170 ] 2561 0.026% 99.765% ( 170, 250 ] 267 0.003% 99.768% ( 250, 380 ] 200 0.002% 99.770% ( 380, 580 ] 27 0.000% 99.770% ( 580, 870 ] 17 0.000% 99.771% ( 870, 1300 ] 18294 0.187% 99.958% ( 1300, 1900 ] 41 0.000% 99.958% ( 1900, 2900 ] 4004 0.041% 99.999% ( 2900, 4400 ] 45 0.000% 100.000% ( 4400, 6600 ] 3 0.000% 100.000% ( 6600, 9900 ] 6 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 211160 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9772999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10085734968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 508 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32923811 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 29977465973 rocksdb.compact.write.bytes COUNT : 29772929108 rocksdb.flush.write.bytes COUNT : 10040637773 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 51 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 278 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9959811072 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3992576 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30068763707 rocksdb.non.last.level.read.count COUNT : 7265335 rocksdb.block.checksum.compute.count COUNT : 7264370 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.382431 P95 : 3.952572 P99 : 8.604626 P100 : 741848.000000 COUNT : 9772999 SUM : 55491496 rocksdb.compaction.times.micros P50 : 930344.827586 P95 : 3684000.000000 P99 : 16463943.000000 P100 : 16463943.000000 COUNT : 84 SUM : 120895005 rocksdb.compaction.times.cpu_micros P50 : 895172.413793 P95 : 3273333.333333 P99 : 15280000.000000 P100 : 15394500.000000 COUNT : 84 SUM : 104422434 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 675.443038 P95 : 1360.000000 P99 : 5852.000000 P100 : 177951.000000 COUNT : 134 SUM : 278611 rocksdb.compaction.outfile.sync.micros P50 : 938.800000 P95 : 47450.000000 P99 : 141440.000000 P100 : 278890.000000 COUNT : 338 SUM : 2881021 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 101.935897 P95 : 1175.300000 P99 : 3155.000000 P100 : 3846.000000 COUNT : 249 SUM : 63226 rocksdb.table.open.io.micros P50 : 1471.428571 P95 : 8019.000000 P99 : 12947.666667 P100 : 16314.000000 COUNT : 508 SUM : 1059971 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.604944 P95 : 7.393780 P99 : 9.965994 P100 : 14505.000000 COUNT : 7262873 SUM : 41147147 rocksdb.read.block.get.micros P50 : 427.311828 P95 : 3438.983051 P99 : 4968.000000 P100 : 7146.000000 COUNT : 1016 SUM : 868693 rocksdb.write.raw.block.micros P50 : 0.512312 P95 : 0.973392 P99 : 2.828350 P100 : 13527.000000 COUNT : 9642687 SUM : 18778558 rocksdb.numfiles.in.singlecompaction P50 : 3.156250 P95 : 5.800000 P99 : 21.020000 P100 : 39.000000 COUNT : 128 SUM : 487 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.563731 P95 : 1161.483337 P99 : 2412.747748 P100 : 741651.000000 COUNT : 199006 SUM : 32946019 rocksdb.sst.read.micros P50 : 1.548719 P95 : 4.346910 P99 : 7.862354 P100 : 14500.000000 COUNT : 7265541 SUM : 26290962 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9772999 SUM : 10085734968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 206543.209877 P95 : 374647.058824 P99 : 761400.000000 P100 : 875109.000000 COUNT : 134 SUM : 28903686 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 312 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0