[2024-11-06 06:45:40.419795] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 23.11.0 initialization... [2024-11-06 06:45:40.419941] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2004118 ] Set seed to 1730871940416374 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-06 06:45:40.525384] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-06 06:45:40.566051] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-06 06:45:40.566097] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2004118' to capture a snapshot of events at runtime. [2024-11-06 06:45:40.566108] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-06 06:45:40.566118] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-06 06:45:40.566126] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2004118 for offline analysis/debug. [2024-11-06 06:45:40.566223] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 6 06:45:44 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/06-06:45:47 ... thread 0: (1000000,1000000) ops and (341122.9,341122.9) ops/second in (2.931495,2.931495) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 566.95 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 357.7 2.47 2.23 12 0.205 0 0 0.0 0.0 L1 3/3 251.75 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 250.9 250.7 1.00 0.97 1 1.004 255K 204 0.0 0.0 L2 1/0 49.09 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 232.5 232.4 0.48 0.44 1 0.480 113K 39 0.0 0.0 L3 18/0 944.29 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.8 210.8 0.30 0.24 1 0.296 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1186/8 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 100.3 308.0 4.25 3.89 15 0.283 432K 243 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 100.3 308.0 4.25 3.89 15 0.283 432K 243 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 239.3 239.1 1.78 1.66 3 0.593 432K 243 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 357.7 2.47 2.23 12 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 419.06 MB/s write, 0.42 GB read, 136.48 MB/s read, 4.2 seconds Interval compaction: 1.28 GB write, 445.81 MB/s write, 0.42 GB read, 145.20 MB/s read, 4.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 103181 Average: 1.7539 StdDev: 14.23 Min: 0 Median: 1.1219 Max: 3019 Percentiles: P50: 1.12 P75: 1.59 P99: 3.49 P99.9: 8.50 P99.99: 319.73 ------------------------------------------------------ [ 0, 1 ] 44883 43.499% 43.499% ######### ( 1, 2 ] 55015 53.319% 96.818% ########### ( 2, 3 ] 1785 1.730% 98.548% ( 3, 4 ] 959 0.929% 99.478% ( 4, 6 ] 337 0.327% 99.804% ( 6, 10 ] 158 0.153% 99.957% ( 10, 15 ] 13 0.013% 99.970% ( 15, 22 ] 3 0.003% 99.973% ( 22, 34 ] 2 0.002% 99.975% ( 34, 51 ] 1 0.001% 99.976% ( 51, 76 ] 1 0.001% 99.977% ( 110, 170 ] 6 0.006% 99.983% ( 170, 250 ] 5 0.005% 99.987% ( 250, 380 ] 5 0.005% 99.992% ( 380, 580 ] 3 0.003% 99.995% ( 580, 870 ] 1 0.001% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 1 read latency histogram (micros): Count: 18448 Average: 1.7532 StdDev: 10.78 Min: 0 Median: 1.1267 Max: 1306 Percentiles: P50: 1.13 P75: 1.59 P99: 3.30 P99.9: 8.09 P99.99: 495.52 ------------------------------------------------------ [ 0, 1 ] 7965 43.175% 43.175% ######### ( 1, 2 ] 9940 53.881% 97.057% ########### ( 2, 3 ] 309 1.675% 98.732% ( 3, 4 ] 166 0.900% 99.631% ( 4, 6 ] 37 0.201% 99.832% ( 6, 10 ] 24 0.130% 99.962% ( 10, 15 ] 2 0.011% 99.973% ( 51, 76 ] 1 0.005% 99.978% ( 250, 380 ] 1 0.005% 99.984% ( 380, 580 ] 2 0.011% 99.995% ( 1300, 1900 ] 1 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 28166 Average: 2.6554 StdDev: 32.79 Min: 0 Median: 1.1699 Max: 3032 Percentiles: P50: 1.17 P75: 1.64 P99: 5.76 P99.9: 221.34 P99.99: 1736.68 ------------------------------------------------------ [ 0, 1 ] 11564 41.057% 41.057% ######## ( 1, 2 ] 14825 52.634% 93.691% ########### ( 2, 3 ] 1032 3.664% 97.355% # ( 3, 4 ] 290 1.030% 98.385% ( 4, 6 ] 197 0.699% 99.084% ( 6, 10 ] 140 0.497% 99.581% ( 10, 15 ] 22 0.078% 99.659% ( 15, 22 ] 5 0.018% 99.677% ( 34, 51 ] 25 0.089% 99.766% ( 51, 76 ] 14 0.050% 99.815% ( 76, 110 ] 7 0.025% 99.840% ( 110, 170 ] 4 0.014% 99.854% ( 170, 250 ] 20 0.071% 99.925% ( 250, 380 ] 6 0.021% 99.947% ( 380, 580 ] 2 0.007% 99.954% ( 580, 870 ] 6 0.021% 99.975% ( 870, 1300 ] 2 0.007% 99.982% ( 1300, 1900 ] 3 0.011% 99.993% ( 1900, 2900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 870.5556 StdDev: 1248.66 Min: 1 Median: 380.0000 Max: 4703 Percentiles: P50: 380.00 P75: 1049.17 P99: 4620.00 P99.9: 4703.00 P99.99: 4703.00 ------------------------------------------------------ [ 0, 1 ] 28 31.111% 31.111% ###### ( 1, 2 ] 10 11.111% 42.222% ## ( 51, 76 ] 2 2.222% 44.444% ( 110, 170 ] 1 1.111% 45.556% ( 170, 250 ] 2 2.222% 47.778% ( 250, 380 ] 2 2.222% 50.000% ( 380, 580 ] 11 12.222% 62.222% ## ( 580, 870 ] 9 10.000% 72.222% ## ( 870, 1300 ] 6 6.667% 78.889% # ( 1300, 1900 ] 2 2.222% 81.111% ( 1900, 2900 ] 5 5.556% 86.667% # ( 2900, 4400 ] 11 12.222% 98.889% ## ( 4400, 6600 ] 1 1.111% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 1569.1600 StdDev: 1381.01 Min: 182 Median: 923.7500 Max: 5501 Percentiles: P50: 923.75 P75: 2775.00 P99: 5501.00 P99.9: 5501.00 P99.99: 5501.00 ------------------------------------------------------ ( 170, 250 ] 1 4.000% 4.000% # ( 250, 380 ] 1 4.000% 8.000% # ( 380, 580 ] 2 8.000% 16.000% ## ( 580, 870 ] 8 32.000% 48.000% ###### ( 870, 1300 ] 4 16.000% 64.000% ### ( 1300, 1900 ] 1 4.000% 68.000% # ( 1900, 2900 ] 2 8.000% 76.000% ## ( 2900, 4400 ] 5 20.000% 96.000% #### ( 4400, 6600 ] 1 4.000% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 315.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.348 H:M:S, 11.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 335.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.348 H:M:S, 11.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/06-06:45:50 ... thread 0: (1000000,2000000) ops and (339425.8,340272.2) ops/second in (2.946152,5.877647) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/10 1.17 GB 0.0 0.6 0.0 0.6 2.3 1.8 0.0 1.3 78.1 329.9 7.25 6.69 27 0.269 575K 577 0.0 0.0 L1 6/6 565.40 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 243.7 243.2 3.36 3.26 2 1.680 831K 1487 0.0 0.0 L2 1/0 49.09 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 232.5 232.4 0.48 0.44 1 0.480 113K 39 0.0 0.0 L3 18/0 944.29 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.8 210.8 0.30 0.24 1 0.296 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1191/16 97.92 GB 0.0 1.5 0.6 0.9 3.3 2.4 0.1 1.9 136.9 297.1 11.39 10.64 31 0.367 1583K 2103 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.6 0.9 3.3 2.4 0.1 1.9 136.9 297.1 11.39 10.64 31 0.367 1583K 2103 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.6 0.9 1.5 0.6 0.0 0.0 249.4 249.0 6.25 6.03 6 1.042 1583K 2103 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 355.7 5.14 4.61 25 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.30 GB write, 557.87 MB/s write, 1.52 GB read, 257.09 MB/s read, 11.4 seconds Interval compaction: 3.30 GB write, 575.63 MB/s write, 1.52 GB read, 265.27 MB/s read, 11.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 353128 Average: 2.0121 StdDev: 12.87 Min: 0 Median: 1.3634 Max: 3400 Percentiles: P50: 1.36 P75: 1.77 P99: 5.21 P99.9: 9.72 P99.99: 14.44 ------------------------------------------------------ [ 0, 1 ] 97322 27.560% 27.560% ###### ( 1, 2 ] 218051 61.748% 89.308% ############ ( 2, 3 ] 22444 6.356% 95.664% # ( 3, 4 ] 8849 2.506% 98.170% # ( 4, 6 ] 4864 1.377% 99.547% ( 6, 10 ] 1341 0.380% 99.927% ( 10, 15 ] 252 0.071% 99.999% ( 15, 22 ] 17 0.005% 100.003% ( 22, 34 ] 9 0.003% 100.006% ( 34, 51 ] 2 0.001% 100.007% ( 51, 76 ] 3 0.001% 100.007% ( 110, 170 ] 13 0.004% 100.011% ( 170, 250 ] 12 0.003% 100.014% ( 250, 380 ] 10 0.003% 100.017% ( 380, 580 ] 5 0.001% 100.019% ( 580, 870 ] 4 0.001% 100.020% ( 870, 1300 ] 3 0.001% 100.021% ( 1300, 1900 ] 2 0.001% 100.021% ( 1900, 2900 ] 4 0.001% 100.022% ( 2900, 4400 ] 2 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 89668 Average: 2.0146 StdDev: 10.59 Min: 0 Median: 1.3708 Max: 1606 Percentiles: P50: 1.37 P75: 1.77 P99: 4.99 P99.9: 9.46 P99.99: 381.66 ------------------------------------------------------ [ 0, 1 ] 24022 26.790% 26.790% ##### ( 1, 2 ] 56125 62.592% 89.382% ############# ( 2, 3 ] 6046 6.743% 96.125% # ( 3, 4 ] 2027 2.261% 98.385% ( 4, 6 ] 1111 1.239% 99.624% ( 6, 10 ] 286 0.319% 99.943% ( 10, 15 ] 30 0.033% 99.977% ( 15, 22 ] 5 0.006% 99.982% ( 34, 51 ] 1 0.001% 99.983% ( 51, 76 ] 1 0.001% 99.984% ( 110, 170 ] 1 0.001% 99.986% ( 250, 380 ] 4 0.004% 99.990% ( 380, 580 ] 4 0.004% 99.994% ( 580, 870 ] 1 0.001% 99.996% ( 1300, 1900 ] 4 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 28166 Average: 2.6554 StdDev: 32.79 Min: 0 Median: 1.1699 Max: 3032 Percentiles: P50: 1.17 P75: 1.64 P99: 5.76 P99.9: 221.34 P99.99: 1736.68 ------------------------------------------------------ [ 0, 1 ] 11564 41.057% 41.057% ######## ( 1, 2 ] 14825 52.634% 93.691% ########### ( 2, 3 ] 1032 3.664% 97.355% # ( 3, 4 ] 290 1.030% 98.385% ( 4, 6 ] 197 0.699% 99.084% ( 6, 10 ] 140 0.497% 99.581% ( 10, 15 ] 22 0.078% 99.659% ( 15, 22 ] 5 0.018% 99.677% ( 34, 51 ] 25 0.089% 99.766% ( 51, 76 ] 14 0.050% 99.815% ( 76, 110 ] 7 0.025% 99.840% ( 110, 170 ] 4 0.014% 99.854% ( 170, 250 ] 20 0.071% 99.925% ( 250, 380 ] 6 0.021% 99.947% ( 380, 580 ] 2 0.007% 99.954% ( 580, 870 ] 6 0.021% 99.975% ( 870, 1300 ] 2 0.007% 99.982% ( 1300, 1900 ] 3 0.011% 99.993% ( 1900, 2900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 870.5556 StdDev: 1248.66 Min: 1 Median: 380.0000 Max: 4703 Percentiles: P50: 380.00 P75: 1049.17 P99: 4620.00 P99.9: 4703.00 P99.99: 4703.00 ------------------------------------------------------ [ 0, 1 ] 28 31.111% 31.111% ###### ( 1, 2 ] 10 11.111% 42.222% ## ( 51, 76 ] 2 2.222% 44.444% ( 110, 170 ] 1 1.111% 45.556% ( 170, 250 ] 2 2.222% 47.778% ( 250, 380 ] 2 2.222% 50.000% ( 380, 580 ] 11 12.222% 62.222% ## ( 580, 870 ] 9 10.000% 72.222% ## ( 870, 1300 ] 6 6.667% 78.889% # ( 1300, 1900 ] 2 2.222% 81.111% ( 1900, 2900 ] 5 5.556% 86.667% # ( 2900, 4400 ] 11 12.222% 98.889% ## ( 4400, 6600 ] 1 1.111% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 1569.1600 StdDev: 1381.01 Min: 182 Median: 923.7500 Max: 5501 Percentiles: P50: 923.75 P75: 2775.00 P99: 5501.00 P99.9: 5501.00 P99.99: 5501.00 ------------------------------------------------------ ( 170, 250 ] 1 4.000% 4.000% # ( 250, 380 ] 1 4.000% 8.000% # ( 380, 580 ] 2 8.000% 16.000% ## ( 580, 870 ] 8 32.000% 48.000% ###### ( 870, 1300 ] 4 16.000% 64.000% ### ( 1300, 1900 ] 1 4.000% 68.000% # ( 1900, 2900 ] 2 8.000% 76.000% ## ( 2900, 4400 ] 5 20.000% 96.000% #### ( 4400, 6600 ] 1 4.000% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 324.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.705 H:M:S, 11.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 334.07 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.357 H:M:S, 12.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/06-06:45:53 ... thread 0: (1000000,3000000) ops and (332410.5,337610.6) ops/second in (3.008329,8.885976) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/10 2.15 GB 107.0 1.4 0.0 1.4 4.2 2.8 0.0 1.5 108.3 320.1 13.38 12.47 44 0.304 1471K 1503 0.0 0.0 L1 6/6 565.40 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 243.7 243.2 3.36 3.26 2 1.680 831K 1487 0.0 0.0 L2 1/0 49.09 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 232.5 232.4 0.48 0.44 1 0.480 113K 39 0.0 0.0 L3 18/0 944.29 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.8 210.8 0.30 0.24 1 0.296 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1196/16 98.90 GB 0.0 2.4 0.6 1.8 5.1 3.4 0.1 1.9 139.4 301.1 17.51 16.41 48 0.365 2479K 3029 0.0 0.0 Int 0/0 0.00 KB 0.0 2.4 0.6 1.8 5.1 3.4 0.1 1.9 139.4 301.1 17.51 16.41 48 0.365 2479K 3029 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.4 0.6 1.8 2.4 0.6 0.0 0.0 254.2 253.8 9.61 9.32 9 1.067 2479K 3029 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 358.5 7.91 7.10 39 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.15 GB write, 581.08 MB/s write, 2.38 GB read, 269.05 MB/s read, 17.5 seconds Interval compaction: 5.15 GB write, 593.33 MB/s write, 2.38 GB read, 274.72 MB/s read, 17.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 722954 Average: 2.1106 StdDev: 10.41 Min: 0 Median: 1.4498 Max: 3400 Percentiles: P50: 1.45 P75: 1.83 P99: 5.45 P99.9: 9.83 P99.99: 13.79 ------------------------------------------------------ [ 0, 1 ] 150352 20.797% 20.797% #### ( 1, 2 ] 469395 64.927% 85.724% ############# ( 2, 3 ] 63170 8.738% 94.462% ## ( 3, 4 ] 23132 3.200% 97.662% # ( 4, 6 ] 13304 1.840% 99.502% ( 6, 10 ] 3005 0.416% 99.918% ( 10, 15 ] 691 0.096% 100.013% ( 15, 22 ] 34 0.005% 100.018% ( 22, 34 ] 15 0.002% 100.020% ( 34, 51 ] 6 0.001% 100.021% ( 51, 76 ] 5 0.001% 100.021% ( 110, 170 ] 16 0.002% 100.024% ( 170, 250 ] 23 0.003% 100.027% ( 250, 380 ] 18 0.002% 100.029% ( 380, 580 ] 6 0.001% 100.030% ( 580, 870 ] 7 0.001% 100.031% ( 870, 1300 ] 7 0.001% 100.032% ( 1300, 1900 ] 5 0.001% 100.033% ( 1900, 2900 ] 5 0.001% 100.033% ( 2900, 4400 ] 2 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 159217 Average: 2.0942 StdDev: 7.97 Min: 0 Median: 1.4567 Max: 1606 Percentiles: P50: 1.46 P75: 1.84 P99: 5.37 P99.9: 9.60 P99.99: 35.33 ------------------------------------------------------ [ 0, 1 ] 31936 20.058% 20.058% #### ( 1, 2 ] 104374 65.555% 85.613% ############# ( 2, 3 ] 14820 9.308% 94.921% ## ( 3, 4 ] 4648 2.919% 97.840% # ( 4, 6 ] 2704 1.698% 99.538% ( 6, 10 ] 640 0.402% 99.940% ( 10, 15 ] 72 0.045% 99.986% ( 15, 22 ] 7 0.004% 99.990% ( 34, 51 ] 1 0.001% 99.991% ( 51, 76 ] 1 0.001% 99.991% ( 110, 170 ] 1 0.001% 99.992% ( 250, 380 ] 4 0.003% 99.994% ( 380, 580 ] 4 0.003% 99.997% ( 580, 870 ] 1 0.001% 99.997% ( 1300, 1900 ] 4 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 28166 Average: 2.6554 StdDev: 32.79 Min: 0 Median: 1.1699 Max: 3032 Percentiles: P50: 1.17 P75: 1.64 P99: 5.76 P99.9: 221.34 P99.99: 1736.68 ------------------------------------------------------ [ 0, 1 ] 11564 41.057% 41.057% ######## ( 1, 2 ] 14825 52.634% 93.691% ########### ( 2, 3 ] 1032 3.664% 97.355% # ( 3, 4 ] 290 1.030% 98.385% ( 4, 6 ] 197 0.699% 99.084% ( 6, 10 ] 140 0.497% 99.581% ( 10, 15 ] 22 0.078% 99.659% ( 15, 22 ] 5 0.018% 99.677% ( 34, 51 ] 25 0.089% 99.766% ( 51, 76 ] 14 0.050% 99.815% ( 76, 110 ] 7 0.025% 99.840% ( 110, 170 ] 4 0.014% 99.854% ( 170, 250 ] 20 0.071% 99.925% ( 250, 380 ] 6 0.021% 99.947% ( 380, 580 ] 2 0.007% 99.954% ( 580, 870 ] 6 0.021% 99.975% ( 870, 1300 ] 2 0.007% 99.982% ( 1300, 1900 ] 3 0.011% 99.993% ( 1900, 2900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 870.5556 StdDev: 1248.66 Min: 1 Median: 380.0000 Max: 4703 Percentiles: P50: 380.00 P75: 1049.17 P99: 4620.00 P99.9: 4703.00 P99.99: 4703.00 ------------------------------------------------------ [ 0, 1 ] 28 31.111% 31.111% ###### ( 1, 2 ] 10 11.111% 42.222% ## ( 51, 76 ] 2 2.222% 44.444% ( 110, 170 ] 1 1.111% 45.556% ( 170, 250 ] 2 2.222% 47.778% ( 250, 380 ] 2 2.222% 50.000% ( 380, 580 ] 11 12.222% 62.222% ## ( 580, 870 ] 9 10.000% 72.222% ## ( 870, 1300 ] 6 6.667% 78.889% # ( 1300, 1900 ] 2 2.222% 81.111% ( 1900, 2900 ] 5 5.556% 86.667% # ( 2900, 4400 ] 11 12.222% 98.889% ## ( 4400, 6600 ] 1 1.111% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 1569.1600 StdDev: 1381.01 Min: 182 Median: 923.7500 Max: 5501 Percentiles: P50: 923.75 P75: 2775.00 P99: 5501.00 P99.9: 5501.00 P99.99: 5501.00 ------------------------------------------------------ ( 170, 250 ] 1 4.000% 4.000% # ( 250, 380 ] 1 4.000% 8.000% # ( 380, 580 ] 2 8.000% 16.000% ## ( 580, 870 ] 8 32.000% 48.000% ###### ( 870, 1300 ] 4 16.000% 64.000% ### ( 1300, 1900 ] 1 4.000% 68.000% # ( 1900, 2900 ] 2 8.000% 76.000% ## ( 2900, 4400 ] 5 20.000% 96.000% #### ( 4400, 6600 ] 1 4.000% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 325.36 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.070 H:M:S, 11.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.365 H:M:S, 12.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/06-06:45:56 ... thread 0: (1000000,4000000) ops and (333451.3,336561.1) ops/second in (2.998939,11.884915) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/4 2.27 GB 207.7 2.3 0.0 2.3 6.0 3.8 0.0 1.6 118.8 314.6 19.61 18.31 61 0.322 2366K 2514 0.0 0.0 L1 12/0 1.40 GB 143.8 2.2 1.4 0.9 2.2 1.3 0.1 1.6 234.7 233.7 9.65 9.34 3 3.217 2300K 9722 0.0 0.0 L2 1/0 49.09 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 232.5 232.4 0.48 0.44 1 0.480 113K 39 0.0 0.0 L3 18/0 944.29 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.8 210.8 0.30 0.24 1 0.296 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1201/4 99.88 GB 0.0 4.7 1.5 3.2 8.4 5.2 0.1 2.2 158.8 286.3 30.04 28.34 66 0.455 4843K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.7 1.5 3.2 8.4 5.2 0.1 2.2 158.8 286.3 30.04 28.34 66 0.455 4843K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.7 1.5 3.2 4.6 1.5 0.0 0.0 247.9 247.3 19.24 18.67 13 1.480 4843K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 355.9 10.80 9.67 53 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.40 GB write, 712.32 MB/s write, 4.66 GB read, 395.09 MB/s read, 30.0 seconds Interval compaction: 8.40 GB write, 723.54 MB/s write, 4.66 GB read, 401.32 MB/s read, 30.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1037109 Average: 2.1591 StdDev: 12.26 Min: 0 Median: 1.4541 Max: 3453 Percentiles: P50: 1.45 P75: 1.84 P99: 5.53 P99.9: 10.44 P99.99: 14.84 ------------------------------------------------------ [ 0, 1 ] 211001 20.345% 20.345% #### ( 1, 2 ] 677269 65.304% 85.649% ############# ( 2, 3 ] 91654 8.837% 94.486% ## ( 3, 4 ] 32369 3.121% 97.607% # ( 4, 6 ] 18904 1.823% 99.430% ( 6, 10 ] 4783 0.461% 99.891% ( 10, 15 ] 1061 0.102% 99.993% ( 15, 22 ] 53 0.005% 99.999% ( 22, 34 ] 18 0.002% 100.000% ( 34, 51 ] 8 0.001% 100.001% ( 51, 76 ] 10 0.001% 100.002% ( 76, 110 ] 42 0.004% 100.006% ( 110, 170 ] 90 0.009% 100.015% ( 170, 250 ] 52 0.005% 100.020% ( 250, 380 ] 36 0.003% 100.023% ( 380, 580 ] 23 0.002% 100.025% ( 580, 870 ] 17 0.002% 100.027% ( 870, 1300 ] 11 0.001% 100.028% ( 1300, 1900 ] 7 0.001% 100.029% ( 1900, 2900 ] 9 0.001% 100.030% ( 2900, 4400 ] 5 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 207567 Average: 2.2811 StdDev: 14.06 Min: 0 Median: 1.4796 Max: 2012 Percentiles: P50: 1.48 P75: 1.86 P99: 5.51 P99.9: 11.24 P99.99: 544.22 ------------------------------------------------------ [ 0, 1 ] 37734 18.179% 18.179% #### ( 1, 2 ] 137727 66.353% 84.532% ############# ( 2, 3 ] 20947 10.092% 94.624% ## ( 3, 4 ] 6332 3.051% 97.674% # ( 4, 6 ] 3648 1.758% 99.432% ( 6, 10 ] 945 0.455% 99.887% ( 10, 15 ] 107 0.052% 99.939% ( 15, 22 ] 12 0.006% 99.945% ( 22, 34 ] 2 0.001% 99.946% ( 34, 51 ] 1 0.000% 99.946% ( 51, 76 ] 5 0.002% 99.948% ( 76, 110 ] 28 0.013% 99.962% ( 110, 170 ] 17 0.008% 99.970% ( 170, 250 ] 14 0.007% 99.977% ( 250, 380 ] 10 0.005% 99.982% ( 380, 580 ] 21 0.010% 99.992% ( 580, 870 ] 1 0.000% 99.992% ( 870, 1300 ] 3 0.001% 99.994% ( 1300, 1900 ] 12 0.006% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28166 Average: 2.6554 StdDev: 32.79 Min: 0 Median: 1.1699 Max: 3032 Percentiles: P50: 1.17 P75: 1.64 P99: 5.76 P99.9: 221.34 P99.99: 1736.68 ------------------------------------------------------ [ 0, 1 ] 11564 41.057% 41.057% ######## ( 1, 2 ] 14825 52.634% 93.691% ########### ( 2, 3 ] 1032 3.664% 97.355% # ( 3, 4 ] 290 1.030% 98.385% ( 4, 6 ] 197 0.699% 99.084% ( 6, 10 ] 140 0.497% 99.581% ( 10, 15 ] 22 0.078% 99.659% ( 15, 22 ] 5 0.018% 99.677% ( 34, 51 ] 25 0.089% 99.766% ( 51, 76 ] 14 0.050% 99.815% ( 76, 110 ] 7 0.025% 99.840% ( 110, 170 ] 4 0.014% 99.854% ( 170, 250 ] 20 0.071% 99.925% ( 250, 380 ] 6 0.021% 99.947% ( 380, 580 ] 2 0.007% 99.954% ( 580, 870 ] 6 0.021% 99.975% ( 870, 1300 ] 2 0.007% 99.982% ( 1300, 1900 ] 3 0.011% 99.993% ( 1900, 2900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 870.5556 StdDev: 1248.66 Min: 1 Median: 380.0000 Max: 4703 Percentiles: P50: 380.00 P75: 1049.17 P99: 4620.00 P99.9: 4703.00 P99.99: 4703.00 ------------------------------------------------------ [ 0, 1 ] 28 31.111% 31.111% ###### ( 1, 2 ] 10 11.111% 42.222% ## ( 51, 76 ] 2 2.222% 44.444% ( 110, 170 ] 1 1.111% 45.556% ( 170, 250 ] 2 2.222% 47.778% ( 250, 380 ] 2 2.222% 50.000% ( 380, 580 ] 11 12.222% 62.222% ## ( 580, 870 ] 9 10.000% 72.222% ## ( 870, 1300 ] 6 6.667% 78.889% # ( 1300, 1900 ] 2 2.222% 81.111% ( 1900, 2900 ] 5 5.556% 86.667% # ( 2900, 4400 ] 11 12.222% 98.889% ## ( 4400, 6600 ] 1 1.111% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 1569.1600 StdDev: 1381.01 Min: 182 Median: 923.7500 Max: 5501 Percentiles: P50: 923.75 P75: 2775.00 P99: 5501.00 P99.9: 5501.00 P99.99: 5501.00 ------------------------------------------------------ ( 170, 250 ] 1 4.000% 4.000% # ( 250, 380 ] 1 4.000% 8.000% # ( 380, 580 ] 2 8.000% 16.000% ## ( 580, 870 ] 8 32.000% 48.000% ###### ( 870, 1300 ] 4 16.000% 64.000% ### ( 1300, 1900 ] 1 4.000% 68.000% # ( 1900, 2900 ] 2 8.000% 76.000% ## ( 2900, 4400 ] 5 20.000% 96.000% #### ( 4400, 6600 ] 1 4.000% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 326.06 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.473 H:M:S, 12.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.403 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/06-06:45:59 ... thread 0: (1000000,5000000) ops and (320885.6,333304.7) ops/second in (3.116375,15.001290) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 3.20 GB 69.2 3.1 0.0 3.1 7.7 4.7 0.0 1.7 124.3 313.2 25.33 23.68 78 0.325 3198K 3351 0.0 0.0 L1 12/12 1.40 GB 0.0 2.2 1.4 0.9 2.2 1.3 0.1 1.6 234.7 233.7 9.65 9.34 3 3.217 2300K 9722 0.0 0.0 L2 1/0 49.09 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 232.5 232.4 0.48 0.44 1 0.480 113K 39 0.0 0.0 L3 18/0 944.29 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.8 210.8 0.30 0.24 1 0.296 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1206/27 100.80 GB 0.0 5.5 1.5 4.0 10.1 6.1 0.1 2.2 156.3 289.8 35.76 33.71 83 0.431 5675K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 1.5 4.0 10.1 6.1 0.1 2.2 156.3 289.8 35.76 33.71 83 0.431 5675K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 1.5 4.0 5.4 1.5 0.0 0.0 250.4 249.8 22.32 21.69 16 1.395 5675K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 356.3 13.44 12.01 67 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.2 total, 15.0 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.12 GB write, 682.25 MB/s write, 5.46 GB read, 367.95 MB/s read, 35.8 seconds Interval compaction: 10.12 GB write, 690.76 MB/s write, 5.46 GB read, 372.54 MB/s read, 35.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 16, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1330219 Average: 2.1857 StdDev: 11.96 Min: 0 Median: 1.4643 Max: 3453 Percentiles: P50: 1.46 P75: 1.85 P99: 5.57 P99.9: 10.83 P99.99: 19.91 ------------------------------------------------------ [ 0, 1 ] 260281 19.567% 19.567% #### ( 1, 2 ] 871878 65.544% 85.111% ############# ( 2, 3 ] 123119 9.256% 94.366% ## ( 3, 4 ] 41905 3.150% 97.516% # ( 4, 6 ] 25216 1.896% 99.412% ( 6, 10 ] 6263 0.471% 99.883% ( 10, 15 ] 1378 0.104% 99.987% ( 15, 22 ] 67 0.005% 99.992% ( 22, 34 ] 20 0.002% 99.993% ( 34, 51 ] 12 0.001% 99.994% ( 51, 76 ] 11 0.001% 99.995% ( 76, 110 ] 95 0.007% 100.002% ( 110, 170 ] 148 0.011% 100.013% ( 170, 250 ] 79 0.006% 100.019% ( 250, 380 ] 51 0.004% 100.023% ( 380, 580 ] 34 0.003% 100.025% ( 580, 870 ] 29 0.002% 100.028% ( 870, 1300 ] 16 0.001% 100.029% ( 1300, 1900 ] 9 0.001% 100.029% ( 1900, 2900 ] 10 0.001% 100.030% ( 2900, 4400 ] 6 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 274773 Average: 2.4097 StdDev: 14.72 Min: 0 Median: 1.4817 Max: 2012 Percentiles: P50: 1.48 P75: 1.86 P99: 5.88 P99.9: 90.62 P99.99: 699.23 ------------------------------------------------------ [ 0, 1 ] 50017 18.203% 18.203% #### ( 1, 2 ] 181389 66.014% 84.217% ############# ( 2, 3 ] 27534 10.021% 94.238% ## ( 3, 4 ] 8252 3.003% 97.241% # ( 4, 6 ] 5136 1.869% 99.110% ( 6, 10 ] 1983 0.722% 99.832% ( 10, 15 ] 141 0.051% 99.883% ( 15, 22 ] 12 0.004% 99.888% ( 22, 34 ] 4 0.001% 99.889% ( 34, 51 ] 1 0.000% 99.889% ( 51, 76 ] 7 0.003% 99.892% ( 76, 110 ] 54 0.020% 99.912% ( 110, 170 ] 100 0.036% 99.948% ( 170, 250 ] 50 0.018% 99.966% ( 250, 380 ] 26 0.009% 99.976% ( 380, 580 ] 36 0.013% 99.989% ( 580, 870 ] 11 0.004% 99.993% ( 870, 1300 ] 7 0.003% 99.995% ( 1300, 1900 ] 13 0.005% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28166 Average: 2.6554 StdDev: 32.79 Min: 0 Median: 1.1699 Max: 3032 Percentiles: P50: 1.17 P75: 1.64 P99: 5.76 P99.9: 221.34 P99.99: 1736.68 ------------------------------------------------------ [ 0, 1 ] 11564 41.057% 41.057% ######## ( 1, 2 ] 14825 52.634% 93.691% ########### ( 2, 3 ] 1032 3.664% 97.355% # ( 3, 4 ] 290 1.030% 98.385% ( 4, 6 ] 197 0.699% 99.084% ( 6, 10 ] 140 0.497% 99.581% ( 10, 15 ] 22 0.078% 99.659% ( 15, 22 ] 5 0.018% 99.677% ( 34, 51 ] 25 0.089% 99.766% ( 51, 76 ] 14 0.050% 99.815% ( 76, 110 ] 7 0.025% 99.840% ( 110, 170 ] 4 0.014% 99.854% ( 170, 250 ] 20 0.071% 99.925% ( 250, 380 ] 6 0.021% 99.947% ( 380, 580 ] 2 0.007% 99.954% ( 580, 870 ] 6 0.021% 99.975% ( 870, 1300 ] 2 0.007% 99.982% ( 1300, 1900 ] 3 0.011% 99.993% ( 1900, 2900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 870.5556 StdDev: 1248.66 Min: 1 Median: 380.0000 Max: 4703 Percentiles: P50: 380.00 P75: 1049.17 P99: 4620.00 P99.9: 4703.00 P99.99: 4703.00 ------------------------------------------------------ [ 0, 1 ] 28 31.111% 31.111% ###### ( 1, 2 ] 10 11.111% 42.222% ## ( 51, 76 ] 2 2.222% 44.444% ( 110, 170 ] 1 1.111% 45.556% ( 170, 250 ] 2 2.222% 47.778% ( 250, 380 ] 2 2.222% 50.000% ( 380, 580 ] 11 12.222% 62.222% ## ( 580, 870 ] 9 10.000% 72.222% ## ( 870, 1300 ] 6 6.667% 78.889% # ( 1300, 1900 ] 2 2.222% 81.111% ( 1900, 2900 ] 5 5.556% 86.667% # ( 2900, 4400 ] 11 12.222% 98.889% ## ( 4400, 6600 ] 1 1.111% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 1569.1600 StdDev: 1381.01 Min: 182 Median: 923.7500 Max: 5501 Percentiles: P50: 923.75 P75: 2775.00 P99: 5501.00 P99.9: 5501.00 P99.99: 5501.00 ------------------------------------------------------ ( 170, 250 ] 1 4.000% 4.000% # ( 250, 380 ] 1 4.000% 8.000% # ( 380, 580 ] 2 8.000% 16.000% ## ( 580, 870 ] 8 32.000% 48.000% ###### ( 870, 1300 ] 4 16.000% 64.000% ### ( 1300, 1900 ] 1 4.000% 68.000% # ( 1900, 2900 ] 2 8.000% 76.000% ## ( 2900, 4400 ] 5 20.000% 96.000% #### ( 4400, 6600 ] 1 4.000% 100.000% # ** DB Stats ** Uptime(secs): 15.2 total, 3.1 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 323.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.956 H:M:S, 12.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 315.81 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.483 H:M:S, 15.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/06-06:46:14 ... thread 0: (1000000,6000000) ops and (69448.9,204079.1) ops/second in (14.399068,29.400358) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/5 1.90 GB 12.6 5.4 0.0 5.4 11.0 5.6 0.0 1.9 147.4 302.9 37.18 34.78 99 0.376 5563K 11K 0.0 0.0 L1 14/14 1.61 GB 0.0 5.9 3.6 2.3 5.8 3.6 0.1 1.6 228.2 225.6 26.43 25.10 4 6.609 6125K 68K 0.0 0.0 L2 17/5 2.06 GB 15.5 0.1 0.1 0.0 0.1 0.1 2.0 1.8 232.5 232.4 0.48 0.44 1 0.480 113K 39 0.0 0.0 L3 18/11 944.29 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.8 210.8 0.30 0.24 1 0.296 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1212/35 101.72 GB 0.0 11.4 3.7 7.7 17.0 9.3 2.1 3.0 181.5 270.2 64.39 60.57 105 0.613 11M 80K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.4 3.7 7.7 17.0 9.3 2.1 3.0 181.5 270.2 64.39 60.57 105 0.613 11M 80K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.4 3.7 7.7 11.3 3.7 0.0 0.0 243.0 241.3 48.09 46.02 22 2.186 11M 80K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 355.6 16.30 14.55 83 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.6 total, 29.4 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.99 GB write, 588.08 MB/s write, 11.41 GB read, 394.93 MB/s read, 64.4 seconds Interval compaction: 16.99 GB write, 591.82 MB/s write, 11.41 GB read, 397.45 MB/s read, 64.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 16, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2393839 Average: 2.5212 StdDev: 15.34 Min: 0 Median: 1.4546 Max: 4150 Percentiles: P50: 1.45 P75: 1.84 P99: 5.90 P99.9: 132.08 P99.99: 286.79 ------------------------------------------------------ [ 0, 1 ] 486360 20.317% 20.317% #### ( 1, 2 ] 1563153 65.299% 85.616% ############# ( 2, 3 ] 209701 8.760% 94.376% ## ( 3, 4 ] 68168 2.848% 97.224% # ( 4, 6 ] 44806 1.872% 99.096% ( 6, 10 ] 13499 0.564% 99.659% ( 10, 15 ] 2132 0.089% 99.749% ( 15, 22 ] 208 0.009% 99.757% ( 22, 34 ] 27 0.001% 99.758% ( 34, 51 ] 17 0.001% 99.759% ( 51, 76 ] 125 0.005% 99.764% ( 76, 110 ] 2411 0.101% 99.865% ( 110, 170 ] 2280 0.095% 99.960% ( 170, 250 ] 599 0.025% 99.985% ( 250, 380 ] 405 0.017% 100.002% ( 380, 580 ] 293 0.012% 100.014% ( 580, 870 ] 116 0.005% 100.019% ( 870, 1300 ] 53 0.002% 100.021% ( 1300, 1900 ] 16 0.001% 100.022% ( 1900, 2900 ] 13 0.001% 100.023% ( 2900, 4400 ] 13 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 604144 Average: 2.5280 StdDev: 16.38 Min: 0 Median: 1.4535 Max: 3671 Percentiles: P50: 1.45 P75: 1.84 P99: 6.77 P99.9: 142.18 P99.99: 739.37 ------------------------------------------------------ [ 0, 1 ] 126140 20.879% 20.879% #### ( 1, 2 ] 387938 64.213% 85.092% ############# ( 2, 3 ] 54072 8.950% 94.042% ## ( 3, 4 ] 16409 2.716% 96.758% # ( 4, 6 ] 12531 2.074% 98.832% ( 6, 10 ] 5285 0.875% 99.707% ( 10, 15 ] 335 0.055% 99.763% ( 15, 22 ] 72 0.012% 99.775% ( 22, 34 ] 7 0.001% 99.776% ( 34, 51 ] 2 0.000% 99.776% ( 51, 76 ] 41 0.007% 99.783% ( 76, 110 ] 430 0.071% 99.854% ( 110, 170 ] 518 0.086% 99.940% ( 170, 250 ] 121 0.020% 99.960% ( 250, 380 ] 86 0.014% 99.974% ( 380, 580 ] 79 0.013% 99.987% ( 580, 870 ] 32 0.005% 99.992% ( 870, 1300 ] 22 0.004% 99.996% ( 1300, 1900 ] 20 0.003% 99.999% ( 1900, 2900 ] 2 0.000% 100.000% ( 2900, 4400 ] 2 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28191 Average: 2.9942 StdDev: 35.49 Min: 0 Median: 1.1708 Max: 3032 Percentiles: P50: 1.17 P75: 1.65 P99: 6.03 P99.9: 351.52 P99.99: 1736.18 ------------------------------------------------------ [ 0, 1 ] 11564 41.020% 41.020% ######## ( 1, 2 ] 14825 52.588% 93.608% ########### ( 2, 3 ] 1032 3.661% 97.269% # ( 3, 4 ] 290 1.029% 98.297% ( 4, 6 ] 197 0.699% 98.996% ( 6, 10 ] 140 0.497% 99.493% ( 10, 15 ] 22 0.078% 99.571% ( 15, 22 ] 5 0.018% 99.589% ( 34, 51 ] 25 0.089% 99.677% ( 51, 76 ] 14 0.050% 99.727% ( 76, 110 ] 7 0.025% 99.752% ( 110, 170 ] 8 0.028% 99.780% ( 170, 250 ] 26 0.092% 99.872% ( 250, 380 ] 10 0.035% 99.908% ( 380, 580 ] 10 0.035% 99.943% ( 580, 870 ] 6 0.021% 99.965% ( 870, 1300 ] 5 0.018% 99.982% ( 1300, 1900 ] 3 0.011% 99.993% ( 1900, 2900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 35813 Average: 6.1934 StdDev: 81.17 Min: 1 Median: 1.6220 Max: 4703 Percentiles: P50: 1.62 P75: 2.03 P99: 9.89 P99.9: 785.71 P99.99: 3911.64 ------------------------------------------------------ [ 0, 1 ] 3433 9.586% 9.586% ## ( 1, 2 ] 23272 64.982% 74.568% ############# ( 2, 3 ] 4756 13.280% 87.848% ### ( 3, 4 ] 1879 5.247% 93.095% # ( 4, 6 ] 1419 3.962% 97.057% # ( 6, 10 ] 716 1.999% 99.056% ( 10, 15 ] 75 0.209% 99.266% ( 15, 22 ] 10 0.028% 99.294% ( 22, 34 ] 1 0.003% 99.296% ( 34, 51 ] 1 0.003% 99.299% ( 51, 76 ] 3 0.008% 99.308% ( 76, 110 ] 33 0.092% 99.400% ( 110, 170 ] 47 0.131% 99.531% ( 170, 250 ] 45 0.126% 99.657% ( 250, 380 ] 30 0.084% 99.740% ( 380, 580 ] 44 0.123% 99.863% ( 580, 870 ] 20 0.056% 99.919% ( 870, 1300 ] 11 0.031% 99.950% ( 1300, 1900 ] 2 0.006% 99.955% ( 1900, 2900 ] 6 0.017% 99.972% ( 2900, 4400 ] 11 0.031% 100.003% ( 4400, 6600 ] 1 0.003% 100.006% ** Level 4 read latency histogram (micros): Count: 25 Average: 1569.1600 StdDev: 1381.01 Min: 182 Median: 923.7500 Max: 5501 Percentiles: P50: 923.75 P75: 2775.00 P99: 5501.00 P99.9: 5501.00 P99.99: 5501.00 ------------------------------------------------------ ( 170, 250 ] 1 4.000% 4.000% # ( 250, 380 ] 1 4.000% 8.000% # ( 380, 580 ] 2 8.000% 16.000% ## ( 580, 870 ] 8 32.000% 48.000% ###### ( 870, 1300 ] 4 16.000% 64.000% ### ( 1300, 1900 ] 1 4.000% 68.000% # ( 1900, 2900 ] 2 8.000% 76.000% ## ( 2900, 4400 ] 5 20.000% 96.000% #### ( 4400, 6600 ] 1 4.000% 100.000% # ** DB Stats ** Uptime(secs): 29.6 total, 14.4 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 199.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:13.182 H:M:S, 44.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 68.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:11.226 H:M:S, 78.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/06-06:46:21 ... thread 0: (1000000,7000000) ops and (144794.4,192801.9) ops/second in (6.906346,36.306704) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/5 2.82 GB 107.0 6.2 0.0 6.2 12.7 6.6 0.0 1.9 144.7 299.2 43.54 40.28 115 0.379 6395K 12K 0.0 0.0 L1 14/14 1.61 GB 0.0 5.9 3.6 2.3 5.8 3.6 0.1 1.6 228.2 225.6 26.43 25.10 4 6.609 6125K 68K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 2.0 1.8 232.5 232.4 0.48 0.44 1 0.480 113K 39 0.0 0.0 L3 21/0 909.05 MB 0.9 3.2 2.0 1.2 3.2 2.0 0.1 1.6 177.2 177.1 18.58 14.71 14 1.327 3331K 1313 0.0 0.0 L4 159/0 9.66 GB 1.0 0.1 0.1 0.0 0.1 0.1 2.0 1.0 210.8 210.8 0.28 0.26 1 0.283 60K 0 0.0 0.0 L5 1064/0 87.66 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/19 102.64 GB 0.0 15.4 5.7 9.7 21.9 12.2 6.3 3.3 176.8 251.4 89.32 80.79 135 0.662 16M 82K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.4 5.7 9.7 21.9 12.2 6.3 3.3 176.8 251.4 89.32 80.79 135 0.662 16M 82K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.4 5.7 9.7 15.3 5.7 0.0 0.0 226.3 225.1 69.81 63.84 39 1.790 16M 82K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 345.6 19.50 16.95 96 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 36.5 total, 36.3 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.93 GB write, 615.22 MB/s write, 15.43 GB read, 432.81 MB/s read, 89.3 seconds Interval compaction: 21.93 GB write, 618.39 MB/s write, 15.43 GB read, 435.04 MB/s read, 89.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 38, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 38, interval: 62 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2873353 Average: 2.5911 StdDev: 17.48 Min: 0 Median: 1.4927 Max: 4792 Percentiles: P50: 1.49 P75: 1.88 P99: 6.32 P99.9: 123.55 P99.99: 296.56 ------------------------------------------------------ [ 0, 1 ] 524076 18.239% 18.239% #### ( 1, 2 ] 1852385 64.468% 82.707% ############# ( 2, 3 ] 298474 10.388% 93.095% ## ( 3, 4 ] 94281 3.281% 96.376% # ( 4, 6 ] 73741 2.566% 98.942% # ( 6, 10 ] 21063 0.733% 99.675% ( 10, 15 ] 3038 0.106% 99.781% ( 15, 22 ] 281 0.010% 99.791% ( 22, 34 ] 34 0.001% 99.792% ( 34, 51 ] 22 0.001% 99.793% ( 51, 76 ] 130 0.005% 99.797% ( 76, 110 ] 2434 0.085% 99.882% ( 110, 170 ] 2306 0.080% 99.962% ( 170, 250 ] 637 0.022% 99.984% ( 250, 380 ] 457 0.016% 100.000% ( 380, 580 ] 332 0.012% 100.012% ( 580, 870 ] 161 0.006% 100.017% ( 870, 1300 ] 81 0.003% 100.020% ( 1300, 1900 ] 30 0.001% 100.021% ( 1900, 2900 ] 26 0.001% 100.022% ( 2900, 4400 ] 22 0.001% 100.023% ( 4400, 6600 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1152455 Average: 3.6724 StdDev: 42.39 Min: 0 Median: 1.6456 Max: 5198 Percentiles: P50: 1.65 P75: 2.28 P99: 9.03 P99.9: 129.70 P99.99: 300.89 ------------------------------------------------------ [ 0, 1 ] 140486 12.190% 12.190% ## ( 1, 2 ] 674903 58.562% 70.752% ############ ( 2, 3 ] 175799 15.254% 86.007% ### ( 3, 4 ] 66605 5.779% 91.786% # ( 4, 6 ] 66052 5.731% 97.517% # ( 6, 10 ] 22521 1.954% 99.472% ( 10, 15 ] 3555 0.308% 99.780% ( 15, 22 ] 463 0.040% 99.820% ( 22, 34 ] 36 0.003% 99.823% ( 34, 51 ] 5 0.000% 99.824% ( 51, 76 ] 46 0.004% 99.828% ( 76, 110 ] 563 0.049% 99.877% ( 110, 170 ] 818 0.071% 99.948% ( 170, 250 ] 357 0.031% 99.979% ( 250, 380 ] 334 0.029% 100.008% ( 380, 580 ] 318 0.028% 100.035% ( 580, 870 ] 240 0.021% 100.056% ( 870, 1300 ] 128 0.011% 100.067% ( 1300, 1900 ] 75 0.007% 100.074% ( 1900, 2900 ] 89 0.008% 100.081% ( 2900, 4400 ] 60 0.005% 100.087% ( 4400, 6600 ] 11 0.001% 100.088% ** Level 2 read latency histogram (micros): Count: 40633 Average: 3.5943 StdDev: 35.18 Min: 0 Median: 1.3857 Max: 3032 Percentiles: P50: 1.39 P75: 1.86 P99: 8.76 P99.9: 478.44 P99.99: 1590.50 ------------------------------------------------------ [ 0, 1 ] 11975 29.471% 29.471% ###### ( 1, 2 ] 21626 53.223% 82.694% ########### ( 2, 3 ] 3254 8.008% 90.702% ## ( 3, 4 ] 1492 3.672% 94.374% # ( 4, 6 ] 1512 3.721% 98.095% # ( 6, 10 ] 533 1.312% 99.407% ( 10, 15 ] 49 0.121% 99.527% ( 15, 22 ] 12 0.030% 99.557% ( 34, 51 ] 25 0.062% 99.619% ( 51, 76 ] 14 0.034% 99.653% ( 76, 110 ] 9 0.022% 99.675% ( 110, 170 ] 16 0.039% 99.715% ( 170, 250 ] 41 0.101% 99.815% ( 250, 380 ] 26 0.064% 99.879% ( 380, 580 ] 17 0.042% 99.921% ( 580, 870 ] 18 0.044% 99.966% ( 870, 1300 ] 8 0.020% 99.985% ( 1300, 1900 ] 4 0.010% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 332981 Average: 3.7474 StdDev: 35.29 Min: 0 Median: 1.7524 Max: 4703 Percentiles: P50: 1.75 P75: 2.59 P99: 9.30 P99.9: 183.26 P99.99: 451.90 ------------------------------------------------------ [ 0, 1 ] 20829 6.255% 6.255% # ( 1, 2 ] 193585 58.137% 64.392% ############ ( 2, 3 ] 59632 17.909% 82.301% #### ( 3, 4 ] 26825 8.056% 90.357% ## ( 4, 6 ] 22818 6.853% 97.209% # ( 6, 10 ] 7218 2.168% 99.377% ( 10, 15 ] 1097 0.329% 99.707% ( 15, 22 ] 124 0.037% 99.744% ( 22, 34 ] 10 0.003% 99.747% ( 34, 51 ] 6 0.002% 99.749% ( 51, 76 ] 30 0.009% 99.758% ( 76, 110 ] 169 0.051% 99.808% ( 110, 170 ] 277 0.083% 99.892% ( 170, 250 ] 169 0.051% 99.942% ( 250, 380 ] 117 0.035% 99.977% ( 380, 580 ] 116 0.035% 100.012% ( 580, 870 ] 56 0.017% 100.029% ( 870, 1300 ] 39 0.012% 100.041% ( 1300, 1900 ] 12 0.004% 100.044% ( 1900, 2900 ] 9 0.003% 100.047% ( 2900, 4400 ] 16 0.005% 100.052% ( 4400, 6600 ] 1 0.000% 100.052% ** Level 4 read latency histogram (micros): Count: 35 Average: 1139.1714 StdDev: 1352.65 Min: 1 Median: 706.8750 Max: 5501 Percentiles: P50: 706.88 P75: 1450.00 P99: 5501.00 P99.9: 5501.00 P99.99: 5501.00 ------------------------------------------------------ [ 0, 1 ] 3 8.571% 8.571% ## ( 1, 2 ] 1 2.857% 11.429% # ( 2, 3 ] 1 2.857% 14.286% # ( 3, 4 ] 1 2.857% 17.143% # ( 4, 6 ] 1 2.857% 20.000% # ( 15, 22 ] 1 2.857% 22.857% # ( 110, 170 ] 1 2.857% 25.714% # ( 170, 250 ] 1 2.857% 28.571% # ( 250, 380 ] 1 2.857% 31.429% # ( 380, 580 ] 3 8.571% 40.000% ## ( 580, 870 ] 8 22.857% 62.857% ##### ( 870, 1300 ] 4 11.429% 74.286% ## ( 1300, 1900 ] 1 2.857% 77.143% # ( 1900, 2900 ] 2 5.714% 82.857% # ( 2900, 4400 ] 5 14.286% 97.143% ### ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 120 Average: 1155.1583 StdDev: 1166.62 Min: 75 Median: 624.6154 Max: 4387 Percentiles: P50: 624.62 P75: 1958.82 P99: 4271.43 P99.9: 4387.00 P99.99: 4387.00 ------------------------------------------------------ ( 51, 76 ] 1 0.833% 0.833% ( 76, 110 ] 12 10.000% 10.833% ## ( 110, 170 ] 9 7.500% 18.333% ## ( 170, 250 ] 11 9.167% 27.500% ## ( 250, 380 ] 10 8.333% 35.833% ## ( 380, 580 ] 15 12.500% 48.333% ### ( 580, 870 ] 13 10.833% 59.167% ## ( 870, 1300 ] 10 8.333% 67.500% ## ( 1300, 1900 ] 8 6.667% 74.167% # ( 1900, 2900 ] 17 14.167% 88.333% ### ( 2900, 4400 ] 14 11.667% 100.000% ## ** DB Stats ** Uptime(secs): 36.5 total, 6.9 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 188.77 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.139 H:M:S, 47.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 142.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.957 H:M:S, 57.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/06-06:46:24 ... thread 0: (1000000,8000000) ops and (334221.6,203568.9) ops/second in (2.992027,39.298731) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/9 3.80 GB 182.5 7.0 0.0 7.0 14.6 7.6 0.0 1.9 144.4 300.0 49.72 46.09 132 0.377 7290K 13K 0.0 0.0 L1 14/14 1.61 GB 0.0 5.9 3.6 2.3 5.8 3.6 0.1 1.6 228.2 225.6 26.43 25.10 4 6.609 6125K 68K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 2.0 1.8 232.5 232.4 0.48 0.44 1 0.480 113K 39 0.0 0.0 L3 21/0 909.05 MB 0.9 3.2 2.0 1.2 3.2 2.0 0.1 1.6 177.2 177.1 18.58 14.71 14 1.327 3331K 1313 0.0 0.0 L4 159/0 9.66 GB 1.0 0.1 0.1 0.0 0.1 0.1 2.0 1.0 210.8 210.8 0.28 0.26 1 0.283 60K 0 0.0 0.0 L5 1064/0 87.66 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1274/23 103.62 GB 0.0 16.3 5.7 10.5 23.8 13.2 6.3 3.1 174.6 254.9 95.50 86.60 152 0.628 16M 83K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.3 5.7 10.5 23.8 13.2 6.3 3.1 174.6 254.9 95.50 86.60 152 0.628 16M 83K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.3 5.7 10.5 16.2 5.7 0.0 0.0 228.0 226.8 73.15 67.12 42 1.742 16M 83K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 346.6 22.35 19.48 110 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.5 total, 39.3 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.77 GB write, 616.44 MB/s write, 16.29 GB read, 422.35 MB/s read, 95.5 seconds Interval compaction: 23.77 GB write, 619.37 MB/s write, 16.29 GB read, 424.36 MB/s read, 95.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 40, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 40, interval: 64 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3155470 Average: 2.5720 StdDev: 16.98 Min: 0 Median: 1.4972 Max: 4792 Percentiles: P50: 1.50 P75: 1.88 P99: 6.20 P99.9: 118.13 P99.99: 281.54 ------------------------------------------------------ [ 0, 1 ] 563259 17.850% 17.850% #### ( 1, 2 ] 2040499 64.665% 82.516% ############# ( 2, 3 ] 333621 10.573% 93.088% ## ( 3, 4 ] 104593 3.315% 96.403% # ( 4, 6 ] 80801 2.561% 98.964% # ( 6, 10 ] 22896 0.726% 99.689% ( 10, 15 ] 3377 0.107% 99.796% ( 15, 22 ] 305 0.010% 99.806% ( 22, 34 ] 35 0.001% 99.807% ( 34, 51 ] 25 0.001% 99.808% ( 51, 76 ] 130 0.004% 99.812% ( 76, 110 ] 2452 0.078% 99.890% ( 110, 170 ] 2379 0.075% 99.965% ( 170, 250 ] 667 0.021% 99.986% ( 250, 380 ] 480 0.015% 100.002% ( 380, 580 ] 347 0.011% 100.013% ( 580, 870 ] 177 0.006% 100.018% ( 870, 1300 ] 86 0.003% 100.021% ( 1300, 1900 ] 33 0.001% 100.022% ( 1900, 2900 ] 27 0.001% 100.023% ( 2900, 4400 ] 22 0.001% 100.023% ( 4400, 6600 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1266113 Average: 3.5887 StdDev: 40.58 Min: 0 Median: 1.6403 Max: 5198 Percentiles: P50: 1.64 P75: 2.24 P99: 8.99 P99.9: 132.77 P99.99: 311.74 ------------------------------------------------------ [ 0, 1 ] 152394 12.036% 12.036% ## ( 1, 2 ] 750711 59.293% 71.329% ############ ( 2, 3 ] 192458 15.201% 86.530% ### ( 3, 4 ] 70280 5.551% 92.080% # ( 4, 6 ] 69296 5.473% 97.554% # ( 6, 10 ] 24486 1.934% 99.488% ( 10, 15 ] 3678 0.290% 99.778% ( 15, 22 ] 475 0.038% 99.816% ( 22, 34 ] 40 0.003% 99.819% ( 34, 51 ] 5 0.000% 99.819% ( 51, 76 ] 48 0.004% 99.823% ( 76, 110 ] 622 0.049% 99.872% ( 110, 170 ] 935 0.074% 99.946% ( 170, 250 ] 387 0.031% 99.976% ( 250, 380 ] 363 0.029% 100.005% ( 380, 580 ] 336 0.027% 100.032% ( 580, 870 ] 244 0.019% 100.051% ( 870, 1300 ] 130 0.010% 100.061% ( 1300, 1900 ] 75 0.006% 100.067% ( 1900, 2900 ] 89 0.007% 100.074% ( 2900, 4400 ] 60 0.005% 100.079% ( 4400, 6600 ] 11 0.001% 100.080% ** Level 2 read latency histogram (micros): Count: 40633 Average: 3.5943 StdDev: 35.18 Min: 0 Median: 1.3857 Max: 3032 Percentiles: P50: 1.39 P75: 1.86 P99: 8.76 P99.9: 478.44 P99.99: 1590.50 ------------------------------------------------------ [ 0, 1 ] 11975 29.471% 29.471% ###### ( 1, 2 ] 21626 53.223% 82.694% ########### ( 2, 3 ] 3254 8.008% 90.702% ## ( 3, 4 ] 1492 3.672% 94.374% # ( 4, 6 ] 1512 3.721% 98.095% # ( 6, 10 ] 533 1.312% 99.407% ( 10, 15 ] 49 0.121% 99.527% ( 15, 22 ] 12 0.030% 99.557% ( 34, 51 ] 25 0.062% 99.619% ( 51, 76 ] 14 0.034% 99.653% ( 76, 110 ] 9 0.022% 99.675% ( 110, 170 ] 16 0.039% 99.715% ( 170, 250 ] 41 0.101% 99.815% ( 250, 380 ] 26 0.064% 99.879% ( 380, 580 ] 17 0.042% 99.921% ( 580, 870 ] 18 0.044% 99.966% ( 870, 1300 ] 8 0.020% 99.985% ( 1300, 1900 ] 4 0.010% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 332981 Average: 3.7474 StdDev: 35.29 Min: 0 Median: 1.7524 Max: 4703 Percentiles: P50: 1.75 P75: 2.59 P99: 9.30 P99.9: 183.26 P99.99: 451.90 ------------------------------------------------------ [ 0, 1 ] 20829 6.255% 6.255% # ( 1, 2 ] 193585 58.137% 64.392% ############ ( 2, 3 ] 59632 17.909% 82.301% #### ( 3, 4 ] 26825 8.056% 90.357% ## ( 4, 6 ] 22818 6.853% 97.209% # ( 6, 10 ] 7218 2.168% 99.377% ( 10, 15 ] 1097 0.329% 99.707% ( 15, 22 ] 124 0.037% 99.744% ( 22, 34 ] 10 0.003% 99.747% ( 34, 51 ] 6 0.002% 99.749% ( 51, 76 ] 30 0.009% 99.758% ( 76, 110 ] 169 0.051% 99.808% ( 110, 170 ] 277 0.083% 99.892% ( 170, 250 ] 169 0.051% 99.942% ( 250, 380 ] 117 0.035% 99.977% ( 380, 580 ] 116 0.035% 100.012% ( 580, 870 ] 56 0.017% 100.029% ( 870, 1300 ] 39 0.012% 100.041% ( 1300, 1900 ] 12 0.004% 100.044% ( 1900, 2900 ] 9 0.003% 100.047% ( 2900, 4400 ] 16 0.005% 100.052% ( 4400, 6600 ] 1 0.000% 100.052% ** Level 4 read latency histogram (micros): Count: 35 Average: 1139.1714 StdDev: 1352.65 Min: 1 Median: 706.8750 Max: 5501 Percentiles: P50: 706.88 P75: 1450.00 P99: 5501.00 P99.9: 5501.00 P99.99: 5501.00 ------------------------------------------------------ [ 0, 1 ] 3 8.571% 8.571% ## ( 1, 2 ] 1 2.857% 11.429% # ( 2, 3 ] 1 2.857% 14.286% # ( 3, 4 ] 1 2.857% 17.143% # ( 4, 6 ] 1 2.857% 20.000% # ( 15, 22 ] 1 2.857% 22.857% # ( 110, 170 ] 1 2.857% 25.714% # ( 170, 250 ] 1 2.857% 28.571% # ( 250, 380 ] 1 2.857% 31.429% # ( 380, 580 ] 3 8.571% 40.000% ## ( 580, 870 ] 8 22.857% 62.857% ##### ( 870, 1300 ] 4 11.429% 74.286% ## ( 1300, 1900 ] 1 2.857% 77.143% # ( 1900, 2900 ] 2 5.714% 82.857% # ( 2900, 4400 ] 5 14.286% 97.143% ### ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 120 Average: 1155.1583 StdDev: 1166.62 Min: 75 Median: 624.6154 Max: 4387 Percentiles: P50: 624.62 P75: 1958.82 P99: 4271.43 P99.9: 4387.00 P99.99: 4387.00 ------------------------------------------------------ ( 51, 76 ] 1 0.833% 0.833% ( 76, 110 ] 12 10.000% 10.833% ## ( 110, 170 ] 9 7.500% 18.333% ## ( 170, 250 ] 11 9.167% 27.500% ## ( 250, 380 ] 10 8.333% 35.833% ## ( 380, 580 ] 15 12.500% 48.333% ### ( 580, 870 ] 13 10.833% 59.167% ## ( 870, 1300 ] 10 8.333% 67.500% ## ( 1300, 1900 ] 8 6.667% 74.167% # ( 1900, 2900 ] 17 14.167% 88.333% ### ( 2900, 4400 ] 14 11.667% 100.000% ## ** DB Stats ** Uptime(secs): 39.5 total, 3.0 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 199.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.513 H:M:S, 44.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.374 H:M:S, 12.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/06-06:46:33 ... thread 0: (1000000,9000000) ops and (111601.7,186493.1) ops/second in (8.960437,48.259168) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 2.95 GB 113.3 7.9 0.0 7.9 16.3 8.5 0.0 1.9 142.2 295.3 56.69 51.83 147 0.386 8186K 14K 0.0 0.0 L1 8/0 877.10 MB 87.7 9.3 5.4 3.9 9.2 5.3 0.1 1.7 222.7 220.2 42.65 40.02 5 8.530 8495K 68K 0.0 0.0 L2 1/0 62.61 MB 0.6 0.1 0.1 0.0 0.1 0.1 4.5 1.8 232.5 232.4 0.48 0.44 1 0.480 113K 39 0.0 0.0 L3 21/0 958.18 MB 1.0 3.3 2.1 1.2 3.3 2.1 2.5 1.6 175.6 175.5 19.15 15.05 15 1.277 3402K 1455 0.0 0.0 L4 154/0 9.70 GB 1.0 2.5 1.8 0.7 2.5 1.8 2.7 1.4 126.2 125.9 20.14 11.95 16 1.259 2451K 5519 0.0 0.0 L5 1092/0 90.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1290/10 104.50 GB 0.0 23.0 9.3 13.7 31.4 17.7 14.1 3.7 169.5 231.0 139.12 119.30 184 0.756 22M 90K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.0 9.3 13.7 31.4 17.7 14.1 3.7 169.5 231.0 139.12 119.30 184 0.756 22M 90K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.0 9.3 13.7 22.9 9.2 0.0 0.0 208.5 207.3 113.11 97.32 62 1.824 22M 90K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 334.2 26.01 21.98 122 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.4 total, 48.3 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.39 GB write, 663.41 MB/s write, 23.02 GB read, 486.65 MB/s read, 139.1 seconds Interval compaction: 31.39 GB write, 665.99 MB/s write, 23.02 GB read, 488.54 MB/s read, 139.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 48, pending-compaction-bytes-delays: 28, pending-compaction-bytes-stops: 0, total-delays: 42, total-stops: 48, interval: 90 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3851107 Average: 2.6276 StdDev: 17.43 Min: 0 Median: 1.5089 Max: 7867 Percentiles: P50: 1.51 P75: 1.90 P99: 6.88 P99.9: 126.63 P99.99: 307.12 ------------------------------------------------------ [ 0, 1 ] 666619 17.310% 17.310% ### ( 1, 2 ] 2473915 64.239% 81.549% ############# ( 2, 3 ] 418778 10.874% 92.423% ## ( 3, 4 ] 136993 3.557% 95.980% # ( 4, 6 ] 109205 2.836% 98.816% # ( 6, 10 ] 32202 0.836% 99.652% ( 10, 15 ] 4770 0.124% 99.776% ( 15, 22 ] 478 0.012% 99.788% ( 22, 34 ] 44 0.001% 99.790% ( 34, 51 ] 28 0.001% 99.790% ( 51, 76 ] 134 0.003% 99.794% ( 76, 110 ] 3209 0.083% 99.877% ( 110, 170 ] 3182 0.083% 99.960% ( 170, 250 ] 897 0.023% 99.983% ( 250, 380 ] 612 0.016% 99.999% ( 380, 580 ] 445 0.012% 100.010% ( 580, 870 ] 225 0.006% 100.016% ( 870, 1300 ] 101 0.003% 100.019% ( 1300, 1900 ] 40 0.001% 100.020% ( 1900, 2900 ] 30 0.001% 100.021% ( 2900, 4400 ] 27 0.001% 100.021% ( 4400, 6600 ] 1 0.000% 100.022% ( 6600, 9900 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1901399 Average: 4.4549 StdDev: 63.96 Min: 0 Median: 1.7205 Max: 9998 Percentiles: P50: 1.72 P75: 2.53 P99: 9.28 P99.9: 123.41 P99.99: 315.09 ------------------------------------------------------ [ 0, 1 ] 178794 9.403% 9.403% ## ( 1, 2 ] 1071333 56.344% 65.748% ########### ( 2, 3 ] 331298 17.424% 83.172% ### ( 3, 4 ] 129729 6.823% 89.994% # ( 4, 6 ] 136582 7.183% 97.178% # ( 6, 10 ] 42201 2.219% 99.397% ( 10, 15 ] 7437 0.391% 99.788% ( 15, 22 ] 897 0.047% 99.835% ( 22, 34 ] 52 0.003% 99.838% ( 34, 51 ] 12 0.001% 99.839% ( 51, 76 ] 62 0.003% 99.842% ( 76, 110 ] 819 0.043% 99.885% ( 110, 170 ] 1260 0.066% 99.951% ( 170, 250 ] 480 0.025% 99.977% ( 250, 380 ] 505 0.027% 100.003% ( 380, 580 ] 505 0.027% 100.030% ( 580, 870 ] 437 0.023% 100.053% ( 870, 1300 ] 335 0.018% 100.070% ( 1300, 1900 ] 204 0.011% 100.081% ( 1900, 2900 ] 237 0.012% 100.094% ( 2900, 4400 ] 239 0.013% 100.106% ( 4400, 6600 ] 55 0.003% 100.109% ( 6600, 9900 ] 13 0.001% 100.110% ( 9900, 14000 ] 1 0.000% 100.110% ** Level 2 read latency histogram (micros): Count: 40633 Average: 3.5943 StdDev: 35.18 Min: 0 Median: 1.3857 Max: 3032 Percentiles: P50: 1.39 P75: 1.86 P99: 8.76 P99.9: 478.44 P99.99: 1590.50 ------------------------------------------------------ [ 0, 1 ] 11975 29.471% 29.471% ###### ( 1, 2 ] 21626 53.223% 82.694% ########### ( 2, 3 ] 3254 8.008% 90.702% ## ( 3, 4 ] 1492 3.672% 94.374% # ( 4, 6 ] 1512 3.721% 98.095% # ( 6, 10 ] 533 1.312% 99.407% ( 10, 15 ] 49 0.121% 99.527% ( 15, 22 ] 12 0.030% 99.557% ( 34, 51 ] 25 0.062% 99.619% ( 51, 76 ] 14 0.034% 99.653% ( 76, 110 ] 9 0.022% 99.675% ( 110, 170 ] 16 0.039% 99.715% ( 170, 250 ] 41 0.101% 99.815% ( 250, 380 ] 26 0.064% 99.879% ( 380, 580 ] 17 0.042% 99.921% ( 580, 870 ] 18 0.044% 99.966% ( 870, 1300 ] 8 0.020% 99.985% ( 1300, 1900 ] 4 0.010% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 482064 Average: 9.8689 StdDev: 130.95 Min: 0 Median: 1.8464 Max: 10227 Percentiles: P50: 1.85 P75: 2.84 P99: 11.82 P99.9: 1460.54 P99.99: 3140.69 ------------------------------------------------------ [ 0, 1 ] 22217 4.609% 4.609% # ( 1, 2 ] 258518 53.627% 58.236% ########### ( 2, 3 ] 96742 20.068% 78.304% #### ( 3, 4 ] 44040 9.136% 87.440% ## ( 4, 6 ] 42387 8.793% 96.233% ## ( 6, 10 ] 12517 2.597% 98.829% # ( 10, 15 ] 2265 0.470% 99.299% ( 15, 22 ] 274 0.057% 99.356% ( 22, 34 ] 14 0.003% 99.359% ( 34, 51 ] 11 0.002% 99.361% ( 51, 76 ] 36 0.007% 99.369% ( 76, 110 ] 181 0.038% 99.406% ( 110, 170 ] 332 0.069% 99.475% ( 170, 250 ] 315 0.065% 99.541% ( 250, 380 ] 355 0.074% 99.614% ( 380, 580 ] 492 0.102% 99.716% ( 580, 870 ] 470 0.097% 99.814% ( 870, 1300 ] 356 0.074% 99.888% ( 1300, 1900 ] 224 0.046% 99.934% ( 1900, 2900 ] 230 0.048% 99.982% ( 2900, 4400 ] 248 0.051% 100.033% ( 4400, 6600 ] 69 0.014% 100.048% ( 6600, 9900 ] 11 0.002% 100.050% ( 9900, 14000 ] 1 0.000% 100.050% ** Level 4 read latency histogram (micros): Count: 74779 Average: 4.7834 StdDev: 62.92 Min: 0 Median: 2.0700 Max: 5501 Percentiles: P50: 2.07 P75: 3.13 P99: 9.38 P99.9: 21.85 P99.99: 683.88 ------------------------------------------------------ [ 0, 1 ] 623 0.833% 0.833% ( 1, 2 ] 35440 47.393% 48.226% ######### ( 2, 3 ] 18950 25.341% 73.567% ##### ( 3, 4 ] 8502 11.370% 84.937% ## ( 4, 6 ] 9101 12.171% 97.107% ## ( 6, 10 ] 1673 2.237% 99.345% ( 10, 15 ] 379 0.507% 99.852% ( 15, 22 ] 37 0.049% 99.901% ( 22, 34 ] 4 0.005% 99.906% ( 34, 51 ] 3 0.004% 99.910% ( 51, 76 ] 3 0.004% 99.914% ( 76, 110 ] 2 0.003% 99.917% ( 110, 170 ] 9 0.012% 99.929% ( 170, 250 ] 30 0.040% 99.969% ( 250, 380 ] 4 0.005% 99.975% ( 380, 580 ] 4 0.005% 99.980% ( 580, 870 ] 21 0.028% 100.008% ( 870, 1300 ] 19 0.025% 100.033% ( 1300, 1900 ] 7 0.009% 100.043% ( 1900, 2900 ] 12 0.016% 100.059% ( 2900, 4400 ] 10 0.013% 100.072% ( 4400, 6600 ] 2 0.003% 100.075% ** Level 5 read latency histogram (micros): Count: 260 Average: 1528.0923 StdDev: 1556.19 Min: 75 Median: 801.7647 Max: 7454 Percentiles: P50: 801.76 P75: 2475.00 P99: 7040.00 P99.9: 7454.00 P99.99: 7454.00 ------------------------------------------------------ ( 51, 76 ] 1 0.385% 0.385% ( 76, 110 ] 12 4.615% 5.000% # ( 110, 170 ] 14 5.385% 10.385% # ( 170, 250 ] 14 5.385% 15.769% # ( 250, 380 ] 31 11.923% 27.692% ## ( 380, 580 ] 32 12.308% 40.000% ## ( 580, 870 ] 34 13.077% 53.077% ### ( 870, 1300 ] 17 6.538% 59.615% # ( 1300, 1900 ] 17 6.538% 66.154% # ( 1900, 2900 ] 40 15.385% 81.538% ### ( 2900, 4400 ] 35 13.462% 95.000% ### ( 4400, 6600 ] 10 3.846% 98.846% # ( 6600, 9900 ] 3 1.154% 100.000% ** DB Stats ** Uptime(secs): 48.4 total, 9.0 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 182.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.540 H:M:S, 48.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 109.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.027 H:M:S, 67.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/06-06:46:36 ... thread 0: (1000000,10000000) ops and (312465.1,194327.5) ops/second in (3.200357,51.459525) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/4 3.98 GB 382.8 10.3 0.0 10.3 19.8 9.5 0.0 2.1 151.6 291.2 69.77 64.16 165 0.423 10M 26K 0.0 0.0 L1 8/0 877.10 MB 87.7 9.3 5.4 3.9 9.2 5.3 0.1 1.7 222.7 220.2 42.65 40.02 5 8.530 8495K 68K 0.0 0.0 L2 1/0 62.61 MB 0.6 0.1 0.1 0.0 0.1 0.1 4.5 1.8 232.5 232.4 0.48 0.44 1 0.480 113K 39 0.0 0.0 L3 21/0 958.18 MB 1.0 3.3 2.1 1.2 3.3 2.1 2.5 1.6 175.6 175.5 19.15 15.05 15 1.277 3402K 1455 0.0 0.0 L4 154/0 9.70 GB 1.0 2.5 1.8 0.7 2.5 1.8 2.7 1.4 126.2 125.9 20.14 11.95 16 1.259 2451K 5519 0.0 0.0 L5 1092/0 90.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1290/4 105.53 GB 0.0 25.5 9.3 16.2 34.9 18.7 14.1 3.7 171.5 234.7 152.20 131.62 202 0.753 25M 101K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.5 9.3 16.2 34.9 18.7 14.1 3.7 171.5 234.7 152.20 131.62 202 0.753 25M 101K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.5 9.3 16.2 25.3 9.2 0.0 0.0 211.9 210.7 123.17 106.95 66 1.866 25M 101K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 336.4 29.03 24.67 136 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 51.6 total, 51.5 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.88 GB write, 691.57 MB/s write, 25.48 GB read, 505.25 MB/s read, 152.2 seconds Interval compaction: 34.88 GB write, 694.09 MB/s write, 25.48 GB read, 507.09 MB/s read, 152.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 53, pending-compaction-bytes-delays: 28, pending-compaction-bytes-stops: 0, total-delays: 42, total-stops: 53, interval: 95 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4157311 Average: 2.5880 StdDev: 17.19 Min: 0 Median: 1.4987 Max: 7867 Percentiles: P50: 1.50 P75: 1.89 P99: 6.68 P99.9: 122.35 P99.99: 300.21 ------------------------------------------------------ [ 0, 1 ] 749272 18.023% 18.023% #### ( 1, 2 ] 2665693 64.121% 82.144% ############# ( 2, 3 ] 438207 10.541% 92.684% ## ( 3, 4 ] 144331 3.472% 96.156% # ( 4, 6 ] 112588 2.708% 98.864% # ( 6, 10 ] 33371 0.803% 99.667% ( 10, 15 ] 5066 0.122% 99.789% ( 15, 22 ] 498 0.012% 99.801% ( 22, 34 ] 47 0.001% 99.802% ( 34, 51 ] 30 0.001% 99.803% ( 51, 76 ] 138 0.003% 99.806% ( 76, 110 ] 3248 0.078% 99.884% ( 110, 170 ] 3235 0.078% 99.962% ( 170, 250 ] 927 0.022% 99.984% ( 250, 380 ] 635 0.015% 99.999% ( 380, 580 ] 458 0.011% 100.010% ( 580, 870 ] 231 0.006% 100.016% ( 870, 1300 ] 109 0.003% 100.019% ( 1300, 1900 ] 43 0.001% 100.020% ( 1900, 2900 ] 31 0.001% 100.020% ( 2900, 4400 ] 27 0.001% 100.021% ( 4400, 6600 ] 2 0.000% 100.021% ( 6600, 9900 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1901399 Average: 4.4549 StdDev: 63.96 Min: 0 Median: 1.7205 Max: 9998 Percentiles: P50: 1.72 P75: 2.53 P99: 9.28 P99.9: 123.41 P99.99: 315.09 ------------------------------------------------------ [ 0, 1 ] 178794 9.403% 9.403% ## ( 1, 2 ] 1071333 56.344% 65.748% ########### ( 2, 3 ] 331298 17.424% 83.172% ### ( 3, 4 ] 129729 6.823% 89.994% # ( 4, 6 ] 136582 7.183% 97.178% # ( 6, 10 ] 42201 2.219% 99.397% ( 10, 15 ] 7437 0.391% 99.788% ( 15, 22 ] 897 0.047% 99.835% ( 22, 34 ] 52 0.003% 99.838% ( 34, 51 ] 12 0.001% 99.839% ( 51, 76 ] 62 0.003% 99.842% ( 76, 110 ] 819 0.043% 99.885% ( 110, 170 ] 1260 0.066% 99.951% ( 170, 250 ] 480 0.025% 99.977% ( 250, 380 ] 505 0.027% 100.003% ( 380, 580 ] 505 0.027% 100.030% ( 580, 870 ] 437 0.023% 100.053% ( 870, 1300 ] 335 0.018% 100.070% ( 1300, 1900 ] 204 0.011% 100.081% ( 1900, 2900 ] 237 0.012% 100.094% ( 2900, 4400 ] 239 0.013% 100.106% ( 4400, 6600 ] 55 0.003% 100.109% ( 6600, 9900 ] 13 0.001% 100.110% ( 9900, 14000 ] 1 0.000% 100.110% ** Level 2 read latency histogram (micros): Count: 40633 Average: 3.5943 StdDev: 35.18 Min: 0 Median: 1.3857 Max: 3032 Percentiles: P50: 1.39 P75: 1.86 P99: 8.76 P99.9: 478.44 P99.99: 1590.50 ------------------------------------------------------ [ 0, 1 ] 11975 29.471% 29.471% ###### ( 1, 2 ] 21626 53.223% 82.694% ########### ( 2, 3 ] 3254 8.008% 90.702% ## ( 3, 4 ] 1492 3.672% 94.374% # ( 4, 6 ] 1512 3.721% 98.095% # ( 6, 10 ] 533 1.312% 99.407% ( 10, 15 ] 49 0.121% 99.527% ( 15, 22 ] 12 0.030% 99.557% ( 34, 51 ] 25 0.062% 99.619% ( 51, 76 ] 14 0.034% 99.653% ( 76, 110 ] 9 0.022% 99.675% ( 110, 170 ] 16 0.039% 99.715% ( 170, 250 ] 41 0.101% 99.815% ( 250, 380 ] 26 0.064% 99.879% ( 380, 580 ] 17 0.042% 99.921% ( 580, 870 ] 18 0.044% 99.966% ( 870, 1300 ] 8 0.020% 99.985% ( 1300, 1900 ] 4 0.010% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 482064 Average: 9.8689 StdDev: 130.95 Min: 0 Median: 1.8464 Max: 10227 Percentiles: P50: 1.85 P75: 2.84 P99: 11.82 P99.9: 1460.54 P99.99: 3140.69 ------------------------------------------------------ [ 0, 1 ] 22217 4.609% 4.609% # ( 1, 2 ] 258518 53.627% 58.236% ########### ( 2, 3 ] 96742 20.068% 78.304% #### ( 3, 4 ] 44040 9.136% 87.440% ## ( 4, 6 ] 42387 8.793% 96.233% ## ( 6, 10 ] 12517 2.597% 98.829% # ( 10, 15 ] 2265 0.470% 99.299% ( 15, 22 ] 274 0.057% 99.356% ( 22, 34 ] 14 0.003% 99.359% ( 34, 51 ] 11 0.002% 99.361% ( 51, 76 ] 36 0.007% 99.369% ( 76, 110 ] 181 0.038% 99.406% ( 110, 170 ] 332 0.069% 99.475% ( 170, 250 ] 315 0.065% 99.541% ( 250, 380 ] 355 0.074% 99.614% ( 380, 580 ] 492 0.102% 99.716% ( 580, 870 ] 470 0.097% 99.814% ( 870, 1300 ] 356 0.074% 99.888% ( 1300, 1900 ] 224 0.046% 99.934% ( 1900, 2900 ] 230 0.048% 99.982% ( 2900, 4400 ] 248 0.051% 100.033% ( 4400, 6600 ] 69 0.014% 100.048% ( 6600, 9900 ] 11 0.002% 100.050% ( 9900, 14000 ] 1 0.000% 100.050% ** Level 4 read latency histogram (micros): Count: 74779 Average: 4.7834 StdDev: 62.92 Min: 0 Median: 2.0700 Max: 5501 Percentiles: P50: 2.07 P75: 3.13 P99: 9.38 P99.9: 21.85 P99.99: 683.88 ------------------------------------------------------ [ 0, 1 ] 623 0.833% 0.833% ( 1, 2 ] 35440 47.393% 48.226% ######### ( 2, 3 ] 18950 25.341% 73.567% ##### ( 3, 4 ] 8502 11.370% 84.937% ## ( 4, 6 ] 9101 12.171% 97.107% ## ( 6, 10 ] 1673 2.237% 99.345% ( 10, 15 ] 379 0.507% 99.852% ( 15, 22 ] 37 0.049% 99.901% ( 22, 34 ] 4 0.005% 99.906% ( 34, 51 ] 3 0.004% 99.910% ( 51, 76 ] 3 0.004% 99.914% ( 76, 110 ] 2 0.003% 99.917% ( 110, 170 ] 9 0.012% 99.929% ( 170, 250 ] 30 0.040% 99.969% ( 250, 380 ] 4 0.005% 99.975% ( 380, 580 ] 4 0.005% 99.980% ( 580, 870 ] 21 0.028% 100.008% ( 870, 1300 ] 19 0.025% 100.033% ( 1300, 1900 ] 7 0.009% 100.043% ( 1900, 2900 ] 12 0.016% 100.059% ( 2900, 4400 ] 10 0.013% 100.072% ( 4400, 6600 ] 2 0.003% 100.075% ** Level 5 read latency histogram (micros): Count: 260 Average: 1528.0923 StdDev: 1556.19 Min: 75 Median: 801.7647 Max: 7454 Percentiles: P50: 801.76 P75: 2475.00 P99: 7040.00 P99.9: 7454.00 P99.99: 7454.00 ------------------------------------------------------ ( 51, 76 ] 1 0.385% 0.385% ( 76, 110 ] 12 4.615% 5.000% # ( 110, 170 ] 14 5.385% 10.385% # ( 170, 250 ] 14 5.385% 15.769% # ( 250, 380 ] 31 11.923% 27.692% ## ( 380, 580 ] 32 12.308% 40.000% ## ( 580, 870 ] 34 13.077% 53.077% ### ( 870, 1300 ] 17 6.538% 59.615% # ( 1300, 1900 ] 17 6.538% 66.154% # ( 1900, 2900 ] 40 15.385% 81.538% ### ( 2900, 4400 ] 35 13.462% 95.000% ### ( 4400, 6600 ] 10 3.846% 98.846% # ( 6600, 9900 ] 3 1.154% 100.000% ** DB Stats ** Uptime(secs): 51.6 total, 3.2 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 190.56 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.137 H:M:S, 46.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 307.56 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.597 H:M:S, 18.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.806 micros/op 172249 ops/sec 60.012 seconds 10336999 operations; 166.9 MB/s Microseconds per write: Count: 10336999 Average: 5.8055 StdDev: 319.58 Min: 0 Median: 1.7260 Max: 496295 Percentiles: P50: 1.73 P75: 2.73 P99: 9.31 P99.9: 1154.46 P99.99: 2709.83 ------------------------------------------------------ [ 0, 1 ] 1453232 14.059% 14.059% ### ( 1, 2 ] 5117764 49.509% 63.568% ########## ( 2, 3 ] 1610695 15.582% 79.150% ### ( 3, 4 ] 1409429 13.635% 92.784% ### ( 4, 6 ] 539416 5.218% 98.003% # ( 6, 10 ] 124463 1.204% 99.207% ( 10, 15 ] 39668 0.384% 99.590% ( 15, 22 ] 9038 0.087% 99.678% ( 22, 34 ] 1628 0.016% 99.694% ( 34, 51 ] 233 0.002% 99.696% ( 51, 76 ] 25 0.000% 99.696% ( 76, 110 ] 7143 0.069% 99.765% ( 110, 170 ] 2839 0.027% 99.793% ( 170, 250 ] 326 0.003% 99.796% ( 250, 380 ] 175 0.002% 99.798% ( 380, 580 ] 22 0.000% 99.798% ( 580, 870 ] 10 0.000% 99.798% ( 870, 1300 ] 15957 0.154% 99.952% ( 1300, 1900 ] 71 0.001% 99.953% ( 1900, 2900 ] 4731 0.046% 99.999% ( 2900, 4400 ] 81 0.001% 99.999% ( 4400, 6600 ] 20 0.000% 100.000% ( 6600, 9900 ] 6 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 175074 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10336999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10667782968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 507 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31726872 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 29898104154 rocksdb.compact.write.bytes COUNT : 29724176406 rocksdb.flush.write.bytes COUNT : 10635196006 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 61 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 313 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10549515264 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4162560 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29996520336 rocksdb.non.last.level.read.count COUNT : 7244166 rocksdb.block.checksum.compute.count COUNT : 7243213 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.371475 P95 : 3.909343 P99 : 7.865425 P100 : 496294.000000 COUNT : 10336999 SUM : 55226953 rocksdb.compaction.times.micros P50 : 1083125.000000 P95 : 5473333.333333 P99 : 16783953.000000 P100 : 16783953.000000 COUNT : 68 SUM : 125080332 rocksdb.compaction.times.cpu_micros P50 : 963888.888889 P95 : 5473333.333333 P99 : 15755135.000000 P100 : 15755135.000000 COUNT : 68 SUM : 108829763 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 690.786517 P95 : 1252.700000 P99 : 46430.000000 P100 : 82380.000000 COUNT : 142 SUM : 276278 rocksdb.compaction.outfile.sync.micros P50 : 941.666667 P95 : 65666.666667 P99 : 123200.000000 P100 : 128995.000000 COUNT : 312 SUM : 3500439 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 99.336364 P95 : 1775.000000 P99 : 3856.250000 P100 : 4997.000000 COUNT : 245 SUM : 73291 rocksdb.table.open.io.micros P50 : 1468.750000 P95 : 8871.500000 P99 : 13973.909091 P100 : 19978.000000 COUNT : 507 SUM : 1175944 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.591387 P95 : 7.468574 P99 : 10.610367 P100 : 10326.000000 COUNT : 7241865 SUM : 40428637 rocksdb.read.block.get.micros P50 : 478.412698 P95 : 3585.294118 P99 : 5814.600000 P100 : 7626.000000 COUNT : 1014 SUM : 925726 rocksdb.write.raw.block.micros P50 : 0.511615 P95 : 0.972069 P99 : 2.954690 P100 : 12622.000000 COUNT : 9774550 SUM : 18651992 rocksdb.numfiles.in.singlecompaction P50 : 3.421348 P95 : 5.871429 P99 : 20.985000 P100 : 23.000000 COUNT : 129 SUM : 539 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560269 P95 : 1169.130786 P99 : 2510.167267 P100 : 496124.000000 COUNT : 194818 SUM : 31746334 rocksdb.sst.read.micros P50 : 1.560847 P95 : 4.502249 P99 : 8.446673 P100 : 10227.000000 COUNT : 7244532 SUM : 26088522 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10336999 SUM : 10667782968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 210412.371134 P95 : 358789.473684 P99 : 654100.000000 P100 : 855396.000000 COUNT : 142 SUM : 30077549 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 316 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0