[2024-11-19 14:20:49.424868] Starting SPDK v25.01-pre git sha1 dcc2ca8f3 / DPDK 24.03.0 initialization... [2024-11-19 14:20:49.425011] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4178707 ] Set seed to 1732022449421287 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-19 14:20:49.541232] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-19 14:20:49.647680] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-19 14:20:49.647726] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 4178707' to capture a snapshot of events at runtime. [2024-11-19 14:20:49.647736] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-19 14:20:49.647746] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-19 14:20:49.647754] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid4178707 for offline analysis/debug. [2024-11-19 14:20:49.649051] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Nov 19 14:20:58 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/19-14:21:00 ... thread 0: (1000000,1000000) ops and (364592.3,364592.3) ops/second in (2.742790,2.742790) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.03 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 356.2 2.30 2.04 12 0.192 0 0 0.0 0.0 L2 3/2 251.77 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 255.1 255.0 1.48 1.43 2 0.741 383K 188 0.0 0.0 L3 10/0 804.32 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 100.0 316.6 3.78 3.47 14 0.270 383K 188 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.1 1.5 100.0 316.6 3.78 3.47 14 0.270 383K 188 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 255.1 255.0 1.48 1.43 2 0.741 383K 188 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 356.2 2.30 2.04 12 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.7 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 399.86 MB/s write, 0.37 GB read, 126.28 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 435.98 MB/s write, 0.37 GB read, 137.69 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 100847 Average: 2.0293 StdDev: 23.26 Min: 1 Median: 1.2796 Max: 3153 Percentiles: P50: 1.28 P75: 1.69 P99: 3.92 P99.9: 9.61 P99.99: 861.80 ------------------------------------------------------ [ 0, 1 ] 33128 32.850% 32.850% ####### ( 1, 2 ] 61861 61.341% 94.191% ############ ( 2, 3 ] 3744 3.713% 97.904% # ( 3, 4 ] 1205 1.195% 99.099% ( 4, 6 ] 616 0.611% 99.709% ( 6, 10 ] 214 0.212% 99.922% ( 10, 15 ] 41 0.041% 99.962% ( 15, 22 ] 12 0.012% 99.974% ( 22, 34 ] 1 0.001% 99.975% ( 34, 51 ] 2 0.002% 99.977% ( 110, 170 ] 7 0.007% 99.984% ( 170, 250 ] 3 0.003% 99.987% ( 250, 380 ] 1 0.001% 99.988% ( 580, 870 ] 3 0.003% 99.991% ( 870, 1300 ] 2 0.002% 99.993% ( 1300, 1900 ] 2 0.002% 99.995% ( 1900, 2900 ] 4 0.004% 99.999% ( 2900, 4400 ] 2 0.002% 100.001% ** Level 2 read latency histogram (micros): Count: 49200 Average: 2.3490 StdDev: 46.21 Min: 0 Median: 1.3286 Max: 8811 Percentiles: P50: 1.33 P75: 1.73 P99: 5.28 P99.9: 10.47 P99.99: 1316.00 ------------------------------------------------------ [ 0, 1 ] 14523 29.518% 29.518% ###### ( 1, 2 ] 30663 62.323% 91.841% ############ ( 2, 3 ] 2294 4.663% 96.504% # ( 3, 4 ] 831 1.689% 98.193% ( 4, 6 ] 618 1.256% 99.449% ( 6, 10 ] 219 0.445% 99.894% ( 10, 15 ] 30 0.061% 99.955% ( 15, 22 ] 3 0.006% 99.961% ( 22, 34 ] 1 0.002% 99.963% ( 34, 51 ] 2 0.004% 99.967% ( 250, 380 ] 4 0.008% 99.976% ( 380, 580 ] 2 0.004% 99.980% ( 580, 870 ] 1 0.002% 99.982% ( 870, 1300 ] 4 0.008% 99.990% ( 1300, 1900 ] 3 0.006% 99.996% ( 2900, 4400 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 40 Average: 3928.4000 StdDev: 3473.18 Min: 211 Median: 1900.0000 Max: 10953 Percentiles: P50: 1900.00 P75: 7150.00 P99: 10953.00 P99.9: 10953.00 P99.99: 10953.00 ------------------------------------------------------ ( 170, 250 ] 1 2.500% 2.500% # ( 380, 580 ] 2 5.000% 7.500% # ( 580, 870 ] 4 10.000% 17.500% ## ( 870, 1300 ] 5 12.500% 30.000% ### ( 1300, 1900 ] 8 20.000% 50.000% #### ( 2900, 4400 ] 7 17.500% 67.500% #### ( 4400, 6600 ] 2 5.000% 72.500% # ( 6600, 9900 ] 6 15.000% 87.500% ### ( 9900, 14000 ] 5 12.500% 100.000% ### ** Level 4 read latency histogram (micros): Count: 30 Average: 3904.0000 StdDev: 3695.77 Min: 264 Median: 1800.0000 Max: 12703 Percentiles: P50: 1800.00 P75: 7012.50 P99: 12703.00 P99.9: 12703.00 P99.99: 12703.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 380, 580 ] 2 6.667% 10.000% # ( 580, 870 ] 3 10.000% 20.000% ## ( 870, 1300 ] 4 13.333% 33.333% ### ( 1300, 1900 ] 6 20.000% 53.333% #### ( 1900, 2900 ] 1 3.333% 56.667% # ( 2900, 4400 ] 3 10.000% 66.667% ## ( 4400, 6600 ] 2 6.667% 73.333% # ( 6600, 9900 ] 4 13.333% 86.667% ### ( 9900, 14000 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 3.0 total, 2.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 328.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.199 H:M:S, 6.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 358.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.199 H:M:S, 7.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-14:21:04 ... thread 0: (1000000,2000000) ops and (322286.8,342136.7) ops/second in (3.102826,5.845616) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/7 1.17 GB 6.3 0.8 0.0 0.8 2.6 1.8 0.0 1.4 98.6 318.5 8.30 7.65 29 0.286 831K 846 0.0 0.0 L1 1/1 3.04 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 239.1 238.6 1.58 1.53 1 1.581 383K 622 0.0 0.0 L2 2/1 54.28 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 255.1 255.0 1.48 1.43 2 0.741 383K 188 0.0 0.0 L3 20/10 1.12 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 225.9 225.9 1.11 1.03 1 1.105 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 145.5 145.5 1.55 1.13 1 1.546 228K 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/19 97.92 GB 0.0 2.0 1.0 1.0 3.8 2.8 1.1 2.1 146.2 276.4 14.02 12.77 34 0.412 2081K 1656 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 1.0 1.0 3.8 2.8 1.0 2.1 146.2 276.4 14.02 12.77 34 0.412 2081K 1656 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 1.0 1.0 2.0 1.0 0.0 0.0 230.4 230.2 8.90 8.24 8 1.112 2081K 1656 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 356.7 5.12 4.53 26 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.78 GB write, 635.65 MB/s write, 2.00 GB read, 336.23 MB/s read, 14.0 seconds Interval compaction: 3.78 GB write, 662.60 MB/s write, 2.00 GB read, 350.48 MB/s read, 14.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 383982 Average: 2.3626 StdDev: 16.73 Min: 1 Median: 1.5599 Max: 4491 Percentiles: P50: 1.56 P75: 1.95 P99: 5.77 P99.9: 10.18 P99.99: 15.11 ------------------------------------------------------ [ 0, 1 ] 54294 14.140% 14.140% ### ( 1, 2 ] 245937 64.049% 78.189% ############# ( 2, 3 ] 54400 14.167% 92.356% ### ( 3, 4 ] 15227 3.966% 96.322% # ( 4, 6 ] 11609 3.023% 99.345% # ( 6, 10 ] 2119 0.552% 99.897% ( 10, 15 ] 358 0.093% 99.990% ( 15, 22 ] 38 0.010% 100.000% ( 22, 34 ] 5 0.001% 100.001% ( 34, 51 ] 7 0.002% 100.003% ( 51, 76 ] 6 0.002% 100.005% ( 110, 170 ] 10 0.003% 100.007% ( 170, 250 ] 8 0.002% 100.009% ( 250, 380 ] 6 0.002% 100.011% ( 380, 580 ] 6 0.002% 100.013% ( 580, 870 ] 8 0.002% 100.015% ( 870, 1300 ] 6 0.002% 100.016% ( 1300, 1900 ] 6 0.002% 100.018% ( 1900, 2900 ] 4 0.001% 100.019% ( 2900, 4400 ] 3 0.001% 100.020% ( 4400, 6600 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 26 Average: 181.1154 StdDev: 348.20 Min: 0 Median: 1.7778 Max: 1233 Percentiles: P50: 1.78 P75: 210.00 P99: 1233.00 P99.9: 1233.00 P99.99: 1233.00 ------------------------------------------------------ [ 0, 1 ] 6 23.077% 23.077% ##### ( 1, 2 ] 9 34.615% 57.692% ####### ( 2, 3 ] 1 3.846% 61.538% # ( 3, 4 ] 1 3.846% 65.385% # ( 4, 6 ] 1 3.846% 69.231% # ( 110, 170 ] 1 3.846% 73.077% # ( 170, 250 ] 1 3.846% 76.923% # ( 250, 380 ] 2 7.692% 84.615% ## ( 380, 580 ] 1 3.846% 88.462% # ( 580, 870 ] 1 3.846% 92.308% # ( 870, 1300 ] 2 7.692% 100.000% ## ** Level 2 read latency histogram (micros): Count: 95728 Average: 2.3210 StdDev: 33.14 Min: 0 Median: 1.4661 Max: 8811 Percentiles: P50: 1.47 P75: 1.85 P99: 5.68 P99.9: 11.65 P99.99: 703.89 ------------------------------------------------------ [ 0, 1 ] 19009 19.857% 19.857% #### ( 1, 2 ] 61909 64.672% 84.529% ############# ( 2, 3 ] 9339 9.756% 94.285% ## ( 3, 4 ] 2784 2.908% 97.193% # ( 4, 6 ] 2058 2.150% 99.343% ( 6, 10 ] 500 0.522% 99.865% ( 10, 15 ] 101 0.106% 99.971% ( 15, 22 ] 8 0.008% 99.979% ( 22, 34 ] 1 0.001% 99.980% ( 34, 51 ] 2 0.002% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 250, 380 ] 4 0.004% 99.987% ( 380, 580 ] 2 0.002% 99.990% ( 580, 870 ] 1 0.001% 99.991% ( 870, 1300 ] 4 0.004% 99.995% ( 1300, 1900 ] 3 0.003% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 183070 Average: 4.0153 StdDev: 79.00 Min: 1 Median: 1.7387 Max: 10953 Percentiles: P50: 1.74 P75: 2.43 P99: 8.88 P99.9: 160.37 P99.99: 364.92 ------------------------------------------------------ [ 0, 1 ] 11228 6.133% 6.133% # ( 1, 2 ] 108720 59.387% 65.520% ############ ( 2, 3 ] 40708 22.236% 87.757% #### ( 3, 4 ] 9717 5.308% 93.064% # ( 4, 6 ] 8647 4.723% 97.788% # ( 6, 10 ] 3083 1.684% 99.472% ( 10, 15 ] 499 0.273% 99.744% ( 15, 22 ] 58 0.032% 99.776% ( 22, 34 ] 9 0.005% 99.781% ( 34, 51 ] 4 0.002% 99.783% ( 76, 110 ] 89 0.049% 99.832% ( 110, 170 ] 150 0.082% 99.914% ( 170, 250 ] 85 0.046% 99.960% ( 250, 380 ] 63 0.034% 99.995% ( 380, 580 ] 42 0.023% 100.017% ( 580, 870 ] 30 0.016% 100.034% ( 870, 1300 ] 14 0.008% 100.042% ( 1300, 1900 ] 8 0.004% 100.046% ( 2900, 4400 ] 7 0.004% 100.050% ( 4400, 6600 ] 2 0.001% 100.051% ( 6600, 9900 ] 6 0.003% 100.054% ( 9900, 14000 ] 5 0.003% 100.057% ** Level 4 read latency histogram (micros): Count: 320 Average: 371.7125 StdDev: 1603.62 Min: 1 Median: 1.9020 Max: 12703 Percentiles: P50: 1.90 P75: 6.40 P99: 10720.00 P99.9: 12703.00 P99.99: 12703.00 ------------------------------------------------------ [ 0, 1 ] 68 21.250% 21.250% #### ( 1, 2 ] 102 31.875% 53.125% ###### ( 2, 3 ] 44 13.750% 66.875% ### ( 3, 4 ] 11 3.438% 70.312% # ( 4, 6 ] 14 4.375% 74.688% # ( 6, 10 ] 10 3.125% 77.812% # ( 10, 15 ] 24 7.500% 85.312% ## ( 15, 22 ] 12 3.750% 89.062% # ( 22, 34 ] 1 0.312% 89.375% ( 110, 170 ] 2 0.625% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 3 0.938% 92.500% ( 870, 1300 ] 4 1.250% 93.750% ( 1300, 1900 ] 6 1.875% 95.625% ( 1900, 2900 ] 1 0.312% 95.938% ( 2900, 4400 ] 3 0.938% 96.875% ( 4400, 6600 ] 2 0.625% 97.500% ( 6600, 9900 ] 4 1.250% 98.750% ( 9900, 14000 ] 4 1.250% 100.000% ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 322.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.624 H:M:S, 10.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.425 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-14:21:07 ... thread 0: (1000000,3000000) ops and (328811.3,337576.5) ops/second in (3.041258,8.886874) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 2.15 GB 75.5 1.3 0.0 1.3 4.1 2.8 0.0 1.5 101.3 318.2 13.06 12.05 45 0.290 1343K 1349 0.0 0.0 L1 1/1 3.04 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 239.1 238.6 1.58 1.53 1 1.581 383K 622 0.0 0.0 L2 1/0 52.22 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 255.1 255.0 1.48 1.43 2 0.741 383K 188 0.0 0.0 L3 19/0 893.67 MB 0.9 1.0 0.2 0.8 1.0 0.2 0.4 4.2 238.1 237.7 4.44 4.06 2 2.218 1072K 2092 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 145.5 145.5 1.55 1.13 1 1.546 228K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1259/12 98.90 GB 0.0 3.3 1.0 2.3 6.0 3.8 1.7 2.2 152.0 280.1 22.10 20.20 51 0.433 3411K 4251 0.0 0.0 Int 0/0 0.00 KB 0.0 3.3 1.0 2.3 6.0 3.8 1.5 2.2 152.0 280.1 22.10 20.20 51 0.433 3411K 4251 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.3 1.0 2.3 3.3 1.0 0.0 0.0 237.5 237.2 14.15 13.16 11 1.286 3411K 4251 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 356.3 7.96 7.05 40 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.05 GB write, 677.52 MB/s write, 3.28 GB read, 367.73 MB/s read, 22.1 seconds Interval compaction: 6.05 GB write, 696.42 MB/s write, 3.28 GB read, 377.99 MB/s read, 22.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 721585 Average: 2.3397 StdDev: 13.09 Min: 1 Median: 1.5776 Max: 4491 Percentiles: P50: 1.58 P75: 1.96 P99: 5.72 P99.9: 9.96 P99.99: 14.58 ------------------------------------------------------ [ 0, 1 ] 88576 12.275% 12.275% ## ( 1, 2 ] 471281 65.312% 77.587% ############# ( 2, 3 ] 109795 15.216% 92.803% ### ( 3, 4 ] 27028 3.746% 96.549% # ( 4, 6 ] 20586 2.853% 99.401% # ( 6, 10 ] 3633 0.503% 99.905% ( 10, 15 ] 671 0.093% 99.998% ( 15, 22 ] 67 0.009% 100.007% ( 22, 34 ] 8 0.001% 100.008% ( 34, 51 ] 10 0.001% 100.010% ( 51, 76 ] 10 0.001% 100.011% ( 76, 110 ] 9 0.001% 100.012% ( 110, 170 ] 17 0.002% 100.015% ( 170, 250 ] 20 0.003% 100.017% ( 250, 380 ] 13 0.002% 100.019% ( 380, 580 ] 13 0.002% 100.021% ( 580, 870 ] 14 0.002% 100.023% ( 870, 1300 ] 9 0.001% 100.024% ( 1300, 1900 ] 7 0.001% 100.025% ( 1900, 2900 ] 5 0.001% 100.026% ( 2900, 4400 ] 3 0.000% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 26 Average: 181.1154 StdDev: 348.20 Min: 0 Median: 1.7778 Max: 1233 Percentiles: P50: 1.78 P75: 210.00 P99: 1233.00 P99.9: 1233.00 P99.99: 1233.00 ------------------------------------------------------ [ 0, 1 ] 6 23.077% 23.077% ##### ( 1, 2 ] 9 34.615% 57.692% ####### ( 2, 3 ] 1 3.846% 61.538% # ( 3, 4 ] 1 3.846% 65.385% # ( 4, 6 ] 1 3.846% 69.231% # ( 110, 170 ] 1 3.846% 73.077% # ( 170, 250 ] 1 3.846% 76.923% # ( 250, 380 ] 2 7.692% 84.615% ## ( 380, 580 ] 1 3.846% 88.462% # ( 580, 870 ] 1 3.846% 92.308% # ( 870, 1300 ] 2 7.692% 100.000% ## ** Level 2 read latency histogram (micros): Count: 124220 Average: 2.6071 StdDev: 30.55 Min: 0 Median: 1.5235 Max: 8811 Percentiles: P50: 1.52 P75: 1.91 P99: 6.43 P99.9: 99.14 P99.99: 799.76 ------------------------------------------------------ [ 0, 1 ] 20435 16.451% 16.451% ### ( 1, 2 ] 79604 64.083% 80.534% ############# ( 2, 3 ] 15298 12.315% 92.849% ## ( 3, 4 ] 4318 3.476% 96.325% # ( 4, 6 ] 3209 2.583% 98.908% # ( 6, 10 ] 1062 0.855% 99.763% ( 10, 15 ] 133 0.107% 99.870% ( 15, 22 ] 9 0.007% 99.878% ( 22, 34 ] 2 0.002% 99.879% ( 34, 51 ] 3 0.002% 99.882% ( 51, 76 ] 1 0.001% 99.882% ( 76, 110 ] 32 0.026% 99.908% ( 110, 170 ] 36 0.029% 99.937% ( 170, 250 ] 30 0.024% 99.961% ( 250, 380 ] 15 0.012% 99.973% ( 380, 580 ] 13 0.010% 99.984% ( 580, 870 ] 10 0.008% 99.992% ( 870, 1300 ] 5 0.004% 99.996% ( 1300, 1900 ] 3 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 233058 Average: 3.8105 StdDev: 70.61 Min: 1 Median: 1.7025 Max: 10953 Percentiles: P50: 1.70 P75: 2.33 P99: 8.83 P99.9: 164.34 P99.99: 418.78 ------------------------------------------------------ [ 0, 1 ] 16484 7.073% 7.073% # ( 1, 2 ] 142418 61.108% 68.181% ############ ( 2, 3 ] 47569 20.411% 88.592% #### ( 3, 4 ] 11494 4.932% 93.524% # ( 4, 6 ] 9932 4.262% 97.786% # ( 6, 10 ] 3998 1.715% 99.501% ( 10, 15 ] 531 0.228% 99.729% ( 15, 22 ] 60 0.026% 99.755% ( 22, 34 ] 9 0.004% 99.758% ( 34, 51 ] 4 0.002% 99.760% ( 51, 76 ] 2 0.001% 99.761% ( 76, 110 ] 112 0.048% 99.809% ( 110, 170 ] 234 0.100% 99.909% ( 170, 250 ] 106 0.045% 99.955% ( 250, 380 ] 72 0.031% 99.986% ( 380, 580 ] 50 0.021% 100.007% ( 580, 870 ] 38 0.016% 100.024% ( 870, 1300 ] 17 0.007% 100.031% ( 1300, 1900 ] 11 0.005% 100.036% ( 2900, 4400 ] 7 0.003% 100.039% ( 4400, 6600 ] 2 0.001% 100.039% ( 6600, 9900 ] 6 0.003% 100.042% ( 9900, 14000 ] 5 0.002% 100.044% ** Level 4 read latency histogram (micros): Count: 320 Average: 371.7125 StdDev: 1603.62 Min: 1 Median: 1.9020 Max: 12703 Percentiles: P50: 1.90 P75: 6.40 P99: 10720.00 P99.9: 12703.00 P99.99: 12703.00 ------------------------------------------------------ [ 0, 1 ] 68 21.250% 21.250% #### ( 1, 2 ] 102 31.875% 53.125% ###### ( 2, 3 ] 44 13.750% 66.875% ### ( 3, 4 ] 11 3.438% 70.312% # ( 4, 6 ] 14 4.375% 74.688% # ( 6, 10 ] 10 3.125% 77.812% # ( 10, 15 ] 24 7.500% 85.312% ## ( 15, 22 ] 12 3.750% 89.062% # ( 22, 34 ] 1 0.312% 89.375% ( 110, 170 ] 2 0.625% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 3 0.938% 92.500% ( 870, 1300 ] 4 1.250% 93.750% ( 1300, 1900 ] 6 1.875% 95.625% ( 1900, 2900 ] 1 0.312% 95.938% ( 2900, 4400 ] 3 0.938% 96.875% ( 4400, 6600 ] 2 0.625% 97.500% ( 6600, 9900 ] 4 1.250% 98.750% ( 9900, 14000 ] 4 1.250% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1024.8000 StdDev: 1076.34 Min: 150 Median: 580.0000 Max: 3661 Percentiles: P50: 580.00 P75: 1500.00 P99: 3661.00 P99.9: 3661.00 P99.99: 3661.00 ------------------------------------------------------ ( 110, 170 ] 1 5.000% 5.000% # ( 170, 250 ] 3 15.000% 20.000% ### ( 250, 380 ] 5 25.000% 45.000% ##### ( 380, 580 ] 1 5.000% 50.000% # ( 580, 870 ] 2 10.000% 60.000% ## ( 870, 1300 ] 2 10.000% 70.000% ## ( 1300, 1900 ] 3 15.000% 85.000% ### ( 1900, 2900 ] 1 5.000% 90.000% # ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 323.14 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.998 H:M:S, 10.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.373 H:M:S, 12.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-14:21:10 ... thread 0: (1000000,4000000) ops and (333041.6,336431.2) ops/second in (3.002628,11.889502) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 1.97 GB 169.9 2.2 0.0 2.2 5.8 3.7 0.0 1.6 115.2 312.5 19.14 17.72 61 0.314 2238K 2378 0.0 0.0 L1 10/0 1.10 GB 113.1 1.5 1.5 0.0 1.5 1.5 0.2 1.0 229.6 228.7 6.59 6.36 2 3.297 1537K 5977 0.0 0.0 L2 1/0 52.22 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 255.1 255.0 1.48 1.43 2 0.741 383K 188 0.0 0.0 L3 19/0 893.67 MB 0.9 1.0 0.2 0.8 1.0 0.2 0.4 4.2 238.1 237.7 4.44 4.06 2 2.218 1072K 2092 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 145.5 145.5 1.55 1.13 1 1.546 228K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1265/4 99.82 GB 0.0 5.3 2.1 3.1 8.9 5.8 1.7 2.4 162.0 275.5 33.20 30.71 68 0.488 5460K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.3 2.1 3.1 8.9 5.8 1.5 2.4 162.0 275.5 33.20 30.71 68 0.488 5460K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.3 2.1 3.1 5.2 2.1 0.0 0.0 238.6 238.1 22.54 21.29 15 1.502 5460K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 354.6 10.66 9.41 53 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.93 GB write, 753.47 MB/s write, 5.25 GB read, 443.01 MB/s read, 33.2 seconds Interval compaction: 8.93 GB write, 769.18 MB/s write, 5.25 GB read, 452.25 MB/s read, 33.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1055431 Average: 2.3333 StdDev: 13.29 Min: 1 Median: 1.5610 Max: 4491 Percentiles: P50: 1.56 P75: 1.94 P99: 5.71 P99.9: 9.95 P99.99: 14.96 ------------------------------------------------------ [ 0, 1 ] 139204 13.189% 13.189% ### ( 1, 2 ] 692494 65.612% 78.802% ############# ( 2, 3 ] 152642 14.463% 93.264% ### ( 3, 4 ] 36919 3.498% 96.762% # ( 4, 6 ] 27616 2.617% 99.379% # ( 6, 10 ] 5568 0.528% 99.906% ( 10, 15 ] 889 0.084% 99.991% ( 15, 22 ] 91 0.009% 99.999% ( 22, 34 ] 11 0.001% 100.000% ( 34, 51 ] 14 0.001% 100.002% ( 51, 76 ] 13 0.001% 100.003% ( 76, 110 ] 49 0.005% 100.007% ( 110, 170 ] 76 0.007% 100.015% ( 170, 250 ] 48 0.005% 100.019% ( 250, 380 ] 23 0.002% 100.021% ( 380, 580 ] 32 0.003% 100.024% ( 580, 870 ] 23 0.002% 100.027% ( 870, 1300 ] 16 0.002% 100.028% ( 1300, 1900 ] 8 0.001% 100.029% ( 1900, 2900 ] 7 0.001% 100.030% ( 2900, 4400 ] 6 0.001% 100.030% ( 4400, 6600 ] 1 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 847 Average: 43.1358 StdDev: 179.17 Min: 0 Median: 1.6533 Max: 1843 Percentiles: P50: 1.65 P75: 2.37 P99: 1001.58 P99.9: 1798.36 P99.99: 1843.00 ------------------------------------------------------ [ 0, 1 ] 106 12.515% 12.515% ### ( 1, 2 ] 486 57.379% 69.894% ########### ( 2, 3 ] 117 13.813% 83.707% ### ( 3, 4 ] 25 2.952% 86.659% # ( 4, 6 ] 12 1.417% 88.076% ( 6, 10 ] 10 1.181% 89.256% ( 76, 110 ] 11 1.299% 90.555% ( 110, 170 ] 25 2.952% 93.506% # ( 170, 250 ] 19 2.243% 95.750% ( 250, 380 ] 6 0.708% 96.458% ( 380, 580 ] 14 1.653% 98.111% ( 580, 870 ] 6 0.708% 98.819% ( 870, 1300 ] 5 0.590% 99.410% ( 1300, 1900 ] 5 0.590% 100.000% ** Level 2 read latency histogram (micros): Count: 124220 Average: 2.6071 StdDev: 30.55 Min: 0 Median: 1.5235 Max: 8811 Percentiles: P50: 1.52 P75: 1.91 P99: 6.43 P99.9: 99.14 P99.99: 799.76 ------------------------------------------------------ [ 0, 1 ] 20435 16.451% 16.451% ### ( 1, 2 ] 79604 64.083% 80.534% ############# ( 2, 3 ] 15298 12.315% 92.849% ## ( 3, 4 ] 4318 3.476% 96.325% # ( 4, 6 ] 3209 2.583% 98.908% # ( 6, 10 ] 1062 0.855% 99.763% ( 10, 15 ] 133 0.107% 99.870% ( 15, 22 ] 9 0.007% 99.878% ( 22, 34 ] 2 0.002% 99.879% ( 34, 51 ] 3 0.002% 99.882% ( 51, 76 ] 1 0.001% 99.882% ( 76, 110 ] 32 0.026% 99.908% ( 110, 170 ] 36 0.029% 99.937% ( 170, 250 ] 30 0.024% 99.961% ( 250, 380 ] 15 0.012% 99.973% ( 380, 580 ] 13 0.010% 99.984% ( 580, 870 ] 10 0.008% 99.992% ( 870, 1300 ] 5 0.004% 99.996% ( 1300, 1900 ] 3 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 233058 Average: 3.8105 StdDev: 70.61 Min: 1 Median: 1.7025 Max: 10953 Percentiles: P50: 1.70 P75: 2.33 P99: 8.83 P99.9: 164.34 P99.99: 418.78 ------------------------------------------------------ [ 0, 1 ] 16484 7.073% 7.073% # ( 1, 2 ] 142418 61.108% 68.181% ############ ( 2, 3 ] 47569 20.411% 88.592% #### ( 3, 4 ] 11494 4.932% 93.524% # ( 4, 6 ] 9932 4.262% 97.786% # ( 6, 10 ] 3998 1.715% 99.501% ( 10, 15 ] 531 0.228% 99.729% ( 15, 22 ] 60 0.026% 99.755% ( 22, 34 ] 9 0.004% 99.758% ( 34, 51 ] 4 0.002% 99.760% ( 51, 76 ] 2 0.001% 99.761% ( 76, 110 ] 112 0.048% 99.809% ( 110, 170 ] 234 0.100% 99.909% ( 170, 250 ] 106 0.045% 99.955% ( 250, 380 ] 72 0.031% 99.986% ( 380, 580 ] 50 0.021% 100.007% ( 580, 870 ] 38 0.016% 100.024% ( 870, 1300 ] 17 0.007% 100.031% ( 1300, 1900 ] 11 0.005% 100.036% ( 2900, 4400 ] 7 0.003% 100.039% ( 4400, 6600 ] 2 0.001% 100.039% ( 6600, 9900 ] 6 0.003% 100.042% ( 9900, 14000 ] 5 0.002% 100.044% ** Level 4 read latency histogram (micros): Count: 320 Average: 371.7125 StdDev: 1603.62 Min: 1 Median: 1.9020 Max: 12703 Percentiles: P50: 1.90 P75: 6.40 P99: 10720.00 P99.9: 12703.00 P99.99: 12703.00 ------------------------------------------------------ [ 0, 1 ] 68 21.250% 21.250% #### ( 1, 2 ] 102 31.875% 53.125% ###### ( 2, 3 ] 44 13.750% 66.875% ### ( 3, 4 ] 11 3.438% 70.312% # ( 4, 6 ] 14 4.375% 74.688% # ( 6, 10 ] 10 3.125% 77.812% # ( 10, 15 ] 24 7.500% 85.312% ## ( 15, 22 ] 12 3.750% 89.062% # ( 22, 34 ] 1 0.312% 89.375% ( 110, 170 ] 2 0.625% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 3 0.938% 92.500% ( 870, 1300 ] 4 1.250% 93.750% ( 1300, 1900 ] 6 1.875% 95.625% ( 1900, 2900 ] 1 0.312% 95.938% ( 2900, 4400 ] 3 0.938% 96.875% ( 4400, 6600 ] 2 0.625% 97.500% ( 6600, 9900 ] 4 1.250% 98.750% ( 9900, 14000 ] 4 1.250% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1024.8000 StdDev: 1076.34 Min: 150 Median: 580.0000 Max: 3661 Percentiles: P50: 580.00 P75: 1500.00 P99: 3661.00 P99.9: 3661.00 P99.99: 3661.00 ------------------------------------------------------ ( 110, 170 ] 1 5.000% 5.000% # ( 170, 250 ] 3 15.000% 20.000% ### ( 250, 380 ] 5 25.000% 45.000% ##### ( 380, 580 ] 1 5.000% 50.000% # ( 580, 870 ] 2 10.000% 60.000% ## ( 870, 1300 ] 2 10.000% 70.000% ## ( 1300, 1900 ] 3 15.000% 85.000% ### ( 1900, 2900 ] 1 5.000% 90.000% # ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 324.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.370 H:M:S, 11.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.77 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.372 H:M:S, 12.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/19-14:21:13 ... thread 0: (1000000,5000000) ops and (334942.1,336132.4) ops/second in (2.985591,14.875093) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 2.95 GB 270.6 3.3 0.0 3.3 7.9 4.7 0.0 1.7 127.8 310.9 26.13 24.34 79 0.331 3390K 3611 0.0 0.0 L1 10/0 1.10 GB 113.1 1.5 1.5 0.0 1.5 1.5 0.2 1.0 229.6 228.7 6.59 6.36 2 3.297 1537K 5977 0.0 0.0 L2 1/0 52.22 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 255.1 255.0 1.48 1.43 2 0.741 383K 188 0.0 0.0 L3 19/0 893.67 MB 0.9 1.0 0.2 0.8 1.0 0.2 0.4 4.2 238.1 237.7 4.44 4.06 2 2.218 1072K 2092 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 145.5 145.5 1.55 1.13 1 1.546 228K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1267/4 100.80 GB 0.0 6.4 2.1 4.2 11.0 6.8 1.7 2.4 162.1 280.9 40.18 37.32 86 0.467 6612K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.4 2.1 4.2 11.0 6.8 1.5 2.4 162.1 280.9 40.18 37.32 86 0.467 6612K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.4 2.1 4.2 6.3 2.1 0.0 0.0 243.3 242.8 26.77 25.44 19 1.409 6612K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 357.0 13.41 11.88 67 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.1 total, 14.9 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.02 GB write, 746.27 MB/s write, 6.36 GB read, 430.54 MB/s read, 40.2 seconds Interval compaction: 11.02 GB write, 758.70 MB/s write, 6.36 GB read, 437.71 MB/s read, 40.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1316831 Average: 2.2724 StdDev: 12.69 Min: 0 Median: 1.5296 Max: 4491 Percentiles: P50: 1.53 P75: 1.91 P99: 5.63 P99.9: 9.98 P99.99: 16.17 ------------------------------------------------------ [ 0, 1 ] 199505 15.150% 15.150% ### ( 1, 2 ] 866520 65.803% 80.954% ############# ( 2, 3 ] 170447 12.944% 93.898% ### ( 3, 4 ] 42545 3.231% 97.128% # ( 4, 6 ] 30253 2.297% 99.426% ( 6, 10 ] 6280 0.477% 99.903% ( 10, 15 ] 1128 0.086% 99.988% ( 15, 22 ] 133 0.010% 99.998% ( 22, 34 ] 15 0.001% 100.000% ( 34, 51 ] 17 0.001% 100.001% ( 51, 76 ] 17 0.001% 100.002% ( 76, 110 ] 49 0.004% 100.006% ( 110, 170 ] 84 0.006% 100.012% ( 170, 250 ] 51 0.004% 100.016% ( 250, 380 ] 28 0.002% 100.018% ( 380, 580 ] 38 0.003% 100.021% ( 580, 870 ] 25 0.002% 100.023% ( 870, 1300 ] 26 0.002% 100.025% ( 1300, 1900 ] 9 0.001% 100.026% ( 1900, 2900 ] 7 0.001% 100.026% ( 2900, 4400 ] 7 0.001% 100.027% ( 4400, 6600 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 847 Average: 43.1358 StdDev: 179.17 Min: 0 Median: 1.6533 Max: 1843 Percentiles: P50: 1.65 P75: 2.37 P99: 1001.58 P99.9: 1798.36 P99.99: 1843.00 ------------------------------------------------------ [ 0, 1 ] 106 12.515% 12.515% ### ( 1, 2 ] 486 57.379% 69.894% ########### ( 2, 3 ] 117 13.813% 83.707% ### ( 3, 4 ] 25 2.952% 86.659% # ( 4, 6 ] 12 1.417% 88.076% ( 6, 10 ] 10 1.181% 89.256% ( 76, 110 ] 11 1.299% 90.555% ( 110, 170 ] 25 2.952% 93.506% # ( 170, 250 ] 19 2.243% 95.750% ( 250, 380 ] 6 0.708% 96.458% ( 380, 580 ] 14 1.653% 98.111% ( 580, 870 ] 6 0.708% 98.819% ( 870, 1300 ] 5 0.590% 99.410% ( 1300, 1900 ] 5 0.590% 100.000% ** Level 2 read latency histogram (micros): Count: 124220 Average: 2.6071 StdDev: 30.55 Min: 0 Median: 1.5235 Max: 8811 Percentiles: P50: 1.52 P75: 1.91 P99: 6.43 P99.9: 99.14 P99.99: 799.76 ------------------------------------------------------ [ 0, 1 ] 20435 16.451% 16.451% ### ( 1, 2 ] 79604 64.083% 80.534% ############# ( 2, 3 ] 15298 12.315% 92.849% ## ( 3, 4 ] 4318 3.476% 96.325% # ( 4, 6 ] 3209 2.583% 98.908% # ( 6, 10 ] 1062 0.855% 99.763% ( 10, 15 ] 133 0.107% 99.870% ( 15, 22 ] 9 0.007% 99.878% ( 22, 34 ] 2 0.002% 99.879% ( 34, 51 ] 3 0.002% 99.882% ( 51, 76 ] 1 0.001% 99.882% ( 76, 110 ] 32 0.026% 99.908% ( 110, 170 ] 36 0.029% 99.937% ( 170, 250 ] 30 0.024% 99.961% ( 250, 380 ] 15 0.012% 99.973% ( 380, 580 ] 13 0.010% 99.984% ( 580, 870 ] 10 0.008% 99.992% ( 870, 1300 ] 5 0.004% 99.996% ( 1300, 1900 ] 3 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 233058 Average: 3.8105 StdDev: 70.61 Min: 1 Median: 1.7025 Max: 10953 Percentiles: P50: 1.70 P75: 2.33 P99: 8.83 P99.9: 164.34 P99.99: 418.78 ------------------------------------------------------ [ 0, 1 ] 16484 7.073% 7.073% # ( 1, 2 ] 142418 61.108% 68.181% ############ ( 2, 3 ] 47569 20.411% 88.592% #### ( 3, 4 ] 11494 4.932% 93.524% # ( 4, 6 ] 9932 4.262% 97.786% # ( 6, 10 ] 3998 1.715% 99.501% ( 10, 15 ] 531 0.228% 99.729% ( 15, 22 ] 60 0.026% 99.755% ( 22, 34 ] 9 0.004% 99.758% ( 34, 51 ] 4 0.002% 99.760% ( 51, 76 ] 2 0.001% 99.761% ( 76, 110 ] 112 0.048% 99.809% ( 110, 170 ] 234 0.100% 99.909% ( 170, 250 ] 106 0.045% 99.955% ( 250, 380 ] 72 0.031% 99.986% ( 380, 580 ] 50 0.021% 100.007% ( 580, 870 ] 38 0.016% 100.024% ( 870, 1300 ] 17 0.007% 100.031% ( 1300, 1900 ] 11 0.005% 100.036% ( 2900, 4400 ] 7 0.003% 100.039% ( 4400, 6600 ] 2 0.001% 100.039% ( 6600, 9900 ] 6 0.003% 100.042% ( 9900, 14000 ] 5 0.002% 100.044% ** Level 4 read latency histogram (micros): Count: 320 Average: 371.7125 StdDev: 1603.62 Min: 1 Median: 1.9020 Max: 12703 Percentiles: P50: 1.90 P75: 6.40 P99: 10720.00 P99.9: 12703.00 P99.99: 12703.00 ------------------------------------------------------ [ 0, 1 ] 68 21.250% 21.250% #### ( 1, 2 ] 102 31.875% 53.125% ###### ( 2, 3 ] 44 13.750% 66.875% ### ( 3, 4 ] 11 3.438% 70.312% # ( 4, 6 ] 14 4.375% 74.688% # ( 6, 10 ] 10 3.125% 77.812% # ( 10, 15 ] 24 7.500% 85.312% ## ( 15, 22 ] 12 3.750% 89.062% # ( 22, 34 ] 1 0.312% 89.375% ( 110, 170 ] 2 0.625% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 3 0.938% 92.500% ( 870, 1300 ] 4 1.250% 93.750% ( 1300, 1900 ] 6 1.875% 95.625% ( 1900, 2900 ] 1 0.312% 95.938% ( 2900, 4400 ] 3 0.938% 96.875% ( 4400, 6600 ] 2 0.625% 97.500% ( 6600, 9900 ] 4 1.250% 98.750% ( 9900, 14000 ] 4 1.250% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1024.8000 StdDev: 1076.34 Min: 150 Median: 580.0000 Max: 3661 Percentiles: P50: 580.00 P75: 1500.00 P99: 3661.00 P99.9: 3661.00 P99.99: 3661.00 ------------------------------------------------------ ( 110, 170 ] 1 5.000% 5.000% # ( 170, 250 ] 3 15.000% 20.000% ### ( 250, 380 ] 5 25.000% 45.000% ##### ( 380, 580 ] 1 5.000% 50.000% # ( 580, 870 ] 2 10.000% 60.000% ## ( 870, 1300 ] 2 10.000% 70.000% ## ( 1300, 1900 ] 3 15.000% 85.000% ### ( 1900, 2900 ] 1 5.000% 90.000% # ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 15.1 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 325.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.762 H:M:S, 11.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.393 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/19-14:21:16 ... thread 0: (1000000,6000000) ops and (299531.1,329423.4) ops/second in (3.338552,18.213645) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/17 3.93 GB 6.3 4.4 0.0 4.4 10.0 5.7 0.0 1.8 134.7 309.0 33.22 31.04 98 0.339 4541K 4865 0.0 0.0 L1 10/10 1.10 GB 0.0 1.5 1.5 0.0 1.5 1.5 0.2 1.0 229.6 228.7 6.59 6.36 2 3.297 1537K 5977 0.0 0.0 L2 1/0 52.22 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 255.1 255.0 1.48 1.43 2 0.741 383K 188 0.0 0.0 L3 19/0 893.67 MB 0.9 1.0 0.2 0.8 1.0 0.2 0.4 4.2 238.1 237.7 4.44 4.06 2 2.218 1072K 2092 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 145.5 145.5 1.55 1.13 1 1.546 228K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1270/27 101.78 GB 0.0 7.5 2.1 5.3 13.1 7.8 1.7 2.3 161.7 284.1 47.27 44.02 105 0.450 7763K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.5 2.1 5.3 13.1 7.8 1.5 2.3 161.7 284.1 47.27 44.02 105 0.450 7763K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.5 2.1 5.3 7.5 2.1 0.0 0.0 246.0 245.5 31.08 29.66 23 1.352 7763K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 358.0 16.19 14.36 82 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.5 total, 18.2 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.11 GB write, 727.26 MB/s write, 7.47 GB read, 414.10 MB/s read, 47.3 seconds Interval compaction: 13.11 GB write, 737.16 MB/s write, 7.47 GB read, 419.74 MB/s read, 47.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 17, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1591002 Average: 2.2637 StdDev: 12.84 Min: 0 Median: 1.5077 Max: 4491 Percentiles: P50: 1.51 P75: 1.89 P99: 5.60 P99.9: 11.26 P99.99: 110.22 ------------------------------------------------------ [ 0, 1 ] 264050 16.596% 16.596% ### ( 1, 2 ] 1046820 65.796% 82.393% ############# ( 2, 3 ] 189717 11.924% 94.317% ## ( 3, 4 ] 47908 3.011% 97.328% # ( 4, 6 ] 33253 2.090% 99.418% ( 6, 10 ] 7301 0.459% 99.877% ( 10, 15 ] 1435 0.090% 99.967% ( 15, 22 ] 166 0.010% 99.978% ( 22, 34 ] 17 0.001% 99.979% ( 34, 51 ] 20 0.001% 99.980% ( 51, 76 ] 24 0.002% 99.982% ( 76, 110 ] 132 0.008% 99.990% ( 110, 170 ] 244 0.015% 100.005% ( 170, 250 ] 97 0.006% 100.011% ( 250, 380 ] 53 0.003% 100.015% ( 380, 580 ] 58 0.004% 100.018% ( 580, 870 ] 32 0.002% 100.020% ( 870, 1300 ] 30 0.002% 100.022% ( 1300, 1900 ] 12 0.001% 100.023% ( 1900, 2900 ] 8 0.001% 100.024% ( 2900, 4400 ] 8 0.001% 100.024% ( 4400, 6600 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 3298 Average: 15.9327 StdDev: 97.11 Min: 0 Median: 1.4622 Max: 1843 Percentiles: P50: 1.46 P75: 1.87 P99: 413.56 P99.9: 1504.24 P99.99: 1843.00 ------------------------------------------------------ [ 0, 1 ] 713 21.619% 21.619% #### ( 1, 2 ] 2025 61.401% 83.020% ############ ( 2, 3 ] 278 8.429% 91.449% ## ( 3, 4 ] 53 1.607% 93.056% ( 4, 6 ] 32 0.970% 94.027% ( 6, 10 ] 38 1.152% 95.179% ( 10, 15 ] 3 0.091% 95.270% ( 15, 22 ] 1 0.030% 95.300% ( 76, 110 ] 30 0.910% 96.210% ( 110, 170 ] 53 1.607% 97.817% ( 170, 250 ] 27 0.819% 98.636% ( 250, 380 ] 9 0.273% 98.908% ( 380, 580 ] 18 0.546% 99.454% ( 580, 870 ] 8 0.243% 99.697% ( 870, 1300 ] 5 0.152% 99.848% ( 1300, 1900 ] 5 0.152% 100.000% ** Level 2 read latency histogram (micros): Count: 124220 Average: 2.6071 StdDev: 30.55 Min: 0 Median: 1.5235 Max: 8811 Percentiles: P50: 1.52 P75: 1.91 P99: 6.43 P99.9: 99.14 P99.99: 799.76 ------------------------------------------------------ [ 0, 1 ] 20435 16.451% 16.451% ### ( 1, 2 ] 79604 64.083% 80.534% ############# ( 2, 3 ] 15298 12.315% 92.849% ## ( 3, 4 ] 4318 3.476% 96.325% # ( 4, 6 ] 3209 2.583% 98.908% # ( 6, 10 ] 1062 0.855% 99.763% ( 10, 15 ] 133 0.107% 99.870% ( 15, 22 ] 9 0.007% 99.878% ( 22, 34 ] 2 0.002% 99.879% ( 34, 51 ] 3 0.002% 99.882% ( 51, 76 ] 1 0.001% 99.882% ( 76, 110 ] 32 0.026% 99.908% ( 110, 170 ] 36 0.029% 99.937% ( 170, 250 ] 30 0.024% 99.961% ( 250, 380 ] 15 0.012% 99.973% ( 380, 580 ] 13 0.010% 99.984% ( 580, 870 ] 10 0.008% 99.992% ( 870, 1300 ] 5 0.004% 99.996% ( 1300, 1900 ] 3 0.002% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 233058 Average: 3.8105 StdDev: 70.61 Min: 1 Median: 1.7025 Max: 10953 Percentiles: P50: 1.70 P75: 2.33 P99: 8.83 P99.9: 164.34 P99.99: 418.78 ------------------------------------------------------ [ 0, 1 ] 16484 7.073% 7.073% # ( 1, 2 ] 142418 61.108% 68.181% ############ ( 2, 3 ] 47569 20.411% 88.592% #### ( 3, 4 ] 11494 4.932% 93.524% # ( 4, 6 ] 9932 4.262% 97.786% # ( 6, 10 ] 3998 1.715% 99.501% ( 10, 15 ] 531 0.228% 99.729% ( 15, 22 ] 60 0.026% 99.755% ( 22, 34 ] 9 0.004% 99.758% ( 34, 51 ] 4 0.002% 99.760% ( 51, 76 ] 2 0.001% 99.761% ( 76, 110 ] 112 0.048% 99.809% ( 110, 170 ] 234 0.100% 99.909% ( 170, 250 ] 106 0.045% 99.955% ( 250, 380 ] 72 0.031% 99.986% ( 380, 580 ] 50 0.021% 100.007% ( 580, 870 ] 38 0.016% 100.024% ( 870, 1300 ] 17 0.007% 100.031% ( 1300, 1900 ] 11 0.005% 100.036% ( 2900, 4400 ] 7 0.003% 100.039% ( 4400, 6600 ] 2 0.001% 100.039% ( 6600, 9900 ] 6 0.003% 100.042% ( 9900, 14000 ] 5 0.002% 100.044% ** Level 4 read latency histogram (micros): Count: 320 Average: 371.7125 StdDev: 1603.62 Min: 1 Median: 1.9020 Max: 12703 Percentiles: P50: 1.90 P75: 6.40 P99: 10720.00 P99.9: 12703.00 P99.99: 12703.00 ------------------------------------------------------ [ 0, 1 ] 68 21.250% 21.250% #### ( 1, 2 ] 102 31.875% 53.125% ###### ( 2, 3 ] 44 13.750% 66.875% ### ( 3, 4 ] 11 3.438% 70.312% # ( 4, 6 ] 14 4.375% 74.688% # ( 6, 10 ] 10 3.125% 77.812% # ( 10, 15 ] 24 7.500% 85.312% ## ( 15, 22 ] 12 3.750% 89.062% # ( 22, 34 ] 1 0.312% 89.375% ( 110, 170 ] 2 0.625% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 3 0.938% 92.500% ( 870, 1300 ] 4 1.250% 93.750% ( 1300, 1900 ] 6 1.875% 95.625% ( 1900, 2900 ] 1 0.312% 95.938% ( 2900, 4400 ] 3 0.938% 96.875% ( 4400, 6600 ] 2 0.625% 97.500% ( 6600, 9900 ] 4 1.250% 98.750% ( 9900, 14000 ] 4 1.250% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1024.8000 StdDev: 1076.34 Min: 150 Median: 580.0000 Max: 3661 Percentiles: P50: 580.00 P75: 1500.00 P99: 3661.00 P99.9: 3661.00 P99.99: 3661.00 ------------------------------------------------------ ( 110, 170 ] 1 5.000% 5.000% # ( 170, 250 ] 3 15.000% 20.000% ### ( 250, 380 ] 5 25.000% 45.000% ##### ( 380, 580 ] 1 5.000% 50.000% # ( 580, 870 ] 2 10.000% 60.000% ## ( 870, 1300 ] 2 10.000% 70.000% ## ( 1300, 1900 ] 3 15.000% 85.000% ### ( 1900, 2900 ] 1 5.000% 90.000% # ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 18.5 total, 3.3 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 319.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.439 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 294.80 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.677 H:M:S, 20.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/19-14:21:45 ... thread 0: (1000000,7000000) ops and (34510.6,148335.7) ops/second in (28.976619,47.190264) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 4/4 1006.71 MB 0.0 5.3 0.0 5.3 11.9 6.6 0.0 1.8 132.8 297.9 40.79 37.28 114 0.358 5500K 6039 0.0 0.0 L1 0/0 0.00 KB 0.0 6.5 5.3 1.1 6.3 5.2 0.2 1.2 209.8 205.8 31.50 28.16 3 10.501 6711K 126K 0.0 0.0 L2 35/32 4.03 GB 3.8 1.1 0.9 0.2 1.1 0.9 4.6 1.3 212.7 212.2 5.27 4.84 3 1.756 436K 188 0.0 0.0 L3 21/9 1.30 GB 0.9 2.3 0.9 1.4 2.3 0.9 0.6 2.5 207.3 204.3 11.36 9.93 4 2.841 2393K 34K 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.7 1.0 145.5 145.5 1.55 1.13 1 1.546 228K 0 0.0 0.0 L5 1052/0 86.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1286/45 102.55 GB 0.0 15.4 7.3 8.0 21.8 13.8 6.8 3.3 173.9 246.5 90.47 81.34 125 0.724 15M 167K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.4 7.3 8.0 21.8 13.8 6.7 3.3 173.9 246.5 90.47 81.34 125 0.724 15M 167K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.4 7.3 8.0 15.2 7.2 0.0 0.0 222.1 219.7 70.82 64.48 30 2.361 15M 167K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 343.0 19.65 16.86 95 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.4 total, 47.2 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.78 GB write, 470.06 MB/s write, 15.36 GB read, 331.55 MB/s read, 90.5 seconds Interval compaction: 21.78 GB write, 472.53 MB/s write, 15.36 GB read, 333.29 MB/s read, 90.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 21, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2832898 Average: 3.1937 StdDev: 23.28 Min: 0 Median: 1.4718 Max: 7020 Percentiles: P50: 1.47 P75: 1.86 P99: 8.54 P99.9: 167.53 P99.99: 501.62 ------------------------------------------------------ [ 0, 1 ] 552922 19.518% 19.518% #### ( 1, 2 ] 1830101 64.602% 84.120% ############# ( 2, 3 ] 263490 9.301% 93.421% ## ( 3, 4 ] 83850 2.960% 96.381% # ( 4, 6 ] 64369 2.272% 98.653% ( 6, 10 ] 15495 0.547% 99.200% ( 10, 15 ] 3331 0.118% 99.317% ( 15, 22 ] 680 0.024% 99.341% ( 22, 34 ] 32 0.001% 99.342% ( 34, 51 ] 24 0.001% 99.343% ( 51, 76 ] 44 0.002% 99.345% ( 76, 110 ] 7087 0.250% 99.595% ( 110, 170 ] 9011 0.318% 99.913% ( 170, 250 ] 1001 0.035% 99.948% ( 250, 380 ] 780 0.028% 99.976% ( 380, 580 ] 654 0.023% 99.999% ( 580, 870 ] 271 0.010% 100.009% ( 870, 1300 ] 64 0.002% 100.011% ( 1300, 1900 ] 30 0.001% 100.012% ( 1900, 2900 ] 39 0.001% 100.013% ( 2900, 4400 ] 36 0.001% 100.015% ( 4400, 6600 ] 3 0.000% 100.015% ( 6600, 9900 ] 1 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 1055683 Average: 4.2250 StdDev: 37.99 Min: 0 Median: 1.8303 Max: 7784 Percentiles: P50: 1.83 P75: 2.74 P99: 9.27 P99.9: 100.14 P99.99: 132.40 ------------------------------------------------------ [ 0, 1 ] 92889 8.799% 8.799% ## ( 1, 2 ] 523826 49.620% 58.419% ########## ( 2, 3 ] 236830 22.434% 80.852% #### ( 3, 4 ] 86201 8.165% 89.018% ## ( 4, 6 ] 88019 8.338% 97.355% ## ( 6, 10 ] 21266 2.014% 99.370% ( 10, 15 ] 3783 0.358% 99.728% ( 15, 22 ] 638 0.060% 99.789% ( 22, 34 ] 25 0.002% 99.791% ( 34, 51 ] 9 0.001% 99.792% ( 51, 76 ] 6 0.001% 99.792% ( 76, 110 ] 1599 0.151% 99.944% ( 110, 170 ] 1303 0.123% 100.067% ( 170, 250 ] 435 0.041% 100.109% ( 250, 380 ] 457 0.043% 100.152% ( 380, 580 ] 483 0.046% 100.198% ( 580, 870 ] 360 0.034% 100.232% ( 870, 1300 ] 207 0.020% 100.251% ( 1300, 1900 ] 61 0.006% 100.257% ( 1900, 2900 ] 54 0.005% 100.262% ( 2900, 4400 ] 23 0.002% 100.264% ( 4400, 6600 ] 5 0.000% 100.265% ( 6600, 9900 ] 1 0.000% 100.265% ** Level 2 read latency histogram (micros): Count: 184873 Average: 3.3111 StdDev: 50.34 Min: 0 Median: 1.6877 Max: 8811 Percentiles: P50: 1.69 P75: 2.39 P99: 7.50 P99.9: 13.08 P99.99: 14.80 ------------------------------------------------------ [ 0, 1 ] 20598 11.142% 11.142% ## ( 1, 2 ] 104468 56.508% 67.650% ########### ( 2, 3 ] 34992 18.928% 86.577% #### ( 3, 4 ] 11395 6.164% 92.741% # ( 4, 6 ] 10756 5.818% 98.559% # ( 6, 10 ] 2182 1.180% 99.739% ( 10, 15 ] 485 0.262% 100.002% ( 15, 22 ] 35 0.019% 100.021% ( 22, 34 ] 5 0.003% 100.023% ( 34, 51 ] 3 0.002% 100.025% ( 51, 76 ] 3 0.002% 100.027% ( 76, 110 ] 32 0.017% 100.044% ( 110, 170 ] 39 0.021% 100.065% ( 170, 250 ] 32 0.017% 100.082% ( 250, 380 ] 24 0.013% 100.095% ( 380, 580 ] 16 0.009% 100.104% ( 580, 870 ] 12 0.006% 100.110% ( 870, 1300 ] 8 0.004% 100.115% ( 1300, 1900 ] 5 0.003% 100.117% ( 1900, 2900 ] 4 0.002% 100.120% ( 2900, 4400 ] 19 0.010% 100.130% ( 6600, 9900 ] 2 0.001% 100.131% ** Level 3 read latency histogram (micros): Count: 377492 Average: 5.7777 StdDev: 79.83 Min: 1 Median: 1.8387 Max: 10953 Percentiles: P50: 1.84 P75: 2.68 P99: 9.76 P99.9: 655.01 P99.99: 1463.40 ------------------------------------------------------ [ 0, 1 ] 17171 4.549% 4.549% # ( 1, 2 ] 204578 54.194% 58.743% ########### ( 2, 3 ] 90277 23.915% 82.658% ##### ( 3, 4 ] 27563 7.302% 89.959% # ( 4, 6 ] 26144 6.926% 96.885% # ( 6, 10 ] 8502 2.252% 99.137% ( 10, 15 ] 1271 0.337% 99.474% ( 15, 22 ] 171 0.045% 99.519% ( 22, 34 ] 11 0.003% 99.522% ( 34, 51 ] 5 0.001% 99.523% ( 51, 76 ] 2 0.001% 99.524% ( 76, 110 ] 129 0.034% 99.558% ( 110, 170 ] 343 0.091% 99.649% ( 170, 250 ] 252 0.067% 99.716% ( 250, 380 ] 299 0.079% 99.795% ( 380, 580 ] 330 0.087% 99.882% ( 580, 870 ] 261 0.069% 99.952% ( 870, 1300 ] 131 0.035% 99.986% ( 1300, 1900 ] 56 0.015% 100.001% ( 1900, 2900 ] 43 0.011% 100.012% ( 2900, 4400 ] 38 0.010% 100.023% ( 4400, 6600 ] 8 0.002% 100.025% ( 6600, 9900 ] 7 0.002% 100.026% ( 9900, 14000 ] 5 0.001% 100.028% ** Level 4 read latency histogram (micros): Count: 320 Average: 371.7125 StdDev: 1603.62 Min: 1 Median: 1.9020 Max: 12703 Percentiles: P50: 1.90 P75: 6.40 P99: 10720.00 P99.9: 12703.00 P99.99: 12703.00 ------------------------------------------------------ [ 0, 1 ] 68 21.250% 21.250% #### ( 1, 2 ] 102 31.875% 53.125% ###### ( 2, 3 ] 44 13.750% 66.875% ### ( 3, 4 ] 11 3.438% 70.312% # ( 4, 6 ] 14 4.375% 74.688% # ( 6, 10 ] 10 3.125% 77.812% # ( 10, 15 ] 24 7.500% 85.312% ## ( 15, 22 ] 12 3.750% 89.062% # ( 22, 34 ] 1 0.312% 89.375% ( 110, 170 ] 2 0.625% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 3 0.938% 92.500% ( 870, 1300 ] 4 1.250% 93.750% ( 1300, 1900 ] 6 1.875% 95.625% ( 1900, 2900 ] 1 0.312% 95.938% ( 2900, 4400 ] 3 0.938% 96.875% ( 4400, 6600 ] 2 0.625% 97.500% ( 6600, 9900 ] 4 1.250% 98.750% ( 9900, 14000 ] 4 1.250% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 1070.4750 StdDev: 1179.71 Min: 148 Median: 500.0000 Max: 4296 Percentiles: P50: 500.00 P75: 1540.00 P99: 4296.00 P99.9: 4296.00 P99.99: 4296.00 ------------------------------------------------------ ( 110, 170 ] 3 7.500% 7.500% ## ( 170, 250 ] 6 15.000% 22.500% ### ( 250, 380 ] 8 20.000% 42.500% #### ( 380, 580 ] 5 12.500% 55.000% ### ( 580, 870 ] 4 10.000% 65.000% ## ( 870, 1300 ] 2 5.000% 70.000% # ( 1300, 1900 ] 5 12.500% 82.500% ### ( 1900, 2900 ] 1 2.500% 85.000% # ( 2900, 4400 ] 6 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 47.4 total, 29.0 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 145.22 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.760 H:M:S, 58.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 33.96 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:25.321 H:M:S, 87.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/19-14:21:49 ... thread 0: (1000000,8000000) ops and (252337.5,156392.9) ops/second in (3.962947,51.153211) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.97 GB 100.7 5.8 0.0 5.8 13.4 7.6 0.0 1.8 127.5 292.4 46.94 42.21 129 0.364 6076K 6651 0.0 0.0 L1 0/0 0.00 KB 0.0 6.5 5.3 1.1 6.3 5.2 0.2 1.2 209.8 205.8 31.50 28.16 3 10.501 6711K 126K 0.0 0.0 L2 28/25 3.51 GB 3.8 1.1 0.9 0.2 1.1 0.9 4.6 1.3 212.7 212.2 5.27 4.84 3 1.756 436K 188 0.0 0.0 L3 19/2 1.18 GB 1.0 3.0 1.4 1.5 2.9 1.4 0.6 2.0 182.0 179.9 16.69 13.14 11 1.517 3085K 36K 0.0 0.0 L4 171/0 9.40 GB 1.0 0.8 0.8 0.0 0.8 0.8 0.7 1.0 131.3 131.1 6.36 4.05 8 0.795 820K 0 0.0 0.0 L5 1064/0 87.48 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1293/31 103.53 GB 0.0 17.2 8.4 8.7 24.6 15.8 7.9 3.2 164.7 235.7 106.76 92.40 154 0.693 17M 169K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.2 8.4 8.7 24.6 15.8 7.8 3.2 164.7 235.7 106.76 92.40 154 0.693 17M 169K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.2 8.4 8.7 17.0 8.3 0.0 0.0 211.2 209.1 83.26 72.86 46 1.810 17M 169K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 329.8 23.49 19.54 108 0.218 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 51.4 total, 51.2 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.57 GB write, 489.51 MB/s write, 17.17 GB read, 342.14 MB/s read, 106.8 seconds Interval compaction: 24.57 GB write, 491.88 MB/s write, 17.17 GB read, 343.80 MB/s read, 106.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 31, interval: 47 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3175378 Average: 3.2103 StdDev: 24.25 Min: 0 Median: 1.5094 Max: 7020 Percentiles: P50: 1.51 P75: 1.90 P99: 8.60 P99.9: 166.01 P99.99: 489.01 ------------------------------------------------------ [ 0, 1 ] 560733 17.659% 17.659% #### ( 1, 2 ] 2016038 63.490% 81.148% ############# ( 2, 3 ] 353343 11.128% 92.276% ## ( 3, 4 ] 109194 3.439% 95.715% # ( 4, 6 ] 90179 2.840% 98.555% # ( 6, 10 ] 21740 0.685% 99.239% ( 10, 15 ] 4473 0.141% 99.380% ( 15, 22 ] 820 0.026% 99.406% ( 22, 34 ] 43 0.001% 99.407% ( 34, 51 ] 24 0.001% 99.408% ( 51, 76 ] 45 0.001% 99.410% ( 76, 110 ] 7109 0.224% 99.634% ( 110, 170 ] 9065 0.285% 99.919% ( 170, 250 ] 1042 0.033% 99.952% ( 250, 380 ] 833 0.026% 99.978% ( 380, 580 ] 698 0.022% 100.000% ( 580, 870 ] 314 0.010% 100.010% ( 870, 1300 ] 88 0.003% 100.013% ( 1300, 1900 ] 45 0.001% 100.014% ( 1900, 2900 ] 46 0.001% 100.016% ( 2900, 4400 ] 45 0.001% 100.017% ( 4400, 6600 ] 4 0.000% 100.017% ( 6600, 9900 ] 2 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 1424732 Average: 4.4686 StdDev: 50.03 Min: 0 Median: 1.8678 Max: 9286 Percentiles: P50: 1.87 P75: 2.76 P99: 9.31 P99.9: 108.10 P99.99: 159.17 ------------------------------------------------------ [ 0, 1 ] 95754 6.721% 6.721% # ( 1, 2 ] 710581 49.875% 56.596% ########## ( 2, 3 ] 345198 24.229% 80.825% ##### ( 3, 4 ] 115463 8.104% 88.929% ## ( 4, 6 ] 118271 8.301% 97.230% ## ( 6, 10 ] 30442 2.137% 99.367% ( 10, 15 ] 5197 0.365% 99.731% ( 15, 22 ] 817 0.057% 99.789% ( 22, 34 ] 31 0.002% 99.791% ( 34, 51 ] 12 0.001% 99.792% ( 51, 76 ] 10 0.001% 99.793% ( 76, 110 ] 1623 0.114% 99.906% ( 110, 170 ] 1454 0.102% 100.008% ( 170, 250 ] 570 0.040% 100.049% ( 250, 380 ] 619 0.043% 100.092% ( 380, 580 ] 648 0.045% 100.137% ( 580, 870 ] 509 0.036% 100.173% ( 870, 1300 ] 286 0.020% 100.193% ( 1300, 1900 ] 107 0.008% 100.201% ( 1900, 2900 ] 98 0.007% 100.208% ( 2900, 4400 ] 69 0.005% 100.212% ( 4400, 6600 ] 15 0.001% 100.214% ( 6600, 9900 ] 12 0.001% 100.214% ** Level 2 read latency histogram (micros): Count: 257565 Average: 3.4826 StdDev: 49.89 Min: 0 Median: 1.8084 Max: 8811 Percentiles: P50: 1.81 P75: 2.67 P99: 7.80 P99.9: 12.19 P99.99: 13.63 ------------------------------------------------------ [ 0, 1 ] 20788 8.071% 8.071% ## ( 1, 2 ] 133584 51.864% 59.935% ########## ( 2, 3 ] 58167 22.583% 82.519% ##### ( 3, 4 ] 20144 7.821% 90.340% ## ( 4, 6 ] 20696 8.035% 98.375% ## ( 6, 10 ] 3576 1.388% 99.763% ( 10, 15 ] 805 0.313% 100.076% ( 15, 22 ] 66 0.026% 100.101% ( 22, 34 ] 5 0.002% 100.103% ( 34, 51 ] 4 0.002% 100.105% ( 51, 76 ] 3 0.001% 100.106% ( 76, 110 ] 32 0.012% 100.118% ( 110, 170 ] 41 0.016% 100.134% ( 170, 250 ] 33 0.013% 100.147% ( 250, 380 ] 25 0.010% 100.157% ( 380, 580 ] 18 0.007% 100.164% ( 580, 870 ] 13 0.005% 100.169% ( 870, 1300 ] 12 0.005% 100.174% ( 1300, 1900 ] 5 0.002% 100.175% ( 1900, 2900 ] 10 0.004% 100.179% ( 2900, 4400 ] 27 0.010% 100.190% ( 4400, 6600 ] 1 0.000% 100.190% ( 6600, 9900 ] 2 0.001% 100.191% ** Level 3 read latency histogram (micros): Count: 557992 Average: 6.6155 StdDev: 96.86 Min: 1 Median: 1.9291 Max: 13354 Percentiles: P50: 1.93 P75: 2.81 P99: 9.72 P99.9: 490.71 P99.99: 802.00 ------------------------------------------------------ [ 0, 1 ] 17925 3.212% 3.212% # ( 1, 2 ] 280990 50.357% 53.570% ########## ( 2, 3 ] 147018 26.348% 79.917% ##### ( 3, 4 ] 46999 8.423% 88.340% ## ( 4, 6 ] 46986 8.421% 96.761% ## ( 6, 10 ] 13442 2.409% 99.170% ( 10, 15 ] 2354 0.422% 99.592% ( 15, 22 ] 300 0.054% 99.646% ( 22, 34 ] 17 0.003% 99.649% ( 34, 51 ] 10 0.002% 99.650% ( 51, 76 ] 2 0.000% 99.651% ( 76, 110 ] 136 0.024% 99.675% ( 110, 170 ] 360 0.065% 99.740% ( 170, 250 ] 294 0.053% 99.792% ( 250, 380 ] 358 0.064% 99.856% ( 380, 580 ] 439 0.079% 99.935% ( 580, 870 ] 400 0.072% 100.007% ( 870, 1300 ] 228 0.041% 100.048% ( 1300, 1900 ] 129 0.023% 100.071% ( 1900, 2900 ] 108 0.019% 100.090% ( 2900, 4400 ] 107 0.019% 100.109% ( 4400, 6600 ] 21 0.004% 100.113% ( 6600, 9900 ] 15 0.003% 100.116% ( 9900, 14000 ] 8 0.001% 100.117% ** Level 4 read latency histogram (micros): Count: 7369 Average: 85.6723 StdDev: 482.50 Min: 0 Median: 2.1233 Max: 12703 Percentiles: P50: 2.12 P75: 3.20 P99: 1908.16 P99.9: 5541.17 P99.99: 9292.06 ------------------------------------------------------ [ 0, 1 ] 174 2.361% 2.361% ( 1, 2 ] 3274 44.429% 46.791% ######### ( 2, 3 ] 1918 26.028% 72.819% ##### ( 3, 4 ] 785 10.653% 83.471% ## ( 4, 6 ] 481 6.527% 89.999% # ( 6, 10 ] 164 2.226% 92.224% ( 10, 15 ] 49 0.665% 92.889% ( 15, 22 ] 18 0.244% 93.133% ( 22, 34 ] 3 0.041% 93.174% ( 34, 51 ] 1 0.014% 93.188% ( 51, 76 ] 2 0.027% 93.215% ( 76, 110 ] 3 0.041% 93.256% ( 110, 170 ] 8 0.109% 93.364% ( 170, 250 ] 26 0.353% 93.717% ( 250, 380 ] 50 0.679% 94.395% ( 380, 580 ] 81 1.099% 95.495% ( 580, 870 ] 109 1.479% 96.974% ( 870, 1300 ] 96 1.303% 98.277% ( 1300, 1900 ] 53 0.719% 98.996% ( 1900, 2900 ] 38 0.516% 99.511% ( 2900, 4400 ] 25 0.339% 99.851% ( 4400, 6600 ] 7 0.095% 99.946% ( 6600, 9900 ] 4 0.054% 100.000% ( 9900, 14000 ] 4 0.054% 100.054% ** Level 5 read latency histogram (micros): Count: 100 Average: 1429.3100 StdDev: 1479.85 Min: 133 Median: 812.0000 Max: 6150 Percentiles: P50: 812.00 P75: 2150.00 P99: 6150.00 P99.9: 6150.00 P99.99: 6150.00 ------------------------------------------------------ ( 110, 170 ] 8 8.000% 8.000% ## ( 170, 250 ] 8 8.000% 16.000% ## ( 250, 380 ] 15 15.000% 31.000% ### ( 380, 580 ] 11 11.000% 42.000% ## ( 580, 870 ] 10 10.000% 52.000% ## ( 870, 1300 ] 12 12.000% 64.000% ## ( 1300, 1900 ] 9 9.000% 73.000% ## ( 1900, 2900 ] 8 8.000% 81.000% ## ( 2900, 4400 ] 13 13.000% 94.000% ### ( 4400, 6600 ] 6 6.000% 100.000% # ** DB Stats ** Uptime(secs): 51.4 total, 4.0 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 153.17 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.886 H:M:S, 56.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 248.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.126 H:M:S, 28.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/19-14:21:55 ... thread 0: (1000000,9000000) ops and (166223.7,157427.4) ops/second in (6.015990,57.169201) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 1.97 GB 37.7 6.5 0.0 6.5 15.0 8.5 0.0 1.8 120.2 279.1 55.04 47.46 142 0.388 6716K 7440 0.0 0.0 L1 18/18 1002.90 MB 0.0 7.4 6.3 1.1 7.3 6.2 0.2 1.2 207.0 203.5 36.79 32.69 4 9.196 7733K 129K 0.0 0.0 L2 1/1 128.78 MB 0.0 1.1 0.9 0.2 1.1 0.9 4.6 1.3 212.7 212.2 5.27 4.84 3 1.756 436K 188 0.0 0.0 L3 18/3 1.03 GB 0.9 6.8 4.8 2.0 6.7 4.8 0.6 1.4 178.7 177.4 38.81 30.92 15 2.587 5820K 43K 0.0 0.0 L4 176/0 9.65 GB 1.0 4.4 4.2 0.2 4.4 4.2 0.9 1.0 120.2 119.9 37.14 21.38 50 0.743 4338K 4332 0.0 0.0 L5 1104/0 90.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1329/33 104.49 GB 0.0 26.1 16.2 9.9 34.5 24.5 11.3 4.0 154.6 204.0 173.04 137.29 214 0.809 25M 185K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.1 16.2 9.9 34.5 24.5 11.2 4.0 154.6 204.0 173.04 137.29 214 0.809 25M 185K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.1 16.2 9.9 25.9 16.0 0.0 0.0 185.2 183.8 144.46 115.04 95 1.521 25M 185K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 306.4 28.57 22.25 119 0.240 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.4 total, 57.2 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.48 GB write, 614.90 MB/s write, 26.12 GB read, 465.89 MB/s read, 173.0 seconds Interval compaction: 34.48 GB write, 617.57 MB/s write, 26.12 GB read, 467.91 MB/s read, 173.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 59, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 59, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3480493 Average: 3.4793 StdDev: 32.60 Min: 0 Median: 1.5403 Max: 8055 Percentiles: P50: 1.54 P75: 1.94 P99: 8.82 P99.9: 176.54 P99.99: 669.37 ------------------------------------------------------ [ 0, 1 ] 567789 16.313% 16.313% ### ( 1, 2 ] 2169991 62.347% 78.661% ############ ( 2, 3 ] 436132 12.531% 91.191% ### ( 3, 4 ] 134568 3.866% 95.058% # ( 4, 6 ] 117283 3.370% 98.428% # ( 6, 10 ] 28219 0.811% 99.238% ( 10, 15 ] 5456 0.157% 99.395% ( 15, 22 ] 924 0.027% 99.422% ( 22, 34 ] 50 0.001% 99.423% ( 34, 51 ] 27 0.001% 99.424% ( 51, 76 ] 57 0.002% 99.425% ( 76, 110 ] 7171 0.206% 99.631% ( 110, 170 ] 9248 0.266% 99.897% ( 170, 250 ] 1205 0.035% 99.932% ( 250, 380 ] 991 0.028% 99.960% ( 380, 580 ] 871 0.025% 99.985% ( 580, 870 ] 532 0.015% 100.001% ( 870, 1300 ] 269 0.008% 100.008% ( 1300, 1900 ] 144 0.004% 100.012% ( 1900, 2900 ] 97 0.003% 100.015% ( 2900, 4400 ] 94 0.003% 100.018% ( 4400, 6600 ] 11 0.000% 100.018% ( 6600, 9900 ] 4 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 1707404 Average: 4.9725 StdDev: 66.78 Min: 0 Median: 1.8850 Max: 14628 Percentiles: P50: 1.89 P75: 2.77 P99: 9.39 P99.9: 133.62 P99.99: 233.46 ------------------------------------------------------ [ 0, 1 ] 100073 5.861% 5.861% # ( 1, 2 ] 851556 49.874% 55.735% ########## ( 2, 3 ] 426016 24.951% 80.687% ##### ( 3, 4 ] 138088 8.088% 88.774% ## ( 4, 6 ] 142778 8.362% 97.136% ## ( 6, 10 ] 37513 2.197% 99.333% ( 10, 15 ] 6353 0.372% 99.706% ( 15, 22 ] 953 0.056% 99.761% ( 22, 34 ] 35 0.002% 99.763% ( 34, 51 ] 14 0.001% 99.764% ( 51, 76 ] 11 0.001% 99.765% ( 76, 110 ] 1673 0.098% 99.863% ( 110, 170 ] 1612 0.094% 99.957% ( 170, 250 ] 705 0.041% 99.999% ( 250, 380 ] 730 0.043% 100.041% ( 380, 580 ] 814 0.048% 100.089% ( 580, 870 ] 660 0.039% 100.128% ( 870, 1300 ] 430 0.025% 100.153% ( 1300, 1900 ] 188 0.011% 100.164% ( 1900, 2900 ] 175 0.010% 100.174% ( 2900, 4400 ] 144 0.008% 100.183% ( 4400, 6600 ] 44 0.003% 100.185% ( 6600, 9900 ] 27 0.002% 100.187% ( 9900, 14000 ] 1 0.000% 100.187% ( 14000, 22000 ] 1 0.000% 100.187% ** Level 2 read latency histogram (micros): Count: 257565 Average: 3.4826 StdDev: 49.89 Min: 0 Median: 1.8084 Max: 8811 Percentiles: P50: 1.81 P75: 2.67 P99: 7.80 P99.9: 12.19 P99.99: 13.63 ------------------------------------------------------ [ 0, 1 ] 20788 8.071% 8.071% ## ( 1, 2 ] 133584 51.864% 59.935% ########## ( 2, 3 ] 58167 22.583% 82.519% ##### ( 3, 4 ] 20144 7.821% 90.340% ## ( 4, 6 ] 20696 8.035% 98.375% ## ( 6, 10 ] 3576 1.388% 99.763% ( 10, 15 ] 805 0.313% 100.076% ( 15, 22 ] 66 0.026% 100.101% ( 22, 34 ] 5 0.002% 100.103% ( 34, 51 ] 4 0.002% 100.105% ( 51, 76 ] 3 0.001% 100.106% ( 76, 110 ] 32 0.012% 100.118% ( 110, 170 ] 41 0.016% 100.134% ( 170, 250 ] 33 0.013% 100.147% ( 250, 380 ] 25 0.010% 100.157% ( 380, 580 ] 18 0.007% 100.164% ( 580, 870 ] 13 0.005% 100.169% ( 870, 1300 ] 12 0.005% 100.174% ( 1300, 1900 ] 5 0.002% 100.175% ( 1900, 2900 ] 10 0.004% 100.179% ( 2900, 4400 ] 27 0.010% 100.190% ( 4400, 6600 ] 1 0.000% 100.190% ( 6600, 9900 ] 2 0.001% 100.191% ** Level 3 read latency histogram (micros): Count: 1492952 Average: 8.2565 StdDev: 117.07 Min: 1 Median: 2.1269 Max: 13354 Percentiles: P50: 2.13 P75: 2.97 P99: 9.59 P99.9: 128.99 P99.99: 335.46 ------------------------------------------------------ [ 0, 1 ] 21537 1.443% 1.443% ( 1, 2 ] 668747 44.794% 46.236% ######### ( 2, 3 ] 442694 29.652% 75.888% ###### ( 3, 4 ] 151050 10.118% 86.006% ## ( 4, 6 ] 160219 10.732% 96.738% ## ( 6, 10 ] 37635 2.521% 99.259% # ( 10, 15 ] 8159 0.547% 99.805% ( 15, 22 ] 979 0.066% 99.871% ( 22, 34 ] 72 0.005% 99.875% ( 34, 51 ] 32 0.002% 99.878% ( 51, 76 ] 17 0.001% 99.879% ( 76, 110 ] 163 0.011% 99.890% ( 110, 170 ] 490 0.033% 99.922% ( 170, 250 ] 494 0.033% 99.956% ( 250, 380 ] 783 0.052% 100.008% ( 380, 580 ] 1119 0.075% 100.083% ( 580, 870 ] 1248 0.084% 100.167% ( 870, 1300 ] 902 0.060% 100.227% ( 1300, 1900 ] 557 0.037% 100.264% ( 1900, 2900 ] 527 0.035% 100.300% ( 2900, 4400 ] 506 0.034% 100.333% ( 4400, 6600 ] 115 0.008% 100.341% ( 6600, 9900 ] 52 0.003% 100.345% ( 9900, 14000 ] 14 0.001% 100.346% ** Level 4 read latency histogram (micros): Count: 49274 Average: 81.7908 StdDev: 419.65 Min: 0 Median: 2.2389 Max: 12703 Percentiles: P50: 2.24 P75: 3.31 P99: 1898.81 P99.9: 5056.46 P99.99: 8193.58 ------------------------------------------------------ [ 0, 1 ] 675 1.370% 1.370% ( 1, 2 ] 20643 41.894% 43.264% ######## ( 2, 3 ] 13895 28.199% 71.464% ###### ( 3, 4 ] 5571 11.306% 82.770% ## ( 4, 6 ] 3692 7.493% 90.263% # ( 6, 10 ] 1124 2.281% 92.544% ( 10, 15 ] 263 0.534% 93.077% ( 15, 22 ] 67 0.136% 93.213% ( 22, 34 ] 12 0.024% 93.238% ( 34, 51 ] 16 0.032% 93.270% ( 51, 76 ] 15 0.030% 93.301% ( 76, 110 ] 15 0.030% 93.331% ( 110, 170 ] 52 0.106% 93.437% ( 170, 250 ] 139 0.282% 93.719% ( 250, 380 ] 287 0.582% 94.301% ( 380, 580 ] 530 1.076% 95.377% ( 580, 870 ] 736 1.494% 96.871% ( 870, 1300 ] 676 1.372% 98.242% ( 1300, 1900 ] 374 0.759% 99.002% ( 1900, 2900 ] 253 0.513% 99.515% ( 2900, 4400 ] 176 0.357% 99.872% ( 4400, 6600 ] 46 0.093% 99.965% ( 6600, 9900 ] 25 0.051% 100.016% ( 9900, 14000 ] 4 0.008% 100.024% ** Level 5 read latency histogram (micros): Count: 300 Average: 1740.4933 StdDev: 1656.42 Min: 97 Median: 983.8235 Max: 6498 Percentiles: P50: 983.82 P75: 3069.81 P99: 6364.29 P99.9: 6498.00 P99.99: 6498.00 ------------------------------------------------------ ( 76, 110 ] 2 0.667% 0.667% ( 110, 170 ] 13 4.333% 5.000% # ( 170, 250 ] 16 5.333% 10.333% # ( 250, 380 ] 40 13.333% 23.667% ### ( 380, 580 ] 30 10.000% 33.667% ## ( 580, 870 ] 40 13.333% 47.000% ### ( 870, 1300 ] 34 11.333% 58.333% ## ( 1300, 1900 ] 18 6.000% 64.333% # ( 1900, 2900 ] 26 8.667% 73.000% ## ( 2900, 4400 ] 53 17.667% 90.667% #### ( 4400, 6600 ] 28 9.333% 100.000% ## ** DB Stats ** Uptime(secs): 57.4 total, 6.0 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 154.26 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:32.004 H:M:S, 55.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 163.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.118 H:M:S, 51.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.047 micros/op 165378 ops/sec 60.002 seconds 9922999 operations; 160.2 MB/s Microseconds per write: Count: 9922999 Average: 6.0468 StdDev: 529.81 Min: 0 Median: 1.7470 Max: 808456 Percentiles: P50: 1.75 P75: 2.76 P99: 9.21 P99.9: 1195.01 P99.99: 2786.49 ------------------------------------------------------ [ 0, 1 ] 1324698 13.350% 13.350% ### ( 1, 2 ] 4868656 49.064% 62.414% ########## ( 2, 3 ] 1634372 16.471% 78.885% ### ( 3, 4 ] 1360301 13.709% 92.593% ### ( 4, 6 ] 542747 5.470% 98.063% # ( 6, 10 ] 115815 1.167% 99.230% ( 10, 15 ] 38855 0.392% 99.622% ( 15, 22 ] 9231 0.093% 99.715% ( 22, 34 ] 1679 0.017% 99.731% ( 34, 51 ] 205 0.002% 99.734% ( 51, 76 ] 29 0.000% 99.734% ( 76, 110 ] 6773 0.068% 99.802% ( 110, 170 ] 2793 0.028% 99.830% ( 170, 250 ] 298 0.003% 99.833% ( 250, 380 ] 178 0.002% 99.835% ( 380, 580 ] 38 0.000% 99.835% ( 580, 870 ] 34 0.000% 99.836% ( 870, 1300 ] 8433 0.085% 99.921% ( 1300, 1900 ] 28 0.000% 99.921% ( 1900, 2900 ] 7720 0.078% 99.999% ( 2900, 4400 ] 69 0.001% 100.000% ( 4400, 6600 ] 14 0.000% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 4 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 15 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 4 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 213373 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9922999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10240534968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 588 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32402674 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30671336053 rocksdb.compact.write.bytes COUNT : 30454058514 rocksdb.flush.write.bytes COUNT : 10106435255 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 74 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 244 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10025295872 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4214784 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30773644529 rocksdb.non.last.level.read.count COUNT : 7431718 rocksdb.block.checksum.compute.count COUNT : 7430616 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.401570 P95 : 3.921144 P99 : 7.719947 P100 : 808455.000000 COUNT : 9922999 SUM : 55391409 rocksdb.compaction.times.micros P50 : 819400.000000 P95 : 4300000.000000 P99 : 14000000.000000 P100 : 24908516.000000 COUNT : 100 SUM : 149231685 rocksdb.compaction.times.cpu_micros P50 : 543793.103448 P95 : 4300000.000000 P99 : 9800000.000000 P100 : 21793403.000000 COUNT : 100 SUM : 119367437 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 698.416667 P95 : 17600.000000 P99 : 143800.000000 P100 : 144282.000000 COUNT : 131 SUM : 702805 rocksdb.compaction.outfile.sync.micros P50 : 1264.166667 P95 : 75700.000000 P99 : 122720.000000 P100 : 145721.000000 COUNT : 394 SUM : 5077158 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 143.750000 P95 : 2395.000000 P99 : 4247.500000 P100 : 5677.000000 COUNT : 261 SUM : 132498 rocksdb.table.open.io.micros P50 : 1685.263158 P95 : 11858.888889 P99 : 20275.555556 P100 : 23084.000000 COUNT : 588 SUM : 1726129 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.806584 P95 : 8.534552 P99 : 13.609869 P100 : 14635.000000 COUNT : 7429070 SUM : 54682230 rocksdb.read.block.get.micros P50 : 593.809524 P95 : 4412.222222 P99 : 9249.428571 P100 : 12997.000000 COUNT : 1176 SUM : 1398656 rocksdb.write.raw.block.micros P50 : 0.515714 P95 : 0.979856 P99 : 2.974981 P100 : 18857.000000 COUNT : 9832853 SUM : 21708521 rocksdb.numfiles.in.singlecompaction P50 : 1.953125 P95 : 7.600000 P99 : 25.360000 P100 : 27.000000 COUNT : 144 SUM : 501 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.567005 P95 : 2013.638726 P99 : 2728.965562 P100 : 808267.000000 COUNT : 137611 SUM : 32418807 rocksdb.sst.read.micros P50 : 1.723210 P95 : 5.168759 P99 : 9.651873 P100 : 14628.000000 COUNT : 7432179 SUM : 39748593 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9922999 SUM : 10240534968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 215500.000000 P95 : 496375.000000 P99 : 784020.000000 P100 : 855582.000000 COUNT : 131 SUM : 31141522 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 352 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0