[2024-07-15 21:18:48.896485] Starting SPDK v24.09-pre git sha1 a95bbf233 / DPDK 23.11.0 initialization... [2024-07-15 21:18:48.896766] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1973768 ] Set seed to 1721071128890117 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-15 21:18:49.001835] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-15 21:18:49.043192] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-15 21:18:49.043244] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1973768' to capture a snapshot of events at runtime. [2024-07-15 21:18:49.043254] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-15 21:18:49.043284] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-15 21:18:49.043292] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1973768 for offline analysis/debug. [2024-07-15 21:18:49.043381] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 15 21:18:53 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/15-21:18:56 ... thread 0: (1000000,1000000) ops and (340724.9,340724.9) ops/second in (2.934919,2.934919) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 629.95 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 354.9 2.48 2.26 12 0.207 0 0 0.0 0.0 L2 3/2 251.72 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 249.4 249.2 1.52 1.46 2 0.758 383K 233 0.0 0.0 L3 12/0 993.30 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1180/8 97.00 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.4 94.5 314.9 4.00 3.72 14 0.286 383K 233 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.1 1.4 94.5 314.9 4.00 3.72 14 0.286 383K 233 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 249.4 249.2 1.52 1.46 2 0.758 383K 233 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 354.9 2.48 2.26 12 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 402.37 MB/s write, 0.37 GB read, 120.72 MB/s read, 4.0 seconds Interval compaction: 1.23 GB write, 428.97 MB/s write, 0.37 GB read, 128.71 MB/s read, 4.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 111326 Average: 1.8809 StdDev: 14.34 Min: 1 Median: 1.2384 Max: 3141 Percentiles: P50: 1.24 P75: 1.67 P99: 3.86 P99.9: 10.37 P99.99: 324.55 ------------------------------------------------------ [ 0, 1 ] 40293 36.194% 36.194% ####### ( 1, 2 ] 64482 57.922% 94.115% ############ ( 2, 3 ] 4206 3.778% 97.894% # ( 3, 4 ] 1433 1.287% 99.181% ( 4, 6 ] 593 0.533% 99.713% ( 6, 10 ] 203 0.182% 99.896% ( 10, 15 ] 77 0.069% 99.965% ( 15, 22 ] 11 0.010% 99.975% ( 22, 34 ] 2 0.002% 99.977% ( 34, 51 ] 2 0.002% 99.978% ( 51, 76 ] 1 0.001% 99.979% ( 110, 170 ] 8 0.007% 99.987% ( 170, 250 ] 2 0.002% 99.988% ( 250, 380 ] 5 0.004% 99.993% ( 580, 870 ] 2 0.002% 99.995% ( 870, 1300 ] 4 0.004% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 60426 Average: 2.0157 StdDev: 15.12 Min: 1 Median: 1.2913 Max: 1770 Percentiles: P50: 1.29 P75: 1.71 P99: 4.61 P99.9: 9.67 P99.99: 809.53 ------------------------------------------------------ [ 0, 1 ] 19585 32.412% 32.412% ###### ( 1, 2 ] 36483 60.376% 92.788% ############ ( 2, 3 ] 2574 4.260% 97.048% # ( 3, 4 ] 1023 1.693% 98.741% ( 4, 6 ] 515 0.852% 99.593% ( 6, 10 ] 202 0.334% 99.927% ( 10, 15 ] 23 0.038% 99.965% ( 15, 22 ] 5 0.008% 99.974% ( 250, 380 ] 5 0.008% 99.982% ( 380, 580 ] 1 0.002% 99.983% ( 580, 870 ] 5 0.008% 99.992% ( 870, 1300 ] 2 0.003% 99.995% ( 1300, 1900 ] 3 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 50 Average: 1568.9200 StdDev: 1133.36 Min: 47 Median: 1156.6667 Max: 4708 Percentiles: P50: 1156.67 P75: 2337.50 P99: 4708.00 P99.9: 4708.00 P99.99: 4708.00 ------------------------------------------------------ ( 34, 51 ] 1 2.000% 2.000% ( 250, 380 ] 3 6.000% 8.000% # ( 380, 580 ] 4 8.000% 16.000% ## ( 580, 870 ] 9 18.000% 34.000% #### ( 870, 1300 ] 12 24.000% 58.000% ##### ( 1300, 1900 ] 5 10.000% 68.000% ## ( 1900, 2900 ] 8 16.000% 84.000% ### ( 2900, 4400 ] 6 12.000% 96.000% ## ( 4400, 6600 ] 2 4.000% 100.000% # ** Level 4 read latency histogram (micros): Count: 20 Average: 1701.0000 StdDev: 1066.85 Min: 309 Median: 1238.5714 Max: 4402 Percentiles: P50: 1238.57 P75: 2566.67 P99: 4402.00 P99.9: 4402.00 P99.99: 4402.00 ------------------------------------------------------ ( 250, 380 ] 1 5.000% 5.000% # ( 580, 870 ] 3 15.000% 20.000% ### ( 870, 1300 ] 7 35.000% 55.000% ####### ( 1300, 1900 ] 2 10.000% 65.000% ## ( 1900, 2900 ] 3 15.000% 80.000% ### ( 2900, 4400 ] 3 15.000% 95.000% ### ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 314.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.416 H:M:S, 13.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 335.08 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.416 H:M:S, 14.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-21:18:59 ... thread 0: (1000000,2000000) ops and (324390.6,332357.2) ops/second in (3.082703,6.017622) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 1.17 GB 88.1 0.9 0.0 0.9 2.6 1.8 0.0 1.5 102.4 314.4 8.61 7.99 28 0.308 895K 896 0.0 0.0 L1 1/0 3.84 MB 0.4 0.4 0.4 0.0 0.4 0.4 0.2 1.0 241.6 241.2 1.56 1.52 1 1.564 383K 592 0.0 0.0 L2 2/1 53.84 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 249.4 249.2 1.52 1.46 2 0.758 383K 233 0.0 0.0 L3 18/8 962.75 MB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 231.3 231.3 1.08 1.01 1 1.077 252K 0 0.0 0.0 L4 169/0 9.51 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 144.6 144.6 1.55 1.13 1 1.550 227K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1245/13 97.92 GB 0.0 2.1 1.0 1.0 3.8 2.8 2.1 2.2 147.4 274.9 14.32 13.10 33 0.434 2143K 1721 0.0 0.0 Int 0/0 0.00 KB 0.0 2.1 1.0 1.0 3.8 2.8 2.0 2.2 147.4 274.9 14.32 13.10 33 0.434 2143K 1721 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.1 1.0 1.0 2.1 1.0 0.0 0.0 232.1 231.9 9.10 8.44 8 1.137 2143K 1721 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 349.7 5.22 4.66 25 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.84 GB write, 633.51 MB/s write, 2.06 GB read, 339.77 MB/s read, 14.3 seconds Interval compaction: 3.84 GB write, 653.94 MB/s write, 2.06 GB read, 350.73 MB/s read, 14.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 397308 Average: 2.2086 StdDev: 10.70 Min: 1 Median: 1.4901 Max: 3141 Percentiles: P50: 1.49 P75: 1.88 P99: 5.72 P99.9: 11.19 P99.99: 14.94 ------------------------------------------------------ [ 0, 1 ] 73178 18.418% 18.418% #### ( 1, 2 ] 256040 64.444% 82.862% ############# ( 2, 3 ] 40558 10.208% 93.070% ## ( 3, 4 ] 15009 3.778% 96.848% # ( 4, 6 ] 9950 2.504% 99.352% # ( 6, 10 ] 2063 0.519% 99.872% ( 10, 15 ] 477 0.120% 99.992% ( 15, 22 ] 43 0.011% 100.003% ( 22, 34 ] 10 0.003% 100.005% ( 34, 51 ] 4 0.001% 100.006% ( 51, 76 ] 2 0.001% 100.007% ( 110, 170 ] 12 0.003% 100.010% ( 170, 250 ] 10 0.003% 100.012% ( 250, 380 ] 9 0.002% 100.014% ( 380, 580 ] 4 0.001% 100.015% ( 580, 870 ] 6 0.002% 100.017% ( 870, 1300 ] 11 0.003% 100.020% ( 1300, 1900 ] 2 0.001% 100.020% ( 1900, 2900 ] 2 0.001% 100.021% ( 2900, 4400 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 25 Average: 227.5200 StdDev: 443.03 Min: 1 Median: 1.5833 Max: 1827 Percentiles: P50: 1.58 P75: 230.00 P99: 1750.00 P99.9: 1827.00 P99.99: 1827.00 ------------------------------------------------------ [ 0, 1 ] 9 36.000% 36.000% ####### ( 1, 2 ] 6 24.000% 60.000% ##### ( 3, 4 ] 1 4.000% 64.000% # ( 6, 10 ] 1 4.000% 68.000% # ( 110, 170 ] 1 4.000% 72.000% # ( 170, 250 ] 1 4.000% 76.000% # ( 250, 380 ] 1 4.000% 80.000% # ( 380, 580 ] 1 4.000% 84.000% # ( 580, 870 ] 2 8.000% 92.000% ## ( 870, 1300 ] 1 4.000% 96.000% # ( 1300, 1900 ] 1 4.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 95838 Average: 2.1074 StdDev: 12.02 Min: 1 Median: 1.4069 Max: 1770 Percentiles: P50: 1.41 P75: 1.80 P99: 5.41 P99.9: 9.72 P99.99: 604.14 ------------------------------------------------------ [ 0, 1 ] 23280 24.291% 24.291% ##### ( 1, 2 ] 60548 63.177% 87.468% ############# ( 2, 3 ] 7173 7.485% 94.953% # ( 3, 4 ] 2651 2.766% 97.719% # ( 4, 6 ] 1737 1.812% 99.532% ( 6, 10 ] 380 0.397% 99.928% ( 10, 15 ] 40 0.042% 99.970% ( 15, 22 ] 13 0.014% 99.983% ( 250, 380 ] 5 0.005% 99.989% ( 380, 580 ] 1 0.001% 99.990% ( 580, 870 ] 5 0.005% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 183943 Average: 3.4540 StdDev: 34.75 Min: 1 Median: 1.7001 Max: 4708 Percentiles: P50: 1.70 P75: 2.32 P99: 8.78 P99.9: 161.75 P99.99: 446.32 ------------------------------------------------------ [ 0, 1 ] 11465 6.233% 6.233% # ( 1, 2 ] 114998 62.518% 68.751% ############# ( 2, 3 ] 36443 19.812% 88.563% #### ( 3, 4 ] 9338 5.077% 93.640% # ( 4, 6 ] 7830 4.257% 97.897% # ( 6, 10 ] 2918 1.586% 99.483% ( 10, 15 ] 407 0.221% 99.704% ( 15, 22 ] 85 0.046% 99.750% ( 22, 34 ] 14 0.008% 99.758% ( 34, 51 ] 6 0.003% 99.761% ( 51, 76 ] 4 0.002% 99.764% ( 76, 110 ] 82 0.045% 99.808% ( 110, 170 ] 196 0.107% 99.915% ( 170, 250 ] 77 0.042% 99.957% ( 250, 380 ] 50 0.027% 99.984% ( 380, 580 ] 35 0.019% 100.003% ( 580, 870 ] 26 0.014% 100.017% ( 870, 1300 ] 18 0.010% 100.027% ( 1300, 1900 ] 6 0.003% 100.030% ( 1900, 2900 ] 8 0.004% 100.034% ( 2900, 4400 ] 6 0.003% 100.038% ( 4400, 6600 ] 2 0.001% 100.039% ** Level 4 read latency histogram (micros): Count: 305 Average: 121.0000 StdDev: 503.46 Min: 0 Median: 1.7250 Max: 4402 Percentiles: P50: 1.73 P75: 6.73 P99: 3375.00 P99.9: 4402.00 P99.99: 4402.00 ------------------------------------------------------ [ 0, 1 ] 51 16.721% 16.721% ### ( 1, 2 ] 140 45.902% 62.623% ######### ( 2, 3 ] 30 9.836% 72.459% ## ( 3, 4 ] 3 0.984% 73.443% ( 4, 6 ] 2 0.656% 74.098% ( 6, 10 ] 15 4.918% 79.016% # ( 10, 15 ] 37 12.131% 91.148% ## ( 15, 22 ] 3 0.984% 92.131% ( 22, 34 ] 1 0.328% 92.459% ( 250, 380 ] 1 0.328% 92.787% ( 380, 580 ] 2 0.656% 93.443% ( 580, 870 ] 4 1.311% 94.754% ( 870, 1300 ] 7 2.295% 97.049% ( 1300, 1900 ] 2 0.656% 97.705% ( 1900, 2900 ] 3 0.984% 98.689% ( 2900, 4400 ] 3 0.984% 99.672% ( 4400, 6600 ] 1 0.328% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 785.5250 StdDev: 899.28 Min: 88 Median: 336.6667 Max: 3101 Percentiles: P50: 336.67 P75: 1085.00 P99: 3101.00 P99.9: 3101.00 P99.99: 3101.00 ------------------------------------------------------ ( 76, 110 ] 5 12.500% 12.500% ### ( 110, 170 ] 8 20.000% 32.500% #### ( 170, 250 ] 5 12.500% 45.000% ### ( 250, 380 ] 3 7.500% 52.500% ## ( 380, 580 ] 3 7.500% 60.000% ## ( 580, 870 ] 4 10.000% 70.000% ## ( 870, 1300 ] 4 10.000% 80.000% ## ( 1300, 1900 ] 3 7.500% 87.500% ## ( 1900, 2900 ] 4 10.000% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 6.2 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 316.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.878 H:M:S, 14.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.463 H:M:S, 15.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-21:19:02 ... thread 0: (1000000,3000000) ops and (343174.7,335886.4) ops/second in (2.913968,8.931590) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/13 2.15 GB 12.6 1.4 0.0 1.4 4.2 2.8 0.0 1.5 107.2 316.7 13.52 12.57 44 0.307 1471K 1527 0.0 0.0 L1 1/1 3.84 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 241.6 241.2 1.56 1.52 1 1.564 383K 592 0.0 0.0 L2 1/0 51.27 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 249.4 249.2 1.52 1.46 2 0.758 383K 233 0.0 0.0 L3 15/0 963.75 MB 1.0 0.8 0.2 0.6 0.8 0.2 0.4 3.4 229.1 228.6 3.79 3.52 2 1.893 880K 1591 0.0 0.0 L4 169/0 9.51 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 144.6 144.6 1.55 1.13 1 1.550 227K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/14 98.90 GB 0.0 3.2 1.0 2.2 6.0 3.8 2.1 2.2 150.2 279.3 21.94 20.19 50 0.439 3346K 3943 0.0 0.0 Int 0/0 0.00 KB 0.0 3.2 1.0 2.2 6.0 3.8 2.0 2.2 150.2 279.3 21.94 20.19 50 0.439 3346K 3943 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.2 1.0 2.2 3.2 1.0 0.0 0.0 236.7 236.4 13.92 13.03 11 1.266 3346K 3943 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 353.8 8.01 7.16 39 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.98 GB write, 671.26 MB/s write, 3.22 GB read, 361.11 MB/s read, 21.9 seconds Interval compaction: 5.98 GB write, 685.85 MB/s write, 3.22 GB read, 368.96 MB/s read, 21.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 642340 Average: 2.1313 StdDev: 11.12 Min: 1 Median: 1.4492 Max: 3624 Percentiles: P50: 1.45 P75: 1.84 P99: 5.55 P99.9: 10.86 P99.99: 14.96 ------------------------------------------------------ [ 0, 1 ] 135174 21.044% 21.044% #### ( 1, 2 ] 414044 64.459% 85.503% ############# ( 2, 3 ] 57043 8.880% 94.383% ## ( 3, 4 ] 20006 3.115% 97.498% # ( 4, 6 ] 12463 1.940% 99.438% ( 6, 10 ] 2847 0.443% 99.881% ( 10, 15 ] 706 0.110% 99.991% ( 15, 22 ] 62 0.010% 100.001% ( 22, 34 ] 15 0.002% 100.003% ( 34, 51 ] 6 0.001% 100.004% ( 51, 76 ] 3 0.000% 100.005% ( 110, 170 ] 18 0.003% 100.007% ( 170, 250 ] 14 0.002% 100.009% ( 250, 380 ] 17 0.003% 100.012% ( 380, 580 ] 7 0.001% 100.013% ( 580, 870 ] 10 0.002% 100.015% ( 870, 1300 ] 13 0.002% 100.017% ( 1300, 1900 ] 5 0.001% 100.018% ( 1900, 2900 ] 3 0.000% 100.018% ( 2900, 4400 ] 2 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 26 Average: 218.9231 StdDev: 436.55 Min: 1 Median: 1.6667 Max: 1827 Percentiles: P50: 1.67 P75: 210.00 P99: 1744.00 P99.9: 1827.00 P99.99: 1827.00 ------------------------------------------------------ [ 0, 1 ] 9 34.615% 34.615% ####### ( 1, 2 ] 6 23.077% 57.692% ##### ( 3, 4 ] 2 7.692% 65.385% ## ( 6, 10 ] 1 3.846% 69.231% # ( 110, 170 ] 1 3.846% 73.077% # ( 170, 250 ] 1 3.846% 76.923% # ( 250, 380 ] 1 3.846% 80.769% # ( 380, 580 ] 1 3.846% 84.615% # ( 580, 870 ] 2 7.692% 92.308% ## ( 870, 1300 ] 1 3.846% 96.154% # ( 1300, 1900 ] 1 3.846% 100.000% # ** Level 2 read latency histogram (micros): Count: 124204 Average: 2.3386 StdDev: 14.51 Min: 1 Median: 1.4431 Max: 2114 Percentiles: P50: 1.44 P75: 1.83 P99: 5.87 P99.9: 91.03 P99.99: 656.35 ------------------------------------------------------ [ 0, 1 ] 26515 21.348% 21.348% #### ( 1, 2 ] 80308 64.658% 86.006% ############# ( 2, 3 ] 10493 8.448% 94.454% ## ( 3, 4 ] 3529 2.841% 97.296% # ( 4, 6 ] 2266 1.824% 99.120% ( 6, 10 ] 864 0.696% 99.816% ( 10, 15 ] 71 0.057% 99.873% ( 15, 22 ] 14 0.011% 99.884% ( 51, 76 ] 3 0.002% 99.886% ( 76, 110 ] 38 0.031% 99.917% ( 110, 170 ] 41 0.033% 99.950% ( 170, 250 ] 23 0.019% 99.969% ( 250, 380 ] 18 0.014% 99.983% ( 380, 580 ] 7 0.006% 99.989% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.996% ( 1300, 1900 ] 4 0.003% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 184830 Average: 3.4850 StdDev: 35.16 Min: 1 Median: 1.7000 Max: 4708 Percentiles: P50: 1.70 P75: 2.32 P99: 8.79 P99.9: 164.54 P99.99: 480.09 ------------------------------------------------------ [ 0, 1 ] 11532 6.239% 6.239% # ( 1, 2 ] 115547 62.515% 68.755% ############# ( 2, 3 ] 36634 19.820% 88.575% #### ( 3, 4 ] 9363 5.066% 93.641% # ( 4, 6 ] 7855 4.250% 97.890% # ( 6, 10 ] 2936 1.588% 99.479% ( 10, 15 ] 409 0.221% 99.700% ( 15, 22 ] 85 0.046% 99.746% ( 22, 34 ] 14 0.008% 99.754% ( 34, 51 ] 6 0.003% 99.757% ( 51, 76 ] 4 0.002% 99.759% ( 76, 110 ] 82 0.044% 99.804% ( 110, 170 ] 196 0.106% 99.910% ( 170, 250 ] 77 0.042% 99.951% ( 250, 380 ] 52 0.028% 99.979% ( 380, 580 ] 39 0.021% 100.001% ( 580, 870 ] 28 0.015% 100.016% ( 870, 1300 ] 19 0.010% 100.026% ( 1300, 1900 ] 7 0.004% 100.030% ( 1900, 2900 ] 8 0.004% 100.034% ( 2900, 4400 ] 6 0.003% 100.037% ( 4400, 6600 ] 2 0.001% 100.038% ** Level 4 read latency histogram (micros): Count: 305 Average: 121.0000 StdDev: 503.46 Min: 0 Median: 1.7250 Max: 4402 Percentiles: P50: 1.73 P75: 6.73 P99: 3375.00 P99.9: 4402.00 P99.99: 4402.00 ------------------------------------------------------ [ 0, 1 ] 51 16.721% 16.721% ### ( 1, 2 ] 140 45.902% 62.623% ######### ( 2, 3 ] 30 9.836% 72.459% ## ( 3, 4 ] 3 0.984% 73.443% ( 4, 6 ] 2 0.656% 74.098% ( 6, 10 ] 15 4.918% 79.016% # ( 10, 15 ] 37 12.131% 91.148% ## ( 15, 22 ] 3 0.984% 92.131% ( 22, 34 ] 1 0.328% 92.459% ( 250, 380 ] 1 0.328% 92.787% ( 380, 580 ] 2 0.656% 93.443% ( 580, 870 ] 4 1.311% 94.754% ( 870, 1300 ] 7 2.295% 97.049% ( 1300, 1900 ] 2 0.656% 97.705% ( 1900, 2900 ] 3 0.984% 98.689% ( 2900, 4400 ] 3 0.984% 99.672% ( 4400, 6600 ] 1 0.328% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 785.5250 StdDev: 899.28 Min: 88 Median: 336.6667 Max: 3101 Percentiles: P50: 336.67 P75: 1085.00 P99: 3101.00 P99.9: 3101.00 P99.99: 3101.00 ------------------------------------------------------ ( 76, 110 ] 5 12.500% 12.500% ### ( 110, 170 ] 8 20.000% 32.500% #### ( 170, 250 ] 5 12.500% 45.000% ### ( 250, 380 ] 3 7.500% 52.500% ## ( 380, 580 ] 3 7.500% 60.000% ## ( 580, 870 ] 4 10.000% 70.000% ## ( 870, 1300 ] 4 10.000% 80.000% ## ( 1300, 1900 ] 3 7.500% 87.500% ## ( 1900, 2900 ] 4 10.000% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 323.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.275 H:M:S, 14.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 337.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.397 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-21:19:05 ... thread 0: (1000000,4000000) ops and (334279.8,335483.3) ops/second in (2.991506,11.923096) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 3.07 GB 107.0 2.3 0.0 2.3 6.0 3.7 0.0 1.6 118.9 311.7 19.60 18.28 60 0.327 2366K 2550 0.0 0.0 L1 1/1 3.84 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 241.6 241.2 1.56 1.52 1 1.564 383K 592 0.0 0.0 L2 1/0 51.27 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 249.4 249.2 1.52 1.46 2 0.758 383K 233 0.0 0.0 L3 15/0 963.75 MB 1.0 0.8 0.2 0.6 0.8 0.2 0.4 3.4 229.1 228.6 3.79 3.52 2 1.893 880K 1591 0.0 0.0 L4 169/0 9.51 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 144.6 144.6 1.55 1.13 1 1.550 227K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1253/14 99.82 GB 0.0 4.1 1.0 3.1 7.8 4.7 2.1 2.1 149.1 283.9 28.01 25.91 66 0.424 4242K 4966 0.0 0.0 Int 0/0 0.00 KB 0.0 4.1 1.0 3.1 7.8 4.7 2.0 2.1 149.1 283.9 28.01 25.91 66 0.424 4242K 4966 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.1 1.0 3.1 4.1 1.0 0.0 0.0 241.3 241.0 17.31 16.35 14 1.237 4242K 4966 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 353.3 10.70 9.56 52 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.77 GB write, 656.22 MB/s write, 4.08 GB read, 344.75 MB/s read, 28.0 seconds Interval compaction: 7.77 GB write, 666.90 MB/s write, 4.08 GB read, 350.36 MB/s read, 28.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 15, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1057822 Average: 2.1876 StdDev: 10.09 Min: 1 Median: 1.4874 Max: 3624 Percentiles: P50: 1.49 P75: 1.87 P99: 5.59 P99.9: 10.71 P99.99: 14.66 ------------------------------------------------------ [ 0, 1 ] 188621 17.831% 17.831% #### ( 1, 2 ] 698242 66.008% 83.839% ############# ( 2, 3 ] 108013 10.211% 94.049% ## ( 3, 4 ] 35136 3.322% 97.371% # ( 4, 6 ] 21629 2.045% 99.416% ( 6, 10 ] 4955 0.468% 99.884% ( 10, 15 ] 1203 0.114% 99.998% ( 15, 22 ] 87 0.008% 100.006% ( 22, 34 ] 21 0.002% 100.008% ( 34, 51 ] 10 0.001% 100.009% ( 51, 76 ] 3 0.000% 100.009% ( 76, 110 ] 13 0.001% 100.010% ( 110, 170 ] 58 0.005% 100.016% ( 170, 250 ] 31 0.003% 100.019% ( 250, 380 ] 33 0.003% 100.022% ( 380, 580 ] 20 0.002% 100.024% ( 580, 870 ] 18 0.002% 100.026% ( 870, 1300 ] 19 0.002% 100.027% ( 1300, 1900 ] 8 0.001% 100.028% ( 1900, 2900 ] 4 0.000% 100.029% ( 2900, 4400 ] 2 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 26 Average: 218.9231 StdDev: 436.55 Min: 1 Median: 1.6667 Max: 1827 Percentiles: P50: 1.67 P75: 210.00 P99: 1744.00 P99.9: 1827.00 P99.99: 1827.00 ------------------------------------------------------ [ 0, 1 ] 9 34.615% 34.615% ####### ( 1, 2 ] 6 23.077% 57.692% ##### ( 3, 4 ] 2 7.692% 65.385% ## ( 6, 10 ] 1 3.846% 69.231% # ( 110, 170 ] 1 3.846% 73.077% # ( 170, 250 ] 1 3.846% 76.923% # ( 250, 380 ] 1 3.846% 80.769% # ( 380, 580 ] 1 3.846% 84.615% # ( 580, 870 ] 2 7.692% 92.308% ## ( 870, 1300 ] 1 3.846% 96.154% # ( 1300, 1900 ] 1 3.846% 100.000% # ** Level 2 read latency histogram (micros): Count: 124204 Average: 2.3386 StdDev: 14.51 Min: 1 Median: 1.4431 Max: 2114 Percentiles: P50: 1.44 P75: 1.83 P99: 5.87 P99.9: 91.03 P99.99: 656.35 ------------------------------------------------------ [ 0, 1 ] 26515 21.348% 21.348% #### ( 1, 2 ] 80308 64.658% 86.006% ############# ( 2, 3 ] 10493 8.448% 94.454% ## ( 3, 4 ] 3529 2.841% 97.296% # ( 4, 6 ] 2266 1.824% 99.120% ( 6, 10 ] 864 0.696% 99.816% ( 10, 15 ] 71 0.057% 99.873% ( 15, 22 ] 14 0.011% 99.884% ( 51, 76 ] 3 0.002% 99.886% ( 76, 110 ] 38 0.031% 99.917% ( 110, 170 ] 41 0.033% 99.950% ( 170, 250 ] 23 0.019% 99.969% ( 250, 380 ] 18 0.014% 99.983% ( 380, 580 ] 7 0.006% 99.989% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.996% ( 1300, 1900 ] 4 0.003% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 184830 Average: 3.4850 StdDev: 35.16 Min: 1 Median: 1.7000 Max: 4708 Percentiles: P50: 1.70 P75: 2.32 P99: 8.79 P99.9: 164.54 P99.99: 480.09 ------------------------------------------------------ [ 0, 1 ] 11532 6.239% 6.239% # ( 1, 2 ] 115547 62.515% 68.755% ############# ( 2, 3 ] 36634 19.820% 88.575% #### ( 3, 4 ] 9363 5.066% 93.641% # ( 4, 6 ] 7855 4.250% 97.890% # ( 6, 10 ] 2936 1.588% 99.479% ( 10, 15 ] 409 0.221% 99.700% ( 15, 22 ] 85 0.046% 99.746% ( 22, 34 ] 14 0.008% 99.754% ( 34, 51 ] 6 0.003% 99.757% ( 51, 76 ] 4 0.002% 99.759% ( 76, 110 ] 82 0.044% 99.804% ( 110, 170 ] 196 0.106% 99.910% ( 170, 250 ] 77 0.042% 99.951% ( 250, 380 ] 52 0.028% 99.979% ( 380, 580 ] 39 0.021% 100.001% ( 580, 870 ] 28 0.015% 100.016% ( 870, 1300 ] 19 0.010% 100.026% ( 1300, 1900 ] 7 0.004% 100.030% ( 1900, 2900 ] 8 0.004% 100.034% ( 2900, 4400 ] 6 0.003% 100.037% ( 4400, 6600 ] 2 0.001% 100.038% ** Level 4 read latency histogram (micros): Count: 305 Average: 121.0000 StdDev: 503.46 Min: 0 Median: 1.7250 Max: 4402 Percentiles: P50: 1.73 P75: 6.73 P99: 3375.00 P99.9: 4402.00 P99.99: 4402.00 ------------------------------------------------------ [ 0, 1 ] 51 16.721% 16.721% ### ( 1, 2 ] 140 45.902% 62.623% ######### ( 2, 3 ] 30 9.836% 72.459% ## ( 3, 4 ] 3 0.984% 73.443% ( 4, 6 ] 2 0.656% 74.098% ( 6, 10 ] 15 4.918% 79.016% # ( 10, 15 ] 37 12.131% 91.148% ## ( 15, 22 ] 3 0.984% 92.131% ( 22, 34 ] 1 0.328% 92.459% ( 250, 380 ] 1 0.328% 92.787% ( 380, 580 ] 2 0.656% 93.443% ( 580, 870 ] 4 1.311% 94.754% ( 870, 1300 ] 7 2.295% 97.049% ( 1300, 1900 ] 2 0.656% 97.705% ( 1900, 2900 ] 3 0.984% 98.689% ( 2900, 4400 ] 3 0.984% 99.672% ( 4400, 6600 ] 1 0.328% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 785.5250 StdDev: 899.28 Min: 88 Median: 336.6667 Max: 3101 Percentiles: P50: 336.67 P75: 1085.00 P99: 3101.00 P99.9: 3101.00 P99.99: 3101.00 ------------------------------------------------------ ( 76, 110 ] 5 12.500% 12.500% ### ( 110, 170 ] 8 20.000% 32.500% #### ( 170, 250 ] 5 12.500% 45.000% ### ( 250, 380 ] 3 7.500% 52.500% ## ( 380, 580 ] 3 7.500% 60.000% ## ( 580, 870 ] 4 10.000% 70.000% ## ( 870, 1300 ] 4 10.000% 80.000% ## ( 1300, 1900 ] 3 7.500% 87.500% ## ( 1900, 2900 ] 4 10.000% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 324.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.706 H:M:S, 14.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.431 H:M:S, 14.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-21:19:09 ... thread 0: (1000000,5000000) ops and (231368.4,307783.1) ops/second in (4.322111,16.245207) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 2.34 GB 6.3 3.3 0.0 3.3 8.0 4.7 0.0 1.7 128.5 309.3 26.47 24.78 80 0.331 3454K 3617 0.0 0.0 L1 15/15 1.71 GB 0.0 2.1 2.1 0.0 2.1 2.1 0.2 1.0 233.3 231.7 9.19 8.89 2 4.595 2177K 14K 0.0 0.0 L2 1/0 51.27 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 249.4 249.2 1.52 1.46 2 0.758 383K 233 0.0 0.0 L3 15/0 963.75 MB 1.0 0.8 0.2 0.6 0.8 0.2 0.4 3.4 229.1 228.6 3.79 3.52 2 1.893 880K 1591 0.0 0.0 L4 169/0 9.51 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 144.6 144.6 1.55 1.13 1 1.550 227K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1262/28 100.79 GB 0.0 6.9 2.7 4.1 11.5 7.4 2.1 2.5 165.0 277.2 42.51 39.77 87 0.489 7123K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.9 2.7 4.1 11.5 7.4 2.0 2.5 165.0 277.2 42.51 39.77 87 0.489 7123K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.9 2.7 4.1 6.8 2.7 0.0 0.0 242.3 241.6 28.95 27.66 19 1.524 7123K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 353.3 13.55 12.11 68 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.4 total, 16.2 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.51 GB write, 716.66 MB/s write, 6.85 GB read, 426.68 MB/s read, 42.5 seconds Interval compaction: 11.51 GB write, 725.23 MB/s write, 6.85 GB read, 431.78 MB/s read, 42.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 15, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1515607 Average: 2.2473 StdDev: 12.48 Min: 1 Median: 1.4886 Max: 4384 Percentiles: P50: 1.49 P75: 1.86 P99: 5.66 P99.9: 11.72 P99.99: 94.11 ------------------------------------------------------ [ 0, 1 ] 265661 17.528% 17.528% #### ( 1, 2 ] 1007217 66.456% 83.985% ############# ( 2, 3 ] 153008 10.095% 94.080% ## ( 3, 4 ] 49649 3.276% 97.356% # ( 4, 6 ] 29990 1.979% 99.335% ( 6, 10 ] 7976 0.526% 99.861% ( 10, 15 ] 1719 0.113% 99.974% ( 15, 22 ] 120 0.008% 99.982% ( 22, 34 ] 26 0.002% 99.984% ( 34, 51 ] 13 0.001% 99.985% ( 51, 76 ] 5 0.000% 99.985% ( 76, 110 ] 136 0.009% 99.994% ( 110, 170 ] 219 0.014% 100.009% ( 170, 250 ] 104 0.007% 100.016% ( 250, 380 ] 83 0.005% 100.021% ( 380, 580 ] 56 0.004% 100.025% ( 580, 870 ] 44 0.003% 100.028% ( 870, 1300 ] 23 0.002% 100.029% ( 1300, 1900 ] 10 0.001% 100.030% ( 1900, 2900 ] 6 0.000% 100.030% ( 2900, 4400 ] 8 0.001% 100.031% ** Level 1 read latency histogram (micros): Count: 26487 Average: 3.3136 StdDev: 30.66 Min: 0 Median: 1.3383 Max: 1827 Percentiles: P50: 1.34 P75: 1.76 P99: 7.00 P99.9: 410.26 P99.99: 1370.26 ------------------------------------------------------ [ 0, 1 ] 7881 29.754% 29.754% ###### ( 1, 2 ] 15851 59.844% 89.599% ############ ( 2, 3 ] 1395 5.267% 94.865% # ( 3, 4 ] 776 2.930% 97.795% # ( 4, 6 ] 283 1.068% 98.864% ( 6, 10 ] 145 0.547% 99.411% ( 10, 15 ] 33 0.125% 99.536% ( 15, 22 ] 5 0.019% 99.554% ( 22, 34 ] 2 0.008% 99.562% ( 76, 110 ] 21 0.079% 99.641% ( 110, 170 ] 42 0.159% 99.800% ( 170, 250 ] 5 0.019% 99.819% ( 250, 380 ] 20 0.076% 99.894% ( 380, 580 ] 10 0.038% 99.932% ( 580, 870 ] 7 0.026% 99.958% ( 870, 1300 ] 8 0.030% 99.989% ( 1300, 1900 ] 3 0.011% 100.000% ** Level 2 read latency histogram (micros): Count: 124204 Average: 2.3386 StdDev: 14.51 Min: 1 Median: 1.4431 Max: 2114 Percentiles: P50: 1.44 P75: 1.83 P99: 5.87 P99.9: 91.03 P99.99: 656.35 ------------------------------------------------------ [ 0, 1 ] 26515 21.348% 21.348% #### ( 1, 2 ] 80308 64.658% 86.006% ############# ( 2, 3 ] 10493 8.448% 94.454% ## ( 3, 4 ] 3529 2.841% 97.296% # ( 4, 6 ] 2266 1.824% 99.120% ( 6, 10 ] 864 0.696% 99.816% ( 10, 15 ] 71 0.057% 99.873% ( 15, 22 ] 14 0.011% 99.884% ( 51, 76 ] 3 0.002% 99.886% ( 76, 110 ] 38 0.031% 99.917% ( 110, 170 ] 41 0.033% 99.950% ( 170, 250 ] 23 0.019% 99.969% ( 250, 380 ] 18 0.014% 99.983% ( 380, 580 ] 7 0.006% 99.989% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.996% ( 1300, 1900 ] 4 0.003% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 184830 Average: 3.4850 StdDev: 35.16 Min: 1 Median: 1.7000 Max: 4708 Percentiles: P50: 1.70 P75: 2.32 P99: 8.79 P99.9: 164.54 P99.99: 480.09 ------------------------------------------------------ [ 0, 1 ] 11532 6.239% 6.239% # ( 1, 2 ] 115547 62.515% 68.755% ############# ( 2, 3 ] 36634 19.820% 88.575% #### ( 3, 4 ] 9363 5.066% 93.641% # ( 4, 6 ] 7855 4.250% 97.890% # ( 6, 10 ] 2936 1.588% 99.479% ( 10, 15 ] 409 0.221% 99.700% ( 15, 22 ] 85 0.046% 99.746% ( 22, 34 ] 14 0.008% 99.754% ( 34, 51 ] 6 0.003% 99.757% ( 51, 76 ] 4 0.002% 99.759% ( 76, 110 ] 82 0.044% 99.804% ( 110, 170 ] 196 0.106% 99.910% ( 170, 250 ] 77 0.042% 99.951% ( 250, 380 ] 52 0.028% 99.979% ( 380, 580 ] 39 0.021% 100.001% ( 580, 870 ] 28 0.015% 100.016% ( 870, 1300 ] 19 0.010% 100.026% ( 1300, 1900 ] 7 0.004% 100.030% ( 1900, 2900 ] 8 0.004% 100.034% ( 2900, 4400 ] 6 0.003% 100.037% ( 4400, 6600 ] 2 0.001% 100.038% ** Level 4 read latency histogram (micros): Count: 305 Average: 121.0000 StdDev: 503.46 Min: 0 Median: 1.7250 Max: 4402 Percentiles: P50: 1.73 P75: 6.73 P99: 3375.00 P99.9: 4402.00 P99.99: 4402.00 ------------------------------------------------------ [ 0, 1 ] 51 16.721% 16.721% ### ( 1, 2 ] 140 45.902% 62.623% ######### ( 2, 3 ] 30 9.836% 72.459% ## ( 3, 4 ] 3 0.984% 73.443% ( 4, 6 ] 2 0.656% 74.098% ( 6, 10 ] 15 4.918% 79.016% # ( 10, 15 ] 37 12.131% 91.148% ## ( 15, 22 ] 3 0.984% 92.131% ( 22, 34 ] 1 0.328% 92.459% ( 250, 380 ] 1 0.328% 92.787% ( 380, 580 ] 2 0.656% 93.443% ( 580, 870 ] 4 1.311% 94.754% ( 870, 1300 ] 7 2.295% 97.049% ( 1300, 1900 ] 2 0.656% 97.705% ( 1900, 2900 ] 3 0.984% 98.689% ( 2900, 4400 ] 3 0.984% 99.672% ( 4400, 6600 ] 1 0.328% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 785.5250 StdDev: 899.28 Min: 88 Median: 336.6667 Max: 3101 Percentiles: P50: 336.67 P75: 1085.00 P99: 3101.00 P99.9: 3101.00 P99.99: 3101.00 ------------------------------------------------------ ( 76, 110 ] 5 12.500% 12.500% ### ( 110, 170 ] 8 20.000% 32.500% #### ( 170, 250 ] 5 12.500% 45.000% ### ( 250, 380 ] 3 7.500% 52.500% ## ( 380, 580 ] 3 7.500% 60.000% ## ( 580, 870 ] 4 10.000% 70.000% ## ( 870, 1300 ] 4 10.000% 80.000% ## ( 1300, 1900 ] 3 7.500% 87.500% ## ( 1900, 2900 ] 4 10.000% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 16.4 total, 4.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 299.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.372 H:M:S, 20.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 227.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.667 H:M:S, 38.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-21:19:12 ... thread 0: (1000000,6000000) ops and (305536.8,307406.4) ops/second in (3.272928,19.518135) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 3.32 GB 107.0 4.2 0.0 4.2 9.8 5.7 0.0 1.7 131.0 308.1 32.70 30.64 97 0.337 4349K 4586 0.0 0.0 L1 15/15 1.71 GB 0.0 2.1 2.1 0.0 2.1 2.1 0.2 1.0 233.3 231.7 9.19 8.89 2 4.595 2177K 14K 0.0 0.0 L2 1/0 51.27 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 249.4 249.2 1.52 1.46 2 0.758 383K 233 0.0 0.0 L3 15/0 963.75 MB 1.0 0.8 0.2 0.6 0.8 0.2 0.4 3.4 229.1 228.6 3.79 3.52 2 1.893 880K 1591 0.0 0.0 L4 169/0 9.51 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 144.6 144.6 1.55 1.13 1 1.550 227K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1267/28 101.78 GB 0.0 7.7 2.7 5.0 13.4 8.4 2.1 2.4 162.0 280.5 48.74 45.64 104 0.469 8018K 20K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.7 2.7 5.0 13.4 8.4 2.0 2.4 162.0 280.5 48.74 45.64 104 0.469 8018K 20K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.7 2.7 5.0 7.7 2.7 0.0 0.0 244.5 243.9 32.29 30.94 22 1.468 8018K 20K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 352.3 16.45 14.70 82 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.7 total, 19.5 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.35 GB write, 693.50 MB/s write, 7.71 GB read, 400.58 MB/s read, 48.7 seconds Interval compaction: 13.35 GB write, 700.39 MB/s write, 7.71 GB read, 404.56 MB/s read, 48.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 18, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1876408 Average: 2.2532 StdDev: 12.37 Min: 1 Median: 1.4969 Max: 4633 Percentiles: P50: 1.50 P75: 1.87 P99: 5.66 P99.9: 11.54 P99.99: 89.94 ------------------------------------------------------ [ 0, 1 ] 315272 16.802% 16.802% ### ( 1, 2 ] 1253738 66.816% 83.618% ############# ( 2, 3 ] 195054 10.395% 94.013% ## ( 3, 4 ] 62475 3.329% 97.342% # ( 4, 6 ] 37571 2.002% 99.345% ( 6, 10 ] 9801 0.522% 99.867% ( 10, 15 ] 2019 0.108% 99.975% ( 15, 22 ] 164 0.009% 99.983% ( 22, 34 ] 33 0.002% 99.985% ( 34, 51 ] 19 0.001% 99.986% ( 51, 76 ] 11 0.001% 99.987% ( 76, 110 ] 157 0.008% 99.995% ( 110, 170 ] 254 0.014% 100.009% ( 170, 250 ] 122 0.007% 100.015% ( 250, 380 ] 100 0.005% 100.020% ( 380, 580 ] 73 0.004% 100.024% ( 580, 870 ] 52 0.003% 100.027% ( 870, 1300 ] 27 0.001% 100.028% ( 1300, 1900 ] 12 0.001% 100.029% ( 1900, 2900 ] 6 0.000% 100.029% ( 2900, 4400 ] 9 0.000% 100.030% ( 4400, 6600 ] 1 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 113169 Average: 2.8394 StdDev: 17.59 Min: 0 Median: 1.5276 Max: 1827 Percentiles: P50: 1.53 P75: 1.90 P99: 8.33 P99.9: 190.19 P99.99: 861.65 ------------------------------------------------------ [ 0, 1 ] 16774 14.822% 14.822% ### ( 1, 2 ] 75455 66.675% 81.497% ############# ( 2, 3 ] 12777 11.290% 92.787% ## ( 3, 4 ] 3682 3.254% 96.040% # ( 4, 6 ] 2449 2.164% 98.204% ( 6, 10 ] 1548 1.368% 99.572% ( 10, 15 ] 152 0.134% 99.707% ( 15, 22 ] 18 0.016% 99.723% ( 22, 34 ] 4 0.004% 99.726% ( 34, 51 ] 2 0.002% 99.728% ( 51, 76 ] 1 0.001% 99.729% ( 76, 110 ] 93 0.082% 99.811% ( 110, 170 ] 92 0.081% 99.892% ( 170, 250 ] 35 0.031% 99.923% ( 250, 380 ] 39 0.034% 99.958% ( 380, 580 ] 26 0.023% 99.981% ( 580, 870 ] 11 0.010% 99.990% ( 870, 1300 ] 8 0.007% 99.997% ( 1300, 1900 ] 3 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 124204 Average: 2.3386 StdDev: 14.51 Min: 1 Median: 1.4431 Max: 2114 Percentiles: P50: 1.44 P75: 1.83 P99: 5.87 P99.9: 91.03 P99.99: 656.35 ------------------------------------------------------ [ 0, 1 ] 26515 21.348% 21.348% #### ( 1, 2 ] 80308 64.658% 86.006% ############# ( 2, 3 ] 10493 8.448% 94.454% ## ( 3, 4 ] 3529 2.841% 97.296% # ( 4, 6 ] 2266 1.824% 99.120% ( 6, 10 ] 864 0.696% 99.816% ( 10, 15 ] 71 0.057% 99.873% ( 15, 22 ] 14 0.011% 99.884% ( 51, 76 ] 3 0.002% 99.886% ( 76, 110 ] 38 0.031% 99.917% ( 110, 170 ] 41 0.033% 99.950% ( 170, 250 ] 23 0.019% 99.969% ( 250, 380 ] 18 0.014% 99.983% ( 380, 580 ] 7 0.006% 99.989% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.996% ( 1300, 1900 ] 4 0.003% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 184830 Average: 3.4850 StdDev: 35.16 Min: 1 Median: 1.7000 Max: 4708 Percentiles: P50: 1.70 P75: 2.32 P99: 8.79 P99.9: 164.54 P99.99: 480.09 ------------------------------------------------------ [ 0, 1 ] 11532 6.239% 6.239% # ( 1, 2 ] 115547 62.515% 68.755% ############# ( 2, 3 ] 36634 19.820% 88.575% #### ( 3, 4 ] 9363 5.066% 93.641% # ( 4, 6 ] 7855 4.250% 97.890% # ( 6, 10 ] 2936 1.588% 99.479% ( 10, 15 ] 409 0.221% 99.700% ( 15, 22 ] 85 0.046% 99.746% ( 22, 34 ] 14 0.008% 99.754% ( 34, 51 ] 6 0.003% 99.757% ( 51, 76 ] 4 0.002% 99.759% ( 76, 110 ] 82 0.044% 99.804% ( 110, 170 ] 196 0.106% 99.910% ( 170, 250 ] 77 0.042% 99.951% ( 250, 380 ] 52 0.028% 99.979% ( 380, 580 ] 39 0.021% 100.001% ( 580, 870 ] 28 0.015% 100.016% ( 870, 1300 ] 19 0.010% 100.026% ( 1300, 1900 ] 7 0.004% 100.030% ( 1900, 2900 ] 8 0.004% 100.034% ( 2900, 4400 ] 6 0.003% 100.037% ( 4400, 6600 ] 2 0.001% 100.038% ** Level 4 read latency histogram (micros): Count: 305 Average: 121.0000 StdDev: 503.46 Min: 0 Median: 1.7250 Max: 4402 Percentiles: P50: 1.73 P75: 6.73 P99: 3375.00 P99.9: 4402.00 P99.99: 4402.00 ------------------------------------------------------ [ 0, 1 ] 51 16.721% 16.721% ### ( 1, 2 ] 140 45.902% 62.623% ######### ( 2, 3 ] 30 9.836% 72.459% ## ( 3, 4 ] 3 0.984% 73.443% ( 4, 6 ] 2 0.656% 74.098% ( 6, 10 ] 15 4.918% 79.016% # ( 10, 15 ] 37 12.131% 91.148% ## ( 15, 22 ] 3 0.984% 92.131% ( 22, 34 ] 1 0.328% 92.459% ( 250, 380 ] 1 0.328% 92.787% ( 380, 580 ] 2 0.656% 93.443% ( 580, 870 ] 4 1.311% 94.754% ( 870, 1300 ] 7 2.295% 97.049% ( 1300, 1900 ] 2 0.656% 97.705% ( 1900, 2900 ] 3 0.984% 98.689% ( 2900, 4400 ] 3 0.984% 99.672% ( 4400, 6600 ] 1 0.328% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 785.5250 StdDev: 899.28 Min: 88 Median: 336.6667 Max: 3101 Percentiles: P50: 336.67 P75: 1085.00 P99: 3101.00 P99.9: 3101.00 P99.99: 3101.00 ------------------------------------------------------ ( 76, 110 ] 5 12.500% 12.500% ### ( 110, 170 ] 8 20.000% 32.500% #### ( 170, 250 ] 5 12.500% 45.000% ### ( 250, 380 ] 3 7.500% 52.500% ## ( 380, 580 ] 3 7.500% 60.000% ## ( 580, 870 ] 4 10.000% 70.000% ## ( 870, 1300 ] 4 10.000% 80.000% ## ( 1300, 1900 ] 3 7.500% 87.500% ## ( 1900, 2900 ] 4 10.000% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 19.7 total, 3.3 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 299.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.039 H:M:S, 20.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 300.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.667 H:M:S, 20.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-21:19:29 ... thread 0: (1000000,7000000) ops and (59512.2,192723.8) ops/second in (16.803281,36.321416) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/3 2.27 GB 63.0 6.6 0.0 6.6 13.2 6.6 0.0 2.0 147.8 296.8 45.59 42.43 116 0.393 6842K 13K 0.0 0.0 L1 10/10 1.17 GB 0.0 5.8 4.1 1.7 5.8 4.0 0.2 1.4 231.3 228.6 25.82 24.77 3 8.607 6065K 70K 0.0 0.0 L2 6/4 772.68 MB 2.6 0.4 0.2 0.2 0.4 0.2 2.9 2.0 249.4 249.2 1.52 1.46 2 0.758 383K 233 0.0 0.0 L3 38/10 2.02 GB 1.5 3.1 2.1 1.0 3.1 2.0 0.4 1.5 204.6 204.1 15.32 13.58 7 2.188 3183K 8687 0.0 0.0 L4 169/7 9.56 GB 1.0 0.5 0.5 0.0 0.5 0.5 0.8 1.0 151.1 150.9 3.27 2.31 5 0.654 501K 622 0.0 0.0 L5 1056/0 86.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1287/34 102.69 GB 0.0 16.3 6.8 9.5 22.9 13.4 5.7 3.4 182.7 256.0 91.51 84.55 133 0.688 16M 93K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.3 6.8 9.5 22.9 13.4 5.6 3.4 182.7 256.0 91.51 84.55 133 0.688 16M 93K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.3 6.8 9.5 16.2 6.7 0.0 0.0 233.6 232.3 71.56 67.18 37 1.934 16M 93K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 341.0 19.95 17.37 96 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 36.5 total, 36.3 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.88 GB write, 641.57 MB/s write, 16.33 GB read, 457.83 MB/s read, 91.5 seconds Interval compaction: 22.88 GB write, 645.00 MB/s write, 16.33 GB read, 460.28 MB/s read, 91.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 26, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 26, interval: 49 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3054613 Average: 2.5014 StdDev: 21.79 Min: 1 Median: 1.5098 Max: 8073 Percentiles: P50: 1.51 P75: 1.89 P99: 5.95 P99.9: 21.10 P99.99: 209.60 ------------------------------------------------------ [ 0, 1 ] 508562 16.649% 16.649% ### ( 1, 2 ] 1998498 65.426% 82.075% ############# ( 2, 3 ] 329094 10.774% 92.848% ## ( 3, 4 ] 110535 3.619% 96.467% # ( 4, 6 ] 79254 2.595% 99.061% # ( 6, 10 ] 21519 0.704% 99.766% ( 10, 15 ] 3733 0.122% 99.888% ( 15, 22 ] 417 0.014% 99.902% ( 22, 34 ] 42 0.001% 99.903% ( 34, 51 ] 24 0.001% 99.904% ( 51, 76 ] 25 0.001% 99.905% ( 76, 110 ] 1110 0.036% 99.941% ( 110, 170 ] 1299 0.043% 99.984% ( 170, 250 ] 395 0.013% 99.997% ( 250, 380 ] 316 0.010% 100.007% ( 380, 580 ] 243 0.008% 100.015% ( 580, 870 ] 161 0.005% 100.020% ( 870, 1300 ] 76 0.002% 100.023% ( 1300, 1900 ] 29 0.001% 100.024% ( 1900, 2900 ] 30 0.001% 100.025% ( 2900, 4400 ] 30 0.001% 100.026% ( 4400, 6600 ] 11 0.000% 100.026% ( 6600, 9900 ] 4 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 1065824 Average: 3.8726 StdDev: 53.83 Min: 0 Median: 1.6682 Max: 8183 Percentiles: P50: 1.67 P75: 2.33 P99: 8.62 P99.9: 125.18 P99.99: 315.61 ------------------------------------------------------ [ 0, 1 ] 110751 10.391% 10.391% ## ( 1, 2 ] 631776 59.276% 69.667% ############ ( 2, 3 ] 172840 16.217% 85.884% ### ( 3, 4 ] 69436 6.515% 92.398% # ( 4, 6 ] 59083 5.543% 97.942% # ( 6, 10 ] 17228 1.616% 99.558% ( 10, 15 ] 2397 0.225% 99.783% ( 15, 22 ] 333 0.031% 99.814% ( 22, 34 ] 18 0.002% 99.816% ( 34, 51 ] 8 0.001% 99.817% ( 51, 76 ] 78 0.007% 99.824% ( 76, 110 ] 629 0.059% 99.883% ( 110, 170 ] 716 0.067% 99.950% ( 170, 250 ] 273 0.026% 99.976% ( 250, 380 ] 300 0.028% 100.004% ( 380, 580 ] 259 0.024% 100.028% ( 580, 870 ] 217 0.020% 100.049% ( 870, 1300 ] 131 0.012% 100.061% ( 1300, 1900 ] 69 0.006% 100.067% ( 1900, 2900 ] 64 0.006% 100.073% ( 2900, 4400 ] 90 0.008% 100.082% ( 4400, 6600 ] 25 0.002% 100.084% ( 6600, 9900 ] 7 0.001% 100.085% ** Level 2 read latency histogram (micros): Count: 124204 Average: 2.3386 StdDev: 14.51 Min: 1 Median: 1.4431 Max: 2114 Percentiles: P50: 1.44 P75: 1.83 P99: 5.87 P99.9: 91.03 P99.99: 656.35 ------------------------------------------------------ [ 0, 1 ] 26515 21.348% 21.348% #### ( 1, 2 ] 80308 64.658% 86.006% ############# ( 2, 3 ] 10493 8.448% 94.454% ## ( 3, 4 ] 3529 2.841% 97.296% # ( 4, 6 ] 2266 1.824% 99.120% ( 6, 10 ] 864 0.696% 99.816% ( 10, 15 ] 71 0.057% 99.873% ( 15, 22 ] 14 0.011% 99.884% ( 51, 76 ] 3 0.002% 99.886% ( 76, 110 ] 38 0.031% 99.917% ( 110, 170 ] 41 0.033% 99.950% ( 170, 250 ] 23 0.019% 99.969% ( 250, 380 ] 18 0.014% 99.983% ( 380, 580 ] 7 0.006% 99.989% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.996% ( 1300, 1900 ] 4 0.003% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 392172 Average: 4.5425 StdDev: 58.47 Min: 1 Median: 1.8573 Max: 7342 Percentiles: P50: 1.86 P75: 2.76 P99: 8.76 P99.9: 115.98 P99.99: 213.31 ------------------------------------------------------ [ 0, 1 ] 13435 3.426% 3.426% # ( 1, 2 ] 213053 54.326% 57.752% ########### ( 2, 3 ] 88854 22.657% 80.409% ##### ( 3, 4 ] 34997 8.924% 89.333% ## ( 4, 6 ] 33543 8.553% 97.886% ## ( 6, 10 ] 6324 1.613% 99.499% ( 10, 15 ] 1241 0.316% 99.815% ( 15, 22 ] 145 0.037% 99.852% ( 22, 34 ] 27 0.007% 99.859% ( 34, 51 ] 14 0.004% 99.863% ( 51, 76 ] 5 0.001% 99.864% ( 76, 110 ] 115 0.029% 99.893% ( 110, 170 ] 279 0.071% 99.964% ( 170, 250 ] 188 0.048% 100.012% ( 250, 380 ] 145 0.037% 100.049% ( 380, 580 ] 161 0.041% 100.090% ( 580, 870 ] 127 0.032% 100.123% ( 870, 1300 ] 69 0.018% 100.140% ( 1300, 1900 ] 31 0.008% 100.148% ( 1900, 2900 ] 28 0.007% 100.155% ( 2900, 4400 ] 41 0.010% 100.166% ( 4400, 6600 ] 7 0.002% 100.168% ( 6600, 9900 ] 3 0.001% 100.168% ** Level 4 read latency histogram (micros): Count: 10518 Average: 65.9539 StdDev: 314.22 Min: 0 Median: 2.1206 Max: 7970 Percentiles: P50: 2.12 P75: 3.40 P99: 1475.94 P99.9: 3682.86 P99.99: 4328.29 ------------------------------------------------------ [ 0, 1 ] 243 2.310% 2.310% ( 1, 2 ] 4728 44.952% 47.262% ######### ( 2, 3 ] 2388 22.704% 69.966% ##### ( 3, 4 ] 1314 12.493% 82.459% ## ( 4, 6 ] 777 7.387% 89.846% # ( 6, 10 ] 244 2.320% 92.166% ( 10, 15 ] 81 0.770% 92.936% ( 15, 22 ] 10 0.095% 93.031% ( 22, 34 ] 1 0.010% 93.041% ( 34, 51 ] 1 0.010% 93.050% ( 76, 110 ] 2 0.019% 93.069% ( 110, 170 ] 20 0.190% 93.259% ( 170, 250 ] 48 0.456% 93.716% ( 250, 380 ] 79 0.751% 94.467% ( 380, 580 ] 160 1.521% 95.988% ( 580, 870 ] 177 1.683% 97.671% ( 870, 1300 ] 119 1.131% 98.802% ( 1300, 1900 ] 71 0.675% 99.477% ( 1900, 2900 ] 33 0.314% 99.791% ( 2900, 4400 ] 22 0.209% 100.000% ( 4400, 6600 ] 6 0.057% 100.057% ( 6600, 9900 ] 1 0.010% 100.067% ** Level 5 read latency histogram (micros): Count: 80 Average: 841.6500 StdDev: 936.45 Min: 76 Median: 380.0000 Max: 3710 Percentiles: P50: 380.00 P75: 1156.67 P99: 3710.00 P99.9: 3710.00 P99.99: 3710.00 ------------------------------------------------------ ( 51, 76 ] 1 1.250% 1.250% ( 76, 110 ] 8 10.000% 11.250% ## ( 110, 170 ] 11 13.750% 25.000% ### ( 170, 250 ] 14 17.500% 42.500% #### ( 250, 380 ] 6 7.500% 50.000% ## ( 380, 580 ] 5 6.250% 56.250% # ( 580, 870 ] 11 13.750% 70.000% ### ( 870, 1300 ] 6 7.500% 77.500% ## ( 1300, 1900 ] 5 6.250% 83.750% # ( 1900, 2900 ] 10 12.500% 96.250% ### ( 2900, 4400 ] 3 3.750% 100.000% # ** DB Stats ** Uptime(secs): 36.5 total, 16.8 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 188.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.878 H:M:S, 49.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 58.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:13.838 H:M:S, 82.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/15-21:19:33 ... thread 0: (1000000,8000000) ops and (243837.5,197909.5) ops/second in (4.101092,40.422508) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/7 3.19 GB 125.8 7.5 0.0 7.5 15.1 7.6 0.0 2.0 144.2 289.3 53.29 48.60 131 0.407 7802K 14K 0.0 0.0 L1 10/10 1.17 GB 0.0 5.8 4.1 1.7 5.8 4.0 0.2 1.4 231.3 228.6 25.82 24.77 3 8.607 6065K 70K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.9 2.0 249.4 249.2 1.52 1.46 2 0.758 383K 233 0.0 0.0 L3 20/0 970.40 MB 1.0 4.2 2.8 1.4 4.2 2.8 0.4 1.5 191.6 191.1 22.45 18.89 11 2.041 4369K 11K 0.0 0.0 L4 178/0 9.71 GB 1.0 2.4 2.3 0.1 2.4 2.3 0.8 1.1 138.0 137.8 17.93 11.51 34 0.527 2458K 3055 0.0 0.0 L5 1076/0 88.58 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1295/17 103.60 GB 0.0 20.3 9.4 10.9 27.8 16.9 7.4 3.7 172.0 235.2 121.00 105.24 181 0.669 21M 100K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.3 9.4 10.9 27.8 16.9 7.3 3.7 172.0 235.2 121.00 105.24 181 0.669 21M 100K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.3 9.4 10.9 20.2 9.3 0.0 0.0 213.8 212.7 97.34 85.32 73 1.333 21M 100K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 327.6 23.66 19.92 108 0.219 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 40.6 total, 40.4 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.79 GB write, 700.60 MB/s write, 20.32 GB read, 512.37 MB/s read, 121.0 seconds Interval compaction: 27.79 GB write, 703.96 MB/s write, 20.32 GB read, 514.83 MB/s read, 121.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 51, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 51, interval: 74 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3418090 Average: 2.6656 StdDev: 28.97 Min: 1 Median: 1.5368 Max: 8073 Percentiles: P50: 1.54 P75: 1.92 P99: 6.17 P99.9: 19.51 P99.99: 233.78 ------------------------------------------------------ [ 0, 1 ] 526088 15.391% 15.391% ### ( 1, 2 ] 2203897 64.477% 79.869% ############# ( 2, 3 ] 403581 11.807% 91.676% ## ( 3, 4 ] 139929 4.094% 95.770% # ( 4, 6 ] 109265 3.197% 98.966% # ( 6, 10 ] 26964 0.789% 99.755% ( 10, 15 ] 4615 0.135% 99.890% ( 15, 22 ] 518 0.015% 99.905% ( 22, 34 ] 52 0.002% 99.907% ( 34, 51 ] 26 0.001% 99.908% ( 51, 76 ] 25 0.001% 99.908% ( 76, 110 ] 1117 0.033% 99.941% ( 110, 170 ] 1327 0.039% 99.980% ( 170, 250 ] 433 0.013% 99.993% ( 250, 380 ] 361 0.011% 100.003% ( 380, 580 ] 298 0.009% 100.012% ( 580, 870 ] 201 0.006% 100.018% ( 870, 1300 ] 104 0.003% 100.021% ( 1300, 1900 ] 60 0.002% 100.023% ( 1900, 2900 ] 74 0.002% 100.025% ( 2900, 4400 ] 69 0.002% 100.027% ( 4400, 6600 ] 20 0.001% 100.027% ( 6600, 9900 ] 9 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 1268977 Average: 4.0789 StdDev: 59.18 Min: 0 Median: 1.6920 Max: 12209 Percentiles: P50: 1.69 P75: 2.40 P99: 8.74 P99.9: 138.60 P99.99: 400.12 ------------------------------------------------------ [ 0, 1 ] 116219 9.158% 9.158% ## ( 1, 2 ] 748921 59.018% 68.176% ############ ( 2, 3 ] 216097 17.029% 85.205% ### ( 3, 4 ] 85589 6.745% 91.950% # ( 4, 6 ] 74450 5.867% 97.817% # ( 6, 10 ] 21886 1.725% 99.542% ( 10, 15 ] 2985 0.235% 99.777% ( 15, 22 ] 397 0.031% 99.808% ( 22, 34 ] 23 0.002% 99.810% ( 34, 51 ] 11 0.001% 99.811% ( 51, 76 ] 81 0.006% 99.817% ( 76, 110 ] 672 0.053% 99.870% ( 110, 170 ] 791 0.062% 99.933% ( 170, 250 ] 325 0.026% 99.958% ( 250, 380 ] 370 0.029% 99.987% ( 380, 580 ] 329 0.026% 100.013% ( 580, 870 ] 276 0.022% 100.035% ( 870, 1300 ] 177 0.014% 100.049% ( 1300, 1900 ] 97 0.008% 100.057% ( 1900, 2900 ] 94 0.007% 100.064% ( 2900, 4400 ] 125 0.010% 100.074% ( 4400, 6600 ] 32 0.003% 100.076% ( 6600, 9900 ] 11 0.001% 100.077% ( 9900, 14000 ] 1 0.000% 100.077% ** Level 2 read latency histogram (micros): Count: 124204 Average: 2.3386 StdDev: 14.51 Min: 1 Median: 1.4431 Max: 2114 Percentiles: P50: 1.44 P75: 1.83 P99: 5.87 P99.9: 91.03 P99.99: 656.35 ------------------------------------------------------ [ 0, 1 ] 26515 21.348% 21.348% #### ( 1, 2 ] 80308 64.658% 86.006% ############# ( 2, 3 ] 10493 8.448% 94.454% ## ( 3, 4 ] 3529 2.841% 97.296% # ( 4, 6 ] 2266 1.824% 99.120% ( 6, 10 ] 864 0.696% 99.816% ( 10, 15 ] 71 0.057% 99.873% ( 15, 22 ] 14 0.011% 99.884% ( 51, 76 ] 3 0.002% 99.886% ( 76, 110 ] 38 0.031% 99.917% ( 110, 170 ] 41 0.033% 99.950% ( 170, 250 ] 23 0.019% 99.969% ( 250, 380 ] 18 0.014% 99.983% ( 380, 580 ] 7 0.006% 99.989% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.996% ( 1300, 1900 ] 4 0.003% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 843459 Average: 5.3179 StdDev: 76.72 Min: 1 Median: 1.9343 Max: 9194 Percentiles: P50: 1.93 P75: 2.90 P99: 8.72 P99.9: 16.10 P99.99: 155.74 ------------------------------------------------------ [ 0, 1 ] 16906 2.004% 2.004% ( 1, 2 ] 433270 51.368% 53.373% ########## ( 2, 3 ] 202740 24.037% 77.409% ##### ( 3, 4 ] 86778 10.288% 87.698% ## ( 4, 6 ] 85120 10.092% 97.789% ## ( 6, 10 ] 14995 1.778% 99.567% ( 10, 15 ] 2758 0.327% 99.894% ( 15, 22 ] 310 0.037% 99.931% ( 22, 34 ] 54 0.006% 99.937% ( 34, 51 ] 29 0.003% 99.941% ( 51, 76 ] 16 0.002% 99.943% ( 76, 110 ] 141 0.017% 99.959% ( 110, 170 ] 338 0.040% 100.000% ( 170, 250 ] 268 0.032% 100.031% ( 250, 380 ] 236 0.028% 100.059% ( 380, 580 ] 282 0.033% 100.093% ( 580, 870 ] 294 0.035% 100.128% ( 870, 1300 ] 189 0.022% 100.150% ( 1300, 1900 ] 105 0.012% 100.162% ( 1900, 2900 ] 140 0.017% 100.179% ( 2900, 4400 ] 168 0.020% 100.199% ( 4400, 6600 ] 37 0.004% 100.203% ( 6600, 9900 ] 6 0.001% 100.204% ** Level 4 read latency histogram (micros): Count: 33226 Average: 71.3465 StdDev: 375.20 Min: 0 Median: 2.0345 Max: 8961 Percentiles: P50: 2.03 P75: 3.27 P99: 1778.61 P99.9: 4322.02 P99.99: 6063.01 ------------------------------------------------------ [ 0, 1 ] 727 2.188% 2.188% ( 1, 2 ] 15628 47.035% 49.223% ######### ( 2, 3 ] 7487 22.534% 71.757% ##### ( 3, 4 ] 3962 11.924% 83.681% ## ( 4, 6 ] 2293 6.901% 90.583% # ( 6, 10 ] 743 2.236% 92.819% ( 10, 15 ] 151 0.454% 93.273% ( 15, 22 ] 24 0.072% 93.346% ( 22, 34 ] 6 0.018% 93.364% ( 34, 51 ] 5 0.015% 93.379% ( 51, 76 ] 1 0.003% 93.382% ( 76, 110 ] 33 0.099% 93.481% ( 110, 170 ] 81 0.244% 93.725% ( 170, 250 ] 170 0.512% 94.236% ( 250, 380 ] 236 0.710% 94.947% ( 380, 580 ] 420 1.264% 96.211% ( 580, 870 ] 453 1.363% 97.574% ( 870, 1300 ] 315 0.948% 98.522% ( 1300, 1900 ] 199 0.599% 99.121% ( 1900, 2900 ] 127 0.382% 99.503% ( 2900, 4400 ] 139 0.418% 99.922% ( 4400, 6600 ] 30 0.090% 100.012% ( 6600, 9900 ] 6 0.018% 100.030% ** Level 5 read latency histogram (micros): Count: 180 Average: 1283.7944 StdDev: 1403.39 Min: 76 Median: 655.6522 Max: 7591 Percentiles: P50: 655.65 P75: 2036.36 P99: 6380.00 P99.9: 7591.00 P99.99: 7591.00 ------------------------------------------------------ ( 51, 76 ] 1 0.556% 0.556% ( 76, 110 ] 11 6.111% 6.667% # ( 110, 170 ] 15 8.333% 15.000% ## ( 170, 250 ] 19 10.556% 25.556% ## ( 250, 380 ] 20 11.111% 36.667% ## ( 380, 580 ] 18 10.000% 46.667% ## ( 580, 870 ] 23 12.778% 59.444% ### ( 870, 1300 ] 12 6.667% 66.111% # ( 1300, 1900 ] 13 7.222% 73.333% # ( 1900, 2900 ] 22 12.222% 85.556% ## ( 2900, 4400 ] 17 9.444% 95.000% ## ( 4400, 6600 ] 8 4.444% 99.444% # ( 6600, 9900 ] 1 0.556% 100.000% ** DB Stats ** Uptime(secs): 40.6 total, 4.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 193.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.117 H:M:S, 47.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 239.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.240 H:M:S, 30.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-21:19:36 ... thread 0: (1000000,9000000) ops and (331893.2,207203.7) ops/second in (3.013017,43.435525) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/7 4.11 GB 226.5 8.4 0.0 8.4 16.8 8.5 0.0 2.0 144.2 290.3 59.39 54.33 147 0.404 8697K 15K 0.0 0.0 L1 10/10 1.17 GB 0.0 5.8 4.1 1.7 5.8 4.0 0.2 1.4 231.3 228.6 25.82 24.77 3 8.607 6065K 70K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.9 2.0 249.4 249.2 1.52 1.46 2 0.758 383K 233 0.0 0.0 L3 20/0 970.40 MB 1.0 4.2 2.8 1.4 4.2 2.8 0.4 1.5 191.6 191.1 22.45 18.89 11 2.041 4369K 11K 0.0 0.0 L4 178/0 9.71 GB 1.0 2.4 2.3 0.1 2.4 2.3 0.8 1.1 138.0 137.8 17.93 11.51 34 0.527 2458K 3055 0.0 0.0 L5 1076/0 88.58 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1299/17 104.52 GB 0.0 21.2 9.4 11.8 29.6 17.8 7.4 3.5 170.7 238.3 127.10 110.96 197 0.645 21M 101K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.2 9.4 11.8 29.6 17.8 7.3 3.5 170.7 238.3 127.10 110.96 197 0.645 21M 101K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.2 9.4 11.8 21.1 9.3 0.0 0.0 215.5 214.4 100.69 88.59 76 1.325 21M 101K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 329.1 26.42 22.37 121 0.218 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.6 total, 43.4 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.57 GB write, 694.07 MB/s write, 21.18 GB read, 497.20 MB/s read, 127.1 seconds Interval compaction: 29.57 GB write, 697.17 MB/s write, 21.18 GB read, 499.42 MB/s read, 127.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 56, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 56, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3695614 Average: 2.6430 StdDev: 28.02 Min: 1 Median: 1.5374 Max: 8073 Percentiles: P50: 1.54 P75: 1.92 P99: 6.07 P99.9: 17.03 P99.99: 227.69 ------------------------------------------------------ [ 0, 1 ] 561464 15.193% 15.193% ### ( 1, 2 ] 2393559 64.768% 79.960% ############# ( 2, 3 ] 437694 11.844% 91.804% ## ( 3, 4 ] 149708 4.051% 95.855% # ( 4, 6 ] 115755 3.132% 98.987% # ( 6, 10 ] 28528 0.772% 99.759% ( 10, 15 ] 5054 0.137% 99.896% ( 15, 22 ] 538 0.015% 99.910% ( 22, 34 ] 54 0.001% 99.912% ( 34, 51 ] 27 0.001% 99.913% ( 51, 76 ] 28 0.001% 99.913% ( 76, 110 ] 1135 0.031% 99.944% ( 110, 170 ] 1368 0.037% 99.981% ( 170, 250 ] 461 0.012% 99.993% ( 250, 380 ] 377 0.010% 100.004% ( 380, 580 ] 312 0.008% 100.012% ( 580, 870 ] 218 0.006% 100.018% ( 870, 1300 ] 109 0.003% 100.021% ( 1300, 1900 ] 63 0.002% 100.023% ( 1900, 2900 ] 75 0.002% 100.025% ( 2900, 4400 ] 69 0.002% 100.027% ( 4400, 6600 ] 20 0.001% 100.027% ( 6600, 9900 ] 9 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 1388535 Average: 3.9511 StdDev: 56.65 Min: 0 Median: 1.6799 Max: 12209 Percentiles: P50: 1.68 P75: 2.35 P99: 8.70 P99.9: 137.58 P99.99: 404.06 ------------------------------------------------------ [ 0, 1 ] 129063 9.295% 9.295% ## ( 1, 2 ] 831345 59.872% 69.167% ############ ( 2, 3 ] 231203 16.651% 85.818% ### ( 3, 4 ] 89639 6.456% 92.274% # ( 4, 6 ] 77321 5.569% 97.842% # ( 6, 10 ] 23781 1.713% 99.555% ( 10, 15 ] 3121 0.225% 99.779% ( 15, 22 ] 409 0.029% 99.809% ( 22, 34 ] 23 0.002% 99.811% ( 34, 51 ] 11 0.001% 99.811% ( 51, 76 ] 88 0.006% 99.818% ( 76, 110 ] 745 0.054% 99.871% ( 110, 170 ] 867 0.062% 99.934% ( 170, 250 ] 356 0.026% 99.959% ( 250, 380 ] 384 0.028% 99.987% ( 380, 580 ] 342 0.025% 100.012% ( 580, 870 ] 281 0.020% 100.032% ( 870, 1300 ] 179 0.013% 100.045% ( 1300, 1900 ] 97 0.007% 100.052% ( 1900, 2900 ] 94 0.007% 100.059% ( 2900, 4400 ] 125 0.009% 100.068% ( 4400, 6600 ] 32 0.002% 100.070% ( 6600, 9900 ] 11 0.001% 100.071% ( 9900, 14000 ] 1 0.000% 100.071% ** Level 2 read latency histogram (micros): Count: 124204 Average: 2.3386 StdDev: 14.51 Min: 1 Median: 1.4431 Max: 2114 Percentiles: P50: 1.44 P75: 1.83 P99: 5.87 P99.9: 91.03 P99.99: 656.35 ------------------------------------------------------ [ 0, 1 ] 26515 21.348% 21.348% #### ( 1, 2 ] 80308 64.658% 86.006% ############# ( 2, 3 ] 10493 8.448% 94.454% ## ( 3, 4 ] 3529 2.841% 97.296% # ( 4, 6 ] 2266 1.824% 99.120% ( 6, 10 ] 864 0.696% 99.816% ( 10, 15 ] 71 0.057% 99.873% ( 15, 22 ] 14 0.011% 99.884% ( 51, 76 ] 3 0.002% 99.886% ( 76, 110 ] 38 0.031% 99.917% ( 110, 170 ] 41 0.033% 99.950% ( 170, 250 ] 23 0.019% 99.969% ( 250, 380 ] 18 0.014% 99.983% ( 380, 580 ] 7 0.006% 99.989% ( 580, 870 ] 6 0.005% 99.994% ( 870, 1300 ] 3 0.002% 99.996% ( 1300, 1900 ] 4 0.003% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 843459 Average: 5.3179 StdDev: 76.72 Min: 1 Median: 1.9343 Max: 9194 Percentiles: P50: 1.93 P75: 2.90 P99: 8.72 P99.9: 16.10 P99.99: 155.74 ------------------------------------------------------ [ 0, 1 ] 16906 2.004% 2.004% ( 1, 2 ] 433270 51.368% 53.373% ########## ( 2, 3 ] 202740 24.037% 77.409% ##### ( 3, 4 ] 86778 10.288% 87.698% ## ( 4, 6 ] 85120 10.092% 97.789% ## ( 6, 10 ] 14995 1.778% 99.567% ( 10, 15 ] 2758 0.327% 99.894% ( 15, 22 ] 310 0.037% 99.931% ( 22, 34 ] 54 0.006% 99.937% ( 34, 51 ] 29 0.003% 99.941% ( 51, 76 ] 16 0.002% 99.943% ( 76, 110 ] 141 0.017% 99.959% ( 110, 170 ] 338 0.040% 100.000% ( 170, 250 ] 268 0.032% 100.031% ( 250, 380 ] 236 0.028% 100.059% ( 380, 580 ] 282 0.033% 100.093% ( 580, 870 ] 294 0.035% 100.128% ( 870, 1300 ] 189 0.022% 100.150% ( 1300, 1900 ] 105 0.012% 100.162% ( 1900, 2900 ] 140 0.017% 100.179% ( 2900, 4400 ] 168 0.020% 100.199% ( 4400, 6600 ] 37 0.004% 100.203% ( 6600, 9900 ] 6 0.001% 100.204% ** Level 4 read latency histogram (micros): Count: 33226 Average: 71.3465 StdDev: 375.20 Min: 0 Median: 2.0345 Max: 8961 Percentiles: P50: 2.03 P75: 3.27 P99: 1778.61 P99.9: 4322.02 P99.99: 6063.01 ------------------------------------------------------ [ 0, 1 ] 727 2.188% 2.188% ( 1, 2 ] 15628 47.035% 49.223% ######### ( 2, 3 ] 7487 22.534% 71.757% ##### ( 3, 4 ] 3962 11.924% 83.681% ## ( 4, 6 ] 2293 6.901% 90.583% # ( 6, 10 ] 743 2.236% 92.819% ( 10, 15 ] 151 0.454% 93.273% ( 15, 22 ] 24 0.072% 93.346% ( 22, 34 ] 6 0.018% 93.364% ( 34, 51 ] 5 0.015% 93.379% ( 51, 76 ] 1 0.003% 93.382% ( 76, 110 ] 33 0.099% 93.481% ( 110, 170 ] 81 0.244% 93.725% ( 170, 250 ] 170 0.512% 94.236% ( 250, 380 ] 236 0.710% 94.947% ( 380, 580 ] 420 1.264% 96.211% ( 580, 870 ] 453 1.363% 97.574% ( 870, 1300 ] 315 0.948% 98.522% ( 1300, 1900 ] 199 0.599% 99.121% ( 1900, 2900 ] 127 0.382% 99.503% ( 2900, 4400 ] 139 0.418% 99.922% ( 4400, 6600 ] 30 0.090% 100.012% ( 6600, 9900 ] 6 0.018% 100.030% ** Level 5 read latency histogram (micros): Count: 180 Average: 1283.7944 StdDev: 1403.39 Min: 76 Median: 655.6522 Max: 7591 Percentiles: P50: 655.65 P75: 2036.36 P99: 6380.00 P99.9: 7591.00 P99.99: 7591.00 ------------------------------------------------------ ( 51, 76 ] 1 0.556% 0.556% ( 76, 110 ] 11 6.111% 6.667% # ( 110, 170 ] 15 8.333% 15.000% ## ( 170, 250 ] 19 10.556% 25.556% ## ( 250, 380 ] 20 11.111% 36.667% ## ( 380, 580 ] 18 10.000% 46.667% ## ( 580, 870 ] 23 12.778% 59.444% ### ( 870, 1300 ] 12 6.667% 66.111% # ( 1300, 1900 ] 13 7.222% 73.333% # ( 1900, 2900 ] 22 12.222% 85.556% ## ( 2900, 4400 ] 17 9.444% 95.000% ## ( 4400, 6600 ] 8 4.444% 99.444% # ( 6600, 9900 ] 1 0.556% 100.000% ** DB Stats ** Uptime(secs): 43.6 total, 3.0 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 203.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.577 H:M:S, 44.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.460 H:M:S, 15.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.104 micros/op 163833 ops/sec 60.073 seconds 9841999 operations; 158.7 MB/s Microseconds per write: Count: 9841999 Average: 6.1037 StdDev: 367.23 Min: 0 Median: 1.7210 Max: 573471 Percentiles: P50: 1.72 P75: 2.66 P99: 8.50 P99.9: 1186.69 P99.99: 2732.03 ------------------------------------------------------ [ 0, 1 ] 1465533 14.891% 14.891% ### ( 1, 2 ] 4792421 48.694% 63.584% ########## ( 2, 3 ] 1694624 17.218% 80.802% ### ( 3, 4 ] 1283729 13.043% 93.846% ### ( 4, 6 ] 449395 4.566% 98.412% # ( 6, 10 ] 92494 0.940% 99.352% ( 10, 15 ] 23062 0.234% 99.586% ( 15, 22 ] 6844 0.070% 99.656% ( 22, 34 ] 1703 0.017% 99.673% ( 34, 51 ] 169 0.002% 99.675% ( 51, 76 ] 10 0.000% 99.675% ( 76, 110 ] 7004 0.071% 99.746% ( 110, 170 ] 2564 0.026% 99.772% ( 170, 250 ] 293 0.003% 99.775% ( 250, 380 ] 88 0.001% 99.776% ( 380, 580 ] 18 0.000% 99.776% ( 580, 870 ] 18 0.000% 99.776% ( 870, 1300 ] 16549 0.168% 99.944% ( 1300, 1900 ] 18 0.000% 99.944% ( 1900, 2900 ] 5383 0.055% 99.999% ( 2900, 4400 ] 47 0.000% 100.000% ( 4400, 6600 ] 2 0.000% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 6 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 75000, 110000 ] 2 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 194335 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9841999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10156942968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 515 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33685460 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30562769976 rocksdb.compact.write.bytes COUNT : 30376664717 rocksdb.flush.write.bytes COUNT : 10106717124 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 48 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 294 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10025315328 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3971072 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30652236038 rocksdb.non.last.level.read.count COUNT : 7407354 rocksdb.block.checksum.compute.count COUNT : 7406372 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.353905 P95 : 3.799147 P99 : 6.842637 P100 : 573467.000000 COUNT : 9841999 SUM : 55590474 rocksdb.compaction.times.micros P50 : 914090.909091 P95 : 4183333.333333 P99 : 16632024.000000 P100 : 16632024.000000 COUNT : 85 SUM : 120745164 rocksdb.compaction.times.cpu_micros P50 : 896060.606061 P95 : 3950000.000000 P99 : 15200000.000000 P100 : 15882063.000000 COUNT : 85 SUM : 106564977 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 712.469136 P95 : 2200.000000 P99 : 12606.000000 P100 : 77283.000000 COUNT : 134 SUM : 205103 rocksdb.compaction.outfile.sync.micros P50 : 979.836957 P95 : 11624.411765 P99 : 19062.857143 P100 : 30113.000000 COUNT : 357 SUM : 847665 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 102.333333 P95 : 1033.400000 P99 : 3335.000000 P100 : 5644.000000 COUNT : 242 SUM : 61314 rocksdb.table.open.io.micros P50 : 1356.666667 P95 : 7237.500000 P99 : 11569.285714 P100 : 16957.000000 COUNT : 515 SUM : 1016115 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.605814 P95 : 7.261765 P99 : 9.948959 P100 : 12215.000000 COUNT : 7404900 SUM : 41026098 rocksdb.read.block.get.micros P50 : 436.000000 P95 : 3231.395349 P99 : 5396.470588 P100 : 7750.000000 COUNT : 1030 SUM : 822808 rocksdb.write.raw.block.micros P50 : 0.512024 P95 : 0.972847 P99 : 2.750905 P100 : 11846.000000 COUNT : 9804971 SUM : 18598204 rocksdb.numfiles.in.singlecompaction P50 : 3.100000 P95 : 6.533333 P99 : 32.560000 P100 : 41.000000 COUNT : 112 SUM : 436 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562417 P95 : 1182.767436 P99 : 2536.285661 P100 : 573275.000000 COUNT : 198260 SUM : 33699952 rocksdb.sst.read.micros P50 : 1.572139 P95 : 4.304468 P99 : 7.717043 P100 : 12209.000000 COUNT : 7407531 SUM : 26054547 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9841999 SUM : 10156942968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212666.666667 P95 : 368950.000000 P99 : 553850.000000 P100 : 732683.000000 COUNT : 134 SUM : 29068982 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 322 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0