[2024-11-17 10:05:47.726160] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-11-17 10:05:47.726301] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1987577 ] Set seed to 1731834347722652 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-17 10:05:47.836058] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-17 10:05:48.046557] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-17 10:05:48.046607] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1987577' to capture a snapshot of events at runtime. [2024-11-17 10:05:48.046618] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1987577 for offline analysis/debug. [2024-11-17 10:05:48.046643] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 17 10:05:56 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/17-10:05:59 ... thread 0: (1000000,1000000) ops and (336709.4,336709.4) ops/second in (2.969920,2.969920) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/10 693.01 MB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 356.3 2.48 2.21 12 0.206 0 0 0.0 0.0 L2 3/2 237.08 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 243.0 242.8 1.43 1.38 2 0.717 353K 170 0.0 0.0 L3 7/0 629.94 MB 0.6 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.66 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1032/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1168/12 97.00 GB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 89.1 314.7 3.91 3.59 14 0.279 353K 170 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 89.1 314.7 3.91 3.59 14 0.279 353K 170 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 243.0 242.8 1.43 1.38 2 0.717 353K 170 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 356.3 2.48 2.21 12 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.20 GB write, 380.42 MB/s write, 0.34 GB read, 107.77 MB/s read, 3.9 seconds Interval compaction: 1.20 GB write, 413.88 MB/s write, 0.34 GB read, 117.25 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 117409 Average: 2.0809 StdDev: 13.32 Min: 0 Median: 1.3936 Max: 3043 Percentiles: P50: 1.39 P75: 1.78 P99: 5.43 P99.9: 11.93 P99.99: 142.59 ------------------------------------------------------ [ 0, 1 ] 28834 24.559% 24.559% ##### ( 1, 2 ] 75885 64.633% 89.192% ############# ( 2, 3 ] 7479 6.370% 95.562% # ( 3, 4 ] 2835 2.415% 97.976% ( 4, 6 ] 1683 1.433% 99.410% ( 6, 10 ] 526 0.448% 99.858% ( 10, 15 ] 134 0.114% 99.972% ( 15, 22 ] 10 0.009% 99.980% ( 22, 34 ] 4 0.003% 99.984% ( 34, 51 ] 3 0.003% 99.986% ( 51, 76 ] 2 0.002% 99.988% ( 76, 110 ] 1 0.001% 99.989% ( 110, 170 ] 6 0.005% 99.994% ( 170, 250 ] 4 0.003% 99.997% ( 250, 380 ] 3 0.003% 100.000% ( 380, 580 ] 4 0.003% 100.003% ( 580, 870 ] 2 0.002% 100.005% ( 870, 1300 ] 2 0.002% 100.007% ( 1300, 1900 ] 1 0.001% 100.008% ( 1900, 2900 ] 1 0.001% 100.009% ( 2900, 4400 ] 1 0.001% 100.009% ** Level 1 read latency histogram (micros): Count: 12269 Average: 3.0161 StdDev: 43.03 Min: 1 Median: 1.3010 Max: 3681 Percentiles: P50: 1.30 P75: 1.71 P99: 10.89 P99.9: 164.62 P99.99: 2673.10 ------------------------------------------------------ [ 0, 1 ] 3871 31.551% 31.551% ###### ( 1, 2 ] 7519 61.285% 92.836% ############ ( 2, 3 ] 408 3.325% 96.161% # ( 3, 4 ] 112 0.913% 97.074% ( 4, 6 ] 57 0.465% 97.539% ( 6, 10 ] 169 1.377% 98.916% ( 10, 15 ] 58 0.473% 99.389% ( 15, 22 ] 6 0.049% 99.438% ( 51, 76 ] 44 0.359% 99.796% ( 76, 110 ] 10 0.082% 99.878% ( 110, 170 ] 3 0.024% 99.902% ( 170, 250 ] 4 0.033% 99.935% ( 250, 380 ] 3 0.024% 99.959% ( 380, 580 ] 2 0.016% 99.976% ( 580, 870 ] 1 0.008% 99.984% ( 1900, 2900 ] 1 0.008% 99.992% ( 2900, 4400 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 70663 Average: 2.0247 StdDev: 13.83 Min: 0 Median: 1.3877 Max: 3500 Percentiles: P50: 1.39 P75: 1.77 P99: 5.37 P99.9: 10.21 P99.99: 208.67 ------------------------------------------------------ [ 0, 1 ] 17272 24.443% 24.443% ##### ( 1, 2 ] 46581 65.920% 90.363% ############# ( 2, 3 ] 3743 5.297% 95.660% # ( 3, 4 ] 1693 2.396% 98.056% ( 4, 6 ] 979 1.385% 99.441% ( 6, 10 ] 323 0.457% 99.898% ( 10, 15 ] 55 0.078% 99.976% ( 15, 22 ] 8 0.011% 99.987% ( 110, 170 ] 1 0.001% 99.989% ( 170, 250 ] 4 0.006% 99.994% ( 250, 380 ] 3 0.004% 99.999% ( 580, 870 ] 1 0.001% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 35 Average: 3354.2286 StdDev: 2870.18 Min: 252 Median: 2733.3333 Max: 10189 Percentiles: P50: 2733.33 P75: 5087.50 P99: 10189.00 P99.9: 10189.00 P99.99: 10189.00 ------------------------------------------------------ ( 250, 380 ] 2 5.714% 5.714% # ( 380, 580 ] 3 8.571% 14.286% ## ( 580, 870 ] 5 14.286% 28.571% ### ( 870, 1300 ] 3 8.571% 37.143% ## ( 1300, 1900 ] 2 5.714% 42.857% # ( 1900, 2900 ] 3 8.571% 51.429% ## ( 2900, 4400 ] 7 20.000% 71.429% #### ( 4400, 6600 ] 4 11.429% 82.857% ## ( 6600, 9900 ] 5 14.286% 97.143% ### ( 9900, 14000 ] 1 2.857% 100.000% # ** Level 4 read latency histogram (micros): Count: 40 Average: 3598.5500 StdDev: 2626.91 Min: 531 Median: 2900.0000 Max: 9474 Percentiles: P50: 2900.00 P75: 5866.67 P99: 9474.00 P99.9: 9474.00 P99.99: 9474.00 ------------------------------------------------------ ( 380, 580 ] 1 2.500% 2.500% # ( 580, 870 ] 3 7.500% 10.000% ## ( 870, 1300 ] 5 12.500% 22.500% ### ( 1300, 1900 ] 9 22.500% 45.000% ##### ( 1900, 2900 ] 2 5.000% 50.000% # ( 2900, 4400 ] 6 15.000% 65.000% ### ( 4400, 6600 ] 6 15.000% 80.000% ### ( 6600, 9900 ] 8 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 304.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.412 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.412 H:M:S, 13.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/17-10:06:02 ... thread 0: (1000000,2000000) ops and (350784.5,343602.9) ops/second in (2.850753,5.820673) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 1.23 GB 69.2 0.6 0.0 0.6 2.3 1.8 0.0 1.3 77.2 325.8 7.35 6.74 28 0.262 575K 625 0.0 0.0 L1 1/0 2.63 MB 0.3 0.4 0.4 0.0 0.4 0.4 0.2 1.0 234.1 233.7 1.61 1.57 1 1.615 383K 577 0.0 0.0 L2 1/0 49.55 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 243.0 242.8 1.43 1.38 2 0.717 353K 170 0.0 0.0 L3 35/0 980.53 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.3 201.7 201.5 3.72 3.29 3 1.239 761K 736 0.0 0.0 L4 136/0 9.56 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1036/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1221/8 97.92 GB 0.0 2.0 1.1 0.9 3.8 2.9 1.1 2.1 144.8 274.1 14.11 12.98 34 0.415 2074K 2108 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 1.1 0.9 3.8 2.9 1.1 2.1 144.8 274.1 14.11 12.98 34 0.415 2074K 2108 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 1.1 0.9 2.0 1.1 0.0 0.0 228.5 228.2 8.94 8.37 8 1.118 2074K 2108 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.4 5.17 4.61 26 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.78 GB write, 635.69 MB/s write, 2.00 GB read, 335.81 MB/s read, 14.1 seconds Interval compaction: 3.78 GB write, 664.24 MB/s write, 2.00 GB read, 350.89 MB/s read, 14.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 397341 Average: 2.2368 StdDev: 10.24 Min: 0 Median: 1.5137 Max: 3043 Percentiles: P50: 1.51 P75: 1.89 P99: 5.75 P99.9: 10.21 P99.99: 14.75 ------------------------------------------------------ [ 0, 1 ] 63419 15.961% 15.961% ### ( 1, 2 ] 263293 66.264% 82.225% ############# ( 2, 3 ] 42602 10.722% 92.946% ## ( 3, 4 ] 14439 3.634% 96.580% # ( 4, 6 ] 10978 2.763% 99.343% # ( 6, 10 ] 2197 0.553% 99.896% ( 10, 15 ] 394 0.099% 99.995% ( 15, 22 ] 27 0.007% 100.002% ( 22, 34 ] 4 0.001% 100.003% ( 34, 51 ] 5 0.001% 100.004% ( 51, 76 ] 3 0.001% 100.005% ( 76, 110 ] 1 0.000% 100.005% ( 110, 170 ] 13 0.003% 100.009% ( 170, 250 ] 9 0.002% 100.011% ( 250, 380 ] 5 0.001% 100.012% ( 380, 580 ] 10 0.003% 100.015% ( 580, 870 ] 7 0.002% 100.016% ( 870, 1300 ] 7 0.002% 100.018% ( 1300, 1900 ] 2 0.001% 100.019% ( 1900, 2900 ] 2 0.001% 100.019% ( 2900, 4400 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 107388 Average: 2.5728 StdDev: 16.16 Min: 1 Median: 1.6456 Max: 3681 Percentiles: P50: 1.65 P75: 2.15 P99: 7.03 P99.9: 14.43 P99.99: 87.09 ------------------------------------------------------ [ 0, 1 ] 9932 9.249% 9.249% ## ( 1, 2 ] 67786 63.123% 72.371% ############# ( 2, 3 ] 18541 17.265% 89.637% ### ( 3, 4 ] 4979 4.636% 94.273% # ( 4, 6 ] 4815 4.484% 98.757% # ( 6, 10 ] 1013 0.943% 99.700% ( 10, 15 ] 242 0.225% 99.926% ( 15, 22 ] 20 0.019% 99.944% ( 22, 34 ] 1 0.001% 99.945% ( 51, 76 ] 45 0.042% 99.987% ( 76, 110 ] 10 0.009% 99.996% ( 110, 170 ] 3 0.003% 99.999% ( 170, 250 ] 4 0.004% 100.003% ( 250, 380 ] 6 0.006% 100.008% ( 380, 580 ] 2 0.002% 100.010% ( 580, 870 ] 1 0.001% 100.011% ( 870, 1300 ] 2 0.002% 100.013% ( 1300, 1900 ] 1 0.001% 100.014% ( 1900, 2900 ] 1 0.001% 100.015% ( 2900, 4400 ] 1 0.001% 100.016% ** Level 2 read latency histogram (micros): Count: 75884 Average: 2.0472 StdDev: 13.35 Min: 0 Median: 1.4044 Max: 3500 Percentiles: P50: 1.40 P75: 1.78 P99: 5.46 P99.9: 10.18 P99.99: 198.23 ------------------------------------------------------ [ 0, 1 ] 17683 23.303% 23.303% ##### ( 1, 2 ] 50099 66.021% 89.323% ############# ( 2, 3 ] 4517 5.953% 95.276% # ( 3, 4 ] 1945 2.563% 97.839% # ( 4, 6 ] 1206 1.589% 99.428% ( 6, 10 ] 356 0.469% 99.897% ( 10, 15 ] 59 0.078% 99.975% ( 15, 22 ] 9 0.012% 99.987% ( 110, 170 ] 1 0.001% 99.988% ( 170, 250 ] 4 0.005% 99.993% ( 250, 380 ] 3 0.004% 99.997% ( 580, 870 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47939 Average: 5.0159 StdDev: 119.60 Min: 1 Median: 1.6594 Max: 10189 Percentiles: P50: 1.66 P75: 2.19 P99: 6.87 P99.9: 42.76 P99.99: 4229.88 ------------------------------------------------------ [ 0, 1 ] 3748 7.818% 7.818% ## ( 1, 2 ] 30668 63.973% 71.791% ############# ( 2, 3 ] 8193 17.090% 88.882% ### ( 3, 4 ] 2506 5.227% 94.109% # ( 4, 6 ] 2266 4.727% 98.836% # ( 6, 10 ] 363 0.757% 99.593% ( 10, 15 ] 117 0.244% 99.837% ( 15, 22 ] 17 0.035% 99.873% ( 22, 34 ] 11 0.023% 99.896% ( 34, 51 ] 4 0.008% 99.904% ( 110, 170 ] 6 0.013% 99.917% ( 170, 250 ] 1 0.002% 99.919% ( 250, 380 ] 7 0.015% 99.933% ( 380, 580 ] 6 0.013% 99.946% ( 580, 870 ] 6 0.013% 99.958% ( 870, 1300 ] 3 0.006% 99.965% ( 1300, 1900 ] 3 0.006% 99.971% ( 1900, 2900 ] 3 0.006% 99.977% ( 2900, 4400 ] 7 0.015% 99.992% ( 4400, 6600 ] 4 0.008% 100.000% ( 6600, 9900 ] 5 0.010% 100.010% ( 9900, 14000 ] 1 0.002% 100.013% ** Level 4 read latency histogram (micros): Count: 40 Average: 3598.5500 StdDev: 2626.91 Min: 531 Median: 2900.0000 Max: 9474 Percentiles: P50: 2900.00 P75: 5866.67 P99: 9474.00 P99.9: 9474.00 P99.99: 9474.00 ------------------------------------------------------ ( 380, 580 ] 1 2.500% 2.500% # ( 580, 870 ] 3 7.500% 10.000% ## ( 870, 1300 ] 5 12.500% 22.500% ### ( 1300, 1900 ] 9 22.500% 45.000% ##### ( 1900, 2900 ] 2 5.000% 50.000% # ( 2900, 4400 ] 6 15.000% 65.000% ### ( 4400, 6600 ] 6 15.000% 80.000% ### ( 6600, 9900 ] 8 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 802.4500 StdDev: 919.48 Min: 83 Median: 380.0000 Max: 2971 Percentiles: P50: 380.00 P75: 1156.67 P99: 2971.00 P99.9: 2971.00 P99.99: 2971.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 5 25.000% 40.000% ##### ( 250, 380 ] 2 10.000% 50.000% ## ( 380, 580 ] 2 10.000% 60.000% ## ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 3 15.000% 80.000% ### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 323.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.638 H:M:S, 10.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 345.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.226 H:M:S, 7.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-10:06:05 ... thread 0: (1000000,3000000) ops and (341086.8,342760.1) ops/second in (2.931805,8.752478) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.15 GB 188.8 1.7 0.0 1.7 4.4 2.7 0.0 1.6 119.0 312.7 14.30 13.35 45 0.318 1727K 1816 0.0 0.0 L1 1/0 2.63 MB 0.3 0.4 0.4 0.0 0.4 0.4 0.2 1.0 234.1 233.7 1.61 1.57 1 1.615 383K 577 0.0 0.0 L2 1/0 49.55 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 243.0 242.8 1.43 1.38 2 0.717 353K 170 0.0 0.0 L3 35/0 980.53 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.3 201.7 201.5 3.72 3.29 3 1.239 761K 736 0.0 0.0 L4 136/0 9.56 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1036/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1222/4 98.84 GB 0.0 3.1 1.1 2.0 5.8 3.8 1.1 2.1 150.9 282.3 21.06 19.59 51 0.413 3226K 3299 0.0 0.0 Int 0/0 0.00 KB 0.0 3.1 1.1 2.0 5.8 3.8 1.1 2.1 150.9 282.3 21.06 19.59 51 0.413 3226K 3299 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.1 1.1 2.0 3.1 1.1 0.0 0.0 238.8 238.6 13.30 12.65 12 1.109 3226K 3299 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 357.2 7.76 6.94 39 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.81 GB write, 659.41 MB/s write, 3.10 GB read, 352.38 MB/s read, 21.1 seconds Interval compaction: 5.81 GB write, 679.11 MB/s write, 3.10 GB read, 362.91 MB/s read, 21.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 627421 Average: 2.1369 StdDev: 11.01 Min: 0 Median: 1.4538 Max: 3043 Percentiles: P50: 1.45 P75: 1.83 P99: 5.57 P99.9: 10.23 P99.99: 17.32 ------------------------------------------------------ [ 0, 1 ] 125092 19.937% 19.937% #### ( 1, 2 ] 415684 66.253% 86.190% ############# ( 2, 3 ] 52301 8.336% 94.526% ## ( 3, 4 ] 17913 2.855% 97.381% # ( 4, 6 ] 12908 2.057% 99.438% ( 6, 10 ] 2869 0.457% 99.896% ( 10, 15 ] 574 0.091% 99.987% ( 15, 22 ] 52 0.008% 99.996% ( 22, 34 ] 10 0.002% 99.997% ( 34, 51 ] 7 0.001% 99.998% ( 51, 76 ] 5 0.001% 99.999% ( 76, 110 ] 1 0.000% 99.999% ( 110, 170 ] 20 0.003% 100.002% ( 170, 250 ] 13 0.002% 100.004% ( 250, 380 ] 7 0.001% 100.006% ( 380, 580 ] 17 0.003% 100.008% ( 580, 870 ] 11 0.002% 100.010% ( 870, 1300 ] 12 0.002% 100.012% ( 1300, 1900 ] 4 0.001% 100.013% ( 1900, 2900 ] 5 0.001% 100.013% ( 2900, 4400 ] 1 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 107388 Average: 2.5728 StdDev: 16.16 Min: 1 Median: 1.6456 Max: 3681 Percentiles: P50: 1.65 P75: 2.15 P99: 7.03 P99.9: 14.43 P99.99: 87.09 ------------------------------------------------------ [ 0, 1 ] 9932 9.249% 9.249% ## ( 1, 2 ] 67786 63.123% 72.371% ############# ( 2, 3 ] 18541 17.265% 89.637% ### ( 3, 4 ] 4979 4.636% 94.273% # ( 4, 6 ] 4815 4.484% 98.757% # ( 6, 10 ] 1013 0.943% 99.700% ( 10, 15 ] 242 0.225% 99.926% ( 15, 22 ] 20 0.019% 99.944% ( 22, 34 ] 1 0.001% 99.945% ( 51, 76 ] 45 0.042% 99.987% ( 76, 110 ] 10 0.009% 99.996% ( 110, 170 ] 3 0.003% 99.999% ( 170, 250 ] 4 0.004% 100.003% ( 250, 380 ] 6 0.006% 100.008% ( 380, 580 ] 2 0.002% 100.010% ( 580, 870 ] 1 0.001% 100.011% ( 870, 1300 ] 2 0.002% 100.013% ( 1300, 1900 ] 1 0.001% 100.014% ( 1900, 2900 ] 1 0.001% 100.015% ( 2900, 4400 ] 1 0.001% 100.016% ** Level 2 read latency histogram (micros): Count: 75884 Average: 2.0472 StdDev: 13.35 Min: 0 Median: 1.4044 Max: 3500 Percentiles: P50: 1.40 P75: 1.78 P99: 5.46 P99.9: 10.18 P99.99: 198.23 ------------------------------------------------------ [ 0, 1 ] 17683 23.303% 23.303% ##### ( 1, 2 ] 50099 66.021% 89.323% ############# ( 2, 3 ] 4517 5.953% 95.276% # ( 3, 4 ] 1945 2.563% 97.839% # ( 4, 6 ] 1206 1.589% 99.428% ( 6, 10 ] 356 0.469% 99.897% ( 10, 15 ] 59 0.078% 99.975% ( 15, 22 ] 9 0.012% 99.987% ( 110, 170 ] 1 0.001% 99.988% ( 170, 250 ] 4 0.005% 99.993% ( 250, 380 ] 3 0.004% 99.997% ( 580, 870 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47939 Average: 5.0159 StdDev: 119.60 Min: 1 Median: 1.6594 Max: 10189 Percentiles: P50: 1.66 P75: 2.19 P99: 6.87 P99.9: 42.76 P99.99: 4229.88 ------------------------------------------------------ [ 0, 1 ] 3748 7.818% 7.818% ## ( 1, 2 ] 30668 63.973% 71.791% ############# ( 2, 3 ] 8193 17.090% 88.882% ### ( 3, 4 ] 2506 5.227% 94.109% # ( 4, 6 ] 2266 4.727% 98.836% # ( 6, 10 ] 363 0.757% 99.593% ( 10, 15 ] 117 0.244% 99.837% ( 15, 22 ] 17 0.035% 99.873% ( 22, 34 ] 11 0.023% 99.896% ( 34, 51 ] 4 0.008% 99.904% ( 110, 170 ] 6 0.013% 99.917% ( 170, 250 ] 1 0.002% 99.919% ( 250, 380 ] 7 0.015% 99.933% ( 380, 580 ] 6 0.013% 99.946% ( 580, 870 ] 6 0.013% 99.958% ( 870, 1300 ] 3 0.006% 99.965% ( 1300, 1900 ] 3 0.006% 99.971% ( 1900, 2900 ] 3 0.006% 99.977% ( 2900, 4400 ] 7 0.015% 99.992% ( 4400, 6600 ] 4 0.008% 100.000% ( 6600, 9900 ] 5 0.010% 100.010% ( 9900, 14000 ] 1 0.002% 100.013% ** Level 4 read latency histogram (micros): Count: 40 Average: 3598.5500 StdDev: 2626.91 Min: 531 Median: 2900.0000 Max: 9474 Percentiles: P50: 2900.00 P75: 5866.67 P99: 9474.00 P99.9: 9474.00 P99.99: 9474.00 ------------------------------------------------------ ( 380, 580 ] 1 2.500% 2.500% # ( 580, 870 ] 3 7.500% 10.000% ## ( 870, 1300 ] 5 12.500% 22.500% ### ( 1300, 1900 ] 9 22.500% 45.000% ##### ( 1900, 2900 ] 2 5.000% 50.000% # ( 2900, 4400 ] 6 15.000% 65.000% ### ( 4400, 6600 ] 6 15.000% 80.000% ### ( 6600, 9900 ] 8 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 802.4500 StdDev: 919.48 Min: 83 Median: 380.0000 Max: 2971 Percentiles: P50: 380.00 P75: 1156.67 P99: 2971.00 P99.9: 2971.00 P99.99: 2971.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 5 25.000% 40.000% ##### ( 250, 380 ] 2 10.000% 50.000% ## ( 380, 580 ] 2 10.000% 60.000% ## ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 3 15.000% 80.000% ### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 327.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.000 H:M:S, 11.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 335.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.362 H:M:S, 12.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-10:06:08 ... thread 0: (1000000,4000000) ops and (291567.5,328347.5) ops/second in (3.429737,12.182215) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 3.20 GB 44.1 2.5 0.0 2.5 6.3 3.7 0.0 1.7 124.9 310.6 20.68 19.36 63 0.328 2622K 2842 0.0 0.0 L1 1/1 2.63 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 234.1 233.7 1.61 1.57 1 1.615 383K 577 0.0 0.0 L2 1/0 49.55 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 243.0 242.8 1.43 1.38 2 0.717 353K 170 0.0 0.0 L3 35/0 980.53 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.3 201.7 201.5 3.72 3.29 3 1.239 761K 736 0.0 0.0 L4 136/0 9.56 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1036/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1228/17 99.88 GB 0.0 4.0 1.1 2.9 7.7 4.9 1.1 2.1 147.9 287.8 27.44 25.59 69 0.398 4121K 4325 0.0 0.0 Int 0/0 0.00 KB 0.0 4.0 1.1 2.9 7.7 4.9 1.1 2.1 147.9 287.8 27.44 25.59 69 0.398 4121K 4325 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.0 1.1 2.9 4.0 1.1 0.0 0.0 243.4 243.1 16.68 15.96 15 1.112 4121K 4325 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 357.0 10.77 9.63 54 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.2 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.71 GB write, 634.52 MB/s write, 3.96 GB read, 326.14 MB/s read, 27.4 seconds Interval compaction: 7.71 GB write, 648.14 MB/s write, 3.96 GB read, 333.14 MB/s read, 27.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 15, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 986448 Average: 2.1708 StdDev: 11.38 Min: 0 Median: 1.4721 Max: 3829 Percentiles: P50: 1.47 P75: 1.84 P99: 5.59 P99.9: 10.00 P99.99: 14.93 ------------------------------------------------------ [ 0, 1 ] 180961 18.345% 18.345% #### ( 1, 2 ] 661408 67.049% 85.394% ############# ( 2, 3 ] 89123 9.035% 94.429% ## ( 3, 4 ] 28248 2.864% 97.293% # ( 4, 6 ] 21126 2.142% 99.434% ( 6, 10 ] 4601 0.466% 99.901% ( 10, 15 ] 895 0.091% 99.991% ( 15, 22 ] 95 0.010% 100.001% ( 22, 34 ] 13 0.001% 100.002% ( 34, 51 ] 7 0.001% 100.003% ( 51, 76 ] 9 0.001% 100.004% ( 76, 110 ] 29 0.003% 100.007% ( 110, 170 ] 49 0.005% 100.012% ( 170, 250 ] 31 0.003% 100.015% ( 250, 380 ] 17 0.002% 100.017% ( 380, 580 ] 27 0.003% 100.019% ( 580, 870 ] 17 0.002% 100.021% ( 870, 1300 ] 17 0.002% 100.023% ( 1300, 1900 ] 6 0.001% 100.023% ( 1900, 2900 ] 5 0.001% 100.024% ( 2900, 4400 ] 4 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 107389 Average: 2.5729 StdDev: 16.16 Min: 1 Median: 1.6456 Max: 3681 Percentiles: P50: 1.65 P75: 2.15 P99: 7.03 P99.9: 14.43 P99.99: 87.09 ------------------------------------------------------ [ 0, 1 ] 9932 9.249% 9.249% ## ( 1, 2 ] 67786 63.122% 72.371% ############# ( 2, 3 ] 18542 17.266% 89.637% ### ( 3, 4 ] 4979 4.636% 94.273% # ( 4, 6 ] 4815 4.484% 98.757% # ( 6, 10 ] 1013 0.943% 99.700% ( 10, 15 ] 242 0.225% 99.926% ( 15, 22 ] 20 0.019% 99.944% ( 22, 34 ] 1 0.001% 99.945% ( 51, 76 ] 45 0.042% 99.987% ( 76, 110 ] 10 0.009% 99.996% ( 110, 170 ] 3 0.003% 99.999% ( 170, 250 ] 4 0.004% 100.003% ( 250, 380 ] 6 0.006% 100.008% ( 380, 580 ] 2 0.002% 100.010% ( 580, 870 ] 1 0.001% 100.011% ( 870, 1300 ] 2 0.002% 100.013% ( 1300, 1900 ] 1 0.001% 100.014% ( 1900, 2900 ] 1 0.001% 100.015% ( 2900, 4400 ] 1 0.001% 100.016% ** Level 2 read latency histogram (micros): Count: 75884 Average: 2.0472 StdDev: 13.35 Min: 0 Median: 1.4044 Max: 3500 Percentiles: P50: 1.40 P75: 1.78 P99: 5.46 P99.9: 10.18 P99.99: 198.23 ------------------------------------------------------ [ 0, 1 ] 17683 23.303% 23.303% ##### ( 1, 2 ] 50099 66.021% 89.323% ############# ( 2, 3 ] 4517 5.953% 95.276% # ( 3, 4 ] 1945 2.563% 97.839% # ( 4, 6 ] 1206 1.589% 99.428% ( 6, 10 ] 356 0.469% 99.897% ( 10, 15 ] 59 0.078% 99.975% ( 15, 22 ] 9 0.012% 99.987% ( 110, 170 ] 1 0.001% 99.988% ( 170, 250 ] 4 0.005% 99.993% ( 250, 380 ] 3 0.004% 99.997% ( 580, 870 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47939 Average: 5.0159 StdDev: 119.60 Min: 1 Median: 1.6594 Max: 10189 Percentiles: P50: 1.66 P75: 2.19 P99: 6.87 P99.9: 42.76 P99.99: 4229.88 ------------------------------------------------------ [ 0, 1 ] 3748 7.818% 7.818% ## ( 1, 2 ] 30668 63.973% 71.791% ############# ( 2, 3 ] 8193 17.090% 88.882% ### ( 3, 4 ] 2506 5.227% 94.109% # ( 4, 6 ] 2266 4.727% 98.836% # ( 6, 10 ] 363 0.757% 99.593% ( 10, 15 ] 117 0.244% 99.837% ( 15, 22 ] 17 0.035% 99.873% ( 22, 34 ] 11 0.023% 99.896% ( 34, 51 ] 4 0.008% 99.904% ( 110, 170 ] 6 0.013% 99.917% ( 170, 250 ] 1 0.002% 99.919% ( 250, 380 ] 7 0.015% 99.933% ( 380, 580 ] 6 0.013% 99.946% ( 580, 870 ] 6 0.013% 99.958% ( 870, 1300 ] 3 0.006% 99.965% ( 1300, 1900 ] 3 0.006% 99.971% ( 1900, 2900 ] 3 0.006% 99.977% ( 2900, 4400 ] 7 0.015% 99.992% ( 4400, 6600 ] 4 0.008% 100.000% ( 6600, 9900 ] 5 0.010% 100.010% ( 9900, 14000 ] 1 0.002% 100.013% ** Level 4 read latency histogram (micros): Count: 40 Average: 3598.5500 StdDev: 2626.91 Min: 531 Median: 2900.0000 Max: 9474 Percentiles: P50: 2900.00 P75: 5866.67 P99: 9474.00 P99.9: 9474.00 P99.99: 9474.00 ------------------------------------------------------ ( 380, 580 ] 1 2.500% 2.500% # ( 580, 870 ] 3 7.500% 10.000% ## ( 870, 1300 ] 5 12.500% 22.500% ### ( 1300, 1900 ] 9 22.500% 45.000% ##### ( 1900, 2900 ] 2 5.000% 50.000% # ( 2900, 4400 ] 6 15.000% 65.000% ### ( 4400, 6600 ] 6 15.000% 80.000% ### ( 6600, 9900 ] 8 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 802.4500 StdDev: 919.48 Min: 83 Median: 380.0000 Max: 2971 Percentiles: P50: 380.00 P75: 1156.67 P99: 2971.00 P99.9: 2971.00 P99.99: 2971.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 5 25.000% 40.000% ##### ( 250, 380 ] 2 10.000% 50.000% ## ( 380, 580 ] 2 10.000% 60.000% ## ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 3 15.000% 80.000% ### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.4 total, 3.4 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 316.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.823 H:M:S, 14.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 286.96 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.823 H:M:S, 24.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-10:06:17 ... thread 0: (1000000,5000000) ops and (114682.5,239212.2) ops/second in (8.719727,20.901942) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 4.11 GB 138.0 4.6 0.0 4.6 9.2 4.7 0.0 2.0 147.9 299.7 31.50 29.70 83 0.380 4732K 8326 0.0 0.0 L1 1/1 2.63 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 234.1 233.7 1.61 1.57 1 1.615 383K 577 0.0 0.0 L2 1/0 49.55 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 243.0 242.8 1.43 1.38 2 0.717 353K 170 0.0 0.0 L3 35/0 980.53 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.3 201.7 201.5 3.72 3.29 3 1.239 761K 736 0.0 0.0 L4 136/0 9.56 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1036/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1227/17 100.80 GB 0.0 6.0 1.1 4.9 10.7 5.8 1.1 2.3 160.4 285.2 38.27 35.94 89 0.430 6231K 9809 0.0 0.0 Int 0/0 0.00 KB 0.0 6.0 1.1 4.9 10.7 5.8 1.1 2.3 160.4 285.2 38.27 35.94 89 0.430 6231K 9809 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.0 1.1 4.9 6.0 1.1 0.0 0.0 247.3 246.9 24.82 23.93 20 1.241 6231K 9809 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 355.9 13.45 12.01 69 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.2 total, 20.9 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.66 GB write, 515.68 MB/s write, 5.99 GB read, 289.95 MB/s read, 38.3 seconds Interval compaction: 10.66 GB write, 522.13 MB/s write, 5.99 GB read, 293.58 MB/s read, 38.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 15, interval: 26 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1974202 Average: 2.3423 StdDev: 12.33 Min: 0 Median: 1.4915 Max: 3829 Percentiles: P50: 1.49 P75: 1.86 P99: 5.83 P99.9: 15.83 P99.99: 163.50 ------------------------------------------------------ [ 0, 1 ] 322545 16.338% 16.338% ### ( 1, 2 ] 1352001 68.483% 84.821% ############## ( 2, 3 ] 190773 9.663% 94.485% ## ( 3, 4 ] 54653 2.768% 97.253% # ( 4, 6 ] 37607 1.905% 99.158% ( 6, 10 ] 13018 0.659% 99.817% ( 10, 15 ] 1612 0.082% 99.899% ( 15, 22 ] 183 0.009% 99.908% ( 22, 34 ] 22 0.001% 99.909% ( 34, 51 ] 10 0.001% 99.910% ( 51, 76 ] 10 0.001% 99.910% ( 76, 110 ] 755 0.038% 99.949% ( 110, 170 ] 918 0.046% 99.995% ( 170, 250 ] 248 0.013% 100.008% ( 250, 380 ] 149 0.008% 100.015% ( 380, 580 ] 128 0.006% 100.022% ( 580, 870 ] 54 0.003% 100.025% ( 870, 1300 ] 28 0.001% 100.026% ( 1300, 1900 ] 9 0.000% 100.026% ( 1900, 2900 ] 10 0.001% 100.027% ( 2900, 4400 ] 8 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 107389 Average: 2.5729 StdDev: 16.16 Min: 1 Median: 1.6456 Max: 3681 Percentiles: P50: 1.65 P75: 2.15 P99: 7.03 P99.9: 14.43 P99.99: 87.09 ------------------------------------------------------ [ 0, 1 ] 9932 9.249% 9.249% ## ( 1, 2 ] 67786 63.122% 72.371% ############# ( 2, 3 ] 18542 17.266% 89.637% ### ( 3, 4 ] 4979 4.636% 94.273% # ( 4, 6 ] 4815 4.484% 98.757% # ( 6, 10 ] 1013 0.943% 99.700% ( 10, 15 ] 242 0.225% 99.926% ( 15, 22 ] 20 0.019% 99.944% ( 22, 34 ] 1 0.001% 99.945% ( 51, 76 ] 45 0.042% 99.987% ( 76, 110 ] 10 0.009% 99.996% ( 110, 170 ] 3 0.003% 99.999% ( 170, 250 ] 4 0.004% 100.003% ( 250, 380 ] 6 0.006% 100.008% ( 380, 580 ] 2 0.002% 100.010% ( 580, 870 ] 1 0.001% 100.011% ( 870, 1300 ] 2 0.002% 100.013% ( 1300, 1900 ] 1 0.001% 100.014% ( 1900, 2900 ] 1 0.001% 100.015% ( 2900, 4400 ] 1 0.001% 100.016% ** Level 2 read latency histogram (micros): Count: 75884 Average: 2.0472 StdDev: 13.35 Min: 0 Median: 1.4044 Max: 3500 Percentiles: P50: 1.40 P75: 1.78 P99: 5.46 P99.9: 10.18 P99.99: 198.23 ------------------------------------------------------ [ 0, 1 ] 17683 23.303% 23.303% ##### ( 1, 2 ] 50099 66.021% 89.323% ############# ( 2, 3 ] 4517 5.953% 95.276% # ( 3, 4 ] 1945 2.563% 97.839% # ( 4, 6 ] 1206 1.589% 99.428% ( 6, 10 ] 356 0.469% 99.897% ( 10, 15 ] 59 0.078% 99.975% ( 15, 22 ] 9 0.012% 99.987% ( 110, 170 ] 1 0.001% 99.988% ( 170, 250 ] 4 0.005% 99.993% ( 250, 380 ] 3 0.004% 99.997% ( 580, 870 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47939 Average: 5.0159 StdDev: 119.60 Min: 1 Median: 1.6594 Max: 10189 Percentiles: P50: 1.66 P75: 2.19 P99: 6.87 P99.9: 42.76 P99.99: 4229.88 ------------------------------------------------------ [ 0, 1 ] 3748 7.818% 7.818% ## ( 1, 2 ] 30668 63.973% 71.791% ############# ( 2, 3 ] 8193 17.090% 88.882% ### ( 3, 4 ] 2506 5.227% 94.109% # ( 4, 6 ] 2266 4.727% 98.836% # ( 6, 10 ] 363 0.757% 99.593% ( 10, 15 ] 117 0.244% 99.837% ( 15, 22 ] 17 0.035% 99.873% ( 22, 34 ] 11 0.023% 99.896% ( 34, 51 ] 4 0.008% 99.904% ( 110, 170 ] 6 0.013% 99.917% ( 170, 250 ] 1 0.002% 99.919% ( 250, 380 ] 7 0.015% 99.933% ( 380, 580 ] 6 0.013% 99.946% ( 580, 870 ] 6 0.013% 99.958% ( 870, 1300 ] 3 0.006% 99.965% ( 1300, 1900 ] 3 0.006% 99.971% ( 1900, 2900 ] 3 0.006% 99.977% ( 2900, 4400 ] 7 0.015% 99.992% ( 4400, 6600 ] 4 0.008% 100.000% ( 6600, 9900 ] 5 0.010% 100.010% ( 9900, 14000 ] 1 0.002% 100.013% ** Level 4 read latency histogram (micros): Count: 40 Average: 3598.5500 StdDev: 2626.91 Min: 531 Median: 2900.0000 Max: 9474 Percentiles: P50: 2900.00 P75: 5866.67 P99: 9474.00 P99.9: 9474.00 P99.99: 9474.00 ------------------------------------------------------ ( 380, 580 ] 1 2.500% 2.500% # ( 580, 870 ] 3 7.500% 10.000% ## ( 870, 1300 ] 5 12.500% 22.500% ### ( 1300, 1900 ] 9 22.500% 45.000% ##### ( 1900, 2900 ] 2 5.000% 50.000% # ( 2900, 4400 ] 6 15.000% 65.000% ### ( 4400, 6600 ] 6 15.000% 80.000% ### ( 6600, 9900 ] 8 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 802.4500 StdDev: 919.48 Min: 83 Median: 380.0000 Max: 2971 Percentiles: P50: 380.00 P75: 1156.67 P99: 2971.00 P99.9: 2971.00 P99.99: 2971.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 5 25.000% 40.000% ##### ( 250, 380 ] 2 10.000% 50.000% ## ( 380, 580 ] 2 10.000% 60.000% ## ( 580, 870 ] 1 5.000% 65.000% # ( 870, 1300 ] 3 15.000% 80.000% ### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 21.2 total, 8.7 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 232.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.614 H:M:S, 36.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 112.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.791 H:M:S, 66.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-10:06:21 ... thread 0: (1000000,6000000) ops and (282036.5,245423.0) ops/second in (3.545640,24.447582) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/11 2.52 GB 12.6 5.0 0.0 5.0 10.6 5.6 0.0 1.9 140.4 296.0 36.79 34.21 98 0.375 5244K 8838 0.0 0.0 L1 9/9 1006.46 MB 0.0 2.9 2.9 0.0 2.9 2.9 0.2 1.0 226.5 224.0 13.07 12.55 2 6.537 3006K 31K 0.0 0.0 L2 1/1 49.55 MB 0.0 0.3 0.2 0.2 0.3 0.2 1.9 1.8 243.0 242.8 1.43 1.38 2 0.717 353K 170 0.0 0.0 L3 24/7 1.58 GB 1.0 1.6 1.2 0.4 1.6 1.2 0.9 1.3 195.6 195.3 8.32 7.32 8 1.040 1590K 1140 0.0 0.0 L4 168/0 9.76 GB 1.0 0.7 0.6 0.1 0.7 0.6 0.5 1.1 162.9 162.5 4.48 3.48 9 0.497 740K 1932 0.0 0.0 L5 1044/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1259/28 101.69 GB 0.0 10.6 4.9 5.7 16.1 10.4 4.4 2.9 169.0 257.7 64.09 58.93 119 0.539 10M 43K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.6 4.9 5.7 16.1 10.4 4.4 2.9 169.0 257.7 64.09 58.93 119 0.539 10M 43K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.6 4.9 5.7 10.5 4.8 0.0 0.0 228.2 227.2 47.47 44.43 37 1.283 10M 43K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 344.8 16.63 14.50 82 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.7 total, 24.5 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.13 GB write, 668.45 MB/s write, 10.58 GB read, 438.30 MB/s read, 64.1 seconds Interval compaction: 16.13 GB write, 675.60 MB/s write, 10.58 GB read, 442.98 MB/s read, 64.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 25, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2237134 Average: 2.4259 StdDev: 14.02 Min: 0 Median: 1.5206 Max: 4765 Percentiles: P50: 1.52 P75: 1.89 P99: 5.99 P99.9: 14.90 P99.99: 166.15 ------------------------------------------------------ [ 0, 1 ] 336924 15.061% 15.061% ### ( 1, 2 ] 1501441 67.114% 82.175% ############# ( 2, 3 ] 246543 11.020% 93.195% ## ( 3, 4 ] 72506 3.241% 96.437% # ( 4, 6 ] 57690 2.579% 99.015% # ( 6, 10 ] 17270 0.772% 99.787% ( 10, 15 ] 2575 0.115% 99.902% ( 15, 22 ] 265 0.012% 99.914% ( 22, 34 ] 30 0.001% 99.916% ( 34, 51 ] 12 0.001% 99.916% ( 51, 76 ] 11 0.000% 99.917% ( 76, 110 ] 760 0.034% 99.951% ( 110, 170 ] 945 0.042% 99.993% ( 170, 250 ] 281 0.013% 100.005% ( 250, 380 ] 177 0.008% 100.013% ( 380, 580 ] 157 0.007% 100.020% ( 580, 870 ] 72 0.003% 100.023% ( 870, 1300 ] 37 0.002% 100.025% ( 1300, 1900 ] 14 0.001% 100.026% ( 1900, 2900 ] 21 0.001% 100.027% ( 2900, 4400 ] 9 0.000% 100.027% ( 4400, 6600 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 303891 Average: 3.5254 StdDev: 44.93 Min: 1 Median: 1.8680 Max: 8855 Percentiles: P50: 1.87 P75: 2.75 P99: 8.60 P99.9: 14.72 P99.99: 180.25 ------------------------------------------------------ [ 0, 1 ] 12214 4.019% 4.019% # ( 1, 2 ] 160980 52.973% 56.992% ########### ( 2, 3 ] 72906 23.991% 80.983% ##### ( 3, 4 ] 23956 7.883% 88.866% ## ( 4, 6 ] 27713 9.119% 97.985% ## ( 6, 10 ] 4751 1.563% 99.549% ( 10, 15 ] 1131 0.372% 99.921% ( 15, 22 ] 95 0.031% 99.952% ( 22, 34 ] 3 0.001% 99.953% ( 34, 51 ] 1 0.000% 99.954% ( 51, 76 ] 47 0.015% 99.969% ( 76, 110 ] 26 0.009% 99.978% ( 110, 170 ] 33 0.011% 99.988% ( 170, 250 ] 36 0.012% 100.000% ( 250, 380 ] 44 0.014% 100.015% ( 380, 580 ] 67 0.022% 100.037% ( 580, 870 ] 17 0.006% 100.042% ( 870, 1300 ] 18 0.006% 100.048% ( 1300, 1900 ] 18 0.006% 100.054% ( 1900, 2900 ] 7 0.002% 100.057% ( 2900, 4400 ] 10 0.003% 100.060% ( 4400, 6600 ] 3 0.001% 100.061% ( 6600, 9900 ] 4 0.001% 100.062% ** Level 2 read latency histogram (micros): Count: 79953 Average: 2.5890 StdDev: 28.89 Min: 0 Median: 1.4195 Max: 3852 Percentiles: P50: 1.42 P75: 1.80 P99: 5.72 P99.9: 19.87 P99.99: 1193.01 ------------------------------------------------------ [ 0, 1 ] 17902 22.391% 22.391% #### ( 1, 2 ] 52621 65.815% 88.206% ############# ( 2, 3 ] 5220 6.529% 94.734% # ( 3, 4 ] 2180 2.727% 97.461% # ( 4, 6 ] 1429 1.787% 99.248% ( 6, 10 ] 438 0.548% 99.796% ( 10, 15 ] 74 0.093% 99.889% ( 15, 22 ] 13 0.016% 99.905% ( 22, 34 ] 1 0.001% 99.906% ( 76, 110 ] 1 0.001% 99.907% ( 110, 170 ] 5 0.006% 99.914% ( 170, 250 ] 14 0.018% 99.931% ( 250, 380 ] 14 0.018% 99.949% ( 380, 580 ] 17 0.021% 99.970% ( 580, 870 ] 13 0.016% 99.986% ( 870, 1300 ] 4 0.005% 99.991% ( 1300, 1900 ] 3 0.004% 99.995% ( 1900, 2900 ] 2 0.003% 99.997% ( 2900, 4400 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 418769 Average: 5.4124 StdDev: 69.10 Min: 1 Median: 1.8876 Max: 10189 Percentiles: P50: 1.89 P75: 2.81 P99: 9.77 P99.9: 363.28 P99.99: 595.47 ------------------------------------------------------ [ 0, 1 ] 13033 3.112% 3.112% # ( 1, 2 ] 221211 52.824% 55.936% ########### ( 2, 3 ] 98553 23.534% 79.470% ##### ( 3, 4 ] 34769 8.303% 87.773% ## ( 4, 6 ] 38988 9.310% 97.083% ## ( 6, 10 ] 8514 2.033% 99.116% ( 10, 15 ] 2037 0.486% 99.603% ( 15, 22 ] 288 0.069% 99.671% ( 22, 34 ] 33 0.008% 99.679% ( 34, 51 ] 8 0.002% 99.681% ( 51, 76 ] 1 0.000% 99.681% ( 76, 110 ] 66 0.016% 99.697% ( 110, 170 ] 295 0.070% 99.768% ( 170, 250 ] 278 0.066% 99.834% ( 250, 380 ] 317 0.076% 99.910% ( 380, 580 ] 323 0.077% 99.987% ( 580, 870 ] 246 0.059% 100.046% ( 870, 1300 ] 123 0.029% 100.075% ( 1300, 1900 ] 46 0.011% 100.086% ( 1900, 2900 ] 40 0.010% 100.096% ( 2900, 4400 ] 40 0.010% 100.105% ( 4400, 6600 ] 9 0.002% 100.107% ( 6600, 9900 ] 6 0.001% 100.109% ( 9900, 14000 ] 1 0.000% 100.109% ** Level 4 read latency histogram (micros): Count: 205 Average: 760.6195 StdDev: 1828.68 Min: 1 Median: 3.3571 Max: 9474 Percentiles: P50: 3.36 P75: 230.00 P99: 9054.37 P99.9: 9474.00 P99.99: 9474.00 ------------------------------------------------------ [ 0, 1 ] 33 16.098% 16.098% ### ( 1, 2 ] 45 21.951% 38.049% #### ( 2, 3 ] 22 10.732% 48.780% ## ( 3, 4 ] 7 3.415% 52.195% # ( 4, 6 ] 12 5.854% 58.049% # ( 6, 10 ] 4 1.951% 60.000% ( 10, 15 ] 1 0.488% 60.488% ( 15, 22 ] 3 1.463% 61.951% ( 22, 34 ] 10 4.878% 66.829% # ( 34, 51 ] 3 1.463% 68.293% ( 51, 76 ] 1 0.488% 68.780% ( 76, 110 ] 1 0.488% 69.268% ( 110, 170 ] 11 5.366% 74.634% # ( 170, 250 ] 1 0.488% 75.122% ( 250, 380 ] 2 0.976% 76.098% ( 380, 580 ] 3 1.463% 77.561% ( 580, 870 ] 5 2.439% 80.000% ( 870, 1300 ] 8 3.902% 83.902% # ( 1300, 1900 ] 11 5.366% 89.268% # ( 1900, 2900 ] 2 0.976% 90.244% ( 2900, 4400 ] 6 2.927% 93.171% # ( 4400, 6600 ] 6 2.927% 96.098% # ( 6600, 9900 ] 8 3.902% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 938.7667 StdDev: 1036.25 Min: 83 Median: 363.7500 Max: 3952 Percentiles: P50: 363.75 P75: 1540.00 P99: 3952.00 P99.9: 3952.00 P99.99: 3952.00 ------------------------------------------------------ ( 76, 110 ] 4 6.667% 6.667% # ( 110, 170 ] 13 21.667% 28.333% #### ( 170, 250 ] 6 10.000% 38.333% ## ( 250, 380 ] 8 13.333% 51.667% ### ( 380, 580 ] 3 5.000% 56.667% # ( 580, 870 ] 5 8.333% 65.000% ## ( 870, 1300 ] 4 6.667% 71.667% # ( 1300, 1900 ] 5 8.333% 80.000% ## ( 1900, 2900 ] 8 13.333% 93.333% ### ( 2900, 4400 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 24.7 total, 3.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 238.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.387 H:M:S, 33.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 277.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.773 H:M:S, 21.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/17-10:06:24 ... thread 0: (1000000,7000000) ops and (317657.6,253663.4) ops/second in (3.148044,27.595626) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 3.50 GB 119.6 5.8 0.0 5.8 12.4 6.6 0.0 1.9 139.4 296.1 42.94 39.97 115 0.373 6075K 9652 0.0 0.0 L1 9/9 1006.46 MB 0.0 2.9 2.9 0.0 2.9 2.9 0.2 1.0 226.5 224.0 13.07 12.55 2 6.537 3006K 31K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 1.9 1.8 243.0 242.8 1.43 1.38 2 0.717 353K 170 0.0 0.0 L3 17/0 990.91 MB 1.0 2.3 1.2 1.0 2.2 1.2 0.9 1.8 198.5 198.1 11.63 10.08 9 1.292 2280K 2412 0.0 0.0 L4 167/0 9.44 GB 1.0 0.7 0.6 0.1 0.7 0.6 1.1 1.1 162.9 162.5 4.48 3.48 9 0.497 740K 1932 0.0 0.0 L5 1056/0 87.78 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1267/20 102.67 GB 0.0 12.0 4.9 7.1 18.6 11.5 6.1 2.8 167.6 258.7 73.55 67.45 137 0.537 12M 45K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.0 4.9 7.1 18.6 11.5 6.0 2.8 167.6 258.7 73.55 67.45 137 0.537 12M 45K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.0 4.9 7.1 12.0 4.9 0.0 0.0 228.3 227.4 54.00 50.35 41 1.317 12M 45K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 344.9 19.54 17.10 96 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.9 total, 27.6 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.58 GB write, 682.80 MB/s write, 12.04 GB read, 442.56 MB/s read, 73.5 seconds Interval compaction: 18.58 GB write, 689.28 MB/s write, 12.04 GB read, 446.75 MB/s read, 73.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 31, interval: 43 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2615709 Average: 2.4229 StdDev: 13.48 Min: 0 Median: 1.5298 Max: 4765 Percentiles: P50: 1.53 P75: 1.90 P99: 6.00 P99.9: 14.37 P99.99: 160.71 ------------------------------------------------------ [ 0, 1 ] 375998 14.375% 14.375% ### ( 1, 2 ] 1759006 67.248% 81.622% ############# ( 2, 3 ] 301716 11.535% 93.157% ## ( 3, 4 ] 85198 3.257% 96.414% # ( 4, 6 ] 67688 2.588% 99.002% # ( 6, 10 ] 20789 0.795% 99.797% ( 10, 15 ] 3092 0.118% 99.915% ( 15, 22 ] 294 0.011% 99.926% ( 22, 34 ] 31 0.001% 99.927% ( 34, 51 ] 13 0.000% 99.928% ( 51, 76 ] 13 0.000% 99.928% ( 76, 110 ] 768 0.029% 99.958% ( 110, 170 ] 998 0.038% 99.996% ( 170, 250 ] 315 0.012% 100.008% ( 250, 380 ] 193 0.007% 100.015% ( 380, 580 ] 185 0.007% 100.022% ( 580, 870 ] 80 0.003% 100.026% ( 870, 1300 ] 44 0.002% 100.027% ( 1300, 1900 ] 17 0.001% 100.028% ( 1900, 2900 ] 22 0.001% 100.029% ( 2900, 4400 ] 9 0.000% 100.029% ( 4400, 6600 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 303891 Average: 3.5254 StdDev: 44.93 Min: 1 Median: 1.8680 Max: 8855 Percentiles: P50: 1.87 P75: 2.75 P99: 8.60 P99.9: 14.72 P99.99: 180.25 ------------------------------------------------------ [ 0, 1 ] 12214 4.019% 4.019% # ( 1, 2 ] 160980 52.973% 56.992% ########### ( 2, 3 ] 72906 23.991% 80.983% ##### ( 3, 4 ] 23956 7.883% 88.866% ## ( 4, 6 ] 27713 9.119% 97.985% ## ( 6, 10 ] 4751 1.563% 99.549% ( 10, 15 ] 1131 0.372% 99.921% ( 15, 22 ] 95 0.031% 99.952% ( 22, 34 ] 3 0.001% 99.953% ( 34, 51 ] 1 0.000% 99.954% ( 51, 76 ] 47 0.015% 99.969% ( 76, 110 ] 26 0.009% 99.978% ( 110, 170 ] 33 0.011% 99.988% ( 170, 250 ] 36 0.012% 100.000% ( 250, 380 ] 44 0.014% 100.015% ( 380, 580 ] 67 0.022% 100.037% ( 580, 870 ] 17 0.006% 100.042% ( 870, 1300 ] 18 0.006% 100.048% ( 1300, 1900 ] 18 0.006% 100.054% ( 1900, 2900 ] 7 0.002% 100.057% ( 2900, 4400 ] 10 0.003% 100.060% ( 4400, 6600 ] 3 0.001% 100.061% ( 6600, 9900 ] 4 0.001% 100.062% ** Level 2 read latency histogram (micros): Count: 88466 Average: 2.5816 StdDev: 27.46 Min: 0 Median: 1.4430 Max: 3852 Percentiles: P50: 1.44 P75: 1.82 P99: 5.89 P99.9: 16.87 P99.99: 1101.49 ------------------------------------------------------ [ 0, 1 ] 18475 20.884% 20.884% #### ( 1, 2 ] 58141 65.721% 86.605% ############# ( 2, 3 ] 6606 7.467% 94.072% # ( 3, 4 ] 2614 2.955% 97.027% # ( 4, 6 ] 1844 2.084% 99.112% ( 6, 10 ] 593 0.670% 99.782% ( 10, 15 ] 100 0.113% 99.895% ( 15, 22 ] 17 0.019% 99.914% ( 22, 34 ] 1 0.001% 99.915% ( 76, 110 ] 1 0.001% 99.916% ( 110, 170 ] 5 0.006% 99.922% ( 170, 250 ] 14 0.016% 99.938% ( 250, 380 ] 14 0.016% 99.954% ( 380, 580 ] 17 0.019% 99.973% ( 580, 870 ] 13 0.015% 99.988% ( 870, 1300 ] 4 0.005% 99.992% ( 1300, 1900 ] 3 0.003% 99.995% ( 1900, 2900 ] 2 0.002% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 418824 Average: 5.4389 StdDev: 69.25 Min: 1 Median: 1.8876 Max: 10189 Percentiles: P50: 1.89 P75: 2.81 P99: 9.78 P99.9: 367.77 P99.99: 602.45 ------------------------------------------------------ [ 0, 1 ] 13049 3.116% 3.116% # ( 1, 2 ] 221225 52.821% 55.936% ########### ( 2, 3 ] 98556 23.532% 79.468% ##### ( 3, 4 ] 34769 8.302% 87.769% ## ( 4, 6 ] 38988 9.309% 97.078% ## ( 6, 10 ] 8514 2.033% 99.111% ( 10, 15 ] 2037 0.486% 99.597% ( 15, 22 ] 288 0.069% 99.666% ( 22, 34 ] 33 0.008% 99.674% ( 34, 51 ] 8 0.002% 99.676% ( 51, 76 ] 1 0.000% 99.676% ( 76, 110 ] 66 0.016% 99.692% ( 110, 170 ] 296 0.071% 99.763% ( 170, 250 ] 288 0.069% 99.831% ( 250, 380 ] 317 0.076% 99.907% ( 380, 580 ] 328 0.078% 99.985% ( 580, 870 ] 247 0.059% 100.044% ( 870, 1300 ] 127 0.030% 100.075% ( 1300, 1900 ] 47 0.011% 100.086% ( 1900, 2900 ] 40 0.010% 100.096% ( 2900, 4400 ] 40 0.010% 100.105% ( 4400, 6600 ] 9 0.002% 100.107% ( 6600, 9900 ] 6 0.001% 100.109% ( 9900, 14000 ] 1 0.000% 100.109% ** Level 4 read latency histogram (micros): Count: 205 Average: 760.6195 StdDev: 1828.68 Min: 1 Median: 3.3571 Max: 9474 Percentiles: P50: 3.36 P75: 230.00 P99: 9054.37 P99.9: 9474.00 P99.99: 9474.00 ------------------------------------------------------ [ 0, 1 ] 33 16.098% 16.098% ### ( 1, 2 ] 45 21.951% 38.049% #### ( 2, 3 ] 22 10.732% 48.780% ## ( 3, 4 ] 7 3.415% 52.195% # ( 4, 6 ] 12 5.854% 58.049% # ( 6, 10 ] 4 1.951% 60.000% ( 10, 15 ] 1 0.488% 60.488% ( 15, 22 ] 3 1.463% 61.951% ( 22, 34 ] 10 4.878% 66.829% # ( 34, 51 ] 3 1.463% 68.293% ( 51, 76 ] 1 0.488% 68.780% ( 76, 110 ] 1 0.488% 69.268% ( 110, 170 ] 11 5.366% 74.634% # ( 170, 250 ] 1 0.488% 75.122% ( 250, 380 ] 2 0.976% 76.098% ( 380, 580 ] 3 1.463% 77.561% ( 580, 870 ] 5 2.439% 80.000% ( 870, 1300 ] 8 3.902% 83.902% # ( 1300, 1900 ] 11 5.366% 89.268% # ( 1900, 2900 ] 2 0.976% 90.244% ( 2900, 4400 ] 6 2.927% 93.171% # ( 4400, 6600 ] 6 2.927% 96.098% # ( 6600, 9900 ] 8 3.902% 100.000% # ** Level 5 read latency histogram (micros): Count: 120 Average: 967.2583 StdDev: 1036.37 Min: 81 Median: 480.0000 Max: 3952 Percentiles: P50: 480.00 P75: 1576.92 P99: 3952.00 P99.9: 3952.00 P99.99: 3952.00 ------------------------------------------------------ ( 76, 110 ] 11 9.167% 9.167% ## ( 110, 170 ] 21 17.500% 26.667% #### ( 170, 250 ] 12 10.000% 36.667% ## ( 250, 380 ] 11 9.167% 45.833% ## ( 380, 580 ] 10 8.333% 54.167% ## ( 580, 870 ] 11 9.167% 63.333% ## ( 870, 1300 ] 8 6.667% 70.000% # ( 1300, 1900 ] 13 10.833% 80.833% ## ( 1900, 2900 ] 13 10.833% 91.667% ## ( 2900, 4400 ] 10 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 27.9 total, 3.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 247.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.894 H:M:S, 31.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 312.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.507 H:M:S, 16.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-10:06:29 ... thread 0: (1000000,8000000) ops and (190699.1,243609.1) ops/second in (5.243864,32.839490) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 4.48 GB 163.6 7.1 0.0 7.1 14.7 7.6 0.0 1.9 143.5 295.6 50.90 47.53 135 0.377 7419K 10K 0.0 0.0 L1 9/9 1006.46 MB 0.0 2.9 2.9 0.0 2.9 2.9 0.2 1.0 226.5 224.0 13.07 12.55 2 6.537 3006K 31K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 1.9 1.8 243.0 242.8 1.43 1.38 2 0.717 353K 170 0.0 0.0 L3 17/0 990.91 MB 1.0 2.3 1.2 1.0 2.2 1.2 0.9 1.8 198.5 198.1 11.63 10.08 9 1.292 2280K 2412 0.0 0.0 L4 167/0 9.44 GB 1.0 0.7 0.6 0.1 0.7 0.6 1.1 1.1 162.9 162.5 4.48 3.48 9 0.497 740K 1932 0.0 0.0 L5 1056/0 87.78 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1267/20 103.66 GB 0.0 13.3 4.9 8.4 20.9 12.5 6.1 2.8 167.5 262.0 81.51 75.02 157 0.519 13M 46K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.3 4.9 8.4 20.9 12.5 6.0 2.8 167.5 262.0 81.51 75.02 157 0.519 13M 46K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.3 4.9 8.4 13.3 4.9 0.0 0.0 231.2 230.4 59.05 55.32 46 1.284 13M 46K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 345.0 22.46 19.70 111 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 33.1 total, 32.8 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.85 GB write, 645.01 MB/s write, 13.33 GB read, 412.42 MB/s read, 81.5 seconds Interval compaction: 20.85 GB write, 650.15 MB/s write, 13.33 GB read, 415.70 MB/s read, 81.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 20, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 20, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 32, interval: 52 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3103705 Average: 2.4049 StdDev: 12.84 Min: 0 Median: 1.5325 Max: 4765 Percentiles: P50: 1.53 P75: 1.90 P99: 5.99 P99.9: 13.99 P99.99: 156.55 ------------------------------------------------------ [ 0, 1 ] 435101 14.019% 14.019% ### ( 1, 2 ] 2097112 67.568% 81.587% ############## ( 2, 3 ] 362504 11.680% 93.266% ## ( 3, 4 ] 100301 3.232% 96.498% # ( 4, 6 ] 78162 2.518% 99.016% # ( 6, 10 ] 24573 0.792% 99.808% ( 10, 15 ] 3569 0.115% 99.923% ( 15, 22 ] 380 0.012% 99.935% ( 22, 34 ] 32 0.001% 99.936% ( 34, 51 ] 14 0.000% 99.937% ( 51, 76 ] 18 0.001% 99.938% ( 76, 110 ] 804 0.026% 99.963% ( 110, 170 ] 1063 0.034% 99.998% ( 170, 250 ] 363 0.012% 100.009% ( 250, 380 ] 204 0.007% 100.016% ( 380, 580 ] 203 0.007% 100.022% ( 580, 870 ] 96 0.003% 100.026% ( 870, 1300 ] 49 0.002% 100.027% ( 1300, 1900 ] 19 0.001% 100.028% ( 1900, 2900 ] 23 0.001% 100.029% ( 2900, 4400 ] 9 0.000% 100.029% ( 4400, 6600 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 433213 Average: 3.2463 StdDev: 38.05 Min: 1 Median: 1.7503 Max: 8855 Percentiles: P50: 1.75 P75: 2.52 P99: 8.55 P99.9: 20.43 P99.99: 241.02 ------------------------------------------------------ [ 0, 1 ] 28705 6.626% 6.626% # ( 1, 2 ] 250448 57.812% 64.438% ############ ( 2, 3 ] 87494 20.197% 84.634% #### ( 3, 4 ] 27476 6.342% 90.977% # ( 4, 6 ] 30374 7.011% 97.988% # ( 6, 10 ] 6879 1.588% 99.576% ( 10, 15 ] 1303 0.301% 99.877% ( 15, 22 ] 130 0.030% 99.907% ( 22, 34 ] 5 0.001% 99.908% ( 34, 51 ] 2 0.000% 99.908% ( 51, 76 ] 47 0.011% 99.919% ( 76, 110 ] 82 0.019% 99.938% ( 110, 170 ] 151 0.035% 99.973% ( 170, 250 ] 83 0.019% 99.992% ( 250, 380 ] 57 0.013% 100.005% ( 380, 580 ] 83 0.019% 100.024% ( 580, 870 ] 21 0.005% 100.029% ( 870, 1300 ] 20 0.005% 100.034% ( 1300, 1900 ] 18 0.004% 100.038% ( 1900, 2900 ] 7 0.002% 100.040% ( 2900, 4400 ] 10 0.002% 100.042% ( 4400, 6600 ] 3 0.001% 100.043% ( 6600, 9900 ] 4 0.001% 100.044% ** Level 2 read latency histogram (micros): Count: 88466 Average: 2.5816 StdDev: 27.46 Min: 0 Median: 1.4430 Max: 3852 Percentiles: P50: 1.44 P75: 1.82 P99: 5.89 P99.9: 16.87 P99.99: 1101.49 ------------------------------------------------------ [ 0, 1 ] 18475 20.884% 20.884% #### ( 1, 2 ] 58141 65.721% 86.605% ############# ( 2, 3 ] 6606 7.467% 94.072% # ( 3, 4 ] 2614 2.955% 97.027% # ( 4, 6 ] 1844 2.084% 99.112% ( 6, 10 ] 593 0.670% 99.782% ( 10, 15 ] 100 0.113% 99.895% ( 15, 22 ] 17 0.019% 99.914% ( 22, 34 ] 1 0.001% 99.915% ( 76, 110 ] 1 0.001% 99.916% ( 110, 170 ] 5 0.006% 99.922% ( 170, 250 ] 14 0.016% 99.938% ( 250, 380 ] 14 0.016% 99.954% ( 380, 580 ] 17 0.019% 99.973% ( 580, 870 ] 13 0.015% 99.988% ( 870, 1300 ] 4 0.005% 99.992% ( 1300, 1900 ] 3 0.003% 99.995% ( 1900, 2900 ] 2 0.002% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 418824 Average: 5.4389 StdDev: 69.25 Min: 1 Median: 1.8876 Max: 10189 Percentiles: P50: 1.89 P75: 2.81 P99: 9.78 P99.9: 367.77 P99.99: 602.45 ------------------------------------------------------ [ 0, 1 ] 13049 3.116% 3.116% # ( 1, 2 ] 221225 52.821% 55.936% ########### ( 2, 3 ] 98556 23.532% 79.468% ##### ( 3, 4 ] 34769 8.302% 87.769% ## ( 4, 6 ] 38988 9.309% 97.078% ## ( 6, 10 ] 8514 2.033% 99.111% ( 10, 15 ] 2037 0.486% 99.597% ( 15, 22 ] 288 0.069% 99.666% ( 22, 34 ] 33 0.008% 99.674% ( 34, 51 ] 8 0.002% 99.676% ( 51, 76 ] 1 0.000% 99.676% ( 76, 110 ] 66 0.016% 99.692% ( 110, 170 ] 296 0.071% 99.763% ( 170, 250 ] 288 0.069% 99.831% ( 250, 380 ] 317 0.076% 99.907% ( 380, 580 ] 328 0.078% 99.985% ( 580, 870 ] 247 0.059% 100.044% ( 870, 1300 ] 127 0.030% 100.075% ( 1300, 1900 ] 47 0.011% 100.086% ( 1900, 2900 ] 40 0.010% 100.096% ( 2900, 4400 ] 40 0.010% 100.105% ( 4400, 6600 ] 9 0.002% 100.107% ( 6600, 9900 ] 6 0.001% 100.109% ( 9900, 14000 ] 1 0.000% 100.109% ** Level 4 read latency histogram (micros): Count: 205 Average: 760.6195 StdDev: 1828.68 Min: 1 Median: 3.3571 Max: 9474 Percentiles: P50: 3.36 P75: 230.00 P99: 9054.37 P99.9: 9474.00 P99.99: 9474.00 ------------------------------------------------------ [ 0, 1 ] 33 16.098% 16.098% ### ( 1, 2 ] 45 21.951% 38.049% #### ( 2, 3 ] 22 10.732% 48.780% ## ( 3, 4 ] 7 3.415% 52.195% # ( 4, 6 ] 12 5.854% 58.049% # ( 6, 10 ] 4 1.951% 60.000% ( 10, 15 ] 1 0.488% 60.488% ( 15, 22 ] 3 1.463% 61.951% ( 22, 34 ] 10 4.878% 66.829% # ( 34, 51 ] 3 1.463% 68.293% ( 51, 76 ] 1 0.488% 68.780% ( 76, 110 ] 1 0.488% 69.268% ( 110, 170 ] 11 5.366% 74.634% # ( 170, 250 ] 1 0.488% 75.122% ( 250, 380 ] 2 0.976% 76.098% ( 380, 580 ] 3 1.463% 77.561% ( 580, 870 ] 5 2.439% 80.000% ( 870, 1300 ] 8 3.902% 83.902% # ( 1300, 1900 ] 11 5.366% 89.268% # ( 1900, 2900 ] 2 0.976% 90.244% ( 2900, 4400 ] 6 2.927% 93.171% # ( 4400, 6600 ] 6 2.927% 96.098% # ( 6600, 9900 ] 8 3.902% 100.000% # ** Level 5 read latency histogram (micros): Count: 120 Average: 967.2583 StdDev: 1036.37 Min: 81 Median: 480.0000 Max: 3952 Percentiles: P50: 480.00 P75: 1576.92 P99: 3952.00 P99.9: 3952.00 P99.99: 3952.00 ------------------------------------------------------ ( 76, 110 ] 11 9.167% 9.167% ## ( 110, 170 ] 21 17.500% 26.667% #### ( 170, 250 ] 12 10.000% 36.667% ## ( 250, 380 ] 11 9.167% 45.833% ## ( 380, 580 ] 10 8.333% 54.167% ## ( 580, 870 ] 11 9.167% 63.333% ## ( 870, 1300 ] 8 6.667% 70.000% # ( 1300, 1900 ] 13 10.833% 80.833% ## ( 1900, 2900 ] 13 10.833% 91.667% ## ( 2900, 4400 ] 10 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 33.1 total, 5.2 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 237.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.456 H:M:S, 34.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 187.68 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.562 H:M:S, 48.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-10:06:43 ... thread 0: (1000000,9000000) ops and (70611.2,191483.0) ops/second in (14.162060,47.001550) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 3.44 GB 69.2 8.7 0.0 8.7 17.3 8.6 0.0 2.0 147.7 293.1 60.56 56.57 154 0.393 9081K 14K 0.0 0.0 L1 22/22 2.53 GB 0.0 6.0 5.0 1.0 5.9 4.9 0.2 1.2 222.7 220.1 27.41 26.21 3 9.137 6177K 49K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 2.4 1.8 243.0 242.8 1.43 1.38 2 0.717 353K 170 0.0 0.0 L3 21/0 981.28 MB 1.0 3.4 1.7 1.7 3.4 1.7 0.9 2.0 206.3 205.5 16.83 15.03 13 1.295 3465K 13K 0.0 0.0 L4 171/0 9.63 GB 1.0 1.3 1.1 0.1 1.3 1.1 1.1 1.1 171.4 170.7 7.56 6.10 16 0.473 1315K 4850 0.0 0.0 L5 1060/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1288/33 104.65 GB 0.0 19.7 8.0 11.7 28.2 16.5 6.9 3.3 177.2 253.8 113.80 105.28 188 0.605 20M 81K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.7 8.0 11.7 28.2 16.5 6.8 3.3 177.2 253.8 113.80 105.28 188 0.605 20M 81K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.7 8.0 11.7 19.6 7.9 0.0 0.0 229.0 227.8 88.07 82.81 62 1.421 20M 81K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 342.8 25.73 22.47 126 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.3 total, 47.0 interval Flush(GB): cumulative 8.613, interval 8.613 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.20 GB write, 611.01 MB/s write, 19.69 GB read, 426.61 MB/s read, 113.8 seconds Interval compaction: 28.20 GB write, 614.41 MB/s write, 19.69 GB read, 428.99 MB/s read, 113.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 25, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 25, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 35, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 33, total-stops: 35, interval: 68 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4001590 Average: 2.4644 StdDev: 13.61 Min: 0 Median: 1.5329 Max: 4765 Percentiles: P50: 1.53 P75: 1.90 P99: 6.47 P99.9: 17.93 P99.99: 198.85 ------------------------------------------------------ [ 0, 1 ] 559065 13.971% 13.971% ### ( 1, 2 ] 2705412 67.608% 81.579% ############## ( 2, 3 ] 464177 11.600% 93.179% ## ( 3, 4 ] 128435 3.210% 96.389% # ( 4, 6 ] 100361 2.508% 98.897% # ( 6, 10 ] 35152 0.878% 99.775% ( 10, 15 ] 4742 0.119% 99.894% ( 15, 22 ] 586 0.015% 99.909% ( 22, 34 ] 42 0.001% 99.910% ( 34, 51 ] 19 0.000% 99.910% ( 51, 76 ] 26 0.001% 99.911% ( 76, 110 ] 1257 0.031% 99.942% ( 110, 170 ] 1690 0.042% 99.984% ( 170, 250 ] 629 0.016% 100.000% ( 250, 380 ] 383 0.010% 100.010% ( 380, 580 ] 335 0.008% 100.018% ( 580, 870 ] 173 0.004% 100.022% ( 870, 1300 ] 76 0.002% 100.024% ( 1300, 1900 ] 25 0.001% 100.025% ( 1900, 2900 ] 30 0.001% 100.026% ( 2900, 4400 ] 13 0.000% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 983514 Average: 2.9784 StdDev: 28.14 Min: 1 Median: 1.6343 Max: 8855 Percentiles: P50: 1.63 P75: 2.12 P99: 8.53 P99.9: 115.71 P99.99: 326.79 ------------------------------------------------------ [ 0, 1 ] 97798 9.944% 9.944% ## ( 1, 2 ] 621113 63.152% 73.096% ############# ( 2, 3 ] 154440 15.703% 88.799% ### ( 3, 4 ] 45656 4.642% 93.441% # ( 4, 6 ] 44522 4.527% 97.968% # ( 6, 10 ] 16042 1.631% 99.599% ( 10, 15 ] 2082 0.212% 99.811% ( 15, 22 ] 250 0.025% 99.836% ( 22, 34 ] 15 0.002% 99.838% ( 34, 51 ] 2 0.000% 99.838% ( 51, 76 ] 51 0.005% 99.843% ( 76, 110 ] 498 0.051% 99.894% ( 110, 170 ] 667 0.068% 99.962% ( 170, 250 ] 196 0.020% 99.981% ( 250, 380 ] 145 0.015% 99.996% ( 380, 580 ] 175 0.018% 100.014% ( 580, 870 ] 54 0.005% 100.020% ( 870, 1300 ] 41 0.004% 100.024% ( 1300, 1900 ] 28 0.003% 100.027% ( 1900, 2900 ] 11 0.001% 100.028% ( 2900, 4400 ] 11 0.001% 100.029% ( 4400, 6600 ] 3 0.000% 100.029% ( 6600, 9900 ] 4 0.000% 100.029% ** Level 2 read latency histogram (micros): Count: 88466 Average: 2.5816 StdDev: 27.46 Min: 0 Median: 1.4430 Max: 3852 Percentiles: P50: 1.44 P75: 1.82 P99: 5.89 P99.9: 16.87 P99.99: 1101.49 ------------------------------------------------------ [ 0, 1 ] 18475 20.884% 20.884% #### ( 1, 2 ] 58141 65.721% 86.605% ############# ( 2, 3 ] 6606 7.467% 94.072% # ( 3, 4 ] 2614 2.955% 97.027% # ( 4, 6 ] 1844 2.084% 99.112% ( 6, 10 ] 593 0.670% 99.782% ( 10, 15 ] 100 0.113% 99.895% ( 15, 22 ] 17 0.019% 99.914% ( 22, 34 ] 1 0.001% 99.915% ( 76, 110 ] 1 0.001% 99.916% ( 110, 170 ] 5 0.006% 99.922% ( 170, 250 ] 14 0.016% 99.938% ( 250, 380 ] 14 0.016% 99.954% ( 380, 580 ] 17 0.019% 99.973% ( 580, 870 ] 13 0.015% 99.988% ( 870, 1300 ] 4 0.005% 99.992% ( 1300, 1900 ] 3 0.003% 99.995% ( 1900, 2900 ] 2 0.002% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 596513 Average: 4.9803 StdDev: 61.04 Min: 0 Median: 1.8887 Max: 10189 Percentiles: P50: 1.89 P75: 2.80 P99: 9.51 P99.9: 258.12 P99.99: 464.25 ------------------------------------------------------ [ 0, 1 ] 17135 2.873% 2.873% # ( 1, 2 ] 316313 53.027% 55.900% ########### ( 2, 3 ] 142306 23.856% 79.756% ##### ( 3, 4 ] 49741 8.339% 88.094% ## ( 4, 6 ] 55383 9.284% 97.379% ## ( 6, 10 ] 11029 1.849% 99.228% ( 10, 15 ] 2667 0.447% 99.675% ( 15, 22 ] 357 0.060% 99.735% ( 22, 34 ] 37 0.006% 99.741% ( 34, 51 ] 8 0.001% 99.742% ( 51, 76 ] 2 0.000% 99.743% ( 76, 110 ] 116 0.019% 99.762% ( 110, 170 ] 415 0.070% 99.832% ( 170, 250 ] 383 0.064% 99.896% ( 250, 380 ] 392 0.066% 99.962% ( 380, 580 ] 402 0.067% 100.029% ( 580, 870 ] 295 0.049% 100.078% ( 870, 1300 ] 139 0.023% 100.102% ( 1300, 1900 ] 49 0.008% 100.110% ( 1900, 2900 ] 50 0.008% 100.118% ( 2900, 4400 ] 47 0.008% 100.126% ( 4400, 6600 ] 9 0.002% 100.128% ( 6600, 9900 ] 6 0.001% 100.129% ( 9900, 14000 ] 1 0.000% 100.129% ** Level 4 read latency histogram (micros): Count: 275 Average: 598.5309 StdDev: 1609.05 Min: 1 Median: 2.8500 Max: 9474 Percentiles: P50: 2.85 P75: 165.91 P99: 8765.62 P99.9: 9474.00 P99.99: 9474.00 ------------------------------------------------------ [ 0, 1 ] 47 17.091% 17.091% ### ( 1, 2 ] 65 23.636% 40.727% ##### ( 2, 3 ] 30 10.909% 51.636% ## ( 3, 4 ] 7 2.545% 54.182% # ( 4, 6 ] 14 5.091% 59.273% # ( 6, 10 ] 7 2.545% 61.818% # ( 10, 15 ] 1 0.364% 62.182% ( 15, 22 ] 3 1.091% 63.273% ( 22, 34 ] 13 4.727% 68.000% # ( 34, 51 ] 3 1.091% 69.091% ( 51, 76 ] 5 1.818% 70.909% ( 76, 110 ] 1 0.364% 71.273% ( 110, 170 ] 11 4.000% 75.273% # ( 170, 250 ] 8 2.909% 78.182% # ( 250, 380 ] 3 1.091% 79.273% ( 380, 580 ] 6 2.182% 81.455% ( 580, 870 ] 6 2.182% 83.636% ( 870, 1300 ] 12 4.364% 88.000% # ( 1300, 1900 ] 11 4.000% 92.000% # ( 1900, 2900 ] 2 0.727% 92.727% ( 2900, 4400 ] 6 2.182% 94.909% ( 4400, 6600 ] 6 2.182% 97.091% ( 6600, 9900 ] 8 2.909% 100.000% # ** Level 5 read latency histogram (micros): Count: 140 Average: 959.9500 StdDev: 1045.35 Min: 81 Median: 460.0000 Max: 3952 Percentiles: P50: 460.00 P75: 1557.14 P99: 3952.00 P99.9: 3952.00 P99.99: 3952.00 ------------------------------------------------------ ( 76, 110 ] 16 11.429% 11.429% ## ( 110, 170 ] 24 17.143% 28.571% ### ( 170, 250 ] 13 9.286% 37.857% ## ( 250, 380 ] 13 9.286% 47.143% ## ( 380, 580 ] 10 7.143% 54.286% # ( 580, 870 ] 13 9.286% 63.571% ## ( 870, 1300 ] 10 7.143% 70.714% # ( 1300, 1900 ] 14 10.000% 80.714% ## ( 1900, 2900 ] 14 10.000% 90.714% ## ( 2900, 4400 ] 13 9.286% 100.000% ## ** DB Stats ** Uptime(secs): 47.3 total, 14.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 187.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.398 H:M:S, 47.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 69.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:10.942 H:M:S, 77.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.612 micros/op 151248 ops/sec 60.007 seconds 9075999 operations; 146.6 MB/s Microseconds per write: Count: 9075999 Average: 6.6116 StdDev: 276.37 Min: 0 Median: 1.7358 Max: 346331 Percentiles: P50: 1.74 P75: 2.77 P99: 10.63 P99.9: 1200.69 P99.99: 2681.03 ------------------------------------------------------ [ 0, 1 ] 1277825 14.079% 14.079% ### ( 1, 2 ] 4431042 48.822% 62.901% ########## ( 2, 3 ] 1418633 15.631% 78.531% ### ( 3, 4 ] 1217946 13.419% 91.951% ### ( 4, 6 ] 487148 5.367% 97.318% # ( 6, 10 ] 146294 1.612% 98.930% ( 10, 15 ] 50747 0.559% 99.489% ( 15, 22 ] 9626 0.106% 99.595% ( 22, 34 ] 1428 0.016% 99.611% ( 34, 51 ] 176 0.002% 99.613% ( 51, 76 ] 23 0.000% 99.613% ( 76, 110 ] 6620 0.073% 99.686% ( 110, 170 ] 2141 0.024% 99.710% ( 170, 250 ] 210 0.002% 99.712% ( 250, 380 ] 219 0.002% 99.714% ( 380, 580 ] 12 0.000% 99.715% ( 580, 870 ] 17 0.000% 99.715% ( 870, 1300 ] 21866 0.241% 99.956% ( 1300, 1900 ] 38 0.000% 99.956% ( 1900, 2900 ] 3944 0.043% 100.000% ( 2900, 4400 ] 19 0.000% 100.000% ( 4400, 6600 ] 2 0.000% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 5 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 170000, 250000 ] 11 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 197852 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9075999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9366430968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 411 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 34675488 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 26111089926 rocksdb.compact.write.bytes COUNT : 25931377636 rocksdb.flush.write.bytes COUNT : 9314136819 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 40 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 201 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9238983680 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3546112 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 26189734413 rocksdb.non.last.level.read.count COUNT : 6331246 rocksdb.block.checksum.compute.count COUNT : 6330464 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.385781 P95 : 3.994201 P99 : 9.102454 P100 : 346328.000000 COUNT : 9075999 SUM : 55711585 rocksdb.compaction.times.micros P50 : 1001666.666667 P95 : 3786666.666667 P99 : 14335658.000000 P100 : 14335658.000000 COUNT : 62 SUM : 88072189 rocksdb.compaction.times.cpu_micros P50 : 960740.740741 P95 : 3530000.000000 P99 : 12698000.000000 P100 : 13660876.000000 COUNT : 62 SUM : 82812381 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 709.533333 P95 : 1265.852941 P99 : 6006.000000 P100 : 7940.000000 COUNT : 127 SUM : 101400 rocksdb.compaction.outfile.sync.micros P50 : 832.446043 P95 : 4427.500000 P99 : 10802.000000 P100 : 37131.000000 COUNT : 278 SUM : 404868 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 97.619565 P95 : 323.500000 P99 : 571.333333 P100 : 1982.000000 COUNT : 213 SUM : 28896 rocksdb.table.open.io.micros P50 : 1233.545455 P95 : 6451.739130 P99 : 19470.769231 P100 : 21964.000000 COUNT : 411 SUM : 886659 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.616244 P95 : 7.023718 P99 : 11.165343 P100 : 8875.000000 COUNT : 6329432 SUM : 32181656 rocksdb.read.block.get.micros P50 : 440.000000 P95 : 3245.000000 P99 : 6921.750000 P100 : 10245.000000 COUNT : 822 SUM : 693671 rocksdb.write.raw.block.micros P50 : 0.511731 P95 : 0.972288 P99 : 2.815615 P100 : 8890.000000 COUNT : 8536422 SUM : 15921084 rocksdb.numfiles.in.singlecompaction P50 : 3.259615 P95 : 6.500000 P99 : 22.600000 P100 : 33.000000 COUNT : 95 SUM : 376 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.564562 P95 : 1155.059413 P99 : 2329.781781 P100 : 346125.000000 COUNT : 227023 SUM : 34700655 rocksdb.sst.read.micros P50 : 1.556314 P95 : 3.988341 P99 : 8.327742 P100 : 10189.000000 COUNT : 6331551 SUM : 19381081 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9075999 SUM : 9366430968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 210000.000000 P95 : 358178.571429 P99 : 506637.000000 P100 : 506637.000000 COUNT : 127 SUM : 25914544 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 251 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0