[2024-07-15 19:18:49.383601] Starting SPDK v24.09-pre git sha1 a95bbf233 / DPDK 24.07.0-rc2 initialization... [2024-07-15 19:18:49.383742] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid525425 ] Set seed to 1721063929380151 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-15 19:18:49.443476] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc2 is used. There is no support for it in SPDK. Enabled only for validation. [2024-07-15 19:18:49.484372] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-15 19:18:49.525620] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-15 19:18:49.525671] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 525425' to capture a snapshot of events at runtime. [2024-07-15 19:18:49.525685] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-15 19:18:49.525693] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-15 19:18:49.525703] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid525425 for offline analysis/debug. [2024-07-15 19:18:49.525793] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 15 19:18:53 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/15-19:18:56 ... thread 0: (1000000,1000000) ops and (360201.2,360201.2) ops/second in (2.776226,2.776226) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 378.02 MB 12.6 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 350.8 2.33 2.11 12 0.195 0 0 0.0 0.0 L1 4/0 251.77 MB 25.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 251.3 251.0 1.00 0.97 1 1.003 255K 221 0.0 0.0 L2 3/2 188.87 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 258.0 257.9 0.73 0.71 1 0.732 191K 86 0.0 0.0 L3 10/0 804.21 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1183/6 96.94 GB 0.0 0.4 0.4 0.1 1.2 1.2 0.4 1.5 108.3 309.5 4.07 3.79 14 0.291 447K 307 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.2 1.2 0.4 1.5 108.3 309.5 4.07 3.79 14 0.291 447K 307 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 254.1 253.9 1.74 1.68 2 0.868 447K 307 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 350.8 2.33 2.11 12 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 418.56 MB/s write, 0.43 GB read, 146.53 MB/s read, 4.1 seconds Interval compaction: 1.23 GB write, 453.47 MB/s write, 0.43 GB read, 158.75 MB/s read, 4.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 142718 Average: 1.9314 StdDev: 13.46 Min: 1 Median: 1.2901 Max: 3410 Percentiles: P50: 1.29 P75: 1.72 P99: 5.04 P99.9: 9.90 P99.99: 130.46 ------------------------------------------------------ [ 0, 1 ] 47552 33.319% 33.319% ####### ( 1, 2 ] 82076 57.509% 90.828% ############ ( 2, 3 ] 7708 5.401% 96.229% # ( 3, 4 ] 3031 2.124% 98.353% ( 4, 6 ] 1773 1.242% 99.595% ( 6, 10 ] 448 0.314% 99.909% ( 10, 15 ] 96 0.067% 99.976% ( 15, 22 ] 13 0.009% 99.985% ( 22, 34 ] 5 0.004% 99.989% ( 110, 170 ] 8 0.006% 99.994% ( 170, 250 ] 4 0.003% 99.997% ( 250, 380 ] 6 0.004% 100.001% ( 580, 870 ] 2 0.001% 100.003% ( 1300, 1900 ] 2 0.001% 100.004% ( 1900, 2900 ] 1 0.001% 100.005% ( 2900, 4400 ] 1 0.001% 100.006% ** Level 1 read latency histogram (micros): Count: 20 Average: 121.5500 StdDev: 251.17 Min: 1 Median: 1.6667 Max: 1080 Percentiles: P50: 1.67 P75: 170.00 P99: 1080.00 P99.9: 1080.00 P99.99: 1080.00 ------------------------------------------------------ [ 0, 1 ] 6 30.000% 30.000% ###### ( 1, 2 ] 6 30.000% 60.000% ###### ( 2, 3 ] 1 5.000% 65.000% # ( 3, 4 ] 1 5.000% 70.000% # ( 110, 170 ] 1 5.000% 75.000% # ( 170, 250 ] 1 5.000% 80.000% # ( 250, 380 ] 3 15.000% 95.000% ### ( 870, 1300 ] 1 5.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 28809 Average: 2.4833 StdDev: 13.72 Min: 1 Median: 1.5481 Max: 1287 Percentiles: P50: 1.55 P75: 1.93 P99: 6.00 P99.9: 13.24 P99.99: 784.85 ------------------------------------------------------ [ 0, 1 ] 3946 13.697% 13.697% ### ( 1, 2 ] 19081 66.233% 79.930% ############# ( 2, 3 ] 3100 10.761% 90.690% ## ( 3, 4 ] 1401 4.863% 95.553% # ( 4, 6 ] 994 3.450% 99.004% # ( 6, 10 ] 242 0.840% 99.844% ( 10, 15 ] 25 0.087% 99.931% ( 15, 22 ] 5 0.017% 99.948% ( 22, 34 ] 1 0.003% 99.951% ( 51, 76 ] 1 0.003% 99.955% ( 76, 110 ] 1 0.003% 99.958% ( 110, 170 ] 1 0.003% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 2 0.007% 99.972% ( 380, 580 ] 3 0.010% 99.983% ( 580, 870 ] 3 0.010% 99.993% ( 870, 1300 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 40 Average: 1529.7500 StdDev: 1147.58 Min: 449 Median: 1042.0000 Max: 4756 Percentiles: P50: 1042.00 P75: 2233.33 P99: 4756.00 P99.9: 4756.00 P99.99: 4756.00 ------------------------------------------------------ ( 380, 580 ] 11 27.500% 27.500% ###### ( 580, 870 ] 7 17.500% 45.000% #### ( 870, 1300 ] 5 12.500% 57.500% ### ( 1300, 1900 ] 4 10.000% 67.500% ## ( 1900, 2900 ] 9 22.500% 90.000% ##### ( 2900, 4400 ] 3 7.500% 97.500% ## ( 4400, 6600 ] 1 2.500% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1716.3000 StdDev: 1115.50 Min: 360 Median: 1300.0000 Max: 4318 Percentiles: P50: 1300.00 P75: 2650.00 P99: 4318.00 P99.9: 4318.00 P99.99: 4318.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 380, 580 ] 4 13.333% 16.667% ### ( 580, 870 ] 1 3.333% 20.000% # ( 870, 1300 ] 9 30.000% 50.000% ###### ( 1300, 1900 ] 3 10.000% 60.000% ## ( 1900, 2900 ] 6 20.000% 80.000% #### ( 2900, 4400 ] 6 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 327.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.231 H:M:S, 7.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 354.18 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.231 H:M:S, 8.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-19:18:59 ... thread 0: (1000000,2000000) ops and (309307.4,332819.9) ops/second in (3.233030,6.009256) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/11 1.41 GB 0.0 0.8 0.0 0.8 2.6 1.8 0.0 1.4 97.2 321.3 8.43 7.83 29 0.291 831K 895 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 251.3 251.0 1.00 0.97 1 1.003 255K 221 0.0 0.0 L2 1/0 3.53 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.3 1.5 254.9 254.8 0.76 0.72 2 0.378 195K 87 0.0 0.0 L3 26/0 994.64 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 199.3 199.2 3.13 2.72 3 1.044 634K 426 0.0 0.0 L4 148/0 9.41 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1234/11 97.98 GB 0.0 1.8 0.8 1.0 3.7 2.6 1.2 2.0 141.7 283.5 13.32 12.25 35 0.381 1916K 1629 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.8 1.0 3.7 2.6 1.2 2.0 141.7 283.5 13.32 12.25 35 0.381 1916K 1629 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.8 1.0 1.8 0.8 0.0 0.0 236.9 236.7 7.97 7.44 9 0.885 1916K 1629 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.1 5.35 4.81 26 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.69 GB write, 604.91 MB/s write, 1.84 GB read, 302.44 MB/s read, 13.3 seconds Interval compaction: 3.69 GB write, 628.23 MB/s write, 1.84 GB read, 314.10 MB/s read, 13.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 383371 Average: 2.0354 StdDev: 12.05 Min: 0 Median: 1.3787 Max: 3410 Percentiles: P50: 1.38 P75: 1.78 P99: 5.32 P99.9: 9.90 P99.99: 25.99 ------------------------------------------------------ [ 0, 1 ] 102239 26.668% 26.668% ##### ( 1, 2 ] 236176 61.605% 88.274% ############ ( 2, 3 ] 27117 7.073% 95.347% # ( 3, 4 ] 10151 2.648% 97.995% # ( 4, 6 ] 5855 1.527% 99.522% ( 6, 10 ] 1488 0.388% 99.910% ( 10, 15 ] 274 0.071% 99.981% ( 15, 22 ] 30 0.008% 99.989% ( 22, 34 ] 8 0.002% 99.991% ( 34, 51 ] 3 0.001% 99.992% ( 51, 76 ] 1 0.000% 99.992% ( 110, 170 ] 13 0.003% 99.996% ( 170, 250 ] 11 0.003% 99.999% ( 250, 380 ] 11 0.003% 100.002% ( 380, 580 ] 4 0.001% 100.003% ( 580, 870 ] 4 0.001% 100.004% ( 870, 1300 ] 6 0.002% 100.005% ( 1300, 1900 ] 5 0.001% 100.007% ( 1900, 2900 ] 3 0.001% 100.007% ( 2900, 4400 ] 1 0.000% 100.008% ** Level 1 read latency histogram (micros): Count: 63921 Average: 2.4014 StdDev: 5.04 Min: 1 Median: 1.6356 Max: 1080 Percentiles: P50: 1.64 P75: 2.07 P99: 5.97 P99.9: 12.72 P99.99: 19.61 ------------------------------------------------------ [ 0, 1 ] 5391 8.434% 8.434% ## ( 1, 2 ] 41804 65.399% 73.833% ############# ( 2, 3 ] 10670 16.692% 90.526% ### ( 3, 4 ] 3055 4.779% 95.305% # ( 4, 6 ] 2393 3.744% 99.049% # ( 6, 10 ] 481 0.752% 99.801% ( 10, 15 ] 116 0.181% 99.983% ( 15, 22 ] 7 0.011% 99.994% ( 22, 34 ] 4 0.006% 100.000% ( 110, 170 ] 1 0.002% 100.002% ( 170, 250 ] 1 0.002% 100.003% ( 250, 380 ] 3 0.005% 100.008% ( 870, 1300 ] 1 0.002% 100.009% ** Level 2 read latency histogram (micros): Count: 47977 Average: 2.3204 StdDev: 10.65 Min: 1 Median: 1.5263 Max: 1287 Percentiles: P50: 1.53 P75: 1.90 P99: 5.83 P99.9: 11.11 P99.99: 599.56 ------------------------------------------------------ [ 0, 1 ] 6952 14.490% 14.490% ### ( 1, 2 ] 32372 67.474% 81.964% ############# ( 2, 3 ] 5058 10.543% 92.507% ## ( 3, 4 ] 1972 4.110% 96.617% # ( 4, 6 ] 1250 2.605% 99.223% # ( 6, 10 ] 317 0.661% 99.883% ( 10, 15 ] 36 0.075% 99.958% ( 15, 22 ] 5 0.010% 99.969% ( 22, 34 ] 1 0.002% 99.971% ( 51, 76 ] 1 0.002% 99.973% ( 76, 110 ] 1 0.002% 99.975% ( 110, 170 ] 1 0.002% 99.977% ( 170, 250 ] 1 0.002% 99.979% ( 250, 380 ] 2 0.004% 99.983% ( 380, 580 ] 3 0.006% 99.990% ( 580, 870 ] 3 0.006% 99.996% ( 870, 1300 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 47902 Average: 3.7425 StdDev: 55.90 Min: 0 Median: 1.6184 Max: 4756 Percentiles: P50: 1.62 P75: 2.00 P99: 6.88 P99.9: 220.98 P99.99: 2701.09 ------------------------------------------------------ [ 0, 1 ] 4414 9.215% 9.215% ## ( 1, 2 ] 31595 65.958% 75.172% ############# ( 2, 3 ] 7366 15.377% 90.549% ### ( 3, 4 ] 2272 4.743% 95.292% # ( 4, 6 ] 1690 3.528% 98.821% # ( 6, 10 ] 393 0.820% 99.641% ( 10, 15 ] 63 0.132% 99.772% ( 15, 22 ] 32 0.067% 99.839% ( 22, 34 ] 20 0.042% 99.881% ( 34, 51 ] 1 0.002% 99.883% ( 110, 170 ] 3 0.006% 99.889% ( 170, 250 ] 8 0.017% 99.906% ( 250, 380 ] 3 0.006% 99.912% ( 380, 580 ] 13 0.027% 99.939% ( 580, 870 ] 7 0.015% 99.954% ( 870, 1300 ] 5 0.010% 99.965% ( 1300, 1900 ] 5 0.010% 99.975% ( 1900, 2900 ] 9 0.019% 99.994% ( 2900, 4400 ] 3 0.006% 100.000% ( 4400, 6600 ] 1 0.002% 100.002% ** Level 4 read latency histogram (micros): Count: 30 Average: 1716.3000 StdDev: 1115.50 Min: 360 Median: 1300.0000 Max: 4318 Percentiles: P50: 1300.00 P75: 2650.00 P99: 4318.00 P99.9: 4318.00 P99.99: 4318.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 380, 580 ] 4 13.333% 16.667% ### ( 580, 870 ] 1 3.333% 20.000% # ( 870, 1300 ] 9 30.000% 50.000% ###### ( 1300, 1900 ] 3 10.000% 60.000% ## ( 1900, 2900 ] 6 20.000% 80.000% #### ( 2900, 4400 ] 6 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 761.2500 StdDev: 914.06 Min: 105 Median: 380.0000 Max: 3354 Percentiles: P50: 380.00 P75: 773.33 P99: 3354.00 P99.9: 3354.00 P99.99: 3354.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 5 25.000% 35.000% ##### ( 250, 380 ] 3 15.000% 50.000% ### ( 380, 580 ] 3 15.000% 65.000% ### ( 580, 870 ] 3 15.000% 80.000% ### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.2 total, 3.2 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 315.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.869 H:M:S, 13.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 304.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.639 H:M:S, 19.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-19:19:02 ... thread 0: (1000000,3000000) ops and (357711.2,340723.0) ops/second in (2.795551,8.804807) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 2.27 GB 62.9 1.4 0.0 1.4 4.1 2.7 0.0 1.5 106.4 319.0 13.03 12.14 44 0.296 1407K 1490 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 251.3 251.0 1.00 0.97 1 1.003 255K 221 0.0 0.0 L2 1/0 3.53 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.3 1.5 254.9 254.8 0.76 0.72 2 0.378 195K 87 0.0 0.0 L3 26/0 994.64 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 199.3 199.2 3.13 2.72 3 1.044 634K 426 0.0 0.0 L4 148/0 9.41 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1241/15 98.84 GB 0.0 2.4 0.8 1.6 5.1 3.5 1.2 1.9 137.0 291.5 17.92 16.56 50 0.358 2492K 2224 0.0 0.0 Int 0/0 0.00 KB 0.0 2.4 0.8 1.6 5.1 3.5 1.2 1.9 137.0 291.5 17.92 16.56 50 0.358 2492K 2224 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.4 0.8 1.6 2.4 0.8 0.0 0.0 242.8 242.5 10.11 9.54 11 0.919 2492K 2224 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 354.9 7.81 7.02 39 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.10 GB write, 578.06 MB/s write, 2.40 GB read, 271.63 MB/s read, 17.9 seconds Interval compaction: 5.10 GB write, 593.27 MB/s write, 2.40 GB read, 278.77 MB/s read, 17.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 793816 Average: 2.1160 StdDev: 10.06 Min: 0 Median: 1.4602 Max: 3410 Percentiles: P50: 1.46 P75: 1.84 P99: 5.36 P99.9: 9.56 P99.99: 13.55 ------------------------------------------------------ [ 0, 1 ] 157947 19.897% 19.897% #### ( 1, 2 ] 519292 65.417% 85.314% ############# ( 2, 3 ] 72947 9.189% 94.504% ## ( 3, 4 ] 26088 3.286% 97.790% # ( 4, 6 ] 14133 1.780% 99.571% ( 6, 10 ] 2942 0.371% 99.941% ( 10, 15 ] 548 0.069% 100.010% ( 15, 22 ] 58 0.007% 100.018% ( 22, 34 ] 17 0.002% 100.020% ( 34, 51 ] 7 0.001% 100.021% ( 51, 76 ] 3 0.000% 100.021% ( 76, 110 ] 1 0.000% 100.021% ( 110, 170 ] 20 0.003% 100.024% ( 170, 250 ] 17 0.002% 100.026% ( 250, 380 ] 16 0.002% 100.028% ( 380, 580 ] 6 0.001% 100.028% ( 580, 870 ] 8 0.001% 100.029% ( 870, 1300 ] 8 0.001% 100.030% ( 1300, 1900 ] 9 0.001% 100.032% ( 1900, 2900 ] 3 0.000% 100.032% ( 2900, 4400 ] 2 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 63921 Average: 2.4014 StdDev: 5.04 Min: 1 Median: 1.6356 Max: 1080 Percentiles: P50: 1.64 P75: 2.07 P99: 5.97 P99.9: 12.72 P99.99: 19.61 ------------------------------------------------------ [ 0, 1 ] 5391 8.434% 8.434% ## ( 1, 2 ] 41804 65.399% 73.833% ############# ( 2, 3 ] 10670 16.692% 90.526% ### ( 3, 4 ] 3055 4.779% 95.305% # ( 4, 6 ] 2393 3.744% 99.049% # ( 6, 10 ] 481 0.752% 99.801% ( 10, 15 ] 116 0.181% 99.983% ( 15, 22 ] 7 0.011% 99.994% ( 22, 34 ] 4 0.006% 100.000% ( 110, 170 ] 1 0.002% 100.002% ( 170, 250 ] 1 0.002% 100.003% ( 250, 380 ] 3 0.005% 100.008% ( 870, 1300 ] 1 0.002% 100.009% ** Level 2 read latency histogram (micros): Count: 47977 Average: 2.3204 StdDev: 10.65 Min: 1 Median: 1.5263 Max: 1287 Percentiles: P50: 1.53 P75: 1.90 P99: 5.83 P99.9: 11.11 P99.99: 599.56 ------------------------------------------------------ [ 0, 1 ] 6952 14.490% 14.490% ### ( 1, 2 ] 32372 67.474% 81.964% ############# ( 2, 3 ] 5058 10.543% 92.507% ## ( 3, 4 ] 1972 4.110% 96.617% # ( 4, 6 ] 1250 2.605% 99.223% # ( 6, 10 ] 317 0.661% 99.883% ( 10, 15 ] 36 0.075% 99.958% ( 15, 22 ] 5 0.010% 99.969% ( 22, 34 ] 1 0.002% 99.971% ( 51, 76 ] 1 0.002% 99.973% ( 76, 110 ] 1 0.002% 99.975% ( 110, 170 ] 1 0.002% 99.977% ( 170, 250 ] 1 0.002% 99.979% ( 250, 380 ] 2 0.004% 99.983% ( 380, 580 ] 3 0.006% 99.990% ( 580, 870 ] 3 0.006% 99.996% ( 870, 1300 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 47902 Average: 3.7425 StdDev: 55.90 Min: 0 Median: 1.6184 Max: 4756 Percentiles: P50: 1.62 P75: 2.00 P99: 6.88 P99.9: 220.98 P99.99: 2701.09 ------------------------------------------------------ [ 0, 1 ] 4414 9.215% 9.215% ## ( 1, 2 ] 31595 65.958% 75.172% ############# ( 2, 3 ] 7366 15.377% 90.549% ### ( 3, 4 ] 2272 4.743% 95.292% # ( 4, 6 ] 1690 3.528% 98.821% # ( 6, 10 ] 393 0.820% 99.641% ( 10, 15 ] 63 0.132% 99.772% ( 15, 22 ] 32 0.067% 99.839% ( 22, 34 ] 20 0.042% 99.881% ( 34, 51 ] 1 0.002% 99.883% ( 110, 170 ] 3 0.006% 99.889% ( 170, 250 ] 8 0.017% 99.906% ( 250, 380 ] 3 0.006% 99.912% ( 380, 580 ] 13 0.027% 99.939% ( 580, 870 ] 7 0.015% 99.954% ( 870, 1300 ] 5 0.010% 99.965% ( 1300, 1900 ] 5 0.010% 99.975% ( 1900, 2900 ] 9 0.019% 99.994% ( 2900, 4400 ] 3 0.006% 100.000% ( 4400, 6600 ] 1 0.002% 100.002% ** Level 4 read latency histogram (micros): Count: 30 Average: 1716.3000 StdDev: 1115.50 Min: 360 Median: 1300.0000 Max: 4318 Percentiles: P50: 1300.00 P75: 2650.00 P99: 4318.00 P99.9: 4318.00 P99.99: 4318.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 380, 580 ] 4 13.333% 16.667% ### ( 580, 870 ] 1 3.333% 20.000% # ( 870, 1300 ] 9 30.000% 50.000% ###### ( 1300, 1900 ] 3 10.000% 60.000% ## ( 1900, 2900 ] 6 20.000% 80.000% #### ( 2900, 4400 ] 6 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 761.2500 StdDev: 914.06 Min: 105 Median: 380.0000 Max: 3354 Percentiles: P50: 380.00 P75: 773.33 P99: 3354.00 P99.9: 3354.00 P99.99: 3354.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 5 25.000% 35.000% ##### ( 250, 380 ] 3 15.000% 50.000% ### ( 380, 580 ] 3 15.000% 65.000% ### ( 580, 870 ] 3 15.000% 80.000% ### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 326.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.057 H:M:S, 11.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 352.07 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.187 H:M:S, 6.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/15-19:19:05 ... thread 0: (1000000,4000000) ops and (328103.0,337477.8) ops/second in (3.047823,11.852630) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/13 2.15 GB 0.0 2.5 0.0 2.5 6.1 3.7 0.0 1.7 124.9 312.0 20.18 18.90 62 0.326 2558K 2660 0.0 0.0 L1 10/10 1.10 GB 0.0 1.4 1.4 0.0 1.3 1.3 0.2 1.0 239.3 238.3 5.79 5.62 2 2.893 1406K 5536 0.0 0.0 L2 1/0 3.53 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.3 1.5 254.9 254.8 0.76 0.72 2 0.378 195K 87 0.0 0.0 L3 26/0 994.64 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 199.3 199.2 3.13 2.72 3 1.044 634K 426 0.0 0.0 L4 148/0 9.41 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1246/23 99.82 GB 0.0 4.6 1.9 2.7 8.3 5.6 1.2 2.2 158.1 284.4 29.86 27.97 69 0.433 4794K 8709 0.0 0.0 Int 0/0 0.00 KB 0.0 4.6 1.9 2.7 8.3 5.6 1.2 2.2 158.1 284.4 29.86 27.97 69 0.433 4794K 8709 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.6 1.9 2.7 4.6 1.9 0.0 0.0 246.2 245.8 19.18 18.38 16 1.198 4794K 8709 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 353.8 10.68 9.59 53 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.29 GB write, 702.69 MB/s write, 4.61 GB read, 390.70 MB/s read, 29.9 seconds Interval compaction: 8.29 GB write, 716.43 MB/s write, 4.61 GB read, 398.33 MB/s read, 29.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1072968 Average: 2.0960 StdDev: 9.28 Min: 0 Median: 1.4503 Max: 3410 Percentiles: P50: 1.45 P75: 1.83 P99: 5.31 P99.9: 9.76 P99.99: 13.98 ------------------------------------------------------ [ 0, 1 ] 220129 20.516% 20.516% #### ( 1, 2 ] 702553 65.478% 85.993% ############# ( 2, 3 ] 95166 8.869% 94.863% ## ( 3, 4 ] 33039 3.079% 97.942% # ( 4, 6 ] 17295 1.612% 99.554% ( 6, 10 ] 3955 0.369% 99.923% ( 10, 15 ] 909 0.085% 100.007% ( 15, 22 ] 80 0.007% 100.015% ( 22, 34 ] 20 0.002% 100.017% ( 34, 51 ] 10 0.001% 100.018% ( 51, 76 ] 4 0.000% 100.018% ( 76, 110 ] 2 0.000% 100.018% ( 110, 170 ] 27 0.003% 100.021% ( 170, 250 ] 23 0.002% 100.023% ( 250, 380 ] 24 0.002% 100.025% ( 380, 580 ] 8 0.001% 100.026% ( 580, 870 ] 16 0.001% 100.027% ( 870, 1300 ] 12 0.001% 100.028% ( 1300, 1900 ] 10 0.001% 100.029% ( 1900, 2900 ] 3 0.000% 100.030% ( 2900, 4400 ] 2 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 79265 Average: 2.5119 StdDev: 15.62 Min: 1 Median: 1.5732 Max: 1668 Percentiles: P50: 1.57 P75: 1.96 P99: 5.99 P99.9: 13.91 P99.99: 482.45 ------------------------------------------------------ [ 0, 1 ] 10393 13.112% 13.112% ### ( 1, 2 ] 51013 64.358% 77.469% ############# ( 2, 3 ] 11279 14.229% 91.699% ### ( 3, 4 ] 3311 4.177% 95.876% # ( 4, 6 ] 2492 3.144% 99.020% # ( 6, 10 ] 596 0.752% 99.772% ( 10, 15 ] 130 0.164% 99.936% ( 15, 22 ] 11 0.014% 99.950% ( 22, 34 ] 8 0.010% 99.960% ( 51, 76 ] 1 0.001% 99.961% ( 76, 110 ] 9 0.011% 99.972% ( 110, 170 ] 2 0.003% 99.975% ( 170, 250 ] 1 0.001% 99.976% ( 250, 380 ] 8 0.010% 99.986% ( 380, 580 ] 6 0.008% 99.994% ( 580, 870 ] 3 0.004% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ( 1300, 1900 ] 6 0.008% 100.008% ** Level 2 read latency histogram (micros): Count: 47977 Average: 2.3204 StdDev: 10.65 Min: 1 Median: 1.5263 Max: 1287 Percentiles: P50: 1.53 P75: 1.90 P99: 5.83 P99.9: 11.11 P99.99: 599.56 ------------------------------------------------------ [ 0, 1 ] 6952 14.490% 14.490% ### ( 1, 2 ] 32372 67.474% 81.964% ############# ( 2, 3 ] 5058 10.543% 92.507% ## ( 3, 4 ] 1972 4.110% 96.617% # ( 4, 6 ] 1250 2.605% 99.223% # ( 6, 10 ] 317 0.661% 99.883% ( 10, 15 ] 36 0.075% 99.958% ( 15, 22 ] 5 0.010% 99.969% ( 22, 34 ] 1 0.002% 99.971% ( 51, 76 ] 1 0.002% 99.973% ( 76, 110 ] 1 0.002% 99.975% ( 110, 170 ] 1 0.002% 99.977% ( 170, 250 ] 1 0.002% 99.979% ( 250, 380 ] 2 0.004% 99.983% ( 380, 580 ] 3 0.006% 99.990% ( 580, 870 ] 3 0.006% 99.996% ( 870, 1300 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 47902 Average: 3.7425 StdDev: 55.90 Min: 0 Median: 1.6184 Max: 4756 Percentiles: P50: 1.62 P75: 2.00 P99: 6.88 P99.9: 220.98 P99.99: 2701.09 ------------------------------------------------------ [ 0, 1 ] 4414 9.215% 9.215% ## ( 1, 2 ] 31595 65.958% 75.172% ############# ( 2, 3 ] 7366 15.377% 90.549% ### ( 3, 4 ] 2272 4.743% 95.292% # ( 4, 6 ] 1690 3.528% 98.821% # ( 6, 10 ] 393 0.820% 99.641% ( 10, 15 ] 63 0.132% 99.772% ( 15, 22 ] 32 0.067% 99.839% ( 22, 34 ] 20 0.042% 99.881% ( 34, 51 ] 1 0.002% 99.883% ( 110, 170 ] 3 0.006% 99.889% ( 170, 250 ] 8 0.017% 99.906% ( 250, 380 ] 3 0.006% 99.912% ( 380, 580 ] 13 0.027% 99.939% ( 580, 870 ] 7 0.015% 99.954% ( 870, 1300 ] 5 0.010% 99.965% ( 1300, 1900 ] 5 0.010% 99.975% ( 1900, 2900 ] 9 0.019% 99.994% ( 2900, 4400 ] 3 0.006% 100.000% ( 4400, 6600 ] 1 0.002% 100.002% ** Level 4 read latency histogram (micros): Count: 30 Average: 1716.3000 StdDev: 1115.50 Min: 360 Median: 1300.0000 Max: 4318 Percentiles: P50: 1300.00 P75: 2650.00 P99: 4318.00 P99.9: 4318.00 P99.99: 4318.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 380, 580 ] 4 13.333% 16.667% ### ( 580, 870 ] 1 3.333% 20.000% # ( 870, 1300 ] 9 30.000% 50.000% ###### ( 1300, 1900 ] 3 10.000% 60.000% ## ( 1900, 2900 ] 6 20.000% 80.000% #### ( 2900, 4400 ] 6 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 761.2500 StdDev: 914.06 Min: 105 Median: 380.0000 Max: 3354 Percentiles: P50: 380.00 P75: 773.33 P99: 3354.00 P99.9: 3354.00 P99.99: 3354.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 5 25.000% 35.000% ##### ( 250, 380 ] 3 15.000% 50.000% ### ( 380, 580 ] 3 15.000% 65.000% ### ( 580, 870 ] 3 15.000% 80.000% ### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 325.73 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.536 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.479 H:M:S, 15.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-19:19:08 ... thread 0: (1000000,5000000) ops and (333619.7,336699.1) ops/second in (2.997425,14.850055) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.13 GB 94.4 3.3 0.0 3.3 7.9 4.7 0.0 1.7 127.8 310.9 26.13 24.49 79 0.331 3390K 3504 0.0 0.0 L1 10/10 1.10 GB 0.0 1.4 1.4 0.0 1.3 1.3 0.2 1.0 239.3 238.3 5.79 5.62 2 2.893 1406K 5536 0.0 0.0 L2 1/0 3.53 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.3 1.5 254.9 254.8 0.76 0.72 2 0.378 195K 87 0.0 0.0 L3 26/0 994.64 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 199.3 199.2 3.13 2.72 3 1.044 634K 426 0.0 0.0 L4 148/0 9.41 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1251/23 100.80 GB 0.0 5.4 1.9 3.5 10.1 6.6 1.2 2.2 154.8 288.2 35.81 33.55 86 0.416 5626K 9553 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 1.9 3.5 10.1 6.6 1.2 2.2 154.8 288.2 35.81 33.55 86 0.416 5626K 9553 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 1.9 3.5 5.4 1.9 0.0 0.0 248.7 248.2 22.28 21.43 19 1.173 5626K 9553 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 354.0 13.52 12.12 67 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.1 total, 14.9 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.08 GB write, 684.12 MB/s write, 5.41 GB read, 367.35 MB/s read, 35.8 seconds Interval compaction: 10.08 GB write, 694.79 MB/s write, 5.41 GB read, 373.09 MB/s read, 35.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1415415 Average: 2.1457 StdDev: 10.66 Min: 0 Median: 1.4675 Max: 4206 Percentiles: P50: 1.47 P75: 1.85 P99: 5.38 P99.9: 9.93 P99.99: 14.47 ------------------------------------------------------ [ 0, 1 ] 269840 19.064% 19.064% #### ( 1, 2 ] 936535 66.167% 85.231% ############# ( 2, 3 ] 133793 9.453% 94.684% ## ( 3, 4 ] 44874 3.170% 97.854% # ( 4, 6 ] 23535 1.663% 99.517% ( 6, 10 ] 5523 0.390% 99.907% ( 10, 15 ] 1314 0.093% 100.000% ( 15, 22 ] 109 0.008% 100.008% ( 22, 34 ] 22 0.002% 100.009% ( 34, 51 ] 12 0.001% 100.010% ( 51, 76 ] 7 0.000% 100.011% ( 76, 110 ] 21 0.001% 100.012% ( 110, 170 ] 108 0.008% 100.020% ( 170, 250 ] 37 0.003% 100.022% ( 250, 380 ] 38 0.003% 100.025% ( 380, 580 ] 27 0.002% 100.027% ( 580, 870 ] 22 0.002% 100.028% ( 870, 1300 ] 19 0.001% 100.030% ( 1300, 1900 ] 12 0.001% 100.031% ( 1900, 2900 ] 4 0.000% 100.031% ( 2900, 4400 ] 5 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 143479 Average: 2.5535 StdDev: 14.82 Min: 1 Median: 1.5655 Max: 2621 Percentiles: P50: 1.57 P75: 1.94 P99: 7.48 P99.9: 82.85 P99.99: 464.58 ------------------------------------------------------ [ 0, 1 ] 17846 12.438% 12.438% ## ( 1, 2 ] 95297 66.419% 78.857% ############# ( 2, 3 ] 18951 13.208% 92.065% ### ( 3, 4 ] 5529 3.854% 95.919% # ( 4, 6 ] 3819 2.662% 98.580% # ( 6, 10 ] 1627 1.134% 99.714% ( 10, 15 ] 225 0.157% 99.871% ( 15, 22 ] 17 0.012% 99.883% ( 22, 34 ] 8 0.006% 99.888% ( 51, 76 ] 1 0.001% 99.889% ( 76, 110 ] 77 0.054% 99.943% ( 110, 170 ] 25 0.017% 99.960% ( 170, 250 ] 20 0.014% 99.974% ( 250, 380 ] 18 0.013% 99.987% ( 380, 580 ] 11 0.008% 99.994% ( 580, 870 ] 4 0.003% 99.997% ( 870, 1300 ] 3 0.002% 99.999% ( 1300, 1900 ] 6 0.004% 100.003% ( 1900, 2900 ] 1 0.001% 100.004% ** Level 2 read latency histogram (micros): Count: 47977 Average: 2.3204 StdDev: 10.65 Min: 1 Median: 1.5263 Max: 1287 Percentiles: P50: 1.53 P75: 1.90 P99: 5.83 P99.9: 11.11 P99.99: 599.56 ------------------------------------------------------ [ 0, 1 ] 6952 14.490% 14.490% ### ( 1, 2 ] 32372 67.474% 81.964% ############# ( 2, 3 ] 5058 10.543% 92.507% ## ( 3, 4 ] 1972 4.110% 96.617% # ( 4, 6 ] 1250 2.605% 99.223% # ( 6, 10 ] 317 0.661% 99.883% ( 10, 15 ] 36 0.075% 99.958% ( 15, 22 ] 5 0.010% 99.969% ( 22, 34 ] 1 0.002% 99.971% ( 51, 76 ] 1 0.002% 99.973% ( 76, 110 ] 1 0.002% 99.975% ( 110, 170 ] 1 0.002% 99.977% ( 170, 250 ] 1 0.002% 99.979% ( 250, 380 ] 2 0.004% 99.983% ( 380, 580 ] 3 0.006% 99.990% ( 580, 870 ] 3 0.006% 99.996% ( 870, 1300 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 47902 Average: 3.7425 StdDev: 55.90 Min: 0 Median: 1.6184 Max: 4756 Percentiles: P50: 1.62 P75: 2.00 P99: 6.88 P99.9: 220.98 P99.99: 2701.09 ------------------------------------------------------ [ 0, 1 ] 4414 9.215% 9.215% ## ( 1, 2 ] 31595 65.958% 75.172% ############# ( 2, 3 ] 7366 15.377% 90.549% ### ( 3, 4 ] 2272 4.743% 95.292% # ( 4, 6 ] 1690 3.528% 98.821% # ( 6, 10 ] 393 0.820% 99.641% ( 10, 15 ] 63 0.132% 99.772% ( 15, 22 ] 32 0.067% 99.839% ( 22, 34 ] 20 0.042% 99.881% ( 34, 51 ] 1 0.002% 99.883% ( 110, 170 ] 3 0.006% 99.889% ( 170, 250 ] 8 0.017% 99.906% ( 250, 380 ] 3 0.006% 99.912% ( 380, 580 ] 13 0.027% 99.939% ( 580, 870 ] 7 0.015% 99.954% ( 870, 1300 ] 5 0.010% 99.965% ( 1300, 1900 ] 5 0.010% 99.975% ( 1900, 2900 ] 9 0.019% 99.994% ( 2900, 4400 ] 3 0.006% 100.000% ( 4400, 6600 ] 1 0.002% 100.002% ** Level 4 read latency histogram (micros): Count: 30 Average: 1716.3000 StdDev: 1115.50 Min: 360 Median: 1300.0000 Max: 4318 Percentiles: P50: 1300.00 P75: 2650.00 P99: 4318.00 P99.9: 4318.00 P99.99: 4318.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 380, 580 ] 4 13.333% 16.667% ### ( 580, 870 ] 1 3.333% 20.000% # ( 870, 1300 ] 9 30.000% 50.000% ###### ( 1300, 1900 ] 3 10.000% 60.000% ## ( 1900, 2900 ] 6 20.000% 80.000% #### ( 2900, 4400 ] 6 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 761.2500 StdDev: 914.06 Min: 105 Median: 380.0000 Max: 3354 Percentiles: P50: 380.00 P75: 773.33 P99: 3354.00 P99.9: 3354.00 P99.99: 3354.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 5 25.000% 35.000% ##### ( 250, 380 ] 3 15.000% 50.000% ### ( 380, 580 ] 3 15.000% 65.000% ### ( 580, 870 ] 3 15.000% 80.000% ### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.1 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 326.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.936 H:M:S, 12.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.400 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-19:19:13 ... thread 0: (1000000,6000000) ops and (193207.4,299612.9) ops/second in (5.175784,20.025839) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 4.12 GB 144.7 4.6 0.0 4.6 10.3 5.7 0.0 1.8 138.5 308.3 34.11 32.09 99 0.345 4797K 4924 0.0 0.0 L1 10/10 1.10 GB 0.0 1.4 1.4 0.0 1.3 1.3 0.2 1.0 239.3 238.3 5.79 5.62 2 2.893 1406K 5536 0.0 0.0 L2 1/0 3.53 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.3 1.5 254.9 254.8 0.76 0.72 2 0.378 195K 87 0.0 0.0 L3 26/0 994.64 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 199.3 199.2 3.13 2.72 3 1.044 634K 426 0.0 0.0 L4 148/0 9.41 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1251/23 101.79 GB 0.0 6.8 1.9 4.9 12.4 7.6 1.2 2.2 158.2 290.3 43.79 41.15 106 0.413 7033K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.8 1.9 4.9 12.4 7.6 1.2 2.2 158.2 290.3 43.79 41.15 106 0.413 7033K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.8 1.9 4.9 6.8 1.9 0.0 0.0 253.0 252.6 27.38 26.46 24 1.141 7033K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 353.3 16.41 14.70 82 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.3 total, 20.0 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.41 GB write, 627.43 MB/s write, 6.76 GB read, 341.92 MB/s read, 43.8 seconds Interval compaction: 12.41 GB write, 634.69 MB/s write, 6.76 GB read, 345.87 MB/s read, 43.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 16, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1937984 Average: 2.1822 StdDev: 11.15 Min: 0 Median: 1.4732 Max: 4763 Percentiles: P50: 1.47 P75: 1.85 P99: 5.46 P99.9: 10.65 P99.99: 19.10 ------------------------------------------------------ [ 0, 1 ] 357107 18.427% 18.427% #### ( 1, 2 ] 1293067 66.722% 85.149% ############# ( 2, 3 ] 183704 9.479% 94.628% ## ( 3, 4 ] 61295 3.163% 97.791% # ( 4, 6 ] 32188 1.661% 99.452% ( 6, 10 ] 8438 0.435% 99.887% ( 10, 15 ] 1898 0.098% 99.985% ( 15, 22 ] 161 0.008% 99.993% ( 22, 34 ] 27 0.001% 99.995% ( 34, 51 ] 14 0.001% 99.996% ( 51, 76 ] 10 0.001% 99.996% ( 76, 110 ] 122 0.006% 100.002% ( 110, 170 ] 231 0.012% 100.014% ( 170, 250 ] 83 0.004% 100.019% ( 250, 380 ] 74 0.004% 100.022% ( 380, 580 ] 56 0.003% 100.025% ( 580, 870 ] 46 0.002% 100.028% ( 870, 1300 ] 27 0.001% 100.029% ( 1300, 1900 ] 17 0.001% 100.030% ( 1900, 2900 ] 4 0.000% 100.030% ( 2900, 4400 ] 6 0.000% 100.030% ( 4400, 6600 ] 1 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 253162 Average: 2.4896 StdDev: 12.39 Min: 1 Median: 1.5369 Max: 2621 Percentiles: P50: 1.54 P75: 1.91 P99: 7.63 P99.9: 93.66 P99.99: 411.57 ------------------------------------------------------ [ 0, 1 ] 35244 13.922% 13.922% ### ( 1, 2 ] 170134 67.204% 81.125% ############# ( 2, 3 ] 29339 11.589% 92.714% ## ( 3, 4 ] 8790 3.472% 96.186% # ( 4, 6 ] 5895 2.329% 98.515% ( 6, 10 ] 3020 1.193% 99.708% ( 10, 15 ] 347 0.137% 99.845% ( 15, 22 ] 29 0.011% 99.856% ( 22, 34 ] 12 0.005% 99.861% ( 51, 76 ] 10 0.004% 99.865% ( 76, 110 ] 173 0.068% 99.933% ( 110, 170 ] 75 0.030% 99.963% ( 170, 250 ] 39 0.015% 99.978% ( 250, 380 ] 28 0.011% 99.989% ( 380, 580 ] 17 0.007% 99.996% ( 580, 870 ] 6 0.002% 99.998% ( 870, 1300 ] 4 0.002% 100.000% ( 1300, 1900 ] 6 0.002% 100.002% ( 1900, 2900 ] 1 0.000% 100.003% ** Level 2 read latency histogram (micros): Count: 47977 Average: 2.3204 StdDev: 10.65 Min: 1 Median: 1.5263 Max: 1287 Percentiles: P50: 1.53 P75: 1.90 P99: 5.83 P99.9: 11.11 P99.99: 599.56 ------------------------------------------------------ [ 0, 1 ] 6952 14.490% 14.490% ### ( 1, 2 ] 32372 67.474% 81.964% ############# ( 2, 3 ] 5058 10.543% 92.507% ## ( 3, 4 ] 1972 4.110% 96.617% # ( 4, 6 ] 1250 2.605% 99.223% # ( 6, 10 ] 317 0.661% 99.883% ( 10, 15 ] 36 0.075% 99.958% ( 15, 22 ] 5 0.010% 99.969% ( 22, 34 ] 1 0.002% 99.971% ( 51, 76 ] 1 0.002% 99.973% ( 76, 110 ] 1 0.002% 99.975% ( 110, 170 ] 1 0.002% 99.977% ( 170, 250 ] 1 0.002% 99.979% ( 250, 380 ] 2 0.004% 99.983% ( 380, 580 ] 3 0.006% 99.990% ( 580, 870 ] 3 0.006% 99.996% ( 870, 1300 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 47902 Average: 3.7425 StdDev: 55.90 Min: 0 Median: 1.6184 Max: 4756 Percentiles: P50: 1.62 P75: 2.00 P99: 6.88 P99.9: 220.98 P99.99: 2701.09 ------------------------------------------------------ [ 0, 1 ] 4414 9.215% 9.215% ## ( 1, 2 ] 31595 65.958% 75.172% ############# ( 2, 3 ] 7366 15.377% 90.549% ### ( 3, 4 ] 2272 4.743% 95.292% # ( 4, 6 ] 1690 3.528% 98.821% # ( 6, 10 ] 393 0.820% 99.641% ( 10, 15 ] 63 0.132% 99.772% ( 15, 22 ] 32 0.067% 99.839% ( 22, 34 ] 20 0.042% 99.881% ( 34, 51 ] 1 0.002% 99.883% ( 110, 170 ] 3 0.006% 99.889% ( 170, 250 ] 8 0.017% 99.906% ( 250, 380 ] 3 0.006% 99.912% ( 380, 580 ] 13 0.027% 99.939% ( 580, 870 ] 7 0.015% 99.954% ( 870, 1300 ] 5 0.010% 99.965% ( 1300, 1900 ] 5 0.010% 99.975% ( 1900, 2900 ] 9 0.019% 99.994% ( 2900, 4400 ] 3 0.006% 100.000% ( 4400, 6600 ] 1 0.002% 100.002% ** Level 4 read latency histogram (micros): Count: 30 Average: 1716.3000 StdDev: 1115.50 Min: 360 Median: 1300.0000 Max: 4318 Percentiles: P50: 1300.00 P75: 2650.00 P99: 4318.00 P99.9: 4318.00 P99.99: 4318.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 380, 580 ] 4 13.333% 16.667% ### ( 580, 870 ] 1 3.333% 20.000% # ( 870, 1300 ] 9 30.000% 50.000% ###### ( 1300, 1900 ] 3 10.000% 60.000% ## ( 1900, 2900 ] 6 20.000% 80.000% #### ( 2900, 4400 ] 6 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 761.2500 StdDev: 914.06 Min: 105 Median: 380.0000 Max: 3354 Percentiles: P50: 380.00 P75: 773.33 P99: 3354.00 P99.9: 3354.00 P99.99: 3354.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 5 25.000% 35.000% ##### ( 250, 380 ] 3 15.000% 50.000% ### ( 380, 580 ] 3 15.000% 65.000% ### ( 580, 870 ] 3 15.000% 80.000% ### ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 20.3 total, 5.2 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 291.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.532 H:M:S, 22.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 190.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.596 H:M:S, 50.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-19:19:20 ... thread 0: (1000000,7000000) ops and (141312.2,258280.0) ops/second in (7.076529,27.102368) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/13 3.13 GB 50.4 5.7 0.0 5.7 12.2 6.6 0.0 1.9 141.9 306.8 40.84 38.38 115 0.355 5884K 7622 0.0 0.0 L1 17/17 1.96 GB 0.0 4.4 3.3 1.1 4.3 3.2 0.2 1.3 232.1 229.8 19.23 18.45 3 6.409 4532K 44K 0.0 0.0 L2 1/0 3.53 MB 0.0 0.2 0.1 0.1 0.2 0.1 1.3 1.5 254.9 254.8 0.76 0.72 2 0.378 195K 87 0.0 0.0 L3 14/0 944.69 MB 0.9 0.6 0.4 0.2 0.6 0.4 1.1 1.4 199.3 199.2 3.13 2.72 3 1.044 634K 426 0.0 0.0 L4 168/0 9.48 GB 1.0 0.2 0.2 0.0 0.2 0.2 1.1 1.1 183.8 183.4 1.32 1.14 2 0.661 246K 579 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1277/30 102.67 GB 0.0 11.1 4.0 7.0 17.6 10.6 5.0 2.7 173.4 275.8 65.28 61.42 125 0.522 11M 53K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.1 4.0 7.0 17.6 10.6 5.0 2.7 173.4 275.8 65.28 61.42 125 0.522 11M 53K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.1 4.0 7.0 11.0 4.0 0.0 0.0 245.2 244.0 46.16 44.31 29 1.592 11M 53K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 352.5 19.12 17.11 96 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.3 total, 27.1 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.58 GB write, 658.68 MB/s write, 11.05 GB read, 414.07 MB/s read, 65.3 seconds Interval compaction: 17.58 GB write, 664.31 MB/s write, 11.05 GB read, 417.60 MB/s read, 65.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 18, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2527790 Average: 2.3109 StdDev: 13.45 Min: 0 Median: 1.4695 Max: 4763 Percentiles: P50: 1.47 P75: 1.84 P99: 5.62 P99.9: 14.29 P99.99: 166.30 ------------------------------------------------------ [ 0, 1 ] 472603 18.696% 18.696% #### ( 1, 2 ] 1685464 66.677% 85.374% ############# ( 2, 3 ] 232987 9.217% 94.591% ## ( 3, 4 ] 77540 3.068% 97.658% # ( 4, 6 ] 41852 1.656% 99.314% ( 6, 10 ] 12706 0.503% 99.817% ( 10, 15 ] 2462 0.097% 99.914% ( 15, 22 ] 244 0.010% 99.924% ( 22, 34 ] 31 0.001% 99.925% ( 34, 51 ] 17 0.001% 99.925% ( 51, 76 ] 17 0.001% 99.926% ( 76, 110 ] 797 0.032% 99.958% ( 110, 170 ] 871 0.034% 99.992% ( 170, 250 ] 287 0.011% 100.003% ( 250, 380 ] 237 0.009% 100.013% ( 380, 580 ] 187 0.007% 100.020% ( 580, 870 ] 106 0.004% 100.024% ( 870, 1300 ] 47 0.002% 100.026% ( 1300, 1900 ] 21 0.001% 100.027% ( 1900, 2900 ] 13 0.001% 100.028% ( 2900, 4400 ] 9 0.000% 100.028% ( 4400, 6600 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 383087 Average: 2.5940 StdDev: 15.83 Min: 1 Median: 1.5112 Max: 3720 Percentiles: P50: 1.51 P75: 1.89 P99: 7.58 P99.9: 118.86 P99.99: 700.32 ------------------------------------------------------ [ 0, 1 ] 62654 16.355% 16.355% ### ( 1, 2 ] 252119 65.812% 82.167% ############# ( 2, 3 ] 41265 10.772% 92.939% ## ( 3, 4 ] 12616 3.293% 96.232% # ( 4, 6 ] 8996 2.348% 98.581% ( 6, 10 ] 4073 1.063% 99.644% ( 10, 15 ] 507 0.132% 99.776% ( 15, 22 ] 53 0.014% 99.790% ( 22, 34 ] 12 0.003% 99.793% ( 51, 76 ] 27 0.007% 99.800% ( 76, 110 ] 349 0.091% 99.891% ( 110, 170 ] 223 0.058% 99.950% ( 170, 250 ] 60 0.016% 99.965% ( 250, 380 ] 45 0.012% 99.977% ( 380, 580 ] 36 0.009% 99.986% ( 580, 870 ] 33 0.009% 99.995% ( 870, 1300 ] 14 0.004% 99.999% ( 1300, 1900 ] 9 0.002% 100.001% ( 1900, 2900 ] 1 0.000% 100.001% ( 2900, 4400 ] 1 0.000% 100.002% ** Level 2 read latency histogram (micros): Count: 47977 Average: 2.3204 StdDev: 10.65 Min: 1 Median: 1.5263 Max: 1287 Percentiles: P50: 1.53 P75: 1.90 P99: 5.83 P99.9: 11.11 P99.99: 599.56 ------------------------------------------------------ [ 0, 1 ] 6952 14.490% 14.490% ### ( 1, 2 ] 32372 67.474% 81.964% ############# ( 2, 3 ] 5058 10.543% 92.507% ## ( 3, 4 ] 1972 4.110% 96.617% # ( 4, 6 ] 1250 2.605% 99.223% # ( 6, 10 ] 317 0.661% 99.883% ( 10, 15 ] 36 0.075% 99.958% ( 15, 22 ] 5 0.010% 99.969% ( 22, 34 ] 1 0.002% 99.971% ( 51, 76 ] 1 0.002% 99.973% ( 76, 110 ] 1 0.002% 99.975% ( 110, 170 ] 1 0.002% 99.977% ( 170, 250 ] 1 0.002% 99.979% ( 250, 380 ] 2 0.004% 99.983% ( 380, 580 ] 3 0.006% 99.990% ( 580, 870 ] 3 0.006% 99.996% ( 870, 1300 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 76892 Average: 4.1678 StdDev: 47.94 Min: 0 Median: 1.6520 Max: 4756 Percentiles: P50: 1.65 P75: 2.15 P99: 8.94 P99.9: 442.42 P99.99: 1934.53 ------------------------------------------------------ [ 0, 1 ] 6251 8.130% 8.130% ## ( 1, 2 ] 49382 64.223% 72.352% ############# ( 2, 3 ] 13170 17.128% 89.480% ### ( 3, 4 ] 3871 5.034% 94.514% # ( 4, 6 ] 2733 3.554% 98.069% # ( 6, 10 ] 974 1.267% 99.335% ( 10, 15 ] 137 0.178% 99.514% ( 15, 22 ] 43 0.056% 99.570% ( 22, 34 ] 20 0.026% 99.596% ( 34, 51 ] 2 0.003% 99.598% ( 76, 110 ] 32 0.042% 99.640% ( 110, 170 ] 80 0.104% 99.744% ( 170, 250 ] 56 0.073% 99.817% ( 250, 380 ] 51 0.066% 99.883% ( 380, 580 ] 42 0.055% 99.938% ( 580, 870 ] 27 0.035% 99.973% ( 870, 1300 ] 8 0.010% 99.983% ( 1300, 1900 ] 5 0.007% 99.990% ( 1900, 2900 ] 9 0.012% 100.001% ( 2900, 4400 ] 3 0.004% 100.005% ( 4400, 6600 ] 1 0.001% 100.007% ** Level 4 read latency histogram (micros): Count: 115 Average: 470.6174 StdDev: 937.34 Min: 0 Median: 4.2500 Max: 4318 Percentiles: P50: 4.25 P75: 442.50 P99: 4112.50 P99.9: 4318.00 P99.99: 4318.00 ------------------------------------------------------ [ 0, 1 ] 35 30.435% 30.435% ###### ( 1, 2 ] 16 13.913% 44.348% ### ( 2, 3 ] 5 4.348% 48.696% # ( 3, 4 ] 1 0.870% 49.565% ( 4, 6 ] 4 3.478% 53.043% # ( 6, 10 ] 9 7.826% 60.870% ## ( 10, 15 ] 4 3.478% 64.348% # ( 15, 22 ] 1 0.870% 65.217% ( 110, 170 ] 4 3.478% 68.696% # ( 170, 250 ] 4 3.478% 72.174% # ( 250, 380 ] 2 1.739% 73.913% ( 380, 580 ] 4 3.478% 77.391% # ( 580, 870 ] 2 1.739% 79.130% ( 870, 1300 ] 9 7.826% 86.957% ## ( 1300, 1900 ] 3 2.609% 89.565% # ( 1900, 2900 ] 6 5.217% 94.783% # ( 2900, 4400 ] 6 5.217% 100.000% # ** Level 5 read latency histogram (micros): Count: 80 Average: 796.4125 StdDev: 1067.97 Min: 79 Median: 304.1667 Max: 4343 Percentiles: P50: 304.17 P75: 870.00 P99: 4200.00 P99.9: 4343.00 P99.99: 4343.00 ------------------------------------------------------ ( 76, 110 ] 15 18.750% 18.750% #### ( 110, 170 ] 17 21.250% 40.000% #### ( 170, 250 ] 3 3.750% 43.750% # ( 250, 380 ] 12 15.000% 58.750% ### ( 380, 580 ] 9 11.250% 70.000% ## ( 580, 870 ] 4 5.000% 75.000% # ( 870, 1300 ] 4 5.000% 80.000% # ( 1300, 1900 ] 3 3.750% 83.750% # ( 1900, 2900 ] 7 8.750% 92.500% ## ( 2900, 4400 ] 6 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 27.3 total, 7.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 252.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.987 H:M:S, 32.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 139.08 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.456 H:M:S, 63.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-19:19:43 ... thread 0: (1000000,8000000) ops and (45014.9,162215.1) ops/second in (22.214858,49.317226) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 1.78 GB 18.9 7.6 0.0 7.6 15.2 7.6 0.0 2.0 143.5 286.7 54.44 48.71 132 0.412 7930K 14K 0.0 0.0 L1 10/10 988.67 MB 0.0 8.7 5.7 3.1 8.6 5.5 0.2 1.5 228.4 225.3 39.08 36.76 4 9.771 8592K 44K 0.0 0.0 L2 2/1 204.39 MB 1.0 0.2 0.1 0.1 0.2 0.1 4.6 1.5 254.9 254.8 0.76 0.72 2 0.378 195K 87 0.0 0.0 L3 20/6 1.65 GB 0.9 1.7 0.9 0.8 1.7 0.9 3.7 1.9 143.0 141.7 12.46 8.02 8 1.558 1810K 16K 0.0 0.0 L4 171/16 10.25 GB 1.0 2.9 2.6 0.3 2.9 2.6 1.1 1.1 122.9 122.4 24.24 13.93 26 0.932 2989K 9921 0.0 0.0 L5 1080/0 88.77 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1291/39 103.61 GB 0.0 21.2 9.3 11.9 28.6 16.8 12.6 3.8 165.6 224.0 130.97 108.14 172 0.761 21M 85K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.2 9.3 11.9 28.6 16.8 12.6 3.8 165.6 224.0 130.97 108.14 172 0.761 21M 85K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.2 9.3 11.9 21.0 9.1 0.0 0.0 204.4 202.9 106.10 88.11 63 1.684 21M 85K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 314.1 24.87 20.03 109 0.228 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.6 total, 49.3 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.65 GB write, 592.04 MB/s write, 21.18 GB read, 437.68 MB/s read, 131.0 seconds Interval compaction: 28.65 GB write, 594.82 MB/s write, 21.18 GB read, 439.73 MB/s read, 131.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 48, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 48, interval: 70 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3718108 Average: 2.9458 StdDev: 37.51 Min: 0 Median: 1.4802 Max: 8838 Percentiles: P50: 1.48 P75: 1.87 P99: 6.38 P99.9: 144.51 P99.99: 426.17 ------------------------------------------------------ [ 0, 1 ] 699961 18.826% 18.826% #### ( 1, 2 ] 2413693 64.917% 83.743% ############# ( 2, 3 ] 356513 9.589% 93.332% ## ( 3, 4 ] 124601 3.351% 96.683% # ( 4, 6 ] 83854 2.255% 98.938% ( 6, 10 ] 24185 0.650% 99.588% ( 10, 15 ] 4484 0.121% 99.709% ( 15, 22 ] 591 0.016% 99.725% ( 22, 34 ] 52 0.001% 99.726% ( 34, 51 ] 24 0.001% 99.727% ( 51, 76 ] 59 0.002% 99.729% ( 76, 110 ] 4273 0.115% 99.844% ( 110, 170 ] 3663 0.099% 99.942% ( 170, 250 ] 934 0.025% 99.967% ( 250, 380 ] 726 0.020% 99.987% ( 380, 580 ] 564 0.015% 100.002% ( 580, 870 ] 303 0.008% 100.010% ( 870, 1300 ] 163 0.004% 100.014% ( 1300, 1900 ] 102 0.003% 100.017% ( 1900, 2900 ] 105 0.003% 100.020% ( 2900, 4400 ] 118 0.003% 100.023% ( 4400, 6600 ] 50 0.001% 100.024% ( 6600, 9900 ] 16 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1671591 Average: 5.2939 StdDev: 89.44 Min: 1 Median: 1.6468 Max: 11624 Percentiles: P50: 1.65 P75: 2.34 P99: 8.93 P99.9: 127.36 P99.99: 303.43 ------------------------------------------------------ [ 0, 1 ] 230252 13.774% 13.774% ### ( 1, 2 ] 936167 56.005% 69.779% ########### ( 2, 3 ] 254251 15.210% 84.989% ### ( 3, 4 ] 108956 6.518% 91.507% # ( 4, 6 ] 104831 6.271% 97.779% # ( 6, 10 ] 27919 1.670% 99.449% ( 10, 15 ] 4857 0.291% 99.739% ( 15, 22 ] 709 0.042% 99.782% ( 22, 34 ] 71 0.004% 99.786% ( 34, 51 ] 20 0.001% 99.787% ( 51, 76 ] 149 0.009% 99.796% ( 76, 110 ] 1349 0.081% 99.877% ( 110, 170 ] 1353 0.081% 99.958% ( 170, 250 ] 369 0.022% 99.980% ( 250, 380 ] 424 0.025% 100.005% ( 380, 580 ] 460 0.028% 100.033% ( 580, 870 ] 518 0.031% 100.064% ( 870, 1300 ] 419 0.025% 100.089% ( 1300, 1900 ] 227 0.014% 100.102% ( 1900, 2900 ] 280 0.017% 100.119% ( 2900, 4400 ] 320 0.019% 100.138% ( 4400, 6600 ] 124 0.007% 100.146% ( 6600, 9900 ] 43 0.003% 100.148% ( 9900, 14000 ] 1 0.000% 100.148% ** Level 2 read latency histogram (micros): Count: 47977 Average: 2.3204 StdDev: 10.65 Min: 1 Median: 1.5263 Max: 1287 Percentiles: P50: 1.53 P75: 1.90 P99: 5.83 P99.9: 11.11 P99.99: 599.56 ------------------------------------------------------ [ 0, 1 ] 6952 14.490% 14.490% ### ( 1, 2 ] 32372 67.474% 81.964% ############# ( 2, 3 ] 5058 10.543% 92.507% ## ( 3, 4 ] 1972 4.110% 96.617% # ( 4, 6 ] 1250 2.605% 99.223% # ( 6, 10 ] 317 0.661% 99.883% ( 10, 15 ] 36 0.075% 99.958% ( 15, 22 ] 5 0.010% 99.969% ( 22, 34 ] 1 0.002% 99.971% ( 51, 76 ] 1 0.002% 99.973% ( 76, 110 ] 1 0.002% 99.975% ( 110, 170 ] 1 0.002% 99.977% ( 170, 250 ] 1 0.002% 99.979% ( 250, 380 ] 2 0.004% 99.983% ( 380, 580 ] 3 0.006% 99.990% ( 580, 870 ] 3 0.006% 99.996% ( 870, 1300 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 423770 Average: 10.4638 StdDev: 135.88 Min: 0 Median: 1.9284 Max: 10891 Percentiles: P50: 1.93 P75: 2.92 P99: 9.58 P99.9: 813.78 P99.99: 1162.55 ------------------------------------------------------ [ 0, 1 ] 10233 2.415% 2.415% ( 1, 2 ] 217207 51.256% 53.671% ########## ( 2, 3 ] 97978 23.121% 76.791% ##### ( 3, 4 ] 46657 11.010% 87.801% ## ( 4, 6 ] 41270 9.739% 97.540% ## ( 6, 10 ] 6921 1.633% 99.173% ( 10, 15 ] 1307 0.308% 99.482% ( 15, 22 ] 174 0.041% 99.523% ( 22, 34 ] 26 0.006% 99.529% ( 34, 51 ] 5 0.001% 99.530% ( 51, 76 ] 5 0.001% 99.531% ( 76, 110 ] 46 0.011% 99.542% ( 110, 170 ] 148 0.035% 99.577% ( 170, 250 ] 195 0.046% 99.623% ( 250, 380 ] 326 0.077% 99.700% ( 380, 580 ] 425 0.100% 99.800% ( 580, 870 ] 525 0.124% 99.924% ( 870, 1300 ] 411 0.097% 100.021% ( 1300, 1900 ] 263 0.062% 100.083% ( 1900, 2900 ] 204 0.048% 100.131% ( 2900, 4400 ] 197 0.046% 100.178% ( 4400, 6600 ] 66 0.016% 100.193% ( 6600, 9900 ] 12 0.003% 100.196% ( 9900, 14000 ] 1 0.000% 100.196% ** Level 4 read latency histogram (micros): Count: 57326 Average: 18.0809 StdDev: 230.48 Min: 0 Median: 1.9665 Max: 32234 Percentiles: P50: 1.97 P75: 2.97 P99: 327.52 P99.9: 2547.58 P99.99: 3791.09 ------------------------------------------------------ [ 0, 1 ] 836 1.458% 1.458% ( 1, 2 ] 28793 50.227% 51.685% ########## ( 2, 3 ] 13824 24.115% 75.800% ##### ( 3, 4 ] 6489 11.319% 87.119% ## ( 4, 6 ] 5372 9.371% 96.490% ## ( 6, 10 ] 1010 1.762% 98.252% ( 10, 15 ] 241 0.420% 98.673% ( 15, 22 ] 16 0.028% 98.700% ( 22, 34 ] 4 0.007% 98.707% ( 34, 51 ] 4 0.007% 98.714% ( 51, 76 ] 1 0.002% 98.716% ( 76, 110 ] 13 0.023% 98.739% ( 110, 170 ] 35 0.061% 98.800% ( 170, 250 ] 73 0.127% 98.927% ( 250, 380 ] 70 0.122% 99.049% ( 380, 580 ] 107 0.187% 99.236% ( 580, 870 ] 141 0.246% 99.482% ( 870, 1300 ] 113 0.197% 99.679% ( 1300, 1900 ] 93 0.162% 99.841% ( 1900, 2900 ] 52 0.091% 99.932% ( 2900, 4400 ] 56 0.098% 100.030% ( 4400, 6600 ] 6 0.010% 100.040% ( 9900, 14000 ] 1 0.002% 100.042% ( 14000, 22000 ] 1 0.002% 100.044% ( 22000, 33000 ] 1 0.002% 100.045% ** Level 5 read latency histogram (micros): Count: 180 Average: 1547.8667 StdDev: 2003.36 Min: 79 Median: 779.3750 Max: 15173 Percentiles: P50: 779.38 P75: 2400.00 P99: 10720.00 P99.9: 15173.00 P99.99: 15173.00 ------------------------------------------------------ ( 76, 110 ] 18 10.000% 10.000% ## ( 110, 170 ] 18 10.000% 20.000% ## ( 170, 250 ] 9 5.000% 25.000% # ( 250, 380 ] 18 10.000% 35.000% ## ( 380, 580 ] 16 8.889% 43.889% ## ( 580, 870 ] 16 8.889% 52.778% ## ( 870, 1300 ] 17 9.444% 62.222% ## ( 1300, 1900 ] 16 8.889% 71.111% ## ( 1900, 2900 ] 14 7.778% 78.889% ## ( 2900, 4400 ] 27 15.000% 93.889% ### ( 4400, 6600 ] 8 4.444% 98.333% # ( 6600, 9900 ] 1 0.556% 98.889% ( 9900, 14000 ] 1 0.556% 99.444% ( 14000, 22000 ] 1 0.556% 100.000% ** DB Stats ** Uptime(secs): 49.6 total, 22.2 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 158.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.138 H:M:S, 56.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 44.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:19.151 H:M:S, 86.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/07/15-19:19:46 ... thread 0: (1000000,9000000) ops and (304600.8,171102.0) ops/second in (3.282986,52.600212) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/6 2.64 GB 119.6 8.6 0.0 8.6 17.1 8.5 0.0 2.0 142.4 282.6 61.92 54.99 147 0.421 8953K 15K 0.0 0.0 L1 10/10 988.67 MB 0.0 8.7 5.7 3.1 8.6 5.5 0.2 1.5 228.4 225.3 39.08 36.76 4 9.771 8592K 44K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 4.6 1.5 254.9 254.8 0.76 0.72 2 0.378 195K 87 0.0 0.0 L3 15/0 944.80 MB 0.9 2.0 1.0 0.9 1.9 1.0 3.8 1.9 141.2 139.8 14.26 9.10 9 1.585 2045K 19K 0.0 0.0 L4 159/0 9.50 GB 1.0 4.3 3.5 0.8 4.3 3.5 1.1 1.2 127.7 127.2 34.41 20.38 34 1.012 4413K 13K 0.0 0.0 L5 1100/0 90.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1295/16 104.46 GB 0.0 23.8 10.3 13.5 32.1 18.6 14.4 3.8 161.8 218.5 150.42 121.96 196 0.767 24M 93K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.8 10.3 13.5 32.1 18.6 14.4 3.8 161.8 218.5 150.42 121.96 196 0.767 24M 93K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.8 10.3 13.5 23.6 10.1 0.0 0.0 198.4 197.0 122.70 99.63 75 1.636 24M 93K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 313.6 27.72 22.33 121 0.229 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 52.8 total, 52.6 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.09 GB write, 622.04 MB/s write, 23.77 GB read, 460.74 MB/s read, 150.4 seconds Interval compaction: 32.09 GB write, 624.78 MB/s write, 23.77 GB read, 462.77 MB/s read, 150.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 60, interval: 82 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4044609 Average: 2.9315 StdDev: 36.47 Min: 0 Median: 1.4960 Max: 8838 Percentiles: P50: 1.50 P75: 1.88 P99: 6.56 P99.9: 137.69 P99.99: 373.06 ------------------------------------------------------ [ 0, 1 ] 723202 17.881% 17.881% #### ( 1, 2 ] 2619327 64.761% 82.642% ############# ( 2, 3 ] 415475 10.272% 92.914% ## ( 3, 4 ] 143449 3.547% 96.461% # ( 4, 6 ] 98743 2.441% 98.902% ( 6, 10 ] 28403 0.702% 99.604% ( 10, 15 ] 5170 0.128% 99.732% ( 15, 22 ] 665 0.016% 99.748% ( 22, 34 ] 54 0.001% 99.750% ( 34, 51 ] 26 0.001% 99.750% ( 51, 76 ] 62 0.002% 99.752% ( 76, 110 ] 4286 0.106% 99.858% ( 110, 170 ] 3691 0.091% 99.949% ( 170, 250 ] 953 0.024% 99.973% ( 250, 380 ] 739 0.018% 99.991% ( 380, 580 ] 587 0.015% 100.006% ( 580, 870 ] 319 0.008% 100.013% ( 870, 1300 ] 180 0.004% 100.018% ( 1300, 1900 ] 110 0.003% 100.021% ( 1900, 2900 ] 112 0.003% 100.023% ( 2900, 4400 ] 122 0.003% 100.026% ( 4400, 6600 ] 50 0.001% 100.028% ( 6600, 9900 ] 16 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 1812395 Average: 5.1910 StdDev: 87.03 Min: 1 Median: 1.6553 Max: 11624 Percentiles: P50: 1.66 P75: 2.36 P99: 8.94 P99.9: 128.57 P99.99: 321.76 ------------------------------------------------------ [ 0, 1 ] 238279 13.147% 13.147% ### ( 1, 2 ] 1019218 56.236% 69.383% ########### ( 2, 3 ] 281623 15.539% 84.922% ### ( 3, 4 ] 118848 6.558% 91.479% # ( 4, 6 ] 113430 6.259% 97.738% # ( 6, 10 ] 31101 1.716% 99.454% ( 10, 15 ] 5258 0.290% 99.744% ( 15, 22 ] 754 0.042% 99.786% ( 22, 34 ] 73 0.004% 99.790% ( 34, 51 ] 23 0.001% 99.791% ( 51, 76 ] 154 0.008% 99.799% ( 76, 110 ] 1380 0.076% 99.876% ( 110, 170 ] 1427 0.079% 99.954% ( 170, 250 ] 399 0.022% 99.976% ( 250, 380 ] 447 0.025% 100.001% ( 380, 580 ] 497 0.027% 100.028% ( 580, 870 ] 543 0.030% 100.058% ( 870, 1300 ] 437 0.024% 100.083% ( 1300, 1900 ] 239 0.013% 100.096% ( 1900, 2900 ] 297 0.016% 100.112% ( 2900, 4400 ] 331 0.018% 100.130% ( 4400, 6600 ] 126 0.007% 100.137% ( 6600, 9900 ] 43 0.002% 100.140% ( 9900, 14000 ] 1 0.000% 100.140% ** Level 2 read latency histogram (micros): Count: 47977 Average: 2.3204 StdDev: 10.65 Min: 1 Median: 1.5263 Max: 1287 Percentiles: P50: 1.53 P75: 1.90 P99: 5.83 P99.9: 11.11 P99.99: 599.56 ------------------------------------------------------ [ 0, 1 ] 6952 14.490% 14.490% ### ( 1, 2 ] 32372 67.474% 81.964% ############# ( 2, 3 ] 5058 10.543% 92.507% ## ( 3, 4 ] 1972 4.110% 96.617% # ( 4, 6 ] 1250 2.605% 99.223% # ( 6, 10 ] 317 0.661% 99.883% ( 10, 15 ] 36 0.075% 99.958% ( 15, 22 ] 5 0.010% 99.969% ( 22, 34 ] 1 0.002% 99.971% ( 51, 76 ] 1 0.002% 99.973% ( 76, 110 ] 1 0.002% 99.975% ( 110, 170 ] 1 0.002% 99.977% ( 170, 250 ] 1 0.002% 99.979% ( 250, 380 ] 2 0.004% 99.983% ( 380, 580 ] 3 0.006% 99.990% ( 580, 870 ] 3 0.006% 99.996% ( 870, 1300 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 472822 Average: 10.0953 StdDev: 131.56 Min: 0 Median: 1.9237 Max: 10891 Percentiles: P50: 1.92 P75: 2.91 P99: 9.55 P99.9: 807.09 P99.99: 1162.91 ------------------------------------------------------ [ 0, 1 ] 11035 2.334% 2.334% ( 1, 2 ] 243998 51.605% 53.938% ########## ( 2, 3 ] 109172 23.089% 77.028% ##### ( 3, 4 ] 51775 10.950% 87.978% ## ( 4, 6 ] 45432 9.609% 97.587% ## ( 6, 10 ] 7528 1.592% 99.179% ( 10, 15 ] 1440 0.305% 99.484% ( 15, 22 ] 190 0.040% 99.524% ( 22, 34 ] 26 0.005% 99.529% ( 34, 51 ] 6 0.001% 99.530% ( 51, 76 ] 6 0.001% 99.532% ( 76, 110 ] 48 0.010% 99.542% ( 110, 170 ] 166 0.035% 99.577% ( 170, 250 ] 224 0.047% 99.624% ( 250, 380 ] 359 0.076% 99.700% ( 380, 580 ] 490 0.104% 99.804% ( 580, 870 ] 580 0.123% 99.927% ( 870, 1300 ] 440 0.093% 100.020% ( 1300, 1900 ] 274 0.058% 100.078% ( 1900, 2900 ] 215 0.045% 100.123% ( 2900, 4400 ] 202 0.043% 100.166% ( 4400, 6600 ] 70 0.015% 100.181% ( 6600, 9900 ] 12 0.003% 100.183% ( 9900, 14000 ] 1 0.000% 100.183% ** Level 4 read latency histogram (micros): Count: 133532 Average: 11.8496 StdDev: 163.78 Min: 0 Median: 1.8918 Max: 32234 Percentiles: P50: 1.89 P75: 2.83 P99: 13.68 P99.9: 1801.52 P99.99: 3346.52 ------------------------------------------------------ [ 0, 1 ] 1970 1.475% 1.475% ( 1, 2 ] 72655 54.410% 55.885% ########### ( 2, 3 ] 30699 22.990% 78.875% ##### ( 3, 4 ] 13009 9.742% 88.618% ## ( 4, 6 ] 10754 8.054% 96.671% ## ( 6, 10 ] 2764 2.070% 98.741% ( 10, 15 ] 470 0.352% 99.093% ( 15, 22 ] 43 0.032% 99.125% ( 22, 34 ] 8 0.006% 99.131% ( 34, 51 ] 4 0.003% 99.134% ( 51, 76 ] 1 0.001% 99.135% ( 76, 110 ] 31 0.023% 99.158% ( 110, 170 ] 79 0.059% 99.217% ( 170, 250 ] 129 0.097% 99.314% ( 250, 380 ] 112 0.084% 99.398% ( 380, 580 ] 193 0.145% 99.542% ( 580, 870 ] 216 0.162% 99.704% ( 870, 1300 ] 162 0.121% 99.826% ( 1300, 1900 ] 119 0.089% 99.915% ( 1900, 2900 ] 81 0.061% 99.975% ( 2900, 4400 ] 66 0.049% 100.025% ( 4400, 6600 ] 7 0.005% 100.030% ( 6600, 9900 ] 1 0.001% 100.031% ( 9900, 14000 ] 1 0.001% 100.031% ( 14000, 22000 ] 1 0.001% 100.032% ( 22000, 33000 ] 1 0.001% 100.033% ** Level 5 read latency histogram (micros): Count: 280 Average: 1368.9000 StdDev: 1779.23 Min: 79 Median: 626.4000 Max: 15173 Percentiles: P50: 626.40 P75: 2117.39 P99: 7260.00 P99.9: 15173.00 P99.99: 15173.00 ------------------------------------------------------ ( 76, 110 ] 26 9.286% 9.286% ## ( 110, 170 ] 35 12.500% 21.786% ### ( 170, 250 ] 21 7.500% 29.286% ## ( 250, 380 ] 26 9.286% 38.571% ## ( 380, 580 ] 28 10.000% 48.571% ## ( 580, 870 ] 25 8.929% 57.500% ## ( 870, 1300 ] 23 8.214% 65.714% ## ( 1300, 1900 ] 21 7.500% 73.214% ## ( 1900, 2900 ] 23 8.214% 81.429% ## ( 2900, 4400 ] 39 13.929% 95.357% ### ( 4400, 6600 ] 10 3.571% 98.929% # ( 6600, 9900 ] 1 0.357% 99.286% ( 9900, 14000 ] 1 0.357% 99.643% ( 14000, 22000 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 52.8 total, 3.3 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 167.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.730 H:M:S, 54.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 299.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.592 H:M:S, 18.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-19:19:49 ... thread 0: (1000000,10000000) ops and (306331.0,179004.1) ops/second in (3.264443,55.864655) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/6 3.62 GB 220.2 9.5 0.0 9.5 18.9 9.5 0.0 2.0 142.4 284.6 68.11 60.82 163 0.418 9848K 16K 0.0 0.0 L1 10/10 988.67 MB 0.0 8.7 5.7 3.1 8.6 5.5 0.2 1.5 228.4 225.3 39.08 36.76 4 9.771 8592K 44K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 4.6 1.5 254.9 254.8 0.76 0.72 2 0.378 195K 87 0.0 0.0 L3 15/0 944.80 MB 0.9 2.0 1.0 0.9 1.9 1.0 3.8 1.9 141.2 139.8 14.26 9.10 9 1.585 2045K 19K 0.0 0.0 L4 159/0 9.50 GB 1.0 4.3 3.5 0.8 4.3 3.5 1.1 1.2 127.7 127.2 34.41 20.38 34 1.012 4413K 13K 0.0 0.0 L5 1100/0 90.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1299/16 105.44 GB 0.0 24.6 10.3 14.3 33.9 19.6 14.4 3.6 161.1 221.9 156.62 127.79 212 0.739 25M 94K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.6 10.3 14.3 33.9 19.6 14.4 3.6 161.1 221.9 156.62 127.79 212 0.739 25M 94K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.6 10.3 14.3 24.5 10.1 0.0 0.0 200.2 198.8 126.02 102.88 78 1.616 25M 94K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 317.0 30.60 24.91 134 0.228 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.1 total, 55.9 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.94 GB write, 619.51 MB/s write, 24.63 GB read, 449.65 MB/s read, 156.6 seconds Interval compaction: 33.94 GB write, 622.08 MB/s write, 24.63 GB read, 451.51 MB/s read, 156.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 65, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 65, interval: 87 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4337576 Average: 2.8842 StdDev: 35.28 Min: 0 Median: 1.4986 Max: 8838 Percentiles: P50: 1.50 P75: 1.88 P99: 6.38 P99.9: 132.28 P99.99: 358.75 ------------------------------------------------------ [ 0, 1 ] 762611 17.582% 17.582% #### ( 1, 2 ] 2819997 65.013% 82.595% ############# ( 2, 3 ] 449933 10.373% 92.968% ## ( 3, 4 ] 154074 3.552% 96.520% # ( 4, 6 ] 104777 2.416% 98.935% ( 6, 10 ] 29795 0.687% 99.622% ( 10, 15 ] 5543 0.128% 99.750% ( 15, 22 ] 700 0.016% 99.766% ( 22, 34 ] 57 0.001% 99.767% ( 34, 51 ] 28 0.001% 99.768% ( 51, 76 ] 64 0.001% 99.770% ( 76, 110 ] 4287 0.099% 99.868% ( 110, 170 ] 3696 0.085% 99.954% ( 170, 250 ] 957 0.022% 99.976% ( 250, 380 ] 745 0.017% 99.993% ( 380, 580 ] 592 0.014% 100.006% ( 580, 870 ] 324 0.007% 100.014% ( 870, 1300 ] 184 0.004% 100.018% ( 1300, 1900 ] 113 0.003% 100.021% ( 1900, 2900 ] 113 0.003% 100.023% ( 2900, 4400 ] 122 0.003% 100.026% ( 4400, 6600 ] 50 0.001% 100.027% ( 6600, 9900 ] 16 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 1967575 Average: 4.9894 StdDev: 83.58 Min: 1 Median: 1.6479 Max: 11624 Percentiles: P50: 1.65 P75: 2.31 P99: 8.89 P99.9: 129.02 P99.99: 326.90 ------------------------------------------------------ [ 0, 1 ] 253280 12.873% 12.873% ### ( 1, 2 ] 1127475 57.303% 70.175% ########### ( 2, 3 ] 301617 15.329% 85.505% ### ( 3, 4 ] 124119 6.308% 91.813% # ( 4, 6 ] 117088 5.951% 97.764% # ( 6, 10 ] 33640 1.710% 99.474% ( 10, 15 ] 5378 0.273% 99.747% ( 15, 22 ] 766 0.039% 99.786% ( 22, 34 ] 74 0.004% 99.790% ( 34, 51 ] 25 0.001% 99.791% ( 51, 76 ] 160 0.008% 99.799% ( 76, 110 ] 1498 0.076% 99.875% ( 110, 170 ] 1538 0.078% 99.953% ( 170, 250 ] 444 0.023% 99.976% ( 250, 380 ] 467 0.024% 100.000% ( 380, 580 ] 514 0.026% 100.026% ( 580, 870 ] 549 0.028% 100.054% ( 870, 1300 ] 438 0.022% 100.076% ( 1300, 1900 ] 240 0.012% 100.088% ( 1900, 2900 ] 297 0.015% 100.103% ( 2900, 4400 ] 331 0.017% 100.120% ( 4400, 6600 ] 126 0.006% 100.127% ( 6600, 9900 ] 43 0.002% 100.129% ( 9900, 14000 ] 1 0.000% 100.129% ** Level 2 read latency histogram (micros): Count: 47977 Average: 2.3204 StdDev: 10.65 Min: 1 Median: 1.5263 Max: 1287 Percentiles: P50: 1.53 P75: 1.90 P99: 5.83 P99.9: 11.11 P99.99: 599.56 ------------------------------------------------------ [ 0, 1 ] 6952 14.490% 14.490% ### ( 1, 2 ] 32372 67.474% 81.964% ############# ( 2, 3 ] 5058 10.543% 92.507% ## ( 3, 4 ] 1972 4.110% 96.617% # ( 4, 6 ] 1250 2.605% 99.223% # ( 6, 10 ] 317 0.661% 99.883% ( 10, 15 ] 36 0.075% 99.958% ( 15, 22 ] 5 0.010% 99.969% ( 22, 34 ] 1 0.002% 99.971% ( 51, 76 ] 1 0.002% 99.973% ( 76, 110 ] 1 0.002% 99.975% ( 110, 170 ] 1 0.002% 99.977% ( 170, 250 ] 1 0.002% 99.979% ( 250, 380 ] 2 0.004% 99.983% ( 380, 580 ] 3 0.006% 99.990% ( 580, 870 ] 3 0.006% 99.996% ( 870, 1300 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 472822 Average: 10.0953 StdDev: 131.56 Min: 0 Median: 1.9237 Max: 10891 Percentiles: P50: 1.92 P75: 2.91 P99: 9.55 P99.9: 807.09 P99.99: 1162.91 ------------------------------------------------------ [ 0, 1 ] 11035 2.334% 2.334% ( 1, 2 ] 243998 51.605% 53.938% ########## ( 2, 3 ] 109172 23.089% 77.028% ##### ( 3, 4 ] 51775 10.950% 87.978% ## ( 4, 6 ] 45432 9.609% 97.587% ## ( 6, 10 ] 7528 1.592% 99.179% ( 10, 15 ] 1440 0.305% 99.484% ( 15, 22 ] 190 0.040% 99.524% ( 22, 34 ] 26 0.005% 99.529% ( 34, 51 ] 6 0.001% 99.530% ( 51, 76 ] 6 0.001% 99.532% ( 76, 110 ] 48 0.010% 99.542% ( 110, 170 ] 166 0.035% 99.577% ( 170, 250 ] 224 0.047% 99.624% ( 250, 380 ] 359 0.076% 99.700% ( 380, 580 ] 490 0.104% 99.804% ( 580, 870 ] 580 0.123% 99.927% ( 870, 1300 ] 440 0.093% 100.020% ( 1300, 1900 ] 274 0.058% 100.078% ( 1900, 2900 ] 215 0.045% 100.123% ( 2900, 4400 ] 202 0.043% 100.166% ( 4400, 6600 ] 70 0.015% 100.181% ( 6600, 9900 ] 12 0.003% 100.183% ( 9900, 14000 ] 1 0.000% 100.183% ** Level 4 read latency histogram (micros): Count: 133532 Average: 11.8496 StdDev: 163.78 Min: 0 Median: 1.8918 Max: 32234 Percentiles: P50: 1.89 P75: 2.83 P99: 13.68 P99.9: 1801.52 P99.99: 3346.52 ------------------------------------------------------ [ 0, 1 ] 1970 1.475% 1.475% ( 1, 2 ] 72655 54.410% 55.885% ########### ( 2, 3 ] 30699 22.990% 78.875% ##### ( 3, 4 ] 13009 9.742% 88.618% ## ( 4, 6 ] 10754 8.054% 96.671% ## ( 6, 10 ] 2764 2.070% 98.741% ( 10, 15 ] 470 0.352% 99.093% ( 15, 22 ] 43 0.032% 99.125% ( 22, 34 ] 8 0.006% 99.131% ( 34, 51 ] 4 0.003% 99.134% ( 51, 76 ] 1 0.001% 99.135% ( 76, 110 ] 31 0.023% 99.158% ( 110, 170 ] 79 0.059% 99.217% ( 170, 250 ] 129 0.097% 99.314% ( 250, 380 ] 112 0.084% 99.398% ( 380, 580 ] 193 0.145% 99.542% ( 580, 870 ] 216 0.162% 99.704% ( 870, 1300 ] 162 0.121% 99.826% ( 1300, 1900 ] 119 0.089% 99.915% ( 1900, 2900 ] 81 0.061% 99.975% ( 2900, 4400 ] 66 0.049% 100.025% ( 4400, 6600 ] 7 0.005% 100.030% ( 6600, 9900 ] 1 0.001% 100.031% ( 9900, 14000 ] 1 0.001% 100.031% ( 14000, 22000 ] 1 0.001% 100.032% ( 22000, 33000 ] 1 0.001% 100.033% ** Level 5 read latency histogram (micros): Count: 280 Average: 1368.9000 StdDev: 1779.23 Min: 79 Median: 626.4000 Max: 15173 Percentiles: P50: 626.40 P75: 2117.39 P99: 7260.00 P99.9: 15173.00 P99.99: 15173.00 ------------------------------------------------------ ( 76, 110 ] 26 9.286% 9.286% ## ( 110, 170 ] 35 12.500% 21.786% ### ( 170, 250 ] 21 7.500% 29.286% ## ( 250, 380 ] 26 9.286% 38.571% ## ( 380, 580 ] 28 10.000% 48.571% ## ( 580, 870 ] 25 8.929% 57.500% ## ( 870, 1300 ] 23 8.214% 65.714% ## ( 1300, 1900 ] 21 7.500% 73.214% ## ( 1900, 2900 ] 23 8.214% 81.429% ## ( 2900, 4400 ] 39 13.929% 95.357% ### ( 4400, 6600 ] 10 3.571% 98.929% # ( 6600, 9900 ] 1 0.357% 99.286% ( 9900, 14000 ] 1 0.357% 99.643% ( 14000, 22000 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 56.1 total, 3.3 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 175.44 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.385 H:M:S, 52.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 301.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.655 H:M:S, 20.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-19:19:52 ... thread 0: (1000000,11000000) ops and (335655.1,186935.3) ops/second in (2.979249,58.843904) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 3.38 GB 289.4 10.3 0.0 10.3 20.8 10.4 0.0 2.0 142.4 286.2 74.32 66.62 180 0.413 10M 17K 0.0 0.0 L1 28/0 2.18 GB 222.8 10.9 6.9 4.0 10.8 6.7 0.2 1.6 217.7 215.1 51.29 46.54 5 10.258 9864K 44K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 4.6 1.5 254.9 254.8 0.76 0.72 2 0.378 195K 87 0.0 0.0 L3 15/0 944.80 MB 0.9 2.0 1.0 0.9 1.9 1.0 3.8 1.9 141.2 139.8 14.26 9.10 9 1.585 2045K 19K 0.0 0.0 L4 159/0 9.50 GB 1.0 4.3 3.5 0.8 4.3 3.5 1.1 1.2 127.7 127.2 34.41 20.38 34 1.012 4413K 13K 0.0 0.0 L5 1100/0 90.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1320/8 106.41 GB 0.0 27.7 11.5 16.1 38.0 21.8 14.4 3.6 162.0 222.1 175.04 143.37 230 0.761 27M 95K 0.0 0.0 Int 0/0 0.00 KB 0.0 27.7 11.5 16.1 38.0 21.8 14.4 3.6 162.0 222.1 175.04 143.37 230 0.761 27M 95K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 27.7 11.5 16.1 27.5 11.4 0.0 0.0 200.3 199.0 141.54 115.89 82 1.726 27M 95K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 319.7 33.50 27.48 148 0.226 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.1 total, 58.8 interval Flush(GB): cumulative 10.458, interval 10.458 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 37.96 GB write, 657.95 MB/s write, 27.68 GB read, 479.84 MB/s read, 175.0 seconds Interval compaction: 37.96 GB write, 660.54 MB/s write, 27.68 GB read, 481.73 MB/s read, 175.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 68, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 68, interval: 90 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4576670 Average: 2.8387 StdDev: 34.55 Min: 0 Median: 1.4918 Max: 8838 Percentiles: P50: 1.49 P75: 1.88 P99: 6.17 P99.9: 128.49 P99.99: 353.02 ------------------------------------------------------ [ 0, 1 ] 827124 18.073% 18.073% #### ( 1, 2 ] 2971409 64.925% 82.998% ############# ( 2, 3 ] 464951 10.159% 93.157% ## ( 3, 4 ] 159136 3.477% 96.634% # ( 4, 6 ] 107009 2.338% 98.972% ( 6, 10 ] 30406 0.664% 99.637% ( 10, 15 ] 5751 0.126% 99.762% ( 15, 22 ] 722 0.016% 99.778% ( 22, 34 ] 60 0.001% 99.779% ( 34, 51 ] 29 0.001% 99.780% ( 51, 76 ] 68 0.001% 99.781% ( 76, 110 ] 4288 0.094% 99.875% ( 110, 170 ] 3704 0.081% 99.956% ( 170, 250 ] 962 0.021% 99.977% ( 250, 380 ] 750 0.016% 99.993% ( 380, 580 ] 592 0.013% 100.006% ( 580, 870 ] 331 0.007% 100.014% ( 870, 1300 ] 187 0.004% 100.018% ( 1300, 1900 ] 114 0.002% 100.020% ( 1900, 2900 ] 116 0.003% 100.023% ( 2900, 4400 ] 123 0.003% 100.025% ( 4400, 6600 ] 51 0.001% 100.027% ( 6600, 9900 ] 16 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 2015237 Average: 4.9592 StdDev: 82.72 Min: 1 Median: 1.6449 Max: 11624 Percentiles: P50: 1.64 P75: 2.30 P99: 8.89 P99.9: 133.02 P99.99: 343.28 ------------------------------------------------------ [ 0, 1 ] 258980 12.851% 12.851% ### ( 1, 2 ] 1160870 57.605% 70.456% ############ ( 2, 3 ] 306949 15.231% 85.687% ### ( 3, 4 ] 125534 6.229% 91.916% # ( 4, 6 ] 117925 5.852% 97.768% # ( 6, 10 ] 34360 1.705% 99.473% ( 10, 15 ] 5397 0.268% 99.741% ( 15, 22 ] 771 0.038% 99.779% ( 22, 34 ] 79 0.004% 99.783% ( 34, 51 ] 26 0.001% 99.784% ( 51, 76 ] 163 0.008% 99.792% ( 76, 110 ] 1554 0.077% 99.870% ( 110, 170 ] 1600 0.079% 99.949% ( 170, 250 ] 473 0.023% 99.972% ( 250, 380 ] 494 0.025% 99.997% ( 380, 580 ] 527 0.026% 100.023% ( 580, 870 ] 574 0.028% 100.052% ( 870, 1300 ] 453 0.022% 100.074% ( 1300, 1900 ] 243 0.012% 100.086% ( 1900, 2900 ] 297 0.015% 100.101% ( 2900, 4400 ] 331 0.016% 100.117% ( 4400, 6600 ] 126 0.006% 100.124% ( 6600, 9900 ] 43 0.002% 100.126% ( 9900, 14000 ] 1 0.000% 100.126% ** Level 2 read latency histogram (micros): Count: 47977 Average: 2.3204 StdDev: 10.65 Min: 1 Median: 1.5263 Max: 1287 Percentiles: P50: 1.53 P75: 1.90 P99: 5.83 P99.9: 11.11 P99.99: 599.56 ------------------------------------------------------ [ 0, 1 ] 6952 14.490% 14.490% ### ( 1, 2 ] 32372 67.474% 81.964% ############# ( 2, 3 ] 5058 10.543% 92.507% ## ( 3, 4 ] 1972 4.110% 96.617% # ( 4, 6 ] 1250 2.605% 99.223% # ( 6, 10 ] 317 0.661% 99.883% ( 10, 15 ] 36 0.075% 99.958% ( 15, 22 ] 5 0.010% 99.969% ( 22, 34 ] 1 0.002% 99.971% ( 51, 76 ] 1 0.002% 99.973% ( 76, 110 ] 1 0.002% 99.975% ( 110, 170 ] 1 0.002% 99.977% ( 170, 250 ] 1 0.002% 99.979% ( 250, 380 ] 2 0.004% 99.983% ( 380, 580 ] 3 0.006% 99.990% ( 580, 870 ] 3 0.006% 99.996% ( 870, 1300 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 472822 Average: 10.0953 StdDev: 131.56 Min: 0 Median: 1.9237 Max: 10891 Percentiles: P50: 1.92 P75: 2.91 P99: 9.55 P99.9: 807.09 P99.99: 1162.91 ------------------------------------------------------ [ 0, 1 ] 11035 2.334% 2.334% ( 1, 2 ] 243998 51.605% 53.938% ########## ( 2, 3 ] 109172 23.089% 77.028% ##### ( 3, 4 ] 51775 10.950% 87.978% ## ( 4, 6 ] 45432 9.609% 97.587% ## ( 6, 10 ] 7528 1.592% 99.179% ( 10, 15 ] 1440 0.305% 99.484% ( 15, 22 ] 190 0.040% 99.524% ( 22, 34 ] 26 0.005% 99.529% ( 34, 51 ] 6 0.001% 99.530% ( 51, 76 ] 6 0.001% 99.532% ( 76, 110 ] 48 0.010% 99.542% ( 110, 170 ] 166 0.035% 99.577% ( 170, 250 ] 224 0.047% 99.624% ( 250, 380 ] 359 0.076% 99.700% ( 380, 580 ] 490 0.104% 99.804% ( 580, 870 ] 580 0.123% 99.927% ( 870, 1300 ] 440 0.093% 100.020% ( 1300, 1900 ] 274 0.058% 100.078% ( 1900, 2900 ] 215 0.045% 100.123% ( 2900, 4400 ] 202 0.043% 100.166% ( 4400, 6600 ] 70 0.015% 100.181% ( 6600, 9900 ] 12 0.003% 100.183% ( 9900, 14000 ] 1 0.000% 100.183% ** Level 4 read latency histogram (micros): Count: 133532 Average: 11.8496 StdDev: 163.78 Min: 0 Median: 1.8918 Max: 32234 Percentiles: P50: 1.89 P75: 2.83 P99: 13.68 P99.9: 1801.52 P99.99: 3346.52 ------------------------------------------------------ [ 0, 1 ] 1970 1.475% 1.475% ( 1, 2 ] 72655 54.410% 55.885% ########### ( 2, 3 ] 30699 22.990% 78.875% ##### ( 3, 4 ] 13009 9.742% 88.618% ## ( 4, 6 ] 10754 8.054% 96.671% ## ( 6, 10 ] 2764 2.070% 98.741% ( 10, 15 ] 470 0.352% 99.093% ( 15, 22 ] 43 0.032% 99.125% ( 22, 34 ] 8 0.006% 99.131% ( 34, 51 ] 4 0.003% 99.134% ( 51, 76 ] 1 0.001% 99.135% ( 76, 110 ] 31 0.023% 99.158% ( 110, 170 ] 79 0.059% 99.217% ( 170, 250 ] 129 0.097% 99.314% ( 250, 380 ] 112 0.084% 99.398% ( 380, 580 ] 193 0.145% 99.542% ( 580, 870 ] 216 0.162% 99.704% ( 870, 1300 ] 162 0.121% 99.826% ( 1300, 1900 ] 119 0.089% 99.915% ( 1900, 2900 ] 81 0.061% 99.975% ( 2900, 4400 ] 66 0.049% 100.025% ( 4400, 6600 ] 7 0.005% 100.030% ( 6600, 9900 ] 1 0.001% 100.031% ( 9900, 14000 ] 1 0.001% 100.031% ( 14000, 22000 ] 1 0.001% 100.032% ( 22000, 33000 ] 1 0.001% 100.033% ** Level 5 read latency histogram (micros): Count: 280 Average: 1368.9000 StdDev: 1779.23 Min: 79 Median: 626.4000 Max: 15173 Percentiles: P50: 626.40 P75: 2117.39 P99: 7260.00 P99.9: 15173.00 P99.99: 15173.00 ------------------------------------------------------ ( 76, 110 ] 26 9.286% 9.286% ## ( 110, 170 ] 35 12.500% 21.786% ### ( 170, 250 ] 21 7.500% 29.286% ## ( 250, 380 ] 26 9.286% 38.571% ## ( 380, 580 ] 28 10.000% 48.571% ## ( 580, 870 ] 25 8.929% 57.500% ## ( 870, 1300 ] 23 8.214% 65.714% ## ( 1300, 1900 ] 21 7.500% 73.214% ## ( 1900, 2900 ] 23 8.214% 81.429% ## ( 2900, 4400 ] 39 13.929% 95.357% ### ( 4400, 6600 ] 10 3.571% 98.929% # ( 6600, 9900 ] 1 0.357% 99.286% ( 9900, 14000 ] 1 0.357% 99.643% ( 14000, 22000 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 59.1 total, 3.0 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 183.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.801 H:M:S, 50.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.416 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.315 micros/op 188149 ops/sec 60.043 seconds 11296999 operations; 182.3 MB/s Microseconds per write: Count: 11296999 Average: 5.3149 StdDev: 507.23 Min: 0 Median: 1.7251 Max: 886474 Percentiles: P50: 1.73 P75: 2.64 P99: 5.97 P99.9: 1073.41 P99.99: 2704.61 ------------------------------------------------------ [ 0, 1 ] 1509036 13.358% 13.358% ### ( 1, 2 ] 5708549 50.532% 63.889% ########## ( 2, 3 ] 1947450 17.239% 81.128% ### ( 3, 4 ] 1525112 13.500% 94.628% ### ( 4, 6 ] 501993 4.444% 99.072% # ( 6, 10 ] 53592 0.474% 99.546% ( 10, 15 ] 14654 0.130% 99.676% ( 15, 22 ] 6489 0.057% 99.733% ( 22, 34 ] 1980 0.018% 99.751% ( 34, 51 ] 161 0.001% 99.752% ( 51, 76 ] 10 0.000% 99.752% ( 76, 110 ] 8062 0.071% 99.824% ( 110, 170 ] 3095 0.027% 99.851% ( 170, 250 ] 248 0.002% 99.853% ( 250, 380 ] 50 0.000% 99.854% ( 380, 580 ] 18 0.000% 99.854% ( 580, 870 ] 17 0.000% 99.854% ( 870, 1300 ] 10963 0.097% 99.951% ( 1300, 1900 ] 6 0.000% 99.951% ( 1900, 2900 ] 5449 0.048% 99.999% ( 2900, 4400 ] 26 0.000% 100.000% ( 4400, 6600 ] 4 0.000% 100.000% ( 6600, 9900 ] 2 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 21 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 188511 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11296999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11658502968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 553 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30239171 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30361091684 rocksdb.compact.write.bytes COUNT : 30162150566 rocksdb.flush.write.bytes COUNT : 11625920926 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 66 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 332 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11532380160 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4659200 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30467822136 rocksdb.non.last.level.read.count COUNT : 7353867 rocksdb.block.checksum.compute.count COUNT : 7352827 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.359041 P95 : 3.713973 P99 : 5.719305 P100 : 886471.000000 COUNT : 11296999 SUM : 54895264 rocksdb.compaction.times.micros P50 : 1109333.333333 P95 : 5180000.000000 P99 : 15280000.000000 P100 : 19854839.000000 COUNT : 84 SUM : 143618691 rocksdb.compaction.times.cpu_micros P50 : 934634.146341 P95 : 5180000.000000 P99 : 15280000.000000 P100 : 18310917.000000 COUNT : 84 SUM : 117938603 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 699.505495 P95 : 1705.000000 P99 : 138200.000000 P100 : 424396.000000 COUNT : 153 SUM : 780326 rocksdb.compaction.outfile.sync.micros P50 : 1061.111111 P95 : 138285.714286 P99 : 273400.000000 P100 : 282864.000000 COUNT : 328 SUM : 7201521 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 105.580000 P95 : 2400.000000 P99 : 4116.666667 P100 : 4428.000000 COUNT : 270 SUM : 113688 rocksdb.table.open.io.micros P50 : 1655.670103 P95 : 7570.200000 P99 : 12954.500000 P100 : 40407.000000 COUNT : 553 SUM : 1260700 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.590263 P95 : 7.271434 P99 : 10.466673 P100 : 32239.000000 COUNT : 7351206 SUM : 44982611 rocksdb.read.block.get.micros P50 : 521.747573 P95 : 3517.500000 P99 : 5492.666667 P100 : 9063.000000 COUNT : 1106 SUM : 1002935 rocksdb.write.raw.block.micros P50 : 0.512264 P95 : 0.973302 P99 : 2.776242 P100 : 24002.000000 COUNT : 10120450 SUM : 20343562 rocksdb.numfiles.in.singlecompaction P50 : 3.267857 P95 : 5.050000 P99 : 29.320000 P100 : 43.000000 COUNT : 139 SUM : 562 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.555999 P95 : 1194.296411 P99 : 2606.190125 P100 : 886276.000000 COUNT : 163180 SUM : 30246234 rocksdb.sst.read.micros P50 : 1.560324 P95 : 4.229641 P99 : 8.149215 P100 : 32234.000000 COUNT : 7354005 SUM : 30167021 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11296999 SUM : 11658502968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 213396.226415 P95 : 454416.666667 P99 : 939900.000000 P100 : 1018042.000000 COUNT : 153 SUM : 34559920 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 332 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0