[2024-11-17 20:49:18.443742] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 22.11.4 initialization... [2024-11-17 20:49:18.443857] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1197957 ] Set seed to 1731872958441360 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-17 20:49:18.528939] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-17 20:49:18.570421] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-17 20:49:18.570468] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1197957' to capture a snapshot of events at runtime. [2024-11-17 20:49:18.570479] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-17 20:49:18.570489] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-17 20:49:18.570500] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1197957 for offline analysis/debug. [2024-11-17 20:49:18.570586] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 17 20:49:22 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/17-20:49:25 ... thread 0: (1000000,1000000) ops and (355146.2,355146.2) ops/second in (2.815742,2.815742) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.05 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 349.0 2.35 2.10 12 0.196 0 0 0.0 0.0 L2 3/2 251.73 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 252.3 252.2 1.50 1.44 2 0.749 383K 209 0.0 0.0 L3 9/0 741.29 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.8 1.5 98.3 311.3 3.84 3.55 14 0.275 383K 209 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.7 1.5 98.3 311.3 3.84 3.55 14 0.275 383K 209 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 252.3 252.2 1.50 1.44 2 0.749 383K 209 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 349.0 2.35 2.10 12 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 399.13 MB/s write, 0.37 GB read, 126.04 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 424.80 MB/s write, 0.37 GB read, 134.15 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 103580 Average: 1.8947 StdDev: 20.18 Min: 1 Median: 1.1711 Max: 3642 Percentiles: P50: 1.17 P75: 1.63 P99: 3.75 P99.9: 8.88 P99.99: 556.13 ------------------------------------------------------ [ 0, 1 ] 42110 40.655% 40.655% ######## ( 1, 2 ] 56581 54.625% 95.280% ########### ( 2, 3 ] 3059 2.953% 98.233% # ( 3, 4 ] 1064 1.027% 99.260% ( 4, 6 ] 538 0.519% 99.780% ( 6, 10 ] 174 0.168% 99.948% ( 10, 15 ] 19 0.018% 99.966% ( 15, 22 ] 4 0.004% 99.970% ( 22, 34 ] 3 0.003% 99.973% ( 34, 51 ] 3 0.003% 99.976% ( 51, 76 ] 1 0.001% 99.977% ( 110, 170 ] 7 0.007% 99.984% ( 170, 250 ] 2 0.002% 99.986% ( 250, 380 ] 3 0.003% 99.988% ( 380, 580 ] 3 0.003% 99.991% ( 580, 870 ] 1 0.001% 99.992% ( 870, 1300 ] 1 0.001% 99.993% ( 1300, 1900 ] 4 0.004% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 48676 Average: 2.0278 StdDev: 19.23 Min: 1 Median: 1.2289 Max: 2355 Percentiles: P50: 1.23 P75: 1.68 P99: 4.94 P99.9: 10.75 P99.99: 926.93 ------------------------------------------------------ [ 0, 1 ] 18129 37.244% 37.244% ####### ( 1, 2 ] 27127 55.730% 92.974% ########### ( 2, 3 ] 1822 3.743% 96.717% # ( 3, 4 ] 860 1.767% 98.484% ( 4, 6 ] 533 1.095% 99.579% ( 6, 10 ] 152 0.312% 99.891% ( 10, 15 ] 29 0.060% 99.951% ( 15, 22 ] 3 0.006% 99.957% ( 22, 34 ] 3 0.006% 99.963% ( 34, 51 ] 1 0.002% 99.965% ( 51, 76 ] 1 0.002% 99.967% ( 110, 170 ] 1 0.002% 99.969% ( 250, 380 ] 5 0.010% 99.979% ( 380, 580 ] 3 0.006% 99.986% ( 580, 870 ] 2 0.004% 99.990% ( 870, 1300 ] 1 0.002% 99.992% ( 1300, 1900 ] 2 0.004% 99.996% ( 1900, 2900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 55 Average: 1465.3636 StdDev: 1232.76 Min: 57 Median: 950.6250 Max: 4519 Percentiles: P50: 950.62 P75: 2108.33 P99: 4519.00 P99.9: 4519.00 P99.99: 4519.00 ------------------------------------------------------ ( 51, 76 ] 2 3.636% 3.636% # ( 110, 170 ] 1 1.818% 5.455% ( 170, 250 ] 1 1.818% 7.273% ( 250, 380 ] 2 3.636% 10.909% # ( 380, 580 ] 9 16.364% 27.273% ### ( 580, 870 ] 11 20.000% 47.273% #### ( 870, 1300 ] 8 14.545% 61.818% ### ( 1300, 1900 ] 6 10.909% 72.727% ## ( 1900, 2900 ] 6 10.909% 83.636% ## ( 2900, 4400 ] 7 12.727% 96.364% ### ( 4400, 6600 ] 2 3.636% 100.000% # ** Level 4 read latency histogram (micros): Count: 15 Average: 1834.2667 StdDev: 1349.04 Min: 289 Median: 1192.5000 Max: 4272 Percentiles: P50: 1192.50 P75: 2993.75 P99: 4272.00 P99.9: 4272.00 P99.99: 4272.00 ------------------------------------------------------ ( 250, 380 ] 1 6.667% 6.667% # ( 380, 580 ] 2 13.333% 20.000% ### ( 580, 870 ] 3 20.000% 40.000% #### ( 870, 1300 ] 2 13.333% 53.333% ### ( 1300, 1900 ] 1 6.667% 60.000% # ( 1900, 2900 ] 2 13.333% 73.333% ### ( 2900, 4400 ] 4 26.667% 100.000% ##### ** Level 5 read latency histogram (micros): Count: 20 Average: 602.5500 StdDev: 832.12 Min: 81 Median: 130.0000 Max: 2821 Percentiles: P50: 130.00 P75: 725.00 P99: 2800.00 P99.9: 2821.00 P99.99: 2821.00 ------------------------------------------------------ ( 76, 110 ] 9 45.000% 45.000% ######### ( 110, 170 ] 3 15.000% 60.000% ### ( 380, 580 ] 2 10.000% 70.000% ## ( 580, 870 ] 2 10.000% 80.000% ## ( 870, 1300 ] 1 5.000% 85.000% # ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 328.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.215 H:M:S, 7.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 349.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.215 H:M:S, 7.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-20:49:28 ... thread 0: (1000000,2000000) ops and (323587.9,338633.4) ops/second in (3.090350,5.906092) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 1.17 GB 12.6 0.8 0.0 0.8 2.6 1.8 0.0 1.4 96.8 312.6 8.46 7.81 29 0.292 831K 886 0.0 0.0 L1 1/1 2.85 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 235.6 235.2 1.60 1.57 1 1.605 383K 629 0.0 0.0 L2 2/0 54.21 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 252.3 252.2 1.50 1.44 2 0.749 383K 209 0.0 0.0 L3 42/0 997.23 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 201.6 201.4 3.95 3.51 3 1.318 809K 840 0.0 0.0 L4 144/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1245/7 97.92 GB 0.0 2.3 1.1 1.2 4.1 2.9 2.1 2.3 152.9 270.4 15.52 14.33 35 0.443 2408K 2564 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 1.1 1.2 4.1 2.9 2.0 2.3 152.9 270.4 15.52 14.33 35 0.443 2408K 2564 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 1.1 1.2 2.3 1.1 0.0 0.0 231.0 230.7 10.27 9.67 9 1.141 2408K 2564 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 348.2 5.25 4.66 26 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.10 GB write, 689.15 MB/s write, 2.32 GB read, 389.53 MB/s read, 15.5 seconds Interval compaction: 4.10 GB write, 710.28 MB/s write, 2.32 GB read, 401.48 MB/s read, 15.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 383619 Average: 2.1857 StdDev: 15.55 Min: 1 Median: 1.4517 Max: 4642 Percentiles: P50: 1.45 P75: 1.85 P99: 5.66 P99.9: 10.38 P99.99: 16.34 ------------------------------------------------------ [ 0, 1 ] 83541 21.777% 21.777% #### ( 1, 2 ] 239689 62.481% 84.258% ############ ( 2, 3 ] 34977 9.118% 93.376% ## ( 3, 4 ] 13925 3.630% 97.006% # ( 4, 6 ] 9235 2.407% 99.413% ( 6, 10 ] 1841 0.480% 99.893% ( 10, 15 ] 365 0.095% 99.988% ( 15, 22 ] 40 0.010% 99.998% ( 22, 34 ] 14 0.004% 100.002% ( 34, 51 ] 5 0.001% 100.003% ( 51, 76 ] 5 0.001% 100.005% ( 110, 170 ] 11 0.003% 100.008% ( 170, 250 ] 10 0.003% 100.010% ( 250, 380 ] 11 0.003% 100.013% ( 380, 580 ] 6 0.002% 100.015% ( 580, 870 ] 6 0.002% 100.016% ( 870, 1300 ] 3 0.001% 100.017% ( 1300, 1900 ] 5 0.001% 100.018% ( 1900, 2900 ] 3 0.001% 100.019% ( 2900, 4400 ] 3 0.001% 100.020% ( 4400, 6600 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 81787 Average: 2.5007 StdDev: 4.68 Min: 0 Median: 1.6792 Max: 748 Percentiles: P50: 1.68 P75: 2.27 P99: 6.10 P99.9: 12.16 P99.99: 14.99 ------------------------------------------------------ [ 0, 1 ] 5614 6.864% 6.864% # ( 1, 2 ] 51939 63.505% 70.369% ############# ( 2, 3 ] 14262 17.438% 87.807% ### ( 3, 4 ] 5067 6.195% 94.003% # ( 4, 6 ] 4069 4.975% 98.978% # ( 6, 10 ] 698 0.853% 99.831% ( 10, 15 ] 130 0.159% 99.990% ( 15, 22 ] 19 0.023% 100.013% ( 22, 34 ] 1 0.001% 100.015% ( 51, 76 ] 1 0.001% 100.016% ( 110, 170 ] 1 0.001% 100.017% ( 170, 250 ] 1 0.001% 100.018% ( 250, 380 ] 2 0.002% 100.021% ( 380, 580 ] 1 0.001% 100.022% ( 580, 870 ] 3 0.004% 100.026% ** Level 2 read latency histogram (micros): Count: 95429 Average: 2.0714 StdDev: 13.75 Min: 1 Median: 1.3767 Max: 2355 Percentiles: P50: 1.38 P75: 1.78 P99: 5.31 P99.9: 9.95 P99.99: 410.47 ------------------------------------------------------ [ 0, 1 ] 25464 26.684% 26.684% ##### ( 1, 2 ] 59064 61.893% 88.577% ############ ( 2, 3 ] 6199 6.496% 95.073% # ( 3, 4 ] 2736 2.867% 97.940% # ( 4, 6 ] 1539 1.613% 99.553% ( 6, 10 ] 336 0.352% 99.905% ( 10, 15 ] 62 0.065% 99.970% ( 15, 22 ] 7 0.007% 99.977% ( 22, 34 ] 3 0.003% 99.980% ( 34, 51 ] 2 0.002% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 5 0.005% 99.990% ( 380, 580 ] 3 0.003% 99.993% ( 580, 870 ] 2 0.002% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57427 Average: 3.9617 StdDev: 59.76 Min: 0 Median: 1.6745 Max: 4519 Percentiles: P50: 1.67 P75: 2.26 P99: 7.34 P99.9: 42.91 P99.99: 1579.20 ------------------------------------------------------ [ 0, 1 ] 4305 7.496% 7.496% # ( 1, 2 ] 36189 63.017% 70.514% ############# ( 2, 3 ] 9958 17.340% 87.854% ### ( 3, 4 ] 3491 6.079% 93.933% # ( 4, 6 ] 2739 4.770% 98.703% # ( 6, 10 ] 511 0.890% 99.593% ( 10, 15 ] 107 0.186% 99.779% ( 15, 22 ] 17 0.030% 99.808% ( 22, 34 ] 51 0.089% 99.897% ( 34, 51 ] 3 0.005% 99.902% ( 51, 76 ] 3 0.005% 99.908% ( 76, 110 ] 1 0.002% 99.909% ( 110, 170 ] 3 0.005% 99.915% ( 170, 250 ] 4 0.007% 99.922% ( 250, 380 ] 5 0.009% 99.930% ( 380, 580 ] 12 0.021% 99.951% ( 580, 870 ] 11 0.019% 99.970% ( 870, 1300 ] 8 0.014% 99.984% ( 1300, 1900 ] 7 0.012% 99.997% ( 1900, 2900 ] 6 0.010% 100.007% ( 2900, 4400 ] 7 0.012% 100.019% ( 4400, 6600 ] 2 0.003% 100.023% ** Level 4 read latency histogram (micros): Count: 15 Average: 1834.2667 StdDev: 1349.04 Min: 289 Median: 1192.5000 Max: 4272 Percentiles: P50: 1192.50 P75: 2993.75 P99: 4272.00 P99.9: 4272.00 P99.99: 4272.00 ------------------------------------------------------ ( 250, 380 ] 1 6.667% 6.667% # ( 380, 580 ] 2 13.333% 20.000% ### ( 580, 870 ] 3 20.000% 40.000% #### ( 870, 1300 ] 2 13.333% 53.333% ### ( 1300, 1900 ] 1 6.667% 60.000% # ( 1900, 2900 ] 2 13.333% 73.333% ### ( 2900, 4400 ] 4 26.667% 100.000% ##### ** Level 5 read latency histogram (micros): Count: 40 Average: 688.1000 StdDev: 941.16 Min: 81 Median: 152.8571 Max: 3953 Percentiles: P50: 152.86 P75: 870.00 P99: 3800.00 P99.9: 3953.00 P99.99: 3953.00 ------------------------------------------------------ ( 76, 110 ] 15 37.500% 37.500% ######## ( 110, 170 ] 7 17.500% 55.000% #### ( 250, 380 ] 3 7.500% 62.500% ## ( 380, 580 ] 2 5.000% 67.500% # ( 580, 870 ] 3 7.500% 75.000% ## ( 870, 1300 ] 2 5.000% 80.000% # ( 1300, 1900 ] 4 10.000% 90.000% ## ( 1900, 2900 ] 3 7.500% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 323.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.618 H:M:S, 10.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 318.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.403 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-20:49:31 ... thread 0: (1000000,3000000) ops and (329926.4,335680.4) ops/second in (3.030979,8.937071) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/6 2.15 GB 113.3 1.6 0.0 1.6 4.4 2.8 0.0 1.6 113.2 309.0 14.47 13.46 46 0.315 1663K 1780 0.0 0.0 L1 1/1 2.85 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 235.6 235.2 1.60 1.57 1 1.605 383K 629 0.0 0.0 L2 2/0 54.21 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 252.3 252.2 1.50 1.44 2 0.749 383K 209 0.0 0.0 L3 42/0 997.23 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 201.6 201.4 3.95 3.51 3 1.318 809K 840 0.0 0.0 L4 144/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/7 98.90 GB 0.0 3.1 1.1 2.0 5.9 3.9 2.1 2.1 148.2 279.8 21.52 19.98 52 0.414 3239K 3458 0.0 0.0 Int 0/0 0.00 KB 0.0 3.1 1.1 2.0 5.9 3.9 2.0 2.1 148.2 279.8 21.52 19.98 52 0.414 3239K 3458 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.1 1.1 2.0 3.1 1.1 0.0 0.0 236.1 235.8 13.52 12.86 12 1.126 3239K 3458 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 354.0 8.01 7.12 40 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.88 GB write, 660.32 MB/s write, 3.12 GB read, 349.87 MB/s read, 21.5 seconds Interval compaction: 5.88 GB write, 673.70 MB/s write, 3.12 GB read, 356.96 MB/s read, 21.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 772264 Average: 2.1791 StdDev: 12.83 Min: 1 Median: 1.4792 Max: 4642 Percentiles: P50: 1.48 P75: 1.87 P99: 5.57 P99.9: 9.78 P99.99: 13.95 ------------------------------------------------------ [ 0, 1 ] 146362 18.952% 18.952% #### ( 1, 2 ] 500306 64.784% 83.737% ############# ( 2, 3 ] 76376 9.890% 93.627% ## ( 3, 4 ] 27719 3.589% 97.216% # ( 4, 6 ] 17516 2.268% 99.484% ( 6, 10 ] 3398 0.440% 99.924% ( 10, 15 ] 646 0.084% 100.008% ( 15, 22 ] 68 0.009% 100.016% ( 22, 34 ] 20 0.003% 100.019% ( 34, 51 ] 6 0.001% 100.020% ( 51, 76 ] 8 0.001% 100.021% ( 110, 170 ] 14 0.002% 100.023% ( 170, 250 ] 20 0.003% 100.025% ( 250, 380 ] 18 0.002% 100.028% ( 380, 580 ] 8 0.001% 100.029% ( 580, 870 ] 9 0.001% 100.030% ( 870, 1300 ] 7 0.001% 100.031% ( 1300, 1900 ] 7 0.001% 100.032% ( 1900, 2900 ] 5 0.001% 100.032% ( 2900, 4400 ] 4 0.001% 100.033% ( 4400, 6600 ] 1 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 81787 Average: 2.5007 StdDev: 4.68 Min: 0 Median: 1.6792 Max: 748 Percentiles: P50: 1.68 P75: 2.27 P99: 6.10 P99.9: 12.16 P99.99: 14.99 ------------------------------------------------------ [ 0, 1 ] 5614 6.864% 6.864% # ( 1, 2 ] 51939 63.505% 70.369% ############# ( 2, 3 ] 14262 17.438% 87.807% ### ( 3, 4 ] 5067 6.195% 94.003% # ( 4, 6 ] 4069 4.975% 98.978% # ( 6, 10 ] 698 0.853% 99.831% ( 10, 15 ] 130 0.159% 99.990% ( 15, 22 ] 19 0.023% 100.013% ( 22, 34 ] 1 0.001% 100.015% ( 51, 76 ] 1 0.001% 100.016% ( 110, 170 ] 1 0.001% 100.017% ( 170, 250 ] 1 0.001% 100.018% ( 250, 380 ] 2 0.002% 100.021% ( 380, 580 ] 1 0.001% 100.022% ( 580, 870 ] 3 0.004% 100.026% ** Level 2 read latency histogram (micros): Count: 95429 Average: 2.0714 StdDev: 13.75 Min: 1 Median: 1.3767 Max: 2355 Percentiles: P50: 1.38 P75: 1.78 P99: 5.31 P99.9: 9.95 P99.99: 410.47 ------------------------------------------------------ [ 0, 1 ] 25464 26.684% 26.684% ##### ( 1, 2 ] 59064 61.893% 88.577% ############ ( 2, 3 ] 6199 6.496% 95.073% # ( 3, 4 ] 2736 2.867% 97.940% # ( 4, 6 ] 1539 1.613% 99.553% ( 6, 10 ] 336 0.352% 99.905% ( 10, 15 ] 62 0.065% 99.970% ( 15, 22 ] 7 0.007% 99.977% ( 22, 34 ] 3 0.003% 99.980% ( 34, 51 ] 2 0.002% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 5 0.005% 99.990% ( 380, 580 ] 3 0.003% 99.993% ( 580, 870 ] 2 0.002% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57427 Average: 3.9617 StdDev: 59.76 Min: 0 Median: 1.6745 Max: 4519 Percentiles: P50: 1.67 P75: 2.26 P99: 7.34 P99.9: 42.91 P99.99: 1579.20 ------------------------------------------------------ [ 0, 1 ] 4305 7.496% 7.496% # ( 1, 2 ] 36189 63.017% 70.514% ############# ( 2, 3 ] 9958 17.340% 87.854% ### ( 3, 4 ] 3491 6.079% 93.933% # ( 4, 6 ] 2739 4.770% 98.703% # ( 6, 10 ] 511 0.890% 99.593% ( 10, 15 ] 107 0.186% 99.779% ( 15, 22 ] 17 0.030% 99.808% ( 22, 34 ] 51 0.089% 99.897% ( 34, 51 ] 3 0.005% 99.902% ( 51, 76 ] 3 0.005% 99.908% ( 76, 110 ] 1 0.002% 99.909% ( 110, 170 ] 3 0.005% 99.915% ( 170, 250 ] 4 0.007% 99.922% ( 250, 380 ] 5 0.009% 99.930% ( 380, 580 ] 12 0.021% 99.951% ( 580, 870 ] 11 0.019% 99.970% ( 870, 1300 ] 8 0.014% 99.984% ( 1300, 1900 ] 7 0.012% 99.997% ( 1900, 2900 ] 6 0.010% 100.007% ( 2900, 4400 ] 7 0.012% 100.019% ( 4400, 6600 ] 2 0.003% 100.023% ** Level 4 read latency histogram (micros): Count: 15 Average: 1834.2667 StdDev: 1349.04 Min: 289 Median: 1192.5000 Max: 4272 Percentiles: P50: 1192.50 P75: 2993.75 P99: 4272.00 P99.9: 4272.00 P99.99: 4272.00 ------------------------------------------------------ ( 250, 380 ] 1 6.667% 6.667% # ( 380, 580 ] 2 13.333% 20.000% ### ( 580, 870 ] 3 20.000% 40.000% #### ( 870, 1300 ] 2 13.333% 53.333% ### ( 1300, 1900 ] 1 6.667% 60.000% # ( 1900, 2900 ] 2 13.333% 73.333% ### ( 2900, 4400 ] 4 26.667% 100.000% ##### ** Level 5 read latency histogram (micros): Count: 40 Average: 688.1000 StdDev: 941.16 Min: 81 Median: 152.8571 Max: 3953 Percentiles: P50: 152.86 P75: 870.00 P99: 3800.00 P99.9: 3953.00 P99.99: 3953.00 ------------------------------------------------------ ( 76, 110 ] 15 37.500% 37.500% ######## ( 110, 170 ] 7 17.500% 55.000% #### ( 250, 380 ] 3 7.500% 62.500% ## ( 380, 580 ] 2 5.000% 67.500% # ( 580, 870 ] 3 7.500% 75.000% ## ( 870, 1300 ] 2 5.000% 80.000% # ( 1300, 1900 ] 4 10.000% 90.000% ## ( 1900, 2900 ] 3 7.500% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 323.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.003 H:M:S, 11.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.72 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.384 H:M:S, 12.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-20:49:34 ... thread 0: (1000000,4000000) ops and (329537.7,334123.4) ops/second in (3.034554,11.971625) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/14 2.09 GB 12.6 2.1 0.0 2.1 5.8 3.8 0.0 1.6 111.4 311.2 19.22 17.90 62 0.310 2174K 2289 0.0 0.0 L1 9/9 1.04 GB 0.0 1.4 1.4 0.0 1.4 1.4 0.2 1.0 233.1 232.2 6.22 6.07 2 3.112 1473K 5327 0.0 0.0 L2 2/0 54.21 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 252.3 252.2 1.50 1.44 2 0.749 383K 209 0.0 0.0 L3 42/0 997.23 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 201.6 201.4 3.95 3.51 3 1.318 809K 840 0.0 0.0 L4 144/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1260/23 99.88 GB 0.0 4.7 2.2 2.5 8.4 5.9 2.1 2.2 154.3 278.4 30.90 28.92 69 0.448 4840K 8665 0.0 0.0 Int 0/0 0.00 KB 0.0 4.7 2.2 2.5 8.4 5.9 2.0 2.2 154.3 278.4 30.90 28.92 69 0.448 4840K 8665 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.7 2.2 2.5 4.6 2.1 0.0 0.0 237.2 236.7 20.10 19.28 15 1.340 4840K 8665 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 356.0 10.80 9.64 54 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.40 GB write, 707.68 MB/s write, 4.66 GB read, 392.25 MB/s read, 30.9 seconds Interval compaction: 8.40 GB write, 718.38 MB/s write, 4.66 GB read, 398.19 MB/s read, 30.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1047834 Average: 2.1569 StdDev: 12.39 Min: 1 Median: 1.4689 Max: 4642 Percentiles: P50: 1.47 P75: 1.85 P99: 5.51 P99.9: 9.85 P99.99: 14.21 ------------------------------------------------------ [ 0, 1 ] 204294 19.497% 19.497% #### ( 1, 2 ] 681602 65.049% 84.545% ############# ( 2, 3 ] 99843 9.529% 94.074% ## ( 3, 4 ] 35556 3.393% 97.467% # ( 4, 6 ] 21296 2.032% 99.500% ( 6, 10 ] 4361 0.416% 99.916% ( 10, 15 ] 924 0.088% 100.004% ( 15, 22 ] 94 0.009% 100.013% ( 22, 34 ] 24 0.002% 100.015% ( 34, 51 ] 9 0.001% 100.016% ( 51, 76 ] 10 0.001% 100.017% ( 76, 110 ] 16 0.002% 100.019% ( 110, 170 ] 26 0.002% 100.021% ( 170, 250 ] 30 0.003% 100.024% ( 250, 380 ] 26 0.002% 100.026% ( 380, 580 ] 9 0.001% 100.027% ( 580, 870 ] 16 0.002% 100.029% ( 870, 1300 ] 9 0.001% 100.030% ( 1300, 1900 ] 10 0.001% 100.031% ( 1900, 2900 ] 5 0.000% 100.031% ( 2900, 4400 ] 5 0.000% 100.032% ( 4400, 6600 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 108307 Average: 2.4724 StdDev: 12.05 Min: 0 Median: 1.6022 Max: 1799 Percentiles: P50: 1.60 P75: 2.00 P99: 5.93 P99.9: 12.31 P99.99: 20.66 ------------------------------------------------------ [ 0, 1 ] 13019 12.020% 12.020% ## ( 1, 2 ] 68313 63.073% 75.094% ############# ( 2, 3 ] 16117 14.881% 89.975% ### ( 3, 4 ] 5594 5.165% 95.140% # ( 4, 6 ] 4328 3.996% 99.136% # ( 6, 10 ] 759 0.701% 99.837% ( 10, 15 ] 151 0.139% 99.976% ( 15, 22 ] 20 0.018% 99.994% ( 22, 34 ] 1 0.001% 99.995% ( 51, 76 ] 1 0.001% 99.996% ( 110, 170 ] 2 0.002% 99.998% ( 170, 250 ] 1 0.001% 99.999% ( 250, 380 ] 3 0.003% 100.002% ( 380, 580 ] 9 0.008% 100.010% ( 580, 870 ] 4 0.004% 100.014% ( 870, 1300 ] 4 0.004% 100.018% ( 1300, 1900 ] 3 0.003% 100.020% ** Level 2 read latency histogram (micros): Count: 95429 Average: 2.0714 StdDev: 13.75 Min: 1 Median: 1.3767 Max: 2355 Percentiles: P50: 1.38 P75: 1.78 P99: 5.31 P99.9: 9.95 P99.99: 410.47 ------------------------------------------------------ [ 0, 1 ] 25464 26.684% 26.684% ##### ( 1, 2 ] 59064 61.893% 88.577% ############ ( 2, 3 ] 6199 6.496% 95.073% # ( 3, 4 ] 2736 2.867% 97.940% # ( 4, 6 ] 1539 1.613% 99.553% ( 6, 10 ] 336 0.352% 99.905% ( 10, 15 ] 62 0.065% 99.970% ( 15, 22 ] 7 0.007% 99.977% ( 22, 34 ] 3 0.003% 99.980% ( 34, 51 ] 2 0.002% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 5 0.005% 99.990% ( 380, 580 ] 3 0.003% 99.993% ( 580, 870 ] 2 0.002% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57427 Average: 3.9617 StdDev: 59.76 Min: 0 Median: 1.6745 Max: 4519 Percentiles: P50: 1.67 P75: 2.26 P99: 7.34 P99.9: 42.91 P99.99: 1579.20 ------------------------------------------------------ [ 0, 1 ] 4305 7.496% 7.496% # ( 1, 2 ] 36189 63.017% 70.514% ############# ( 2, 3 ] 9958 17.340% 87.854% ### ( 3, 4 ] 3491 6.079% 93.933% # ( 4, 6 ] 2739 4.770% 98.703% # ( 6, 10 ] 511 0.890% 99.593% ( 10, 15 ] 107 0.186% 99.779% ( 15, 22 ] 17 0.030% 99.808% ( 22, 34 ] 51 0.089% 99.897% ( 34, 51 ] 3 0.005% 99.902% ( 51, 76 ] 3 0.005% 99.908% ( 76, 110 ] 1 0.002% 99.909% ( 110, 170 ] 3 0.005% 99.915% ( 170, 250 ] 4 0.007% 99.922% ( 250, 380 ] 5 0.009% 99.930% ( 380, 580 ] 12 0.021% 99.951% ( 580, 870 ] 11 0.019% 99.970% ( 870, 1300 ] 8 0.014% 99.984% ( 1300, 1900 ] 7 0.012% 99.997% ( 1900, 2900 ] 6 0.010% 100.007% ( 2900, 4400 ] 7 0.012% 100.019% ( 4400, 6600 ] 2 0.003% 100.023% ** Level 4 read latency histogram (micros): Count: 15 Average: 1834.2667 StdDev: 1349.04 Min: 289 Median: 1192.5000 Max: 4272 Percentiles: P50: 1192.50 P75: 2993.75 P99: 4272.00 P99.9: 4272.00 P99.99: 4272.00 ------------------------------------------------------ ( 250, 380 ] 1 6.667% 6.667% # ( 380, 580 ] 2 13.333% 20.000% ### ( 580, 870 ] 3 20.000% 40.000% #### ( 870, 1300 ] 2 13.333% 53.333% ### ( 1300, 1900 ] 1 6.667% 60.000% # ( 1900, 2900 ] 2 13.333% 73.333% ### ( 2900, 4400 ] 4 26.667% 100.000% ##### ** Level 5 read latency histogram (micros): Count: 40 Average: 688.1000 StdDev: 941.16 Min: 81 Median: 152.8571 Max: 3953 Percentiles: P50: 152.86 P75: 870.00 P99: 3800.00 P99.9: 3953.00 P99.99: 3953.00 ------------------------------------------------------ ( 76, 110 ] 15 37.500% 37.500% ######## ( 110, 170 ] 7 17.500% 55.000% #### ( 250, 380 ] 3 7.500% 62.500% ## ( 380, 580 ] 2 5.000% 67.500% # ( 580, 870 ] 3 7.500% 75.000% ## ( 870, 1300 ] 2 5.000% 80.000% # ( 1300, 1900 ] 4 10.000% 90.000% ## ( 1900, 2900 ] 3 7.500% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 12.2 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 323.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.431 H:M:S, 11.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.32 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.428 H:M:S, 14.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-20:49:38 ... thread 0: (1000000,5000000) ops and (286022.0,323250.9) ops/second in (3.496235,15.467860) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/10 3.01 GB 132.2 3.1 0.0 3.1 7.8 4.7 0.0 1.7 124.0 308.7 25.91 24.24 80 0.324 3262K 3427 0.0 0.0 L1 9/9 1.04 GB 0.0 1.4 1.4 0.0 1.4 1.4 0.2 1.0 233.1 232.2 6.22 6.07 2 3.112 1473K 5327 0.0 0.0 L2 2/0 54.21 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 252.3 252.2 1.50 1.44 2 0.749 383K 209 0.0 0.0 L3 42/0 997.23 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.1 1.4 201.6 201.4 3.95 3.51 3 1.318 809K 840 0.0 0.0 L4 144/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1262/19 100.80 GB 0.0 5.7 2.2 3.5 10.4 6.8 2.1 2.2 155.4 282.5 37.58 35.27 87 0.432 5928K 9803 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 2.2 3.5 10.4 6.8 2.0 2.2 155.4 282.5 37.58 35.27 87 0.432 5928K 9803 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 2.2 3.5 5.7 2.1 0.0 0.0 241.7 241.2 24.16 23.28 19 1.272 5928K 9803 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 356.7 13.42 11.99 68 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.7 total, 15.5 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.37 GB write, 678.32 MB/s write, 5.70 GB read, 373.06 MB/s read, 37.6 seconds Interval compaction: 10.37 GB write, 686.27 MB/s write, 5.70 GB read, 377.43 MB/s read, 37.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 16, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1411959 Average: 2.1696 StdDev: 11.67 Min: 1 Median: 1.4766 Max: 4642 Percentiles: P50: 1.48 P75: 1.86 P99: 5.50 P99.9: 9.89 P99.99: 14.37 ------------------------------------------------------ [ 0, 1 ] 262926 18.621% 18.621% #### ( 1, 2 ] 929619 65.839% 84.460% ############# ( 2, 3 ] 136742 9.685% 94.145% ## ( 3, 4 ] 47837 3.388% 97.533% # ( 4, 6 ] 27674 1.960% 99.493% ( 6, 10 ] 5916 0.419% 99.912% ( 10, 15 ] 1264 0.090% 100.001% ( 15, 22 ] 104 0.007% 100.009% ( 22, 34 ] 27 0.002% 100.011% ( 34, 51 ] 10 0.001% 100.011% ( 51, 76 ] 11 0.001% 100.012% ( 76, 110 ] 43 0.003% 100.015% ( 110, 170 ] 59 0.004% 100.019% ( 170, 250 ] 56 0.004% 100.023% ( 250, 380 ] 40 0.003% 100.026% ( 380, 580 ] 18 0.001% 100.027% ( 580, 870 ] 27 0.002% 100.029% ( 870, 1300 ] 15 0.001% 100.030% ( 1300, 1900 ] 12 0.001% 100.031% ( 1900, 2900 ] 5 0.000% 100.032% ( 2900, 4400 ] 6 0.000% 100.032% ( 4400, 6600 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 182828 Average: 2.5215 StdDev: 11.43 Min: 0 Median: 1.5719 Max: 1799 Percentiles: P50: 1.57 P75: 1.96 P99: 6.95 P99.9: 77.67 P99.99: 322.77 ------------------------------------------------------ [ 0, 1 ] 23224 12.703% 12.703% ### ( 1, 2 ] 119241 65.220% 77.923% ############# ( 2, 3 ] 24229 13.252% 91.175% ### ( 3, 4 ] 7997 4.374% 95.549% # ( 4, 6 ] 5882 3.217% 98.767% # ( 6, 10 ] 1796 0.982% 99.749% ( 10, 15 ] 230 0.126% 99.875% ( 15, 22 ] 28 0.015% 99.890% ( 22, 34 ] 1 0.001% 99.891% ( 34, 51 ] 1 0.001% 99.891% ( 51, 76 ] 12 0.007% 99.898% ( 76, 110 ] 85 0.046% 99.944% ( 110, 170 ] 65 0.036% 99.980% ( 170, 250 ] 12 0.007% 99.986% ( 250, 380 ] 12 0.007% 99.993% ( 380, 580 ] 15 0.008% 100.001% ( 580, 870 ] 12 0.007% 100.008% ( 870, 1300 ] 4 0.002% 100.010% ( 1300, 1900 ] 3 0.002% 100.011% ** Level 2 read latency histogram (micros): Count: 95429 Average: 2.0714 StdDev: 13.75 Min: 1 Median: 1.3767 Max: 2355 Percentiles: P50: 1.38 P75: 1.78 P99: 5.31 P99.9: 9.95 P99.99: 410.47 ------------------------------------------------------ [ 0, 1 ] 25464 26.684% 26.684% ##### ( 1, 2 ] 59064 61.893% 88.577% ############ ( 2, 3 ] 6199 6.496% 95.073% # ( 3, 4 ] 2736 2.867% 97.940% # ( 4, 6 ] 1539 1.613% 99.553% ( 6, 10 ] 336 0.352% 99.905% ( 10, 15 ] 62 0.065% 99.970% ( 15, 22 ] 7 0.007% 99.977% ( 22, 34 ] 3 0.003% 99.980% ( 34, 51 ] 2 0.002% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 5 0.005% 99.990% ( 380, 580 ] 3 0.003% 99.993% ( 580, 870 ] 2 0.002% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57427 Average: 3.9617 StdDev: 59.76 Min: 0 Median: 1.6745 Max: 4519 Percentiles: P50: 1.67 P75: 2.26 P99: 7.34 P99.9: 42.91 P99.99: 1579.20 ------------------------------------------------------ [ 0, 1 ] 4305 7.496% 7.496% # ( 1, 2 ] 36189 63.017% 70.514% ############# ( 2, 3 ] 9958 17.340% 87.854% ### ( 3, 4 ] 3491 6.079% 93.933% # ( 4, 6 ] 2739 4.770% 98.703% # ( 6, 10 ] 511 0.890% 99.593% ( 10, 15 ] 107 0.186% 99.779% ( 15, 22 ] 17 0.030% 99.808% ( 22, 34 ] 51 0.089% 99.897% ( 34, 51 ] 3 0.005% 99.902% ( 51, 76 ] 3 0.005% 99.908% ( 76, 110 ] 1 0.002% 99.909% ( 110, 170 ] 3 0.005% 99.915% ( 170, 250 ] 4 0.007% 99.922% ( 250, 380 ] 5 0.009% 99.930% ( 380, 580 ] 12 0.021% 99.951% ( 580, 870 ] 11 0.019% 99.970% ( 870, 1300 ] 8 0.014% 99.984% ( 1300, 1900 ] 7 0.012% 99.997% ( 1900, 2900 ] 6 0.010% 100.007% ( 2900, 4400 ] 7 0.012% 100.019% ( 4400, 6600 ] 2 0.003% 100.023% ** Level 4 read latency histogram (micros): Count: 15 Average: 1834.2667 StdDev: 1349.04 Min: 289 Median: 1192.5000 Max: 4272 Percentiles: P50: 1192.50 P75: 2993.75 P99: 4272.00 P99.9: 4272.00 P99.99: 4272.00 ------------------------------------------------------ ( 250, 380 ] 1 6.667% 6.667% # ( 380, 580 ] 2 13.333% 20.000% ### ( 580, 870 ] 3 20.000% 40.000% #### ( 870, 1300 ] 2 13.333% 53.333% ### ( 1300, 1900 ] 1 6.667% 60.000% # ( 1900, 2900 ] 2 13.333% 73.333% ### ( 2900, 4400 ] 4 26.667% 100.000% ##### ** Level 5 read latency histogram (micros): Count: 40 Average: 688.1000 StdDev: 941.16 Min: 81 Median: 152.8571 Max: 3953 Percentiles: P50: 152.86 P75: 870.00 P99: 3800.00 P99.9: 3953.00 P99.99: 3953.00 ------------------------------------------------------ ( 76, 110 ] 15 37.500% 37.500% ######## ( 110, 170 ] 7 17.500% 55.000% #### ( 250, 380 ] 3 7.500% 62.500% ## ( 380, 580 ] 2 5.000% 67.500% # ( 580, 870 ] 3 7.500% 75.000% ## ( 870, 1300 ] 2 5.000% 80.000% # ( 1300, 1900 ] 4 10.000% 90.000% ## ( 1900, 2900 ] 3 7.500% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 15.7 total, 3.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 314.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.314 H:M:S, 14.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 281.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.883 H:M:S, 25.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-20:49:46 ... thread 0: (1000000,6000000) ops and (120132.5,252185.6) ops/second in (8.324145,23.792005) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 2.27 GB 207.5 4.7 0.0 4.7 10.3 5.7 0.0 1.8 137.7 304.2 34.77 32.67 100 0.348 4860K 6670 0.0 0.0 L1 15/0 1.72 GB 176.6 4.2 3.1 1.0 4.1 3.1 0.2 1.3 225.8 223.8 18.96 18.31 3 6.319 4347K 38K 0.0 0.0 L2 2/0 54.21 MB 0.5 0.4 0.2 0.2 0.4 0.2 1.4 2.0 252.3 252.2 1.50 1.44 2 0.749 383K 209 0.0 0.0 L3 15/1 1.03 GB 0.9 0.8 0.6 0.2 0.8 0.6 1.1 1.4 201.6 201.4 3.95 3.51 3 1.318 809K 840 0.0 0.0 L4 167/3 9.44 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1060/0 87.23 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1270/8 101.75 GB 0.0 10.0 3.9 6.1 15.6 9.5 6.0 2.8 173.1 270.2 59.18 55.94 108 0.548 10M 46K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.0 3.9 6.1 15.6 9.5 5.9 2.8 173.1 270.2 59.18 55.94 108 0.548 10M 46K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.0 3.9 6.1 10.0 3.8 0.0 0.0 239.0 237.9 42.85 41.36 24 1.785 10M 46K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 354.9 16.33 14.58 84 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.0 total, 23.8 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.62 GB write, 667.03 MB/s write, 10.00 GB read, 427.25 MB/s read, 59.2 seconds Interval compaction: 15.62 GB write, 672.11 MB/s write, 10.00 GB read, 430.50 MB/s read, 59.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 16, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2155131 Average: 2.2217 StdDev: 11.67 Min: 0 Median: 1.4691 Max: 4642 Percentiles: P50: 1.47 P75: 1.85 P99: 5.59 P99.9: 12.64 P99.99: 124.46 ------------------------------------------------------ [ 0, 1 ] 408006 18.932% 18.932% #### ( 1, 2 ] 1427197 66.223% 85.155% ############# ( 2, 3 ] 198718 9.221% 94.376% ## ( 3, 4 ] 68908 3.197% 97.573% # ( 4, 6 ] 38600 1.791% 99.364% ( 6, 10 ] 10465 0.486% 99.850% ( 10, 15 ] 2054 0.095% 99.945% ( 15, 22 ] 280 0.013% 99.958% ( 22, 34 ] 31 0.001% 99.960% ( 34, 51 ] 14 0.001% 99.960% ( 51, 76 ] 18 0.001% 99.961% ( 76, 110 ] 525 0.024% 99.985% ( 110, 170 ] 417 0.019% 100.005% ( 170, 250 ] 145 0.007% 100.011% ( 250, 380 ] 128 0.006% 100.017% ( 380, 580 ] 77 0.004% 100.021% ( 580, 870 ] 54 0.003% 100.023% ( 870, 1300 ] 21 0.001% 100.024% ( 1300, 1900 ] 14 0.001% 100.025% ( 1900, 2900 ] 9 0.000% 100.026% ( 2900, 4400 ] 7 0.000% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 361312 Average: 2.5542 StdDev: 15.28 Min: 0 Median: 1.5250 Max: 2659 Percentiles: P50: 1.53 P75: 1.90 P99: 7.32 P99.9: 94.09 P99.99: 579.31 ------------------------------------------------------ [ 0, 1 ] 55780 15.438% 15.438% ### ( 1, 2 ] 237848 65.829% 81.267% ############# ( 2, 3 ] 39999 11.070% 92.338% ## ( 3, 4 ] 13204 3.654% 95.992% # ( 4, 6 ] 9604 2.658% 98.650% # ( 6, 10 ] 3816 1.056% 99.706% ( 10, 15 ] 423 0.117% 99.823% ( 15, 22 ] 67 0.019% 99.842% ( 22, 34 ] 5 0.001% 99.843% ( 34, 51 ] 3 0.001% 99.844% ( 51, 76 ] 57 0.016% 99.860% ( 76, 110 ] 272 0.075% 99.935% ( 110, 170 ] 96 0.027% 99.962% ( 170, 250 ] 35 0.010% 99.971% ( 250, 380 ] 29 0.008% 99.980% ( 380, 580 ] 38 0.011% 99.990% ( 580, 870 ] 25 0.007% 99.997% ( 870, 1300 ] 21 0.006% 100.003% ( 1300, 1900 ] 9 0.002% 100.005% ( 1900, 2900 ] 2 0.001% 100.006% ** Level 2 read latency histogram (micros): Count: 95429 Average: 2.0714 StdDev: 13.75 Min: 1 Median: 1.3767 Max: 2355 Percentiles: P50: 1.38 P75: 1.78 P99: 5.31 P99.9: 9.95 P99.99: 410.47 ------------------------------------------------------ [ 0, 1 ] 25464 26.684% 26.684% ##### ( 1, 2 ] 59064 61.893% 88.577% ############ ( 2, 3 ] 6199 6.496% 95.073% # ( 3, 4 ] 2736 2.867% 97.940% # ( 4, 6 ] 1539 1.613% 99.553% ( 6, 10 ] 336 0.352% 99.905% ( 10, 15 ] 62 0.065% 99.970% ( 15, 22 ] 7 0.007% 99.977% ( 22, 34 ] 3 0.003% 99.980% ( 34, 51 ] 2 0.002% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 5 0.005% 99.990% ( 380, 580 ] 3 0.003% 99.993% ( 580, 870 ] 2 0.002% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 59091 Average: 4.1488 StdDev: 59.57 Min: 0 Median: 1.6698 Max: 4519 Percentiles: P50: 1.67 P75: 2.25 P99: 7.86 P99.9: 286.30 P99.99: 1564.93 ------------------------------------------------------ [ 0, 1 ] 4666 7.896% 7.896% ## ( 1, 2 ] 37146 62.862% 70.759% ############# ( 2, 3 ] 10089 17.074% 87.832% ### ( 3, 4 ] 3567 6.036% 93.869% # ( 4, 6 ] 2782 4.708% 98.577% # ( 6, 10 ] 538 0.910% 99.487% ( 10, 15 ] 112 0.190% 99.677% ( 15, 22 ] 17 0.029% 99.706% ( 22, 34 ] 51 0.086% 99.792% ( 34, 51 ] 3 0.005% 99.797% ( 51, 76 ] 3 0.005% 99.802% ( 76, 110 ] 13 0.022% 99.824% ( 110, 170 ] 29 0.049% 99.873% ( 170, 250 ] 12 0.020% 99.893% ( 250, 380 ] 14 0.024% 99.917% ( 380, 580 ] 18 0.030% 99.948% ( 580, 870 ] 14 0.024% 99.971% ( 870, 1300 ] 8 0.014% 99.985% ( 1300, 1900 ] 7 0.012% 99.997% ( 1900, 2900 ] 6 0.010% 100.007% ( 2900, 4400 ] 7 0.012% 100.019% ( 4400, 6600 ] 2 0.003% 100.022% ** Level 4 read latency histogram (micros): Count: 15 Average: 1834.2667 StdDev: 1349.04 Min: 289 Median: 1192.5000 Max: 4272 Percentiles: P50: 1192.50 P75: 2993.75 P99: 4272.00 P99.9: 4272.00 P99.99: 4272.00 ------------------------------------------------------ ( 250, 380 ] 1 6.667% 6.667% # ( 380, 580 ] 2 13.333% 20.000% ### ( 580, 870 ] 3 20.000% 40.000% #### ( 870, 1300 ] 2 13.333% 53.333% ### ( 1300, 1900 ] 1 6.667% 60.000% # ( 1900, 2900 ] 2 13.333% 73.333% ### ( 2900, 4400 ] 4 26.667% 100.000% ##### ** Level 5 read latency histogram (micros): Count: 100 Average: 681.7300 StdDev: 880.78 Min: 77 Median: 218.0000 Max: 3953 Percentiles: P50: 218.00 P75: 870.00 P99: 3900.00 P99.9: 3953.00 P99.99: 3953.00 ------------------------------------------------------ ( 76, 110 ] 27 27.000% 27.000% ##### ( 110, 170 ] 20 20.000% 47.000% #### ( 170, 250 ] 5 5.000% 52.000% # ( 250, 380 ] 8 8.000% 60.000% ## ( 380, 580 ] 7 7.000% 67.000% # ( 580, 870 ] 8 8.000% 75.000% ## ( 870, 1300 ] 5 5.000% 80.000% # ( 1300, 1900 ] 9 9.000% 89.000% ## ( 1900, 2900 ] 8 8.000% 97.000% ## ( 2900, 4400 ] 3 3.000% 100.000% # ** DB Stats ** Uptime(secs): 24.0 total, 8.3 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 246.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.920 H:M:S, 33.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 118.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.606 H:M:S, 67.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-20:49:49 ... thread 0: (1000000,7000000) ops and (349792.2,262655.8) ops/second in (2.858840,26.650845) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 3.19 GB 37.8 5.2 0.0 5.2 11.7 6.6 0.0 1.8 134.4 305.4 39.38 36.93 116 0.339 5372K 7157 0.0 0.0 L1 15/15 1.72 GB 0.0 4.2 3.1 1.0 4.1 3.1 0.2 1.3 225.8 223.8 18.96 18.31 3 6.319 4347K 38K 0.0 0.0 L2 2/0 54.21 MB 0.5 0.4 0.2 0.2 0.4 0.2 1.4 2.0 252.3 252.2 1.50 1.44 2 0.749 383K 209 0.0 0.0 L3 14/0 926.53 MB 0.9 0.8 0.6 0.2 0.8 0.6 1.1 1.4 201.6 201.4 3.95 3.51 3 1.318 809K 840 0.0 0.0 L4 168/0 9.56 GB 1.0 0.2 0.1 0.0 0.2 0.1 1.6 1.2 210.4 209.3 0.75 0.68 1 0.755 161K 822 0.0 0.0 L5 1060/0 87.23 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1278/31 102.67 GB 0.0 10.7 4.0 6.6 17.2 10.5 6.0 2.6 169.0 272.7 64.54 60.87 125 0.516 11M 47K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.7 4.0 6.6 17.2 10.5 5.9 2.6 169.0 272.7 64.54 60.87 125 0.516 11M 47K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.7 4.0 6.6 10.6 4.0 0.0 0.0 239.6 238.5 45.52 43.92 27 1.686 11M 47K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 354.5 19.01 16.95 98 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.8 total, 26.7 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.19 GB write, 655.83 MB/s write, 10.65 GB read, 406.43 MB/s read, 64.5 seconds Interval compaction: 17.19 GB write, 660.29 MB/s write, 10.65 GB read, 409.19 MB/s read, 64.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 17, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2486472 Average: 2.2619 StdDev: 12.51 Min: 0 Median: 1.4774 Max: 4642 Percentiles: P50: 1.48 P75: 1.85 P99: 5.66 P99.9: 12.82 P99.99: 139.12 ------------------------------------------------------ [ 0, 1 ] 455325 18.312% 18.312% #### ( 1, 2 ] 1650583 66.383% 84.695% ############# ( 2, 3 ] 237004 9.532% 94.226% ## ( 3, 4 ] 80746 3.247% 97.474% # ( 4, 6 ] 45843 1.844% 99.317% ( 6, 10 ] 13176 0.530% 99.847% ( 10, 15 ] 2318 0.093% 99.941% ( 15, 22 ] 299 0.012% 99.953% ( 22, 34 ] 33 0.001% 99.954% ( 34, 51 ] 14 0.001% 99.955% ( 51, 76 ] 22 0.001% 99.955% ( 76, 110 ] 574 0.023% 99.978% ( 110, 170 ] 592 0.024% 100.002% ( 170, 250 ] 210 0.008% 100.011% ( 250, 380 ] 176 0.007% 100.018% ( 380, 580 ] 116 0.005% 100.022% ( 580, 870 ] 82 0.003% 100.026% ( 870, 1300 ] 28 0.001% 100.027% ( 1300, 1900 ] 15 0.001% 100.028% ( 1900, 2900 ] 9 0.000% 100.028% ( 2900, 4400 ] 11 0.000% 100.028% ( 4400, 6600 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 386543 Average: 2.5428 StdDev: 14.93 Min: 0 Median: 1.5231 Max: 2659 Percentiles: P50: 1.52 P75: 1.90 P99: 7.34 P99.9: 94.34 P99.99: 566.73 ------------------------------------------------------ [ 0, 1 ] 60050 15.535% 15.535% ### ( 1, 2 ] 254696 65.891% 81.426% ############# ( 2, 3 ] 42735 11.056% 92.482% ## ( 3, 4 ] 13823 3.576% 96.058% # ( 4, 6 ] 10007 2.589% 98.646% # ( 6, 10 ] 4087 1.057% 99.704% ( 10, 15 ] 465 0.120% 99.824% ( 15, 22 ] 70 0.018% 99.842% ( 22, 34 ] 6 0.002% 99.844% ( 34, 51 ] 3 0.001% 99.845% ( 51, 76 ] 58 0.015% 99.860% ( 76, 110 ] 290 0.075% 99.935% ( 110, 170 ] 105 0.027% 99.962% ( 170, 250 ] 42 0.011% 99.973% ( 250, 380 ] 30 0.008% 99.980% ( 380, 580 ] 40 0.010% 99.991% ( 580, 870 ] 26 0.007% 99.997% ( 870, 1300 ] 21 0.005% 100.003% ( 1300, 1900 ] 9 0.002% 100.005% ( 1900, 2900 ] 2 0.001% 100.006% ** Level 2 read latency histogram (micros): Count: 95429 Average: 2.0714 StdDev: 13.75 Min: 1 Median: 1.3767 Max: 2355 Percentiles: P50: 1.38 P75: 1.78 P99: 5.31 P99.9: 9.95 P99.99: 410.47 ------------------------------------------------------ [ 0, 1 ] 25464 26.684% 26.684% ##### ( 1, 2 ] 59064 61.893% 88.577% ############ ( 2, 3 ] 6199 6.496% 95.073% # ( 3, 4 ] 2736 2.867% 97.940% # ( 4, 6 ] 1539 1.613% 99.553% ( 6, 10 ] 336 0.352% 99.905% ( 10, 15 ] 62 0.065% 99.970% ( 15, 22 ] 7 0.007% 99.977% ( 22, 34 ] 3 0.003% 99.980% ( 34, 51 ] 2 0.002% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 5 0.005% 99.990% ( 380, 580 ] 3 0.003% 99.993% ( 580, 870 ] 2 0.002% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 65048 Average: 4.2928 StdDev: 57.59 Min: 0 Median: 1.6479 Max: 4519 Percentiles: P50: 1.65 P75: 2.18 P99: 8.70 P99.9: 356.56 P99.99: 1513.87 ------------------------------------------------------ [ 0, 1 ] 6094 9.368% 9.368% ## ( 1, 2 ] 40792 62.711% 72.079% ############# ( 2, 3 ] 10541 16.205% 88.284% ### ( 3, 4 ] 3704 5.694% 93.978% # ( 4, 6 ] 2848 4.378% 98.357% # ( 6, 10 ] 620 0.953% 99.310% ( 10, 15 ] 130 0.200% 99.510% ( 15, 22 ] 17 0.026% 99.536% ( 22, 34 ] 51 0.078% 99.614% ( 34, 51 ] 3 0.005% 99.619% ( 51, 76 ] 3 0.005% 99.623% ( 76, 110 ] 76 0.117% 99.740% ( 110, 170 ] 57 0.088% 99.828% ( 170, 250 ] 24 0.037% 99.865% ( 250, 380 ] 28 0.043% 99.908% ( 380, 580 ] 26 0.040% 99.948% ( 580, 870 ] 17 0.026% 99.974% ( 870, 1300 ] 8 0.012% 99.986% ( 1300, 1900 ] 7 0.011% 99.997% ( 1900, 2900 ] 6 0.009% 100.006% ( 2900, 4400 ] 7 0.011% 100.017% ( 4400, 6600 ] 2 0.003% 100.020% ** Level 4 read latency histogram (micros): Count: 35 Average: 839.9714 StdDev: 1240.79 Min: 1 Median: 271.6667 Max: 4272 Percentiles: P50: 271.67 P75: 923.75 P99: 4268.75 P99.9: 4272.00 P99.99: 4272.00 ------------------------------------------------------ [ 0, 1 ] 8 22.857% 22.857% ##### ( 1, 2 ] 4 11.429% 34.286% ## ( 2, 3 ] 2 5.714% 40.000% # ( 170, 250 ] 3 8.571% 48.571% ## ( 250, 380 ] 3 8.571% 57.143% ## ( 380, 580 ] 2 5.714% 62.857% # ( 580, 870 ] 4 11.429% 74.286% ## ( 870, 1300 ] 2 5.714% 80.000% # ( 1300, 1900 ] 1 2.857% 82.857% # ( 1900, 2900 ] 2 5.714% 88.571% # ( 2900, 4400 ] 4 11.429% 100.000% ## ** Level 5 read latency histogram (micros): Count: 100 Average: 681.7300 StdDev: 880.78 Min: 77 Median: 218.0000 Max: 3953 Percentiles: P50: 218.00 P75: 870.00 P99: 3900.00 P99.9: 3953.00 P99.99: 3953.00 ------------------------------------------------------ ( 76, 110 ] 27 27.000% 27.000% ##### ( 110, 170 ] 20 20.000% 47.000% #### ( 170, 250 ] 5 5.000% 52.000% # ( 250, 380 ] 8 8.000% 60.000% ## ( 380, 580 ] 7 7.000% 67.000% # ( 580, 870 ] 8 8.000% 75.000% ## ( 870, 1300 ] 5 5.000% 80.000% # ( 1300, 1900 ] 9 9.000% 89.000% ## ( 1900, 2900 ] 8 8.000% 97.000% ## ( 2900, 4400 ] 3 3.000% 100.000% # ** DB Stats ** Uptime(secs): 26.8 total, 2.9 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 256.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.143 H:M:S, 30.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 344.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.223 H:M:S, 7.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/17-20:50:08 ... thread 0: (1000000,8000000) ops and (51601.0,173798.5) ops/second in (19.379481,46.030326) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 1.90 GB 12.6 7.6 0.0 7.6 15.2 7.6 0.0 2.0 143.4 285.4 54.45 49.25 134 0.406 7929K 16K 0.0 0.0 L1 10/10 937.73 MB 0.0 8.2 5.4 2.8 8.1 5.3 0.2 1.5 226.6 223.8 36.95 35.36 4 9.238 8217K 38K 0.0 0.0 L2 4/2 515.12 MB 2.6 0.4 0.2 0.2 0.4 0.2 4.5 2.0 252.3 252.2 1.50 1.44 2 0.749 383K 209 0.0 0.0 L3 24/8 1.73 GB 1.0 1.7 1.0 0.7 1.7 1.0 3.3 1.7 135.1 134.6 13.14 8.08 7 1.877 1803K 7581 0.0 0.0 L4 164/7 9.69 GB 1.0 2.2 1.9 0.4 2.2 1.8 1.6 1.2 122.8 122.1 18.56 10.54 19 0.977 2245K 9014 0.0 0.0 L5 1080/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1290/33 103.57 GB 0.0 20.1 8.4 11.7 27.6 15.9 12.8 3.6 165.5 226.5 124.60 104.68 166 0.751 20M 72K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.1 8.4 11.7 27.6 15.9 12.7 3.6 165.5 226.5 124.60 104.68 166 0.751 20M 72K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.1 8.4 11.7 20.0 8.3 0.0 0.0 205.6 204.2 100.29 84.93 55 1.823 20M 72K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 318.7 24.31 19.76 111 0.219 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 46.2 total, 46.0 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.56 GB write, 610.74 MB/s write, 20.13 GB read, 446.10 MB/s read, 124.6 seconds Interval compaction: 27.56 GB write, 613.14 MB/s write, 20.13 GB read, 447.85 MB/s read, 124.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 38, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 38, interval: 61 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3614040 Average: 2.6380 StdDev: 30.23 Min: 0 Median: 1.4829 Max: 8581 Percentiles: P50: 1.48 P75: 1.87 P99: 5.91 P99.9: 95.34 P99.99: 291.77 ------------------------------------------------------ [ 0, 1 ] 669720 18.531% 18.531% #### ( 1, 2 ] 2355236 65.169% 83.700% ############# ( 2, 3 ] 352149 9.744% 93.444% ## ( 3, 4 ] 123549 3.419% 96.863% # ( 4, 6 ] 80921 2.239% 99.102% ( 6, 10 ] 23185 0.642% 99.743% ( 10, 15 ] 3821 0.106% 99.849% ( 15, 22 ] 531 0.015% 99.864% ( 22, 34 ] 53 0.001% 99.865% ( 34, 51 ] 17 0.000% 99.866% ( 51, 76 ] 80 0.002% 99.868% ( 76, 110 ] 2050 0.057% 99.925% ( 110, 170 ] 1728 0.048% 99.972% ( 170, 250 ] 505 0.014% 99.986% ( 250, 380 ] 422 0.012% 99.998% ( 380, 580 ] 345 0.010% 100.008% ( 580, 870 ] 241 0.007% 100.014% ( 870, 1300 ] 109 0.003% 100.017% ( 1300, 1900 ] 77 0.002% 100.019% ( 1900, 2900 ] 86 0.002% 100.022% ( 2900, 4400 ] 98 0.003% 100.024% ( 4400, 6600 ] 23 0.001% 100.025% ( 6600, 9900 ] 5 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1558914 Average: 5.0825 StdDev: 83.84 Min: 0 Median: 1.6431 Max: 9907 Percentiles: P50: 1.64 P75: 2.31 P99: 8.80 P99.9: 109.16 P99.99: 372.87 ------------------------------------------------------ [ 0, 1 ] 205882 13.207% 13.207% ### ( 1, 2 ] 891914 57.214% 70.421% ########### ( 2, 3 ] 233459 14.976% 85.396% ### ( 3, 4 ] 101844 6.533% 91.929% # ( 4, 6 ] 92164 5.912% 97.841% # ( 6, 10 ] 25828 1.657% 99.498% ( 10, 15 ] 4431 0.284% 99.782% ( 15, 22 ] 594 0.038% 99.821% ( 22, 34 ] 44 0.003% 99.823% ( 34, 51 ] 11 0.001% 99.824% ( 51, 76 ] 157 0.010% 99.834% ( 76, 110 ] 1054 0.068% 99.902% ( 110, 170 ] 824 0.053% 99.955% ( 170, 250 ] 245 0.016% 99.970% ( 250, 380 ] 326 0.021% 99.991% ( 380, 580 ] 501 0.032% 100.023% ( 580, 870 ] 471 0.030% 100.054% ( 870, 1300 ] 339 0.022% 100.075% ( 1300, 1900 ] 215 0.014% 100.089% ( 1900, 2900 ] 243 0.016% 100.105% ( 2900, 4400 ] 338 0.022% 100.126% ( 4400, 6600 ] 104 0.007% 100.133% ( 6600, 9900 ] 19 0.001% 100.134% ( 9900, 14000 ] 1 0.000% 100.134% ** Level 2 read latency histogram (micros): Count: 95429 Average: 2.0714 StdDev: 13.75 Min: 1 Median: 1.3767 Max: 2355 Percentiles: P50: 1.38 P75: 1.78 P99: 5.31 P99.9: 9.95 P99.99: 410.47 ------------------------------------------------------ [ 0, 1 ] 25464 26.684% 26.684% ##### ( 1, 2 ] 59064 61.893% 88.577% ############ ( 2, 3 ] 6199 6.496% 95.073% # ( 3, 4 ] 2736 2.867% 97.940% # ( 4, 6 ] 1539 1.613% 99.553% ( 6, 10 ] 336 0.352% 99.905% ( 10, 15 ] 62 0.065% 99.970% ( 15, 22 ] 7 0.007% 99.977% ( 22, 34 ] 3 0.003% 99.980% ( 34, 51 ] 2 0.002% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 5 0.005% 99.990% ( 380, 580 ] 3 0.003% 99.993% ( 580, 870 ] 2 0.002% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 309585 Average: 12.4913 StdDev: 147.82 Min: 0 Median: 1.8596 Max: 17525 Percentiles: P50: 1.86 P75: 2.83 P99: 12.93 P99.9: 1384.95 P99.99: 2381.28 ------------------------------------------------------ [ 0, 1 ] 11620 3.753% 3.753% # ( 1, 2 ] 166557 53.800% 57.553% ########### ( 2, 3 ] 64837 20.943% 78.497% #### ( 3, 4 ] 32515 10.503% 88.999% ## ( 4, 6 ] 25751 8.318% 97.317% ## ( 6, 10 ] 4714 1.523% 98.840% ( 10, 15 ] 847 0.274% 99.114% ( 15, 22 ] 97 0.031% 99.145% ( 22, 34 ] 56 0.018% 99.163% ( 34, 51 ] 12 0.004% 99.167% ( 51, 76 ] 10 0.003% 99.170% ( 76, 110 ] 95 0.031% 99.201% ( 110, 170 ] 133 0.043% 99.244% ( 170, 250 ] 151 0.049% 99.293% ( 250, 380 ] 300 0.097% 99.390% ( 380, 580 ] 517 0.167% 99.557% ( 580, 870 ] 576 0.186% 99.743% ( 870, 1300 ] 455 0.147% 99.890% ( 1300, 1900 ] 236 0.076% 99.966% ( 1900, 2900 ] 158 0.051% 100.017% ( 2900, 4400 ] 193 0.062% 100.079% ( 4400, 6600 ] 44 0.014% 100.093% ( 6600, 9900 ] 6 0.002% 100.095% ( 9900, 14000 ] 1 0.000% 100.096% ( 14000, 22000 ] 1 0.000% 100.096% ** Level 4 read latency histogram (micros): Count: 32427 Average: 6.1375 StdDev: 85.81 Min: 1 Median: 1.9392 Max: 4485 Percentiles: P50: 1.94 P75: 2.98 P99: 9.21 P99.9: 770.62 P99.99: 2494.66 ------------------------------------------------------ [ 0, 1 ] 414 1.277% 1.277% ( 1, 2 ] 16822 51.877% 53.153% ########## ( 2, 3 ] 7240 22.327% 75.480% #### ( 3, 4 ] 3713 11.450% 86.931% ## ( 4, 6 ] 3541 10.920% 97.851% ## ( 6, 10 ] 465 1.434% 99.285% ( 10, 15 ] 123 0.379% 99.664% ( 15, 22 ] 15 0.046% 99.710% ( 22, 34 ] 1 0.003% 99.713% ( 34, 51 ] 4 0.012% 99.726% ( 51, 76 ] 2 0.006% 99.732% ( 76, 110 ] 5 0.015% 99.747% ( 110, 170 ] 3 0.009% 99.756% ( 170, 250 ] 30 0.093% 99.849% ( 250, 380 ] 5 0.015% 99.864% ( 380, 580 ] 5 0.015% 99.880% ( 580, 870 ] 10 0.031% 99.911% ( 870, 1300 ] 7 0.022% 99.932% ( 1300, 1900 ] 14 0.043% 99.975% ( 1900, 2900 ] 8 0.025% 100.000% ( 2900, 4400 ] 9 0.028% 100.028% ( 4400, 6600 ] 1 0.003% 100.031% ** Level 5 read latency histogram (micros): Count: 200 Average: 1337.0250 StdDev: 1542.26 Min: 77 Median: 624.6154 Max: 8950 Percentiles: P50: 624.62 P75: 2163.16 P99: 6600.00 P99.9: 8950.00 P99.99: 8950.00 ------------------------------------------------------ ( 76, 110 ] 29 14.500% 14.500% ### ( 110, 170 ] 25 12.500% 27.000% ### ( 170, 250 ] 7 3.500% 30.500% # ( 250, 380 ] 21 10.500% 41.000% ## ( 380, 580 ] 16 8.000% 49.000% ## ( 580, 870 ] 13 6.500% 55.500% # ( 870, 1300 ] 17 8.500% 64.000% ## ( 1300, 1900 ] 17 8.500% 72.500% ## ( 1900, 2900 ] 19 9.500% 82.000% ## ( 2900, 4400 ] 27 13.500% 95.500% ### ( 4400, 6600 ] 7 3.500% 99.000% # ( 6600, 9900 ] 2 1.000% 100.000% ** DB Stats ** Uptime(secs): 46.2 total, 19.4 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 170.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.576 H:M:S, 53.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 50.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:16.432 H:M:S, 84.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/11/17-20:50:13 ... thread 0: (1000000,9000000) ops and (234971.1,178975.7) ops/second in (4.255842,50.286168) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/6 2.88 GB 125.8 8.7 0.0 8.7 17.2 8.5 0.0 2.0 140.9 279.5 63.04 56.20 149 0.423 9016K 17K 0.0 0.0 L1 10/10 937.73 MB 0.0 8.2 5.4 2.8 8.1 5.3 0.2 1.5 226.6 223.8 36.95 35.36 4 9.238 8217K 38K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 4.5 2.0 252.3 252.2 1.50 1.44 2 0.749 383K 209 0.0 0.0 L3 18/0 954.66 MB 1.0 3.1 1.5 1.6 3.1 1.5 3.3 2.1 141.3 140.5 22.31 14.32 11 2.028 3200K 17K 0.0 0.0 L4 157/0 9.62 GB 1.0 3.8 3.2 0.7 3.8 3.1 1.6 1.2 131.3 130.6 29.95 18.14 34 0.881 3915K 18K 0.0 0.0 L5 1096/0 90.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1292/16 104.53 GB 0.0 24.1 10.2 13.9 32.5 18.6 14.1 3.8 160.8 216.7 153.75 125.47 200 0.769 24M 92K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.1 10.2 13.9 32.5 18.6 14.0 3.8 160.8 216.7 153.75 125.47 200 0.769 24M 92K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.1 10.2 13.9 24.0 10.1 0.0 0.0 196.7 195.4 125.64 103.07 77 1.632 24M 92K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 311.5 28.11 22.40 123 0.229 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.5 total, 50.3 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.53 GB write, 660.03 MB/s write, 24.14 GB read, 489.73 MB/s read, 153.7 seconds Interval compaction: 32.53 GB write, 662.41 MB/s write, 24.14 GB read, 491.49 MB/s read, 153.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 55, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 55, interval: 78 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4069340 Average: 2.7531 StdDev: 35.57 Min: 0 Median: 1.5123 Max: 13337 Percentiles: P50: 1.51 P75: 1.90 P99: 6.10 P99.9: 89.32 P99.99: 289.31 ------------------------------------------------------ [ 0, 1 ] 697053 17.129% 17.129% ### ( 1, 2 ] 2611241 64.169% 81.298% ############# ( 2, 3 ] 446246 10.966% 92.264% ## ( 3, 4 ] 158095 3.885% 96.149% # ( 4, 6 ] 115223 2.831% 98.981% # ( 6, 10 ] 30696 0.754% 99.735% ( 10, 15 ] 5091 0.125% 99.860% ( 15, 22 ] 653 0.016% 99.876% ( 22, 34 ] 62 0.002% 99.878% ( 34, 51 ] 22 0.001% 99.878% ( 51, 76 ] 86 0.002% 99.880% ( 76, 110 ] 2052 0.050% 99.931% ( 110, 170 ] 1750 0.043% 99.974% ( 170, 250 ] 528 0.013% 99.987% ( 250, 380 ] 450 0.011% 99.998% ( 380, 580 ] 382 0.009% 100.007% ( 580, 870 ] 280 0.007% 100.014% ( 870, 1300 ] 139 0.003% 100.017% ( 1300, 1900 ] 96 0.002% 100.020% ( 1900, 2900 ] 113 0.003% 100.023% ( 2900, 4400 ] 125 0.003% 100.026% ( 4400, 6600 ] 41 0.001% 100.027% ( 6600, 9900 ] 10 0.000% 100.027% ( 9900, 14000 ] 3 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 1720067 Average: 5.1426 StdDev: 85.23 Min: 0 Median: 1.6674 Max: 14809 Percentiles: P50: 1.67 P75: 2.39 P99: 8.89 P99.9: 117.86 P99.99: 434.16 ------------------------------------------------------ [ 0, 1 ] 209014 12.152% 12.152% ## ( 1, 2 ] 975393 56.707% 68.858% ########### ( 2, 3 ] 270166 15.707% 84.565% ### ( 3, 4 ] 118588 6.894% 91.459% # ( 4, 6 ] 108017 6.280% 97.739% # ( 6, 10 ] 30023 1.745% 99.485% ( 10, 15 ] 5054 0.294% 99.778% ( 15, 22 ] 667 0.039% 99.817% ( 22, 34 ] 51 0.003% 99.820% ( 34, 51 ] 13 0.001% 99.821% ( 51, 76 ] 158 0.009% 99.830% ( 76, 110 ] 1090 0.063% 99.893% ( 110, 170 ] 862 0.050% 99.944% ( 170, 250 ] 274 0.016% 99.959% ( 250, 380 ] 372 0.022% 99.981% ( 380, 580 ] 565 0.033% 100.014% ( 580, 870 ] 532 0.031% 100.045% ( 870, 1300 ] 369 0.021% 100.066% ( 1300, 1900 ] 244 0.014% 100.081% ( 1900, 2900 ] 277 0.016% 100.097% ( 2900, 4400 ] 356 0.021% 100.117% ( 4400, 6600 ] 116 0.007% 100.124% ( 6600, 9900 ] 23 0.001% 100.125% ( 9900, 14000 ] 2 0.000% 100.126% ( 14000, 22000 ] 1 0.000% 100.126% ** Level 2 read latency histogram (micros): Count: 95429 Average: 2.0714 StdDev: 13.75 Min: 1 Median: 1.3767 Max: 2355 Percentiles: P50: 1.38 P75: 1.78 P99: 5.31 P99.9: 9.95 P99.99: 410.47 ------------------------------------------------------ [ 0, 1 ] 25464 26.684% 26.684% ##### ( 1, 2 ] 59064 61.893% 88.577% ############ ( 2, 3 ] 6199 6.496% 95.073% # ( 3, 4 ] 2736 2.867% 97.940% # ( 4, 6 ] 1539 1.613% 99.553% ( 6, 10 ] 336 0.352% 99.905% ( 10, 15 ] 62 0.065% 99.970% ( 15, 22 ] 7 0.007% 99.977% ( 22, 34 ] 3 0.003% 99.980% ( 34, 51 ] 2 0.002% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 5 0.005% 99.990% ( 380, 580 ] 3 0.003% 99.993% ( 580, 870 ] 2 0.002% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 695529 Average: 9.0090 StdDev: 117.88 Min: 0 Median: 1.9171 Max: 17525 Percentiles: P50: 1.92 P75: 2.92 P99: 9.55 P99.9: 792.32 P99.99: 1159.40 ------------------------------------------------------ [ 0, 1 ] 17461 2.510% 2.510% # ( 1, 2 ] 360149 51.781% 54.291% ########## ( 2, 3 ] 156205 22.458% 76.749% #### ( 3, 4 ] 77474 11.139% 87.888% ## ( 4, 6 ] 67077 9.644% 97.532% ## ( 6, 10 ] 11506 1.654% 99.187% ( 10, 15 ] 2133 0.307% 99.493% ( 15, 22 ] 216 0.031% 99.524% ( 22, 34 ] 62 0.009% 99.533% ( 34, 51 ] 15 0.002% 99.535% ( 51, 76 ] 16 0.002% 99.538% ( 76, 110 ] 116 0.017% 99.554% ( 110, 170 ] 198 0.028% 99.583% ( 170, 250 ] 273 0.039% 99.622% ( 250, 380 ] 495 0.071% 99.693% ( 380, 580 ] 821 0.118% 99.811% ( 580, 870 ] 842 0.121% 99.932% ( 870, 1300 ] 595 0.086% 100.018% ( 1300, 1900 ] 292 0.042% 100.060% ( 1900, 2900 ] 243 0.035% 100.095% ( 2900, 4400 ] 270 0.039% 100.134% ( 4400, 6600 ] 62 0.009% 100.143% ( 6600, 9900 ] 9 0.001% 100.144% ( 9900, 14000 ] 1 0.000% 100.144% ( 14000, 22000 ] 2 0.000% 100.144% ** Level 4 read latency histogram (micros): Count: 60620 Average: 7.8439 StdDev: 107.61 Min: 1 Median: 1.9487 Max: 7337 Percentiles: P50: 1.95 P75: 2.99 P99: 9.78 P99.9: 1178.34 P99.99: 3482.91 ------------------------------------------------------ [ 0, 1 ] 922 1.521% 1.521% ( 1, 2 ] 30978 51.102% 52.623% ########## ( 2, 3 ] 13742 22.669% 75.292% ##### ( 3, 4 ] 6922 11.419% 86.711% ## ( 4, 6 ] 6451 10.642% 97.352% ## ( 6, 10 ] 1058 1.745% 99.098% ( 10, 15 ] 222 0.366% 99.464% ( 15, 22 ] 22 0.036% 99.500% ( 22, 34 ] 3 0.005% 99.505% ( 34, 51 ] 6 0.010% 99.515% ( 51, 76 ] 3 0.005% 99.520% ( 76, 110 ] 12 0.020% 99.540% ( 110, 170 ] 17 0.028% 99.568% ( 170, 250 ] 58 0.096% 99.663% ( 250, 380 ] 26 0.043% 99.706% ( 380, 580 ] 39 0.064% 99.771% ( 580, 870 ] 54 0.089% 99.860% ( 870, 1300 ] 34 0.056% 99.916% ( 1300, 1900 ] 20 0.033% 99.949% ( 1900, 2900 ] 16 0.026% 99.975% ( 2900, 4400 ] 23 0.038% 100.013% ( 4400, 6600 ] 2 0.003% 100.016% ( 6600, 9900 ] 3 0.005% 100.021% ** Level 5 read latency histogram (micros): Count: 280 Average: 1397.4786 StdDev: 1538.06 Min: 77 Median: 710.5000 Max: 8950 Percentiles: P50: 710.50 P75: 2361.54 P99: 6820.00 P99.9: 8950.00 P99.99: 8950.00 ------------------------------------------------------ ( 76, 110 ] 30 10.714% 10.714% ## ( 110, 170 ] 37 13.214% 23.929% ### ( 170, 250 ] 13 4.643% 28.571% # ( 250, 380 ] 26 9.286% 37.857% ## ( 380, 580 ] 25 8.929% 46.786% ## ( 580, 870 ] 20 7.143% 53.929% # ( 870, 1300 ] 23 8.214% 62.143% ## ( 1300, 1900 ] 18 6.429% 68.571% # ( 1900, 2900 ] 39 13.929% 82.500% ### ( 2900, 4400 ] 37 13.214% 95.714% ### ( 4400, 6600 ] 9 3.214% 98.929% # ( 6600, 9900 ] 3 1.071% 100.000% ** DB Stats ** Uptime(secs): 50.5 total, 4.3 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 175.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.876 H:M:S, 51.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 231.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.300 H:M:S, 30.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-20:50:16 ... thread 0: (1000000,10000000) ops and (325684.0,187418.1) ops/second in (3.070461,53.356629) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/6 3.80 GB 220.2 9.5 0.0 9.5 19.0 9.5 0.0 2.0 141.0 280.8 69.24 62.02 165 0.420 9912K 18K 0.0 0.0 L1 10/10 937.73 MB 0.0 8.2 5.4 2.8 8.1 5.3 0.2 1.5 226.6 223.8 36.95 35.36 4 9.238 8217K 38K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 4.5 2.0 252.3 252.2 1.50 1.44 2 0.749 383K 209 0.0 0.0 L3 18/0 954.66 MB 1.0 3.1 1.5 1.6 3.1 1.5 3.3 2.1 141.3 140.5 22.31 14.32 11 2.028 3200K 17K 0.0 0.0 L4 157/0 9.62 GB 1.0 3.8 3.2 0.7 3.8 3.1 1.6 1.2 131.3 130.6 29.95 18.14 34 0.881 3915K 18K 0.0 0.0 L5 1096/0 90.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1296/16 105.45 GB 0.0 25.0 10.2 14.8 34.3 19.5 14.1 3.6 160.0 219.7 159.95 131.29 216 0.740 25M 93K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.0 10.2 14.8 34.3 19.5 14.0 3.6 160.0 219.7 159.95 131.29 216 0.740 25M 93K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.0 10.2 14.8 24.8 10.1 0.0 0.0 198.3 197.0 129.09 106.45 80 1.614 25M 93K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 314.4 30.85 24.85 136 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.5 total, 53.4 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.31 GB write, 656.28 MB/s write, 25.00 GB read, 478.12 MB/s read, 159.9 seconds Interval compaction: 34.31 GB write, 658.51 MB/s write, 25.00 GB read, 479.74 MB/s read, 159.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 59, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 59, interval: 82 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4351485 Average: 2.7218 StdDev: 34.52 Min: 0 Median: 1.5139 Max: 13337 Percentiles: P50: 1.51 P75: 1.90 P99: 6.00 P99.9: 84.57 P99.99: 269.91 ------------------------------------------------------ [ 0, 1 ] 735289 16.897% 16.897% ### ( 1, 2 ] 2802848 64.411% 81.309% ############# ( 2, 3 ] 479895 11.028% 92.337% ## ( 3, 4 ] 168772 3.878% 96.216% # ( 4, 6 ] 121248 2.786% 99.002% # ( 6, 10 ] 32229 0.741% 99.743% ( 10, 15 ] 5476 0.126% 99.868% ( 15, 22 ] 676 0.016% 99.884% ( 22, 34 ] 65 0.001% 99.885% ( 34, 51 ] 24 0.001% 99.886% ( 51, 76 ] 90 0.002% 99.888% ( 76, 110 ] 2074 0.048% 99.936% ( 110, 170 ] 1758 0.040% 99.976% ( 170, 250 ] 537 0.012% 99.988% ( 250, 380 ] 456 0.010% 99.999% ( 380, 580 ] 385 0.009% 100.008% ( 580, 870 ] 287 0.007% 100.014% ( 870, 1300 ] 143 0.003% 100.018% ( 1300, 1900 ] 97 0.002% 100.020% ( 1900, 2900 ] 115 0.003% 100.022% ( 2900, 4400 ] 126 0.003% 100.025% ( 4400, 6600 ] 41 0.001% 100.026% ( 6600, 9900 ] 10 0.000% 100.027% ( 9900, 14000 ] 3 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 1857848 Average: 4.9656 StdDev: 82.08 Min: 0 Median: 1.6604 Max: 14809 Percentiles: P50: 1.66 P75: 2.35 P99: 8.86 P99.9: 123.12 P99.99: 437.91 ------------------------------------------------------ [ 0, 1 ] 221746 11.936% 11.936% ## ( 1, 2 ] 1070777 57.635% 69.571% ############ ( 2, 3 ] 288721 15.541% 85.112% ### ( 3, 4 ] 123664 6.656% 91.768% # ( 4, 6 ] 111262 5.989% 97.757% # ( 6, 10 ] 32295 1.738% 99.495% ( 10, 15 ] 5220 0.281% 99.776% ( 15, 22 ] 679 0.037% 99.812% ( 22, 34 ] 52 0.003% 99.815% ( 34, 51 ] 13 0.001% 99.816% ( 51, 76 ] 160 0.009% 99.825% ( 76, 110 ] 1180 0.064% 99.888% ( 110, 170 ] 1011 0.054% 99.943% ( 170, 250 ] 314 0.017% 99.959% ( 250, 380 ] 400 0.022% 99.981% ( 380, 580 ] 581 0.031% 100.012% ( 580, 870 ] 542 0.029% 100.041% ( 870, 1300 ] 371 0.020% 100.061% ( 1300, 1900 ] 245 0.013% 100.075% ( 1900, 2900 ] 277 0.015% 100.089% ( 2900, 4400 ] 356 0.019% 100.109% ( 4400, 6600 ] 116 0.006% 100.115% ( 6600, 9900 ] 23 0.001% 100.116% ( 9900, 14000 ] 2 0.000% 100.116% ( 14000, 22000 ] 1 0.000% 100.116% ** Level 2 read latency histogram (micros): Count: 95429 Average: 2.0714 StdDev: 13.75 Min: 1 Median: 1.3767 Max: 2355 Percentiles: P50: 1.38 P75: 1.78 P99: 5.31 P99.9: 9.95 P99.99: 410.47 ------------------------------------------------------ [ 0, 1 ] 25464 26.684% 26.684% ##### ( 1, 2 ] 59064 61.893% 88.577% ############ ( 2, 3 ] 6199 6.496% 95.073% # ( 3, 4 ] 2736 2.867% 97.940% # ( 4, 6 ] 1539 1.613% 99.553% ( 6, 10 ] 336 0.352% 99.905% ( 10, 15 ] 62 0.065% 99.970% ( 15, 22 ] 7 0.007% 99.977% ( 22, 34 ] 3 0.003% 99.980% ( 34, 51 ] 2 0.002% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 5 0.005% 99.990% ( 380, 580 ] 3 0.003% 99.993% ( 580, 870 ] 2 0.002% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 695529 Average: 9.0090 StdDev: 117.88 Min: 0 Median: 1.9171 Max: 17525 Percentiles: P50: 1.92 P75: 2.92 P99: 9.55 P99.9: 792.32 P99.99: 1159.40 ------------------------------------------------------ [ 0, 1 ] 17461 2.510% 2.510% # ( 1, 2 ] 360149 51.781% 54.291% ########## ( 2, 3 ] 156205 22.458% 76.749% #### ( 3, 4 ] 77474 11.139% 87.888% ## ( 4, 6 ] 67077 9.644% 97.532% ## ( 6, 10 ] 11506 1.654% 99.187% ( 10, 15 ] 2133 0.307% 99.493% ( 15, 22 ] 216 0.031% 99.524% ( 22, 34 ] 62 0.009% 99.533% ( 34, 51 ] 15 0.002% 99.535% ( 51, 76 ] 16 0.002% 99.538% ( 76, 110 ] 116 0.017% 99.554% ( 110, 170 ] 198 0.028% 99.583% ( 170, 250 ] 273 0.039% 99.622% ( 250, 380 ] 495 0.071% 99.693% ( 380, 580 ] 821 0.118% 99.811% ( 580, 870 ] 842 0.121% 99.932% ( 870, 1300 ] 595 0.086% 100.018% ( 1300, 1900 ] 292 0.042% 100.060% ( 1900, 2900 ] 243 0.035% 100.095% ( 2900, 4400 ] 270 0.039% 100.134% ( 4400, 6600 ] 62 0.009% 100.143% ( 6600, 9900 ] 9 0.001% 100.144% ( 9900, 14000 ] 1 0.000% 100.144% ( 14000, 22000 ] 2 0.000% 100.144% ** Level 4 read latency histogram (micros): Count: 60620 Average: 7.8439 StdDev: 107.61 Min: 1 Median: 1.9487 Max: 7337 Percentiles: P50: 1.95 P75: 2.99 P99: 9.78 P99.9: 1178.34 P99.99: 3482.91 ------------------------------------------------------ [ 0, 1 ] 922 1.521% 1.521% ( 1, 2 ] 30978 51.102% 52.623% ########## ( 2, 3 ] 13742 22.669% 75.292% ##### ( 3, 4 ] 6922 11.419% 86.711% ## ( 4, 6 ] 6451 10.642% 97.352% ## ( 6, 10 ] 1058 1.745% 99.098% ( 10, 15 ] 222 0.366% 99.464% ( 15, 22 ] 22 0.036% 99.500% ( 22, 34 ] 3 0.005% 99.505% ( 34, 51 ] 6 0.010% 99.515% ( 51, 76 ] 3 0.005% 99.520% ( 76, 110 ] 12 0.020% 99.540% ( 110, 170 ] 17 0.028% 99.568% ( 170, 250 ] 58 0.096% 99.663% ( 250, 380 ] 26 0.043% 99.706% ( 380, 580 ] 39 0.064% 99.771% ( 580, 870 ] 54 0.089% 99.860% ( 870, 1300 ] 34 0.056% 99.916% ( 1300, 1900 ] 20 0.033% 99.949% ( 1900, 2900 ] 16 0.026% 99.975% ( 2900, 4400 ] 23 0.038% 100.013% ( 4400, 6600 ] 2 0.003% 100.016% ( 6600, 9900 ] 3 0.005% 100.021% ** Level 5 read latency histogram (micros): Count: 280 Average: 1397.4786 StdDev: 1538.06 Min: 77 Median: 710.5000 Max: 8950 Percentiles: P50: 710.50 P75: 2361.54 P99: 6820.00 P99.9: 8950.00 P99.99: 8950.00 ------------------------------------------------------ ( 76, 110 ] 30 10.714% 10.714% ## ( 110, 170 ] 37 13.214% 23.929% ### ( 170, 250 ] 13 4.643% 28.571% # ( 250, 380 ] 26 9.286% 37.857% ## ( 380, 580 ] 25 8.929% 46.786% ## ( 580, 870 ] 20 7.143% 53.929% # ( 870, 1300 ] 23 8.214% 62.143% ## ( 1300, 1900 ] 18 6.429% 68.571% # ( 1900, 2900 ] 39 13.929% 82.500% ### ( 2900, 4400 ] 37 13.214% 95.714% ### ( 4400, 6600 ] 9 3.214% 98.929% # ( 6600, 9900 ] 3 1.071% 100.000% ** DB Stats ** Uptime(secs): 53.5 total, 3.1 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 183.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.297 H:M:S, 49.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.422 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-20:50:19 ... thread 0: (1000000,11000000) ops and (327907.2,195013.8) ops/second in (3.049643,56.406272) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/4 3.32 GB 308.3 10.6 0.0 10.6 21.0 10.4 0.0 2.0 142.4 281.3 76.51 68.87 182 0.420 11M 20K 0.0 0.0 L1 28/0 2.31 GB 236.2 10.5 6.8 3.7 10.4 6.7 0.2 1.5 215.0 212.6 50.01 45.77 5 10.002 9679K 38K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 4.5 2.0 252.3 252.2 1.50 1.44 2 0.749 383K 209 0.0 0.0 L3 18/0 954.66 MB 1.0 3.1 1.5 1.6 3.1 1.5 3.3 2.1 141.3 140.5 22.31 14.32 11 2.028 3200K 17K 0.0 0.0 L4 157/0 9.62 GB 1.0 3.8 3.2 0.7 3.8 3.1 1.6 1.2 131.3 130.6 29.95 18.14 34 0.881 3915K 18K 0.0 0.0 L5 1096/0 90.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1313/4 106.36 GB 0.0 28.4 11.6 16.8 38.6 21.9 14.1 3.7 161.5 219.5 180.28 148.55 234 0.770 28M 95K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.4 11.6 16.8 38.6 21.9 14.0 3.7 161.5 219.5 180.28 148.55 234 0.770 28M 95K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.4 11.6 16.8 28.3 11.5 0.0 0.0 198.5 197.3 146.66 121.27 85 1.725 28M 95K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.4 10.4 0.0 0.0 0.0 316.7 33.62 27.28 149 0.226 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.6 total, 56.4 interval Flush(GB): cumulative 10.397, interval 10.397 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 38.65 GB write, 699.37 MB/s write, 28.43 GB read, 514.40 MB/s read, 180.3 seconds Interval compaction: 38.65 GB write, 701.62 MB/s write, 28.43 GB read, 516.05 MB/s read, 180.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 63, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 63, interval: 86 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4611002 Average: 2.6882 StdDev: 33.65 Min: 0 Median: 1.5100 Max: 13337 Percentiles: P50: 1.51 P75: 1.90 P99: 5.98 P99.9: 80.36 P99.99: 256.73 ------------------------------------------------------ [ 0, 1 ] 789606 17.124% 17.124% ### ( 1, 2 ] 2972209 64.459% 81.583% ############# ( 2, 3 ] 503269 10.915% 92.498% ## ( 3, 4 ] 176000 3.817% 96.315% # ( 4, 6 ] 125031 2.712% 99.027% # ( 6, 10 ] 33342 0.723% 99.750% ( 10, 15 ] 5780 0.125% 99.875% ( 15, 22 ] 704 0.015% 99.890% ( 22, 34 ] 66 0.001% 99.892% ( 34, 51 ] 26 0.001% 99.892% ( 51, 76 ] 93 0.002% 99.894% ( 76, 110 ] 2075 0.045% 99.939% ( 110, 170 ] 1772 0.038% 99.978% ( 170, 250 ] 545 0.012% 99.990% ( 250, 380 ] 462 0.010% 100.000% ( 380, 580 ] 390 0.008% 100.008% ( 580, 870 ] 294 0.006% 100.014% ( 870, 1300 ] 149 0.003% 100.018% ( 1300, 1900 ] 98 0.002% 100.020% ( 1900, 2900 ] 116 0.003% 100.022% ( 2900, 4400 ] 127 0.003% 100.025% ( 4400, 6600 ] 41 0.001% 100.026% ( 6600, 9900 ] 10 0.000% 100.026% ( 9900, 14000 ] 3 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 1932511 Average: 4.9054 StdDev: 80.65 Min: 0 Median: 1.6564 Max: 14809 Percentiles: P50: 1.66 P75: 2.33 P99: 8.86 P99.9: 128.89 P99.99: 455.62 ------------------------------------------------------ [ 0, 1 ] 229443 11.873% 11.873% ## ( 1, 2 ] 1122462 58.083% 69.956% ############ ( 2, 3 ] 298097 15.425% 85.381% ### ( 3, 4 ] 126255 6.533% 91.914% # ( 4, 6 ] 112901 5.842% 97.757% # ( 6, 10 ] 33579 1.738% 99.494% ( 10, 15 ] 5305 0.275% 99.769% ( 15, 22 ] 690 0.036% 99.804% ( 22, 34 ] 52 0.003% 99.807% ( 34, 51 ] 14 0.001% 99.808% ( 51, 76 ] 164 0.008% 99.816% ( 76, 110 ] 1272 0.066% 99.882% ( 110, 170 ] 1094 0.057% 99.939% ( 170, 250 ] 338 0.017% 99.956% ( 250, 380 ] 423 0.022% 99.978% ( 380, 580 ] 605 0.031% 100.009% ( 580, 870 ] 556 0.029% 100.038% ( 870, 1300 ] 395 0.020% 100.059% ( 1300, 1900 ] 251 0.013% 100.072% ( 1900, 2900 ] 277 0.014% 100.086% ( 2900, 4400 ] 356 0.018% 100.104% ( 4400, 6600 ] 116 0.006% 100.110% ( 6600, 9900 ] 23 0.001% 100.112% ( 9900, 14000 ] 2 0.000% 100.112% ( 14000, 22000 ] 1 0.000% 100.112% ** Level 2 read latency histogram (micros): Count: 95429 Average: 2.0714 StdDev: 13.75 Min: 1 Median: 1.3767 Max: 2355 Percentiles: P50: 1.38 P75: 1.78 P99: 5.31 P99.9: 9.95 P99.99: 410.47 ------------------------------------------------------ [ 0, 1 ] 25464 26.684% 26.684% ##### ( 1, 2 ] 59064 61.893% 88.577% ############ ( 2, 3 ] 6199 6.496% 95.073% # ( 3, 4 ] 2736 2.867% 97.940% # ( 4, 6 ] 1539 1.613% 99.553% ( 6, 10 ] 336 0.352% 99.905% ( 10, 15 ] 62 0.065% 99.970% ( 15, 22 ] 7 0.007% 99.977% ( 22, 34 ] 3 0.003% 99.980% ( 34, 51 ] 2 0.002% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 250, 380 ] 5 0.005% 99.990% ( 380, 580 ] 3 0.003% 99.993% ( 580, 870 ] 2 0.002% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 695529 Average: 9.0090 StdDev: 117.88 Min: 0 Median: 1.9171 Max: 17525 Percentiles: P50: 1.92 P75: 2.92 P99: 9.55 P99.9: 792.32 P99.99: 1159.40 ------------------------------------------------------ [ 0, 1 ] 17461 2.510% 2.510% # ( 1, 2 ] 360149 51.781% 54.291% ########## ( 2, 3 ] 156205 22.458% 76.749% #### ( 3, 4 ] 77474 11.139% 87.888% ## ( 4, 6 ] 67077 9.644% 97.532% ## ( 6, 10 ] 11506 1.654% 99.187% ( 10, 15 ] 2133 0.307% 99.493% ( 15, 22 ] 216 0.031% 99.524% ( 22, 34 ] 62 0.009% 99.533% ( 34, 51 ] 15 0.002% 99.535% ( 51, 76 ] 16 0.002% 99.538% ( 76, 110 ] 116 0.017% 99.554% ( 110, 170 ] 198 0.028% 99.583% ( 170, 250 ] 273 0.039% 99.622% ( 250, 380 ] 495 0.071% 99.693% ( 380, 580 ] 821 0.118% 99.811% ( 580, 870 ] 842 0.121% 99.932% ( 870, 1300 ] 595 0.086% 100.018% ( 1300, 1900 ] 292 0.042% 100.060% ( 1900, 2900 ] 243 0.035% 100.095% ( 2900, 4400 ] 270 0.039% 100.134% ( 4400, 6600 ] 62 0.009% 100.143% ( 6600, 9900 ] 9 0.001% 100.144% ( 9900, 14000 ] 1 0.000% 100.144% ( 14000, 22000 ] 2 0.000% 100.144% ** Level 4 read latency histogram (micros): Count: 60620 Average: 7.8439 StdDev: 107.61 Min: 1 Median: 1.9487 Max: 7337 Percentiles: P50: 1.95 P75: 2.99 P99: 9.78 P99.9: 1178.34 P99.99: 3482.91 ------------------------------------------------------ [ 0, 1 ] 922 1.521% 1.521% ( 1, 2 ] 30978 51.102% 52.623% ########## ( 2, 3 ] 13742 22.669% 75.292% ##### ( 3, 4 ] 6922 11.419% 86.711% ## ( 4, 6 ] 6451 10.642% 97.352% ## ( 6, 10 ] 1058 1.745% 99.098% ( 10, 15 ] 222 0.366% 99.464% ( 15, 22 ] 22 0.036% 99.500% ( 22, 34 ] 3 0.005% 99.505% ( 34, 51 ] 6 0.010% 99.515% ( 51, 76 ] 3 0.005% 99.520% ( 76, 110 ] 12 0.020% 99.540% ( 110, 170 ] 17 0.028% 99.568% ( 170, 250 ] 58 0.096% 99.663% ( 250, 380 ] 26 0.043% 99.706% ( 380, 580 ] 39 0.064% 99.771% ( 580, 870 ] 54 0.089% 99.860% ( 870, 1300 ] 34 0.056% 99.916% ( 1300, 1900 ] 20 0.033% 99.949% ( 1900, 2900 ] 16 0.026% 99.975% ( 2900, 4400 ] 23 0.038% 100.013% ( 4400, 6600 ] 2 0.003% 100.016% ( 6600, 9900 ] 3 0.005% 100.021% ** Level 5 read latency histogram (micros): Count: 280 Average: 1397.4786 StdDev: 1538.06 Min: 77 Median: 710.5000 Max: 8950 Percentiles: P50: 710.50 P75: 2361.54 P99: 6820.00 P99.9: 8950.00 P99.99: 8950.00 ------------------------------------------------------ ( 76, 110 ] 30 10.714% 10.714% ## ( 110, 170 ] 37 13.214% 23.929% ### ( 170, 250 ] 13 4.643% 28.571% # ( 250, 380 ] 26 9.286% 37.857% ## ( 380, 580 ] 25 8.929% 46.786% ## ( 580, 870 ] 20 7.143% 53.929% # ( 870, 1300 ] 23 8.214% 62.143% ## ( 1300, 1900 ] 18 6.429% 68.571% # ( 1900, 2900 ] 39 13.929% 82.500% ### ( 2900, 4400 ] 37 13.214% 95.714% ### ( 4400, 6600 ] 9 3.214% 98.929% # ( 6600, 9900 ] 3 1.071% 100.000% ** DB Stats ** Uptime(secs): 56.6 total, 3.0 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 191.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.702 H:M:S, 47.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.405 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.411 micros/op 184823 ops/sec 60.036 seconds 11095999 operations; 179.1 MB/s Microseconds per write: Count: 11095999 Average: 5.4106 StdDev: 496.94 Min: 1 Median: 1.7453 Max: 959897 Percentiles: P50: 1.75 P75: 2.73 P99: 5.99 P99.9: 1088.12 P99.99: 2706.26 ------------------------------------------------------ [ 0, 1 ] 1372985 12.374% 12.374% ## ( 1, 2 ] 5602140 50.488% 62.862% ########## ( 2, 3 ] 1837408 16.559% 79.421% ### ( 3, 4 ] 1571918 14.167% 93.587% ### ( 4, 6 ] 603500 5.439% 99.026% # ( 6, 10 ] 58866 0.531% 99.557% ( 10, 15 ] 13090 0.118% 99.675% ( 15, 22 ] 5909 0.053% 99.728% ( 22, 34 ] 1697 0.015% 99.743% ( 34, 51 ] 179 0.002% 99.745% ( 51, 76 ] 24 0.000% 99.745% ( 76, 110 ] 7570 0.068% 99.813% ( 110, 170 ] 3345 0.030% 99.843% ( 170, 250 ] 316 0.003% 99.846% ( 250, 380 ] 69 0.001% 99.847% ( 380, 580 ] 26 0.000% 99.847% ( 580, 870 ] 27 0.000% 99.847% ( 870, 1300 ] 11501 0.104% 99.951% ( 1300, 1900 ] 18 0.000% 99.951% ( 1900, 2900 ] 5335 0.048% 99.999% ( 2900, 4400 ] 36 0.000% 100.000% ( 4400, 6600 ] 3 0.000% 100.000% ( 6600, 9900 ] 6 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 18 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 192702 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11095999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11451070968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 556 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30023853 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31484286154 rocksdb.compact.write.bytes COUNT : 31283751665 rocksdb.flush.write.bytes COUNT : 11427674757 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 63 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 340 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11335749632 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4609024 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31589864704 rocksdb.non.last.level.read.count COUNT : 7626669 rocksdb.block.checksum.compute.count COUNT : 7625620 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.413366 P95 : 3.827935 P99 : 5.806043 P100 : 959895.000000 COUNT : 11095999 SUM : 55132096 rocksdb.compaction.times.micros P50 : 1171666.666667 P95 : 5070000.000000 P99 : 15120000.000000 P100 : 17994333.000000 COUNT : 86 SUM : 147836907 rocksdb.compaction.times.cpu_micros P50 : 939333.333333 P95 : 5070000.000000 P99 : 15120000.000000 P100 : 17047728.000000 COUNT : 86 SUM : 122430914 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 689.176471 P95 : 7040.000000 P99 : 189200.000000 P100 : 243227.000000 COUNT : 152 SUM : 627805 rocksdb.compaction.outfile.sync.micros P50 : 1088.257576 P95 : 191000.000000 P99 : 325237.500000 P100 : 341480.000000 COUNT : 337 SUM : 8450884 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 109.182692 P95 : 1714.000000 P99 : 4612.666667 P100 : 5267.000000 COUNT : 271 SUM : 95463 rocksdb.table.open.io.micros P50 : 1619.148936 P95 : 8537.419355 P99 : 13418.545455 P100 : 21003.000000 COUNT : 556 SUM : 1321187 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.604390 P95 : 7.303919 P99 : 9.983650 P100 : 17529.000000 COUNT : 7623968 SUM : 44976399 rocksdb.read.block.get.micros P50 : 548.181818 P95 : 3740.000000 P99 : 5988.000000 P100 : 9035.000000 COUNT : 1112 SUM : 1062372 rocksdb.write.raw.block.micros P50 : 0.512414 P95 : 0.973587 P99 : 2.864827 P100 : 23189.000000 COUNT : 10344200 SUM : 21088274 rocksdb.numfiles.in.singlecompaction P50 : 3.306818 P95 : 5.450000 P99 : 28.960000 P100 : 42.000000 COUNT : 142 SUM : 577 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.556470 P95 : 1188.961291 P99 : 2593.379297 P100 : 959715.000000 COUNT : 166025 SUM : 30030984 rocksdb.sst.read.micros P50 : 1.569882 P95 : 4.313187 P99 : 7.853839 P100 : 17525.000000 COUNT : 7626786 SUM : 29749127 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11095999 SUM : 11451070968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214190.476190 P95 : 418000.000000 P99 : 941600.000000 P100 : 1094369.000000 COUNT : 152 SUM : 34282885 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 342 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0