[2024-11-06 15:16:20.071048] Starting SPDK v25.01-pre git sha1 d1c46ed8e / DPDK 24.03.0 initialization... [2024-11-06 15:16:20.071369] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2659965 ] Set seed to 1730902580062882 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-06 15:16:20.219274] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-06 15:16:20.327549] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-06 15:16:20.327601] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2659965' to capture a snapshot of events at runtime. [2024-11-06 15:16:20.327614] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-06 15:16:20.327628] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-06 15:16:20.327639] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2659965 for offline analysis/debug. [2024-11-06 15:16:20.328990] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 6 15:16:25 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/06-15:16:28 ... thread 0: (1000000,1000000) ops and (324956.6,324956.6) ops/second in (3.077334,3.077334) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 693.02 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 352.5 2.50 2.33 13 0.192 0 0 0.0 0.0 L2 3/2 237.33 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 252.2 252.0 1.38 1.35 2 0.692 354K 166 0.0 0.0 L3 11/0 881.90 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1060/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1201/11 97.00 GB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 89.8 316.7 3.89 3.68 15 0.259 354K 166 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 89.8 316.7 3.89 3.68 15 0.259 354K 166 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 252.2 252.0 1.38 1.35 2 0.692 354K 166 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 352.5 2.50 2.33 13 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.3 total, 3.1 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.20 GB write, 373.95 MB/s write, 0.34 GB read, 106.04 MB/s read, 3.9 seconds Interval compaction: 1.20 GB write, 399.80 MB/s write, 0.34 GB read, 113.36 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 148825 Average: 2.1033 StdDev: 6.05 Min: 0 Median: 1.4396 Max: 1760 Percentiles: P50: 1.44 P75: 1.84 P99: 5.70 P99.9: 9.94 P99.99: 15.49 ------------------------------------------------------ [ 0, 1 ] 33591 22.571% 22.571% ##### ( 1, 2 ] 92863 62.397% 84.968% ############ ( 2, 3 ] 13373 8.986% 93.954% ## ( 3, 4 ] 4724 3.174% 97.128% # ( 4, 6 ] 3279 2.203% 99.331% ( 6, 10 ] 860 0.578% 99.909% ( 10, 15 ] 120 0.081% 99.990% ( 15, 22 ] 16 0.011% 100.001% ( 22, 34 ] 5 0.003% 100.004% ( 51, 76 ] 2 0.001% 100.005% ( 170, 250 ] 12 0.008% 100.013% ( 250, 380 ] 11 0.007% 100.021% ( 380, 580 ] 2 0.001% 100.022% ( 1300, 1900 ] 1 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 12329 Average: 2.9053 StdDev: 37.74 Min: 1 Median: 1.1599 Max: 3283 Percentiles: P50: 1.16 P75: 1.65 P99: 10.17 P99.9: 159.18 P99.99: 2667.10 ------------------------------------------------------ [ 0, 1 ] 5151 41.780% 41.780% ######## ( 1, 2 ] 6339 51.415% 93.195% ########## ( 2, 3 ] 365 2.960% 96.155% # ( 3, 4 ] 124 1.006% 97.161% ( 4, 6 ] 109 0.884% 98.045% ( 6, 10 ] 116 0.941% 98.986% ( 10, 15 ] 50 0.406% 99.392% ( 15, 22 ] 6 0.049% 99.440% ( 76, 110 ] 37 0.300% 99.740% ( 110, 170 ] 24 0.195% 99.935% ( 170, 250 ] 5 0.041% 99.976% ( 380, 580 ] 1 0.008% 99.984% ( 1900, 2900 ] 1 0.008% 99.992% ( 2900, 4400 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 69508 Average: 2.1526 StdDev: 3.98 Min: 1 Median: 1.4724 Max: 641 Percentiles: P50: 1.47 P75: 1.86 P99: 5.98 P99.9: 13.34 P99.99: 210.66 ------------------------------------------------------ [ 0, 1 ] 13829 19.896% 19.896% #### ( 1, 2 ] 44291 63.721% 83.616% ############# ( 2, 3 ] 6719 9.667% 93.283% ## ( 3, 4 ] 2392 3.441% 96.724% # ( 4, 6 ] 1597 2.298% 99.022% ( 6, 10 ] 528 0.760% 99.781% ( 10, 15 ] 125 0.180% 99.961% ( 15, 22 ] 14 0.020% 99.981% ( 22, 34 ] 1 0.001% 99.983% ( 34, 51 ] 2 0.003% 99.986% ( 76, 110 ] 1 0.001% 99.987% ( 170, 250 ] 6 0.009% 99.996% ( 250, 380 ] 2 0.003% 99.999% ( 380, 580 ] 1 0.001% 100.000% ( 580, 870 ] 1 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 55 Average: 2623.9091 StdDev: 1974.43 Min: 169 Median: 2288.8889 Max: 7214 Percentiles: P50: 2288.89 P75: 4025.00 P99: 7214.00 P99.9: 7214.00 P99.99: 7214.00 ------------------------------------------------------ ( 110, 170 ] 1 1.818% 1.818% ( 170, 250 ] 3 5.455% 7.273% # ( 250, 380 ] 3 5.455% 12.727% # ( 380, 580 ] 4 7.273% 20.000% # ( 870, 1300 ] 8 14.545% 34.545% ### ( 1300, 1900 ] 5 9.091% 43.636% ## ( 1900, 2900 ] 9 16.364% 60.000% ### ( 2900, 4400 ] 11 20.000% 80.000% #### ( 4400, 6600 ] 8 14.545% 94.545% ### ( 6600, 9900 ] 3 5.455% 100.000% # ** Level 4 read latency histogram (micros): Count: 20 Average: 3461.3500 StdDev: 2068.28 Min: 306 Median: 3200.0000 Max: 7681 Percentiles: P50: 3200.00 P75: 4840.00 P99: 7681.00 P99.9: 7681.00 P99.99: 7681.00 ------------------------------------------------------ ( 250, 380 ] 1 5.000% 5.000% # ( 870, 1300 ] 3 15.000% 20.000% ### ( 1300, 1900 ] 1 5.000% 25.000% # ( 1900, 2900 ] 4 20.000% 45.000% #### ( 2900, 4400 ] 5 25.000% 70.000% ##### ( 4400, 6600 ] 5 25.000% 95.000% ##### ( 6600, 9900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.3 total, 3.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 299.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.204 H:M:S, 6.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.204 H:M:S, 6.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/06-15:16:31 ... thread 0: (1000000,2000000) ops and (335941.6,330357.8) ops/second in (2.976708,6.054042) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 1.29 GB 107.0 1.0 0.0 1.0 2.8 1.8 0.0 1.6 109.1 306.8 9.24 8.70 32 0.289 1023K 938 0.0 0.0 L1 1/0 3.04 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 237.2 236.9 1.33 1.30 1 1.328 319K 396 0.0 0.0 L2 2/1 147.23 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 252.2 252.0 1.38 1.35 2 0.692 354K 166 0.0 0.0 L3 20/11 1.09 GB 0.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 226.9 226.9 0.82 0.79 1 0.825 190K 0 0.0 0.0 L4 173/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 171.5 171.6 0.98 0.86 1 0.981 170K 0 0.0 0.0 L5 1060/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1265/16 97.92 GB 0.0 2.0 0.8 1.1 3.8 2.6 0.7 2.1 147.4 280.1 13.75 13.01 37 0.372 2058K 1500 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 0.8 1.1 3.8 2.6 0.7 2.1 147.4 280.1 13.75 13.01 37 0.372 2058K 1500 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 0.8 1.1 2.0 0.8 0.0 0.0 236.2 236.0 8.58 8.26 9 0.954 2058K 1500 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.4 5.17 4.75 28 0.185 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.3 total, 6.1 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.76 GB write, 614.69 MB/s write, 1.98 GB read, 323.47 MB/s read, 13.8 seconds Interval compaction: 3.76 GB write, 636.30 MB/s write, 1.98 GB read, 334.84 MB/s read, 13.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 406182 Average: 2.3566 StdDev: 7.11 Min: 0 Median: 1.5833 Max: 1760 Percentiles: P50: 1.58 P75: 1.98 P99: 6.33 P99.9: 13.17 P99.99: 19.70 ------------------------------------------------------ [ 0, 1 ] 52181 12.847% 12.847% ### ( 1, 2 ] 258697 63.690% 76.537% ############# ( 2, 3 ] 59490 14.646% 91.183% ### ( 3, 4 ] 18351 4.518% 95.701% # ( 4, 6 ] 13125 3.231% 98.932% # ( 6, 10 ] 3398 0.837% 99.769% ( 10, 15 ] 843 0.208% 99.976% ( 15, 22 ] 84 0.021% 99.997% ( 22, 34 ] 25 0.006% 100.003% ( 34, 51 ] 2 0.000% 100.003% ( 51, 76 ] 6 0.001% 100.005% ( 170, 250 ] 25 0.006% 100.011% ( 250, 380 ] 19 0.005% 100.016% ( 380, 580 ] 11 0.003% 100.018% ( 580, 870 ] 1 0.000% 100.019% ( 870, 1300 ] 4 0.001% 100.020% ( 1300, 1900 ] 4 0.001% 100.021% ** Level 1 read latency histogram (micros): Count: 12349 Average: 3.1156 StdDev: 39.12 Min: 1 Median: 1.1606 Max: 3283 Percentiles: P50: 1.16 P75: 1.65 P99: 10.75 P99.9: 192.01 P99.99: 2665.10 ------------------------------------------------------ [ 0, 1 ] 5155 41.744% 41.744% ######## ( 1, 2 ] 6347 51.397% 93.141% ########## ( 2, 3 ] 366 2.964% 96.105% # ( 3, 4 ] 125 1.012% 97.117% ( 4, 6 ] 109 0.883% 98.000% ( 6, 10 ] 116 0.939% 98.939% ( 10, 15 ] 50 0.405% 99.344% ( 15, 22 ] 6 0.049% 99.393% ( 76, 110 ] 37 0.300% 99.692% ( 110, 170 ] 24 0.194% 99.887% ( 170, 250 ] 6 0.049% 99.935% ( 250, 380 ] 2 0.016% 99.951% ( 380, 580 ] 2 0.016% 99.968% ( 580, 870 ] 2 0.016% 99.984% ( 1900, 2900 ] 1 0.008% 99.992% ( 2900, 4400 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 76161 Average: 2.1859 StdDev: 3.82 Min: 1 Median: 1.4956 Max: 641 Percentiles: P50: 1.50 P75: 1.89 P99: 5.99 P99.9: 13.25 P99.99: 201.79 ------------------------------------------------------ [ 0, 1 ] 14068 18.471% 18.471% #### ( 1, 2 ] 48449 63.614% 82.085% ############# ( 2, 3 ] 8164 10.719% 92.805% ## ( 3, 4 ] 2829 3.714% 96.519% # ( 4, 6 ] 1900 2.495% 99.014% ( 6, 10 ] 587 0.771% 99.785% ( 10, 15 ] 135 0.177% 99.962% ( 15, 22 ] 15 0.020% 99.982% ( 22, 34 ] 1 0.001% 99.983% ( 34, 51 ] 2 0.003% 99.986% ( 76, 110 ] 1 0.001% 99.987% ( 170, 250 ] 6 0.008% 99.995% ( 250, 380 ] 2 0.003% 99.997% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 210301 Average: 3.3923 StdDev: 53.39 Min: 0 Median: 1.6610 Max: 7214 Percentiles: P50: 1.66 P75: 2.19 P99: 9.26 P99.9: 84.46 P99.99: 336.34 ------------------------------------------------------ [ 0, 1 ] 15575 7.406% 7.406% # ( 1, 2 ] 135519 64.440% 71.847% ############# ( 2, 3 ] 34630 16.467% 88.313% ### ( 3, 4 ] 10693 5.085% 93.398% # ( 4, 6 ] 8525 4.054% 97.452% # ( 6, 10 ] 3993 1.899% 99.350% ( 10, 15 ] 689 0.328% 99.678% ( 15, 22 ] 66 0.031% 99.709% ( 22, 34 ] 6 0.003% 99.712% ( 34, 51 ] 282 0.134% 99.846% ( 51, 76 ] 101 0.048% 99.894% ( 76, 110 ] 47 0.022% 99.917% ( 110, 170 ] 103 0.049% 99.966% ( 170, 250 ] 43 0.020% 99.986% ( 250, 380 ] 12 0.006% 99.992% ( 380, 580 ] 5 0.002% 99.994% ( 580, 870 ] 3 0.001% 99.996% ( 870, 1300 ] 8 0.004% 100.000% ( 1300, 1900 ] 5 0.002% 100.002% ( 1900, 2900 ] 9 0.004% 100.006% ( 2900, 4400 ] 11 0.005% 100.011% ( 4400, 6600 ] 8 0.004% 100.015% ( 6600, 9900 ] 3 0.001% 100.017% ** Level 4 read latency histogram (micros): Count: 305 Average: 233.8230 StdDev: 1005.97 Min: 1 Median: 2.0091 Max: 7681 Percentiles: P50: 2.01 P75: 6.58 P99: 5698.00 P99.9: 7681.00 P99.99: 7681.00 ------------------------------------------------------ [ 0, 1 ] 49 16.066% 16.066% ### ( 1, 2 ] 103 33.770% 49.836% ####### ( 2, 3 ] 55 18.033% 67.869% #### ( 3, 4 ] 10 3.279% 71.148% # ( 4, 6 ] 9 2.951% 74.098% # ( 6, 10 ] 19 6.230% 80.328% # ( 10, 15 ] 29 9.508% 89.836% ## ( 15, 22 ] 4 1.311% 91.148% ( 110, 170 ] 6 1.967% 93.115% ( 170, 250 ] 1 0.328% 93.443% ( 250, 380 ] 1 0.328% 93.770% ( 870, 1300 ] 3 0.984% 94.754% ( 1300, 1900 ] 1 0.328% 95.082% ( 1900, 2900 ] 4 1.311% 96.393% ( 2900, 4400 ] 5 1.639% 98.033% ( 4400, 6600 ] 5 1.639% 99.672% ( 6600, 9900 ] 1 0.328% 100.000% ** DB Stats ** Uptime(secs): 6.3 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 314.02 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.204 H:M:S, 3.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.63 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/06-15:16:34 ... thread 0: (1000000,3000000) ops and (347227.4,335795.9) ops/second in (2.879957,8.933999) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.27 GB 207.7 2.0 0.0 2.0 4.7 2.8 0.0 1.7 127.0 305.5 15.87 15.06 52 0.305 2046K 1981 0.0 0.0 L1 1/0 3.04 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 237.2 236.9 1.33 1.30 1 1.328 319K 396 0.0 0.0 L2 1/0 97.09 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 252.2 252.0 1.38 1.35 2 0.692 354K 166 0.0 0.0 L3 20/0 906.16 MB 0.9 1.1 0.2 0.9 1.1 0.2 0.2 4.7 241.3 241.0 4.64 4.47 2 2.319 1136K 1640 0.0 0.0 L4 173/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 171.5 171.6 0.98 0.86 1 0.981 170K 0 0.0 0.0 L5 1064/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1272/4 98.90 GB 0.0 3.9 0.9 3.0 6.6 3.7 1.3 2.4 163.9 280.9 24.20 23.04 58 0.417 4029K 4183 0.0 0.0 Int 0/0 0.00 KB 0.0 3.9 0.9 3.0 6.6 3.7 1.3 2.4 163.9 280.9 24.20 23.04 58 0.417 4029K 4183 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.9 0.9 3.0 3.9 0.9 0.0 0.0 243.2 242.9 16.31 15.78 14 1.165 4029K 4183 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 359.3 7.89 7.26 44 0.179 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.64 GB write, 743.15 MB/s write, 3.87 GB read, 433.72 MB/s read, 24.2 seconds Interval compaction: 6.64 GB write, 760.85 MB/s write, 3.87 GB read, 444.05 MB/s read, 24.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 652340 Average: 2.2845 StdDev: 6.86 Min: 0 Median: 1.5454 Max: 1760 Percentiles: P50: 1.55 P75: 1.93 P99: 5.98 P99.9: 12.95 P99.99: 19.22 ------------------------------------------------------ [ 0, 1 ] 97513 14.948% 14.948% ### ( 1, 2 ] 419256 64.270% 79.218% ############# ( 2, 3 ] 86283 13.227% 92.444% ### ( 3, 4 ] 25219 3.866% 96.310% # ( 4, 6 ] 17716 2.716% 99.026% # ( 6, 10 ] 4950 0.759% 99.785% ( 10, 15 ] 1273 0.195% 99.980% ( 15, 22 ] 109 0.017% 99.997% ( 22, 34 ] 33 0.005% 100.002% ( 34, 51 ] 3 0.000% 100.002% ( 51, 76 ] 10 0.002% 100.004% ( 170, 250 ] 40 0.006% 100.010% ( 250, 380 ] 31 0.005% 100.015% ( 380, 580 ] 18 0.003% 100.017% ( 580, 870 ] 4 0.001% 100.018% ( 870, 1300 ] 6 0.001% 100.019% ( 1300, 1900 ] 5 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 12349 Average: 3.1156 StdDev: 39.12 Min: 1 Median: 1.1606 Max: 3283 Percentiles: P50: 1.16 P75: 1.65 P99: 10.75 P99.9: 192.01 P99.99: 2665.10 ------------------------------------------------------ [ 0, 1 ] 5155 41.744% 41.744% ######## ( 1, 2 ] 6347 51.397% 93.141% ########## ( 2, 3 ] 366 2.964% 96.105% # ( 3, 4 ] 125 1.012% 97.117% ( 4, 6 ] 109 0.883% 98.000% ( 6, 10 ] 116 0.939% 98.939% ( 10, 15 ] 50 0.405% 99.344% ( 15, 22 ] 6 0.049% 99.393% ( 76, 110 ] 37 0.300% 99.692% ( 110, 170 ] 24 0.194% 99.887% ( 170, 250 ] 6 0.049% 99.935% ( 250, 380 ] 2 0.016% 99.951% ( 380, 580 ] 2 0.016% 99.968% ( 580, 870 ] 2 0.016% 99.984% ( 1900, 2900 ] 1 0.008% 99.992% ( 2900, 4400 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 88588 Average: 2.1989 StdDev: 3.56 Min: 1 Median: 1.5111 Max: 641 Percentiles: P50: 1.51 P75: 1.90 P99: 5.98 P99.9: 13.42 P99.99: 185.22 ------------------------------------------------------ [ 0, 1 ] 15277 17.245% 17.245% ### ( 1, 2 ] 56773 64.087% 81.332% ############# ( 2, 3 ] 10237 11.556% 92.887% ## ( 3, 4 ] 3280 3.703% 96.590% # ( 4, 6 ] 2158 2.436% 99.026% ( 6, 10 ] 650 0.734% 99.760% ( 10, 15 ] 182 0.205% 99.965% ( 15, 22 ] 17 0.019% 99.984% ( 22, 34 ] 1 0.001% 99.985% ( 34, 51 ] 2 0.002% 99.988% ( 76, 110 ] 1 0.001% 99.989% ( 170, 250 ] 6 0.007% 99.995% ( 250, 380 ] 2 0.002% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 266782 Average: 3.2590 StdDev: 47.59 Min: 0 Median: 1.6507 Max: 7214 Percentiles: P50: 1.65 P75: 2.15 P99: 9.28 P99.9: 102.50 P99.99: 363.51 ------------------------------------------------------ [ 0, 1 ] 20926 7.844% 7.844% ## ( 1, 2 ] 172825 64.781% 72.625% ############# ( 2, 3 ] 43272 16.220% 88.845% ### ( 3, 4 ] 12775 4.789% 93.634% # ( 4, 6 ] 10126 3.796% 97.429% # ( 6, 10 ] 5107 1.914% 99.344% ( 10, 15 ] 910 0.341% 99.685% ( 15, 22 ] 73 0.027% 99.712% ( 22, 34 ] 6 0.002% 99.714% ( 34, 51 ] 325 0.122% 99.836% ( 51, 76 ] 118 0.044% 99.880% ( 76, 110 ] 67 0.025% 99.906% ( 110, 170 ] 137 0.051% 99.957% ( 170, 250 ] 63 0.024% 99.981% ( 250, 380 ] 29 0.011% 99.991% ( 380, 580 ] 11 0.004% 99.996% ( 580, 870 ] 3 0.001% 99.997% ( 870, 1300 ] 8 0.003% 100.000% ( 1300, 1900 ] 5 0.002% 100.001% ( 1900, 2900 ] 9 0.003% 100.005% ( 2900, 4400 ] 11 0.004% 100.009% ( 4400, 6600 ] 8 0.003% 100.012% ( 6600, 9900 ] 3 0.001% 100.013% ** Level 4 read latency histogram (micros): Count: 305 Average: 233.8230 StdDev: 1005.97 Min: 1 Median: 2.0091 Max: 7681 Percentiles: P50: 2.01 P75: 6.58 P99: 5698.00 P99.9: 7681.00 P99.99: 7681.00 ------------------------------------------------------ [ 0, 1 ] 49 16.066% 16.066% ### ( 1, 2 ] 103 33.770% 49.836% ####### ( 2, 3 ] 55 18.033% 67.869% #### ( 3, 4 ] 10 3.279% 71.148% # ( 4, 6 ] 9 2.951% 74.098% # ( 6, 10 ] 19 6.230% 80.328% # ( 10, 15 ] 29 9.508% 89.836% ## ( 15, 22 ] 4 1.311% 91.148% ( 110, 170 ] 6 1.967% 93.115% ( 170, 250 ] 1 0.328% 93.443% ( 250, 380 ] 1 0.328% 93.770% ( 870, 1300 ] 3 0.984% 94.754% ( 1300, 1900 ] 1 0.328% 95.082% ( 1900, 2900 ] 4 1.311% 96.393% ( 2900, 4400 ] 5 1.639% 98.033% ( 4400, 6600 ] 5 1.639% 99.672% ( 6600, 9900 ] 1 0.328% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 428.1500 StdDev: 415.16 Min: 110 Median: 271.6667 Max: 1786 Percentiles: P50: 271.67 P75: 380.00 P99: 1780.00 P99.9: 1786.00 P99.99: 1786.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 5 25.000% 30.000% ##### ( 170, 250 ] 3 15.000% 45.000% ### ( 250, 380 ] 6 30.000% 75.000% ###### ( 380, 580 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 322.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.204 H:M:S, 2.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 341.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/06-15:16:37 ... thread 0: (1000000,4000000) ops and (352673.5,339862.0) ops/second in (2.835484,11.769483) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/8 3.20 GB 276.9 2.7 0.0 2.7 6.4 3.7 0.0 1.7 130.2 307.7 21.29 20.23 70 0.304 2814K 2691 0.0 0.0 L1 1/0 3.04 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 237.2 236.9 1.33 1.30 1 1.328 319K 396 0.0 0.0 L2 1/0 97.09 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 252.2 252.0 1.38 1.35 2 0.692 354K 166 0.0 0.0 L3 20/0 906.16 MB 0.9 1.1 0.2 0.9 1.1 0.2 0.2 4.7 241.3 241.0 4.64 4.47 2 2.319 1136K 1640 0.0 0.0 L4 173/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 171.5 171.6 0.98 0.86 1 0.981 170K 0 0.0 0.0 L5 1064/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1278/8 99.82 GB 0.0 4.6 0.9 3.7 8.3 4.6 1.3 2.2 159.5 287.0 29.62 28.22 76 0.390 4796K 4893 0.0 0.0 Int 0/0 0.00 KB 0.0 4.6 0.9 3.7 8.3 4.6 1.3 2.2 159.5 287.0 29.62 28.22 76 0.390 4796K 4893 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.6 0.9 3.7 4.6 0.9 0.0 0.0 245.5 245.2 19.24 18.65 17 1.132 4796K 4893 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 364.4 10.37 9.57 59 0.176 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.8 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.30 GB write, 709.18 MB/s write, 4.61 GB read, 394.18 MB/s read, 29.6 seconds Interval compaction: 8.30 GB write, 722.01 MB/s write, 4.61 GB read, 401.30 MB/s read, 29.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 892266 Average: 2.2125 StdDev: 6.46 Min: 0 Median: 1.5089 Max: 1760 Percentiles: P50: 1.51 P75: 1.90 P99: 5.88 P99.9: 12.61 P99.99: 18.96 ------------------------------------------------------ [ 0, 1 ] 152625 17.105% 17.105% ### ( 1, 2 ] 576738 64.637% 81.743% ############# ( 2, 3 ] 104572 11.720% 93.463% ## ( 3, 4 ] 30223 3.387% 96.850% # ( 4, 6 ] 20465 2.294% 99.143% ( 6, 10 ] 5956 0.668% 99.811% ( 10, 15 ] 1529 0.171% 99.982% ( 15, 22 ] 125 0.014% 99.996% ( 22, 34 ] 38 0.004% 100.001% ( 34, 51 ] 4 0.000% 100.001% ( 51, 76 ] 14 0.002% 100.003% ( 170, 250 ] 55 0.006% 100.009% ( 250, 380 ] 45 0.005% 100.014% ( 380, 580 ] 21 0.002% 100.016% ( 580, 870 ] 5 0.001% 100.017% ( 870, 1300 ] 9 0.001% 100.018% ( 1300, 1900 ] 5 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 12349 Average: 3.1156 StdDev: 39.12 Min: 1 Median: 1.1606 Max: 3283 Percentiles: P50: 1.16 P75: 1.65 P99: 10.75 P99.9: 192.01 P99.99: 2665.10 ------------------------------------------------------ [ 0, 1 ] 5155 41.744% 41.744% ######## ( 1, 2 ] 6347 51.397% 93.141% ########## ( 2, 3 ] 366 2.964% 96.105% # ( 3, 4 ] 125 1.012% 97.117% ( 4, 6 ] 109 0.883% 98.000% ( 6, 10 ] 116 0.939% 98.939% ( 10, 15 ] 50 0.405% 99.344% ( 15, 22 ] 6 0.049% 99.393% ( 76, 110 ] 37 0.300% 99.692% ( 110, 170 ] 24 0.194% 99.887% ( 170, 250 ] 6 0.049% 99.935% ( 250, 380 ] 2 0.016% 99.951% ( 380, 580 ] 2 0.016% 99.968% ( 580, 870 ] 2 0.016% 99.984% ( 1900, 2900 ] 1 0.008% 99.992% ( 2900, 4400 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 88588 Average: 2.1989 StdDev: 3.56 Min: 1 Median: 1.5111 Max: 641 Percentiles: P50: 1.51 P75: 1.90 P99: 5.98 P99.9: 13.42 P99.99: 185.22 ------------------------------------------------------ [ 0, 1 ] 15277 17.245% 17.245% ### ( 1, 2 ] 56773 64.087% 81.332% ############# ( 2, 3 ] 10237 11.556% 92.887% ## ( 3, 4 ] 3280 3.703% 96.590% # ( 4, 6 ] 2158 2.436% 99.026% ( 6, 10 ] 650 0.734% 99.760% ( 10, 15 ] 182 0.205% 99.965% ( 15, 22 ] 17 0.019% 99.984% ( 22, 34 ] 1 0.001% 99.985% ( 34, 51 ] 2 0.002% 99.988% ( 76, 110 ] 1 0.001% 99.989% ( 170, 250 ] 6 0.007% 99.995% ( 250, 380 ] 2 0.002% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 266782 Average: 3.2590 StdDev: 47.59 Min: 0 Median: 1.6507 Max: 7214 Percentiles: P50: 1.65 P75: 2.15 P99: 9.28 P99.9: 102.50 P99.99: 363.51 ------------------------------------------------------ [ 0, 1 ] 20926 7.844% 7.844% ## ( 1, 2 ] 172825 64.781% 72.625% ############# ( 2, 3 ] 43272 16.220% 88.845% ### ( 3, 4 ] 12775 4.789% 93.634% # ( 4, 6 ] 10126 3.796% 97.429% # ( 6, 10 ] 5107 1.914% 99.344% ( 10, 15 ] 910 0.341% 99.685% ( 15, 22 ] 73 0.027% 99.712% ( 22, 34 ] 6 0.002% 99.714% ( 34, 51 ] 325 0.122% 99.836% ( 51, 76 ] 118 0.044% 99.880% ( 76, 110 ] 67 0.025% 99.906% ( 110, 170 ] 137 0.051% 99.957% ( 170, 250 ] 63 0.024% 99.981% ( 250, 380 ] 29 0.011% 99.991% ( 380, 580 ] 11 0.004% 99.996% ( 580, 870 ] 3 0.001% 99.997% ( 870, 1300 ] 8 0.003% 100.000% ( 1300, 1900 ] 5 0.002% 100.001% ( 1900, 2900 ] 9 0.003% 100.005% ( 2900, 4400 ] 11 0.004% 100.009% ( 4400, 6600 ] 8 0.003% 100.012% ( 6600, 9900 ] 3 0.001% 100.013% ** Level 4 read latency histogram (micros): Count: 305 Average: 233.8230 StdDev: 1005.97 Min: 1 Median: 2.0091 Max: 7681 Percentiles: P50: 2.01 P75: 6.58 P99: 5698.00 P99.9: 7681.00 P99.99: 7681.00 ------------------------------------------------------ [ 0, 1 ] 49 16.066% 16.066% ### ( 1, 2 ] 103 33.770% 49.836% ####### ( 2, 3 ] 55 18.033% 67.869% #### ( 3, 4 ] 10 3.279% 71.148% # ( 4, 6 ] 9 2.951% 74.098% # ( 6, 10 ] 19 6.230% 80.328% # ( 10, 15 ] 29 9.508% 89.836% ## ( 15, 22 ] 4 1.311% 91.148% ( 110, 170 ] 6 1.967% 93.115% ( 170, 250 ] 1 0.328% 93.443% ( 250, 380 ] 1 0.328% 93.770% ( 870, 1300 ] 3 0.984% 94.754% ( 1300, 1900 ] 1 0.328% 95.082% ( 1900, 2900 ] 4 1.311% 96.393% ( 2900, 4400 ] 5 1.639% 98.033% ( 4400, 6600 ] 5 1.639% 99.672% ( 6600, 9900 ] 1 0.328% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 428.1500 StdDev: 415.16 Min: 110 Median: 271.6667 Max: 1786 Percentiles: P50: 271.67 P75: 380.00 P99: 1780.00 P99.9: 1786.00 P99.99: 1786.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 5 25.000% 30.000% ##### ( 170, 250 ] 3 15.000% 45.000% ### ( 250, 380 ] 6 30.000% 75.000% ###### ( 380, 580 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.0 total, 2.8 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 328.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.204 H:M:S, 1.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 347.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/06-15:16:55 ... thread 0: (1000000,5000000) ops and (55068.1,167063.0) ops/second in (18.159346,29.928829) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 4/0 629.49 MB 62.9 3.9 0.0 3.9 8.7 4.7 0.0 1.8 138.8 305.6 29.05 27.72 92 0.316 4093K 3908 0.0 0.0 L1 9/9 1.10 GB 0.0 3.9 3.9 0.0 3.9 3.9 0.2 1.0 228.1 224.3 17.67 16.89 2 8.837 4093K 66K 0.0 0.0 L2 22/13 2.56 GB 10.7 0.3 0.2 0.2 0.3 0.2 2.8 1.8 252.2 252.0 1.38 1.35 2 0.692 354K 166 0.0 0.0 L3 20/14 906.16 MB 0.0 1.1 0.2 0.9 1.1 0.2 0.2 4.7 241.3 241.0 4.64 4.47 2 2.319 1136K 1640 0.0 0.0 L4 173/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 171.5 171.6 0.98 0.86 1 0.981 170K 0 0.0 0.0 L5 1064/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1292/36 100.80 GB 0.0 9.5 4.5 5.0 14.1 9.2 3.8 3.0 180.5 269.5 53.73 51.29 99 0.543 9849K 72K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.5 4.5 5.0 14.1 9.2 3.7 3.0 180.5 269.5 53.73 51.29 99 0.543 9849K 72K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.5 4.5 5.0 9.4 4.4 0.0 0.0 240.1 238.3 40.41 38.98 23 1.757 9849K 72K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 364.1 13.32 12.31 76 0.175 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 30.1 total, 29.9 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.14 GB write, 480.32 MB/s write, 9.47 GB read, 321.80 MB/s read, 53.7 seconds Interval compaction: 14.14 GB write, 483.74 MB/s write, 9.47 GB read, 324.09 MB/s read, 53.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 1, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2093899 Average: 2.3543 StdDev: 8.73 Min: 0 Median: 1.4261 Max: 1760 Percentiles: P50: 1.43 P75: 1.81 P99: 5.90 P99.9: 138.68 P99.99: 225.05 ------------------------------------------------------ [ 0, 1 ] 460718 22.003% 22.003% #### ( 1, 2 ] 1375960 65.713% 87.716% ############# ( 2, 3 ] 154087 7.359% 95.075% # ( 3, 4 ] 48952 2.338% 97.412% ( 4, 6 ] 34999 1.671% 99.084% ( 6, 10 ] 11950 0.571% 99.655% ( 10, 15 ] 2326 0.111% 99.766% ( 15, 22 ] 429 0.020% 99.786% ( 22, 34 ] 47 0.002% 99.788% ( 34, 51 ] 6 0.000% 99.789% ( 51, 76 ] 19 0.001% 99.790% ( 76, 110 ] 868 0.041% 99.831% ( 110, 170 ] 3021 0.144% 99.975% ( 170, 250 ] 447 0.021% 99.997% ( 250, 380 ] 226 0.011% 100.007% ( 380, 580 ] 53 0.003% 100.010% ( 580, 870 ] 16 0.001% 100.011% ( 870, 1300 ] 12 0.001% 100.011% ( 1300, 1900 ] 6 0.000% 100.012% ** Level 1 read latency histogram (micros): Count: 38682 Average: 5.6615 StdDev: 45.77 Min: 1 Median: 1.6467 Max: 3283 Percentiles: P50: 1.65 P75: 2.35 P99: 87.71 P99.9: 228.11 P99.99: 341.57 ------------------------------------------------------ [ 0, 1 ] 5820 15.046% 15.046% ### ( 1, 2 ] 20907 54.048% 69.094% ########### ( 2, 3 ] 6590 17.036% 86.130% ### ( 3, 4 ] 2335 6.036% 92.167% # ( 4, 6 ] 1824 4.715% 96.882% # ( 6, 10 ] 545 1.409% 98.291% ( 10, 15 ] 212 0.548% 98.839% ( 15, 22 ] 33 0.085% 98.925% ( 22, 34 ] 3 0.008% 98.932% ( 34, 51 ] 1 0.003% 98.935% ( 76, 110 ] 76 0.196% 99.131% ( 110, 170 ] 262 0.677% 99.809% ( 170, 250 ] 50 0.129% 99.938% ( 250, 380 ] 30 0.078% 100.016% ( 380, 580 ] 17 0.044% 100.059% ( 580, 870 ] 26 0.067% 100.127% ( 870, 1300 ] 23 0.059% 100.186% ( 1300, 1900 ] 4 0.010% 100.196% ( 1900, 2900 ] 1 0.003% 100.199% ( 2900, 4400 ] 1 0.003% 100.202% ** Level 2 read latency histogram (micros): Count: 88588 Average: 2.1989 StdDev: 3.56 Min: 1 Median: 1.5111 Max: 641 Percentiles: P50: 1.51 P75: 1.90 P99: 5.98 P99.9: 13.42 P99.99: 185.22 ------------------------------------------------------ [ 0, 1 ] 15277 17.245% 17.245% ### ( 1, 2 ] 56773 64.087% 81.332% ############# ( 2, 3 ] 10237 11.556% 92.887% ## ( 3, 4 ] 3280 3.703% 96.590% # ( 4, 6 ] 2158 2.436% 99.026% ( 6, 10 ] 650 0.734% 99.760% ( 10, 15 ] 182 0.205% 99.965% ( 15, 22 ] 17 0.019% 99.984% ( 22, 34 ] 1 0.001% 99.985% ( 34, 51 ] 2 0.002% 99.988% ( 76, 110 ] 1 0.001% 99.989% ( 170, 250 ] 6 0.007% 99.995% ( 250, 380 ] 2 0.002% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 270701 Average: 3.3323 StdDev: 47.42 Min: 0 Median: 1.6545 Max: 7214 Percentiles: P50: 1.65 P75: 2.16 P99: 9.38 P99.9: 137.86 P99.99: 402.70 ------------------------------------------------------ [ 0, 1 ] 20967 7.745% 7.745% ## ( 1, 2 ] 174770 64.562% 72.307% ############# ( 2, 3 ] 44423 16.410% 88.718% ### ( 3, 4 ] 13052 4.822% 93.539% # ( 4, 6 ] 10386 3.837% 97.376% # ( 6, 10 ] 5204 1.922% 99.298% ( 10, 15 ] 929 0.343% 99.642% ( 15, 22 ] 75 0.028% 99.669% ( 22, 34 ] 6 0.002% 99.672% ( 34, 51 ] 325 0.120% 99.792% ( 51, 76 ] 118 0.044% 99.835% ( 76, 110 ] 76 0.028% 99.863% ( 110, 170 ] 216 0.080% 99.943% ( 170, 250 ] 82 0.030% 99.973% ( 250, 380 ] 44 0.016% 99.990% ( 380, 580 ] 17 0.006% 99.996% ( 580, 870 ] 3 0.001% 99.997% ( 870, 1300 ] 8 0.003% 100.000% ( 1300, 1900 ] 5 0.002% 100.002% ( 1900, 2900 ] 9 0.003% 100.005% ( 2900, 4400 ] 11 0.004% 100.009% ( 4400, 6600 ] 8 0.003% 100.012% ( 6600, 9900 ] 3 0.001% 100.013% ** Level 4 read latency histogram (micros): Count: 305 Average: 233.8230 StdDev: 1005.97 Min: 1 Median: 2.0091 Max: 7681 Percentiles: P50: 2.01 P75: 6.58 P99: 5698.00 P99.9: 7681.00 P99.99: 7681.00 ------------------------------------------------------ [ 0, 1 ] 49 16.066% 16.066% ### ( 1, 2 ] 103 33.770% 49.836% ####### ( 2, 3 ] 55 18.033% 67.869% #### ( 3, 4 ] 10 3.279% 71.148% # ( 4, 6 ] 9 2.951% 74.098% # ( 6, 10 ] 19 6.230% 80.328% # ( 10, 15 ] 29 9.508% 89.836% ## ( 15, 22 ] 4 1.311% 91.148% ( 110, 170 ] 6 1.967% 93.115% ( 170, 250 ] 1 0.328% 93.443% ( 250, 380 ] 1 0.328% 93.770% ( 870, 1300 ] 3 0.984% 94.754% ( 1300, 1900 ] 1 0.328% 95.082% ( 1900, 2900 ] 4 1.311% 96.393% ( 2900, 4400 ] 5 1.639% 98.033% ( 4400, 6600 ] 5 1.639% 99.672% ( 6600, 9900 ] 1 0.328% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 428.1500 StdDev: 415.16 Min: 110 Median: 271.6667 Max: 1786 Percentiles: P50: 271.67 P75: 380.00 P99: 1780.00 P99.9: 1786.00 P99.99: 1786.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 5 25.000% 30.000% ##### ( 170, 250 ] 3 15.000% 45.000% ### ( 250, 380 ] 6 30.000% 75.000% ###### ( 380, 580 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 30.1 total, 18.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 163.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.780 H:M:S, 49.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 54.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:14.576 H:M:S, 80.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/06-15:16:59 ... thread 0: (1000000,6000000) ops and (293632.9,179994.0) ops/second in (3.405613,33.334442) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/0 1.54 GB 157.4 4.7 0.0 4.7 10.3 5.7 0.0 1.8 135.2 298.7 35.42 33.46 109 0.325 4861K 4570 0.0 0.0 L1 9/9 1.10 GB 0.0 3.9 3.9 0.0 3.9 3.9 0.2 1.0 228.1 224.3 17.67 16.89 2 8.837 4093K 66K 0.0 0.0 L2 18/14 2.06 GB 4.3 0.3 0.2 0.2 0.3 0.2 2.8 1.8 252.2 252.0 1.38 1.35 2 0.692 354K 166 0.0 0.0 L3 30/15 1.39 GB 0.6 1.7 0.7 1.0 1.7 0.7 0.2 2.3 227.0 226.6 7.77 7.39 3 2.589 1790K 3307 0.0 0.0 L4 173/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 171.5 171.6 0.98 0.86 1 0.981 170K 0 0.0 0.0 L5 1064/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1303/38 101.72 GB 0.0 10.8 5.0 5.8 16.4 10.6 3.8 2.9 175.6 266.0 63.23 59.95 117 0.540 11M 74K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.8 5.0 5.8 16.4 10.6 3.7 2.9 175.6 266.0 63.23 59.95 117 0.540 11M 74K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.8 5.0 5.8 10.8 4.9 0.0 0.0 236.9 235.3 46.86 45.06 27 1.736 11M 74K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 354.1 16.37 14.90 90 0.182 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 33.5 total, 33.3 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.43 GB write, 501.39 MB/s write, 10.84 GB read, 330.86 MB/s read, 63.2 seconds Interval compaction: 16.43 GB write, 504.59 MB/s write, 10.84 GB read, 332.97 MB/s read, 63.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 2, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2285802 Average: 2.4279 StdDev: 11.03 Min: 0 Median: 1.4618 Max: 8022 Percentiles: P50: 1.46 P75: 1.85 P99: 6.07 P99.9: 136.70 P99.99: 225.71 ------------------------------------------------------ [ 0, 1 ] 463893 20.295% 20.295% #### ( 1, 2 ] 1470359 64.326% 84.620% ############# ( 2, 3 ] 206067 9.015% 93.635% ## ( 3, 4 ] 67274 2.943% 96.578% # ( 4, 6 ] 55077 2.410% 98.988% ( 6, 10 ] 15052 0.658% 99.647% ( 10, 15 ] 2990 0.131% 99.777% ( 15, 22 ] 472 0.021% 99.798% ( 22, 34 ] 57 0.002% 99.800% ( 34, 51 ] 10 0.000% 99.801% ( 51, 76 ] 19 0.001% 99.802% ( 76, 110 ] 868 0.038% 99.840% ( 110, 170 ] 3097 0.135% 99.975% ( 170, 250 ] 486 0.021% 99.996% ( 250, 380 ] 248 0.011% 100.007% ( 380, 580 ] 70 0.003% 100.010% ( 580, 870 ] 19 0.001% 100.011% ( 870, 1300 ] 16 0.001% 100.012% ( 1300, 1900 ] 7 0.000% 100.012% ( 1900, 2900 ] 1 0.000% 100.012% ( 2900, 4400 ] 2 0.000% 100.012% ( 6600, 9900 ] 1 0.000% 100.012% ** Level 1 read latency histogram (micros): Count: 580620 Average: 3.7413 StdDev: 30.53 Min: 1 Median: 2.0184 Max: 4112 Percentiles: P50: 2.02 P75: 2.90 P99: 9.05 P99.9: 14.54 P99.99: 87.31 ------------------------------------------------------ [ 0, 1 ] 8826 1.520% 1.520% ( 1, 2 ] 278441 47.956% 49.476% ########## ( 2, 3 ] 165349 28.478% 77.954% ###### ( 3, 4 ] 56890 9.798% 87.752% ## ( 4, 6 ] 55485 9.556% 97.308% ## ( 6, 10 ] 12871 2.217% 99.525% ( 10, 15 ] 2397 0.413% 99.938% ( 15, 22 ] 245 0.042% 99.980% ( 22, 34 ] 15 0.003% 99.983% ( 34, 51 ] 5 0.001% 99.983% ( 51, 76 ] 3 0.001% 99.984% ( 76, 110 ] 108 0.019% 100.003% ( 110, 170 ] 577 0.099% 100.102% ( 170, 250 ] 267 0.046% 100.148% ( 250, 380 ] 153 0.026% 100.174% ( 380, 580 ] 73 0.013% 100.187% ( 580, 870 ] 46 0.008% 100.195% ( 870, 1300 ] 34 0.006% 100.201% ( 1300, 1900 ] 9 0.002% 100.202% ( 1900, 2900 ] 47 0.008% 100.210% ( 2900, 4400 ] 11 0.002% 100.212% ** Level 2 read latency histogram (micros): Count: 88588 Average: 2.1989 StdDev: 3.56 Min: 1 Median: 1.5111 Max: 641 Percentiles: P50: 1.51 P75: 1.90 P99: 5.98 P99.9: 13.42 P99.99: 185.22 ------------------------------------------------------ [ 0, 1 ] 15277 17.245% 17.245% ### ( 1, 2 ] 56773 64.087% 81.332% ############# ( 2, 3 ] 10237 11.556% 92.887% ## ( 3, 4 ] 3280 3.703% 96.590% # ( 4, 6 ] 2158 2.436% 99.026% ( 6, 10 ] 650 0.734% 99.760% ( 10, 15 ] 182 0.205% 99.965% ( 15, 22 ] 17 0.019% 99.984% ( 22, 34 ] 1 0.001% 99.985% ( 34, 51 ] 2 0.002% 99.988% ( 76, 110 ] 1 0.001% 99.989% ( 170, 250 ] 6 0.007% 99.995% ( 250, 380 ] 2 0.002% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 443302 Average: 3.6863 StdDev: 43.62 Min: 0 Median: 1.7930 Max: 7214 Percentiles: P50: 1.79 P75: 2.60 P99: 9.62 P99.9: 182.47 P99.99: 631.62 ------------------------------------------------------ [ 0, 1 ] 21654 4.885% 4.885% # ( 1, 2 ] 252200 56.891% 61.776% ########### ( 2, 3 ] 98101 22.130% 83.906% #### ( 3, 4 ] 30209 6.815% 90.720% # ( 4, 6 ] 27766 6.263% 96.984% # ( 6, 10 ] 9883 2.229% 99.213% ( 10, 15 ] 1748 0.394% 99.607% ( 15, 22 ] 166 0.037% 99.645% ( 22, 34 ] 13 0.003% 99.648% ( 34, 51 ] 325 0.073% 99.721% ( 51, 76 ] 119 0.027% 99.748% ( 76, 110 ] 105 0.024% 99.771% ( 110, 170 ] 529 0.119% 99.891% ( 170, 250 ] 261 0.059% 99.950% ( 250, 380 ] 131 0.030% 99.979% ( 380, 580 ] 45 0.010% 99.989% ( 580, 870 ] 15 0.003% 99.993% ( 870, 1300 ] 12 0.003% 99.995% ( 1300, 1900 ] 7 0.002% 99.997% ( 1900, 2900 ] 29 0.007% 100.004% ( 2900, 4400 ] 16 0.004% 100.007% ( 4400, 6600 ] 8 0.002% 100.009% ( 6600, 9900 ] 3 0.001% 100.010% ** Level 4 read latency histogram (micros): Count: 305 Average: 233.8230 StdDev: 1005.97 Min: 1 Median: 2.0091 Max: 7681 Percentiles: P50: 2.01 P75: 6.58 P99: 5698.00 P99.9: 7681.00 P99.99: 7681.00 ------------------------------------------------------ [ 0, 1 ] 49 16.066% 16.066% ### ( 1, 2 ] 103 33.770% 49.836% ####### ( 2, 3 ] 55 18.033% 67.869% #### ( 3, 4 ] 10 3.279% 71.148% # ( 4, 6 ] 9 2.951% 74.098% # ( 6, 10 ] 19 6.230% 80.328% # ( 10, 15 ] 29 9.508% 89.836% ## ( 15, 22 ] 4 1.311% 91.148% ( 110, 170 ] 6 1.967% 93.115% ( 170, 250 ] 1 0.328% 93.443% ( 250, 380 ] 1 0.328% 93.770% ( 870, 1300 ] 3 0.984% 94.754% ( 1300, 1900 ] 1 0.328% 95.082% ( 1900, 2900 ] 4 1.311% 96.393% ( 2900, 4400 ] 5 1.639% 98.033% ( 4400, 6600 ] 5 1.639% 99.672% ( 6600, 9900 ] 1 0.328% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 428.1500 StdDev: 415.16 Min: 110 Median: 271.6667 Max: 1786 Percentiles: P50: 271.67 P75: 380.00 P99: 1780.00 P99.9: 1786.00 P99.99: 1786.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 5 25.000% 30.000% ##### ( 170, 250 ] 3 15.000% 45.000% ### ( 250, 380 ] 6 30.000% 75.000% ###### ( 380, 580 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 33.5 total, 3.4 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 176.02 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.035 H:M:S, 44.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 288.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.256 H:M:S, 7.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/11/06-15:17:04 ... thread 0: (1000000,7000000) ops and (200096.0,182614.8) ops/second in (4.997601,38.332043) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/11 2.46 GB 18.9 5.5 0.0 5.5 12.1 6.6 0.0 1.8 128.3 282.5 43.70 39.61 125 0.350 5693K 5387 0.0 0.0 L1 0/0 0.00 KB 0.0 3.9 3.9 0.0 3.9 3.9 0.2 1.0 228.1 224.3 17.67 16.89 2 8.837 4093K 66K 0.0 0.0 L2 3/1 145.92 MB 0.9 1.5 1.3 0.3 1.5 1.3 2.8 1.2 201.4 200.9 7.80 7.06 3 2.600 452K 166 0.0 0.0 L3 27/8 1.74 GB 1.3 5.0 2.9 2.1 5.0 2.8 1.1 1.7 187.5 186.1 27.43 23.26 14 1.959 5222K 37K 0.0 0.0 L4 197/9 10.91 GB 1.1 2.3 2.2 0.1 2.3 2.2 0.8 1.0 124.6 124.4 19.22 11.84 35 0.549 2376K 1826 0.0 0.0 L5 1080/0 87.35 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1320/29 102.60 GB 0.0 18.3 10.3 8.0 24.8 16.8 6.5 3.8 161.9 219.1 115.82 98.66 179 0.647 17M 111K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.3 10.3 8.0 24.8 16.8 6.5 3.8 161.9 219.1 115.82 98.66 179 0.647 17M 111K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.3 10.3 8.0 18.2 10.2 0.0 0.0 197.4 196.1 94.98 81.08 76 1.250 17M 111K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 323.5 20.84 17.58 103 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.5 total, 38.3 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.78 GB write, 658.18 MB/s write, 18.31 GB read, 486.35 MB/s read, 115.8 seconds Interval compaction: 24.78 GB write, 661.83 MB/s write, 18.31 GB read, 489.05 MB/s read, 115.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 27, interval: 40 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2504669 Average: 2.6536 StdDev: 21.43 Min: 0 Median: 1.4968 Max: 8022 Percentiles: P50: 1.50 P75: 1.89 P99: 6.59 P99.9: 142.81 P99.99: 346.59 ------------------------------------------------------ [ 0, 1 ] 468006 18.685% 18.685% #### ( 1, 2 ] 1578746 63.032% 81.717% ############# ( 2, 3 ] 262473 10.479% 92.197% ## ( 3, 4 ] 89233 3.563% 95.759% # ( 4, 6 ] 78443 3.132% 98.891% # ( 6, 10 ] 18416 0.735% 99.627% ( 10, 15 ] 3657 0.146% 99.773% ( 15, 22 ] 521 0.021% 99.793% ( 22, 34 ] 61 0.002% 99.796% ( 34, 51 ] 12 0.000% 99.796% ( 51, 76 ] 22 0.001% 99.797% ( 76, 110 ] 870 0.035% 99.832% ( 110, 170 ] 3119 0.125% 99.956% ( 170, 250 ] 579 0.023% 99.980% ( 250, 380 ] 352 0.014% 99.994% ( 380, 580 ] 183 0.007% 100.001% ( 580, 870 ] 110 0.004% 100.005% ( 870, 1300 ] 74 0.003% 100.008% ( 1300, 1900 ] 27 0.001% 100.009% ( 1900, 2900 ] 24 0.001% 100.010% ( 2900, 4400 ] 34 0.001% 100.012% ( 4400, 6600 ] 5 0.000% 100.012% ( 6600, 9900 ] 1 0.000% 100.012% ** Level 1 read latency histogram (micros): Count: 1014669 Average: 4.7572 StdDev: 71.11 Min: 1 Median: 2.0742 Max: 9154 Percentiles: P50: 2.07 P75: 2.93 P99: 9.26 P99.9: 14.93 P99.99: 127.37 ------------------------------------------------------ [ 0, 1 ] 10895 1.074% 1.074% ( 1, 2 ] 474497 46.764% 47.837% ######### ( 2, 3 ] 295539 29.127% 76.964% ###### ( 3, 4 ] 100876 9.942% 86.906% ## ( 4, 6 ] 102187 10.071% 96.977% ## ( 6, 10 ] 25213 2.485% 99.462% ( 10, 15 ] 4513 0.445% 99.906% ( 15, 22 ] 433 0.043% 99.949% ( 22, 34 ] 40 0.004% 99.953% ( 34, 51 ] 8 0.001% 99.954% ( 51, 76 ] 6 0.001% 99.954% ( 76, 110 ] 144 0.014% 99.969% ( 110, 170 ] 748 0.074% 100.042% ( 170, 250 ] 456 0.045% 100.087% ( 250, 380 ] 276 0.027% 100.115% ( 380, 580 ] 169 0.017% 100.131% ( 580, 870 ] 102 0.010% 100.141% ( 870, 1300 ] 85 0.008% 100.150% ( 1300, 1900 ] 48 0.005% 100.154% ( 1900, 2900 ] 133 0.013% 100.167% ( 2900, 4400 ] 137 0.014% 100.181% ( 4400, 6600 ] 44 0.004% 100.185% ( 6600, 9900 ] 15 0.001% 100.187% ** Level 2 read latency histogram (micros): Count: 159870 Average: 3.7281 StdDev: 45.66 Min: 1 Median: 1.7802 Max: 6078 Percentiles: P50: 1.78 P75: 2.64 P99: 8.49 P99.9: 141.30 P99.99: 854.84 ------------------------------------------------------ [ 0, 1 ] 15404 9.635% 9.635% ## ( 1, 2 ] 82713 51.738% 61.373% ########## ( 2, 3 ] 34067 21.309% 82.682% #### ( 3, 4 ] 12134 7.590% 90.272% ## ( 4, 6 ] 12555 7.853% 98.125% ## ( 6, 10 ] 2246 1.405% 99.530% ( 10, 15 ] 525 0.328% 99.859% ( 15, 22 ] 40 0.025% 99.884% ( 22, 34 ] 12 0.008% 99.891% ( 34, 51 ] 3 0.002% 99.893% ( 51, 76 ] 2 0.001% 99.894% ( 76, 110 ] 6 0.004% 99.898% ( 110, 170 ] 6 0.004% 99.902% ( 170, 250 ] 28 0.018% 99.919% ( 250, 380 ] 47 0.029% 99.949% ( 380, 580 ] 30 0.019% 99.967% ( 580, 870 ] 38 0.024% 99.991% ( 870, 1300 ] 24 0.015% 100.006% ( 1300, 1900 ] 11 0.007% 100.013% ( 1900, 2900 ] 10 0.006% 100.019% ( 2900, 4400 ] 7 0.004% 100.024% ( 4400, 6600 ] 4 0.003% 100.026% ** Level 3 read latency histogram (micros): Count: 1121458 Average: 5.9773 StdDev: 88.07 Min: 0 Median: 2.0937 Max: 9021 Percentiles: P50: 2.09 P75: 2.96 P99: 9.61 P99.9: 184.64 P99.99: 365.65 ------------------------------------------------------ [ 0, 1 ] 23330 2.080% 2.080% ( 1, 2 ] 507168 45.224% 47.304% ######### ( 2, 3 ] 322634 28.769% 76.073% ###### ( 3, 4 ] 112112 9.997% 86.070% ## ( 4, 6 ] 120231 10.721% 96.791% ## ( 6, 10 ] 27461 2.449% 99.240% ( 10, 15 ] 5403 0.482% 99.722% ( 15, 22 ] 560 0.050% 99.772% ( 22, 34 ] 62 0.006% 99.777% ( 34, 51 ] 351 0.031% 99.809% ( 51, 76 ] 135 0.012% 99.821% ( 76, 110 ] 118 0.011% 99.831% ( 110, 170 ] 663 0.059% 99.890% ( 170, 250 ] 593 0.053% 99.943% ( 250, 380 ] 590 0.053% 99.996% ( 380, 580 ] 428 0.038% 100.034% ( 580, 870 ] 346 0.031% 100.065% ( 870, 1300 ] 235 0.021% 100.086% ( 1300, 1900 ] 149 0.013% 100.099% ( 1900, 2900 ] 221 0.020% 100.119% ( 2900, 4400 ] 267 0.024% 100.143% ( 4400, 6600 ] 66 0.006% 100.148% ( 6600, 9900 ] 21 0.002% 100.150% ** Level 4 read latency histogram (micros): Count: 28549 Average: 108.9419 StdDev: 494.36 Min: 1 Median: 2.4697 Max: 8657 Percentiles: P50: 2.47 P75: 3.70 P99: 2975.97 P99.9: 5497.60 P99.99: 7753.20 ------------------------------------------------------ [ 0, 1 ] 245 0.858% 0.858% ( 1, 2 ] 9955 34.870% 35.728% ####### ( 2, 3 ] 8675 30.386% 66.114% ###### ( 3, 4 ] 3603 12.620% 78.735% ### ( 4, 6 ] 2497 8.746% 87.481% ## ( 6, 10 ] 686 2.403% 89.884% ( 10, 15 ] 195 0.683% 90.567% ( 15, 22 ] 43 0.151% 90.718% ( 22, 34 ] 7 0.025% 90.742% ( 34, 51 ] 1 0.004% 90.746% ( 76, 110 ] 1 0.004% 90.749% ( 110, 170 ] 108 0.378% 91.128% ( 170, 250 ] 290 1.016% 92.143% ( 250, 380 ] 362 1.268% 93.411% ( 380, 580 ] 448 1.569% 94.981% ( 580, 870 ] 410 1.436% 96.417% ( 870, 1300 ] 301 1.054% 97.471% ( 1300, 1900 ] 211 0.739% 98.210% ( 1900, 2900 ] 213 0.746% 98.956% ( 2900, 4400 ] 247 0.865% 99.821% ( 4400, 6600 ] 45 0.158% 99.979% ( 6600, 9900 ] 9 0.032% 100.011% ** Level 5 read latency histogram (micros): Count: 100 Average: 998.8900 StdDev: 1384.69 Min: 89 Median: 363.7500 Max: 7272 Percentiles: P50: 363.75 P75: 1165.62 P99: 7272.00 P99.9: 7272.00 P99.99: 7272.00 ------------------------------------------------------ ( 76, 110 ] 6 6.000% 6.000% # ( 110, 170 ] 17 17.000% 23.000% ### ( 170, 250 ] 13 13.000% 36.000% ### ( 250, 380 ] 16 16.000% 52.000% ### ( 380, 580 ] 9 9.000% 61.000% ## ( 580, 870 ] 3 3.000% 64.000% # ( 870, 1300 ] 16 16.000% 80.000% ### ( 1300, 1900 ] 5 5.000% 85.000% # ( 1900, 2900 ] 5 5.000% 90.000% # ( 2900, 4400 ] 6 6.000% 96.000% # ( 4400, 6600 ] 2 2.000% 98.000% ( 6600, 9900 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 38.5 total, 5.0 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 178.73 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.552 H:M:S, 42.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 196.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.517 H:M:S, 30.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/06-15:17:08 ... thread 0: (1000000,8000000) ops and (229868.1,187431.0) ops/second in (4.350321,42.682364) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 3.44 GB 94.4 6.3 0.0 6.3 13.9 7.6 0.0 1.8 128.6 282.1 50.45 45.75 143 0.353 6588K 6427 0.0 0.0 L1 0/0 0.00 KB 0.0 3.9 3.9 0.0 3.9 3.9 0.2 1.0 228.1 224.3 17.67 16.89 2 8.837 4093K 66K 0.0 0.0 L2 2/0 85.20 MB 0.9 1.5 1.3 0.3 1.5 1.3 2.8 1.2 201.4 200.9 7.80 7.06 3 2.600 452K 166 0.0 0.0 L3 16/0 964.67 MB 1.0 5.1 2.9 2.1 5.0 2.9 1.1 1.7 185.7 184.4 28.03 23.57 15 1.868 5287K 37K 0.0 0.0 L4 181/0 9.49 GB 1.0 3.2 3.1 0.1 3.2 3.1 0.8 1.0 127.9 127.6 25.99 16.29 47 0.553 3287K 2562 0.0 0.0 L5 1108/0 89.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1326/15 103.59 GB 0.0 20.1 11.3 8.9 27.6 18.7 8.8 3.6 158.7 217.4 129.93 109.57 210 0.619 19M 113K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.1 11.3 8.9 27.6 18.7 8.8 3.6 158.7 217.4 129.93 109.57 210 0.619 19M 113K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.1 11.3 8.9 20.0 11.1 0.0 0.0 194.7 193.6 105.91 89.34 92 1.151 19M 113K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 322.5 24.03 20.23 118 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 42.9 total, 42.7 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.59 GB write, 658.52 MB/s write, 20.14 GB read, 480.68 MB/s read, 129.9 seconds Interval compaction: 27.59 GB write, 661.80 MB/s write, 20.14 GB read, 483.08 MB/s read, 129.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 36, interval: 53 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3014382 Average: 2.6119 StdDev: 19.74 Min: 0 Median: 1.5189 Max: 8022 Percentiles: P50: 1.52 P75: 1.91 P99: 6.70 P99.9: 127.81 P99.99: 238.57 ------------------------------------------------------ [ 0, 1 ] 513054 17.020% 17.020% ### ( 1, 2 ] 1915674 63.551% 80.571% ############# ( 2, 3 ] 344297 11.422% 91.993% ## ( 3, 4 ] 111667 3.704% 95.698% # ( 4, 6 ] 95270 3.161% 98.858% # ( 6, 10 ] 24359 0.808% 99.666% ( 10, 15 ] 4555 0.151% 99.817% ( 15, 22 ] 576 0.019% 99.836% ( 22, 34 ] 75 0.002% 99.839% ( 34, 51 ] 18 0.001% 99.840% ( 51, 76 ] 25 0.001% 99.840% ( 76, 110 ] 870 0.029% 99.869% ( 110, 170 ] 3129 0.104% 99.973% ( 170, 250 ] 598 0.020% 99.993% ( 250, 380 ] 366 0.012% 100.005% ( 380, 580 ] 191 0.006% 100.011% ( 580, 870 ] 114 0.004% 100.015% ( 870, 1300 ] 76 0.003% 100.018% ( 1300, 1900 ] 31 0.001% 100.019% ( 1900, 2900 ] 24 0.001% 100.019% ( 2900, 4400 ] 35 0.001% 100.021% ( 4400, 6600 ] 5 0.000% 100.021% ( 6600, 9900 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1014669 Average: 4.7572 StdDev: 71.11 Min: 1 Median: 2.0742 Max: 9154 Percentiles: P50: 2.07 P75: 2.93 P99: 9.26 P99.9: 14.93 P99.99: 127.37 ------------------------------------------------------ [ 0, 1 ] 10895 1.074% 1.074% ( 1, 2 ] 474497 46.764% 47.837% ######### ( 2, 3 ] 295539 29.127% 76.964% ###### ( 3, 4 ] 100876 9.942% 86.906% ## ( 4, 6 ] 102187 10.071% 96.977% ## ( 6, 10 ] 25213 2.485% 99.462% ( 10, 15 ] 4513 0.445% 99.906% ( 15, 22 ] 433 0.043% 99.949% ( 22, 34 ] 40 0.004% 99.953% ( 34, 51 ] 8 0.001% 99.954% ( 51, 76 ] 6 0.001% 99.954% ( 76, 110 ] 144 0.014% 99.969% ( 110, 170 ] 748 0.074% 100.042% ( 170, 250 ] 456 0.045% 100.087% ( 250, 380 ] 276 0.027% 100.115% ( 380, 580 ] 169 0.017% 100.131% ( 580, 870 ] 102 0.010% 100.141% ( 870, 1300 ] 85 0.008% 100.150% ( 1300, 1900 ] 48 0.005% 100.154% ( 1900, 2900 ] 133 0.013% 100.167% ( 2900, 4400 ] 137 0.014% 100.181% ( 4400, 6600 ] 44 0.004% 100.185% ( 6600, 9900 ] 15 0.001% 100.187% ** Level 2 read latency histogram (micros): Count: 231671 Average: 4.2616 StdDev: 61.52 Min: 1 Median: 1.8274 Max: 6078 Percentiles: P50: 1.83 P75: 2.69 P99: 8.85 P99.9: 200.98 P99.99: 1228.33 ------------------------------------------------------ [ 0, 1 ] 16281 7.028% 7.028% # ( 1, 2 ] 120324 51.937% 58.965% ########## ( 2, 3 ] 53851 23.245% 82.210% ##### ( 3, 4 ] 18011 7.774% 89.984% ## ( 4, 6 ] 18037 7.786% 97.770% ## ( 6, 10 ] 3999 1.726% 99.496% ( 10, 15 ] 812 0.350% 99.846% ( 15, 22 ] 66 0.028% 99.875% ( 22, 34 ] 16 0.007% 99.882% ( 34, 51 ] 5 0.002% 99.884% ( 51, 76 ] 4 0.002% 99.886% ( 76, 110 ] 8 0.003% 99.889% ( 110, 170 ] 11 0.005% 99.894% ( 170, 250 ] 37 0.016% 99.910% ( 250, 380 ] 60 0.026% 99.936% ( 380, 580 ] 43 0.019% 99.954% ( 580, 870 ] 52 0.022% 99.977% ( 870, 1300 ] 37 0.016% 99.993% ( 1300, 1900 ] 18 0.008% 100.000% ( 1900, 2900 ] 27 0.012% 100.012% ( 2900, 4400 ] 24 0.010% 100.022% ( 4400, 6600 ] 10 0.004% 100.027% ** Level 3 read latency histogram (micros): Count: 1225272 Average: 5.8591 StdDev: 86.77 Min: 0 Median: 2.1105 Max: 10318 Percentiles: P50: 2.11 P75: 2.97 P99: 9.55 P99.9: 154.10 P99.99: 322.54 ------------------------------------------------------ [ 0, 1 ] 23585 1.925% 1.925% ( 1, 2 ] 549634 44.858% 46.783% ######### ( 2, 3 ] 356796 29.120% 75.903% ###### ( 3, 4 ] 123655 10.092% 85.995% ## ( 4, 6 ] 132988 10.854% 96.849% ## ( 6, 10 ] 29722 2.426% 99.274% ( 10, 15 ] 5905 0.482% 99.756% ( 15, 22 ] 594 0.048% 99.805% ( 22, 34 ] 70 0.006% 99.810% ( 34, 51 ] 354 0.029% 99.839% ( 51, 76 ] 136 0.011% 99.850% ( 76, 110 ] 119 0.010% 99.860% ( 110, 170 ] 665 0.054% 99.914% ( 170, 250 ] 595 0.049% 99.963% ( 250, 380 ] 594 0.048% 100.011% ( 380, 580 ] 432 0.035% 100.047% ( 580, 870 ] 354 0.029% 100.076% ( 870, 1300 ] 238 0.019% 100.095% ( 1300, 1900 ] 157 0.013% 100.108% ( 1900, 2900 ] 233 0.019% 100.127% ( 2900, 4400 ] 289 0.024% 100.150% ( 4400, 6600 ] 67 0.005% 100.156% ( 6600, 9900 ] 21 0.002% 100.158% ( 9900, 14000 ] 1 0.000% 100.158% ** Level 4 read latency histogram (micros): Count: 37789 Average: 96.2575 StdDev: 456.70 Min: 0 Median: 2.3851 Max: 8657 Percentiles: P50: 2.39 P75: 3.58 P99: 2692.59 P99.9: 5112.00 P99.99: 7332.96 ------------------------------------------------------ [ 0, 1 ] 430 1.138% 1.138% ( 1, 2 ] 14180 37.524% 38.662% ######## ( 2, 3 ] 11126 29.442% 68.104% ###### ( 3, 4 ] 4460 11.802% 79.907% ## ( 4, 6 ] 3108 8.225% 88.131% ## ( 6, 10 ] 897 2.374% 90.505% ( 10, 15 ] 247 0.654% 91.159% ( 15, 22 ] 52 0.138% 91.296% ( 22, 34 ] 11 0.029% 91.326% ( 34, 51 ] 1 0.003% 91.328% ( 76, 110 ] 9 0.024% 91.352% ( 110, 170 ] 237 0.627% 91.979% ( 170, 250 ] 366 0.969% 92.948% ( 250, 380 ] 446 1.180% 94.128% ( 380, 580 ] 525 1.389% 95.517% ( 580, 870 ] 481 1.273% 96.790% ( 870, 1300 ] 379 1.003% 97.793% ( 1300, 1900 ] 254 0.672% 98.465% ( 1900, 2900 ] 255 0.675% 99.140% ( 2900, 4400 ] 272 0.720% 99.860% ( 4400, 6600 ] 47 0.124% 99.984% ( 6600, 9900 ] 10 0.026% 100.011% ** Level 5 read latency histogram (micros): Count: 240 Average: 935.6625 StdDev: 1199.92 Min: 89 Median: 416.3636 Max: 7509 Percentiles: P50: 416.36 P75: 1195.76 P99: 7260.00 P99.9: 7509.00 P99.99: 7509.00 ------------------------------------------------------ ( 76, 110 ] 9 3.750% 3.750% # ( 110, 170 ] 37 15.417% 19.167% ### ( 170, 250 ] 36 15.000% 34.167% ### ( 250, 380 ] 34 14.167% 48.333% ### ( 380, 580 ] 22 9.167% 57.500% ## ( 580, 870 ] 17 7.083% 64.583% # ( 870, 1300 ] 33 13.750% 78.333% ### ( 1300, 1900 ] 20 8.333% 86.667% ## ( 1900, 2900 ] 16 6.667% 93.333% # ( 2900, 4400 ] 11 4.583% 97.917% # ( 4400, 6600 ] 2 0.833% 98.750% ( 6600, 9900 ] 3 1.250% 100.000% ** DB Stats ** Uptime(secs): 42.9 total, 4.4 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 183.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.784 H:M:S, 41.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 226.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.232 H:M:S, 28.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/06-15:17:16 ... thread 0: (1000000,9000000) ops and (117650.8,175842.8) ops/second in (8.499729,51.182093) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/6 2.09 GB 81.8 7.3 0.0 7.3 15.8 8.5 0.0 1.9 128.2 276.8 58.47 52.34 161 0.363 7612K 7409 0.0 0.0 L1 2/0 71.99 MB 7.2 6.2 6.2 0.0 6.1 6.1 0.2 1.0 221.7 218.5 28.69 27.23 3 9.562 6458K 91K 0.0 0.0 L2 3/2 363.78 MB 1.3 1.5 1.3 0.3 1.5 1.3 5.0 1.2 201.4 200.9 7.80 7.06 3 2.600 452K 166 0.0 0.0 L3 28/15 2.47 GB 1.3 5.6 3.1 2.4 5.5 3.1 2.8 1.8 177.8 176.6 32.01 25.94 18 1.778 5779K 38K 0.0 0.0 L4 184/34 9.87 GB 0.9 3.8 3.4 0.5 3.8 3.4 0.9 1.1 123.5 123.2 31.89 19.34 52 0.613 3905K 6840 0.0 0.0 L5 1108/0 89.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1335/57 104.48 GB 0.0 24.5 14.0 10.4 32.8 22.4 12.8 3.9 157.7 211.5 158.85 131.91 237 0.670 24M 144K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.5 14.0 10.4 32.8 22.4 12.7 3.9 157.7 211.5 158.85 131.91 237 0.670 24M 144K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.5 14.0 10.4 24.3 13.9 0.0 0.0 191.2 190.0 131.06 109.07 105 1.248 24M 144K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 312.8 27.79 22.84 132 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 51.4 total, 51.2 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.81 GB write, 653.71 MB/s write, 24.47 GB read, 487.52 MB/s read, 158.9 seconds Interval compaction: 32.81 GB write, 656.43 MB/s write, 24.47 GB read, 489.54 MB/s read, 158.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 25, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 25, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 41, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 25, total-stops: 41, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3871883 Average: 2.6661 StdDev: 23.75 Min: 0 Median: 1.5359 Max: 8022 Percentiles: P50: 1.54 P75: 1.93 P99: 6.98 P99.9: 119.43 P99.99: 239.13 ------------------------------------------------------ [ 0, 1 ] 616728 15.928% 15.928% ### ( 1, 2 ] 2461881 63.584% 79.512% ############# ( 2, 3 ] 467423 12.072% 91.584% ## ( 3, 4 ] 148235 3.828% 95.413% # ( 4, 6 ] 130376 3.367% 98.780% # ( 6, 10 ] 34937 0.902% 99.682% ( 10, 15 ] 5972 0.154% 99.836% ( 15, 22 ] 798 0.021% 99.857% ( 22, 34 ] 93 0.002% 99.859% ( 34, 51 ] 23 0.001% 99.860% ( 51, 76 ] 40 0.001% 99.861% ( 76, 110 ] 968 0.025% 99.886% ( 110, 170 ] 3424 0.088% 99.975% ( 170, 250 ] 693 0.018% 99.992% ( 250, 380 ] 470 0.012% 100.005% ( 380, 580 ] 275 0.007% 100.012% ( 580, 870 ] 172 0.004% 100.016% ( 870, 1300 ] 91 0.002% 100.018% ( 1300, 1900 ] 41 0.001% 100.020% ( 1900, 2900 ] 43 0.001% 100.021% ( 2900, 4400 ] 75 0.002% 100.023% ( 4400, 6600 ] 11 0.000% 100.023% ( 6600, 9900 ] 3 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1161752 Average: 4.9277 StdDev: 73.50 Min: 1 Median: 2.1150 Max: 9154 Percentiles: P50: 2.11 P75: 2.96 P99: 9.31 P99.9: 16.83 P99.99: 143.43 ------------------------------------------------------ [ 0, 1 ] 11524 0.992% 0.992% ( 1, 2 ] 529862 45.609% 46.601% ######### ( 2, 3 ] 343448 29.563% 76.164% ###### ( 3, 4 ] 118249 10.179% 86.342% ## ( 4, 6 ] 122624 10.555% 96.897% ## ( 6, 10 ] 29537 2.542% 99.440% # ( 10, 15 ] 5215 0.449% 99.889% ( 15, 22 ] 507 0.044% 99.932% ( 22, 34 ] 56 0.005% 99.937% ( 34, 51 ] 17 0.001% 99.939% ( 51, 76 ] 18 0.002% 99.940% ( 76, 110 ] 153 0.013% 99.953% ( 110, 170 ] 766 0.066% 100.019% ( 170, 250 ] 506 0.044% 100.063% ( 250, 380 ] 338 0.029% 100.092% ( 380, 580 ] 237 0.020% 100.112% ( 580, 870 ] 155 0.013% 100.126% ( 870, 1300 ] 103 0.009% 100.135% ( 1300, 1900 ] 57 0.005% 100.139% ( 1900, 2900 ] 149 0.013% 100.152% ( 2900, 4400 ] 194 0.017% 100.169% ( 4400, 6600 ] 51 0.004% 100.173% ( 6600, 9900 ] 15 0.001% 100.175% ** Level 2 read latency histogram (micros): Count: 393448 Average: 6.5728 StdDev: 107.97 Min: 1 Median: 2.0314 Max: 7965 Percentiles: P50: 2.03 P75: 2.94 P99: 9.68 P99.9: 475.05 P99.99: 2837.12 ------------------------------------------------------ [ 0, 1 ] 16591 4.217% 4.217% # ( 1, 2 ] 176714 44.914% 49.131% ######### ( 2, 3 ] 108783 27.649% 76.780% ###### ( 3, 4 ] 37473 9.524% 86.304% ## ( 4, 6 ] 41211 10.474% 96.778% ## ( 6, 10 ] 9505 2.416% 99.194% ( 10, 15 ] 2074 0.527% 99.721% ( 15, 22 ] 155 0.039% 99.761% ( 22, 34 ] 25 0.006% 99.767% ( 34, 51 ] 20 0.005% 99.772% ( 51, 76 ] 13 0.003% 99.775% ( 76, 110 ] 11 0.003% 99.778% ( 110, 170 ] 61 0.016% 99.794% ( 170, 250 ] 178 0.045% 99.839% ( 250, 380 ] 184 0.047% 99.886% ( 380, 580 ] 119 0.030% 99.916% ( 580, 870 ] 86 0.022% 99.938% ( 870, 1300 ] 71 0.018% 99.956% ( 1300, 1900 ] 55 0.014% 99.970% ( 1900, 2900 ] 85 0.022% 99.991% ( 2900, 4400 ] 142 0.036% 100.027% ( 4400, 6600 ] 40 0.010% 100.038% ( 6600, 9900 ] 13 0.003% 100.041% ** Level 3 read latency histogram (micros): Count: 1322017 Average: 6.3573 StdDev: 95.44 Min: 0 Median: 2.1325 Max: 10318 Percentiles: P50: 2.13 P75: 2.98 P99: 9.63 P99.9: 205.86 P99.99: 422.75 ------------------------------------------------------ [ 0, 1 ] 23850 1.804% 1.804% ( 1, 2 ] 585691 44.303% 46.107% ######### ( 2, 3 ] 388513 29.388% 75.495% ###### ( 3, 4 ] 135066 10.217% 85.711% ## ( 4, 6 ] 146066 11.049% 96.760% ## ( 6, 10 ] 32602 2.466% 99.226% ( 10, 15 ] 6545 0.495% 99.721% ( 15, 22 ] 656 0.050% 99.771% ( 22, 34 ] 77 0.006% 99.777% ( 34, 51 ] 356 0.027% 99.804% ( 51, 76 ] 139 0.011% 99.814% ( 76, 110 ] 124 0.009% 99.824% ( 110, 170 ] 707 0.053% 99.877% ( 170, 250 ] 676 0.051% 99.928% ( 250, 380 ] 705 0.053% 99.982% ( 380, 580 ] 523 0.040% 100.021% ( 580, 870 ] 410 0.031% 100.052% ( 870, 1300 ] 280 0.021% 100.073% ( 1300, 1900 ] 190 0.014% 100.088% ( 1900, 2900 ] 290 0.022% 100.110% ( 2900, 4400 ] 393 0.030% 100.139% ( 4400, 6600 ] 92 0.007% 100.146% ( 6600, 9900 ] 27 0.002% 100.148% ( 9900, 14000 ] 1 0.000% 100.148% ** Level 4 read latency histogram (micros): Count: 211895 Average: 32.1026 StdDev: 273.87 Min: 0 Median: 2.3705 Max: 8686 Percentiles: P50: 2.37 P75: 3.46 P99: 747.85 P99.9: 3791.35 P99.99: 4324.05 ------------------------------------------------------ [ 0, 1 ] 1141 0.538% 0.538% ( 1, 2 ] 80367 37.928% 38.466% ######## ( 2, 3 ] 65971 31.134% 69.600% ###### ( 3, 4 ] 24676 11.645% 81.245% ## ( 4, 6 ] 26294 12.409% 93.654% ## ( 6, 10 ] 6685 3.155% 96.809% # ( 10, 15 ] 1377 0.650% 97.459% ( 15, 22 ] 167 0.079% 97.538% ( 22, 34 ] 27 0.013% 97.551% ( 34, 51 ] 20 0.009% 97.560% ( 51, 76 ] 14 0.007% 97.567% ( 76, 110 ] 24 0.011% 97.578% ( 110, 170 ] 325 0.153% 97.731% ( 170, 250 ] 657 0.310% 98.041% ( 250, 380 ] 809 0.382% 98.423% ( 380, 580 ] 826 0.390% 98.813% ( 580, 870 ] 686 0.324% 99.137% ( 870, 1300 ] 548 0.259% 99.395% ( 1300, 1900 ] 359 0.169% 99.565% ( 1900, 2900 ] 392 0.185% 99.750% ( 2900, 4400 ] 537 0.253% 100.003% ( 4400, 6600 ] 115 0.054% 100.058% ( 6600, 9900 ] 30 0.014% 100.072% ** Level 5 read latency histogram (micros): Count: 240 Average: 935.6625 StdDev: 1199.92 Min: 89 Median: 416.3636 Max: 7509 Percentiles: P50: 416.36 P75: 1195.76 P99: 7260.00 P99.9: 7509.00 P99.99: 7509.00 ------------------------------------------------------ ( 76, 110 ] 9 3.750% 3.750% # ( 110, 170 ] 37 15.417% 19.167% ### ( 170, 250 ] 36 15.000% 34.167% ### ( 250, 380 ] 34 14.167% 48.333% ### ( 380, 580 ] 22 9.167% 57.500% ## ( 580, 870 ] 17 7.083% 64.583% # ( 870, 1300 ] 33 13.750% 78.333% ### ( 1300, 1900 ] 20 8.333% 86.667% ## ( 1900, 2900 ] 16 6.667% 93.333% # ( 2900, 4400 ] 11 4.583% 97.917% # ( 4400, 6600 ] 2 0.833% 98.750% ( 6600, 9900 ] 3 1.250% 100.000% ** DB Stats ** Uptime(secs): 51.4 total, 8.5 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 172.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.965 H:M:S, 44.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 115.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.181 H:M:S, 60.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/06-15:17:22 ... thread 0: (1000000,10000000) ops and (180425.9,176290.6) ops/second in (5.542440,56.724533) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/14 3.07 GB 37.7 9.0 0.0 9.0 18.4 9.5 0.0 1.9 128.0 262.9 71.82 62.22 176 0.408 9337K 15K 0.0 0.0 L1 2/2 71.99 MB 0.0 6.2 6.2 0.0 6.1 6.1 0.2 1.0 221.7 218.5 28.69 27.23 3 9.562 6458K 91K 0.0 0.0 L2 0/0 0.00 KB 0.0 1.5 1.3 0.3 1.5 1.3 5.0 1.2 201.4 200.9 7.80 7.06 3 2.600 452K 166 0.0 0.0 L3 12/2 1006.89 MB 0.9 6.2 3.4 2.8 6.2 3.3 2.9 1.8 170.3 169.1 37.42 29.27 20 1.871 6473K 46K 0.0 0.0 L4 173/12 10.66 GB 1.0 8.5 5.2 3.3 8.4 5.1 0.9 1.6 125.1 124.2 69.61 42.92 71 0.980 8738K 61K 0.0 0.0 L5 1120/0 90.61 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1322/30 105.39 GB 0.0 31.5 16.0 15.4 40.7 25.3 13.9 4.3 149.6 193.6 215.34 168.71 273 0.789 31M 215K 0.0 0.0 Int 0/0 0.00 KB 0.0 31.5 16.0 15.4 40.7 25.3 13.9 4.3 149.6 193.6 215.34 168.71 273 0.789 31M 215K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 31.5 16.0 15.4 31.2 15.8 0.0 0.0 176.9 175.6 182.13 142.98 128 1.423 31M 215K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 292.2 33.20 25.73 145 0.229 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.9 total, 56.7 interval Flush(GB): cumulative 9.475, interval 9.475 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 40.71 GB write, 732.17 MB/s write, 31.46 GB read, 565.72 MB/s read, 215.3 seconds Interval compaction: 40.71 GB write, 734.92 MB/s write, 31.46 GB read, 567.85 MB/s read, 215.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 25, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 25, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 54, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 25, total-stops: 54, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4241181 Average: 2.9320 StdDev: 35.11 Min: 0 Median: 1.5728 Max: 14746 Percentiles: P50: 1.57 P75: 1.98 P99: 7.61 P99.9: 121.60 P99.99: 285.98 ------------------------------------------------------ [ 0, 1 ] 621031 14.643% 14.643% ### ( 1, 2 ] 2618160 61.732% 76.375% ############ ( 2, 3 ] 582951 13.745% 90.120% ### ( 3, 4 ] 184604 4.353% 94.472% # ( 4, 6 ] 173583 4.093% 98.565% # ( 6, 10 ] 45695 1.077% 99.643% ( 10, 15 ] 8038 0.190% 99.832% ( 15, 22 ] 1046 0.025% 99.857% ( 22, 34 ] 115 0.003% 99.860% ( 34, 51 ] 31 0.001% 99.860% ( 51, 76 ] 45 0.001% 99.861% ( 76, 110 ] 972 0.023% 99.884% ( 110, 170 ] 3475 0.082% 99.966% ( 170, 250 ] 842 0.020% 99.986% ( 250, 380 ] 621 0.015% 100.001% ( 380, 580 ] 378 0.009% 100.010% ( 580, 870 ] 238 0.006% 100.015% ( 870, 1300 ] 129 0.003% 100.018% ( 1300, 1900 ] 81 0.002% 100.020% ( 1900, 2900 ] 101 0.002% 100.023% ( 2900, 4400 ] 173 0.004% 100.027% ( 4400, 6600 ] 35 0.001% 100.027% ( 6600, 9900 ] 8 0.000% 100.028% ( 14000, 22000 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 1432161 Average: 5.1779 StdDev: 78.86 Min: 1 Median: 2.1603 Max: 13725 Percentiles: P50: 2.16 P75: 2.99 P99: 9.43 P99.9: 18.99 P99.99: 162.17 ------------------------------------------------------ [ 0, 1 ] 13073 0.913% 0.913% ( 1, 2 ] 634166 44.280% 45.193% ######### ( 2, 3 ] 429337 29.978% 75.171% ###### ( 3, 4 ] 149052 10.407% 85.579% ## ( 4, 6 ] 159174 11.114% 96.693% ## ( 6, 10 ] 38552 2.692% 99.385% # ( 10, 15 ] 6965 0.486% 99.871% ( 15, 22 ] 719 0.050% 99.922% ( 22, 34 ] 76 0.005% 99.927% ( 34, 51 ] 40 0.003% 99.930% ( 51, 76 ] 34 0.002% 99.932% ( 76, 110 ] 155 0.011% 99.943% ( 110, 170 ] 776 0.054% 99.997% ( 170, 250 ] 577 0.040% 100.037% ( 250, 380 ] 486 0.034% 100.071% ( 380, 580 ] 388 0.027% 100.098% ( 580, 870 ] 243 0.017% 100.115% ( 870, 1300 ] 143 0.010% 100.125% ( 1300, 1900 ] 71 0.005% 100.130% ( 1900, 2900 ] 191 0.013% 100.144% ( 2900, 4400 ] 268 0.019% 100.162% ( 4400, 6600 ] 68 0.005% 100.167% ( 6600, 9900 ] 24 0.002% 100.169% ( 9900, 14000 ] 1 0.000% 100.169% ** Level 2 read latency histogram (micros): Count: 397601 Average: 6.5965 StdDev: 108.34 Min: 1 Median: 2.0373 Max: 7965 Percentiles: P50: 2.04 P75: 2.94 P99: 9.69 P99.9: 479.83 P99.99: 2868.64 ------------------------------------------------------ [ 0, 1 ] 16604 4.176% 4.176% # ( 1, 2 ] 178091 44.791% 48.967% ######### ( 2, 3 ] 110187 27.713% 76.680% ###### ( 3, 4 ] 37984 9.553% 86.234% ## ( 4, 6 ] 41835 10.522% 96.756% ## ( 6, 10 ] 9669 2.432% 99.187% ( 10, 15 ] 2120 0.533% 99.721% ( 15, 22 ] 161 0.040% 99.761% ( 22, 34 ] 25 0.006% 99.767% ( 34, 51 ] 20 0.005% 99.772% ( 51, 76 ] 13 0.003% 99.776% ( 76, 110 ] 12 0.003% 99.779% ( 110, 170 ] 61 0.015% 99.794% ( 170, 250 ] 178 0.045% 99.839% ( 250, 380 ] 184 0.046% 99.885% ( 380, 580 ] 119 0.030% 99.915% ( 580, 870 ] 86 0.022% 99.937% ( 870, 1300 ] 71 0.018% 99.954% ( 1300, 1900 ] 56 0.014% 99.969% ( 1900, 2900 ] 88 0.022% 99.991% ( 2900, 4400 ] 144 0.036% 100.027% ( 4400, 6600 ] 41 0.010% 100.037% ( 6600, 9900 ] 13 0.003% 100.040% ** Level 3 read latency histogram (micros): Count: 1495738 Average: 6.7259 StdDev: 108.60 Min: 0 Median: 2.1572 Max: 29465 Percentiles: P50: 2.16 P75: 3.00 P99: 9.65 P99.9: 226.58 P99.99: 487.12 ------------------------------------------------------ [ 0, 1 ] 24954 1.668% 1.668% ( 1, 2 ] 653042 43.660% 45.329% ######### ( 2, 3 ] 444527 29.720% 75.048% ###### ( 3, 4 ] 155438 10.392% 85.440% ## ( 4, 6 ] 168833 11.288% 96.728% ## ( 6, 10 ] 37201 2.487% 99.215% ( 10, 15 ] 7512 0.502% 99.717% ( 15, 22 ] 748 0.050% 99.767% ( 22, 34 ] 85 0.006% 99.773% ( 34, 51 ] 368 0.025% 99.797% ( 51, 76 ] 148 0.010% 99.807% ( 76, 110 ] 128 0.009% 99.816% ( 110, 170 ] 725 0.048% 99.864% ( 170, 250 ] 754 0.050% 99.915% ( 250, 380 ] 788 0.053% 99.967% ( 380, 580 ] 630 0.042% 100.010% ( 580, 870 ] 479 0.032% 100.042% ( 870, 1300 ] 329 0.022% 100.064% ( 1300, 1900 ] 228 0.015% 100.079% ( 1900, 2900 ] 341 0.023% 100.102% ( 2900, 4400 ] 490 0.033% 100.134% ( 4400, 6600 ] 123 0.008% 100.143% ( 6600, 9900 ] 39 0.003% 100.145% ( 9900, 14000 ] 5 0.000% 100.146% ( 14000, 22000 ] 3 0.000% 100.146% ( 22000, 33000 ] 1 0.000% 100.146% ** Level 4 read latency histogram (micros): Count: 904421 Average: 16.1280 StdDev: 191.03 Min: 0 Median: 2.3016 Max: 21772 Percentiles: P50: 2.30 P75: 3.29 P99: 49.59 P99.9: 1789.93 P99.99: 2785.27 ------------------------------------------------------ [ 0, 1 ] 5638 0.623% 0.623% ( 1, 2 ] 361470 39.967% 40.590% ######## ( 2, 3 ] 282154 31.197% 71.788% ###### ( 3, 4 ] 100512 11.113% 82.901% ## ( 4, 6 ] 111623 12.342% 95.243% ## ( 6, 10 ] 27367 3.026% 98.269% # ( 10, 15 ] 5742 0.635% 98.904% ( 15, 22 ] 664 0.073% 98.977% ( 22, 34 ] 83 0.009% 98.986% ( 34, 51 ] 135 0.015% 99.001% ( 51, 76 ] 91 0.010% 99.011% ( 76, 110 ] 52 0.006% 99.017% ( 110, 170 ] 516 0.057% 99.074% ( 170, 250 ] 1401 0.155% 99.229% ( 250, 380 ] 1887 0.209% 99.438% ( 380, 580 ] 1645 0.182% 99.620% ( 580, 870 ] 1210 0.134% 99.753% ( 870, 1300 ] 844 0.093% 99.847% ( 1300, 1900 ] 591 0.065% 99.912% ( 1900, 2900 ] 797 0.088% 100.000% ( 2900, 4400 ] 995 0.110% 100.110% ( 4400, 6600 ] 246 0.027% 100.137% ( 6600, 9900 ] 62 0.007% 100.144% ( 9900, 14000 ] 3 0.000% 100.145% ( 14000, 22000 ] 5 0.001% 100.145% ** Level 5 read latency histogram (micros): Count: 300 Average: 907.2867 StdDev: 1142.47 Min: 89 Median: 411.2500 Max: 7509 Percentiles: P50: 411.25 P75: 1174.15 P99: 6600.00 P99.9: 7509.00 P99.99: 7509.00 ------------------------------------------------------ ( 76, 110 ] 9 3.000% 3.000% # ( 110, 170 ] 47 15.667% 18.667% ### ( 170, 250 ] 48 16.000% 34.667% ### ( 250, 380 ] 41 13.667% 48.333% ### ( 380, 580 ] 32 10.667% 59.000% ## ( 580, 870 ] 19 6.333% 65.333% # ( 870, 1300 ] 41 13.667% 79.000% ### ( 1300, 1900 ] 21 7.000% 86.000% # ( 1900, 2900 ] 25 8.333% 94.333% ## ( 2900, 4400 ] 12 4.000% 98.333% # ( 4400, 6600 ] 2 0.667% 99.000% ( 6600, 9900 ] 3 1.000% 100.000% ** DB Stats ** Uptime(secs): 56.9 total, 5.5 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 172.85 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.755 H:M:S, 43.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 177.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.790 H:M:S, 32.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/06-15:17:25 ... thread 0: (1000000,11000000) ops and (318024.0,183734.6) ops/second in (3.144417,59.868950) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 4.05 GB 169.9 10.1 0.0 10.1 20.5 10.4 0.0 2.0 130.2 265.0 79.34 69.40 195 0.407 10M 16K 0.0 0.0 L1 2/2 71.99 MB 0.0 6.2 6.2 0.0 6.1 6.1 0.2 1.0 221.7 218.5 28.69 27.23 3 9.562 6458K 91K 0.0 0.0 L2 0/0 0.00 KB 0.0 1.5 1.3 0.3 1.5 1.3 5.0 1.2 201.4 200.9 7.80 7.06 3 2.600 452K 166 0.0 0.0 L3 10/0 875.52 MB 0.9 6.2 3.4 2.8 6.2 3.3 2.9 1.8 170.3 169.1 37.42 29.27 20 1.871 6473K 46K 0.0 0.0 L4 166/0 9.76 GB 1.0 9.6 5.3 4.3 9.5 5.2 0.9 1.8 130.5 129.1 75.04 47.29 72 1.042 9133K 61K 0.0 0.0 L5 1132/0 91.60 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1328/12 106.34 GB 0.0 33.6 16.2 17.5 43.8 26.4 14.9 4.2 150.8 196.6 228.29 180.25 293 0.779 33M 216K 0.0 0.0 Int 0/0 0.00 KB 0.0 33.6 16.2 17.5 43.8 26.4 14.9 4.2 150.8 196.6 228.29 180.25 293 0.779 33M 216K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 33.6 16.2 17.5 33.4 15.9 0.0 0.0 179.1 177.7 192.21 151.89 133 1.445 33M 216K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 296.9 36.07 28.35 160 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 60.1 total, 59.9 interval Flush(GB): cumulative 10.459, interval 10.459 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 43.82 GB write, 746.84 MB/s write, 33.62 GB read, 573.00 MB/s read, 228.3 seconds Interval compaction: 43.82 GB write, 749.49 MB/s write, 33.62 GB read, 575.03 MB/s read, 228.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 25, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 25, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 55, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 25, total-stops: 55, interval: 80 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4676843 Average: 2.9101 StdDev: 33.49 Min: 0 Median: 1.5911 Max: 14746 Percentiles: P50: 1.59 P75: 2.00 P99: 7.61 P99.9: 110.05 P99.99: 229.73 ------------------------------------------------------ [ 0, 1 ] 639460 13.673% 13.673% ### ( 1, 2 ] 2874061 61.453% 75.126% ############ ( 2, 3 ] 686722 14.683% 89.809% ### ( 3, 4 ] 211385 4.520% 94.329% # ( 4, 6 ] 197658 4.226% 98.555% # ( 6, 10 ] 51784 1.107% 99.663% ( 10, 15 ] 8757 0.187% 99.850% ( 15, 22 ] 1149 0.025% 99.875% ( 22, 34 ] 122 0.003% 99.877% ( 34, 51 ] 36 0.001% 99.878% ( 51, 76 ] 49 0.001% 99.879% ( 76, 110 ] 981 0.021% 99.900% ( 110, 170 ] 3556 0.076% 99.976% ( 170, 250 ] 879 0.019% 99.995% ( 250, 380 ] 644 0.014% 100.009% ( 380, 580 ] 394 0.008% 100.017% ( 580, 870 ] 240 0.005% 100.022% ( 870, 1300 ] 134 0.003% 100.025% ( 1300, 1900 ] 82 0.002% 100.027% ( 1900, 2900 ] 101 0.002% 100.029% ( 2900, 4400 ] 173 0.004% 100.033% ( 4400, 6600 ] 35 0.001% 100.033% ( 6600, 9900 ] 8 0.000% 100.034% ( 14000, 22000 ] 1 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 1432161 Average: 5.1779 StdDev: 78.86 Min: 1 Median: 2.1603 Max: 13725 Percentiles: P50: 2.16 P75: 2.99 P99: 9.43 P99.9: 18.99 P99.99: 162.17 ------------------------------------------------------ [ 0, 1 ] 13073 0.913% 0.913% ( 1, 2 ] 634166 44.280% 45.193% ######### ( 2, 3 ] 429337 29.978% 75.171% ###### ( 3, 4 ] 149052 10.407% 85.579% ## ( 4, 6 ] 159174 11.114% 96.693% ## ( 6, 10 ] 38552 2.692% 99.385% # ( 10, 15 ] 6965 0.486% 99.871% ( 15, 22 ] 719 0.050% 99.922% ( 22, 34 ] 76 0.005% 99.927% ( 34, 51 ] 40 0.003% 99.930% ( 51, 76 ] 34 0.002% 99.932% ( 76, 110 ] 155 0.011% 99.943% ( 110, 170 ] 776 0.054% 99.997% ( 170, 250 ] 577 0.040% 100.037% ( 250, 380 ] 486 0.034% 100.071% ( 380, 580 ] 388 0.027% 100.098% ( 580, 870 ] 243 0.017% 100.115% ( 870, 1300 ] 143 0.010% 100.125% ( 1300, 1900 ] 71 0.005% 100.130% ( 1900, 2900 ] 191 0.013% 100.144% ( 2900, 4400 ] 268 0.019% 100.162% ( 4400, 6600 ] 68 0.005% 100.167% ( 6600, 9900 ] 24 0.002% 100.169% ( 9900, 14000 ] 1 0.000% 100.169% ** Level 2 read latency histogram (micros): Count: 397601 Average: 6.5965 StdDev: 108.34 Min: 1 Median: 2.0373 Max: 7965 Percentiles: P50: 2.04 P75: 2.94 P99: 9.69 P99.9: 479.83 P99.99: 2868.64 ------------------------------------------------------ [ 0, 1 ] 16604 4.176% 4.176% # ( 1, 2 ] 178091 44.791% 48.967% ######### ( 2, 3 ] 110187 27.713% 76.680% ###### ( 3, 4 ] 37984 9.553% 86.234% ## ( 4, 6 ] 41835 10.522% 96.756% ## ( 6, 10 ] 9669 2.432% 99.187% ( 10, 15 ] 2120 0.533% 99.721% ( 15, 22 ] 161 0.040% 99.761% ( 22, 34 ] 25 0.006% 99.767% ( 34, 51 ] 20 0.005% 99.772% ( 51, 76 ] 13 0.003% 99.776% ( 76, 110 ] 12 0.003% 99.779% ( 110, 170 ] 61 0.015% 99.794% ( 170, 250 ] 178 0.045% 99.839% ( 250, 380 ] 184 0.046% 99.885% ( 380, 580 ] 119 0.030% 99.915% ( 580, 870 ] 86 0.022% 99.937% ( 870, 1300 ] 71 0.018% 99.954% ( 1300, 1900 ] 56 0.014% 99.969% ( 1900, 2900 ] 88 0.022% 99.991% ( 2900, 4400 ] 144 0.036% 100.027% ( 4400, 6600 ] 41 0.010% 100.037% ( 6600, 9900 ] 13 0.003% 100.040% ** Level 3 read latency histogram (micros): Count: 1588943 Average: 6.5150 StdDev: 105.39 Min: 0 Median: 2.1279 Max: 29465 Percentiles: P50: 2.13 P75: 2.98 P99: 9.62 P99.9: 220.98 P99.99: 484.92 ------------------------------------------------------ [ 0, 1 ] 27550 1.734% 1.734% ( 1, 2 ] 707173 44.506% 46.240% ######### ( 2, 3 ] 467008 29.391% 75.631% ###### ( 3, 4 ] 161528 10.166% 85.797% ## ( 4, 6 ] 174191 10.963% 96.759% ## ( 6, 10 ] 39294 2.473% 99.232% ( 10, 15 ] 7693 0.484% 99.716% ( 15, 22 ] 760 0.048% 99.764% ( 22, 34 ] 85 0.005% 99.770% ( 34, 51 ] 369 0.023% 99.793% ( 51, 76 ] 148 0.009% 99.802% ( 76, 110 ] 161 0.010% 99.812% ( 110, 170 ] 883 0.056% 99.868% ( 170, 250 ] 802 0.050% 99.918% ( 250, 380 ] 806 0.051% 99.969% ( 380, 580 ] 635 0.040% 100.009% ( 580, 870 ] 479 0.030% 100.039% ( 870, 1300 ] 329 0.021% 100.060% ( 1300, 1900 ] 228 0.014% 100.074% ( 1900, 2900 ] 341 0.021% 100.096% ( 2900, 4400 ] 490 0.031% 100.126% ( 4400, 6600 ] 123 0.008% 100.134% ( 6600, 9900 ] 39 0.002% 100.137% ( 9900, 14000 ] 5 0.000% 100.137% ( 14000, 22000 ] 3 0.000% 100.137% ( 22000, 33000 ] 1 0.000% 100.137% ** Level 4 read latency histogram (micros): Count: 946196 Average: 15.5563 StdDev: 186.80 Min: 0 Median: 2.2759 Max: 21772 Percentiles: P50: 2.28 P75: 3.24 P99: 20.86 P99.9: 1747.52 P99.99: 2780.03 ------------------------------------------------------ [ 0, 1 ] 6838 0.723% 0.723% ( 1, 2 ] 385690 40.762% 41.485% ######## ( 2, 3 ] 292060 30.867% 72.352% ###### ( 3, 4 ] 103305 10.918% 83.270% ## ( 4, 6 ] 114091 12.058% 95.327% ## ( 6, 10 ] 28252 2.986% 98.313% # ( 10, 15 ] 5931 0.627% 98.940% ( 15, 22 ] 677 0.072% 99.012% ( 22, 34 ] 84 0.009% 99.020% ( 34, 51 ] 151 0.016% 99.036% ( 51, 76 ] 107 0.011% 99.048% ( 76, 110 ] 56 0.006% 99.054% ( 110, 170 ] 540 0.057% 99.111% ( 170, 250 ] 1404 0.148% 99.259% ( 250, 380 ] 1916 0.202% 99.462% ( 380, 580 ] 1651 0.174% 99.636% ( 580, 870 ] 1211 0.128% 99.764% ( 870, 1300 ] 845 0.089% 99.853% ( 1300, 1900 ] 591 0.062% 99.916% ( 1900, 2900 ] 797 0.084% 100.000% ( 2900, 4400 ] 995 0.105% 100.105% ( 4400, 6600 ] 246 0.026% 100.131% ( 6600, 9900 ] 62 0.007% 100.138% ( 9900, 14000 ] 3 0.000% 100.138% ( 14000, 22000 ] 5 0.001% 100.139% ** Level 5 read latency histogram (micros): Count: 360 Average: 835.6694 StdDev: 1075.39 Min: 89 Median: 369.3878 Max: 7509 Percentiles: P50: 369.39 P75: 1106.08 P99: 5940.00 P99.9: 7509.00 P99.99: 7509.00 ------------------------------------------------------ ( 76, 110 ] 19 5.278% 5.278% # ( 110, 170 ] 61 16.944% 22.222% ### ( 170, 250 ] 55 15.278% 37.500% ### ( 250, 380 ] 49 13.611% 51.111% ### ( 380, 580 ] 37 10.278% 61.389% ## ( 580, 870 ] 21 5.833% 67.222% # ( 870, 1300 ] 51 14.167% 81.389% ### ( 1300, 1900 ] 23 6.389% 87.778% # ( 1900, 2900 ] 27 7.500% 95.278% ## ( 2900, 4400 ] 12 3.333% 98.611% # ( 4400, 6600 ] 2 0.556% 99.167% ( 6600, 9900 ] 3 0.833% 100.000% ** DB Stats ** Uptime(secs): 60.1 total, 3.1 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 180.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.919 H:M:S, 41.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 313.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.164 H:M:S, 5.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.431 micros/op 184125 ops/sec 60.002 seconds 11047999 operations; 178.4 MB/s Microseconds per write: Count: 11047999 Average: 5.4311 StdDev: 481.57 Min: 0 Median: 1.8627 Max: 695939 Percentiles: P50: 1.86 P75: 3.20 P99: 9.49 P99.9: 1030.64 P99.99: 2677.51 ------------------------------------------------------ [ 0, 1 ] 1105039 10.002% 10.002% ## ( 1, 2 ] 5122144 46.363% 56.365% ######### ( 2, 3 ] 1766992 15.994% 72.359% ### ( 3, 4 ] 1454430 13.165% 85.523% ### ( 4, 6 ] 1319794 11.946% 97.469% ## ( 6, 10 ] 193993 1.756% 99.225% ( 10, 15 ] 42476 0.384% 99.610% ( 15, 22 ] 12545 0.114% 99.723% ( 22, 34 ] 3187 0.029% 99.752% ( 34, 51 ] 703 0.006% 99.758% ( 51, 76 ] 162 0.001% 99.760% ( 76, 110 ] 38 0.000% 99.760% ( 110, 170 ] 9999 0.091% 99.851% ( 170, 250 ] 920 0.008% 99.859% ( 250, 380 ] 238 0.002% 99.861% ( 380, 580 ] 94 0.001% 99.862% ( 580, 870 ] 69 0.001% 99.863% ( 870, 1300 ] 11050 0.100% 99.963% ( 1300, 1900 ] 48 0.000% 99.963% ( 1900, 2900 ] 3824 0.035% 99.998% ( 2900, 4400 ] 197 0.002% 99.999% ( 4400, 6600 ] 23 0.000% 100.000% ( 6600, 9900 ] 11 0.000% 100.000% ( 9900, 14000 ] 4 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 75000, 110000 ] 2 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 3 0.000% 100.000% ( 250000, 380000 ] 3 0.000% 100.000% ( 570000, 860000 ] 5 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 275704 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11047999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11401534968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 741 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 24919277 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 37794608452 rocksdb.compact.write.bytes COUNT : 37511229143 rocksdb.flush.write.bytes COUNT : 11230150186 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 84 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 370 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11139212288 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3989504 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 37577617658 rocksdb.non.last.level.read.count COUNT : 9077223 rocksdb.block.checksum.compute.count COUNT : 9155831 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.511682 P95 : 5.079086 P99 : 8.506182 P100 : 695930.000000 COUNT : 11047999 SUM : 54345604 rocksdb.compaction.times.micros P50 : 915000.000000 P95 : 4224166.666667 P99 : 12614000.000000 P100 : 16345910.000000 COUNT : 133 SUM : 192214568 rocksdb.compaction.times.cpu_micros P50 : 835833.333333 P95 : 3996666.666667 P99 : 12614000.000000 P100 : 15588326.000000 COUNT : 133 SUM : 151891525 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 589.830508 P95 : 2566.666667 P99 : 6270.000000 P100 : 14336.000000 COUNT : 160 SUM : 146848 rocksdb.compaction.outfile.sync.micros P50 : 1067.701149 P95 : 8116.216216 P99 : 9900.000000 P100 : 26951.000000 COUNT : 500 SUM : 1130864 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 106.260000 P95 : 2514.285714 P99 : 4042.142857 P100 : 4062.000000 COUNT : 334 SUM : 128288 rocksdb.table.open.io.micros P50 : 1022.378641 P95 : 6212.608696 P99 : 17440.000000 P100 : 20832.000000 COUNT : 741 SUM : 1441114 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.981616 P95 : 8.898575 P99 : 13.329283 P100 : 29471.000000 COUNT : 9154143 SUM : 71298685 rocksdb.read.block.get.micros P50 : 367.845528 P95 : 2851.562500 P99 : 6234.608696 P100 : 10667.000000 COUNT : 1482 SUM : 1106491 rocksdb.write.raw.block.micros P50 : 0.523791 P95 : 0.995204 P99 : 3.409556 P100 : 75982.000000 COUNT : 11821118 SUM : 31022185 rocksdb.numfiles.in.singlecompaction P50 : 3.100000 P95 : 8.583333 P99 : 13.937500 P100 : 18.000000 COUNT : 185 SUM : 681 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.565149 P95 : 1194.814155 P99 : 2559.462279 P100 : 695716.000000 COUNT : 129193 SUM : 24935231 rocksdb.sst.read.micros P50 : 1.800054 P95 : 5.361012 P99 : 9.365134 P100 : 29465.000000 COUNT : 9078215 SUM : 49256234 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11047999 SUM : 11401534968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 199090.909091 P95 : 513000.000000 P99 : 928000.000000 P100 : 928226.000000 COUNT : 160 SUM : 36072378 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 509 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0