[2024-11-03 07:15:09.806470] Starting SPDK v25.01-pre git sha1 fa3ab7384 / DPDK 24.11.0-rc1 initialization... [2024-11-03 07:15:09.806573] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2891830 ] Set seed to 1730614509804057 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-03 07:15:09.963353] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.11.0-rc1 is used. There is no support for it in SPDK. Enabled only for validation. [2024-11-03 07:15:10.014594] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-03 07:15:10.037689] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-03 07:15:10.037732] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2891830' to capture a snapshot of events at runtime. [2024-11-03 07:15:10.037745] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-03 07:15:10.037754] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-03 07:15:10.037763] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2891830 for offline analysis/debug. [2024-11-03 07:15:10.038283] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 3 07:15:14 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/03-07:15:17 ... thread 0: (1000000,1000000) ops and (359746.3,359746.3) ops/second in (2.779737,2.779737) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.00 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 353.5 2.32 2.10 12 0.193 0 0 0.0 0.0 L2 3/2 251.75 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.2 2.0 248.3 248.2 1.52 1.47 2 0.761 383K 204 0.0 0.0 L3 10/0 867.41 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.3 1.5 98.4 311.7 3.84 3.57 14 0.274 383K 204 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 98.4 311.7 3.84 3.57 14 0.274 383K 204 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 248.3 248.2 1.52 1.47 2 0.761 383K 204 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 353.5 2.32 2.10 12 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 404.79 MB/s write, 0.37 GB read, 127.84 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 430.32 MB/s write, 0.37 GB read, 135.90 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 100878 Average: 1.9131 StdDev: 23.20 Min: 1 Median: 1.1722 Max: 4298 Percentiles: P50: 1.17 P75: 1.63 P99: 3.81 P99.9: 9.62 P99.99: 571.22 ------------------------------------------------------ [ 0, 1 ] 40978 40.621% 40.621% ######## ( 1, 2 ] 54946 54.468% 95.089% ########### ( 2, 3 ] 3158 3.131% 98.220% # ( 3, 4 ] 973 0.965% 99.184% ( 4, 6 ] 553 0.548% 99.732% ( 6, 10 ] 188 0.186% 99.919% ( 10, 15 ] 51 0.051% 99.969% ( 15, 22 ] 5 0.005% 99.974% ( 22, 34 ] 1 0.001% 99.975% ( 51, 76 ] 2 0.002% 99.977% ( 110, 170 ] 9 0.009% 99.986% ( 170, 250 ] 2 0.002% 99.988% ( 250, 380 ] 1 0.001% 99.989% ( 380, 580 ] 2 0.002% 99.991% ( 580, 870 ] 2 0.002% 99.993% ( 870, 1300 ] 2 0.002% 99.995% ( 1300, 1900 ] 1 0.001% 99.996% ( 1900, 2900 ] 4 0.004% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 1 read latency histogram (micros): Count: 5 Average: 1009.6000 StdDev: 1028.01 Min: 282 Median: 530.0000 Max: 3016 Percentiles: P50: 530.00 P75: 1192.50 P99: 3016.00 P99.9: 3016.00 P99.99: 3016.00 ------------------------------------------------------ ( 250, 380 ] 1 20.000% 20.000% #### ( 380, 580 ] 2 40.000% 60.000% ######## ( 870, 1300 ] 1 20.000% 80.000% #### ( 2900, 4400 ] 1 20.000% 100.000% #### ** Level 2 read latency histogram (micros): Count: 49776 Average: 1.8621 StdDev: 7.59 Min: 0 Median: 1.2424 Max: 1236 Percentiles: P50: 1.24 P75: 1.68 P99: 5.25 P99.9: 11.94 P99.99: 294.30 ------------------------------------------------------ [ 0, 1 ] 18063 36.289% 36.289% ####### ( 1, 2 ] 28157 56.567% 92.856% ########### ( 2, 3 ] 1947 3.912% 96.768% # ( 3, 4 ] 760 1.527% 98.294% ( 4, 6 ] 565 1.135% 99.429% ( 6, 10 ] 217 0.436% 99.865% ( 10, 15 ] 47 0.094% 99.960% ( 15, 22 ] 8 0.016% 99.976% ( 22, 34 ] 4 0.008% 99.984% ( 51, 76 ] 2 0.004% 99.988% ( 170, 250 ] 1 0.002% 99.990% ( 250, 380 ] 3 0.006% 99.996% ( 580, 870 ] 2 0.004% 100.000% ( 870, 1300 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 45 Average: 1359.8667 StdDev: 1005.10 Min: 76 Median: 1192.5000 Max: 3800 Percentiles: P50: 1192.50 P75: 2094.44 P99: 3800.00 P99.9: 3800.00 P99.99: 3800.00 ------------------------------------------------------ ( 51, 76 ] 1 2.222% 2.222% ( 76, 110 ] 1 2.222% 4.444% ( 110, 170 ] 2 4.444% 8.889% # ( 170, 250 ] 3 6.667% 15.556% # ( 250, 380 ] 2 4.444% 20.000% # ( 380, 580 ] 6 13.333% 33.333% ### ( 580, 870 ] 3 6.667% 40.000% # ( 870, 1300 ] 6 13.333% 53.333% ### ( 1300, 1900 ] 8 17.778% 71.111% #### ( 1900, 2900 ] 9 20.000% 91.111% #### ( 2900, 4400 ] 4 8.889% 100.000% ## ** Level 4 read latency histogram (micros): Count: 30 Average: 1572.1667 StdDev: 950.83 Min: 536 Median: 1246.2500 Max: 3992 Percentiles: P50: 1246.25 P75: 1857.14 P99: 3992.00 P99.9: 3992.00 P99.99: 3992.00 ------------------------------------------------------ ( 380, 580 ] 3 10.000% 10.000% ## ( 580, 870 ] 5 16.667% 26.667% ### ( 870, 1300 ] 8 26.667% 53.333% ##### ( 1300, 1900 ] 7 23.333% 76.667% ##### ( 1900, 2900 ] 3 10.000% 86.667% ## ( 2900, 4400 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 332.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.224 H:M:S, 7.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 353.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.224 H:M:S, 8.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/03-07:15:20 ... thread 0: (1000000,2000000) ops and (329135.9,343761.0) ops/second in (3.038259,5.817996) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 1.17 GB 25.2 0.2 0.0 0.2 2.0 1.8 0.0 1.1 41.1 338.9 6.13 5.57 27 0.227 255K 243 0.0 0.0 L1 1/1 3.29 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 233.2 232.8 1.62 1.57 1 1.621 383K 630 0.0 0.0 L2 2/1 55.06 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 248.3 248.2 1.52 1.47 2 0.761 383K 204 0.0 0.0 L3 20/10 1.18 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 228.0 228.0 1.09 1.03 1 1.094 253K 0 0.0 0.0 L4 174/0 9.69 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 148.6 148.6 1.51 1.13 1 1.513 228K 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/23 97.92 GB 0.0 1.4 1.0 0.4 3.2 2.8 1.2 1.8 124.7 278.4 11.88 10.77 32 0.371 1504K 1077 0.0 0.0 Int 0/0 0.00 KB 0.0 1.4 1.0 0.4 3.2 2.8 1.1 1.8 124.7 278.4 11.88 10.77 32 0.371 1504K 1077 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.4 1.0 0.4 1.4 1.0 0.0 0.0 220.3 220.2 6.73 6.16 6 1.121 1504K 1077 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 354.3 5.16 4.61 26 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.23 GB write, 551.83 MB/s write, 1.45 GB read, 247.25 MB/s read, 11.9 seconds Interval compaction: 3.23 GB write, 568.46 MB/s write, 1.45 GB read, 254.71 MB/s read, 11.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 348752 Average: 2.2150 StdDev: 15.08 Min: 1 Median: 1.4779 Max: 4298 Percentiles: P50: 1.48 P75: 1.87 P99: 5.66 P99.9: 9.92 P99.99: 14.59 ------------------------------------------------------ [ 0, 1 ] 68496 19.640% 19.640% #### ( 1, 2 ] 221556 63.528% 83.169% ############# ( 2, 3 ] 34677 9.943% 93.112% ## ( 3, 4 ] 13252 3.800% 96.912% # ( 4, 6 ] 8783 2.518% 99.430% # ( 6, 10 ] 1676 0.481% 99.911% ( 10, 15 ] 304 0.087% 99.998% ( 15, 22 ] 28 0.008% 100.006% ( 22, 34 ] 4 0.001% 100.007% ( 34, 51 ] 1 0.000% 100.007% ( 51, 76 ] 4 0.001% 100.008% ( 110, 170 ] 12 0.003% 100.012% ( 170, 250 ] 12 0.003% 100.015% ( 250, 380 ] 9 0.003% 100.018% ( 380, 580 ] 5 0.001% 100.019% ( 580, 870 ] 2 0.001% 100.020% ( 870, 1300 ] 4 0.001% 100.021% ( 1300, 1900 ] 2 0.001% 100.022% ( 1900, 2900 ] 7 0.002% 100.024% ( 2900, 4400 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 31 Average: 299.9032 StdDev: 598.72 Min: 0 Median: 2.5000 Max: 3016 Percentiles: P50: 2.50 P75: 396.67 P99: 3016.00 P99.9: 3016.00 P99.99: 3016.00 ------------------------------------------------------ [ 0, 1 ] 11 35.484% 35.484% ####### ( 1, 2 ] 4 12.903% 48.387% ### ( 2, 3 ] 1 3.226% 51.613% # ( 3, 4 ] 2 6.452% 58.065% # ( 110, 170 ] 1 3.226% 61.290% # ( 170, 250 ] 2 6.452% 67.742% # ( 250, 380 ] 2 6.452% 74.194% # ( 380, 580 ] 3 9.677% 83.871% ## ( 580, 870 ] 1 3.226% 87.097% # ( 870, 1300 ] 2 6.452% 93.548% # ( 1300, 1900 ] 1 3.226% 96.774% # ( 2900, 4400 ] 1 3.226% 100.000% # ** Level 2 read latency histogram (micros): Count: 95649 Average: 2.0705 StdDev: 5.53 Min: 0 Median: 1.4250 Max: 1236 Percentiles: P50: 1.42 P75: 1.83 P99: 5.70 P99.9: 11.85 P99.99: 54.63 ------------------------------------------------------ [ 0, 1 ] 22598 23.626% 23.626% ##### ( 1, 2 ] 59359 62.059% 85.685% ############ ( 2, 3 ] 7778 8.132% 93.817% ## ( 3, 4 ] 2948 3.082% 96.899% # ( 4, 6 ] 2361 2.468% 99.367% ( 6, 10 ] 468 0.489% 99.857% ( 10, 15 ] 112 0.117% 99.974% ( 15, 22 ] 11 0.012% 99.985% ( 22, 34 ] 4 0.004% 99.990% ( 51, 76 ] 3 0.003% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 177916 Average: 3.2550 StdDev: 30.24 Min: 1 Median: 1.6237 Max: 3800 Percentiles: P50: 1.62 P75: 2.10 P99: 8.44 P99.9: 145.82 P99.99: 322.19 ------------------------------------------------------ [ 0, 1 ] 20034 11.260% 11.260% ## ( 1, 2 ] 110509 62.113% 73.373% ############ ( 2, 3 ] 29270 16.452% 89.825% ### ( 3, 4 ] 7900 4.440% 94.265% # ( 4, 6 ] 6899 3.878% 98.143% # ( 6, 10 ] 2504 1.407% 99.550% ( 10, 15 ] 309 0.174% 99.724% ( 15, 22 ] 83 0.047% 99.771% ( 22, 34 ] 21 0.012% 99.782% ( 34, 51 ] 4 0.002% 99.785% ( 51, 76 ] 4 0.002% 99.787% ( 76, 110 ] 100 0.056% 99.843% ( 110, 170 ] 171 0.096% 99.939% ( 170, 250 ] 59 0.033% 99.972% ( 250, 380 ] 58 0.033% 100.005% ( 380, 580 ] 40 0.022% 100.028% ( 580, 870 ] 23 0.013% 100.040% ( 870, 1300 ] 11 0.006% 100.047% ( 1300, 1900 ] 8 0.004% 100.051% ( 1900, 2900 ] 9 0.005% 100.056% ( 2900, 4400 ] 4 0.002% 100.058% ** Level 4 read latency histogram (micros): Count: 320 Average: 159.0875 StdDev: 543.00 Min: 1 Median: 1.9524 Max: 3992 Percentiles: P50: 1.95 P75: 10.68 P99: 3200.00 P99.9: 3992.00 P99.99: 3992.00 ------------------------------------------------------ [ 0, 1 ] 60 18.750% 18.750% #### ( 1, 2 ] 105 32.812% 51.562% ####### ( 2, 3 ] 41 12.812% 64.375% ### ( 3, 4 ] 14 4.375% 68.750% # ( 4, 6 ] 10 3.125% 71.875% # ( 6, 10 ] 7 2.188% 74.062% ( 10, 15 ] 22 6.875% 80.938% # ( 15, 22 ] 19 5.938% 86.875% # ( 22, 34 ] 4 1.250% 88.125% ( 110, 170 ] 3 0.938% 89.062% ( 170, 250 ] 2 0.625% 89.688% ( 250, 380 ] 1 0.312% 90.000% ( 380, 580 ] 4 1.250% 91.250% ( 580, 870 ] 6 1.875% 93.125% ( 870, 1300 ] 8 2.500% 95.625% # ( 1300, 1900 ] 7 2.188% 97.812% ( 1900, 2900 ] 3 0.938% 98.750% ( 2900, 4400 ] 4 1.250% 100.000% ** DB Stats ** Uptime(secs): 6.0 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 328.35 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.605 H:M:S, 10.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.380 H:M:S, 12.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/03-07:15:23 ... thread 0: (1000000,3000000) ops and (311892.1,332438.2) ops/second in (3.206237,9.024233) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/11 1.41 GB 0.0 1.0 0.0 1.0 3.8 2.7 0.0 1.4 87.3 313.2 12.27 11.10 43 0.285 1087K 1127 0.0 0.0 L1 3/3 212.29 MB 0.0 1.0 1.0 0.0 1.0 1.0 0.2 1.0 232.4 231.8 4.62 4.49 2 2.311 1090K 2626 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.0 2.0 248.3 248.2 1.52 1.47 2 0.761 383K 204 0.0 0.0 L3 22/0 973.05 MB 1.0 2.0 0.8 1.2 1.9 0.8 0.4 2.5 214.8 214.4 9.31 8.31 6 1.551 2030K 4273 0.0 0.0 L4 174/0 9.46 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 148.6 148.6 1.51 1.13 1 1.513 228K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1266/14 98.84 GB 0.0 4.6 2.2 2.4 7.3 4.9 3.4 2.7 162.4 256.9 29.23 26.50 54 0.541 4820K 8230 0.0 0.0 Int 0/0 0.00 KB 0.0 4.6 2.2 2.4 7.3 4.9 3.3 2.7 162.4 256.9 29.23 26.50 54 0.541 4820K 8230 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.6 2.2 2.4 4.6 2.2 0.0 0.0 223.3 222.9 21.25 19.53 15 1.417 4820K 8230 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 347.5 7.98 6.98 39 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.33 GB write, 816.29 MB/s write, 4.64 GB read, 515.95 MB/s read, 29.2 seconds Interval compaction: 7.33 GB write, 832.16 MB/s write, 4.64 GB read, 525.98 MB/s read, 29.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 663410 Average: 2.3709 StdDev: 16.44 Min: 1 Median: 1.5541 Max: 4298 Percentiles: P50: 1.55 P75: 1.94 P99: 5.82 P99.9: 9.91 P99.99: 14.54 ------------------------------------------------------ [ 0, 1 ] 95145 14.342% 14.342% ### ( 1, 2 ] 426918 64.352% 78.694% ############# ( 2, 3 ] 80035 12.064% 90.758% ## ( 3, 4 ] 33039 4.980% 95.738% # ( 4, 6 ] 23774 3.584% 99.322% # ( 6, 10 ] 3926 0.592% 99.914% ( 10, 15 ] 561 0.085% 99.998% ( 15, 22 ] 57 0.009% 100.007% ( 22, 34 ] 7 0.001% 100.008% ( 34, 51 ] 3 0.000% 100.008% ( 51, 76 ] 7 0.001% 100.009% ( 76, 110 ] 18 0.003% 100.012% ( 110, 170 ] 30 0.005% 100.017% ( 170, 250 ] 28 0.004% 100.021% ( 250, 380 ] 19 0.003% 100.024% ( 380, 580 ] 10 0.002% 100.025% ( 580, 870 ] 8 0.001% 100.026% ( 870, 1300 ] 6 0.001% 100.027% ( 1300, 1900 ] 7 0.001% 100.028% ( 1900, 2900 ] 8 0.001% 100.030% ( 2900, 4400 ] 6 0.001% 100.030% ** Level 1 read latency histogram (micros): Count: 245507 Average: 3.2328 StdDev: 40.42 Min: 0 Median: 1.7342 Max: 9652 Percentiles: P50: 1.73 P75: 2.52 P99: 7.38 P99.9: 9.90 P99.99: 11.78 ------------------------------------------------------ [ 0, 1 ] 14293 5.822% 5.822% # ( 1, 2 ] 147719 60.169% 65.991% ############ ( 2, 3 ] 42733 17.406% 83.397% ### ( 3, 4 ] 19371 7.890% 91.287% ## ( 4, 6 ] 17730 7.222% 98.509% # ( 6, 10 ] 3503 1.427% 99.936% ( 10, 15 ] 375 0.153% 100.088% ( 15, 22 ] 43 0.018% 100.106% ( 22, 34 ] 6 0.002% 100.108% ( 34, 51 ] 4 0.002% 100.110% ( 51, 76 ] 2 0.001% 100.111% ( 76, 110 ] 28 0.011% 100.122% ( 110, 170 ] 63 0.026% 100.148% ( 170, 250 ] 27 0.011% 100.159% ( 250, 380 ] 30 0.012% 100.171% ( 380, 580 ] 26 0.011% 100.182% ( 580, 870 ] 18 0.007% 100.189% ( 870, 1300 ] 11 0.004% 100.193% ( 1300, 1900 ] 8 0.003% 100.197% ( 1900, 2900 ] 7 0.003% 100.200% ( 2900, 4400 ] 11 0.004% 100.204% ( 4400, 6600 ] 3 0.001% 100.205% ( 6600, 9900 ] 1 0.000% 100.206% ** Level 2 read latency histogram (micros): Count: 95910 Average: 2.0725 StdDev: 5.52 Min: 0 Median: 1.4264 Max: 1236 Percentiles: P50: 1.43 P75: 1.83 P99: 5.70 P99.9: 11.83 P99.99: 54.41 ------------------------------------------------------ [ 0, 1 ] 22599 23.563% 23.563% ##### ( 1, 2 ] 59469 62.005% 85.568% ############ ( 2, 3 ] 7883 8.219% 93.787% ## ( 3, 4 ] 2983 3.110% 96.897% # ( 4, 6 ] 2370 2.471% 99.368% ( 6, 10 ] 469 0.489% 99.857% ( 10, 15 ] 112 0.117% 99.974% ( 15, 22 ] 11 0.011% 99.985% ( 22, 34 ] 4 0.004% 99.990% ( 51, 76 ] 3 0.003% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 255426 Average: 3.3272 StdDev: 30.83 Min: 0 Median: 1.6247 Max: 4016 Percentiles: P50: 1.62 P75: 2.09 P99: 8.56 P99.9: 169.43 P99.99: 442.95 ------------------------------------------------------ [ 0, 1 ] 27059 10.594% 10.594% ## ( 1, 2 ] 161128 63.082% 73.676% ############# ( 2, 3 ] 39759 15.566% 89.242% ### ( 3, 4 ] 12325 4.825% 94.067% # ( 4, 6 ] 10142 3.971% 98.037% # ( 6, 10 ] 3837 1.502% 99.540% ( 10, 15 ] 417 0.163% 99.703% ( 15, 22 ] 95 0.037% 99.740% ( 22, 34 ] 25 0.010% 99.750% ( 34, 51 ] 5 0.002% 99.752% ( 51, 76 ] 5 0.002% 99.754% ( 76, 110 ] 119 0.047% 99.800% ( 110, 170 ] 257 0.101% 99.901% ( 170, 250 ] 106 0.041% 99.942% ( 250, 380 ] 101 0.040% 99.982% ( 380, 580 ] 65 0.025% 100.007% ( 580, 870 ] 36 0.014% 100.022% ( 870, 1300 ] 20 0.008% 100.029% ( 1300, 1900 ] 11 0.004% 100.034% ( 1900, 2900 ] 11 0.004% 100.038% ( 2900, 4400 ] 6 0.002% 100.040% ** Level 4 read latency histogram (micros): Count: 320 Average: 159.0875 StdDev: 543.00 Min: 1 Median: 1.9524 Max: 3992 Percentiles: P50: 1.95 P75: 10.68 P99: 3200.00 P99.9: 3992.00 P99.99: 3992.00 ------------------------------------------------------ [ 0, 1 ] 60 18.750% 18.750% #### ( 1, 2 ] 105 32.812% 51.562% ####### ( 2, 3 ] 41 12.812% 64.375% ### ( 3, 4 ] 14 4.375% 68.750% # ( 4, 6 ] 10 3.125% 71.875% # ( 6, 10 ] 7 2.188% 74.062% ( 10, 15 ] 22 6.875% 80.938% # ( 15, 22 ] 19 5.938% 86.875% # ( 22, 34 ] 4 1.250% 88.125% ( 110, 170 ] 3 0.938% 89.062% ( 170, 250 ] 2 0.625% 89.688% ( 250, 380 ] 1 0.312% 90.000% ( 380, 580 ] 4 1.250% 91.250% ( 580, 870 ] 6 1.875% 93.125% ( 870, 1300 ] 8 2.500% 95.625% # ( 1300, 1900 ] 7 2.188% 97.812% ( 1900, 2900 ] 3 0.938% 98.750% ( 2900, 4400 ] 4 1.250% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 873.1667 StdDev: 1059.18 Min: 75 Median: 351.1111 Max: 4365 Percentiles: P50: 351.11 P75: 1156.67 P99: 4220.00 P99.9: 4365.00 P99.99: 4365.00 ------------------------------------------------------ ( 51, 76 ] 2 3.333% 3.333% # ( 76, 110 ] 6 10.000% 13.333% ## ( 110, 170 ] 9 15.000% 28.333% ### ( 170, 250 ] 6 10.000% 38.333% ## ( 250, 380 ] 9 15.000% 53.333% ### ( 380, 580 ] 5 8.333% 61.667% ## ( 580, 870 ] 6 10.000% 71.667% ## ( 870, 1300 ] 3 5.000% 76.667% # ( 1300, 1900 ] 3 5.000% 81.667% # ( 1900, 2900 ] 6 10.000% 91.667% ## ( 2900, 4400 ] 5 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 9.2 total, 3.2 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 320.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.092 H:M:S, 11.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 306.96 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.488 H:M:S, 15.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/03-07:15:26 ... thread 0: (1000000,4000000) ops and (326256.5,330870.9) ops/second in (3.065073,12.089306) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 2.40 GB 100.7 1.8 0.0 1.8 5.5 3.7 0.0 1.5 103.8 311.2 18.21 16.69 60 0.304 1918K 1953 0.0 0.0 L1 3/3 212.29 MB 0.0 1.0 1.0 0.0 1.0 1.0 0.2 1.0 232.4 231.8 4.62 4.49 2 2.311 1090K 2626 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.0 2.0 248.3 248.2 1.52 1.47 2 0.761 383K 204 0.0 0.0 L3 22/0 973.05 MB 1.0 2.0 0.8 1.2 1.9 0.8 0.4 2.5 214.8 214.4 9.31 8.31 6 1.551 2030K 4273 0.0 0.0 L4 174/0 9.46 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 148.6 148.6 1.51 1.13 1 1.513 228K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/14 99.82 GB 0.0 5.4 2.2 3.2 9.1 5.9 3.4 2.5 158.2 265.4 35.18 32.09 71 0.495 5652K 9056 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 2.2 3.2 9.1 5.9 3.3 2.5 158.2 265.4 35.18 32.09 71 0.495 5652K 9056 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 2.2 3.2 5.4 2.2 0.0 0.0 228.3 228.0 24.38 22.59 18 1.354 5652K 9056 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 350.0 10.80 9.50 53 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.1 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.12 GB write, 761.18 MB/s write, 5.44 GB read, 453.79 MB/s read, 35.2 seconds Interval compaction: 9.12 GB write, 772.23 MB/s write, 5.44 GB read, 460.37 MB/s read, 35.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1054513 Average: 2.3058 StdDev: 14.10 Min: 1 Median: 1.5335 Max: 4298 Percentiles: P50: 1.53 P75: 1.91 P99: 5.75 P99.9: 9.83 P99.99: 14.02 ------------------------------------------------------ [ 0, 1 ] 157401 14.926% 14.926% ### ( 1, 2 ] 693311 65.747% 80.673% ############# ( 2, 3 ] 119833 11.364% 92.037% ## ( 3, 4 ] 46071 4.369% 96.406% # ( 4, 6 ] 31295 2.968% 99.374% # ( 6, 10 ] 5796 0.550% 99.924% ( 10, 15 ] 873 0.083% 100.006% ( 15, 22 ] 75 0.007% 100.013% ( 22, 34 ] 10 0.001% 100.014% ( 34, 51 ] 4 0.000% 100.015% ( 51, 76 ] 8 0.001% 100.016% ( 76, 110 ] 51 0.005% 100.020% ( 110, 170 ] 48 0.005% 100.025% ( 170, 250 ] 45 0.004% 100.029% ( 250, 380 ] 32 0.003% 100.032% ( 380, 580 ] 17 0.002% 100.034% ( 580, 870 ] 15 0.001% 100.035% ( 870, 1300 ] 10 0.001% 100.036% ( 1300, 1900 ] 12 0.001% 100.037% ( 1900, 2900 ] 9 0.001% 100.038% ( 2900, 4400 ] 6 0.001% 100.039% ** Level 1 read latency histogram (micros): Count: 250283 Average: 3.2584 StdDev: 40.17 Min: 0 Median: 1.7306 Max: 9652 Percentiles: P50: 1.73 P75: 2.51 P99: 7.45 P99.9: 9.97 P99.99: 12.64 ------------------------------------------------------ [ 0, 1 ] 14864 5.939% 5.939% # ( 1, 2 ] 150949 60.311% 66.250% ############ ( 2, 3 ] 43310 17.304% 83.555% ### ( 3, 4 ] 19507 7.794% 91.349% ## ( 4, 6 ] 17854 7.134% 98.482% # ( 6, 10 ] 3574 1.428% 99.910% ( 10, 15 ] 379 0.151% 100.062% ( 15, 22 ] 43 0.017% 100.079% ( 22, 34 ] 6 0.002% 100.081% ( 34, 51 ] 4 0.002% 100.083% ( 51, 76 ] 2 0.001% 100.084% ( 76, 110 ] 46 0.018% 100.102% ( 110, 170 ] 85 0.034% 100.136% ( 170, 250 ] 39 0.016% 100.151% ( 250, 380 ] 38 0.015% 100.167% ( 380, 580 ] 27 0.011% 100.177% ( 580, 870 ] 20 0.008% 100.185% ( 870, 1300 ] 11 0.004% 100.190% ( 1300, 1900 ] 8 0.003% 100.193% ( 1900, 2900 ] 7 0.003% 100.196% ( 2900, 4400 ] 11 0.004% 100.200% ( 4400, 6600 ] 3 0.001% 100.201% ( 6600, 9900 ] 1 0.000% 100.202% ** Level 2 read latency histogram (micros): Count: 95910 Average: 2.0725 StdDev: 5.52 Min: 0 Median: 1.4264 Max: 1236 Percentiles: P50: 1.43 P75: 1.83 P99: 5.70 P99.9: 11.83 P99.99: 54.41 ------------------------------------------------------ [ 0, 1 ] 22599 23.563% 23.563% ##### ( 1, 2 ] 59469 62.005% 85.568% ############ ( 2, 3 ] 7883 8.219% 93.787% ## ( 3, 4 ] 2983 3.110% 96.897% # ( 4, 6 ] 2370 2.471% 99.368% ( 6, 10 ] 469 0.489% 99.857% ( 10, 15 ] 112 0.117% 99.974% ( 15, 22 ] 11 0.011% 99.985% ( 22, 34 ] 4 0.004% 99.990% ( 51, 76 ] 3 0.003% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 255426 Average: 3.3272 StdDev: 30.83 Min: 0 Median: 1.6247 Max: 4016 Percentiles: P50: 1.62 P75: 2.09 P99: 8.56 P99.9: 169.43 P99.99: 442.95 ------------------------------------------------------ [ 0, 1 ] 27059 10.594% 10.594% ## ( 1, 2 ] 161128 63.082% 73.676% ############# ( 2, 3 ] 39759 15.566% 89.242% ### ( 3, 4 ] 12325 4.825% 94.067% # ( 4, 6 ] 10142 3.971% 98.037% # ( 6, 10 ] 3837 1.502% 99.540% ( 10, 15 ] 417 0.163% 99.703% ( 15, 22 ] 95 0.037% 99.740% ( 22, 34 ] 25 0.010% 99.750% ( 34, 51 ] 5 0.002% 99.752% ( 51, 76 ] 5 0.002% 99.754% ( 76, 110 ] 119 0.047% 99.800% ( 110, 170 ] 257 0.101% 99.901% ( 170, 250 ] 106 0.041% 99.942% ( 250, 380 ] 101 0.040% 99.982% ( 380, 580 ] 65 0.025% 100.007% ( 580, 870 ] 36 0.014% 100.022% ( 870, 1300 ] 20 0.008% 100.029% ( 1300, 1900 ] 11 0.004% 100.034% ( 1900, 2900 ] 11 0.004% 100.038% ( 2900, 4400 ] 6 0.002% 100.040% ** Level 4 read latency histogram (micros): Count: 320 Average: 159.0875 StdDev: 543.00 Min: 1 Median: 1.9524 Max: 3992 Percentiles: P50: 1.95 P75: 10.68 P99: 3200.00 P99.9: 3992.00 P99.99: 3992.00 ------------------------------------------------------ [ 0, 1 ] 60 18.750% 18.750% #### ( 1, 2 ] 105 32.812% 51.562% ####### ( 2, 3 ] 41 12.812% 64.375% ### ( 3, 4 ] 14 4.375% 68.750% # ( 4, 6 ] 10 3.125% 71.875% # ( 6, 10 ] 7 2.188% 74.062% ( 10, 15 ] 22 6.875% 80.938% # ( 15, 22 ] 19 5.938% 86.875% # ( 22, 34 ] 4 1.250% 88.125% ( 110, 170 ] 3 0.938% 89.062% ( 170, 250 ] 2 0.625% 89.688% ( 250, 380 ] 1 0.312% 90.000% ( 380, 580 ] 4 1.250% 91.250% ( 580, 870 ] 6 1.875% 93.125% ( 870, 1300 ] 8 2.500% 95.625% # ( 1300, 1900 ] 7 2.188% 97.812% ( 1900, 2900 ] 3 0.938% 98.750% ( 2900, 4400 ] 4 1.250% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 873.1667 StdDev: 1059.18 Min: 75 Median: 351.1111 Max: 4365 Percentiles: P50: 351.11 P75: 1156.67 P99: 4220.00 P99.9: 4365.00 P99.99: 4365.00 ------------------------------------------------------ ( 51, 76 ] 2 3.333% 3.333% # ( 76, 110 ] 6 10.000% 13.333% ## ( 110, 170 ] 9 15.000% 28.333% ### ( 170, 250 ] 6 10.000% 38.333% ## ( 250, 380 ] 9 15.000% 53.333% ### ( 380, 580 ] 5 8.333% 61.667% ## ( 580, 870 ] 6 10.000% 71.667% ## ( 870, 1300 ] 3 5.000% 76.667% # ( 1300, 1900 ] 3 5.000% 81.667% # ( 1900, 2900 ] 6 10.000% 91.667% ## ( 2900, 4400 ] 5 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 12.3 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 320.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.503 H:M:S, 12.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.410 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/03-07:15:29 ... thread 0: (1000000,5000000) ops and (284685.7,320472.7) ops/second in (3.512646,15.601952) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/14 2.27 GB 12.6 2.6 0.0 2.6 7.4 4.7 0.0 1.6 111.2 310.2 24.36 22.47 78 0.312 2750K 2795 0.0 0.0 L1 13/13 1.37 GB 0.0 2.4 2.2 0.2 2.4 2.2 0.2 1.1 230.0 229.0 10.79 10.43 3 3.597 2520K 11K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.0 2.0 248.3 248.2 1.52 1.47 2 0.761 383K 204 0.0 0.0 L3 22/0 973.05 MB 1.0 2.0 0.8 1.2 1.9 0.8 0.4 2.5 214.8 214.4 9.31 8.31 6 1.551 2030K 4273 0.0 0.0 L4 174/0 9.46 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 148.6 148.6 1.51 1.13 1 1.513 228K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1280/27 100.86 GB 0.0 7.6 3.4 4.2 12.3 8.1 3.4 2.6 164.1 265.8 47.49 43.81 90 0.528 7913K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.6 3.4 4.2 12.3 8.1 3.3 2.6 164.1 265.8 47.49 43.81 90 0.528 7913K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.6 3.4 4.2 7.6 3.4 0.0 0.0 231.6 231.1 33.65 31.58 22 1.529 7913K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 350.4 13.85 12.23 68 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.8 total, 15.6 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.33 GB write, 800.14 MB/s write, 7.61 GB read, 493.92 MB/s read, 47.5 seconds Interval compaction: 12.33 GB write, 809.14 MB/s write, 7.61 GB read, 499.47 MB/s read, 47.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 14, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1393170 Average: 2.2912 StdDev: 13.72 Min: 1 Median: 1.5201 Max: 4298 Percentiles: P50: 1.52 P75: 1.90 P99: 5.72 P99.9: 9.89 P99.99: 14.60 ------------------------------------------------------ [ 0, 1 ] 216976 15.574% 15.574% ### ( 1, 2 ] 922068 66.185% 81.759% ############# ( 2, 3 ] 151336 10.863% 92.622% ## ( 3, 4 ] 56793 4.077% 96.698% # ( 4, 6 ] 37241 2.673% 99.372% # ( 6, 10 ] 7581 0.544% 99.916% ( 10, 15 ] 1128 0.081% 99.997% ( 15, 22 ] 95 0.007% 100.003% ( 22, 34 ] 11 0.001% 100.004% ( 34, 51 ] 6 0.000% 100.005% ( 51, 76 ] 8 0.001% 100.005% ( 76, 110 ] 118 0.008% 100.014% ( 110, 170 ] 94 0.007% 100.020% ( 170, 250 ] 68 0.005% 100.025% ( 250, 380 ] 58 0.004% 100.030% ( 380, 580 ] 38 0.003% 100.032% ( 580, 870 ] 22 0.002% 100.034% ( 870, 1300 ] 18 0.001% 100.035% ( 1300, 1900 ] 13 0.001% 100.036% ( 1900, 2900 ] 9 0.001% 100.037% ( 2900, 4400 ] 9 0.001% 100.037% ** Level 1 read latency histogram (micros): Count: 323007 Average: 3.1576 StdDev: 36.18 Min: 0 Median: 1.6725 Max: 9652 Percentiles: P50: 1.67 P75: 2.31 P99: 7.59 P99.9: 12.10 P99.99: 20.68 ------------------------------------------------------ [ 0, 1 ] 27281 8.446% 8.446% ## ( 1, 2 ] 199599 61.794% 70.240% ############ ( 2, 3 ] 50027 15.488% 85.728% ### ( 3, 4 ] 21775 6.741% 92.469% # ( 4, 6 ] 19293 5.973% 98.442% # ( 6, 10 ] 4525 1.401% 99.843% ( 10, 15 ] 439 0.136% 99.979% ( 15, 22 ] 44 0.014% 99.993% ( 22, 34 ] 6 0.002% 99.994% ( 34, 51 ] 4 0.001% 99.996% ( 51, 76 ] 2 0.001% 99.996% ( 76, 110 ] 94 0.029% 100.025% ( 110, 170 ] 166 0.051% 100.077% ( 170, 250 ] 70 0.022% 100.098% ( 250, 380 ] 68 0.021% 100.120% ( 380, 580 ] 47 0.015% 100.134% ( 580, 870 ] 26 0.008% 100.142% ( 870, 1300 ] 16 0.005% 100.147% ( 1300, 1900 ] 8 0.002% 100.150% ( 1900, 2900 ] 7 0.002% 100.152% ( 2900, 4400 ] 11 0.003% 100.155% ( 4400, 6600 ] 3 0.001% 100.156% ( 6600, 9900 ] 1 0.000% 100.156% ** Level 2 read latency histogram (micros): Count: 95910 Average: 2.0725 StdDev: 5.52 Min: 0 Median: 1.4264 Max: 1236 Percentiles: P50: 1.43 P75: 1.83 P99: 5.70 P99.9: 11.83 P99.99: 54.41 ------------------------------------------------------ [ 0, 1 ] 22599 23.563% 23.563% ##### ( 1, 2 ] 59469 62.005% 85.568% ############ ( 2, 3 ] 7883 8.219% 93.787% ## ( 3, 4 ] 2983 3.110% 96.897% # ( 4, 6 ] 2370 2.471% 99.368% ( 6, 10 ] 469 0.489% 99.857% ( 10, 15 ] 112 0.117% 99.974% ( 15, 22 ] 11 0.011% 99.985% ( 22, 34 ] 4 0.004% 99.990% ( 51, 76 ] 3 0.003% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 255426 Average: 3.3272 StdDev: 30.83 Min: 0 Median: 1.6247 Max: 4016 Percentiles: P50: 1.62 P75: 2.09 P99: 8.56 P99.9: 169.43 P99.99: 442.95 ------------------------------------------------------ [ 0, 1 ] 27059 10.594% 10.594% ## ( 1, 2 ] 161128 63.082% 73.676% ############# ( 2, 3 ] 39759 15.566% 89.242% ### ( 3, 4 ] 12325 4.825% 94.067% # ( 4, 6 ] 10142 3.971% 98.037% # ( 6, 10 ] 3837 1.502% 99.540% ( 10, 15 ] 417 0.163% 99.703% ( 15, 22 ] 95 0.037% 99.740% ( 22, 34 ] 25 0.010% 99.750% ( 34, 51 ] 5 0.002% 99.752% ( 51, 76 ] 5 0.002% 99.754% ( 76, 110 ] 119 0.047% 99.800% ( 110, 170 ] 257 0.101% 99.901% ( 170, 250 ] 106 0.041% 99.942% ( 250, 380 ] 101 0.040% 99.982% ( 380, 580 ] 65 0.025% 100.007% ( 580, 870 ] 36 0.014% 100.022% ( 870, 1300 ] 20 0.008% 100.029% ( 1300, 1900 ] 11 0.004% 100.034% ( 1900, 2900 ] 11 0.004% 100.038% ( 2900, 4400 ] 6 0.002% 100.040% ** Level 4 read latency histogram (micros): Count: 320 Average: 159.0875 StdDev: 543.00 Min: 1 Median: 1.9524 Max: 3992 Percentiles: P50: 1.95 P75: 10.68 P99: 3200.00 P99.9: 3992.00 P99.99: 3992.00 ------------------------------------------------------ [ 0, 1 ] 60 18.750% 18.750% #### ( 1, 2 ] 105 32.812% 51.562% ####### ( 2, 3 ] 41 12.812% 64.375% ### ( 3, 4 ] 14 4.375% 68.750% # ( 4, 6 ] 10 3.125% 71.875% # ( 6, 10 ] 7 2.188% 74.062% ( 10, 15 ] 22 6.875% 80.938% # ( 15, 22 ] 19 5.938% 86.875% # ( 22, 34 ] 4 1.250% 88.125% ( 110, 170 ] 3 0.938% 89.062% ( 170, 250 ] 2 0.625% 89.688% ( 250, 380 ] 1 0.312% 90.000% ( 380, 580 ] 4 1.250% 91.250% ( 580, 870 ] 6 1.875% 93.125% ( 870, 1300 ] 8 2.500% 95.625% # ( 1300, 1900 ] 7 2.188% 97.812% ( 1900, 2900 ] 3 0.938% 98.750% ( 2900, 4400 ] 4 1.250% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 873.1667 StdDev: 1059.18 Min: 75 Median: 351.1111 Max: 4365 Percentiles: P50: 351.11 P75: 1156.67 P99: 4220.00 P99.9: 4365.00 P99.99: 4365.00 ------------------------------------------------------ ( 51, 76 ] 2 3.333% 3.333% # ( 76, 110 ] 6 10.000% 13.333% ## ( 110, 170 ] 9 15.000% 28.333% ### ( 170, 250 ] 6 10.000% 38.333% ## ( 250, 380 ] 9 15.000% 53.333% ### ( 380, 580 ] 5 8.333% 61.667% ## ( 580, 870 ] 6 10.000% 71.667% ## ( 870, 1300 ] 3 5.000% 76.667% # ( 1300, 1900 ] 3 5.000% 81.667% # ( 1900, 2900 ] 6 10.000% 91.667% ## ( 2900, 4400 ] 5 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 15.8 total, 3.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 311.87 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.327 H:M:S, 14.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 280.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.825 H:M:S, 23.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/03-07:15:33 ... thread 0: (1000000,6000000) ops and (274623.0,311796.7) ops/second in (3.641355,19.243307) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 3.26 GB 138.5 3.7 0.0 3.7 9.4 5.7 0.0 1.6 121.0 308.4 31.24 28.96 97 0.322 3837K 3869 0.0 0.0 L1 13/13 1.37 GB 0.0 2.4 2.2 0.2 2.4 2.2 0.2 1.1 230.0 229.0 10.79 10.43 3 3.597 2520K 11K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.0 2.0 248.3 248.2 1.52 1.47 2 0.761 383K 204 0.0 0.0 L3 22/0 973.05 MB 1.0 2.0 0.8 1.2 1.9 0.8 0.4 2.5 214.8 214.4 9.31 8.31 6 1.551 2030K 4273 0.0 0.0 L4 174/0 9.46 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 148.6 148.6 1.51 1.13 1 1.513 228K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1283/23 101.84 GB 0.0 8.7 3.4 5.3 14.4 9.1 3.4 2.5 163.0 270.4 54.38 50.30 109 0.499 9001K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.7 3.4 5.3 14.4 9.1 3.3 2.5 163.0 270.4 54.38 50.30 109 0.499 9001K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.7 3.4 5.3 8.6 3.4 0.0 0.0 235.4 234.9 37.65 35.51 26 1.448 9001K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 350.2 16.73 14.79 83 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.4 total, 19.2 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.36 GB write, 757.10 MB/s write, 8.66 GB read, 456.46 MB/s read, 54.4 seconds Interval compaction: 14.36 GB write, 764.00 MB/s write, 8.66 GB read, 460.62 MB/s read, 54.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 15, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1765440 Average: 2.2764 StdDev: 13.59 Min: 1 Median: 1.5116 Max: 4298 Percentiles: P50: 1.51 P75: 1.89 P99: 5.68 P99.9: 9.89 P99.99: 14.79 ------------------------------------------------------ [ 0, 1 ] 281285 15.933% 15.933% ### ( 1, 2 ] 1175513 66.585% 82.518% ############# ( 2, 3 ] 185726 10.520% 93.038% ## ( 3, 4 ] 68464 3.878% 96.916% # ( 4, 6 ] 43770 2.479% 99.395% ( 6, 10 ] 9159 0.519% 99.914% ( 10, 15 ] 1405 0.080% 99.993% ( 15, 22 ] 126 0.007% 100.000% ( 22, 34 ] 13 0.001% 100.001% ( 34, 51 ] 9 0.001% 100.002% ( 51, 76 ] 12 0.001% 100.002% ( 76, 110 ] 155 0.009% 100.011% ( 110, 170 ] 137 0.008% 100.019% ( 170, 250 ] 93 0.005% 100.024% ( 250, 380 ] 78 0.004% 100.029% ( 380, 580 ] 49 0.003% 100.031% ( 580, 870 ] 33 0.002% 100.033% ( 870, 1300 ] 23 0.001% 100.035% ( 1300, 1900 ] 13 0.001% 100.035% ( 1900, 2900 ] 14 0.001% 100.036% ( 2900, 4400 ] 11 0.001% 100.037% ** Level 1 read latency histogram (micros): Count: 401465 Average: 3.0487 StdDev: 32.87 Min: 0 Median: 1.6377 Max: 9652 Percentiles: P50: 1.64 P75: 2.15 P99: 7.68 P99.9: 13.61 P99.99: 112.87 ------------------------------------------------------ [ 0, 1 ] 39414 9.818% 9.818% ## ( 1, 2 ] 252951 63.007% 72.825% ############# ( 2, 3 ] 57658 14.362% 87.186% ### ( 3, 4 ] 24074 5.997% 93.183% # ( 4, 6 ] 20987 5.228% 98.411% # ( 6, 10 ] 5630 1.402% 99.813% ( 10, 15 ] 484 0.121% 99.933% ( 15, 22 ] 51 0.013% 99.946% ( 22, 34 ] 6 0.001% 99.948% ( 34, 51 ] 4 0.001% 99.949% ( 51, 76 ] 4 0.001% 99.950% ( 76, 110 ] 150 0.037% 99.987% ( 110, 170 ] 248 0.062% 100.049% ( 170, 250 ] 93 0.023% 100.072% ( 250, 380 ] 78 0.019% 100.091% ( 380, 580 ] 61 0.015% 100.107% ( 580, 870 ] 29 0.007% 100.114% ( 870, 1300 ] 18 0.004% 100.118% ( 1300, 1900 ] 8 0.002% 100.120% ( 1900, 2900 ] 7 0.002% 100.122% ( 2900, 4400 ] 11 0.003% 100.125% ( 4400, 6600 ] 3 0.001% 100.126% ( 6600, 9900 ] 1 0.000% 100.126% ** Level 2 read latency histogram (micros): Count: 95910 Average: 2.0725 StdDev: 5.52 Min: 0 Median: 1.4264 Max: 1236 Percentiles: P50: 1.43 P75: 1.83 P99: 5.70 P99.9: 11.83 P99.99: 54.41 ------------------------------------------------------ [ 0, 1 ] 22599 23.563% 23.563% ##### ( 1, 2 ] 59469 62.005% 85.568% ############ ( 2, 3 ] 7883 8.219% 93.787% ## ( 3, 4 ] 2983 3.110% 96.897% # ( 4, 6 ] 2370 2.471% 99.368% ( 6, 10 ] 469 0.489% 99.857% ( 10, 15 ] 112 0.117% 99.974% ( 15, 22 ] 11 0.011% 99.985% ( 22, 34 ] 4 0.004% 99.990% ( 51, 76 ] 3 0.003% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 255426 Average: 3.3272 StdDev: 30.83 Min: 0 Median: 1.6247 Max: 4016 Percentiles: P50: 1.62 P75: 2.09 P99: 8.56 P99.9: 169.43 P99.99: 442.95 ------------------------------------------------------ [ 0, 1 ] 27059 10.594% 10.594% ## ( 1, 2 ] 161128 63.082% 73.676% ############# ( 2, 3 ] 39759 15.566% 89.242% ### ( 3, 4 ] 12325 4.825% 94.067% # ( 4, 6 ] 10142 3.971% 98.037% # ( 6, 10 ] 3837 1.502% 99.540% ( 10, 15 ] 417 0.163% 99.703% ( 15, 22 ] 95 0.037% 99.740% ( 22, 34 ] 25 0.010% 99.750% ( 34, 51 ] 5 0.002% 99.752% ( 51, 76 ] 5 0.002% 99.754% ( 76, 110 ] 119 0.047% 99.800% ( 110, 170 ] 257 0.101% 99.901% ( 170, 250 ] 106 0.041% 99.942% ( 250, 380 ] 101 0.040% 99.982% ( 380, 580 ] 65 0.025% 100.007% ( 580, 870 ] 36 0.014% 100.022% ( 870, 1300 ] 20 0.008% 100.029% ( 1300, 1900 ] 11 0.004% 100.034% ( 1900, 2900 ] 11 0.004% 100.038% ( 2900, 4400 ] 6 0.002% 100.040% ** Level 4 read latency histogram (micros): Count: 320 Average: 159.0875 StdDev: 543.00 Min: 1 Median: 1.9524 Max: 3992 Percentiles: P50: 1.95 P75: 10.68 P99: 3200.00 P99.9: 3992.00 P99.99: 3992.00 ------------------------------------------------------ [ 0, 1 ] 60 18.750% 18.750% #### ( 1, 2 ] 105 32.812% 51.562% ####### ( 2, 3 ] 41 12.812% 64.375% ### ( 3, 4 ] 14 4.375% 68.750% # ( 4, 6 ] 10 3.125% 71.875% # ( 6, 10 ] 7 2.188% 74.062% ( 10, 15 ] 22 6.875% 80.938% # ( 15, 22 ] 19 5.938% 86.875% # ( 22, 34 ] 4 1.250% 88.125% ( 110, 170 ] 3 0.938% 89.062% ( 170, 250 ] 2 0.625% 89.688% ( 250, 380 ] 1 0.312% 90.000% ( 380, 580 ] 4 1.250% 91.250% ( 580, 870 ] 6 1.875% 93.125% ( 870, 1300 ] 8 2.500% 95.625% # ( 1300, 1900 ] 7 2.188% 97.812% ( 1900, 2900 ] 3 0.938% 98.750% ( 2900, 4400 ] 4 1.250% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 873.1667 StdDev: 1059.18 Min: 75 Median: 351.1111 Max: 4365 Percentiles: P50: 351.11 P75: 1156.67 P99: 4220.00 P99.9: 4365.00 P99.99: 4365.00 ------------------------------------------------------ ( 51, 76 ] 2 3.333% 3.333% # ( 76, 110 ] 6 10.000% 13.333% ## ( 110, 170 ] 9 15.000% 28.333% ### ( 170, 250 ] 6 10.000% 38.333% ## ( 250, 380 ] 9 15.000% 53.333% ### ( 380, 580 ] 5 8.333% 61.667% ## ( 580, 870 ] 6 10.000% 71.667% ## ( 870, 1300 ] 3 5.000% 76.667% # ( 1300, 1900 ] 3 5.000% 81.667% # ( 1900, 2900 ] 6 10.000% 91.667% ## ( 2900, 4400 ] 5 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 19.4 total, 3.6 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 304.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.275 H:M:S, 16.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 270.28 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.947 H:M:S, 26.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/11/03-07:15:41 ... thread 0: (1000000,7000000) ops and (118756.9,253037.6) ops/second in (8.420562,27.663869) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 4.18 GB 232.6 5.5 0.0 5.5 12.1 6.6 0.0 1.8 137.5 304.2 40.77 38.09 117 0.348 5692K 7192 0.0 0.0 L1 13/13 1.37 GB 0.0 2.4 2.2 0.2 2.4 2.2 0.2 1.1 230.0 229.0 10.79 10.43 3 3.597 2520K 11K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.0 2.0 248.3 248.2 1.52 1.47 2 0.761 383K 204 0.0 0.0 L3 22/0 973.05 MB 1.0 2.0 0.8 1.2 1.9 0.8 0.4 2.5 214.8 214.4 9.31 8.31 6 1.551 2030K 4273 0.0 0.0 L4 174/0 9.46 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 148.6 148.6 1.51 1.13 1 1.513 228K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1283/23 102.76 GB 0.0 10.4 3.4 7.1 17.1 10.0 3.4 2.6 167.3 273.4 63.90 59.42 129 0.495 10M 22K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.4 3.4 7.1 17.1 10.0 3.3 2.6 167.3 273.4 63.90 59.42 129 0.495 10M 22K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.4 3.4 7.1 10.4 3.4 0.0 0.0 240.8 240.2 44.40 42.19 31 1.432 10M 22K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 348.9 19.50 17.23 98 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.8 total, 27.7 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.06 GB write, 627.54 MB/s write, 10.44 GB read, 384.00 MB/s read, 63.9 seconds Interval compaction: 17.06 GB write, 631.52 MB/s write, 10.44 GB read, 386.43 MB/s read, 63.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 15, interval: 33 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2504898 Average: 2.2478 StdDev: 12.99 Min: 1 Median: 1.4918 Max: 4298 Percentiles: P50: 1.49 P75: 1.86 P99: 5.64 P99.9: 9.95 P99.99: 81.75 ------------------------------------------------------ [ 0, 1 ] 426384 17.022% 17.022% ### ( 1, 2 ] 1679592 67.052% 84.074% ############# ( 2, 3 ] 241542 9.643% 93.717% ## ( 3, 4 ] 88133 3.518% 97.236% # ( 4, 6 ] 53963 2.154% 99.390% ( 6, 10 ] 12936 0.516% 99.906% ( 10, 15 ] 1825 0.073% 99.979% ( 15, 22 ] 175 0.007% 99.986% ( 22, 34 ] 16 0.001% 99.987% ( 34, 51 ] 9 0.000% 99.987% ( 51, 76 ] 14 0.001% 99.988% ( 76, 110 ] 346 0.014% 100.001% ( 110, 170 ] 298 0.012% 100.013% ( 170, 250 ] 159 0.006% 100.020% ( 250, 380 ] 124 0.005% 100.025% ( 380, 580 ] 75 0.003% 100.028% ( 580, 870 ] 52 0.002% 100.030% ( 870, 1300 ] 31 0.001% 100.031% ( 1300, 1900 ] 15 0.001% 100.032% ( 1900, 2900 ] 20 0.001% 100.032% ( 2900, 4400 ] 13 0.001% 100.033% ** Level 1 read latency histogram (micros): Count: 604403 Average: 2.8329 StdDev: 27.27 Min: 0 Median: 1.5789 Max: 9652 Percentiles: P50: 1.58 P75: 1.97 P99: 7.54 P99.9: 79.91 P99.99: 144.55 ------------------------------------------------------ [ 0, 1 ] 76164 12.602% 12.602% ### ( 1, 2 ] 390441 64.599% 77.201% ############# ( 2, 3 ] 74445 12.317% 89.518% ## ( 3, 4 ] 29475 4.877% 94.395% # ( 4, 6 ] 24882 4.117% 98.512% # ( 6, 10 ] 7643 1.265% 99.776% ( 10, 15 ] 615 0.102% 99.878% ( 15, 22 ] 73 0.012% 99.890% ( 22, 34 ] 6 0.001% 99.891% ( 34, 51 ] 4 0.001% 99.892% ( 51, 76 ] 11 0.002% 99.893% ( 76, 110 ] 344 0.057% 99.950% ( 110, 170 ] 416 0.069% 100.019% ( 170, 250 ] 122 0.020% 100.039% ( 250, 380 ] 103 0.017% 100.056% ( 380, 580 ] 81 0.013% 100.070% ( 580, 870 ] 34 0.006% 100.075% ( 870, 1300 ] 19 0.003% 100.079% ( 1300, 1900 ] 8 0.001% 100.080% ( 1900, 2900 ] 7 0.001% 100.081% ( 2900, 4400 ] 11 0.002% 100.083% ( 4400, 6600 ] 3 0.000% 100.083% ( 6600, 9900 ] 1 0.000% 100.084% ** Level 2 read latency histogram (micros): Count: 95910 Average: 2.0725 StdDev: 5.52 Min: 0 Median: 1.4264 Max: 1236 Percentiles: P50: 1.43 P75: 1.83 P99: 5.70 P99.9: 11.83 P99.99: 54.41 ------------------------------------------------------ [ 0, 1 ] 22599 23.563% 23.563% ##### ( 1, 2 ] 59469 62.005% 85.568% ############ ( 2, 3 ] 7883 8.219% 93.787% ## ( 3, 4 ] 2983 3.110% 96.897% # ( 4, 6 ] 2370 2.471% 99.368% ( 6, 10 ] 469 0.489% 99.857% ( 10, 15 ] 112 0.117% 99.974% ( 15, 22 ] 11 0.011% 99.985% ( 22, 34 ] 4 0.004% 99.990% ( 51, 76 ] 3 0.003% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 255426 Average: 3.3272 StdDev: 30.83 Min: 0 Median: 1.6247 Max: 4016 Percentiles: P50: 1.62 P75: 2.09 P99: 8.56 P99.9: 169.43 P99.99: 442.95 ------------------------------------------------------ [ 0, 1 ] 27059 10.594% 10.594% ## ( 1, 2 ] 161128 63.082% 73.676% ############# ( 2, 3 ] 39759 15.566% 89.242% ### ( 3, 4 ] 12325 4.825% 94.067% # ( 4, 6 ] 10142 3.971% 98.037% # ( 6, 10 ] 3837 1.502% 99.540% ( 10, 15 ] 417 0.163% 99.703% ( 15, 22 ] 95 0.037% 99.740% ( 22, 34 ] 25 0.010% 99.750% ( 34, 51 ] 5 0.002% 99.752% ( 51, 76 ] 5 0.002% 99.754% ( 76, 110 ] 119 0.047% 99.800% ( 110, 170 ] 257 0.101% 99.901% ( 170, 250 ] 106 0.041% 99.942% ( 250, 380 ] 101 0.040% 99.982% ( 380, 580 ] 65 0.025% 100.007% ( 580, 870 ] 36 0.014% 100.022% ( 870, 1300 ] 20 0.008% 100.029% ( 1300, 1900 ] 11 0.004% 100.034% ( 1900, 2900 ] 11 0.004% 100.038% ( 2900, 4400 ] 6 0.002% 100.040% ** Level 4 read latency histogram (micros): Count: 320 Average: 159.0875 StdDev: 543.00 Min: 1 Median: 1.9524 Max: 3992 Percentiles: P50: 1.95 P75: 10.68 P99: 3200.00 P99.9: 3992.00 P99.99: 3992.00 ------------------------------------------------------ [ 0, 1 ] 60 18.750% 18.750% #### ( 1, 2 ] 105 32.812% 51.562% ####### ( 2, 3 ] 41 12.812% 64.375% ### ( 3, 4 ] 14 4.375% 68.750% # ( 4, 6 ] 10 3.125% 71.875% # ( 6, 10 ] 7 2.188% 74.062% ( 10, 15 ] 22 6.875% 80.938% # ( 15, 22 ] 19 5.938% 86.875% # ( 22, 34 ] 4 1.250% 88.125% ( 110, 170 ] 3 0.938% 89.062% ( 170, 250 ] 2 0.625% 89.688% ( 250, 380 ] 1 0.312% 90.000% ( 380, 580 ] 4 1.250% 91.250% ( 580, 870 ] 6 1.875% 93.125% ( 870, 1300 ] 8 2.500% 95.625% # ( 1300, 1900 ] 7 2.188% 97.812% ( 1900, 2900 ] 3 0.938% 98.750% ( 2900, 4400 ] 4 1.250% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 873.1667 StdDev: 1059.18 Min: 75 Median: 351.1111 Max: 4365 Percentiles: P50: 351.11 P75: 1156.67 P99: 4220.00 P99.9: 4365.00 P99.99: 4365.00 ------------------------------------------------------ ( 51, 76 ] 2 3.333% 3.333% # ( 76, 110 ] 6 10.000% 13.333% ## ( 110, 170 ] 9 15.000% 28.333% ### ( 170, 250 ] 6 10.000% 38.333% ## ( 250, 380 ] 9 15.000% 53.333% ### ( 380, 580 ] 5 8.333% 61.667% ## ( 580, 870 ] 6 10.000% 71.667% ## ( 870, 1300 ] 3 5.000% 76.667% # ( 1300, 1900 ] 3 5.000% 81.667% # ( 1900, 2900 ] 6 10.000% 91.667% ## ( 2900, 4400 ] 5 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 27.8 total, 8.4 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 247.46 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.778 H:M:S, 31.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 116.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.503 H:M:S, 65.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/03-07:15:49 ... thread 0: (1000000,8000000) ops and (140806.6,230111.1) ops/second in (7.101939,34.765808) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 3.25 GB 25.2 6.8 0.0 6.8 14.4 7.6 0.0 1.9 136.9 291.1 50.60 45.96 134 0.378 7035K 10K 0.0 0.0 L1 20/20 1.69 GB 0.0 5.7 4.1 1.6 5.6 4.1 0.2 1.4 225.5 223.4 25.86 24.78 4 6.465 5923K 55K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.5 2.0 248.3 248.2 1.52 1.47 2 0.761 383K 204 0.0 0.0 L3 21/0 956.16 MB 1.0 4.0 2.3 1.7 4.0 2.3 0.4 1.7 148.1 147.4 27.79 18.29 15 1.853 4182K 21K 0.0 0.0 L4 183/0 9.70 GB 1.0 1.8 1.7 0.1 1.7 1.7 0.8 1.1 125.4 125.2 14.30 9.18 24 0.596 1794K 2746 0.0 0.0 L5 1072/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1309/30 103.68 GB 0.0 18.6 8.3 10.3 26.1 15.8 6.3 3.4 158.7 222.9 120.08 99.69 179 0.671 19M 90K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.6 8.3 10.3 26.1 15.8 6.2 3.4 158.7 222.9 120.08 99.69 179 0.671 19M 90K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.6 8.3 10.3 18.5 8.2 0.0 0.0 197.0 196.0 96.72 79.83 67 1.444 19M 90K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 334.5 23.36 19.86 112 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.9 total, 34.8 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.14 GB write, 766.13 MB/s write, 18.60 GB read, 545.21 MB/s read, 120.1 seconds Interval compaction: 26.14 GB write, 769.99 MB/s write, 18.60 GB read, 547.96 MB/s read, 120.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 26, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 30, total-stops: 26, interval: 56 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2925843 Average: 2.4592 StdDev: 27.19 Min: 0 Median: 1.5039 Max: 14099 Percentiles: P50: 1.50 P75: 1.88 P99: 5.86 P99.9: 13.19 P99.99: 157.52 ------------------------------------------------------ [ 0, 1 ] 493867 16.879% 16.879% ### ( 1, 2 ] 1922993 65.724% 82.604% ############# ( 2, 3 ] 291730 9.971% 92.575% ## ( 3, 4 ] 114100 3.900% 96.474% # ( 4, 6 ] 79380 2.713% 99.187% # ( 6, 10 ] 19208 0.656% 99.844% ( 10, 15 ] 2570 0.088% 99.932% ( 15, 22 ] 253 0.009% 99.940% ( 22, 34 ] 21 0.001% 99.941% ( 34, 51 ] 23 0.001% 99.942% ( 51, 76 ] 44 0.002% 99.943% ( 76, 110 ] 788 0.027% 99.970% ( 110, 170 ] 724 0.025% 99.995% ( 170, 250 ] 302 0.010% 100.005% ( 250, 380 ] 237 0.008% 100.014% ( 380, 580 ] 181 0.006% 100.020% ( 580, 870 ] 126 0.004% 100.024% ( 870, 1300 ] 49 0.002% 100.026% ( 1300, 1900 ] 36 0.001% 100.027% ( 1900, 2900 ] 31 0.001% 100.028% ( 2900, 4400 ] 33 0.001% 100.029% ( 4400, 6600 ] 5 0.000% 100.029% ( 6600, 9900 ] 10 0.000% 100.030% ( 9900, 14000 ] 2 0.000% 100.030% ( 14000, 22000 ] 1 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 1051272 Average: 4.6649 StdDev: 75.13 Min: 0 Median: 1.7188 Max: 10491 Percentiles: P50: 1.72 P75: 2.55 P99: 8.60 P99.9: 14.45 P99.99: 93.33 ------------------------------------------------------ [ 0, 1 ] 93419 8.886% 8.886% ## ( 1, 2 ] 601280 57.195% 66.082% ########### ( 2, 3 ] 171722 16.335% 82.416% ### ( 3, 4 ] 79132 7.527% 89.944% ## ( 4, 6 ] 81861 7.787% 97.731% ## ( 6, 10 ] 20545 1.954% 99.685% ( 10, 15 ] 2542 0.242% 99.927% ( 15, 22 ] 330 0.031% 99.958% ( 22, 34 ] 29 0.003% 99.961% ( 34, 51 ] 11 0.001% 99.962% ( 51, 76 ] 69 0.007% 99.968% ( 76, 110 ] 445 0.042% 100.011% ( 110, 170 ] 474 0.045% 100.056% ( 170, 250 ] 203 0.019% 100.075% ( 250, 380 ] 272 0.026% 100.101% ( 380, 580 ] 320 0.030% 100.131% ( 580, 870 ] 269 0.026% 100.157% ( 870, 1300 ] 222 0.021% 100.178% ( 1300, 1900 ] 99 0.009% 100.188% ( 1900, 2900 ] 90 0.009% 100.196% ( 2900, 4400 ] 175 0.017% 100.213% ( 4400, 6600 ] 35 0.003% 100.216% ( 6600, 9900 ] 24 0.002% 100.218% ( 9900, 14000 ] 1 0.000% 100.218% ** Level 2 read latency histogram (micros): Count: 95910 Average: 2.0725 StdDev: 5.52 Min: 0 Median: 1.4264 Max: 1236 Percentiles: P50: 1.43 P75: 1.83 P99: 5.70 P99.9: 11.83 P99.99: 54.41 ------------------------------------------------------ [ 0, 1 ] 22599 23.563% 23.563% ##### ( 1, 2 ] 59469 62.005% 85.568% ############ ( 2, 3 ] 7883 8.219% 93.787% ## ( 3, 4 ] 2983 3.110% 96.897% # ( 4, 6 ] 2370 2.471% 99.368% ( 6, 10 ] 469 0.489% 99.857% ( 10, 15 ] 112 0.117% 99.974% ( 15, 22 ] 11 0.011% 99.985% ( 22, 34 ] 4 0.004% 99.990% ( 51, 76 ] 3 0.003% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 764943 Average: 4.0237 StdDev: 50.50 Min: 0 Median: 1.8627 Max: 14565 Percentiles: P50: 1.86 P75: 2.84 P99: 8.34 P99.9: 12.08 P99.99: 13.65 ------------------------------------------------------ [ 0, 1 ] 33251 4.347% 4.347% # ( 1, 2 ] 404800 52.919% 57.266% ########### ( 2, 3 ] 161089 21.059% 78.325% #### ( 3, 4 ] 74186 9.698% 88.023% ## ( 4, 6 ] 75566 9.879% 97.902% ## ( 6, 10 ] 14368 1.878% 99.780% ( 10, 15 ] 2202 0.288% 100.068% ( 15, 22 ] 285 0.037% 100.105% ( 22, 34 ] 39 0.005% 100.110% ( 34, 51 ] 8 0.001% 100.111% ( 51, 76 ] 21 0.003% 100.114% ( 76, 110 ] 125 0.016% 100.130% ( 110, 170 ] 297 0.039% 100.169% ( 170, 250 ] 189 0.025% 100.194% ( 250, 380 ] 240 0.031% 100.225% ( 380, 580 ] 231 0.030% 100.255% ( 580, 870 ] 165 0.022% 100.277% ( 870, 1300 ] 98 0.013% 100.290% ( 1300, 1900 ] 31 0.004% 100.294% ( 1900, 2900 ] 41 0.005% 100.299% ( 2900, 4400 ] 62 0.008% 100.307% ( 4400, 6600 ] 2 0.000% 100.308% ( 6600, 9900 ] 3 0.000% 100.308% ( 14000, 22000 ] 1 0.000% 100.308% ** Level 4 read latency histogram (micros): Count: 23414 Average: 98.0728 StdDev: 716.99 Min: 1 Median: 1.9863 Max: 34156 Percentiles: P50: 1.99 P75: 3.27 P99: 2172.05 P99.9: 9868.23 P99.99: 21024.44 ------------------------------------------------------ [ 0, 1 ] 656 2.802% 2.802% # ( 1, 2 ] 11205 47.856% 50.658% ########## ( 2, 3 ] 4960 21.184% 71.842% #### ( 3, 4 ] 2745 11.724% 83.565% ## ( 4, 6 ] 1665 7.111% 90.677% # ( 6, 10 ] 464 1.982% 92.658% ( 10, 15 ] 114 0.487% 93.145% ( 15, 22 ] 28 0.120% 93.265% ( 22, 34 ] 4 0.017% 93.282% ( 51, 76 ] 1 0.004% 93.286% ( 76, 110 ] 15 0.064% 93.350% ( 110, 170 ] 61 0.261% 93.611% ( 170, 250 ] 95 0.406% 94.016% ( 250, 380 ] 182 0.777% 94.794% ( 380, 580 ] 296 1.264% 96.058% ( 580, 870 ] 318 1.358% 97.416% ( 870, 1300 ] 238 1.016% 98.433% ( 1300, 1900 ] 113 0.483% 98.915% ( 1900, 2900 ] 73 0.312% 99.227% ( 2900, 4400 ] 85 0.363% 99.590% ( 4400, 6600 ] 30 0.128% 99.718% ( 6600, 9900 ] 43 0.184% 99.902% ( 9900, 14000 ] 11 0.047% 99.949% ( 14000, 22000 ] 11 0.047% 99.996% ( 22000, 33000 ] 2 0.009% 100.004% ( 33000, 50000 ] 1 0.004% 100.009% ** Level 5 read latency histogram (micros): Count: 140 Average: 1142.8571 StdDev: 1220.04 Min: 75 Median: 580.0000 Max: 4820 Percentiles: P50: 580.00 P75: 1833.33 P99: 4366.67 P99.9: 4820.00 P99.99: 4820.00 ------------------------------------------------------ ( 51, 76 ] 2 1.429% 1.429% ( 76, 110 ] 7 5.000% 6.429% # ( 110, 170 ] 14 10.000% 16.429% ## ( 170, 250 ] 15 10.714% 27.143% ## ( 250, 380 ] 21 15.000% 42.143% ### ( 380, 580 ] 11 7.857% 50.000% ## ( 580, 870 ] 16 11.429% 61.429% ## ( 870, 1300 ] 11 7.857% 69.286% ## ( 1300, 1900 ] 9 6.429% 75.714% # ( 1900, 2900 ] 15 10.714% 86.429% ## ( 2900, 4400 ] 18 12.857% 99.286% ### ( 4400, 6600 ] 1 0.714% 100.000% ** DB Stats ** Uptime(secs): 34.9 total, 7.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 225.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.900 H:M:S, 36.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 138.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.121 H:M:S, 58.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/03-07:16:06 ... thread 0: (1000000,9000000) ops and (57794.6,172849.3) ops/second in (17.302665,52.068473) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/15 4.24 GB 0.0 7.9 0.0 7.9 16.5 8.6 0.0 1.9 139.5 291.8 57.81 52.78 152 0.380 8186K 11K 0.0 0.0 L1 20/20 1.69 GB 0.0 5.7 4.1 1.6 5.6 4.1 0.2 1.4 225.5 223.4 25.86 24.78 4 6.465 5923K 55K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.5 2.0 248.3 248.2 1.52 1.47 2 0.761 383K 204 0.0 0.0 L3 21/0 956.16 MB 1.0 4.0 2.3 1.7 4.0 2.3 0.4 1.7 148.1 147.4 27.79 18.29 15 1.853 4182K 21K 0.0 0.0 L4 183/0 9.70 GB 1.0 1.8 1.7 0.1 1.7 1.7 0.8 1.1 125.4 125.2 14.30 9.18 24 0.596 1794K 2746 0.0 0.0 L5 1072/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1311/35 104.66 GB 0.0 19.7 8.3 11.4 28.2 16.8 6.3 3.3 158.6 227.1 127.29 106.51 197 0.646 20M 91K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.7 8.3 11.4 28.2 16.8 6.2 3.3 158.6 227.1 127.29 106.51 197 0.646 20M 91K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.7 8.3 11.4 19.6 8.2 0.0 0.0 199.8 198.9 101.02 84.03 71 1.423 20M 91K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 335.8 26.27 22.48 126 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 52.2 total, 52.1 interval Flush(GB): cumulative 8.613, interval 8.613 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.23 GB write, 553.37 MB/s write, 19.71 GB read, 386.35 MB/s read, 127.3 seconds Interval compaction: 28.23 GB write, 555.23 MB/s write, 19.71 GB read, 387.65 MB/s read, 127.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 22, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 22, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 30, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 36, total-stops: 30, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4128240 Average: 2.8165 StdDev: 25.95 Min: 0 Median: 1.4787 Max: 14099 Percentiles: P50: 1.48 P75: 1.87 P99: 6.66 P99.9: 152.41 P99.99: 318.26 ------------------------------------------------------ [ 0, 1 ] 786752 19.058% 19.058% #### ( 1, 2 ] 2668591 64.642% 83.700% ############# ( 2, 3 ] 376047 9.109% 92.809% ## ( 3, 4 ] 149692 3.626% 96.435% # ( 4, 6 ] 101375 2.456% 98.891% ( 6, 10 ] 27258 0.660% 99.551% ( 10, 15 ] 3799 0.092% 99.643% ( 15, 22 ] 690 0.017% 99.660% ( 22, 34 ] 46 0.001% 99.661% ( 34, 51 ] 54 0.001% 99.662% ( 51, 76 ] 111 0.003% 99.665% ( 76, 110 ] 5480 0.133% 99.798% ( 110, 170 ] 5968 0.145% 99.942% ( 170, 250 ] 1470 0.036% 99.978% ( 250, 380 ] 945 0.023% 100.001% ( 380, 580 ] 698 0.017% 100.018% ( 580, 870 ] 275 0.007% 100.024% ( 870, 1300 ] 75 0.002% 100.026% ( 1300, 1900 ] 43 0.001% 100.027% ( 1900, 2900 ] 36 0.001% 100.028% ( 2900, 4400 ] 44 0.001% 100.029% ( 4400, 6600 ] 5 0.000% 100.029% ( 6600, 9900 ] 10 0.000% 100.030% ( 9900, 14000 ] 2 0.000% 100.030% ( 14000, 22000 ] 1 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 1340261 Average: 4.3044 StdDev: 66.96 Min: 0 Median: 1.6477 Max: 10491 Percentiles: P50: 1.65 P75: 2.34 P99: 8.70 P99.9: 98.88 P99.99: 147.45 ------------------------------------------------------ [ 0, 1 ] 172563 12.875% 12.875% ### ( 1, 2 ] 768240 57.320% 70.196% ########### ( 2, 3 ] 190826 14.238% 84.433% ### ( 3, 4 ] 89980 6.714% 91.147% # ( 4, 6 ] 89682 6.691% 97.838% # ( 6, 10 ] 23085 1.722% 99.561% ( 10, 15 ] 2960 0.221% 99.782% ( 15, 22 ] 482 0.036% 99.818% ( 22, 34 ] 37 0.003% 99.820% ( 34, 51 ] 11 0.001% 99.821% ( 51, 76 ] 145 0.011% 99.832% ( 76, 110 ] 1352 0.101% 99.933% ( 110, 170 ] 1224 0.091% 100.024% ( 170, 250 ] 320 0.024% 100.048% ( 250, 380 ] 347 0.026% 100.074% ( 380, 580 ] 364 0.027% 100.101% ( 580, 870 ] 288 0.021% 100.123% ( 870, 1300 ] 225 0.017% 100.140% ( 1300, 1900 ] 100 0.007% 100.147% ( 1900, 2900 ] 91 0.007% 100.154% ( 2900, 4400 ] 176 0.013% 100.167% ( 4400, 6600 ] 35 0.003% 100.170% ( 6600, 9900 ] 24 0.002% 100.171% ( 9900, 14000 ] 1 0.000% 100.171% ** Level 2 read latency histogram (micros): Count: 95910 Average: 2.0725 StdDev: 5.52 Min: 0 Median: 1.4264 Max: 1236 Percentiles: P50: 1.43 P75: 1.83 P99: 5.70 P99.9: 11.83 P99.99: 54.41 ------------------------------------------------------ [ 0, 1 ] 22599 23.563% 23.563% ##### ( 1, 2 ] 59469 62.005% 85.568% ############ ( 2, 3 ] 7883 8.219% 93.787% ## ( 3, 4 ] 2983 3.110% 96.897% # ( 4, 6 ] 2370 2.471% 99.368% ( 6, 10 ] 469 0.489% 99.857% ( 10, 15 ] 112 0.117% 99.974% ( 15, 22 ] 11 0.011% 99.985% ( 22, 34 ] 4 0.004% 99.990% ( 51, 76 ] 3 0.003% 99.993% ( 170, 250 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 764943 Average: 4.0237 StdDev: 50.50 Min: 0 Median: 1.8627 Max: 14565 Percentiles: P50: 1.86 P75: 2.84 P99: 8.34 P99.9: 12.08 P99.99: 13.65 ------------------------------------------------------ [ 0, 1 ] 33251 4.347% 4.347% # ( 1, 2 ] 404800 52.919% 57.266% ########### ( 2, 3 ] 161089 21.059% 78.325% #### ( 3, 4 ] 74186 9.698% 88.023% ## ( 4, 6 ] 75566 9.879% 97.902% ## ( 6, 10 ] 14368 1.878% 99.780% ( 10, 15 ] 2202 0.288% 100.068% ( 15, 22 ] 285 0.037% 100.105% ( 22, 34 ] 39 0.005% 100.110% ( 34, 51 ] 8 0.001% 100.111% ( 51, 76 ] 21 0.003% 100.114% ( 76, 110 ] 125 0.016% 100.130% ( 110, 170 ] 297 0.039% 100.169% ( 170, 250 ] 189 0.025% 100.194% ( 250, 380 ] 240 0.031% 100.225% ( 380, 580 ] 231 0.030% 100.255% ( 580, 870 ] 165 0.022% 100.277% ( 870, 1300 ] 98 0.013% 100.290% ( 1300, 1900 ] 31 0.004% 100.294% ( 1900, 2900 ] 41 0.005% 100.299% ( 2900, 4400 ] 62 0.008% 100.307% ( 4400, 6600 ] 2 0.000% 100.308% ( 6600, 9900 ] 3 0.000% 100.308% ( 14000, 22000 ] 1 0.000% 100.308% ** Level 4 read latency histogram (micros): Count: 23414 Average: 98.0728 StdDev: 716.99 Min: 1 Median: 1.9863 Max: 34156 Percentiles: P50: 1.99 P75: 3.27 P99: 2172.05 P99.9: 9868.23 P99.99: 21024.44 ------------------------------------------------------ [ 0, 1 ] 656 2.802% 2.802% # ( 1, 2 ] 11205 47.856% 50.658% ########## ( 2, 3 ] 4960 21.184% 71.842% #### ( 3, 4 ] 2745 11.724% 83.565% ## ( 4, 6 ] 1665 7.111% 90.677% # ( 6, 10 ] 464 1.982% 92.658% ( 10, 15 ] 114 0.487% 93.145% ( 15, 22 ] 28 0.120% 93.265% ( 22, 34 ] 4 0.017% 93.282% ( 51, 76 ] 1 0.004% 93.286% ( 76, 110 ] 15 0.064% 93.350% ( 110, 170 ] 61 0.261% 93.611% ( 170, 250 ] 95 0.406% 94.016% ( 250, 380 ] 182 0.777% 94.794% ( 380, 580 ] 296 1.264% 96.058% ( 580, 870 ] 318 1.358% 97.416% ( 870, 1300 ] 238 1.016% 98.433% ( 1300, 1900 ] 113 0.483% 98.915% ( 1900, 2900 ] 73 0.312% 99.227% ( 2900, 4400 ] 85 0.363% 99.590% ( 4400, 6600 ] 30 0.128% 99.718% ( 6600, 9900 ] 43 0.184% 99.902% ( 9900, 14000 ] 11 0.047% 99.949% ( 14000, 22000 ] 11 0.047% 99.996% ( 22000, 33000 ] 2 0.009% 100.004% ( 33000, 50000 ] 1 0.004% 100.009% ** Level 5 read latency histogram (micros): Count: 140 Average: 1142.8571 StdDev: 1220.04 Min: 75 Median: 580.0000 Max: 4820 Percentiles: P50: 580.00 P75: 1833.33 P99: 4366.67 P99.9: 4820.00 P99.99: 4820.00 ------------------------------------------------------ ( 51, 76 ] 2 1.429% 1.429% ( 76, 110 ] 7 5.000% 6.429% # ( 110, 170 ] 14 10.000% 16.429% ## ( 170, 250 ] 15 10.714% 27.143% ## ( 250, 380 ] 21 15.000% 42.143% ### ( 380, 580 ] 11 7.857% 50.000% ## ( 580, 870 ] 16 11.429% 61.429% ## ( 870, 1300 ] 11 7.857% 69.286% ## ( 1300, 1900 ] 9 6.429% 75.714% # ( 1900, 2900 ] 15 10.714% 86.429% ## ( 2900, 4400 ] 18 12.857% 99.286% ### ( 4400, 6600 ] 1 0.714% 100.000% ** DB Stats ** Uptime(secs): 52.2 total, 17.3 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 169.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.381 H:M:S, 52.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 56.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:14.481 H:M:S, 83.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.628 micros/op 150879 ops/sec 60.035 seconds 9057999 operations; 146.2 MB/s Microseconds per write: Count: 9057999 Average: 6.6275 StdDev: 302.12 Min: 1 Median: 1.7382 Max: 359580 Percentiles: P50: 1.74 P75: 2.77 P99: 9.14 P99.9: 1223.35 P99.99: 2791.65 ------------------------------------------------------ [ 0, 1 ] 1236857 13.655% 13.655% ### ( 1, 2 ] 4459453 49.232% 62.887% ########## ( 2, 3 ] 1422484 15.704% 78.591% ### ( 3, 4 ] 1263432 13.948% 92.539% ### ( 4, 6 ] 510214 5.633% 98.172% # ( 6, 10 ] 95600 1.055% 99.228% ( 10, 15 ] 26819 0.296% 99.524% ( 15, 22 ] 7948 0.088% 99.611% ( 22, 34 ] 1914 0.021% 99.633% ( 34, 51 ] 219 0.002% 99.635% ( 51, 76 ] 25 0.000% 99.635% ( 76, 110 ] 5817 0.064% 99.700% ( 110, 170 ] 2937 0.032% 99.732% ( 170, 250 ] 315 0.003% 99.735% ( 250, 380 ] 127 0.001% 99.737% ( 380, 580 ] 22 0.000% 99.737% ( 580, 870 ] 20 0.000% 99.737% ( 870, 1300 ] 17935 0.198% 99.935% ( 1300, 1900 ] 110 0.001% 99.937% ( 1900, 2900 ] 5434 0.060% 99.997% ( 2900, 4400 ] 231 0.003% 99.999% ( 4400, 6600 ] 47 0.001% 100.000% ( 6600, 9900 ] 22 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 170000, 250000 ] 12 0.000% 100.000% ( 250000, 380000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 224522 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9057999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9347854968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 511 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 35057282 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31543088411 rocksdb.compact.write.bytes COUNT : 31315190057 rocksdb.flush.write.bytes COUNT : 9314144730 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 38 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 292 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9239070720 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3622912 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31627652643 rocksdb.non.last.level.read.count COUNT : 7645257 rocksdb.block.checksum.compute.count COUNT : 7644273 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.387586 P95 : 3.919178 P99 : 7.814029 P100 : 359577.000000 COUNT : 9057999 SUM : 55848197 rocksdb.compaction.times.micros P50 : 993939.393939 P95 : 4195000.000000 P99 : 22788665.000000 P100 : 22788665.000000 COUNT : 86 SUM : 140781368 rocksdb.compaction.times.cpu_micros P50 : 885185.185185 P95 : 4195000.000000 P99 : 18560000.000000 P100 : 20665494.000000 COUNT : 86 SUM : 115682153 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 680.220588 P95 : 1209.968750 P99 : 26015.000000 P100 : 32306.000000 COUNT : 127 SUM : 142545 rocksdb.compaction.outfile.sync.micros P50 : 1085.000000 P95 : 179866.666667 P99 : 285620.000000 P100 : 323687.000000 COUNT : 363 SUM : 10020910 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 96.622951 P95 : 1195.571429 P99 : 3730.000000 P100 : 12513.000000 COUNT : 234 SUM : 73358 rocksdb.table.open.io.micros P50 : 1455.172414 P95 : 6667.500000 P99 : 9733.500000 P100 : 31950.000000 COUNT : 511 SUM : 1029298 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.652248 P95 : 8.074410 P99 : 11.548917 P100 : 34162.000000 COUNT : 7643055 SUM : 49161085 rocksdb.read.block.get.micros P50 : 453.949580 P95 : 3075.000000 P99 : 5156.000000 P100 : 23578.000000 COUNT : 1022 SUM : 854802 rocksdb.write.raw.block.micros P50 : 0.514882 P95 : 0.978276 P99 : 2.963365 P100 : 70552.000000 COUNT : 9843735 SUM : 19959372 rocksdb.numfiles.in.singlecompaction P50 : 3.016949 P95 : 7.100000 P99 : 25.720000 P100 : 30.000000 COUNT : 138 SUM : 497 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.555776 P95 : 1154.061006 P99 : 2511.416206 P100 : 359037.000000 COUNT : 237501 SUM : 35073088 rocksdb.sst.read.micros P50 : 1.592961 P95 : 4.839907 P99 : 8.762942 P100 : 34156.000000 COUNT : 7645792 SUM : 32932020 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9057999 SUM : 9347854968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211276.595745 P95 : 366500.000000 P99 : 557175.000000 P100 : 574781.000000 COUNT : 127 SUM : 26455791 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 338 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0