[2024-11-16 22:37:29.498120] Starting SPDK v25.01-pre git sha1 83e8405e4 / DPDK 23.11.0 initialization... [2024-11-16 22:37:29.498386] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid428700 ] Set seed to 1731793049491462 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-16 22:37:29.624542] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-16 22:37:29.647817] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-16 22:37:29.647863] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 428700' to capture a snapshot of events at runtime. [2024-11-16 22:37:29.647874] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-16 22:37:29.647884] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-16 22:37:29.647892] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid428700 for offline analysis/debug. [2024-11-16 22:37:29.648466] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Nov 16 22:37:33 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/16-22:37:36 ... thread 0: (1000000,1000000) ops and (356081.4,356081.4) ops/second in (2.808347,2.808347) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/10 630.01 MB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 352.6 2.32 2.10 12 0.194 0 0 0.0 0.0 L2 3/2 237.24 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 238.2 238.1 1.46 1.40 2 0.732 354K 175 0.0 0.0 L3 9/0 755.91 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/12 96.94 GB 0.0 0.3 0.2 0.2 1.1 1.0 0.0 1.4 92.1 308.3 3.79 3.50 14 0.270 354K 175 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.1 1.0 0.0 1.4 92.1 308.3 3.79 3.50 14 0.270 354K 175 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 238.2 238.1 1.46 1.40 2 0.732 354K 175 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 352.6 2.32 2.10 12 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.14 GB write, 385.19 MB/s write, 0.34 GB read, 115.09 MB/s read, 3.8 seconds Interval compaction: 1.14 GB write, 415.58 MB/s write, 0.34 GB read, 124.17 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 105207 Average: 2.0593 StdDev: 22.62 Min: 1 Median: 1.3031 Max: 4549 Percentiles: P50: 1.30 P75: 1.73 P99: 5.04 P99.9: 9.64 P99.99: 24.88 ------------------------------------------------------ [ 0, 1 ] 33898 32.220% 32.220% ###### ( 1, 2 ] 61718 58.663% 90.884% ############ ( 2, 3 ] 5583 5.307% 96.190% # ( 3, 4 ] 2321 2.206% 98.396% ( 4, 6 ] 1228 1.167% 99.564% ( 6, 10 ] 391 0.372% 99.935% ( 10, 15 ] 46 0.044% 99.979% ( 15, 22 ] 13 0.012% 99.991% ( 22, 34 ] 2 0.002% 99.993% ( 51, 76 ] 3 0.003% 99.996% ( 76, 110 ] 1 0.001% 99.997% ( 110, 170 ] 8 0.008% 100.005% ( 170, 250 ] 2 0.002% 100.007% ( 250, 380 ] 4 0.004% 100.010% ( 380, 580 ] 1 0.001% 100.011% ( 580, 870 ] 2 0.002% 100.013% ( 1300, 1900 ] 2 0.002% 100.015% ( 1900, 2900 ] 4 0.004% 100.019% ( 4400, 6600 ] 1 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 12314 Average: 3.4907 StdDev: 46.40 Min: 1 Median: 1.2777 Max: 2774 Percentiles: P50: 1.28 P75: 1.73 P99: 9.53 P99.9: 286.53 P99.99: 2489.53 ------------------------------------------------------ [ 0, 1 ] 4279 34.749% 34.749% ####### ( 1, 2 ] 6763 54.921% 89.670% ########### ( 2, 3 ] 752 6.107% 95.777% # ( 3, 4 ] 122 0.991% 96.768% ( 4, 6 ] 160 1.299% 98.067% ( 6, 10 ] 130 1.056% 99.123% ( 10, 15 ] 15 0.122% 99.245% ( 15, 22 ] 5 0.041% 99.285% ( 22, 34 ] 2 0.016% 99.302% ( 34, 51 ] 30 0.244% 99.545% ( 51, 76 ] 21 0.171% 99.716% ( 76, 110 ] 4 0.032% 99.748% ( 110, 170 ] 2 0.016% 99.764% ( 170, 250 ] 15 0.122% 99.886% ( 250, 380 ] 6 0.049% 99.935% ( 380, 580 ] 1 0.008% 99.943% ( 580, 870 ] 2 0.016% 99.959% ( 870, 1300 ] 1 0.008% 99.968% ( 1300, 1900 ] 1 0.008% 99.976% ( 1900, 2900 ] 3 0.024% 100.000% ** Level 2 read latency histogram (micros): Count: 59073 Average: 1.9531 StdDev: 7.31 Min: 0 Median: 1.3339 Max: 1069 Percentiles: P50: 1.33 P75: 1.74 P99: 5.29 P99.9: 9.77 P99.99: 225.81 ------------------------------------------------------ [ 0, 1 ] 17521 29.660% 29.660% ###### ( 1, 2 ] 35990 60.925% 90.585% ############ ( 2, 3 ] 3112 5.268% 95.853% # ( 3, 4 ] 1346 2.279% 98.131% ( 4, 6 ] 798 1.351% 99.482% ( 6, 10 ] 263 0.445% 99.927% ( 10, 15 ] 29 0.049% 99.976% ( 15, 22 ] 3 0.005% 99.981% ( 22, 34 ] 1 0.002% 99.983% ( 76, 110 ] 1 0.002% 99.985% ( 110, 170 ] 2 0.003% 99.988% ( 170, 250 ] 3 0.005% 99.993% ( 250, 380 ] 2 0.003% 99.997% ( 580, 870 ] 1 0.002% 99.998% ( 870, 1300 ] 2 0.003% 100.002% ** Level 3 read latency histogram (micros): Count: 45 Average: 1151.2444 StdDev: 908.02 Min: 65 Median: 934.5000 Max: 3660 Percentiles: P50: 934.50 P75: 1630.00 P99: 3660.00 P99.9: 3660.00 P99.99: 3660.00 ------------------------------------------------------ ( 51, 76 ] 2 4.444% 4.444% # ( 110, 170 ] 2 4.444% 8.889% # ( 170, 250 ] 4 8.889% 17.778% ## ( 250, 380 ] 1 2.222% 20.000% ( 380, 580 ] 2 4.444% 24.444% # ( 580, 870 ] 10 22.222% 46.667% #### ( 870, 1300 ] 10 22.222% 68.889% #### ( 1300, 1900 ] 5 11.111% 80.000% ## ( 1900, 2900 ] 6 13.333% 93.333% ### ( 2900, 4400 ] 3 6.667% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1565.2000 StdDev: 975.80 Min: 201 Median: 1420.0000 Max: 4387 Percentiles: P50: 1420.00 P75: 1870.00 P99: 4287.50 P99.9: 4387.00 P99.99: 4387.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 3 10.000% 13.333% ## ( 580, 870 ] 6 20.000% 33.333% #### ( 870, 1300 ] 3 10.000% 43.333% ## ( 1300, 1900 ] 10 33.333% 76.667% ####### ( 1900, 2900 ] 3 10.000% 86.667% ## ( 2900, 4400 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 324.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.232 H:M:S, 7.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 350.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.232 H:M:S, 8.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/16-22:37:39 ... thread 0: (1000000,2000000) ops and (331631.8,343422.0) ops/second in (3.015392,5.823739) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 1.23 GB 44.1 0.5 0.0 0.5 2.3 1.8 0.0 1.3 71.3 329.7 7.07 6.51 28 0.252 511K 511 0.0 0.0 L1 4/4 377.33 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 237.8 237.3 1.59 1.54 1 1.590 383K 624 0.0 0.0 L2 1/0 49.90 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 238.2 238.1 1.46 1.40 2 0.732 354K 175 0.0 0.0 L3 18/0 943.26 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.0 1.0 220.8 220.8 0.85 0.78 1 0.848 190K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1195/12 97.92 GB 0.0 1.4 0.7 0.6 3.2 2.5 0.2 1.8 129.3 295.7 10.97 10.24 32 0.343 1440K 1310 0.0 0.0 Int 0/0 0.00 KB 0.0 1.4 0.7 0.6 3.2 2.5 0.2 1.8 129.3 295.7 10.97 10.24 32 0.343 1440K 1310 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.4 0.7 0.6 1.4 0.7 0.0 0.0 243.6 243.4 5.82 5.61 6 0.970 1440K 1310 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 354.7 5.15 4.62 26 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.17 GB write, 536.45 MB/s write, 1.38 GB read, 234.55 MB/s read, 11.0 seconds Interval compaction: 3.17 GB write, 556.86 MB/s write, 1.38 GB read, 243.47 MB/s read, 11.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 389226 Average: 2.1011 StdDev: 14.90 Min: 1 Median: 1.4315 Max: 4549 Percentiles: P50: 1.43 P75: 1.82 P99: 5.18 P99.9: 9.38 P99.99: 13.41 ------------------------------------------------------ [ 0, 1 ] 85437 21.950% 21.950% #### ( 1, 2 ] 253002 65.001% 86.952% ############# ( 2, 3 ] 32415 8.328% 95.280% ## ( 3, 4 ] 11146 2.864% 98.143% # ( 4, 6 ] 5666 1.456% 99.599% ( 6, 10 ] 1387 0.356% 99.956% ( 10, 15 ] 198 0.051% 100.006% ( 15, 22 ] 26 0.007% 100.013% ( 22, 34 ] 5 0.001% 100.014% ( 34, 51 ] 2 0.001% 100.015% ( 51, 76 ] 4 0.001% 100.016% ( 76, 110 ] 1 0.000% 100.016% ( 110, 170 ] 14 0.004% 100.020% ( 170, 250 ] 9 0.002% 100.022% ( 250, 380 ] 11 0.003% 100.025% ( 380, 580 ] 5 0.001% 100.026% ( 580, 870 ] 5 0.001% 100.027% ( 870, 1300 ] 3 0.001% 100.028% ( 1300, 1900 ] 2 0.001% 100.029% ( 1900, 2900 ] 5 0.001% 100.030% ( 2900, 4400 ] 1 0.000% 100.030% ( 4400, 6600 ] 1 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 68634 Average: 2.3070 StdDev: 20.58 Min: 0 Median: 1.4156 Max: 2774 Percentiles: P50: 1.42 P75: 1.80 P99: 5.37 P99.9: 47.24 P99.99: 889.58 ------------------------------------------------------ [ 0, 1 ] 15792 23.009% 23.009% ##### ( 1, 2 ] 44576 64.947% 87.956% ############# ( 2, 3 ] 5562 8.104% 96.060% ## ( 3, 4 ] 1451 2.114% 98.174% ( 4, 6 ] 827 1.205% 99.379% ( 6, 10 ] 290 0.423% 99.802% ( 10, 15 ] 38 0.055% 99.857% ( 15, 22 ] 5 0.007% 99.864% ( 22, 34 ] 2 0.003% 99.867% ( 34, 51 ] 30 0.044% 99.911% ( 51, 76 ] 21 0.031% 99.942% ( 76, 110 ] 4 0.006% 99.948% ( 110, 170 ] 2 0.003% 99.950% ( 170, 250 ] 15 0.022% 99.972% ( 250, 380 ] 8 0.012% 99.984% ( 380, 580 ] 3 0.004% 99.988% ( 580, 870 ] 2 0.003% 99.991% ( 870, 1300 ] 3 0.004% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 3 0.004% 100.001% ** Level 2 read latency histogram (micros): Count: 75879 Average: 2.0309 StdDev: 6.47 Min: 0 Median: 1.4000 Max: 1069 Percentiles: P50: 1.40 P75: 1.80 P99: 5.47 P99.9: 9.76 P99.99: 180.99 ------------------------------------------------------ [ 0, 1 ] 18914 24.927% 24.927% ##### ( 1, 2 ] 47560 62.679% 87.605% ############# ( 2, 3 ] 5440 7.169% 94.775% # ( 3, 4 ] 2205 2.906% 97.681% # ( 4, 6 ] 1362 1.795% 99.475% ( 6, 10 ] 343 0.452% 99.928% ( 10, 15 ] 35 0.046% 99.974% ( 15, 22 ] 5 0.007% 99.980% ( 22, 34 ] 3 0.004% 99.984% ( 34, 51 ] 1 0.001% 99.986% ( 76, 110 ] 1 0.001% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 3 0.004% 99.993% ( 250, 380 ] 2 0.003% 99.996% ( 580, 870 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 603.1778 StdDev: 865.63 Min: 1 Median: 130.0000 Max: 3660 Percentiles: P50: 130.00 P75: 977.50 P99: 3660.00 P99.9: 3660.00 P99.99: 3660.00 ------------------------------------------------------ [ 0, 1 ] 14 15.556% 15.556% ### ( 1, 2 ] 19 21.111% 36.667% #### ( 2, 3 ] 2 2.222% 38.889% ( 3, 4 ] 2 2.222% 41.111% ( 4, 6 ] 4 4.444% 45.556% # ( 15, 22 ] 1 1.111% 46.667% ( 51, 76 ] 2 2.222% 48.889% ( 110, 170 ] 3 3.333% 52.222% # ( 170, 250 ] 4 4.444% 56.667% # ( 250, 380 ] 1 1.111% 57.778% ( 380, 580 ] 3 3.333% 61.111% # ( 580, 870 ] 10 11.111% 72.222% ## ( 870, 1300 ] 10 11.111% 83.333% ## ( 1300, 1900 ] 6 6.667% 90.000% # ( 1900, 2900 ] 6 6.667% 96.667% # ( 2900, 4400 ] 3 3.333% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1565.2000 StdDev: 975.80 Min: 201 Median: 1420.0000 Max: 4387 Percentiles: P50: 1420.00 P75: 1870.00 P99: 4287.50 P99.9: 4387.00 P99.99: 4387.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 3 10.000% 13.333% ## ( 580, 870 ] 6 20.000% 33.333% #### ( 870, 1300 ] 3 10.000% 43.333% ## ( 1300, 1900 ] 10 33.333% 76.667% ####### ( 1900, 2900 ] 3 10.000% 86.667% ## ( 2900, 4400 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 6.0 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 325.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.641 H:M:S, 10.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.409 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/16-22:37:42 ... thread 0: (1000000,3000000) ops and (336612.5,341121.7) ops/second in (2.970775,8.794514) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/8 1.72 GB 119.6 1.3 0.0 1.3 4.1 2.8 0.0 1.5 101.9 320.2 12.98 12.08 45 0.288 1343K 1359 0.0 0.0 L1 8/0 878.16 MB 87.8 1.2 0.9 0.4 1.2 0.9 0.2 1.4 236.6 235.9 5.32 5.18 2 2.661 1278K 3399 0.0 0.0 L2 1/0 49.90 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 238.2 238.1 1.46 1.40 2 0.732 354K 175 0.0 0.0 L3 18/0 943.26 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.0 1.0 220.8 220.8 0.85 0.78 1 0.848 190K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1200/8 98.90 GB 0.0 3.0 1.2 1.8 5.8 4.0 0.2 2.1 151.3 288.5 20.62 19.45 50 0.412 3166K 4933 0.0 0.0 Int 0/0 0.00 KB 0.0 3.0 1.2 1.8 5.8 4.0 0.2 2.1 151.3 288.5 20.62 19.45 50 0.412 3166K 4933 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.0 1.2 1.8 3.0 1.2 0.0 0.0 245.6 245.2 12.69 12.33 10 1.269 3166K 4933 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 357.9 7.92 7.11 40 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.81 GB write, 659.60 MB/s write, 3.05 GB read, 345.80 MB/s read, 20.6 seconds Interval compaction: 5.81 GB write, 676.22 MB/s write, 3.05 GB read, 354.52 MB/s read, 20.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 660026 Average: 2.0783 StdDev: 12.26 Min: 0 Median: 1.4254 Max: 4549 Percentiles: P50: 1.43 P75: 1.81 P99: 5.27 P99.9: 9.51 P99.99: 13.42 ------------------------------------------------------ [ 0, 1 ] 149519 22.654% 22.654% ##### ( 1, 2 ] 424290 64.284% 86.937% ############# ( 2, 3 ] 54144 8.203% 95.141% ## ( 3, 4 ] 19033 2.884% 98.024% # ( 4, 6 ] 10146 1.537% 99.562% ( 6, 10 ] 2549 0.386% 99.948% ( 10, 15 ] 409 0.062% 100.010% ( 15, 22 ] 43 0.007% 100.016% ( 22, 34 ] 6 0.001% 100.017% ( 34, 51 ] 2 0.000% 100.017% ( 51, 76 ] 10 0.002% 100.019% ( 76, 110 ] 1 0.000% 100.019% ( 110, 170 ] 20 0.003% 100.022% ( 170, 250 ] 16 0.002% 100.025% ( 250, 380 ] 19 0.003% 100.027% ( 380, 580 ] 8 0.001% 100.029% ( 580, 870 ] 12 0.002% 100.030% ( 870, 1300 ] 5 0.001% 100.031% ( 1300, 1900 ] 2 0.000% 100.032% ( 1900, 2900 ] 6 0.001% 100.032% ( 2900, 4400 ] 1 0.000% 100.033% ( 4400, 6600 ] 1 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 108170 Average: 2.3381 StdDev: 19.82 Min: 0 Median: 1.4546 Max: 2774 Percentiles: P50: 1.45 P75: 1.83 P99: 5.38 P99.9: 21.80 P99.99: 822.61 ------------------------------------------------------ [ 0, 1 ] 21543 19.916% 19.916% #### ( 1, 2 ] 71581 66.175% 86.090% ############# ( 2, 3 ] 10073 9.312% 95.403% ## ( 3, 4 ] 2793 2.582% 97.985% # ( 4, 6 ] 1597 1.476% 99.461% ( 6, 10 ] 397 0.367% 99.828% ( 10, 15 ] 72 0.067% 99.895% ( 15, 22 ] 6 0.006% 99.900% ( 22, 34 ] 2 0.002% 99.902% ( 34, 51 ] 30 0.028% 99.930% ( 51, 76 ] 21 0.019% 99.949% ( 76, 110 ] 4 0.004% 99.953% ( 110, 170 ] 2 0.002% 99.955% ( 170, 250 ] 16 0.015% 99.969% ( 250, 380 ] 13 0.012% 99.982% ( 380, 580 ] 5 0.005% 99.986% ( 580, 870 ] 5 0.005% 99.991% ( 870, 1300 ] 3 0.003% 99.994% ( 1300, 1900 ] 3 0.003% 99.996% ( 1900, 2900 ] 4 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 75879 Average: 2.0309 StdDev: 6.47 Min: 0 Median: 1.4000 Max: 1069 Percentiles: P50: 1.40 P75: 1.80 P99: 5.47 P99.9: 9.76 P99.99: 180.99 ------------------------------------------------------ [ 0, 1 ] 18914 24.927% 24.927% ##### ( 1, 2 ] 47560 62.679% 87.605% ############# ( 2, 3 ] 5440 7.169% 94.775% # ( 3, 4 ] 2205 2.906% 97.681% # ( 4, 6 ] 1362 1.795% 99.475% ( 6, 10 ] 343 0.452% 99.928% ( 10, 15 ] 35 0.046% 99.974% ( 15, 22 ] 5 0.007% 99.980% ( 22, 34 ] 3 0.004% 99.984% ( 34, 51 ] 1 0.001% 99.986% ( 76, 110 ] 1 0.001% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 3 0.004% 99.993% ( 250, 380 ] 2 0.003% 99.996% ( 580, 870 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 603.1778 StdDev: 865.63 Min: 1 Median: 130.0000 Max: 3660 Percentiles: P50: 130.00 P75: 977.50 P99: 3660.00 P99.9: 3660.00 P99.99: 3660.00 ------------------------------------------------------ [ 0, 1 ] 14 15.556% 15.556% ### ( 1, 2 ] 19 21.111% 36.667% #### ( 2, 3 ] 2 2.222% 38.889% ( 3, 4 ] 2 2.222% 41.111% ( 4, 6 ] 4 4.444% 45.556% # ( 15, 22 ] 1 1.111% 46.667% ( 51, 76 ] 2 2.222% 48.889% ( 110, 170 ] 3 3.333% 52.222% # ( 170, 250 ] 4 4.444% 56.667% # ( 250, 380 ] 1 1.111% 57.778% ( 380, 580 ] 3 3.333% 61.111% # ( 580, 870 ] 10 11.111% 72.222% ## ( 870, 1300 ] 10 11.111% 83.333% ## ( 1300, 1900 ] 6 6.667% 90.000% # ( 1900, 2900 ] 6 6.667% 96.667% # ( 2900, 4400 ] 3 3.333% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1565.2000 StdDev: 975.80 Min: 201 Median: 1420.0000 Max: 4387 Percentiles: P50: 1420.00 P75: 1870.00 P99: 4287.50 P99.9: 4387.00 P99.99: 4387.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 3 10.000% 13.333% ## ( 580, 870 ] 6 20.000% 33.333% #### ( 870, 1300 ] 3 10.000% 43.333% ## ( 1300, 1900 ] 10 33.333% 76.667% ####### ( 1900, 2900 ] 3 10.000% 86.667% ## ( 2900, 4400 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 9.0 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 327.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.004 H:M:S, 11.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.29 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.363 H:M:S, 12.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/16-22:37:45 ... thread 0: (1000000,4000000) ops and (332526.1,338931.4) ops/second in (3.007283,11.801797) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/4 2.64 GB 239.1 2.4 0.0 2.4 6.1 3.7 0.0 1.6 123.0 312.0 19.98 18.69 62 0.322 2494K 2576 0.0 0.0 L1 8/0 878.16 MB 87.8 1.2 0.9 0.4 1.2 0.9 0.2 1.4 236.6 235.9 5.32 5.18 2 2.661 1278K 3399 0.0 0.0 L2 1/0 49.90 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 238.2 238.1 1.46 1.40 2 0.732 354K 175 0.0 0.0 L3 18/0 943.26 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.0 1.0 220.8 220.8 0.85 0.78 1 0.848 190K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1201/4 99.82 GB 0.0 4.2 1.2 2.9 7.8 4.9 0.2 2.1 154.0 290.6 27.62 26.05 67 0.412 4317K 6150 0.0 0.0 Int 0/0 0.00 KB 0.0 4.2 1.2 2.9 7.8 4.9 0.2 2.1 154.0 290.6 27.62 26.05 67 0.412 4317K 6150 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.2 1.2 2.9 4.1 1.2 0.0 0.0 249.1 248.8 17.07 16.58 14 1.219 4317K 6150 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 358.4 10.55 9.47 53 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.8 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.84 GB write, 667.42 MB/s write, 4.15 GB read, 353.62 MB/s read, 27.6 seconds Interval compaction: 7.84 GB write, 679.95 MB/s write, 4.15 GB read, 360.26 MB/s read, 27.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 918688 Average: 2.0378 StdDev: 11.28 Min: 0 Median: 1.4007 Max: 4549 Percentiles: P50: 1.40 P75: 1.79 P99: 5.15 P99.9: 9.47 P99.99: 13.70 ------------------------------------------------------ [ 0, 1 ] 225766 24.575% 24.575% ##### ( 1, 2 ] 582985 63.458% 88.033% ############# ( 2, 3 ] 68913 7.501% 95.535% ## ( 3, 4 ] 24582 2.676% 98.210% # ( 4, 6 ] 12610 1.373% 99.583% ( 6, 10 ] 3356 0.365% 99.948% ( 10, 15 ] 519 0.056% 100.005% ( 15, 22 ] 58 0.006% 100.011% ( 22, 34 ] 10 0.001% 100.012% ( 34, 51 ] 5 0.001% 100.013% ( 51, 76 ] 14 0.002% 100.014% ( 76, 110 ] 1 0.000% 100.014% ( 110, 170 ] 24 0.003% 100.017% ( 170, 250 ] 24 0.003% 100.019% ( 250, 380 ] 24 0.003% 100.022% ( 380, 580 ] 13 0.001% 100.024% ( 580, 870 ] 15 0.002% 100.025% ( 870, 1300 ] 10 0.001% 100.026% ( 1300, 1900 ] 6 0.001% 100.027% ( 1900, 2900 ] 6 0.001% 100.028% ( 2900, 4400 ] 1 0.000% 100.028% ( 4400, 6600 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 108170 Average: 2.3381 StdDev: 19.82 Min: 0 Median: 1.4546 Max: 2774 Percentiles: P50: 1.45 P75: 1.83 P99: 5.38 P99.9: 21.80 P99.99: 822.61 ------------------------------------------------------ [ 0, 1 ] 21543 19.916% 19.916% #### ( 1, 2 ] 71581 66.175% 86.090% ############# ( 2, 3 ] 10073 9.312% 95.403% ## ( 3, 4 ] 2793 2.582% 97.985% # ( 4, 6 ] 1597 1.476% 99.461% ( 6, 10 ] 397 0.367% 99.828% ( 10, 15 ] 72 0.067% 99.895% ( 15, 22 ] 6 0.006% 99.900% ( 22, 34 ] 2 0.002% 99.902% ( 34, 51 ] 30 0.028% 99.930% ( 51, 76 ] 21 0.019% 99.949% ( 76, 110 ] 4 0.004% 99.953% ( 110, 170 ] 2 0.002% 99.955% ( 170, 250 ] 16 0.015% 99.969% ( 250, 380 ] 13 0.012% 99.982% ( 380, 580 ] 5 0.005% 99.986% ( 580, 870 ] 5 0.005% 99.991% ( 870, 1300 ] 3 0.003% 99.994% ( 1300, 1900 ] 3 0.003% 99.996% ( 1900, 2900 ] 4 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 75879 Average: 2.0309 StdDev: 6.47 Min: 0 Median: 1.4000 Max: 1069 Percentiles: P50: 1.40 P75: 1.80 P99: 5.47 P99.9: 9.76 P99.99: 180.99 ------------------------------------------------------ [ 0, 1 ] 18914 24.927% 24.927% ##### ( 1, 2 ] 47560 62.679% 87.605% ############# ( 2, 3 ] 5440 7.169% 94.775% # ( 3, 4 ] 2205 2.906% 97.681% # ( 4, 6 ] 1362 1.795% 99.475% ( 6, 10 ] 343 0.452% 99.928% ( 10, 15 ] 35 0.046% 99.974% ( 15, 22 ] 5 0.007% 99.980% ( 22, 34 ] 3 0.004% 99.984% ( 34, 51 ] 1 0.001% 99.986% ( 76, 110 ] 1 0.001% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 3 0.004% 99.993% ( 250, 380 ] 2 0.003% 99.996% ( 580, 870 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 603.1778 StdDev: 865.63 Min: 1 Median: 130.0000 Max: 3660 Percentiles: P50: 130.00 P75: 977.50 P99: 3660.00 P99.9: 3660.00 P99.99: 3660.00 ------------------------------------------------------ [ 0, 1 ] 14 15.556% 15.556% ### ( 1, 2 ] 19 21.111% 36.667% #### ( 2, 3 ] 2 2.222% 38.889% ( 3, 4 ] 2 2.222% 41.111% ( 4, 6 ] 4 4.444% 45.556% # ( 15, 22 ] 1 1.111% 46.667% ( 51, 76 ] 2 2.222% 48.889% ( 110, 170 ] 3 3.333% 52.222% # ( 170, 250 ] 4 4.444% 56.667% # ( 250, 380 ] 1 1.111% 57.778% ( 380, 580 ] 3 3.333% 61.111% # ( 580, 870 ] 10 11.111% 72.222% ## ( 870, 1300 ] 10 11.111% 83.333% ## ( 1300, 1900 ] 6 6.667% 90.000% # ( 1900, 2900 ] 6 6.667% 96.667% # ( 2900, 4400 ] 3 3.333% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1565.2000 StdDev: 975.80 Min: 201 Median: 1420.0000 Max: 4387 Percentiles: P50: 1420.00 P75: 1870.00 P99: 4287.50 P99.9: 4387.00 P99.99: 4387.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 3 10.000% 13.333% ## ( 580, 870 ] 6 20.000% 33.333% #### ( 870, 1300 ] 3 10.000% 43.333% ## ( 1300, 1900 ] 10 33.333% 76.667% ####### ( 1900, 2900 ] 3 10.000% 86.667% ## ( 2900, 4400 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 327.38 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.393 H:M:S, 11.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.27 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.389 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/16-22:37:48 ... thread 0: (1000000,5000000) ops and (331459.2,337410.1) ops/second in (3.016963,14.818760) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/4 3.63 GB 346.1 3.3 0.0 3.3 7.9 4.7 0.0 1.7 128.1 311.6 26.07 24.44 79 0.330 3390K 3552 0.0 0.0 L1 8/0 878.16 MB 87.8 1.2 0.9 0.4 1.2 0.9 0.2 1.4 236.6 235.9 5.32 5.18 2 2.661 1278K 3399 0.0 0.0 L2 1/0 49.90 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 238.2 238.1 1.46 1.40 2 0.732 354K 175 0.0 0.0 L3 18/0 943.26 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.0 1.0 220.8 220.8 0.85 0.78 1 0.848 190K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1206/4 100.80 GB 0.0 5.0 1.2 3.8 9.7 5.9 0.2 2.1 152.3 294.2 33.70 31.81 84 0.401 5213K 7126 0.0 0.0 Int 0/0 0.00 KB 0.0 5.0 1.2 3.8 9.7 5.9 0.2 2.1 152.3 294.2 33.70 31.81 84 0.401 5213K 7126 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.0 1.2 3.8 5.0 1.2 0.0 0.0 251.5 251.1 20.41 19.87 17 1.201 5213K 7126 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 360.3 13.29 11.94 67 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.0 total, 14.8 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.68 GB write, 659.13 MB/s write, 5.01 GB read, 341.33 MB/s read, 33.7 seconds Interval compaction: 9.68 GB write, 668.98 MB/s write, 5.01 GB read, 346.43 MB/s read, 33.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 17, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1182456 Average: 2.0173 StdDev: 11.50 Min: 0 Median: 1.3859 Max: 4549 Percentiles: P50: 1.39 P75: 1.78 P99: 5.06 P99.9: 9.58 P99.99: 14.21 ------------------------------------------------------ [ 0, 1 ] 303157 25.638% 25.638% ##### ( 1, 2 ] 746509 63.132% 88.770% ############# ( 2, 3 ] 83614 7.071% 95.841% # ( 3, 4 ] 29539 2.498% 98.339% ( 4, 6 ] 14789 1.251% 99.590% ( 6, 10 ] 4098 0.347% 99.937% ( 10, 15 ] 751 0.064% 100.000% ( 15, 22 ] 81 0.007% 100.007% ( 22, 34 ] 13 0.001% 100.008% ( 34, 51 ] 7 0.001% 100.009% ( 51, 76 ] 18 0.002% 100.010% ( 76, 110 ] 1 0.000% 100.010% ( 110, 170 ] 30 0.003% 100.013% ( 170, 250 ] 31 0.003% 100.015% ( 250, 380 ] 30 0.003% 100.018% ( 380, 580 ] 15 0.001% 100.019% ( 580, 870 ] 20 0.002% 100.021% ( 870, 1300 ] 13 0.001% 100.022% ( 1300, 1900 ] 7 0.001% 100.023% ( 1900, 2900 ] 8 0.001% 100.023% ( 2900, 4400 ] 3 0.000% 100.024% ( 4400, 6600 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 108170 Average: 2.3381 StdDev: 19.82 Min: 0 Median: 1.4546 Max: 2774 Percentiles: P50: 1.45 P75: 1.83 P99: 5.38 P99.9: 21.80 P99.99: 822.61 ------------------------------------------------------ [ 0, 1 ] 21543 19.916% 19.916% #### ( 1, 2 ] 71581 66.175% 86.090% ############# ( 2, 3 ] 10073 9.312% 95.403% ## ( 3, 4 ] 2793 2.582% 97.985% # ( 4, 6 ] 1597 1.476% 99.461% ( 6, 10 ] 397 0.367% 99.828% ( 10, 15 ] 72 0.067% 99.895% ( 15, 22 ] 6 0.006% 99.900% ( 22, 34 ] 2 0.002% 99.902% ( 34, 51 ] 30 0.028% 99.930% ( 51, 76 ] 21 0.019% 99.949% ( 76, 110 ] 4 0.004% 99.953% ( 110, 170 ] 2 0.002% 99.955% ( 170, 250 ] 16 0.015% 99.969% ( 250, 380 ] 13 0.012% 99.982% ( 380, 580 ] 5 0.005% 99.986% ( 580, 870 ] 5 0.005% 99.991% ( 870, 1300 ] 3 0.003% 99.994% ( 1300, 1900 ] 3 0.003% 99.996% ( 1900, 2900 ] 4 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 75879 Average: 2.0309 StdDev: 6.47 Min: 0 Median: 1.4000 Max: 1069 Percentiles: P50: 1.40 P75: 1.80 P99: 5.47 P99.9: 9.76 P99.99: 180.99 ------------------------------------------------------ [ 0, 1 ] 18914 24.927% 24.927% ##### ( 1, 2 ] 47560 62.679% 87.605% ############# ( 2, 3 ] 5440 7.169% 94.775% # ( 3, 4 ] 2205 2.906% 97.681% # ( 4, 6 ] 1362 1.795% 99.475% ( 6, 10 ] 343 0.452% 99.928% ( 10, 15 ] 35 0.046% 99.974% ( 15, 22 ] 5 0.007% 99.980% ( 22, 34 ] 3 0.004% 99.984% ( 34, 51 ] 1 0.001% 99.986% ( 76, 110 ] 1 0.001% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 3 0.004% 99.993% ( 250, 380 ] 2 0.003% 99.996% ( 580, 870 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 603.1778 StdDev: 865.63 Min: 1 Median: 130.0000 Max: 3660 Percentiles: P50: 130.00 P75: 977.50 P99: 3660.00 P99.9: 3660.00 P99.99: 3660.00 ------------------------------------------------------ [ 0, 1 ] 14 15.556% 15.556% ### ( 1, 2 ] 19 21.111% 36.667% #### ( 2, 3 ] 2 2.222% 38.889% ( 3, 4 ] 2 2.222% 41.111% ( 4, 6 ] 4 4.444% 45.556% # ( 15, 22 ] 1 1.111% 46.667% ( 51, 76 ] 2 2.222% 48.889% ( 110, 170 ] 3 3.333% 52.222% # ( 170, 250 ] 4 4.444% 56.667% # ( 250, 380 ] 1 1.111% 57.778% ( 380, 580 ] 3 3.333% 61.111% # ( 580, 870 ] 10 11.111% 72.222% ## ( 870, 1300 ] 10 11.111% 83.333% ## ( 1300, 1900 ] 6 6.667% 90.000% # ( 1900, 2900 ] 6 6.667% 96.667% # ( 2900, 4400 ] 3 3.333% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1565.2000 StdDev: 975.80 Min: 201 Median: 1420.0000 Max: 4387 Percentiles: P50: 1420.00 P75: 1870.00 P99: 4287.50 P99.9: 4387.00 P99.99: 4387.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 3 10.000% 13.333% ## ( 580, 870 ] 6 20.000% 33.333% #### ( 870, 1300 ] 3 10.000% 43.333% ## ( 1300, 1900 ] 10 33.333% 76.667% ####### ( 1900, 2900 ] 3 10.000% 86.667% ## ( 2900, 4400 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 15.0 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 327.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.826 H:M:S, 12.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.22 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.433 H:M:S, 14.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/16-22:38:12 ... thread 0: (1000000,6000000) ops and (42603.4,156694.4) ops/second in (23.472327,38.291087) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/8 881.46 MB 0.0 4.0 0.0 4.0 9.6 5.6 0.0 1.7 128.9 309.1 31.78 29.72 97 0.328 4157K 4293 0.0 0.0 L1 4/4 432.77 MB 0.0 5.8 4.5 1.2 5.7 4.4 0.2 1.2 214.2 210.4 27.61 24.98 3 9.202 6004K 103K 0.0 0.0 L2 33/11 4.07 GB 28.3 0.3 0.2 0.2 0.3 0.2 4.1 1.8 238.2 238.1 1.46 1.40 2 0.732 354K 175 0.0 0.0 L3 18/11 943.26 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 220.8 220.8 0.85 0.78 1 0.848 190K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1223/34 101.63 GB 0.0 10.3 4.9 5.4 15.8 10.4 4.3 2.8 170.9 262.1 61.69 56.89 103 0.599 10M 108K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.3 4.9 5.4 15.8 10.4 4.3 2.8 170.9 262.1 61.69 56.89 103 0.599 10M 108K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.3 4.9 5.4 10.2 4.8 0.0 0.0 231.4 229.0 45.57 42.46 21 2.170 10M 108K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 355.5 16.13 14.43 82 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.5 total, 38.3 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.79 GB write, 419.81 MB/s write, 10.30 GB read, 273.78 MB/s read, 61.7 seconds Interval compaction: 15.79 GB write, 422.24 MB/s write, 10.30 GB read, 275.36 MB/s read, 61.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 17, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2328739 Average: 2.8985 StdDev: 18.74 Min: 0 Median: 1.3529 Max: 4549 Percentiles: P50: 1.35 P75: 1.76 P99: 7.36 P99.9: 164.42 P99.99: 461.90 ------------------------------------------------------ [ 0, 1 ] 660178 28.349% 28.349% ###### ( 1, 2 ] 1428809 61.355% 89.705% ############ ( 2, 3 ] 127552 5.477% 95.182% # ( 3, 4 ] 52885 2.271% 97.453% ( 4, 6 ] 32960 1.415% 98.868% ( 6, 10 ] 8999 0.386% 99.255% ( 10, 15 ] 1891 0.081% 99.336% ( 15, 22 ] 265 0.011% 99.347% ( 22, 34 ] 21 0.001% 99.348% ( 34, 51 ] 10 0.000% 99.349% ( 51, 76 ] 153 0.007% 99.355% ( 76, 110 ] 8011 0.344% 99.699% ( 110, 170 ] 5156 0.221% 99.921% ( 170, 250 ] 823 0.035% 99.956% ( 250, 380 ] 572 0.025% 99.981% ( 380, 580 ] 540 0.023% 100.004% ( 580, 870 ] 206 0.009% 100.013% ( 870, 1300 ] 37 0.002% 100.014% ( 1300, 1900 ] 13 0.001% 100.015% ( 1900, 2900 ] 17 0.001% 100.015% ( 2900, 4400 ] 14 0.001% 100.016% ( 4400, 6600 ] 1 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 427838 Average: 3.0245 StdDev: 22.51 Min: 0 Median: 1.4313 Max: 3591 Percentiles: P50: 1.43 P75: 1.85 P99: 7.96 P99.9: 160.30 P99.99: 545.77 ------------------------------------------------------ [ 0, 1 ] 104503 24.426% 24.426% ##### ( 1, 2 ] 253672 59.292% 83.717% ############ ( 2, 3 ] 37341 8.728% 92.445% ## ( 3, 4 ] 14885 3.479% 95.924% # ( 4, 6 ] 11863 2.773% 98.697% # ( 6, 10 ] 2645 0.618% 99.315% ( 10, 15 ] 536 0.125% 99.441% ( 15, 22 ] 72 0.017% 99.458% ( 22, 34 ] 6 0.001% 99.459% ( 34, 51 ] 30 0.007% 99.466% ( 51, 76 ] 100 0.023% 99.489% ( 76, 110 ] 1107 0.259% 99.748% ( 110, 170 ] 778 0.182% 99.930% ( 170, 250 ] 128 0.030% 99.960% ( 250, 380 ] 79 0.018% 99.978% ( 380, 580 ] 63 0.015% 99.993% ( 580, 870 ] 41 0.010% 100.003% ( 870, 1300 ] 50 0.012% 100.014% ( 1300, 1900 ] 14 0.003% 100.018% ( 1900, 2900 ] 5 0.001% 100.019% ( 2900, 4400 ] 3 0.001% 100.019% ** Level 2 read latency histogram (micros): Count: 75990 Average: 2.3389 StdDev: 14.31 Min: 0 Median: 1.4011 Max: 1338 Percentiles: P50: 1.40 P75: 1.80 P99: 5.57 P99.9: 34.17 P99.99: 777.26 ------------------------------------------------------ [ 0, 1 ] 18914 24.890% 24.890% ##### ( 1, 2 ] 47566 62.595% 87.485% ############# ( 2, 3 ] 5472 7.201% 94.686% # ( 3, 4 ] 2209 2.907% 97.593% # ( 4, 6 ] 1364 1.795% 99.388% ( 6, 10 ] 344 0.453% 99.841% ( 10, 15 ] 37 0.049% 99.889% ( 15, 22 ] 5 0.007% 99.896% ( 22, 34 ] 3 0.004% 99.900% ( 34, 51 ] 1 0.001% 99.901% ( 76, 110 ] 7 0.009% 99.911% ( 110, 170 ] 9 0.012% 99.922% ( 170, 250 ] 14 0.018% 99.941% ( 250, 380 ] 19 0.025% 99.966% ( 380, 580 ] 15 0.020% 99.986% ( 580, 870 ] 5 0.007% 99.992% ( 870, 1300 ] 5 0.007% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 61188 Average: 5.4493 StdDev: 52.19 Min: 1 Median: 1.7824 Max: 3660 Percentiles: P50: 1.78 P75: 2.63 P99: 9.99 P99.9: 692.66 P99.99: 1558.75 ------------------------------------------------------ [ 0, 1 ] 2457 4.015% 4.015% # ( 1, 2 ] 35962 58.773% 62.788% ############ ( 2, 3 ] 11952 19.533% 82.322% #### ( 3, 4 ] 4742 7.750% 90.072% ## ( 4, 6 ] 4109 6.715% 96.787% # ( 6, 10 ] 1359 2.221% 99.008% ( 10, 15 ] 197 0.322% 99.330% ( 15, 22 ] 27 0.044% 99.374% ( 22, 34 ] 2 0.003% 99.377% ( 34, 51 ] 1 0.002% 99.379% ( 51, 76 ] 4 0.007% 99.386% ( 76, 110 ] 43 0.070% 99.456% ( 110, 170 ] 87 0.142% 99.598% ( 170, 250 ] 57 0.093% 99.691% ( 250, 380 ] 58 0.095% 99.786% ( 380, 580 ] 50 0.082% 99.868% ( 580, 870 ] 51 0.083% 99.951% ( 870, 1300 ] 20 0.033% 99.984% ( 1300, 1900 ] 9 0.015% 99.998% ( 1900, 2900 ] 8 0.013% 100.011% ( 2900, 4400 ] 3 0.005% 100.016% ** Level 4 read latency histogram (micros): Count: 30 Average: 1565.2000 StdDev: 975.80 Min: 201 Median: 1420.0000 Max: 4387 Percentiles: P50: 1420.00 P75: 1870.00 P99: 4287.50 P99.9: 4387.00 P99.99: 4387.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 3 10.000% 13.333% ## ( 580, 870 ] 6 20.000% 33.333% #### ( 870, 1300 ] 3 10.000% 43.333% ## ( 1300, 1900 ] 10 33.333% 76.667% ####### ( 1900, 2900 ] 3 10.000% 86.667% ## ( 2900, 4400 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 38.5 total, 23.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 153.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.044 H:M:S, 57.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 41.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:20.219 H:M:S, 86.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/11/16-22:38:19 ... thread 0: (1000000,7000000) ops and (146930.2,155220.8) ops/second in (6.805954,45.097041) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/5 1.23 GB 18.9 4.9 0.0 4.9 11.4 6.6 0.0 1.7 121.8 286.7 40.85 36.01 112 0.365 5053K 5268 0.0 0.0 L1 10/10 640.80 MB 0.0 6.8 5.2 1.6 6.7 5.1 0.2 1.3 206.1 202.9 33.85 29.82 4 8.463 6643K 103K 0.0 0.0 L2 9/8 932.42 MB 0.5 0.3 0.2 0.2 0.3 0.2 4.5 1.8 238.2 238.1 1.46 1.40 2 0.732 354K 175 0.0 0.0 L3 58/39 2.53 GB 0.9 5.2 3.8 1.4 5.2 3.7 0.0 1.4 139.7 139.5 38.01 24.32 22 1.728 4282K 3694 0.0 0.0 L4 135/4 10.14 GB 1.0 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1279/66 102.60 GB 0.0 17.2 9.1 8.1 23.7 15.6 8.0 3.6 154.2 212.2 114.18 91.54 140 0.816 16M 113K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.2 9.1 8.1 23.7 15.6 8.0 3.6 154.2 212.2 114.18 91.54 140 0.816 16M 113K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.2 9.1 8.1 17.1 9.0 0.0 0.0 189.4 188.1 92.99 74.40 46 2.022 16M 113K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 318.1 21.19 17.14 94 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 45.3 total, 45.1 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.66 GB write, 534.66 MB/s write, 17.20 GB read, 388.63 MB/s read, 114.2 seconds Interval compaction: 23.66 GB write, 537.29 MB/s write, 17.20 GB read, 390.54 MB/s read, 114.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 44, interval: 61 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2684177 Average: 3.1144 StdDev: 31.94 Min: 0 Median: 1.4129 Max: 24622 Percentiles: P50: 1.41 P75: 1.83 P99: 7.95 P99.9: 164.75 P99.99: 521.06 ------------------------------------------------------ [ 0, 1 ] 671664 25.023% 25.023% ##### ( 1, 2 ] 1623584 60.487% 85.510% ############ ( 2, 3 ] 203833 7.594% 93.104% ## ( 3, 4 ] 86191 3.211% 96.315% # ( 4, 6 ] 64627 2.408% 98.723% ( 6, 10 ] 15284 0.569% 99.292% ( 10, 15 ] 2954 0.110% 99.402% ( 15, 22 ] 390 0.015% 99.417% ( 22, 34 ] 24 0.001% 99.418% ( 34, 51 ] 14 0.001% 99.418% ( 51, 76 ] 155 0.006% 99.424% ( 76, 110 ] 8026 0.299% 99.723% ( 110, 170 ] 5202 0.194% 99.917% ( 170, 250 ] 883 0.033% 99.950% ( 250, 380 ] 641 0.024% 99.974% ( 380, 580 ] 619 0.023% 99.997% ( 580, 870 ] 308 0.011% 100.008% ( 870, 1300 ] 121 0.005% 100.013% ( 1300, 1900 ] 59 0.002% 100.015% ( 1900, 2900 ] 45 0.002% 100.017% ( 2900, 4400 ] 57 0.002% 100.019% ( 4400, 6600 ] 12 0.000% 100.019% ( 6600, 9900 ] 1 0.000% 100.019% ( 22000, 33000 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 1490410 Average: 7.7602 StdDev: 115.75 Min: 0 Median: 1.8185 Max: 9001 Percentiles: P50: 1.82 P75: 2.75 P99: 9.38 P99.9: 140.75 P99.99: 350.89 ------------------------------------------------------ [ 0, 1 ] 114694 7.695% 7.695% ## ( 1, 2 ] 770320 51.685% 59.381% ########## ( 2, 3 ] 308490 20.698% 80.079% #### ( 3, 4 ] 131604 8.830% 88.909% ## ( 4, 6 ] 124377 8.345% 97.254% ## ( 6, 10 ] 30761 2.064% 99.318% ( 10, 15 ] 6035 0.405% 99.723% ( 15, 22 ] 714 0.048% 99.771% ( 22, 34 ] 56 0.004% 99.775% ( 34, 51 ] 58 0.004% 99.779% ( 51, 76 ] 108 0.007% 99.786% ( 76, 110 ] 1186 0.080% 99.865% ( 110, 170 ] 1010 0.068% 99.933% ( 170, 250 ] 426 0.029% 99.962% ( 250, 380 ] 545 0.037% 99.998% ( 380, 580 ] 663 0.044% 100.043% ( 580, 870 ] 716 0.048% 100.091% ( 870, 1300 ] 647 0.043% 100.134% ( 1300, 1900 ] 470 0.032% 100.166% ( 1900, 2900 ] 597 0.040% 100.206% ( 2900, 4400 ] 639 0.043% 100.249% ( 4400, 6600 ] 185 0.012% 100.261% ( 6600, 9900 ] 26 0.002% 100.263% ** Level 2 read latency histogram (micros): Count: 88552 Average: 2.5627 StdDev: 15.75 Min: 0 Median: 1.4426 Max: 1338 Percentiles: P50: 1.44 P75: 1.84 P99: 5.91 P99.9: 187.79 P99.99: 802.75 ------------------------------------------------------ [ 0, 1 ] 19714 22.263% 22.263% #### ( 1, 2 ] 55499 62.674% 84.937% ############# ( 2, 3 ] 7587 8.568% 93.504% ## ( 3, 4 ] 2964 3.347% 96.852% # ( 4, 6 ] 1991 2.248% 99.100% ( 6, 10 ] 586 0.662% 99.762% ( 10, 15 ] 52 0.059% 99.820% ( 15, 22 ] 6 0.007% 99.827% ( 22, 34 ] 3 0.003% 99.831% ( 34, 51 ] 1 0.001% 99.832% ( 76, 110 ] 23 0.026% 99.858% ( 110, 170 ] 31 0.035% 99.893% ( 170, 250 ] 29 0.033% 99.925% ( 250, 380 ] 24 0.027% 99.953% ( 380, 580 ] 27 0.030% 99.983% ( 580, 870 ] 8 0.009% 99.992% ( 870, 1300 ] 6 0.007% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 489321 Average: 9.7736 StdDev: 125.78 Min: 1 Median: 1.9400 Max: 7869 Percentiles: P50: 1.94 P75: 2.91 P99: 9.91 P99.9: 1046.10 P99.99: 1747.91 ------------------------------------------------------ [ 0, 1 ] 10032 2.050% 2.050% ( 1, 2 ] 249600 51.009% 53.060% ########## ( 2, 3 ] 117970 24.109% 77.169% ##### ( 3, 4 ] 50109 10.241% 87.409% ## ( 4, 6 ] 46378 9.478% 96.887% ## ( 6, 10 ] 10568 2.160% 99.047% ( 10, 15 ] 1958 0.400% 99.447% ( 15, 22 ] 216 0.044% 99.491% ( 22, 34 ] 23 0.005% 99.496% ( 34, 51 ] 5 0.001% 99.497% ( 51, 76 ] 8 0.002% 99.498% ( 76, 110 ] 122 0.025% 99.523% ( 110, 170 ] 222 0.045% 99.569% ( 170, 250 ] 245 0.050% 99.619% ( 250, 380 ] 311 0.064% 99.682% ( 380, 580 ] 410 0.084% 99.766% ( 580, 870 ] 489 0.100% 99.866% ( 870, 1300 ] 407 0.083% 99.949% ( 1300, 1900 ] 268 0.055% 100.004% ( 1900, 2900 ] 254 0.052% 100.056% ( 2900, 4400 ] 236 0.048% 100.104% ( 4400, 6600 ] 59 0.012% 100.116% ( 6600, 9900 ] 7 0.001% 100.118% ** Level 4 read latency histogram (micros): Count: 30 Average: 1565.2000 StdDev: 975.80 Min: 201 Median: 1420.0000 Max: 4387 Percentiles: P50: 1420.00 P75: 1870.00 P99: 4287.50 P99.9: 4387.00 P99.99: 4387.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 380, 580 ] 3 10.000% 13.333% ## ( 580, 870 ] 6 20.000% 33.333% #### ( 870, 1300 ] 3 10.000% 43.333% ## ( 1300, 1900 ] 10 33.333% 76.667% ####### ( 1900, 2900 ] 3 10.000% 86.667% ## ( 2900, 4400 ] 4 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 80 Average: 2253.0625 StdDev: 1770.18 Min: 182 Median: 1700.0000 Max: 6781 Percentiles: P50: 1700.00 P75: 3733.33 P99: 6781.00 P99.9: 6781.00 P99.99: 6781.00 ------------------------------------------------------ ( 170, 250 ] 3 3.750% 3.750% # ( 250, 380 ] 2 2.500% 6.250% # ( 380, 580 ] 12 15.000% 21.250% ### ( 580, 870 ] 10 12.500% 33.750% ### ( 870, 1300 ] 9 11.250% 45.000% ## ( 1300, 1900 ] 6 7.500% 52.500% ## ( 1900, 2900 ] 8 10.000% 62.500% ## ( 2900, 4400 ] 18 22.500% 85.000% ##### ( 4400, 6600 ] 11 13.750% 98.750% ### ( 6600, 9900 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 45.3 total, 6.8 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 152.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.878 H:M:S, 57.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 144.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.834 H:M:S, 56.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/16-22:38:22 ... thread 0: (1000000,8000000) ops and (263668.4,163633.7) ops/second in (3.792643,48.889684) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/9 2.21 GB 94.4 5.5 0.0 5.5 13.1 7.6 0.0 1.7 120.5 285.0 47.06 41.42 127 0.371 5756K 6215 0.0 0.0 L1 10/10 640.80 MB 0.0 6.8 5.2 1.6 6.7 5.1 0.2 1.3 206.1 202.9 33.85 29.82 4 8.463 6643K 103K 0.0 0.0 L2 1/0 53.45 MB 0.5 0.3 0.2 0.2 0.3 0.2 4.5 1.8 238.2 238.1 1.46 1.40 2 0.732 354K 175 0.0 0.0 L3 20/0 952.22 MB 1.0 7.7 4.6 3.0 7.6 4.6 0.0 1.7 142.3 142.0 55.06 36.04 30 1.835 6836K 10K 0.0 0.0 L4 143/0 9.63 GB 1.0 0.3 0.3 0.0 0.3 0.3 4.1 1.0 217.3 217.3 1.43 1.34 1 1.427 314K 0 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1284/19 103.58 GB 0.0 20.6 10.3 10.4 28.1 17.7 13.1 3.7 152.2 207.1 138.86 110.01 164 0.847 19M 120K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.6 10.3 10.4 28.1 17.7 13.1 3.7 152.2 207.1 138.86 110.01 164 0.847 19M 120K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.6 10.3 10.4 20.5 10.1 0.0 0.0 185.0 183.9 114.25 90.20 57 2.004 19M 120K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 314.9 24.61 19.82 107 0.230 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.1 total, 48.9 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.08 GB write, 585.52 MB/s write, 20.64 GB read, 430.42 MB/s read, 138.9 seconds Interval compaction: 28.08 GB write, 588.18 MB/s write, 20.64 GB read, 432.37 MB/s read, 138.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 58, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 58, interval: 75 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3041467 Average: 3.1001 StdDev: 31.20 Min: 0 Median: 1.4509 Max: 24622 Percentiles: P50: 1.45 P75: 1.86 P99: 7.86 P99.9: 159.42 P99.99: 447.33 ------------------------------------------------------ [ 0, 1 ] 691151 22.724% 22.724% ##### ( 1, 2 ] 1839806 60.491% 83.215% ############ ( 2, 3 ] 269871 8.873% 92.088% ## ( 3, 4 ] 113212 3.722% 95.810% # ( 4, 6 ] 87747 2.885% 98.695% # ( 6, 10 ] 19974 0.657% 99.352% ( 10, 15 ] 3667 0.121% 99.473% ( 15, 22 ] 460 0.015% 99.488% ( 22, 34 ] 28 0.001% 99.489% ( 34, 51 ] 16 0.001% 99.489% ( 51, 76 ] 158 0.005% 99.494% ( 76, 110 ] 8031 0.264% 99.758% ( 110, 170 ] 5228 0.172% 99.930% ( 170, 250 ] 918 0.030% 99.961% ( 250, 380 ] 676 0.022% 99.983% ( 380, 580 ] 659 0.022% 100.004% ( 580, 870 ] 335 0.011% 100.015% ( 870, 1300 ] 144 0.005% 100.020% ( 1300, 1900 ] 69 0.002% 100.022% ( 1900, 2900 ] 52 0.002% 100.024% ( 2900, 4400 ] 64 0.002% 100.026% ( 4400, 6600 ] 13 0.000% 100.027% ( 6600, 9900 ] 1 0.000% 100.027% ( 22000, 33000 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 1646426 Average: 7.5696 StdDev: 112.81 Min: 0 Median: 1.8270 Max: 9001 Percentiles: P50: 1.83 P75: 2.76 P99: 9.40 P99.9: 150.70 P99.99: 389.77 ------------------------------------------------------ [ 0, 1 ] 118119 7.174% 7.174% # ( 1, 2 ] 852556 51.782% 58.956% ########## ( 2, 3 ] 345315 20.974% 79.930% #### ( 3, 4 ] 146050 8.871% 88.801% ## ( 4, 6 ] 138363 8.404% 97.205% ## ( 6, 10 ] 34775 2.112% 99.317% ( 10, 15 ] 6588 0.400% 99.717% ( 15, 22 ] 780 0.047% 99.764% ( 22, 34 ] 61 0.004% 99.768% ( 34, 51 ] 59 0.004% 99.772% ( 51, 76 ] 110 0.007% 99.778% ( 76, 110 ] 1258 0.076% 99.855% ( 110, 170 ] 1099 0.067% 99.921% ( 170, 250 ] 476 0.029% 99.950% ( 250, 380 ] 616 0.037% 99.988% ( 380, 580 ] 744 0.045% 100.033% ( 580, 870 ] 786 0.048% 100.081% ( 870, 1300 ] 693 0.042% 100.123% ( 1300, 1900 ] 500 0.030% 100.153% ( 1900, 2900 ] 628 0.038% 100.191% ( 2900, 4400 ] 666 0.040% 100.232% ( 4400, 6600 ] 190 0.012% 100.243% ( 6600, 9900 ] 29 0.002% 100.245% ** Level 2 read latency histogram (micros): Count: 88552 Average: 2.5627 StdDev: 15.75 Min: 0 Median: 1.4426 Max: 1338 Percentiles: P50: 1.44 P75: 1.84 P99: 5.91 P99.9: 187.79 P99.99: 802.75 ------------------------------------------------------ [ 0, 1 ] 19714 22.263% 22.263% #### ( 1, 2 ] 55499 62.674% 84.937% ############# ( 2, 3 ] 7587 8.568% 93.504% ## ( 3, 4 ] 2964 3.347% 96.852% # ( 4, 6 ] 1991 2.248% 99.100% ( 6, 10 ] 586 0.662% 99.762% ( 10, 15 ] 52 0.059% 99.820% ( 15, 22 ] 6 0.007% 99.827% ( 22, 34 ] 3 0.003% 99.831% ( 34, 51 ] 1 0.001% 99.832% ( 76, 110 ] 23 0.026% 99.858% ( 110, 170 ] 31 0.035% 99.893% ( 170, 250 ] 29 0.033% 99.925% ( 250, 380 ] 24 0.027% 99.953% ( 380, 580 ] 27 0.030% 99.983% ( 580, 870 ] 8 0.009% 99.992% ( 870, 1300 ] 6 0.007% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 867553 Average: 8.3251 StdDev: 108.62 Min: 1 Median: 1.9331 Max: 7869 Percentiles: P50: 1.93 P75: 2.88 P99: 9.64 P99.9: 645.81 P99.99: 995.68 ------------------------------------------------------ [ 0, 1 ] 14674 1.691% 1.691% ( 1, 2 ] 449140 51.771% 53.462% ########## ( 2, 3 ] 211866 24.421% 77.883% ##### ( 3, 4 ] 85394 9.843% 87.727% ## ( 4, 6 ] 80265 9.252% 96.978% ## ( 6, 10 ] 19261 2.220% 99.199% ( 10, 15 ] 3237 0.373% 99.572% ( 15, 22 ] 367 0.042% 99.614% ( 22, 34 ] 29 0.003% 99.617% ( 34, 51 ] 6 0.001% 99.618% ( 51, 76 ] 11 0.001% 99.619% ( 76, 110 ] 178 0.021% 99.640% ( 110, 170 ] 380 0.044% 99.684% ( 170, 250 ] 465 0.054% 99.737% ( 250, 380 ] 540 0.062% 99.799% ( 380, 580 ] 695 0.080% 99.880% ( 580, 870 ] 782 0.090% 99.970% ( 870, 1300 ] 603 0.070% 100.039% ( 1300, 1900 ] 377 0.043% 100.083% ( 1900, 2900 ] 323 0.037% 100.120% ( 2900, 4400 ] 301 0.035% 100.155% ( 4400, 6600 ] 78 0.009% 100.164% ( 6600, 9900 ] 9 0.001% 100.165% ** Level 4 read latency histogram (micros): Count: 60 Average: 831.6667 StdDev: 1013.41 Min: 0 Median: 430.0000 Max: 4387 Percentiles: P50: 430.00 P75: 1420.00 P99: 4175.00 P99.9: 4377.50 P99.99: 4387.00 ------------------------------------------------------ [ 0, 1 ] 6 10.000% 10.000% ## ( 1, 2 ] 11 18.333% 28.333% #### ( 2, 3 ] 1 1.667% 30.000% ( 6, 10 ] 1 1.667% 31.667% ( 22, 34 ] 1 1.667% 33.333% ( 170, 250 ] 7 11.667% 45.000% ## ( 250, 380 ] 2 3.333% 48.333% # ( 380, 580 ] 4 6.667% 55.000% # ( 580, 870 ] 7 11.667% 66.667% ## ( 870, 1300 ] 3 5.000% 71.667% # ( 1300, 1900 ] 10 16.667% 88.333% ### ( 1900, 2900 ] 3 5.000% 93.333% # ( 2900, 4400 ] 4 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 260 Average: 1751.9923 StdDev: 1675.87 Min: 88 Median: 1038.2609 Max: 7751 Percentiles: P50: 1038.26 P75: 2842.86 P99: 7040.00 P99.9: 7751.00 P99.99: 7751.00 ------------------------------------------------------ ( 76, 110 ] 7 2.692% 2.692% # ( 110, 170 ] 9 3.462% 6.154% # ( 170, 250 ] 17 6.538% 12.692% # ( 250, 380 ] 23 8.846% 21.538% ## ( 380, 580 ] 34 13.077% 34.615% ### ( 580, 870 ] 31 11.923% 46.538% ## ( 870, 1300 ] 23 8.846% 55.385% ## ( 1300, 1900 ] 18 6.923% 62.308% # ( 1900, 2900 ] 35 13.462% 75.769% ### ( 2900, 4400 ] 38 14.615% 90.385% ### ( 4400, 6600 ] 22 8.462% 98.846% ## ( 6600, 9900 ] 3 1.154% 100.000% ** DB Stats ** Uptime(secs): 49.1 total, 3.8 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 160.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.928 H:M:S, 54.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 259.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.050 H:M:S, 27.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/16-22:38:25 ... thread 0: (1000000,9000000) ops and (326808.7,173244.9) ops/second in (3.059894,51.949578) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/9 3.20 GB 188.8 6.6 0.0 6.6 15.2 8.5 0.0 1.8 125.3 286.3 54.32 48.27 145 0.375 6908K 7380 0.0 0.0 L1 10/10 640.80 MB 0.0 6.8 5.2 1.6 6.7 5.1 0.2 1.3 206.1 202.9 33.85 29.82 4 8.463 6643K 103K 0.0 0.0 L2 1/0 53.45 MB 0.5 0.3 0.2 0.2 0.3 0.2 4.5 1.8 238.2 238.1 1.46 1.40 2 0.732 354K 175 0.0 0.0 L3 20/0 952.22 MB 1.0 7.7 4.6 3.0 7.6 4.6 0.0 1.7 142.3 142.0 55.06 36.04 30 1.835 6836K 10K 0.0 0.0 L4 143/0 9.63 GB 1.0 0.3 0.3 0.0 0.3 0.3 4.1 1.0 217.3 217.3 1.43 1.34 1 1.427 314K 0 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1286/19 104.56 GB 0.0 21.8 10.3 11.5 30.2 18.7 13.1 3.5 152.4 211.5 146.12 116.86 182 0.803 21M 122K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.8 10.3 11.5 30.2 18.7 13.1 3.5 152.4 211.5 146.12 116.86 182 0.803 21M 122K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.8 10.3 11.5 21.6 10.1 0.0 0.0 187.8 186.7 118.61 94.47 61 1.944 21M 122K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 318.4 27.50 22.39 121 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 52.2 total, 52.0 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.17 GB write, 592.21 MB/s write, 21.75 GB read, 426.91 MB/s read, 146.1 seconds Interval compaction: 30.17 GB write, 594.74 MB/s write, 21.75 GB read, 428.73 MB/s read, 146.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 61, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 61, interval: 78 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3393808 Average: 3.0247 StdDev: 29.73 Min: 0 Median: 1.4624 Max: 24622 Percentiles: P50: 1.46 P75: 1.87 P99: 7.61 P99.9: 154.58 P99.99: 393.18 ------------------------------------------------------ [ 0, 1 ] 735874 21.683% 21.683% #### ( 1, 2 ] 2078261 61.237% 82.920% ############ ( 2, 3 ] 313934 9.250% 92.170% ## ( 3, 4 ] 126230 3.719% 95.889% # ( 4, 6 ] 96387 2.840% 98.729% # ( 6, 10 ] 22777 0.671% 99.401% ( 10, 15 ] 4231 0.125% 99.525% ( 15, 22 ] 496 0.015% 99.540% ( 22, 34 ] 34 0.001% 99.541% ( 34, 51 ] 17 0.001% 99.541% ( 51, 76 ] 161 0.005% 99.546% ( 76, 110 ] 8082 0.238% 99.784% ( 110, 170 ] 5291 0.156% 99.940% ( 170, 250 ] 946 0.028% 99.968% ( 250, 380 ] 704 0.021% 99.989% ( 380, 580 ] 677 0.020% 100.009% ( 580, 870 ] 345 0.010% 100.019% ( 870, 1300 ] 150 0.004% 100.023% ( 1300, 1900 ] 72 0.002% 100.025% ( 1900, 2900 ] 52 0.002% 100.027% ( 2900, 4400 ] 65 0.002% 100.029% ( 4400, 6600 ] 13 0.000% 100.029% ( 6600, 9900 ] 1 0.000% 100.029% ( 22000, 33000 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 1704304 Average: 7.4072 StdDev: 110.90 Min: 0 Median: 1.8160 Max: 9001 Percentiles: P50: 1.82 P75: 2.74 P99: 9.38 P99.9: 150.48 P99.99: 392.30 ------------------------------------------------------ [ 0, 1 ] 124027 7.277% 7.277% # ( 1, 2 ] 892339 52.358% 59.635% ########## ( 2, 3 ] 353339 20.732% 80.367% #### ( 3, 4 ] 147857 8.676% 89.043% ## ( 4, 6 ] 139494 8.185% 97.228% ## ( 6, 10 ] 35730 2.096% 99.324% ( 10, 15 ] 6650 0.390% 99.714% ( 15, 22 ] 792 0.046% 99.761% ( 22, 34 ] 62 0.004% 99.764% ( 34, 51 ] 60 0.004% 99.768% ( 51, 76 ] 114 0.007% 99.775% ( 76, 110 ] 1370 0.080% 99.855% ( 110, 170 ] 1135 0.067% 99.922% ( 170, 250 ] 492 0.029% 99.951% ( 250, 380 ] 626 0.037% 99.987% ( 380, 580 ] 757 0.044% 100.032% ( 580, 870 ] 789 0.046% 100.078% ( 870, 1300 ] 693 0.041% 100.119% ( 1300, 1900 ] 500 0.029% 100.148% ( 1900, 2900 ] 628 0.037% 100.185% ( 2900, 4400 ] 666 0.039% 100.224% ( 4400, 6600 ] 190 0.011% 100.235% ( 6600, 9900 ] 29 0.002% 100.237% ** Level 2 read latency histogram (micros): Count: 88552 Average: 2.5627 StdDev: 15.75 Min: 0 Median: 1.4426 Max: 1338 Percentiles: P50: 1.44 P75: 1.84 P99: 5.91 P99.9: 187.79 P99.99: 802.75 ------------------------------------------------------ [ 0, 1 ] 19714 22.263% 22.263% #### ( 1, 2 ] 55499 62.674% 84.937% ############# ( 2, 3 ] 7587 8.568% 93.504% ## ( 3, 4 ] 2964 3.347% 96.852% # ( 4, 6 ] 1991 2.248% 99.100% ( 6, 10 ] 586 0.662% 99.762% ( 10, 15 ] 52 0.059% 99.820% ( 15, 22 ] 6 0.007% 99.827% ( 22, 34 ] 3 0.003% 99.831% ( 34, 51 ] 1 0.001% 99.832% ( 76, 110 ] 23 0.026% 99.858% ( 110, 170 ] 31 0.035% 99.893% ( 170, 250 ] 29 0.033% 99.925% ( 250, 380 ] 24 0.027% 99.953% ( 380, 580 ] 27 0.030% 99.983% ( 580, 870 ] 8 0.009% 99.992% ( 870, 1300 ] 6 0.007% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 867553 Average: 8.3251 StdDev: 108.62 Min: 1 Median: 1.9331 Max: 7869 Percentiles: P50: 1.93 P75: 2.88 P99: 9.64 P99.9: 645.81 P99.99: 995.68 ------------------------------------------------------ [ 0, 1 ] 14674 1.691% 1.691% ( 1, 2 ] 449140 51.771% 53.462% ########## ( 2, 3 ] 211866 24.421% 77.883% ##### ( 3, 4 ] 85394 9.843% 87.727% ## ( 4, 6 ] 80265 9.252% 96.978% ## ( 6, 10 ] 19261 2.220% 99.199% ( 10, 15 ] 3237 0.373% 99.572% ( 15, 22 ] 367 0.042% 99.614% ( 22, 34 ] 29 0.003% 99.617% ( 34, 51 ] 6 0.001% 99.618% ( 51, 76 ] 11 0.001% 99.619% ( 76, 110 ] 178 0.021% 99.640% ( 110, 170 ] 380 0.044% 99.684% ( 170, 250 ] 465 0.054% 99.737% ( 250, 380 ] 540 0.062% 99.799% ( 380, 580 ] 695 0.080% 99.880% ( 580, 870 ] 782 0.090% 99.970% ( 870, 1300 ] 603 0.070% 100.039% ( 1300, 1900 ] 377 0.043% 100.083% ( 1900, 2900 ] 323 0.037% 100.120% ( 2900, 4400 ] 301 0.035% 100.155% ( 4400, 6600 ] 78 0.009% 100.164% ( 6600, 9900 ] 9 0.001% 100.165% ** Level 4 read latency histogram (micros): Count: 60 Average: 831.6667 StdDev: 1013.41 Min: 0 Median: 430.0000 Max: 4387 Percentiles: P50: 430.00 P75: 1420.00 P99: 4175.00 P99.9: 4377.50 P99.99: 4387.00 ------------------------------------------------------ [ 0, 1 ] 6 10.000% 10.000% ## ( 1, 2 ] 11 18.333% 28.333% #### ( 2, 3 ] 1 1.667% 30.000% ( 6, 10 ] 1 1.667% 31.667% ( 22, 34 ] 1 1.667% 33.333% ( 170, 250 ] 7 11.667% 45.000% ## ( 250, 380 ] 2 3.333% 48.333% # ( 380, 580 ] 4 6.667% 55.000% # ( 580, 870 ] 7 11.667% 66.667% ## ( 870, 1300 ] 3 5.000% 71.667% # ( 1300, 1900 ] 10 16.667% 88.333% ### ( 1900, 2900 ] 3 5.000% 93.333% # ( 2900, 4400 ] 4 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 260 Average: 1751.9923 StdDev: 1675.87 Min: 88 Median: 1038.2609 Max: 7751 Percentiles: P50: 1038.26 P75: 2842.86 P99: 7040.00 P99.9: 7751.00 P99.99: 7751.00 ------------------------------------------------------ ( 76, 110 ] 7 2.692% 2.692% # ( 110, 170 ] 9 3.462% 6.154% # ( 170, 250 ] 17 6.538% 12.692% # ( 250, 380 ] 23 8.846% 21.538% ## ( 380, 580 ] 34 13.077% 34.615% ### ( 580, 870 ] 31 11.923% 46.538% ## ( 870, 1300 ] 23 8.846% 55.385% ## ( 1300, 1900 ] 18 6.923% 62.308% # ( 1900, 2900 ] 35 13.462% 75.769% ### ( 2900, 4400 ] 38 14.615% 90.385% ### ( 4400, 6600 ] 22 8.462% 98.846% ## ( 6600, 9900 ] 3 1.154% 100.000% ** DB Stats ** Uptime(secs): 52.2 total, 3.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 169.78 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.340 H:M:S, 52.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.412 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/16-22:38:28 ... thread 0: (1000000,10000000) ops and (331955.4,181943.8) ops/second in (3.012453,54.962031) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 3.07 GB 283.2 7.5 0.0 7.5 17.0 9.5 0.0 1.8 127.5 288.2 60.30 53.91 161 0.375 7803K 8385 0.0 0.0 L1 23/0 1.66 GB 169.9 8.5 6.2 2.3 8.4 6.1 0.2 1.3 204.9 202.0 42.40 37.39 5 8.480 8380K 115K 0.0 0.0 L2 1/0 53.45 MB 0.5 0.3 0.2 0.2 0.3 0.2 4.5 1.8 238.2 238.1 1.46 1.40 2 0.732 354K 175 0.0 0.0 L3 20/0 952.22 MB 1.0 7.7 4.6 3.0 7.6 4.6 0.0 1.7 142.3 142.0 55.06 36.04 30 1.835 6836K 10K 0.0 0.0 L4 143/0 9.63 GB 1.0 0.3 0.3 0.0 0.3 0.3 4.1 1.0 217.3 217.3 1.43 1.34 1 1.427 314K 0 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1298/4 105.47 GB 0.0 24.3 11.3 13.0 33.6 20.6 13.1 3.5 154.8 214.3 160.65 130.08 199 0.807 23M 134K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.3 11.3 13.0 33.6 20.6 13.1 3.5 154.8 214.3 160.65 130.08 199 0.807 23M 134K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.3 11.3 13.0 24.1 11.2 0.0 0.0 190.5 189.4 130.50 105.32 65 2.008 23M 134K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 321.8 30.14 24.75 134 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 55.2 total, 55.0 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.62 GB write, 623.76 MB/s write, 24.28 GB read, 450.58 MB/s read, 160.6 seconds Interval compaction: 33.62 GB write, 626.27 MB/s write, 24.28 GB read, 452.40 MB/s read, 160.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 65, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 65, interval: 82 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3645682 Average: 2.9529 StdDev: 28.86 Min: 0 Median: 1.4555 Max: 24622 Percentiles: P50: 1.46 P75: 1.86 P99: 7.31 P99.9: 151.78 P99.99: 382.19 ------------------------------------------------------ [ 0, 1 ] 803668 22.044% 22.044% #### ( 1, 2 ] 2237337 61.370% 83.414% ############ ( 2, 3 ] 329653 9.042% 92.456% ## ( 3, 4 ] 131836 3.616% 96.072% # ( 4, 6 ] 99037 2.717% 98.789% # ( 6, 10 ] 23569 0.646% 99.435% ( 10, 15 ] 4429 0.121% 99.557% ( 15, 22 ] 521 0.014% 99.571% ( 22, 34 ] 36 0.001% 99.572% ( 34, 51 ] 18 0.000% 99.573% ( 51, 76 ] 162 0.004% 99.577% ( 76, 110 ] 8082 0.222% 99.799% ( 110, 170 ] 5297 0.145% 99.944% ( 170, 250 ] 955 0.026% 99.970% ( 250, 380 ] 710 0.019% 99.990% ( 380, 580 ] 678 0.019% 100.008% ( 580, 870 ] 347 0.010% 100.018% ( 870, 1300 ] 153 0.004% 100.022% ( 1300, 1900 ] 74 0.002% 100.024% ( 1900, 2900 ] 53 0.001% 100.026% ( 2900, 4400 ] 67 0.002% 100.027% ( 4400, 6600 ] 13 0.000% 100.028% ( 6600, 9900 ] 1 0.000% 100.028% ( 22000, 33000 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 1734530 Average: 7.3440 StdDev: 110.03 Min: 0 Median: 1.8103 Max: 9001 Percentiles: P50: 1.81 P75: 2.73 P99: 9.37 P99.9: 152.39 P99.99: 400.74 ------------------------------------------------------ [ 0, 1 ] 126538 7.295% 7.295% # ( 1, 2 ] 914181 52.705% 60.000% ########### ( 2, 3 ] 357055 20.585% 80.585% #### ( 3, 4 ] 148833 8.581% 89.166% ## ( 4, 6 ] 140051 8.074% 97.240% ## ( 6, 10 ] 36193 2.087% 99.327% ( 10, 15 ] 6675 0.385% 99.712% ( 15, 22 ] 794 0.046% 99.757% ( 22, 34 ] 62 0.004% 99.761% ( 34, 51 ] 60 0.003% 99.764% ( 51, 76 ] 115 0.007% 99.771% ( 76, 110 ] 1419 0.082% 99.853% ( 110, 170 ] 1160 0.067% 99.920% ( 170, 250 ] 503 0.029% 99.949% ( 250, 380 ] 638 0.037% 99.985% ( 380, 580 ] 767 0.044% 100.030% ( 580, 870 ] 800 0.046% 100.076% ( 870, 1300 ] 703 0.041% 100.116% ( 1300, 1900 ] 504 0.029% 100.145% ( 1900, 2900 ] 628 0.036% 100.182% ( 2900, 4400 ] 667 0.038% 100.220% ( 4400, 6600 ] 190 0.011% 100.231% ( 6600, 9900 ] 29 0.002% 100.233% ** Level 2 read latency histogram (micros): Count: 88552 Average: 2.5627 StdDev: 15.75 Min: 0 Median: 1.4426 Max: 1338 Percentiles: P50: 1.44 P75: 1.84 P99: 5.91 P99.9: 187.79 P99.99: 802.75 ------------------------------------------------------ [ 0, 1 ] 19714 22.263% 22.263% #### ( 1, 2 ] 55499 62.674% 84.937% ############# ( 2, 3 ] 7587 8.568% 93.504% ## ( 3, 4 ] 2964 3.347% 96.852% # ( 4, 6 ] 1991 2.248% 99.100% ( 6, 10 ] 586 0.662% 99.762% ( 10, 15 ] 52 0.059% 99.820% ( 15, 22 ] 6 0.007% 99.827% ( 22, 34 ] 3 0.003% 99.831% ( 34, 51 ] 1 0.001% 99.832% ( 76, 110 ] 23 0.026% 99.858% ( 110, 170 ] 31 0.035% 99.893% ( 170, 250 ] 29 0.033% 99.925% ( 250, 380 ] 24 0.027% 99.953% ( 380, 580 ] 27 0.030% 99.983% ( 580, 870 ] 8 0.009% 99.992% ( 870, 1300 ] 6 0.007% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 867553 Average: 8.3251 StdDev: 108.62 Min: 1 Median: 1.9331 Max: 7869 Percentiles: P50: 1.93 P75: 2.88 P99: 9.64 P99.9: 645.81 P99.99: 995.68 ------------------------------------------------------ [ 0, 1 ] 14674 1.691% 1.691% ( 1, 2 ] 449140 51.771% 53.462% ########## ( 2, 3 ] 211866 24.421% 77.883% ##### ( 3, 4 ] 85394 9.843% 87.727% ## ( 4, 6 ] 80265 9.252% 96.978% ## ( 6, 10 ] 19261 2.220% 99.199% ( 10, 15 ] 3237 0.373% 99.572% ( 15, 22 ] 367 0.042% 99.614% ( 22, 34 ] 29 0.003% 99.617% ( 34, 51 ] 6 0.001% 99.618% ( 51, 76 ] 11 0.001% 99.619% ( 76, 110 ] 178 0.021% 99.640% ( 110, 170 ] 380 0.044% 99.684% ( 170, 250 ] 465 0.054% 99.737% ( 250, 380 ] 540 0.062% 99.799% ( 380, 580 ] 695 0.080% 99.880% ( 580, 870 ] 782 0.090% 99.970% ( 870, 1300 ] 603 0.070% 100.039% ( 1300, 1900 ] 377 0.043% 100.083% ( 1900, 2900 ] 323 0.037% 100.120% ( 2900, 4400 ] 301 0.035% 100.155% ( 4400, 6600 ] 78 0.009% 100.164% ( 6600, 9900 ] 9 0.001% 100.165% ** Level 4 read latency histogram (micros): Count: 60 Average: 831.6667 StdDev: 1013.41 Min: 0 Median: 430.0000 Max: 4387 Percentiles: P50: 430.00 P75: 1420.00 P99: 4175.00 P99.9: 4377.50 P99.99: 4387.00 ------------------------------------------------------ [ 0, 1 ] 6 10.000% 10.000% ## ( 1, 2 ] 11 18.333% 28.333% #### ( 2, 3 ] 1 1.667% 30.000% ( 6, 10 ] 1 1.667% 31.667% ( 22, 34 ] 1 1.667% 33.333% ( 170, 250 ] 7 11.667% 45.000% ## ( 250, 380 ] 2 3.333% 48.333% # ( 380, 580 ] 4 6.667% 55.000% # ( 580, 870 ] 7 11.667% 66.667% ## ( 870, 1300 ] 3 5.000% 71.667% # ( 1300, 1900 ] 10 16.667% 88.333% ### ( 1900, 2900 ] 3 5.000% 93.333% # ( 2900, 4400 ] 4 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 260 Average: 1751.9923 StdDev: 1675.87 Min: 88 Median: 1038.2609 Max: 7751 Percentiles: P50: 1038.26 P75: 2842.86 P99: 7040.00 P99.9: 7751.00 P99.99: 7751.00 ------------------------------------------------------ ( 76, 110 ] 7 2.692% 2.692% # ( 110, 170 ] 9 3.462% 6.154% # ( 170, 250 ] 17 6.538% 12.692% # ( 250, 380 ] 23 8.846% 21.538% ## ( 380, 580 ] 34 13.077% 34.615% ### ( 580, 870 ] 31 11.923% 46.538% ## ( 870, 1300 ] 23 8.846% 55.385% ## ( 1300, 1900 ] 18 6.923% 62.308% # ( 1900, 2900 ] 35 13.462% 75.769% ### ( 2900, 4400 ] 38 14.615% 90.385% ### ( 4400, 6600 ] 22 8.462% 98.846% ## ( 6600, 9900 ] 3 1.154% 100.000% ** DB Stats ** Uptime(secs): 55.2 total, 3.0 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 178.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.739 H:M:S, 50.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.399 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.810 micros/op 172111 ops/sec 60.083 seconds 10340999 operations; 166.8 MB/s Microseconds per write: Count: 10340999 Average: 5.8102 StdDev: 470.46 Min: 0 Median: 1.7292 Max: 816696 Percentiles: P50: 1.73 P75: 2.73 P99: 9.07 P99.9: 1163.50 P99.99: 2769.55 ------------------------------------------------------ [ 0, 1 ] 1428755 13.816% 13.816% ### ( 1, 2 ] 5130998 49.618% 63.434% ########## ( 2, 3 ] 1631450 15.777% 79.211% ### ( 3, 4 ] 1410287 13.638% 92.849% ### ( 4, 6 ] 550068 5.319% 98.168% # ( 6, 10 ] 112093 1.084% 99.252% ( 10, 15 ] 37857 0.366% 99.618% ( 15, 22 ] 10145 0.098% 99.716% ( 22, 34 ] 1884 0.018% 99.734% ( 34, 51 ] 245 0.002% 99.737% ( 51, 76 ] 33 0.000% 99.737% ( 76, 110 ] 6903 0.067% 99.804% ( 110, 170 ] 3070 0.030% 99.834% ( 170, 250 ] 327 0.003% 99.837% ( 250, 380 ] 163 0.002% 99.838% ( 380, 580 ] 32 0.000% 99.839% ( 580, 870 ] 24 0.000% 99.839% ( 870, 1300 ] 9265 0.090% 99.928% ( 1300, 1900 ] 33 0.000% 99.929% ( 1900, 2900 ] 7283 0.070% 99.999% ( 2900, 4400 ] 32 0.000% 99.999% ( 4400, 6600 ] 15 0.000% 100.000% ( 6600, 9900 ] 5 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 33000, 50000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 250000, 380000 ] 4 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 164975 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10340999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10671910968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 523 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31769950 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 27614982651 rocksdb.compact.write.bytes COUNT : 27444742115 rocksdb.flush.write.bytes COUNT : 10635073048 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 62 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 327 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10549472256 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4229120 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 27713926019 rocksdb.non.last.level.read.count COUNT : 6690211 rocksdb.block.checksum.compute.count COUNT : 6689228 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.380945 P95 : 3.897445 P99 : 7.532510 P100 : 816695.000000 COUNT : 10340999 SUM : 55350151 rocksdb.compaction.times.micros P50 : 1385937.500000 P95 : 4218333.333333 P99 : 22283327.000000 P100 : 22283327.000000 COUNT : 67 SUM : 132631608 rocksdb.compaction.times.cpu_micros P50 : 1030000.000000 P95 : 4177500.000000 P99 : 16640000.000000 P100 : 19802842.000000 COUNT : 67 SUM : 107418962 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 696.000000 P95 : 5500.000000 P99 : 30800.000000 P100 : 272190.000000 COUNT : 140 SUM : 456778 rocksdb.compaction.outfile.sync.micros P50 : 1226.518987 P95 : 92325.000000 P99 : 198640.000000 P100 : 215485.000000 COUNT : 321 SUM : 4669152 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 105.231707 P95 : 2010.000000 P99 : 4080.714286 P100 : 4883.000000 COUNT : 249 SUM : 97296 rocksdb.table.open.io.micros P50 : 1681.000000 P95 : 9410.892857 P99 : 18513.333333 P100 : 20731.000000 COUNT : 523 SUM : 1392174 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.694314 P95 : 8.121466 P99 : 12.624796 P100 : 24628.000000 COUNT : 6687821 SUM : 46296144 rocksdb.read.block.get.micros P50 : 550.642202 P95 : 3933.064516 P99 : 6307.230769 P100 : 11586.000000 COUNT : 1046 SUM : 1078068 rocksdb.write.raw.block.micros P50 : 0.515198 P95 : 0.978876 P99 : 2.960566 P100 : 11821.000000 COUNT : 9223024 SUM : 19327379 rocksdb.numfiles.in.singlecompaction P50 : 3.480769 P95 : 8.100000 P99 : 31.960000 P100 : 37.000000 COUNT : 117 SUM : 529 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.578916 P95 : 2066.043699 P99 : 2740.134671 P100 : 816504.000000 COUNT : 122634 SUM : 31784673 rocksdb.sst.read.micros P50 : 1.586127 P95 : 4.739609 P99 : 9.026829 P100 : 24622.000000 COUNT : 6690561 SUM : 32368835 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10340999 SUM : 10671910968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 210000.000000 P95 : 380000.000000 P99 : 821333.333333 P100 : 969957.000000 COUNT : 140 SUM : 31385405 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 331 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0