[2024-11-19 05:58:43.742076] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 22.11.4 initialization... [2024-11-19 05:58:43.742341] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1204321 ] Set seed to 1731992323735423 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-19 05:58:43.837283] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-19 05:58:43.878996] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-19 05:58:43.879047] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1204321' to capture a snapshot of events at runtime. [2024-11-19 05:58:43.879057] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-19 05:58:43.879067] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-19 05:58:43.879075] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1204321 for offline analysis/debug. [2024-11-19 05:58:43.879165] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Nov 19 05:58:48 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/19-05:58:50 ... thread 0: (1000000,1000000) ops and (355345.4,355345.4) ops/second in (2.814163,2.814163) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.02 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 353.1 2.32 2.10 12 0.193 0 0 0.0 0.0 L2 3/2 251.73 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 250.1 249.9 1.51 1.46 2 0.756 383K 210 0.0 0.0 L3 10/0 804.24 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 98.7 312.4 3.83 3.56 14 0.274 383K 210 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 98.7 312.4 3.83 3.56 14 0.274 383K 210 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 250.1 249.9 1.51 1.46 2 0.756 383K 210 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 353.1 2.32 2.10 12 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 398.03 MB/s write, 0.37 GB read, 125.70 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 425.06 MB/s write, 0.37 GB read, 134.24 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 103167 Average: 1.8513 StdDev: 19.03 Min: 1 Median: 1.1864 Max: 3751 Percentiles: P50: 1.19 P75: 1.64 P99: 3.75 P99.9: 9.28 P99.99: 267.77 ------------------------------------------------------ [ 0, 1 ] 40971 39.713% 39.713% ######## ( 1, 2 ] 56946 55.198% 94.911% ########### ( 2, 3 ] 3363 3.260% 98.171% # ( 3, 4 ] 1148 1.113% 99.284% ( 4, 6 ] 490 0.475% 99.759% ( 6, 10 ] 179 0.174% 99.932% ( 10, 15 ] 36 0.035% 99.967% ( 15, 22 ] 10 0.010% 99.977% ( 34, 51 ] 2 0.002% 99.979% ( 110, 170 ] 9 0.009% 99.987% ( 170, 250 ] 3 0.003% 99.990% ( 250, 380 ] 5 0.005% 99.995% ( 380, 580 ] 1 0.001% 99.996% ( 580, 870 ] 2 0.002% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 3 0.003% 100.002% ** Level 1 read latency histogram (micros): Count: 5 Average: 1195.6000 StdDev: 922.20 Min: 213 Median: 725.0000 Max: 2755 Percentiles: P50: 725.00 P75: 1750.00 P99: 2755.00 P99.9: 2755.00 P99.99: 2755.00 ------------------------------------------------------ ( 170, 250 ] 1 20.000% 20.000% #### ( 380, 580 ] 1 20.000% 40.000% #### ( 580, 870 ] 1 20.000% 60.000% #### ( 1300, 1900 ] 1 20.000% 80.000% #### ( 1900, 2900 ] 1 20.000% 100.000% #### ** Level 2 read latency histogram (micros): Count: 52484 Average: 2.0020 StdDev: 18.93 Min: 1 Median: 1.2528 Max: 3106 Percentiles: P50: 1.25 P75: 1.69 P99: 4.99 P99.9: 9.87 P99.99: 797.96 ------------------------------------------------------ [ 0, 1 ] 18661 35.556% 35.556% ####### ( 1, 2 ] 29984 57.130% 92.685% ########### ( 2, 3 ] 2154 4.104% 96.789% # ( 3, 4 ] 925 1.762% 98.552% ( 4, 6 ] 477 0.909% 99.461% ( 6, 10 ] 239 0.455% 99.916% ( 10, 15 ] 24 0.046% 99.962% ( 15, 22 ] 7 0.013% 99.975% ( 22, 34 ] 2 0.004% 99.979% ( 51, 76 ] 1 0.002% 99.981% ( 250, 380 ] 2 0.004% 99.985% ( 380, 580 ] 3 0.006% 99.990% ( 580, 870 ] 1 0.002% 99.992% ( 870, 1300 ] 3 0.006% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ( 2900, 4400 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 40 Average: 1570.4500 StdDev: 1117.84 Min: 183 Median: 1156.6667 Max: 4856 Percentiles: P50: 1156.67 P75: 2500.00 P99: 4856.00 P99.9: 4856.00 P99.99: 4856.00 ------------------------------------------------------ ( 170, 250 ] 2 5.000% 5.000% # ( 250, 380 ] 1 2.500% 7.500% # ( 380, 580 ] 3 7.500% 15.000% ## ( 580, 870 ] 10 25.000% 40.000% ##### ( 870, 1300 ] 6 15.000% 55.000% ### ( 1300, 1900 ] 2 5.000% 60.000% # ( 1900, 2900 ] 10 25.000% 85.000% ##### ( 2900, 4400 ] 5 12.500% 97.500% ### ( 4400, 6600 ] 1 2.500% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1783.5333 StdDev: 1151.11 Min: 345 Median: 1471.4286 Max: 4132 Percentiles: P50: 1471.43 P75: 2733.33 P99: 4132.00 P99.9: 4132.00 P99.99: 4132.00 ------------------------------------------------------ ( 250, 380 ] 2 6.667% 6.667% # ( 380, 580 ] 2 6.667% 13.333% # ( 580, 870 ] 3 10.000% 23.333% ## ( 870, 1300 ] 6 20.000% 43.333% #### ( 1300, 1900 ] 7 23.333% 66.667% ##### ( 1900, 2900 ] 3 10.000% 76.667% ## ( 2900, 4400 ] 7 23.333% 100.000% ##### ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 327.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.215 H:M:S, 7.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 349.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.215 H:M:S, 7.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-05:58:54 ... thread 0: (1000000,2000000) ops and (325755.5,339907.7) ops/second in (3.069787,5.883950) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 1.17 GB 18.9 0.2 0.0 0.2 2.0 1.8 0.0 1.1 40.9 337.5 6.16 5.61 27 0.228 255K 228 0.0 0.0 L1 1/1 3.11 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 241.6 241.2 1.56 1.52 1 1.565 383K 565 0.0 0.0 L2 2/1 54.02 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 250.1 249.9 1.51 1.46 2 0.756 383K 210 0.0 0.0 L3 20/10 1.12 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 228.9 228.9 1.09 1.03 1 1.091 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 145.8 145.8 1.54 1.14 1 1.541 228K 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/23 97.92 GB 0.0 1.4 1.0 0.4 3.2 2.8 1.1 1.8 124.9 278.8 11.87 10.76 32 0.371 1505K 1003 0.0 0.0 Int 0/0 0.00 KB 0.0 1.4 1.0 0.4 3.2 2.8 1.1 1.8 124.9 278.8 11.87 10.76 32 0.371 1505K 1003 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.4 1.0 0.4 1.4 1.0 0.0 0.0 221.4 221.2 6.70 6.12 6 1.116 1505K 1003 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.3 5.17 4.64 26 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.23 GB write, 544.45 MB/s write, 1.45 GB read, 243.96 MB/s read, 11.9 seconds Interval compaction: 3.23 GB write, 562.14 MB/s write, 1.45 GB read, 251.89 MB/s read, 11.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 363920 Average: 2.1994 StdDev: 11.13 Min: 1 Median: 1.4974 Max: 3751 Percentiles: P50: 1.50 P75: 1.89 P99: 5.61 P99.9: 10.75 P99.99: 17.04 ------------------------------------------------------ [ 0, 1 ] 67519 18.553% 18.553% #### ( 1, 2 ] 230074 63.221% 81.774% ############# ( 2, 3 ] 41431 11.385% 93.159% ## ( 3, 4 ] 14037 3.857% 97.016% # ( 4, 6 ] 8950 2.459% 99.475% ( 6, 10 ] 1491 0.410% 99.885% ( 10, 15 ] 374 0.103% 99.988% ( 15, 22 ] 33 0.009% 99.997% ( 22, 34 ] 3 0.001% 99.998% ( 34, 51 ] 3 0.001% 99.999% ( 51, 76 ] 3 0.001% 99.999% ( 110, 170 ] 15 0.004% 100.004% ( 170, 250 ] 10 0.003% 100.006% ( 250, 380 ] 12 0.003% 100.010% ( 380, 580 ] 4 0.001% 100.011% ( 580, 870 ] 6 0.002% 100.012% ( 870, 1300 ] 3 0.001% 100.013% ( 1300, 1900 ] 1 0.000% 100.013% ( 2900, 4400 ] 3 0.001% 100.014% ** Level 1 read latency histogram (micros): Count: 31 Average: 338.5806 StdDev: 631.66 Min: 1 Median: 2.7500 Max: 2755 Percentiles: P50: 2.75 P75: 396.67 P99: 2590.00 P99.9: 2755.00 P99.99: 2755.00 ------------------------------------------------------ [ 0, 1 ] 8 25.806% 25.806% ##### ( 1, 2 ] 6 19.355% 45.161% #### ( 2, 3 ] 2 6.452% 51.613% # ( 3, 4 ] 1 3.226% 54.839% # ( 4, 6 ] 1 3.226% 58.065% # ( 15, 22 ] 1 3.226% 61.290% # ( 170, 250 ] 3 9.677% 70.968% ## ( 250, 380 ] 1 3.226% 74.194% # ( 380, 580 ] 3 9.677% 83.871% ## ( 580, 870 ] 1 3.226% 87.097% # ( 870, 1300 ] 1 3.226% 90.323% # ( 1300, 1900 ] 2 6.452% 96.774% # ( 1900, 2900 ] 1 3.226% 100.000% # ** Level 2 read latency histogram (micros): Count: 95704 Average: 2.1049 StdDev: 14.04 Min: 1 Median: 1.4075 Max: 3106 Percentiles: P50: 1.41 P75: 1.81 P99: 5.47 P99.9: 9.74 P99.99: 342.92 ------------------------------------------------------ [ 0, 1 ] 23573 24.631% 24.631% ##### ( 1, 2 ] 59580 62.254% 86.886% ############ ( 2, 3 ] 7213 7.537% 94.422% ## ( 3, 4 ] 3096 3.235% 97.657% # ( 4, 6 ] 1750 1.829% 99.486% ( 6, 10 ] 424 0.443% 99.929% ( 10, 15 ] 42 0.044% 99.973% ( 15, 22 ] 7 0.007% 99.980% ( 22, 34 ] 6 0.006% 99.986% ( 34, 51 ] 1 0.001% 99.987% ( 51, 76 ] 1 0.001% 99.989% ( 250, 380 ] 2 0.002% 99.991% ( 380, 580 ] 3 0.003% 99.994% ( 580, 870 ] 1 0.001% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 178765 Average: 3.2767 StdDev: 32.70 Min: 0 Median: 1.6606 Max: 4856 Percentiles: P50: 1.66 P75: 2.24 P99: 8.79 P99.9: 147.25 P99.99: 432.13 ------------------------------------------------------ [ 0, 1 ] 18085 10.117% 10.117% ## ( 1, 2 ] 107935 60.378% 70.495% ############ ( 2, 3 ] 32981 18.449% 88.944% #### ( 3, 4 ] 8759 4.900% 93.844% # ( 4, 6 ] 7281 4.073% 97.917% # ( 6, 10 ] 2778 1.554% 99.471% ( 10, 15 ] 414 0.232% 99.702% ( 15, 22 ] 99 0.055% 99.758% ( 22, 34 ] 26 0.015% 99.772% ( 34, 51 ] 7 0.004% 99.776% ( 51, 76 ] 9 0.005% 99.781% ( 76, 110 ] 117 0.065% 99.847% ( 110, 170 ] 155 0.087% 99.933% ( 170, 250 ] 65 0.036% 99.970% ( 250, 380 ] 28 0.016% 99.985% ( 380, 580 ] 35 0.020% 100.005% ( 580, 870 ] 19 0.011% 100.016% ( 870, 1300 ] 12 0.007% 100.022% ( 1300, 1900 ] 5 0.003% 100.025% ( 1900, 2900 ] 10 0.006% 100.031% ( 2900, 4400 ] 6 0.003% 100.034% ( 4400, 6600 ] 1 0.001% 100.035% ** Level 4 read latency histogram (micros): Count: 320 Average: 175.9719 StdDev: 627.36 Min: 0 Median: 2.2830 Max: 4132 Percentiles: P50: 2.28 P75: 9.08 P99: 3714.29 P99.9: 4132.00 P99.99: 4132.00 ------------------------------------------------------ [ 0, 1 ] 46 14.375% 14.375% ### ( 1, 2 ] 99 30.938% 45.312% ###### ( 2, 3 ] 53 16.562% 61.875% ### ( 3, 4 ] 12 3.750% 65.625% # ( 4, 6 ] 20 6.250% 71.875% # ( 6, 10 ] 13 4.062% 75.938% # ( 10, 15 ] 22 6.875% 82.812% # ( 15, 22 ] 14 4.375% 87.188% # ( 22, 34 ] 6 1.875% 89.062% ( 34, 51 ] 1 0.312% 89.375% ( 110, 170 ] 1 0.312% 89.688% ( 250, 380 ] 4 1.250% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 4 1.250% 92.812% ( 870, 1300 ] 6 1.875% 94.688% ( 1300, 1900 ] 7 2.188% 96.875% ( 1900, 2900 ] 3 0.938% 97.812% ( 2900, 4400 ] 7 2.188% 100.000% ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 323.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.577 H:M:S, 9.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.362 H:M:S, 11.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/19-05:58:57 ... thread 0: (1000000,3000000) ops and (319441.4,332800.3) ops/second in (3.130465,9.014415) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/7 1.48 GB 12.6 1.4 0.0 1.4 4.1 2.8 0.0 1.5 102.8 312.9 13.48 12.49 45 0.300 1407K 1395 0.0 0.0 L1 3/3 211.52 MB 0.0 1.0 1.0 0.0 1.0 1.0 0.2 1.0 230.8 230.2 4.65 4.52 2 2.326 1090K 2567 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.9 2.0 250.1 249.9 1.51 1.46 2 0.756 383K 210 0.0 0.0 L3 21/0 911.01 MB 0.9 1.9 0.8 1.1 1.9 0.8 0.4 2.5 224.5 224.0 8.63 8.07 6 1.439 1967K 4022 0.0 0.0 L4 178/4 9.83 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 145.8 145.8 1.54 1.14 1 1.541 228K 0 0.0 0.0 L5 1052/0 86.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1263/14 98.90 GB 0.0 4.9 2.2 2.7 7.6 5.0 3.0 2.8 167.7 262.4 29.82 27.69 56 0.533 5077K 8194 0.0 0.0 Int 0/0 0.00 KB 0.0 4.9 2.2 2.7 7.6 5.0 3.0 2.8 167.7 262.4 29.82 27.69 56 0.533 5077K 8194 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.9 2.2 2.7 4.9 2.2 0.0 0.0 229.4 229.0 21.80 20.53 16 1.362 5077K 8194 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 353.4 8.02 7.16 40 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.64 GB write, 850.07 MB/s write, 4.88 GB read, 543.07 MB/s read, 29.8 seconds Interval compaction: 7.64 GB write, 868.09 MB/s write, 4.88 GB read, 554.59 MB/s read, 29.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 704395 Average: 2.3494 StdDev: 9.75 Min: 1 Median: 1.5812 Max: 3751 Percentiles: P50: 1.58 P75: 1.98 P99: 5.82 P99.9: 9.96 P99.99: 14.38 ------------------------------------------------------ [ 0, 1 ] 94298 13.387% 13.387% ### ( 1, 2 ] 443720 62.993% 76.380% ############# ( 2, 3 ] 97203 13.800% 90.180% ### ( 3, 4 ] 37401 5.310% 95.489% # ( 4, 6 ] 27121 3.850% 99.340% # ( 6, 10 ] 3993 0.567% 99.906% ( 10, 15 ] 673 0.096% 100.002% ( 15, 22 ] 78 0.011% 100.013% ( 22, 34 ] 6 0.001% 100.014% ( 34, 51 ] 3 0.000% 100.014% ( 51, 76 ] 4 0.001% 100.015% ( 110, 170 ] 19 0.003% 100.018% ( 170, 250 ] 18 0.003% 100.020% ( 250, 380 ] 20 0.003% 100.023% ( 380, 580 ] 4 0.001% 100.024% ( 580, 870 ] 12 0.002% 100.025% ( 870, 1300 ] 9 0.001% 100.027% ( 1300, 1900 ] 4 0.001% 100.027% ( 1900, 2900 ] 1 0.000% 100.027% ( 2900, 4400 ] 3 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 229983 Average: 2.9443 StdDev: 14.70 Min: 1 Median: 1.7757 Max: 2755 Percentiles: P50: 1.78 P75: 2.60 P99: 7.65 P99.9: 12.57 P99.99: 14.79 ------------------------------------------------------ [ 0, 1 ] 11219 4.878% 4.878% # ( 1, 2 ] 133783 58.171% 63.049% ############ ( 2, 3 ] 45449 19.762% 82.811% #### ( 3, 4 ] 18475 8.033% 90.844% ## ( 4, 6 ] 17475 7.598% 98.442% ## ( 6, 10 ] 3111 1.353% 99.795% ( 10, 15 ] 468 0.203% 99.999% ( 15, 22 ] 54 0.023% 100.022% ( 22, 34 ] 7 0.003% 100.025% ( 34, 51 ] 2 0.001% 100.026% ( 51, 76 ] 2 0.001% 100.027% ( 76, 110 ] 29 0.013% 100.040% ( 110, 170 ] 60 0.026% 100.066% ( 170, 250 ] 37 0.016% 100.082% ( 250, 380 ] 25 0.011% 100.093% ( 380, 580 ] 20 0.009% 100.101% ( 580, 870 ] 16 0.007% 100.108% ( 870, 1300 ] 7 0.003% 100.111% ( 1300, 1900 ] 4 0.002% 100.113% ( 1900, 2900 ] 2 0.001% 100.114% ** Level 2 read latency histogram (micros): Count: 111911 Average: 2.2677 StdDev: 14.20 Min: 1 Median: 1.4423 Max: 3106 Percentiles: P50: 1.44 P75: 1.84 P99: 5.80 P99.9: 13.98 P99.99: 473.63 ------------------------------------------------------ [ 0, 1 ] 24862 22.216% 22.216% #### ( 1, 2 ] 70298 62.816% 85.032% ############# ( 2, 3 ] 9522 8.509% 93.540% ## ( 3, 4 ] 3990 3.565% 97.106% # ( 4, 6 ] 2356 2.105% 99.211% ( 6, 10 ] 717 0.641% 99.852% ( 10, 15 ] 68 0.061% 99.912% ( 15, 22 ] 8 0.007% 99.920% ( 22, 34 ] 6 0.005% 99.925% ( 34, 51 ] 1 0.001% 99.926% ( 51, 76 ] 1 0.001% 99.927% ( 76, 110 ] 10 0.009% 99.936% ( 110, 170 ] 41 0.037% 99.972% ( 170, 250 ] 7 0.006% 99.979% ( 250, 380 ] 10 0.009% 99.987% ( 380, 580 ] 6 0.005% 99.993% ( 580, 870 ] 3 0.003% 99.996% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 239505 Average: 3.3278 StdDev: 30.40 Min: 0 Median: 1.6640 Max: 4856 Percentiles: P50: 1.66 P75: 2.25 P99: 8.82 P99.9: 167.01 P99.99: 565.63 ------------------------------------------------------ [ 0, 1 ] 22500 9.394% 9.394% ## ( 1, 2 ] 146464 61.153% 70.547% ############ ( 2, 3 ] 42043 17.554% 88.101% #### ( 3, 4 ] 13162 5.496% 93.597% # ( 4, 6 ] 10225 4.269% 97.866% # ( 6, 10 ] 3848 1.607% 99.473% ( 10, 15 ] 512 0.214% 99.686% ( 15, 22 ] 110 0.046% 99.732% ( 22, 34 ] 30 0.013% 99.745% ( 34, 51 ] 8 0.003% 99.748% ( 51, 76 ] 10 0.004% 99.752% ( 76, 110 ] 134 0.056% 99.808% ( 110, 170 ] 231 0.096% 99.905% ( 170, 250 ] 102 0.043% 99.947% ( 250, 380 ] 51 0.021% 99.969% ( 380, 580 ] 55 0.023% 99.992% ( 580, 870 ] 34 0.014% 100.006% ( 870, 1300 ] 25 0.010% 100.016% ( 1300, 1900 ] 5 0.002% 100.018% ( 1900, 2900 ] 10 0.004% 100.023% ( 2900, 4400 ] 6 0.003% 100.025% ( 4400, 6600 ] 1 0.000% 100.025% ** Level 4 read latency histogram (micros): Count: 320 Average: 175.9719 StdDev: 627.36 Min: 0 Median: 2.2830 Max: 4132 Percentiles: P50: 2.28 P75: 9.08 P99: 3714.29 P99.9: 4132.00 P99.99: 4132.00 ------------------------------------------------------ [ 0, 1 ] 46 14.375% 14.375% ### ( 1, 2 ] 99 30.938% 45.312% ###### ( 2, 3 ] 53 16.562% 61.875% ### ( 3, 4 ] 12 3.750% 65.625% # ( 4, 6 ] 20 6.250% 71.875% # ( 6, 10 ] 13 4.062% 75.938% # ( 10, 15 ] 22 6.875% 82.812% # ( 15, 22 ] 14 4.375% 87.188% # ( 22, 34 ] 6 1.875% 89.062% ( 34, 51 ] 1 0.312% 89.375% ( 110, 170 ] 1 0.312% 89.688% ( 250, 380 ] 4 1.250% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 4 1.250% 92.812% ( 870, 1300 ] 6 1.875% 94.688% ( 1300, 1900 ] 7 2.188% 96.875% ( 1900, 2900 ] 3 0.938% 97.812% ( 2900, 4400 ] 7 2.188% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 752.1667 StdDev: 1017.25 Min: 78 Median: 315.0000 Max: 4042 Percentiles: P50: 315.00 P75: 821.67 P99: 4042.00 P99.9: 4042.00 P99.99: 4042.00 ------------------------------------------------------ ( 76, 110 ] 10 16.667% 16.667% ### ( 110, 170 ] 13 21.667% 38.333% #### ( 170, 250 ] 4 6.667% 45.000% # ( 250, 380 ] 6 10.000% 55.000% ## ( 380, 580 ] 7 11.667% 66.667% ## ( 580, 870 ] 6 10.000% 76.667% ## ( 870, 1300 ] 2 3.333% 80.000% # ( 1300, 1900 ] 4 6.667% 86.667% # ( 1900, 2900 ] 3 5.000% 91.667% # ( 2900, 4400 ] 5 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 9.2 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 320.69 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.974 H:M:S, 10.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 314.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.397 H:M:S, 12.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-05:59:00 ... thread 0: (1000000,4000000) ops and (321246.0,329834.5) ops/second in (3.112879,12.127294) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 2.40 GB 75.5 1.9 0.0 1.9 5.6 3.7 0.0 1.5 105.8 310.5 18.46 17.11 60 0.308 1982K 2028 0.0 0.0 L1 3/3 211.52 MB 0.0 1.0 1.0 0.0 1.0 1.0 0.2 1.0 230.8 230.2 4.65 4.52 2 2.326 1090K 2567 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.9 2.0 250.1 249.9 1.51 1.46 2 0.756 383K 210 0.0 0.0 L3 21/0 911.01 MB 0.9 1.9 0.8 1.1 1.9 0.8 0.4 2.5 224.5 224.0 8.63 8.07 6 1.439 1967K 4022 0.0 0.0 L4 174/0 9.52 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 145.8 145.8 1.54 1.14 1 1.541 228K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1270/14 99.82 GB 0.0 5.4 2.2 3.2 9.1 5.9 3.4 2.5 160.0 268.4 34.79 32.31 71 0.490 5652K 8827 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 2.2 3.2 9.1 5.9 3.4 2.5 160.0 268.4 34.79 32.31 71 0.490 5652K 8827 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 2.2 3.2 5.4 2.2 0.0 0.0 232.1 231.8 23.98 22.67 18 1.332 5652K 8827 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 349.6 10.81 9.64 53 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.1 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.12 GB write, 757.94 MB/s write, 5.44 GB read, 451.87 MB/s read, 34.8 seconds Interval compaction: 9.12 GB write, 769.89 MB/s write, 5.44 GB read, 458.99 MB/s read, 34.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1079777 Average: 2.2829 StdDev: 8.92 Min: 1 Median: 1.5539 Max: 3751 Percentiles: P50: 1.55 P75: 1.94 P99: 5.76 P99.9: 9.90 P99.99: 14.25 ------------------------------------------------------ [ 0, 1 ] 155747 14.424% 14.424% ### ( 1, 2 ] 693480 64.224% 78.648% ############# ( 2, 3 ] 141111 13.069% 91.717% ### ( 3, 4 ] 48592 4.500% 96.217% # ( 4, 6 ] 34120 3.160% 99.377% # ( 6, 10 ] 5788 0.536% 99.913% ( 10, 15 ] 980 0.091% 100.004% ( 15, 22 ] 102 0.009% 100.013% ( 22, 34 ] 8 0.001% 100.014% ( 34, 51 ] 7 0.001% 100.015% ( 51, 76 ] 6 0.001% 100.015% ( 76, 110 ] 1 0.000% 100.015% ( 110, 170 ] 25 0.002% 100.018% ( 170, 250 ] 30 0.003% 100.020% ( 250, 380 ] 29 0.003% 100.023% ( 380, 580 ] 5 0.000% 100.024% ( 580, 870 ] 16 0.001% 100.025% ( 870, 1300 ] 15 0.001% 100.026% ( 1300, 1900 ] 4 0.000% 100.027% ( 1900, 2900 ] 2 0.000% 100.027% ( 2900, 4400 ] 3 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 229983 Average: 2.9443 StdDev: 14.70 Min: 1 Median: 1.7757 Max: 2755 Percentiles: P50: 1.78 P75: 2.60 P99: 7.65 P99.9: 12.57 P99.99: 14.79 ------------------------------------------------------ [ 0, 1 ] 11219 4.878% 4.878% # ( 1, 2 ] 133783 58.171% 63.049% ############ ( 2, 3 ] 45449 19.762% 82.811% #### ( 3, 4 ] 18475 8.033% 90.844% ## ( 4, 6 ] 17475 7.598% 98.442% ## ( 6, 10 ] 3111 1.353% 99.795% ( 10, 15 ] 468 0.203% 99.999% ( 15, 22 ] 54 0.023% 100.022% ( 22, 34 ] 7 0.003% 100.025% ( 34, 51 ] 2 0.001% 100.026% ( 51, 76 ] 2 0.001% 100.027% ( 76, 110 ] 29 0.013% 100.040% ( 110, 170 ] 60 0.026% 100.066% ( 170, 250 ] 37 0.016% 100.082% ( 250, 380 ] 25 0.011% 100.093% ( 380, 580 ] 20 0.009% 100.101% ( 580, 870 ] 16 0.007% 100.108% ( 870, 1300 ] 7 0.003% 100.111% ( 1300, 1900 ] 4 0.002% 100.113% ( 1900, 2900 ] 2 0.001% 100.114% ** Level 2 read latency histogram (micros): Count: 111911 Average: 2.2677 StdDev: 14.20 Min: 1 Median: 1.4423 Max: 3106 Percentiles: P50: 1.44 P75: 1.84 P99: 5.80 P99.9: 13.98 P99.99: 473.63 ------------------------------------------------------ [ 0, 1 ] 24862 22.216% 22.216% #### ( 1, 2 ] 70298 62.816% 85.032% ############# ( 2, 3 ] 9522 8.509% 93.540% ## ( 3, 4 ] 3990 3.565% 97.106% # ( 4, 6 ] 2356 2.105% 99.211% ( 6, 10 ] 717 0.641% 99.852% ( 10, 15 ] 68 0.061% 99.912% ( 15, 22 ] 8 0.007% 99.920% ( 22, 34 ] 6 0.005% 99.925% ( 34, 51 ] 1 0.001% 99.926% ( 51, 76 ] 1 0.001% 99.927% ( 76, 110 ] 10 0.009% 99.936% ( 110, 170 ] 41 0.037% 99.972% ( 170, 250 ] 7 0.006% 99.979% ( 250, 380 ] 10 0.009% 99.987% ( 380, 580 ] 6 0.005% 99.993% ( 580, 870 ] 3 0.003% 99.996% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 239505 Average: 3.3278 StdDev: 30.40 Min: 0 Median: 1.6640 Max: 4856 Percentiles: P50: 1.66 P75: 2.25 P99: 8.82 P99.9: 167.01 P99.99: 565.63 ------------------------------------------------------ [ 0, 1 ] 22500 9.394% 9.394% ## ( 1, 2 ] 146464 61.153% 70.547% ############ ( 2, 3 ] 42043 17.554% 88.101% #### ( 3, 4 ] 13162 5.496% 93.597% # ( 4, 6 ] 10225 4.269% 97.866% # ( 6, 10 ] 3848 1.607% 99.473% ( 10, 15 ] 512 0.214% 99.686% ( 15, 22 ] 110 0.046% 99.732% ( 22, 34 ] 30 0.013% 99.745% ( 34, 51 ] 8 0.003% 99.748% ( 51, 76 ] 10 0.004% 99.752% ( 76, 110 ] 134 0.056% 99.808% ( 110, 170 ] 231 0.096% 99.905% ( 170, 250 ] 102 0.043% 99.947% ( 250, 380 ] 51 0.021% 99.969% ( 380, 580 ] 55 0.023% 99.992% ( 580, 870 ] 34 0.014% 100.006% ( 870, 1300 ] 25 0.010% 100.016% ( 1300, 1900 ] 5 0.002% 100.018% ( 1900, 2900 ] 10 0.004% 100.023% ( 2900, 4400 ] 6 0.003% 100.025% ( 4400, 6600 ] 1 0.000% 100.025% ** Level 4 read latency histogram (micros): Count: 320 Average: 175.9719 StdDev: 627.36 Min: 0 Median: 2.2830 Max: 4132 Percentiles: P50: 2.28 P75: 9.08 P99: 3714.29 P99.9: 4132.00 P99.99: 4132.00 ------------------------------------------------------ [ 0, 1 ] 46 14.375% 14.375% ### ( 1, 2 ] 99 30.938% 45.312% ###### ( 2, 3 ] 53 16.562% 61.875% ### ( 3, 4 ] 12 3.750% 65.625% # ( 4, 6 ] 20 6.250% 71.875% # ( 6, 10 ] 13 4.062% 75.938% # ( 10, 15 ] 22 6.875% 82.812% # ( 15, 22 ] 14 4.375% 87.188% # ( 22, 34 ] 6 1.875% 89.062% ( 34, 51 ] 1 0.312% 89.375% ( 110, 170 ] 1 0.312% 89.688% ( 250, 380 ] 4 1.250% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 4 1.250% 92.812% ( 870, 1300 ] 6 1.875% 94.688% ( 1300, 1900 ] 7 2.188% 96.875% ( 1900, 2900 ] 3 0.938% 97.812% ( 2900, 4400 ] 7 2.188% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 752.1667 StdDev: 1017.25 Min: 78 Median: 315.0000 Max: 4042 Percentiles: P50: 315.00 P75: 821.67 P99: 4042.00 P99.9: 4042.00 P99.99: 4042.00 ------------------------------------------------------ ( 76, 110 ] 10 16.667% 16.667% ### ( 110, 170 ] 13 21.667% 38.333% #### ( 170, 250 ] 4 6.667% 45.000% # ( 250, 380 ] 6 10.000% 55.000% ## ( 380, 580 ] 7 11.667% 66.667% ## ( 580, 870 ] 6 10.000% 76.667% ## ( 870, 1300 ] 2 3.333% 80.000% # ( 1300, 1900 ] 4 6.667% 86.667% # ( 1900, 2900 ] 3 5.000% 91.667% # ( 2900, 4400 ] 5 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 12.3 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 319.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.403 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 316.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.430 H:M:S, 13.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-05:59:03 ... thread 0: (1000000,5000000) ops and (320315.0,327885.6) ops/second in (3.121927,15.249221) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 3.38 GB 182.5 3.0 0.0 3.0 7.7 4.7 0.0 1.6 120.4 307.1 25.63 23.89 78 0.329 3134K 3245 0.0 0.0 L1 3/3 211.52 MB 0.0 1.0 1.0 0.0 1.0 1.0 0.2 1.0 230.8 230.2 4.65 4.52 2 2.326 1090K 2567 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.9 2.0 250.1 249.9 1.51 1.46 2 0.756 383K 210 0.0 0.0 L3 21/0 911.01 MB 0.9 1.9 0.8 1.1 1.9 0.8 0.4 2.5 224.5 224.0 8.63 8.07 6 1.439 1967K 4022 0.0 0.0 L4 174/0 9.52 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 145.8 145.8 1.54 1.14 1 1.541 228K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1272/14 100.80 GB 0.0 6.5 2.2 4.3 11.2 6.9 3.4 2.4 159.7 273.5 41.97 39.09 89 0.472 6804K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.5 2.2 4.3 11.2 6.9 3.4 2.4 159.7 273.5 41.97 39.09 89 0.472 6804K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.5 2.2 4.3 6.5 2.2 0.0 0.0 236.9 236.6 28.28 26.90 22 1.286 6804K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 349.9 13.68 12.19 67 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.4 total, 15.3 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.21 GB write, 743.33 MB/s write, 6.54 GB read, 433.95 MB/s read, 42.0 seconds Interval compaction: 11.21 GB write, 752.65 MB/s write, 6.54 GB read, 439.39 MB/s read, 42.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 15, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1458265 Average: 2.3108 StdDev: 10.20 Min: 1 Median: 1.5521 Max: 3751 Percentiles: P50: 1.55 P75: 1.94 P99: 5.77 P99.9: 9.96 P99.99: 14.81 ------------------------------------------------------ [ 0, 1 ] 208069 14.268% 14.268% ### ( 1, 2 ] 943855 64.725% 78.993% ############# ( 2, 3 ] 190556 13.067% 92.060% ### ( 3, 4 ] 62508 4.286% 96.347% # ( 4, 6 ] 43690 2.996% 99.343% # ( 6, 10 ] 8205 0.563% 99.905% ( 10, 15 ] 1285 0.088% 99.993% ( 15, 22 ] 135 0.009% 100.003% ( 22, 34 ] 9 0.001% 100.003% ( 34, 51 ] 8 0.001% 100.004% ( 51, 76 ] 9 0.001% 100.004% ( 76, 110 ] 67 0.005% 100.009% ( 110, 170 ] 103 0.007% 100.016% ( 170, 250 ] 71 0.005% 100.021% ( 250, 380 ] 58 0.004% 100.025% ( 380, 580 ] 20 0.001% 100.026% ( 580, 870 ] 29 0.002% 100.028% ( 870, 1300 ] 25 0.002% 100.030% ( 1300, 1900 ] 5 0.000% 100.030% ( 1900, 2900 ] 5 0.000% 100.031% ( 2900, 4400 ] 5 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 274476 Average: 2.9037 StdDev: 14.12 Min: 1 Median: 1.7367 Max: 2755 Percentiles: P50: 1.74 P75: 2.50 P99: 7.76 P99.9: 13.67 P99.99: 91.20 ------------------------------------------------------ [ 0, 1 ] 17236 6.280% 6.280% # ( 1, 2 ] 162887 59.345% 65.624% ############ ( 2, 3 ] 51524 18.772% 84.396% #### ( 3, 4 ] 19909 7.253% 91.650% # ( 4, 6 ] 18532 6.752% 98.401% # ( 6, 10 ] 3727 1.358% 99.759% ( 10, 15 ] 527 0.192% 99.951% ( 15, 22 ] 56 0.020% 99.972% ( 22, 34 ] 8 0.003% 99.974% ( 34, 51 ] 2 0.001% 99.975% ( 51, 76 ] 3 0.001% 99.976% ( 76, 110 ] 84 0.031% 100.007% ( 110, 170 ] 99 0.036% 100.043% ( 170, 250 ] 52 0.019% 100.062% ( 250, 380 ] 35 0.013% 100.075% ( 380, 580 ] 27 0.010% 100.085% ( 580, 870 ] 16 0.006% 100.090% ( 870, 1300 ] 8 0.003% 100.093% ( 1300, 1900 ] 4 0.001% 100.095% ( 1900, 2900 ] 2 0.001% 100.095% ** Level 2 read latency histogram (micros): Count: 111911 Average: 2.2677 StdDev: 14.20 Min: 1 Median: 1.4423 Max: 3106 Percentiles: P50: 1.44 P75: 1.84 P99: 5.80 P99.9: 13.98 P99.99: 473.63 ------------------------------------------------------ [ 0, 1 ] 24862 22.216% 22.216% #### ( 1, 2 ] 70298 62.816% 85.032% ############# ( 2, 3 ] 9522 8.509% 93.540% ## ( 3, 4 ] 3990 3.565% 97.106% # ( 4, 6 ] 2356 2.105% 99.211% ( 6, 10 ] 717 0.641% 99.852% ( 10, 15 ] 68 0.061% 99.912% ( 15, 22 ] 8 0.007% 99.920% ( 22, 34 ] 6 0.005% 99.925% ( 34, 51 ] 1 0.001% 99.926% ( 51, 76 ] 1 0.001% 99.927% ( 76, 110 ] 10 0.009% 99.936% ( 110, 170 ] 41 0.037% 99.972% ( 170, 250 ] 7 0.006% 99.979% ( 250, 380 ] 10 0.009% 99.987% ( 380, 580 ] 6 0.005% 99.993% ( 580, 870 ] 3 0.003% 99.996% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 239505 Average: 3.3278 StdDev: 30.40 Min: 0 Median: 1.6640 Max: 4856 Percentiles: P50: 1.66 P75: 2.25 P99: 8.82 P99.9: 167.01 P99.99: 565.63 ------------------------------------------------------ [ 0, 1 ] 22500 9.394% 9.394% ## ( 1, 2 ] 146464 61.153% 70.547% ############ ( 2, 3 ] 42043 17.554% 88.101% #### ( 3, 4 ] 13162 5.496% 93.597% # ( 4, 6 ] 10225 4.269% 97.866% # ( 6, 10 ] 3848 1.607% 99.473% ( 10, 15 ] 512 0.214% 99.686% ( 15, 22 ] 110 0.046% 99.732% ( 22, 34 ] 30 0.013% 99.745% ( 34, 51 ] 8 0.003% 99.748% ( 51, 76 ] 10 0.004% 99.752% ( 76, 110 ] 134 0.056% 99.808% ( 110, 170 ] 231 0.096% 99.905% ( 170, 250 ] 102 0.043% 99.947% ( 250, 380 ] 51 0.021% 99.969% ( 380, 580 ] 55 0.023% 99.992% ( 580, 870 ] 34 0.014% 100.006% ( 870, 1300 ] 25 0.010% 100.016% ( 1300, 1900 ] 5 0.002% 100.018% ( 1900, 2900 ] 10 0.004% 100.023% ( 2900, 4400 ] 6 0.003% 100.025% ( 4400, 6600 ] 1 0.000% 100.025% ** Level 4 read latency histogram (micros): Count: 320 Average: 175.9719 StdDev: 627.36 Min: 0 Median: 2.2830 Max: 4132 Percentiles: P50: 2.28 P75: 9.08 P99: 3714.29 P99.9: 4132.00 P99.99: 4132.00 ------------------------------------------------------ [ 0, 1 ] 46 14.375% 14.375% ### ( 1, 2 ] 99 30.938% 45.312% ###### ( 2, 3 ] 53 16.562% 61.875% ### ( 3, 4 ] 12 3.750% 65.625% # ( 4, 6 ] 20 6.250% 71.875% # ( 6, 10 ] 13 4.062% 75.938% # ( 10, 15 ] 22 6.875% 82.812% # ( 15, 22 ] 14 4.375% 87.188% # ( 22, 34 ] 6 1.875% 89.062% ( 34, 51 ] 1 0.312% 89.375% ( 110, 170 ] 1 0.312% 89.688% ( 250, 380 ] 4 1.250% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 4 1.250% 92.812% ( 870, 1300 ] 6 1.875% 94.688% ( 1300, 1900 ] 7 2.188% 96.875% ( 1900, 2900 ] 3 0.938% 97.812% ( 2900, 4400 ] 7 2.188% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 752.1667 StdDev: 1017.25 Min: 78 Median: 315.0000 Max: 4042 Percentiles: P50: 315.00 P75: 821.67 P99: 4042.00 P99.9: 4042.00 P99.99: 4042.00 ------------------------------------------------------ ( 76, 110 ] 10 16.667% 16.667% ### ( 110, 170 ] 13 21.667% 38.333% #### ( 170, 250 ] 4 6.667% 45.000% # ( 250, 380 ] 6 10.000% 55.000% ## ( 380, 580 ] 7 11.667% 66.667% ## ( 580, 870 ] 6 10.000% 76.667% ## ( 870, 1300 ] 2 3.333% 80.000% # ( 1300, 1900 ] 4 6.667% 86.667% # ( 1900, 2900 ] 3 5.000% 91.667% # ( 2900, 4400 ] 5 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 15.4 total, 3.1 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 318.68 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.823 H:M:S, 11.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 315.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.419 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-05:59:06 ... thread 0: (1000000,6000000) ops and (322986.8,327058.8) ops/second in (3.096102,18.345323) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 3.01 GB 44.1 3.5 0.0 3.5 9.2 5.7 0.0 1.6 118.1 308.7 30.39 28.28 94 0.323 3646K 3713 0.0 0.0 L1 13/13 1.55 GB 0.0 2.6 2.4 0.2 2.6 2.4 0.2 1.1 228.2 227.1 11.70 11.29 3 3.899 2711K 13K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.9 2.0 250.1 249.9 1.51 1.46 2 0.756 383K 210 0.0 0.0 L3 21/0 911.01 MB 0.9 1.9 0.8 1.1 1.9 0.8 0.4 2.5 224.5 224.0 8.63 8.07 6 1.439 1967K 4022 0.0 0.0 L4 174/0 9.52 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 145.8 145.8 1.54 1.14 1 1.541 228K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1283/28 101.77 GB 0.0 8.6 3.6 5.0 14.2 9.2 3.4 2.5 163.7 271.0 53.78 50.25 106 0.507 8936K 21K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.6 3.6 5.0 14.2 9.2 3.4 2.5 163.7 271.0 53.78 50.25 106 0.507 8936K 21K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.6 3.6 5.0 8.6 3.5 0.0 0.0 236.6 236.0 37.20 35.51 25 1.488 8936K 21K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 349.7 16.57 14.74 81 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.5 total, 18.3 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.23 GB write, 786.22 MB/s write, 8.59 GB read, 474.77 MB/s read, 53.8 seconds Interval compaction: 14.23 GB write, 794.41 MB/s write, 8.59 GB read, 479.71 MB/s read, 53.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 19, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1716006 Average: 2.3005 StdDev: 11.02 Min: 1 Median: 1.5345 Max: 3751 Percentiles: P50: 1.53 P75: 1.92 P99: 5.75 P99.9: 10.43 P99.99: 23.53 ------------------------------------------------------ [ 0, 1 ] 262335 15.288% 15.288% ### ( 1, 2 ] 1114355 64.939% 80.226% ############# ( 2, 3 ] 211976 12.353% 92.579% ## ( 3, 4 ] 69495 4.050% 96.629% # ( 4, 6 ] 46575 2.714% 99.343% # ( 6, 10 ] 9424 0.549% 99.892% ( 10, 15 ] 1525 0.089% 99.981% ( 15, 22 ] 148 0.009% 99.990% ( 22, 34 ] 11 0.001% 99.991% ( 34, 51 ] 8 0.000% 99.991% ( 51, 76 ] 19 0.001% 99.992% ( 76, 110 ] 140 0.008% 100.000% ( 110, 170 ] 168 0.010% 100.010% ( 170, 250 ] 106 0.006% 100.016% ( 250, 380 ] 81 0.005% 100.021% ( 380, 580 ] 34 0.002% 100.023% ( 580, 870 ] 39 0.002% 100.025% ( 870, 1300 ] 28 0.002% 100.027% ( 1300, 1900 ] 9 0.001% 100.027% ( 1900, 2900 ] 5 0.000% 100.028% ( 2900, 4400 ] 8 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 329583 Average: 2.9476 StdDev: 16.71 Min: 1 Median: 1.6901 Max: 2755 Percentiles: P50: 1.69 P75: 2.36 P99: 7.92 P99.9: 18.78 P99.99: 141.99 ------------------------------------------------------ [ 0, 1 ] 27268 8.273% 8.273% ## ( 1, 2 ] 199279 60.464% 68.737% ############ ( 2, 3 ] 56749 17.218% 85.956% ### ( 3, 4 ] 21421 6.499% 92.455% # ( 4, 6 ] 19397 5.885% 98.341% # ( 6, 10 ] 4516 1.370% 99.711% ( 10, 15 ] 591 0.179% 99.890% ( 15, 22 ] 60 0.018% 99.908% ( 22, 34 ] 8 0.002% 99.911% ( 34, 51 ] 2 0.001% 99.911% ( 51, 76 ] 6 0.002% 99.913% ( 76, 110 ] 172 0.052% 99.965% ( 110, 170 ] 152 0.046% 100.012% ( 170, 250 ] 69 0.021% 100.032% ( 250, 380 ] 55 0.017% 100.049% ( 380, 580 ] 45 0.014% 100.063% ( 580, 870 ] 25 0.008% 100.070% ( 870, 1300 ] 20 0.006% 100.076% ( 1300, 1900 ] 7 0.002% 100.079% ( 1900, 2900 ] 3 0.001% 100.079% ** Level 2 read latency histogram (micros): Count: 111911 Average: 2.2677 StdDev: 14.20 Min: 1 Median: 1.4423 Max: 3106 Percentiles: P50: 1.44 P75: 1.84 P99: 5.80 P99.9: 13.98 P99.99: 473.63 ------------------------------------------------------ [ 0, 1 ] 24862 22.216% 22.216% #### ( 1, 2 ] 70298 62.816% 85.032% ############# ( 2, 3 ] 9522 8.509% 93.540% ## ( 3, 4 ] 3990 3.565% 97.106% # ( 4, 6 ] 2356 2.105% 99.211% ( 6, 10 ] 717 0.641% 99.852% ( 10, 15 ] 68 0.061% 99.912% ( 15, 22 ] 8 0.007% 99.920% ( 22, 34 ] 6 0.005% 99.925% ( 34, 51 ] 1 0.001% 99.926% ( 51, 76 ] 1 0.001% 99.927% ( 76, 110 ] 10 0.009% 99.936% ( 110, 170 ] 41 0.037% 99.972% ( 170, 250 ] 7 0.006% 99.979% ( 250, 380 ] 10 0.009% 99.987% ( 380, 580 ] 6 0.005% 99.993% ( 580, 870 ] 3 0.003% 99.996% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 239505 Average: 3.3278 StdDev: 30.40 Min: 0 Median: 1.6640 Max: 4856 Percentiles: P50: 1.66 P75: 2.25 P99: 8.82 P99.9: 167.01 P99.99: 565.63 ------------------------------------------------------ [ 0, 1 ] 22500 9.394% 9.394% ## ( 1, 2 ] 146464 61.153% 70.547% ############ ( 2, 3 ] 42043 17.554% 88.101% #### ( 3, 4 ] 13162 5.496% 93.597% # ( 4, 6 ] 10225 4.269% 97.866% # ( 6, 10 ] 3848 1.607% 99.473% ( 10, 15 ] 512 0.214% 99.686% ( 15, 22 ] 110 0.046% 99.732% ( 22, 34 ] 30 0.013% 99.745% ( 34, 51 ] 8 0.003% 99.748% ( 51, 76 ] 10 0.004% 99.752% ( 76, 110 ] 134 0.056% 99.808% ( 110, 170 ] 231 0.096% 99.905% ( 170, 250 ] 102 0.043% 99.947% ( 250, 380 ] 51 0.021% 99.969% ( 380, 580 ] 55 0.023% 99.992% ( 580, 870 ] 34 0.014% 100.006% ( 870, 1300 ] 25 0.010% 100.016% ( 1300, 1900 ] 5 0.002% 100.018% ( 1900, 2900 ] 10 0.004% 100.023% ( 2900, 4400 ] 6 0.003% 100.025% ( 4400, 6600 ] 1 0.000% 100.025% ** Level 4 read latency histogram (micros): Count: 320 Average: 175.9719 StdDev: 627.36 Min: 0 Median: 2.2830 Max: 4132 Percentiles: P50: 2.28 P75: 9.08 P99: 3714.29 P99.9: 4132.00 P99.99: 4132.00 ------------------------------------------------------ [ 0, 1 ] 46 14.375% 14.375% ### ( 1, 2 ] 99 30.938% 45.312% ###### ( 2, 3 ] 53 16.562% 61.875% ### ( 3, 4 ] 12 3.750% 65.625% # ( 4, 6 ] 20 6.250% 71.875% # ( 6, 10 ] 13 4.062% 75.938% # ( 10, 15 ] 22 6.875% 82.812% # ( 15, 22 ] 14 4.375% 87.188% # ( 22, 34 ] 6 1.875% 89.062% ( 34, 51 ] 1 0.312% 89.375% ( 110, 170 ] 1 0.312% 89.688% ( 250, 380 ] 4 1.250% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 4 1.250% 92.812% ( 870, 1300 ] 6 1.875% 94.688% ( 1300, 1900 ] 7 2.188% 96.875% ( 1900, 2900 ] 3 0.938% 97.812% ( 2900, 4400 ] 7 2.188% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 752.1667 StdDev: 1017.25 Min: 78 Median: 315.0000 Max: 4042 Percentiles: P50: 315.00 P75: 821.67 P99: 4042.00 P99.9: 4042.00 P99.99: 4042.00 ------------------------------------------------------ ( 76, 110 ] 10 16.667% 16.667% ### ( 110, 170 ] 13 21.667% 38.333% #### ( 170, 250 ] 4 6.667% 45.000% # ( 250, 380 ] 6 10.000% 55.000% ## ( 380, 580 ] 7 11.667% 66.667% ## ( 580, 870 ] 6 10.000% 76.667% ## ( 870, 1300 ] 2 3.333% 80.000% # ( 1300, 1900 ] 4 6.667% 86.667% # ( 1900, 2900 ] 3 5.000% 91.667% # ( 2900, 4400 ] 5 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 18.5 total, 3.1 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 318.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.290 H:M:S, 12.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.468 H:M:S, 15.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-05:59:12 ... thread 0: (1000000,7000000) ops and (179940.7,292853.8) ops/second in (5.557386,23.902709) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 21/16 4.06 GB 75.5 4.8 0.0 4.8 11.5 6.7 0.0 1.7 128.0 306.6 38.40 35.87 116 0.331 4989K 5025 0.0 0.0 L1 13/13 1.55 GB 0.0 2.6 2.4 0.2 2.6 2.4 0.2 1.1 228.2 227.1 11.70 11.29 3 3.899 2711K 13K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.9 2.0 250.1 249.9 1.51 1.46 2 0.756 383K 210 0.0 0.0 L3 21/0 911.01 MB 0.9 1.9 0.8 1.1 1.9 0.8 0.4 2.5 224.5 224.0 8.63 8.07 6 1.439 1967K 4022 0.0 0.0 L4 174/0 9.52 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 145.8 145.8 1.54 1.14 1 1.541 228K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1285/29 102.82 GB 0.0 9.9 3.6 6.3 16.6 10.3 3.4 2.5 163.9 274.6 61.78 57.83 128 0.483 10M 22K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.9 3.6 6.3 16.6 10.3 3.4 2.5 163.9 274.6 61.78 57.83 128 0.483 10M 22K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.9 3.6 6.3 9.9 3.5 0.0 0.0 240.3 239.8 42.12 40.36 30 1.404 10M 22K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.7 6.7 0.0 0.0 0.0 349.2 19.66 17.48 98 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.1 total, 23.9 interval Flush(GB): cumulative 6.706, interval 6.706 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.57 GB write, 704.18 MB/s write, 9.89 GB read, 420.17 MB/s read, 61.8 seconds Interval compaction: 16.57 GB write, 709.81 MB/s write, 9.89 GB read, 423.53 MB/s read, 61.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 19, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2265718 Average: 2.2794 StdDev: 11.67 Min: 1 Median: 1.5172 Max: 6655 Percentiles: P50: 1.52 P75: 1.90 P99: 5.70 P99.9: 10.68 P99.99: 90.77 ------------------------------------------------------ [ 0, 1 ] 361849 15.971% 15.971% ### ( 1, 2 ] 1490676 65.793% 81.763% ############# ( 2, 3 ] 257932 11.384% 93.147% ## ( 3, 4 ] 86817 3.832% 96.979% # ( 4, 6 ] 53765 2.373% 99.352% ( 6, 10 ] 12150 0.536% 99.888% ( 10, 15 ] 1963 0.087% 99.975% ( 15, 22 ] 193 0.009% 99.984% ( 22, 34 ] 19 0.001% 99.984% ( 34, 51 ] 11 0.000% 99.985% ( 51, 76 ] 22 0.001% 99.986% ( 76, 110 ] 222 0.010% 99.996% ( 110, 170 ] 273 0.012% 100.008% ( 170, 250 ] 158 0.007% 100.015% ( 250, 380 ] 116 0.005% 100.020% ( 380, 580 ] 58 0.003% 100.022% ( 580, 870 ] 55 0.002% 100.025% ( 870, 1300 ] 38 0.002% 100.026% ( 1300, 1900 ] 12 0.001% 100.027% ( 1900, 2900 ] 6 0.000% 100.027% ( 2900, 4400 ] 9 0.000% 100.028% ( 6600, 9900 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 448435 Average: 2.8348 StdDev: 15.49 Min: 1 Median: 1.6308 Max: 2755 Percentiles: P50: 1.63 P75: 2.13 P99: 7.89 P99.9: 89.06 P99.99: 174.98 ------------------------------------------------------ [ 0, 1 ] 47278 10.543% 10.543% ## ( 1, 2 ] 280521 62.556% 73.098% ############# ( 2, 3 ] 67026 14.947% 88.045% ### ( 3, 4 ] 24987 5.572% 93.617% # ( 4, 6 ] 21328 4.756% 98.373% # ( 6, 10 ] 5963 1.330% 99.703% ( 10, 15 ] 695 0.155% 99.858% ( 15, 22 ] 77 0.017% 99.875% ( 22, 34 ] 9 0.002% 99.877% ( 34, 51 ] 2 0.000% 99.878% ( 51, 76 ] 8 0.002% 99.879% ( 76, 110 ] 241 0.054% 99.933% ( 110, 170 ] 248 0.055% 99.988% ( 170, 250 ] 115 0.026% 100.014% ( 250, 380 ] 75 0.017% 100.031% ( 380, 580 ] 56 0.012% 100.043% ( 580, 870 ] 37 0.008% 100.052% ( 870, 1300 ] 21 0.005% 100.056% ( 1300, 1900 ] 7 0.002% 100.058% ( 1900, 2900 ] 3 0.001% 100.058% ** Level 2 read latency histogram (micros): Count: 111911 Average: 2.2677 StdDev: 14.20 Min: 1 Median: 1.4423 Max: 3106 Percentiles: P50: 1.44 P75: 1.84 P99: 5.80 P99.9: 13.98 P99.99: 473.63 ------------------------------------------------------ [ 0, 1 ] 24862 22.216% 22.216% #### ( 1, 2 ] 70298 62.816% 85.032% ############# ( 2, 3 ] 9522 8.509% 93.540% ## ( 3, 4 ] 3990 3.565% 97.106% # ( 4, 6 ] 2356 2.105% 99.211% ( 6, 10 ] 717 0.641% 99.852% ( 10, 15 ] 68 0.061% 99.912% ( 15, 22 ] 8 0.007% 99.920% ( 22, 34 ] 6 0.005% 99.925% ( 34, 51 ] 1 0.001% 99.926% ( 51, 76 ] 1 0.001% 99.927% ( 76, 110 ] 10 0.009% 99.936% ( 110, 170 ] 41 0.037% 99.972% ( 170, 250 ] 7 0.006% 99.979% ( 250, 380 ] 10 0.009% 99.987% ( 380, 580 ] 6 0.005% 99.993% ( 580, 870 ] 3 0.003% 99.996% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 239505 Average: 3.3278 StdDev: 30.40 Min: 0 Median: 1.6640 Max: 4856 Percentiles: P50: 1.66 P75: 2.25 P99: 8.82 P99.9: 167.01 P99.99: 565.63 ------------------------------------------------------ [ 0, 1 ] 22500 9.394% 9.394% ## ( 1, 2 ] 146464 61.153% 70.547% ############ ( 2, 3 ] 42043 17.554% 88.101% #### ( 3, 4 ] 13162 5.496% 93.597% # ( 4, 6 ] 10225 4.269% 97.866% # ( 6, 10 ] 3848 1.607% 99.473% ( 10, 15 ] 512 0.214% 99.686% ( 15, 22 ] 110 0.046% 99.732% ( 22, 34 ] 30 0.013% 99.745% ( 34, 51 ] 8 0.003% 99.748% ( 51, 76 ] 10 0.004% 99.752% ( 76, 110 ] 134 0.056% 99.808% ( 110, 170 ] 231 0.096% 99.905% ( 170, 250 ] 102 0.043% 99.947% ( 250, 380 ] 51 0.021% 99.969% ( 380, 580 ] 55 0.023% 99.992% ( 580, 870 ] 34 0.014% 100.006% ( 870, 1300 ] 25 0.010% 100.016% ( 1300, 1900 ] 5 0.002% 100.018% ( 1900, 2900 ] 10 0.004% 100.023% ( 2900, 4400 ] 6 0.003% 100.025% ( 4400, 6600 ] 1 0.000% 100.025% ** Level 4 read latency histogram (micros): Count: 320 Average: 175.9719 StdDev: 627.36 Min: 0 Median: 2.2830 Max: 4132 Percentiles: P50: 2.28 P75: 9.08 P99: 3714.29 P99.9: 4132.00 P99.99: 4132.00 ------------------------------------------------------ [ 0, 1 ] 46 14.375% 14.375% ### ( 1, 2 ] 99 30.938% 45.312% ###### ( 2, 3 ] 53 16.562% 61.875% ### ( 3, 4 ] 12 3.750% 65.625% # ( 4, 6 ] 20 6.250% 71.875% # ( 6, 10 ] 13 4.062% 75.938% # ( 10, 15 ] 22 6.875% 82.812% # ( 15, 22 ] 14 4.375% 87.188% # ( 22, 34 ] 6 1.875% 89.062% ( 34, 51 ] 1 0.312% 89.375% ( 110, 170 ] 1 0.312% 89.688% ( 250, 380 ] 4 1.250% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 4 1.250% 92.812% ( 870, 1300 ] 6 1.875% 94.688% ( 1300, 1900 ] 7 2.188% 96.875% ( 1900, 2900 ] 3 0.938% 97.812% ( 2900, 4400 ] 7 2.188% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 752.1667 StdDev: 1017.25 Min: 78 Median: 315.0000 Max: 4042 Percentiles: P50: 315.00 P75: 821.67 P99: 4042.00 P99.9: 4042.00 P99.99: 4042.00 ------------------------------------------------------ ( 76, 110 ] 10 16.667% 16.667% ### ( 110, 170 ] 13 21.667% 38.333% #### ( 170, 250 ] 4 6.667% 45.000% # ( 250, 380 ] 6 10.000% 55.000% ## ( 380, 580 ] 7 11.667% 66.667% ## ( 580, 870 ] 6 10.000% 76.667% ## ( 870, 1300 ] 2 3.333% 80.000% # ( 1300, 1900 ] 4 6.667% 86.667% # ( 1900, 2900 ] 3 5.000% 91.667% # ( 2900, 4400 ] 5 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 24.1 total, 5.6 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 285.92 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.153 H:M:S, 21.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 177.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.863 H:M:S, 51.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/11/19-05:59:27 ... thread 0: (1000000,8000000) ops and (66719.7,205704.3) ops/second in (14.988070,38.890779) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/11 2.64 GB 18.9 6.3 0.0 6.3 13.9 7.6 0.0 1.8 137.2 300.9 47.28 43.96 132 0.358 6587K 10K 0.0 0.0 L1 21/21 1.97 GB 0.0 6.4 4.7 1.8 6.4 4.6 0.2 1.4 224.1 221.5 29.38 27.93 4 7.344 6685K 75K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.7 2.0 250.1 249.9 1.51 1.46 2 0.756 383K 210 0.0 0.0 L3 20/0 945.84 MB 0.9 4.5 2.6 1.9 4.4 2.5 0.4 1.7 165.3 164.4 27.69 20.25 17 1.629 4648K 24K 0.0 0.0 L4 179/0 9.60 GB 1.0 2.0 1.9 0.1 2.0 1.9 0.8 1.0 159.2 158.9 12.98 9.58 25 0.519 2063K 2791 0.0 0.0 L5 1076/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1309/32 103.59 GB 0.0 19.6 9.3 10.3 27.1 16.8 6.8 3.6 169.1 233.3 118.83 103.18 180 0.660 20M 113K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.6 9.3 10.3 27.1 16.8 6.8 3.6 169.1 233.3 118.83 103.18 180 0.660 20M 113K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.6 9.3 10.3 19.5 9.2 0.0 0.0 208.8 207.6 96.24 83.42 69 1.395 20M 113K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 343.0 22.59 19.75 111 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.1 total, 38.9 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.08 GB write, 709.42 MB/s write, 19.62 GB read, 514.11 MB/s read, 118.8 seconds Interval compaction: 27.08 GB write, 712.91 MB/s write, 19.62 GB read, 516.63 MB/s read, 118.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 29, pending-compaction-bytes-stops: 0, total-delays: 46, total-stops: 25, interval: 71 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3181173 Average: 2.6106 StdDev: 22.85 Min: 1 Median: 1.5175 Max: 6770 Percentiles: P50: 1.52 P75: 1.90 P99: 5.99 P99.9: 100.93 P99.99: 280.46 ------------------------------------------------------ [ 0, 1 ] 528101 16.601% 16.601% ### ( 1, 2 ] 2053293 64.545% 81.146% ############# ( 2, 3 ] 354944 11.158% 92.304% ## ( 3, 4 ] 125657 3.950% 96.254% # ( 4, 6 ] 87911 2.763% 99.017% # ( 6, 10 ] 23054 0.725% 99.742% ( 10, 15 ] 3327 0.105% 99.846% ( 15, 22 ] 370 0.012% 99.858% ( 22, 34 ] 35 0.001% 99.859% ( 34, 51 ] 16 0.001% 99.860% ( 51, 76 ] 45 0.001% 99.861% ( 76, 110 ] 1691 0.053% 99.914% ( 110, 170 ] 1859 0.058% 99.973% ( 170, 250 ] 454 0.014% 99.987% ( 250, 380 ] 422 0.013% 100.000% ( 380, 580 ] 310 0.010% 100.010% ( 580, 870 ] 198 0.006% 100.016% ( 870, 1300 ] 118 0.004% 100.020% ( 1300, 1900 ] 42 0.001% 100.021% ( 1900, 2900 ] 30 0.001% 100.022% ( 2900, 4400 ] 47 0.001% 100.024% ( 4400, 6600 ] 9 0.000% 100.024% ( 6600, 9900 ] 3 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1149693 Average: 4.3357 StdDev: 61.51 Min: 1 Median: 1.6997 Max: 9071 Percentiles: P50: 1.70 P75: 2.50 P99: 8.84 P99.9: 100.58 P99.99: 230.01 ------------------------------------------------------ [ 0, 1 ] 122075 10.618% 10.618% ## ( 1, 2 ] 647070 56.282% 66.900% ########### ( 2, 3 ] 187152 16.278% 83.178% ### ( 3, 4 ] 84923 7.387% 90.565% # ( 4, 6 ] 82088 7.140% 97.705% # ( 6, 10 ] 20940 1.821% 99.526% ( 10, 15 ] 3238 0.282% 99.808% ( 15, 22 ] 381 0.033% 99.841% ( 22, 34 ] 28 0.002% 99.844% ( 34, 51 ] 15 0.001% 99.845% ( 51, 76 ] 68 0.006% 99.851% ( 76, 110 ] 782 0.068% 99.919% ( 110, 170 ] 629 0.055% 99.974% ( 170, 250 ] 252 0.022% 99.995% ( 250, 380 ] 262 0.023% 100.018% ( 380, 580 ] 336 0.029% 100.047% ( 580, 870 ] 322 0.028% 100.075% ( 870, 1300 ] 221 0.019% 100.095% ( 1300, 1900 ] 109 0.009% 100.104% ( 1900, 2900 ] 103 0.009% 100.113% ( 2900, 4400 ] 145 0.013% 100.126% ( 4400, 6600 ] 33 0.003% 100.129% ( 6600, 9900 ] 4 0.000% 100.129% ** Level 2 read latency histogram (micros): Count: 111911 Average: 2.2677 StdDev: 14.20 Min: 1 Median: 1.4423 Max: 3106 Percentiles: P50: 1.44 P75: 1.84 P99: 5.80 P99.9: 13.98 P99.99: 473.63 ------------------------------------------------------ [ 0, 1 ] 24862 22.216% 22.216% #### ( 1, 2 ] 70298 62.816% 85.032% ############# ( 2, 3 ] 9522 8.509% 93.540% ## ( 3, 4 ] 3990 3.565% 97.106% # ( 4, 6 ] 2356 2.105% 99.211% ( 6, 10 ] 717 0.641% 99.852% ( 10, 15 ] 68 0.061% 99.912% ( 15, 22 ] 8 0.007% 99.920% ( 22, 34 ] 6 0.005% 99.925% ( 34, 51 ] 1 0.001% 99.926% ( 51, 76 ] 1 0.001% 99.927% ( 76, 110 ] 10 0.009% 99.936% ( 110, 170 ] 41 0.037% 99.972% ( 170, 250 ] 7 0.006% 99.979% ( 250, 380 ] 10 0.009% 99.987% ( 380, 580 ] 6 0.005% 99.993% ( 580, 870 ] 3 0.003% 99.996% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 884006 Average: 3.9212 StdDev: 43.45 Min: 0 Median: 1.9209 Max: 6735 Percentiles: P50: 1.92 P75: 2.94 P99: 8.65 P99.9: 14.02 P99.99: 18.71 ------------------------------------------------------ [ 0, 1 ] 30934 3.499% 3.499% # ( 1, 2 ] 446355 50.492% 53.992% ########## ( 2, 3 ] 197590 22.352% 76.343% #### ( 3, 4 ] 94973 10.743% 87.087% ## ( 4, 6 ] 94433 10.682% 97.769% ## ( 6, 10 ] 16401 1.855% 99.624% ( 10, 15 ] 3031 0.343% 99.967% ( 15, 22 ] 379 0.043% 100.010% ( 22, 34 ] 40 0.005% 100.015% ( 34, 51 ] 20 0.002% 100.017% ( 51, 76 ] 67 0.008% 100.025% ( 76, 110 ] 153 0.017% 100.042% ( 110, 170 ] 295 0.033% 100.075% ( 170, 250 ] 235 0.027% 100.102% ( 250, 380 ] 243 0.027% 100.129% ( 380, 580 ] 184 0.021% 100.150% ( 580, 870 ] 129 0.015% 100.165% ( 870, 1300 ] 106 0.012% 100.177% ( 1300, 1900 ] 41 0.005% 100.181% ( 1900, 2900 ] 43 0.005% 100.186% ( 2900, 4400 ] 65 0.007% 100.194% ( 4400, 6600 ] 5 0.001% 100.194% ( 6600, 9900 ] 1 0.000% 100.194% ** Level 4 read latency histogram (micros): Count: 24424 Average: 58.5364 StdDev: 318.68 Min: 0 Median: 2.1208 Max: 10308 Percentiles: P50: 2.12 P75: 3.43 P99: 1309.03 P99.9: 4182.52 P99.99: 6126.67 ------------------------------------------------------ [ 0, 1 ] 522 2.137% 2.137% ( 1, 2 ] 11044 45.218% 47.355% ######### ( 2, 3 ] 5346 21.888% 69.243% #### ( 3, 4 ] 3271 13.393% 82.636% ### ( 4, 6 ] 1875 7.677% 90.313% ## ( 6, 10 ] 570 2.334% 92.647% ( 10, 15 ] 114 0.467% 93.113% ( 15, 22 ] 25 0.102% 93.216% ( 22, 34 ] 24 0.098% 93.314% ( 34, 51 ] 3 0.012% 93.326% ( 51, 76 ] 3 0.012% 93.339% ( 76, 110 ] 45 0.184% 93.523% ( 110, 170 ] 100 0.409% 93.932% ( 170, 250 ] 150 0.614% 94.546% ( 250, 380 ] 224 0.917% 95.463% ( 380, 580 ] 334 1.368% 96.831% ( 580, 870 ] 320 1.310% 98.141% ( 870, 1300 ] 208 0.852% 98.993% ( 1300, 1900 ] 117 0.479% 99.472% ( 1900, 2900 ] 49 0.201% 99.672% ( 2900, 4400 ] 65 0.266% 99.939% ( 4400, 6600 ] 16 0.066% 100.004% ( 6600, 9900 ] 2 0.008% 100.012% ( 9900, 14000 ] 1 0.004% 100.016% ** Level 5 read latency histogram (micros): Count: 160 Average: 922.3625 StdDev: 1089.96 Min: 77 Median: 442.5000 Max: 5219 Percentiles: P50: 442.50 P75: 1354.55 P99: 4840.00 P99.9: 5219.00 P99.99: 5219.00 ------------------------------------------------------ ( 76, 110 ] 18 11.250% 11.250% ## ( 110, 170 ] 27 16.875% 28.125% ### ( 170, 250 ] 13 8.125% 36.250% ## ( 250, 380 ] 17 10.625% 46.875% ## ( 380, 580 ] 16 10.000% 56.875% ## ( 580, 870 ] 16 10.000% 66.875% ## ( 870, 1300 ] 12 7.500% 74.375% ## ( 1300, 1900 ] 11 6.875% 81.250% # ( 1900, 2900 ] 17 10.625% 91.875% ## ( 2900, 4400 ] 11 6.875% 98.750% # ( 4400, 6600 ] 2 1.250% 100.000% ** DB Stats ** Uptime(secs): 39.1 total, 15.0 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 201.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.202 H:M:S, 44.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 65.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:12.049 H:M:S, 80.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-05:59:30 ... thread 0: (1000000,9000000) ops and (325911.9,214494.6) ops/second in (3.068314,41.959093) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/11 3.62 GB 113.3 7.4 0.0 7.4 16.0 8.5 0.0 1.9 139.7 300.0 54.55 50.82 150 0.364 7738K 11K 0.0 0.0 L1 21/21 1.97 GB 0.0 6.4 4.7 1.8 6.4 4.6 0.2 1.4 224.1 221.5 29.38 27.93 4 7.344 6685K 75K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.7 2.0 250.1 249.9 1.51 1.46 2 0.756 383K 210 0.0 0.0 L3 20/0 945.84 MB 0.9 4.5 2.6 1.9 4.4 2.5 0.4 1.7 165.3 164.4 27.69 20.25 17 1.629 4648K 24K 0.0 0.0 L4 179/0 9.60 GB 1.0 2.0 1.9 0.1 2.0 1.9 0.8 1.0 159.2 158.9 12.98 9.58 25 0.519 2063K 2791 0.0 0.0 L5 1076/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1311/32 104.57 GB 0.0 20.7 9.3 11.4 29.2 17.8 6.8 3.4 168.3 236.9 126.10 110.04 198 0.637 21M 114K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.7 9.3 11.4 29.2 17.8 6.8 3.4 168.3 236.9 126.10 110.04 198 0.637 21M 114K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.7 9.3 11.4 20.6 9.2 0.0 0.0 211.0 209.8 100.60 87.69 73 1.378 21M 114K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 343.4 25.50 22.35 125 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 42.2 total, 42.0 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.17 GB write, 708.56 MB/s write, 20.73 GB read, 503.58 MB/s read, 126.1 seconds Interval compaction: 29.17 GB write, 711.79 MB/s write, 20.73 GB read, 505.88 MB/s read, 126.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 29, pending-compaction-bytes-stops: 0, total-delays: 46, total-stops: 28, interval: 74 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3535822 Average: 2.5756 StdDev: 21.94 Min: 1 Median: 1.5200 Max: 6770 Percentiles: P50: 1.52 P75: 1.91 P99: 5.98 P99.9: 92.11 P99.99: 244.32 ------------------------------------------------------ [ 0, 1 ] 575941 16.289% 16.289% ### ( 1, 2 ] 2292205 64.828% 81.117% ############# ( 2, 3 ] 398984 11.284% 92.401% ## ( 3, 4 ] 138480 3.916% 96.317% # ( 4, 6 ] 95960 2.714% 99.031% # ( 6, 10 ] 25699 0.727% 99.758% ( 10, 15 ] 3721 0.105% 99.863% ( 15, 22 ] 392 0.011% 99.874% ( 22, 34 ] 38 0.001% 99.876% ( 34, 51 ] 16 0.000% 99.876% ( 51, 76 ] 49 0.001% 99.877% ( 76, 110 ] 1691 0.048% 99.925% ( 110, 170 ] 1866 0.053% 99.978% ( 170, 250 ] 459 0.013% 99.991% ( 250, 380 ] 428 0.012% 100.003% ( 380, 580 ] 314 0.009% 100.012% ( 580, 870 ] 202 0.006% 100.018% ( 870, 1300 ] 123 0.003% 100.021% ( 1300, 1900 ] 43 0.001% 100.022% ( 1900, 2900 ] 32 0.001% 100.023% ( 2900, 4400 ] 49 0.001% 100.025% ( 4400, 6600 ] 9 0.000% 100.025% ( 6600, 9900 ] 3 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1206762 Average: 4.2634 StdDev: 60.09 Min: 1 Median: 1.6933 Max: 9071 Percentiles: P50: 1.69 P75: 2.47 P99: 8.84 P99.9: 102.99 P99.99: 236.91 ------------------------------------------------------ [ 0, 1 ] 127570 10.571% 10.571% ## ( 1, 2 ] 686265 56.868% 67.440% ########### ( 2, 3 ] 194873 16.148% 83.588% ### ( 3, 4 ] 87032 7.212% 90.800% # ( 4, 6 ] 83486 6.918% 97.718% # ( 6, 10 ] 21809 1.807% 99.525% ( 10, 15 ] 3319 0.275% 99.800% ( 15, 22 ] 389 0.032% 99.833% ( 22, 34 ] 29 0.002% 99.835% ( 34, 51 ] 15 0.001% 99.836% ( 51, 76 ] 76 0.006% 99.843% ( 76, 110 ] 872 0.072% 99.915% ( 110, 170 ] 678 0.056% 99.971% ( 170, 250 ] 273 0.023% 99.994% ( 250, 380 ] 274 0.023% 100.016% ( 380, 580 ] 345 0.029% 100.045% ( 580, 870 ] 324 0.027% 100.072% ( 870, 1300 ] 222 0.018% 100.090% ( 1300, 1900 ] 109 0.009% 100.099% ( 1900, 2900 ] 103 0.009% 100.108% ( 2900, 4400 ] 145 0.012% 100.120% ( 4400, 6600 ] 33 0.003% 100.123% ( 6600, 9900 ] 4 0.000% 100.123% ** Level 2 read latency histogram (micros): Count: 111911 Average: 2.2677 StdDev: 14.20 Min: 1 Median: 1.4423 Max: 3106 Percentiles: P50: 1.44 P75: 1.84 P99: 5.80 P99.9: 13.98 P99.99: 473.63 ------------------------------------------------------ [ 0, 1 ] 24862 22.216% 22.216% #### ( 1, 2 ] 70298 62.816% 85.032% ############# ( 2, 3 ] 9522 8.509% 93.540% ## ( 3, 4 ] 3990 3.565% 97.106% # ( 4, 6 ] 2356 2.105% 99.211% ( 6, 10 ] 717 0.641% 99.852% ( 10, 15 ] 68 0.061% 99.912% ( 15, 22 ] 8 0.007% 99.920% ( 22, 34 ] 6 0.005% 99.925% ( 34, 51 ] 1 0.001% 99.926% ( 51, 76 ] 1 0.001% 99.927% ( 76, 110 ] 10 0.009% 99.936% ( 110, 170 ] 41 0.037% 99.972% ( 170, 250 ] 7 0.006% 99.979% ( 250, 380 ] 10 0.009% 99.987% ( 380, 580 ] 6 0.005% 99.993% ( 580, 870 ] 3 0.003% 99.996% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 884006 Average: 3.9212 StdDev: 43.45 Min: 0 Median: 1.9209 Max: 6735 Percentiles: P50: 1.92 P75: 2.94 P99: 8.65 P99.9: 14.02 P99.99: 18.71 ------------------------------------------------------ [ 0, 1 ] 30934 3.499% 3.499% # ( 1, 2 ] 446355 50.492% 53.992% ########## ( 2, 3 ] 197590 22.352% 76.343% #### ( 3, 4 ] 94973 10.743% 87.087% ## ( 4, 6 ] 94433 10.682% 97.769% ## ( 6, 10 ] 16401 1.855% 99.624% ( 10, 15 ] 3031 0.343% 99.967% ( 15, 22 ] 379 0.043% 100.010% ( 22, 34 ] 40 0.005% 100.015% ( 34, 51 ] 20 0.002% 100.017% ( 51, 76 ] 67 0.008% 100.025% ( 76, 110 ] 153 0.017% 100.042% ( 110, 170 ] 295 0.033% 100.075% ( 170, 250 ] 235 0.027% 100.102% ( 250, 380 ] 243 0.027% 100.129% ( 380, 580 ] 184 0.021% 100.150% ( 580, 870 ] 129 0.015% 100.165% ( 870, 1300 ] 106 0.012% 100.177% ( 1300, 1900 ] 41 0.005% 100.181% ( 1900, 2900 ] 43 0.005% 100.186% ( 2900, 4400 ] 65 0.007% 100.194% ( 4400, 6600 ] 5 0.001% 100.194% ( 6600, 9900 ] 1 0.000% 100.194% ** Level 4 read latency histogram (micros): Count: 24424 Average: 58.5364 StdDev: 318.68 Min: 0 Median: 2.1208 Max: 10308 Percentiles: P50: 2.12 P75: 3.43 P99: 1309.03 P99.9: 4182.52 P99.99: 6126.67 ------------------------------------------------------ [ 0, 1 ] 522 2.137% 2.137% ( 1, 2 ] 11044 45.218% 47.355% ######### ( 2, 3 ] 5346 21.888% 69.243% #### ( 3, 4 ] 3271 13.393% 82.636% ### ( 4, 6 ] 1875 7.677% 90.313% ## ( 6, 10 ] 570 2.334% 92.647% ( 10, 15 ] 114 0.467% 93.113% ( 15, 22 ] 25 0.102% 93.216% ( 22, 34 ] 24 0.098% 93.314% ( 34, 51 ] 3 0.012% 93.326% ( 51, 76 ] 3 0.012% 93.339% ( 76, 110 ] 45 0.184% 93.523% ( 110, 170 ] 100 0.409% 93.932% ( 170, 250 ] 150 0.614% 94.546% ( 250, 380 ] 224 0.917% 95.463% ( 380, 580 ] 334 1.368% 96.831% ( 580, 870 ] 320 1.310% 98.141% ( 870, 1300 ] 208 0.852% 98.993% ( 1300, 1900 ] 117 0.479% 99.472% ( 1900, 2900 ] 49 0.201% 99.672% ( 2900, 4400 ] 65 0.266% 99.939% ( 4400, 6600 ] 16 0.066% 100.004% ( 6600, 9900 ] 2 0.008% 100.012% ( 9900, 14000 ] 1 0.004% 100.016% ** Level 5 read latency histogram (micros): Count: 160 Average: 922.3625 StdDev: 1089.96 Min: 77 Median: 442.5000 Max: 5219 Percentiles: P50: 442.50 P75: 1354.55 P99: 4840.00 P99.9: 5219.00 P99.99: 5219.00 ------------------------------------------------------ ( 76, 110 ] 18 11.250% 11.250% ## ( 110, 170 ] 27 16.875% 28.125% ### ( 170, 250 ] 13 8.125% 36.250% ## ( 250, 380 ] 17 10.625% 46.875% ## ( 380, 580 ] 16 10.000% 56.875% ## ( 580, 870 ] 16 10.000% 66.875% ## ( 870, 1300 ] 12 7.500% 74.375% ## ( 1300, 1900 ] 11 6.875% 81.250% # ( 1900, 2900 ] 17 10.625% 91.875% ## ( 2900, 4400 ] 11 6.875% 98.750% # ( 4400, 6600 ] 2 1.250% 100.000% ** DB Stats ** Uptime(secs): 42.2 total, 3.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 210.14 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.607 H:M:S, 41.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.405 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.147 micros/op 162681 ops/sec 60.001 seconds 9760999 operations; 157.6 MB/s Microseconds per write: Count: 9760999 Average: 6.1470 StdDev: 346.62 Min: 1 Median: 1.7665 Max: 727358 Percentiles: P50: 1.77 P75: 2.81 P99: 9.08 P99.9: 1165.84 P99.99: 2695.03 ------------------------------------------------------ [ 0, 1 ] 1133972 11.617% 11.617% ## ( 1, 2 ] 4887817 50.075% 61.692% ########## ( 2, 3 ] 1604156 16.434% 78.127% ### ( 3, 4 ] 1387948 14.219% 92.346% ### ( 4, 6 ] 567493 5.814% 98.160% # ( 6, 10 ] 106464 1.091% 99.251% ( 10, 15 ] 29916 0.306% 99.557% ( 15, 22 ] 7859 0.081% 99.638% ( 22, 34 ] 1760 0.018% 99.656% ( 34, 51 ] 188 0.002% 99.658% ( 51, 76 ] 30 0.000% 99.658% ( 76, 110 ] 6586 0.067% 99.725% ( 110, 170 ] 2898 0.030% 99.755% ( 170, 250 ] 293 0.003% 99.758% ( 250, 380 ] 128 0.001% 99.759% ( 380, 580 ] 31 0.000% 99.760% ( 580, 870 ] 16 0.000% 99.760% ( 870, 1300 ] 19888 0.204% 99.964% ( 1300, 1900 ] 163 0.002% 99.965% ( 1900, 2900 ] 3040 0.031% 99.996% ( 2900, 4400 ] 249 0.003% 99.999% ( 4400, 6600 ] 67 0.001% 100.000% ( 6600, 9900 ] 14 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 4 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 13 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 228666 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9760999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10073350968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 622 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32808341 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 36318528178 rocksdb.compact.write.bytes COUNT : 36080378329 rocksdb.flush.write.bytes COUNT : 9908539618 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 66 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 302 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9828667392 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3843072 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 36416620967 rocksdb.non.last.level.read.count COUNT : 8799299 rocksdb.block.checksum.compute.count COUNT : 8798121 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.437077 P95 : 3.929789 P99 : 7.658300 P100 : 727355.000000 COUNT : 9760999 SUM : 55462933 rocksdb.compaction.times.micros P50 : 997837.837838 P95 : 3705000.000000 P99 : 17440000.000000 P100 : 20203989.000000 COUNT : 114 SUM : 171634885 rocksdb.compaction.times.cpu_micros P50 : 878378.378378 P95 : 3506666.666667 P99 : 17440000.000000 P100 : 18101531.000000 COUNT : 114 SUM : 140505144 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 671.369863 P95 : 1272.636364 P99 : 118682.000000 P100 : 118682.000000 COUNT : 134 SUM : 354433 rocksdb.compaction.outfile.sync.micros P50 : 1190.432692 P95 : 137954.545455 P99 : 215200.000000 P100 : 226721.000000 COUNT : 435 SUM : 9540368 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 106.046512 P95 : 2354.545455 P99 : 4200.000000 P100 : 5892.000000 COUNT : 280 SUM : 105706 rocksdb.table.open.io.micros P50 : 1546.666667 P95 : 7860.769231 P99 : 10539.600000 P100 : 15839.000000 COUNT : 622 SUM : 1345140 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.714708 P95 : 8.212672 P99 : 11.502408 P100 : 15417.000000 COUNT : 8796594 SUM : 57166244 rocksdb.read.block.get.micros P50 : 483.703704 P95 : 3354.166667 P99 : 4390.833333 P100 : 6745.000000 COUNT : 1244 SUM : 1097224 rocksdb.write.raw.block.micros P50 : 0.513419 P95 : 0.975497 P99 : 2.924920 P100 : 12061.000000 COUNT : 11146169 SUM : 21586673 rocksdb.numfiles.in.singlecompaction P50 : 2.565217 P95 : 5.566667 P99 : 24.040000 P100 : 28.000000 COUNT : 166 SUM : 572 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.557736 P95 : 1130.604423 P99 : 2259.071452 P100 : 727180.000000 COUNT : 226850 SUM : 32825740 rocksdb.sst.read.micros P50 : 1.659758 P95 : 5.012254 P99 : 8.756099 P100 : 15411.000000 COUNT : 8799941 SUM : 39054064 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9760999 SUM : 10073350968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212772.277228 P95 : 373500.000000 P99 : 557080.000000 P100 : 869522.000000 COUNT : 134 SUM : 28492668 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 404 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0