[2024-11-21 06:48:53.170601] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... [2024-11-21 06:48:53.170867] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2942118 ] Set seed to 1732168133163916 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-21 06:48:53.270581] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-21 06:48:53.310520] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-21 06:48:53.310570] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2942118' to capture a snapshot of events at runtime. [2024-11-21 06:48:53.310583] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2942118 for offline analysis/debug. [2024-11-21 06:48:53.310625] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Nov 21 06:48:57 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/21-06:49:00 ... thread 0: (1000000,1000000) ops and (335792.7,335792.7) ops/second in (2.978028,2.978028) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 503.99 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 342.6 2.57 2.34 12 0.215 0 0 0.0 0.0 L1 3/3 188.87 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 259.3 259.1 0.73 0.70 1 0.729 191K 118 0.0 0.0 L2 3/2 188.88 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 259.3 259.2 0.73 0.71 1 0.729 191K 79 0.0 0.0 L3 9/0 741.33 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/9 97.00 GB 0.0 0.4 0.3 0.1 1.2 1.2 1.0 1.4 93.7 312.4 4.03 3.74 14 0.288 383K 197 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.2 1.2 0.6 1.4 93.7 312.4 4.03 3.74 14 0.288 383K 197 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 259.3 259.2 1.46 1.40 2 0.729 383K 197 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 342.6 2.57 2.34 12 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 397.73 MB/s write, 0.37 GB read, 119.34 MB/s read, 4.0 seconds Interval compaction: 1.23 GB write, 422.79 MB/s write, 0.37 GB read, 126.85 MB/s read, 4.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 117812 Average: 1.8502 StdDev: 16.52 Min: 1 Median: 1.1951 Max: 3221 Percentiles: P50: 1.20 P75: 1.64 P99: 3.81 P99.9: 9.59 P99.99: 329.22 ------------------------------------------------------ [ 0, 1 ] 45956 39.008% 39.008% ######## ( 1, 2 ] 66384 56.347% 95.355% ########### ( 2, 3 ] 3278 2.782% 98.138% # ( 3, 4 ] 1259 1.069% 99.206% ( 4, 6 ] 594 0.504% 99.711% ( 6, 10 ] 250 0.212% 99.923% ( 10, 15 ] 60 0.051% 99.974% ( 15, 22 ] 7 0.006% 99.980% ( 22, 34 ] 1 0.001% 99.980% ( 110, 170 ] 5 0.004% 99.985% ( 170, 250 ] 6 0.005% 99.990% ( 250, 380 ] 2 0.002% 99.992% ( 380, 580 ] 1 0.001% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 4 0.003% 99.997% ( 1300, 1900 ] 2 0.002% 99.999% ( 2900, 4400 ] 2 0.002% 100.001% ** Level 1 read latency histogram (micros): Count: 16497 Average: 2.1051 StdDev: 8.45 Min: 0 Median: 1.4356 Max: 869 Percentiles: P50: 1.44 P75: 1.80 P99: 4.95 P99.9: 12.29 P99.99: 450.06 ------------------------------------------------------ [ 0, 1 ] 3334 20.210% 20.210% #### ( 1, 2 ] 11284 68.400% 88.610% ############## ( 2, 3 ] 1117 6.771% 95.381% # ( 3, 4 ] 493 2.988% 98.369% # ( 4, 6 ] 220 1.334% 99.703% ( 6, 10 ] 28 0.170% 99.873% ( 10, 15 ] 12 0.073% 99.945% ( 15, 22 ] 6 0.036% 99.982% ( 110, 170 ] 1 0.006% 99.988% ( 250, 380 ] 1 0.006% 99.994% ( 380, 580 ] 1 0.006% 100.000% ( 580, 870 ] 1 0.006% 100.006% ** Level 2 read latency histogram (micros): Count: 39443 Average: 2.3191 StdDev: 27.85 Min: 0 Median: 1.3894 Max: 3782 Percentiles: P50: 1.39 P75: 1.78 P99: 5.47 P99.9: 9.91 P99.99: 1316.68 ------------------------------------------------------ [ 0, 1 ] 9828 24.917% 24.917% ##### ( 1, 2 ] 25410 64.422% 89.339% ############# ( 2, 3 ] 2222 5.633% 94.972% # ( 3, 4 ] 1127 2.857% 97.830% # ( 4, 6 ] 629 1.595% 99.424% ( 6, 10 ] 193 0.489% 99.914% ( 10, 15 ] 14 0.035% 99.949% ( 15, 22 ] 6 0.015% 99.965% ( 51, 76 ] 1 0.003% 99.967% ( 110, 170 ] 1 0.003% 99.970% ( 170, 250 ] 1 0.003% 99.972% ( 250, 380 ] 3 0.008% 99.980% ( 380, 580 ] 1 0.003% 99.982% ( 580, 870 ] 4 0.010% 99.992% ( 1300, 1900 ] 2 0.005% 99.997% ( 1900, 2900 ] 1 0.003% 100.000% ( 2900, 4400 ] 1 0.003% 100.003% ** Level 3 read latency histogram (micros): Count: 55 Average: 1549.3818 StdDev: 1324.51 Min: 48 Median: 962.1429 Max: 4253 Percentiles: P50: 962.14 P75: 2705.56 P99: 4253.00 P99.9: 4253.00 P99.99: 4253.00 ------------------------------------------------------ ( 34, 51 ] 1 1.818% 1.818% ( 51, 76 ] 1 1.818% 3.636% ( 76, 110 ] 2 3.636% 7.273% # ( 110, 170 ] 1 1.818% 9.091% ( 170, 250 ] 3 5.455% 14.545% # ( 250, 380 ] 3 5.455% 20.000% # ( 380, 580 ] 4 7.273% 27.273% # ( 580, 870 ] 11 20.000% 47.273% #### ( 870, 1300 ] 7 12.727% 60.000% ### ( 1300, 1900 ] 1 1.818% 61.818% ( 1900, 2900 ] 9 16.364% 78.182% ### ( 2900, 4400 ] 12 21.818% 100.000% #### ** Level 4 read latency histogram (micros): Count: 15 Average: 1777.5333 StdDev: 1210.82 Min: 385 Median: 2000.0000 Max: 3914 Percentiles: P50: 2000.00 P75: 2750.00 P99: 3914.00 P99.9: 3914.00 P99.99: 3914.00 ------------------------------------------------------ ( 380, 580 ] 3 20.000% 20.000% #### ( 580, 870 ] 2 13.333% 33.333% ### ( 870, 1300 ] 2 13.333% 46.667% ### ( 1900, 2900 ] 5 33.333% 80.000% ####### ( 2900, 4400 ] 3 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 560.3000 StdDev: 673.19 Min: 76 Median: 156.6667 Max: 2079 Percentiles: P50: 156.67 P75: 580.00 P99: 2079.00 P99.9: 2079.00 P99.99: 2079.00 ------------------------------------------------------ ( 51, 76 ] 1 5.000% 5.000% # ( 76, 110 ] 2 10.000% 15.000% ## ( 110, 170 ] 9 45.000% 60.000% ######### ( 380, 580 ] 3 15.000% 75.000% ### ( 870, 1300 ] 2 10.000% 85.000% ## ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 310.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.398 H:M:S, 12.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.21 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.398 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/21-06:49:03 ... thread 0: (1000000,2000000) ops and (321798.3,328646.6) ops/second in (3.107537,6.085565) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 1.23 GB 12.6 0.2 0.0 0.2 2.1 1.8 0.0 1.1 39.9 338.9 6.32 5.76 27 0.234 255K 254 0.0 0.0 L1 1/1 11.22 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.2 1.4 243.2 242.8 2.59 2.51 2 1.295 639K 875 0.0 0.0 L2 4/3 301.45 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.5 1.5 259.3 259.2 0.73 0.71 1 0.729 191K 79 0.0 0.0 L3 18/1 1.03 GB 0.9 0.4 0.3 0.1 0.4 0.3 0.1 1.2 218.6 218.4 1.71 1.58 2 0.856 379K 254 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1197/18 97.98 GB 0.0 1.4 0.9 0.5 3.3 2.7 1.4 1.8 127.3 293.7 11.35 10.56 32 0.355 1467K 1462 0.0 0.0 Int 0/0 0.00 KB 0.0 1.4 0.9 0.5 3.3 2.7 1.0 1.8 127.3 293.7 11.35 10.56 32 0.355 1467K 1462 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.4 0.9 0.5 1.4 0.9 0.0 0.0 243.1 242.8 5.94 5.70 6 0.991 1467K 1462 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 349.6 5.41 4.86 26 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.3 total, 6.1 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.26 GB write, 531.23 MB/s write, 1.41 GB read, 230.28 MB/s read, 11.3 seconds Interval compaction: 3.26 GB write, 547.61 MB/s write, 1.41 GB read, 237.38 MB/s read, 11.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 398545 Average: 2.1141 StdDev: 13.82 Min: 1 Median: 1.4221 Max: 3393 Percentiles: P50: 1.42 P75: 1.82 P99: 5.52 P99.9: 9.64 P99.99: 13.92 ------------------------------------------------------ [ 0, 1 ] 93251 23.398% 23.398% ##### ( 1, 2 ] 251153 63.017% 86.415% ############# ( 2, 3 ] 30591 7.676% 94.091% ## ( 3, 4 ] 13207 3.314% 97.405% # ( 4, 6 ] 8359 2.097% 99.502% ( 6, 10 ] 1743 0.437% 99.940% ( 10, 15 ] 258 0.065% 100.004% ( 15, 22 ] 19 0.005% 100.009% ( 22, 34 ] 2 0.001% 100.010% ( 34, 51 ] 2 0.001% 100.010% ( 51, 76 ] 2 0.001% 100.011% ( 110, 170 ] 7 0.002% 100.012% ( 170, 250 ] 14 0.004% 100.016% ( 250, 380 ] 7 0.002% 100.018% ( 380, 580 ] 3 0.001% 100.018% ( 580, 870 ] 6 0.002% 100.020% ( 870, 1300 ] 10 0.003% 100.022% ( 1300, 1900 ] 2 0.001% 100.023% ( 2900, 4400 ] 5 0.001% 100.024% ** Level 1 read latency histogram (micros): Count: 143249 Average: 2.2556 StdDev: 6.94 Min: 0 Median: 1.5431 Max: 1779 Percentiles: P50: 1.54 P75: 1.92 P99: 5.73 P99.9: 10.96 P99.99: 18.80 ------------------------------------------------------ [ 0, 1 ] 20001 13.962% 13.962% ### ( 1, 2 ] 95048 66.352% 80.314% ############# ( 2, 3 ] 16278 11.363% 91.677% ## ( 3, 4 ] 6581 4.594% 96.272% # ( 4, 6 ] 4524 3.158% 99.430% # ( 6, 10 ] 645 0.450% 99.880% ( 10, 15 ] 149 0.104% 99.984% ( 15, 22 ] 16 0.011% 99.995% ( 22, 34 ] 1 0.001% 99.996% ( 34, 51 ] 1 0.001% 99.997% ( 51, 76 ] 1 0.001% 99.997% ( 110, 170 ] 2 0.001% 99.999% ( 250, 380 ] 5 0.003% 100.002% ( 380, 580 ] 1 0.001% 100.003% ( 580, 870 ] 2 0.001% 100.004% ( 870, 1300 ] 1 0.001% 100.005% ( 1300, 1900 ] 1 0.001% 100.006% ** Level 2 read latency histogram (micros): Count: 47631 Average: 2.2775 StdDev: 25.34 Min: 0 Median: 1.4072 Max: 3782 Percentiles: P50: 1.41 P75: 1.79 P99: 5.47 P99.9: 9.82 P99.99: 814.68 ------------------------------------------------------ [ 0, 1 ] 11184 23.481% 23.481% ##### ( 1, 2 ] 31023 65.132% 88.612% ############# ( 2, 3 ] 3026 6.353% 94.965% # ( 3, 4 ] 1352 2.838% 97.804% # ( 4, 6 ] 777 1.631% 99.435% ( 6, 10 ] 232 0.487% 99.922% ( 10, 15 ] 16 0.034% 99.956% ( 15, 22 ] 6 0.013% 99.969% ( 51, 76 ] 1 0.002% 99.971% ( 110, 170 ] 1 0.002% 99.973% ( 170, 250 ] 1 0.002% 99.975% ( 250, 380 ] 3 0.006% 99.981% ( 380, 580 ] 1 0.002% 99.983% ( 580, 870 ] 4 0.008% 99.992% ( 1300, 1900 ] 2 0.004% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 41544 Average: 4.4105 StdDev: 74.43 Min: 0 Median: 1.5819 Max: 4253 Percentiles: P50: 1.58 P75: 1.97 P99: 5.91 P99.9: 591.02 P99.99: 3880.70 ------------------------------------------------------ [ 0, 1 ] 5161 12.423% 12.423% ## ( 1, 2 ] 26827 64.575% 76.998% ############# ( 2, 3 ] 5320 12.806% 89.804% ### ( 3, 4 ] 2307 5.553% 95.357% # ( 4, 6 ] 1586 3.818% 99.174% # ( 6, 10 ] 217 0.522% 99.697% ( 10, 15 ] 53 0.128% 99.824% ( 15, 22 ] 6 0.014% 99.839% ( 22, 34 ] 1 0.002% 99.841% ( 34, 51 ] 3 0.007% 99.848% ( 51, 76 ] 3 0.007% 99.856% ( 76, 110 ] 2 0.005% 99.860% ( 110, 170 ] 2 0.005% 99.865% ( 170, 250 ] 5 0.012% 99.877% ( 250, 380 ] 4 0.010% 99.887% ( 380, 580 ] 5 0.012% 99.899% ( 580, 870 ] 12 0.029% 99.928% ( 870, 1300 ] 8 0.019% 99.947% ( 1300, 1900 ] 1 0.002% 99.949% ( 1900, 2900 ] 9 0.022% 99.971% ( 2900, 4400 ] 12 0.029% 100.000% ** Level 4 read latency histogram (micros): Count: 15 Average: 1777.5333 StdDev: 1210.82 Min: 385 Median: 2000.0000 Max: 3914 Percentiles: P50: 2000.00 P75: 2750.00 P99: 3914.00 P99.9: 3914.00 P99.99: 3914.00 ------------------------------------------------------ ( 380, 580 ] 3 20.000% 20.000% #### ( 580, 870 ] 2 13.333% 33.333% ### ( 870, 1300 ] 2 13.333% 46.667% ### ( 1900, 2900 ] 5 33.333% 80.000% ####### ( 2900, 4400 ] 3 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 560.3000 StdDev: 673.19 Min: 76 Median: 156.6667 Max: 2079 Percentiles: P50: 156.67 P75: 580.00 P99: 2079.00 P99.9: 2079.00 P99.99: 2079.00 ------------------------------------------------------ ( 51, 76 ] 1 5.000% 5.000% # ( 76, 110 ] 2 10.000% 15.000% ## ( 110, 170 ] 9 45.000% 60.000% ######### ( 380, 580 ] 3 15.000% 75.000% ### ( 870, 1300 ] 2 10.000% 85.000% ## ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 6.3 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 313.69 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.851 H:M:S, 13.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 316.72 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.453 H:M:S, 14.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/21-06:49:06 ... thread 0: (1000000,3000000) ops and (337727.6,331618.8) ops/second in (2.960966,9.046531) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.60 GB 138.5 1.4 0.0 1.4 4.1 2.8 0.0 1.5 104.3 317.5 13.29 12.38 44 0.302 1407K 1519 0.0 0.0 L1 3/0 190.76 MB 19.1 1.2 1.0 0.2 1.2 1.0 0.2 1.2 237.7 237.2 5.08 4.90 3 1.694 1226K 2168 0.0 0.0 L2 2/0 93.13 MB 0.9 0.2 0.1 0.1 0.2 0.1 0.9 1.5 259.3 259.2 0.73 0.71 1 0.729 191K 79 0.0 0.0 L3 15/0 715.89 MB 0.7 0.8 0.6 0.2 0.8 0.6 0.4 1.3 202.0 201.8 3.98 3.55 3 1.325 815K 800 0.0 0.0 L4 166/0 9.46 GB 1.0 0.1 0.1 0.0 0.1 0.1 1.1 1.0 196.7 196.7 0.65 0.56 1 0.655 130K 0 0.0 0.0 L5 1056/0 86.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1252/4 98.90 GB 0.0 3.6 1.8 1.8 6.4 4.6 3.8 2.3 156.5 275.8 23.73 22.10 52 0.456 3771K 4566 0.0 0.0 Int 0/0 0.00 KB 0.0 3.6 1.8 1.8 6.4 4.6 3.4 2.3 156.5 275.8 23.73 22.10 52 0.456 3771K 4566 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.6 1.8 1.8 3.6 1.8 0.0 0.0 236.6 236.3 15.70 14.88 13 1.208 3771K 4566 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 353.1 8.03 7.22 39 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.39 GB write, 708.62 MB/s write, 3.63 GB read, 402.19 MB/s read, 23.7 seconds Interval compaction: 6.39 GB write, 723.32 MB/s write, 3.63 GB read, 410.53 MB/s read, 23.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 687496 Average: 2.0958 StdDev: 12.66 Min: 1 Median: 1.4183 Max: 3625 Percentiles: P50: 1.42 P75: 1.81 P99: 5.49 P99.9: 9.80 P99.99: 14.20 ------------------------------------------------------ [ 0, 1 ] 161431 23.481% 23.481% ##### ( 1, 2 ] 435875 63.400% 86.881% ############# ( 2, 3 ] 50993 7.417% 94.299% # ( 3, 4 ] 22267 3.239% 97.537% # ( 4, 6 ] 13499 1.964% 99.501% ( 6, 10 ] 2891 0.421% 99.921% ( 10, 15 ] 562 0.082% 100.003% ( 15, 22 ] 47 0.007% 100.010% ( 22, 34 ] 6 0.001% 100.011% ( 34, 51 ] 2 0.000% 100.011% ( 51, 76 ] 3 0.000% 100.012% ( 76, 110 ] 1 0.000% 100.012% ( 110, 170 ] 14 0.002% 100.014% ( 170, 250 ] 20 0.003% 100.017% ( 250, 380 ] 11 0.002% 100.018% ( 380, 580 ] 5 0.001% 100.019% ( 580, 870 ] 12 0.002% 100.021% ( 870, 1300 ] 14 0.002% 100.023% ( 1300, 1900 ] 5 0.001% 100.024% ( 1900, 2900 ] 1 0.000% 100.024% ( 2900, 4400 ] 6 0.001% 100.025% ** Level 1 read latency histogram (micros): Count: 159715 Average: 2.3031 StdDev: 9.32 Min: 0 Median: 1.5488 Max: 1779 Percentiles: P50: 1.55 P75: 1.93 P99: 5.74 P99.9: 11.29 P99.99: 76.48 ------------------------------------------------------ [ 0, 1 ] 21684 13.577% 13.577% ### ( 1, 2 ] 106006 66.372% 79.949% ############# ( 2, 3 ] 18539 11.608% 91.556% ## ( 3, 4 ] 7402 4.635% 96.191% # ( 4, 6 ] 5148 3.223% 99.414% # ( 6, 10 ] 734 0.460% 99.874% ( 10, 15 ] 164 0.103% 99.976% ( 15, 22 ] 18 0.011% 99.987% ( 22, 34 ] 2 0.001% 99.989% ( 34, 51 ] 1 0.001% 99.989% ( 51, 76 ] 1 0.001% 99.990% ( 76, 110 ] 2 0.001% 99.991% ( 110, 170 ] 3 0.002% 99.993% ( 250, 380 ] 9 0.006% 99.999% ( 380, 580 ] 2 0.001% 100.000% ( 580, 870 ] 3 0.002% 100.002% ( 870, 1300 ] 2 0.001% 100.003% ( 1300, 1900 ] 3 0.002% 100.005% ** Level 2 read latency histogram (micros): Count: 47631 Average: 2.2775 StdDev: 25.34 Min: 0 Median: 1.4072 Max: 3782 Percentiles: P50: 1.41 P75: 1.79 P99: 5.47 P99.9: 9.82 P99.99: 814.68 ------------------------------------------------------ [ 0, 1 ] 11184 23.481% 23.481% ##### ( 1, 2 ] 31023 65.132% 88.612% ############# ( 2, 3 ] 3026 6.353% 94.965% # ( 3, 4 ] 1352 2.838% 97.804% # ( 4, 6 ] 777 1.631% 99.435% ( 6, 10 ] 232 0.487% 99.922% ( 10, 15 ] 16 0.034% 99.956% ( 15, 22 ] 6 0.013% 99.969% ( 51, 76 ] 1 0.002% 99.971% ( 110, 170 ] 1 0.002% 99.973% ( 170, 250 ] 1 0.002% 99.975% ( 250, 380 ] 3 0.006% 99.981% ( 380, 580 ] 1 0.002% 99.983% ( 580, 870 ] 4 0.008% 99.992% ( 1300, 1900 ] 2 0.004% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 80407 Average: 3.4632 StdDev: 53.65 Min: 0 Median: 1.5978 Max: 4253 Percentiles: P50: 1.60 P75: 1.98 P99: 5.94 P99.9: 45.55 P99.99: 3394.91 ------------------------------------------------------ [ 0, 1 ] 8915 11.087% 11.087% ## ( 1, 2 ] 52336 65.089% 76.176% ############# ( 2, 3 ] 10927 13.590% 89.766% ### ( 3, 4 ] 4310 5.360% 95.126% # ( 4, 6 ] 3217 4.001% 99.127% # ( 6, 10 ] 458 0.570% 99.697% ( 10, 15 ] 105 0.131% 99.827% ( 15, 22 ] 19 0.024% 99.851% ( 22, 34 ] 26 0.032% 99.883% ( 34, 51 ] 20 0.025% 99.908% ( 51, 76 ] 4 0.005% 99.913% ( 76, 110 ] 2 0.002% 99.915% ( 110, 170 ] 6 0.007% 99.923% ( 170, 250 ] 7 0.009% 99.932% ( 250, 380 ] 6 0.007% 99.939% ( 380, 580 ] 5 0.006% 99.945% ( 580, 870 ] 14 0.017% 99.963% ( 870, 1300 ] 8 0.010% 99.973% ( 1300, 1900 ] 1 0.001% 99.974% ( 1900, 2900 ] 9 0.011% 99.985% ( 2900, 4400 ] 12 0.015% 100.000% ** Level 4 read latency histogram (micros): Count: 85 Average: 323.2824 StdDev: 844.16 Min: 1 Median: 2.1667 Max: 3914 Percentiles: P50: 2.17 P75: 32.33 P99: 3914.00 P99.9: 3914.00 P99.99: 3914.00 ------------------------------------------------------ [ 0, 1 ] 20 23.529% 23.529% ##### ( 1, 2 ] 22 25.882% 49.412% ##### ( 2, 3 ] 3 3.529% 52.941% # ( 3, 4 ] 1 1.176% 54.118% ( 6, 10 ] 10 11.765% 65.882% ## ( 22, 34 ] 9 10.588% 76.471% ## ( 34, 51 ] 4 4.706% 81.176% # ( 170, 250 ] 1 1.176% 82.353% ( 380, 580 ] 3 3.529% 85.882% # ( 580, 870 ] 2 2.353% 88.235% ( 870, 1300 ] 2 2.353% 90.588% ( 1900, 2900 ] 5 5.882% 96.471% # ( 2900, 4400 ] 3 3.529% 100.000% # ** Level 5 read latency histogram (micros): Count: 80 Average: 657.7375 StdDev: 807.22 Min: 76 Median: 186.0000 Max: 3275 Percentiles: P50: 186.00 P75: 833.75 P99: 3275.00 P99.9: 3275.00 P99.99: 3275.00 ------------------------------------------------------ ( 51, 76 ] 1 1.250% 1.250% ( 76, 110 ] 12 15.000% 16.250% ### ( 110, 170 ] 26 32.500% 48.750% ####### ( 170, 250 ] 5 6.250% 55.000% # ( 250, 380 ] 3 3.750% 58.750% # ( 380, 580 ] 6 7.500% 66.250% ## ( 580, 870 ] 8 10.000% 76.250% ## ( 870, 1300 ] 3 3.750% 80.000% # ( 1300, 1900 ] 4 5.000% 85.000% # ( 1900, 2900 ] 10 12.500% 97.500% ### ( 2900, 4400 ] 2 2.500% 100.000% # ** DB Stats ** Uptime(secs): 9.2 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 319.68 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.211 H:M:S, 13.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.39 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.359 H:M:S, 12.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/21-06:49:09 ... thread 0: (1000000,4000000) ops and (335882.1,332674.5) ops/second in (2.977235,12.023766) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 2.52 GB 50.4 1.9 0.0 1.9 5.6 3.7 0.0 1.5 107.5 315.5 18.16 16.91 59 0.308 1982K 2087 0.0 0.0 L1 3/3 190.76 MB 0.0 1.2 1.0 0.2 1.2 1.0 0.2 1.2 237.7 237.2 5.08 4.90 3 1.694 1226K 2168 0.0 0.0 L2 2/0 93.13 MB 0.9 0.2 0.1 0.1 0.2 0.1 0.9 1.5 259.3 259.2 0.73 0.71 1 0.729 191K 79 0.0 0.0 L3 15/0 715.89 MB 0.7 0.8 0.6 0.2 0.8 0.6 0.4 1.3 202.0 201.8 3.98 3.55 3 1.325 815K 800 0.0 0.0 L4 166/0 9.46 GB 1.0 0.1 0.1 0.0 0.1 0.1 1.1 1.0 196.7 196.7 0.65 0.56 1 0.655 130K 0 0.0 0.0 L5 1056/0 86.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1259/17 99.82 GB 0.0 4.2 1.8 2.3 7.9 5.5 3.8 2.1 149.7 281.7 28.60 26.63 67 0.427 4347K 5134 0.0 0.0 Int 0/0 0.00 KB 0.0 4.2 1.8 2.3 7.9 5.5 3.4 2.1 149.7 281.7 28.60 26.63 67 0.427 4347K 5134 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.2 1.8 2.3 4.2 1.8 0.0 0.0 239.2 238.9 17.90 17.04 15 1.193 4347K 5134 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 353.2 10.70 9.60 52 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.87 GB write, 659.62 MB/s write, 4.18 GB read, 350.57 MB/s read, 28.6 seconds Interval compaction: 7.87 GB write, 669.91 MB/s write, 4.18 GB read, 356.04 MB/s read, 28.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 998372 Average: 2.0993 StdDev: 12.31 Min: 0 Median: 1.4222 Max: 3625 Percentiles: P50: 1.42 P75: 1.81 P99: 5.47 P99.9: 9.64 P99.99: 13.63 ------------------------------------------------------ [ 0, 1 ] 230312 23.069% 23.069% ##### ( 1, 2 ] 636865 63.790% 86.859% ############# ( 2, 3 ] 75152 7.527% 94.387% ## ( 3, 4 ] 31717 3.177% 97.563% # ( 4, 6 ] 19530 1.956% 99.520% ( 6, 10 ] 4170 0.418% 99.937% ( 10, 15 ] 727 0.073% 100.010% ( 15, 22 ] 68 0.007% 100.017% ( 22, 34 ] 11 0.001% 100.018% ( 34, 51 ] 4 0.000% 100.018% ( 51, 76 ] 5 0.001% 100.019% ( 76, 110 ] 9 0.001% 100.020% ( 110, 170 ] 45 0.005% 100.024% ( 170, 250 ] 32 0.003% 100.028% ( 250, 380 ] 18 0.002% 100.029% ( 380, 580 ] 13 0.001% 100.031% ( 580, 870 ] 13 0.001% 100.032% ( 870, 1300 ] 17 0.002% 100.034% ( 1300, 1900 ] 7 0.001% 100.034% ( 1900, 2900 ] 3 0.000% 100.035% ( 2900, 4400 ] 8 0.001% 100.035% ** Level 1 read latency histogram (micros): Count: 159716 Average: 2.3031 StdDev: 9.32 Min: 0 Median: 1.5488 Max: 1779 Percentiles: P50: 1.55 P75: 1.93 P99: 5.74 P99.9: 11.29 P99.99: 76.48 ------------------------------------------------------ [ 0, 1 ] 21684 13.577% 13.577% ### ( 1, 2 ] 106006 66.372% 79.948% ############# ( 2, 3 ] 18540 11.608% 91.556% ## ( 3, 4 ] 7402 4.634% 96.191% # ( 4, 6 ] 5148 3.223% 99.414% # ( 6, 10 ] 734 0.460% 99.874% ( 10, 15 ] 164 0.103% 99.976% ( 15, 22 ] 18 0.011% 99.987% ( 22, 34 ] 2 0.001% 99.989% ( 34, 51 ] 1 0.001% 99.989% ( 51, 76 ] 1 0.001% 99.990% ( 76, 110 ] 2 0.001% 99.991% ( 110, 170 ] 3 0.002% 99.993% ( 250, 380 ] 9 0.006% 99.999% ( 380, 580 ] 2 0.001% 100.000% ( 580, 870 ] 3 0.002% 100.002% ( 870, 1300 ] 2 0.001% 100.003% ( 1300, 1900 ] 3 0.002% 100.005% ** Level 2 read latency histogram (micros): Count: 47631 Average: 2.2775 StdDev: 25.34 Min: 0 Median: 1.4072 Max: 3782 Percentiles: P50: 1.41 P75: 1.79 P99: 5.47 P99.9: 9.82 P99.99: 814.68 ------------------------------------------------------ [ 0, 1 ] 11184 23.481% 23.481% ##### ( 1, 2 ] 31023 65.132% 88.612% ############# ( 2, 3 ] 3026 6.353% 94.965% # ( 3, 4 ] 1352 2.838% 97.804% # ( 4, 6 ] 777 1.631% 99.435% ( 6, 10 ] 232 0.487% 99.922% ( 10, 15 ] 16 0.034% 99.956% ( 15, 22 ] 6 0.013% 99.969% ( 51, 76 ] 1 0.002% 99.971% ( 110, 170 ] 1 0.002% 99.973% ( 170, 250 ] 1 0.002% 99.975% ( 250, 380 ] 3 0.006% 99.981% ( 380, 580 ] 1 0.002% 99.983% ( 580, 870 ] 4 0.008% 99.992% ( 1300, 1900 ] 2 0.004% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 80407 Average: 3.4632 StdDev: 53.65 Min: 0 Median: 1.5978 Max: 4253 Percentiles: P50: 1.60 P75: 1.98 P99: 5.94 P99.9: 45.55 P99.99: 3394.91 ------------------------------------------------------ [ 0, 1 ] 8915 11.087% 11.087% ## ( 1, 2 ] 52336 65.089% 76.176% ############# ( 2, 3 ] 10927 13.590% 89.766% ### ( 3, 4 ] 4310 5.360% 95.126% # ( 4, 6 ] 3217 4.001% 99.127% # ( 6, 10 ] 458 0.570% 99.697% ( 10, 15 ] 105 0.131% 99.827% ( 15, 22 ] 19 0.024% 99.851% ( 22, 34 ] 26 0.032% 99.883% ( 34, 51 ] 20 0.025% 99.908% ( 51, 76 ] 4 0.005% 99.913% ( 76, 110 ] 2 0.002% 99.915% ( 110, 170 ] 6 0.007% 99.923% ( 170, 250 ] 7 0.009% 99.932% ( 250, 380 ] 6 0.007% 99.939% ( 380, 580 ] 5 0.006% 99.945% ( 580, 870 ] 14 0.017% 99.963% ( 870, 1300 ] 8 0.010% 99.973% ( 1300, 1900 ] 1 0.001% 99.974% ( 1900, 2900 ] 9 0.011% 99.985% ( 2900, 4400 ] 12 0.015% 100.000% ** Level 4 read latency histogram (micros): Count: 85 Average: 323.2824 StdDev: 844.16 Min: 1 Median: 2.1667 Max: 3914 Percentiles: P50: 2.17 P75: 32.33 P99: 3914.00 P99.9: 3914.00 P99.99: 3914.00 ------------------------------------------------------ [ 0, 1 ] 20 23.529% 23.529% ##### ( 1, 2 ] 22 25.882% 49.412% ##### ( 2, 3 ] 3 3.529% 52.941% # ( 3, 4 ] 1 1.176% 54.118% ( 6, 10 ] 10 11.765% 65.882% ## ( 22, 34 ] 9 10.588% 76.471% ## ( 34, 51 ] 4 4.706% 81.176% # ( 170, 250 ] 1 1.176% 82.353% ( 380, 580 ] 3 3.529% 85.882% # ( 580, 870 ] 2 2.353% 88.235% ( 870, 1300 ] 2 2.353% 90.588% ( 1900, 2900 ] 5 5.882% 96.471% # ( 2900, 4400 ] 3 3.529% 100.000% # ** Level 5 read latency histogram (micros): Count: 80 Average: 657.7375 StdDev: 807.22 Min: 76 Median: 186.0000 Max: 3275 Percentiles: P50: 186.00 P75: 833.75 P99: 3275.00 P99.9: 3275.00 P99.99: 3275.00 ------------------------------------------------------ ( 51, 76 ] 1 1.250% 1.250% ( 76, 110 ] 12 15.000% 16.250% ### ( 110, 170 ] 26 32.500% 48.750% ####### ( 170, 250 ] 5 6.250% 55.000% # ( 250, 380 ] 3 3.750% 58.750% # ( 380, 580 ] 6 7.500% 66.250% ## ( 580, 870 ] 8 10.000% 76.250% ## ( 870, 1300 ] 3 3.750% 80.000% # ( 1300, 1900 ] 4 5.000% 85.000% # ( 1900, 2900 ] 10 12.500% 97.500% ### ( 2900, 4400 ] 2 2.500% 100.000% # ** DB Stats ** Uptime(secs): 12.2 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 322.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.586 H:M:S, 13.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.376 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/21-06:49:15 ... thread 0: (1000000,5000000) ops and (157965.0,272416.0) ops/second in (6.330516,18.354282) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.78 GB 113.3 2.9 0.0 2.9 7.6 4.7 0.0 1.6 118.6 312.7 24.97 23.34 79 0.316 3006K 3052 0.0 0.0 L1 10/0 1.03 GB 105.7 3.1 2.8 0.4 3.1 2.7 0.2 1.1 234.0 232.4 13.78 13.31 4 3.445 3273K 20K 0.0 0.0 L2 9/7 941.82 MB 2.6 0.2 0.1 0.1 0.2 0.1 1.8 1.5 259.3 259.2 0.73 0.71 1 0.729 191K 79 0.0 0.0 L3 16/7 807.67 MB 0.2 0.8 0.6 0.2 0.8 0.6 0.5 1.3 202.0 201.8 3.98 3.55 3 1.325 815K 800 0.0 0.0 L4 166/0 9.46 GB 1.0 0.1 0.1 0.0 0.1 0.1 1.1 1.0 196.7 196.7 0.65 0.56 1 0.655 130K 0 0.0 0.0 L5 1056/0 86.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1268/18 100.85 GB 0.0 7.1 3.6 3.5 11.8 8.3 4.8 2.5 165.6 275.0 44.11 41.47 88 0.501 7418K 24K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.1 3.6 3.5 11.8 8.3 4.4 2.5 165.6 275.0 44.11 41.47 88 0.501 7418K 24K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.1 3.6 3.5 7.1 3.6 0.0 0.0 240.7 239.9 30.35 29.13 20 1.517 7418K 24K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 352.4 13.76 12.35 68 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.5 total, 18.4 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.85 GB write, 654.20 MB/s write, 7.13 GB read, 393.97 MB/s read, 44.1 seconds Interval compaction: 11.85 GB write, 660.89 MB/s write, 7.13 GB read, 398.00 MB/s read, 44.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 14, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1682653 Average: 2.1021 StdDev: 11.21 Min: 0 Median: 1.4211 Max: 4220 Percentiles: P50: 1.42 P75: 1.81 P99: 5.43 P99.9: 9.74 P99.99: 16.27 ------------------------------------------------------ [ 0, 1 ] 379924 22.579% 22.579% ##### ( 1, 2 ] 1095656 65.115% 87.694% ############# ( 2, 3 ] 118838 7.063% 94.756% # ( 3, 4 ] 51381 3.054% 97.810% # ( 4, 6 ] 28063 1.668% 99.478% ( 6, 10 ] 7598 0.452% 99.929% ( 10, 15 ] 998 0.059% 99.988% ( 15, 22 ] 147 0.009% 99.997% ( 22, 34 ] 16 0.001% 99.998% ( 34, 51 ] 5 0.000% 99.998% ( 51, 76 ] 21 0.001% 100.000% ( 76, 110 ] 105 0.006% 100.006% ( 110, 170 ] 150 0.009% 100.015% ( 170, 250 ] 87 0.005% 100.020% ( 250, 380 ] 55 0.003% 100.023% ( 380, 580 ] 39 0.002% 100.026% ( 580, 870 ] 32 0.002% 100.027% ( 870, 1300 ] 23 0.001% 100.029% ( 1300, 1900 ] 9 0.001% 100.029% ( 1900, 2900 ] 4 0.000% 100.030% ( 2900, 4400 ] 9 0.001% 100.030% ** Level 1 read latency histogram (micros): Count: 215478 Average: 2.6346 StdDev: 14.53 Min: 0 Median: 1.5374 Max: 1779 Percentiles: P50: 1.54 P75: 1.91 P99: 6.28 P99.9: 130.24 P99.99: 511.95 ------------------------------------------------------ [ 0, 1 ] 31015 14.394% 14.394% ### ( 1, 2 ] 142759 66.252% 80.646% ############# ( 2, 3 ] 23179 10.757% 91.403% ## ( 3, 4 ] 9695 4.499% 95.902% # ( 4, 6 ] 6561 3.045% 98.947% # ( 6, 10 ] 1645 0.763% 99.710% ( 10, 15 ] 227 0.105% 99.816% ( 15, 22 ] 28 0.013% 99.829% ( 22, 34 ] 7 0.003% 99.832% ( 34, 51 ] 1 0.000% 99.832% ( 51, 76 ] 1 0.000% 99.833% ( 76, 110 ] 102 0.047% 99.880% ( 110, 170 ] 129 0.060% 99.940% ( 170, 250 ] 41 0.019% 99.959% ( 250, 380 ] 47 0.022% 99.981% ( 380, 580 ] 31 0.014% 99.995% ( 580, 870 ] 12 0.006% 100.001% ( 870, 1300 ] 13 0.006% 100.007% ( 1300, 1900 ] 3 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 47810 Average: 2.7044 StdDev: 30.56 Min: 0 Median: 1.4100 Max: 3782 Percentiles: P50: 1.41 P75: 1.80 P99: 5.70 P99.9: 210.84 P99.99: 1365.70 ------------------------------------------------------ [ 0, 1 ] 11184 23.393% 23.393% ##### ( 1, 2 ] 31024 64.890% 88.283% ############# ( 2, 3 ] 3028 6.333% 94.616% # ( 3, 4 ] 1395 2.918% 97.534% # ( 4, 6 ] 827 1.730% 99.264% ( 6, 10 ] 247 0.517% 99.780% ( 10, 15 ] 18 0.038% 99.818% ( 15, 22 ] 7 0.015% 99.833% ( 22, 34 ] 1 0.002% 99.835% ( 51, 76 ] 1 0.002% 99.837% ( 76, 110 ] 3 0.006% 99.843% ( 110, 170 ] 18 0.038% 99.881% ( 170, 250 ] 18 0.038% 99.918% ( 250, 380 ] 17 0.036% 99.954% ( 380, 580 ] 10 0.021% 99.975% ( 580, 870 ] 6 0.013% 99.987% ( 870, 1300 ] 1 0.002% 99.990% ( 1300, 1900 ] 2 0.004% 99.994% ( 1900, 2900 ] 2 0.004% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 82553 Average: 3.6027 StdDev: 53.34 Min: 0 Median: 1.6090 Max: 4253 Percentiles: P50: 1.61 P75: 2.00 P99: 6.60 P99.9: 160.20 P99.99: 3368.09 ------------------------------------------------------ [ 0, 1 ] 8951 10.843% 10.843% ## ( 1, 2 ] 53076 64.293% 75.136% ############# ( 2, 3 ] 11475 13.900% 89.036% ### ( 3, 4 ] 4595 5.566% 94.602% # ( 4, 6 ] 3545 4.294% 98.896% # ( 6, 10 ] 572 0.693% 99.589% ( 10, 15 ] 127 0.154% 99.743% ( 15, 22 ] 27 0.033% 99.776% ( 22, 34 ] 27 0.033% 99.809% ( 34, 51 ] 20 0.024% 99.833% ( 51, 76 ] 4 0.005% 99.838% ( 76, 110 ] 23 0.028% 99.866% ( 110, 170 ] 34 0.041% 99.907% ( 170, 250 ] 15 0.018% 99.925% ( 250, 380 ] 6 0.007% 99.932% ( 380, 580 ] 9 0.011% 99.943% ( 580, 870 ] 17 0.021% 99.964% ( 870, 1300 ] 8 0.010% 99.973% ( 1300, 1900 ] 1 0.001% 99.975% ( 1900, 2900 ] 9 0.011% 99.985% ( 2900, 4400 ] 12 0.015% 100.000% ** Level 4 read latency histogram (micros): Count: 85 Average: 323.2824 StdDev: 844.16 Min: 1 Median: 2.1667 Max: 3914 Percentiles: P50: 2.17 P75: 32.33 P99: 3914.00 P99.9: 3914.00 P99.99: 3914.00 ------------------------------------------------------ [ 0, 1 ] 20 23.529% 23.529% ##### ( 1, 2 ] 22 25.882% 49.412% ##### ( 2, 3 ] 3 3.529% 52.941% # ( 3, 4 ] 1 1.176% 54.118% ( 6, 10 ] 10 11.765% 65.882% ## ( 22, 34 ] 9 10.588% 76.471% ## ( 34, 51 ] 4 4.706% 81.176% # ( 170, 250 ] 1 1.176% 82.353% ( 380, 580 ] 3 3.529% 85.882% # ( 580, 870 ] 2 2.353% 88.235% ( 870, 1300 ] 2 2.353% 90.588% ( 1900, 2900 ] 5 5.882% 96.471% # ( 2900, 4400 ] 3 3.529% 100.000% # ** Level 5 read latency histogram (micros): Count: 80 Average: 657.7375 StdDev: 807.22 Min: 76 Median: 186.0000 Max: 3275 Percentiles: P50: 186.00 P75: 833.75 P99: 3275.00 P99.9: 3275.00 P99.99: 3275.00 ------------------------------------------------------ ( 51, 76 ] 1 1.250% 1.250% ( 76, 110 ] 12 15.000% 16.250% ### ( 110, 170 ] 26 32.500% 48.750% ####### ( 170, 250 ] 5 6.250% 55.000% # ( 250, 380 ] 3 3.750% 58.750% # ( 380, 580 ] 6 7.500% 66.250% ## ( 580, 870 ] 8 10.000% 76.250% ## ( 870, 1300 ] 3 3.750% 80.000% # ( 1300, 1900 ] 4 5.000% 85.000% # ( 1900, 2900 ] 10 12.500% 97.500% ### ( 2900, 4400 ] 2 2.500% 100.000% # ** DB Stats ** Uptime(secs): 18.5 total, 6.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 265.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.260 H:M:S, 28.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 155.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.673 H:M:S, 58.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/21-06:49:19 ... thread 0: (1000000,6000000) ops and (261292.9,270496.8) ops/second in (3.827123,22.181405) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/14 2.70 GB 0.0 4.1 0.0 4.1 9.7 5.7 0.0 1.7 126.2 302.0 32.94 30.31 94 0.350 4221K 5230 0.0 0.0 L1 6/6 633.53 MB 0.0 3.1 2.8 0.4 3.1 2.7 0.2 1.1 234.0 232.4 13.78 13.31 4 3.445 3273K 20K 0.0 0.0 L2 1/1 128.78 MB 0.0 0.2 0.1 0.1 0.2 0.1 2.2 1.5 259.3 259.2 0.73 0.71 1 0.729 191K 79 0.0 0.0 L3 22/4 1.14 GB 1.0 2.7 1.7 1.0 2.7 1.7 0.6 1.6 199.5 198.9 13.75 12.28 8 1.719 2786K 7894 0.0 0.0 L4 168/2 9.63 GB 1.0 0.9 0.7 0.2 0.9 0.7 1.3 1.2 136.5 135.9 6.75 4.29 11 0.614 896K 2980 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1275/27 101.76 GB 0.0 11.0 5.3 5.7 16.6 10.9 6.3 2.9 165.4 250.1 67.95 60.90 118 0.576 11M 36K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.0 5.3 5.7 16.6 10.9 5.9 2.9 165.4 250.1 67.95 60.90 118 0.576 11M 36K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.0 5.3 5.7 10.9 5.3 0.0 0.0 221.1 220.4 50.81 46.10 38 1.337 11M 36K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 338.1 17.14 14.80 80 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.4 total, 22.2 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.59 GB write, 759.61 MB/s write, 10.97 GB read, 502.25 MB/s read, 68.0 seconds Interval compaction: 16.59 GB write, 766.04 MB/s write, 10.97 GB read, 506.50 MB/s read, 68.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 21, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1909634 Average: 2.2295 StdDev: 13.16 Min: 0 Median: 1.4532 Max: 4220 Percentiles: P50: 1.45 P75: 1.84 P99: 5.71 P99.9: 10.57 P99.99: 123.04 ------------------------------------------------------ [ 0, 1 ] 397316 20.806% 20.806% #### ( 1, 2 ] 1230136 64.417% 85.223% ############# ( 2, 3 ] 154189 8.074% 93.298% ## ( 3, 4 ] 70073 3.669% 96.967% # ( 4, 6 ] 45333 2.374% 99.341% ( 6, 10 ] 10511 0.550% 99.891% ( 10, 15 ] 1466 0.077% 99.968% ( 15, 22 ] 198 0.010% 99.978% ( 22, 34 ] 21 0.001% 99.980% ( 34, 51 ] 6 0.000% 99.980% ( 51, 76 ] 23 0.001% 99.981% ( 76, 110 ] 119 0.006% 99.987% ( 110, 170 ] 244 0.013% 100.000% ( 170, 250 ] 183 0.010% 100.010% ( 250, 380 ] 113 0.006% 100.016% ( 380, 580 ] 97 0.005% 100.021% ( 580, 870 ] 59 0.003% 100.024% ( 870, 1300 ] 31 0.002% 100.025% ( 1300, 1900 ] 13 0.001% 100.026% ( 1900, 2900 ] 6 0.000% 100.026% ( 2900, 4400 ] 13 0.001% 100.027% ** Level 1 read latency histogram (micros): Count: 590102 Average: 3.2759 StdDev: 31.42 Min: 0 Median: 1.7014 Max: 7587 Percentiles: P50: 1.70 P75: 2.44 P99: 8.47 P99.9: 19.96 P99.99: 192.25 ------------------------------------------------------ [ 0, 1 ] 46089 7.810% 7.810% ## ( 1, 2 ] 354940 60.149% 67.959% ############ ( 2, 3 ] 94905 16.083% 84.042% ### ( 3, 4 ] 43052 7.296% 91.338% # ( 4, 6 ] 39511 6.696% 98.033% # ( 6, 10 ] 9251 1.568% 99.601% ( 10, 15 ] 1654 0.280% 99.881% ( 15, 22 ] 155 0.026% 99.908% ( 22, 34 ] 21 0.004% 99.911% ( 34, 51 ] 2 0.000% 99.912% ( 51, 76 ] 3 0.001% 99.912% ( 76, 110 ] 154 0.026% 99.938% ( 110, 170 ] 264 0.045% 99.983% ( 170, 250 ] 151 0.026% 100.008% ( 250, 380 ] 152 0.026% 100.034% ( 380, 580 ] 126 0.021% 100.056% ( 580, 870 ] 95 0.016% 100.072% ( 870, 1300 ] 42 0.007% 100.079% ( 1300, 1900 ] 11 0.002% 100.081% ( 1900, 2900 ] 16 0.003% 100.083% ( 2900, 4400 ] 10 0.002% 100.085% ( 4400, 6600 ] 1 0.000% 100.085% ( 6600, 9900 ] 3 0.001% 100.086% ** Level 2 read latency histogram (micros): Count: 76261 Average: 3.8118 StdDev: 40.12 Min: 0 Median: 1.5585 Max: 3782 Percentiles: P50: 1.56 P75: 1.97 P99: 8.44 P99.9: 493.04 P99.99: 1853.04 ------------------------------------------------------ [ 0, 1 ] 12096 15.861% 15.861% ### ( 1, 2 ] 46612 61.122% 76.983% ############ ( 2, 3 ] 8714 11.427% 88.410% ## ( 3, 4 ] 4162 5.458% 93.867% # ( 4, 6 ] 3344 4.385% 98.252% # ( 6, 10 ] 936 1.227% 99.479% ( 10, 15 ] 147 0.193% 99.672% ( 15, 22 ] 21 0.028% 99.700% ( 22, 34 ] 1 0.001% 99.701% ( 51, 76 ] 1 0.001% 99.702% ( 76, 110 ] 13 0.017% 99.719% ( 110, 170 ] 29 0.038% 99.757% ( 170, 250 ] 42 0.055% 99.812% ( 250, 380 ] 43 0.056% 99.869% ( 380, 580 ] 42 0.055% 99.924% ( 580, 870 ] 29 0.038% 99.962% ( 870, 1300 ] 14 0.018% 99.980% ( 1300, 1900 ] 8 0.010% 99.991% ( 1900, 2900 ] 6 0.008% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 402166 Average: 5.5575 StdDev: 68.40 Min: 0 Median: 1.7844 Max: 9557 Percentiles: P50: 1.78 P75: 2.70 P99: 8.91 P99.9: 291.88 P99.99: 508.92 ------------------------------------------------------ [ 0, 1 ] 22215 5.524% 5.524% # ( 1, 2 ] 228032 56.701% 62.225% ########### ( 2, 3 ] 73135 18.185% 80.410% #### ( 3, 4 ] 35719 8.882% 89.292% ## ( 4, 6 ] 34334 8.537% 97.829% ## ( 6, 10 ] 6479 1.611% 99.440% ( 10, 15 ] 1128 0.280% 99.721% ( 15, 22 ] 117 0.029% 99.750% ( 22, 34 ] 37 0.009% 99.759% ( 34, 51 ] 23 0.006% 99.765% ( 51, 76 ] 7 0.002% 99.766% ( 76, 110 ] 85 0.021% 99.787% ( 110, 170 ] 193 0.048% 99.835% ( 170, 250 ] 188 0.047% 99.882% ( 250, 380 ] 223 0.055% 99.938% ( 380, 580 ] 327 0.081% 100.019% ( 580, 870 ] 309 0.077% 100.096% ( 870, 1300 ] 149 0.037% 100.133% ( 1300, 1900 ] 70 0.017% 100.150% ( 1900, 2900 ] 49 0.012% 100.162% ( 2900, 4400 ] 57 0.014% 100.177% ( 4400, 6600 ] 5 0.001% 100.178% ( 6600, 9900 ] 3 0.001% 100.179% ** Level 4 read latency histogram (micros): Count: 210 Average: 217.3810 StdDev: 659.22 Min: 0 Median: 2.2174 Max: 4167 Percentiles: P50: 2.22 P75: 30.67 P99: 3612.50 P99.9: 4167.00 P99.99: 4167.00 ------------------------------------------------------ [ 0, 1 ] 40 19.048% 19.048% #### ( 1, 2 ] 60 28.571% 47.619% ###### ( 2, 3 ] 23 10.952% 58.571% ## ( 3, 4 ] 6 2.857% 61.429% # ( 4, 6 ] 4 1.905% 63.333% ( 6, 10 ] 10 4.762% 68.095% # ( 10, 15 ] 3 1.429% 69.524% ( 15, 22 ] 5 2.381% 71.905% ( 22, 34 ] 9 4.286% 76.190% # ( 34, 51 ] 5 2.381% 78.571% ( 110, 170 ] 16 7.619% 86.190% ## ( 170, 250 ] 2 0.952% 87.143% ( 250, 380 ] 2 0.952% 88.095% ( 380, 580 ] 3 1.429% 89.524% ( 580, 870 ] 5 2.381% 91.905% ( 870, 1300 ] 4 1.905% 93.810% ( 1300, 1900 ] 3 1.429% 95.238% ( 1900, 2900 ] 6 2.857% 98.095% # ( 2900, 4400 ] 4 1.905% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 714.9667 StdDev: 869.63 Min: 76 Median: 263.0000 Max: 3897 Percentiles: P50: 263.00 P75: 977.50 P99: 3897.00 P99.9: 3897.00 P99.99: 3897.00 ------------------------------------------------------ ( 51, 76 ] 1 0.833% 0.833% ( 76, 110 ] 20 16.667% 17.500% ### ( 110, 170 ] 28 23.333% 40.833% ##### ( 170, 250 ] 10 8.333% 49.167% ## ( 250, 380 ] 10 8.333% 57.500% ## ( 380, 580 ] 10 8.333% 65.833% ## ( 580, 870 ] 10 8.333% 74.167% ## ( 870, 1300 ] 4 3.333% 77.500% # ( 1300, 1900 ] 8 6.667% 84.167% # ( 1900, 2900 ] 15 12.500% 96.667% ### ( 2900, 4400 ] 4 3.333% 100.000% # ** DB Stats ** Uptime(secs): 22.4 total, 3.8 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 263.97 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.304 H:M:S, 28.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 257.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.044 H:M:S, 27.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/21-06:49:23 ... thread 0: (1000000,7000000) ops and (291252.8,273279.0) ops/second in (3.433443,25.614848) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 3.69 GB 107.0 5.0 0.0 5.0 11.6 6.6 0.0 1.7 128.2 298.9 39.81 36.54 111 0.359 5180K 6314 0.0 0.0 L1 6/6 633.53 MB 0.0 3.1 2.8 0.4 3.1 2.7 0.2 1.1 234.0 232.4 13.78 13.31 4 3.445 3273K 20K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 2.2 1.5 259.3 259.2 0.73 0.71 1 0.729 191K 79 0.0 0.0 L3 18/0 926.26 MB 0.9 2.9 1.8 1.1 2.9 1.8 0.6 1.6 201.4 200.8 14.92 13.40 9 1.658 3051K 8630 0.0 0.0 L4 169/0 9.68 GB 1.0 1.4 1.1 0.3 1.4 1.1 1.3 1.2 144.7 144.1 9.63 6.44 16 0.602 1375K 5290 0.0 0.0 L5 1068/0 87.85 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1280/20 102.74 GB 0.0 12.6 5.8 6.8 19.2 12.4 6.6 2.9 163.7 249.5 78.87 70.40 141 0.559 13M 40K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.6 5.8 6.8 19.2 12.4 6.2 2.9 163.7 249.5 78.87 70.40 141 0.559 13M 40K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.6 5.8 6.8 12.6 5.8 0.0 0.0 220.3 219.6 58.62 52.95 47 1.247 13M 40K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 336.1 20.25 17.45 94 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.8 total, 25.6 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.21 GB write, 762.47 MB/s write, 12.61 GB read, 500.45 MB/s read, 78.9 seconds Interval compaction: 19.21 GB write, 768.05 MB/s write, 12.61 GB read, 504.12 MB/s read, 78.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 29, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2365729 Average: 2.2879 StdDev: 14.16 Min: 0 Median: 1.4769 Max: 4220 Percentiles: P50: 1.48 P75: 1.87 P99: 5.82 P99.9: 10.79 P99.99: 95.29 ------------------------------------------------------ [ 0, 1 ] 456465 19.295% 19.295% #### ( 1, 2 ] 1523218 64.387% 83.682% ############# ( 2, 3 ] 208581 8.817% 92.499% ## ( 3, 4 ] 94562 3.997% 96.496% # ( 4, 6 ] 65028 2.749% 99.244% # ( 6, 10 ] 15191 0.642% 99.887% ( 10, 15 ] 2023 0.086% 99.972% ( 15, 22 ] 241 0.010% 99.982% ( 22, 34 ] 33 0.001% 99.984% ( 34, 51 ] 8 0.000% 99.984% ( 51, 76 ] 27 0.001% 99.985% ( 76, 110 ] 207 0.009% 99.994% ( 110, 170 ] 308 0.013% 100.007% ( 170, 250 ] 222 0.009% 100.016% ( 250, 380 ] 155 0.007% 100.023% ( 380, 580 ] 124 0.005% 100.028% ( 580, 870 ] 72 0.003% 100.031% ( 870, 1300 ] 40 0.002% 100.033% ( 1300, 1900 ] 15 0.001% 100.033% ( 1900, 2900 ] 9 0.000% 100.034% ( 2900, 4400 ] 19 0.001% 100.035% ** Level 1 read latency histogram (micros): Count: 618637 Average: 3.2393 StdDev: 30.69 Min: 0 Median: 1.6984 Max: 7587 Percentiles: P50: 1.70 P75: 2.42 P99: 8.47 P99.9: 18.94 P99.99: 191.26 ------------------------------------------------------ [ 0, 1 ] 48049 7.767% 7.767% ## ( 1, 2 ] 374094 60.471% 68.238% ############ ( 2, 3 ] 98937 15.993% 84.230% ### ( 3, 4 ] 44587 7.207% 91.438% # ( 4, 6 ] 40759 6.589% 98.026% # ( 6, 10 ] 9775 1.580% 99.606% ( 10, 15 ] 1725 0.279% 99.885% ( 15, 22 ] 164 0.027% 99.912% ( 22, 34 ] 21 0.003% 99.915% ( 34, 51 ] 3 0.000% 99.915% ( 51, 76 ] 3 0.000% 99.916% ( 76, 110 ] 154 0.025% 99.941% ( 110, 170 ] 264 0.043% 99.984% ( 170, 250 ] 151 0.024% 100.008% ( 250, 380 ] 153 0.025% 100.033% ( 380, 580 ] 126 0.020% 100.053% ( 580, 870 ] 95 0.015% 100.068% ( 870, 1300 ] 42 0.007% 100.075% ( 1300, 1900 ] 11 0.002% 100.077% ( 1900, 2900 ] 16 0.003% 100.080% ( 2900, 4400 ] 10 0.002% 100.081% ( 4400, 6600 ] 1 0.000% 100.081% ( 6600, 9900 ] 3 0.000% 100.082% ** Level 2 read latency histogram (micros): Count: 76261 Average: 3.8118 StdDev: 40.12 Min: 0 Median: 1.5585 Max: 3782 Percentiles: P50: 1.56 P75: 1.97 P99: 8.44 P99.9: 493.04 P99.99: 1853.04 ------------------------------------------------------ [ 0, 1 ] 12096 15.861% 15.861% ### ( 1, 2 ] 46612 61.122% 76.983% ############ ( 2, 3 ] 8714 11.427% 88.410% ## ( 3, 4 ] 4162 5.458% 93.867% # ( 4, 6 ] 3344 4.385% 98.252% # ( 6, 10 ] 936 1.227% 99.479% ( 10, 15 ] 147 0.193% 99.672% ( 15, 22 ] 21 0.028% 99.700% ( 22, 34 ] 1 0.001% 99.701% ( 51, 76 ] 1 0.001% 99.702% ( 76, 110 ] 13 0.017% 99.719% ( 110, 170 ] 29 0.038% 99.757% ( 170, 250 ] 42 0.055% 99.812% ( 250, 380 ] 43 0.056% 99.869% ( 380, 580 ] 42 0.055% 99.924% ( 580, 870 ] 29 0.038% 99.962% ( 870, 1300 ] 14 0.018% 99.980% ( 1300, 1900 ] 8 0.010% 99.991% ( 1900, 2900 ] 6 0.008% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 518849 Average: 5.5847 StdDev: 69.95 Min: 0 Median: 1.7965 Max: 9557 Percentiles: P50: 1.80 P75: 2.74 P99: 8.82 P99.9: 309.00 P99.99: 518.84 ------------------------------------------------------ [ 0, 1 ] 27030 5.210% 5.210% # ( 1, 2 ] 291767 56.234% 61.443% ########### ( 2, 3 ] 95647 18.434% 79.878% #### ( 3, 4 ] 47771 9.207% 89.085% ## ( 4, 6 ] 45792 8.826% 97.910% ## ( 6, 10 ] 8006 1.543% 99.453% ( 10, 15 ] 1298 0.250% 99.704% ( 15, 22 ] 133 0.026% 99.729% ( 22, 34 ] 39 0.008% 99.737% ( 34, 51 ] 23 0.004% 99.741% ( 51, 76 ] 7 0.001% 99.743% ( 76, 110 ] 115 0.022% 99.765% ( 110, 170 ] 282 0.054% 99.819% ( 170, 250 ] 279 0.054% 99.873% ( 250, 380 ] 311 0.060% 99.933% ( 380, 580 ] 428 0.082% 100.015% ( 580, 870 ] 377 0.073% 100.088% ( 870, 1300 ] 172 0.033% 100.121% ( 1300, 1900 ] 81 0.016% 100.137% ( 1900, 2900 ] 57 0.011% 100.148% ( 2900, 4400 ] 84 0.016% 100.164% ( 4400, 6600 ] 9 0.002% 100.166% ( 6600, 9900 ] 3 0.001% 100.166% ** Level 4 read latency histogram (micros): Count: 285 Average: 186.5930 StdDev: 582.42 Min: 0 Median: 2.2838 Max: 4167 Percentiles: P50: 2.28 P75: 30.10 P99: 3331.25 P99.9: 4167.00 P99.99: 4167.00 ------------------------------------------------------ [ 0, 1 ] 54 18.947% 18.947% #### ( 1, 2 ] 78 27.368% 46.316% ##### ( 2, 3 ] 37 12.982% 59.298% ### ( 3, 4 ] 8 2.807% 62.105% # ( 4, 6 ] 5 1.754% 63.860% ( 6, 10 ] 14 4.912% 68.772% # ( 10, 15 ] 5 1.754% 70.526% ( 15, 22 ] 6 2.105% 72.632% ( 22, 34 ] 10 3.509% 76.140% # ( 34, 51 ] 5 1.754% 77.895% ( 110, 170 ] 25 8.772% 86.667% ## ( 170, 250 ] 4 1.404% 88.070% ( 250, 380 ] 2 0.702% 88.772% ( 380, 580 ] 6 2.105% 90.877% ( 580, 870 ] 6 2.105% 92.982% ( 870, 1300 ] 6 2.105% 95.088% ( 1300, 1900 ] 4 1.404% 96.491% ( 1900, 2900 ] 6 2.105% 98.596% ( 2900, 4400 ] 4 1.404% 100.000% ** Level 5 read latency histogram (micros): Count: 140 Average: 761.7000 StdDev: 962.99 Min: 76 Median: 315.0000 Max: 5469 Percentiles: P50: 315.00 P75: 1054.29 P99: 4280.00 P99.9: 5469.00 P99.99: 5469.00 ------------------------------------------------------ ( 51, 76 ] 1 0.714% 0.714% ( 76, 110 ] 22 15.714% 16.429% ### ( 110, 170 ] 30 21.429% 37.857% #### ( 170, 250 ] 11 7.857% 45.714% ## ( 250, 380 ] 12 8.571% 54.286% ## ( 380, 580 ] 15 10.714% 65.000% ## ( 580, 870 ] 11 7.857% 72.857% ## ( 870, 1300 ] 7 5.000% 77.857% # ( 1300, 1900 ] 8 5.714% 83.571% # ( 1900, 2900 ] 17 12.143% 95.714% ## ( 2900, 4400 ] 5 3.571% 99.286% # ( 4400, 6600 ] 1 0.714% 100.000% ** DB Stats ** Uptime(secs): 25.8 total, 3.4 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 266.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.010 H:M:S, 27.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 286.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.706 H:M:S, 20.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/21-06:49:30 ... thread 0: (1000000,8000000) ops and (133088.1,241482.7) ops/second in (7.513820,33.128668) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 4.61 GB 207.4 6.8 0.0 6.8 14.4 7.6 0.0 1.9 140.6 296.3 49.71 46.01 131 0.379 7099K 9941 0.0 0.0 L1 6/6 633.53 MB 0.0 3.1 2.8 0.4 3.1 2.7 0.2 1.1 234.0 232.4 13.78 13.31 4 3.445 3273K 20K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 2.2 1.5 259.3 259.2 0.73 0.71 1 0.729 191K 79 0.0 0.0 L3 18/0 926.26 MB 0.9 2.9 1.8 1.1 2.9 1.8 0.6 1.6 201.4 200.8 14.92 13.40 9 1.658 3051K 8630 0.0 0.0 L4 169/0 9.68 GB 1.0 1.4 1.1 0.3 1.4 1.1 1.3 1.2 144.7 144.1 9.63 6.44 16 0.602 1375K 5290 0.0 0.0 L5 1068/0 87.85 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1280/20 103.66 GB 0.0 14.5 5.8 8.7 22.0 13.3 6.6 2.9 166.8 253.5 88.77 79.86 161 0.551 14M 44K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.5 5.8 8.7 22.0 13.3 6.2 2.9 166.8 253.5 88.77 79.86 161 0.551 14M 44K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.5 5.8 8.7 14.4 5.8 0.0 0.0 225.2 224.5 65.74 59.94 52 1.264 14M 44K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 336.5 23.03 19.92 109 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 33.3 total, 33.1 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.98 GB write, 675.47 MB/s write, 14.46 GB read, 444.30 MB/s read, 88.8 seconds Interval compaction: 21.98 GB write, 679.30 MB/s write, 14.46 GB read, 446.81 MB/s read, 88.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 29, interval: 47 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3123839 Average: 2.2722 StdDev: 13.01 Min: 0 Median: 1.4696 Max: 4220 Percentiles: P50: 1.47 P75: 1.85 P99: 5.84 P99.9: 11.28 P99.99: 116.09 ------------------------------------------------------ [ 0, 1 ] 605846 19.394% 19.394% #### ( 1, 2 ] 2035807 65.170% 84.564% ############# ( 2, 3 ] 262734 8.411% 92.975% ## ( 3, 4 ] 117015 3.746% 96.721% # ( 4, 6 ] 77513 2.481% 99.202% ( 6, 10 ] 21149 0.677% 99.879% ( 10, 15 ] 2552 0.082% 99.961% ( 15, 22 ] 283 0.009% 99.970% ( 22, 34 ] 38 0.001% 99.971% ( 34, 51 ] 10 0.000% 99.971% ( 51, 76 ] 31 0.001% 99.972% ( 76, 110 ] 489 0.016% 99.988% ( 110, 170 ] 597 0.019% 100.007% ( 170, 250 ] 303 0.010% 100.017% ( 250, 380 ] 209 0.007% 100.024% ( 380, 580 ] 158 0.005% 100.029% ( 580, 870 ] 89 0.003% 100.031% ( 870, 1300 ] 47 0.002% 100.033% ( 1300, 1900 ] 16 0.001% 100.034% ( 1900, 2900 ] 11 0.000% 100.034% ( 2900, 4400 ] 19 0.001% 100.034% ** Level 1 read latency histogram (micros): Count: 746976 Average: 3.0950 StdDev: 28.10 Min: 0 Median: 1.6577 Max: 7587 Percentiles: P50: 1.66 P75: 2.26 P99: 8.41 P99.9: 77.73 P99.99: 204.74 ------------------------------------------------------ [ 0, 1 ] 68782 9.208% 9.208% ## ( 1, 2 ] 463289 62.022% 71.230% ############ ( 2, 3 ] 109063 14.601% 85.831% ### ( 3, 4 ] 48412 6.481% 92.312% # ( 4, 6 ] 42877 5.740% 98.052% # ( 6, 10 ] 11745 1.572% 99.624% ( 10, 15 ] 1834 0.246% 99.870% ( 15, 22 ] 170 0.023% 99.892% ( 22, 34 ] 21 0.003% 99.895% ( 34, 51 ] 5 0.001% 99.896% ( 51, 76 ] 16 0.002% 99.898% ( 76, 110 ] 295 0.039% 99.937% ( 110, 170 ] 315 0.042% 99.980% ( 170, 250 ] 178 0.024% 100.003% ( 250, 380 ] 166 0.022% 100.026% ( 380, 580 ] 135 0.018% 100.044% ( 580, 870 ] 96 0.013% 100.057% ( 870, 1300 ] 42 0.006% 100.062% ( 1300, 1900 ] 11 0.001% 100.064% ( 1900, 2900 ] 16 0.002% 100.066% ( 2900, 4400 ] 10 0.001% 100.067% ( 4400, 6600 ] 1 0.000% 100.067% ( 6600, 9900 ] 3 0.000% 100.068% ** Level 2 read latency histogram (micros): Count: 76261 Average: 3.8118 StdDev: 40.12 Min: 0 Median: 1.5585 Max: 3782 Percentiles: P50: 1.56 P75: 1.97 P99: 8.44 P99.9: 493.04 P99.99: 1853.04 ------------------------------------------------------ [ 0, 1 ] 12096 15.861% 15.861% ### ( 1, 2 ] 46612 61.122% 76.983% ############ ( 2, 3 ] 8714 11.427% 88.410% ## ( 3, 4 ] 4162 5.458% 93.867% # ( 4, 6 ] 3344 4.385% 98.252% # ( 6, 10 ] 936 1.227% 99.479% ( 10, 15 ] 147 0.193% 99.672% ( 15, 22 ] 21 0.028% 99.700% ( 22, 34 ] 1 0.001% 99.701% ( 51, 76 ] 1 0.001% 99.702% ( 76, 110 ] 13 0.017% 99.719% ( 110, 170 ] 29 0.038% 99.757% ( 170, 250 ] 42 0.055% 99.812% ( 250, 380 ] 43 0.056% 99.869% ( 380, 580 ] 42 0.055% 99.924% ( 580, 870 ] 29 0.038% 99.962% ( 870, 1300 ] 14 0.018% 99.980% ( 1300, 1900 ] 8 0.010% 99.991% ( 1900, 2900 ] 6 0.008% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 518849 Average: 5.5847 StdDev: 69.95 Min: 0 Median: 1.7965 Max: 9557 Percentiles: P50: 1.80 P75: 2.74 P99: 8.82 P99.9: 309.00 P99.99: 518.84 ------------------------------------------------------ [ 0, 1 ] 27030 5.210% 5.210% # ( 1, 2 ] 291767 56.234% 61.443% ########### ( 2, 3 ] 95647 18.434% 79.878% #### ( 3, 4 ] 47771 9.207% 89.085% ## ( 4, 6 ] 45792 8.826% 97.910% ## ( 6, 10 ] 8006 1.543% 99.453% ( 10, 15 ] 1298 0.250% 99.704% ( 15, 22 ] 133 0.026% 99.729% ( 22, 34 ] 39 0.008% 99.737% ( 34, 51 ] 23 0.004% 99.741% ( 51, 76 ] 7 0.001% 99.743% ( 76, 110 ] 115 0.022% 99.765% ( 110, 170 ] 282 0.054% 99.819% ( 170, 250 ] 279 0.054% 99.873% ( 250, 380 ] 311 0.060% 99.933% ( 380, 580 ] 428 0.082% 100.015% ( 580, 870 ] 377 0.073% 100.088% ( 870, 1300 ] 172 0.033% 100.121% ( 1300, 1900 ] 81 0.016% 100.137% ( 1900, 2900 ] 57 0.011% 100.148% ( 2900, 4400 ] 84 0.016% 100.164% ( 4400, 6600 ] 9 0.002% 100.166% ( 6600, 9900 ] 3 0.001% 100.166% ** Level 4 read latency histogram (micros): Count: 285 Average: 186.5930 StdDev: 582.42 Min: 0 Median: 2.2838 Max: 4167 Percentiles: P50: 2.28 P75: 30.10 P99: 3331.25 P99.9: 4167.00 P99.99: 4167.00 ------------------------------------------------------ [ 0, 1 ] 54 18.947% 18.947% #### ( 1, 2 ] 78 27.368% 46.316% ##### ( 2, 3 ] 37 12.982% 59.298% ### ( 3, 4 ] 8 2.807% 62.105% # ( 4, 6 ] 5 1.754% 63.860% ( 6, 10 ] 14 4.912% 68.772% # ( 10, 15 ] 5 1.754% 70.526% ( 15, 22 ] 6 2.105% 72.632% ( 22, 34 ] 10 3.509% 76.140% # ( 34, 51 ] 5 1.754% 77.895% ( 110, 170 ] 25 8.772% 86.667% ## ( 170, 250 ] 4 1.404% 88.070% ( 250, 380 ] 2 0.702% 88.772% ( 380, 580 ] 6 2.105% 90.877% ( 580, 870 ] 6 2.105% 92.982% ( 870, 1300 ] 6 2.105% 95.088% ( 1300, 1900 ] 4 1.404% 96.491% ( 1900, 2900 ] 6 2.105% 98.596% ( 2900, 4400 ] 4 1.404% 100.000% ** Level 5 read latency histogram (micros): Count: 140 Average: 761.7000 StdDev: 962.99 Min: 76 Median: 315.0000 Max: 5469 Percentiles: P50: 315.00 P75: 1054.29 P99: 4280.00 P99.9: 5469.00 P99.99: 5469.00 ------------------------------------------------------ ( 51, 76 ] 1 0.714% 0.714% ( 76, 110 ] 22 15.714% 16.429% ### ( 110, 170 ] 30 21.429% 37.857% #### ( 170, 250 ] 11 7.857% 45.714% ## ( 250, 380 ] 12 8.571% 54.286% ## ( 380, 580 ] 15 10.714% 65.000% ## ( 580, 870 ] 11 7.857% 72.857% ## ( 870, 1300 ] 7 5.000% 77.857% # ( 1300, 1900 ] 8 5.714% 83.571% # ( 1900, 2900 ] 17 12.143% 95.714% ## ( 2900, 4400 ] 5 3.571% 99.286% # ( 4400, 6600 ] 1 0.714% 100.000% ** DB Stats ** Uptime(secs): 33.3 total, 7.5 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 236.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.847 H:M:S, 35.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 130.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.837 H:M:S, 64.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/21-06:49:36 ... thread 0: (1000000,9000000) ops and (168349.4,230363.5) ops/second in (5.940028,39.068696) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/13 3.26 GB 50.3 7.6 0.0 7.6 16.1 8.5 0.0 1.9 139.4 296.8 55.57 51.45 149 0.373 7866K 10K 0.0 0.0 L1 19/19 2.25 GB 0.0 6.1 5.1 1.0 6.0 5.0 0.2 1.2 226.9 224.6 27.54 26.24 5 5.508 6344K 61K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 2.8 1.5 259.3 259.2 0.73 0.71 1 0.729 191K 79 0.0 0.0 L3 17/0 978.30 MB 1.0 3.6 2.2 1.4 3.6 2.2 0.9 1.6 203.0 202.2 18.11 16.33 12 1.509 3733K 14K 0.0 0.0 L4 169/0 9.60 GB 1.0 2.1 1.7 0.4 2.1 1.7 1.3 1.2 158.5 157.8 13.43 9.81 25 0.537 2123K 9404 0.0 0.0 L5 1076/0 88.52 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1296/32 104.59 GB 0.0 19.5 9.1 10.4 28.0 17.6 8.2 3.3 173.2 248.3 115.39 104.54 192 0.601 20M 95K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.5 9.1 10.4 28.0 17.6 7.8 3.3 173.2 248.3 115.39 104.54 192 0.601 20M 95K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.5 9.1 10.4 19.4 9.0 0.0 0.0 223.7 222.6 89.38 81.99 68 1.314 20M 95K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 336.7 26.01 22.54 124 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.3 total, 39.1 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.98 GB write, 729.77 MB/s write, 19.52 GB read, 509.19 MB/s read, 115.4 seconds Interval compaction: 27.98 GB write, 733.27 MB/s write, 19.52 GB read, 511.64 MB/s read, 115.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 20, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 20, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 30, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 35, total-stops: 30, interval: 65 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3561734 Average: 2.3228 StdDev: 13.88 Min: 0 Median: 1.4791 Max: 4312 Percentiles: P50: 1.48 P75: 1.86 P99: 5.91 P99.9: 12.11 P99.99: 135.07 ------------------------------------------------------ [ 0, 1 ] 668963 18.782% 18.782% #### ( 1, 2 ] 2321018 65.165% 83.947% ############# ( 2, 3 ] 308998 8.675% 92.623% ## ( 3, 4 ] 137289 3.855% 96.477% # ( 4, 6 ] 94116 2.642% 99.120% # ( 6, 10 ] 26359 0.740% 99.860% ( 10, 15 ] 3399 0.095% 99.955% ( 15, 22 ] 358 0.010% 99.965% ( 22, 34 ] 45 0.001% 99.967% ( 34, 51 ] 13 0.000% 99.967% ( 51, 76 ] 32 0.001% 99.968% ( 76, 110 ] 507 0.014% 99.982% ( 110, 170 ] 677 0.019% 100.001% ( 170, 250 ] 376 0.011% 100.012% ( 250, 380 ] 304 0.009% 100.020% ( 380, 580 ] 219 0.006% 100.026% ( 580, 870 ] 149 0.004% 100.031% ( 870, 1300 ] 68 0.002% 100.032% ( 1300, 1900 ] 24 0.001% 100.033% ( 1900, 2900 ] 15 0.000% 100.034% ( 2900, 4400 ] 22 0.001% 100.034% ** Level 1 read latency histogram (micros): Count: 913985 Average: 3.1164 StdDev: 27.39 Min: 0 Median: 1.6344 Max: 7587 Percentiles: P50: 1.63 P75: 2.14 P99: 8.50 P99.9: 113.96 P99.99: 290.51 ------------------------------------------------------ [ 0, 1 ] 92111 10.078% 10.078% ## ( 1, 2 ] 575193 62.932% 73.010% ############# ( 2, 3 ] 125816 13.766% 86.776% ### ( 3, 4 ] 54962 6.013% 92.789% # ( 4, 6 ] 47694 5.218% 98.008% # ( 6, 10 ] 14497 1.586% 99.594% ( 10, 15 ] 2124 0.232% 99.826% ( 15, 22 ] 198 0.022% 99.848% ( 22, 34 ] 22 0.002% 99.850% ( 34, 51 ] 6 0.001% 99.851% ( 51, 76 ] 18 0.002% 99.853% ( 76, 110 ] 396 0.043% 99.896% ( 110, 170 ] 531 0.058% 99.954% ( 170, 250 ] 254 0.028% 99.982% ( 250, 380 ] 233 0.025% 100.008% ( 380, 580 ] 189 0.021% 100.028% ( 580, 870 ] 154 0.017% 100.045% ( 870, 1300 ] 53 0.006% 100.051% ( 1300, 1900 ] 11 0.001% 100.052% ( 1900, 2900 ] 17 0.002% 100.054% ( 2900, 4400 ] 12 0.001% 100.055% ( 4400, 6600 ] 1 0.000% 100.055% ( 6600, 9900 ] 3 0.000% 100.056% ** Level 2 read latency histogram (micros): Count: 76261 Average: 3.8118 StdDev: 40.12 Min: 0 Median: 1.5585 Max: 3782 Percentiles: P50: 1.56 P75: 1.97 P99: 8.44 P99.9: 493.04 P99.99: 1853.04 ------------------------------------------------------ [ 0, 1 ] 12096 15.861% 15.861% ### ( 1, 2 ] 46612 61.122% 76.983% ############ ( 2, 3 ] 8714 11.427% 88.410% ## ( 3, 4 ] 4162 5.458% 93.867% # ( 4, 6 ] 3344 4.385% 98.252% # ( 6, 10 ] 936 1.227% 99.479% ( 10, 15 ] 147 0.193% 99.672% ( 15, 22 ] 21 0.028% 99.700% ( 22, 34 ] 1 0.001% 99.701% ( 51, 76 ] 1 0.001% 99.702% ( 76, 110 ] 13 0.017% 99.719% ( 110, 170 ] 29 0.038% 99.757% ( 170, 250 ] 42 0.055% 99.812% ( 250, 380 ] 43 0.056% 99.869% ( 380, 580 ] 42 0.055% 99.924% ( 580, 870 ] 29 0.038% 99.962% ( 870, 1300 ] 14 0.018% 99.980% ( 1300, 1900 ] 8 0.010% 99.991% ( 1900, 2900 ] 6 0.008% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 779176 Average: 5.0797 StdDev: 59.12 Min: 0 Median: 1.7785 Max: 9557 Percentiles: P50: 1.78 P75: 2.69 P99: 9.04 P99.9: 245.89 P99.99: 446.02 ------------------------------------------------------ [ 0, 1 ] 42659 5.475% 5.475% # ( 1, 2 ] 445611 57.190% 62.665% ########### ( 2, 3 ] 138724 17.804% 80.469% #### ( 3, 4 ] 69110 8.870% 89.338% ## ( 4, 6 ] 65403 8.394% 97.732% ## ( 6, 10 ] 12998 1.668% 99.401% ( 10, 15 ] 2108 0.271% 99.671% ( 15, 22 ] 220 0.028% 99.699% ( 22, 34 ] 43 0.006% 99.705% ( 34, 51 ] 23 0.003% 99.708% ( 51, 76 ] 7 0.001% 99.709% ( 76, 110 ] 294 0.038% 99.746% ( 110, 170 ] 714 0.092% 99.838% ( 170, 250 ] 509 0.065% 99.903% ( 250, 380 ] 479 0.061% 99.965% ( 380, 580 ] 594 0.076% 100.041% ( 580, 870 ] 479 0.061% 100.103% ( 870, 1300 ] 204 0.026% 100.129% ( 1300, 1900 ] 82 0.011% 100.139% ( 1900, 2900 ] 59 0.008% 100.147% ( 2900, 4400 ] 86 0.011% 100.158% ( 4400, 6600 ] 9 0.001% 100.159% ( 6600, 9900 ] 3 0.000% 100.159% ** Level 4 read latency histogram (micros): Count: 883 Average: 90.8913 StdDev: 353.53 Min: 0 Median: 3.4899 Max: 4167 Percentiles: P50: 3.49 P75: 8.88 P99: 2095.00 P99.9: 4068.88 P99.99: 4167.00 ------------------------------------------------------ [ 0, 1 ] 75 8.494% 8.494% ## ( 1, 2 ] 145 16.421% 24.915% ### ( 2, 3 ] 173 19.592% 44.507% #### ( 3, 4 ] 99 11.212% 55.719% ## ( 4, 6 ] 114 12.911% 68.630% ### ( 6, 10 ] 78 8.834% 77.463% ## ( 10, 15 ] 13 1.472% 78.935% ( 15, 22 ] 11 1.246% 80.181% ( 22, 34 ] 12 1.359% 81.540% ( 34, 51 ] 5 0.566% 82.106% ( 51, 76 ] 3 0.340% 82.446% ( 76, 110 ] 3 0.340% 82.786% ( 110, 170 ] 66 7.475% 90.260% # ( 170, 250 ] 22 2.492% 92.752% ( 250, 380 ] 16 1.812% 94.564% ( 380, 580 ] 15 1.699% 96.263% ( 580, 870 ] 11 1.246% 97.508% ( 870, 1300 ] 7 0.793% 98.301% ( 1300, 1900 ] 5 0.566% 98.867% ( 1900, 2900 ] 6 0.680% 99.547% ( 2900, 4400 ] 4 0.453% 100.000% ** Level 5 read latency histogram (micros): Count: 180 Average: 754.6278 StdDev: 925.89 Min: 76 Median: 345.3333 Max: 5469 Percentiles: P50: 345.33 P75: 1054.29 P99: 4200.00 P99.9: 5469.00 P99.99: 5469.00 ------------------------------------------------------ ( 51, 76 ] 1 0.556% 0.556% ( 76, 110 ] 26 14.444% 15.000% ### ( 110, 170 ] 36 20.000% 35.000% #### ( 170, 250 ] 16 8.889% 43.889% ## ( 250, 380 ] 15 8.333% 52.222% ## ( 380, 580 ] 23 12.778% 65.000% ### ( 580, 870 ] 15 8.333% 73.333% ## ( 870, 1300 ] 7 3.889% 77.222% # ( 1300, 1900 ] 13 7.222% 84.444% # ( 1900, 2900 ] 21 11.667% 96.111% ## ( 2900, 4400 ] 6 3.333% 99.444% # ( 4400, 6600 ] 1 0.556% 100.000% ** DB Stats ** Uptime(secs): 39.3 total, 5.9 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 225.63 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.986 H:M:S, 38.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 165.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.140 H:M:S, 52.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.227 micros/op 160602 ops/sec 60.167 seconds 9662999 operations; 155.6 MB/s Microseconds per write: Count: 9662999 Average: 6.2266 StdDev: 322.86 Min: 1 Median: 1.7369 Max: 468726 Percentiles: P50: 1.74 P75: 2.76 P99: 9.50 P99.9: 1179.00 P99.99: 2687.66 ------------------------------------------------------ [ 0, 1 ] 1326185 13.724% 13.724% ### ( 1, 2 ] 4756840 49.227% 62.952% ########## ( 2, 3 ] 1523476 15.766% 78.718% ### ( 3, 4 ] 1327980 13.743% 92.461% ### ( 4, 6 ] 529429 5.479% 97.940% # ( 6, 10 ] 117174 1.213% 99.152% ( 10, 15 ] 37566 0.389% 99.541% ( 15, 22 ] 8798 0.091% 99.632% ( 22, 34 ] 1740 0.018% 99.650% ( 34, 51 ] 219 0.002% 99.652% ( 51, 76 ] 24 0.000% 99.653% ( 76, 110 ] 6443 0.067% 99.719% ( 110, 170 ] 2919 0.030% 99.749% ( 170, 250 ] 300 0.003% 99.753% ( 250, 380 ] 158 0.002% 99.754% ( 380, 580 ] 9 0.000% 99.754% ( 580, 870 ] 17 0.000% 99.755% ( 870, 1300 ] 19564 0.202% 99.957% ( 1300, 1900 ] 45 0.000% 99.957% ( 1900, 2900 ] 3995 0.041% 99.999% ( 2900, 4400 ] 85 0.001% 100.000% ( 4400, 6600 ] 10 0.000% 100.000% ( 6600, 9900 ] 2 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 13 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 217059 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9662999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9972214968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 519 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33478863 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30348017767 rocksdb.compact.write.bytes COUNT : 30119254416 rocksdb.flush.write.bytes COUNT : 9842586064 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 43 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 297 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9763198976 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3770368 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30438583352 rocksdb.non.last.level.read.count COUNT : 7354181 rocksdb.block.checksum.compute.count COUNT : 7353186 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.386900 P95 : 3.936140 P99 : 8.144344 P100 : 468724.000000 COUNT : 9662999 SUM : 55682048 rocksdb.compaction.times.micros P50 : 983103.448276 P95 : 2893750.000000 P99 : 22791560.000000 P100 : 22791560.000000 COUNT : 81 SUM : 129025796 rocksdb.compaction.times.cpu_micros P50 : 922333.333333 P95 : 2890000.000000 P99 : 15520000.000000 P100 : 20618519.000000 COUNT : 81 SUM : 113956397 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 677.302632 P95 : 1405.000000 P99 : 20680.000000 P100 : 23019.000000 COUNT : 133 SUM : 170143 rocksdb.compaction.outfile.sync.micros P50 : 875.443038 P95 : 137600.000000 P99 : 231963.636364 P100 : 279546.000000 COUNT : 348 SUM : 6286595 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 96.705128 P95 : 642.833333 P99 : 2076.666667 P100 : 2619.000000 COUNT : 247 SUM : 47976 rocksdb.table.open.io.micros P50 : 1309.890110 P95 : 5662.380952 P99 : 9597.923077 P100 : 10913.000000 COUNT : 519 SUM : 916783 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.604447 P95 : 7.720244 P99 : 11.485542 P100 : 11303.000000 COUNT : 7351919 SUM : 41246085 rocksdb.read.block.get.micros P50 : 430.943396 P95 : 2713.207547 P99 : 4148.157895 P100 : 6733.000000 COUNT : 1038 SUM : 762681 rocksdb.write.raw.block.micros P50 : 0.513212 P95 : 0.975103 P99 : 2.922773 P100 : 15337.000000 COUNT : 9686803 SUM : 18677960 rocksdb.numfiles.in.singlecompaction P50 : 3.168919 P95 : 5.425000 P99 : 18.990000 P100 : 28.000000 COUNT : 143 SUM : 547 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.564117 P95 : 1160.526317 P99 : 2396.122807 P100 : 468531.000000 COUNT : 209047 SUM : 33498726 rocksdb.sst.read.micros P50 : 1.550783 P95 : 4.572892 P99 : 8.545723 P100 : 11202.000000 COUNT : 7354703 SUM : 25950165 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9662999 SUM : 9972214968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212424.242424 P95 : 391083.333333 P99 : 559550.000000 P100 : 593823.000000 COUNT : 133 SUM : 28474036 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 332 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0