[2024-10-17 15:48:09.079883] Starting SPDK v25.01-pre git sha1 1f58a2f77 / DPDK 24.03.0 initialization... [2024-10-17 15:48:09.080196] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid481481 ] Set seed to 1729172889072704 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-10-17 15:48:09.222467] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-10-17 15:48:09.327396] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-10-17 15:48:09.327452] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 481481' to capture a snapshot of events at runtime. [2024-10-17 15:48:09.327466] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-10-17 15:48:09.327479] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-10-17 15:48:09.327489] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid481481 for offline analysis/debug. [2024-10-17 15:48:09.328755] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Oct 17 15:48:12 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/10/17-15:48:15 ... thread 0: (1000000,1000000) ops and (326719.7,326719.7) ops/second in (3.060728,3.060728) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 629.06 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 332.2 2.65 2.48 13 0.204 0 0 0.0 0.0 L1 3/3 188.12 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 242.0 241.5 0.78 0.74 1 0.779 191K 389 0.0 0.0 L2 1/1 100.85 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.0 2.5 236.6 236.1 0.68 0.65 1 0.680 163K 342 0.0 0.0 L3 18/11 1004.51 MB 0.1 0.1 0.1 0.0 0.1 0.1 0.0 1.0 193.3 193.3 0.31 0.29 1 0.308 60K 0 0.0 0.0 L4 120/0 9.66 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.55 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 260/23 20.09 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 92.6 291.8 4.42 4.16 16 0.276 415K 731 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 92.6 291.8 4.42 4.16 16 0.276 415K 731 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 231.4 231.0 1.77 1.69 3 0.589 415K 731 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 332.2 2.65 2.48 13 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.1 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.26 GB write, 409.83 MB/s write, 0.40 GB read, 130.04 MB/s read, 4.4 seconds Interval compaction: 1.26 GB write, 420.70 MB/s write, 0.40 GB read, 133.49 MB/s read, 4.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 125845 Average: 2.1489 StdDev: 5.73 Min: 0 Median: 1.4448 Max: 1199 Percentiles: P50: 1.44 P75: 1.86 P99: 5.92 P99.9: 13.47 P99.99: 172.77 ------------------------------------------------------ [ 0, 1 ] 28855 22.929% 22.929% ##### ( 1, 2 ] 76590 60.861% 83.790% ############ ( 2, 3 ] 11770 9.353% 93.142% ## ( 3, 4 ] 4507 3.581% 96.724% # ( 4, 6 ] 2979 2.367% 99.091% ( 6, 10 ] 867 0.689% 99.780% ( 10, 15 ] 221 0.176% 99.956% ( 15, 22 ] 31 0.025% 99.980% ( 22, 34 ] 9 0.007% 99.987% ( 34, 51 ] 2 0.002% 99.989% ( 51, 76 ] 2 0.002% 99.990% ( 76, 110 ] 1 0.001% 99.991% ( 170, 250 ] 12 0.010% 100.001% ( 250, 380 ] 5 0.004% 100.005% ( 380, 580 ] 8 0.006% 100.011% ( 870, 1300 ] 1 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 35920 Average: 2.4427 StdDev: 26.90 Min: 0 Median: 1.4343 Max: 3390 Percentiles: P50: 1.43 P75: 1.84 P99: 6.12 P99.9: 48.66 P99.99: 784.16 ------------------------------------------------------ [ 0, 1 ] 8322 23.168% 23.168% ##### ( 1, 2 ] 22192 61.782% 84.950% ############ ( 2, 3 ] 3150 8.769% 93.719% ## ( 3, 4 ] 1092 3.040% 96.759% # ( 4, 6 ] 797 2.219% 98.978% ( 6, 10 ] 250 0.696% 99.674% ( 10, 15 ] 36 0.100% 99.774% ( 15, 22 ] 8 0.022% 99.797% ( 34, 51 ] 43 0.120% 99.916% ( 51, 76 ] 13 0.036% 99.953% ( 76, 110 ] 5 0.014% 99.967% ( 110, 170 ] 3 0.008% 99.975% ( 170, 250 ] 3 0.008% 99.983% ( 380, 580 ] 1 0.003% 99.986% ( 580, 870 ] 2 0.006% 99.992% ( 1900, 2900 ] 1 0.003% 99.994% ( 2900, 4400 ] 2 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 31221 Average: 3.0077 StdDev: 35.04 Min: 0 Median: 1.5547 Max: 4741 Percentiles: P50: 1.55 P75: 1.98 P99: 9.81 P99.9: 140.67 P99.99: 567.79 ------------------------------------------------------ [ 0, 1 ] 5487 17.575% 17.575% #### ( 1, 2 ] 18251 58.457% 76.032% ############ ( 2, 3 ] 3903 12.501% 88.533% ### ( 3, 4 ] 1365 4.372% 92.905% # ( 4, 6 ] 1404 4.497% 97.402% # ( 6, 10 ] 523 1.675% 99.078% ( 10, 15 ] 191 0.612% 99.689% ( 15, 22 ] 17 0.054% 99.744% ( 22, 34 ] 4 0.013% 99.757% ( 34, 51 ] 2 0.006% 99.763% ( 76, 110 ] 30 0.096% 99.859% ( 110, 170 ] 25 0.080% 99.939% ( 170, 250 ] 9 0.029% 99.968% ( 250, 380 ] 5 0.016% 99.984% ( 380, 580 ] 2 0.006% 99.990% ( 1300, 1900 ] 1 0.003% 99.994% ( 2900, 4400 ] 1 0.003% 99.997% ( 4400, 6600 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 25500 Average: 8.7882 StdDev: 135.21 Min: 1 Median: 1.7510 Max: 5712 Percentiles: P50: 1.75 P75: 2.57 P99: 14.15 P99.9: 2930.00 P99.99: 4307.00 ------------------------------------------------------ [ 0, 1 ] 1308 5.129% 5.129% # ( 1, 2 ] 15236 59.749% 64.878% ############ ( 2, 3 ] 4537 17.792% 82.671% #### ( 3, 4 ] 1787 7.008% 89.678% # ( 4, 6 ] 1602 6.282% 95.961% # ( 6, 10 ] 571 2.239% 98.200% ( 10, 15 ] 246 0.965% 99.165% ( 15, 22 ] 20 0.078% 99.243% ( 22, 34 ] 6 0.024% 99.267% ( 34, 51 ] 8 0.031% 99.298% ( 51, 76 ] 11 0.043% 99.341% ( 76, 110 ] 20 0.078% 99.420% ( 110, 170 ] 74 0.290% 99.710% ( 170, 250 ] 18 0.071% 99.780% ( 250, 380 ] 5 0.020% 99.800% ( 380, 580 ] 4 0.016% 99.816% ( 580, 870 ] 5 0.020% 99.835% ( 870, 1300 ] 3 0.012% 99.847% ( 1300, 1900 ] 4 0.016% 99.863% ( 1900, 2900 ] 9 0.035% 99.898% ( 2900, 4400 ] 25 0.098% 99.996% ( 4400, 6600 ] 1 0.004% 100.000% ** Level 4 read latency histogram (micros): Count: 15 Average: 2585.4000 StdDev: 1436.21 Min: 98 Median: 2775.0000 Max: 4890 Percentiles: P50: 2775.00 P75: 4118.75 P99: 4890.00 P99.9: 4890.00 P99.99: 4890.00 ------------------------------------------------------ ( 76, 110 ] 1 6.667% 6.667% # ( 250, 380 ] 1 6.667% 13.333% # ( 380, 580 ] 1 6.667% 20.000% # ( 1300, 1900 ] 1 6.667% 26.667% # ( 1900, 2900 ] 4 26.667% 53.333% ##### ( 2900, 4400 ] 4 26.667% 80.000% ##### ( 4400, 6600 ] 3 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 3.1 total, 3.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 312.97 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.189 H:M:S, 6.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.189 H:M:S, 6.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/10/17-15:48:18 ... thread 0: (1000000,2000000) ops and (312229.5,319310.3) ops/second in (3.202772,6.263500) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 1.35 GB 112.7 1.0 0.0 1.0 2.8 1.8 0.0 1.5 104.8 300.8 9.60 9.11 32 0.300 1022K 4948 0.0 0.0 L1 1/0 49.74 MB 5.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 233.6 232.1 2.69 2.62 2 1.345 638K 4031 0.0 0.0 L2 1/1 100.85 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 2.5 236.6 236.1 0.68 0.65 1 0.680 163K 342 0.0 0.0 L3 22/11 1.36 GB 0.4 0.5 0.4 0.1 0.5 0.4 0.0 1.2 209.3 208.8 2.61 2.51 4 0.652 554K 1320 0.0 0.0 L4 120/0 9.66 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.55 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 261/16 21.06 GB 0.0 2.3 0.9 1.4 4.1 2.8 0.5 2.2 150.3 270.7 15.58 14.90 39 0.399 2377K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 0.9 1.4 4.1 2.8 0.5 2.2 150.3 270.7 15.58 14.90 39 0.399 2377K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 0.9 1.4 2.3 0.9 0.0 0.0 233.3 232.3 10.03 9.76 11 0.912 2377K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 340.2 5.55 5.13 28 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.3 total, 6.3 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.12 GB write, 664.46 MB/s write, 2.29 GB read, 368.87 MB/s read, 15.6 seconds Interval compaction: 4.12 GB write, 673.08 MB/s write, 2.29 GB read, 373.66 MB/s read, 15.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 409033 Average: 2.5042 StdDev: 6.69 Min: 0 Median: 1.6662 Max: 1682 Percentiles: P50: 1.67 P75: 2.28 P99: 6.95 P99.9: 13.77 P99.99: 19.56 ------------------------------------------------------ [ 0, 1 ] 41901 10.244% 10.244% ## ( 1, 2 ] 244098 59.677% 69.921% ############ ( 2, 3 ] 75522 18.464% 88.384% #### ( 3, 4 ] 23907 5.845% 94.229% # ( 4, 6 ] 18645 4.558% 98.787% # ( 6, 10 ] 3685 0.901% 99.688% ( 10, 15 ] 1151 0.281% 99.970% ( 15, 22 ] 129 0.032% 100.001% ( 22, 34 ] 20 0.005% 100.006% ( 34, 51 ] 4 0.001% 100.007% ( 51, 76 ] 10 0.002% 100.010% ( 76, 110 ] 1 0.000% 100.010% ( 170, 250 ] 26 0.006% 100.016% ( 250, 380 ] 7 0.002% 100.018% ( 380, 580 ] 21 0.005% 100.023% ( 870, 1300 ] 9 0.002% 100.025% ( 1300, 1900 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 154676 Average: 2.8908 StdDev: 14.76 Min: 0 Median: 1.7903 Max: 3390 Percentiles: P50: 1.79 P75: 2.58 P99: 8.92 P99.9: 20.86 P99.99: 171.33 ------------------------------------------------------ [ 0, 1 ] 10334 6.681% 6.681% # ( 1, 2 ] 84786 54.815% 61.496% ########### ( 2, 3 ] 36013 23.283% 84.779% ##### ( 3, 4 ] 10482 6.777% 91.556% # ( 4, 6 ] 9646 6.236% 97.792% # ( 6, 10 ] 2557 1.653% 99.445% ( 10, 15 ] 618 0.400% 99.845% ( 15, 22 ] 102 0.066% 99.911% ( 22, 34 ] 7 0.005% 99.915% ( 34, 51 ] 46 0.030% 99.945% ( 51, 76 ] 15 0.010% 99.955% ( 76, 110 ] 7 0.005% 99.959% ( 110, 170 ] 47 0.030% 99.990% ( 170, 250 ] 32 0.021% 100.010% ( 250, 380 ] 9 0.006% 100.016% ( 380, 580 ] 6 0.004% 100.020% ( 580, 870 ] 7 0.005% 100.025% ( 870, 1300 ] 1 0.001% 100.025% ( 1900, 2900 ] 1 0.001% 100.026% ( 2900, 4400 ] 2 0.001% 100.027% ** Level 2 read latency histogram (micros): Count: 31845 Average: 3.5330 StdDev: 36.16 Min: 0 Median: 1.5691 Max: 4741 Percentiles: P50: 1.57 P75: 2.01 P99: 11.71 P99.9: 229.72 P99.99: 567.70 ------------------------------------------------------ [ 0, 1 ] 5488 17.233% 17.233% ### ( 1, 2 ] 18335 57.576% 74.809% ############ ( 2, 3 ] 4199 13.186% 87.995% ### ( 3, 4 ] 1442 4.528% 92.523% # ( 4, 6 ] 1462 4.591% 97.114% # ( 6, 10 ] 535 1.680% 98.794% ( 10, 15 ] 192 0.603% 99.397% ( 15, 22 ] 17 0.053% 99.450% ( 22, 34 ] 4 0.013% 99.463% ( 34, 51 ] 2 0.006% 99.469% ( 76, 110 ] 30 0.094% 99.564% ( 110, 170 ] 87 0.273% 99.837% ( 170, 250 ] 27 0.085% 99.921% ( 250, 380 ] 19 0.060% 99.981% ( 380, 580 ] 3 0.009% 99.991% ( 1300, 1900 ] 1 0.003% 99.994% ( 2900, 4400 ] 1 0.003% 99.997% ( 4400, 6600 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 247624 Average: 3.5860 StdDev: 44.15 Min: 1 Median: 1.7475 Max: 5712 Percentiles: P50: 1.75 P75: 2.49 P99: 9.51 P99.9: 154.14 P99.99: 587.66 ------------------------------------------------------ [ 0, 1 ] 12578 5.079% 5.079% # ( 1, 2 ] 148805 60.093% 65.173% ############ ( 2, 3 ] 49727 20.082% 85.254% #### ( 3, 4 ] 15977 6.452% 91.706% # ( 4, 6 ] 13532 5.465% 97.171% # ( 6, 10 ] 5168 2.087% 99.258% ( 10, 15 ] 880 0.355% 99.614% ( 15, 22 ] 101 0.041% 99.654% ( 22, 34 ] 14 0.006% 99.660% ( 34, 51 ] 143 0.058% 99.718% ( 51, 76 ] 89 0.036% 99.754% ( 76, 110 ] 138 0.056% 99.809% ( 110, 170 ] 305 0.123% 99.933% ( 170, 250 ] 102 0.041% 99.974% ( 250, 380 ] 28 0.011% 99.985% ( 380, 580 ] 12 0.005% 99.990% ( 580, 870 ] 9 0.004% 99.994% ( 870, 1300 ] 4 0.002% 99.995% ( 1300, 1900 ] 4 0.002% 99.997% ( 1900, 2900 ] 9 0.004% 100.000% ( 2900, 4400 ] 25 0.010% 100.010% ( 4400, 6600 ] 1 0.000% 100.011% ** Level 4 read latency histogram (micros): Count: 15 Average: 2585.4000 StdDev: 1436.21 Min: 98 Median: 2775.0000 Max: 4890 Percentiles: P50: 2775.00 P75: 4118.75 P99: 4890.00 P99.9: 4890.00 P99.99: 4890.00 ------------------------------------------------------ ( 76, 110 ] 1 6.667% 6.667% # ( 250, 380 ] 1 6.667% 13.333% # ( 380, 580 ] 1 6.667% 20.000% # ( 1300, 1900 ] 1 6.667% 26.667% # ( 1900, 2900 ] 4 26.667% 53.333% ##### ( 2900, 4400 ] 4 26.667% 80.000% ##### ( 4400, 6600 ] 3 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 6.3 total, 3.2 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 310.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.359 H:M:S, 5.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 307.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.170 H:M:S, 5.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/17-15:48:21 ... thread 0: (1000000,3000000) ops and (340064.2,325941.0) ops/second in (2.940621,9.204121) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/17 2.27 GB 25.0 1.5 0.0 1.5 4.2 2.8 0.0 1.5 105.5 302.8 14.31 13.57 49 0.292 1533K 7478 0.0 0.0 L1 1/1 49.74 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 233.6 232.1 2.69 2.62 2 1.345 638K 4031 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 2.5 236.6 236.1 0.68 0.65 1 0.680 163K 342 0.0 0.0 L3 18/0 751.07 MB 0.8 1.6 0.5 1.0 1.5 0.5 0.0 2.9 231.2 230.6 6.88 6.60 5 1.377 1616K 4359 0.0 0.0 L4 126/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 206.5 206.5 1.07 1.02 1 1.071 224K 0 0.0 0.0 L5 116/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 279/18 21.98 GB 0.0 4.0 1.2 2.8 6.8 4.0 1.6 2.4 160.4 270.2 25.63 24.46 58 0.442 4175K 16K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.0 1.2 2.8 6.8 4.0 1.6 2.4 160.4 270.2 25.63 24.46 58 0.442 4175K 16K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.0 1.2 2.8 4.0 1.2 0.0 0.0 235.7 234.8 17.44 16.90 15 1.163 4175K 16K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 345.6 8.19 7.57 43 0.190 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.3 total, 9.2 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.76 GB write, 745.70 MB/s write, 4.02 GB read, 442.69 MB/s read, 25.6 seconds Interval compaction: 6.76 GB write, 752.28 MB/s write, 4.02 GB read, 446.59 MB/s read, 25.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 698220 Average: 2.5518 StdDev: 7.61 Min: 0 Median: 1.6597 Max: 1972 Percentiles: P50: 1.66 P75: 2.21 P99: 7.12 P99.9: 14.30 P99.99: 149.60 ------------------------------------------------------ [ 0, 1 ] 64607 9.253% 9.253% ## ( 1, 2 ] 431260 61.766% 71.019% ############ ( 2, 3 ] 130703 18.719% 89.738% #### ( 3, 4 ] 36208 5.186% 94.924% # ( 4, 6 ] 26581 3.807% 98.731% # ( 6, 10 ] 6736 0.965% 99.696% ( 10, 15 ] 1663 0.238% 99.934% ( 15, 22 ] 177 0.025% 99.959% ( 22, 34 ] 29 0.004% 99.963% ( 34, 51 ] 7 0.001% 99.964% ( 51, 76 ] 15 0.002% 99.966% ( 76, 110 ] 17 0.002% 99.969% ( 110, 170 ] 226 0.032% 100.001% ( 170, 250 ] 109 0.016% 100.017% ( 250, 380 ] 40 0.006% 100.023% ( 380, 580 ] 38 0.005% 100.028% ( 580, 870 ] 3 0.000% 100.029% ( 870, 1300 ] 12 0.002% 100.030% ( 1300, 1900 ] 1 0.000% 100.030% ( 1900, 2900 ] 1 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 154677 Average: 2.8918 StdDev: 14.77 Min: 0 Median: 1.7903 Max: 3390 Percentiles: P50: 1.79 P75: 2.58 P99: 8.92 P99.9: 20.92 P99.99: 171.33 ------------------------------------------------------ [ 0, 1 ] 10334 6.681% 6.681% # ( 1, 2 ] 84786 54.815% 61.496% ########### ( 2, 3 ] 36013 23.283% 84.779% ##### ( 3, 4 ] 10482 6.777% 91.555% # ( 4, 6 ] 9646 6.236% 97.792% # ( 6, 10 ] 2557 1.653% 99.445% ( 10, 15 ] 618 0.400% 99.844% ( 15, 22 ] 102 0.066% 99.910% ( 22, 34 ] 7 0.005% 99.915% ( 34, 51 ] 46 0.030% 99.944% ( 51, 76 ] 15 0.010% 99.954% ( 76, 110 ] 7 0.005% 99.959% ( 110, 170 ] 48 0.031% 99.990% ( 170, 250 ] 32 0.021% 100.010% ( 250, 380 ] 9 0.006% 100.016% ( 380, 580 ] 6 0.004% 100.020% ( 580, 870 ] 7 0.005% 100.025% ( 870, 1300 ] 1 0.001% 100.025% ( 1900, 2900 ] 1 0.001% 100.026% ( 2900, 4400 ] 2 0.001% 100.027% ** Level 2 read latency histogram (micros): Count: 56753 Average: 2.9843 StdDev: 27.18 Min: 0 Median: 1.5656 Max: 4741 Percentiles: P50: 1.57 P75: 1.97 P99: 9.43 P99.9: 167.41 P99.99: 446.23 ------------------------------------------------------ [ 0, 1 ] 8637 15.219% 15.219% ### ( 1, 2 ] 34900 61.495% 76.713% ############ ( 2, 3 ] 7596 13.384% 90.097% ### ( 3, 4 ] 2259 3.980% 94.078% # ( 4, 6 ] 1942 3.422% 97.500% # ( 6, 10 ] 993 1.750% 99.249% ( 10, 15 ] 231 0.407% 99.656% ( 15, 22 ] 19 0.033% 99.690% ( 22, 34 ] 4 0.007% 99.697% ( 34, 51 ] 2 0.004% 99.700% ( 76, 110 ] 30 0.053% 99.753% ( 110, 170 ] 87 0.153% 99.907% ( 170, 250 ] 27 0.048% 99.954% ( 250, 380 ] 19 0.033% 99.988% ( 380, 580 ] 4 0.007% 99.995% ( 1300, 1900 ] 1 0.002% 99.996% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 321616 Average: 3.4613 StdDev: 39.31 Min: 0 Median: 1.7361 Max: 5712 Percentiles: P50: 1.74 P75: 2.45 P99: 9.52 P99.9: 158.90 P99.99: 578.46 ------------------------------------------------------ [ 0, 1 ] 17861 5.554% 5.554% # ( 1, 2 ] 194189 60.379% 65.933% ############ ( 2, 3 ] 65019 20.216% 86.149% #### ( 3, 4 ] 19368 6.022% 92.171% # ( 4, 6 ] 16076 4.999% 97.170% # ( 6, 10 ] 6689 2.080% 99.249% ( 10, 15 ] 1231 0.383% 99.632% ( 15, 22 ] 156 0.049% 99.681% ( 22, 34 ] 20 0.006% 99.687% ( 34, 51 ] 145 0.045% 99.732% ( 51, 76 ] 89 0.028% 99.760% ( 76, 110 ] 158 0.049% 99.809% ( 110, 170 ] 360 0.112% 99.921% ( 170, 250 ] 139 0.043% 99.964% ( 250, 380 ] 63 0.020% 99.984% ( 380, 580 ] 21 0.007% 99.990% ( 580, 870 ] 12 0.004% 99.994% ( 870, 1300 ] 8 0.002% 99.996% ( 1300, 1900 ] 4 0.001% 99.998% ( 1900, 2900 ] 9 0.003% 100.000% ( 2900, 4400 ] 25 0.008% 100.008% ( 4400, 6600 ] 1 0.000% 100.008% ** Level 4 read latency histogram (micros): Count: 45 Average: 912.1111 StdDev: 1447.23 Min: 1 Median: 135.0000 Max: 4890 Percentiles: P50: 135.00 P75: 1750.00 P99: 4890.00 P99.9: 4890.00 P99.99: 4890.00 ------------------------------------------------------ [ 0, 1 ] 10 22.222% 22.222% #### ( 1, 2 ] 7 15.556% 37.778% ### ( 2, 3 ] 1 2.222% 40.000% ( 34, 51 ] 1 2.222% 42.222% ( 76, 110 ] 1 2.222% 44.444% ( 110, 170 ] 6 13.333% 57.778% ### ( 170, 250 ] 2 4.444% 62.222% # ( 250, 380 ] 4 8.889% 71.111% ## ( 380, 580 ] 1 2.222% 73.333% ( 1300, 1900 ] 1 2.222% 75.556% ( 1900, 2900 ] 4 8.889% 84.444% ## ( 2900, 4400 ] 4 8.889% 93.333% ## ( 4400, 6600 ] 3 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 455.7750 StdDev: 492.95 Min: 108 Median: 210.0000 Max: 2107 Percentiles: P50: 210.00 P75: 676.67 P99: 2107.00 P99.9: 2107.00 P99.99: 2107.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 17 42.500% 47.500% ######### ( 170, 250 ] 2 5.000% 52.500% # ( 250, 380 ] 7 17.500% 70.000% #### ( 380, 580 ] 1 2.500% 72.500% # ( 580, 870 ] 3 7.500% 80.000% ## ( 870, 1300 ] 6 15.000% 95.000% ### ( 1300, 1900 ] 1 2.500% 97.500% # ( 1900, 2900 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 9.3 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 317.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.359 H:M:S, 3.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 334.68 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/10/17-15:48:25 ... thread 0: (1000000,4000000) ops and (264988.5,308217.0) ops/second in (3.773749,12.977870) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 3.24 GB 150.2 2.7 0.0 2.7 6.4 3.7 0.0 1.7 124.6 296.8 22.21 21.17 70 0.317 2811K 13K 0.0 0.0 L1 1/1 49.74 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 233.6 232.1 2.69 2.62 2 1.345 638K 4031 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 2.5 236.6 236.1 0.68 0.65 1 0.680 163K 342 0.0 0.0 L3 18/0 751.07 MB 0.8 1.6 0.5 1.0 1.5 0.5 0.0 2.9 231.2 230.6 6.88 6.60 5 1.377 1616K 4359 0.0 0.0 L4 126/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 206.5 206.5 1.07 1.02 1 1.071 224K 0 0.0 0.0 L5 116/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 280/14 22.95 GB 0.0 5.2 1.2 4.0 9.0 5.0 1.6 2.4 160.1 273.9 33.53 32.07 79 0.424 5453K 22K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.2 1.2 4.0 9.0 5.0 1.6 2.4 160.1 273.9 33.53 32.07 79 0.424 5453K 22K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.2 1.2 4.0 5.2 1.2 0.0 0.0 239.2 238.2 22.45 21.81 20 1.122 5453K 22K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 346.2 11.08 10.26 59 0.188 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.1 total, 13.0 interval Flush(GB): cumulative 3.747, interval 3.747 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.97 GB write, 703.17 MB/s write, 5.24 GB read, 411.12 MB/s read, 33.5 seconds Interval compaction: 8.97 GB write, 707.57 MB/s write, 5.24 GB read, 413.69 MB/s read, 33.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 2, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1177036 Average: 2.5379 StdDev: 7.38 Min: 0 Median: 1.6455 Max: 1972 Percentiles: P50: 1.65 P75: 2.14 P99: 7.18 P99.9: 14.33 P99.99: 144.73 ------------------------------------------------------ [ 0, 1 ] 107961 9.172% 9.172% ## ( 1, 2 ] 744441 63.247% 72.419% ############# ( 2, 3 ] 215623 18.319% 90.739% #### ( 3, 4 ] 54334 4.616% 95.355% # ( 4, 6 ] 39351 3.343% 98.698% # ( 6, 10 ] 12070 1.025% 99.723% ( 10, 15 ] 2403 0.204% 99.928% ( 15, 22 ] 245 0.021% 99.948% ( 22, 34 ] 38 0.003% 99.952% ( 34, 51 ] 11 0.001% 99.953% ( 51, 76 ] 23 0.002% 99.954% ( 76, 110 ] 110 0.009% 99.964% ( 110, 170 ] 536 0.046% 100.009% ( 170, 250 ] 174 0.015% 100.024% ( 250, 380 ] 57 0.005% 100.029% ( 380, 580 ] 62 0.005% 100.034% ( 580, 870 ] 7 0.001% 100.035% ( 870, 1300 ] 19 0.002% 100.036% ( 1300, 1900 ] 1 0.000% 100.037% ( 1900, 2900 ] 1 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 154677 Average: 2.8918 StdDev: 14.77 Min: 0 Median: 1.7903 Max: 3390 Percentiles: P50: 1.79 P75: 2.58 P99: 8.92 P99.9: 20.92 P99.99: 171.33 ------------------------------------------------------ [ 0, 1 ] 10334 6.681% 6.681% # ( 1, 2 ] 84786 54.815% 61.496% ########### ( 2, 3 ] 36013 23.283% 84.779% ##### ( 3, 4 ] 10482 6.777% 91.555% # ( 4, 6 ] 9646 6.236% 97.792% # ( 6, 10 ] 2557 1.653% 99.445% ( 10, 15 ] 618 0.400% 99.844% ( 15, 22 ] 102 0.066% 99.910% ( 22, 34 ] 7 0.005% 99.915% ( 34, 51 ] 46 0.030% 99.944% ( 51, 76 ] 15 0.010% 99.954% ( 76, 110 ] 7 0.005% 99.959% ( 110, 170 ] 48 0.031% 99.990% ( 170, 250 ] 32 0.021% 100.010% ( 250, 380 ] 9 0.006% 100.016% ( 380, 580 ] 6 0.004% 100.020% ( 580, 870 ] 7 0.005% 100.025% ( 870, 1300 ] 1 0.001% 100.025% ( 1900, 2900 ] 1 0.001% 100.026% ( 2900, 4400 ] 2 0.001% 100.027% ** Level 2 read latency histogram (micros): Count: 56753 Average: 2.9843 StdDev: 27.18 Min: 0 Median: 1.5656 Max: 4741 Percentiles: P50: 1.57 P75: 1.97 P99: 9.43 P99.9: 167.41 P99.99: 446.23 ------------------------------------------------------ [ 0, 1 ] 8637 15.219% 15.219% ### ( 1, 2 ] 34900 61.495% 76.713% ############ ( 2, 3 ] 7596 13.384% 90.097% ### ( 3, 4 ] 2259 3.980% 94.078% # ( 4, 6 ] 1942 3.422% 97.500% # ( 6, 10 ] 993 1.750% 99.249% ( 10, 15 ] 231 0.407% 99.656% ( 15, 22 ] 19 0.033% 99.690% ( 22, 34 ] 4 0.007% 99.697% ( 34, 51 ] 2 0.004% 99.700% ( 76, 110 ] 30 0.053% 99.753% ( 110, 170 ] 87 0.153% 99.907% ( 170, 250 ] 27 0.048% 99.954% ( 250, 380 ] 19 0.033% 99.988% ( 380, 580 ] 4 0.007% 99.995% ( 1300, 1900 ] 1 0.002% 99.996% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 321616 Average: 3.4613 StdDev: 39.31 Min: 0 Median: 1.7361 Max: 5712 Percentiles: P50: 1.74 P75: 2.45 P99: 9.52 P99.9: 158.90 P99.99: 578.46 ------------------------------------------------------ [ 0, 1 ] 17861 5.554% 5.554% # ( 1, 2 ] 194189 60.379% 65.933% ############ ( 2, 3 ] 65019 20.216% 86.149% #### ( 3, 4 ] 19368 6.022% 92.171% # ( 4, 6 ] 16076 4.999% 97.170% # ( 6, 10 ] 6689 2.080% 99.249% ( 10, 15 ] 1231 0.383% 99.632% ( 15, 22 ] 156 0.049% 99.681% ( 22, 34 ] 20 0.006% 99.687% ( 34, 51 ] 145 0.045% 99.732% ( 51, 76 ] 89 0.028% 99.760% ( 76, 110 ] 158 0.049% 99.809% ( 110, 170 ] 360 0.112% 99.921% ( 170, 250 ] 139 0.043% 99.964% ( 250, 380 ] 63 0.020% 99.984% ( 380, 580 ] 21 0.007% 99.990% ( 580, 870 ] 12 0.004% 99.994% ( 870, 1300 ] 8 0.002% 99.996% ( 1300, 1900 ] 4 0.001% 99.998% ( 1900, 2900 ] 9 0.003% 100.000% ( 2900, 4400 ] 25 0.008% 100.008% ( 4400, 6600 ] 1 0.000% 100.008% ** Level 4 read latency histogram (micros): Count: 45 Average: 912.1111 StdDev: 1447.23 Min: 1 Median: 135.0000 Max: 4890 Percentiles: P50: 135.00 P75: 1750.00 P99: 4890.00 P99.9: 4890.00 P99.99: 4890.00 ------------------------------------------------------ [ 0, 1 ] 10 22.222% 22.222% #### ( 1, 2 ] 7 15.556% 37.778% ### ( 2, 3 ] 1 2.222% 40.000% ( 34, 51 ] 1 2.222% 42.222% ( 76, 110 ] 1 2.222% 44.444% ( 110, 170 ] 6 13.333% 57.778% ### ( 170, 250 ] 2 4.444% 62.222% # ( 250, 380 ] 4 8.889% 71.111% ## ( 380, 580 ] 1 2.222% 73.333% ( 1300, 1900 ] 1 2.222% 75.556% ( 1900, 2900 ] 4 8.889% 84.444% ## ( 2900, 4400 ] 4 8.889% 93.333% ## ( 4400, 6600 ] 3 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 455.7750 StdDev: 492.95 Min: 108 Median: 210.0000 Max: 2107 Percentiles: P50: 210.00 P75: 676.67 P99: 2107.00 P99.9: 2107.00 P99.99: 2107.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 17 42.500% 47.500% ######### ( 170, 250 ] 2 5.000% 52.500% # ( 250, 380 ] 7 17.500% 70.000% #### ( 380, 580 ] 1 2.500% 72.500% # ( 580, 870 ] 3 7.500% 80.000% ## ( 870, 1300 ] 6 15.000% 95.000% ### ( 1300, 1900 ] 1 2.500% 97.500% # ( 1900, 2900 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 13.1 total, 3.8 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 301.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.129 H:M:S, 8.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 260.80 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.770 H:M:S, 20.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/17-15:48:28 ... thread 0: (1000000,5000000) ops and (273386.5,300558.5) ops/second in (3.657825,16.635695) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/13 2.63 GB 56.4 3.4 0.0 3.4 8.1 4.7 0.0 1.7 126.6 297.8 27.83 26.55 88 0.316 3577K 17K 0.0 0.0 L1 13/13 1.52 GB 0.0 2.2 2.0 0.2 2.1 1.9 0.1 1.1 225.4 219.4 9.96 9.63 3 3.319 2279K 60K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 2.5 236.6 236.1 0.68 0.65 1 0.680 163K 342 0.0 0.0 L3 18/0 751.07 MB 0.8 1.6 0.5 1.0 1.5 0.5 0.0 2.9 231.2 230.6 6.88 6.60 5 1.377 1616K 4359 0.0 0.0 L4 126/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 206.5 206.5 1.07 1.02 1 1.071 224K 0 0.0 0.0 L5 116/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 289/26 23.82 GB 0.0 7.6 2.8 4.8 12.1 7.4 1.6 2.6 166.8 268.0 46.42 44.46 98 0.474 7861K 82K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.6 2.8 4.8 12.1 7.4 1.6 2.6 166.8 268.0 46.42 44.46 98 0.474 7861K 82K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.6 2.8 4.8 7.5 2.7 0.0 0.0 236.9 234.4 32.67 31.74 24 1.361 7861K 82K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 347.9 13.74 12.72 74 0.186 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.7 total, 16.6 interval Flush(GB): cumulative 4.669, interval 4.669 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.15 GB write, 744.01 MB/s write, 7.56 GB read, 462.99 MB/s read, 46.4 seconds Interval compaction: 12.15 GB write, 747.64 MB/s write, 7.56 GB read, 465.25 MB/s read, 46.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 2, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1507941 Average: 2.5519 StdDev: 7.81 Min: 0 Median: 1.6343 Max: 1972 Percentiles: P50: 1.63 P75: 2.09 P99: 7.15 P99.9: 14.80 P99.99: 160.19 ------------------------------------------------------ [ 0, 1 ] 142888 9.476% 9.476% ## ( 1, 2 ] 963415 63.889% 73.365% ############# ( 2, 3 ] 269187 17.851% 91.216% #### ( 3, 4 ] 65886 4.369% 95.586% # ( 4, 6 ] 47181 3.129% 98.715% # ( 6, 10 ] 15040 0.997% 99.712% ( 10, 15 ] 2957 0.196% 99.908% ( 15, 22 ] 295 0.020% 99.928% ( 22, 34 ] 45 0.003% 99.931% ( 34, 51 ] 18 0.001% 99.932% ( 51, 76 ] 26 0.002% 99.933% ( 76, 110 ] 155 0.010% 99.944% ( 110, 170 ] 837 0.056% 99.999% ( 170, 250 ] 317 0.021% 100.020% ( 250, 380 ] 104 0.007% 100.027% ( 380, 580 ] 89 0.006% 100.033% ( 580, 870 ] 11 0.001% 100.034% ( 870, 1300 ] 22 0.001% 100.035% ( 1300, 1900 ] 1 0.000% 100.035% ( 1900, 2900 ] 1 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 226330 Average: 2.9480 StdDev: 15.90 Min: 0 Median: 1.7304 Max: 3390 Percentiles: P50: 1.73 P75: 2.44 P99: 8.99 P99.9: 125.54 P99.99: 252.39 ------------------------------------------------------ [ 0, 1 ] 17657 7.801% 7.801% ## ( 1, 2 ] 130769 57.778% 65.579% ############ ( 2, 3 ] 48128 21.265% 86.844% #### ( 3, 4 ] 13027 5.756% 92.600% # ( 4, 6 ] 11610 5.130% 97.729% # ( 6, 10 ] 3847 1.700% 99.429% ( 10, 15 ] 800 0.353% 99.783% ( 15, 22 ] 125 0.055% 99.838% ( 22, 34 ] 8 0.004% 99.841% ( 34, 51 ] 47 0.021% 99.862% ( 51, 76 ] 15 0.007% 99.869% ( 76, 110 ] 30 0.013% 99.882% ( 110, 170 ] 157 0.069% 99.951% ( 170, 250 ] 87 0.038% 99.990% ( 250, 380 ] 20 0.009% 99.999% ( 380, 580 ] 22 0.010% 100.008% ( 580, 870 ] 16 0.007% 100.015% ( 870, 1300 ] 1 0.000% 100.016% ( 1300, 1900 ] 2 0.001% 100.017% ( 1900, 2900 ] 2 0.001% 100.018% ( 2900, 4400 ] 2 0.001% 100.019% ** Level 2 read latency histogram (micros): Count: 56753 Average: 2.9843 StdDev: 27.18 Min: 0 Median: 1.5656 Max: 4741 Percentiles: P50: 1.57 P75: 1.97 P99: 9.43 P99.9: 167.41 P99.99: 446.23 ------------------------------------------------------ [ 0, 1 ] 8637 15.219% 15.219% ### ( 1, 2 ] 34900 61.495% 76.713% ############ ( 2, 3 ] 7596 13.384% 90.097% ### ( 3, 4 ] 2259 3.980% 94.078% # ( 4, 6 ] 1942 3.422% 97.500% # ( 6, 10 ] 993 1.750% 99.249% ( 10, 15 ] 231 0.407% 99.656% ( 15, 22 ] 19 0.033% 99.690% ( 22, 34 ] 4 0.007% 99.697% ( 34, 51 ] 2 0.004% 99.700% ( 76, 110 ] 30 0.053% 99.753% ( 110, 170 ] 87 0.153% 99.907% ( 170, 250 ] 27 0.048% 99.954% ( 250, 380 ] 19 0.033% 99.988% ( 380, 580 ] 4 0.007% 99.995% ( 1300, 1900 ] 1 0.002% 99.996% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 321616 Average: 3.4613 StdDev: 39.31 Min: 0 Median: 1.7361 Max: 5712 Percentiles: P50: 1.74 P75: 2.45 P99: 9.52 P99.9: 158.90 P99.99: 578.46 ------------------------------------------------------ [ 0, 1 ] 17861 5.554% 5.554% # ( 1, 2 ] 194189 60.379% 65.933% ############ ( 2, 3 ] 65019 20.216% 86.149% #### ( 3, 4 ] 19368 6.022% 92.171% # ( 4, 6 ] 16076 4.999% 97.170% # ( 6, 10 ] 6689 2.080% 99.249% ( 10, 15 ] 1231 0.383% 99.632% ( 15, 22 ] 156 0.049% 99.681% ( 22, 34 ] 20 0.006% 99.687% ( 34, 51 ] 145 0.045% 99.732% ( 51, 76 ] 89 0.028% 99.760% ( 76, 110 ] 158 0.049% 99.809% ( 110, 170 ] 360 0.112% 99.921% ( 170, 250 ] 139 0.043% 99.964% ( 250, 380 ] 63 0.020% 99.984% ( 380, 580 ] 21 0.007% 99.990% ( 580, 870 ] 12 0.004% 99.994% ( 870, 1300 ] 8 0.002% 99.996% ( 1300, 1900 ] 4 0.001% 99.998% ( 1900, 2900 ] 9 0.003% 100.000% ( 2900, 4400 ] 25 0.008% 100.008% ( 4400, 6600 ] 1 0.000% 100.008% ** Level 4 read latency histogram (micros): Count: 45 Average: 912.1111 StdDev: 1447.23 Min: 1 Median: 135.0000 Max: 4890 Percentiles: P50: 135.00 P75: 1750.00 P99: 4890.00 P99.9: 4890.00 P99.99: 4890.00 ------------------------------------------------------ [ 0, 1 ] 10 22.222% 22.222% #### ( 1, 2 ] 7 15.556% 37.778% ### ( 2, 3 ] 1 2.222% 40.000% ( 34, 51 ] 1 2.222% 42.222% ( 76, 110 ] 1 2.222% 44.444% ( 110, 170 ] 6 13.333% 57.778% ### ( 170, 250 ] 2 4.444% 62.222% # ( 250, 380 ] 4 8.889% 71.111% ## ( 380, 580 ] 1 2.222% 73.333% ( 1300, 1900 ] 1 2.222% 75.556% ( 1900, 2900 ] 4 8.889% 84.444% ## ( 2900, 4400 ] 4 8.889% 93.333% ## ( 4400, 6600 ] 3 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 455.7750 StdDev: 492.95 Min: 108 Median: 210.0000 Max: 2107 Percentiles: P50: 210.00 P75: 676.67 P99: 2107.00 P99.9: 2107.00 P99.99: 2107.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 17 42.500% 47.500% ######### ( 170, 250 ] 2 5.000% 52.500% # ( 250, 380 ] 7 17.500% 70.000% #### ( 380, 580 ] 1 2.500% 72.500% # ( 580, 870 ] 3 7.500% 80.000% ## ( 870, 1300 ] 6 15.000% 95.000% ### ( 1300, 1900 ] 1 2.500% 97.500% # ( 1900, 2900 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 16.7 total, 3.7 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 294.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.862 H:M:S, 11.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 269.07 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.734 H:M:S, 20.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 3.425 micros/op 291941 ops/sec 20.001 seconds 5838999 operations; 282.9 MB/s Microseconds per write: Count: 5838999 Average: 3.4254 StdDev: 108.49 Min: 1 Median: 1.8089 Max: 189476 Percentiles: P50: 1.81 P75: 3.15 P99: 8.75 P99.9: 132.91 P99.99: 1211.28 ------------------------------------------------------ [ 0, 1 ] 693641 11.879% 11.879% ## ( 1, 2 ] 2751810 47.128% 59.008% ######### ( 2, 3 ] 818533 14.018% 73.026% ### ( 3, 4 ] 754806 12.927% 85.953% ### ( 4, 6 ] 702390 12.029% 97.982% ## ( 6, 10 ] 86477 1.481% 99.463% ( 10, 15 ] 16558 0.284% 99.747% ( 15, 22 ] 4614 0.079% 99.826% ( 22, 34 ] 1848 0.032% 99.857% ( 34, 51 ] 341 0.006% 99.863% ( 51, 76 ] 53 0.001% 99.864% ( 76, 110 ] 7 0.000% 99.864% ( 110, 170 ] 5453 0.093% 99.958% ( 170, 250 ] 377 0.006% 99.964% ( 250, 380 ] 97 0.002% 99.966% ( 380, 580 ] 11 0.000% 99.966% ( 580, 870 ] 7 0.000% 99.966% ( 870, 1300 ] 1754 0.030% 99.996% ( 1300, 1900 ] 2 0.000% 99.996% ( 1900, 2900 ] 217 0.004% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 168081 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5838999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6025846968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 194 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 2694505 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 10477691129 rocksdb.compact.write.bytes COUNT : 10309694064 rocksdb.flush.write.bytes COUNT : 5936783377 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 15 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 97 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5897246720 rocksdb.memtable.garbage.bytes.at.flush COUNT : 9916416 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 10525906552 rocksdb.non.last.level.read.count COUNT : 2540161 rocksdb.block.checksum.compute.count COUNT : 2539788 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.461069 P95 : 5.009452 P99 : 7.440533 P100 : 189474.000000 COUNT : 5838999 SUM : 17265712 rocksdb.compaction.times.micros P50 : 1003157.894737 P95 : 3740000.000000 P99 : 7267252.000000 P100 : 7267252.000000 COUNT : 28 SUM : 36671037 rocksdb.compaction.times.cpu_micros P50 : 1003157.894737 P95 : 3740000.000000 P99 : 7011206.000000 P100 : 7011206.000000 COUNT : 28 SUM : 35655421 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 542.500000 P95 : 1257.000000 P99 : 1349.000000 P100 : 1349.000000 COUNT : 88 SUM : 58006 rocksdb.compaction.outfile.sync.micros P50 : 691.279070 P95 : 1215.194444 P99 : 1354.000000 P100 : 1467.000000 COUNT : 91 SUM : 64387 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 87.027027 P95 : 202.000000 P99 : 299.400000 P100 : 343.000000 COUNT : 124 SUM : 12814 rocksdb.table.open.io.micros P50 : 798.247423 P95 : 12155.000000 P99 : 17950.000000 P100 : 17950.000000 COUNT : 194 SUM : 398780 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.810739 P95 : 7.590693 P99 : 11.791882 P100 : 6284.000000 COUNT : 2539267 SUM : 12324227 rocksdb.read.block.get.micros P50 : 378.206897 P95 : 3300.000000 P99 : 4466.000000 P100 : 6147.000000 COUNT : 388 SUM : 272211 rocksdb.write.raw.block.micros P50 : 0.512604 P95 : 0.973947 P99 : 3.110524 P100 : 3277.000000 COUNT : 3938817 SUM : 7658059 rocksdb.numfiles.in.singlecompaction P50 : 3.409091 P95 : 11.000000 P99 : 19.480000 P100 : 22.000000 COUNT : 36 SUM : 163 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.563846 P95 : 1135.640091 P99 : 2088.755760 P100 : 189276.000000 COUNT : 17804 SUM : 2696700 rocksdb.sst.read.micros P50 : 1.653732 P95 : 4.074869 P99 : 8.093489 P100 : 5712.000000 COUNT : 2540268 SUM : 6955624 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5838999 SUM : 6025846968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 205068.493151 P95 : 248465.753425 P99 : 341866.666667 P100 : 358097.000000 COUNT : 88 SUM : 16285964 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 124 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0