Invalid opts->opts_size 0 too small, please set opts_size correctly [2024-08-12 06:51:40.297828] Starting SPDK v24.09-pre git sha1 227b8322c / DPDK 22.11.4 initialization... [2024-08-12 06:51:40.297969] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3087768 ] Set seed to 1723438300294330 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-08-12 06:51:40.384804] app.c: 910:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-08-12 06:51:40.426744] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-08-12 06:51:40.426789] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3087768' to capture a snapshot of events at runtime. [2024-08-12 06:51:40.426800] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-08-12 06:51:40.426814] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-08-12 06:51:40.426822] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3087768 for offline analysis/debug. [2024-08-12 06:51:40.426904] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Aug 12 06:51:44 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/08/12-06:51:52 ... thread 0: (1000000,1000000) ops and (134194.0,134194.0) ops/second in (7.451899,7.451899) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 566.88 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 119.5 6.85 2.40 9 0.761 0 0 0.0 0.0 L1 2/1 129.77 MB 6.5 0.5 0.4 0.2 0.5 0.4 0.0 1.5 123.8 123.6 4.40 2.43 2 2.200 553K 519 0.0 0.0 L2 7/2 494.13 MB 2.4 0.1 0.1 0.0 0.1 0.1 0.1 1.0 173.5 173.5 0.88 0.69 1 0.882 155K 0 0.0 0.0 L3 58/8 4.60 GB 3.9 5.0 3.1 1.8 4.9 3.1 0.0 1.6 107.0 106.2 47.50 23.43 23 2.065 3010K 6510 0.0 0.0 L4 172/12 10.78 GB 1.1 1.3 1.0 0.3 1.3 1.0 0.1 1.3 112.2 110.7 11.63 5.95 9 1.292 497K 0 0.0 0.0 L5 1100/0 90.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1345/27 106.64 GB 0.0 6.9 4.6 2.3 7.7 5.4 0.1 9.6 99.4 110.1 71.27 34.90 44 1.620 4216K 7029 0.0 0.0 Int 0/0 0.00 KB 0.0 6.9 4.6 2.3 7.7 5.4 0.1 9.6 99.4 110.1 71.27 34.90 44 1.620 4216K 7029 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.9 4.6 2.3 6.9 4.6 0.0 0.0 110.0 109.1 64.41 32.50 35 1.840 4216K 7029 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 119.5 6.85 2.40 9 0.761 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.6 total, 7.5 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.66 GB write, 1028.68 MB/s write, 6.92 GB read, 928.85 MB/s read, 71.3 seconds Interval compaction: 7.66 GB write, 1052.76 MB/s write, 6.92 GB read, 950.60 MB/s read, 71.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 31, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 172895 Average: 8.8465 StdDev: 119.02 Min: 1 Median: 1.8741 Max: 8102 Percentiles: P50: 1.87 P75: 2.87 P99: 9.64 P99.9: 1732.13 P99.99: 4198.05 ------------------------------------------------------ [ 0, 1 ] 5957 3.445% 3.445% # ( 1, 2 ] 92086 53.261% 56.707% ########### ( 2, 3 ] 36339 21.018% 77.725% #### ( 3, 4 ] 17896 10.351% 88.075% ## ( 4, 6 ] 15877 9.183% 97.258% ## ( 6, 10 ] 3310 1.914% 99.173% ( 10, 15 ] 601 0.348% 99.521% ( 15, 22 ] 64 0.037% 99.558% ( 22, 34 ] 7 0.004% 99.562% ( 34, 51 ] 2 0.001% 99.563% ( 51, 76 ] 4 0.002% 99.565% ( 76, 110 ] 3 0.002% 99.567% ( 110, 170 ] 4 0.002% 99.569% ( 170, 250 ] 21 0.012% 99.581% ( 250, 380 ] 41 0.024% 99.605% ( 380, 580 ] 87 0.050% 99.655% ( 580, 870 ] 175 0.101% 99.756% ( 870, 1300 ] 166 0.096% 99.853% ( 1300, 1900 ] 114 0.066% 99.918% ( 1900, 2900 ] 64 0.037% 99.955% ( 2900, 4400 ] 69 0.040% 99.995% ( 4400, 6600 ] 11 0.006% 100.002% ( 6600, 9900 ] 6 0.003% 100.005% ** Level 1 read latency histogram (micros): Count: 93494 Average: 5.0914 StdDev: 74.03 Min: 1 Median: 1.9121 Max: 5438 Percentiles: P50: 1.91 P75: 2.89 P99: 8.19 P99.9: 639.14 P99.99: 2838.66 ------------------------------------------------------ [ 0, 1 ] 2090 2.235% 2.235% ( 1, 2 ] 48959 52.366% 54.601% ########## ( 2, 3 ] 21354 22.840% 77.441% ##### ( 3, 4 ] 10175 10.883% 88.324% ## ( 4, 6 ] 9305 9.953% 98.277% ## ( 6, 10 ] 1236 1.322% 99.599% ( 10, 15 ] 226 0.242% 99.841% ( 15, 22 ] 16 0.017% 99.858% ( 22, 34 ] 3 0.003% 99.861% ( 34, 51 ] 3 0.003% 99.864% ( 51, 76 ] 11 0.012% 99.876% ( 110, 170 ] 5 0.005% 99.881% ( 170, 250 ] 3 0.003% 99.884% ( 250, 380 ] 3 0.003% 99.888% ( 380, 580 ] 6 0.006% 99.894% ( 580, 870 ] 27 0.029% 99.923% ( 870, 1300 ] 23 0.025% 99.948% ( 1300, 1900 ] 19 0.020% 99.968% ( 1900, 2900 ] 22 0.024% 99.991% ( 2900, 4400 ] 17 0.018% 100.010% ( 4400, 6600 ] 3 0.003% 100.013% ** Level 2 read latency histogram (micros): Count: 665671 Average: 15.3330 StdDev: 188.06 Min: 1 Median: 1.9732 Max: 10342 Percentiles: P50: 1.97 P75: 3.00 P99: 11.59 P99.9: 1584.22 P99.99: 2252.97 ------------------------------------------------------ [ 0, 1 ] 15747 2.366% 2.366% ( 1, 2 ] 325831 48.948% 51.313% ########## ( 2, 3 ] 157727 23.694% 75.008% ##### ( 3, 4 ] 71369 10.721% 85.729% ## ( 4, 6 ] 69091 10.379% 96.108% ## ( 6, 10 ] 18046 2.711% 98.819% # ( 10, 15 ] 3785 0.569% 99.388% ( 15, 22 ] 518 0.078% 99.466% ( 22, 34 ] 85 0.013% 99.478% ( 34, 51 ] 47 0.007% 99.485% ( 51, 76 ] 32 0.005% 99.490% ( 76, 110 ] 32 0.005% 99.495% ( 110, 170 ] 58 0.009% 99.504% ( 170, 250 ] 97 0.015% 99.518% ( 250, 380 ] 211 0.032% 99.550% ( 380, 580 ] 444 0.067% 99.617% ( 580, 870 ] 727 0.109% 99.726% ( 870, 1300 ] 831 0.125% 99.851% ( 1300, 1900 ] 691 0.104% 99.955% ( 1900, 2900 ] 667 0.100% 100.055% ( 2900, 4400 ] 686 0.103% 100.158% ( 4400, 6600 ] 233 0.035% 100.193% ( 6600, 9900 ] 26 0.004% 100.197% ( 9900, 14000 ] 1 0.000% 100.197% ** Level 3 read latency histogram (micros): Count: 729682 Average: 11.8551 StdDev: 153.52 Min: 1 Median: 1.9621 Max: 9169 Percentiles: P50: 1.96 P75: 2.97 P99: 9.61 P99.9: 1125.28 P99.99: 1653.03 ------------------------------------------------------ [ 0, 1 ] 13130 1.799% 1.799% ( 1, 2 ] 365550 50.097% 51.897% ########## ( 2, 3 ] 174239 23.879% 75.775% ##### ( 3, 4 ] 80150 10.984% 86.760% ## ( 4, 6 ] 74961 10.273% 97.033% ## ( 6, 10 ] 15924 2.182% 99.215% ( 10, 15 ] 2750 0.377% 99.592% ( 15, 22 ] 348 0.048% 99.640% ( 22, 34 ] 37 0.005% 99.645% ( 34, 51 ] 32 0.004% 99.649% ( 51, 76 ] 48 0.007% 99.656% ( 76, 110 ] 17 0.002% 99.658% ( 110, 170 ] 38 0.005% 99.663% ( 170, 250 ] 64 0.009% 99.672% ( 250, 380 ] 184 0.025% 99.697% ( 380, 580 ] 377 0.052% 99.749% ( 580, 870 ] 645 0.088% 99.837% ( 870, 1300 ] 772 0.106% 99.943% ( 1300, 1900 ] 583 0.080% 100.023% ( 1900, 2900 ] 576 0.079% 100.102% ( 2900, 4400 ] 537 0.074% 100.175% ( 4400, 6600 ] 128 0.018% 100.193% ( 6600, 9900 ] 20 0.003% 100.196% ** Level 4 read latency histogram (micros): Count: 131465 Average: 39.5968 StdDev: 316.48 Min: 1 Median: 1.9466 Max: 9338 Percentiles: P50: 1.95 P75: 3.02 P99: 1254.60 P99.9: 4133.62 P99.99: 5271.16 ------------------------------------------------------ [ 0, 1 ] 2868 2.182% 2.182% ( 1, 2 ] 66411 50.516% 52.698% ########## ( 2, 3 ] 29026 22.079% 74.777% #### ( 3, 4 ] 13940 10.604% 85.380% ## ( 4, 6 ] 12745 9.695% 95.075% ## ( 6, 10 ] 3123 2.376% 97.450% ( 10, 15 ] 487 0.370% 97.821% ( 15, 22 ] 49 0.037% 97.858% ( 22, 34 ] 8 0.006% 97.864% ( 34, 51 ] 15 0.011% 97.875% ( 51, 76 ] 15 0.011% 97.887% ( 76, 110 ] 8 0.006% 97.893% ( 110, 170 ] 18 0.014% 97.907% ( 170, 250 ] 52 0.040% 97.946% ( 250, 380 ] 116 0.088% 98.034% ( 380, 580 ] 266 0.202% 98.237% ( 580, 870 ] 498 0.379% 98.616% ( 870, 1300 ] 565 0.430% 99.045% ( 1300, 1900 ] 479 0.364% 99.410% ( 1900, 2900 ] 346 0.263% 99.673% ( 2900, 4400 ] 363 0.276% 99.949% ( 4400, 6600 ] 136 0.103% 100.052% ( 6600, 9900 ] 18 0.014% 100.066% ** Level 5 read latency histogram (micros): Count: 11886 Average: 1817.0501 StdDev: 1517.26 Min: 93 Median: 1267.2784 Max: 21052 Percentiles: P50: 1267.28 P75: 2586.31 P99: 7009.71 P99.9: 9725.20 P99.99: 12504.46 ------------------------------------------------------ ( 76, 110 ] 8 0.067% 0.067% ( 110, 170 ] 57 0.480% 0.547% ( 170, 250 ] 151 1.270% 1.817% ( 250, 380 ] 513 4.316% 6.133% # ( 380, 580 ] 1231 10.357% 16.490% ## ( 580, 870 ] 1919 16.145% 32.635% ### ( 870, 1300 ] 2234 18.795% 51.430% #### ( 1300, 1900 ] 1759 14.799% 66.229% ### ( 1900, 2900 ] 1519 12.780% 79.009% ### ( 2900, 4400 ] 1613 13.571% 92.580% ### ( 4400, 6600 ] 747 6.285% 98.864% # ( 6600, 9900 ] 130 1.094% 99.958% ( 9900, 14000 ] 6 0.050% 100.008% ( 14000, 22000 ] 1 0.008% 100.017% ** DB Stats ** Uptime(secs): 7.6 total, 7.5 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 129.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.461 H:M:S, 45.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 132.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.461 H:M:S, 46.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/08/12-06:52:00 ... thread 0: (1000000,2000000) ops and (121233.8,127385.1) ops/second in (8.248522,15.700421) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 1.60 GB 50.3 0.7 0.0 0.7 2.6 1.8 0.0 1.4 38.5 134.9 19.61 8.75 23 0.853 767K 1054 0.0 0.0 L1 1/1 64.87 MB 0.0 0.5 0.4 0.2 0.5 0.4 0.0 1.5 123.8 123.6 4.40 2.43 2 2.200 553K 519 0.0 0.0 L2 3/2 131.26 MB 0.4 0.5 0.2 0.3 0.5 0.2 0.1 2.2 138.8 138.5 3.43 2.16 2 1.713 482K 952 0.0 0.0 L3 25/15 1.81 GB 0.7 6.5 3.6 3.0 6.5 3.5 0.0 1.8 110.0 109.2 60.73 30.94 29 2.094 4237K 13K 0.0 0.0 L4 182/6 9.95 GB 1.0 7.1 4.2 2.9 7.0 4.0 0.1 1.7 117.7 115.3 61.97 34.71 47 1.318 3609K 0 0.0 0.0 L5 1148/0 94.00 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1371/34 107.55 GB 0.0 15.4 8.3 7.1 17.0 10.0 4.1 9.2 104.9 116.1 150.13 79.00 103 1.458 9649K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.4 8.3 7.1 17.0 10.0 4.1 9.2 104.9 116.1 150.13 79.00 103 1.458 9649K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.4 8.3 7.1 15.2 8.1 0.0 0.0 116.5 115.1 135.13 73.36 82 1.648 9649K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 126.0 15.00 5.64 21 0.714 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.9 total, 15.7 interval Flush(GB): cumulative 1.845, interval 1.845 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.03 GB write, 1098.26 MB/s write, 15.38 GB read, 991.77 MB/s read, 150.1 seconds Interval compaction: 17.03 GB write, 1110.47 MB/s write, 15.38 GB read, 1002.79 MB/s read, 150.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 69, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 69, interval: 69 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 518203 Average: 12.3969 StdDev: 382.53 Min: 1 Median: 1.8691 Max: 182984 Percentiles: P50: 1.87 P75: 2.85 P99: 10.33 P99.9: 1864.27 P99.99: 3926.73 ------------------------------------------------------ [ 0, 1 ] 19066 3.679% 3.679% # ( 1, 2 ] 276204 53.300% 56.980% ########### ( 2, 3 ] 109974 21.222% 78.202% #### ( 3, 4 ] 50843 9.811% 88.013% ## ( 4, 6 ] 46473 8.968% 96.981% ## ( 6, 10 ] 10341 1.996% 98.977% ( 10, 15 ] 1801 0.348% 99.324% ( 15, 22 ] 186 0.036% 99.360% ( 22, 34 ] 20 0.004% 99.364% ( 34, 51 ] 14 0.003% 99.367% ( 51, 76 ] 20 0.004% 99.371% ( 76, 110 ] 4 0.001% 99.371% ( 110, 170 ] 25 0.005% 99.376% ( 170, 250 ] 76 0.015% 99.391% ( 250, 380 ] 217 0.042% 99.433% ( 380, 580 ] 445 0.086% 99.519% ( 580, 870 ] 836 0.161% 99.680% ( 870, 1300 ] 726 0.140% 99.820% ( 1300, 1900 ] 440 0.085% 99.905% ( 1900, 2900 ] 254 0.049% 99.954% ( 2900, 4400 ] 272 0.052% 100.007% ( 4400, 6600 ] 64 0.012% 100.019% ( 6600, 9900 ] 14 0.003% 100.022% ( 9900, 14000 ] 3 0.001% 100.022% ( 14000, 22000 ] 5 0.001% 100.023% ( 22000, 33000 ] 3 0.001% 100.024% ( 50000, 75000 ] 1 0.000% 100.024% ( 110000, 170000 ] 1 0.000% 100.024% ( 170000, 250000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 127384 Average: 7.2568 StdDev: 115.07 Min: 1 Median: 1.9289 Max: 20321 Percentiles: P50: 1.93 P75: 2.92 P99: 9.06 P99.9: 1263.83 P99.99: 3548.25 ------------------------------------------------------ [ 0, 1 ] 2666 2.093% 2.093% ( 1, 2 ] 65694 51.572% 53.665% ########## ( 2, 3 ] 29627 23.258% 76.923% ##### ( 3, 4 ] 13632 10.702% 87.624% ## ( 4, 6 ] 12842 10.081% 97.705% ## ( 6, 10 ] 2155 1.692% 99.397% ( 10, 15 ] 343 0.269% 99.666% ( 15, 22 ] 31 0.024% 99.691% ( 22, 34 ] 4 0.003% 99.694% ( 34, 51 ] 6 0.005% 99.699% ( 51, 76 ] 17 0.013% 99.712% ( 76, 110 ] 1 0.001% 99.713% ( 110, 170 ] 8 0.006% 99.719% ( 170, 250 ] 12 0.009% 99.728% ( 250, 380 ] 22 0.017% 99.746% ( 380, 580 ] 42 0.033% 99.779% ( 580, 870 ] 96 0.075% 99.854% ( 870, 1300 ] 64 0.050% 99.904% ( 1300, 1900 ] 49 0.038% 99.943% ( 1900, 2900 ] 46 0.036% 99.979% ( 2900, 4400 ] 33 0.026% 100.005% ( 4400, 6600 ] 10 0.008% 100.013% ( 6600, 9900 ] 1 0.001% 100.013% ( 14000, 22000 ] 1 0.001% 100.014% ** Level 2 read latency histogram (micros): Count: 817715 Average: 14.4275 StdDev: 189.08 Min: 1 Median: 1.9649 Max: 37955 Percentiles: P50: 1.96 P75: 2.98 P99: 11.25 P99.9: 1606.85 P99.99: 2379.03 ------------------------------------------------------ [ 0, 1 ] 18220 2.228% 2.228% ( 1, 2 ] 404859 49.511% 51.739% ########## ( 2, 3 ] 194126 23.740% 75.479% ##### ( 3, 4 ] 86742 10.608% 86.087% ## ( 4, 6 ] 83483 10.209% 96.296% ## ( 6, 10 ] 21005 2.569% 98.865% # ( 10, 15 ] 4427 0.541% 99.407% ( 15, 22 ] 582 0.071% 99.478% ( 22, 34 ] 86 0.011% 99.488% ( 34, 51 ] 63 0.008% 99.496% ( 51, 76 ] 49 0.006% 99.502% ( 76, 110 ] 34 0.004% 99.506% ( 110, 170 ] 64 0.008% 99.514% ( 170, 250 ] 114 0.014% 99.528% ( 250, 380 ] 267 0.033% 99.560% ( 380, 580 ] 568 0.069% 99.630% ( 580, 870 ] 872 0.107% 99.737% ( 870, 1300 ] 943 0.115% 99.852% ( 1300, 1900 ] 769 0.094% 99.946% ( 1900, 2900 ] 752 0.092% 100.038% ( 2900, 4400 ] 756 0.092% 100.130% ( 4400, 6600 ] 259 0.032% 100.162% ( 6600, 9900 ] 31 0.004% 100.166% ( 9900, 14000 ] 1 0.000% 100.166% ( 14000, 22000 ] 1 0.000% 100.166% ( 22000, 33000 ] 2 0.000% 100.166% ( 33000, 50000 ] 1 0.000% 100.166% ** Level 3 read latency histogram (micros): Count: 1853244 Average: 11.6535 StdDev: 249.69 Min: 1 Median: 1.9661 Max: 194849 Percentiles: P50: 1.97 P75: 2.97 P99: 9.64 P99.9: 900.08 P99.99: 1283.82 ------------------------------------------------------ [ 0, 1 ] 30679 1.655% 1.655% ( 1, 2 ] 927345 50.039% 51.694% ########## ( 2, 3 ] 446187 24.076% 75.770% ##### ( 3, 4 ] 200487 10.818% 86.589% ## ( 4, 6 ] 191059 10.309% 96.898% ## ( 6, 10 ] 42805 2.310% 99.208% ( 10, 15 ] 7751 0.418% 99.626% ( 15, 22 ] 936 0.051% 99.677% ( 22, 34 ] 90 0.005% 99.681% ( 34, 51 ] 110 0.006% 99.687% ( 51, 76 ] 167 0.009% 99.696% ( 76, 110 ] 41 0.002% 99.699% ( 110, 170 ] 95 0.005% 99.704% ( 170, 250 ] 160 0.009% 99.712% ( 250, 380 ] 457 0.025% 99.737% ( 380, 580 ] 1087 0.059% 99.796% ( 580, 870 ] 1804 0.097% 99.893% ( 870, 1300 ] 1869 0.101% 99.994% ( 1300, 1900 ] 1263 0.068% 100.062% ( 1900, 2900 ] 1178 0.064% 100.126% ( 2900, 4400 ] 1251 0.068% 100.193% ( 4400, 6600 ] 320 0.017% 100.210% ( 6600, 9900 ] 59 0.003% 100.213% ( 9900, 14000 ] 3 0.000% 100.214% ( 14000, 22000 ] 16 0.001% 100.214% ( 22000, 33000 ] 8 0.000% 100.215% ( 33000, 50000 ] 1 0.000% 100.215% ( 110000, 170000 ] 1 0.000% 100.215% ( 170000, 250000 ] 1 0.000% 100.215% ** Level 4 read latency histogram (micros): Count: 787500 Average: 21.7919 StdDev: 466.64 Min: 1 Median: 1.9573 Max: 161952 Percentiles: P50: 1.96 P75: 2.99 P99: 267.32 P99.9: 2515.93 P99.99: 3461.71 ------------------------------------------------------ [ 0, 1 ] 15584 1.979% 1.979% ( 1, 2 ] 395054 50.166% 52.145% ########## ( 2, 3 ] 181317 23.024% 75.169% ##### ( 3, 4 ] 83565 10.611% 85.780% ## ( 4, 6 ] 79531 10.099% 95.879% ## ( 6, 10 ] 20179 2.562% 98.442% # ( 10, 15 ] 3409 0.433% 98.875% ( 15, 22 ] 417 0.053% 98.928% ( 22, 34 ] 35 0.004% 98.932% ( 34, 51 ] 54 0.007% 98.939% ( 51, 76 ] 83 0.011% 98.950% ( 76, 110 ] 26 0.003% 98.953% ( 110, 170 ] 64 0.008% 98.961% ( 170, 250 ] 244 0.031% 98.992% ( 250, 380 ] 473 0.060% 99.052% ( 380, 580 ] 1101 0.140% 99.192% ( 580, 870 ] 1851 0.235% 99.427% ( 870, 1300 ] 1915 0.243% 99.670% ( 1300, 1900 ] 1242 0.158% 99.828% ( 1900, 2900 ] 923 0.117% 99.945% ( 2900, 4400 ] 946 0.120% 100.065% ( 4400, 6600 ] 312 0.040% 100.105% ( 6600, 9900 ] 53 0.007% 100.111% ( 9900, 14000 ] 5 0.001% 100.112% ( 14000, 22000 ] 12 0.002% 100.114% ( 22000, 33000 ] 8 0.001% 100.115% ( 33000, 50000 ] 1 0.000% 100.115% ( 110000, 170000 ] 5 0.001% 100.115% ** Level 5 read latency histogram (micros): Count: 30505 Average: 1526.0128 StdDev: 2095.78 Min: 83 Median: 1044.3644 Max: 184032 Percentiles: P50: 1044.36 P75: 1851.64 P99: 6433.18 P99.9: 14247.50 P99.99: 35690.25 ------------------------------------------------------ ( 76, 110 ] 22 0.072% 0.072% ( 110, 170 ] 176 0.577% 0.649% ( 170, 250 ] 514 1.685% 2.334% ( 250, 380 ] 1651 5.412% 7.746% # ( 380, 580 ] 3980 13.047% 20.793% ### ( 580, 870 ] 6262 20.528% 41.321% #### ( 870, 1300 ] 6529 21.403% 62.724% #### ( 1300, 1900 ] 4073 13.352% 76.076% ### ( 1900, 2900 ] 2891 9.477% 85.553% ## ( 2900, 4400 ] 3041 9.969% 95.522% ## ( 4400, 6600 ] 1148 3.763% 99.285% # ( 6600, 9900 ] 174 0.570% 99.856% ( 9900, 14000 ] 13 0.043% 99.898% ( 14000, 22000 ] 16 0.052% 99.951% ( 22000, 33000 ] 11 0.036% 99.987% ( 33000, 50000 ] 6 0.020% 100.007% ( 170000, 250000 ] 2 0.007% 100.013% ** DB Stats ** Uptime(secs): 15.9 total, 8.2 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 123.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.780 H:M:S, 49.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 119.32 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.319 H:M:S, 52.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/08/12-06:52:04 ... thread 0: (1000000,3000000) ops and (253312.2,152686.4) ops/second in (3.947698,19.648119) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 1.72 GB 25.2 1.3 0.0 1.3 4.1 2.8 0.0 1.5 50.9 159.9 25.98 13.88 39 0.666 1343K 1653 0.0 0.0 L1 10/10 880.04 MB 0.0 1.4 1.2 0.2 1.4 1.2 0.0 1.2 128.8 128.5 11.08 6.79 3 3.694 1449K 3501 0.0 0.0 L2 1/0 43.11 MB 0.4 0.5 0.2 0.3 0.5 0.2 0.1 2.2 138.8 138.5 3.43 2.16 2 1.713 482K 952 0.0 0.0 L3 14/0 929.46 MB 0.9 7.5 3.6 3.9 7.4 3.6 0.0 2.0 113.5 112.8 67.59 35.63 31 2.180 4988K 15K 0.0 0.0 L4 180/0 9.55 GB 1.0 8.6 4.8 3.8 8.4 4.6 0.5 1.8 124.0 121.4 71.18 41.88 54 1.318 4518K 0 0.0 0.0 L5 1164/0 95.35 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1383/23 108.43 GB 0.0 19.3 9.8 9.5 21.8 12.3 5.8 7.9 110.0 124.5 179.27 100.34 129 1.390 12M 21K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.3 9.8 9.5 21.8 12.3 5.8 7.9 110.0 124.5 179.27 100.34 129 1.390 12M 21K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.3 9.8 9.5 19.0 9.6 0.0 0.0 122.8 121.3 160.59 91.99 94 1.708 12M 21K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 151.7 18.68 8.35 35 0.534 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.8 total, 19.6 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.80 GB write, 1125.91 MB/s write, 19.26 GB read, 994.91 MB/s read, 179.3 seconds Interval compaction: 21.80 GB write, 1135.91 MB/s write, 19.26 GB read, 1003.74 MB/s read, 179.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 71, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 71, interval: 71 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 812781 Average: 10.1832 StdDev: 308.42 Min: 1 Median: 1.8007 Max: 182984 Percentiles: P50: 1.80 P75: 2.69 P99: 9.86 P99.9: 1415.93 P99.99: 3107.92 ------------------------------------------------------ [ 0, 1 ] 41533 5.110% 5.110% # ( 1, 2 ] 455696 56.066% 61.176% ########### ( 2, 3 ] 161837 19.912% 81.088% #### ( 3, 4 ] 70820 8.713% 89.801% ## ( 4, 6 ] 61854 7.610% 97.411% ## ( 6, 10 ] 13399 1.649% 99.060% ( 10, 15 ] 2220 0.273% 99.333% ( 15, 22 ] 232 0.029% 99.361% ( 22, 34 ] 30 0.004% 99.365% ( 34, 51 ] 19 0.002% 99.367% ( 51, 76 ] 22 0.003% 99.370% ( 76, 110 ] 57 0.007% 99.377% ( 110, 170 ] 295 0.036% 99.413% ( 170, 250 ] 389 0.048% 99.461% ( 250, 380 ] 575 0.071% 99.532% ( 380, 580 ] 849 0.104% 99.637% ( 580, 870 ] 1164 0.143% 99.780% ( 870, 1300 ] 883 0.109% 99.888% ( 1300, 1900 ] 498 0.061% 99.950% ( 1900, 2900 ] 288 0.035% 99.985% ( 2900, 4400 ] 301 0.037% 100.022% ( 4400, 6600 ] 70 0.009% 100.031% ( 6600, 9900 ] 16 0.002% 100.033% ( 9900, 14000 ] 3 0.000% 100.033% ( 14000, 22000 ] 5 0.001% 100.034% ( 22000, 33000 ] 3 0.000% 100.034% ( 50000, 75000 ] 1 0.000% 100.034% ( 110000, 170000 ] 1 0.000% 100.034% ( 170000, 250000 ] 1 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 199233 Average: 7.4820 StdDev: 117.00 Min: 1 Median: 1.8735 Max: 20321 Percentiles: P50: 1.87 P75: 2.82 P99: 9.61 P99.9: 1127.17 P99.99: 3432.80 ------------------------------------------------------ [ 0, 1 ] 5145 2.582% 2.582% # ( 1, 2 ] 108153 54.285% 56.867% ########### ( 2, 3 ] 44244 22.207% 79.074% #### ( 3, 4 ] 18984 9.529% 88.603% ## ( 4, 6 ] 17366 8.716% 97.319% ## ( 6, 10 ] 3715 1.865% 99.184% ( 10, 15 ] 483 0.242% 99.426% ( 15, 22 ] 50 0.025% 99.451% ( 22, 34 ] 4 0.002% 99.453% ( 34, 51 ] 8 0.004% 99.457% ( 51, 76 ] 20 0.010% 99.467% ( 76, 110 ] 18 0.009% 99.476% ( 110, 170 ] 100 0.050% 99.527% ( 170, 250 ] 138 0.069% 99.596% ( 250, 380 ] 165 0.083% 99.679% ( 380, 580 ] 168 0.084% 99.763% ( 580, 870 ] 201 0.101% 99.864% ( 870, 1300 ] 120 0.060% 99.924% ( 1300, 1900 ] 65 0.033% 99.957% ( 1900, 2900 ] 54 0.027% 99.984% ( 2900, 4400 ] 34 0.017% 100.001% ( 4400, 6600 ] 10 0.005% 100.006% ( 6600, 9900 ] 2 0.001% 100.007% ( 9900, 14000 ] 1 0.001% 100.008% ( 14000, 22000 ] 3 0.002% 100.009% ** Level 2 read latency histogram (micros): Count: 836741 Average: 14.2082 StdDev: 187.12 Min: 1 Median: 1.9593 Max: 37955 Percentiles: P50: 1.96 P75: 2.97 P99: 11.11 P99.9: 1596.71 P99.99: 2379.90 ------------------------------------------------------ [ 0, 1 ] 18721 2.237% 2.237% ( 1, 2 ] 416600 49.788% 52.026% ########## ( 2, 3 ] 198300 23.699% 75.725% ##### ( 3, 4 ] 87973 10.514% 86.239% ## ( 4, 6 ] 84431 10.090% 96.329% ## ( 6, 10 ] 21358 2.553% 98.882% # ( 10, 15 ] 4446 0.531% 99.413% ( 15, 22 ] 585 0.070% 99.483% ( 22, 34 ] 86 0.010% 99.493% ( 34, 51 ] 63 0.008% 99.501% ( 51, 76 ] 49 0.006% 99.507% ( 76, 110 ] 34 0.004% 99.511% ( 110, 170 ] 69 0.008% 99.519% ( 170, 250 ] 117 0.014% 99.533% ( 250, 380 ] 280 0.033% 99.566% ( 380, 580 ] 578 0.069% 99.635% ( 580, 870 ] 881 0.105% 99.741% ( 870, 1300 ] 951 0.114% 99.854% ( 1300, 1900 ] 773 0.092% 99.947% ( 1900, 2900 ] 755 0.090% 100.037% ( 2900, 4400 ] 756 0.090% 100.127% ( 4400, 6600 ] 260 0.031% 100.158% ( 6600, 9900 ] 31 0.004% 100.162% ( 9900, 14000 ] 1 0.000% 100.162% ( 14000, 22000 ] 1 0.000% 100.162% ( 22000, 33000 ] 2 0.000% 100.163% ( 33000, 50000 ] 1 0.000% 100.163% ** Level 3 read latency histogram (micros): Count: 2140310 Average: 10.8237 StdDev: 235.73 Min: 1 Median: 1.9415 Max: 194849 Percentiles: P50: 1.94 P75: 2.93 P99: 9.58 P99.9: 846.71 P99.99: 1254.29 ------------------------------------------------------ [ 0, 1 ] 37692 1.761% 1.761% ( 1, 2 ] 1096568 51.234% 52.995% ########## ( 2, 3 ] 508501 23.758% 76.753% ##### ( 3, 4 ] 223190 10.428% 87.181% ## ( 4, 6 ] 209521 9.789% 96.971% ## ( 6, 10 ] 48572 2.269% 99.240% ( 10, 15 ] 8245 0.385% 99.625% ( 15, 22 ] 996 0.047% 99.672% ( 22, 34 ] 93 0.004% 99.676% ( 34, 51 ] 121 0.006% 99.682% ( 51, 76 ] 176 0.008% 99.690% ( 76, 110 ] 74 0.003% 99.693% ( 110, 170 ] 235 0.011% 99.704% ( 170, 250 ] 377 0.018% 99.722% ( 250, 380 ] 656 0.031% 99.753% ( 380, 580 ] 1317 0.062% 99.814% ( 580, 870 ] 1996 0.093% 99.907% ( 870, 1300 ] 1976 0.092% 100.000% ( 1300, 1900 ] 1294 0.060% 100.060% ( 1900, 2900 ] 1198 0.056% 100.116% ( 2900, 4400 ] 1276 0.060% 100.176% ( 4400, 6600 ] 322 0.015% 100.191% ( 6600, 9900 ] 61 0.003% 100.194% ( 9900, 14000 ] 4 0.000% 100.194% ( 14000, 22000 ] 18 0.001% 100.195% ( 22000, 33000 ] 9 0.000% 100.195% ( 33000, 50000 ] 2 0.000% 100.195% ( 110000, 170000 ] 1 0.000% 100.195% ( 170000, 250000 ] 1 0.000% 100.195% ** Level 4 read latency histogram (micros): Count: 1005616 Average: 20.1903 StdDev: 419.11 Min: 1 Median: 1.9258 Max: 161952 Percentiles: P50: 1.93 P75: 2.94 P99: 338.11 P99.9: 2202.84 P99.99: 3237.06 ------------------------------------------------------ [ 0, 1 ] 21358 2.124% 2.124% ( 1, 2 ] 520024 51.712% 53.836% ########## ( 2, 3 ] 227519 22.625% 76.461% ##### ( 3, 4 ] 100842 10.028% 86.489% ## ( 4, 6 ] 93364 9.284% 95.773% ## ( 6, 10 ] 24777 2.464% 98.237% ( 10, 15 ] 3940 0.392% 98.629% ( 15, 22 ] 480 0.048% 98.676% ( 22, 34 ] 42 0.004% 98.680% ( 34, 51 ] 64 0.006% 98.687% ( 51, 76 ] 90 0.009% 98.696% ( 76, 110 ] 153 0.015% 98.711% ( 110, 170 ] 795 0.079% 98.790% ( 170, 250 ] 1163 0.116% 98.906% ( 250, 380 ] 1400 0.139% 99.045% ( 380, 580 ] 2105 0.209% 99.254% ( 580, 870 ] 2599 0.258% 99.513% ( 870, 1300 ] 2238 0.223% 99.735% ( 1300, 1900 ] 1360 0.135% 99.870% ( 1900, 2900 ] 982 0.098% 99.968% ( 2900, 4400 ] 981 0.098% 100.066% ( 4400, 6600 ] 318 0.032% 100.097% ( 6600, 9900 ] 57 0.006% 100.103% ( 9900, 14000 ] 6 0.001% 100.104% ( 14000, 22000 ] 16 0.002% 100.105% ( 22000, 33000 ] 10 0.001% 100.106% ( 33000, 50000 ] 1 0.000% 100.106% ( 110000, 170000 ] 5 0.000% 100.107% ** Level 5 read latency histogram (micros): Count: 54286 Average: 1068.2391 StdDev: 1716.91 Min: 77 Median: 669.3895 Max: 184032 Percentiles: P50: 669.39 P75: 1231.81 P99: 6016.13 P99.9: 10313.38 P99.99: 32705.34 ------------------------------------------------------ ( 76, 110 ] 641 1.181% 1.181% ( 110, 170 ] 3551 6.541% 7.722% # ( 170, 250 ] 5134 9.457% 17.179% ## ( 250, 380 ] 6268 11.546% 28.726% ## ( 380, 580 ] 8560 15.768% 44.494% ### ( 580, 870 ] 9697 17.863% 62.357% #### ( 870, 1300 ] 8157 15.026% 77.383% ### ( 1300, 1900 ] 4542 8.367% 85.750% ## ( 1900, 2900 ] 3135 5.775% 91.525% # ( 2900, 4400 ] 3206 5.906% 97.430% # ( 4400, 6600 ] 1160 2.137% 99.567% ( 6600, 9900 ] 179 0.330% 99.897% ( 9900, 14000 ] 17 0.031% 99.928% ( 14000, 22000 ] 18 0.033% 99.961% ( 22000, 33000 ] 16 0.029% 99.991% ( 33000, 50000 ] 7 0.013% 100.004% ( 170000, 250000 ] 2 0.004% 100.007% ** DB Stats ** Uptime(secs): 19.8 total, 3.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 148.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.061 H:M:S, 40.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 249.31 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.281 H:M:S, 7.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/08/12-06:52:07 ... thread 0: (1000000,4000000) ops and (289195.8,173115.3) ops/second in (3.457865,23.105984) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/9 2.70 GB 157.3 2.6 0.0 2.6 6.3 3.7 0.0 1.7 76.8 188.3 34.44 21.74 60 0.574 2686K 3004 0.0 0.0 L1 10/10 880.04 MB 0.0 1.4 1.2 0.2 1.4 1.2 0.0 1.2 128.8 128.5 11.08 6.79 3 3.694 1449K 3501 0.0 0.0 L2 1/0 43.11 MB 0.4 0.5 0.2 0.3 0.5 0.2 0.1 2.2 138.8 138.5 3.43 2.16 2 1.713 482K 952 0.0 0.0 L3 14/0 929.46 MB 0.9 7.5 3.6 3.9 7.4 3.6 0.0 2.0 113.5 112.8 67.59 35.63 31 2.180 4988K 15K 0.0 0.0 L4 180/0 9.55 GB 1.0 8.6 4.8 3.8 8.4 4.6 0.5 1.8 124.0 121.4 71.18 41.88 54 1.318 4518K 0 0.0 0.0 L5 1164/0 95.35 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1384/19 109.41 GB 0.0 20.6 9.8 10.8 24.1 13.3 5.8 6.4 112.1 131.3 187.73 108.20 150 1.252 14M 22K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.6 9.8 10.8 24.1 13.3 5.8 6.4 112.1 131.3 187.73 108.20 150 1.252 14M 22K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.6 9.8 10.8 20.3 9.6 0.0 0.0 127.0 125.5 165.75 97.04 99 1.674 14M 22K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 174.9 21.97 11.16 51 0.431 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.3 total, 23.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.07 GB write, 1058.75 MB/s write, 20.55 GB read, 903.97 MB/s read, 187.7 seconds Interval compaction: 24.07 GB write, 1066.75 MB/s write, 20.55 GB read, 910.80 MB/s read, 187.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 71, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 71, interval: 71 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1100982 Average: 10.7287 StdDev: 267.22 Min: 1 Median: 1.7065 Max: 182984 Percentiles: P50: 1.71 P75: 2.50 P99: 166.18 P99.9: 1143.39 P99.99: 2365.48 ------------------------------------------------------ [ 0, 1 ] 113223 10.284% 10.284% ## ( 1, 2 ] 618933 56.216% 66.500% ########### ( 2, 3 ] 186040 16.898% 83.398% ### ( 3, 4 ] 79995 7.266% 90.664% # ( 4, 6 ] 66393 6.030% 96.694% # ( 6, 10 ] 14580 1.324% 98.018% ( 10, 15 ] 2490 0.226% 98.244% ( 15, 22 ] 299 0.027% 98.272% ( 22, 34 ] 39 0.004% 98.275% ( 34, 51 ] 22 0.002% 98.277% ( 51, 76 ] 32 0.003% 98.280% ( 76, 110 ] 1833 0.166% 98.447% ( 110, 170 ] 6509 0.591% 99.038% ( 170, 250 ] 3494 0.317% 99.355% ( 250, 380 ] 1983 0.180% 99.535% ( 380, 580 ] 1920 0.174% 99.710% ( 580, 870 ] 1500 0.136% 99.846% ( 870, 1300 ] 939 0.085% 99.931% ( 1300, 1900 ] 506 0.046% 99.977% ( 1900, 2900 ] 307 0.028% 100.005% ( 2900, 4400 ] 311 0.028% 100.033% ( 4400, 6600 ] 70 0.006% 100.040% ( 6600, 9900 ] 16 0.001% 100.041% ( 9900, 14000 ] 5 0.000% 100.042% ( 14000, 22000 ] 5 0.000% 100.042% ( 22000, 33000 ] 3 0.000% 100.042% ( 50000, 75000 ] 1 0.000% 100.042% ( 110000, 170000 ] 1 0.000% 100.042% ( 170000, 250000 ] 1 0.000% 100.043% ** Level 1 read latency histogram (micros): Count: 227575 Average: 8.0862 StdDev: 111.14 Min: 1 Median: 1.9171 Max: 20321 Percentiles: P50: 1.92 P75: 2.93 P99: 79.19 P99.9: 1034.46 P99.99: 3253.25 ------------------------------------------------------ [ 0, 1 ] 5982 2.629% 2.629% # ( 1, 2 ] 117554 51.655% 54.284% ########## ( 2, 3 ] 50663 22.262% 76.546% #### ( 3, 4 ] 22602 9.932% 86.477% ## ( 4, 6 ] 22586 9.925% 96.402% ## ( 6, 10 ] 4932 2.167% 98.569% ( 10, 15 ] 736 0.323% 98.893% ( 15, 22 ] 186 0.082% 98.974% ( 22, 34 ] 14 0.006% 98.981% ( 34, 51 ] 8 0.004% 98.984% ( 51, 76 ] 20 0.009% 98.993% ( 76, 110 ] 173 0.076% 99.069% ( 110, 170 ] 658 0.289% 99.358% ( 170, 250 ] 422 0.185% 99.543% ( 250, 380 ] 277 0.122% 99.665% ( 380, 580 ] 260 0.114% 99.779% ( 580, 870 ] 227 0.100% 99.879% ( 870, 1300 ] 124 0.054% 99.934% ( 1300, 1900 ] 66 0.029% 99.963% ( 1900, 2900 ] 54 0.024% 99.986% ( 2900, 4400 ] 35 0.015% 100.002% ( 4400, 6600 ] 10 0.004% 100.006% ( 6600, 9900 ] 2 0.001% 100.007% ( 9900, 14000 ] 1 0.000% 100.007% ( 14000, 22000 ] 3 0.001% 100.009% ** Level 2 read latency histogram (micros): Count: 836741 Average: 14.2082 StdDev: 187.12 Min: 1 Median: 1.9593 Max: 37955 Percentiles: P50: 1.96 P75: 2.97 P99: 11.11 P99.9: 1596.71 P99.99: 2379.90 ------------------------------------------------------ [ 0, 1 ] 18721 2.237% 2.237% ( 1, 2 ] 416600 49.788% 52.026% ########## ( 2, 3 ] 198300 23.699% 75.725% ##### ( 3, 4 ] 87973 10.514% 86.239% ## ( 4, 6 ] 84431 10.090% 96.329% ## ( 6, 10 ] 21358 2.553% 98.882% # ( 10, 15 ] 4446 0.531% 99.413% ( 15, 22 ] 585 0.070% 99.483% ( 22, 34 ] 86 0.010% 99.493% ( 34, 51 ] 63 0.008% 99.501% ( 51, 76 ] 49 0.006% 99.507% ( 76, 110 ] 34 0.004% 99.511% ( 110, 170 ] 69 0.008% 99.519% ( 170, 250 ] 117 0.014% 99.533% ( 250, 380 ] 280 0.033% 99.566% ( 380, 580 ] 578 0.069% 99.635% ( 580, 870 ] 881 0.105% 99.741% ( 870, 1300 ] 951 0.114% 99.854% ( 1300, 1900 ] 773 0.092% 99.947% ( 1900, 2900 ] 755 0.090% 100.037% ( 2900, 4400 ] 756 0.090% 100.127% ( 4400, 6600 ] 260 0.031% 100.158% ( 6600, 9900 ] 31 0.004% 100.162% ( 9900, 14000 ] 1 0.000% 100.162% ( 14000, 22000 ] 1 0.000% 100.162% ( 22000, 33000 ] 2 0.000% 100.163% ( 33000, 50000 ] 1 0.000% 100.163% ** Level 3 read latency histogram (micros): Count: 2141235 Average: 10.8958 StdDev: 235.74 Min: 1 Median: 1.9420 Max: 194849 Percentiles: P50: 1.94 P75: 2.93 P99: 9.64 P99.9: 847.66 P99.99: 1254.61 ------------------------------------------------------ [ 0, 1 ] 37692 1.760% 1.760% ( 1, 2 ] 1096580 51.213% 52.973% ########## ( 2, 3 ] 508541 23.750% 76.723% ##### ( 3, 4 ] 223220 10.425% 87.148% ## ( 4, 6 ] 209559 9.787% 96.934% ## ( 6, 10 ] 48580 2.269% 99.203% ( 10, 15 ] 8246 0.385% 99.588% ( 15, 22 ] 996 0.047% 99.635% ( 22, 34 ] 93 0.004% 99.639% ( 34, 51 ] 121 0.006% 99.645% ( 51, 76 ] 176 0.008% 99.653% ( 76, 110 ] 194 0.009% 99.662% ( 110, 170 ] 601 0.028% 99.690% ( 170, 250 ] 527 0.025% 99.715% ( 250, 380 ] 734 0.034% 99.749% ( 380, 580 ] 1374 0.064% 99.813% ( 580, 870 ] 2015 0.094% 99.907% ( 870, 1300 ] 1981 0.093% 100.000% ( 1300, 1900 ] 1294 0.060% 100.060% ( 1900, 2900 ] 1199 0.056% 100.116% ( 2900, 4400 ] 1276 0.060% 100.176% ( 4400, 6600 ] 322 0.015% 100.191% ( 6600, 9900 ] 61 0.003% 100.194% ( 9900, 14000 ] 4 0.000% 100.194% ( 14000, 22000 ] 18 0.001% 100.195% ( 22000, 33000 ] 9 0.000% 100.195% ( 33000, 50000 ] 2 0.000% 100.195% ( 110000, 170000 ] 1 0.000% 100.195% ( 170000, 250000 ] 1 0.000% 100.195% ** Level 4 read latency histogram (micros): Count: 1013129 Average: 21.4420 StdDev: 418.10 Min: 1 Median: 1.9329 Max: 161952 Percentiles: P50: 1.93 P75: 2.96 P99: 391.68 P99.9: 2200.07 P99.99: 3238.28 ------------------------------------------------------ [ 0, 1 ] 21358 2.108% 2.108% ( 1, 2 ] 520079 51.334% 53.442% ########## ( 2, 3 ] 227735 22.478% 75.920% #### ( 3, 4 ] 100985 9.968% 85.888% ## ( 4, 6 ] 93502 9.229% 95.117% ## ( 6, 10 ] 24803 2.448% 97.565% ( 10, 15 ] 3945 0.389% 97.955% ( 15, 22 ] 482 0.048% 98.002% ( 22, 34 ] 43 0.004% 98.006% ( 34, 51 ] 64 0.006% 98.013% ( 51, 76 ] 91 0.009% 98.022% ( 76, 110 ] 1125 0.111% 98.133% ( 110, 170 ] 3961 0.391% 98.524% ( 170, 250 ] 2647 0.261% 98.785% ( 250, 380 ] 2027 0.200% 98.985% ( 380, 580 ] 2580 0.255% 99.240% ( 580, 870 ] 2772 0.274% 99.513% ( 870, 1300 ] 2260 0.223% 99.736% ( 1300, 1900 ] 1361 0.134% 99.871% ( 1900, 2900 ] 986 0.097% 99.968% ( 2900, 4400 ] 983 0.097% 100.065% ( 4400, 6600 ] 318 0.031% 100.097% ( 6600, 9900 ] 58 0.006% 100.102% ( 9900, 14000 ] 6 0.001% 100.103% ( 14000, 22000 ] 16 0.002% 100.104% ( 22000, 33000 ] 10 0.001% 100.105% ( 33000, 50000 ] 1 0.000% 100.106% ( 110000, 170000 ] 5 0.000% 100.106% ** Level 5 read latency histogram (micros): Count: 96612 Average: 690.0211 StdDev: 1360.76 Min: 76 Median: 309.6585 Max: 184032 Percentiles: P50: 309.66 P75: 775.49 P99: 5219.08 P99.9: 9177.79 P99.99: 30482.92 ------------------------------------------------------ ( 51, 76 ] 2 0.002% 0.002% ( 76, 110 ] 6389 6.613% 6.615% # ( 110, 170 ] 23060 23.869% 30.484% ##### ( 170, 250 ] 14259 14.759% 45.243% ### ( 250, 380 ] 10015 10.366% 55.609% ## ( 380, 580 ] 11556 11.961% 67.570% ## ( 580, 870 ] 10648 11.021% 78.592% ## ( 870, 1300 ] 8333 8.625% 87.217% ## ( 1300, 1900 ] 4577 4.738% 91.954% # ( 1900, 2900 ] 3162 3.273% 95.227% # ( 2900, 4400 ] 3213 3.326% 98.553% # ( 4400, 6600 ] 1160 1.201% 99.754% ( 6600, 9900 ] 181 0.187% 99.941% ( 9900, 14000 ] 17 0.018% 99.959% ( 14000, 22000 ] 18 0.019% 99.977% ( 22000, 33000 ] 16 0.017% 99.994% ( 33000, 50000 ] 7 0.007% 100.001% ( 170000, 250000 ] 2 0.002% 100.003% ** DB Stats ** Uptime(secs): 23.3 total, 3.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 169.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.061 H:M:S, 34.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 284.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/12-06:52:11 ... thread 0: (1000000,5000000) ops and (237218.4,183006.0) ops/second in (4.215524,27.321508) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/9 3.69 GB 258.0 3.6 0.0 3.6 8.3 4.7 0.0 1.8 88.2 205.2 41.42 28.21 80 0.518 3710K 3984 0.0 0.0 L1 10/10 880.04 MB 0.0 1.4 1.2 0.2 1.4 1.2 0.0 1.2 128.8 128.5 11.08 6.79 3 3.694 1449K 3501 0.0 0.0 L2 1/0 43.11 MB 0.4 0.5 0.2 0.3 0.5 0.2 0.1 2.2 138.8 138.5 3.43 2.16 2 1.713 482K 952 0.0 0.0 L3 14/0 929.46 MB 0.9 7.5 3.6 3.9 7.4 3.6 0.0 2.0 113.5 112.8 67.59 35.63 31 2.180 4988K 15K 0.0 0.0 L4 180/0 9.55 GB 1.0 8.6 4.8 3.8 8.4 4.6 0.5 1.8 124.0 121.4 71.18 41.88 54 1.318 4518K 0 0.0 0.0 L5 1164/0 95.35 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1388/19 110.40 GB 0.0 21.5 9.8 11.7 26.0 14.3 5.8 5.5 113.3 136.9 194.71 114.67 170 1.145 15M 23K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.5 9.8 11.7 26.0 14.3 5.8 5.5 113.3 136.9 194.71 114.67 170 1.145 15M 23K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.5 9.8 11.7 21.3 9.6 0.0 0.0 130.1 128.7 169.54 100.76 103 1.646 15M 23K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 192.8 25.17 13.91 67 0.376 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.5 total, 27.3 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.04 GB write, 969.72 MB/s write, 21.54 GB read, 802.05 MB/s read, 194.7 seconds Interval compaction: 26.04 GB write, 975.92 MB/s write, 21.54 GB read, 807.17 MB/s read, 194.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 71, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 71, interval: 75 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1391810 Average: 11.6995 StdDev: 239.38 Min: 0 Median: 1.6512 Max: 182984 Percentiles: P50: 1.65 P75: 2.37 P99: 209.96 P99.9: 960.33 P99.99: 1850.57 ------------------------------------------------------ [ 0, 1 ] 190210 13.666% 13.666% ### ( 1, 2 ] 776561 55.795% 69.461% ########### ( 2, 3 ] 207724 14.925% 84.386% ### ( 3, 4 ] 88102 6.330% 90.716% # ( 4, 6 ] 70850 5.090% 95.807% # ( 6, 10 ] 15640 1.124% 96.930% ( 10, 15 ] 2771 0.199% 97.129% ( 15, 22 ] 341 0.025% 97.154% ( 22, 34 ] 48 0.003% 97.157% ( 34, 51 ] 27 0.002% 97.159% ( 51, 76 ] 34 0.002% 97.162% ( 76, 110 ] 5154 0.370% 97.532% ( 110, 170 ] 16662 1.197% 98.729% ( 170, 250 ] 7543 0.542% 99.271% ( 250, 380 ] 3547 0.255% 99.526% ( 380, 580 ] 3131 0.225% 99.751% ( 580, 870 ] 1865 0.134% 99.885% ( 870, 1300 ] 991 0.071% 99.956% ( 1300, 1900 ] 512 0.037% 99.993% ( 1900, 2900 ] 320 0.023% 100.016% ( 2900, 4400 ] 318 0.023% 100.039% ( 4400, 6600 ] 70 0.005% 100.044% ( 6600, 9900 ] 16 0.001% 100.045% ( 9900, 14000 ] 5 0.000% 100.045% ( 14000, 22000 ] 5 0.000% 100.046% ( 22000, 33000 ] 3 0.000% 100.046% ( 50000, 75000 ] 1 0.000% 100.046% ( 110000, 170000 ] 1 0.000% 100.046% ( 170000, 250000 ] 1 0.000% 100.046% ** Level 1 read latency histogram (micros): Count: 256679 Average: 8.6158 StdDev: 105.92 Min: 1 Median: 1.9752 Max: 20321 Percentiles: P50: 1.98 P75: 3.13 P99: 142.69 P99.9: 942.76 P99.99: 3128.52 ------------------------------------------------------ [ 0, 1 ] 6457 2.516% 2.516% # ( 1, 2 ] 124978 48.690% 51.206% ########## ( 2, 3 ] 57453 22.383% 73.589% #### ( 3, 4 ] 26990 10.515% 84.104% ## ( 4, 6 ] 29206 11.378% 95.483% ## ( 6, 10 ] 6400 2.493% 97.976% ( 10, 15 ] 1048 0.408% 98.384% ( 15, 22 ] 373 0.145% 98.530% ( 22, 34 ] 27 0.011% 98.540% ( 34, 51 ] 8 0.003% 98.543% ( 51, 76 ] 20 0.008% 98.551% ( 76, 110 ] 377 0.147% 98.698% ( 110, 170 ] 1423 0.554% 99.252% ( 170, 250 ] 677 0.264% 99.516% ( 250, 380 ] 367 0.143% 99.659% ( 380, 580 ] 348 0.136% 99.795% ( 580, 870 ] 249 0.097% 99.892% ( 870, 1300 ] 126 0.049% 99.941% ( 1300, 1900 ] 66 0.026% 99.966% ( 1900, 2900 ] 55 0.021% 99.988% ( 2900, 4400 ] 35 0.014% 100.002% ( 4400, 6600 ] 10 0.004% 100.005% ( 6600, 9900 ] 2 0.001% 100.006% ( 9900, 14000 ] 1 0.000% 100.007% ( 14000, 22000 ] 3 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 836741 Average: 14.2082 StdDev: 187.12 Min: 1 Median: 1.9593 Max: 37955 Percentiles: P50: 1.96 P75: 2.97 P99: 11.11 P99.9: 1596.71 P99.99: 2379.90 ------------------------------------------------------ [ 0, 1 ] 18721 2.237% 2.237% ( 1, 2 ] 416600 49.788% 52.026% ########## ( 2, 3 ] 198300 23.699% 75.725% ##### ( 3, 4 ] 87973 10.514% 86.239% ## ( 4, 6 ] 84431 10.090% 96.329% ## ( 6, 10 ] 21358 2.553% 98.882% # ( 10, 15 ] 4446 0.531% 99.413% ( 15, 22 ] 585 0.070% 99.483% ( 22, 34 ] 86 0.010% 99.493% ( 34, 51 ] 63 0.008% 99.501% ( 51, 76 ] 49 0.006% 99.507% ( 76, 110 ] 34 0.004% 99.511% ( 110, 170 ] 69 0.008% 99.519% ( 170, 250 ] 117 0.014% 99.533% ( 250, 380 ] 280 0.033% 99.566% ( 380, 580 ] 578 0.069% 99.635% ( 580, 870 ] 881 0.105% 99.741% ( 870, 1300 ] 951 0.114% 99.854% ( 1300, 1900 ] 773 0.092% 99.947% ( 1900, 2900 ] 755 0.090% 100.037% ( 2900, 4400 ] 756 0.090% 100.127% ( 4400, 6600 ] 260 0.031% 100.158% ( 6600, 9900 ] 31 0.004% 100.162% ( 9900, 14000 ] 1 0.000% 100.162% ( 14000, 22000 ] 1 0.000% 100.162% ( 22000, 33000 ] 2 0.000% 100.163% ( 33000, 50000 ] 1 0.000% 100.163% ** Level 3 read latency histogram (micros): Count: 2142492 Average: 10.9989 StdDev: 235.73 Min: 1 Median: 1.9425 Max: 194849 Percentiles: P50: 1.94 P75: 2.93 P99: 9.74 P99.9: 848.18 P99.99: 1254.84 ------------------------------------------------------ [ 0, 1 ] 37692 1.759% 1.759% ( 1, 2 ] 1096580 51.182% 52.942% ########## ( 2, 3 ] 508541 23.736% 76.678% ##### ( 3, 4 ] 223220 10.419% 87.096% ## ( 4, 6 ] 209559 9.781% 96.877% ## ( 6, 10 ] 48580 2.267% 99.145% ( 10, 15 ] 8246 0.385% 99.530% ( 15, 22 ] 996 0.046% 99.576% ( 22, 34 ] 93 0.004% 99.581% ( 34, 51 ] 121 0.006% 99.586% ( 51, 76 ] 176 0.008% 99.594% ( 76, 110 ] 385 0.018% 99.612% ( 110, 170 ] 1262 0.059% 99.671% ( 170, 250 ] 755 0.035% 99.707% ( 250, 380 ] 813 0.038% 99.745% ( 380, 580 ] 1444 0.067% 99.812% ( 580, 870 ] 2040 0.095% 99.907% ( 870, 1300 ] 1983 0.093% 100.000% ( 1300, 1900 ] 1294 0.060% 100.060% ( 1900, 2900 ] 1200 0.056% 100.116% ( 2900, 4400 ] 1276 0.060% 100.176% ( 4400, 6600 ] 322 0.015% 100.191% ( 6600, 9900 ] 61 0.003% 100.194% ( 9900, 14000 ] 4 0.000% 100.194% ( 14000, 22000 ] 18 0.001% 100.195% ( 22000, 33000 ] 9 0.000% 100.195% ( 33000, 50000 ] 2 0.000% 100.195% ( 110000, 170000 ] 1 0.000% 100.195% ( 170000, 250000 ] 1 0.000% 100.195% ** Level 4 read latency histogram (micros): Count: 1023189 Average: 22.9824 StdDev: 416.51 Min: 1 Median: 1.9425 Max: 161952 Percentiles: P50: 1.94 P75: 2.99 P99: 428.89 P99.9: 2191.31 P99.99: 3236.75 ------------------------------------------------------ [ 0, 1 ] 21358 2.087% 2.087% ( 1, 2 ] 520132 50.834% 52.922% ########## ( 2, 3 ] 227863 22.270% 75.192% #### ( 3, 4 ] 101071 9.878% 85.070% ## ( 4, 6 ] 93576 9.146% 94.215% ## ( 6, 10 ] 24815 2.425% 96.641% ( 10, 15 ] 3949 0.386% 97.026% ( 15, 22 ] 483 0.047% 97.074% ( 22, 34 ] 43 0.004% 97.078% ( 34, 51 ] 64 0.006% 97.084% ( 51, 76 ] 92 0.009% 97.093% ( 76, 110 ] 2724 0.266% 97.359% ( 110, 170 ] 8904 0.870% 98.230% ( 170, 250 ] 4429 0.433% 98.662% ( 250, 380 ] 2697 0.264% 98.926% ( 380, 580 ] 3097 0.303% 99.229% ( 580, 870 ] 2940 0.287% 99.516% ( 870, 1300 ] 2279 0.223% 99.739% ( 1300, 1900 ] 1362 0.133% 99.872% ( 1900, 2900 ] 988 0.097% 99.968% ( 2900, 4400 ] 983 0.096% 100.065% ( 4400, 6600 ] 318 0.031% 100.096% ( 6600, 9900 ] 58 0.006% 100.101% ( 9900, 14000 ] 6 0.001% 100.102% ( 14000, 22000 ] 16 0.002% 100.103% ( 22000, 33000 ] 10 0.001% 100.104% ( 33000, 50000 ] 1 0.000% 100.104% ( 110000, 170000 ] 5 0.000% 100.105% ** Level 5 read latency histogram (micros): Count: 152589 Average: 504.4471 StdDev: 1112.58 Min: 73 Median: 199.2433 Max: 184032 Percentiles: P50: 199.24 P75: 500.53 P99: 4340.33 P99.9: 8157.22 P99.99: 26634.51 ------------------------------------------------------ ( 51, 76 ] 11 0.007% 0.007% ( 76, 110 ] 15695 10.286% 10.293% ## ( 110, 170 ] 51632 33.837% 44.130% ####### ( 170, 250 ] 24502 16.058% 60.188% ### ( 250, 380 ] 13823 9.059% 69.247% ## ( 380, 580 ] 14567 9.547% 78.793% ## ( 580, 870 ] 11527 7.554% 86.348% ## ( 870, 1300 ] 8438 5.530% 91.878% # ( 1300, 1900 ] 4594 3.011% 94.888% # ( 1900, 2900 ] 3187 2.089% 96.977% ( 2900, 4400 ] 3215 2.107% 99.084% ( 4400, 6600 ] 1160 0.760% 99.844% ( 6600, 9900 ] 181 0.119% 99.963% ( 9900, 14000 ] 17 0.011% 99.974% ( 14000, 22000 ] 18 0.012% 99.986% ( 22000, 33000 ] 16 0.010% 99.996% ( 33000, 50000 ] 7 0.005% 100.001% ( 170000, 250000 ] 2 0.001% 100.002% ** DB Stats ** Uptime(secs): 27.5 total, 4.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 178.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.802 H:M:S, 32.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 233.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.740 H:M:S, 17.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 269.803 micros/op 14811 ops/sec 60.156 seconds 890996 operations; 14.4 MB/s (225999 of 225999 found) Microseconds per read: Count: 890996 Average: 269.8046 StdDev: 892.60 Min: 1 Median: 168.0401 Max: 194893 Percentiles: P50: 168.04 P75: 235.32 P99: 1850.23 P99.9: 13059.39 P99.99: 31347.36 ------------------------------------------------------ [ 0, 1 ] 1 0.000% 0.000% ( 1, 2 ] 10 0.001% 0.001% ( 2, 3 ] 45 0.005% 0.006% ( 3, 4 ] 60 0.007% 0.013% ( 4, 6 ] 83 0.009% 0.022% ( 6, 10 ] 444 0.050% 0.072% ( 10, 15 ] 3453 0.388% 0.460% ( 15, 22 ] 3676 0.413% 0.872% ( 22, 34 ] 6706 0.753% 1.625% ( 34, 51 ] 1522 0.171% 1.796% ( 51, 76 ] 197 0.022% 1.818% ( 76, 110 ] 28807 3.233% 5.051% # ( 110, 170 ] 414018 46.467% 51.518% ######### ( 170, 250 ] 256232 28.758% 80.276% ###### ( 250, 380 ] 91064 10.220% 90.496% ## ( 380, 580 ] 40149 4.506% 95.002% # ( 580, 870 ] 19909 2.234% 97.237% ( 870, 1300 ] 10935 1.227% 98.464% ( 1300, 1900 ] 5207 0.584% 99.048% ( 1900, 2900 ] 3267 0.367% 99.415% ( 2900, 4400 ] 2778 0.312% 99.727% ( 4400, 6600 ] 926 0.104% 99.831% ( 6600, 9900 ] 307 0.034% 99.865% ( 9900, 14000 ] 401 0.045% 99.910% ( 14000, 22000 ] 534 0.060% 99.970% ( 22000, 33000 ] 207 0.023% 99.993% ( 33000, 50000 ] 46 0.005% 99.999% ( 50000, 75000 ] 6 0.001% 99.999% ( 75000, 110000 ] 2 0.000% 100.000% ( 170000, 250000 ] 4 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 13018279 rocksdb.bloom.filter.full.positive COUNT : 1017354 rocksdb.bloom.filter.full.true.positive COUNT : 890572 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 424 rocksdb.memtable.miss COUNT : 890572 rocksdb.l0.hit COUNT : 31220 rocksdb.l1.hit COUNT : 11104 rocksdb.l2andup.hit COUNT : 848248 rocksdb.compaction.key.drop.new COUNT : 276195 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5614394 rocksdb.number.keys.read COUNT : 890996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5794054608 rocksdb.bytes.read COUNT : 890996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1737 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 38497237 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 27977309957 rocksdb.compact.write.bytes COUNT : 27687335231 rocksdb.flush.write.bytes COUNT : 5747017726 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 27 rocksdb.number.superversion_acquires COUNT : 1143 rocksdb.number.superversion_releases COUNT : 1105 rocksdb.number.superversion_cleanups COUNT : 288 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 352 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5700654080 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2187264 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31817301900 rocksdb.non.last.level.read.count COUNT : 7545440 rocksdb.block.checksum.compute.count COUNT : 7802760 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 167.179586 P95 : 579.285500 P99 : 1849.503852 P100 : 194891.000000 COUNT : 890996 SUM : 239613350 rocksdb.db.write.micros P50 : 1.570629 P95 : 4.566609 P99 : 9.353584 P100 : 938959.000000 COUNT : 5614394 SUM : 52960022 rocksdb.compaction.times.micros P50 : 1508823.529412 P95 : 3646666.666667 P99 : 9536000.000000 P100 : 26405856.000000 COUNT : 108 SUM : 204344600 rocksdb.compaction.times.cpu_micros P50 : 848846.153846 P95 : 1886000.000000 P99 : 6412000.000000 P100 : 12578483.000000 COUNT : 108 SUM : 121615169 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 865.735294 P95 : 53750.000000 P99 : 263923.000000 P100 : 263923.000000 COUNT : 77 SUM : 895606 rocksdb.compaction.outfile.sync.micros P50 : 27711.538462 P95 : 207523.809524 P99 : 316820.000000 P100 : 542756.000000 COUNT : 343 SUM : 19449192 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 420.000000 P95 : 4388.461538 P99 : 6350.666667 P100 : 7547.000000 COUNT : 202 SUM : 225986 rocksdb.table.open.io.micros P50 : 8861.401425 P95 : 20099.633700 P99 : 24425.238095 P100 : 60732.000000 COUNT : 1737 SUM : 15530764 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.932256 P95 : 9.821031 P99 : 167.586948 P100 : 161957.000000 COUNT : 6774342 SUM : 100387892 rocksdb.read.block.get.micros P50 : 140.850611 P95 : 506.768122 P99 : 1772.186592 P100 : 194854.000000 COUNT : 1026693 SUM : 208761899 rocksdb.write.raw.block.micros P50 : 0.537980 P95 : 1.428634 P99 : 3.705464 P100 : 176437.000000 COUNT : 8098215 SUM : 27008109 rocksdb.numfiles.in.singlecompaction P50 : 2.637931 P95 : 5.510000 P99 : 14.275000 P100 : 25.000000 COUNT : 129 SUM : 450 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.566599 P95 : 1221.561858 P99 : 2616.887107 P100 : 938784.000000 COUNT : 189081 SUM : 38515510 rocksdb.sst.read.micros P50 : 1.993173 P95 : 159.852651 P99 : 501.600630 P100 : 194849.000000 COUNT : 7545502 SUM : 288745435 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 890996 SUM : 890996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5614394 SUM : 5794054608 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 229230.769231 P95 : 1013000.000000 P99 : 1162600.000000 P100 : 1185744.000000 COUNT : 77 SUM : 27186214 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 353 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0