[2024-11-20 06:03:09.598526] Starting SPDK v25.01-pre git sha1 f22e807f1 / DPDK 24.11.0-rc3 initialization... [2024-11-20 06:03:09.598797] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid601151 ] Set seed to 1732078989591821 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 06:03:09.769018] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.11.0-rc3 is used. There is no support for it in SPDK. Enabled only for validation. [2024-11-20 06:03:09.819332] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 06:03:09.840648] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 06:03:09.840687] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 601151' to capture a snapshot of events at runtime. [2024-11-20 06:03:09.840699] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 06:03:09.840709] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 06:03:09.840719] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid601151 for offline analysis/debug. [2024-11-20 06:03:09.841244] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 06:03:14 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/20-06:03:21 ... thread 0: (1000000,1000000) ops and (133305.6,133305.6) ops/second in (7.501563,7.501563) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/5 818.26 MB 12.6 0.4 0.0 0.4 1.2 0.8 0.0 1.5 43.0 136.2 8.78 3.87 10 0.878 383K 553 0.0 0.0 L1 3/3 123.72 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.0 1.0 96.3 96.2 4.78 2.23 1 4.776 467K 743 0.0 0.0 L2 6/1 328.60 MB 2.9 0.1 0.1 0.1 0.1 0.1 0.3 2.2 116.7 116.4 1.28 0.71 1 1.284 152K 381 0.0 0.0 L3 42/10 4.10 GB 3.0 2.7 1.8 0.8 2.6 1.8 0.2 1.4 97.7 96.1 28.05 12.88 19 1.476 1213K 0 0.0 0.0 L4 214/23 11.83 GB 1.1 2.8 2.2 0.6 2.8 2.2 0.1 1.3 118.5 117.6 24.14 13.98 24 1.006 2232K 6924 0.0 0.0 L5 1084/0 89.08 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1355/42 106.25 GB 0.0 6.4 4.5 1.9 7.2 5.3 0.6 9.0 98.3 109.5 67.03 33.66 55 1.219 4448K 8601 0.0 0.0 Int 0/0 0.00 KB 0.0 6.4 4.5 1.9 7.2 5.3 0.6 9.0 98.3 109.5 67.03 33.66 55 1.219 4448K 8601 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.4 4.5 1.9 6.4 4.5 0.0 0.0 109.2 108.0 60.36 31.35 46 1.312 4448K 8601 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 122.7 6.67 2.31 9 0.742 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.7 total, 7.5 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.17 GB write, 957.11 MB/s write, 6.44 GB read, 859.39 MB/s read, 67.0 seconds Interval compaction: 7.17 GB write, 978.14 MB/s write, 6.44 GB read, 878.27 MB/s read, 67.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 34, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 242613 Average: 11.4423 StdDev: 210.73 Min: 1 Median: 1.8861 Max: 45548 Percentiles: P50: 1.89 P75: 2.91 P99: 9.84 P99.9: 2292.55 P99.99: 5386.93 ------------------------------------------------------ [ 0, 1 ] 9281 3.825% 3.825% # ( 1, 2 ] 126430 52.112% 55.937% ########## ( 2, 3 ] 50639 20.872% 76.810% #### ( 3, 4 ] 24108 9.937% 86.746% ## ( 4, 6 ] 24568 10.126% 96.873% ## ( 6, 10 ] 5374 2.215% 99.088% ( 10, 15 ] 776 0.320% 99.408% ( 15, 22 ] 100 0.041% 99.449% ( 22, 34 ] 20 0.008% 99.457% ( 34, 51 ] 12 0.005% 99.462% ( 51, 76 ] 9 0.004% 99.466% ( 76, 110 ] 6 0.002% 99.468% ( 110, 170 ] 15 0.006% 99.474% ( 170, 250 ] 45 0.019% 99.493% ( 250, 380 ] 86 0.035% 99.528% ( 380, 580 ] 170 0.070% 99.599% ( 580, 870 ] 225 0.093% 99.691% ( 870, 1300 ] 274 0.113% 99.804% ( 1300, 1900 ] 179 0.074% 99.878% ( 1900, 2900 ] 136 0.056% 99.934% ( 2900, 4400 ] 116 0.048% 99.982% ( 4400, 6600 ] 44 0.018% 100.000% ( 6600, 9900 ] 8 0.003% 100.003% ( 9900, 14000 ] 1 0.000% 100.004% ( 14000, 22000 ] 4 0.002% 100.005% ( 22000, 33000 ] 2 0.001% 100.006% ( 33000, 50000 ] 2 0.001% 100.007% ** Level 1 read latency histogram (micros): Count: 21470 Average: 23.5615 StdDev: 235.61 Min: 1 Median: 1.9775 Max: 6105 Percentiles: P50: 1.98 P75: 3.00 P99: 609.00 P99.9: 4047.08 P99.99: 6105.00 ------------------------------------------------------ [ 0, 1 ] 299 1.393% 1.393% ( 1, 2 ] 10676 49.725% 51.118% ########## ( 2, 3 ] 5150 23.987% 75.105% ##### ( 3, 4 ] 2182 10.163% 85.268% ## ( 4, 6 ] 2208 10.284% 95.552% ## ( 6, 10 ] 554 2.580% 98.132% # ( 10, 15 ] 115 0.536% 98.668% ( 15, 22 ] 13 0.061% 98.728% ( 22, 34 ] 1 0.005% 98.733% ( 34, 51 ] 3 0.014% 98.747% ( 51, 76 ] 1 0.005% 98.752% ( 76, 110 ] 1 0.005% 98.756% ( 110, 170 ] 5 0.023% 98.780% ( 170, 250 ] 6 0.028% 98.808% ( 250, 380 ] 9 0.042% 98.850% ( 380, 580 ] 27 0.126% 98.975% ( 580, 870 ] 53 0.247% 99.222% ( 870, 1300 ] 51 0.238% 99.460% ( 1300, 1900 ] 33 0.154% 99.613% ( 1900, 2900 ] 34 0.158% 99.772% ( 2900, 4400 ] 36 0.168% 99.939% ( 4400, 6600 ] 13 0.061% 100.000% ** Level 2 read latency histogram (micros): Count: 408031 Average: 13.9903 StdDev: 179.53 Min: 1 Median: 1.9587 Max: 10206 Percentiles: P50: 1.96 P75: 3.01 P99: 11.52 P99.9: 1711.37 P99.99: 2719.10 ------------------------------------------------------ [ 0, 1 ] 12387 3.036% 3.036% # ( 1, 2 ] 199878 48.986% 52.022% ########## ( 2, 3 ] 93483 22.911% 74.933% ##### ( 3, 4 ] 41565 10.187% 85.119% ## ( 4, 6 ] 43807 10.736% 95.855% ## ( 6, 10 ] 12170 2.983% 98.838% # ( 10, 15 ] 2172 0.532% 99.370% ( 15, 22 ] 356 0.087% 99.458% ( 22, 34 ] 62 0.015% 99.473% ( 34, 51 ] 35 0.009% 99.481% ( 51, 76 ] 28 0.007% 99.488% ( 76, 110 ] 19 0.005% 99.493% ( 110, 170 ] 35 0.009% 99.502% ( 170, 250 ] 72 0.018% 99.519% ( 250, 380 ] 136 0.033% 99.552% ( 380, 580 ] 260 0.064% 99.616% ( 580, 870 ] 433 0.106% 99.722% ( 870, 1300 ] 486 0.119% 99.841% ( 1300, 1900 ] 350 0.086% 99.927% ( 1900, 2900 ] 314 0.077% 100.004% ( 2900, 4400 ] 367 0.090% 100.094% ( 4400, 6600 ] 138 0.034% 100.128% ( 6600, 9900 ] 21 0.005% 100.133% ( 9900, 14000 ] 1 0.000% 100.133% ** Level 3 read latency histogram (micros): Count: 835602 Average: 9.9112 StdDev: 157.88 Min: 1 Median: 1.9500 Max: 39932 Percentiles: P50: 1.95 P75: 2.99 P99: 9.24 P99.9: 627.90 P99.99: 1009.35 ------------------------------------------------------ [ 0, 1 ] 20266 2.425% 2.425% ( 1, 2 ] 418464 50.079% 52.505% ########## ( 2, 3 ] 190230 22.766% 75.270% ##### ( 3, 4 ] 92077 11.019% 86.290% ## ( 4, 6 ] 91684 10.972% 97.262% ## ( 6, 10 ] 17906 2.143% 99.405% ( 10, 15 ] 2839 0.340% 99.744% ( 15, 22 ] 352 0.042% 99.787% ( 22, 34 ] 43 0.005% 99.792% ( 34, 51 ] 38 0.005% 99.796% ( 51, 76 ] 45 0.005% 99.802% ( 76, 110 ] 21 0.003% 99.804% ( 110, 170 ] 43 0.005% 99.809% ( 170, 250 ] 76 0.009% 99.818% ( 250, 380 ] 195 0.023% 99.842% ( 380, 580 ] 384 0.046% 99.888% ( 580, 870 ] 626 0.075% 99.963% ( 870, 1300 ] 708 0.085% 100.047% ( 1300, 1900 ] 525 0.063% 100.110% ( 1900, 2900 ] 443 0.053% 100.163% ( 2900, 4400 ] 412 0.049% 100.212% ( 4400, 6600 ] 112 0.013% 100.226% ( 6600, 9900 ] 33 0.004% 100.230% ( 9900, 14000 ] 2 0.000% 100.230% ( 14000, 22000 ] 3 0.000% 100.230% ( 22000, 33000 ] 3 0.000% 100.231% ( 33000, 50000 ] 2 0.000% 100.231% ** Level 4 read latency histogram (micros): Count: 255421 Average: 33.7703 StdDev: 413.14 Min: 1 Median: 1.9461 Max: 70010 Percentiles: P50: 1.95 P75: 2.99 P99: 914.74 P99.9: 3643.61 P99.99: 4250.68 ------------------------------------------------------ [ 0, 1 ] 5681 2.224% 2.224% ( 1, 2 ] 128984 50.499% 52.723% ########## ( 2, 3 ] 57548 22.531% 75.253% ##### ( 3, 4 ] 26629 10.426% 85.679% ## ( 4, 6 ] 25355 9.927% 95.606% ## ( 6, 10 ] 5695 2.230% 97.835% ( 10, 15 ] 905 0.354% 98.190% ( 15, 22 ] 122 0.048% 98.237% ( 22, 34 ] 11 0.004% 98.242% ( 34, 51 ] 19 0.007% 98.249% ( 51, 76 ] 20 0.008% 98.257% ( 76, 110 ] 14 0.005% 98.262% ( 110, 170 ] 50 0.020% 98.282% ( 170, 250 ] 141 0.055% 98.337% ( 250, 380 ] 232 0.091% 98.428% ( 380, 580 ] 525 0.206% 98.634% ( 580, 870 ] 837 0.328% 98.961% ( 870, 1300 ] 959 0.375% 99.337% ( 1300, 1900 ] 662 0.259% 99.596% ( 1900, 2900 ] 496 0.194% 99.790% ( 2900, 4400 ] 568 0.222% 100.013% ( 4400, 6600 ] 162 0.063% 100.076% ( 6600, 9900 ] 42 0.016% 100.092% ( 9900, 14000 ] 1 0.000% 100.093% ( 14000, 22000 ] 4 0.002% 100.094% ( 22000, 33000 ] 4 0.002% 100.096% ( 33000, 50000 ] 3 0.001% 100.097% ( 50000, 75000 ] 3 0.001% 100.098% ** Level 5 read latency histogram (micros): Count: 11193 Average: 1929.0499 StdDev: 2216.58 Min: 83 Median: 1252.4189 Max: 69889 Percentiles: P50: 1252.42 P75: 2718.62 P99: 8490.13 P99.9: 30319.67 P99.99: 61008.75 ------------------------------------------------------ ( 76, 110 ] 11 0.098% 0.098% ( 110, 170 ] 60 0.536% 0.634% ( 170, 250 ] 171 1.528% 2.162% ( 250, 380 ] 527 4.708% 6.870% # ( 380, 580 ] 1153 10.301% 17.171% ## ( 580, 870 ] 1838 16.421% 33.592% ### ( 870, 1300 ] 2065 18.449% 52.041% #### ( 1300, 1900 ] 1517 13.553% 65.595% ### ( 1900, 2900 ] 1286 11.489% 77.084% ## ( 2900, 4400 ] 1621 14.482% 91.566% ### ( 4400, 6600 ] 741 6.620% 98.186% # ( 6600, 9900 ] 159 1.421% 99.607% ( 9900, 14000 ] 18 0.161% 99.768% ( 14000, 22000 ] 8 0.071% 99.839% ( 22000, 33000 ] 9 0.080% 99.920% ( 33000, 50000 ] 7 0.063% 99.982% ( 50000, 75000 ] 2 0.018% 100.000% ** DB Stats ** Uptime(secs): 7.7 total, 7.5 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 128.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.562 H:M:S, 46.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 131.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.562 H:M:S, 47.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/20-06:03:28 ... thread 0: (1000000,2000000) ops and (135886.5,134583.7) ops/second in (7.359081,14.860644) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 1.17 GB 88.1 1.1 0.0 1.1 3.0 1.8 0.0 1.6 54.7 145.9 20.71 9.98 24 0.863 1151K 1612 0.0 0.0 L1 3/0 284.63 MB 28.5 1.2 1.1 0.1 1.2 1.1 0.0 1.1 114.3 114.0 11.16 6.06 2 5.582 1295K 3198 0.0 0.0 L2 3/1 176.33 MB 0.8 0.1 0.1 0.1 0.1 0.1 0.8 2.2 116.7 116.4 1.28 0.71 1 1.284 152K 381 0.0 0.0 L3 24/9 1.82 GB 1.0 4.5 2.2 2.3 4.4 2.2 0.5 2.0 109.1 107.8 41.99 21.54 26 1.615 2024K 2902 0.0 0.0 L4 179/24 9.70 GB 0.9 7.9 4.7 3.1 7.7 4.6 0.5 1.6 116.7 115.0 68.93 38.42 47 1.467 3664K 10K 0.0 0.0 L5 1144/0 94.06 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1360/38 107.19 GB 0.0 14.8 8.1 6.7 16.5 9.8 6.7 8.9 105.4 117.3 144.08 76.70 100 1.441 8287K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.8 8.1 6.7 16.5 9.8 6.7 8.9 105.4 117.3 144.08 76.70 100 1.441 8287K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.8 8.1 6.7 14.7 8.0 0.0 0.0 116.9 115.6 129.87 71.39 79 1.644 8287K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 133.0 14.21 5.32 21 0.677 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.0 total, 14.9 interval Flush(GB): cumulative 1.845, interval 1.845 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.50 GB write, 1124.48 MB/s write, 14.83 GB read, 1010.45 MB/s read, 144.1 seconds Interval compaction: 16.50 GB write, 1136.96 MB/s write, 14.83 GB read, 1021.66 MB/s read, 144.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 81, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 81, interval: 81 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 628389 Average: 10.9528 StdDev: 176.82 Min: 1 Median: 1.8651 Max: 45548 Percentiles: P50: 1.87 P75: 2.87 P99: 9.80 P99.9: 2086.54 P99.99: 4294.33 ------------------------------------------------------ [ 0, 1 ] 24812 3.949% 3.949% # ( 1, 2 ] 334495 53.231% 57.179% ########### ( 2, 3 ] 129168 20.555% 77.734% #### ( 3, 4 ] 60677 9.656% 87.390% ## ( 4, 6 ] 60375 9.608% 96.998% ## ( 6, 10 ] 13228 2.105% 99.103% ( 10, 15 ] 1895 0.302% 99.405% ( 15, 22 ] 226 0.036% 99.441% ( 22, 34 ] 29 0.005% 99.446% ( 34, 51 ] 27 0.004% 99.450% ( 51, 76 ] 44 0.007% 99.457% ( 76, 110 ] 14 0.002% 99.459% ( 110, 170 ] 33 0.005% 99.464% ( 170, 250 ] 103 0.016% 99.481% ( 250, 380 ] 234 0.037% 99.518% ( 380, 580 ] 473 0.075% 99.593% ( 580, 870 ] 685 0.109% 99.702% ( 870, 1300 ] 738 0.117% 99.820% ( 1300, 1900 ] 442 0.070% 99.890% ( 1900, 2900 ] 341 0.054% 99.944% ( 2900, 4400 ] 310 0.049% 99.994% ( 4400, 6600 ] 89 0.014% 100.008% ( 6600, 9900 ] 20 0.003% 100.011% ( 9900, 14000 ] 1 0.000% 100.011% ( 14000, 22000 ] 7 0.001% 100.012% ( 22000, 33000 ] 3 0.000% 100.013% ( 33000, 50000 ] 2 0.000% 100.013% ** Level 1 read latency histogram (micros): Count: 165277 Average: 13.8387 StdDev: 174.21 Min: 1 Median: 1.9548 Max: 26381 Percentiles: P50: 1.95 P75: 2.97 P99: 12.95 P99.9: 2424.31 P99.99: 4103.43 ------------------------------------------------------ [ 0, 1 ] 2918 1.766% 1.766% ( 1, 2 ] 83491 50.516% 52.281% ########## ( 2, 3 ] 38858 23.511% 75.792% ##### ( 3, 4 ] 16796 10.162% 85.954% ## ( 4, 6 ] 16861 10.202% 96.156% ## ( 6, 10 ] 4322 2.615% 98.771% # ( 10, 15 ] 641 0.388% 99.159% ( 15, 22 ] 80 0.048% 99.207% ( 22, 34 ] 5 0.003% 99.210% ( 34, 51 ] 13 0.008% 99.218% ( 51, 76 ] 15 0.009% 99.227% ( 76, 110 ] 6 0.004% 99.231% ( 110, 170 ] 14 0.008% 99.239% ( 170, 250 ] 28 0.017% 99.256% ( 250, 380 ] 86 0.052% 99.308% ( 380, 580 ] 190 0.115% 99.423% ( 580, 870 ] 300 0.182% 99.605% ( 870, 1300 ] 277 0.168% 99.773% ( 1300, 1900 ] 152 0.092% 99.864% ( 1900, 2900 ] 112 0.068% 99.932% ( 2900, 4400 ] 119 0.072% 100.004% ( 4400, 6600 ] 27 0.016% 100.021% ( 6600, 9900 ] 6 0.004% 100.024% ( 9900, 14000 ] 1 0.001% 100.025% ( 22000, 33000 ] 1 0.001% 100.025% ** Level 2 read latency histogram (micros): Count: 415319 Average: 13.9423 StdDev: 178.96 Min: 1 Median: 1.9554 Max: 10206 Percentiles: P50: 1.96 P75: 3.00 P99: 11.47 P99.9: 1718.62 P99.99: 2743.25 ------------------------------------------------------ [ 0, 1 ] 12651 3.046% 3.046% # ( 1, 2 ] 204111 49.146% 52.192% ########## ( 2, 3 ] 94957 22.864% 75.055% ##### ( 3, 4 ] 42187 10.158% 85.213% ## ( 4, 6 ] 44383 10.686% 95.900% ## ( 6, 10 ] 12232 2.945% 98.845% # ( 10, 15 ] 2186 0.526% 99.371% ( 15, 22 ] 357 0.086% 99.457% ( 22, 34 ] 62 0.015% 99.472% ( 34, 51 ] 35 0.008% 99.480% ( 51, 76 ] 28 0.007% 99.487% ( 76, 110 ] 19 0.005% 99.492% ( 110, 170 ] 35 0.008% 99.500% ( 170, 250 ] 72 0.017% 99.517% ( 250, 380 ] 137 0.033% 99.550% ( 380, 580 ] 262 0.063% 99.614% ( 580, 870 ] 446 0.107% 99.721% ( 870, 1300 ] 496 0.119% 99.840% ( 1300, 1900 ] 355 0.085% 99.926% ( 1900, 2900 ] 316 0.076% 100.002% ( 2900, 4400 ] 374 0.090% 100.092% ( 4400, 6600 ] 139 0.033% 100.125% ( 6600, 9900 ] 21 0.005% 100.131% ( 9900, 14000 ] 1 0.000% 100.131% ** Level 3 read latency histogram (micros): Count: 1772728 Average: 10.1847 StdDev: 161.30 Min: 1 Median: 1.9475 Max: 42504 Percentiles: P50: 1.95 P75: 2.97 P99: 9.45 P99.9: 757.01 P99.99: 1166.21 ------------------------------------------------------ [ 0, 1 ] 37544 2.118% 2.118% ( 1, 2 ] 895878 50.537% 52.655% ########## ( 2, 3 ] 407257 22.973% 75.628% ##### ( 3, 4 ] 188847 10.653% 86.281% ## ( 4, 6 ] 189489 10.689% 96.970% ## ( 6, 10 ] 41667 2.350% 99.320% ( 10, 15 ] 6542 0.369% 99.690% ( 15, 22 ] 804 0.045% 99.735% ( 22, 34 ] 74 0.004% 99.739% ( 34, 51 ] 119 0.007% 99.746% ( 51, 76 ] 171 0.010% 99.755% ( 76, 110 ] 49 0.003% 99.758% ( 110, 170 ] 79 0.004% 99.763% ( 170, 250 ] 167 0.009% 99.772% ( 250, 380 ] 447 0.025% 99.797% ( 380, 580 ] 948 0.053% 99.851% ( 580, 870 ] 1434 0.081% 99.932% ( 870, 1300 ] 1505 0.085% 100.017% ( 1300, 1900 ] 962 0.054% 100.071% ( 1900, 2900 ] 927 0.052% 100.123% ( 2900, 4400 ] 957 0.054% 100.177% ( 4400, 6600 ] 285 0.016% 100.193% ( 6600, 9900 ] 74 0.004% 100.197% ( 9900, 14000 ] 10 0.001% 100.198% ( 14000, 22000 ] 10 0.001% 100.198% ( 22000, 33000 ] 5 0.000% 100.199% ( 33000, 50000 ] 3 0.000% 100.199% ** Level 4 read latency histogram (micros): Count: 881746 Average: 22.9080 StdDev: 281.18 Min: 1 Median: 1.9545 Max: 70010 Percentiles: P50: 1.95 P75: 3.00 P99: 492.34 P99.9: 2580.57 P99.99: 3436.12 ------------------------------------------------------ [ 0, 1 ] 17430 1.977% 1.977% ( 1, 2 ] 443629 50.313% 52.289% ########## ( 2, 3 ] 200834 22.777% 75.066% ##### ( 3, 4 ] 92419 10.481% 85.548% ## ( 4, 6 ] 90732 10.290% 95.838% ## ( 6, 10 ] 21859 2.479% 98.317% ( 10, 15 ] 3341 0.379% 98.696% ( 15, 22 ] 430 0.049% 98.744% ( 22, 34 ] 41 0.005% 98.749% ( 34, 51 ] 65 0.007% 98.756% ( 51, 76 ] 107 0.012% 98.768% ( 76, 110 ] 36 0.004% 98.773% ( 110, 170 ] 119 0.013% 98.786% ( 170, 250 ] 346 0.039% 98.825% ( 250, 380 ] 691 0.078% 98.904% ( 380, 580 ] 1516 0.172% 99.076% ( 580, 870 ] 2518 0.286% 99.361% ( 870, 1300 ] 2466 0.280% 99.641% ( 1300, 1900 ] 1508 0.171% 99.812% ( 1900, 2900 ] 1145 0.130% 99.942% ( 2900, 4400 ] 1197 0.136% 100.077% ( 4400, 6600 ] 319 0.036% 100.114% ( 6600, 9900 ] 62 0.007% 100.121% ( 9900, 14000 ] 7 0.001% 100.121% ( 14000, 22000 ] 13 0.001% 100.123% ( 22000, 33000 ] 5 0.001% 100.124% ( 33000, 50000 ] 3 0.000% 100.124% ( 50000, 75000 ] 3 0.000% 100.124% ** Level 5 read latency histogram (micros): Count: 28364 Average: 1537.1838 StdDev: 1756.78 Min: 83 Median: 1024.4582 Max: 69889 Percentiles: P50: 1024.46 P75: 1854.69 P99: 6538.50 P99.9: 20424.00 P99.99: 48578.12 ------------------------------------------------------ ( 76, 110 ] 30 0.106% 0.106% ( 110, 170 ] 186 0.656% 0.762% ( 170, 250 ] 533 1.879% 2.641% ( 250, 380 ] 1637 5.771% 8.412% # ( 380, 580 ] 3749 13.217% 21.630% ### ( 580, 870 ] 5932 20.914% 42.543% #### ( 870, 1300 ] 5888 20.759% 63.302% #### ( 1300, 1900 ] 3589 12.653% 75.955% ### ( 1900, 2900 ] 2542 8.962% 84.918% ## ( 2900, 4400 ] 2929 10.326% 95.244% ## ( 4400, 6600 ] 1096 3.864% 99.108% # ( 6600, 9900 ] 187 0.659% 99.767% ( 9900, 14000 ] 28 0.099% 99.866% ( 14000, 22000 ] 12 0.042% 99.908% ( 22000, 33000 ] 14 0.049% 99.958% ( 33000, 50000 ] 10 0.035% 99.993% ( 50000, 75000 ] 2 0.007% 100.000% ** DB Stats ** Uptime(secs): 15.0 total, 7.4 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 130.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.975 H:M:S, 46.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 133.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.414 H:M:S, 46.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/11/20-06:03:33 ... thread 0: (1000000,3000000) ops and (228162.1,155896.9) ops/second in (4.382849,19.243493) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 2.09 GB 31.5 1.7 0.0 1.7 4.5 2.8 0.0 1.6 64.2 167.2 27.48 15.15 39 0.705 1790K 2340 0.0 0.0 L1 3/3 284.63 MB 0.0 1.2 1.1 0.1 1.2 1.1 0.0 1.1 114.3 114.0 11.16 6.06 2 5.582 1295K 3198 0.0 0.0 L2 2/0 80.90 MB 0.8 0.1 0.1 0.1 0.1 0.1 0.8 2.2 116.7 116.4 1.28 0.71 1 1.284 152K 381 0.0 0.0 L3 15/0 997.15 MB 1.0 4.8 2.3 2.5 4.7 2.2 0.5 2.1 111.2 109.9 43.99 22.97 27 1.629 2341K 4398 0.0 0.0 L4 176/0 9.61 GB 1.0 10.7 5.7 5.0 10.5 5.5 0.5 1.9 123.9 122.2 88.22 51.83 56 1.575 5941K 17K 0.0 0.0 L5 1156/0 95.04 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1366/16 108.07 GB 0.0 18.6 9.2 9.4 21.1 11.7 7.7 7.6 110.5 125.7 172.14 96.71 125 1.377 11M 27K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.6 9.2 9.4 21.1 11.7 7.7 7.6 110.5 125.7 172.14 96.71 125 1.377 11M 27K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.6 9.2 9.4 18.4 9.0 0.0 0.0 123.6 122.2 153.85 88.73 91 1.691 11M 27K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 155.0 18.29 7.99 34 0.538 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.4 total, 19.2 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.12 GB write, 1114.43 MB/s write, 18.57 GB read, 979.70 MB/s read, 172.1 seconds Interval compaction: 21.12 GB write, 1123.97 MB/s write, 18.57 GB read, 988.10 MB/s read, 172.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 90, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 90, interval: 90 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 937653 Average: 10.1599 StdDev: 162.97 Min: 0 Median: 1.7901 Max: 55720 Percentiles: P50: 1.79 P75: 2.71 P99: 13.53 P99.9: 1582.90 P99.99: 3588.13 ------------------------------------------------------ [ 0, 1 ] 60777 6.482% 6.482% # ( 1, 2 ] 516446 55.079% 61.560% ########### ( 2, 3 ] 177273 18.906% 80.466% #### ( 3, 4 ] 79859 8.517% 88.983% ## ( 4, 6 ] 75489 8.051% 97.034% ## ( 6, 10 ] 16737 1.785% 98.819% ( 10, 15 ] 2399 0.256% 99.075% ( 15, 22 ] 326 0.035% 99.110% ( 22, 34 ] 46 0.005% 99.115% ( 34, 51 ] 33 0.004% 99.118% ( 51, 76 ] 49 0.005% 99.123% ( 76, 110 ] 498 0.053% 99.177% ( 110, 170 ] 1641 0.175% 99.352% ( 170, 250 ] 1011 0.108% 99.459% ( 250, 380 ] 853 0.091% 99.550% ( 380, 580 ] 1059 0.113% 99.663% ( 580, 870 ] 1049 0.112% 99.775% ( 870, 1300 ] 928 0.099% 99.874% ( 1300, 1900 ] 514 0.055% 99.929% ( 1900, 2900 ] 408 0.044% 99.972% ( 2900, 4400 ] 358 0.038% 100.011% ( 4400, 6600 ] 94 0.010% 100.021% ( 6600, 9900 ] 21 0.002% 100.023% ( 9900, 14000 ] 1 0.000% 100.023% ( 14000, 22000 ] 8 0.001% 100.024% ( 22000, 33000 ] 3 0.000% 100.024% ( 33000, 50000 ] 2 0.000% 100.024% ( 50000, 75000 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 197301 Average: 13.5962 StdDev: 175.35 Min: 1 Median: 1.9287 Max: 26381 Percentiles: P50: 1.93 P75: 2.93 P99: 14.57 P99.9: 2340.16 P99.99: 4141.70 ------------------------------------------------------ [ 0, 1 ] 4073 2.064% 2.064% ( 1, 2 ] 101836 51.615% 53.679% ########## ( 2, 3 ] 45191 22.905% 76.583% ##### ( 3, 4 ] 19424 9.845% 86.428% ## ( 4, 6 ] 19134 9.698% 96.126% ## ( 6, 10 ] 5005 2.537% 98.663% # ( 10, 15 ] 727 0.368% 99.031% ( 15, 22 ] 88 0.045% 99.076% ( 22, 34 ] 8 0.004% 99.080% ( 34, 51 ] 13 0.007% 99.087% ( 51, 76 ] 15 0.008% 99.094% ( 76, 110 ] 36 0.018% 99.113% ( 110, 170 ] 132 0.067% 99.179% ( 170, 250 ] 113 0.057% 99.237% ( 250, 380 ] 146 0.074% 99.311% ( 380, 580 ] 263 0.133% 99.444% ( 580, 870 ] 367 0.186% 99.630% ( 870, 1300 ] 317 0.161% 99.791% ( 1300, 1900 ] 162 0.082% 99.873% ( 1900, 2900 ] 122 0.062% 99.935% ( 2900, 4400 ] 132 0.067% 100.002% ( 4400, 6600 ] 28 0.014% 100.016% ( 6600, 9900 ] 8 0.004% 100.020% ( 9900, 14000 ] 1 0.001% 100.020% ( 22000, 33000 ] 2 0.001% 100.021% ** Level 2 read latency histogram (micros): Count: 415380 Average: 14.0104 StdDev: 179.26 Min: 1 Median: 1.9556 Max: 10206 Percentiles: P50: 1.96 P75: 3.00 P99: 11.61 P99.9: 1726.25 P99.99: 2747.84 ------------------------------------------------------ [ 0, 1 ] 12651 3.046% 3.046% # ( 1, 2 ] 204111 49.138% 52.184% ########## ( 2, 3 ] 94957 22.860% 75.044% ##### ( 3, 4 ] 42187 10.156% 85.201% ## ( 4, 6 ] 44383 10.685% 95.885% ## ( 6, 10 ] 12232 2.945% 98.830% # ( 10, 15 ] 2186 0.526% 99.356% ( 15, 22 ] 357 0.086% 99.442% ( 22, 34 ] 62 0.015% 99.457% ( 34, 51 ] 35 0.008% 99.466% ( 51, 76 ] 28 0.007% 99.473% ( 76, 110 ] 21 0.005% 99.478% ( 110, 170 ] 55 0.013% 99.491% ( 170, 250 ] 88 0.021% 99.512% ( 250, 380 ] 145 0.035% 99.547% ( 380, 580 ] 267 0.064% 99.611% ( 580, 870 ] 447 0.108% 99.719% ( 870, 1300 ] 499 0.120% 99.839% ( 1300, 1900 ] 357 0.086% 99.925% ( 1900, 2900 ] 319 0.077% 100.002% ( 2900, 4400 ] 375 0.090% 100.092% ( 4400, 6600 ] 139 0.033% 100.125% ( 6600, 9900 ] 21 0.005% 100.130% ( 9900, 14000 ] 1 0.000% 100.131% ** Level 3 read latency histogram (micros): Count: 2048701 Average: 9.7533 StdDev: 157.55 Min: 1 Median: 1.9368 Max: 42504 Percentiles: P50: 1.94 P75: 2.95 P99: 9.44 P99.9: 746.41 P99.99: 1175.37 ------------------------------------------------------ [ 0, 1 ] 44097 2.152% 2.152% ( 1, 2 ] 1046383 51.075% 53.228% ########## ( 2, 3 ] 468489 22.868% 76.095% ##### ( 3, 4 ] 214791 10.484% 86.580% ## ( 4, 6 ] 213647 10.428% 97.008% ## ( 6, 10 ] 47452 2.316% 99.324% ( 10, 15 ] 7316 0.357% 99.681% ( 15, 22 ] 902 0.044% 99.725% ( 22, 34 ] 85 0.004% 99.730% ( 34, 51 ] 158 0.008% 99.737% ( 51, 76 ] 211 0.010% 99.748% ( 76, 110 ] 82 0.004% 99.752% ( 110, 170 ] 193 0.009% 99.761% ( 170, 250 ] 274 0.013% 99.774% ( 250, 380 ] 557 0.027% 99.802% ( 380, 580 ] 1096 0.053% 99.855% ( 580, 870 ] 1602 0.078% 99.933% ( 870, 1300 ] 1635 0.080% 100.013% ( 1300, 1900 ] 1024 0.050% 100.063% ( 1900, 2900 ] 1020 0.050% 100.113% ( 2900, 4400 ] 1014 0.049% 100.162% ( 4400, 6600 ] 300 0.015% 100.177% ( 6600, 9900 ] 78 0.004% 100.181% ( 9900, 14000 ] 11 0.001% 100.181% ( 14000, 22000 ] 14 0.001% 100.182% ( 22000, 33000 ] 7 0.000% 100.182% ( 33000, 50000 ] 3 0.000% 100.183% ** Level 4 read latency histogram (micros): Count: 1222650 Average: 20.8941 StdDev: 254.33 Min: 1 Median: 1.9448 Max: 70010 Percentiles: P50: 1.94 P75: 2.98 P99: 391.57 P99.9: 2212.25 P99.99: 3086.56 ------------------------------------------------------ [ 0, 1 ] 23488 1.921% 1.921% ( 1, 2 ] 622158 50.886% 52.807% ########## ( 2, 3 ] 278103 22.746% 75.553% ##### ( 3, 4 ] 124883 10.214% 85.767% ## ( 4, 6 ] 121612 9.947% 95.714% ## ( 6, 10 ] 30223 2.472% 98.186% ( 10, 15 ] 4367 0.357% 98.543% ( 15, 22 ] 568 0.046% 98.589% ( 22, 34 ] 56 0.005% 98.594% ( 34, 51 ] 109 0.009% 98.603% ( 51, 76 ] 162 0.013% 98.616% ( 76, 110 ] 348 0.028% 98.645% ( 110, 170 ] 1463 0.120% 98.764% ( 170, 250 ] 1282 0.105% 98.869% ( 250, 380 ] 1460 0.119% 98.988% ( 380, 580 ] 2446 0.200% 99.188% ( 580, 870 ] 3444 0.282% 99.470% ( 870, 1300 ] 3063 0.251% 99.721% ( 1300, 1900 ] 1773 0.145% 99.866% ( 1900, 2900 ] 1343 0.110% 99.976% ( 2900, 4400 ] 1421 0.116% 100.092% ( 4400, 6600 ] 360 0.029% 100.121% ( 6600, 9900 ] 67 0.005% 100.127% ( 9900, 14000 ] 8 0.001% 100.127% ( 14000, 22000 ] 16 0.001% 100.129% ( 22000, 33000 ] 7 0.001% 100.129% ( 33000, 50000 ] 3 0.000% 100.129% ( 50000, 75000 ] 3 0.000% 100.130% ** Level 5 read latency histogram (micros): Count: 55239 Average: 1016.1245 StdDev: 1467.44 Min: 73 Median: 596.6688 Max: 69889 Percentiles: P50: 596.67 P75: 1192.13 P99: 6061.57 P99.9: 12874.00 P99.99: 44553.97 ------------------------------------------------------ ( 51, 76 ] 3 0.005% 0.005% ( 76, 110 ] 1851 3.351% 3.356% # ( 110, 170 ] 7455 13.496% 16.852% ### ( 170, 250 ] 5407 9.788% 26.641% ## ( 250, 380 ] 5035 9.115% 35.756% ## ( 380, 580 ] 7367 13.337% 49.092% ### ( 580, 870 ] 8725 15.795% 64.887% ### ( 870, 1300 ] 7457 13.500% 78.387% ### ( 1300, 1900 ] 4257 7.707% 86.093% ## ( 1900, 2900 ] 2956 5.351% 91.444% # ( 2900, 4400 ] 3296 5.967% 97.411% # ( 4400, 6600 ] 1162 2.104% 99.515% ( 6600, 9900 ] 191 0.346% 99.861% ( 9900, 14000 ] 30 0.054% 99.915% ( 14000, 22000 ] 16 0.029% 99.944% ( 22000, 33000 ] 18 0.033% 99.976% ( 33000, 50000 ] 11 0.020% 99.996% ( 50000, 75000 ] 2 0.004% 100.000% ** DB Stats ** Uptime(secs): 19.4 total, 4.4 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 152.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.639 H:M:S, 39.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 224.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.663 H:M:S, 15.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/20-06:03:36 ... thread 0: (1000000,4000000) ops and (292473.1,176502.2) ops/second in (3.419118,22.662611) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/9 3.07 GB 163.6 3.0 0.0 3.0 6.8 3.7 0.0 1.8 85.9 192.7 35.93 23.05 60 0.599 3134K 3630 0.0 0.0 L1 3/3 284.63 MB 0.0 1.2 1.1 0.1 1.2 1.1 0.0 1.1 114.3 114.0 11.16 6.06 2 5.582 1295K 3198 0.0 0.0 L2 2/0 80.90 MB 0.8 0.1 0.1 0.1 0.1 0.1 0.8 2.2 116.7 116.4 1.28 0.71 1 1.284 152K 381 0.0 0.0 L3 15/0 997.15 MB 1.0 4.8 2.3 2.5 4.7 2.2 0.5 2.1 111.2 109.9 43.99 22.97 27 1.629 2341K 4398 0.0 0.0 L4 176/0 9.61 GB 1.0 10.7 5.7 5.0 10.5 5.5 0.5 1.9 123.9 122.2 88.22 51.83 56 1.575 5941K 17K 0.0 0.0 L5 1156/0 95.04 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1367/12 109.06 GB 0.0 19.9 9.2 10.7 23.4 12.7 7.7 6.2 112.6 132.7 180.59 104.62 146 1.237 12M 29K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.9 9.2 10.7 23.4 12.7 7.7 6.2 112.6 132.7 180.59 104.62 146 1.237 12M 29K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.9 9.2 10.7 19.6 8.9 0.0 0.0 127.9 126.5 159.04 93.81 96 1.657 12M 29K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 178.3 21.55 10.81 50 0.431 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.8 total, 22.7 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.40 GB write, 1049.56 MB/s write, 19.86 GB read, 890.93 MB/s read, 180.6 seconds Interval compaction: 23.40 GB write, 1057.20 MB/s write, 19.86 GB read, 897.41 MB/s read, 180.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 90, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 90, interval: 90 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1261284 Average: 10.4805 StdDev: 143.27 Min: 0 Median: 1.7011 Max: 55720 Percentiles: P50: 1.70 P75: 2.51 P99: 166.75 P99.9: 1180.60 P99.99: 2705.45 ------------------------------------------------------ [ 0, 1 ] 137012 10.863% 10.863% ## ( 1, 2 ] 704089 55.823% 66.686% ########### ( 2, 3 ] 207170 16.425% 83.111% ### ( 3, 4 ] 88603 7.025% 90.136% # ( 4, 6 ] 80278 6.365% 96.501% # ( 6, 10 ] 18227 1.445% 97.946% ( 10, 15 ] 2758 0.219% 98.165% ( 15, 22 ] 391 0.031% 98.196% ( 22, 34 ] 50 0.004% 98.200% ( 34, 51 ] 35 0.003% 98.203% ( 51, 76 ] 56 0.004% 98.207% ( 76, 110 ] 2132 0.169% 98.376% ( 110, 170 ] 8321 0.660% 99.036% ( 170, 250 ] 4393 0.348% 99.384% ( 250, 380 ] 2194 0.174% 99.558% ( 380, 580 ] 2175 0.172% 99.730% ( 580, 870 ] 1420 0.113% 99.843% ( 870, 1300 ] 995 0.079% 99.922% ( 1300, 1900 ] 523 0.041% 99.963% ( 1900, 2900 ] 417 0.033% 99.996% ( 2900, 4400 ] 364 0.029% 100.025% ( 4400, 6600 ] 94 0.007% 100.033% ( 6600, 9900 ] 21 0.002% 100.034% ( 9900, 14000 ] 1 0.000% 100.034% ( 14000, 22000 ] 8 0.001% 100.035% ( 22000, 33000 ] 3 0.000% 100.035% ( 33000, 50000 ] 2 0.000% 100.036% ( 50000, 75000 ] 1 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 205620 Average: 13.9787 StdDev: 172.44 Min: 1 Median: 1.9451 Max: 26381 Percentiles: P50: 1.95 P75: 2.97 P99: 157.41 P99.9: 2271.97 P99.99: 4132.25 ------------------------------------------------------ [ 0, 1 ] 4262 2.073% 2.073% ( 1, 2 ] 104270 50.710% 52.783% ########## ( 2, 3 ] 47109 22.911% 75.694% ##### ( 3, 4 ] 20605 10.021% 85.714% ## ( 4, 6 ] 20477 9.959% 95.673% ## ( 6, 10 ] 5328 2.591% 98.264% # ( 10, 15 ] 823 0.400% 98.665% ( 15, 22 ] 137 0.067% 98.731% ( 22, 34 ] 13 0.006% 98.737% ( 34, 51 ] 13 0.006% 98.744% ( 51, 76 ] 16 0.008% 98.752% ( 76, 110 ] 126 0.061% 98.813% ( 110, 170 ] 487 0.237% 99.050% ( 170, 250 ] 292 0.142% 99.192% ( 250, 380 ] 217 0.106% 99.297% ( 380, 580 ] 318 0.155% 99.452% ( 580, 870 ] 390 0.190% 99.642% ( 870, 1300 ] 324 0.158% 99.799% ( 1300, 1900 ] 162 0.079% 99.878% ( 1900, 2900 ] 122 0.059% 99.937% ( 2900, 4400 ] 132 0.064% 100.001% ( 4400, 6600 ] 28 0.014% 100.015% ( 6600, 9900 ] 8 0.004% 100.019% ( 9900, 14000 ] 1 0.000% 100.019% ( 22000, 33000 ] 2 0.001% 100.020% ** Level 2 read latency histogram (micros): Count: 415480 Average: 14.0519 StdDev: 179.27 Min: 1 Median: 1.9558 Max: 10206 Percentiles: P50: 1.96 P75: 3.00 P99: 11.84 P99.9: 1726.08 P99.99: 2747.81 ------------------------------------------------------ [ 0, 1 ] 12651 3.045% 3.045% # ( 1, 2 ] 204111 49.127% 52.171% ########## ( 2, 3 ] 94957 22.855% 75.026% ##### ( 3, 4 ] 42187 10.154% 85.180% ## ( 4, 6 ] 44383 10.682% 95.862% ## ( 6, 10 ] 12232 2.944% 98.806% # ( 10, 15 ] 2186 0.526% 99.333% ( 15, 22 ] 357 0.086% 99.419% ( 22, 34 ] 62 0.015% 99.433% ( 34, 51 ] 35 0.008% 99.442% ( 51, 76 ] 28 0.007% 99.449% ( 76, 110 ] 34 0.008% 99.457% ( 110, 170 ] 97 0.023% 99.480% ( 170, 250 ] 116 0.028% 99.508% ( 250, 380 ] 157 0.038% 99.546% ( 380, 580 ] 272 0.065% 99.611% ( 580, 870 ] 447 0.108% 99.719% ( 870, 1300 ] 499 0.120% 99.839% ( 1300, 1900 ] 357 0.086% 99.925% ( 1900, 2900 ] 319 0.077% 100.002% ( 2900, 4400 ] 375 0.090% 100.092% ( 4400, 6600 ] 139 0.033% 100.125% ( 6600, 9900 ] 21 0.005% 100.130% ( 9900, 14000 ] 1 0.000% 100.131% ** Level 3 read latency histogram (micros): Count: 2049246 Average: 9.8060 StdDev: 157.58 Min: 1 Median: 1.9371 Max: 42504 Percentiles: P50: 1.94 P75: 2.95 P99: 9.49 P99.9: 748.18 P99.99: 1175.66 ------------------------------------------------------ [ 0, 1 ] 44097 2.152% 2.152% ( 1, 2 ] 1046383 51.062% 53.214% ########## ( 2, 3 ] 468489 22.862% 76.075% ##### ( 3, 4 ] 214791 10.481% 86.557% ## ( 4, 6 ] 213647 10.426% 96.982% ## ( 6, 10 ] 47452 2.316% 99.298% ( 10, 15 ] 7316 0.357% 99.655% ( 15, 22 ] 902 0.044% 99.699% ( 22, 34 ] 85 0.004% 99.703% ( 34, 51 ] 158 0.008% 99.711% ( 51, 76 ] 212 0.010% 99.721% ( 76, 110 ] 164 0.008% 99.729% ( 110, 170 ] 436 0.021% 99.750% ( 170, 250 ] 383 0.019% 99.769% ( 250, 380 ] 603 0.029% 99.799% ( 380, 580 ] 1141 0.056% 99.854% ( 580, 870 ] 1617 0.079% 99.933% ( 870, 1300 ] 1639 0.080% 100.013% ( 1300, 1900 ] 1024 0.050% 100.063% ( 1900, 2900 ] 1020 0.050% 100.113% ( 2900, 4400 ] 1014 0.049% 100.162% ( 4400, 6600 ] 300 0.015% 100.177% ( 6600, 9900 ] 78 0.004% 100.181% ( 9900, 14000 ] 11 0.001% 100.181% ( 14000, 22000 ] 14 0.001% 100.182% ( 22000, 33000 ] 7 0.000% 100.182% ( 33000, 50000 ] 3 0.000% 100.183% ** Level 4 read latency histogram (micros): Count: 1231005 Average: 22.0212 StdDev: 254.13 Min: 1 Median: 1.9514 Max: 70010 Percentiles: P50: 1.95 P75: 3.00 P99: 432.74 P99.9: 2208.83 P99.99: 3086.60 ------------------------------------------------------ [ 0, 1 ] 23488 1.908% 1.908% ( 1, 2 ] 622241 50.547% 52.455% ########## ( 2, 3 ] 278343 22.611% 75.066% ##### ( 3, 4 ] 125000 10.154% 85.221% ## ( 4, 6 ] 121751 9.890% 95.111% ## ( 6, 10 ] 30243 2.457% 97.568% ( 10, 15 ] 4373 0.355% 97.923% ( 15, 22 ] 568 0.046% 97.969% ( 22, 34 ] 56 0.005% 97.974% ( 34, 51 ] 109 0.009% 97.983% ( 51, 76 ] 164 0.013% 97.996% ( 76, 110 ] 1467 0.119% 98.115% ( 110, 170 ] 5019 0.408% 98.523% ( 170, 250 ] 2938 0.239% 98.762% ( 250, 380 ] 2151 0.175% 98.936% ( 380, 580 ] 2973 0.242% 99.178% ( 580, 870 ] 3602 0.293% 99.470% ( 870, 1300 ] 3095 0.251% 99.722% ( 1300, 1900 ] 1777 0.144% 99.866% ( 1900, 2900 ] 1347 0.109% 99.976% ( 2900, 4400 ] 1422 0.116% 100.091% ( 4400, 6600 ] 360 0.029% 100.120% ( 6600, 9900 ] 67 0.005% 100.126% ( 9900, 14000 ] 8 0.001% 100.126% ( 14000, 22000 ] 16 0.001% 100.128% ( 22000, 33000 ] 7 0.001% 100.128% ( 33000, 50000 ] 3 0.000% 100.129% ( 50000, 75000 ] 3 0.000% 100.129% ** Level 5 read latency histogram (micros): Count: 97643 Average: 663.4224 StdDev: 1178.80 Min: 73 Median: 248.9548 Max: 69889 Percentiles: P50: 248.95 P75: 726.62 P99: 5258.74 P99.9: 9543.34 P99.99: 38000.63 ------------------------------------------------------ ( 51, 76 ] 7 0.007% 0.007% ( 76, 110 ] 7791 7.979% 7.986% ## ( 110, 170 ] 26935 27.585% 35.571% ###### ( 170, 250 ] 14275 14.620% 50.191% ### ( 250, 380 ] 8756 8.967% 59.158% ## ( 380, 580 ] 10557 10.812% 69.970% ## ( 580, 870 ] 9714 9.948% 79.919% ## ( 870, 1300 ] 7631 7.815% 87.734% ## ( 1300, 1900 ] 4278 4.381% 92.115% # ( 1900, 2900 ] 2972 3.044% 95.159% # ( 2900, 4400 ] 3297 3.377% 98.535% # ( 4400, 6600 ] 1162 1.190% 99.726% ( 6600, 9900 ] 191 0.196% 99.921% ( 9900, 14000 ] 30 0.031% 99.952% ( 14000, 22000 ] 16 0.016% 99.968% ( 22000, 33000 ] 18 0.018% 99.987% ( 33000, 50000 ] 11 0.011% 99.998% ( 50000, 75000 ] 2 0.002% 100.000% ** DB Stats ** Uptime(secs): 22.8 total, 3.4 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 172.44 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.639 H:M:S, 33.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 287.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-06:03:40 ... thread 0: (1000000,5000000) ops and (243217.2,186747.2) ops/second in (4.111551,26.774162) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/9 4.06 GB 264.3 4.0 0.0 4.0 8.7 4.7 0.0 1.8 95.2 208.0 42.99 29.60 80 0.537 4157K 4583 0.0 0.0 L1 3/3 284.63 MB 0.0 1.2 1.1 0.1 1.2 1.1 0.0 1.1 114.3 114.0 11.16 6.06 2 5.582 1295K 3198 0.0 0.0 L2 2/0 80.90 MB 0.8 0.1 0.1 0.1 0.1 0.1 0.8 2.2 116.7 116.4 1.28 0.71 1 1.284 152K 381 0.0 0.0 L3 15/0 997.15 MB 1.0 4.8 2.3 2.5 4.7 2.2 0.5 2.1 111.2 109.9 43.99 22.97 27 1.629 2341K 4398 0.0 0.0 L4 176/0 9.61 GB 1.0 10.7 5.7 5.0 10.5 5.5 0.5 1.9 123.9 122.2 88.22 51.83 56 1.575 5941K 17K 0.0 0.0 L5 1156/0 95.04 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1371/12 110.04 GB 0.0 20.8 9.2 11.7 25.4 13.7 7.7 5.4 113.8 138.4 187.65 111.16 166 1.130 13M 30K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.8 9.2 11.7 25.4 13.7 7.7 5.4 113.8 138.4 187.65 111.16 166 1.130 13M 30K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.8 9.2 11.7 20.6 8.9 0.0 0.0 131.0 129.7 162.91 97.59 100 1.629 13M 30K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 196.1 24.74 13.58 66 0.375 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.9 total, 26.8 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.37 GB write, 964.18 MB/s write, 20.85 GB read, 792.37 MB/s read, 187.6 seconds Interval compaction: 25.37 GB write, 970.12 MB/s write, 20.85 GB read, 797.25 MB/s read, 187.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 90, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 90, interval: 96 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1559128 Average: 11.3885 StdDev: 131.84 Min: 0 Median: 1.6512 Max: 55720 Percentiles: P50: 1.65 P75: 2.39 P99: 206.11 P99.9: 1003.38 P99.99: 2216.83 ------------------------------------------------------ [ 0, 1 ] 218195 13.995% 13.995% ### ( 1, 2 ] 862060 55.291% 69.286% ########### ( 2, 3 ] 230609 14.791% 84.077% ### ( 3, 4 ] 97319 6.242% 90.319% # ( 4, 6 ] 85034 5.454% 95.773% # ( 6, 10 ] 19436 1.247% 97.019% ( 10, 15 ] 2993 0.192% 97.211% ( 15, 22 ] 437 0.028% 97.239% ( 22, 34 ] 66 0.004% 97.243% ( 34, 51 ] 40 0.003% 97.246% ( 51, 76 ] 65 0.004% 97.250% ( 76, 110 ] 5104 0.327% 97.577% ( 110, 170 ] 18351 1.177% 98.754% ( 170, 250 ] 8481 0.544% 99.298% ( 250, 380 ] 3825 0.245% 99.544% ( 380, 580 ] 3431 0.220% 99.764% ( 580, 870 ] 1795 0.115% 99.879% ( 870, 1300 ] 1057 0.068% 99.947% ( 1300, 1900 ] 535 0.034% 99.981% ( 1900, 2900 ] 439 0.028% 100.009% ( 2900, 4400 ] 368 0.024% 100.033% ( 4400, 6600 ] 94 0.006% 100.039% ( 6600, 9900 ] 21 0.001% 100.040% ( 9900, 14000 ] 1 0.000% 100.040% ( 14000, 22000 ] 8 0.001% 100.041% ( 22000, 33000 ] 3 0.000% 100.041% ( 33000, 50000 ] 2 0.000% 100.041% ( 50000, 75000 ] 1 0.000% 100.041% ** Level 1 read latency histogram (micros): Count: 224305 Average: 13.8251 StdDev: 165.65 Min: 1 Median: 1.9687 Max: 26381 Percentiles: P50: 1.97 P75: 3.04 P99: 171.39 P99.9: 2118.81 P99.99: 4111.02 ------------------------------------------------------ [ 0, 1 ] 4891 2.181% 2.181% ( 1, 2 ] 110731 49.366% 51.547% ########## ( 2, 3 ] 51739 23.066% 74.613% ##### ( 3, 4 ] 23018 10.262% 84.875% ## ( 4, 6 ] 23266 10.372% 95.248% ## ( 6, 10 ] 5964 2.659% 97.906% # ( 10, 15 ] 961 0.428% 98.335% ( 15, 22 ] 209 0.093% 98.428% ( 22, 34 ] 22 0.010% 98.438% ( 34, 51 ] 13 0.006% 98.444% ( 51, 76 ] 16 0.007% 98.451% ( 76, 110 ] 279 0.124% 98.575% ( 110, 170 ] 945 0.421% 98.996% ( 170, 250 ] 459 0.205% 99.201% ( 250, 380 ] 279 0.124% 99.325% ( 380, 580 ] 366 0.163% 99.489% ( 580, 870 ] 408 0.182% 99.671% ( 870, 1300 ] 326 0.145% 99.816% ( 1300, 1900 ] 162 0.072% 99.888% ( 1900, 2900 ] 122 0.054% 99.942% ( 2900, 4400 ] 132 0.059% 100.001% ( 4400, 6600 ] 28 0.012% 100.014% ( 6600, 9900 ] 8 0.004% 100.017% ( 9900, 14000 ] 1 0.000% 100.018% ( 22000, 33000 ] 2 0.001% 100.019% ** Level 2 read latency histogram (micros): Count: 415604 Average: 14.1105 StdDev: 179.29 Min: 1 Median: 1.9561 Max: 10206 Percentiles: P50: 1.96 P75: 3.00 P99: 12.12 P99.9: 1725.88 P99.99: 2747.77 ------------------------------------------------------ [ 0, 1 ] 12651 3.044% 3.044% # ( 1, 2 ] 204111 49.112% 52.156% ########## ( 2, 3 ] 94957 22.848% 75.004% ##### ( 3, 4 ] 42187 10.151% 85.155% ## ( 4, 6 ] 44383 10.679% 95.834% ## ( 6, 10 ] 12232 2.943% 98.777% # ( 10, 15 ] 2186 0.526% 99.303% ( 15, 22 ] 357 0.086% 99.389% ( 22, 34 ] 62 0.015% 99.404% ( 34, 51 ] 35 0.008% 99.412% ( 51, 76 ] 28 0.007% 99.419% ( 76, 110 ] 51 0.012% 99.431% ( 110, 170 ] 159 0.038% 99.469% ( 170, 250 ] 132 0.032% 99.501% ( 250, 380 ] 170 0.041% 99.542% ( 380, 580 ] 285 0.069% 99.611% ( 580, 870 ] 449 0.108% 99.719% ( 870, 1300 ] 500 0.120% 99.839% ( 1300, 1900 ] 357 0.086% 99.925% ( 1900, 2900 ] 319 0.077% 100.002% ( 2900, 4400 ] 375 0.090% 100.092% ( 4400, 6600 ] 139 0.033% 100.125% ( 6600, 9900 ] 21 0.005% 100.130% ( 9900, 14000 ] 1 0.000% 100.131% ** Level 3 read latency histogram (micros): Count: 2049951 Average: 9.8672 StdDev: 157.61 Min: 1 Median: 1.9374 Max: 42504 Percentiles: P50: 1.94 P75: 2.95 P99: 9.54 P99.9: 749.15 P99.99: 1176.13 ------------------------------------------------------ [ 0, 1 ] 44097 2.151% 2.151% ( 1, 2 ] 1046383 51.044% 53.195% ########## ( 2, 3 ] 468489 22.854% 76.049% ##### ( 3, 4 ] 214791 10.478% 86.527% ## ( 4, 6 ] 213647 10.422% 96.949% ## ( 6, 10 ] 47452 2.315% 99.264% ( 10, 15 ] 7316 0.357% 99.621% ( 15, 22 ] 902 0.044% 99.665% ( 22, 34 ] 85 0.004% 99.669% ( 34, 51 ] 158 0.008% 99.677% ( 51, 76 ] 212 0.010% 99.687% ( 76, 110 ] 267 0.013% 99.700% ( 110, 170 ] 795 0.039% 99.739% ( 170, 250 ] 523 0.026% 99.764% ( 250, 380 ] 652 0.032% 99.796% ( 380, 580 ] 1186 0.058% 99.854% ( 580, 870 ] 1622 0.079% 99.933% ( 870, 1300 ] 1642 0.080% 100.013% ( 1300, 1900 ] 1025 0.050% 100.063% ( 1900, 2900 ] 1020 0.050% 100.113% ( 2900, 4400 ] 1014 0.049% 100.162% ( 4400, 6600 ] 300 0.015% 100.177% ( 6600, 9900 ] 78 0.004% 100.181% ( 9900, 14000 ] 11 0.001% 100.181% ( 14000, 22000 ] 14 0.001% 100.182% ( 22000, 33000 ] 7 0.000% 100.182% ( 33000, 50000 ] 3 0.000% 100.182% ** Level 4 read latency histogram (micros): Count: 1241451 Average: 23.4062 StdDev: 253.86 Min: 1 Median: 1.9598 Max: 70010 Percentiles: P50: 1.96 P75: 3.06 P99: 463.07 P99.9: 2207.47 P99.99: 3086.42 ------------------------------------------------------ [ 0, 1 ] 23488 1.892% 1.892% ( 1, 2 ] 622273 50.125% 52.017% ########## ( 2, 3 ] 278419 22.427% 74.444% #### ( 3, 4 ] 125029 10.071% 84.515% ## ( 4, 6 ] 121804 9.811% 94.326% ## ( 6, 10 ] 30248 2.437% 96.763% ( 10, 15 ] 4375 0.352% 97.115% ( 15, 22 ] 568 0.046% 97.161% ( 22, 34 ] 56 0.005% 97.165% ( 34, 51 ] 109 0.009% 97.174% ( 51, 76 ] 165 0.013% 97.187% ( 76, 110 ] 3041 0.245% 97.432% ( 110, 170 ] 10188 0.821% 98.253% ( 170, 250 ] 4868 0.392% 98.645% ( 250, 380 ] 2924 0.236% 98.881% ( 380, 580 ] 3567 0.287% 99.168% ( 580, 870 ] 3779 0.304% 99.472% ( 870, 1300 ] 3111 0.251% 99.723% ( 1300, 1900 ] 1780 0.143% 99.866% ( 1900, 2900 ] 1358 0.109% 99.976% ( 2900, 4400 ] 1423 0.115% 100.090% ( 4400, 6600 ] 360 0.029% 100.119% ( 6600, 9900 ] 67 0.005% 100.125% ( 9900, 14000 ] 8 0.001% 100.125% ( 14000, 22000 ] 16 0.001% 100.127% ( 22000, 33000 ] 7 0.001% 100.127% ( 33000, 50000 ] 3 0.000% 100.128% ( 50000, 75000 ] 3 0.000% 100.128% ** Level 5 read latency histogram (micros): Count: 150595 Average: 496.1892 StdDev: 979.42 Min: 73 Median: 187.7963 Max: 69889 Percentiles: P50: 187.80 P75: 472.30 P99: 4365.46 P99.9: 8617.90 P99.99: 31130.31 ------------------------------------------------------ ( 51, 76 ] 9 0.006% 0.006% ( 76, 110 ] 16344 10.853% 10.859% ## ( 110, 170 ] 53562 35.567% 46.426% ####### ( 170, 250 ] 24196 16.067% 62.493% ### ( 250, 380 ] 12577 8.352% 70.844% ## ( 380, 580 ] 13560 9.004% 79.849% ## ( 580, 870 ] 10547 7.004% 86.852% # ( 870, 1300 ] 7759 5.152% 92.004% # ( 1300, 1900 ] 4306 2.859% 94.864% # ( 1900, 2900 ] 3007 1.997% 96.860% ( 2900, 4400 ] 3298 2.190% 99.050% ( 4400, 6600 ] 1162 0.772% 99.822% ( 6600, 9900 ] 192 0.127% 99.950% ( 9900, 14000 ] 30 0.020% 99.969% ( 14000, 22000 ] 16 0.011% 99.980% ( 22000, 33000 ] 18 0.012% 99.992% ( 33000, 50000 ] 11 0.007% 99.999% ( 50000, 75000 ] 2 0.001% 100.001% ** DB Stats ** Uptime(secs): 26.9 total, 4.1 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 182.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.282 H:M:S, 30.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 239.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.644 H:M:S, 15.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 268.450 micros/op 14885 ops/sec 60.127 seconds 894996 operations; 14.4 MB/s (220999 of 220999 found) Microseconds per read: Count: 894996 Average: 268.4525 StdDev: 876.57 Min: 2 Median: 169.9424 Max: 158750 Percentiles: P50: 169.94 P75: 234.19 P99: 1834.00 P99.9: 12798.15 P99.99: 32210.42 ------------------------------------------------------ ( 1, 2 ] 5 0.001% 0.001% ( 2, 3 ] 26 0.003% 0.003% ( 3, 4 ] 43 0.005% 0.008% ( 4, 6 ] 89 0.010% 0.018% ( 6, 10 ] 388 0.043% 0.062% ( 10, 15 ] 3954 0.442% 0.503% ( 15, 22 ] 3514 0.393% 0.896% ( 22, 34 ] 9546 1.067% 1.963% ( 34, 51 ] 2097 0.234% 2.197% ( 51, 76 ] 186 0.021% 2.218% ( 76, 110 ] 22087 2.468% 4.685% ( 110, 170 ] 405953 45.358% 50.044% ######### ( 170, 250 ] 278382 31.104% 81.148% ###### ( 250, 380 ] 86059 9.616% 90.763% ## ( 380, 580 ] 39264 4.387% 95.150% # ( 580, 870 ] 19614 2.192% 97.342% ( 870, 1300 ] 10422 1.164% 98.506% ( 1300, 1900 ] 4963 0.555% 99.061% ( 1900, 2900 ] 3107 0.347% 99.408% ( 2900, 4400 ] 2883 0.322% 99.730% ( 4400, 6600 ] 929 0.104% 99.834% ( 6600, 9900 ] 291 0.033% 99.867% ( 9900, 14000 ] 423 0.047% 99.914% ( 14000, 22000 ] 494 0.055% 99.969% ( 22000, 33000 ] 202 0.023% 99.992% ( 33000, 50000 ] 54 0.006% 99.998% ( 50000, 75000 ] 14 0.002% 99.999% ( 75000, 110000 ] 4 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 12807533 rocksdb.bloom.filter.full.positive COUNT : 1019078 rocksdb.bloom.filter.full.true.positive COUNT : 894574 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 422 rocksdb.memtable.miss COUNT : 894574 rocksdb.l0.hit COUNT : 31610 rocksdb.l1.hit COUNT : 9889 rocksdb.l2andup.hit COUNT : 853075 rocksdb.compaction.key.drop.new COUNT : 274795 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5736621 rocksdb.number.keys.read COUNT : 894996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5920192872 rocksdb.bytes.read COUNT : 894996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1750 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 38394737 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 27905280795 rocksdb.compact.write.bytes COUNT : 27622074897 rocksdb.flush.write.bytes COUNT : 5878991373 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 30 rocksdb.number.superversion_acquires COUNT : 1202 rocksdb.number.superversion_releases COUNT : 1173 rocksdb.number.superversion_cleanups COUNT : 307 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 376 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5831741440 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2411520 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31871072505 rocksdb.non.last.level.read.count COUNT : 7560149 rocksdb.block.checksum.compute.count COUNT : 7788276 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 168.984104 P95 : 572.595136 P99 : 1832.921837 P100 : 158747.000000 COUNT : 894996 SUM : 239469750 rocksdb.db.write.micros P50 : 1.542415 P95 : 4.156872 P99 : 8.390155 P100 : 784919.000000 COUNT : 5736621 SUM : 52777376 rocksdb.compaction.times.micros P50 : 1550000.000000 P95 : 3862500.000000 P99 : 6463333.333333 P100 : 17138450.000000 COUNT : 105 SUM : 189049050 rocksdb.compaction.times.cpu_micros P50 : 866538.461538 P95 : 2450000.000000 P99 : 6390000.000000 P100 : 8675569.000000 COUNT : 105 SUM : 114994219 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 842.812500 P95 : 87833.333333 P99 : 393037.000000 P100 : 393037.000000 COUNT : 78 SUM : 1179199 rocksdb.compaction.outfile.sync.micros P50 : 20206.896552 P95 : 241142.857143 P99 : 444220.000000 P100 : 489376.000000 COUNT : 331 SUM : 18311575 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 405.000000 P95 : 3855.263158 P99 : 6402.000000 P100 : 8912.000000 COUNT : 218 SUM : 224214 rocksdb.table.open.io.micros P50 : 8757.419355 P95 : 20815.450644 P99 : 30489.130435 P100 : 117761.000000 COUNT : 1750 SUM : 16262446 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.958017 P95 : 9.705366 P99 : 163.326614 P100 : 70015.000000 COUNT : 6758237 SUM : 95318263 rocksdb.read.block.get.micros P50 : 140.870586 P95 : 495.885927 P99 : 1758.982945 P100 : 69895.000000 COUNT : 1028288 SUM : 206663843 rocksdb.write.raw.block.micros P50 : 0.529466 P95 : 1.152621 P99 : 3.327061 P100 : 122250.000000 COUNT : 8114357 SUM : 26286993 rocksdb.numfiles.in.singlecompaction P50 : 2.924242 P95 : 6.485714 P99 : 9.754286 P100 : 23.000000 COUNT : 143 SUM : 497 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.578207 P95 : 2012.942000 P99 : 2724.642315 P100 : 784748.000000 COUNT : 152464 SUM : 38407662 rocksdb.sst.read.micros P50 : 1.975791 P95 : 159.068095 P99 : 494.164828 P100 : 70010.000000 COUNT : 7560188 SUM : 282535315 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 894996 SUM : 894996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5736621 SUM : 5920192872 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 232040.816327 P95 : 1010460.000000 P99 : 1010460.000000 P100 : 1010460.000000 COUNT : 78 SUM : 27066287 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 379 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0