[2024-11-19 21:03:57.897163] Starting SPDK v25.01-pre git sha1 f22e807f1 / DPDK 24.03.0 initialization... [2024-11-19 21:03:57.897309] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1924419 ] Set seed to 1732046637893674 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-19 21:03:58.017614] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-19 21:03:58.130761] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-19 21:03:58.130810] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1924419' to capture a snapshot of events at runtime. [2024-11-19 21:03:58.130821] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-19 21:03:58.130831] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-19 21:03:58.130840] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1924419 for offline analysis/debug. [2024-11-19 21:03:58.132100] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Nov 19 21:04:06 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/19-21:04:14 ... thread 0: (1000000,1000000) ops and (129975.6,129975.6) ops/second in (7.693751,7.693751) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 1.51 GB 44.0 0.4 0.0 0.4 1.2 0.8 0.0 1.5 39.9 126.2 9.48 3.96 10 0.948 383K 497 0.0 0.0 L1 5/5 449.57 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 2/0 200.40 MB 2.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 44/11 3.28 GB 2.7 3.0 2.2 0.8 3.0 2.2 0.1 1.4 93.1 92.1 33.14 15.05 17 1.949 845K 0 0.0 0.0 L4 200/16 11.52 GB 1.1 2.6 1.9 0.6 2.5 1.9 0.2 1.3 109.1 108.1 24.00 12.12 21 1.143 1995K 0 0.0 0.0 L5 1100/0 90.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1362/41 107.51 GB 0.0 5.9 4.1 1.8 6.7 4.8 0.3 8.4 91.3 102.7 66.61 31.12 48 1.388 3225K 497 0.0 0.0 Int 0/0 0.00 KB 0.0 5.9 4.1 1.8 6.7 4.8 0.3 8.4 91.3 102.7 66.61 31.12 48 1.388 3225K 497 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.9 4.1 1.8 5.9 4.0 0.0 0.0 102.2 101.2 59.53 28.73 39 1.526 3225K 497 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 115.6 7.08 2.40 9 0.787 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.9 total, 7.7 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.68 GB write, 869.74 MB/s write, 5.94 GB read, 773.31 MB/s read, 66.6 seconds Interval compaction: 6.68 GB write, 889.09 MB/s write, 5.94 GB read, 790.51 MB/s read, 66.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 40, pending-compaction-bytes-delays: 2, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 40, interval: 42 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 298229 Average: 13.0376 StdDev: 190.99 Min: 1 Median: 1.9813 Max: 35713 Percentiles: P50: 1.98 P75: 2.95 P99: 10.71 P99.9: 2814.17 P99.99: 4940.40 ------------------------------------------------------ [ 0, 1 ] 7899 2.649% 2.649% # ( 1, 2 ] 143912 48.256% 50.904% ########## ( 2, 3 ] 75880 25.444% 76.348% ##### ( 3, 4 ] 29456 9.877% 86.225% ## ( 4, 6 ] 29752 9.976% 96.201% ## ( 6, 10 ] 8127 2.725% 98.926% # ( 10, 15 ] 1553 0.521% 99.447% ( 15, 22 ] 137 0.046% 99.493% ( 22, 34 ] 23 0.008% 99.500% ( 34, 51 ] 6 0.002% 99.502% ( 51, 76 ] 10 0.003% 99.506% ( 76, 110 ] 3 0.001% 99.507% ( 110, 170 ] 7 0.002% 99.509% ( 170, 250 ] 19 0.006% 99.515% ( 250, 380 ] 34 0.011% 99.527% ( 380, 580 ] 103 0.035% 99.561% ( 580, 870 ] 189 0.063% 99.625% ( 870, 1300 ] 303 0.102% 99.726% ( 1300, 1900 ] 282 0.095% 99.821% ( 1900, 2900 ] 259 0.087% 99.908% ( 2900, 4400 ] 228 0.076% 99.984% ( 4400, 6600 ] 74 0.025% 100.009% ( 6600, 9900 ] 17 0.006% 100.015% ( 9900, 14000 ] 1 0.000% 100.015% ( 14000, 22000 ] 2 0.001% 100.016% ( 22000, 33000 ] 1 0.000% 100.016% ( 33000, 50000 ] 1 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 35601 Average: 20.3500 StdDev: 264.01 Min: 1 Median: 2.2304 Max: 14963 Percentiles: P50: 2.23 P75: 3.15 P99: 13.88 P99.9: 4373.49 P99.99: 9250.13 ------------------------------------------------------ [ 0, 1 ] 257 0.722% 0.722% ( 1, 2 ] 15044 42.257% 42.979% ######## ( 2, 3 ] 10848 30.471% 73.450% ###### ( 3, 4 ] 3690 10.365% 83.815% ## ( 4, 6 ] 3936 11.056% 94.871% ## ( 6, 10 ] 1272 3.573% 98.444% # ( 10, 15 ] 255 0.716% 99.160% ( 15, 22 ] 32 0.090% 99.250% ( 22, 34 ] 2 0.006% 99.256% ( 34, 51 ] 1 0.003% 99.258% ( 51, 76 ] 6 0.017% 99.275% ( 76, 110 ] 4 0.011% 99.287% ( 110, 170 ] 1 0.003% 99.289% ( 250, 380 ] 5 0.014% 99.303% ( 380, 580 ] 15 0.042% 99.346% ( 580, 870 ] 28 0.079% 99.424% ( 870, 1300 ] 41 0.115% 99.539% ( 1300, 1900 ] 42 0.118% 99.657% ( 1900, 2900 ] 53 0.149% 99.806% ( 2900, 4400 ] 34 0.096% 99.902% ( 4400, 6600 ] 21 0.059% 99.961% ( 6600, 9900 ] 13 0.037% 99.997% ( 14000, 22000 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 443038 Average: 20.0142 StdDev: 241.96 Min: 1 Median: 2.1602 Max: 31381 Percentiles: P50: 2.16 P75: 3.10 P99: 13.64 P99.9: 2533.42 P99.99: 3231.61 ------------------------------------------------------ [ 0, 1 ] 6856 1.547% 1.547% ( 1, 2 ] 194403 43.880% 45.427% ######### ( 2, 3 ] 126488 28.550% 73.977% ###### ( 3, 4 ] 45983 10.379% 84.356% ## ( 4, 6 ] 47851 10.801% 95.157% ## ( 6, 10 ] 14391 3.248% 98.405% # ( 10, 15 ] 3619 0.817% 99.222% ( 15, 22 ] 525 0.118% 99.340% ( 22, 34 ] 52 0.012% 99.352% ( 34, 51 ] 20 0.005% 99.357% ( 51, 76 ] 20 0.005% 99.361% ( 76, 110 ] 10 0.002% 99.363% ( 110, 170 ] 13 0.003% 99.366% ( 170, 250 ] 38 0.009% 99.375% ( 250, 380 ] 70 0.016% 99.391% ( 380, 580 ] 185 0.042% 99.433% ( 580, 870 ] 336 0.076% 99.508% ( 870, 1300 ] 552 0.125% 99.633% ( 1300, 1900 ] 706 0.159% 99.792% ( 1900, 2900 ] 753 0.170% 99.962% ( 2900, 4400 ] 555 0.125% 100.088% ( 4400, 6600 ] 229 0.052% 100.139% ( 6600, 9900 ] 51 0.012% 100.151% ( 9900, 14000 ] 1 0.000% 100.151% ( 14000, 22000 ] 2 0.000% 100.151% ( 22000, 33000 ] 3 0.001% 100.152% ** Level 3 read latency histogram (micros): Count: 698256 Average: 13.1981 StdDev: 177.26 Min: 0 Median: 2.1739 Max: 31536 Percentiles: P50: 2.17 P75: 3.08 P99: 10.27 P99.9: 1531.34 P99.99: 2122.32 ------------------------------------------------------ [ 0, 1 ] 7361 1.054% 1.054% ( 1, 2 ] 306289 43.865% 44.919% ######### ( 2, 3 ] 204004 29.216% 74.135% ###### ( 3, 4 ] 77271 11.066% 85.202% ## ( 4, 6 ] 77410 11.086% 96.288% ## ( 6, 10 ] 18717 2.681% 98.968% # ( 10, 15 ] 4162 0.596% 99.564% ( 15, 22 ] 502 0.072% 99.636% ( 22, 34 ] 38 0.005% 99.642% ( 34, 51 ] 30 0.004% 99.646% ( 51, 76 ] 34 0.005% 99.651% ( 76, 110 ] 11 0.002% 99.652% ( 110, 170 ] 18 0.003% 99.655% ( 170, 250 ] 43 0.006% 99.661% ( 250, 380 ] 86 0.012% 99.673% ( 380, 580 ] 215 0.031% 99.704% ( 580, 870 ] 401 0.057% 99.762% ( 870, 1300 ] 665 0.095% 99.857% ( 1300, 1900 ] 780 0.112% 99.969% ( 1900, 2900 ] 671 0.096% 100.065% ( 2900, 4400 ] 513 0.073% 100.138% ( 4400, 6600 ] 210 0.030% 100.168% ( 6600, 9900 ] 23 0.003% 100.172% ( 22000, 33000 ] 2 0.000% 100.172% ** Level 4 read latency histogram (micros): Count: 285500 Average: 33.3147 StdDev: 327.29 Min: 1 Median: 2.1255 Max: 44330 Percentiles: P50: 2.13 P75: 3.03 P99: 982.37 P99.9: 3762.37 P99.99: 4434.35 ------------------------------------------------------ [ 0, 1 ] 3534 1.238% 1.238% ( 1, 2 ] 129108 45.222% 46.460% ######### ( 2, 3 ] 80527 28.206% 74.665% ###### ( 3, 4 ] 30512 10.687% 85.352% ## ( 4, 6 ] 28313 9.917% 95.269% ## ( 6, 10 ] 7762 2.719% 97.988% # ( 10, 15 ] 1557 0.545% 98.533% ( 15, 22 ] 180 0.063% 98.596% ( 22, 34 ] 12 0.004% 98.601% ( 34, 51 ] 19 0.007% 98.607% ( 51, 76 ] 12 0.004% 98.612% ( 76, 110 ] 5 0.002% 98.613% ( 110, 170 ] 23 0.008% 98.621% ( 170, 250 ] 36 0.013% 98.634% ( 250, 380 ] 93 0.033% 98.667% ( 380, 580 ] 219 0.077% 98.743% ( 580, 870 ] 514 0.180% 98.923% ( 870, 1300 ] 838 0.294% 99.217% ( 1300, 1900 ] 826 0.289% 99.506% ( 1900, 2900 ] 783 0.274% 99.780% ( 2900, 4400 ] 594 0.208% 99.988% ( 4400, 6600 ] 285 0.100% 100.088% ( 6600, 9900 ] 47 0.016% 100.105% ( 9900, 14000 ] 1 0.000% 100.105% ( 22000, 33000 ] 4 0.001% 100.106% ( 33000, 50000 ] 1 0.000% 100.107% ** Level 5 read latency histogram (micros): Count: 8649 Average: 2477.8817 StdDev: 2025.38 Min: 99 Median: 1897.6596 Max: 53739 Percentiles: P50: 1897.66 P75: 3561.72 P99: 9226.53 P99.9: 13319.25 P99.99: 42648.35 ------------------------------------------------------ ( 76, 110 ] 1 0.012% 0.012% ( 110, 170 ] 9 0.104% 0.116% ( 170, 250 ] 51 0.590% 0.705% ( 250, 380 ] 175 2.023% 2.729% ( 380, 580 ] 467 5.399% 8.128% # ( 580, 870 ] 873 10.094% 18.222% ## ( 870, 1300 ] 1344 15.539% 33.761% ### ( 1300, 1900 ] 1410 16.302% 50.064% ### ( 1900, 2900 ] 1514 17.505% 67.569% #### ( 2900, 4400 ] 1457 16.846% 84.414% ### ( 4400, 6600 ] 1049 12.129% 96.543% ## ( 6600, 9900 ] 267 3.087% 99.630% # ( 9900, 14000 ] 28 0.324% 99.954% ( 14000, 22000 ] 1 0.012% 99.965% ( 22000, 33000 ] 1 0.012% 99.977% ( 33000, 50000 ] 2 0.023% 100.000% ( 50000, 75000 ] 1 0.012% 100.012% ** DB Stats ** Uptime(secs): 7.9 total, 7.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 125.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.836 H:M:S, 48.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 127.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.836 H:M:S, 49.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/19-21:04:20 ... thread 0: (1000000,2000000) ops and (152604.3,140383.9) ops/second in (6.552895,14.246646) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.78 GB 157.3 1.4 0.0 1.4 3.1 1.8 0.0 1.8 66.1 153.3 20.95 10.91 27 0.776 1407K 1767 0.0 0.0 L1 10/0 869.36 MB 86.9 1.2 0.7 0.4 1.1 0.7 0.0 1.6 90.3 89.9 13.05 5.69 1 13.054 1197K 5411 0.0 0.0 L2 2/1 172.27 MB 0.4 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 14/1 1.05 GB 0.9 3.1 2.3 0.8 3.1 2.2 0.4 1.4 94.4 93.3 33.63 15.44 18 1.868 918K 0 0.0 0.0 L4 177/0 9.59 GB 1.0 8.2 4.4 3.8 8.0 4.2 0.3 1.8 119.5 117.5 69.99 38.48 46 1.522 3790K 2027 0.0 0.0 L5 1152/0 94.92 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1366/6 108.36 GB 0.0 13.8 7.3 6.4 15.4 8.9 5.3 8.6 102.5 114.4 137.63 70.52 92 1.496 7313K 9205 0.0 0.0 Int 0/0 0.00 KB 0.0 13.8 7.3 6.4 15.4 8.9 5.3 8.6 102.5 114.4 137.63 70.52 92 1.496 7313K 9205 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.8 7.3 6.4 13.6 7.2 0.0 0.0 113.0 111.5 124.86 65.21 69 1.810 7313K 9205 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 143.1 12.77 5.31 23 0.555 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.4 total, 14.2 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.37 GB write, 1091.76 MB/s write, 13.77 GB read, 978.20 MB/s read, 137.6 seconds Interval compaction: 15.37 GB write, 1104.88 MB/s write, 13.77 GB read, 989.95 MB/s read, 137.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 51, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 51, interval: 65 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 592879 Average: 17.7374 StdDev: 196.82 Min: 1 Median: 1.9020 Max: 35713 Percentiles: P50: 1.90 P75: 2.83 P99: 293.17 P99.9: 2987.56 P99.99: 4989.70 ------------------------------------------------------ [ 0, 1 ] 23887 4.029% 4.029% # ( 1, 2 ] 302151 50.963% 54.992% ########## ( 2, 3 ] 142109 23.969% 78.962% ##### ( 3, 4 ] 51664 8.714% 87.676% ## ( 4, 6 ] 50792 8.567% 96.243% ## ( 6, 10 ] 12645 2.133% 98.376% ( 10, 15 ] 2330 0.393% 98.769% ( 15, 22 ] 228 0.038% 98.807% ( 22, 34 ] 27 0.005% 98.812% ( 34, 51 ] 11 0.002% 98.813% ( 51, 76 ] 14 0.002% 98.816% ( 76, 110 ] 31 0.005% 98.821% ( 110, 170 ] 342 0.058% 98.879% ( 170, 250 ] 506 0.085% 98.964% ( 250, 380 ] 642 0.108% 99.072% ( 380, 580 ] 923 0.156% 99.228% ( 580, 870 ] 1177 0.199% 99.427% ( 870, 1300 ] 1301 0.219% 99.646% ( 1300, 1900 ] 871 0.147% 99.793% ( 1900, 2900 ] 605 0.102% 99.895% ( 2900, 4400 ] 516 0.087% 99.982% ( 4400, 6600 ] 178 0.030% 100.012% ( 6600, 9900 ] 24 0.004% 100.016% ( 9900, 14000 ] 1 0.000% 100.016% ( 14000, 22000 ] 2 0.000% 100.017% ( 22000, 33000 ] 1 0.000% 100.017% ( 33000, 50000 ] 1 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 134061 Average: 12.9025 StdDev: 177.49 Min: 1 Median: 2.3346 Max: 14963 Percentiles: P50: 2.33 P75: 3.31 P99: 13.81 P99.9: 2852.78 P99.99: 7491.76 ------------------------------------------------------ [ 0, 1 ] 853 0.636% 0.636% ( 1, 2 ] 51704 38.568% 39.204% ######## ( 2, 3 ] 43262 32.270% 71.474% ###### ( 3, 4 ] 15439 11.516% 82.991% ## ( 4, 6 ] 15738 11.739% 94.730% ## ( 6, 10 ] 4981 3.715% 98.445% # ( 10, 15 ] 975 0.727% 99.173% ( 15, 22 ] 137 0.102% 99.275% ( 22, 34 ] 14 0.010% 99.285% ( 34, 51 ] 12 0.009% 99.294% ( 51, 76 ] 16 0.012% 99.306% ( 76, 110 ] 17 0.013% 99.319% ( 110, 170 ] 60 0.045% 99.364% ( 170, 250 ] 73 0.054% 99.418% ( 250, 380 ] 90 0.067% 99.485% ( 380, 580 ] 139 0.104% 99.589% ( 580, 870 ] 116 0.087% 99.676% ( 870, 1300 ] 130 0.097% 99.772% ( 1300, 1900 ] 89 0.066% 99.839% ( 1900, 2900 ] 86 0.064% 99.903% ( 2900, 4400 ] 72 0.054% 99.957% ( 4400, 6600 ] 40 0.030% 99.987% ( 6600, 9900 ] 17 0.013% 99.999% ( 14000, 22000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 493953 Average: 18.9890 StdDev: 232.77 Min: 1 Median: 2.1573 Max: 31381 Percentiles: P50: 2.16 P75: 3.08 P99: 13.48 P99.9: 2523.45 P99.99: 3290.06 ------------------------------------------------------ [ 0, 1 ] 7409 1.500% 1.500% ( 1, 2 ] 217331 43.998% 45.498% ######### ( 2, 3 ] 141386 28.623% 74.122% ###### ( 3, 4 ] 51150 10.355% 84.477% ## ( 4, 6 ] 53071 10.744% 95.221% ## ( 6, 10 ] 15946 3.228% 98.449% # ( 10, 15 ] 3911 0.792% 99.241% ( 15, 22 ] 557 0.113% 99.354% ( 22, 34 ] 54 0.011% 99.365% ( 34, 51 ] 21 0.004% 99.369% ( 51, 76 ] 21 0.004% 99.373% ( 76, 110 ] 11 0.002% 99.375% ( 110, 170 ] 15 0.003% 99.378% ( 170, 250 ] 48 0.010% 99.388% ( 250, 380 ] 89 0.018% 99.406% ( 380, 580 ] 224 0.045% 99.452% ( 580, 870 ] 390 0.079% 99.531% ( 870, 1300 ] 601 0.122% 99.652% ( 1300, 1900 ] 739 0.150% 99.802% ( 1900, 2900 ] 778 0.158% 99.959% ( 2900, 4400 ] 583 0.118% 100.077% ( 4400, 6600 ] 235 0.048% 100.125% ( 6600, 9900 ] 51 0.010% 100.135% ( 9900, 14000 ] 1 0.000% 100.135% ( 14000, 22000 ] 2 0.000% 100.136% ( 22000, 33000 ] 3 0.001% 100.136% ** Level 3 read latency histogram (micros): Count: 1230581 Average: 11.5373 StdDev: 157.39 Min: 0 Median: 2.1287 Max: 31536 Percentiles: P50: 2.13 P75: 3.01 P99: 9.98 P99.9: 1292.53 P99.99: 1878.16 ------------------------------------------------------ [ 0, 1 ] 15174 1.233% 1.233% ( 1, 2 ] 554852 45.089% 46.322% ######### ( 2, 3 ] 351602 28.572% 74.894% ###### ( 3, 4 ] 130712 10.622% 85.516% ## ( 4, 6 ] 131350 10.674% 96.190% ## ( 6, 10 ] 34764 2.825% 99.015% # ( 10, 15 ] 6886 0.560% 99.574% ( 15, 22 ] 812 0.066% 99.640% ( 22, 34 ] 55 0.004% 99.645% ( 34, 51 ] 60 0.005% 99.649% ( 51, 76 ] 66 0.005% 99.655% ( 76, 110 ] 28 0.002% 99.657% ( 110, 170 ] 79 0.006% 99.663% ( 170, 250 ] 138 0.011% 99.675% ( 250, 380 ] 206 0.017% 99.691% ( 380, 580 ] 497 0.040% 99.732% ( 580, 870 ] 905 0.074% 99.805% ( 870, 1300 ] 1185 0.096% 99.902% ( 1300, 1900 ] 1128 0.092% 99.993% ( 1900, 2900 ] 919 0.075% 100.068% ( 2900, 4400 ] 708 0.058% 100.126% ( 4400, 6600 ] 282 0.023% 100.148% ( 6600, 9900 ] 27 0.002% 100.151% ( 14000, 22000 ] 1 0.000% 100.151% ( 22000, 33000 ] 3 0.000% 100.151% ** Level 4 read latency histogram (micros): Count: 990986 Average: 20.8709 StdDev: 228.71 Min: 1 Median: 2.0740 Max: 44330 Percentiles: P50: 2.07 P75: 2.98 P99: 195.08 P99.9: 2277.09 P99.99: 2945.82 ------------------------------------------------------ [ 0, 1 ] 13457 1.358% 1.358% ( 1, 2 ] 461787 46.599% 47.957% ######### ( 2, 3 ] 273546 27.603% 75.560% ###### ( 3, 4 ] 102129 10.306% 85.866% ## ( 4, 6 ] 95660 9.653% 95.519% ## ( 6, 10 ] 28047 2.830% 98.349% # ( 10, 15 ] 4997 0.504% 98.853% ( 15, 22 ] 592 0.060% 98.913% ( 22, 34 ] 37 0.004% 98.917% ( 34, 51 ] 63 0.006% 98.923% ( 51, 76 ] 55 0.006% 98.929% ( 76, 110 ] 63 0.006% 98.935% ( 110, 170 ] 450 0.045% 98.981% ( 170, 250 ] 616 0.062% 99.043% ( 250, 380 ] 724 0.073% 99.116% ( 380, 580 ] 1241 0.125% 99.241% ( 580, 870 ] 1922 0.194% 99.435% ( 870, 1300 ] 2333 0.235% 99.670% ( 1300, 1900 ] 1756 0.177% 99.848% ( 1900, 2900 ] 1379 0.139% 99.987% ( 2900, 4400 ] 1077 0.109% 100.095% ( 4400, 6600 ] 449 0.045% 100.141% ( 6600, 9900 ] 74 0.007% 100.148% ( 9900, 14000 ] 2 0.000% 100.148% ( 14000, 22000 ] 3 0.000% 100.149% ( 22000, 33000 ] 4 0.000% 100.149% ( 33000, 50000 ] 1 0.000% 100.149% ** Level 5 read latency histogram (micros): Count: 31486 Average: 1282.6838 StdDev: 1529.93 Min: 84 Median: 759.7041 Max: 53739 Percentiles: P50: 759.70 P75: 1607.51 P99: 6811.95 P99.9: 10560.98 P99.99: 26682.70 ------------------------------------------------------ ( 76, 110 ] 276 0.877% 0.877% ( 110, 170 ] 2586 8.213% 9.090% ## ( 170, 250 ] 2970 9.433% 18.523% ## ( 250, 380 ] 3046 9.674% 28.197% ## ( 380, 580 ] 4017 12.758% 40.955% ### ( 580, 870 ] 4596 14.597% 55.552% ### ( 870, 1300 ] 4506 14.311% 69.863% ### ( 1300, 1900 ] 3156 10.024% 79.886% ## ( 1900, 2900 ] 2452 7.788% 87.674% ## ( 2900, 4400 ] 2233 7.092% 94.766% # ( 4400, 6600 ] 1314 4.173% 98.939% # ( 6600, 9900 ] 298 0.946% 99.886% ( 9900, 14000 ] 28 0.089% 99.975% ( 14000, 22000 ] 4 0.013% 99.987% ( 22000, 33000 ] 2 0.006% 99.994% ( 33000, 50000 ] 2 0.006% 100.000% ( 50000, 75000 ] 1 0.003% 100.003% ** DB Stats ** Uptime(secs): 14.4 total, 6.6 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 136.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.724 H:M:S, 46.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 150.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.888 H:M:S, 44.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-21:04:24 ... thread 0: (1000000,3000000) ops and (291531.6,169713.9) ops/second in (3.430160,17.676806) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 2.77 GB 258.0 2.3 0.0 2.3 5.1 2.8 0.0 1.8 84.7 185.0 28.25 17.56 47 0.601 2430K 2768 0.0 0.0 L1 10/0 869.36 MB 86.9 1.2 0.7 0.4 1.1 0.7 0.0 1.6 90.3 89.9 13.05 5.69 1 13.054 1197K 5411 0.0 0.0 L2 1/0 43.50 MB 0.4 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 986.33 MB 1.0 3.4 2.4 1.0 3.3 2.3 0.4 1.4 98.3 97.2 34.90 16.57 19 1.837 1049K 0 0.0 0.0 L4 178/0 9.43 GB 1.0 8.6 4.6 4.0 8.4 4.4 0.3 1.8 121.8 119.7 72.07 40.38 49 1.471 4124K 5103 0.0 0.0 L5 1156/0 95.29 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1373/4 109.34 GB 0.0 15.4 7.7 7.8 18.0 10.2 5.7 6.5 106.5 124.2 148.27 80.20 116 1.278 8801K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.4 7.7 7.8 18.0 10.2 5.7 6.5 106.5 124.2 148.27 80.20 116 1.278 8801K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.4 7.7 7.8 15.2 7.5 0.0 0.0 119.4 117.9 132.21 72.12 77 1.717 8801K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 176.6 16.05 8.08 39 0.412 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.8 total, 17.7 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.99 GB write, 1031.82 MB/s write, 15.41 GB read, 884.26 MB/s read, 148.3 seconds Interval compaction: 17.99 GB write, 1041.81 MB/s write, 15.41 GB read, 892.83 MB/s read, 148.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 51, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 51, interval: 65 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 856681 Average: 13.8391 StdDev: 165.04 Min: 1 Median: 1.7650 Max: 35713 Percentiles: P50: 1.77 P75: 2.60 P99: 163.34 P99.9: 2428.39 P99.99: 4296.91 ------------------------------------------------------ [ 0, 1 ] 73333 8.560% 8.560% ## ( 1, 2 ] 464050 54.168% 62.728% ########### ( 2, 3 ] 175216 20.453% 83.181% #### ( 3, 4 ] 59861 6.988% 90.169% # ( 4, 6 ] 57231 6.681% 96.849% # ( 6, 10 ] 13843 1.616% 98.465% ( 10, 15 ] 2678 0.313% 98.778% ( 15, 22 ] 265 0.031% 98.809% ( 22, 34 ] 32 0.004% 98.813% ( 34, 51 ] 14 0.002% 98.814% ( 51, 76 ] 17 0.002% 98.816% ( 76, 110 ] 185 0.022% 98.838% ( 110, 170 ] 1565 0.183% 99.021% ( 170, 250 ] 1455 0.170% 99.190% ( 250, 380 ] 1047 0.122% 99.313% ( 380, 580 ] 1188 0.139% 99.451% ( 580, 870 ] 1312 0.153% 99.604% ( 870, 1300 ] 1337 0.156% 99.760% ( 1300, 1900 ] 875 0.102% 99.863% ( 1900, 2900 ] 610 0.071% 99.934% ( 2900, 4400 ] 519 0.061% 99.994% ( 4400, 6600 ] 178 0.021% 100.015% ( 6600, 9900 ] 24 0.003% 100.018% ( 9900, 14000 ] 1 0.000% 100.018% ( 14000, 22000 ] 2 0.000% 100.018% ( 22000, 33000 ] 1 0.000% 100.018% ( 33000, 50000 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 148202 Average: 13.3652 StdDev: 170.64 Min: 1 Median: 2.2592 Max: 14963 Percentiles: P50: 2.26 P75: 3.19 P99: 150.51 P99.9: 2706.72 P99.99: 7217.26 ------------------------------------------------------ [ 0, 1 ] 1610 1.086% 1.086% ( 1, 2 ] 60589 40.883% 41.969% ######## ( 2, 3 ] 45915 30.981% 72.950% ###### ( 3, 4 ] 15816 10.672% 83.622% ## ( 4, 6 ] 16022 10.811% 94.433% ## ( 6, 10 ] 5242 3.537% 97.970% # ( 10, 15 ] 987 0.666% 98.636% ( 15, 22 ] 138 0.093% 98.729% ( 22, 34 ] 14 0.009% 98.739% ( 34, 51 ] 12 0.008% 98.747% ( 51, 76 ] 16 0.011% 98.758% ( 76, 110 ] 70 0.047% 98.805% ( 110, 170 ] 428 0.289% 99.094% ( 170, 250 ] 326 0.220% 99.314% ( 250, 380 ] 211 0.142% 99.456% ( 380, 580 ] 211 0.142% 99.599% ( 580, 870 ] 147 0.099% 99.698% ( 870, 1300 ] 138 0.093% 99.791% ( 1300, 1900 ] 90 0.061% 99.852% ( 1900, 2900 ] 89 0.060% 99.912% ( 2900, 4400 ] 73 0.049% 99.961% ( 4400, 6600 ] 40 0.027% 99.988% ( 6600, 9900 ] 17 0.011% 99.999% ( 14000, 22000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 493953 Average: 18.9890 StdDev: 232.77 Min: 1 Median: 2.1573 Max: 31381 Percentiles: P50: 2.16 P75: 3.08 P99: 13.48 P99.9: 2523.45 P99.99: 3290.06 ------------------------------------------------------ [ 0, 1 ] 7409 1.500% 1.500% ( 1, 2 ] 217331 43.998% 45.498% ######### ( 2, 3 ] 141386 28.623% 74.122% ###### ( 3, 4 ] 51150 10.355% 84.477% ## ( 4, 6 ] 53071 10.744% 95.221% ## ( 6, 10 ] 15946 3.228% 98.449% # ( 10, 15 ] 3911 0.792% 99.241% ( 15, 22 ] 557 0.113% 99.354% ( 22, 34 ] 54 0.011% 99.365% ( 34, 51 ] 21 0.004% 99.369% ( 51, 76 ] 21 0.004% 99.373% ( 76, 110 ] 11 0.002% 99.375% ( 110, 170 ] 15 0.003% 99.378% ( 170, 250 ] 48 0.010% 99.388% ( 250, 380 ] 89 0.018% 99.406% ( 380, 580 ] 224 0.045% 99.452% ( 580, 870 ] 390 0.079% 99.531% ( 870, 1300 ] 601 0.122% 99.652% ( 1300, 1900 ] 739 0.150% 99.802% ( 1900, 2900 ] 778 0.158% 99.959% ( 2900, 4400 ] 583 0.118% 100.077% ( 4400, 6600 ] 235 0.048% 100.125% ( 6600, 9900 ] 51 0.010% 100.135% ( 9900, 14000 ] 1 0.000% 100.135% ( 14000, 22000 ] 2 0.000% 100.136% ( 22000, 33000 ] 3 0.001% 100.136% ** Level 3 read latency histogram (micros): Count: 1294072 Average: 11.2196 StdDev: 153.72 Min: 0 Median: 2.1125 Max: 31536 Percentiles: P50: 2.11 P75: 2.99 P99: 9.99 P99.9: 1261.34 P99.99: 1861.55 ------------------------------------------------------ [ 0, 1 ] 16626 1.285% 1.285% ( 1, 2 ] 588936 45.510% 46.795% ######### ( 2, 3 ] 368700 28.491% 75.287% ###### ( 3, 4 ] 135657 10.483% 85.769% ## ( 4, 6 ] 135626 10.481% 96.250% ## ( 6, 10 ] 35686 2.758% 99.008% # ( 10, 15 ] 7020 0.542% 99.550% ( 15, 22 ] 828 0.064% 99.614% ( 22, 34 ] 56 0.004% 99.618% ( 34, 51 ] 61 0.005% 99.623% ( 51, 76 ] 68 0.005% 99.628% ( 76, 110 ] 74 0.006% 99.634% ( 110, 170 ] 310 0.024% 99.658% ( 170, 250 ] 303 0.023% 99.682% ( 250, 380 ] 265 0.020% 99.702% ( 380, 580 ] 547 0.042% 99.744% ( 580, 870 ] 931 0.072% 99.816% ( 870, 1300 ] 1191 0.092% 99.908% ( 1300, 1900 ] 1130 0.087% 99.996% ( 1900, 2900 ] 920 0.071% 100.067% ( 2900, 4400 ] 710 0.055% 100.122% ( 4400, 6600 ] 282 0.022% 100.143% ( 6600, 9900 ] 27 0.002% 100.145% ( 14000, 22000 ] 1 0.000% 100.146% ( 22000, 33000 ] 3 0.000% 100.146% ** Level 4 read latency histogram (micros): Count: 1052362 Average: 21.1768 StdDev: 223.45 Min: 1 Median: 2.0709 Max: 44330 Percentiles: P50: 2.07 P75: 2.98 P99: 294.56 P99.9: 2211.38 P99.99: 2896.21 ------------------------------------------------------ [ 0, 1 ] 14545 1.382% 1.382% ( 1, 2 ] 491174 46.673% 48.056% ######### ( 2, 3 ] 288772 27.440% 75.496% ##### ( 3, 4 ] 106632 10.133% 85.629% ## ( 4, 6 ] 99496 9.455% 95.083% ## ( 6, 10 ] 29234 2.778% 97.861% # ( 10, 15 ] 5173 0.492% 98.353% ( 15, 22 ] 613 0.058% 98.411% ( 22, 34 ] 37 0.004% 98.414% ( 34, 51 ] 63 0.006% 98.420% ( 51, 76 ] 55 0.005% 98.426% ( 76, 110 ] 462 0.044% 98.470% ( 110, 170 ] 2945 0.280% 98.749% ( 170, 250 ] 2150 0.204% 98.954% ( 250, 380 ] 1422 0.135% 99.089% ( 380, 580 ] 1801 0.171% 99.260% ( 580, 870 ] 2150 0.204% 99.464% ( 870, 1300 ] 2393 0.227% 99.692% ( 1300, 1900 ] 1762 0.167% 99.859% ( 1900, 2900 ] 1383 0.131% 99.990% ( 2900, 4400 ] 1080 0.103% 100.093% ( 4400, 6600 ] 449 0.043% 100.136% ( 6600, 9900 ] 75 0.007% 100.143% ( 9900, 14000 ] 3 0.000% 100.143% ( 14000, 22000 ] 3 0.000% 100.143% ( 22000, 33000 ] 4 0.000% 100.144% ( 33000, 50000 ] 1 0.000% 100.144% ** Level 5 read latency histogram (micros): Count: 70060 Average: 706.6074 StdDev: 1161.01 Min: 80 Median: 253.8287 Max: 53739 Percentiles: P50: 253.83 P75: 719.40 P99: 5990.49 P99.9: 9544.97 P99.99: 15988.00 ------------------------------------------------------ ( 76, 110 ] 2885 4.118% 4.118% # ( 110, 170 ] 18405 26.270% 30.388% ##### ( 170, 250 ] 13524 19.303% 49.692% #### ( 250, 380 ] 7334 10.468% 60.160% ## ( 380, 580 ] 7522 10.737% 70.896% ## ( 580, 870 ] 5981 8.537% 79.433% ## ( 870, 1300 ] 4812 6.868% 86.302% # ( 1300, 1900 ] 3199 4.566% 90.868% # ( 1900, 2900 ] 2495 3.561% 94.429% # ( 2900, 4400 ] 2251 3.213% 97.642% # ( 4400, 6600 ] 1316 1.878% 99.520% ( 6600, 9900 ] 298 0.425% 99.946% ( 9900, 14000 ] 30 0.043% 99.989% ( 14000, 22000 ] 4 0.006% 99.994% ( 22000, 33000 ] 2 0.003% 99.997% ( 33000, 50000 ] 2 0.003% 100.000% ( 50000, 75000 ] 1 0.001% 100.001% ** DB Stats ** Uptime(secs): 17.8 total, 3.4 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 165.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.724 H:M:S, 37.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 286.92 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/19-21:04:27 ... thread 0: (1000000,4000000) ops and (296438.9,190022.1) ops/second in (3.373377,21.050183) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/4 3.75 GB 358.7 3.3 0.0 3.3 7.1 3.7 0.0 1.9 96.5 205.4 35.24 23.95 67 0.526 3454K 3766 0.0 0.0 L1 10/0 869.36 MB 86.9 1.2 0.7 0.4 1.1 0.7 0.0 1.6 90.3 89.9 13.05 5.69 1 13.054 1197K 5411 0.0 0.0 L2 1/0 43.50 MB 0.4 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 986.33 MB 1.0 3.4 2.4 1.0 3.3 2.3 0.4 1.4 98.3 97.2 34.90 16.57 19 1.837 1049K 0 0.0 0.0 L4 178/0 9.43 GB 1.0 8.6 4.6 4.0 8.4 4.4 0.3 1.8 121.8 119.7 72.07 40.38 49 1.471 4124K 5103 0.0 0.0 L5 1156/0 95.29 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1377/4 110.32 GB 0.0 16.4 7.7 8.7 20.0 11.2 5.7 5.3 108.1 131.6 155.26 86.58 136 1.142 9825K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.4 7.7 8.7 20.0 11.2 5.7 5.3 108.1 131.6 155.26 86.58 136 1.142 9825K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.4 7.7 8.7 16.2 7.5 0.0 0.0 123.4 121.9 136.06 75.87 81 1.680 9825K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 200.1 19.20 10.72 55 0.349 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.2 total, 21.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.95 GB write, 962.75 MB/s write, 16.40 GB read, 791.21 MB/s read, 155.3 seconds Interval compaction: 19.95 GB write, 970.58 MB/s write, 16.40 GB read, 797.64 MB/s read, 155.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 51, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 51, interval: 65 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1116970 Average: 11.7980 StdDev: 145.57 Min: 1 Median: 1.6786 Max: 35713 Percentiles: P50: 1.68 P75: 2.40 P99: 151.43 P99.9: 1895.92 P99.99: 4000.10 ------------------------------------------------------ [ 0, 1 ] 134733 12.062% 12.062% ## ( 1, 2 ] 624447 55.905% 67.968% ########### ( 2, 3 ] 198530 17.774% 85.742% #### ( 3, 4 ] 66107 5.918% 91.660% # ( 4, 6 ] 61494 5.505% 97.166% # ( 6, 10 ] 14648 1.311% 98.477% ( 10, 15 ] 2988 0.268% 98.745% ( 15, 22 ] 308 0.028% 98.772% ( 22, 34 ] 39 0.003% 98.776% ( 34, 51 ] 15 0.001% 98.777% ( 51, 76 ] 18 0.002% 98.779% ( 76, 110 ] 392 0.035% 98.814% ( 110, 170 ] 3014 0.270% 99.084% ( 170, 250 ] 2583 0.231% 99.315% ( 250, 380 ] 1466 0.131% 99.446% ( 380, 580 ] 1445 0.129% 99.575% ( 580, 870 ] 1404 0.126% 99.701% ( 870, 1300 ] 1351 0.121% 99.822% ( 1300, 1900 ] 877 0.079% 99.901% ( 1900, 2900 ] 615 0.055% 99.956% ( 2900, 4400 ] 524 0.047% 100.003% ( 4400, 6600 ] 178 0.016% 100.018% ( 6600, 9900 ] 24 0.002% 100.021% ( 9900, 14000 ] 1 0.000% 100.021% ( 14000, 22000 ] 2 0.000% 100.021% ( 22000, 33000 ] 1 0.000% 100.021% ( 33000, 50000 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 149127 Average: 14.5589 StdDev: 171.05 Min: 1 Median: 2.2693 Max: 14963 Percentiles: P50: 2.27 P75: 3.24 P99: 208.91 P99.9: 2696.33 P99.99: 7199.30 ------------------------------------------------------ [ 0, 1 ] 1610 1.080% 1.080% ( 1, 2 ] 60589 40.629% 41.709% ######## ( 2, 3 ] 45916 30.790% 72.499% ###### ( 3, 4 ] 15817 10.606% 83.105% ## ( 4, 6 ] 16023 10.745% 93.850% ## ( 6, 10 ] 5242 3.515% 97.365% # ( 10, 15 ] 987 0.662% 98.027% ( 15, 22 ] 138 0.093% 98.119% ( 22, 34 ] 14 0.009% 98.128% ( 34, 51 ] 12 0.008% 98.136% ( 51, 76 ] 16 0.011% 98.147% ( 76, 110 ] 150 0.101% 98.248% ( 110, 170 ] 845 0.567% 98.814% ( 170, 250 ] 569 0.382% 99.196% ( 250, 380 ] 304 0.204% 99.400% ( 380, 580 ] 281 0.188% 99.588% ( 580, 870 ] 164 0.110% 99.698% ( 870, 1300 ] 140 0.094% 99.792% ( 1300, 1900 ] 90 0.060% 99.852% ( 1900, 2900 ] 89 0.060% 99.912% ( 2900, 4400 ] 73 0.049% 99.961% ( 4400, 6600 ] 40 0.027% 99.988% ( 6600, 9900 ] 17 0.011% 99.999% ( 14000, 22000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 493953 Average: 18.9890 StdDev: 232.77 Min: 1 Median: 2.1573 Max: 31381 Percentiles: P50: 2.16 P75: 3.08 P99: 13.48 P99.9: 2523.45 P99.99: 3290.06 ------------------------------------------------------ [ 0, 1 ] 7409 1.500% 1.500% ( 1, 2 ] 217331 43.998% 45.498% ######### ( 2, 3 ] 141386 28.623% 74.122% ###### ( 3, 4 ] 51150 10.355% 84.477% ## ( 4, 6 ] 53071 10.744% 95.221% ## ( 6, 10 ] 15946 3.228% 98.449% # ( 10, 15 ] 3911 0.792% 99.241% ( 15, 22 ] 557 0.113% 99.354% ( 22, 34 ] 54 0.011% 99.365% ( 34, 51 ] 21 0.004% 99.369% ( 51, 76 ] 21 0.004% 99.373% ( 76, 110 ] 11 0.002% 99.375% ( 110, 170 ] 15 0.003% 99.378% ( 170, 250 ] 48 0.010% 99.388% ( 250, 380 ] 89 0.018% 99.406% ( 380, 580 ] 224 0.045% 99.452% ( 580, 870 ] 390 0.079% 99.531% ( 870, 1300 ] 601 0.122% 99.652% ( 1300, 1900 ] 739 0.150% 99.802% ( 1900, 2900 ] 778 0.158% 99.959% ( 2900, 4400 ] 583 0.118% 100.077% ( 4400, 6600 ] 235 0.048% 100.125% ( 6600, 9900 ] 51 0.010% 100.135% ( 9900, 14000 ] 1 0.000% 100.135% ( 14000, 22000 ] 2 0.000% 100.136% ( 22000, 33000 ] 3 0.001% 100.136% ** Level 3 read latency histogram (micros): Count: 1294786 Average: 11.2991 StdDev: 153.74 Min: 0 Median: 2.1134 Max: 31536 Percentiles: P50: 2.11 P75: 2.99 P99: 10.33 P99.9: 1261.12 P99.99: 1861.52 ------------------------------------------------------ [ 0, 1 ] 16626 1.284% 1.284% ( 1, 2 ] 588950 45.486% 46.770% ######### ( 2, 3 ] 368755 28.480% 75.250% ###### ( 3, 4 ] 135682 10.479% 85.729% ## ( 4, 6 ] 135669 10.478% 96.208% ## ( 6, 10 ] 35692 2.757% 98.964% # ( 10, 15 ] 7023 0.542% 99.507% ( 15, 22 ] 828 0.064% 99.571% ( 22, 34 ] 56 0.004% 99.575% ( 34, 51 ] 61 0.005% 99.580% ( 51, 76 ] 68 0.005% 99.585% ( 76, 110 ] 124 0.010% 99.594% ( 110, 170 ] 591 0.046% 99.640% ( 170, 250 ] 450 0.035% 99.675% ( 250, 380 ] 310 0.024% 99.699% ( 380, 580 ] 580 0.045% 99.744% ( 580, 870 ] 942 0.073% 99.816% ( 870, 1300 ] 1192 0.092% 99.908% ( 1300, 1900 ] 1130 0.087% 99.996% ( 1900, 2900 ] 920 0.071% 100.067% ( 2900, 4400 ] 710 0.055% 100.121% ( 4400, 6600 ] 282 0.022% 100.143% ( 6600, 9900 ] 27 0.002% 100.145% ( 14000, 22000 ] 1 0.000% 100.145% ( 22000, 33000 ] 3 0.000% 100.146% ** Level 4 read latency histogram (micros): Count: 1059674 Average: 22.3802 StdDev: 223.54 Min: 1 Median: 2.0834 Max: 44330 Percentiles: P50: 2.08 P75: 3.00 P99: 357.69 P99.9: 2211.30 P99.99: 2896.43 ------------------------------------------------------ [ 0, 1 ] 14545 1.373% 1.373% ( 1, 2 ] 491203 46.354% 47.727% ######### ( 2, 3 ] 288947 27.268% 74.994% ##### ( 3, 4 ] 106749 10.074% 85.068% ## ( 4, 6 ] 99612 9.400% 94.468% ## ( 6, 10 ] 29255 2.761% 97.229% # ( 10, 15 ] 5180 0.489% 97.718% ( 15, 22 ] 614 0.058% 97.776% ( 22, 34 ] 37 0.003% 97.779% ( 34, 51 ] 63 0.006% 97.785% ( 51, 76 ] 55 0.005% 97.790% ( 76, 110 ] 1006 0.095% 97.885% ( 110, 170 ] 6237 0.589% 98.474% ( 170, 250 ] 3915 0.369% 98.843% ( 250, 380 ] 2003 0.189% 99.032% ( 380, 580 ] 2273 0.214% 99.247% ( 580, 870 ] 2305 0.218% 99.464% ( 870, 1300 ] 2417 0.228% 99.693% ( 1300, 1900 ] 1765 0.167% 99.859% ( 1900, 2900 ] 1392 0.131% 99.990% ( 2900, 4400 ] 1081 0.102% 100.092% ( 4400, 6600 ] 449 0.042% 100.135% ( 6600, 9900 ] 75 0.007% 100.142% ( 9900, 14000 ] 3 0.000% 100.142% ( 14000, 22000 ] 3 0.000% 100.142% ( 22000, 33000 ] 4 0.000% 100.143% ( 33000, 50000 ] 1 0.000% 100.143% ** Level 5 read latency histogram (micros): Count: 111847 Average: 519.6834 StdDev: 954.32 Min: 80 Median: 207.0645 Max: 53739 Percentiles: P50: 207.06 P75: 454.97 P99: 5291.92 P99.9: 9082.23 P99.99: 13564.76 ------------------------------------------------------ ( 76, 110 ] 6290 5.624% 5.624% # ( 110, 170 ] 38276 34.222% 39.846% ####### ( 170, 250 ] 24514 21.917% 61.763% #### ( 250, 380 ] 10923 9.766% 71.529% ## ( 380, 580 ] 10357 9.260% 80.789% ## ( 580, 870 ] 6913 6.181% 86.970% # ( 870, 1300 ] 4922 4.401% 91.370% # ( 1300, 1900 ] 3226 2.884% 94.255% # ( 1900, 2900 ] 2518 2.251% 96.506% ( 2900, 4400 ] 2256 2.017% 98.523% ( 4400, 6600 ] 1316 1.177% 99.700% ( 6600, 9900 ] 298 0.266% 99.966% ( 9900, 14000 ] 30 0.027% 99.993% ( 14000, 22000 ] 4 0.004% 99.996% ( 22000, 33000 ] 2 0.002% 99.998% ( 33000, 50000 ] 2 0.002% 100.000% ( 50000, 75000 ] 1 0.001% 100.001% ** DB Stats ** Uptime(secs): 21.2 total, 3.4 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 185.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.724 H:M:S, 31.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 291.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 265.456 micros/op 15052 ops/sec 60.189 seconds 905996 operations; 14.6 MB/s (229999 of 229999 found) Microseconds per read: Count: 905996 Average: 265.4589 StdDev: 937.89 Min: 2 Median: 195.8773 Max: 120921 Percentiles: P50: 195.88 P75: 238.20 P99: 1297.24 P99.9: 15931.09 P99.99: 37285.02 ------------------------------------------------------ ( 1, 2 ] 9 0.001% 0.001% ( 2, 3 ] 34 0.004% 0.005% ( 3, 4 ] 48 0.005% 0.010% ( 4, 6 ] 74 0.008% 0.018% ( 6, 10 ] 423 0.047% 0.065% ( 10, 15 ] 4104 0.453% 0.518% ( 15, 22 ] 4641 0.512% 1.030% ( 22, 34 ] 9634 1.063% 2.093% ( 34, 51 ] 3710 0.409% 2.503% ( 51, 76 ] 501 0.055% 2.558% ( 76, 110 ] 3496 0.386% 2.944% ( 110, 170 ] 287838 31.770% 34.715% ###### ( 170, 250 ] 428131 47.255% 81.970% ######### ( 250, 380 ] 94078 10.384% 92.354% ## ( 380, 580 ] 40734 4.496% 96.850% # ( 580, 870 ] 13444 1.484% 98.334% ( 870, 1300 ] 6076 0.671% 99.004% ( 1300, 1900 ] 3276 0.362% 99.366% ( 1900, 2900 ] 2187 0.241% 99.607% ( 2900, 4400 ] 1519 0.168% 99.775% ( 4400, 6600 ] 634 0.070% 99.845% ( 6600, 9900 ] 145 0.016% 99.861% ( 9900, 14000 ] 207 0.023% 99.884% ( 14000, 22000 ] 609 0.067% 99.951% ( 22000, 33000 ] 335 0.037% 99.988% ( 33000, 50000 ] 73 0.008% 99.996% ( 50000, 75000 ] 28 0.003% 99.999% ( 75000, 110000 ] 6 0.001% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 17825853 rocksdb.bloom.filter.full.positive COUNT : 1080028 rocksdb.bloom.filter.full.true.positive COUNT : 905587 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 409 rocksdb.memtable.miss COUNT : 905587 rocksdb.l0.hit COUNT : 37472 rocksdb.l1.hit COUNT : 7556 rocksdb.l2andup.hit COUNT : 860559 rocksdb.compaction.key.drop.new COUNT : 232984 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4573522 rocksdb.number.keys.read COUNT : 905996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4719874704 rocksdb.bytes.read COUNT : 905996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1662 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 42945880 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 19879214138 rocksdb.compact.write.bytes COUNT : 19640155614 rocksdb.flush.write.bytes COUNT : 4690196445 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 29 rocksdb.number.superversion_acquires COUNT : 963 rocksdb.number.superversion_releases COUNT : 940 rocksdb.number.superversion_cleanups COUNT : 243 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 280 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4652289024 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1727488 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 24099797696 rocksdb.non.last.level.read.count COUNT : 5678213 rocksdb.block.checksum.compute.count COUNT : 5908413 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 194.880657 P95 : 496.467352 P99 : 1296.245210 P100 : 120915.000000 COUNT : 905996 SUM : 239740141 rocksdb.db.write.micros P50 : 1.545951 P95 : 4.534732 P99 : 9.963680 P100 : 857509.000000 COUNT : 4573522 SUM : 54481498 rocksdb.compaction.times.micros P50 : 1497500.000000 P95 : 2825000.000000 P99 : 10472000.000000 P100 : 13054030.000000 COUNT : 84 SUM : 139020477 rocksdb.compaction.times.cpu_micros P50 : 807948.717949 P95 : 1840000.000000 P99 : 4652000.000000 P100 : 5686441.000000 COUNT : 84 SUM : 78733286 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 855.000000 P95 : 40437.500000 P99 : 85816.000000 P100 : 85816.000000 COUNT : 65 SUM : 418234 rocksdb.compaction.outfile.sync.micros P50 : 27500.000000 P95 : 163125.000000 P99 : 365700.000000 P100 : 732658.000000 COUNT : 255 SUM : 13385689 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 396.666667 P95 : 5137.000000 P99 : 7491.000000 P100 : 10553.000000 COUNT : 173 SUM : 213180 rocksdb.table.open.io.micros P50 : 12161.158798 P95 : 23454.444444 P99 : 31579.777778 P100 : 92798.000000 COUNT : 1662 SUM : 19963235 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.323713 P95 : 12.939125 P99 : 214.523888 P100 : 55988.000000 COUNT : 4814896 SUM : 91317433 rocksdb.read.block.get.micros P50 : 149.106824 P95 : 333.692166 P99 : 1273.910844 P100 : 54006.000000 COUNT : 1091839 SUM : 203026297 rocksdb.write.raw.block.micros P50 : 0.537794 P95 : 1.406922 P99 : 3.763359 P100 : 19963.000000 COUNT : 5893319 SUM : 19407277 rocksdb.numfiles.in.singlecompaction P50 : 3.000000 P95 : 5.433333 P99 : 9.680000 P100 : 27.000000 COUNT : 108 SUM : 382 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.576488 P95 : 2144.375963 P99 : 2753.737374 P100 : 857329.000000 COUNT : 177964 SUM : 42962050 rocksdb.sst.read.micros P50 : 2.432724 P95 : 195.075645 P99 : 493.815199 P100 : 53739.000000 COUNT : 5678234 SUM : 279223341 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 905996 SUM : 905996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4573522 SUM : 4719874704 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 224166.666667 P95 : 979000.000000 P99 : 1094778.000000 P100 : 1094778.000000 COUNT : 65 SUM : 21191012 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 284 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0