[2024-11-18 15:16:46.353287] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... [2024-11-18 15:16:46.353401] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid706930 ] Set seed to 1731939406350815 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-18 15:16:46.441488] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-18 15:16:46.480942] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-18 15:16:46.480997] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 706930' to capture a snapshot of events at runtime. [2024-11-18 15:16:46.481009] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid706930 for offline analysis/debug. [2024-11-18 15:16:46.481034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Nov 18 15:16:50 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/18-15:16:58 ... thread 0: (1000000,1000000) ops and (132596.1,132596.1) ops/second in (7.541698,7.541698) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/3 566.87 MB 31.5 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 121.6 6.73 2.42 9 0.748 0 0 0.0 0.0 L1 4/4 229.55 MB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 1.3 128.0 127.9 2.98 1.67 2 1.491 387K 289 0.0 0.0 L2 4/1 381.20 MB 2.6 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 48/8 4.04 GB 3.3 2.7 1.9 0.8 2.7 1.9 0.0 1.4 99.7 98.4 27.60 12.80 17 1.624 1926K 1297 0.0 0.0 L4 192/12 11.84 GB 1.2 3.2 2.3 0.8 3.1 2.3 0.0 1.3 107.6 106.4 30.23 15.21 20 1.511 1411K 22 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1350/28 107.15 GB 0.0 6.2 4.5 1.7 7.0 5.3 0.1 8.7 94.5 105.6 67.54 32.09 48 1.407 3724K 1608 0.0 0.0 Int 0/0 0.00 KB 0.0 6.2 4.5 1.7 7.0 5.3 0.1 8.7 94.5 105.6 67.54 32.09 48 1.407 3724K 1608 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.2 4.5 1.7 6.2 4.5 0.0 0.0 105.0 103.8 60.81 29.67 39 1.559 3724K 1608 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 121.6 6.73 2.42 9 0.748 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.7 total, 7.5 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.97 GB write, 929.23 MB/s write, 6.24 GB read, 832.01 MB/s read, 67.5 seconds Interval compaction: 6.97 GB write, 945.53 MB/s write, 6.24 GB read, 846.61 MB/s read, 67.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 34, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 116404 Average: 8.1337 StdDev: 140.84 Min: 1 Median: 1.7995 Max: 28241 Percentiles: P50: 1.80 P75: 2.82 P99: 9.46 P99.9: 1634.80 P99.99: 4871.92 ------------------------------------------------------ [ 0, 1 ] 7620 6.546% 6.546% # ( 1, 2 ] 63265 54.350% 60.896% ########### ( 2, 3 ] 19945 17.134% 78.030% ### ( 3, 4 ] 11080 9.519% 87.549% ## ( 4, 6 ] 11562 9.933% 97.481% ## ( 6, 10 ] 2046 1.758% 99.239% ( 10, 15 ] 406 0.349% 99.588% ( 15, 22 ] 38 0.033% 99.620% ( 22, 34 ] 6 0.005% 99.625% ( 34, 51 ] 2 0.002% 99.627% ( 51, 76 ] 2 0.002% 99.629% ( 110, 170 ] 4 0.003% 99.632% ( 170, 250 ] 16 0.014% 99.646% ( 250, 380 ] 28 0.024% 99.670% ( 380, 580 ] 53 0.046% 99.716% ( 580, 870 ] 92 0.079% 99.795% ( 870, 1300 ] 88 0.076% 99.870% ( 1300, 1900 ] 62 0.053% 99.924% ( 1900, 2900 ] 31 0.027% 99.950% ( 2900, 4400 ] 44 0.038% 99.988% ( 4400, 6600 ] 11 0.009% 99.997% ( 6600, 9900 ] 1 0.001% 99.998% ( 9900, 14000 ] 1 0.001% 99.999% ( 22000, 33000 ] 1 0.001% 100.000% ** Level 1 read latency histogram (micros): Count: 59682 Average: 6.3403 StdDev: 81.68 Min: 1 Median: 1.8070 Max: 6019 Percentiles: P50: 1.81 P75: 2.84 P99: 9.14 P99.9: 1205.38 P99.99: 3905.30 ------------------------------------------------------ [ 0, 1 ] 3531 5.916% 5.916% # ( 1, 2 ] 32601 54.625% 60.541% ########### ( 2, 3 ] 10266 17.201% 77.742% ### ( 3, 4 ] 5724 9.591% 87.333% ## ( 4, 6 ] 6173 10.343% 97.676% ## ( 6, 10 ] 1008 1.689% 99.365% ( 10, 15 ] 170 0.285% 99.650% ( 15, 22 ] 18 0.030% 99.680% ( 22, 34 ] 2 0.003% 99.683% ( 51, 76 ] 2 0.003% 99.687% ( 76, 110 ] 1 0.002% 99.688% ( 110, 170 ] 2 0.003% 99.692% ( 170, 250 ] 10 0.017% 99.708% ( 250, 380 ] 7 0.012% 99.720% ( 380, 580 ] 24 0.040% 99.760% ( 580, 870 ] 49 0.082% 99.842% ( 870, 1300 ] 44 0.074% 99.916% ( 1300, 1900 ] 23 0.039% 99.955% ( 1900, 2900 ] 15 0.025% 99.980% ( 2900, 4400 ] 9 0.015% 99.995% ( 4400, 6600 ] 3 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 465395 Average: 13.5282 StdDev: 171.65 Min: 1 Median: 1.8858 Max: 21735 Percentiles: P50: 1.89 P75: 3.01 P99: 12.61 P99.9: 1398.04 P99.99: 2043.26 ------------------------------------------------------ [ 0, 1 ] 28782 6.184% 6.184% # ( 1, 2 ] 230205 49.464% 55.649% ########## ( 2, 3 ] 89785 19.292% 74.941% #### ( 3, 4 ] 46991 10.097% 85.038% ## ( 4, 6 ] 49801 10.701% 95.739% ## ( 6, 10 ] 13400 2.879% 98.618% # ( 10, 15 ] 3409 0.732% 99.351% ( 15, 22 ] 495 0.106% 99.457% ( 22, 34 ] 101 0.022% 99.479% ( 34, 51 ] 49 0.011% 99.489% ( 51, 76 ] 43 0.009% 99.498% ( 76, 110 ] 19 0.004% 99.503% ( 110, 170 ] 66 0.014% 99.517% ( 170, 250 ] 109 0.023% 99.540% ( 250, 380 ] 213 0.046% 99.586% ( 380, 580 ] 378 0.081% 99.667% ( 580, 870 ] 504 0.108% 99.775% ( 870, 1300 ] 510 0.110% 99.885% ( 1300, 1900 ] 426 0.092% 99.977% ( 1900, 2900 ] 436 0.094% 100.070% ( 2900, 4400 ] 393 0.084% 100.155% ( 4400, 6600 ] 101 0.022% 100.176% ( 6600, 9900 ] 11 0.002% 100.179% ( 9900, 14000 ] 2 0.000% 100.179% ( 14000, 22000 ] 2 0.000% 100.180% ** Level 3 read latency histogram (micros): Count: 906625 Average: 12.8422 StdDev: 182.73 Min: 1 Median: 1.8767 Max: 31340 Percentiles: P50: 1.88 P75: 2.96 P99: 10.14 P99.9: 1035.87 P99.99: 1471.47 ------------------------------------------------------ [ 0, 1 ] 38644 4.262% 4.262% # ( 1, 2 ] 472963 52.167% 56.430% ########## ( 2, 3 ] 176174 19.432% 75.862% #### ( 3, 4 ] 90993 10.036% 85.898% ## ( 4, 6 ] 96565 10.651% 96.549% ## ( 6, 10 ] 22072 2.435% 98.984% ( 10, 15 ] 5261 0.580% 99.564% ( 15, 22 ] 664 0.073% 99.637% ( 22, 34 ] 63 0.007% 99.644% ( 34, 51 ] 36 0.004% 99.648% ( 51, 76 ] 47 0.005% 99.653% ( 76, 110 ] 8 0.001% 99.654% ( 110, 170 ] 49 0.005% 99.660% ( 170, 250 ] 125 0.014% 99.673% ( 250, 380 ] 255 0.028% 99.702% ( 380, 580 ] 547 0.060% 99.762% ( 580, 870 ] 863 0.095% 99.857% ( 870, 1300 ] 1012 0.112% 99.969% ( 1300, 1900 ] 680 0.075% 100.044% ( 1900, 2900 ] 687 0.076% 100.119% ( 2900, 4400 ] 748 0.083% 100.202% ( 4400, 6600 ] 211 0.023% 100.225% ( 6600, 9900 ] 27 0.003% 100.228% ( 9900, 14000 ] 9 0.001% 100.229% ( 14000, 22000 ] 7 0.001% 100.230% ( 22000, 33000 ] 4 0.000% 100.230% ** Level 4 read latency histogram (micros): Count: 298621 Average: 23.6555 StdDev: 232.45 Min: 1 Median: 1.8703 Max: 19620 Percentiles: P50: 1.87 P75: 2.97 P99: 658.42 P99.9: 2905.52 P99.99: 3980.55 ------------------------------------------------------ [ 0, 1 ] 12749 4.269% 4.269% # ( 1, 2 ] 156913 52.546% 56.815% ########### ( 2, 3 ] 55773 18.677% 75.492% #### ( 3, 4 ] 29934 10.024% 85.516% ## ( 4, 6 ] 30242 10.127% 95.643% ## ( 6, 10 ] 7025 2.352% 97.996% ( 10, 15 ] 1449 0.485% 98.481% ( 15, 22 ] 155 0.052% 98.533% ( 22, 34 ] 23 0.008% 98.541% ( 34, 51 ] 13 0.004% 98.545% ( 51, 76 ] 23 0.008% 98.553% ( 76, 110 ] 19 0.006% 98.559% ( 110, 170 ] 52 0.017% 98.576% ( 170, 250 ] 139 0.047% 98.623% ( 250, 380 ] 295 0.099% 98.722% ( 380, 580 ] 583 0.195% 98.917% ( 580, 870 ] 920 0.308% 99.225% ( 870, 1300 ] 969 0.324% 99.550% ( 1300, 1900 ] 636 0.213% 99.763% ( 1900, 2900 ] 410 0.137% 99.900% ( 2900, 4400 ] 375 0.126% 100.025% ( 4400, 6600 ] 117 0.039% 100.065% ( 6600, 9900 ] 15 0.005% 100.070% ( 9900, 14000 ] 1 0.000% 100.070% ( 14000, 22000 ] 6 0.002% 100.072% ** Level 5 read latency histogram (micros): Count: 13574 Average: 1600.2268 StdDev: 1633.98 Min: 83 Median: 1083.1863 Max: 37398 Percentiles: P50: 1083.19 P75: 2124.50 P99: 6555.47 P99.9: 14852.00 P99.99: 37398.00 ------------------------------------------------------ ( 76, 110 ] 20 0.147% 0.147% ( 110, 170 ] 128 0.943% 1.090% ( 170, 250 ] 330 2.431% 3.521% ( 250, 380 ] 777 5.724% 9.246% # ( 380, 580 ] 1708 12.583% 21.828% ### ( 580, 870 ] 2531 18.646% 40.474% #### ( 870, 1300 ] 2608 19.213% 59.688% #### ( 1300, 1900 ] 1744 12.848% 72.536% ### ( 1900, 2900 ] 1490 10.977% 83.513% ## ( 2900, 4400 ] 1534 11.301% 94.814% ## ( 4400, 6600 ] 580 4.273% 99.086% # ( 6600, 9900 ] 99 0.729% 99.816% ( 9900, 14000 ] 11 0.081% 99.897% ( 14000, 22000 ] 4 0.029% 99.926% ( 22000, 33000 ] 6 0.044% 99.971% ( 33000, 50000 ] 4 0.029% 100.000% ** DB Stats ** Uptime(secs): 7.7 total, 7.5 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 128.22 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.574 H:M:S, 46.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 130.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.574 H:M:S, 47.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/18-15:17:06 ... thread 0: (1000000,2000000) ops and (127728.5,130116.8) ops/second in (7.829105,15.370803) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 1.35 GB 31.5 0.7 0.0 0.7 2.5 1.8 0.0 1.4 36.3 135.2 19.10 8.76 23 0.830 703K 873 0.0 0.0 L1 2/2 167.12 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.0 1.6 114.1 113.9 7.57 4.13 3 2.522 876K 1088 0.0 0.0 L2 2/1 142.69 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 33/20 2.01 GB 0.9 3.8 2.2 1.6 3.8 2.2 0.2 1.7 107.6 106.3 36.14 18.05 20 1.807 2293K 1297 0.0 0.0 L4 176/11 10.05 GB 1.0 8.6 4.9 3.7 8.5 4.8 0.0 1.7 113.7 111.9 77.56 42.16 46 1.686 3199K 22 0.0 0.0 L5 1148/0 94.37 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1370/42 108.09 GB 0.0 13.9 7.6 6.3 15.6 9.3 4.9 8.4 101.6 113.7 140.37 73.11 92 1.526 7073K 3280 0.0 0.0 Int 0/0 0.00 KB 0.0 13.9 7.6 6.3 15.6 9.3 4.9 8.4 101.6 113.7 140.37 73.11 92 1.526 7073K 3280 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.9 7.6 6.3 13.7 7.4 0.0 0.0 113.5 112.0 125.67 67.44 71 1.770 7073K 3280 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 128.5 14.70 5.67 21 0.700 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.5 total, 15.4 interval Flush(GB): cumulative 1.845, interval 1.845 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.59 GB write, 1029.62 MB/s write, 13.93 GB read, 919.81 MB/s read, 140.4 seconds Interval compaction: 15.59 GB write, 1038.49 MB/s write, 13.93 GB read, 927.73 MB/s read, 140.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 68, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 68, interval: 68 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 461390 Average: 11.4549 StdDev: 257.70 Min: 1 Median: 1.7970 Max: 57821 Percentiles: P50: 1.80 P75: 2.82 P99: 9.86 P99.9: 1829.95 P99.99: 4901.81 ------------------------------------------------------ [ 0, 1 ] 31251 6.773% 6.773% # ( 1, 2 ] 250240 54.236% 61.009% ########### ( 2, 3 ] 79049 17.133% 78.142% ### ( 3, 4 ] 42670 9.248% 87.390% ## ( 4, 6 ] 45040 9.762% 97.152% ## ( 6, 10 ] 8838 1.916% 99.068% ( 10, 15 ] 1644 0.356% 99.424% ( 15, 22 ] 137 0.030% 99.454% ( 22, 34 ] 10 0.002% 99.456% ( 34, 51 ] 7 0.002% 99.457% ( 51, 76 ] 16 0.003% 99.461% ( 76, 110 ] 9 0.002% 99.463% ( 110, 170 ] 23 0.005% 99.468% ( 170, 250 ] 74 0.016% 99.484% ( 250, 380 ] 170 0.037% 99.521% ( 380, 580 ] 389 0.084% 99.605% ( 580, 870 ] 576 0.125% 99.730% ( 870, 1300 ] 533 0.116% 99.845% ( 1300, 1900 ] 286 0.062% 99.907% ( 1900, 2900 ] 181 0.039% 99.946% ( 2900, 4400 ] 189 0.041% 99.987% ( 4400, 6600 ] 52 0.011% 99.999% ( 6600, 9900 ] 11 0.002% 100.001% ( 9900, 14000 ] 9 0.002% 100.003% ( 14000, 22000 ] 12 0.003% 100.006% ( 22000, 33000 ] 14 0.003% 100.009% ( 33000, 50000 ] 4 0.001% 100.010% ( 50000, 75000 ] 1 0.000% 100.010% ** Level 1 read latency histogram (micros): Count: 182814 Average: 11.2933 StdDev: 138.13 Min: 1 Median: 1.8538 Max: 14646 Percentiles: P50: 1.85 P75: 2.91 P99: 11.66 P99.9: 2011.80 P99.99: 4067.56 ------------------------------------------------------ [ 0, 1 ] 7961 4.355% 4.355% # ( 1, 2 ] 97735 53.461% 57.816% ########### ( 2, 3 ] 34490 18.866% 76.682% #### ( 3, 4 ] 17209 9.413% 86.096% ## ( 4, 6 ] 19090 10.442% 96.538% ## ( 6, 10 ] 4237 2.318% 98.856% ( 10, 15 ] 796 0.435% 99.291% ( 15, 22 ] 92 0.050% 99.341% ( 22, 34 ] 4 0.002% 99.344% ( 34, 51 ] 8 0.004% 99.348% ( 51, 76 ] 17 0.009% 99.357% ( 76, 110 ] 4 0.002% 99.359% ( 110, 170 ] 9 0.005% 99.364% ( 170, 250 ] 28 0.015% 99.380% ( 250, 380 ] 54 0.030% 99.409% ( 380, 580 ] 176 0.096% 99.506% ( 580, 870 ] 314 0.172% 99.677% ( 870, 1300 ] 253 0.138% 99.816% ( 1300, 1900 ] 142 0.078% 99.893% ( 1900, 2900 ] 109 0.060% 99.953% ( 2900, 4400 ] 87 0.048% 100.001% ( 4400, 6600 ] 24 0.013% 100.014% ( 6600, 9900 ] 2 0.001% 100.015% ( 14000, 22000 ] 1 0.001% 100.015% ** Level 2 read latency histogram (micros): Count: 472626 Average: 13.7075 StdDev: 172.42 Min: 1 Median: 1.8835 Max: 21735 Percentiles: P50: 1.88 P75: 3.00 P99: 12.74 P99.9: 1425.23 P99.99: 2084.68 ------------------------------------------------------ [ 0, 1 ] 29214 6.181% 6.181% # ( 1, 2 ] 234410 49.597% 55.779% ########## ( 2, 3 ] 90900 19.233% 75.012% #### ( 3, 4 ] 47571 10.065% 85.077% ## ( 4, 6 ] 50381 10.660% 95.737% ## ( 6, 10 ] 13548 2.867% 98.603% # ( 10, 15 ] 3424 0.724% 99.328% ( 15, 22 ] 496 0.105% 99.433% ( 22, 34 ] 101 0.021% 99.454% ( 34, 51 ] 50 0.011% 99.464% ( 51, 76 ] 46 0.010% 99.474% ( 76, 110 ] 21 0.004% 99.479% ( 110, 170 ] 68 0.014% 99.493% ( 170, 250 ] 113 0.024% 99.517% ( 250, 380 ] 221 0.047% 99.564% ( 380, 580 ] 406 0.086% 99.650% ( 580, 870 ] 549 0.116% 99.766% ( 870, 1300 ] 544 0.115% 99.881% ( 1300, 1900 ] 433 0.092% 99.972% ( 1900, 2900 ] 448 0.095% 100.067% ( 2900, 4400 ] 400 0.085% 100.152% ( 4400, 6600 ] 102 0.022% 100.173% ( 6600, 9900 ] 12 0.003% 100.176% ( 9900, 14000 ] 2 0.000% 100.176% ( 14000, 22000 ] 2 0.000% 100.177% ** Level 3 read latency histogram (micros): Count: 1813953 Average: 11.6090 StdDev: 187.30 Min: 1 Median: 1.8831 Max: 54859 Percentiles: P50: 1.88 P75: 2.97 P99: 9.95 P99.9: 933.24 P99.99: 1331.51 ------------------------------------------------------ [ 0, 1 ] 70270 3.874% 3.874% # ( 1, 2 ] 947467 52.232% 56.106% ########## ( 2, 3 ] 353790 19.504% 75.610% #### ( 3, 4 ] 183014 10.089% 85.699% ## ( 4, 6 ] 196616 10.839% 96.538% ## ( 6, 10 ] 45232 2.494% 99.032% ( 10, 15 ] 9954 0.549% 99.580% ( 15, 22 ] 1204 0.066% 99.647% ( 22, 34 ] 105 0.006% 99.653% ( 34, 51 ] 91 0.005% 99.658% ( 51, 76 ] 134 0.007% 99.665% ( 76, 110 ] 30 0.002% 99.667% ( 110, 170 ] 117 0.006% 99.673% ( 170, 250 ] 271 0.015% 99.688% ( 250, 380 ] 556 0.031% 99.719% ( 380, 580 ] 1201 0.066% 99.785% ( 580, 870 ] 1816 0.100% 99.885% ( 870, 1300 ] 1843 0.102% 99.987% ( 1300, 1900 ] 1154 0.064% 100.050% ( 1900, 2900 ] 1081 0.060% 100.110% ( 2900, 4400 ] 1167 0.064% 100.174% ( 4400, 6600 ] 327 0.018% 100.192% ( 6600, 9900 ] 57 0.003% 100.195% ( 9900, 14000 ] 16 0.001% 100.196% ( 14000, 22000 ] 28 0.002% 100.198% ( 22000, 33000 ] 14 0.001% 100.199% ( 33000, 50000 ] 1 0.000% 100.199% ( 50000, 75000 ] 1 0.000% 100.199% ** Level 4 read latency histogram (micros): Count: 1027543 Average: 20.2401 StdDev: 305.77 Min: 1 Median: 1.8766 Max: 64980 Percentiles: P50: 1.88 P75: 2.99 P99: 274.21 P99.9: 2083.44 P99.99: 3060.25 ------------------------------------------------------ [ 0, 1 ] 41241 4.014% 4.014% # ( 1, 2 ] 539068 52.462% 56.475% ########## ( 2, 3 ] 192020 18.687% 75.163% #### ( 3, 4 ] 103315 10.055% 85.217% ## ( 4, 6 ] 108959 10.604% 95.821% ## ( 6, 10 ] 25808 2.512% 98.333% # ( 10, 15 ] 5297 0.516% 98.848% ( 15, 22 ] 534 0.052% 98.900% ( 22, 34 ] 60 0.006% 98.906% ( 34, 51 ] 73 0.007% 98.913% ( 51, 76 ] 109 0.011% 98.924% ( 76, 110 ] 60 0.006% 98.930% ( 110, 170 ] 130 0.013% 98.942% ( 170, 250 ] 423 0.041% 98.983% ( 250, 380 ] 916 0.089% 99.073% ( 380, 580 ] 1734 0.169% 99.241% ( 580, 870 ] 2652 0.258% 99.499% ( 870, 1300 ] 2458 0.239% 99.739% ( 1300, 1900 ] 1473 0.143% 99.882% ( 1900, 2900 ] 1011 0.098% 99.980% ( 2900, 4400 ] 929 0.090% 100.071% ( 4400, 6600 ] 303 0.029% 100.100% ( 6600, 9900 ] 50 0.005% 100.105% ( 9900, 14000 ] 24 0.002% 100.107% ( 14000, 22000 ] 40 0.004% 100.111% ( 22000, 33000 ] 25 0.002% 100.114% ( 33000, 50000 ] 9 0.001% 100.115% ( 50000, 75000 ] 4 0.000% 100.115% ** Level 5 read latency histogram (micros): Count: 32613 Average: 1392.5365 StdDev: 1707.77 Min: 83 Median: 917.7106 Max: 60931 Percentiles: P50: 917.71 P75: 1651.23 P99: 6395.43 P99.9: 24509.18 P99.99: 49444.74 ------------------------------------------------------ ( 76, 110 ] 51 0.156% 0.156% ( 110, 170 ] 350 1.073% 1.230% ( 170, 250 ] 910 2.790% 4.020% # ( 250, 380 ] 2215 6.792% 10.812% # ( 380, 580 ] 4931 15.120% 25.931% ### ( 580, 870 ] 7100 21.770% 47.702% #### ( 870, 1300 ] 6755 20.713% 68.414% #### ( 1300, 1900 ] 3669 11.250% 79.665% ## ( 1900, 2900 ] 2703 8.288% 87.953% ## ( 2900, 4400 ] 2792 8.561% 96.514% ## ( 4400, 6600 ] 894 2.741% 99.255% # ( 6600, 9900 ] 151 0.463% 99.718% ( 9900, 14000 ] 20 0.061% 99.779% ( 14000, 22000 ] 33 0.101% 99.880% ( 22000, 33000 ] 28 0.086% 99.966% ( 33000, 50000 ] 8 0.025% 99.991% ( 50000, 75000 ] 3 0.009% 100.000% ** DB Stats ** Uptime(secs): 15.5 total, 7.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 126.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.552 H:M:S, 48.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 125.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.979 H:M:S, 50.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/18-15:17:11 ... thread 0: (1000000,3000000) ops and (194000.1,146160.1) ops/second in (5.154637,20.525440) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 1.60 GB 37.8 1.3 0.0 1.3 4.1 2.8 0.0 1.5 48.5 152.2 27.30 14.05 37 0.738 1343K 1656 0.0 0.0 L1 2/2 128.01 MB 0.0 1.7 1.2 0.5 1.7 1.2 0.0 1.4 127.6 127.3 13.50 8.22 4 3.375 1749K 3802 0.0 0.0 L2 1/1 128.77 MB 0.0 0.0 0.0 0.0 0.0 0.0 1.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 20/5 1.35 GB 0.9 6.0 2.8 3.3 6.0 2.7 0.4 2.1 118.3 117.2 52.36 28.77 28 1.870 4534K 9357 0.0 0.0 L4 177/17 9.72 GB 0.9 10.5 5.7 4.8 10.3 5.6 0.5 1.8 114.8 112.8 93.67 52.24 58 1.615 4371K 11K 0.0 0.0 L5 1168/0 96.03 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1379/34 108.95 GB 0.0 19.5 9.7 9.8 22.0 12.3 7.9 8.0 107.0 120.8 186.83 103.28 127 1.471 11M 26K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.5 9.7 9.8 22.0 12.3 7.9 8.0 107.0 120.8 186.83 103.28 127 1.471 11M 26K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.5 9.7 9.8 19.3 9.5 0.0 0.0 119.6 118.1 167.19 95.00 94 1.779 11M 26K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 144.4 19.63 8.29 33 0.595 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.7 total, 20.5 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.05 GB write, 1092.78 MB/s write, 19.53 GB read, 967.82 MB/s read, 186.8 seconds Interval compaction: 22.05 GB write, 1099.83 MB/s write, 19.53 GB read, 974.06 MB/s read, 186.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 86, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 86, interval: 86 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 773273 Average: 10.1430 StdDev: 227.63 Min: 1 Median: 1.7811 Max: 57821 Percentiles: P50: 1.78 P75: 2.76 P99: 9.81 P99.9: 1485.66 P99.99: 3953.88 ------------------------------------------------------ [ 0, 1 ] 54970 7.109% 7.109% # ( 1, 2 ] 424599 54.909% 62.018% ########### ( 2, 3 ] 131935 17.062% 79.080% ### ( 3, 4 ] 68902 8.910% 87.990% ## ( 4, 6 ] 71770 9.281% 97.272% ## ( 6, 10 ] 14036 1.815% 99.087% ( 10, 15 ] 2707 0.350% 99.437% ( 15, 22 ] 244 0.032% 99.468% ( 22, 34 ] 20 0.003% 99.471% ( 34, 51 ] 18 0.002% 99.473% ( 51, 76 ] 27 0.003% 99.477% ( 76, 110 ] 31 0.004% 99.481% ( 110, 170 ] 149 0.019% 99.500% ( 170, 250 ] 238 0.031% 99.531% ( 250, 380 ] 387 0.050% 99.581% ( 380, 580 ] 716 0.093% 99.674% ( 580, 870 ] 885 0.114% 99.788% ( 870, 1300 ] 752 0.097% 99.885% ( 1300, 1900 ] 374 0.048% 99.934% ( 1900, 2900 ] 255 0.033% 99.967% ( 2900, 4400 ] 260 0.034% 100.000% ( 4400, 6600 ] 72 0.009% 100.010% ( 6600, 9900 ] 18 0.002% 100.012% ( 9900, 14000 ] 10 0.001% 100.013% ( 14000, 22000 ] 17 0.002% 100.015% ( 22000, 33000 ] 20 0.003% 100.018% ( 33000, 50000 ] 5 0.001% 100.019% ( 50000, 75000 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 393526 Average: 9.4728 StdDev: 132.75 Min: 1 Median: 1.8514 Max: 30811 Percentiles: P50: 1.85 P75: 2.89 P99: 10.25 P99.9: 1409.42 P99.99: 3032.07 ------------------------------------------------------ [ 0, 1 ] 15466 3.930% 3.930% # ( 1, 2 ] 212931 54.108% 58.039% ########### ( 2, 3 ] 75150 19.097% 77.135% #### ( 3, 4 ] 36950 9.389% 86.525% ## ( 4, 6 ] 39925 10.145% 96.670% ## ( 6, 10 ] 9077 2.307% 98.977% ( 10, 15 ] 1810 0.460% 99.437% ( 15, 22 ] 200 0.051% 99.487% ( 22, 34 ] 11 0.003% 99.490% ( 34, 51 ] 17 0.004% 99.495% ( 51, 76 ] 33 0.008% 99.503% ( 76, 110 ] 10 0.003% 99.505% ( 110, 170 ] 52 0.013% 99.519% ( 170, 250 ] 90 0.023% 99.542% ( 250, 380 ] 159 0.040% 99.582% ( 380, 580 ] 346 0.088% 99.670% ( 580, 870 ] 481 0.122% 99.792% ( 870, 1300 ] 388 0.099% 99.891% ( 1300, 1900 ] 200 0.051% 99.942% ( 1900, 2900 ] 177 0.045% 99.987% ( 2900, 4400 ] 155 0.039% 100.026% ( 4400, 6600 ] 46 0.012% 100.038% ( 6600, 9900 ] 5 0.001% 100.039% ( 14000, 22000 ] 1 0.000% 100.039% ( 22000, 33000 ] 1 0.000% 100.039% ** Level 2 read latency histogram (micros): Count: 524866 Average: 13.5934 StdDev: 197.60 Min: 1 Median: 1.8820 Max: 50609 Percentiles: P50: 1.88 P75: 2.99 P99: 12.48 P99.9: 1468.72 P99.99: 2218.40 ------------------------------------------------------ [ 0, 1 ] 31079 5.921% 5.921% # ( 1, 2 ] 262318 49.978% 55.899% ########## ( 2, 3 ] 101138 19.269% 75.169% #### ( 3, 4 ] 52639 10.029% 85.198% ## ( 4, 6 ] 55731 10.618% 95.816% ## ( 6, 10 ] 14877 2.834% 98.650% # ( 10, 15 ] 3703 0.706% 99.356% ( 15, 22 ] 526 0.100% 99.456% ( 22, 34 ] 103 0.020% 99.476% ( 34, 51 ] 56 0.011% 99.486% ( 51, 76 ] 54 0.010% 99.497% ( 76, 110 ] 21 0.004% 99.501% ( 110, 170 ] 69 0.013% 99.514% ( 170, 250 ] 115 0.022% 99.536% ( 250, 380 ] 229 0.044% 99.579% ( 380, 580 ] 418 0.080% 99.659% ( 580, 870 ] 563 0.107% 99.766% ( 870, 1300 ] 577 0.110% 99.876% ( 1300, 1900 ] 445 0.085% 99.961% ( 1900, 2900 ] 479 0.091% 100.052% ( 2900, 4400 ] 429 0.082% 100.134% ( 4400, 6600 ] 109 0.021% 100.155% ( 6600, 9900 ] 16 0.003% 100.158% ( 9900, 14000 ] 5 0.001% 100.159% ( 14000, 22000 ] 4 0.001% 100.159% ( 22000, 33000 ] 1 0.000% 100.160% ( 33000, 50000 ] 1 0.000% 100.160% ( 50000, 75000 ] 1 0.000% 100.160% ** Level 3 read latency histogram (micros): Count: 2235922 Average: 10.9185 StdDev: 183.27 Min: 1 Median: 1.8756 Max: 54859 Percentiles: P50: 1.88 P75: 2.94 P99: 9.89 P99.9: 885.83 P99.99: 1299.06 ------------------------------------------------------ [ 0, 1 ] 84688 3.788% 3.788% # ( 1, 2 ] 1180022 52.776% 56.563% ########### ( 2, 3 ] 436593 19.526% 76.090% #### ( 3, 4 ] 221859 9.922% 86.012% ## ( 4, 6 ] 237813 10.636% 96.648% ## ( 6, 10 ] 54047 2.417% 99.065% ( 10, 15 ] 11703 0.523% 99.589% ( 15, 22 ] 1399 0.063% 99.651% ( 22, 34 ] 126 0.006% 99.657% ( 34, 51 ] 131 0.006% 99.663% ( 51, 76 ] 172 0.008% 99.670% ( 76, 110 ] 56 0.003% 99.673% ( 110, 170 ] 203 0.009% 99.682% ( 170, 250 ] 391 0.017% 99.699% ( 250, 380 ] 758 0.034% 99.733% ( 380, 580 ] 1506 0.067% 99.801% ( 580, 870 ] 2143 0.096% 99.897% ( 870, 1300 ] 2094 0.094% 99.990% ( 1300, 1900 ] 1260 0.056% 100.047% ( 1900, 2900 ] 1184 0.053% 100.100% ( 2900, 4400 ] 1268 0.057% 100.156% ( 4400, 6600 ] 373 0.017% 100.173% ( 6600, 9900 ] 69 0.003% 100.176% ( 9900, 14000 ] 20 0.001% 100.177% ( 14000, 22000 ] 34 0.002% 100.178% ( 22000, 33000 ] 18 0.001% 100.179% ( 33000, 50000 ] 2 0.000% 100.179% ( 50000, 75000 ] 1 0.000% 100.179% ** Level 4 read latency histogram (micros): Count: 1357242 Average: 20.4431 StdDev: 315.51 Min: 1 Median: 1.8794 Max: 64980 Percentiles: P50: 1.88 P75: 2.99 P99: 310.18 P99.9: 2051.85 P99.99: 3075.56 ------------------------------------------------------ [ 0, 1 ] 51950 3.828% 3.828% # ( 1, 2 ] 712583 52.502% 56.330% ########### ( 2, 3 ] 255669 18.837% 75.167% #### ( 3, 4 ] 135584 9.990% 85.157% ## ( 4, 6 ] 143408 10.566% 95.723% ## ( 6, 10 ] 34077 2.511% 98.234% # ( 10, 15 ] 7316 0.539% 98.773% ( 15, 22 ] 709 0.052% 98.825% ( 22, 34 ] 83 0.006% 98.831% ( 34, 51 ] 121 0.009% 98.840% ( 51, 76 ] 148 0.011% 98.851% ( 76, 110 ] 118 0.009% 98.860% ( 110, 170 ] 374 0.028% 98.887% ( 170, 250 ] 825 0.061% 98.948% ( 250, 380 ] 1522 0.112% 99.060% ( 380, 580 ] 2632 0.194% 99.254% ( 580, 870 ] 3660 0.270% 99.524% ( 870, 1300 ] 3148 0.232% 99.756% ( 1300, 1900 ] 1764 0.130% 99.886% ( 1900, 2900 ] 1276 0.094% 99.980% ( 2900, 4400 ] 1190 0.088% 100.067% ( 4400, 6600 ] 387 0.029% 100.096% ( 6600, 9900 ] 76 0.006% 100.102% ( 9900, 14000 ] 36 0.003% 100.104% ( 14000, 22000 ] 60 0.004% 100.109% ( 22000, 33000 ] 47 0.003% 100.112% ( 33000, 50000 ] 10 0.001% 100.113% ( 50000, 75000 ] 5 0.000% 100.113% ** Level 5 read latency histogram (micros): Count: 50299 Average: 1208.3574 StdDev: 1765.29 Min: 79 Median: 781.5692 Max: 70972 Percentiles: P50: 781.57 P75: 1320.32 P99: 6173.22 P99.9: 25269.75 P99.99: 64521.04 ------------------------------------------------------ ( 76, 110 ] 225 0.447% 0.447% ( 110, 170 ] 1594 3.169% 3.616% # ( 170, 250 ] 2719 5.406% 9.022% # ( 250, 380 ] 4657 9.259% 18.281% ## ( 380, 580 ] 8502 16.903% 35.184% ### ( 580, 870 ] 10722 21.317% 56.500% #### ( 870, 1300 ] 9148 18.187% 74.687% #### ( 1300, 1900 ] 4644 9.233% 83.920% ## ( 1900, 2900 ] 3379 6.718% 90.638% # ( 2900, 4400 ] 3346 6.652% 97.290% # ( 4400, 6600 ] 1067 2.121% 99.412% ( 6600, 9900 ] 170 0.338% 99.749% ( 9900, 14000 ] 26 0.052% 99.801% ( 14000, 22000 ] 39 0.078% 99.879% ( 22000, 33000 ] 36 0.072% 99.950% ( 33000, 50000 ] 13 0.026% 99.976% ( 50000, 75000 ] 12 0.024% 100.000% ** DB Stats ** Uptime(secs): 20.7 total, 5.2 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 142.92 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.771 H:M:S, 42.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 190.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.218 H:M:S, 23.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/11/18-15:17:15 ... thread 0: (1000000,4000000) ops and (241159.9,162126.7) ops/second in (4.146627,24.672067) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.60 GB 138.5 2.2 0.0 2.2 5.8 3.7 0.0 1.6 62.7 170.1 35.16 20.10 54 0.651 2238K 2640 0.0 0.0 L1 9/0 637.84 MB 63.8 2.7 2.1 0.6 2.7 2.1 0.0 1.3 143.9 143.4 19.42 13.25 5 3.884 2837K 8316 0.0 0.0 L2 4/2 429.45 MB 1.7 0.0 0.0 0.0 0.0 0.0 1.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/3 988.17 MB 0.8 6.4 2.9 3.4 6.3 2.9 0.4 2.2 119.9 118.9 54.38 30.26 29 1.875 4736K 9357 0.0 0.0 L4 183/6 10.15 GB 1.0 12.3 6.2 6.1 12.1 6.0 0.5 1.9 120.2 118.1 105.05 60.69 64 1.641 6105K 28K 0.0 0.0 L5 1169/36 96.08 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1392/51 109.83 GB 0.0 23.6 11.3 12.3 27.0 14.7 8.4 7.3 112.8 129.1 214.01 124.30 152 1.408 15M 48K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.6 11.3 12.3 27.0 14.7 8.4 7.3 112.8 129.1 214.01 124.30 152 1.408 15M 48K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.6 11.3 12.3 23.3 11.0 0.0 0.0 126.9 125.3 190.30 113.45 105 1.812 15M 48K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 159.4 23.71 10.84 47 0.505 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.8 total, 24.7 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.99 GB write, 1113.98 MB/s write, 23.58 GB read, 973.40 MB/s read, 214.0 seconds Interval compaction: 26.99 GB write, 1119.96 MB/s write, 23.58 GB read, 978.62 MB/s read, 214.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 92, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 92, interval: 92 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1182937 Average: 8.9663 StdDev: 189.86 Min: 0 Median: 1.7561 Max: 57821 Percentiles: P50: 1.76 P75: 2.69 P99: 9.91 P99.9: 1187.09 P99.99: 3067.90 ------------------------------------------------------ [ 0, 1 ] 93751 7.925% 7.925% ## ( 1, 2 ] 658243 55.645% 63.570% ########### ( 2, 3 ] 196095 16.577% 80.147% ### ( 3, 4 ] 100552 8.500% 88.647% ## ( 4, 6 ] 103133 8.718% 97.366% ## ( 6, 10 ] 19756 1.670% 99.036% ( 10, 15 ] 3778 0.319% 99.355% ( 15, 22 ] 343 0.029% 99.384% ( 22, 34 ] 30 0.003% 99.387% ( 34, 51 ] 29 0.002% 99.389% ( 51, 76 ] 36 0.003% 99.392% ( 76, 110 ] 209 0.018% 99.410% ( 110, 170 ] 887 0.075% 99.485% ( 170, 250 ] 884 0.075% 99.559% ( 250, 380 ] 883 0.075% 99.634% ( 380, 580 ] 1198 0.101% 99.735% ( 580, 870 ] 1263 0.107% 99.842% ( 870, 1300 ] 929 0.079% 99.921% ( 1300, 1900 ] 450 0.038% 99.959% ( 1900, 2900 ] 335 0.028% 99.987% ( 2900, 4400 ] 319 0.027% 100.014% ( 4400, 6600 ] 90 0.008% 100.022% ( 6600, 9900 ] 20 0.002% 100.023% ( 9900, 14000 ] 10 0.001% 100.024% ( 14000, 22000 ] 17 0.001% 100.026% ( 22000, 33000 ] 20 0.002% 100.027% ( 33000, 50000 ] 5 0.000% 100.028% ( 50000, 75000 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 440918 Average: 9.7430 StdDev: 135.26 Min: 1 Median: 1.8615 Max: 30811 Percentiles: P50: 1.86 P75: 2.91 P99: 10.75 P99.9: 1555.08 P99.99: 3297.72 ------------------------------------------------------ [ 0, 1 ] 16733 3.795% 3.795% # ( 1, 2 ] 236475 53.632% 57.427% ########### ( 2, 3 ] 85061 19.292% 76.719% #### ( 3, 4 ] 41823 9.485% 86.205% ## ( 4, 6 ] 45685 10.361% 96.566% ## ( 6, 10 ] 10419 2.363% 98.929% ( 10, 15 ] 2095 0.475% 99.404% ( 15, 22 ] 233 0.053% 99.457% ( 22, 34 ] 15 0.003% 99.460% ( 34, 51 ] 23 0.005% 99.466% ( 51, 76 ] 42 0.010% 99.475% ( 76, 110 ] 26 0.006% 99.481% ( 110, 170 ] 92 0.021% 99.502% ( 170, 250 ] 119 0.027% 99.529% ( 250, 380 ] 200 0.045% 99.574% ( 380, 580 ] 391 0.089% 99.663% ( 580, 870 ] 525 0.119% 99.782% ( 870, 1300 ] 424 0.096% 99.878% ( 1300, 1900 ] 226 0.051% 99.929% ( 1900, 2900 ] 216 0.049% 99.978% ( 2900, 4400 ] 192 0.044% 100.022% ( 4400, 6600 ] 50 0.011% 100.033% ( 6600, 9900 ] 8 0.002% 100.035% ( 14000, 22000 ] 1 0.000% 100.035% ( 22000, 33000 ] 1 0.000% 100.036% ** Level 2 read latency histogram (micros): Count: 524866 Average: 13.5934 StdDev: 197.60 Min: 1 Median: 1.8820 Max: 50609 Percentiles: P50: 1.88 P75: 2.99 P99: 12.48 P99.9: 1468.72 P99.99: 2218.40 ------------------------------------------------------ [ 0, 1 ] 31079 5.921% 5.921% # ( 1, 2 ] 262318 49.978% 55.899% ########## ( 2, 3 ] 101138 19.269% 75.169% #### ( 3, 4 ] 52639 10.029% 85.198% ## ( 4, 6 ] 55731 10.618% 95.816% ## ( 6, 10 ] 14877 2.834% 98.650% # ( 10, 15 ] 3703 0.706% 99.356% ( 15, 22 ] 526 0.100% 99.456% ( 22, 34 ] 103 0.020% 99.476% ( 34, 51 ] 56 0.011% 99.486% ( 51, 76 ] 54 0.010% 99.497% ( 76, 110 ] 21 0.004% 99.501% ( 110, 170 ] 69 0.013% 99.514% ( 170, 250 ] 115 0.022% 99.536% ( 250, 380 ] 229 0.044% 99.579% ( 380, 580 ] 418 0.080% 99.659% ( 580, 870 ] 563 0.107% 99.766% ( 870, 1300 ] 577 0.110% 99.876% ( 1300, 1900 ] 445 0.085% 99.961% ( 1900, 2900 ] 479 0.091% 100.052% ( 2900, 4400 ] 429 0.082% 100.134% ( 4400, 6600 ] 109 0.021% 100.155% ( 6600, 9900 ] 16 0.003% 100.158% ( 9900, 14000 ] 5 0.001% 100.159% ( 14000, 22000 ] 4 0.001% 100.159% ( 22000, 33000 ] 1 0.000% 100.160% ( 33000, 50000 ] 1 0.000% 100.160% ( 50000, 75000 ] 1 0.000% 100.160% ** Level 3 read latency histogram (micros): Count: 2413427 Average: 10.5843 StdDev: 177.72 Min: 1 Median: 1.8726 Max: 54859 Percentiles: P50: 1.87 P75: 2.94 P99: 9.89 P99.9: 875.67 P99.99: 1315.15 ------------------------------------------------------ [ 0, 1 ] 92066 3.815% 3.815% # ( 1, 2 ] 1277381 52.928% 56.743% ########### ( 2, 3 ] 470526 19.496% 76.239% #### ( 3, 4 ] 237838 9.855% 86.094% ## ( 4, 6 ] 255457 10.585% 96.679% ## ( 6, 10 ] 57614 2.387% 99.066% ( 10, 15 ] 12394 0.514% 99.579% ( 15, 22 ] 1460 0.060% 99.640% ( 22, 34 ] 130 0.005% 99.645% ( 34, 51 ] 156 0.006% 99.652% ( 51, 76 ] 188 0.008% 99.660% ( 76, 110 ] 94 0.004% 99.663% ( 110, 170 ] 358 0.015% 99.678% ( 170, 250 ] 542 0.022% 99.701% ( 250, 380 ] 873 0.036% 99.737% ( 380, 580 ] 1650 0.068% 99.805% ( 580, 870 ] 2258 0.094% 99.899% ( 870, 1300 ] 2168 0.090% 99.989% ( 1300, 1900 ] 1293 0.054% 100.042% ( 1900, 2900 ] 1234 0.051% 100.093% ( 2900, 4400 ] 1298 0.054% 100.147% ( 4400, 6600 ] 379 0.016% 100.163% ( 6600, 9900 ] 70 0.003% 100.166% ( 9900, 14000 ] 20 0.001% 100.167% ( 14000, 22000 ] 34 0.001% 100.168% ( 22000, 33000 ] 18 0.001% 100.169% ( 33000, 50000 ] 2 0.000% 100.169% ( 50000, 75000 ] 1 0.000% 100.169% ** Level 4 read latency histogram (micros): Count: 1630729 Average: 19.7446 StdDev: 294.96 Min: 1 Median: 1.8716 Max: 64980 Percentiles: P50: 1.87 P75: 2.97 P99: 315.88 P99.9: 2035.37 P99.99: 3074.94 ------------------------------------------------------ [ 0, 1 ] 64055 3.928% 3.928% # ( 1, 2 ] 861955 52.857% 56.785% ########### ( 2, 3 ] 305657 18.744% 75.529% #### ( 3, 4 ] 159467 9.779% 85.307% ## ( 4, 6 ] 168593 10.339% 95.646% ## ( 6, 10 ] 40359 2.475% 98.121% ( 10, 15 ] 8603 0.528% 98.648% ( 15, 22 ] 832 0.051% 98.699% ( 22, 34 ] 100 0.006% 98.706% ( 34, 51 ] 176 0.011% 98.716% ( 51, 76 ] 188 0.012% 98.728% ( 76, 110 ] 330 0.020% 98.748% ( 110, 170 ] 1279 0.078% 98.827% ( 170, 250 ] 1691 0.104% 98.930% ( 250, 380 ] 2245 0.138% 99.068% ( 380, 580 ] 3478 0.213% 99.281% ( 580, 870 ] 4372 0.268% 99.549% ( 870, 1300 ] 3560 0.218% 99.768% ( 1300, 1900 ] 1955 0.120% 99.888% ( 1900, 2900 ] 1509 0.093% 99.980% ( 2900, 4400 ] 1397 0.086% 100.066% ( 4400, 6600 ] 420 0.026% 100.091% ( 6600, 9900 ] 83 0.005% 100.097% ( 9900, 14000 ] 36 0.002% 100.099% ( 14000, 22000 ] 60 0.004% 100.102% ( 22000, 33000 ] 47 0.003% 100.105% ( 33000, 50000 ] 10 0.001% 100.106% ( 50000, 75000 ] 5 0.000% 100.106% ** Level 5 read latency histogram (micros): Count: 185542 Average: 403.0647 StdDev: 1099.21 Min: 1 Median: 3.8028 Max: 70972 Percentiles: P50: 3.80 P75: 453.03 P99: 4209.83 P99.9: 6522.14 P99.99: 8695.26 ------------------------------------------------------ [ 0, 1 ] 4920 2.652% 2.652% # ( 1, 2 ] 55404 29.861% 32.512% ###### ( 2, 3 ] 21804 11.752% 44.264% ## ( 3, 4 ] 13258 7.146% 51.409% # ( 4, 6 ] 14141 7.621% 59.031% ## ( 6, 10 ] 3018 1.627% 60.657% ( 10, 15 ] 731 0.394% 61.051% ( 15, 22 ] 87 0.047% 61.098% ( 22, 34 ] 9 0.005% 61.103% ( 34, 51 ] 3 0.002% 61.105% ( 51, 76 ] 10 0.005% 61.110% ( 76, 110 ] 1219 0.657% 61.767% ( 110, 170 ] 6076 3.275% 65.042% # ( 170, 250 ] 6446 3.474% 68.516% # ( 250, 380 ] 7720 4.161% 72.677% # ( 380, 580 ] 11804 6.362% 79.039% # ( 580, 870 ] 13377 7.210% 86.248% # ( 870, 1300 ] 10664 5.747% 91.996% # ( 1300, 1900 ] 5331 2.873% 94.869% # ( 1900, 2900 ] 4149 2.236% 97.105% ( 2900, 4400 ] 4026 2.170% 99.275% ( 4400, 6600 ] 1202 0.648% 99.923% ( 6600, 9900 ] 196 0.106% 100.029% ( 9900, 14000 ] 27 0.015% 100.043% ( 14000, 22000 ] 39 0.021% 100.064% ( 22000, 33000 ] 36 0.019% 100.084% ( 33000, 50000 ] 13 0.007% 100.091% ( 50000, 75000 ] 12 0.006% 100.097% ** DB Stats ** Uptime(secs): 24.8 total, 4.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 158.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.201 H:M:S, 37.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 237.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.431 H:M:S, 10.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/11/18-15:17:21 ... thread 0: (1000000,5000000) ops and (173682.3,164313.1) ops/second in (5.757638,30.429705) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 2.58 GB 75.5 3.1 0.0 3.1 7.7 4.7 0.0 1.7 69.4 174.9 45.36 26.75 70 0.648 3198K 3796 0.0 0.0 L1 9/9 637.84 MB 0.0 2.7 2.1 0.6 2.7 2.1 0.0 1.3 143.9 143.4 19.42 13.25 5 3.884 2837K 8316 0.0 0.0 L2 1/0 43.90 MB 0.4 0.0 0.0 0.0 0.0 0.0 1.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 952.30 MB 1.0 7.1 3.3 3.8 7.0 3.2 0.4 2.1 121.2 120.2 60.04 33.73 32 1.876 5504K 13K 0.0 0.0 L4 182/6 10.12 GB 1.0 14.1 6.7 7.4 13.8 6.4 0.5 2.1 123.8 121.6 116.57 68.99 70 1.665 7895K 59K 0.0 0.0 L5 1182/35 96.14 GB 1.0 3.4 0.4 3.0 3.0 0.1 6.0 7.5 132.0 118.6 26.04 13.77 6 4.339 932K 58K 0.0 0.0 Sum 1406/62 110.43 GB 0.0 30.4 12.5 17.9 34.4 16.5 8.4 7.4 116.3 131.6 267.43 156.49 183 1.461 20M 143K 0.0 0.0 Int 0/0 0.00 KB 0.0 30.4 12.5 17.9 34.4 16.5 8.4 7.4 116.3 131.6 267.43 156.49 183 1.461 20M 143K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 30.4 12.5 17.9 29.7 11.8 0.0 0.0 130.5 127.6 238.31 142.83 123 1.937 20M 143K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 164.4 29.12 13.66 60 0.485 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 30.6 total, 30.4 interval Flush(GB): cumulative 4.675, interval 4.675 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.37 GB write, 1151.45 MB/s write, 30.36 GB read, 1017.21 MB/s read, 267.4 seconds Interval compaction: 34.37 GB write, 1156.46 MB/s write, 30.36 GB read, 1021.63 MB/s read, 267.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 104, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 104, interval: 104 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1396413 Average: 13.5059 StdDev: 220.51 Min: 0 Median: 1.7514 Max: 57821 Percentiles: P50: 1.75 P75: 2.69 P99: 170.47 P99.9: 1824.28 P99.99: 3677.92 ------------------------------------------------------ [ 0, 1 ] 113834 8.152% 8.152% ## ( 1, 2 ] 777678 55.691% 63.843% ########### ( 2, 3 ] 227374 16.283% 80.126% ### ( 3, 4 ] 116162 8.319% 88.444% ## ( 4, 6 ] 118487 8.485% 96.929% ## ( 6, 10 ] 22425 1.606% 98.535% ( 10, 15 ] 4219 0.302% 98.837% ( 15, 22 ] 376 0.027% 98.864% ( 22, 34 ] 34 0.002% 98.867% ( 34, 51 ] 40 0.003% 98.870% ( 51, 76 ] 45 0.003% 98.873% ( 76, 110 ] 299 0.021% 98.894% ( 110, 170 ] 1466 0.105% 98.999% ( 170, 250 ] 1860 0.133% 99.132% ( 250, 380 ] 2102 0.151% 99.283% ( 380, 580 ] 2755 0.197% 99.480% ( 580, 870 ] 2791 0.200% 99.680% ( 870, 1300 ] 2133 0.153% 99.833% ( 1300, 1900 ] 1073 0.077% 99.910% ( 1900, 2900 ] 777 0.056% 99.965% ( 2900, 4400 ] 664 0.048% 100.013% ( 4400, 6600 ] 161 0.012% 100.024% ( 6600, 9900 ] 24 0.002% 100.026% ( 9900, 14000 ] 12 0.001% 100.027% ( 14000, 22000 ] 20 0.001% 100.029% ( 22000, 33000 ] 24 0.002% 100.030% ( 33000, 50000 ] 8 0.001% 100.031% ( 50000, 75000 ] 2 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 502734 Average: 10.2624 StdDev: 137.00 Min: 1 Median: 1.8710 Max: 30811 Percentiles: P50: 1.87 P75: 2.93 P99: 11.54 P99.9: 1701.31 P99.99: 3463.94 ------------------------------------------------------ [ 0, 1 ] 18620 3.704% 3.704% # ( 1, 2 ] 267206 53.151% 56.854% ########### ( 2, 3 ] 97743 19.442% 76.297% #### ( 3, 4 ] 48226 9.593% 85.889% ## ( 4, 6 ] 53035 10.549% 96.439% ## ( 6, 10 ] 12114 2.410% 98.848% ( 10, 15 ] 2477 0.493% 99.341% ( 15, 22 ] 289 0.057% 99.398% ( 22, 34 ] 19 0.004% 99.402% ( 34, 51 ] 27 0.005% 99.408% ( 51, 76 ] 50 0.010% 99.418% ( 76, 110 ] 31 0.006% 99.424% ( 110, 170 ] 112 0.022% 99.446% ( 170, 250 ] 159 0.032% 99.478% ( 250, 380 ] 265 0.053% 99.530% ( 380, 580 ] 498 0.099% 99.629% ( 580, 870 ] 658 0.131% 99.760% ( 870, 1300 ] 519 0.103% 99.864% ( 1300, 1900 ] 274 0.055% 99.918% ( 1900, 2900 ] 273 0.054% 99.972% ( 2900, 4400 ] 236 0.047% 100.019% ( 4400, 6600 ] 56 0.011% 100.030% ( 6600, 9900 ] 9 0.002% 100.032% ( 14000, 22000 ] 1 0.000% 100.032% ( 22000, 33000 ] 1 0.000% 100.033% ** Level 2 read latency histogram (micros): Count: 524866 Average: 13.5934 StdDev: 197.60 Min: 1 Median: 1.8820 Max: 50609 Percentiles: P50: 1.88 P75: 2.99 P99: 12.48 P99.9: 1468.72 P99.99: 2218.40 ------------------------------------------------------ [ 0, 1 ] 31079 5.921% 5.921% # ( 1, 2 ] 262318 49.978% 55.899% ########## ( 2, 3 ] 101138 19.269% 75.169% #### ( 3, 4 ] 52639 10.029% 85.198% ## ( 4, 6 ] 55731 10.618% 95.816% ## ( 6, 10 ] 14877 2.834% 98.650% # ( 10, 15 ] 3703 0.706% 99.356% ( 15, 22 ] 526 0.100% 99.456% ( 22, 34 ] 103 0.020% 99.476% ( 34, 51 ] 56 0.011% 99.486% ( 51, 76 ] 54 0.010% 99.497% ( 76, 110 ] 21 0.004% 99.501% ( 110, 170 ] 69 0.013% 99.514% ( 170, 250 ] 115 0.022% 99.536% ( 250, 380 ] 229 0.044% 99.579% ( 380, 580 ] 418 0.080% 99.659% ( 580, 870 ] 563 0.107% 99.766% ( 870, 1300 ] 577 0.110% 99.876% ( 1300, 1900 ] 445 0.085% 99.961% ( 1900, 2900 ] 479 0.091% 100.052% ( 2900, 4400 ] 429 0.082% 100.134% ( 4400, 6600 ] 109 0.021% 100.155% ( 6600, 9900 ] 16 0.003% 100.158% ( 9900, 14000 ] 5 0.001% 100.159% ( 14000, 22000 ] 4 0.001% 100.159% ( 22000, 33000 ] 1 0.000% 100.160% ( 33000, 50000 ] 1 0.000% 100.160% ( 50000, 75000 ] 1 0.000% 100.160% ** Level 3 read latency histogram (micros): Count: 2578957 Average: 10.5296 StdDev: 175.56 Min: 1 Median: 1.8726 Max: 54859 Percentiles: P50: 1.87 P75: 2.94 P99: 9.91 P99.9: 917.97 P99.99: 1410.38 ------------------------------------------------------ [ 0, 1 ] 98457 3.818% 3.818% # ( 1, 2 ] 1364932 52.926% 56.743% ########### ( 2, 3 ] 502923 19.501% 76.244% #### ( 3, 4 ] 253657 9.836% 86.080% ## ( 4, 6 ] 273114 10.590% 96.670% ## ( 6, 10 ] 61513 2.385% 99.055% ( 10, 15 ] 13153 0.510% 99.565% ( 15, 22 ] 1528 0.059% 99.625% ( 22, 34 ] 132 0.005% 99.630% ( 34, 51 ] 163 0.006% 99.636% ( 51, 76 ] 196 0.008% 99.644% ( 76, 110 ] 101 0.004% 99.648% ( 110, 170 ] 392 0.015% 99.663% ( 170, 250 ] 614 0.024% 99.687% ( 250, 380 ] 986 0.038% 99.725% ( 380, 580 ] 1807 0.070% 99.795% ( 580, 870 ] 2451 0.095% 99.890% ( 870, 1300 ] 2322 0.090% 99.980% ( 1300, 1900 ] 1403 0.054% 100.034% ( 1900, 2900 ] 1310 0.051% 100.085% ( 2900, 4400 ] 1365 0.053% 100.138% ( 4400, 6600 ] 393 0.015% 100.153% ( 6600, 9900 ] 71 0.003% 100.156% ( 9900, 14000 ] 20 0.001% 100.157% ( 14000, 22000 ] 34 0.001% 100.158% ( 22000, 33000 ] 19 0.001% 100.159% ( 33000, 50000 ] 2 0.000% 100.159% ( 50000, 75000 ] 1 0.000% 100.159% ** Level 4 read latency histogram (micros): Count: 2183819 Average: 18.4703 StdDev: 269.18 Min: 1 Median: 1.8727 Max: 64980 Percentiles: P50: 1.87 P75: 2.97 P99: 267.15 P99.9: 1881.49 P99.99: 2860.13 ------------------------------------------------------ [ 0, 1 ] 84951 3.890% 3.890% # ( 1, 2 ] 1153851 52.836% 56.726% ########### ( 2, 3 ] 412726 18.899% 75.626% #### ( 3, 4 ] 213604 9.781% 85.407% ## ( 4, 6 ] 224812 10.294% 95.701% ## ( 6, 10 ] 54184 2.481% 98.182% ( 10, 15 ] 11449 0.524% 98.707% ( 15, 22 ] 1134 0.052% 98.759% ( 22, 34 ] 139 0.006% 98.765% ( 34, 51 ] 205 0.009% 98.774% ( 51, 76 ] 222 0.010% 98.785% ( 76, 110 ] 392 0.018% 98.803% ( 110, 170 ] 1656 0.076% 98.878% ( 170, 250 ] 2269 0.104% 98.982% ( 250, 380 ] 2932 0.134% 99.117% ( 380, 580 ] 4491 0.206% 99.322% ( 580, 870 ] 5624 0.258% 99.580% ( 870, 1300 ] 4550 0.208% 99.788% ( 1300, 1900 ] 2522 0.115% 99.904% ( 1900, 2900 ] 1966 0.090% 99.994% ( 2900, 4400 ] 1732 0.079% 100.073% ( 4400, 6600 ] 490 0.022% 100.095% ( 6600, 9900 ] 92 0.004% 100.100% ( 9900, 14000 ] 41 0.002% 100.101% ( 14000, 22000 ] 64 0.003% 100.104% ( 22000, 33000 ] 48 0.002% 100.107% ( 33000, 50000 ] 11 0.001% 100.107% ( 50000, 75000 ] 5 0.000% 100.107% ** Level 5 read latency histogram (micros): Count: 763121 Average: 129.7230 StdDev: 633.14 Min: 1 Median: 2.1081 Max: 70972 Percentiles: P50: 2.11 P75: 4.02 P99: 2598.01 P99.9: 4371.69 P99.99: 5303.50 ------------------------------------------------------ [ 0, 1 ] 31397 4.114% 4.114% # ( 1, 2 ] 336302 44.069% 48.184% ######### ( 2, 3 ] 128199 16.799% 64.983% ### ( 3, 4 ] 75678 9.917% 74.900% ## ( 4, 6 ] 75880 9.943% 84.843% ## ( 6, 10 ] 17389 2.279% 87.122% ( 10, 15 ] 4501 0.590% 87.712% ( 15, 22 ] 526 0.069% 87.781% ( 22, 34 ] 51 0.007% 87.787% ( 34, 51 ] 41 0.005% 87.793% ( 51, 76 ] 58 0.008% 87.800% ( 76, 110 ] 1388 0.182% 87.982% ( 110, 170 ] 7166 0.939% 88.921% ( 170, 250 ] 8455 1.108% 90.029% ( 250, 380 ] 10417 1.365% 91.394% ( 380, 580 ] 15437 2.023% 93.417% ( 580, 870 ] 17524 2.296% 95.713% ( 870, 1300 ] 13972 1.831% 97.544% ( 1300, 1900 ] 7145 0.936% 98.481% ( 1900, 2900 ] 5683 0.745% 99.225% ( 2900, 4400 ] 5251 0.688% 99.913% ( 4400, 6600 ] 1431 0.188% 100.101% ( 6600, 9900 ] 218 0.029% 100.129% ( 9900, 14000 ] 43 0.006% 100.135% ( 14000, 22000 ] 59 0.008% 100.143% ( 22000, 33000 ] 44 0.006% 100.149% ( 33000, 50000 ] 17 0.002% 100.151% ( 50000, 75000 ] 13 0.002% 100.153% ** DB Stats ** Uptime(secs): 30.6 total, 5.8 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 161.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.089 H:M:S, 36.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 170.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.888 H:M:S, 32.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/11/18-15:17:26 ... thread 0: (1000000,6000000) ops and (198756.5,169200.0) ops/second in (5.031283,35.460988) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/8 3.56 GB 201.4 4.2 0.0 4.2 9.8 5.7 0.0 1.7 78.1 183.6 54.87 33.94 88 0.623 4349K 5030 0.0 0.0 L1 9/9 637.84 MB 0.0 2.7 2.1 0.6 2.7 2.1 0.0 1.3 143.9 143.4 19.42 13.25 5 3.884 2837K 8316 0.0 0.0 L2 1/0 43.90 MB 0.4 0.0 0.0 0.0 0.0 0.0 1.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 952.30 MB 1.0 7.1 3.3 3.8 7.0 3.2 0.4 2.1 121.2 120.2 60.04 33.73 32 1.876 5504K 13K 0.0 0.0 L4 176/0 9.76 GB 1.0 14.1 6.7 7.4 13.8 6.4 0.5 2.1 123.8 121.6 116.57 68.99 70 1.665 7895K 59K 0.0 0.0 L5 1194/0 96.14 GB 1.0 6.6 0.8 5.8 5.9 0.1 6.0 7.7 144.6 129.3 46.79 27.27 12 3.899 1305K 58K 0.0 0.0 Sum 1414/17 111.06 GB 0.0 34.7 12.8 21.9 39.3 17.5 8.4 7.0 119.4 135.4 297.68 177.18 207 1.438 21M 144K 0.0 0.0 Int 0/0 0.00 KB 0.0 34.7 12.8 21.9 39.3 17.5 8.4 7.0 119.4 135.4 297.68 177.18 207 1.438 21M 144K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 34.7 12.8 21.9 33.7 11.8 0.0 0.0 134.7 130.7 264.01 160.83 133 1.985 21M 144K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 172.1 33.67 16.35 74 0.455 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.6 total, 35.5 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 39.35 GB write, 1132.01 MB/s write, 34.72 GB read, 998.79 MB/s read, 297.7 seconds Interval compaction: 39.35 GB write, 1136.24 MB/s write, 34.72 GB read, 1002.52 MB/s read, 297.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 109, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 109, interval: 110 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1676349 Average: 15.8170 StdDev: 214.07 Min: 0 Median: 1.7292 Max: 57821 Percentiles: P50: 1.73 P75: 2.65 P99: 302.74 P99.9: 1955.49 P99.99: 3691.30 ------------------------------------------------------ [ 0, 1 ] 163261 9.739% 9.739% ## ( 1, 2 ] 925581 55.214% 64.953% ########### ( 2, 3 ] 258318 15.410% 80.363% ### ( 3, 4 ] 132743 7.919% 88.281% ## ( 4, 6 ] 133643 7.972% 96.254% ## ( 6, 10 ] 24542 1.464% 97.718% ( 10, 15 ] 4606 0.275% 97.992% ( 15, 22 ] 420 0.025% 98.017% ( 22, 34 ] 35 0.002% 98.020% ( 34, 51 ] 42 0.003% 98.022% ( 51, 76 ] 52 0.003% 98.025% ( 76, 110 ] 2078 0.124% 98.149% ( 110, 170 ] 7830 0.467% 98.616% ( 170, 250 ] 4959 0.296% 98.912% ( 250, 380 ] 3637 0.217% 99.129% ( 380, 580 ] 4418 0.264% 99.392% ( 580, 870 ] 4030 0.240% 99.633% ( 870, 1300 ] 2973 0.177% 99.810% ( 1300, 1900 ] 1444 0.086% 99.896% ( 1900, 2900 ] 1093 0.065% 99.962% ( 2900, 4400 ] 903 0.054% 100.015% ( 4400, 6600 ] 191 0.011% 100.027% ( 6600, 9900 ] 26 0.002% 100.028% ( 9900, 14000 ] 13 0.001% 100.029% ( 14000, 22000 ] 20 0.001% 100.030% ( 22000, 33000 ] 24 0.001% 100.032% ( 33000, 50000 ] 8 0.000% 100.032% ( 50000, 75000 ] 2 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 503391 Average: 10.7999 StdDev: 139.67 Min: 1 Median: 1.8723 Max: 30811 Percentiles: P50: 1.87 P75: 2.94 P99: 12.85 P99.9: 1756.93 P99.99: 3528.93 ------------------------------------------------------ [ 0, 1 ] 18620 3.699% 3.699% # ( 1, 2 ] 267206 53.081% 56.780% ########### ( 2, 3 ] 97743 19.417% 76.197% #### ( 3, 4 ] 48226 9.580% 85.777% ## ( 4, 6 ] 53035 10.536% 96.313% ## ( 6, 10 ] 12114 2.406% 98.719% ( 10, 15 ] 2477 0.492% 99.211% ( 15, 22 ] 289 0.057% 99.269% ( 22, 34 ] 19 0.004% 99.273% ( 34, 51 ] 27 0.005% 99.278% ( 51, 76 ] 50 0.010% 99.288% ( 76, 110 ] 103 0.020% 99.308% ( 110, 170 ] 363 0.072% 99.380% ( 170, 250 ] 257 0.051% 99.431% ( 250, 380 ] 314 0.062% 99.494% ( 380, 580 ] 574 0.114% 99.608% ( 580, 870 ] 699 0.139% 99.747% ( 870, 1300 ] 550 0.109% 99.856% ( 1300, 1900 ] 291 0.058% 99.914% ( 1900, 2900 ] 278 0.055% 99.969% ( 2900, 4400 ] 252 0.050% 100.019% ( 4400, 6600 ] 57 0.011% 100.030% ( 6600, 9900 ] 9 0.002% 100.032% ( 14000, 22000 ] 1 0.000% 100.032% ( 22000, 33000 ] 1 0.000% 100.033% ** Level 2 read latency histogram (micros): Count: 524866 Average: 13.5934 StdDev: 197.60 Min: 1 Median: 1.8820 Max: 50609 Percentiles: P50: 1.88 P75: 2.99 P99: 12.48 P99.9: 1468.72 P99.99: 2218.40 ------------------------------------------------------ [ 0, 1 ] 31079 5.921% 5.921% # ( 1, 2 ] 262318 49.978% 55.899% ########## ( 2, 3 ] 101138 19.269% 75.169% #### ( 3, 4 ] 52639 10.029% 85.198% ## ( 4, 6 ] 55731 10.618% 95.816% ## ( 6, 10 ] 14877 2.834% 98.650% # ( 10, 15 ] 3703 0.706% 99.356% ( 15, 22 ] 526 0.100% 99.456% ( 22, 34 ] 103 0.020% 99.476% ( 34, 51 ] 56 0.011% 99.486% ( 51, 76 ] 54 0.010% 99.497% ( 76, 110 ] 21 0.004% 99.501% ( 110, 170 ] 69 0.013% 99.514% ( 170, 250 ] 115 0.022% 99.536% ( 250, 380 ] 229 0.044% 99.579% ( 380, 580 ] 418 0.080% 99.659% ( 580, 870 ] 563 0.107% 99.766% ( 870, 1300 ] 577 0.110% 99.876% ( 1300, 1900 ] 445 0.085% 99.961% ( 1900, 2900 ] 479 0.091% 100.052% ( 2900, 4400 ] 429 0.082% 100.134% ( 4400, 6600 ] 109 0.021% 100.155% ( 6600, 9900 ] 16 0.003% 100.158% ( 9900, 14000 ] 5 0.001% 100.159% ( 14000, 22000 ] 4 0.001% 100.159% ( 22000, 33000 ] 1 0.000% 100.160% ( 33000, 50000 ] 1 0.000% 100.160% ( 50000, 75000 ] 1 0.000% 100.160% ** Level 3 read latency histogram (micros): Count: 2579695 Average: 10.6433 StdDev: 175.94 Min: 1 Median: 1.8729 Max: 54859 Percentiles: P50: 1.87 P75: 2.94 P99: 9.95 P99.9: 930.81 P99.99: 1426.02 ------------------------------------------------------ [ 0, 1 ] 98457 3.817% 3.817% # ( 1, 2 ] 1364932 52.911% 56.727% ########### ( 2, 3 ] 502923 19.495% 76.223% #### ( 3, 4 ] 253657 9.833% 86.055% ## ( 4, 6 ] 273114 10.587% 96.643% ## ( 6, 10 ] 61513 2.385% 99.027% ( 10, 15 ] 13153 0.510% 99.537% ( 15, 22 ] 1528 0.059% 99.596% ( 22, 34 ] 132 0.005% 99.601% ( 34, 51 ] 163 0.006% 99.608% ( 51, 76 ] 196 0.008% 99.615% ( 76, 110 ] 164 0.006% 99.622% ( 110, 170 ] 673 0.026% 99.648% ( 170, 250 ] 728 0.028% 99.676% ( 250, 380 ] 1047 0.041% 99.716% ( 380, 580 ] 1885 0.073% 99.790% ( 580, 870 ] 2517 0.098% 99.887% ( 870, 1300 ] 2357 0.091% 99.978% ( 1300, 1900 ] 1419 0.055% 100.033% ( 1900, 2900 ] 1322 0.051% 100.085% ( 2900, 4400 ] 1376 0.053% 100.138% ( 4400, 6600 ] 394 0.015% 100.153% ( 6600, 9900 ] 71 0.003% 100.156% ( 9900, 14000 ] 20 0.001% 100.157% ( 14000, 22000 ] 34 0.001% 100.158% ( 22000, 33000 ] 19 0.001% 100.159% ( 33000, 50000 ] 2 0.000% 100.159% ( 50000, 75000 ] 1 0.000% 100.159% ** Level 4 read latency histogram (micros): Count: 2278423 Average: 18.9352 StdDev: 266.36 Min: 1 Median: 1.8758 Max: 64980 Percentiles: P50: 1.88 P75: 2.98 P99: 311.82 P99.9: 1900.76 P99.99: 2892.82 ------------------------------------------------------ [ 0, 1 ] 89631 3.934% 3.934% # ( 1, 2 ] 1198389 52.597% 56.531% ########### ( 2, 3 ] 429927 18.869% 75.401% #### ( 3, 4 ] 223349 9.803% 85.203% ## ( 4, 6 ] 234958 10.312% 95.516% ## ( 6, 10 ] 56104 2.462% 97.978% ( 10, 15 ] 11804 0.518% 98.496% ( 15, 22 ] 1191 0.052% 98.549% ( 22, 34 ] 146 0.006% 98.555% ( 34, 51 ] 209 0.009% 98.564% ( 51, 76 ] 227 0.010% 98.574% ( 76, 110 ] 1023 0.045% 98.619% ( 110, 170 ] 3805 0.167% 98.786% ( 170, 250 ] 3240 0.142% 98.928% ( 250, 380 ] 3440 0.151% 99.079% ( 380, 580 ] 5082 0.223% 99.302% ( 580, 870 ] 6106 0.268% 99.570% ( 870, 1300 ] 4859 0.213% 99.783% ( 1300, 1900 ] 2653 0.116% 99.900% ( 1900, 2900 ] 2067 0.091% 99.991% ( 2900, 4400 ] 1830 0.080% 100.071% ( 4400, 6600 ] 510 0.022% 100.093% ( 6600, 9900 ] 93 0.004% 100.097% ( 9900, 14000 ] 41 0.002% 100.099% ( 14000, 22000 ] 64 0.003% 100.102% ( 22000, 33000 ] 48 0.002% 100.104% ( 33000, 50000 ] 11 0.000% 100.105% ( 50000, 75000 ] 5 0.000% 100.105% ** Level 5 read latency histogram (micros): Count: 1505537 Average: 78.6919 StdDev: 472.38 Min: 0 Median: 1.9868 Max: 70972 Percentiles: P50: 1.99 P75: 3.67 P99: 1614.38 P99.9: 3649.61 P99.99: 3989.15 ------------------------------------------------------ [ 0, 1 ] 65301 4.337% 4.337% # ( 1, 2 ] 696632 46.271% 50.609% ######### ( 2, 3 ] 262948 17.465% 68.074% ### ( 3, 4 ] 156120 10.370% 78.444% ## ( 4, 6 ] 152381 10.121% 88.565% ## ( 6, 10 ] 35643 2.367% 90.933% ( 10, 15 ] 9026 0.600% 91.532% ( 15, 22 ] 1020 0.068% 91.600% ( 22, 34 ] 104 0.007% 91.607% ( 34, 51 ] 102 0.007% 91.614% ( 51, 76 ] 133 0.009% 91.622% ( 76, 110 ] 4538 0.301% 91.924% ( 110, 170 ] 18764 1.246% 93.170% ( 170, 250 ] 13829 0.919% 94.089% ( 250, 380 ] 13544 0.900% 94.988% ( 380, 580 ] 19175 1.274% 96.262% ( 580, 870 ] 20751 1.378% 97.640% ( 870, 1300 ] 16140 1.072% 98.712% ( 1300, 1900 ] 8265 0.549% 99.261% ( 1900, 2900 ] 6624 0.440% 99.701% ( 2900, 4400 ] 5986 0.398% 100.099% ( 4400, 6600 ] 1528 0.101% 100.200% ( 6600, 9900 ] 237 0.016% 100.216% ( 9900, 14000 ] 46 0.003% 100.219% ( 14000, 22000 ] 59 0.004% 100.223% ( 22000, 33000 ] 44 0.003% 100.226% ( 33000, 50000 ] 17 0.001% 100.227% ( 50000, 75000 ] 13 0.001% 100.228% ** DB Stats ** Uptime(secs): 35.6 total, 5.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 165.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.437 H:M:S, 34.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 195.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.348 H:M:S, 26.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 370.294 micros/op 10788 ops/sec 60.156 seconds 648996 operations; 10.5 MB/s (163999 of 163999 found) Microseconds per read: Count: 648996 Average: 370.2969 StdDev: 1093.36 Min: 2 Median: 189.4894 Max: 84015 Percentiles: P50: 189.49 P75: 288.22 P99: 3509.46 P99.9: 16656.66 P99.99: 43011.22 ------------------------------------------------------ ( 1, 2 ] 10 0.002% 0.002% ( 2, 3 ] 25 0.004% 0.005% ( 3, 4 ] 36 0.006% 0.011% ( 4, 6 ] 76 0.012% 0.023% ( 6, 10 ] 237 0.037% 0.059% ( 10, 15 ] 2372 0.365% 0.425% ( 15, 22 ] 3448 0.531% 0.956% ( 22, 34 ] 6005 0.925% 1.881% ( 34, 51 ] 3703 0.571% 2.452% ( 51, 76 ] 331 0.051% 2.503% ( 76, 110 ] 10564 1.628% 4.131% ( 110, 170 ] 252629 38.926% 43.057% ######## ( 170, 250 ] 184970 28.501% 71.558% ###### ( 250, 380 ] 75989 11.709% 83.266% ## ( 380, 580 ] 38357 5.910% 89.177% # ( 580, 870 ] 26703 4.115% 93.291% # ( 870, 1300 ] 18759 2.890% 96.181% # ( 1300, 1900 ] 9500 1.464% 97.645% ( 1900, 2900 ] 6611 1.019% 98.664% ( 2900, 4400 ] 5368 0.827% 99.491% ( 4400, 6600 ] 1529 0.236% 99.727% ( 6600, 9900 ] 459 0.071% 99.797% ( 9900, 14000 ] 490 0.076% 99.873% ( 14000, 22000 ] 530 0.082% 99.955% ( 22000, 33000 ] 193 0.030% 99.984% ( 33000, 50000 ] 63 0.010% 99.994% ( 50000, 75000 ] 36 0.006% 100.000% ( 75000, 110000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 11606888 rocksdb.bloom.filter.full.positive COUNT : 761257 rocksdb.bloom.filter.full.true.positive COUNT : 648634 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 362 rocksdb.memtable.miss COUNT : 648634 rocksdb.l0.hit COUNT : 24930 rocksdb.l1.hit COUNT : 3665 rocksdb.l2andup.hit COUNT : 620039 rocksdb.compaction.key.drop.new COUNT : 1079892 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6760542 rocksdb.number.keys.read COUNT : 648996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6976879344 rocksdb.bytes.read COUNT : 648996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1930 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33631386 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 39917806155 rocksdb.compact.write.bytes COUNT : 38807609229 rocksdb.flush.write.bytes COUNT : 6935647096 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 19 rocksdb.number.superversion_acquires COUNT : 1447 rocksdb.number.superversion_releases COUNT : 1414 rocksdb.number.superversion_cleanups COUNT : 362 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 357 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 6880072704 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2983936 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 43287226548 rocksdb.non.last.level.read.count COUNT : 10321630 rocksdb.block.checksum.compute.count COUNT : 10440509 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 188.129840 P95 : 1123.274019 P99 : 3508.224995 P100 : 84013.000000 COUNT : 648996 SUM : 239749347 rocksdb.db.write.micros P50 : 1.579623 P95 : 4.437930 P99 : 8.303010 P100 : 954821.000000 COUNT : 6760542 SUM : 51182569 rocksdb.compaction.times.micros P50 : 1746875.000000 P95 : 4347142.857143 P99 : 6069428.571429 P100 : 6218508.000000 COUNT : 137 SUM : 270837219 rocksdb.compaction.times.cpu_micros P50 : 1062903.225806 P95 : 2721875.000000 P99 : 4127333.333333 P100 : 5031508.000000 COUNT : 137 SUM : 167532088 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 2087.500000 P95 : 141800.000000 P99 : 266900.000000 P100 : 355829.000000 COUNT : 87 SUM : 1978780 rocksdb.compaction.outfile.sync.micros P50 : 19297.297297 P95 : 226952.380952 P99 : 405016.666667 P100 : 498763.000000 COUNT : 521 SUM : 27445337 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 612.222222 P95 : 4010.000000 P99 : 9262.000000 P100 : 21173.000000 COUNT : 258 SUM : 310381 rocksdb.table.open.io.micros P50 : 7871.311475 P95 : 19327.272727 P99 : 23938.095238 P100 : 48417.000000 COUNT : 1930 SUM : 15397509 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.945802 P95 : 9.700673 P99 : 157.977563 P100 : 64986.000000 COUNT : 9668428 SUM : 142736011 rocksdb.read.block.get.micros P50 : 145.776685 P95 : 969.074816 P99 : 3057.571268 P100 : 70980.000000 COUNT : 770176 SUM : 212943104 rocksdb.write.raw.block.micros P50 : 0.521932 P95 : 0.991670 P99 : 3.382379 P100 : 103755.000000 COUNT : 11079929 SUM : 38080815 rocksdb.numfiles.in.singlecompaction P50 : 2.971429 P95 : 8.350000 P99 : 11.400000 P100 : 17.000000 COUNT : 172 SUM : 636 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.574036 P95 : 1246.166054 P99 : 2647.940674 P100 : 954661.000000 COUNT : 121815 SUM : 33645463 rocksdb.sst.read.micros P50 : 1.906062 P95 : 140.203884 P99 : 598.211427 P100 : 70972.000000 COUNT : 10321752 SUM : 331878929 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 648996 SUM : 648996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6760542 SUM : 6976879344 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 335000.000000 P95 : 1015125.000000 P99 : 1163025.000000 P100 : 1183978.000000 COUNT : 87 SUM : 36221573 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 517 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0