[2024-11-20 18:39:49.105762] Starting SPDK v25.01-pre git sha1 5c8d99223 / DPDK 24.03.0 initialization... [2024-11-20 18:39:49.105901] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid308856 ] Set seed to 1732124389103123 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 18:39:49.243786] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 18:39:49.349850] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 18:39:49.349907] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 308856' to capture a snapshot of events at runtime. [2024-11-20 18:39:49.349937] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 18:39:49.349951] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 18:39:49.349961] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid308856 for offline analysis/debug. [2024-11-20 18:39:49.351211] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 18:39:52 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/20-18:39:59 ... thread 0: (1000000,1000000) ops and (146232.7,146232.7) ops/second in (6.838417,6.838417) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/4 878.31 MB 31.4 0.3 0.0 0.3 1.2 0.9 0.0 1.4 37.1 140.8 8.47 4.11 12 0.706 319K 1834 0.0 0.0 L1 1/1 63.31 MB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 1.4 104.7 104.1 2.83 1.46 1 2.830 301K 1803 0.0 0.0 L2 2/1 223.73 MB 1.3 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 33/8 1.78 GB 1.4 2.8 1.9 0.9 2.7 1.8 0.0 1.4 109.2 105.1 25.99 13.95 13 2.000 2040K 11K 0.0 0.0 L4 165/27 11.90 GB 1.0 3.2 1.7 1.5 3.0 1.6 0.8 1.8 123.1 116.2 26.81 16.04 16 1.676 775K 0 0.0 0.0 L5 116/0 9.23 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 325/41 24.04 GB 0.0 6.6 3.8 2.8 7.2 4.4 1.1 8.3 105.3 114.4 64.11 35.56 42 1.526 3436K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.6 3.8 2.8 7.2 4.4 1.1 8.3 105.3 114.4 64.11 35.56 42 1.526 3436K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.6 3.8 2.8 6.3 3.5 0.0 0.0 117.0 111.9 57.68 32.87 31 1.861 3436K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 136.9 6.43 2.70 11 0.584 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.9 total, 6.8 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.16 GB write, 1059.85 MB/s write, 6.59 GB read, 975.23 MB/s read, 64.1 seconds Interval compaction: 7.16 GB write, 1072.49 MB/s write, 6.59 GB read, 986.86 MB/s read, 64.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 18, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 137970 Average: 37.1091 StdDev: 337.99 Min: 1 Median: 2.2126 Max: 39062 Percentiles: P50: 2.21 P75: 3.28 P99: 855.87 P99.9: 4254.04 P99.99: 8781.30 ------------------------------------------------------ [ 0, 1 ] 2434 1.764% 1.764% ( 1, 2 ] 58290 42.248% 44.012% ######## ( 2, 3 ] 38864 28.168% 72.181% ###### ( 3, 4 ] 13859 10.045% 82.226% ## ( 4, 6 ] 15312 11.098% 93.324% ## ( 6, 10 ] 3961 2.871% 96.195% # ( 10, 15 ] 971 0.704% 96.899% ( 15, 22 ] 147 0.107% 97.005% ( 22, 34 ] 20 0.014% 97.020% ( 34, 51 ] 15 0.011% 97.031% ( 51, 76 ] 6 0.004% 97.035% ( 76, 110 ] 5 0.004% 97.038% ( 110, 170 ] 31 0.022% 97.061% ( 170, 250 ] 139 0.101% 97.162% ( 250, 380 ] 498 0.361% 97.523% ( 380, 580 ] 1107 0.802% 98.325% ( 580, 870 ] 979 0.710% 99.035% ( 870, 1300 ] 460 0.333% 99.368% ( 1300, 1900 ] 208 0.151% 99.519% ( 1900, 2900 ] 248 0.180% 99.698% ( 2900, 4400 ] 308 0.223% 99.922% ( 4400, 6600 ] 79 0.057% 99.979% ( 6600, 9900 ] 23 0.017% 99.996% ( 9900, 14000 ] 6 0.004% 100.000% ( 22000, 33000 ] 4 0.003% 100.003% ( 33000, 50000 ] 1 0.001% 100.004% ** Level 1 read latency histogram (micros): Count: 22067 Average: 34.3009 StdDev: 328.24 Min: 1 Median: 2.3645 Max: 23671 Percentiles: P50: 2.36 P75: 3.52 P99: 807.94 P99.9: 4172.49 P99.99: 9786.31 ------------------------------------------------------ [ 0, 1 ] 160 0.725% 0.725% ( 1, 2 ] 8491 38.478% 39.203% ######## ( 2, 3 ] 6536 29.619% 68.822% ###### ( 3, 4 ] 2623 11.887% 80.709% ## ( 4, 6 ] 2725 12.349% 93.058% ## ( 6, 10 ] 728 3.299% 96.357% # ( 10, 15 ] 149 0.675% 97.032% ( 15, 22 ] 21 0.095% 97.127% ( 22, 34 ] 4 0.018% 97.145% ( 34, 51 ] 7 0.032% 97.177% ( 51, 76 ] 4 0.018% 97.195% ( 76, 110 ] 1 0.005% 97.199% ( 110, 170 ] 8 0.036% 97.236% ( 170, 250 ] 25 0.113% 97.349% ( 250, 380 ] 75 0.340% 97.689% ( 380, 580 ] 162 0.734% 98.423% ( 580, 870 ] 162 0.734% 99.157% ( 870, 1300 ] 78 0.353% 99.511% ( 1300, 1900 ] 20 0.091% 99.601% ( 1900, 2900 ] 32 0.145% 99.746% ( 2900, 4400 ] 40 0.181% 99.927% ( 4400, 6600 ] 8 0.036% 99.964% ( 6600, 9900 ] 6 0.027% 99.991% ( 14000, 22000 ] 1 0.005% 99.995% ( 22000, 33000 ] 1 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 410966 Average: 14.2487 StdDev: 219.48 Min: 1 Median: 2.3124 Max: 27086 Percentiles: P50: 2.31 P75: 3.34 P99: 13.45 P99.9: 1360.64 P99.99: 2453.83 ------------------------------------------------------ [ 0, 1 ] 3470 0.844% 0.844% ( 1, 2 ] 162581 39.561% 40.405% ######## ( 2, 3 ] 126216 30.712% 71.117% ###### ( 3, 4 ] 46334 11.274% 82.391% ## ( 4, 6 ] 52661 12.814% 95.205% ### ( 6, 10 ] 12986 3.160% 98.365% # ( 10, 15 ] 3779 0.920% 99.285% ( 15, 22 ] 665 0.162% 99.447% ( 22, 34 ] 100 0.024% 99.471% ( 34, 51 ] 113 0.027% 99.498% ( 51, 76 ] 83 0.020% 99.519% ( 76, 110 ] 28 0.007% 99.526% ( 110, 170 ] 30 0.007% 99.533% ( 170, 250 ] 57 0.014% 99.547% ( 250, 380 ] 261 0.064% 99.610% ( 380, 580 ] 431 0.105% 99.715% ( 580, 870 ] 463 0.113% 99.828% ( 870, 1300 ] 275 0.067% 99.895% ( 1300, 1900 ] 218 0.053% 99.948% ( 1900, 2900 ] 314 0.076% 100.024% ( 2900, 4400 ] 334 0.081% 100.105% ( 4400, 6600 ] 124 0.030% 100.136% ( 6600, 9900 ] 36 0.009% 100.144% ( 9900, 14000 ] 12 0.003% 100.147% ( 14000, 22000 ] 9 0.002% 100.149% ( 22000, 33000 ] 5 0.001% 100.151% ** Level 3 read latency histogram (micros): Count: 649890 Average: 16.7576 StdDev: 228.41 Min: 0 Median: 2.3633 Max: 42110 Percentiles: P50: 2.36 P75: 3.38 P99: 14.76 P99.9: 996.47 P99.99: 1371.77 ------------------------------------------------------ [ 0, 1 ] 3834 0.590% 0.590% ( 1, 2 ] 244486 37.620% 38.210% ######## ( 2, 3 ] 210899 32.451% 70.661% ###### ( 3, 4 ] 74945 11.532% 82.193% ## ( 4, 6 ] 84235 12.961% 95.154% ### ( 6, 10 ] 20600 3.170% 98.324% # ( 10, 15 ] 4617 0.710% 99.035% ( 15, 22 ] 635 0.098% 99.132% ( 22, 34 ] 112 0.017% 99.150% ( 34, 51 ] 228 0.035% 99.185% ( 51, 76 ] 129 0.020% 99.204% ( 76, 110 ] 62 0.010% 99.214% ( 110, 170 ] 62 0.010% 99.224% ( 170, 250 ] 240 0.037% 99.260% ( 250, 380 ] 725 0.112% 99.372% ( 380, 580 ] 1629 0.251% 99.623% ( 580, 870 ] 1578 0.243% 99.866% ( 870, 1300 ] 762 0.117% 99.983% ( 1300, 1900 ] 393 0.060% 100.043% ( 1900, 2900 ] 503 0.077% 100.121% ( 2900, 4400 ] 657 0.101% 100.222% ( 4400, 6600 ] 161 0.025% 100.247% ( 6600, 9900 ] 39 0.006% 100.253% ( 9900, 14000 ] 9 0.001% 100.254% ( 14000, 22000 ] 8 0.001% 100.255% ( 22000, 33000 ] 7 0.001% 100.256% ( 33000, 50000 ] 3 0.000% 100.257% ** Level 4 read latency histogram (micros): Count: 582976 Average: 31.1087 StdDev: 363.20 Min: 1 Median: 2.3908 Max: 47096 Percentiles: P50: 2.39 P75: 3.49 P99: 576.56 P99.9: 1650.22 P99.99: 2155.62 ------------------------------------------------------ [ 0, 1 ] 4437 0.761% 0.761% ( 1, 2 ] 214859 36.856% 37.617% ####### ( 2, 3 ] 184713 31.684% 69.301% ###### ( 3, 4 ] 68469 11.745% 81.046% ## ( 4, 6 ] 76158 13.064% 94.110% ### ( 6, 10 ] 18278 3.135% 97.245% # ( 10, 15 ] 4080 0.700% 97.945% ( 15, 22 ] 524 0.090% 98.035% ( 22, 34 ] 98 0.017% 98.051% ( 34, 51 ] 216 0.037% 98.088% ( 51, 76 ] 123 0.021% 98.110% ( 76, 110 ] 54 0.009% 98.119% ( 110, 170 ] 91 0.016% 98.134% ( 170, 250 ] 426 0.073% 98.207% ( 250, 380 ] 1440 0.247% 98.454% ( 380, 580 ] 3238 0.555% 99.010% ( 580, 870 ] 3195 0.548% 99.558% ( 870, 1300 ] 1560 0.268% 99.826% ( 1300, 1900 ] 747 0.128% 99.954% ( 1900, 2900 ] 836 0.143% 100.097% ( 2900, 4400 ] 1020 0.175% 100.272% ( 4400, 6600 ] 274 0.047% 100.319% ( 6600, 9900 ] 59 0.010% 100.329% ( 9900, 14000 ] 22 0.004% 100.333% ( 14000, 22000 ] 22 0.004% 100.337% ( 22000, 33000 ] 26 0.004% 100.341% ( 33000, 50000 ] 10 0.002% 100.343% ** Level 5 read latency histogram (micros): Count: 8628 Average: 1083.8574 StdDev: 1450.31 Min: 116 Median: 652.5971 Max: 32746 Percentiles: P50: 652.60 P75: 1082.33 P99: 6030.97 P99.9: 19488.00 P99.99: 30723.24 ------------------------------------------------------ ( 110, 170 ] 42 0.487% 0.487% ( 170, 250 ] 271 3.141% 3.628% # ( 250, 380 ] 1065 12.344% 15.971% ## ( 380, 580 ] 2375 27.527% 43.498% ###### ( 580, 870 ] 2241 25.974% 69.471% ##### ( 870, 1300 ] 966 11.196% 80.668% ## ( 1300, 1900 ] 411 4.764% 85.431% # ( 1900, 2900 ] 464 5.378% 90.809% # ( 2900, 4400 ] 597 6.919% 97.728% # ( 4400, 6600 ] 148 1.715% 99.444% ( 6600, 9900 ] 32 0.371% 99.815% ( 9900, 14000 ] 6 0.070% 99.884% ( 14000, 22000 ] 2 0.023% 99.907% ( 22000, 33000 ] 9 0.104% 100.012% ** DB Stats ** Uptime(secs): 6.9 total, 6.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 142.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.079 H:M:S, 30.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 143.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.079 H:M:S, 30.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/20-18:40:04 ... thread 0: (1000000,2000000) ops and (182308.1,162289.8) ops/second in (5.485219,12.323636) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/8 1.84 GB 106.4 1.2 0.0 1.2 3.0 1.8 0.0 1.6 57.5 147.8 20.79 10.76 29 0.717 1213K 6854 0.0 0.0 L1 1/1 63.31 MB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 1.4 104.7 104.1 2.83 1.46 1 2.830 301K 1803 0.0 0.0 L2 1/1 128.78 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/6 995.24 MB 0.6 2.9 2.0 0.9 2.8 1.9 0.0 1.4 109.9 105.9 26.71 14.45 14 1.908 2136K 11K 0.0 0.0 L4 150/0 9.67 GB 1.0 8.5 2.6 5.9 7.4 1.6 0.8 2.8 141.0 123.0 61.68 38.77 33 1.869 1712K 0 0.0 0.0 L5 148/0 11.45 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 331/16 24.12 GB 0.0 12.8 4.8 8.0 13.5 5.5 3.3 7.3 117.1 123.1 112.01 65.44 77 1.455 5363K 20K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.8 4.8 8.0 13.5 5.5 3.3 7.3 117.1 123.1 112.01 65.44 77 1.455 5363K 20K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.8 4.8 8.0 11.6 3.6 0.0 0.0 130.3 118.2 100.66 59.81 52 1.936 5363K 20K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 166.2 11.35 5.63 25 0.454 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.3 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.46 GB write, 1111.05 MB/s write, 12.81 GB read, 1057.45 MB/s read, 112.0 seconds Interval compaction: 13.46 GB write, 1118.41 MB/s write, 12.81 GB read, 1064.45 MB/s read, 112.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 27, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 468762 Average: 34.0928 StdDev: 313.80 Min: 1 Median: 1.9894 Max: 55022 Percentiles: P50: 1.99 P75: 2.92 P99: 730.50 P99.9: 1956.18 P99.99: 2610.27 ------------------------------------------------------ [ 0, 1 ] 13427 2.864% 2.864% # ( 1, 2 ] 223326 47.642% 50.506% ########## ( 2, 3 ] 124825 26.629% 77.135% ##### ( 3, 4 ] 39288 8.381% 85.516% ## ( 4, 6 ] 38134 8.135% 93.651% ## ( 6, 10 ] 10941 2.334% 95.985% ( 10, 15 ] 2304 0.492% 96.476% ( 15, 22 ] 315 0.067% 96.544% ( 22, 34 ] 40 0.009% 96.552% ( 34, 51 ] 28 0.006% 96.558% ( 51, 76 ] 9 0.002% 96.560% ( 76, 110 ] 38 0.008% 96.568% ( 110, 170 ] 580 0.124% 96.692% ( 170, 250 ] 2084 0.445% 97.136% ( 250, 380 ] 2787 0.595% 97.731% ( 380, 580 ] 3980 0.849% 98.580% ( 580, 870 ] 3793 0.809% 99.389% ( 870, 1300 ] 1818 0.388% 99.777% ( 1300, 1900 ] 540 0.115% 99.892% ( 1900, 2900 ] 645 0.138% 100.030% ( 2900, 4400 ] 709 0.151% 100.181% ( 4400, 6600 ] 189 0.040% 100.221% ( 6600, 9900 ] 33 0.007% 100.228% ( 9900, 14000 ] 12 0.003% 100.231% ( 14000, 22000 ] 3 0.001% 100.232% ( 22000, 33000 ] 10 0.002% 100.234% ( 33000, 50000 ] 4 0.001% 100.235% ( 50000, 75000 ] 1 0.000% 100.235% ** Level 1 read latency histogram (micros): Count: 67855 Average: 19.5970 StdDev: 244.31 Min: 1 Median: 2.2409 Max: 26563 Percentiles: P50: 2.24 P75: 3.21 P99: 458.24 P99.9: 3084.78 P99.99: 6717.97 ------------------------------------------------------ [ 0, 1 ] 1170 1.724% 1.724% ( 1, 2 ] 27834 41.020% 42.744% ######## ( 2, 3 ] 20436 30.117% 72.861% ###### ( 3, 4 ] 6885 10.147% 83.008% ## ( 4, 6 ] 7460 10.994% 94.002% ## ( 6, 10 ] 2142 3.157% 97.159% # ( 10, 15 ] 434 0.640% 97.798% ( 15, 22 ] 61 0.090% 97.888% ( 22, 34 ] 12 0.018% 97.906% ( 34, 51 ] 24 0.035% 97.941% ( 51, 76 ] 21 0.031% 97.972% ( 76, 110 ] 5 0.007% 97.980% ( 110, 170 ] 64 0.094% 98.074% ( 170, 250 ] 268 0.395% 98.469% ( 250, 380 ] 247 0.364% 98.833% ( 380, 580 ] 290 0.427% 99.260% ( 580, 870 ] 234 0.345% 99.605% ( 870, 1300 ] 115 0.169% 99.775% ( 1300, 1900 ] 36 0.053% 99.828% ( 1900, 2900 ] 42 0.062% 99.889% ( 2900, 4400 ] 58 0.085% 99.975% ( 4400, 6600 ] 10 0.015% 99.990% ( 6600, 9900 ] 6 0.009% 99.999% ( 14000, 22000 ] 2 0.003% 100.001% ( 22000, 33000 ] 2 0.003% 100.004% ** Level 2 read latency histogram (micros): Count: 410966 Average: 14.2487 StdDev: 219.48 Min: 1 Median: 2.3124 Max: 27086 Percentiles: P50: 2.31 P75: 3.34 P99: 13.45 P99.9: 1360.64 P99.99: 2453.83 ------------------------------------------------------ [ 0, 1 ] 3470 0.844% 0.844% ( 1, 2 ] 162581 39.561% 40.405% ######## ( 2, 3 ] 126216 30.712% 71.117% ###### ( 3, 4 ] 46334 11.274% 82.391% ## ( 4, 6 ] 52661 12.814% 95.205% ### ( 6, 10 ] 12986 3.160% 98.365% # ( 10, 15 ] 3779 0.920% 99.285% ( 15, 22 ] 665 0.162% 99.447% ( 22, 34 ] 100 0.024% 99.471% ( 34, 51 ] 113 0.027% 99.498% ( 51, 76 ] 83 0.020% 99.519% ( 76, 110 ] 28 0.007% 99.526% ( 110, 170 ] 30 0.007% 99.533% ( 170, 250 ] 57 0.014% 99.547% ( 250, 380 ] 261 0.064% 99.610% ( 380, 580 ] 431 0.105% 99.715% ( 580, 870 ] 463 0.113% 99.828% ( 870, 1300 ] 275 0.067% 99.895% ( 1300, 1900 ] 218 0.053% 99.948% ( 1900, 2900 ] 314 0.076% 100.024% ( 2900, 4400 ] 334 0.081% 100.105% ( 4400, 6600 ] 124 0.030% 100.136% ( 6600, 9900 ] 36 0.009% 100.144% ( 9900, 14000 ] 12 0.003% 100.147% ( 14000, 22000 ] 9 0.002% 100.149% ( 22000, 33000 ] 5 0.001% 100.151% ** Level 3 read latency histogram (micros): Count: 897695 Average: 16.9716 StdDev: 240.37 Min: 0 Median: 2.3588 Max: 45838 Percentiles: P50: 2.36 P75: 3.38 P99: 176.76 P99.9: 1120.73 P99.99: 1666.74 ------------------------------------------------------ [ 0, 1 ] 6307 0.703% 0.703% ( 1, 2 ] 339161 37.781% 38.484% ######## ( 2, 3 ] 288156 32.100% 70.583% ###### ( 3, 4 ] 103174 11.493% 82.077% ## ( 4, 6 ] 114826 12.791% 94.868% ### ( 6, 10 ] 28664 3.193% 98.061% # ( 10, 15 ] 6415 0.715% 98.776% ( 15, 22 ] 893 0.099% 98.875% ( 22, 34 ] 154 0.017% 98.892% ( 34, 51 ] 294 0.033% 98.925% ( 51, 76 ] 178 0.020% 98.945% ( 76, 110 ] 90 0.010% 98.955% ( 110, 170 ] 317 0.035% 98.990% ( 170, 250 ] 1065 0.119% 99.109% ( 250, 380 ] 1501 0.167% 99.276% ( 380, 580 ] 2527 0.281% 99.557% ( 580, 870 ] 2390 0.266% 99.824% ( 870, 1300 ] 1177 0.131% 99.955% ( 1300, 1900 ] 519 0.058% 100.013% ( 1900, 2900 ] 640 0.071% 100.084% ( 2900, 4400 ] 813 0.091% 100.174% ( 4400, 6600 ] 186 0.021% 100.195% ( 6600, 9900 ] 46 0.005% 100.200% ( 9900, 14000 ] 13 0.001% 100.202% ( 14000, 22000 ] 13 0.001% 100.203% ( 22000, 33000 ] 10 0.001% 100.204% ( 33000, 50000 ] 8 0.001% 100.205% ** Level 4 read latency histogram (micros): Count: 1534788 Average: 23.0761 StdDev: 290.02 Min: 1 Median: 2.4072 Max: 47096 Percentiles: P50: 2.41 P75: 3.52 P99: 367.37 P99.9: 958.28 P99.99: 1157.46 ------------------------------------------------------ [ 0, 1 ] 11298 0.736% 0.736% ( 1, 2 ] 559077 36.427% 37.163% ####### ( 2, 3 ] 483780 31.521% 68.684% ###### ( 3, 4 ] 187148 12.194% 80.878% ## ( 4, 6 ] 204050 13.295% 94.173% ### ( 6, 10 ] 49497 3.225% 97.398% # ( 10, 15 ] 11832 0.771% 98.169% ( 15, 22 ] 1564 0.102% 98.271% ( 22, 34 ] 294 0.019% 98.290% ( 34, 51 ] 527 0.034% 98.324% ( 51, 76 ] 358 0.023% 98.347% ( 76, 110 ] 160 0.010% 98.358% ( 110, 170 ] 1402 0.091% 98.449% ( 170, 250 ] 4244 0.277% 98.726% ( 250, 380 ] 4662 0.304% 99.030% ( 380, 580 ] 6592 0.430% 99.459% ( 580, 870 ] 6156 0.401% 99.860% ( 870, 1300 ] 2982 0.194% 100.054% ( 1300, 1900 ] 1287 0.084% 100.138% ( 1900, 2900 ] 1604 0.105% 100.243% ( 2900, 4400 ] 1666 0.109% 100.351% ( 4400, 6600 ] 440 0.029% 100.380% ( 6600, 9900 ] 89 0.006% 100.386% ( 9900, 14000 ] 33 0.002% 100.388% ( 14000, 22000 ] 42 0.003% 100.391% ( 22000, 33000 ] 42 0.003% 100.393% ( 33000, 50000 ] 16 0.001% 100.394% ** Level 5 read latency histogram (micros): Count: 19516 Average: 821.8181 StdDev: 1361.31 Min: 97 Median: 498.4580 Max: 43363 Percentiles: P50: 498.46 P75: 814.82 P99: 5227.29 P99.9: 19574.40 P99.99: 37455.70 ------------------------------------------------------ ( 76, 110 ] 42 0.215% 0.215% ( 110, 170 ] 955 4.893% 5.109% # ( 170, 250 ] 2979 15.264% 20.373% ### ( 250, 380 ] 3170 16.243% 36.616% ### ( 380, 580 ] 4410 22.597% 59.213% ##### ( 580, 870 ] 3805 19.497% 78.710% #### ( 870, 1300 ] 1702 8.721% 87.431% ## ( 1300, 1900 ] 605 3.100% 90.531% # ( 1900, 2900 ] 737 3.776% 94.307% # ( 2900, 4400 ] 838 4.294% 98.601% # ( 4400, 6600 ] 207 1.061% 99.662% ( 6600, 9900 ] 37 0.190% 99.851% ( 9900, 14000 ] 6 0.031% 99.882% ( 14000, 22000 ] 5 0.026% 99.908% ( 22000, 33000 ] 15 0.077% 99.985% ( 33000, 50000 ] 4 0.020% 100.005% ** DB Stats ** Uptime(secs): 12.4 total, 5.5 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 158.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.400 H:M:S, 27.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 179.43 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.321 H:M:S, 24.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/20-18:40:08 ... thread 0: (1000000,3000000) ops and (275606.8,188064.3) ops/second in (3.628357,15.951993) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/8 2.26 GB 181.5 1.9 0.0 1.9 4.7 2.8 0.0 1.7 72.7 180.1 26.83 16.41 48 0.559 1979K 10K 0.0 0.0 L1 7/0 620.38 MB 62.0 0.9 0.8 0.1 0.9 0.8 0.0 1.2 81.2 80.5 11.37 4.59 2 5.686 938K 8684 0.0 0.0 L3 16/0 888.12 MB 0.9 3.3 2.1 1.2 3.2 2.0 0.0 1.5 116.8 113.0 29.23 16.75 15 1.948 2570K 11K 0.0 0.0 L4 150/0 9.59 GB 1.0 8.5 2.6 5.9 7.4 1.6 1.1 2.8 141.0 123.0 61.68 38.77 33 1.869 1712K 0 0.0 0.0 L5 152/0 11.76 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 341/8 25.09 GB 0.0 14.6 5.5 9.1 16.2 7.1 3.6 5.8 116.0 128.9 129.10 76.52 98 1.317 7200K 30K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.6 5.5 9.1 16.2 7.1 3.6 5.8 116.0 128.9 129.10 76.52 98 1.317 7200K 30K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.6 5.5 9.1 13.4 4.3 0.0 0.0 130.7 119.9 114.66 68.12 57 2.012 7200K 30K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 200.3 14.45 8.39 41 0.352 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.0 total, 16.0 interval Flush(GB): cumulative 2.825, interval 2.825 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.25 GB write, 1037.61 MB/s write, 14.63 GB read, 934.27 MB/s read, 129.1 seconds Interval compaction: 16.25 GB write, 1042.92 MB/s write, 14.63 GB read, 939.05 MB/s read, 129.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 27, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 773719 Average: 23.7216 StdDev: 245.67 Min: 1 Median: 1.7783 Max: 55022 Percentiles: P50: 1.78 P75: 2.64 P99: 525.10 P99.9: 1397.91 P99.99: 2277.72 ------------------------------------------------------ [ 0, 1 ] 68947 8.911% 8.911% ## ( 1, 2 ] 408456 52.791% 61.702% ########### ( 2, 3 ] 162010 20.939% 82.642% #### ( 3, 4 ] 48985 6.331% 88.973% # ( 4, 6 ] 44902 5.803% 94.776% # ( 6, 10 ] 12944 1.673% 96.449% ( 10, 15 ] 2692 0.348% 96.797% ( 15, 22 ] 388 0.050% 96.847% ( 22, 34 ] 62 0.008% 96.855% ( 34, 51 ] 29 0.004% 96.859% ( 51, 76 ] 11 0.001% 96.860% ( 76, 110 ] 210 0.027% 96.887% ( 110, 170 ] 3117 0.403% 97.290% ( 170, 250 ] 6317 0.816% 98.107% ( 250, 380 ] 3761 0.486% 98.593% ( 380, 580 ] 4343 0.561% 99.154% ( 580, 870 ] 3859 0.499% 99.653% ( 870, 1300 ] 1824 0.236% 99.889% ( 1300, 1900 ] 541 0.070% 99.959% ( 1900, 2900 ] 645 0.083% 100.042% ( 2900, 4400 ] 709 0.092% 100.134% ( 4400, 6600 ] 189 0.024% 100.158% ( 6600, 9900 ] 33 0.004% 100.162% ( 9900, 14000 ] 12 0.002% 100.164% ( 14000, 22000 ] 3 0.000% 100.164% ( 22000, 33000 ] 10 0.001% 100.165% ( 33000, 50000 ] 4 0.001% 100.166% ( 50000, 75000 ] 1 0.000% 100.166% ** Level 1 read latency histogram (micros): Count: 96210 Average: 16.7589 StdDev: 206.55 Min: 1 Median: 2.0517 Max: 26563 Percentiles: P50: 2.05 P75: 2.94 P99: 334.50 P99.9: 2383.49 P99.99: 5803.38 ------------------------------------------------------ [ 0, 1 ] 2284 2.374% 2.374% ( 1, 2 ] 44426 46.176% 48.550% ######### ( 2, 3 ] 26994 28.057% 76.607% ###### ( 3, 4 ] 8203 8.526% 85.134% ## ( 4, 6 ] 8584 8.922% 94.056% ## ( 6, 10 ] 2699 2.805% 96.861% # ( 10, 15 ] 484 0.503% 97.364% ( 15, 22 ] 68 0.071% 97.435% ( 22, 34 ] 17 0.018% 97.452% ( 34, 51 ] 24 0.025% 97.477% ( 51, 76 ] 21 0.022% 97.499% ( 76, 110 ] 22 0.023% 97.522% ( 110, 170 ] 410 0.426% 97.948% ( 170, 250 ] 787 0.818% 98.766% ( 250, 380 ] 346 0.360% 99.126% ( 380, 580 ] 327 0.340% 99.466% ( 580, 870 ] 244 0.254% 99.719% ( 870, 1300 ] 117 0.122% 99.841% ( 1300, 1900 ] 36 0.037% 99.878% ( 1900, 2900 ] 43 0.045% 99.923% ( 2900, 4400 ] 58 0.060% 99.983% ( 4400, 6600 ] 10 0.010% 99.994% ( 6600, 9900 ] 6 0.006% 100.000% ( 14000, 22000 ] 2 0.002% 100.002% ( 22000, 33000 ] 2 0.002% 100.004% ** Level 2 read latency histogram (micros): Count: 410966 Average: 14.2487 StdDev: 219.48 Min: 1 Median: 2.3124 Max: 27086 Percentiles: P50: 2.31 P75: 3.34 P99: 13.45 P99.9: 1360.64 P99.99: 2453.83 ------------------------------------------------------ [ 0, 1 ] 3470 0.844% 0.844% ( 1, 2 ] 162581 39.561% 40.405% ######## ( 2, 3 ] 126216 30.712% 71.117% ###### ( 3, 4 ] 46334 11.274% 82.391% ## ( 4, 6 ] 52661 12.814% 95.205% ### ( 6, 10 ] 12986 3.160% 98.365% # ( 10, 15 ] 3779 0.920% 99.285% ( 15, 22 ] 665 0.162% 99.447% ( 22, 34 ] 100 0.024% 99.471% ( 34, 51 ] 113 0.027% 99.498% ( 51, 76 ] 83 0.020% 99.519% ( 76, 110 ] 28 0.007% 99.526% ( 110, 170 ] 30 0.007% 99.533% ( 170, 250 ] 57 0.014% 99.547% ( 250, 380 ] 261 0.064% 99.610% ( 380, 580 ] 431 0.105% 99.715% ( 580, 870 ] 463 0.113% 99.828% ( 870, 1300 ] 275 0.067% 99.895% ( 1300, 1900 ] 218 0.053% 99.948% ( 1900, 2900 ] 314 0.076% 100.024% ( 2900, 4400 ] 334 0.081% 100.105% ( 4400, 6600 ] 124 0.030% 100.136% ( 6600, 9900 ] 36 0.009% 100.144% ( 9900, 14000 ] 12 0.003% 100.147% ( 14000, 22000 ] 9 0.002% 100.149% ( 22000, 33000 ] 5 0.001% 100.151% ** Level 3 read latency histogram (micros): Count: 941040 Average: 17.2716 StdDev: 235.22 Min: 0 Median: 2.3409 Max: 45838 Percentiles: P50: 2.34 P75: 3.36 P99: 233.38 P99.9: 1103.97 P99.99: 1658.26 ------------------------------------------------------ [ 0, 1 ] 7078 0.752% 0.752% ( 1, 2 ] 361549 38.420% 39.172% ######## ( 2, 3 ] 298883 31.761% 70.933% ###### ( 3, 4 ] 105377 11.198% 82.131% ## ( 4, 6 ] 116663 12.397% 94.528% ## ( 6, 10 ] 29518 3.137% 97.665% # ( 10, 15 ] 6556 0.697% 98.362% ( 15, 22 ] 924 0.098% 98.460% ( 22, 34 ] 157 0.017% 98.477% ( 34, 51 ] 296 0.031% 98.508% ( 51, 76 ] 179 0.019% 98.527% ( 76, 110 ] 188 0.020% 98.547% ( 110, 170 ] 1682 0.179% 98.726% ( 170, 250 ] 3256 0.346% 99.072% ( 250, 380 ] 2018 0.214% 99.286% ( 380, 580 ] 2711 0.288% 99.574% ( 580, 870 ] 2423 0.257% 99.832% ( 870, 1300 ] 1178 0.125% 99.957% ( 1300, 1900 ] 519 0.055% 100.012% ( 1900, 2900 ] 640 0.068% 100.080% ( 2900, 4400 ] 813 0.086% 100.167% ( 4400, 6600 ] 186 0.020% 100.186% ( 6600, 9900 ] 46 0.005% 100.191% ( 9900, 14000 ] 13 0.001% 100.193% ( 14000, 22000 ] 13 0.001% 100.194% ( 22000, 33000 ] 10 0.001% 100.195% ( 33000, 50000 ] 8 0.001% 100.196% ** Level 4 read latency histogram (micros): Count: 1561928 Average: 26.2240 StdDev: 288.66 Min: 1 Median: 2.4353 Max: 47096 Percentiles: P50: 2.44 P75: 3.63 P99: 392.21 P99.9: 955.29 P99.99: 1157.45 ------------------------------------------------------ [ 0, 1 ] 11298 0.723% 0.723% ( 1, 2 ] 559082 35.794% 36.518% ####### ( 2, 3 ] 483796 30.974% 67.492% ###### ( 3, 4 ] 187161 11.983% 79.475% ## ( 4, 6 ] 204058 13.064% 92.539% ### ( 6, 10 ] 49502 3.169% 95.708% # ( 10, 15 ] 11833 0.758% 96.466% ( 15, 22 ] 1564 0.100% 96.566% ( 22, 34 ] 294 0.019% 96.585% ( 34, 51 ] 527 0.034% 96.619% ( 51, 76 ] 358 0.023% 96.642% ( 76, 110 ] 746 0.048% 96.689% ( 110, 170 ] 10172 0.651% 97.341% ( 170, 250 ] 17851 1.143% 98.484% ( 250, 380 ] 7602 0.487% 98.970% ( 380, 580 ] 7612 0.487% 99.458% ( 580, 870 ] 6317 0.404% 99.862% ( 870, 1300 ] 2990 0.191% 100.053% ( 1300, 1900 ] 1288 0.082% 100.136% ( 1900, 2900 ] 1604 0.103% 100.239% ( 2900, 4400 ] 1666 0.107% 100.345% ( 4400, 6600 ] 440 0.028% 100.373% ( 6600, 9900 ] 89 0.006% 100.379% ( 9900, 14000 ] 33 0.002% 100.381% ( 14000, 22000 ] 42 0.003% 100.384% ( 22000, 33000 ] 42 0.003% 100.387% ( 33000, 50000 ] 16 0.001% 100.388% ** Level 5 read latency histogram (micros): Count: 38818 Average: 515.0853 StdDev: 1014.93 Min: 90 Median: 244.5608 Max: 43363 Percentiles: P50: 244.56 P75: 517.04 P99: 4193.83 P99.9: 9024.34 P99.99: 32353.35 ------------------------------------------------------ ( 76, 110 ] 492 1.267% 1.267% ( 110, 170 ] 7183 18.504% 19.772% #### ( 170, 250 ] 12590 32.433% 52.205% ###### ( 250, 380 ] 5354 13.793% 65.998% ### ( 380, 580 ] 5100 13.138% 79.136% ### ( 580, 870 ] 3936 10.140% 89.276% ## ( 870, 1300 ] 1709 4.403% 93.678% # ( 1300, 1900 ] 606 1.561% 95.239% ( 1900, 2900 ] 737 1.899% 97.138% ( 2900, 4400 ] 838 2.159% 99.297% ( 4400, 6600 ] 207 0.533% 99.830% ( 6600, 9900 ] 37 0.095% 99.925% ( 9900, 14000 ] 6 0.015% 99.941% ( 14000, 22000 ] 5 0.013% 99.954% ( 22000, 33000 ] 15 0.039% 99.992% ( 33000, 50000 ] 4 0.010% 100.003% ** DB Stats ** Uptime(secs): 16.0 total, 3.6 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 184.12 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.400 H:M:S, 21.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 271.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/11/20-18:40:11 ... thread 0: (1000000,4000000) ops and (276336.3,204386.4) ops/second in (3.618779,19.570772) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/4 3.18 GB 300.5 2.9 0.0 2.9 6.6 3.7 0.0 1.8 88.5 202.9 33.40 22.62 67 0.499 3001K 15K 0.0 0.0 L1 7/0 620.38 MB 62.0 0.9 0.8 0.1 0.9 0.8 0.0 1.2 81.2 80.5 11.37 4.59 2 5.686 938K 8684 0.0 0.0 L3 16/0 888.12 MB 0.9 3.3 2.1 1.2 3.2 2.0 0.0 1.5 116.8 113.0 29.23 16.75 15 1.948 2570K 11K 0.0 0.0 L4 150/0 9.59 GB 1.0 8.5 2.6 5.9 7.4 1.6 1.1 2.8 141.0 123.0 61.68 38.77 33 1.869 1712K 0 0.0 0.0 L5 152/0 11.76 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 344/4 26.01 GB 0.0 15.6 5.5 10.1 18.1 8.0 3.6 4.8 117.8 137.0 135.68 82.73 117 1.160 8222K 35K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.6 5.5 10.1 18.1 8.0 3.6 4.8 117.8 137.0 135.68 82.73 117 1.160 8222K 35K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.6 5.5 10.1 14.4 4.3 0.0 0.0 134.9 124.4 118.50 71.88 61 1.943 8222K 35K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 223.3 17.18 10.84 56 0.307 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.7 total, 19.6 interval Flush(GB): cumulative 3.747, interval 3.747 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.15 GB write, 945.53 MB/s write, 15.61 GB read, 813.46 MB/s read, 135.7 seconds Interval compaction: 18.15 GB write, 949.47 MB/s write, 15.61 GB read, 816.86 MB/s read, 135.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 27, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1042692 Average: 19.7590 StdDev: 212.53 Min: 1 Median: 1.6814 Max: 55022 Percentiles: P50: 1.68 P75: 2.43 P99: 405.63 P99.9: 1231.70 P99.99: 2063.92 ------------------------------------------------------ [ 0, 1 ] 134306 12.881% 12.881% ### ( 1, 2 ] 567979 54.472% 67.353% ########### ( 2, 3 ] 183595 17.608% 84.961% #### ( 3, 4 ] 55758 5.348% 90.308% # ( 4, 6 ] 49947 4.790% 95.099% # ( 6, 10 ] 14192 1.361% 96.460% ( 10, 15 ] 3043 0.292% 96.751% ( 15, 22 ] 441 0.042% 96.794% ( 22, 34 ] 91 0.009% 96.803% ( 34, 51 ] 30 0.003% 96.805% ( 51, 76 ] 11 0.001% 96.806% ( 76, 110 ] 408 0.039% 96.846% ( 110, 170 ] 6603 0.633% 97.479% ( 170, 250 ] 10902 1.046% 98.524% ( 250, 380 ] 4378 0.420% 98.944% ( 380, 580 ] 4534 0.435% 99.379% ( 580, 870 ] 3892 0.373% 99.752% ( 870, 1300 ] 1830 0.176% 99.928% ( 1300, 1900 ] 542 0.052% 99.980% ( 1900, 2900 ] 645 0.062% 100.042% ( 2900, 4400 ] 709 0.068% 100.110% ( 4400, 6600 ] 189 0.018% 100.128% ( 6600, 9900 ] 33 0.003% 100.131% ( 9900, 14000 ] 12 0.001% 100.132% ( 14000, 22000 ] 3 0.000% 100.132% ( 22000, 33000 ] 10 0.001% 100.133% ( 33000, 50000 ] 4 0.000% 100.134% ( 50000, 75000 ] 1 0.000% 100.134% ** Level 1 read latency histogram (micros): Count: 98394 Average: 20.1112 StdDev: 205.87 Min: 1 Median: 2.0908 Max: 26563 Percentiles: P50: 2.09 P75: 3.00 P99: 354.71 P99.9: 2332.70 P99.99: 5755.33 ------------------------------------------------------ [ 0, 1 ] 2284 2.321% 2.321% ( 1, 2 ] 44457 45.183% 47.504% ######### ( 2, 3 ] 27049 27.490% 74.994% ##### ( 3, 4 ] 8263 8.398% 83.392% ## ( 4, 6 ] 8689 8.831% 92.223% ## ( 6, 10 ] 2707 2.751% 94.974% # ( 10, 15 ] 487 0.495% 95.469% ( 15, 22 ] 69 0.070% 95.539% ( 22, 34 ] 19 0.019% 95.559% ( 34, 51 ] 24 0.024% 95.583% ( 51, 76 ] 21 0.021% 95.604% ( 76, 110 ] 81 0.082% 95.687% ( 110, 170 ] 1141 1.160% 96.846% ( 170, 250 ] 1755 1.784% 98.630% ( 250, 380 ] 452 0.459% 99.089% ( 380, 580 ] 372 0.378% 99.467% ( 580, 870 ] 253 0.257% 99.725% ( 870, 1300 ] 118 0.120% 99.845% ( 1300, 1900 ] 36 0.037% 99.881% ( 1900, 2900 ] 43 0.044% 99.925% ( 2900, 4400 ] 58 0.059% 99.984% ( 4400, 6600 ] 10 0.010% 99.994% ( 6600, 9900 ] 6 0.006% 100.000% ( 14000, 22000 ] 2 0.002% 100.002% ( 22000, 33000 ] 2 0.002% 100.004% ** Level 2 read latency histogram (micros): Count: 410966 Average: 14.2487 StdDev: 219.48 Min: 1 Median: 2.3124 Max: 27086 Percentiles: P50: 2.31 P75: 3.34 P99: 13.45 P99.9: 1360.64 P99.99: 2453.83 ------------------------------------------------------ [ 0, 1 ] 3470 0.844% 0.844% ( 1, 2 ] 162581 39.561% 40.405% ######## ( 2, 3 ] 126216 30.712% 71.117% ###### ( 3, 4 ] 46334 11.274% 82.391% ## ( 4, 6 ] 52661 12.814% 95.205% ### ( 6, 10 ] 12986 3.160% 98.365% # ( 10, 15 ] 3779 0.920% 99.285% ( 15, 22 ] 665 0.162% 99.447% ( 22, 34 ] 100 0.024% 99.471% ( 34, 51 ] 113 0.027% 99.498% ( 51, 76 ] 83 0.020% 99.519% ( 76, 110 ] 28 0.007% 99.526% ( 110, 170 ] 30 0.007% 99.533% ( 170, 250 ] 57 0.014% 99.547% ( 250, 380 ] 261 0.064% 99.610% ( 380, 580 ] 431 0.105% 99.715% ( 580, 870 ] 463 0.113% 99.828% ( 870, 1300 ] 275 0.067% 99.895% ( 1300, 1900 ] 218 0.053% 99.948% ( 1900, 2900 ] 314 0.076% 100.024% ( 2900, 4400 ] 334 0.081% 100.105% ( 4400, 6600 ] 124 0.030% 100.136% ( 6600, 9900 ] 36 0.009% 100.144% ( 9900, 14000 ] 12 0.003% 100.147% ( 14000, 22000 ] 9 0.002% 100.149% ( 22000, 33000 ] 5 0.001% 100.151% ** Level 3 read latency histogram (micros): Count: 945881 Average: 18.0967 StdDev: 234.97 Min: 0 Median: 2.3488 Max: 45838 Percentiles: P50: 2.35 P75: 3.40 P99: 245.73 P99.9: 1102.20 P99.99: 1657.70 ------------------------------------------------------ [ 0, 1 ] 7078 0.748% 0.748% ( 1, 2 ] 361580 38.227% 38.975% ######## ( 2, 3 ] 298962 31.607% 70.582% ###### ( 3, 4 ] 105445 11.148% 81.730% ## ( 4, 6 ] 116777 12.346% 94.075% ## ( 6, 10 ] 29527 3.122% 97.197% # ( 10, 15 ] 6564 0.694% 97.891% ( 15, 22 ] 926 0.098% 97.989% ( 22, 34 ] 158 0.017% 98.006% ( 34, 51 ] 296 0.031% 98.037% ( 51, 76 ] 179 0.019% 98.056% ( 76, 110 ] 302 0.032% 98.088% ( 110, 170 ] 3432 0.363% 98.451% ( 170, 250 ] 5489 0.580% 99.031% ( 250, 380 ] 2326 0.246% 99.277% ( 380, 580 ] 2818 0.298% 99.575% ( 580, 870 ] 2440 0.258% 99.833% ( 870, 1300 ] 1178 0.125% 99.957% ( 1300, 1900 ] 519 0.055% 100.012% ( 1900, 2900 ] 640 0.068% 100.080% ( 2900, 4400 ] 813 0.086% 100.166% ( 4400, 6600 ] 186 0.020% 100.185% ( 6600, 9900 ] 46 0.005% 100.190% ( 9900, 14000 ] 13 0.001% 100.192% ( 14000, 22000 ] 13 0.001% 100.193% ( 22000, 33000 ] 10 0.001% 100.194% ( 33000, 50000 ] 8 0.001% 100.195% ** Level 4 read latency histogram (micros): Count: 1588806 Average: 28.9928 StdDev: 287.10 Min: 1 Median: 2.4631 Max: 47096 Percentiles: P50: 2.46 P75: 3.73 P99: 400.77 P99.9: 952.01 P99.99: 1157.31 ------------------------------------------------------ [ 0, 1 ] 11298 0.711% 0.711% ( 1, 2 ] 559082 35.189% 35.900% ####### ( 2, 3 ] 483796 30.450% 66.350% ###### ( 3, 4 ] 187161 11.780% 78.130% ## ( 4, 6 ] 204058 12.843% 90.974% ### ( 6, 10 ] 49502 3.116% 94.089% # ( 10, 15 ] 11833 0.745% 94.834% ( 15, 22 ] 1564 0.098% 94.933% ( 22, 34 ] 294 0.019% 94.951% ( 34, 51 ] 527 0.033% 94.984% ( 51, 76 ] 358 0.023% 95.007% ( 76, 110 ] 1382 0.087% 95.094% ( 110, 170 ] 20473 1.289% 96.382% ( 170, 250 ] 31341 1.973% 98.355% ( 250, 380 ] 9399 0.592% 98.947% ( 380, 580 ] 8185 0.515% 99.462% ( 580, 870 ] 6393 0.402% 99.864% ( 870, 1300 ] 2995 0.189% 100.053% ( 1300, 1900 ] 1288 0.081% 100.134% ( 1900, 2900 ] 1604 0.101% 100.235% ( 2900, 4400 ] 1666 0.105% 100.339% ( 4400, 6600 ] 440 0.028% 100.367% ( 6600, 9900 ] 89 0.006% 100.373% ( 9900, 14000 ] 33 0.002% 100.375% ( 14000, 22000 ] 42 0.003% 100.377% ( 22000, 33000 ] 42 0.003% 100.380% ( 33000, 50000 ] 16 0.001% 100.381% ** Level 5 read latency histogram (micros): Count: 57867 Average: 408.1525 StdDev: 845.97 Min: 90 Median: 218.9320 Max: 43363 Percentiles: P50: 218.93 P75: 364.39 P99: 3852.86 P99.9: 7325.38 P99.99: 30956.42 ------------------------------------------------------ ( 76, 110 ] 955 1.650% 1.650% ( 110, 170 ] 14365 24.824% 26.475% ##### ( 170, 250 ] 22257 38.462% 64.937% ######## ( 250, 380 ] 6618 11.437% 76.373% ## ( 380, 580 ] 5513 9.527% 85.900% ## ( 580, 870 ] 3994 6.902% 92.802% # ( 870, 1300 ] 1711 2.957% 95.759% # ( 1300, 1900 ] 606 1.047% 96.806% ( 1900, 2900 ] 737 1.274% 98.080% ( 2900, 4400 ] 838 1.448% 99.528% ( 4400, 6600 ] 207 0.358% 99.886% ( 6600, 9900 ] 37 0.064% 99.950% ( 9900, 14000 ] 6 0.010% 99.960% ( 14000, 22000 ] 5 0.009% 99.969% ( 22000, 33000 ] 15 0.026% 99.995% ( 33000, 50000 ] 4 0.007% 100.002% ** DB Stats ** Uptime(secs): 19.7 total, 3.6 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 200.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.400 H:M:S, 17.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 271.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 447.851 micros/op 8917 ops/sec 20.073 seconds 178996 operations; 8.6 MB/s (44999 of 44999 found) Microseconds per read: Count: 178996 Average: 447.8639 StdDev: 1161.12 Min: 2 Median: 242.2280 Max: 88060 Percentiles: P50: 242.23 P75: 415.92 P99: 3927.64 P99.9: 17347.27 P99.99: 41878.03 ------------------------------------------------------ ( 1, 2 ] 14 0.008% 0.008% ( 2, 3 ] 49 0.027% 0.035% ( 3, 4 ] 68 0.038% 0.073% ( 4, 6 ] 173 0.097% 0.170% ( 6, 10 ] 317 0.177% 0.347% ( 10, 15 ] 929 0.519% 0.866% ( 15, 22 ] 2500 1.397% 2.263% ( 22, 34 ] 3592 2.007% 4.269% ( 34, 51 ] 2165 1.210% 5.479% ( 51, 76 ] 407 0.227% 5.706% ( 76, 110 ] 144 0.080% 5.787% ( 110, 170 ] 14198 7.932% 13.719% ## ( 170, 250 ] 71930 40.185% 53.904% ######## ( 250, 380 ] 33777 18.870% 72.774% #### ( 380, 580 ] 22184 12.394% 85.168% ## ( 580, 870 ] 13369 7.469% 92.637% # ( 870, 1300 ] 6083 3.398% 96.035% # ( 1300, 1900 ] 2061 1.151% 97.187% ( 1900, 2900 ] 1782 0.996% 98.182% ( 2900, 4400 ] 2137 1.194% 99.376% ( 4400, 6600 ] 598 0.334% 99.710% ( 6600, 9900 ] 193 0.108% 99.818% ( 9900, 14000 ] 106 0.059% 99.877% ( 14000, 22000 ] 98 0.055% 99.932% ( 22000, 33000 ] 90 0.050% 99.982% ( 33000, 50000 ] 27 0.015% 99.997% ( 50000, 75000 ] 4 0.002% 99.999% ( 75000, 110000 ] 1 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 2595538 rocksdb.bloom.filter.full.positive COUNT : 203369 rocksdb.bloom.filter.full.true.positive COUNT : 178073 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 923 rocksdb.memtable.miss COUNT : 178073 rocksdb.l0.hit COUNT : 17233 rocksdb.l1.hit COUNT : 3286 rocksdb.l2andup.hit COUNT : 157554 rocksdb.compaction.key.drop.new COUNT : 1261513 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4127138 rocksdb.number.keys.read COUNT : 178996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4259206416 rocksdb.bytes.read COUNT : 178996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 563 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 3421005 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 17142948656 rocksdb.compact.write.bytes COUNT : 15843392914 rocksdb.flush.write.bytes COUNT : 4154809113 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 28 rocksdb.number.superversion_acquires COUNT : 814 rocksdb.number.superversion_releases COUNT : 791 rocksdb.number.superversion_cleanups COUNT : 203 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 216 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4128059392 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7813120 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 17533066523 rocksdb.non.last.level.read.count COUNT : 4209066 rocksdb.block.checksum.compute.count COUNT : 4359310 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 241.524199 P95 : 1167.957447 P99 : 3926.011236 P100 : 88058.000000 COUNT : 178996 SUM : 80004004 rocksdb.db.write.micros P50 : 1.598175 P95 : 5.124971 P99 : 7.430906 P100 : 656116.000000 COUNT : 4127138 SUM : 14942388 rocksdb.compaction.times.micros P50 : 1826315.789474 P95 : 2896153.846154 P99 : 7754000.000000 P100 : 8542087.000000 COUNT : 62 SUM : 119457337 rocksdb.compaction.times.cpu_micros P50 : 1169090.909091 P95 : 1871481.481481 P99 : 3126272.000000 P100 : 3126272.000000 COUNT : 62 SUM : 72826151 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1054.285714 P95 : 6765.000000 P99 : 14756.000000 P100 : 14756.000000 COUNT : 58 SUM : 112908 rocksdb.compaction.outfile.sync.micros P50 : 2622.222222 P95 : 7315.000000 P99 : 9603.000000 P100 : 11241.000000 COUNT : 208 SUM : 614670 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 213.333333 P95 : 1300.000000 P99 : 4280.000000 P100 : 4812.000000 COUNT : 140 SUM : 62034 rocksdb.table.open.io.micros P50 : 5487.209302 P95 : 18470.175439 P99 : 21630.877193 P100 : 27241.000000 COUNT : 563 SUM : 3566596 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.578077 P95 : 9.604122 P99 : 19.619683 P100 : 55026.000000 COUNT : 4152843 SUM : 59434943 rocksdb.read.block.get.micros P50 : 209.315637 P95 : 999.958812 P99 : 3551.374029 P100 : 47104.000000 COUNT : 206041 SUM : 72085180 rocksdb.write.raw.block.micros P50 : 0.534027 P95 : 1.338469 P99 : 4.013262 P100 : 56609.000000 COUNT : 4855559 SUM : 17652803 rocksdb.numfiles.in.singlecompaction P50 : 3.150000 P95 : 4.966667 P99 : 6.720000 P100 : 7.000000 COUNT : 82 SUM : 281 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562072 P95 : 1114.310861 P99 : 1283.476404 P100 : 655864.000000 COUNT : 2626 SUM : 3421251 rocksdb.sst.read.micros P50 : 2.194428 P95 : 104.718442 P99 : 550.624506 P100 : 55022.000000 COUNT : 4209327 SUM : 117397289 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 178996 SUM : 178996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4127138 SUM : 4259206416 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 228947.368421 P95 : 773000.000000 P99 : 984583.000000 P100 : 984583.000000 COUNT : 58 SUM : 17551957 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 220 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0