[2024-11-17 11:56:13.689431] Starting SPDK v25.01-pre git sha1 83e8405e4 / DPDK 23.11.0 initialization... [2024-11-17 11:56:13.689692] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid438481 ] Set seed to 1731840973682689 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-17 11:56:13.805777] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-17 11:56:13.829176] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-17 11:56:13.829216] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 438481' to capture a snapshot of events at runtime. [2024-11-17 11:56:13.829226] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-17 11:56:13.829237] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-17 11:56:13.829244] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid438481 for offline analysis/debug. [2024-11-17 11:56:13.829794] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 17 11:56:18 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/17-11:56:25 ... thread 0: (1000000,1000000) ops and (129709.8,129709.8) ops/second in (7.709516,7.709516) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 2.37 GB 56.6 0.4 0.0 0.4 1.2 0.9 0.0 1.4 39.3 130.9 9.62 4.18 11 0.875 383K 546 0.0 0.0 L1 10/10 1.16 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 19/2 1.18 GB 0.9 1.6 1.1 0.5 1.6 1.1 0.0 1.4 102.7 101.5 15.87 7.88 5 3.174 261K 0 0.0 0.0 L4 167/10 10.08 GB 1.0 4.5 2.2 2.2 4.4 2.1 0.0 2.0 109.2 107.4 41.82 22.05 23 1.818 1305K 0 0.0 0.0 L5 1124/0 92.40 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1335/34 107.18 GB 0.0 6.4 3.3 3.1 7.2 4.1 1.6 8.3 97.7 109.4 67.31 34.11 39 1.726 1950K 546 0.0 0.0 Int 0/0 0.00 KB 0.0 6.4 3.3 3.1 7.2 4.1 1.6 8.3 97.7 109.4 67.31 34.11 39 1.726 1950K 546 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.4 3.3 3.1 6.3 3.2 0.0 0.0 109.1 107.6 60.25 31.51 29 2.078 1950K 546 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 124.9 7.06 2.60 10 0.706 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.9 total, 7.7 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.19 GB write, 927.88 MB/s write, 6.42 GB read, 828.70 MB/s read, 67.3 seconds Interval compaction: 7.19 GB write, 954.68 MB/s write, 6.42 GB read, 852.63 MB/s read, 67.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 21, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 370886 Average: 12.6373 StdDev: 160.92 Min: 1 Median: 1.9251 Max: 14552 Percentiles: P50: 1.93 P75: 2.90 P99: 11.90 P99.9: 2089.63 P99.99: 3793.59 ------------------------------------------------------ [ 0, 1 ] 11437 3.084% 3.084% # ( 1, 2 ] 188091 50.714% 53.798% ########## ( 2, 3 ] 87837 23.683% 77.481% ##### ( 3, 4 ] 34562 9.319% 86.799% ## ( 4, 6 ] 35919 9.685% 96.484% ## ( 6, 10 ] 8736 2.355% 98.840% ( 10, 15 ] 1568 0.423% 99.262% ( 15, 22 ] 173 0.047% 99.309% ( 22, 34 ] 11 0.003% 99.312% ( 34, 51 ] 17 0.005% 99.317% ( 51, 76 ] 13 0.004% 99.320% ( 76, 110 ] 8 0.002% 99.322% ( 110, 170 ] 68 0.018% 99.340% ( 170, 250 ] 129 0.035% 99.375% ( 250, 380 ] 208 0.056% 99.431% ( 380, 580 ] 333 0.090% 99.521% ( 580, 870 ] 509 0.137% 99.658% ( 870, 1300 ] 482 0.130% 99.788% ( 1300, 1900 ] 366 0.099% 99.887% ( 1900, 2900 ] 259 0.070% 99.957% ( 2900, 4400 ] 208 0.056% 100.013% ( 4400, 6600 ] 76 0.020% 100.033% ( 6600, 9900 ] 13 0.004% 100.037% ( 9900, 14000 ] 5 0.001% 100.038% ( 14000, 22000 ] 1 0.000% 100.039% ** Level 1 read latency histogram (micros): Count: 153 Average: 1473.2288 StdDev: 1336.13 Min: 136 Median: 1021.2963 Max: 7663 Percentiles: P50: 1021.30 P75: 1892.86 P99: 6366.80 P99.9: 7663.00 P99.99: 7663.00 ------------------------------------------------------ ( 110, 170 ] 3 1.961% 1.961% ( 170, 250 ] 6 3.922% 5.882% # ( 250, 380 ] 16 10.458% 16.340% ## ( 380, 580 ] 16 10.458% 26.797% ## ( 580, 870 ] 26 16.993% 43.791% ### ( 870, 1300 ] 27 17.647% 61.438% #### ( 1300, 1900 ] 21 13.725% 75.163% ### ( 1900, 2900 ] 16 10.458% 85.621% ## ( 2900, 4400 ] 16 10.458% 96.078% ## ( 4400, 6600 ] 5 3.268% 99.346% # ( 6600, 9900 ] 1 0.654% 100.000% ** Level 2 read latency histogram (micros): Count: 163315 Average: 12.9624 StdDev: 154.77 Min: 1 Median: 2.0275 Max: 11338 Percentiles: P50: 2.03 P75: 3.06 P99: 13.41 P99.9: 1839.06 P99.99: 2845.29 ------------------------------------------------------ [ 0, 1 ] 3415 2.091% 2.091% ( 1, 2 ] 77116 47.219% 49.310% ######### ( 2, 3 ] 40913 25.052% 74.362% ##### ( 3, 4 ] 16881 10.336% 84.698% ## ( 4, 6 ] 17661 10.814% 95.512% ## ( 6, 10 ] 4922 3.014% 98.526% # ( 10, 15 ] 1135 0.695% 99.221% ( 15, 22 ] 190 0.116% 99.337% ( 22, 34 ] 25 0.015% 99.353% ( 34, 51 ] 8 0.005% 99.358% ( 51, 76 ] 11 0.007% 99.364% ( 76, 110 ] 5 0.003% 99.367% ( 110, 170 ] 10 0.006% 99.374% ( 170, 250 ] 34 0.021% 99.394% ( 250, 380 ] 77 0.047% 99.442% ( 380, 580 ] 127 0.078% 99.519% ( 580, 870 ] 201 0.123% 99.642% ( 870, 1300 ] 241 0.148% 99.790% ( 1300, 1900 ] 200 0.122% 99.912% ( 1900, 2900 ] 134 0.082% 99.994% ( 2900, 4400 ] 88 0.054% 100.048% ( 4400, 6600 ] 23 0.014% 100.062% ( 6600, 9900 ] 8 0.005% 100.067% ( 9900, 14000 ] 1 0.001% 100.068% ** Level 3 read latency histogram (micros): Count: 540546 Average: 10.0002 StdDev: 150.10 Min: 1 Median: 2.0543 Max: 23447 Percentiles: P50: 2.05 P75: 3.04 P99: 9.83 P99.9: 928.99 P99.99: 1399.31 ------------------------------------------------------ [ 0, 1 ] 7993 1.479% 1.479% ( 1, 2 ] 254664 47.112% 48.591% ######### ( 2, 3 ] 140296 25.954% 74.546% ##### ( 3, 4 ] 57474 10.633% 85.178% ## ( 4, 6 ] 60597 11.210% 96.388% ## ( 6, 10 ] 14740 2.727% 99.115% # ( 10, 15 ] 2786 0.515% 99.631% ( 15, 22 ] 378 0.070% 99.701% ( 22, 34 ] 42 0.008% 99.708% ( 34, 51 ] 24 0.004% 99.713% ( 51, 76 ] 17 0.003% 99.716% ( 76, 110 ] 13 0.002% 99.718% ( 110, 170 ] 19 0.004% 99.722% ( 170, 250 ] 71 0.013% 99.735% ( 250, 380 ] 132 0.024% 99.760% ( 380, 580 ] 248 0.046% 99.805% ( 580, 870 ] 443 0.082% 99.887% ( 870, 1300 ] 499 0.092% 99.980% ( 1300, 1900 ] 338 0.063% 100.042% ( 1900, 2900 ] 235 0.043% 100.086% ( 2900, 4400 ] 239 0.044% 100.130% ( 4400, 6600 ] 95 0.018% 100.147% ( 6600, 9900 ] 22 0.004% 100.152% ( 9900, 14000 ] 7 0.001% 100.153% ( 14000, 22000 ] 2 0.000% 100.153% ( 22000, 33000 ] 1 0.000% 100.153% ** Level 4 read latency histogram (micros): Count: 598157 Average: 20.3630 StdDev: 235.88 Min: 0 Median: 2.0100 Max: 33214 Percentiles: P50: 2.01 P75: 3.02 P99: 20.06 P99.9: 2408.93 P99.99: 3267.49 ------------------------------------------------------ [ 0, 1 ] 11257 1.882% 1.882% ( 1, 2 ] 286321 47.867% 49.749% ########## ( 2, 3 ] 150094 25.093% 74.842% ##### ( 3, 4 ] 61302 10.248% 85.090% ## ( 4, 6 ] 62495 10.448% 95.538% ## ( 6, 10 ] 17109 2.860% 98.399% # ( 10, 15 ] 3268 0.546% 98.945% ( 15, 22 ] 457 0.076% 99.021% ( 22, 34 ] 43 0.007% 99.029% ( 34, 51 ] 38 0.006% 99.035% ( 51, 76 ] 35 0.006% 99.041% ( 76, 110 ] 34 0.006% 99.046% ( 110, 170 ] 117 0.020% 99.066% ( 170, 250 ] 216 0.036% 99.102% ( 250, 380 ] 402 0.067% 99.169% ( 380, 580 ] 697 0.117% 99.286% ( 580, 870 ] 1077 0.180% 99.466% ( 870, 1300 ] 1277 0.213% 99.679% ( 1300, 1900 ] 931 0.156% 99.835% ( 1900, 2900 ] 766 0.128% 99.963% ( 2900, 4400 ] 662 0.111% 100.074% ( 4400, 6600 ] 259 0.043% 100.117% ( 6600, 9900 ] 61 0.010% 100.127% ( 9900, 14000 ] 7 0.001% 100.128% ( 14000, 22000 ] 13 0.002% 100.131% ( 22000, 33000 ] 1 0.000% 100.131% ( 33000, 50000 ] 1 0.000% 100.131% ** Level 5 read latency histogram (micros): Count: 12944 Average: 1695.8460 StdDev: 1796.67 Min: 81 Median: 1098.0904 Max: 39378 Percentiles: P50: 1098.09 P75: 2324.49 P99: 7667.67 P99.9: 18889.60 P99.99: 39378.00 ------------------------------------------------------ ( 76, 110 ] 32 0.247% 0.247% ( 110, 170 ] 237 1.831% 2.078% ( 170, 250 ] 446 3.446% 5.524% # ( 250, 380 ] 910 7.030% 12.554% # ( 380, 580 ] 1543 11.921% 24.475% ## ( 580, 870 ] 2154 16.641% 41.116% ### ( 870, 1300 ] 2168 16.749% 57.865% ### ( 1300, 1900 ] 1639 12.662% 70.527% ### ( 1900, 2900 ] 1364 10.538% 81.065% ## ( 2900, 4400 ] 1478 11.418% 92.483% ## ( 4400, 6600 ] 796 6.150% 98.633% # ( 6600, 9900 ] 147 1.136% 99.768% ( 9900, 14000 ] 14 0.108% 99.876% ( 14000, 22000 ] 5 0.039% 99.915% ( 22000, 33000 ] 7 0.054% 99.969% ( 33000, 50000 ] 4 0.031% 100.000% ** DB Stats ** Uptime(secs): 7.9 total, 7.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 124.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.659 H:M:S, 46.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 127.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.659 H:M:S, 47.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/17-11:56:29 ... thread 0: (1000000,2000000) ops and (258830.7,172815.4) ops/second in (3.863529,11.573045) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 3.35 GB 163.6 1.4 0.0 1.4 3.3 1.8 0.0 1.8 83.0 191.2 17.46 11.37 31 0.563 1471K 1618 0.0 0.0 L1 10/10 1.16 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 949.93 MB 0.9 1.6 1.1 0.5 1.6 1.1 0.0 1.4 102.7 101.5 15.87 7.88 5 3.174 261K 0 0.0 0.0 L4 161/0 9.64 GB 1.0 5.2 2.5 2.7 5.1 2.4 0.0 2.1 115.0 113.1 46.29 25.67 25 1.852 1557K 0 0.0 0.0 L5 1132/0 93.07 GB 1.0 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1339/22 108.15 GB 0.0 8.2 3.5 4.7 9.9 5.3 2.3 5.4 105.5 127.9 79.62 44.92 61 1.305 3290K 1618 0.0 0.0 Int 0/0 0.00 KB 0.0 8.2 3.5 4.7 9.9 5.3 2.3 5.4 105.5 127.9 79.62 44.92 61 1.305 3290K 1618 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.2 3.5 4.7 8.1 3.4 0.0 0.0 121.5 119.9 69.14 39.35 35 1.975 3290K 1618 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 180.4 10.48 5.57 26 0.403 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.8 total, 11.6 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.94 GB write, 863.03 MB/s write, 8.20 GB read, 712.15 MB/s read, 79.6 seconds Interval compaction: 9.94 GB write, 879.63 MB/s write, 8.20 GB read, 725.85 MB/s read, 79.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 21, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 653268 Average: 14.6475 StdDev: 133.52 Min: 1 Median: 1.7420 Max: 22875 Percentiles: P50: 1.74 P75: 2.64 P99: 243.37 P99.9: 1289.64 P99.99: 2578.81 ------------------------------------------------------ [ 0, 1 ] 70840 10.844% 10.844% ## ( 1, 2 ] 344756 52.774% 63.618% ########### ( 2, 3 ] 115838 17.732% 81.350% #### ( 3, 4 ] 44427 6.801% 88.151% # ( 4, 6 ] 42212 6.462% 94.612% # ( 6, 10 ] 10108 1.547% 96.160% ( 10, 15 ] 1846 0.283% 96.442% ( 15, 22 ] 211 0.032% 96.475% ( 22, 34 ] 23 0.004% 96.478% ( 34, 51 ] 18 0.003% 96.481% ( 51, 76 ] 19 0.003% 96.484% ( 76, 110 ] 2572 0.394% 96.878% ( 110, 170 ] 9786 1.498% 98.376% ( 170, 250 ] 4449 0.681% 99.057% ( 250, 380 ] 2087 0.319% 99.376% ( 380, 580 ] 1783 0.273% 99.649% ( 580, 870 ] 1063 0.163% 99.812% ( 870, 1300 ] 592 0.091% 99.902% ( 1300, 1900 ] 387 0.059% 99.962% ( 1900, 2900 ] 275 0.042% 100.004% ( 2900, 4400 ] 213 0.033% 100.036% ( 4400, 6600 ] 76 0.012% 100.048% ( 6600, 9900 ] 13 0.002% 100.050% ( 9900, 14000 ] 6 0.001% 100.051% ( 14000, 22000 ] 1 0.000% 100.051% ( 22000, 33000 ] 1 0.000% 100.051% ** Level 1 read latency histogram (micros): Count: 820 Average: 457.8939 StdDev: 770.18 Min: 86 Median: 187.7181 Max: 7663 Percentiles: P50: 187.72 P75: 407.78 P99: 4193.75 P99.9: 7194.00 P99.99: 7663.00 ------------------------------------------------------ ( 76, 110 ] 72 8.780% 8.780% ## ( 110, 170 ] 305 37.195% 45.976% ####### ( 170, 250 ] 149 18.171% 64.146% #### ( 250, 380 ] 79 9.634% 73.780% ## ( 380, 580 ] 72 8.780% 82.561% ## ( 580, 870 ] 51 6.220% 88.780% # ( 870, 1300 ] 30 3.659% 92.439% # ( 1300, 1900 ] 24 2.927% 95.366% # ( 1900, 2900 ] 16 1.951% 97.317% ( 2900, 4400 ] 16 1.951% 99.268% ( 4400, 6600 ] 5 0.610% 99.878% ( 6600, 9900 ] 1 0.122% 100.000% ** Level 2 read latency histogram (micros): Count: 163315 Average: 12.9624 StdDev: 154.77 Min: 1 Median: 2.0275 Max: 11338 Percentiles: P50: 2.03 P75: 3.06 P99: 13.41 P99.9: 1839.06 P99.99: 2845.29 ------------------------------------------------------ [ 0, 1 ] 3415 2.091% 2.091% ( 1, 2 ] 77116 47.219% 49.310% ######### ( 2, 3 ] 40913 25.052% 74.362% ##### ( 3, 4 ] 16881 10.336% 84.698% ## ( 4, 6 ] 17661 10.814% 95.512% ## ( 6, 10 ] 4922 3.014% 98.526% # ( 10, 15 ] 1135 0.695% 99.221% ( 15, 22 ] 190 0.116% 99.337% ( 22, 34 ] 25 0.015% 99.353% ( 34, 51 ] 8 0.005% 99.358% ( 51, 76 ] 11 0.007% 99.364% ( 76, 110 ] 5 0.003% 99.367% ( 110, 170 ] 10 0.006% 99.374% ( 170, 250 ] 34 0.021% 99.394% ( 250, 380 ] 77 0.047% 99.442% ( 380, 580 ] 127 0.078% 99.519% ( 580, 870 ] 201 0.123% 99.642% ( 870, 1300 ] 241 0.148% 99.790% ( 1300, 1900 ] 200 0.122% 99.912% ( 1900, 2900 ] 134 0.082% 99.994% ( 2900, 4400 ] 88 0.054% 100.048% ( 4400, 6600 ] 23 0.014% 100.062% ( 6600, 9900 ] 8 0.005% 100.067% ( 9900, 14000 ] 1 0.001% 100.068% ** Level 3 read latency histogram (micros): Count: 574638 Average: 9.8019 StdDev: 146.19 Min: 1 Median: 2.0153 Max: 23447 Percentiles: P50: 2.02 P75: 2.99 P99: 9.92 P99.9: 901.15 P99.99: 1390.95 ------------------------------------------------------ [ 0, 1 ] 9897 1.722% 1.722% ( 1, 2 ] 275166 47.885% 49.607% ########## ( 2, 3 ] 147107 25.600% 75.207% ##### ( 3, 4 ] 59402 10.337% 85.545% ## ( 4, 6 ] 62141 10.814% 96.359% ## ( 6, 10 ] 15471 2.692% 99.051% # ( 10, 15 ] 2862 0.498% 99.549% ( 15, 22 ] 390 0.068% 99.617% ( 22, 34 ] 44 0.008% 99.624% ( 34, 51 ] 24 0.004% 99.629% ( 51, 76 ] 17 0.003% 99.632% ( 76, 110 ] 75 0.013% 99.645% ( 110, 170 ] 266 0.046% 99.691% ( 170, 250 ] 201 0.035% 99.726% ( 250, 380 ] 202 0.035% 99.761% ( 380, 580 ] 296 0.052% 99.813% ( 580, 870 ] 466 0.081% 99.894% ( 870, 1300 ] 502 0.087% 99.981% ( 1300, 1900 ] 340 0.059% 100.040% ( 1900, 2900 ] 235 0.041% 100.081% ( 2900, 4400 ] 239 0.042% 100.123% ( 4400, 6600 ] 95 0.017% 100.139% ( 6600, 9900 ] 23 0.004% 100.143% ( 9900, 14000 ] 7 0.001% 100.144% ( 14000, 22000 ] 2 0.000% 100.145% ( 22000, 33000 ] 1 0.000% 100.145% ** Level 4 read latency histogram (micros): Count: 670046 Average: 20.3562 StdDev: 225.11 Min: 0 Median: 1.9828 Max: 33214 Percentiles: P50: 1.98 P75: 2.99 P99: 245.19 P99.9: 2289.55 P99.99: 3201.35 ------------------------------------------------------ [ 0, 1 ] 14199 2.119% 2.119% ( 1, 2 ] 326439 48.719% 50.838% ########## ( 2, 3 ] 164044 24.482% 75.321% ##### ( 3, 4 ] 65303 9.746% 85.067% ## ( 4, 6 ] 65846 9.827% 94.894% ## ( 6, 10 ] 18680 2.788% 97.682% # ( 10, 15 ] 3414 0.510% 98.191% ( 15, 22 ] 486 0.073% 98.264% ( 22, 34 ] 48 0.007% 98.271% ( 34, 51 ] 39 0.006% 98.277% ( 51, 76 ] 35 0.005% 98.282% ( 76, 110 ] 630 0.094% 98.376% ( 110, 170 ] 2753 0.411% 98.787% ( 170, 250 ] 1521 0.227% 99.014% ( 250, 380 ] 982 0.147% 99.160% ( 380, 580 ] 1138 0.170% 99.330% ( 580, 870 ] 1259 0.188% 99.518% ( 870, 1300 ] 1326 0.198% 99.716% ( 1300, 1900 ] 934 0.139% 99.855% ( 1900, 2900 ] 770 0.115% 99.970% ( 2900, 4400 ] 662 0.099% 100.069% ( 4400, 6600 ] 259 0.039% 100.108% ( 6600, 9900 ] 62 0.009% 100.117% ( 9900, 14000 ] 7 0.001% 100.118% ( 14000, 22000 ] 14 0.002% 100.120% ( 22000, 33000 ] 1 0.000% 100.120% ( 33000, 50000 ] 1 0.000% 100.120% ** Level 5 read latency histogram (micros): Count: 56689 Average: 553.9734 StdDev: 1080.74 Min: 72 Median: 194.0850 Max: 39378 Percentiles: P50: 194.09 P75: 465.74 P99: 5533.47 P99.9: 9371.80 P99.99: 29330.26 ------------------------------------------------------ ( 51, 76 ] 1 0.002% 0.002% ( 76, 110 ] 4511 7.957% 7.959% ## ( 110, 170 ] 20830 36.744% 44.704% ####### ( 170, 250 ] 9973 17.592% 62.296% #### ( 250, 380 ] 5102 9.000% 71.296% ## ( 380, 580 ] 4898 8.640% 79.936% ## ( 580, 870 ] 3422 6.036% 85.973% # ( 870, 1300 ] 2430 4.287% 90.259% # ( 1300, 1900 ] 1675 2.955% 93.214% # ( 1900, 2900 ] 1388 2.448% 95.662% ( 2900, 4400 ] 1482 2.614% 98.277% # ( 4400, 6600 ] 796 1.404% 99.681% ( 6600, 9900 ] 148 0.261% 99.942% ( 9900, 14000 ] 15 0.026% 99.968% ( 14000, 22000 ] 7 0.012% 99.981% ( 22000, 33000 ] 8 0.014% 99.995% ( 33000, 50000 ] 4 0.007% 100.002% ** DB Stats ** Uptime(secs): 11.8 total, 3.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 166.85 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.958 H:M:S, 33.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 254.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.300 H:M:S, 7.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-11:56:40 ... thread 0: (1000000,3000000) ops and (92685.1,134154.6) ops/second in (10.789217,22.362262) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 4.26 GB 257.0 3.7 0.0 3.7 6.4 2.8 0.0 2.3 128.0 223.5 29.53 22.91 50 0.591 3836K 13K 0.0 0.0 L1 10/10 1.16 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 949.93 MB 0.9 1.6 1.1 0.5 1.6 1.1 0.0 1.4 102.7 101.5 15.87 7.88 5 3.174 261K 0 0.0 0.0 L4 161/0 9.64 GB 1.0 5.2 2.5 2.7 5.1 2.4 0.0 2.1 115.0 113.1 46.29 25.67 25 1.852 1557K 0 0.0 0.0 L5 1132/0 93.07 GB 1.0 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1339/22 109.06 GB 0.0 10.5 3.5 6.9 13.1 6.2 2.3 4.7 117.0 146.6 91.69 56.45 80 1.146 5655K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.5 3.5 6.9 13.1 6.2 2.3 4.7 117.0 146.6 91.69 56.45 80 1.146 5655K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.5 3.5 6.9 10.4 3.4 0.0 0.0 137.5 135.9 78.04 48.14 39 2.001 5655K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 207.8 13.64 8.31 41 0.333 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.6 total, 22.4 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.13 GB write, 595.23 MB/s write, 10.48 GB read, 475.10 MB/s read, 91.7 seconds Interval compaction: 13.13 GB write, 601.16 MB/s write, 10.48 GB read, 479.83 MB/s read, 91.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 21, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1360208 Average: 16.9284 StdDev: 103.40 Min: 0 Median: 1.5862 Max: 22875 Percentiles: P50: 1.59 P75: 2.29 P99: 245.59 P99.9: 809.01 P99.99: 1558.16 ------------------------------------------------------ [ 0, 1 ] 264077 19.414% 19.414% #### ( 1, 2 ] 709660 52.173% 71.587% ########## ( 2, 3 ] 161876 11.901% 83.488% ## ( 3, 4 ] 61946 4.554% 88.042% # ( 4, 6 ] 53129 3.906% 91.948% # ( 6, 10 ] 12065 0.887% 92.835% ( 10, 15 ] 2255 0.166% 93.001% ( 15, 22 ] 265 0.019% 93.021% ( 22, 34 ] 33 0.002% 93.023% ( 34, 51 ] 20 0.001% 93.024% ( 51, 76 ] 34 0.002% 93.027% ( 76, 110 ] 14786 1.087% 94.114% ( 110, 170 ] 50931 3.744% 97.858% # ( 170, 250 ] 16437 1.208% 99.067% ( 250, 380 ] 5605 0.412% 99.479% ( 380, 580 ] 4366 0.321% 99.800% ( 580, 870 ] 1727 0.127% 99.927% ( 870, 1300 ] 685 0.050% 99.977% ( 1300, 1900 ] 409 0.030% 100.007% ( 1900, 2900 ] 297 0.022% 100.029% ( 2900, 4400 ] 235 0.017% 100.046% ( 4400, 6600 ] 77 0.006% 100.052% ( 6600, 9900 ] 13 0.001% 100.053% ( 9900, 14000 ] 6 0.000% 100.053% ( 14000, 22000 ] 1 0.000% 100.053% ( 22000, 33000 ] 1 0.000% 100.054% ** Level 1 read latency histogram (micros): Count: 3157 Average: 245.5185 StdDev: 420.11 Min: 86 Median: 152.3371 Max: 7663 Percentiles: P50: 152.34 P75: 212.47 P99: 2301.87 P99.9: 5650.92 P99.99: 7663.00 ------------------------------------------------------ ( 76, 110 ] 398 12.607% 12.607% ### ( 110, 170 ] 1673 52.993% 65.600% ########### ( 170, 250 ] 559 17.707% 83.307% #### ( 250, 380 ] 198 6.272% 89.579% # ( 380, 580 ] 168 5.322% 94.900% # ( 580, 870 ] 68 2.154% 97.054% ( 870, 1300 ] 30 0.950% 98.004% ( 1300, 1900 ] 25 0.792% 98.796% ( 1900, 2900 ] 16 0.507% 99.303% ( 2900, 4400 ] 16 0.507% 99.810% ( 4400, 6600 ] 5 0.158% 99.968% ( 6600, 9900 ] 1 0.032% 100.000% ** Level 2 read latency histogram (micros): Count: 163315 Average: 12.9624 StdDev: 154.77 Min: 1 Median: 2.0275 Max: 11338 Percentiles: P50: 2.03 P75: 3.06 P99: 13.41 P99.9: 1839.06 P99.99: 2845.29 ------------------------------------------------------ [ 0, 1 ] 3415 2.091% 2.091% ( 1, 2 ] 77116 47.219% 49.310% ######### ( 2, 3 ] 40913 25.052% 74.362% ##### ( 3, 4 ] 16881 10.336% 84.698% ## ( 4, 6 ] 17661 10.814% 95.512% ## ( 6, 10 ] 4922 3.014% 98.526% # ( 10, 15 ] 1135 0.695% 99.221% ( 15, 22 ] 190 0.116% 99.337% ( 22, 34 ] 25 0.015% 99.353% ( 34, 51 ] 8 0.005% 99.358% ( 51, 76 ] 11 0.007% 99.364% ( 76, 110 ] 5 0.003% 99.367% ( 110, 170 ] 10 0.006% 99.374% ( 170, 250 ] 34 0.021% 99.394% ( 250, 380 ] 77 0.047% 99.442% ( 380, 580 ] 127 0.078% 99.519% ( 580, 870 ] 201 0.123% 99.642% ( 870, 1300 ] 241 0.148% 99.790% ( 1300, 1900 ] 200 0.122% 99.912% ( 1900, 2900 ] 134 0.082% 99.994% ( 2900, 4400 ] 88 0.054% 100.048% ( 4400, 6600 ] 23 0.014% 100.062% ( 6600, 9900 ] 8 0.005% 100.067% ( 9900, 14000 ] 1 0.001% 100.068% ** Level 3 read latency histogram (micros): Count: 576680 Average: 10.3626 StdDev: 146.33 Min: 1 Median: 2.0223 Max: 23447 Percentiles: P50: 2.02 P75: 3.01 P99: 13.02 P99.9: 900.19 P99.99: 1390.59 ------------------------------------------------------ [ 0, 1 ] 9897 1.716% 1.716% ( 1, 2 ] 275166 47.716% 49.432% ########## ( 2, 3 ] 147107 25.509% 74.941% ##### ( 3, 4 ] 59402 10.301% 85.242% ## ( 4, 6 ] 62141 10.776% 96.017% ## ( 6, 10 ] 15471 2.683% 98.700% # ( 10, 15 ] 2862 0.496% 99.196% ( 15, 22 ] 390 0.068% 99.264% ( 22, 34 ] 44 0.008% 99.272% ( 34, 51 ] 24 0.004% 99.276% ( 51, 76 ] 17 0.003% 99.279% ( 76, 110 ] 359 0.062% 99.341% ( 110, 170 ] 1494 0.259% 99.600% ( 170, 250 ] 526 0.091% 99.691% ( 250, 380 ] 325 0.056% 99.748% ( 380, 580 ] 365 0.063% 99.811% ( 580, 870 ] 478 0.083% 99.894% ( 870, 1300 ] 503 0.087% 99.981% ( 1300, 1900 ] 340 0.059% 100.040% ( 1900, 2900 ] 235 0.041% 100.081% ( 2900, 4400 ] 239 0.041% 100.122% ( 4400, 6600 ] 95 0.016% 100.139% ( 6600, 9900 ] 23 0.004% 100.143% ( 9900, 14000 ] 7 0.001% 100.144% ( 14000, 22000 ] 2 0.000% 100.144% ( 22000, 33000 ] 1 0.000% 100.144% ** Level 4 read latency histogram (micros): Count: 691812 Average: 24.6250 StdDev: 223.65 Min: 0 Median: 2.0320 Max: 33214 Percentiles: P50: 2.03 P75: 3.21 P99: 356.19 P99.9: 2263.76 P99.99: 3195.97 ------------------------------------------------------ [ 0, 1 ] 14199 2.052% 2.052% ( 1, 2 ] 326450 47.188% 49.240% ######### ( 2, 3 ] 164086 23.718% 72.958% ##### ( 3, 4 ] 65979 9.537% 82.496% ## ( 4, 6 ] 66720 9.644% 92.140% ## ( 6, 10 ] 18766 2.713% 94.852% # ( 10, 15 ] 3459 0.500% 95.352% ( 15, 22 ] 489 0.071% 95.423% ( 22, 34 ] 50 0.007% 95.430% ( 34, 51 ] 39 0.006% 95.436% ( 51, 76 ] 35 0.005% 95.441% ( 76, 110 ] 3719 0.538% 95.979% ( 110, 170 ] 14516 2.098% 98.077% ( 170, 250 ] 4803 0.694% 98.771% ( 250, 380 ] 1939 0.280% 99.051% ( 380, 580 ] 1882 0.272% 99.323% ( 580, 870 ] 1417 0.205% 99.528% ( 870, 1300 ] 1347 0.195% 99.723% ( 1300, 1900 ] 944 0.136% 99.859% ( 1900, 2900 ] 773 0.112% 99.971% ( 2900, 4400 ] 663 0.096% 100.067% ( 4400, 6600 ] 259 0.037% 100.104% ( 6600, 9900 ] 62 0.009% 100.113% ( 9900, 14000 ] 7 0.001% 100.114% ( 14000, 22000 ] 14 0.002% 100.116% ( 22000, 33000 ] 1 0.000% 100.117% ( 33000, 50000 ] 1 0.000% 100.117% ** Level 5 read latency histogram (micros): Count: 204904 Average: 276.0412 StdDev: 601.11 Min: 72 Median: 151.7348 Max: 39378 Percentiles: P50: 151.73 P75: 213.30 P99: 3313.72 P99.9: 6514.59 P99.99: 11405.96 ------------------------------------------------------ ( 51, 76 ] 1 0.000% 0.000% ( 76, 110 ] 28067 13.698% 13.698% ### ( 110, 170 ] 106938 52.189% 65.887% ########## ( 170, 250 ] 34501 16.838% 82.725% ### ( 250, 380 ] 12080 5.895% 88.621% # ( 380, 580 ] 10362 5.057% 93.678% # ( 580, 870 ] 4742 2.314% 95.992% ( 870, 1300 ] 2593 1.265% 97.257% ( 1300, 1900 ] 1717 0.838% 98.095% ( 1900, 2900 ] 1443 0.704% 98.799% ( 2900, 4400 ] 1490 0.727% 99.527% ( 4400, 6600 ] 796 0.388% 99.915% ( 6600, 9900 ] 148 0.072% 99.987% ( 9900, 14000 ] 15 0.007% 99.995% ( 14000, 22000 ] 7 0.003% 99.998% ( 22000, 33000 ] 8 0.004% 100.002% ( 33000, 50000 ] 4 0.002% 100.004% ** DB Stats ** Uptime(secs): 22.6 total, 10.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 130.72 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.761 H:M:S, 47.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 91.22 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.802 H:M:S, 63.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 237.047 micros/op 16857 ops/sec 60.153 seconds 1013996 operations; 16.3 MB/s (253999 of 253999 found) Microseconds per read: Count: 1013996 Average: 237.0495 StdDev: 698.67 Min: 4 Median: 185.7578 Max: 74185 Percentiles: P50: 185.76 P75: 235.89 P99: 830.12 P99.9: 11481.02 P99.99: 30270.18 ------------------------------------------------------ ( 3, 4 ] 2 0.000% 0.000% ( 4, 6 ] 56 0.006% 0.006% ( 6, 10 ] 239 0.024% 0.029% ( 10, 15 ] 98 0.010% 0.039% ( 15, 22 ] 289 0.029% 0.067% ( 22, 34 ] 14103 1.391% 1.458% ( 34, 51 ] 3704 0.365% 1.824% ( 51, 76 ] 487 0.048% 1.872% ( 76, 110 ] 348 0.034% 1.906% ( 110, 170 ] 407985 40.235% 42.141% ######## ( 170, 250 ] 404558 39.897% 82.039% ######## ( 250, 380 ] 117848 11.622% 93.661% ## ( 380, 580 ] 42693 4.210% 97.871% # ( 580, 870 ] 13271 1.309% 99.180% ( 870, 1300 ] 3823 0.377% 99.557% ( 1300, 1900 ] 1315 0.130% 99.687% ( 1900, 2900 ] 822 0.081% 99.768% ( 2900, 4400 ] 694 0.068% 99.836% ( 4400, 6600 ] 334 0.033% 99.869% ( 6600, 9900 ] 163 0.016% 99.885% ( 9900, 14000 ] 389 0.038% 99.924% ( 14000, 22000 ] 530 0.052% 99.976% ( 22000, 33000 ] 191 0.019% 99.995% ( 33000, 50000 ] 40 0.004% 99.999% ( 50000, 75000 ] 14 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 15397150 rocksdb.bloom.filter.full.positive COUNT : 1164150 rocksdb.bloom.filter.full.true.positive COUNT : 1013632 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 364 rocksdb.memtable.miss COUNT : 1013632 rocksdb.l0.hit COUNT : 43322 rocksdb.l1.hit COUNT : 13758 rocksdb.l2andup.hit COUNT : 956552 rocksdb.compaction.key.drop.new COUNT : 159921 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3405633 rocksdb.number.keys.read COUNT : 1013996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3514613256 rocksdb.bytes.read COUNT : 1013996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1516 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 45510423 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 16036964729 rocksdb.compact.write.bytes COUNT : 15861251547 rocksdb.flush.write.bytes COUNT : 3501096326 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 40 rocksdb.number.superversion_acquires COUNT : 624 rocksdb.number.superversion_releases COUNT : 586 rocksdb.number.superversion_cleanups COUNT : 153 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 172 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3472825344 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1318912 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 19902989199 rocksdb.non.last.level.read.count COUNT : 4661812 rocksdb.block.checksum.compute.count COUNT : 5056700 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 184.061467 P95 : 441.531028 P99 : 829.197633 P100 : 74185.000000 COUNT : 1013996 SUM : 239075330 rocksdb.db.write.micros P50 : 1.626310 P95 : 5.756263 P99 : 106.966287 P100 : 995323.000000 COUNT : 3405633 SUM : 55180270 rocksdb.compaction.times.micros P50 : 1500000.000000 P95 : 4276666.666667 P99 : 52922156.000000 P100 : 52922156.000000 COUNT : 44 SUM : 137012952 rocksdb.compaction.times.cpu_micros P50 : 1098000.000000 P95 : 4020000.000000 P99 : 25477441.000000 P100 : 25477441.000000 COUNT : 44 SUM : 79579199 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 819.250000 P95 : 156500.000000 P99 : 316300.000000 P100 : 373398.000000 COUNT : 49 SUM : 894206 rocksdb.compaction.outfile.sync.micros P50 : 24357.142857 P95 : 295500.000000 P99 : 533266.666667 P100 : 614560.000000 COUNT : 158 SUM : 10886315 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 180.000000 P95 : 4840.000000 P99 : 6600.000000 P100 : 6871.000000 COUNT : 100 SUM : 95116 rocksdb.table.open.io.micros P50 : 10057.692308 P95 : 21117.241379 P99 : 30756.000000 P100 : 71760.000000 COUNT : 1516 SUM : 15688539 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.053742 P95 : 97.377586 P99 : 213.926598 P100 : 33219.000000 COUNT : 3881294 SUM : 69993645 rocksdb.read.block.get.micros P50 : 142.001154 P95 : 294.083878 P99 : 753.585392 P100 : 39457.000000 COUNT : 1173922 SUM : 196675400 rocksdb.write.raw.block.micros P50 : 0.570375 P95 : 1.757163 P99 : 4.496532 P100 : 39890.000000 COUNT : 4689683 SUM : 13783538 rocksdb.numfiles.in.singlecompaction P50 : 3.300000 P95 : 7.600000 P99 : 27.760000 P100 : 33.000000 COUNT : 52 SUM : 233 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.573607 P95 : 1214.177906 P99 : 2573.885015 P100 : 995145.000000 COUNT : 248880 SUM : 45540090 rocksdb.sst.read.micros P50 : 2.623533 P95 : 176.289194 P99 : 439.718587 P100 : 39378.000000 COUNT : 4661927 SUM : 248885938 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1013996 SUM : 1013996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3405633 SUM : 3514613256 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 220256.410256 P95 : 953500.000000 P99 : 1239128.000000 P100 : 1239128.000000 COUNT : 49 SUM : 15414558 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 172 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0