[2024-11-15 10:28:58.213735] Starting SPDK v25.01-pre git sha1 318515b44 / DPDK 24.03.0 initialization... [2024-11-15 10:28:58.214049] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1115045 ] Set seed to 1731662938206518 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-15 10:28:58.366409] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-15 10:28:58.469697] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-15 10:28:58.469755] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1115045' to capture a snapshot of events at runtime. [2024-11-15 10:28:58.469768] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-15 10:28:58.469781] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-15 10:28:58.469792] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1115045 for offline analysis/debug. [2024-11-15 10:28:58.471022] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Nov 15 10:29:01 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/15-10:29:07 ... thread 0: (1000000,1000000) ops and (154363.7,154363.7) ops/second in (6.478207,6.478207) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 1.25 GB 50.1 0.3 0.0 0.3 1.1 0.8 0.0 1.4 40.2 144.5 7.82 3.82 11 0.711 319K 1790 0.0 0.0 L1 4/4 356.33 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/1 128.78 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 27/7 1.30 GB 1.0 2.0 1.5 0.5 2.0 1.5 0.0 1.3 116.9 114.4 17.51 9.90 9 1.946 1461K 7439 0.0 0.0 L4 151/15 10.94 GB 1.0 3.5 1.8 1.8 3.3 1.5 0.2 1.9 132.9 123.5 27.01 16.77 16 1.688 758K 0 0.0 0.0 L5 132/0 10.27 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 327/36 24.24 GB 0.0 5.8 3.3 2.6 6.3 3.8 1.1 7.9 113.7 123.6 52.34 30.48 36 1.454 2539K 9229 0.0 0.0 Int 0/0 0.00 KB 0.0 5.8 3.3 2.6 6.3 3.8 1.1 7.9 113.7 123.6 52.34 30.48 36 1.454 2539K 9229 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.8 3.3 2.6 5.5 3.0 0.0 0.0 127.4 120.9 46.74 28.04 26 1.798 2539K 9229 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 145.9 5.60 2.44 10 0.560 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.6 total, 6.5 interval Flush(GB): cumulative 0.798, interval 0.798 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.32 GB write, 987.02 MB/s write, 5.81 GB read, 908.06 MB/s read, 52.3 seconds Interval compaction: 6.32 GB write, 998.39 MB/s write, 5.81 GB read, 918.51 MB/s read, 52.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 131962 Average: 75.7848 StdDev: 556.52 Min: 1 Median: 2.2163 Max: 65225 Percentiles: P50: 2.22 P75: 3.47 P99: 1514.20 P99.9: 4709.51 P99.99: 13839.12 ------------------------------------------------------ [ 0, 1 ] 2956 2.240% 2.240% ( 1, 2 ] 55595 42.130% 44.370% ######## ( 2, 3 ] 34354 26.033% 70.403% ##### ( 3, 4 ] 12822 9.716% 80.119% ## ( 4, 6 ] 12867 9.751% 89.870% ## ( 6, 10 ] 3345 2.535% 92.405% # ( 10, 15 ] 721 0.546% 92.951% ( 15, 22 ] 108 0.082% 93.033% ( 22, 34 ] 15 0.011% 93.044% ( 34, 51 ] 22 0.017% 93.061% ( 51, 76 ] 30 0.023% 93.084% ( 76, 110 ] 8 0.006% 93.090% ( 110, 170 ] 57 0.043% 93.133% ( 170, 250 ] 221 0.167% 93.300% ( 250, 380 ] 968 0.734% 94.034% ( 380, 580 ] 2448 1.855% 95.889% ( 580, 870 ] 2741 2.077% 97.966% ( 870, 1300 ] 1238 0.938% 98.904% ( 1300, 1900 ] 354 0.268% 99.172% ( 1900, 2900 ] 427 0.324% 99.496% ( 2900, 4400 ] 517 0.392% 99.888% ( 4400, 6600 ] 114 0.086% 99.974% ( 6600, 9900 ] 16 0.012% 99.986% ( 9900, 14000 ] 5 0.004% 99.990% ( 14000, 22000 ] 10 0.008% 99.998% ( 22000, 33000 ] 8 0.006% 100.004% ( 33000, 50000 ] 5 0.004% 100.008% ( 50000, 75000 ] 2 0.002% 100.009% ** Level 1 read latency histogram (micros): Count: 399 Average: 970.2957 StdDev: 984.10 Min: 155 Median: 662.3305 Max: 6435 Percentiles: P50: 662.33 P75: 981.14 P99: 5346.00 P99.9: 6435.00 P99.99: 6435.00 ------------------------------------------------------ ( 110, 170 ] 2 0.501% 0.501% ( 170, 250 ] 9 2.256% 2.757% ( 250, 380 ] 43 10.777% 13.534% ## ( 380, 580 ] 112 28.070% 41.604% ###### ( 580, 870 ] 118 29.574% 71.178% ###### ( 870, 1300 ] 59 14.787% 85.965% ### ( 1300, 1900 ] 9 2.256% 88.221% ( 1900, 2900 ] 18 4.511% 92.732% # ( 2900, 4400 ] 22 5.514% 98.246% # ( 4400, 6600 ] 7 1.754% 100.000% ** Level 2 read latency histogram (micros): Count: 326259 Average: 12.9342 StdDev: 188.73 Min: 1 Median: 2.1956 Max: 34791 Percentiles: P50: 2.20 P75: 3.20 P99: 13.56 P99.9: 1638.11 P99.99: 3031.94 ------------------------------------------------------ [ 0, 1 ] 4002 1.227% 1.227% ( 1, 2 ] 141110 43.251% 44.478% ######### ( 2, 3 ] 92122 28.236% 72.713% ###### ( 3, 4 ] 36842 11.292% 84.006% ## ( 4, 6 ] 37949 11.632% 95.637% ## ( 6, 10 ] 9406 2.883% 98.520% # ( 10, 15 ] 2200 0.674% 99.195% ( 15, 22 ] 365 0.112% 99.306% ( 22, 34 ] 71 0.022% 99.328% ( 34, 51 ] 130 0.040% 99.368% ( 51, 76 ] 104 0.032% 99.400% ( 76, 110 ] 31 0.010% 99.409% ( 110, 170 ] 38 0.012% 99.421% ( 170, 250 ] 54 0.017% 99.438% ( 250, 380 ] 216 0.066% 99.504% ( 380, 580 ] 459 0.141% 99.644% ( 580, 870 ] 497 0.152% 99.797% ( 870, 1300 ] 237 0.073% 99.869% ( 1300, 1900 ] 177 0.054% 99.924% ( 1900, 2900 ] 195 0.060% 99.983% ( 2900, 4400 ] 243 0.074% 100.058% ( 4400, 6600 ] 80 0.025% 100.082% ( 6600, 9900 ] 19 0.006% 100.088% ( 9900, 14000 ] 1 0.000% 100.089% ( 14000, 22000 ] 3 0.001% 100.089% ( 22000, 33000 ] 1 0.000% 100.090% ( 33000, 50000 ] 1 0.000% 100.090% ** Level 3 read latency histogram (micros): Count: 520291 Average: 14.3701 StdDev: 229.72 Min: 1 Median: 2.2361 Max: 33764 Percentiles: P50: 2.24 P75: 3.21 P99: 13.99 P99.9: 1143.27 P99.99: 1971.10 ------------------------------------------------------ [ 0, 1 ] 4670 0.898% 0.898% ( 1, 2 ] 219044 42.100% 42.998% ######## ( 2, 3 ] 154331 29.662% 72.660% ###### ( 3, 4 ] 58046 11.156% 83.817% ## ( 4, 6 ] 61971 11.911% 95.728% ## ( 6, 10 ] 14757 2.836% 98.564% # ( 10, 15 ] 2840 0.546% 99.110% ( 15, 22 ] 403 0.077% 99.187% ( 22, 34 ] 80 0.015% 99.203% ( 34, 51 ] 186 0.036% 99.238% ( 51, 76 ] 139 0.027% 99.265% ( 76, 110 ] 38 0.007% 99.272% ( 110, 170 ] 40 0.008% 99.280% ( 170, 250 ] 135 0.026% 99.306% ( 250, 380 ] 438 0.084% 99.390% ( 380, 580 ] 1075 0.207% 99.597% ( 580, 870 ] 1225 0.235% 99.832% ( 870, 1300 ] 555 0.107% 99.939% ( 1300, 1900 ] 244 0.047% 99.986% ( 1900, 2900 ] 309 0.059% 100.045% ( 2900, 4400 ] 364 0.070% 100.115% ( 4400, 6600 ] 78 0.015% 100.130% ( 6600, 9900 ] 29 0.006% 100.136% ( 9900, 14000 ] 9 0.002% 100.137% ( 14000, 22000 ] 9 0.002% 100.139% ( 22000, 33000 ] 13 0.002% 100.142% ( 33000, 50000 ] 2 0.000% 100.142% ** Level 4 read latency histogram (micros): Count: 646184 Average: 26.9762 StdDev: 354.99 Min: 1 Median: 2.2491 Max: 55429 Percentiles: P50: 2.25 P75: 3.29 P99: 558.67 P99.9: 1693.63 P99.99: 2367.06 ------------------------------------------------------ [ 0, 1 ] 6483 1.003% 1.003% ( 1, 2 ] 270031 41.789% 42.792% ######## ( 2, 3 ] 187010 28.941% 71.733% ###### ( 3, 4 ] 72773 11.262% 82.994% ## ( 4, 6 ] 75867 11.741% 94.735% ## ( 6, 10 ] 18363 2.842% 97.577% # ( 10, 15 ] 3586 0.555% 98.132% ( 15, 22 ] 456 0.071% 98.203% ( 22, 34 ] 109 0.017% 98.219% ( 34, 51 ] 229 0.035% 98.255% ( 51, 76 ] 158 0.024% 98.279% ( 76, 110 ] 66 0.010% 98.289% ( 110, 170 ] 111 0.017% 98.307% ( 170, 250 ] 376 0.058% 98.365% ( 250, 380 ] 1274 0.197% 98.562% ( 380, 580 ] 3168 0.490% 99.052% ( 580, 870 ] 3449 0.534% 99.586% ( 870, 1300 ] 1626 0.252% 99.838% ( 1300, 1900 ] 614 0.095% 99.933% ( 1900, 2900 ] 793 0.123% 100.055% ( 2900, 4400 ] 862 0.133% 100.189% ( 4400, 6600 ] 216 0.033% 100.222% ( 6600, 9900 ] 63 0.010% 100.232% ( 9900, 14000 ] 15 0.002% 100.234% ( 14000, 22000 ] 26 0.004% 100.238% ( 22000, 33000 ] 21 0.003% 100.242% ( 33000, 50000 ] 13 0.002% 100.244% ( 50000, 75000 ] 2 0.000% 100.244% ** Level 5 read latency histogram (micros): Count: 8163 Average: 1057.6145 StdDev: 1620.45 Min: 117 Median: 666.1077 Max: 42978 Percentiles: P50: 666.11 P75: 1041.09 P99: 5910.12 P99.9: 25900.88 P99.99: 42978.00 ------------------------------------------------------ ( 110, 170 ] 22 0.270% 0.270% ( 170, 250 ] 229 2.805% 3.075% # ( 250, 380 ] 888 10.878% 13.953% ## ( 380, 580 ] 2267 27.772% 41.725% ###### ( 580, 870 ] 2275 27.870% 69.595% ###### ( 870, 1300 ] 1109 13.586% 83.180% ### ( 1300, 1900 ] 354 4.337% 87.517% # ( 1900, 2900 ] 376 4.606% 92.123% # ( 2900, 4400 ] 479 5.868% 97.991% # ( 4400, 6600 ] 120 1.470% 99.461% ( 6600, 9900 ] 24 0.294% 99.755% ( 9900, 14000 ] 4 0.049% 99.804% ( 14000, 22000 ] 5 0.061% 99.865% ( 22000, 33000 ] 8 0.098% 99.963% ( 33000, 50000 ] 3 0.037% 100.000% ** DB Stats ** Uptime(secs): 6.6 total, 6.5 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 150.13 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.690 H:M:S, 25.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 151.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.690 H:M:S, 26.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/11/15-10:29:12 ... thread 0: (1000000,2000000) ops and (240148.3,187929.3) ops/second in (4.164093,10.642300) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/9 2.29 GB 162.6 1.5 0.0 1.5 3.3 1.8 0.0 1.8 78.0 175.0 19.36 11.83 31 0.624 1532K 8749 0.0 0.0 L1 4/4 356.33 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 19/0 958.61 MB 1.0 2.2 1.6 0.6 2.2 1.6 0.0 1.3 115.3 112.9 19.58 11.17 10 1.958 1675K 11K 0.0 0.0 L4 141/0 9.73 GB 1.0 5.9 2.2 3.7 5.2 1.5 0.3 2.4 144.0 128.0 41.82 27.57 24 1.743 1180K 0 0.0 0.0 L5 152/0 11.57 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 332/13 24.87 GB 0.0 9.6 3.8 5.8 10.7 4.9 2.5 5.8 121.2 135.6 80.76 50.57 65 1.243 4388K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.6 3.8 5.8 10.7 4.9 2.5 5.8 121.2 135.6 80.76 50.57 65 1.243 4388K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.6 3.8 5.8 8.9 3.1 0.0 0.0 138.2 127.9 70.85 45.03 39 1.817 4388K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 190.4 9.91 5.54 26 0.381 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.7 total, 10.6 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.69 GB write, 1021.46 MB/s write, 9.56 GB read, 913.19 MB/s read, 80.8 seconds Interval compaction: 10.69 GB write, 1028.62 MB/s write, 9.56 GB read, 919.59 MB/s read, 80.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 492343 Average: 36.2655 StdDev: 507.19 Min: 1 Median: 1.7944 Max: 201061 Percentiles: P50: 1.79 P75: 2.77 P99: 726.16 P99.9: 2895.63 P99.99: 4000.08 ------------------------------------------------------ [ 0, 1 ] 47178 9.582% 9.582% ## ( 1, 2 ] 250501 50.879% 60.462% ########## ( 2, 3 ] 93034 18.896% 79.358% #### ( 3, 4 ] 32979 6.698% 86.056% # ( 4, 6 ] 28452 5.779% 91.835% # ( 6, 10 ] 8022 1.629% 93.465% ( 10, 15 ] 1474 0.299% 93.764% ( 15, 22 ] 244 0.050% 93.813% ( 22, 34 ] 52 0.011% 93.824% ( 34, 51 ] 58 0.012% 93.836% ( 51, 76 ] 39 0.008% 93.844% ( 76, 110 ] 167 0.034% 93.878% ( 110, 170 ] 4119 0.837% 94.714% ( 170, 250 ] 9996 2.030% 96.745% ( 250, 380 ] 4404 0.894% 97.639% ( 380, 580 ] 4739 0.963% 98.602% ( 580, 870 ] 3896 0.791% 99.393% ( 870, 1300 ] 1541 0.313% 99.706% ( 1300, 1900 ] 424 0.086% 99.792% ( 1900, 2900 ] 536 0.109% 99.901% ( 2900, 4400 ] 601 0.122% 100.023% ( 4400, 6600 ] 123 0.025% 100.048% ( 6600, 9900 ] 20 0.004% 100.052% ( 9900, 14000 ] 9 0.002% 100.054% ( 14000, 22000 ] 11 0.002% 100.056% ( 22000, 33000 ] 8 0.002% 100.058% ( 33000, 50000 ] 5 0.001% 100.059% ( 50000, 75000 ] 2 0.000% 100.059% ( 170000, 250000 ] 2 0.000% 100.060% ** Level 1 read latency histogram (micros): Count: 1179 Average: 523.6845 StdDev: 710.49 Min: 99 Median: 287.3077 Max: 6435 Percentiles: P50: 287.31 P75: 573.61 P99: 4123.65 P99.9: 6229.46 P99.99: 6435.00 ------------------------------------------------------ ( 76, 110 ] 5 0.424% 0.424% ( 110, 170 ] 169 14.334% 14.758% ### ( 170, 250 ] 367 31.128% 45.886% ###### ( 250, 380 ] 169 14.334% 60.221% ### ( 380, 580 ] 180 15.267% 75.488% ### ( 580, 870 ] 157 13.316% 88.804% ### ( 870, 1300 ] 67 5.683% 94.487% # ( 1300, 1900 ] 10 0.848% 95.335% ( 1900, 2900 ] 22 1.866% 97.201% ( 2900, 4400 ] 26 2.205% 99.406% ( 4400, 6600 ] 7 0.594% 100.000% ** Level 2 read latency histogram (micros): Count: 326269 Average: 12.9562 StdDev: 188.79 Min: 1 Median: 2.1956 Max: 34791 Percentiles: P50: 2.20 P75: 3.20 P99: 13.58 P99.9: 1639.54 P99.99: 3031.93 ------------------------------------------------------ [ 0, 1 ] 4002 1.227% 1.227% ( 1, 2 ] 141110 43.250% 44.476% ######### ( 2, 3 ] 92122 28.235% 72.711% ###### ( 3, 4 ] 36842 11.292% 84.003% ## ( 4, 6 ] 37949 11.631% 95.634% ## ( 6, 10 ] 9406 2.883% 98.517% # ( 10, 15 ] 2200 0.674% 99.191% ( 15, 22 ] 365 0.112% 99.303% ( 22, 34 ] 71 0.022% 99.325% ( 34, 51 ] 130 0.040% 99.365% ( 51, 76 ] 104 0.032% 99.397% ( 76, 110 ] 31 0.010% 99.406% ( 110, 170 ] 38 0.012% 99.418% ( 170, 250 ] 54 0.017% 99.435% ( 250, 380 ] 218 0.067% 99.501% ( 380, 580 ] 463 0.142% 99.643% ( 580, 870 ] 497 0.152% 99.796% ( 870, 1300 ] 240 0.074% 99.869% ( 1300, 1900 ] 178 0.055% 99.924% ( 1900, 2900 ] 195 0.060% 99.983% ( 2900, 4400 ] 243 0.074% 100.058% ( 4400, 6600 ] 80 0.025% 100.082% ( 6600, 9900 ] 19 0.006% 100.088% ( 9900, 14000 ] 1 0.000% 100.089% ( 14000, 22000 ] 3 0.001% 100.089% ( 22000, 33000 ] 1 0.000% 100.090% ( 33000, 50000 ] 1 0.000% 100.090% ** Level 3 read latency histogram (micros): Count: 593289 Average: 15.7306 StdDev: 489.83 Min: 1 Median: 2.2320 Max: 202970 Percentiles: P50: 2.23 P75: 3.22 P99: 186.38 P99.9: 1101.34 P99.99: 1899.22 ------------------------------------------------------ [ 0, 1 ] 5582 0.941% 0.941% ( 1, 2 ] 250638 42.246% 43.186% ######## ( 2, 3 ] 174255 29.371% 72.557% ###### ( 3, 4 ] 65713 11.076% 83.633% ## ( 4, 6 ] 69431 11.703% 95.336% ## ( 6, 10 ] 16716 2.818% 98.154% # ( 10, 15 ] 3138 0.529% 98.683% ( 15, 22 ] 434 0.073% 98.756% ( 22, 34 ] 85 0.014% 98.770% ( 34, 51 ] 202 0.034% 98.804% ( 51, 76 ] 149 0.025% 98.829% ( 76, 110 ] 67 0.011% 98.841% ( 110, 170 ] 648 0.109% 98.950% ( 170, 250 ] 1456 0.245% 99.195% ( 250, 380 ] 970 0.163% 99.359% ( 380, 580 ] 1439 0.243% 99.601% ( 580, 870 ] 1445 0.244% 99.845% ( 870, 1300 ] 611 0.103% 99.948% ( 1300, 1900 ] 252 0.042% 99.990% ( 1900, 2900 ] 324 0.055% 100.045% ( 2900, 4400 ] 375 0.063% 100.108% ( 4400, 6600 ] 81 0.014% 100.122% ( 6600, 9900 ] 32 0.005% 100.127% ( 9900, 14000 ] 10 0.002% 100.129% ( 14000, 22000 ] 10 0.002% 100.130% ( 22000, 33000 ] 13 0.002% 100.133% ( 33000, 50000 ] 2 0.000% 100.133% ( 170000, 250000 ] 3 0.001% 100.133% ** Level 4 read latency histogram (micros): Count: 975363 Average: 26.4130 StdDev: 480.90 Min: 1 Median: 2.2467 Max: 187329 Percentiles: P50: 2.25 P75: 3.35 P99: 478.51 P99.9: 1221.04 P99.99: 1744.49 ------------------------------------------------------ [ 0, 1 ] 10078 1.033% 1.033% ( 1, 2 ] 410023 42.038% 43.071% ######## ( 2, 3 ] 273956 28.088% 71.159% ###### ( 3, 4 ] 107853 11.058% 82.217% ## ( 4, 6 ] 108386 11.112% 93.329% ## ( 6, 10 ] 26621 2.729% 96.058% # ( 10, 15 ] 4943 0.507% 96.565% ( 15, 22 ] 625 0.064% 96.629% ( 22, 34 ] 143 0.015% 96.644% ( 34, 51 ] 322 0.033% 96.677% ( 51, 76 ] 210 0.022% 96.698% ( 76, 110 ] 286 0.029% 96.728% ( 110, 170 ] 4626 0.474% 97.202% ( 170, 250 ] 10376 1.064% 98.266% ( 250, 380 ] 4550 0.466% 98.732% ( 380, 580 ] 5302 0.544% 99.276% ( 580, 870 ] 4530 0.464% 99.740% ( 870, 1300 ] 1908 0.196% 99.936% ( 1300, 1900 ] 712 0.073% 100.009% ( 1900, 2900 ] 937 0.096% 100.105% ( 2900, 4400 ] 957 0.098% 100.203% ( 4400, 6600 ] 223 0.023% 100.226% ( 6600, 9900 ] 67 0.007% 100.233% ( 9900, 14000 ] 16 0.002% 100.234% ( 14000, 22000 ] 26 0.003% 100.237% ( 22000, 33000 ] 21 0.002% 100.239% ( 33000, 50000 ] 13 0.001% 100.241% ( 50000, 75000 ] 2 0.000% 100.241% ( 170000, 250000 ] 4 0.000% 100.241% ** Level 5 read latency histogram (micros): Count: 24435 Average: 563.5754 StdDev: 2040.25 Min: 91 Median: 280.3360 Max: 201001 Percentiles: P50: 280.34 P75: 568.84 P99: 4200.90 P99.9: 10363.30 P99.99: 47486.83 ------------------------------------------------------ ( 76, 110 ] 145 0.593% 0.593% ( 110, 170 ] 3460 14.160% 14.753% ### ( 170, 250 ] 7859 32.163% 46.916% ###### ( 250, 380 ] 3229 13.215% 60.131% ### ( 380, 580 ] 3848 15.748% 75.879% ### ( 580, 870 ] 3040 12.441% 88.320% ## ( 870, 1300 ] 1294 5.296% 93.616% # ( 1300, 1900 ] 412 1.686% 95.302% ( 1900, 2900 ] 444 1.817% 97.119% ( 2900, 4400 ] 530 2.169% 99.288% ( 4400, 6600 ] 122 0.499% 99.787% ( 6600, 9900 ] 27 0.110% 99.898% ( 9900, 14000 ] 5 0.020% 99.918% ( 14000, 22000 ] 7 0.029% 99.947% ( 22000, 33000 ] 8 0.033% 99.980% ( 33000, 50000 ] 3 0.012% 99.992% ( 170000, 250000 ] 2 0.008% 100.000% ** DB Stats ** Uptime(secs): 10.7 total, 4.2 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 183.63 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.999 H:M:S, 18.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 236.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.309 H:M:S, 7.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/15-10:29:15 ... thread 0: (1000000,3000000) ops and (259557.0,206967.6) ops/second in (3.852719,14.495019) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/9 3.21 GB 256.5 2.5 0.0 2.5 5.2 2.8 0.0 1.9 96.0 203.5 26.20 18.22 50 0.524 2554K 13K 0.0 0.0 L1 4/4 356.33 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 19/0 958.61 MB 1.0 2.2 1.6 0.6 2.2 1.6 0.0 1.3 115.3 112.9 19.58 11.17 10 1.958 1675K 11K 0.0 0.0 L4 141/0 9.73 GB 1.0 5.9 2.2 3.7 5.2 1.5 0.3 2.4 144.0 128.0 41.82 27.57 24 1.743 1180K 0 0.0 0.0 L5 152/0 11.57 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 335/13 25.78 GB 0.0 10.5 3.8 6.7 12.6 5.8 2.5 4.6 123.2 147.2 87.60 56.95 84 1.043 5410K 24K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.5 3.8 6.7 12.6 5.8 2.5 4.6 123.2 147.2 87.60 56.95 84 1.043 5410K 24K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.5 3.8 6.7 9.8 3.1 0.0 0.0 144.5 134.7 74.73 48.78 43 1.738 5410K 24K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 219.8 12.88 8.17 41 0.314 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.6 total, 14.5 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.59 GB write, 884.89 MB/s write, 10.54 GB read, 740.83 MB/s read, 87.6 seconds Interval compaction: 12.59 GB write, 889.44 MB/s write, 10.54 GB read, 744.64 MB/s read, 87.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 15, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 788709 Average: 29.8852 StdDev: 402.50 Min: 0 Median: 1.6777 Max: 201061 Percentiles: P50: 1.68 P75: 2.54 P99: 539.32 P99.9: 1941.51 P99.99: 3387.01 ------------------------------------------------------ [ 0, 1 ] 111494 14.136% 14.136% ### ( 1, 2 ] 417387 52.920% 67.057% ########### ( 2, 3 ] 116727 14.800% 81.856% ### ( 3, 4 ] 42495 5.388% 87.244% # ( 4, 6 ] 33386 4.233% 91.477% # ( 6, 10 ] 9299 1.179% 92.656% ( 10, 15 ] 1781 0.226% 92.882% ( 15, 22 ] 321 0.041% 92.923% ( 22, 34 ] 84 0.011% 92.933% ( 34, 51 ] 60 0.008% 92.941% ( 51, 76 ] 39 0.005% 92.946% ( 76, 110 ] 510 0.065% 93.011% ( 110, 170 ] 11460 1.453% 94.464% ( 170, 250 ] 24534 3.111% 97.574% # ( 250, 380 ] 6907 0.876% 98.450% ( 380, 580 ] 5448 0.691% 99.141% ( 580, 870 ] 3984 0.505% 99.646% ( 870, 1300 ] 1557 0.197% 99.843% ( 1300, 1900 ] 427 0.054% 99.897% ( 1900, 2900 ] 537 0.068% 99.966% ( 2900, 4400 ] 601 0.076% 100.042% ( 4400, 6600 ] 123 0.016% 100.057% ( 6600, 9900 ] 20 0.003% 100.060% ( 9900, 14000 ] 9 0.001% 100.061% ( 14000, 22000 ] 11 0.001% 100.062% ( 22000, 33000 ] 8 0.001% 100.063% ( 33000, 50000 ] 5 0.001% 100.064% ( 50000, 75000 ] 2 0.000% 100.064% ( 170000, 250000 ] 2 0.000% 100.065% ** Level 1 read latency histogram (micros): Count: 2203 Average: 372.7376 StdDev: 546.16 Min: 93 Median: 220.6611 Max: 6435 Percentiles: P50: 220.66 P75: 352.20 P99: 3532.88 P99.9: 5907.63 P99.99: 6435.00 ------------------------------------------------------ ( 76, 110 ] 24 1.089% 1.089% ( 110, 170 ] 474 21.516% 22.606% #### ( 170, 250 ] 953 43.259% 65.865% ######### ( 250, 380 ] 256 11.621% 77.485% ## ( 380, 580 ] 204 9.260% 86.745% ## ( 580, 870 ] 160 7.263% 94.008% # ( 870, 1300 ] 67 3.041% 97.049% # ( 1300, 1900 ] 10 0.454% 97.503% ( 1900, 2900 ] 22 0.999% 98.502% ( 2900, 4400 ] 26 1.180% 99.682% ( 4400, 6600 ] 7 0.318% 100.000% ** Level 2 read latency histogram (micros): Count: 326269 Average: 12.9562 StdDev: 188.79 Min: 1 Median: 2.1956 Max: 34791 Percentiles: P50: 2.20 P75: 3.20 P99: 13.58 P99.9: 1639.54 P99.99: 3031.93 ------------------------------------------------------ [ 0, 1 ] 4002 1.227% 1.227% ( 1, 2 ] 141110 43.250% 44.476% ######### ( 2, 3 ] 92122 28.235% 72.711% ###### ( 3, 4 ] 36842 11.292% 84.003% ## ( 4, 6 ] 37949 11.631% 95.634% ## ( 6, 10 ] 9406 2.883% 98.517% # ( 10, 15 ] 2200 0.674% 99.191% ( 15, 22 ] 365 0.112% 99.303% ( 22, 34 ] 71 0.022% 99.325% ( 34, 51 ] 130 0.040% 99.365% ( 51, 76 ] 104 0.032% 99.397% ( 76, 110 ] 31 0.010% 99.406% ( 110, 170 ] 38 0.012% 99.418% ( 170, 250 ] 54 0.017% 99.435% ( 250, 380 ] 218 0.067% 99.501% ( 380, 580 ] 463 0.142% 99.643% ( 580, 870 ] 497 0.152% 99.796% ( 870, 1300 ] 240 0.074% 99.869% ( 1300, 1900 ] 178 0.055% 99.924% ( 1900, 2900 ] 195 0.060% 99.983% ( 2900, 4400 ] 243 0.074% 100.058% ( 4400, 6600 ] 80 0.025% 100.082% ( 6600, 9900 ] 19 0.006% 100.088% ( 9900, 14000 ] 1 0.000% 100.089% ( 14000, 22000 ] 3 0.001% 100.089% ( 22000, 33000 ] 1 0.000% 100.090% ( 33000, 50000 ] 1 0.000% 100.090% ** Level 3 read latency histogram (micros): Count: 596964 Average: 16.8611 StdDev: 488.56 Min: 1 Median: 2.2425 Max: 202970 Percentiles: P50: 2.24 P75: 3.26 P99: 232.78 P99.9: 1098.75 P99.99: 1898.34 ------------------------------------------------------ [ 0, 1 ] 5582 0.935% 0.935% ( 1, 2 ] 250638 41.985% 42.921% ######## ( 2, 3 ] 174255 29.190% 72.111% ###### ( 3, 4 ] 65713 11.008% 83.119% ## ( 4, 6 ] 69431 11.631% 94.749% ## ( 6, 10 ] 16716 2.800% 97.549% # ( 10, 15 ] 3138 0.526% 98.075% ( 15, 22 ] 434 0.073% 98.148% ( 22, 34 ] 85 0.014% 98.162% ( 34, 51 ] 202 0.034% 98.196% ( 51, 76 ] 149 0.025% 98.221% ( 76, 110 ] 116 0.019% 98.240% ( 110, 170 ] 1769 0.296% 98.537% ( 170, 250 ] 3525 0.590% 99.127% ( 250, 380 ] 1296 0.217% 99.344% ( 380, 580 ] 1537 0.257% 99.602% ( 580, 870 ] 1456 0.244% 99.846% ( 870, 1300 ] 611 0.102% 99.948% ( 1300, 1900 ] 252 0.042% 99.990% ( 1900, 2900 ] 324 0.054% 100.044% ( 2900, 4400 ] 375 0.063% 100.107% ( 4400, 6600 ] 81 0.014% 100.121% ( 6600, 9900 ] 32 0.005% 100.126% ( 9900, 14000 ] 10 0.002% 100.128% ( 14000, 22000 ] 10 0.002% 100.129% ( 22000, 33000 ] 13 0.002% 100.132% ( 33000, 50000 ] 2 0.000% 100.132% ( 170000, 250000 ] 3 0.001% 100.133% ** Level 4 read latency histogram (micros): Count: 1004024 Average: 31.2990 StdDev: 475.01 Min: 1 Median: 2.2986 Max: 187329 Percentiles: P50: 2.30 P75: 3.54 P99: 484.97 P99.9: 1215.34 P99.99: 1741.68 ------------------------------------------------------ [ 0, 1 ] 10078 1.004% 1.004% ( 1, 2 ] 410076 40.843% 41.847% ######## ( 2, 3 ] 274133 27.303% 69.150% ##### ( 3, 4 ] 107955 10.752% 79.903% ## ( 4, 6 ] 108509 10.807% 90.710% ## ( 6, 10 ] 26630 2.652% 93.362% # ( 10, 15 ] 4949 0.493% 93.855% ( 15, 22 ] 628 0.063% 93.918% ( 22, 34 ] 144 0.014% 93.932% ( 34, 51 ] 322 0.032% 93.964% ( 51, 76 ] 210 0.021% 93.985% ( 76, 110 ] 687 0.068% 94.054% ( 110, 170 ] 13119 1.307% 95.360% ( 170, 250 ] 26239 2.613% 97.974% # ( 250, 380 ] 7120 0.709% 98.683% ( 380, 580 ] 6068 0.604% 99.287% ( 580, 870 ] 4611 0.459% 99.746% ( 870, 1300 ] 1920 0.191% 99.938% ( 1300, 1900 ] 714 0.071% 100.009% ( 1900, 2900 ] 937 0.093% 100.102% ( 2900, 4400 ] 957 0.095% 100.197% ( 4400, 6600 ] 223 0.022% 100.220% ( 6600, 9900 ] 67 0.007% 100.226% ( 9900, 14000 ] 16 0.002% 100.228% ( 14000, 22000 ] 26 0.003% 100.230% ( 22000, 33000 ] 21 0.002% 100.233% ( 33000, 50000 ] 13 0.001% 100.234% ( 50000, 75000 ] 2 0.000% 100.234% ( 170000, 250000 ] 4 0.000% 100.234% ** Level 5 read latency histogram (micros): Count: 45070 Average: 397.0303 StdDev: 1513.86 Min: 91 Median: 220.6512 Max: 201001 Percentiles: P50: 220.65 P75: 356.42 P99: 3616.89 P99.9: 7447.00 P99.99: 35793.67 ------------------------------------------------------ ( 76, 110 ] 460 1.021% 1.021% ( 110, 170 ] 9844 21.842% 22.862% #### ( 170, 250 ] 19318 42.862% 65.724% ######### ( 250, 380 ] 5107 11.331% 77.056% ## ( 380, 580 ] 4379 9.716% 86.772% ## ( 580, 870 ] 3096 6.869% 93.641% # ( 870, 1300 ] 1305 2.895% 96.536% # ( 1300, 1900 ] 413 0.916% 97.453% ( 1900, 2900 ] 444 0.985% 98.438% ( 2900, 4400 ] 530 1.176% 99.614% ( 4400, 6600 ] 122 0.271% 99.885% ( 6600, 9900 ] 27 0.060% 99.945% ( 9900, 14000 ] 5 0.011% 99.956% ( 14000, 22000 ] 7 0.016% 99.971% ( 22000, 33000 ] 8 0.018% 99.989% ( 33000, 50000 ] 3 0.007% 99.996% ( 170000, 250000 ] 2 0.004% 100.000% ** DB Stats ** Uptime(secs): 14.6 total, 3.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 202.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.209 H:M:S, 15.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 255.46 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.210 H:M:S, 5.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 363.945 micros/op 10931 ops/sec 20.216 seconds 220996 operations; 10.6 MB/s (54999 of 54999 found) Microseconds per read: Count: 220996 Average: 363.9640 StdDev: 1252.67 Min: 2 Median: 232.5629 Max: 201043 Percentiles: P50: 232.56 P75: 349.77 P99: 2736.12 P99.9: 13475.77 P99.99: 42195.76 ------------------------------------------------------ ( 1, 2 ] 6 0.003% 0.003% ( 2, 3 ] 52 0.024% 0.026% ( 3, 4 ] 87 0.039% 0.066% ( 4, 6 ] 199 0.090% 0.156% ( 6, 10 ] 345 0.156% 0.312% ( 10, 15 ] 1798 0.814% 1.125% ( 15, 22 ] 3032 1.372% 2.497% ( 22, 34 ] 5114 2.314% 4.811% ( 34, 51 ] 1782 0.806% 5.618% ( 51, 76 ] 321 0.145% 5.763% ( 76, 110 ] 91 0.041% 5.804% ( 110, 170 ] 17395 7.871% 13.675% ## ( 170, 250 ] 102650 46.449% 60.124% ######### ( 250, 380 ] 42836 19.383% 79.507% #### ( 380, 580 ] 24791 11.218% 90.725% ## ( 580, 870 ] 11490 5.199% 95.924% # ( 870, 1300 ] 4446 2.012% 97.936% ( 1300, 1900 ] 1438 0.651% 98.587% ( 1900, 2900 ] 1092 0.494% 99.081% ( 2900, 4400 ] 1244 0.563% 99.644% ( 4400, 6600 ] 336 0.152% 99.796% ( 6600, 9900 ] 155 0.070% 99.866% ( 9900, 14000 ] 86 0.039% 99.905% ( 14000, 22000 ] 103 0.047% 99.952% ( 22000, 33000 ] 73 0.033% 99.985% ( 33000, 50000 ] 22 0.010% 99.995% ( 50000, 75000 ] 8 0.004% 99.998% ( 170000, 250000 ] 4 0.002% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 3612043 rocksdb.bloom.filter.full.positive COUNT : 254958 rocksdb.bloom.filter.full.true.positive COUNT : 220078 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 918 rocksdb.memtable.miss COUNT : 220078 rocksdb.l0.hit COUNT : 29121 rocksdb.l1.hit COUNT : 3406 rocksdb.l2andup.hit COUNT : 187551 rocksdb.compaction.key.drop.new COUNT : 761019 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3579325 rocksdb.number.keys.read COUNT : 220996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3693863400 rocksdb.bytes.read COUNT : 220996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 490 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 5702151 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 13005718345 rocksdb.compact.write.bytes COUNT : 12220641498 rocksdb.flush.write.bytes COUNT : 3627402456 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 24 rocksdb.number.superversion_acquires COUNT : 641 rocksdb.number.superversion_releases COUNT : 620 rocksdb.number.superversion_cleanups COUNT : 164 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3603844096 rocksdb.memtable.garbage.bytes.at.flush COUNT : 6622208 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 13245999405 rocksdb.non.last.level.read.count COUNT : 3171452 rocksdb.block.checksum.compute.count COUNT : 3409105 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 231.891389 P95 : 817.772656 P99 : 2735.352242 P100 : 201043.000000 COUNT : 220996 SUM : 80244202 rocksdb.db.write.micros P50 : 1.569665 P95 : 5.086805 P99 : 7.747477 P100 : 630862.000000 COUNT : 3579325 SUM : 15536171 rocksdb.compaction.times.micros P50 : 1760000.000000 P95 : 2831578.947368 P99 : 3426528.000000 P100 : 3426528.000000 COUNT : 46 SUM : 77586759 rocksdb.compaction.times.cpu_micros P50 : 1132000.000000 P95 : 1565199.000000 P99 : 1565199.000000 P100 : 1565199.000000 COUNT : 46 SUM : 51599483 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 928.636364 P95 : 5463.333333 P99 : 7496.000000 P100 : 7496.000000 COUNT : 51 SUM : 68611 rocksdb.compaction.outfile.sync.micros P50 : 2373.684211 P95 : 8043.750000 P99 : 12975.000000 P100 : 61063.000000 COUNT : 150 SUM : 483421 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 203.333333 P95 : 845.833333 P99 : 4325.000000 P100 : 6018.000000 COUNT : 110 SUM : 43928 rocksdb.table.open.io.micros P50 : 5942.857143 P95 : 18095.238095 P99 : 21828.571429 P100 : 26503.000000 COUNT : 490 SUM : 3239200 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.323829 P95 : 9.963757 P99 : 239.864728 P100 : 202976.000000 COUNT : 3150951 SUM : 55361720 rocksdb.read.block.get.micros P50 : 201.994886 P95 : 710.686160 P99 : 2341.911290 P100 : 201007.000000 COUNT : 258003 SUM : 71459343 rocksdb.write.raw.block.micros P50 : 0.539699 P95 : 1.482738 P99 : 4.490891 P100 : 212903.000000 COUNT : 3839792 SUM : 13575886 rocksdb.numfiles.in.singlecompaction P50 : 3.080645 P95 : 3.966129 P99 : 8.780000 P100 : 9.000000 COUNT : 61 SUM : 207 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562904 P95 : 1143.632665 P99 : 2263.797170 P100 : 630690.000000 COUNT : 27875 SUM : 5704482 rocksdb.sst.read.micros P50 : 2.069455 P95 : 206.096303 P99 : 541.582556 P100 : 202970.000000 COUNT : 3172014 SUM : 114100121 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 220996 SUM : 220996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3579325 SUM : 3693863400 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 226666.666667 P95 : 710166.666667 P99 : 896480.000000 P100 : 896480.000000 COUNT : 51 SUM : 14957070 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 155 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0