[2024-11-19 07:37:42.401645] Starting SPDK v25.01-pre git sha1 d47eb51c9 / DPDK 24.03.0 initialization... [2024-11-19 07:37:42.401925] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1712196 ] Set seed to 1731998262394765 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-19 07:37:42.526070] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-19 07:37:42.639240] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-19 07:37:42.639292] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1712196' to capture a snapshot of events at runtime. [2024-11-19 07:37:42.639304] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-19 07:37:42.639314] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-19 07:37:42.639322] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1712196 for offline analysis/debug. [2024-11-19 07:37:42.640738] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Nov 19 07:37:51 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/19-07:37:57 ... thread 0: (1000000,1000000) ops and (165250.5,165250.5) ops/second in (6.051420,6.051420) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/12 2.24 GB 56.7 0.3 0.0 0.3 1.1 0.8 0.0 1.4 49.1 176.6 6.42 3.63 12 0.535 319K 375 0.0 0.0 L1 12/12 1.39 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/1 1.03 GB 0.9 0.9 0.5 0.4 0.9 0.5 0.0 1.8 109.1 108.5 8.53 4.46 4 2.133 0 0 0.0 0.0 L4 175/3 9.54 GB 1.0 3.0 2.1 0.9 3.0 2.1 0.0 1.4 104.7 103.9 29.21 14.34 21 1.391 822K 0 0.0 0.0 L5 1116/0 91.97 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1337/28 106.16 GB 0.0 4.2 2.6 1.6 5.0 3.4 3.0 6.2 97.5 115.3 44.15 22.43 37 1.193 1142K 375 0.0 0.0 Int 0/0 0.00 KB 0.0 4.2 2.6 1.6 5.0 3.4 3.0 6.2 97.5 115.3 44.15 22.43 37 1.193 1142K 375 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.2 2.6 1.6 4.2 2.6 0.0 0.0 110.0 109.2 39.13 20.07 26 1.505 1142K 375 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 163.1 5.02 2.36 11 0.457 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.3 total, 6.1 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.97 GB write, 814.55 MB/s write, 4.20 GB read, 688.52 MB/s read, 44.2 seconds Interval compaction: 4.97 GB write, 841.33 MB/s write, 4.20 GB read, 711.15 MB/s read, 44.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 15, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 334681 Average: 9.3482 StdDev: 132.85 Min: 1 Median: 1.8724 Max: 14382 Percentiles: P50: 1.87 P75: 2.74 P99: 9.86 P99.9: 1634.12 P99.99: 2825.99 ------------------------------------------------------ [ 0, 1 ] 13289 3.971% 3.971% # ( 1, 2 ] 176582 52.761% 56.732% ########### ( 2, 3 ] 82102 24.531% 81.263% ##### ( 3, 4 ] 24910 7.443% 88.706% # ( 4, 6 ] 27550 8.232% 96.938% ## ( 6, 10 ] 7153 2.137% 99.075% ( 10, 15 ] 1254 0.375% 99.450% ( 15, 22 ] 175 0.052% 99.502% ( 22, 34 ] 13 0.004% 99.506% ( 34, 51 ] 6 0.002% 99.508% ( 51, 76 ] 2 0.001% 99.508% ( 76, 110 ] 11 0.003% 99.512% ( 110, 170 ] 75 0.022% 99.534% ( 170, 250 ] 140 0.042% 99.576% ( 250, 380 ] 203 0.061% 99.637% ( 380, 580 ] 230 0.069% 99.705% ( 580, 870 ] 264 0.079% 99.784% ( 870, 1300 ] 253 0.076% 99.860% ( 1300, 1900 ] 243 0.073% 99.932% ( 1900, 2900 ] 209 0.062% 99.995% ( 2900, 4400 ] 107 0.032% 100.027% ( 4400, 6600 ] 22 0.007% 100.033% ( 6600, 9900 ] 12 0.004% 100.037% ( 9900, 14000 ] 4 0.001% 100.038% ( 14000, 22000 ] 2 0.001% 100.039% ** Level 1 read latency histogram (micros): Count: 155 Average: 2496.6645 StdDev: 3718.82 Min: 91 Median: 797.5000 Max: 18074 Percentiles: P50: 797.50 P75: 3033.93 P99: 18074.00 P99.9: 18074.00 P99.99: 18074.00 ------------------------------------------------------ ( 76, 110 ] 3 1.935% 1.935% ( 110, 170 ] 7 4.516% 6.452% # ( 170, 250 ] 14 9.032% 15.484% ## ( 250, 380 ] 24 15.484% 30.968% ### ( 380, 580 ] 13 8.387% 39.355% ## ( 580, 870 ] 22 14.194% 53.548% ### ( 870, 1300 ] 15 9.677% 63.226% ## ( 1300, 1900 ] 6 3.871% 67.097% # ( 1900, 2900 ] 11 7.097% 74.194% # ( 2900, 4400 ] 14 9.032% 83.226% ## ( 4400, 6600 ] 4 2.581% 85.806% # ( 6600, 9900 ] 12 7.742% 93.548% ## ( 9900, 14000 ] 4 2.581% 96.129% # ( 14000, 22000 ] 6 3.871% 100.000% # ** Level 2 read latency histogram (micros): Count: 32717 Average: 7.3670 StdDev: 92.38 Min: 1 Median: 1.7889 Max: 6710 Percentiles: P50: 1.79 P75: 2.50 P99: 9.31 P99.9: 1277.63 P99.99: 3923.11 ------------------------------------------------------ [ 0, 1 ] 1590 4.860% 4.860% # ( 1, 2 ] 18721 57.221% 62.081% ########### ( 2, 3 ] 8534 26.084% 88.165% ##### ( 3, 4 ] 1499 4.582% 92.747% # ( 4, 6 ] 1501 4.588% 97.335% # ( 6, 10 ] 658 2.011% 99.346% ( 10, 15 ] 42 0.128% 99.474% ( 15, 22 ] 9 0.028% 99.502% ( 22, 34 ] 1 0.003% 99.505% ( 110, 170 ] 3 0.009% 99.514% ( 170, 250 ] 6 0.018% 99.532% ( 250, 380 ] 29 0.089% 99.621% ( 380, 580 ] 22 0.067% 99.688% ( 580, 870 ] 38 0.116% 99.804% ( 870, 1300 ] 33 0.101% 99.905% ( 1300, 1900 ] 13 0.040% 99.945% ( 1900, 2900 ] 12 0.037% 99.982% ( 2900, 4400 ] 4 0.012% 99.994% ( 4400, 6600 ] 1 0.003% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 436104 Average: 13.1360 StdDev: 162.03 Min: 1 Median: 2.1481 Max: 8297 Percentiles: P50: 2.15 P75: 2.99 P99: 10.23 P99.9: 1606.24 P99.99: 2152.08 ------------------------------------------------------ [ 0, 1 ] 5272 1.209% 1.209% ( 1, 2 ] 193659 44.407% 45.615% ######### ( 2, 3 ] 129141 29.612% 75.228% ###### ( 3, 4 ] 42472 9.739% 84.967% ## ( 4, 6 ] 49560 11.364% 96.331% ## ( 6, 10 ] 11530 2.644% 98.975% # ( 10, 15 ] 2362 0.542% 99.517% ( 15, 22 ] 390 0.089% 99.606% ( 22, 34 ] 23 0.005% 99.611% ( 34, 51 ] 11 0.003% 99.614% ( 51, 76 ] 9 0.002% 99.616% ( 76, 110 ] 8 0.002% 99.618% ( 110, 170 ] 18 0.004% 99.622% ( 170, 250 ] 52 0.012% 99.634% ( 250, 380 ] 84 0.019% 99.653% ( 380, 580 ] 139 0.032% 99.685% ( 580, 870 ] 254 0.058% 99.743% ( 870, 1300 ] 419 0.096% 99.839% ( 1300, 1900 ] 519 0.119% 99.958% ( 1900, 2900 ] 549 0.126% 100.084% ( 2900, 4400 ] 294 0.067% 100.152% ( 4400, 6600 ] 95 0.022% 100.173% ( 6600, 9900 ] 5 0.001% 100.174% ** Level 4 read latency histogram (micros): Count: 205991 Average: 35.5326 StdDev: 300.08 Min: 1 Median: 2.1005 Max: 11811 Percentiles: P50: 2.10 P75: 2.97 P99: 1164.01 P99.9: 3878.87 P99.99: 4776.06 ------------------------------------------------------ [ 0, 1 ] 3080 1.495% 1.495% ( 1, 2 ] 93999 45.633% 47.128% ######### ( 2, 3 ] 58889 28.588% 75.716% ###### ( 3, 4 ] 18740 9.097% 84.813% ## ( 4, 6 ] 20566 9.984% 94.797% ## ( 6, 10 ] 5567 2.703% 97.500% # ( 10, 15 ] 1062 0.516% 98.015% ( 15, 22 ] 170 0.083% 98.098% ( 22, 34 ] 10 0.005% 98.103% ( 34, 51 ] 5 0.002% 98.105% ( 51, 76 ] 4 0.002% 98.107% ( 76, 110 ] 27 0.013% 98.120% ( 110, 170 ] 113 0.055% 98.175% ( 170, 250 ] 261 0.127% 98.302% ( 250, 380 ] 245 0.119% 98.421% ( 380, 580 ] 312 0.151% 98.572% ( 580, 870 ] 464 0.225% 98.798% ( 870, 1300 ] 610 0.296% 99.094% ( 1300, 1900 ] 621 0.301% 99.395% ( 1900, 2900 ] 747 0.363% 99.758% ( 2900, 4400 ] 449 0.218% 99.976% ( 4400, 6600 ] 172 0.083% 100.059% ( 6600, 9900 ] 24 0.012% 100.071% ( 9900, 14000 ] 2 0.001% 100.072% ** Level 5 read latency histogram (micros): Count: 11712 Average: 1443.7355 StdDev: 1594.01 Min: 77 Median: 808.7868 Max: 12956 Percentiles: P50: 808.79 P75: 1975.94 P99: 7517.71 P99.9: 9884.02 P99.99: 12956.00 ------------------------------------------------------ ( 76, 110 ] 76 0.649% 0.649% ( 110, 170 ] 756 6.455% 7.104% # ( 170, 250 ] 1164 9.939% 17.042% ## ( 250, 380 ] 1264 10.792% 27.835% ## ( 380, 580 ] 1471 12.560% 40.394% ### ( 580, 870 ] 1426 12.176% 52.570% ## ( 870, 1300 ] 1416 12.090% 64.660% ## ( 1300, 1900 ] 1122 9.580% 74.240% ## ( 1900, 2900 ] 1172 10.007% 84.247% ## ( 2900, 4400 ] 1062 9.068% 93.315% ## ( 4400, 6600 ] 625 5.336% 98.651% # ( 6600, 9900 ] 147 1.255% 99.906% ( 9900, 14000 ] 11 0.094% 100.000% ** DB Stats ** Uptime(secs): 6.3 total, 6.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 157.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.382 H:M:S, 38.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 162.56 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.382 H:M:S, 39.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/19-07:38:01 ... thread 0: (1000000,2000000) ops and (241474.1,196219.8) ops/second in (4.141231,10.192651) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 3.28 GB 188.8 1.5 0.0 1.5 3.4 1.8 0.0 1.8 107.0 235.4 14.71 11.27 34 0.433 1599K 1620 0.0 0.0 L1 12/12 1.39 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 946.37 MB 0.9 0.9 0.5 0.4 0.9 0.5 0.0 1.8 109.1 108.5 8.53 4.46 4 2.133 0 0 0.0 0.0 L4 176/0 9.64 GB 1.0 3.2 2.2 1.0 3.2 2.2 0.0 1.4 108.4 107.4 30.46 15.45 22 1.384 822K 0 0.0 0.0 L5 1116/0 91.97 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1339/20 107.20 GB 0.0 5.7 2.7 3.0 7.5 4.5 3.0 4.1 108.2 142.7 53.70 31.18 60 0.895 2421K 1620 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 2.7 3.0 7.5 4.5 3.0 4.1 108.2 142.7 53.70 31.18 60 0.895 2421K 1620 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 2.7 3.0 5.6 2.7 0.0 0.0 128.4 127.6 45.24 25.93 32 1.414 2421K 1620 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 223.3 8.46 5.25 28 0.302 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.4 total, 10.2 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.48 GB write, 737.16 MB/s write, 5.67 GB read, 558.88 MB/s read, 53.7 seconds Interval compaction: 7.48 GB write, 751.55 MB/s write, 5.67 GB read, 569.79 MB/s read, 53.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 15, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 653753 Average: 13.4185 StdDev: 108.14 Min: 1 Median: 1.6996 Max: 14382 Percentiles: P50: 1.70 P75: 2.48 P99: 243.16 P99.9: 881.56 P99.99: 1876.42 ------------------------------------------------------ [ 0, 1 ] 75119 11.490% 11.490% ## ( 1, 2 ] 359838 55.042% 66.532% ########### ( 2, 3 ] 116248 17.782% 84.314% #### ( 3, 4 ] 34390 5.260% 89.574% # ( 4, 6 ] 33765 5.165% 94.739% # ( 6, 10 ] 8460 1.294% 96.033% ( 10, 15 ] 1615 0.247% 96.280% ( 15, 22 ] 249 0.038% 96.318% ( 22, 34 ] 26 0.004% 96.322% ( 34, 51 ] 9 0.001% 96.324% ( 51, 76 ] 9 0.001% 96.325% ( 76, 110 ] 731 0.112% 96.437% ( 110, 170 ] 9471 1.449% 97.886% ( 170, 250 ] 7967 1.219% 99.104% ( 250, 380 ] 2588 0.396% 99.500% ( 380, 580 ] 1769 0.271% 99.771% ( 580, 870 ] 836 0.128% 99.899% ( 870, 1300 ] 344 0.053% 99.951% ( 1300, 1900 ] 264 0.040% 99.992% ( 1900, 2900 ] 222 0.034% 100.026% ( 2900, 4400 ] 120 0.018% 100.044% ( 4400, 6600 ] 22 0.003% 100.047% ( 6600, 9900 ] 14 0.002% 100.049% ( 9900, 14000 ] 4 0.001% 100.050% ( 14000, 22000 ] 2 0.000% 100.050% ** Level 1 read latency histogram (micros): Count: 997 Average: 573.7914 StdDev: 1688.74 Min: 91 Median: 198.3828 Max: 18074 Percentiles: P50: 198.38 P75: 311.84 P99: 9930.75 P99.9: 18074.00 P99.99: 18074.00 ------------------------------------------------------ ( 76, 110 ] 37 3.711% 3.711% # ( 110, 170 ] 354 35.507% 39.218% ####### ( 170, 250 ] 303 30.391% 69.609% ###### ( 250, 380 ] 113 11.334% 80.943% ## ( 380, 580 ] 71 7.121% 88.064% # ( 580, 870 ] 41 4.112% 92.177% # ( 870, 1300 ] 20 2.006% 94.183% ( 1300, 1900 ] 6 0.602% 94.784% ( 1900, 2900 ] 12 1.204% 95.988% ( 2900, 4400 ] 14 1.404% 97.392% ( 4400, 6600 ] 4 0.401% 97.793% ( 6600, 9900 ] 12 1.204% 98.997% ( 9900, 14000 ] 4 0.401% 99.398% ( 14000, 22000 ] 6 0.602% 100.000% ** Level 2 read latency histogram (micros): Count: 32717 Average: 7.3670 StdDev: 92.38 Min: 1 Median: 1.7889 Max: 6710 Percentiles: P50: 1.79 P75: 2.50 P99: 9.31 P99.9: 1277.63 P99.99: 3923.11 ------------------------------------------------------ [ 0, 1 ] 1590 4.860% 4.860% # ( 1, 2 ] 18721 57.221% 62.081% ########### ( 2, 3 ] 8534 26.084% 88.165% ##### ( 3, 4 ] 1499 4.582% 92.747% # ( 4, 6 ] 1501 4.588% 97.335% # ( 6, 10 ] 658 2.011% 99.346% ( 10, 15 ] 42 0.128% 99.474% ( 15, 22 ] 9 0.028% 99.502% ( 22, 34 ] 1 0.003% 99.505% ( 110, 170 ] 3 0.009% 99.514% ( 170, 250 ] 6 0.018% 99.532% ( 250, 380 ] 29 0.089% 99.621% ( 380, 580 ] 22 0.067% 99.688% ( 580, 870 ] 38 0.116% 99.804% ( 870, 1300 ] 33 0.101% 99.905% ( 1300, 1900 ] 13 0.040% 99.945% ( 1900, 2900 ] 12 0.037% 99.982% ( 2900, 4400 ] 4 0.012% 99.994% ( 4400, 6600 ] 1 0.003% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 454454 Average: 13.0639 StdDev: 159.43 Min: 1 Median: 2.1239 Max: 8297 Percentiles: P50: 2.12 P75: 2.98 P99: 11.43 P99.9: 1587.94 P99.99: 2152.38 ------------------------------------------------------ [ 0, 1 ] 6174 1.359% 1.359% ( 1, 2 ] 204594 45.020% 46.378% ######### ( 2, 3 ] 132893 29.242% 75.621% ###### ( 3, 4 ] 43376 9.545% 85.165% ## ( 4, 6 ] 50290 11.066% 96.231% ## ( 6, 10 ] 11899 2.618% 98.850% # ( 10, 15 ] 2394 0.527% 99.376% ( 15, 22 ] 397 0.087% 99.464% ( 22, 34 ] 24 0.005% 99.469% ( 34, 51 ] 11 0.002% 99.471% ( 51, 76 ] 9 0.002% 99.473% ( 76, 110 ] 29 0.006% 99.480% ( 110, 170 ] 345 0.076% 99.556% ( 170, 250 ] 274 0.060% 99.616% ( 250, 380 ] 162 0.036% 99.652% ( 380, 580 ] 191 0.042% 99.694% ( 580, 870 ] 268 0.059% 99.753% ( 870, 1300 ] 420 0.092% 99.845% ( 1300, 1900 ] 520 0.114% 99.960% ( 1900, 2900 ] 549 0.121% 100.080% ( 2900, 4400 ] 295 0.065% 100.145% ( 4400, 6600 ] 95 0.021% 100.166% ( 6600, 9900 ] 6 0.001% 100.167% ** Level 4 read latency histogram (micros): Count: 225455 Average: 38.6351 StdDev: 291.00 Min: 1 Median: 2.1115 Max: 11811 Percentiles: P50: 2.11 P75: 3.08 P99: 1046.45 P99.9: 3813.12 P99.99: 4738.37 ------------------------------------------------------ [ 0, 1 ] 3812 1.691% 1.691% ( 1, 2 ] 102029 45.255% 46.946% ######### ( 2, 3 ] 61780 27.402% 74.348% ##### ( 3, 4 ] 19490 8.645% 82.993% ## ( 4, 6 ] 21304 9.449% 92.442% ## ( 6, 10 ] 5840 2.590% 95.032% # ( 10, 15 ] 1087 0.482% 95.514% ( 15, 22 ] 175 0.078% 95.592% ( 22, 34 ] 11 0.005% 95.597% ( 34, 51 ] 5 0.002% 95.599% ( 51, 76 ] 4 0.002% 95.601% ( 76, 110 ] 276 0.122% 95.723% ( 110, 170 ] 2634 1.168% 96.892% ( 170, 250 ] 2240 0.994% 97.885% ( 250, 380 ] 887 0.393% 98.279% ( 380, 580 ] 741 0.329% 98.607% ( 580, 870 ] 622 0.276% 98.883% ( 870, 1300 ] 642 0.285% 99.168% ( 1300, 1900 ] 627 0.278% 99.446% ( 1900, 2900 ] 749 0.332% 99.778% ( 2900, 4400 ] 451 0.200% 99.978% ( 4400, 6600 ] 172 0.076% 100.055% ( 6600, 9900 ] 25 0.011% 100.066% ( 9900, 14000 ] 3 0.001% 100.067% ** Level 5 read latency histogram (micros): Count: 59855 Average: 459.9847 StdDev: 870.10 Min: 77 Median: 201.1331 Max: 15125 Percentiles: P50: 201.13 P75: 347.70 P99: 5052.78 P99.9: 8810.67 P99.99: 11769.04 ------------------------------------------------------ ( 76, 110 ] 2174 3.632% 3.632% # ( 110, 170 ] 21235 35.477% 39.110% ####### ( 170, 250 ] 16750 27.984% 67.094% ###### ( 250, 380 ] 6297 10.520% 77.614% ## ( 380, 580 ] 4945 8.262% 85.876% ## ( 580, 870 ] 2620 4.377% 90.253% # ( 870, 1300 ] 1612 2.693% 92.946% # ( 1300, 1900 ] 1161 1.940% 94.886% ( 1900, 2900 ] 1197 2.000% 96.886% ( 2900, 4400 ] 1080 1.804% 98.690% ( 4400, 6600 ] 625 1.044% 99.734% ( 6600, 9900 ] 148 0.247% 99.982% ( 9900, 14000 ] 11 0.018% 100.000% ( 14000, 22000 ] 1 0.002% 100.002% ** DB Stats ** Uptime(secs): 10.4 total, 4.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 189.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.041 H:M:S, 29.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 237.66 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.659 H:M:S, 15.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/19-07:38:11 ... thread 0: (1000000,3000000) ops and (96929.4,146274.1) ops/second in (10.316792,20.509443) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 4.19 GB 257.0 3.8 0.0 3.8 6.6 2.8 0.0 2.4 147.5 254.1 26.47 22.39 53 0.499 3964K 13K 0.0 0.0 L1 12/12 1.39 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 946.37 MB 0.9 0.9 0.5 0.4 0.9 0.5 0.0 1.8 109.1 108.5 8.53 4.46 4 2.133 0 0 0.0 0.0 L4 176/0 9.64 GB 1.0 3.2 2.2 1.0 3.2 2.2 0.0 1.4 108.4 107.4 30.46 15.45 22 1.384 822K 0 0.0 0.0 L5 1116/0 91.97 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1339/24 108.12 GB 0.0 7.9 2.7 5.2 10.7 5.4 3.0 3.9 124.3 166.9 65.46 42.30 79 0.829 4786K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.9 2.7 5.2 10.7 5.4 3.0 3.9 124.3 166.9 65.46 42.30 79 0.829 4786K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.9 2.7 5.2 7.9 2.7 0.0 0.0 150.9 150.0 53.93 34.48 36 1.498 4786K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 245.9 11.53 7.82 43 0.268 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.7 total, 20.5 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.67 GB write, 527.49 MB/s write, 7.95 GB read, 392.94 MB/s read, 65.5 seconds Interval compaction: 10.67 GB write, 532.61 MB/s write, 7.95 GB read, 396.76 MB/s read, 65.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 15, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1363052 Average: 17.1868 StdDev: 89.64 Min: 0 Median: 1.5632 Max: 14382 Percentiles: P50: 1.56 P75: 2.09 P99: 252.18 P99.9: 692.55 P99.99: 1146.41 ------------------------------------------------------ [ 0, 1 ] 261221 19.164% 19.164% #### ( 1, 2 ] 746262 54.749% 73.914% ########### ( 2, 3 ] 159703 11.717% 85.630% ## ( 3, 4 ] 47415 3.479% 89.109% # ( 4, 6 ] 41356 3.034% 92.143% # ( 6, 10 ] 9828 0.721% 92.864% ( 10, 15 ] 2406 0.177% 93.041% ( 15, 22 ] 342 0.025% 93.066% ( 22, 34 ] 30 0.002% 93.068% ( 34, 51 ] 10 0.001% 93.069% ( 51, 76 ] 14 0.001% 93.070% ( 76, 110 ] 4194 0.308% 93.377% ( 110, 170 ] 45547 3.342% 96.719% # ( 170, 250 ] 30973 2.272% 98.991% ( 250, 380 ] 7250 0.532% 99.523% ( 380, 580 ] 4537 0.333% 99.856% ( 580, 870 ] 1551 0.114% 99.970% ( 870, 1300 ] 432 0.032% 100.001% ( 1300, 1900 ] 282 0.021% 100.022% ( 1900, 2900 ] 255 0.019% 100.041% ( 2900, 4400 ] 139 0.010% 100.051% ( 4400, 6600 ] 23 0.002% 100.053% ( 6600, 9900 ] 14 0.001% 100.054% ( 9900, 14000 ] 4 0.000% 100.054% ( 14000, 22000 ] 2 0.000% 100.054% ** Level 1 read latency histogram (micros): Count: 3338 Average: 304.1582 StdDev: 944.03 Min: 87 Median: 169.3325 Max: 18074 Percentiles: P50: 169.33 P75: 230.17 P99: 3609.29 P99.9: 17549.33 P99.99: 18074.00 ------------------------------------------------------ ( 76, 110 ] 158 4.733% 4.733% # ( 110, 170 ] 1528 45.776% 50.509% ######### ( 170, 250 ] 1087 32.564% 83.074% ####### ( 250, 380 ] 249 7.460% 90.533% # ( 380, 580 ] 166 4.973% 95.506% # ( 580, 870 ] 67 2.007% 97.513% ( 870, 1300 ] 24 0.719% 98.232% ( 1300, 1900 ] 6 0.180% 98.412% ( 1900, 2900 ] 13 0.389% 98.802% ( 2900, 4400 ] 14 0.419% 99.221% ( 4400, 6600 ] 4 0.120% 99.341% ( 6600, 9900 ] 12 0.359% 99.700% ( 9900, 14000 ] 4 0.120% 99.820% ( 14000, 22000 ] 6 0.180% 100.000% ** Level 2 read latency histogram (micros): Count: 32717 Average: 7.3670 StdDev: 92.38 Min: 1 Median: 1.7889 Max: 6710 Percentiles: P50: 1.79 P75: 2.50 P99: 9.31 P99.9: 1277.63 P99.99: 3923.11 ------------------------------------------------------ [ 0, 1 ] 1590 4.860% 4.860% # ( 1, 2 ] 18721 57.221% 62.081% ########### ( 2, 3 ] 8534 26.084% 88.165% ##### ( 3, 4 ] 1499 4.582% 92.747% # ( 4, 6 ] 1501 4.588% 97.335% # ( 6, 10 ] 658 2.011% 99.346% ( 10, 15 ] 42 0.128% 99.474% ( 15, 22 ] 9 0.028% 99.502% ( 22, 34 ] 1 0.003% 99.505% ( 110, 170 ] 3 0.009% 99.514% ( 170, 250 ] 6 0.018% 99.532% ( 250, 380 ] 29 0.089% 99.621% ( 380, 580 ] 22 0.067% 99.688% ( 580, 870 ] 38 0.116% 99.804% ( 870, 1300 ] 33 0.101% 99.905% ( 1300, 1900 ] 13 0.040% 99.945% ( 1900, 2900 ] 12 0.037% 99.982% ( 2900, 4400 ] 4 0.012% 99.994% ( 4400, 6600 ] 1 0.003% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 456682 Average: 13.8540 StdDev: 159.70 Min: 1 Median: 2.1320 Max: 8297 Percentiles: P50: 2.13 P75: 2.99 P99: 20.57 P99.9: 1588.27 P99.99: 2155.15 ------------------------------------------------------ [ 0, 1 ] 6174 1.352% 1.352% ( 1, 2 ] 204609 44.803% 46.155% ######### ( 2, 3 ] 132968 29.116% 75.271% ###### ( 3, 4 ] 43414 9.506% 84.778% ## ( 4, 6 ] 50333 11.021% 95.799% ## ( 6, 10 ] 11905 2.607% 98.406% # ( 10, 15 ] 2396 0.525% 98.931% ( 15, 22 ] 397 0.087% 99.018% ( 22, 34 ] 24 0.005% 99.023% ( 34, 51 ] 11 0.002% 99.025% ( 51, 76 ] 9 0.002% 99.027% ( 76, 110 ] 131 0.029% 99.056% ( 110, 170 ] 1420 0.311% 99.367% ( 170, 250 ] 911 0.199% 99.566% ( 250, 380 ] 289 0.063% 99.630% ( 380, 580 ] 273 0.060% 99.689% ( 580, 870 ] 288 0.063% 99.753% ( 870, 1300 ] 423 0.093% 99.845% ( 1300, 1900 ] 521 0.114% 99.959% ( 1900, 2900 ] 550 0.120% 100.080% ( 2900, 4400 ] 296 0.065% 100.145% ( 4400, 6600 ] 95 0.021% 100.165% ( 6600, 9900 ] 6 0.001% 100.167% ** Level 4 read latency histogram (micros): Count: 244782 Average: 49.6375 StdDev: 283.30 Min: 1 Median: 2.2651 Max: 11811 Percentiles: P50: 2.27 P75: 3.79 P99: 932.47 P99.9: 3745.51 P99.99: 4700.86 ------------------------------------------------------ [ 0, 1 ] 3812 1.557% 1.557% ( 1, 2 ] 102112 41.715% 43.273% ######## ( 2, 3 ] 62105 25.372% 68.644% ##### ( 3, 4 ] 19723 8.057% 76.702% ## ( 4, 6 ] 21586 8.818% 85.520% ## ( 6, 10 ] 5872 2.399% 87.919% ( 10, 15 ] 1099 0.449% 88.368% ( 15, 22 ] 175 0.071% 88.440% ( 22, 34 ] 11 0.004% 88.444% ( 34, 51 ] 5 0.002% 88.446% ( 51, 76 ] 4 0.002% 88.448% ( 76, 110 ] 1213 0.496% 88.943% ( 110, 170 ] 12128 4.955% 93.898% # ( 170, 250 ] 8038 3.284% 97.182% # ( 250, 380 ] 2101 0.858% 98.040% ( 380, 580 ] 1466 0.599% 98.639% ( 580, 870 ] 788 0.322% 98.961% ( 870, 1300 ] 662 0.270% 99.231% ( 1300, 1900 ] 631 0.258% 99.489% ( 1900, 2900 ] 752 0.307% 99.796% ( 2900, 4400 ] 451 0.184% 99.980% ( 4400, 6600 ] 172 0.070% 100.051% ( 6600, 9900 ] 25 0.010% 100.061% ( 9900, 14000 ] 3 0.001% 100.062% ** Level 5 read latency histogram (micros): Count: 197054 Average: 270.6877 StdDev: 503.88 Min: 77 Median: 167.9902 Max: 15125 Percentiles: P50: 167.99 P75: 231.54 P99: 2818.13 P99.9: 6466.05 P99.99: 9685.05 ------------------------------------------------------ ( 76, 110 ] 9140 4.638% 4.638% # ( 110, 170 ] 92485 46.934% 51.572% ######### ( 170, 250 ] 60014 30.456% 82.028% ###### ( 250, 380 ] 14915 7.569% 89.597% ## ( 380, 580 ] 10363 5.259% 94.856% # ( 580, 870 ] 4072 2.066% 96.922% ( 870, 1300 ] 1769 0.898% 97.820% ( 1300, 1900 ] 1198 0.608% 98.428% ( 1900, 2900 ] 1228 0.623% 99.051% ( 2900, 4400 ] 1086 0.551% 99.602% ( 4400, 6600 ] 625 0.317% 99.919% ( 6600, 9900 ] 149 0.076% 99.995% ( 9900, 14000 ] 11 0.006% 100.001% ( 14000, 22000 ] 1 0.001% 100.001% ** DB Stats ** Uptime(secs): 20.7 total, 10.3 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 142.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.640 H:M:S, 46.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 95.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.598 H:M:S, 64.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 240.424 micros/op 16620 ops/sec 60.167 seconds 999996 operations; 16.1 MB/s (252999 of 252999 found) Microseconds per read: Count: 999996 Average: 240.4258 StdDev: 673.30 Min: 2 Median: 197.1311 Max: 74686 Percentiles: P50: 197.13 P75: 240.30 P99: 786.98 P99.9: 8927.86 P99.99: 30650.51 ------------------------------------------------------ ( 1, 2 ] 4 0.000% 0.000% ( 2, 3 ] 31 0.003% 0.004% ( 3, 4 ] 40 0.004% 0.008% ( 4, 6 ] 62 0.006% 0.014% ( 6, 10 ] 433 0.043% 0.057% ( 10, 15 ] 3787 0.379% 0.436% ( 15, 22 ] 2450 0.245% 0.681% ( 22, 34 ] 10137 1.014% 1.694% ( 34, 51 ] 1904 0.190% 1.885% ( 51, 76 ] 221 0.022% 1.907% ( 76, 110 ] 4887 0.489% 2.396% ( 110, 170 ] 318908 31.891% 34.287% ###### ( 170, 250 ] 463333 46.333% 80.620% ######### ( 250, 380 ] 119916 11.992% 92.612% ## ( 380, 580 ] 53754 5.375% 97.987% # ( 580, 870 ] 14192 1.419% 99.406% ( 870, 1300 ] 3167 0.317% 99.723% ( 1300, 1900 ] 684 0.068% 99.791% ( 1900, 2900 ] 491 0.049% 99.840% ( 2900, 4400 ] 261 0.026% 99.867% ( 4400, 6600 ] 164 0.016% 99.883% ( 6600, 9900 ] 241 0.024% 99.907% ( 9900, 14000 ] 203 0.020% 99.927% ( 14000, 22000 ] 464 0.046% 99.974% ( 22000, 33000 ] 206 0.021% 99.994% ( 33000, 50000 ] 48 0.005% 99.999% ( 50000, 75000 ] 8 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 14987137 rocksdb.bloom.filter.full.positive COUNT : 1146525 rocksdb.bloom.filter.full.true.positive COUNT : 999647 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 349 rocksdb.memtable.miss COUNT : 999647 rocksdb.l0.hit COUNT : 40333 rocksdb.l1.hit COUNT : 16826 rocksdb.l2andup.hit COUNT : 942488 rocksdb.compaction.key.drop.new COUNT : 89903 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3286947 rocksdb.number.keys.read COUNT : 999996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3392129304 rocksdb.bytes.read COUNT : 999996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1486 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 47344532 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 13416895469 rocksdb.compact.write.bytes COUNT : 13313918833 rocksdb.flush.write.bytes COUNT : 3368996372 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 55 rocksdb.number.superversion_acquires COUNT : 610 rocksdb.number.superversion_releases COUNT : 581 rocksdb.number.superversion_cleanups COUNT : 149 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 145 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3341743104 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1230848 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 17175819422 rocksdb.non.last.level.read.count COUNT : 4003015 rocksdb.block.checksum.compute.count COUNT : 4404322 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 196.057959 P95 : 467.195966 P99 : 786.106496 P100 : 74685.000000 COUNT : 999996 SUM : 239480521 rocksdb.db.write.micros P50 : 1.566514 P95 : 5.169961 P99 : 131.051208 P100 : 655528.000000 COUNT : 3286947 SUM : 55823001 rocksdb.compaction.times.micros P50 : 1263636.363636 P95 : 4300000.000000 P99 : 50344433.000000 P100 : 50344433.000000 COUNT : 40 SUM : 109295340 rocksdb.compaction.times.cpu_micros P50 : 902500.000000 P95 : 4300000.000000 P99 : 23324926.000000 P100 : 23324926.000000 COUNT : 40 SUM : 62735996 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 882.647059 P95 : 12155.000000 P99 : 25709.000000 P100 : 25709.000000 COUNT : 49 SUM : 113321 rocksdb.compaction.outfile.sync.micros P50 : 5225.000000 P95 : 113600.000000 P99 : 168320.000000 P100 : 395914.000000 COUNT : 114 SUM : 2335905 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 207.894737 P95 : 3971.428571 P99 : 6600.000000 P100 : 7357.000000 COUNT : 100 SUM : 89710 rocksdb.table.open.io.micros P50 : 10256.521739 P95 : 21186.167147 P99 : 30851.333333 P100 : 42476.000000 COUNT : 1486 SUM : 15696623 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.958404 P95 : 126.845817 P99 : 240.217199 P100 : 10899.000000 COUNT : 3246900 SUM : 66797711 rocksdb.read.block.get.micros P50 : 154.264895 P95 : 314.000541 P99 : 651.041904 P100 : 18266.000000 COUNT : 1155902 SUM : 205658789 rocksdb.write.raw.block.micros P50 : 0.563699 P95 : 1.696181 P99 : 3.727768 P100 : 17198.000000 COUNT : 4040630 SUM : 11171585 rocksdb.numfiles.in.singlecompaction P50 : 3.043478 P95 : 7.600000 P99 : 27.760000 P100 : 31.000000 COUNT : 52 SUM : 214 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.567330 P95 : 1265.015412 P99 : 2674.416296 P100 : 655351.000000 COUNT : 268372 SUM : 47369473 rocksdb.sst.read.micros P50 : 2.712094 P95 : 226.295047 P99 : 451.903456 P100 : 18074.000000 COUNT : 4003048 SUM : 254739438 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 999996 SUM : 999996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3286947 SUM : 3392129304 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 221578.947368 P95 : 729500.000000 P99 : 1013188.000000 P100 : 1013188.000000 COUNT : 49 SUM : 12820860 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 146 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0