[2024-07-15 09:25:02.453453] Starting SPDK v24.09-pre git sha1 9c8eb396d / DPDK 24.03.0 initialization... [2024-07-15 09:25:02.453768] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1171388 ] Set seed to 1721028302446255 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-15 09:25:02.607306] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-15 09:25:02.838300] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-15 09:25:02.838350] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1171388' to capture a snapshot of events at runtime. [2024-07-15 09:25:02.838364] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-15 09:25:02.838377] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-15 09:25:02.838387] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1171388 for offline analysis/debug. [2024-07-15 09:25:02.838496] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 15 09:25:09 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/15-09:25:16 ... thread 0: (1000000,1000000) ops and (137761.4,137761.4) ops/second in (7.258927,7.258927) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/7 817.17 MB 25.1 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 123.6 6.61 2.62 10 0.661 0 0 0.0 0.0 L1 2/2 113.72 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 114.5 114.0 1.86 1.07 1 1.855 215K 831 0.0 0.0 L2 2/0 97.82 MB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 127.3 127.3 0.77 0.47 1 0.769 99K 0 0.0 0.0 L3 47/8 2.87 GB 2.1 2.7 2.3 0.4 2.6 2.3 0.1 1.1 102.2 99.5 26.88 14.15 9 2.986 2000K 1728 0.0 0.0 L4 161/18 11.76 GB 1.1 3.1 1.7 1.4 2.8 1.4 0.7 1.6 117.9 105.8 26.70 14.95 13 2.054 317K 0 0.0 0.0 L5 112/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 334/35 24.80 GB 0.0 6.1 4.4 1.7 6.5 4.8 0.8 8.1 98.8 105.5 62.81 33.26 34 1.847 2632K 2559 0.0 0.0 Int 0/0 0.00 KB 0.0 6.1 4.4 1.7 6.5 4.8 0.8 8.1 98.8 105.5 62.81 33.26 34 1.847 2632K 2559 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.1 4.4 1.7 5.7 4.0 0.0 0.0 110.4 103.3 56.20 30.63 24 2.342 2632K 2559 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 123.6 6.61 2.62 10 0.661 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.4 total, 7.3 interval Flush(GB): cumulative 0.798, interval 0.798 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.47 GB write, 901.26 MB/s write, 6.06 GB read, 844.14 MB/s read, 62.8 seconds Interval compaction: 6.47 GB write, 911.80 MB/s write, 6.06 GB read, 854.01 MB/s read, 62.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 119901 Average: 54.4520 StdDev: 393.05 Min: 1 Median: 2.3216 Max: 35881 Percentiles: P50: 2.32 P75: 3.32 P99: 1490.64 P99.9: 4450.19 P99.99: 9910.15 ------------------------------------------------------ [ 0, 1 ] 2201 1.836% 1.836% ( 1, 2 ] 45460 37.915% 39.750% ######## ( 2, 3 ] 38208 31.866% 71.617% ###### ( 3, 4 ] 12500 10.425% 82.042% ## ( 4, 6 ] 12637 10.540% 92.581% ## ( 6, 10 ] 3354 2.797% 95.379% # ( 10, 15 ] 901 0.751% 96.130% ( 15, 22 ] 94 0.078% 96.209% ( 22, 34 ] 12 0.010% 96.219% ( 34, 51 ] 9 0.008% 96.226% ( 51, 76 ] 12 0.010% 96.236% ( 76, 110 ] 2 0.002% 96.238% ( 110, 170 ] 25 0.021% 96.259% ( 170, 250 ] 73 0.061% 96.319% ( 250, 380 ] 236 0.197% 96.516% ( 380, 580 ] 633 0.528% 97.044% ( 580, 870 ] 1141 0.952% 97.996% ( 870, 1300 ] 1034 0.862% 98.858% ( 1300, 1900 ] 535 0.446% 99.304% ( 1900, 2900 ] 318 0.265% 99.570% ( 2900, 4400 ] 394 0.329% 99.898% ( 4400, 6600 ] 92 0.077% 99.975% ( 6600, 9900 ] 18 0.015% 99.990% ( 9900, 14000 ] 4 0.003% 99.993% ( 14000, 22000 ] 4 0.003% 99.997% ( 22000, 33000 ] 3 0.003% 99.999% ( 33000, 50000 ] 1 0.001% 100.000% ** Level 1 read latency histogram (micros): Count: 52750 Average: 14.0243 StdDev: 169.33 Min: 1 Median: 2.3541 Max: 7950 Percentiles: P50: 2.35 P75: 3.21 P99: 13.25 P99.9: 3224.52 P99.99: 6513.57 ------------------------------------------------------ [ 0, 1 ] 555 1.052% 1.052% ( 1, 2 ] 19293 36.574% 37.627% ####### ( 2, 3 ] 18431 34.940% 72.567% ####### ( 3, 4 ] 6167 11.691% 84.258% ## ( 4, 6 ] 6203 11.759% 96.017% ## ( 6, 10 ] 1357 2.573% 98.590% # ( 10, 15 ] 333 0.631% 99.221% ( 15, 22 ] 32 0.061% 99.282% ( 22, 34 ] 1 0.002% 99.283% ( 34, 51 ] 4 0.008% 99.291% ( 51, 76 ] 10 0.019% 99.310% ( 76, 110 ] 1 0.002% 99.312% ( 170, 250 ] 6 0.011% 99.323% ( 250, 380 ] 12 0.023% 99.346% ( 380, 580 ] 42 0.080% 99.426% ( 580, 870 ] 83 0.157% 99.583% ( 870, 1300 ] 77 0.146% 99.729% ( 1300, 1900 ] 41 0.078% 99.807% ( 1900, 2900 ] 38 0.072% 99.879% ( 2900, 4400 ] 52 0.099% 99.977% ( 4400, 6600 ] 7 0.013% 99.991% ( 6600, 9900 ] 5 0.009% 100.000% ** Level 2 read latency histogram (micros): Count: 505989 Average: 16.4501 StdDev: 227.85 Min: 1 Median: 2.4073 Max: 30579 Percentiles: P50: 2.41 P75: 3.31 P99: 12.97 P99.9: 1232.64 P99.99: 1876.00 ------------------------------------------------------ [ 0, 1 ] 3523 0.696% 0.696% ( 1, 2 ] 175450 34.675% 35.371% ####### ( 2, 3 ] 181748 35.919% 71.290% ####### ( 3, 4 ] 61182 12.092% 83.382% ## ( 4, 6 ] 61097 12.075% 95.457% ## ( 6, 10 ] 15134 2.991% 98.448% # ( 10, 15 ] 4701 0.929% 99.377% ( 15, 22 ] 628 0.124% 99.501% ( 22, 34 ] 80 0.016% 99.517% ( 34, 51 ] 59 0.012% 99.528% ( 51, 76 ] 107 0.021% 99.549% ( 76, 110 ] 23 0.005% 99.554% ( 110, 170 ] 22 0.004% 99.558% ( 170, 250 ] 68 0.013% 99.572% ( 250, 380 ] 200 0.040% 99.611% ( 380, 580 ] 473 0.093% 99.705% ( 580, 870 ] 552 0.109% 99.814% ( 870, 1300 ] 517 0.102% 99.916% ( 1300, 1900 ] 390 0.077% 99.993% ( 1900, 2900 ] 447 0.088% 100.081% ( 2900, 4400 ] 591 0.117% 100.198% ( 4400, 6600 ] 172 0.034% 100.232% ( 6600, 9900 ] 57 0.011% 100.243% ( 9900, 14000 ] 4 0.001% 100.244% ( 14000, 22000 ] 3 0.001% 100.245% ( 22000, 33000 ] 6 0.001% 100.246% ** Level 3 read latency histogram (micros): Count: 599377 Average: 19.3678 StdDev: 235.17 Min: 1 Median: 2.4439 Max: 38218 Percentiles: P50: 2.44 P75: 3.35 P99: 14.65 P99.9: 1866.42 P99.99: 2724.69 ------------------------------------------------------ [ 0, 1 ] 3043 0.508% 0.508% ( 1, 2 ] 197050 32.876% 33.383% ####### ( 2, 3 ] 224378 37.435% 70.819% ####### ( 3, 4 ] 72341 12.069% 82.888% ## ( 4, 6 ] 73738 12.302% 95.191% ## ( 6, 10 ] 18409 3.071% 98.262% # ( 10, 15 ] 4760 0.794% 99.056% ( 15, 22 ] 526 0.088% 99.144% ( 22, 34 ] 61 0.010% 99.154% ( 34, 51 ] 99 0.017% 99.170% ( 51, 76 ] 143 0.024% 99.194% ( 76, 110 ] 40 0.007% 99.201% ( 110, 170 ] 66 0.011% 99.212% ( 170, 250 ] 104 0.017% 99.229% ( 250, 380 ] 293 0.049% 99.278% ( 380, 580 ] 682 0.114% 99.392% ( 580, 870 ] 1255 0.209% 99.601% ( 870, 1300 ] 1177 0.196% 99.798% ( 1300, 1900 ] 650 0.108% 99.906% ( 1900, 2900 ] 610 0.102% 100.008% ( 2900, 4400 ] 849 0.142% 100.150% ( 4400, 6600 ] 187 0.031% 100.181% ( 6600, 9900 ] 36 0.006% 100.187% ( 9900, 14000 ] 9 0.002% 100.188% ( 14000, 22000 ] 7 0.001% 100.190% ( 22000, 33000 ] 5 0.001% 100.190% ( 33000, 50000 ] 1 0.000% 100.191% ** Level 4 read latency histogram (micros): Count: 465194 Average: 40.1766 StdDev: 366.13 Min: 1 Median: 2.4651 Max: 43366 Percentiles: P50: 2.47 P75: 3.46 P99: 982.02 P99.9: 3260.70 P99.99: 3741.93 ------------------------------------------------------ [ 0, 1 ] 3126 0.672% 0.672% ( 1, 2 ] 151158 32.494% 33.166% ###### ( 2, 3 ] 168390 36.198% 69.363% ####### ( 3, 4 ] 57346 12.327% 81.691% ## ( 4, 6 ] 57332 12.324% 94.015% ## ( 6, 10 ] 14112 3.034% 97.049% # ( 10, 15 ] 3554 0.764% 97.813% ( 15, 22 ] 396 0.085% 97.898% ( 22, 34 ] 38 0.008% 97.906% ( 34, 51 ] 44 0.009% 97.915% ( 51, 76 ] 71 0.015% 97.931% ( 76, 110 ] 38 0.008% 97.939% ( 110, 170 ] 65 0.014% 97.953% ( 170, 250 ] 171 0.037% 97.989% ( 250, 380 ] 507 0.109% 98.098% ( 380, 580 ] 1361 0.293% 98.391% ( 580, 870 ] 2263 0.486% 98.877% ( 870, 1300 ] 2196 0.472% 99.350% ( 1300, 1900 ] 1283 0.276% 99.625% ( 1900, 2900 ] 966 0.208% 99.833% ( 2900, 4400 ] 1305 0.281% 100.114% ( 4400, 6600 ] 396 0.085% 100.199% ( 6600, 9900 ] 87 0.019% 100.217% ( 9900, 14000 ] 17 0.004% 100.221% ( 14000, 22000 ] 17 0.004% 100.225% ( 22000, 33000 ] 10 0.002% 100.227% ( 33000, 50000 ] 2 0.000% 100.227% ** Level 5 read latency histogram (micros): Count: 6225 Average: 1494.0937 StdDev: 1813.60 Min: 94 Median: 982.7590 Max: 70260 Percentiles: P50: 982.76 P75: 1741.07 P99: 6506.04 P99.9: 20366.67 P99.99: 59437.50 ------------------------------------------------------ ( 76, 110 ] 4 0.064% 0.064% ( 110, 170 ] 39 0.627% 0.691% ( 170, 250 ] 112 1.799% 2.490% ( 250, 380 ] 314 5.044% 7.534% # ( 380, 580 ] 855 13.735% 21.269% ### ( 580, 870 ] 1424 22.876% 44.145% ##### ( 870, 1300 ] 1390 22.329% 66.474% #### ( 1300, 1900 ] 722 11.598% 78.072% ## ( 1900, 2900 ] 454 7.293% 85.365% # ( 2900, 4400 ] 619 9.944% 95.309% ## ( 4400, 6600 ] 240 3.855% 99.165% # ( 6600, 9900 ] 36 0.578% 99.743% ( 9900, 14000 ] 5 0.080% 99.823% ( 14000, 22000 ] 6 0.096% 99.920% ( 22000, 33000 ] 3 0.048% 99.968% ( 33000, 50000 ] 1 0.016% 99.984% ( 50000, 75000 ] 1 0.016% 100.000% ** DB Stats ** Uptime(secs): 7.4 total, 7.3 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 133.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.519 H:M:S, 34.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 135.42 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.519 H:M:S, 34.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/15-09:25:21 ... thread 0: (1000000,2000000) ops and (191503.3,160246.5) ops/second in (5.221842,12.480769) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 1.60 GB 37.6 0.2 0.0 0.2 2.1 1.8 0.0 1.1 19.5 165.6 12.90 6.88 26 0.496 255K 1219 0.0 0.0 L1 0/0 0.00 KB 0.0 0.6 0.5 0.1 0.6 0.4 0.0 1.2 88.8 88.3 6.50 3.08 2 3.251 586K 3372 0.0 0.0 L2 2/1 129.36 MB 0.6 0.3 0.2 0.1 0.3 0.2 0.2 1.5 124.2 123.7 2.51 1.52 3 0.835 315K 1235 0.0 0.0 L3 27/9 1.41 GB 1.0 3.8 2.4 1.4 3.7 2.4 0.3 1.5 112.4 109.7 34.82 19.85 11 3.166 3188K 26K 0.0 0.0 L4 149/2 9.82 GB 1.0 6.6 2.8 3.8 5.8 2.0 1.3 2.1 132.0 115.8 51.55 31.18 27 1.909 1393K 0 0.0 0.0 L5 152/0 12.37 GB 0.1 0.0 0.0 0.0 0.0 0.0 3.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 349/28 25.32 GB 0.0 11.6 5.9 5.6 12.5 6.9 5.1 6.8 109.5 118.3 108.28 62.52 69 1.569 5739K 31K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.6 5.9 5.6 12.5 6.9 5.1 6.8 109.5 118.3 108.28 62.52 69 1.569 5739K 31K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.6 5.9 5.6 10.7 5.0 0.0 0.0 123.0 113.3 96.46 56.68 44 2.192 5739K 31K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 159.6 11.82 5.85 25 0.473 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.6 total, 12.5 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.51 GB write, 1018.59 MB/s write, 11.58 GB read, 943.06 MB/s read, 108.3 seconds Interval compaction: 12.51 GB write, 1025.51 MB/s write, 11.58 GB read, 949.48 MB/s read, 108.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 28, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 263107 Average: 79.1345 StdDev: 363.39 Min: 1 Median: 2.1612 Max: 35881 Percentiles: P50: 2.16 P75: 3.40 P99: 1389.77 P99.9: 4048.11 P99.99: 4976.55 ------------------------------------------------------ [ 0, 1 ] 8427 3.203% 3.203% # ( 1, 2 ] 112101 42.607% 45.809% ######### ( 2, 3 ] 68401 25.997% 71.807% ##### ( 3, 4 ] 20807 7.908% 79.715% ## ( 4, 6 ] 18879 7.175% 86.891% # ( 6, 10 ] 4825 1.834% 88.724% ( 10, 15 ] 1085 0.412% 89.137% ( 15, 22 ] 111 0.042% 89.179% ( 22, 34 ] 26 0.010% 89.189% ( 34, 51 ] 11 0.004% 89.193% ( 51, 76 ] 12 0.005% 89.198% ( 76, 110 ] 38 0.014% 89.212% ( 110, 170 ] 1121 0.426% 89.638% ( 170, 250 ] 4348 1.653% 91.291% ( 250, 380 ] 6122 2.327% 93.617% ( 380, 580 ] 5937 2.256% 95.874% ( 580, 870 ] 5106 1.941% 97.815% ( 870, 1300 ] 2938 1.117% 98.931% ( 1300, 1900 ] 1216 0.462% 99.393% ( 1900, 2900 ] 681 0.259% 99.652% ( 2900, 4400 ] 853 0.324% 99.976% ( 4400, 6600 ] 140 0.053% 100.030% ( 6600, 9900 ] 19 0.007% 100.037% ( 9900, 14000 ] 10 0.004% 100.041% ( 14000, 22000 ] 5 0.002% 100.043% ( 22000, 33000 ] 3 0.001% 100.044% ( 33000, 50000 ] 1 0.000% 100.044% ** Level 1 read latency histogram (micros): Count: 122951 Average: 15.4679 StdDev: 158.92 Min: 1 Median: 2.2982 Max: 7950 Percentiles: P50: 2.30 P75: 3.07 P99: 290.90 P99.9: 2775.61 P99.99: 4366.58 ------------------------------------------------------ [ 0, 1 ] 1467 1.193% 1.193% ( 1, 2 ] 47316 38.484% 39.677% ######## ( 2, 3 ] 42569 34.623% 74.300% ####### ( 3, 4 ] 13143 10.690% 84.989% ## ( 4, 6 ] 13078 10.637% 95.626% ## ( 6, 10 ] 3243 2.638% 98.264% # ( 10, 15 ] 652 0.530% 98.794% ( 15, 22 ] 60 0.049% 98.843% ( 22, 34 ] 2 0.002% 98.844% ( 34, 51 ] 8 0.007% 98.851% ( 51, 76 ] 10 0.008% 98.859% ( 76, 110 ] 1 0.001% 98.860% ( 110, 170 ] 20 0.016% 98.876% ( 170, 250 ] 99 0.081% 98.956% ( 250, 380 ] 170 0.138% 99.095% ( 380, 580 ] 233 0.190% 99.284% ( 580, 870 ] 312 0.254% 99.538% ( 870, 1300 ] 254 0.207% 99.745% ( 1300, 1900 ] 121 0.098% 99.843% ( 1900, 2900 ] 80 0.065% 99.908% ( 2900, 4400 ] 103 0.084% 99.992% ( 4400, 6600 ] 13 0.011% 100.002% ( 6600, 9900 ] 5 0.004% 100.007% ** Level 2 read latency histogram (micros): Count: 563935 Average: 16.1648 StdDev: 219.15 Min: 1 Median: 2.3839 Max: 30579 Percentiles: P50: 2.38 P75: 3.25 P99: 13.45 P99.9: 1253.87 P99.99: 1943.84 ------------------------------------------------------ [ 0, 1 ] 4107 0.728% 0.728% ( 1, 2 ] 200489 35.552% 36.280% ####### ( 2, 3 ] 201520 35.735% 72.015% ####### ( 3, 4 ] 66319 11.760% 83.775% ## ( 4, 6 ] 65795 11.667% 95.442% ## ( 6, 10 ] 16652 2.953% 98.395% # ( 10, 15 ] 4950 0.878% 99.272% ( 15, 22 ] 652 0.116% 99.388% ( 22, 34 ] 83 0.015% 99.403% ( 34, 51 ] 64 0.011% 99.414% ( 51, 76 ] 114 0.020% 99.434% ( 76, 110 ] 24 0.004% 99.439% ( 110, 170 ] 58 0.010% 99.449% ( 170, 250 ] 166 0.029% 99.478% ( 250, 380 ] 376 0.067% 99.545% ( 380, 580 ] 693 0.123% 99.668% ( 580, 870 ] 752 0.133% 99.801% ( 870, 1300 ] 624 0.111% 99.912% ( 1300, 1900 ] 420 0.074% 99.986% ( 1900, 2900 ] 470 0.083% 100.070% ( 2900, 4400 ] 613 0.109% 100.178% ( 4400, 6600 ] 172 0.030% 100.209% ( 6600, 9900 ] 58 0.010% 100.219% ( 9900, 14000 ] 4 0.001% 100.220% ( 14000, 22000 ] 3 0.001% 100.220% ( 22000, 33000 ] 6 0.001% 100.221% ** Level 3 read latency histogram (micros): Count: 1085128 Average: 16.0526 StdDev: 193.56 Min: 1 Median: 2.3732 Max: 38218 Percentiles: P50: 2.37 P75: 3.19 P99: 15.02 P99.9: 1470.64 P99.99: 2254.48 ------------------------------------------------------ [ 0, 1 ] 6443 0.594% 0.594% ( 1, 2 ] 388509 35.803% 36.397% ####### ( 2, 3 ] 395501 36.447% 72.844% ####### ( 3, 4 ] 122720 11.309% 84.153% ## ( 4, 6 ] 121591 11.205% 95.359% ## ( 6, 10 ] 32058 2.954% 98.313% # ( 10, 15 ] 7452 0.687% 99.000% ( 15, 22 ] 797 0.073% 99.073% ( 22, 34 ] 100 0.009% 99.082% ( 34, 51 ] 155 0.014% 99.097% ( 51, 76 ] 212 0.020% 99.116% ( 76, 110 ] 57 0.005% 99.121% ( 110, 170 ] 232 0.021% 99.143% ( 170, 250 ] 727 0.067% 99.210% ( 250, 380 ] 1298 0.120% 99.329% ( 380, 580 ] 1821 0.168% 99.497% ( 580, 870 ] 2256 0.208% 99.705% ( 870, 1300 ] 1840 0.170% 99.875% ( 1300, 1900 ] 963 0.089% 99.964% ( 1900, 2900 ] 811 0.075% 100.038% ( 2900, 4400 ] 1068 0.098% 100.137% ( 4400, 6600 ] 208 0.019% 100.156% ( 6600, 9900 ] 43 0.004% 100.160% ( 9900, 14000 ] 11 0.001% 100.161% ( 14000, 22000 ] 8 0.001% 100.162% ( 22000, 33000 ] 5 0.000% 100.162% ( 33000, 50000 ] 1 0.000% 100.162% ** Level 4 read latency histogram (micros): Count: 1012641 Average: 31.2367 StdDev: 281.33 Min: 0 Median: 2.4333 Max: 43366 Percentiles: P50: 2.43 P75: 3.39 P99: 707.47 P99.9: 2244.63 P99.99: 2861.26 ------------------------------------------------------ [ 0, 1 ] 7116 0.703% 0.703% ( 1, 2 ] 341924 33.766% 34.468% ####### ( 2, 3 ] 362944 35.841% 70.310% ####### ( 3, 4 ] 120386 11.888% 82.198% ## ( 4, 6 ] 117752 11.628% 93.826% ## ( 6, 10 ] 29932 2.956% 96.782% # ( 10, 15 ] 7574 0.748% 97.530% ( 15, 22 ] 808 0.080% 97.610% ( 22, 34 ] 99 0.010% 97.619% ( 34, 51 ] 146 0.014% 97.634% ( 51, 76 ] 197 0.019% 97.653% ( 76, 110 ] 78 0.008% 97.661% ( 110, 170 ] 661 0.065% 97.726% ( 170, 250 ] 2401 0.237% 97.963% ( 250, 380 ] 3753 0.371% 98.334% ( 380, 580 ] 4585 0.453% 98.787% ( 580, 870 ] 4911 0.485% 99.272% ( 870, 1300 ] 3818 0.377% 99.649% ( 1300, 1900 ] 2034 0.201% 99.850% ( 1900, 2900 ] 1478 0.146% 99.996% ( 2900, 4400 ] 1797 0.177% 100.173% ( 4400, 6600 ] 480 0.047% 100.221% ( 6600, 9900 ] 98 0.010% 100.230% ( 9900, 14000 ] 19 0.002% 100.232% ( 14000, 22000 ] 17 0.002% 100.234% ( 22000, 33000 ] 10 0.001% 100.235% ( 33000, 50000 ] 2 0.000% 100.235% ** Level 5 read latency histogram (micros): Count: 15381 Average: 996.5442 StdDev: 1339.48 Min: 94 Median: 631.8094 Max: 70260 Percentiles: P50: 631.81 P75: 1122.90 P99: 5808.89 P99.9: 10322.98 P99.99: 31026.97 ------------------------------------------------------ ( 76, 110 ] 18 0.117% 0.117% ( 110, 170 ] 420 2.731% 2.848% # ( 170, 250 ] 1551 10.084% 12.932% ## ( 250, 380 ] 2337 15.194% 28.126% ### ( 380, 580 ] 2818 18.321% 46.447% #### ( 580, 870 ] 3059 19.888% 66.335% #### ( 870, 1300 ] 2266 14.732% 81.068% ### ( 1300, 1900 ] 1089 7.080% 88.148% # ( 1900, 2900 ] 644 4.187% 92.335% # ( 2900, 4400 ] 851 5.533% 97.867% # ( 4400, 6600 ] 272 1.768% 99.636% ( 6600, 9900 ] 40 0.260% 99.896% ( 9900, 14000 ] 6 0.039% 99.935% ( 14000, 22000 ] 6 0.039% 99.974% ( 22000, 33000 ] 3 0.020% 99.993% ( 33000, 50000 ] 1 0.007% 100.000% ( 50000, 75000 ] 1 0.007% 100.007% ** DB Stats ** Uptime(secs): 12.6 total, 5.2 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 156.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.478 H:M:S, 27.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 188.34 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.959 H:M:S, 18.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/07/15-09:25:27 ... thread 0: (1000000,3000000) ops and (181299.5,166699.1) ops/second in (5.515734,17.996503) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/13 2.51 GB 37.6 2.0 0.0 2.0 4.7 2.8 0.0 1.7 48.5 116.5 41.46 18.77 46 0.901 2043K 11K 0.0 0.0 L1 0/0 0.00 KB 0.0 0.6 0.5 0.1 0.6 0.4 0.0 1.2 88.8 88.3 6.50 3.08 2 3.251 586K 3372 0.0 0.0 L2 1/0 58.72 MB 0.6 0.3 0.2 0.1 0.3 0.2 0.2 1.5 124.2 123.7 2.51 1.52 3 0.835 315K 1235 0.0 0.0 L3 18/0 975.08 MB 1.0 4.3 2.5 1.8 4.2 2.4 0.3 1.7 117.3 114.6 37.49 22.17 12 3.124 3678K 35K 0.0 0.0 L4 152/0 9.68 GB 1.0 8.8 3.3 5.5 7.5 2.1 1.3 2.3 129.1 110.9 69.47 42.49 35 1.985 2113K 1890 0.0 0.0 L5 156/0 12.61 GB 0.1 0.0 0.0 0.0 0.0 0.0 3.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 342/13 25.80 GB 0.0 15.9 6.5 9.4 17.3 7.9 5.4 6.3 103.3 112.5 157.43 88.04 98 1.606 8738K 52K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.9 6.5 9.4 17.3 7.9 5.4 6.3 103.3 112.5 157.43 88.04 98 1.606 8738K 52K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.9 6.5 9.4 14.5 5.1 0.0 0.0 115.5 105.7 140.84 79.18 59 2.387 8738K 52K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 170.6 16.59 8.86 39 0.425 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.1 total, 18.0 interval Flush(GB): cumulative 2.763, interval 2.763 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.30 GB write, 979.29 MB/s write, 15.89 GB read, 899.31 MB/s read, 157.4 seconds Interval compaction: 17.30 GB write, 983.91 MB/s write, 15.89 GB read, 903.56 MB/s read, 157.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 32, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 666646 Average: 43.5456 StdDev: 315.27 Min: 1 Median: 1.9456 Max: 49865 Percentiles: P50: 1.95 P75: 2.91 P99: 845.40 P99.9: 2755.23 P99.99: 3665.48 ------------------------------------------------------ [ 0, 1 ] 37430 5.615% 5.615% # ( 1, 2 ] 312909 46.938% 52.552% ######### ( 2, 3 ] 163774 24.567% 77.119% ##### ( 3, 4 ] 48594 7.289% 84.409% # ( 4, 6 ] 43526 6.529% 90.938% # ( 6, 10 ] 11289 1.693% 92.631% ( 10, 15 ] 2278 0.342% 92.973% ( 15, 22 ] 242 0.036% 93.009% ( 22, 34 ] 37 0.006% 93.015% ( 34, 51 ] 13 0.002% 93.017% ( 51, 76 ] 23 0.003% 93.020% ( 76, 110 ] 449 0.067% 93.087% ( 110, 170 ] 7104 1.066% 94.153% ( 170, 250 ] 10289 1.543% 95.697% ( 250, 380 ] 8613 1.292% 96.989% ( 380, 580 ] 7849 1.177% 98.166% ( 580, 870 ] 6076 0.911% 99.077% ( 870, 1300 ] 3397 0.510% 99.587% ( 1300, 1900 ] 1416 0.212% 99.799% ( 1900, 2900 ] 785 0.118% 99.917% ( 2900, 4400 ] 953 0.143% 100.060% ( 4400, 6600 ] 154 0.023% 100.083% ( 6600, 9900 ] 40 0.006% 100.089% ( 9900, 14000 ] 21 0.003% 100.092% ( 14000, 22000 ] 37 0.006% 100.098% ( 22000, 33000 ] 14 0.002% 100.100% ( 33000, 50000 ] 5 0.001% 100.101% ** Level 1 read latency histogram (micros): Count: 131770 Average: 15.4893 StdDev: 156.39 Min: 1 Median: 2.2983 Max: 7950 Percentiles: P50: 2.30 P75: 3.06 P99: 312.83 P99.9: 2705.31 P99.99: 4368.90 ------------------------------------------------------ [ 0, 1 ] 1564 1.187% 1.187% ( 1, 2 ] 50649 38.437% 39.624% ######## ( 2, 3 ] 45826 34.777% 74.402% ####### ( 3, 4 ] 14028 10.646% 85.047% ## ( 4, 6 ] 13771 10.451% 95.498% ## ( 6, 10 ] 3474 2.636% 98.135% # ( 10, 15 ] 704 0.534% 98.669% ( 15, 22 ] 66 0.050% 98.719% ( 22, 34 ] 2 0.002% 98.720% ( 34, 51 ] 8 0.006% 98.727% ( 51, 76 ] 10 0.008% 98.734% ( 76, 110 ] 8 0.006% 98.740% ( 110, 170 ] 71 0.054% 98.794% ( 170, 250 ] 164 0.124% 98.919% ( 250, 380 ] 222 0.168% 99.087% ( 380, 580 ] 270 0.205% 99.292% ( 580, 870 ] 342 0.260% 99.551% ( 870, 1300 ] 269 0.204% 99.756% ( 1300, 1900 ] 125 0.095% 99.850% ( 1900, 2900 ] 81 0.061% 99.912% ( 2900, 4400 ] 105 0.080% 99.992% ( 4400, 6600 ] 14 0.011% 100.002% ( 6600, 9900 ] 5 0.004% 100.006% ** Level 2 read latency histogram (micros): Count: 564517 Average: 16.7116 StdDev: 229.08 Min: 1 Median: 2.3854 Max: 30579 Percentiles: P50: 2.39 P75: 3.26 P99: 14.03 P99.9: 1274.44 P99.99: 1975.47 ------------------------------------------------------ [ 0, 1 ] 4107 0.728% 0.728% ( 1, 2 ] 200489 35.515% 36.243% ####### ( 2, 3 ] 201520 35.698% 71.940% ####### ( 3, 4 ] 66319 11.748% 83.688% ## ( 4, 6 ] 65795 11.655% 95.343% ## ( 6, 10 ] 16652 2.950% 98.293% # ( 10, 15 ] 4950 0.877% 99.170% ( 15, 22 ] 652 0.115% 99.286% ( 22, 34 ] 83 0.015% 99.300% ( 34, 51 ] 64 0.011% 99.312% ( 51, 76 ] 114 0.020% 99.332% ( 76, 110 ] 41 0.007% 99.339% ( 110, 170 ] 238 0.042% 99.381% ( 170, 250 ] 332 0.059% 99.440% ( 250, 380 ] 445 0.079% 99.519% ( 380, 580 ] 750 0.133% 99.652% ( 580, 870 ] 792 0.140% 99.792% ( 870, 1300 ] 648 0.115% 99.907% ( 1300, 1900 ] 434 0.077% 99.984% ( 1900, 2900 ] 471 0.083% 100.067% ( 2900, 4400 ] 622 0.110% 100.177% ( 4400, 6600 ] 172 0.030% 100.208% ( 6600, 9900 ] 59 0.010% 100.218% ( 9900, 14000 ] 4 0.001% 100.219% ( 14000, 22000 ] 5 0.001% 100.220% ( 22000, 33000 ] 8 0.001% 100.221% ** Level 3 read latency histogram (micros): Count: 1240436 Average: 16.8023 StdDev: 225.54 Min: 1 Median: 2.3798 Max: 61980 Percentiles: P50: 2.38 P75: 3.22 P99: 165.54 P99.9: 1470.96 P99.99: 2282.00 ------------------------------------------------------ [ 0, 1 ] 7815 0.630% 0.630% ( 1, 2 ] 441786 35.615% 36.245% ####### ( 2, 3 ] 449214 36.214% 72.460% ####### ( 3, 4 ] 141214 11.384% 83.844% ## ( 4, 6 ] 139895 11.278% 95.122% ## ( 6, 10 ] 36876 2.973% 98.095% # ( 10, 15 ] 8489 0.684% 98.779% ( 15, 22 ] 909 0.073% 98.852% ( 22, 34 ] 111 0.009% 98.861% ( 34, 51 ] 162 0.013% 98.874% ( 51, 76 ] 228 0.018% 98.893% ( 76, 110 ] 144 0.012% 98.904% ( 110, 170 ] 1284 0.104% 99.008% ( 170, 250 ] 1711 0.138% 99.146% ( 250, 380 ] 1877 0.151% 99.297% ( 380, 580 ] 2375 0.191% 99.488% ( 580, 870 ] 2690 0.217% 99.705% ( 870, 1300 ] 2103 0.170% 99.875% ( 1300, 1900 ] 1097 0.088% 99.963% ( 1900, 2900 ] 869 0.070% 100.033% ( 2900, 4400 ] 1133 0.091% 100.125% ( 4400, 6600 ] 229 0.018% 100.143% ( 6600, 9900 ] 55 0.004% 100.148% ( 9900, 14000 ] 17 0.001% 100.149% ( 14000, 22000 ] 29 0.002% 100.151% ( 22000, 33000 ] 13 0.001% 100.152% ( 33000, 50000 ] 3 0.000% 100.153% ( 50000, 75000 ] 1 0.000% 100.153% ** Level 4 read latency histogram (micros): Count: 1433330 Average: 33.2096 StdDev: 364.14 Min: 0 Median: 2.4671 Max: 51963 Percentiles: P50: 2.47 P75: 3.51 P99: 623.02 P99.9: 1824.02 P99.99: 2414.21 ------------------------------------------------------ [ 0, 1 ] 11352 0.792% 0.792% ( 1, 2 ] 469338 32.745% 33.537% ####### ( 2, 3 ] 505139 35.242% 68.779% ####### ( 3, 4 ] 173732 12.121% 80.900% ## ( 4, 6 ] 172407 12.028% 92.928% ## ( 6, 10 ] 43588 3.041% 95.969% # ( 10, 15 ] 11095 0.774% 96.743% ( 15, 22 ] 1202 0.084% 96.827% ( 22, 34 ] 134 0.009% 96.837% ( 34, 51 ] 171 0.012% 96.848% ( 51, 76 ] 268 0.019% 96.867% ( 76, 110 ] 552 0.039% 96.906% ( 110, 170 ] 7030 0.490% 97.396% ( 170, 250 ] 8099 0.565% 97.961% ( 250, 380 ] 6592 0.460% 98.421% ( 380, 580 ] 7295 0.509% 98.930% ( 580, 870 ] 6760 0.472% 99.402% ( 870, 1300 ] 4899 0.342% 99.743% ( 1300, 1900 ] 2569 0.179% 99.923% ( 1900, 2900 ] 1876 0.131% 100.054% ( 2900, 4400 ] 2202 0.154% 100.207% ( 4400, 6600 ] 568 0.040% 100.247% ( 6600, 9900 ] 158 0.011% 100.258% ( 9900, 14000 ] 49 0.003% 100.261% ( 14000, 22000 ] 107 0.007% 100.269% ( 22000, 33000 ] 61 0.004% 100.273% ( 33000, 50000 ] 18 0.001% 100.274% ( 50000, 75000 ] 2 0.000% 100.274% ** Level 5 read latency histogram (micros): Count: 28829 Average: 727.2595 StdDev: 1290.40 Min: 85 Median: 382.4948 Max: 70260 Percentiles: P50: 382.49 P75: 796.53 P99: 5116.37 P99.9: 15492.24 P99.99: 40198.14 ------------------------------------------------------ ( 76, 110 ] 306 1.061% 1.061% ( 110, 170 ] 4602 15.963% 17.025% ### ( 170, 250 ] 5426 18.821% 35.846% #### ( 250, 380 ] 4027 13.969% 49.814% ### ( 380, 580 ] 4289 14.877% 64.692% ### ( 580, 870 ] 3980 13.806% 78.497% ### ( 870, 1300 ] 2729 9.466% 87.964% ## ( 1300, 1900 ] 1326 4.600% 92.563% # ( 1900, 2900 ] 781 2.709% 95.272% # ( 2900, 4400 ] 978 3.392% 98.665% # ( 4400, 6600 ] 297 1.030% 99.695% ( 6600, 9900 ] 49 0.170% 99.865% ( 9900, 14000 ] 7 0.024% 99.889% ( 14000, 22000 ] 17 0.059% 99.948% ( 22000, 33000 ] 10 0.035% 99.983% ( 33000, 50000 ] 5 0.017% 100.000% ( 50000, 75000 ] 1 0.003% 100.003% ** DB Stats ** Uptime(secs): 18.1 total, 5.5 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 163.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.764 H:M:S, 26.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 178.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.286 H:M:S, 23.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 664.809 micros/op 5973 ops/sec 20.257 seconds 120996 operations; 5.8 MB/s (29999 of 29999 found) Microseconds per read: Count: 120996 Average: 664.8342 StdDev: 1730.24 Min: 1 Median: 322.3808 Max: 97129 Percentiles: P50: 322.38 P75: 669.88 P99: 4854.12 P99.9: 28600.33 P99.99: 54751.00 ------------------------------------------------------ [ 0, 1 ] 1 0.001% 0.001% ( 1, 2 ] 6 0.005% 0.006% ( 2, 3 ] 21 0.017% 0.023% ( 3, 4 ] 46 0.038% 0.061% ( 4, 6 ] 109 0.090% 0.151% ( 6, 10 ] 216 0.179% 0.330% ( 10, 15 ] 381 0.315% 0.645% ( 15, 22 ] 1351 1.117% 1.761% ( 22, 34 ] 2128 1.759% 3.520% ( 34, 51 ] 1738 1.436% 4.956% ( 51, 76 ] 288 0.238% 5.194% ( 76, 110 ] 114 0.094% 5.289% ( 110, 170 ] 11692 9.663% 14.952% ## ( 170, 250 ] 31453 25.995% 40.947% ##### ( 250, 380 ] 19674 16.260% 57.207% ### ( 380, 580 ] 17231 14.241% 71.448% ### ( 580, 870 ] 13868 11.462% 82.909% ## ( 870, 1300 ] 9347 7.725% 90.634% ## ( 1300, 1900 ] 4652 3.845% 94.479% # ( 1900, 2900 ] 2606 2.154% 96.633% ( 2900, 4400 ] 2702 2.233% 98.866% ( 4400, 6600 ] 785 0.649% 99.515% ( 6600, 9900 ] 179 0.148% 99.663% ( 9900, 14000 ] 71 0.059% 99.721% ( 14000, 22000 ] 135 0.112% 99.833% ( 22000, 33000 ] 135 0.112% 99.945% ( 33000, 50000 ] 53 0.044% 99.988% ( 50000, 75000 ] 10 0.008% 99.997% ( 75000, 110000 ] 4 0.003% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 1774844 rocksdb.bloom.filter.full.positive COUNT : 137513 rocksdb.bloom.filter.full.true.positive COUNT : 120331 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 665 rocksdb.memtable.miss COUNT : 120331 rocksdb.l0.hit COUNT : 10875 rocksdb.l1.hit COUNT : 140 rocksdb.l2andup.hit COUNT : 109316 rocksdb.compaction.key.drop.new COUNT : 1410680 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3587912 rocksdb.number.keys.read COUNT : 120996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3702725184 rocksdb.bytes.read COUNT : 120996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 575 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 4819521 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 17809105764 rocksdb.compact.write.bytes COUNT : 16355238859 rocksdb.flush.write.bytes COUNT : 3626844939 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 39 rocksdb.number.superversion_acquires COUNT : 749 rocksdb.number.superversion_releases COUNT : 721 rocksdb.number.superversion_cleanups COUNT : 188 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 190 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3603863552 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7166976 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 17838518309 rocksdb.non.last.level.read.count COUNT : 4282459 rocksdb.block.checksum.compute.count COUNT : 4454788 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 321.209174 P95 : 2138.722094 P99 : 4844.613811 P100 : 97127.000000 COUNT : 120996 SUM : 80319602 rocksdb.db.write.micros P50 : 1.693634 P95 : 5.219697 P99 : 7.682016 P100 : 728373.000000 COUNT : 3587912 SUM : 15147633 rocksdb.compaction.times.micros P50 : 2129166.666667 P95 : 4292222.222222 P99 : 8406698.000000 P100 : 8406698.000000 COUNT : 61 SUM : 142826933 rocksdb.compaction.times.cpu_micros P50 : 1421666.666667 P95 : 2672222.222222 P99 : 2937059.000000 P100 : 2937059.000000 COUNT : 61 SUM : 81126447 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1575.000000 P95 : 15466.666667 P99 : 17736.000000 P100 : 17736.000000 COUNT : 49 SUM : 182464 rocksdb.compaction.outfile.sync.micros P50 : 3412.195122 P95 : 12926.190476 P99 : 29700.000000 P100 : 64068.000000 COUNT : 230 SUM : 1147188 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 445.217391 P95 : 2975.000000 P99 : 5830.000000 P100 : 7454.000000 COUNT : 135 SUM : 105509 rocksdb.table.open.io.micros P50 : 7391.326531 P95 : 25344.594595 P99 : 32182.432432 P100 : 84292.000000 COUNT : 575 SUM : 5120133 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.778706 P95 : 9.816048 P99 : 256.006017 P100 : 38224.000000 COUNT : 4314754 SUM : 80880715 rocksdb.read.block.get.micros P50 : 240.956963 P95 : 1828.282609 P99 : 4261.100000 P100 : 70917.000000 COUNT : 139717 SUM : 74145057 rocksdb.write.raw.block.micros P50 : 0.570834 P95 : 1.752165 P99 : 4.408520 P100 : 73650.000000 COUNT : 4841666 SUM : 20684938 rocksdb.numfiles.in.singlecompaction P50 : 3.197917 P95 : 5.300000 P99 : 10.650000 P100 : 11.000000 COUNT : 87 SUM : 319 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.561912 P95 : 1122.973239 P99 : 1891.000000 P100 : 728087.000000 COUNT : 3703 SUM : 4819871 rocksdb.sst.read.micros P50 : 2.339357 P95 : 11.825294 P99 : 751.159785 P100 : 70260.000000 COUNT : 4282773 SUM : 139898285 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 120996 SUM : 120996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3587912 SUM : 3702725184 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 256500.000000 P95 : 922333.333333 P99 : 1032968.000000 P100 : 1032968.000000 COUNT : 49 SUM : 18676665 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 229 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0