[2024-11-17 14:18:52.060739] Starting SPDK v25.01-pre git sha1 ca87521f7 / DPDK 24.03.0 initialization... [2024-11-17 14:18:52.060858] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2986291 ] Set seed to 1731849532058155 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-17 14:18:52.201118] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-17 14:18:52.304458] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-17 14:18:52.304512] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2986291' to capture a snapshot of events at runtime. [2024-11-17 14:18:52.304542] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-17 14:18:52.304557] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-17 14:18:52.304567] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2986291 for offline analysis/debug. [2024-11-17 14:18:52.305873] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 17 14:18:55 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/17-14:19:02 ... thread 0: (1000000,1000000) ops and (132596.3,132596.3) ops/second in (7.541686,7.541686) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 878.13 MB 50.1 0.3 0.0 0.3 1.2 0.9 0.0 1.4 28.7 108.7 10.97 4.49 11 0.997 319K 1773 0.0 0.0 L1 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 1.5 89.8 89.2 3.84 1.66 1 3.837 349K 2408 0.0 0.0 L2 4/1 416.49 MB 3.2 0.3 0.1 0.1 0.3 0.1 0.2 2.0 111.5 110.9 2.31 1.40 1 2.310 261K 1443 0.0 0.0 L3 34/8 1.73 GB 1.3 2.0 1.7 0.3 2.0 1.7 0.1 1.1 107.0 105.1 19.22 10.48 9 2.136 1541K 6 0.0 0.0 L4 169/25 12.02 GB 1.0 3.5 1.9 1.6 3.3 1.7 0.0 1.7 118.0 110.5 30.53 18.33 16 1.908 830K 453 0.0 0.0 L5 116/0 9.10 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 330/38 24.12 GB 0.0 6.4 4.0 2.5 7.0 4.6 0.3 8.2 98.3 107.4 66.87 36.36 38 1.760 3302K 6083 0.0 0.0 Int 0/0 0.00 KB 0.0 6.4 4.0 2.5 7.0 4.6 0.3 8.2 98.3 107.4 66.87 36.36 38 1.760 3302K 6083 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.4 4.0 2.5 6.2 3.7 0.0 0.0 109.7 105.1 59.96 33.52 28 2.141 3302K 6083 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 127.3 6.91 2.83 10 0.691 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.6 total, 7.5 interval Flush(GB): cumulative 0.859, interval 0.859 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.02 GB write, 945.00 MB/s write, 6.42 GB read, 864.86 MB/s read, 66.9 seconds Interval compaction: 7.02 GB write, 952.53 MB/s write, 6.42 GB read, 871.75 MB/s read, 66.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 21, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 194300 Average: 36.6753 StdDev: 465.71 Min: 1 Median: 2.1810 Max: 63621 Percentiles: P50: 2.18 P75: 3.25 P99: 826.80 P99.9: 4186.22 P99.99: 12339.50 ------------------------------------------------------ [ 0, 1 ] 4228 2.176% 2.176% ( 1, 2 ] 83340 42.892% 45.068% ######### ( 2, 3 ] 52944 27.249% 72.317% ##### ( 3, 4 ] 20609 10.607% 82.924% ## ( 4, 6 ] 21656 11.146% 94.069% ## ( 6, 10 ] 5452 2.806% 96.875% # ( 10, 15 ] 1020 0.525% 97.400% ( 15, 22 ] 170 0.087% 97.488% ( 22, 34 ] 10 0.005% 97.493% ( 34, 51 ] 8 0.004% 97.497% ( 51, 76 ] 16 0.008% 97.505% ( 76, 110 ] 10 0.005% 97.511% ( 110, 170 ] 58 0.030% 97.540% ( 170, 250 ] 208 0.107% 97.647% ( 250, 380 ] 566 0.291% 97.939% ( 380, 580 ] 1085 0.558% 98.497% ( 580, 870 ] 1148 0.591% 99.088% ( 870, 1300 ] 677 0.348% 99.436% ( 1300, 1900 ] 250 0.129% 99.565% ( 1900, 2900 ] 324 0.167% 99.732% ( 2900, 4400 ] 381 0.196% 99.928% ( 4400, 6600 ] 82 0.042% 99.970% ( 6600, 9900 ] 35 0.018% 99.988% ( 9900, 14000 ] 6 0.003% 99.991% ( 14000, 22000 ] 26 0.013% 100.005% ( 22000, 33000 ] 12 0.006% 100.011% ( 33000, 50000 ] 2 0.001% 100.012% ( 50000, 75000 ] 2 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 81927 Average: 17.9894 StdDev: 343.55 Min: 1 Median: 2.3645 Max: 47549 Percentiles: P50: 2.36 P75: 3.39 P99: 21.22 P99.9: 3334.80 P99.99: 16065.49 ------------------------------------------------------ [ 0, 1 ] 513 0.626% 0.626% ( 1, 2 ] 30894 37.709% 38.335% ######## ( 2, 3 ] 26216 31.999% 70.335% ###### ( 3, 4 ] 9842 12.013% 82.348% ## ( 4, 6 ] 10484 12.797% 95.144% ### ( 6, 10 ] 2565 3.131% 98.275% # ( 10, 15 ] 536 0.654% 98.930% ( 15, 22 ] 65 0.079% 99.009% ( 22, 34 ] 10 0.012% 99.021% ( 34, 51 ] 28 0.034% 99.055% ( 51, 76 ] 14 0.017% 99.072% ( 76, 110 ] 6 0.007% 99.080% ( 110, 170 ] 7 0.009% 99.088% ( 170, 250 ] 24 0.029% 99.118% ( 250, 380 ] 86 0.105% 99.222% ( 380, 580 ] 154 0.188% 99.410% ( 580, 870 ] 197 0.240% 99.651% ( 870, 1300 ] 88 0.107% 99.758% ( 1300, 1900 ] 42 0.051% 99.810% ( 1900, 2900 ] 59 0.072% 99.882% ( 2900, 4400 ] 52 0.063% 99.945% ( 4400, 6600 ] 20 0.024% 99.969% ( 6600, 9900 ] 12 0.015% 99.984% ( 9900, 14000 ] 3 0.004% 99.988% ( 14000, 22000 ] 7 0.009% 99.996% ( 22000, 33000 ] 1 0.001% 99.998% ( 33000, 50000 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 413340 Average: 14.9141 StdDev: 231.24 Min: 1 Median: 2.2087 Max: 37954 Percentiles: P50: 2.21 P75: 3.21 P99: 13.42 P99.9: 1380.98 P99.99: 2402.06 ------------------------------------------------------ [ 0, 1 ] 4714 1.140% 1.140% ( 1, 2 ] 177333 42.902% 44.043% ######### ( 2, 3 ] 117980 28.543% 72.586% ###### ( 3, 4 ] 46818 11.327% 83.913% ## ( 4, 6 ] 48614 11.761% 95.674% ## ( 6, 10 ] 11704 2.832% 98.506% # ( 10, 15 ] 2987 0.723% 99.228% ( 15, 22 ] 505 0.122% 99.350% ( 22, 34 ] 75 0.018% 99.369% ( 34, 51 ] 117 0.028% 99.397% ( 51, 76 ] 72 0.017% 99.414% ( 76, 110 ] 28 0.007% 99.421% ( 110, 170 ] 37 0.009% 99.430% ( 170, 250 ] 84 0.020% 99.450% ( 250, 380 ] 339 0.082% 99.532% ( 380, 580 ] 608 0.147% 99.679% ( 580, 870 ] 538 0.130% 99.810% ( 870, 1300 ] 341 0.082% 99.892% ( 1300, 1900 ] 242 0.059% 99.951% ( 1900, 2900 ] 324 0.078% 100.029% ( 2900, 4400 ] 365 0.088% 100.117% ( 4400, 6600 ] 125 0.030% 100.148% ( 6600, 9900 ] 30 0.007% 100.155% ( 9900, 14000 ] 4 0.001% 100.156% ( 14000, 22000 ] 7 0.002% 100.157% ( 22000, 33000 ] 5 0.001% 100.159% ( 33000, 50000 ] 2 0.000% 100.159% ** Level 3 read latency histogram (micros): Count: 552424 Average: 18.5481 StdDev: 340.46 Min: 1 Median: 2.3044 Max: 70147 Percentiles: P50: 2.30 P75: 3.30 P99: 14.34 P99.9: 1226.14 P99.99: 1909.30 ------------------------------------------------------ [ 0, 1 ] 4592 0.831% 0.831% ( 1, 2 ] 219523 39.738% 40.569% ######## ( 2, 3 ] 171125 30.977% 71.546% ###### ( 3, 4 ] 64358 11.650% 83.197% ## ( 4, 6 ] 68696 12.435% 95.632% ## ( 6, 10 ] 16113 2.917% 98.549% # ( 10, 15 ] 2875 0.520% 99.069% ( 15, 22 ] 406 0.073% 99.143% ( 22, 34 ] 98 0.018% 99.160% ( 34, 51 ] 188 0.034% 99.194% ( 51, 76 ] 119 0.022% 99.216% ( 76, 110 ] 45 0.008% 99.224% ( 110, 170 ] 79 0.014% 99.238% ( 170, 250 ] 213 0.039% 99.277% ( 250, 380 ] 531 0.096% 99.373% ( 380, 580 ] 1116 0.202% 99.575% ( 580, 870 ] 1239 0.224% 99.799% ( 870, 1300 ] 672 0.122% 99.921% ( 1300, 1900 ] 378 0.068% 99.990% ( 1900, 2900 ] 404 0.073% 100.063% ( 2900, 4400 ] 452 0.082% 100.144% ( 4400, 6600 ] 140 0.025% 100.170% ( 6600, 9900 ] 52 0.009% 100.179% ( 9900, 14000 ] 21 0.004% 100.183% ( 14000, 22000 ] 36 0.007% 100.190% ( 22000, 33000 ] 26 0.005% 100.194% ( 33000, 50000 ] 7 0.001% 100.196% ( 50000, 75000 ] 1 0.000% 100.196% ** Level 4 read latency histogram (micros): Count: 676784 Average: 34.4292 StdDev: 482.40 Min: 1 Median: 2.3376 Max: 73925 Percentiles: P50: 2.34 P75: 3.43 P99: 628.87 P99.9: 2619.10 P99.99: 3340.91 ------------------------------------------------------ [ 0, 1 ] 6267 0.926% 0.926% ( 1, 2 ] 263510 38.936% 39.862% ######## ( 2, 3 ] 203257 30.033% 69.894% ###### ( 3, 4 ] 80737 11.930% 81.824% ## ( 4, 6 ] 85600 12.648% 94.472% ### ( 6, 10 ] 19897 2.940% 97.412% # ( 10, 15 ] 3842 0.568% 97.980% ( 15, 22 ] 520 0.077% 98.056% ( 22, 34 ] 104 0.015% 98.072% ( 34, 51 ] 182 0.027% 98.099% ( 51, 76 ] 164 0.024% 98.123% ( 76, 110 ] 60 0.009% 98.132% ( 110, 170 ] 155 0.023% 98.155% ( 170, 250 ] 491 0.073% 98.227% ( 250, 380 ] 1464 0.216% 98.444% ( 380, 580 ] 3213 0.475% 98.918% ( 580, 870 ] 3294 0.487% 99.405% ( 870, 1300 ] 1844 0.272% 99.677% ( 1300, 1900 ] 815 0.120% 99.798% ( 1900, 2900 ] 964 0.142% 99.940% ( 2900, 4400 ] 1151 0.170% 100.110% ( 4400, 6600 ] 378 0.056% 100.166% ( 6600, 9900 ] 106 0.016% 100.182% ( 9900, 14000 ] 53 0.008% 100.190% ( 14000, 22000 ] 86 0.013% 100.202% ( 22000, 33000 ] 57 0.008% 100.211% ( 33000, 50000 ] 15 0.002% 100.213% ( 50000, 75000 ] 4 0.001% 100.214% ** Level 5 read latency histogram (micros): Count: 8351 Average: 1196.9835 StdDev: 2125.04 Min: 94 Median: 689.3871 Max: 56069 Percentiles: P50: 689.39 P75: 1164.31 P99: 6459.58 P99.9: 32742.60 P99.99: 54122.50 ------------------------------------------------------ ( 76, 110 ] 3 0.036% 0.036% ( 110, 170 ] 77 0.922% 0.958% ( 170, 250 ] 321 3.844% 4.802% # ( 250, 380 ] 959 11.484% 16.285% ## ( 380, 580 ] 2000 23.949% 40.235% ##### ( 580, 870 ] 2162 25.889% 66.124% ##### ( 870, 1300 ] 1083 12.969% 79.092% ### ( 1300, 1900 ] 493 5.903% 84.996% # ( 1900, 2900 ] 446 5.341% 90.336% # ( 2900, 4400 ] 540 6.466% 96.803% # ( 4400, 6600 ] 196 2.347% 99.150% ( 6600, 9900 ] 33 0.395% 99.545% ( 9900, 14000 ] 4 0.048% 99.593% ( 14000, 22000 ] 11 0.132% 99.725% ( 22000, 33000 ] 15 0.180% 99.904% ( 33000, 50000 ] 7 0.084% 99.988% ( 50000, 75000 ] 1 0.012% 100.000% ** DB Stats ** Uptime(secs): 7.6 total, 7.5 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 129.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.960 H:M:S, 38.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 130.46 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.960 H:M:S, 39.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/17-14:19:07 ... thread 0: (1000000,2000000) ops and (199885.3,159431.7) ops/second in (5.002870,12.544556) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 1.83 GB 62.5 1.3 0.0 1.3 3.1 1.8 0.0 1.7 61.8 149.8 21.35 11.93 28 0.762 1340K 8194 0.0 0.0 L1 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 1.5 89.8 89.2 3.84 1.66 1 3.837 349K 2408 0.0 0.0 L2 2/1 187.75 MB 0.6 0.3 0.1 0.1 0.3 0.1 0.2 2.0 111.5 110.9 2.31 1.40 1 2.310 261K 1443 0.0 0.0 L3 20/8 1.07 GB 0.6 2.3 1.9 0.4 2.3 1.9 0.1 1.2 108.6 106.8 21.69 12.06 11 1.972 1846K 3260 0.0 0.0 L4 151/0 9.66 GB 1.0 8.1 2.7 5.4 7.0 1.7 0.1 2.6 126.4 110.6 65.24 38.98 31 2.105 1644K 453 0.0 0.0 L5 151/0 11.57 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 336/19 24.31 GB 0.0 12.2 5.0 7.3 13.0 5.7 2.8 7.1 109.4 116.5 114.43 66.03 72 1.589 5442K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.2 5.0 7.3 13.0 5.7 2.8 7.1 109.4 116.5 114.43 66.03 72 1.589 5442K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.2 5.0 7.3 11.2 3.9 0.0 0.0 121.9 111.4 102.74 60.25 48 2.140 5442K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 161.3 11.70 5.79 24 0.487 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.6 total, 12.5 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.02 GB write, 1057.43 MB/s write, 12.23 GB read, 993.57 MB/s read, 114.4 seconds Interval compaction: 13.02 GB write, 1062.49 MB/s write, 12.23 GB read, 998.33 MB/s read, 114.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 32, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 414920 Average: 33.4046 StdDev: 360.15 Min: 1 Median: 1.9221 Max: 63621 Percentiles: P50: 1.92 P75: 2.92 P99: 649.63 P99.9: 3511.32 P99.99: 5054.90 ------------------------------------------------------ [ 0, 1 ] 20046 4.831% 4.831% # ( 1, 2 ] 203241 48.983% 53.814% ########## ( 2, 3 ] 95298 22.968% 76.782% ##### ( 3, 4 ] 33719 8.127% 84.909% ## ( 4, 6 ] 32449 7.821% 92.729% ## ( 6, 10 ] 8494 2.047% 94.777% ( 10, 15 ] 1619 0.390% 95.167% ( 15, 22 ] 243 0.059% 95.225% ( 22, 34 ] 23 0.006% 95.231% ( 34, 51 ] 15 0.004% 95.235% ( 51, 76 ] 20 0.005% 95.239% ( 76, 110 ] 54 0.013% 95.252% ( 110, 170 ] 1782 0.429% 95.682% ( 170, 250 ] 6129 1.477% 97.159% ( 250, 380 ] 3991 0.962% 98.121% ( 380, 580 ] 3127 0.754% 98.874% ( 580, 870 ] 2169 0.523% 99.397% ( 870, 1300 ] 1015 0.245% 99.642% ( 1300, 1900 ] 370 0.089% 99.731% ( 1900, 2900 ] 470 0.113% 99.844% ( 2900, 4400 ] 567 0.137% 99.981% ( 4400, 6600 ] 126 0.030% 100.011% ( 6600, 9900 ] 46 0.011% 100.022% ( 9900, 14000 ] 9 0.002% 100.025% ( 14000, 22000 ] 29 0.007% 100.032% ( 22000, 33000 ] 14 0.003% 100.035% ( 33000, 50000 ] 3 0.001% 100.036% ( 50000, 75000 ] 2 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 89850 Average: 19.1958 StdDev: 336.45 Min: 1 Median: 2.3786 Max: 47549 Percentiles: P50: 2.38 P75: 3.43 P99: 255.79 P99.9: 3539.77 P99.99: 15160.00 ------------------------------------------------------ [ 0, 1 ] 525 0.584% 0.584% ( 1, 2 ] 33523 37.310% 37.894% ####### ( 2, 3 ] 28729 31.974% 69.869% ###### ( 3, 4 ] 10837 12.061% 81.930% ## ( 4, 6 ] 11596 12.906% 94.836% ### ( 6, 10 ] 2826 3.145% 97.981% # ( 10, 15 ] 605 0.673% 98.654% ( 15, 22 ] 71 0.079% 98.733% ( 22, 34 ] 10 0.011% 98.745% ( 34, 51 ] 28 0.031% 98.776% ( 51, 76 ] 15 0.017% 98.792% ( 76, 110 ] 8 0.009% 98.801% ( 110, 170 ] 35 0.039% 98.840% ( 170, 250 ] 137 0.152% 98.993% ( 250, 380 ] 146 0.162% 99.155% ( 380, 580 ] 199 0.221% 99.377% ( 580, 870 ] 216 0.240% 99.617% ( 870, 1300 ] 104 0.116% 99.733% ( 1300, 1900 ] 53 0.059% 99.792% ( 1900, 2900 ] 69 0.077% 99.869% ( 2900, 4400 ] 66 0.073% 99.942% ( 4400, 6600 ] 27 0.030% 99.972% ( 6600, 9900 ] 12 0.013% 99.986% ( 9900, 14000 ] 3 0.003% 99.989% ( 14000, 22000 ] 7 0.008% 99.997% ( 22000, 33000 ] 1 0.001% 99.998% ( 33000, 50000 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 458399 Average: 14.7886 StdDev: 228.06 Min: 1 Median: 2.2057 Max: 37954 Percentiles: P50: 2.21 P75: 3.20 P99: 13.80 P99.9: 1467.02 P99.99: 2533.41 ------------------------------------------------------ [ 0, 1 ] 5422 1.183% 1.183% ( 1, 2 ] 196760 42.923% 44.106% ######### ( 2, 3 ] 131351 28.654% 72.760% ###### ( 3, 4 ] 51368 11.206% 83.966% ## ( 4, 6 ] 53458 11.662% 95.628% ## ( 6, 10 ] 13008 2.838% 98.466% # ( 10, 15 ] 3225 0.704% 99.170% ( 15, 22 ] 535 0.117% 99.286% ( 22, 34 ] 83 0.018% 99.304% ( 34, 51 ] 134 0.029% 99.334% ( 51, 76 ] 81 0.018% 99.351% ( 76, 110 ] 30 0.007% 99.358% ( 110, 170 ] 77 0.017% 99.375% ( 170, 250 ] 236 0.051% 99.426% ( 250, 380 ] 444 0.097% 99.523% ( 380, 580 ] 678 0.148% 99.671% ( 580, 870 ] 602 0.131% 99.802% ( 870, 1300 ] 374 0.082% 99.884% ( 1300, 1900 ] 268 0.058% 99.942% ( 1900, 2900 ] 346 0.075% 100.018% ( 2900, 4400 ] 390 0.085% 100.103% ( 4400, 6600 ] 130 0.028% 100.131% ( 6600, 9900 ] 37 0.008% 100.139% ( 9900, 14000 ] 5 0.001% 100.140% ( 14000, 22000 ] 8 0.002% 100.142% ( 22000, 33000 ] 5 0.001% 100.143% ( 33000, 50000 ] 2 0.000% 100.144% ** Level 3 read latency histogram (micros): Count: 817137 Average: 17.0264 StdDev: 300.50 Min: 1 Median: 2.2392 Max: 70147 Percentiles: P50: 2.24 P75: 3.18 P99: 64.03 P99.9: 1238.04 P99.99: 2134.93 ------------------------------------------------------ [ 0, 1 ] 9110 1.115% 1.115% ( 1, 2 ] 340323 41.648% 42.763% ######## ( 2, 3 ] 247184 30.250% 73.013% ###### ( 3, 4 ] 89737 10.982% 83.995% ## ( 4, 6 ] 94244 11.533% 95.528% ## ( 6, 10 ] 23286 2.850% 98.378% # ( 10, 15 ] 4083 0.500% 98.878% ( 15, 22 ] 578 0.071% 98.949% ( 22, 34 ] 119 0.015% 98.963% ( 34, 51 ] 226 0.028% 98.991% ( 51, 76 ] 147 0.018% 99.009% ( 76, 110 ] 62 0.008% 99.016% ( 110, 170 ] 384 0.047% 99.063% ( 170, 250 ] 1259 0.154% 99.217% ( 250, 380 ] 1267 0.155% 99.372% ( 380, 580 ] 1740 0.213% 99.585% ( 580, 870 ] 1781 0.218% 99.803% ( 870, 1300 ] 924 0.113% 99.916% ( 1300, 1900 ] 482 0.059% 99.975% ( 1900, 2900 ] 512 0.063% 100.038% ( 2900, 4400 ] 611 0.075% 100.113% ( 4400, 6600 ] 164 0.020% 100.133% ( 6600, 9900 ] 70 0.009% 100.141% ( 9900, 14000 ] 22 0.003% 100.144% ( 14000, 22000 ] 45 0.006% 100.150% ( 22000, 33000 ] 26 0.003% 100.153% ( 33000, 50000 ] 8 0.001% 100.154% ( 50000, 75000 ] 1 0.000% 100.154% ** Level 4 read latency histogram (micros): Count: 1410208 Average: 28.0573 StdDev: 380.50 Min: 1 Median: 2.3316 Max: 73925 Percentiles: P50: 2.33 P75: 3.44 P99: 455.20 P99.9: 1642.89 P99.99: 2338.94 ------------------------------------------------------ [ 0, 1 ] 13201 0.936% 0.936% ( 1, 2 ] 553279 39.234% 40.170% ######## ( 2, 3 ] 418061 29.645% 69.815% ###### ( 3, 4 ] 168008 11.914% 81.729% ## ( 4, 6 ] 174254 12.357% 94.086% ## ( 6, 10 ] 40890 2.900% 96.985% # ( 10, 15 ] 8442 0.599% 97.584% ( 15, 22 ] 1107 0.078% 97.662% ( 22, 34 ] 196 0.014% 97.676% ( 34, 51 ] 365 0.026% 97.702% ( 51, 76 ] 337 0.024% 97.726% ( 76, 110 ] 164 0.012% 97.738% ( 110, 170 ] 2236 0.159% 97.896% ( 170, 250 ] 7595 0.539% 98.435% ( 250, 380 ] 5658 0.401% 98.836% ( 380, 580 ] 6154 0.436% 99.272% ( 580, 870 ] 5319 0.377% 99.650% ( 870, 1300 ] 2775 0.197% 99.846% ( 1300, 1900 ] 1326 0.094% 99.940% ( 1900, 2900 ] 1597 0.113% 100.054% ( 2900, 4400 ] 1839 0.130% 100.184% ( 4400, 6600 ] 567 0.040% 100.224% ( 6600, 9900 ] 167 0.012% 100.236% ( 9900, 14000 ] 85 0.006% 100.242% ( 14000, 22000 ] 109 0.008% 100.250% ( 22000, 33000 ] 67 0.005% 100.255% ( 33000, 50000 ] 17 0.001% 100.256% ( 50000, 75000 ] 4 0.000% 100.256% ** Level 5 read latency histogram (micros): Count: 21009 Average: 760.4340 StdDev: 1596.59 Min: 94 Median: 390.6939 Max: 56069 Percentiles: P50: 390.69 P75: 743.19 P99: 5565.47 P99.9: 26047.42 P99.99: 46031.63 ------------------------------------------------------ ( 76, 110 ] 36 0.171% 0.171% ( 110, 170 ] 1433 6.821% 6.992% # ( 170, 250 ] 5284 25.151% 32.143% ##### ( 250, 380 ] 3555 16.921% 49.065% ### ( 380, 580 ] 3675 17.493% 66.557% ### ( 580, 870 ] 3152 15.003% 81.560% ### ( 870, 1300 ] 1523 7.249% 88.810% # ( 1300, 1900 ] 638 3.037% 91.846% # ( 1900, 2900 ] 608 2.894% 94.740% # ( 2900, 4400 ] 763 3.632% 98.372% # ( 4400, 6600 ] 249 1.185% 99.557% ( 6600, 9900 ] 42 0.200% 99.757% ( 9900, 14000 ] 7 0.033% 99.791% ( 14000, 22000 ] 16 0.076% 99.867% ( 22000, 33000 ] 19 0.090% 99.957% ( 33000, 50000 ] 9 0.043% 100.000% ( 50000, 75000 ] 1 0.005% 100.005% ** DB Stats ** Uptime(secs): 12.6 total, 5.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 156.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.794 H:M:S, 30.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 196.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.834 H:M:S, 16.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/17-14:19:11 ... thread 0: (1000000,3000000) ops and (271733.9,184904.1) ops/second in (3.680071,16.224627) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 2.81 GB 137.6 2.0 0.0 2.0 4.8 2.8 0.0 1.7 75.2 179.5 27.60 17.74 47 0.587 2107K 11K 0.0 0.0 L1 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 1.5 89.8 89.2 3.84 1.66 1 3.837 349K 2408 0.0 0.0 L2 1/0 60.40 MB 0.6 0.3 0.1 0.1 0.3 0.1 0.2 2.0 111.5 110.9 2.31 1.40 1 2.310 261K 1443 0.0 0.0 L3 16/0 954.31 MB 1.0 2.9 2.1 0.8 2.8 2.0 0.1 1.4 119.4 117.5 24.55 14.70 12 2.046 2375K 3260 0.0 0.0 L4 152/0 9.61 GB 1.0 8.4 2.7 5.7 7.4 1.7 0.3 2.7 129.3 112.9 66.73 40.36 32 2.085 1713K 453 0.0 0.0 L5 155/0 11.81 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 343/14 25.22 GB 0.0 13.9 5.2 8.7 15.6 6.8 3.3 5.5 113.9 127.7 125.03 75.85 93 1.344 6808K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.9 5.2 8.7 15.6 6.8 3.3 5.5 113.9 127.7 125.03 75.85 93 1.344 6808K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.9 5.2 8.7 12.8 4.0 0.0 0.0 129.3 118.8 110.11 67.23 53 2.078 6808K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 193.9 14.92 8.62 40 0.373 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.3 total, 16.2 interval Flush(GB): cumulative 2.825, interval 2.825 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.60 GB write, 980.71 MB/s write, 13.90 GB read, 874.23 MB/s read, 125.0 seconds Interval compaction: 15.60 GB write, 984.34 MB/s write, 13.90 GB read, 877.46 MB/s read, 125.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 32, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 692881 Average: 28.1826 StdDev: 281.79 Min: 1 Median: 1.7765 Max: 63621 Percentiles: P50: 1.78 P75: 2.71 P99: 471.33 P99.9: 2440.68 P99.99: 3979.34 ------------------------------------------------------ [ 0, 1 ] 62941 9.084% 9.084% ## ( 1, 2 ] 365098 52.693% 61.777% ########### ( 2, 3 ] 128920 18.606% 80.383% #### ( 3, 4 ] 42228 6.095% 86.478% # ( 4, 6 ] 38614 5.573% 92.051% # ( 6, 10 ] 9790 1.413% 93.464% ( 10, 15 ] 1930 0.279% 93.742% ( 15, 22 ] 284 0.041% 93.783% ( 22, 34 ] 33 0.005% 93.788% ( 34, 51 ] 17 0.002% 93.790% ( 51, 76 ] 21 0.003% 93.793% ( 76, 110 ] 219 0.032% 93.825% ( 110, 170 ] 7092 1.024% 94.848% ( 170, 250 ] 19300 2.785% 97.634% # ( 250, 380 ] 7545 1.089% 98.723% ( 380, 580 ] 4207 0.607% 99.330% ( 580, 870 ] 2301 0.332% 99.662% ( 870, 1300 ] 1020 0.147% 99.809% ( 1300, 1900 ] 374 0.054% 99.863% ( 1900, 2900 ] 470 0.068% 99.931% ( 2900, 4400 ] 568 0.082% 100.013% ( 4400, 6600 ] 126 0.018% 100.031% ( 6600, 9900 ] 46 0.007% 100.038% ( 9900, 14000 ] 9 0.001% 100.039% ( 14000, 22000 ] 29 0.004% 100.043% ( 22000, 33000 ] 14 0.002% 100.045% ( 33000, 50000 ] 3 0.000% 100.046% ( 50000, 75000 ] 2 0.000% 100.046% ** Level 1 read latency histogram (micros): Count: 90270 Average: 20.1431 StdDev: 336.01 Min: 1 Median: 2.3859 Max: 47549 Percentiles: P50: 2.39 P75: 3.45 P99: 305.72 P99.9: 3530.23 P99.99: 15112.00 ------------------------------------------------------ [ 0, 1 ] 525 0.582% 0.582% ( 1, 2 ] 33523 37.136% 37.718% ####### ( 2, 3 ] 28729 31.826% 69.544% ###### ( 3, 4 ] 10837 12.005% 81.549% ## ( 4, 6 ] 11596 12.846% 94.395% ### ( 6, 10 ] 2826 3.131% 97.525% # ( 10, 15 ] 605 0.670% 98.195% ( 15, 22 ] 71 0.079% 98.274% ( 22, 34 ] 10 0.011% 98.285% ( 34, 51 ] 28 0.031% 98.316% ( 51, 76 ] 15 0.017% 98.333% ( 76, 110 ] 13 0.014% 98.347% ( 110, 170 ] 127 0.141% 98.488% ( 170, 250 ] 374 0.414% 98.902% ( 250, 380 ] 206 0.228% 99.130% ( 380, 580 ] 219 0.243% 99.373% ( 580, 870 ] 221 0.245% 99.618% ( 870, 1300 ] 105 0.116% 99.734% ( 1300, 1900 ] 53 0.059% 99.793% ( 1900, 2900 ] 69 0.076% 99.869% ( 2900, 4400 ] 66 0.073% 99.942% ( 4400, 6600 ] 27 0.030% 99.972% ( 6600, 9900 ] 12 0.013% 99.986% ( 9900, 14000 ] 3 0.003% 99.989% ( 14000, 22000 ] 7 0.008% 99.997% ( 22000, 33000 ] 1 0.001% 99.998% ( 33000, 50000 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 478826 Average: 14.3288 StdDev: 223.19 Min: 1 Median: 2.1736 Max: 37954 Percentiles: P50: 2.17 P75: 3.14 P99: 13.73 P99.9: 1421.29 P99.99: 2527.51 ------------------------------------------------------ [ 0, 1 ] 6470 1.351% 1.351% ( 1, 2 ] 209302 43.711% 45.063% ######### ( 2, 3 ] 136200 28.445% 73.507% ###### ( 3, 4 ] 52190 10.900% 84.407% ## ( 4, 6 ] 53994 11.276% 95.683% ## ( 6, 10 ] 13395 2.797% 98.481% # ( 10, 15 ] 3331 0.696% 99.176% ( 15, 22 ] 539 0.113% 99.289% ( 22, 34 ] 84 0.018% 99.306% ( 34, 51 ] 134 0.028% 99.334% ( 51, 76 ] 81 0.017% 99.351% ( 76, 110 ] 31 0.006% 99.358% ( 110, 170 ] 105 0.022% 99.380% ( 170, 250 ] 301 0.063% 99.443% ( 250, 380 ] 477 0.100% 99.542% ( 380, 580 ] 682 0.142% 99.685% ( 580, 870 ] 603 0.126% 99.811% ( 870, 1300 ] 374 0.078% 99.889% ( 1300, 1900 ] 268 0.056% 99.945% ( 1900, 2900 ] 346 0.072% 100.017% ( 2900, 4400 ] 390 0.081% 100.098% ( 4400, 6600 ] 130 0.027% 100.126% ( 6600, 9900 ] 37 0.008% 100.133% ( 9900, 14000 ] 5 0.001% 100.134% ( 14000, 22000 ] 8 0.002% 100.136% ( 22000, 33000 ] 5 0.001% 100.137% ( 33000, 50000 ] 2 0.000% 100.137% ** Level 3 read latency histogram (micros): Count: 856499 Average: 17.0504 StdDev: 293.78 Min: 0 Median: 2.2120 Max: 70147 Percentiles: P50: 2.21 P75: 3.14 P99: 203.52 P99.9: 1218.42 P99.99: 2121.39 ------------------------------------------------------ [ 0, 1 ] 11576 1.352% 1.352% ( 1, 2 ] 362563 42.331% 43.682% ######## ( 2, 3 ] 255203 29.796% 73.478% ###### ( 3, 4 ] 91546 10.688% 84.167% ## ( 4, 6 ] 95425 11.141% 95.308% ## ( 6, 10 ] 23997 2.802% 98.110% # ( 10, 15 ] 4221 0.493% 98.603% ( 15, 22 ] 599 0.070% 98.673% ( 22, 34 ] 123 0.014% 98.687% ( 34, 51 ] 226 0.026% 98.713% ( 51, 76 ] 147 0.017% 98.731% ( 76, 110 ] 82 0.010% 98.740% ( 110, 170 ] 1044 0.122% 98.862% ( 170, 250 ] 2821 0.329% 99.191% ( 250, 380 ] 1674 0.195% 99.387% ( 380, 580 ] 1855 0.217% 99.603% ( 580, 870 ] 1791 0.209% 99.812% ( 870, 1300 ] 925 0.108% 99.920% ( 1300, 1900 ] 482 0.056% 99.977% ( 1900, 2900 ] 512 0.060% 100.037% ( 2900, 4400 ] 611 0.071% 100.108% ( 4400, 6600 ] 164 0.019% 100.127% ( 6600, 9900 ] 70 0.008% 100.135% ( 9900, 14000 ] 22 0.003% 100.138% ( 14000, 22000 ] 45 0.005% 100.143% ( 22000, 33000 ] 26 0.003% 100.146% ( 33000, 50000 ] 8 0.001% 100.147% ( 50000, 75000 ] 1 0.000% 100.147% ** Level 4 read latency histogram (micros): Count: 1517255 Average: 30.0922 StdDev: 367.92 Min: 1 Median: 2.3131 Max: 73925 Percentiles: P50: 2.31 P75: 3.47 P99: 450.92 P99.9: 1573.23 P99.99: 2302.18 ------------------------------------------------------ [ 0, 1 ] 18908 1.246% 1.246% ( 1, 2 ] 603980 39.807% 41.054% ######## ( 2, 3 ] 433498 28.571% 69.625% ###### ( 3, 4 ] 171892 11.329% 80.954% ## ( 4, 6 ] 176760 11.650% 92.604% ## ( 6, 10 ] 42532 2.803% 95.407% # ( 10, 15 ] 8636 0.569% 95.976% ( 15, 22 ] 1150 0.076% 96.052% ( 22, 34 ] 206 0.014% 96.066% ( 34, 51 ] 367 0.024% 96.090% ( 51, 76 ] 337 0.022% 96.112% ( 76, 110 ] 387 0.026% 96.138% ( 110, 170 ] 8430 0.556% 96.693% ( 170, 250 ] 22736 1.498% 98.192% ( 250, 380 ] 9634 0.635% 98.827% ( 380, 580 ] 7415 0.489% 99.315% ( 580, 870 ] 5482 0.361% 99.677% ( 870, 1300 ] 2783 0.183% 99.860% ( 1300, 1900 ] 1328 0.088% 99.948% ( 1900, 2900 ] 1597 0.105% 100.053% ( 2900, 4400 ] 1839 0.121% 100.174% ( 4400, 6600 ] 567 0.037% 100.212% ( 6600, 9900 ] 167 0.011% 100.223% ( 9900, 14000 ] 85 0.006% 100.228% ( 14000, 22000 ] 109 0.007% 100.235% ( 22000, 33000 ] 67 0.004% 100.240% ( 33000, 50000 ] 17 0.001% 100.241% ( 50000, 75000 ] 4 0.000% 100.241% ** Level 5 read latency histogram (micros): Count: 38819 Average: 511.4800 StdDev: 1206.49 Min: 91 Median: 241.4545 Max: 56069 Percentiles: P50: 241.45 P75: 464.54 P99: 4309.19 P99.9: 16590.50 P99.99: 42667.52 ------------------------------------------------------ ( 76, 110 ] 161 0.415% 0.415% ( 110, 170 ] 5481 14.119% 14.534% ### ( 170, 250 ] 15414 39.707% 54.241% ######## ( 250, 380 ] 6167 15.887% 70.128% ### ( 380, 580 ] 4474 11.525% 81.653% ## ( 580, 870 ] 3243 8.354% 90.007% ## ( 870, 1300 ] 1525 3.928% 93.936% # ( 1300, 1900 ] 641 1.651% 95.587% ( 1900, 2900 ] 608 1.566% 97.153% ( 2900, 4400 ] 763 1.966% 99.119% ( 4400, 6600 ] 249 0.641% 99.760% ( 6600, 9900 ] 42 0.108% 99.869% ( 9900, 14000 ] 7 0.018% 99.887% ( 14000, 22000 ] 16 0.041% 99.928% ( 22000, 33000 ] 19 0.049% 99.977% ( 33000, 50000 ] 9 0.023% 100.000% ( 50000, 75000 ] 1 0.003% 100.003% ** DB Stats ** Uptime(secs): 16.3 total, 3.7 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 181.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.794 H:M:S, 23.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 267.43 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 454.031 micros/op 8773 ops/sec 20.175 seconds 176996 operations; 8.5 MB/s (43999 of 43999 found) Microseconds per read: Count: 176996 Average: 454.0414 StdDev: 1336.01 Min: 2 Median: 247.9357 Max: 105624 Percentiles: P50: 247.94 P75: 401.30 P99: 3992.43 P99.9: 20872.00 P99.99: 47670.62 ------------------------------------------------------ ( 1, 2 ] 4 0.002% 0.002% ( 2, 3 ] 25 0.014% 0.016% ( 3, 4 ] 58 0.033% 0.049% ( 4, 6 ] 162 0.092% 0.141% ( 6, 10 ] 298 0.168% 0.309% ( 10, 15 ] 1022 0.577% 0.886% ( 15, 22 ] 2701 1.526% 2.412% ( 22, 34 ] 3407 1.925% 4.337% ( 34, 51 ] 2106 1.190% 5.527% ( 51, 76 ] 363 0.205% 5.732% ( 76, 110 ] 101 0.057% 5.789% ( 110, 170 ] 10445 5.901% 11.691% # ( 170, 250 ] 69602 39.324% 51.015% ######## ( 250, 380 ] 40003 22.601% 73.616% ##### ( 380, 580 ] 23001 12.995% 86.611% ### ( 580, 870 ] 11939 6.745% 93.356% # ( 870, 1300 ] 5132 2.900% 96.256% # ( 1300, 1900 ] 1911 1.080% 97.336% ( 1900, 2900 ] 1547 0.874% 98.210% ( 2900, 4400 ] 1921 1.085% 99.295% ( 4400, 6600 ] 616 0.348% 99.643% ( 6600, 9900 ] 214 0.121% 99.764% ( 9900, 14000 ] 107 0.060% 99.824% ( 14000, 22000 ] 156 0.088% 99.912% ( 22000, 33000 ] 114 0.064% 99.977% ( 33000, 50000 ] 27 0.015% 99.992% ( 50000, 75000 ] 11 0.006% 99.998% ( 75000, 110000 ] 3 0.002% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 2630658 rocksdb.bloom.filter.full.positive COUNT : 201497 rocksdb.bloom.filter.full.true.positive COUNT : 176113 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 883 rocksdb.memtable.miss COUNT : 176113 rocksdb.l0.hit COUNT : 19350 rocksdb.l1.hit COUNT : 145 rocksdb.l2andup.hit COUNT : 156618 rocksdb.compaction.key.drop.new COUNT : 1185058 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3831483 rocksdb.number.keys.read COUNT : 176996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3954090456 rocksdb.bytes.read COUNT : 176996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 549 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 4663158 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 16293030024 rocksdb.compact.write.bytes COUNT : 15071961923 rocksdb.flush.write.bytes COUNT : 3890938936 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 23 rocksdb.number.superversion_acquires COUNT : 748 rocksdb.number.superversion_releases COUNT : 724 rocksdb.number.superversion_cleanups COUNT : 185 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 104 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3865972736 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7385088 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 16696253994 rocksdb.non.last.level.read.count COUNT : 4006811 rocksdb.block.checksum.compute.count COUNT : 4151856 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 247.056944 P95 : 1112.783067 P99 : 3991.224596 P100 : 105622.000000 COUNT : 176996 SUM : 80191785 rocksdb.db.write.micros P50 : 1.584086 P95 : 5.073479 P99 : 7.366453 P100 : 838869.000000 COUNT : 3831483 SUM : 15205610 rocksdb.compaction.times.micros P50 : 2116666.666667 P95 : 3502000.000000 P99 : 4057634.000000 P100 : 4057634.000000 COUNT : 57 SUM : 114066928 rocksdb.compaction.times.cpu_micros P50 : 1354411.764706 P95 : 1882500.000000 P99 : 2615000.000000 P100 : 2631952.000000 COUNT : 57 SUM : 71119576 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1124.090909 P95 : 6123.333333 P99 : 10953.000000 P100 : 10953.000000 COUNT : 53 SUM : 99576 rocksdb.compaction.outfile.sync.micros P50 : 2757.142857 P95 : 8836.666667 P99 : 27610.000000 P100 : 37486.000000 COUNT : 198 SUM : 684893 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 227.777778 P95 : 3562.500000 P99 : 9009.000000 P100 : 22250.000000 COUNT : 127 SUM : 102690 rocksdb.table.open.io.micros P50 : 5717.708333 P95 : 18989.473684 P99 : 23122.000000 P100 : 43483.000000 COUNT : 549 SUM : 3664394 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.494961 P95 : 9.708332 P99 : 213.268805 P100 : 70152.000000 COUNT : 3947301 SUM : 66321648 rocksdb.read.block.get.micros P50 : 214.042726 P95 : 931.652676 P99 : 3634.950843 P100 : 73932.000000 COUNT : 204143 SUM : 72573287 rocksdb.write.raw.block.micros P50 : 0.540693 P95 : 1.498814 P99 : 4.200931 P100 : 68849.000000 COUNT : 4594129 SUM : 18399505 rocksdb.numfiles.in.singlecompaction P50 : 3.226190 P95 : 4.625000 P99 : 7.000000 P100 : 9.000000 COUNT : 75 SUM : 264 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558866 P95 : 1102.205506 P99 : 1273.654930 P100 : 838681.000000 COUNT : 7785 SUM : 4664017 rocksdb.sst.read.micros P50 : 2.122685 P95 : 161.540689 P99 : 518.598157 P100 : 73925.000000 COUNT : 4007053 SUM : 125455882 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 176996 SUM : 176996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3831483 SUM : 3954090456 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 228888.888889 P95 : 899666.666667 P99 : 1114944.000000 P100 : 1114944.000000 COUNT : 53 SUM : 17503166 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 205 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0