[2024-11-19 09:37:21.455498] Starting SPDK v25.01-pre git sha1 d47eb51c9 / DPDK 22.11.4 initialization... [2024-11-19 09:37:21.455695] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2148211 ] Set seed to 1732005441451968 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-19 09:37:21.584114] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-19 09:37:21.629570] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-19 09:37:21.629640] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2148211' to capture a snapshot of events at runtime. [2024-11-19 09:37:21.629661] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-19 09:37:21.629681] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-19 09:37:21.629698] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2148211 for offline analysis/debug. [2024-11-19 09:37:21.630444] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Nov 19 09:37:26 2024 CPU: 48 * Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz CPUCache: 30720 KB 2024/11/19-09:37:34 ... thread 0: (1000000,1000000) ops and (126337.8,126337.8) ops/second in (7.915287,7.915287) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/12 2.83 GB 88.1 0.7 0.0 0.7 1.6 0.9 0.0 1.9 85.7 185.5 8.83 7.62 17 0.519 767K 754 0.0 0.0 L1 15/15 1.10 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 20/0 997.71 MB 1.0 0.3 0.1 0.1 0.3 0.1 0.0 2.0 114.5 114.2 2.29 2.08 1 2.287 0 0 0.0 0.0 L4 196/0 9.70 GB 1.0 0.3 0.3 0.0 0.3 0.3 0.0 1.0 104.1 104.0 3.24 2.62 5 0.647 132K 0 0.0 0.0 L5 1308/0 89.01 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1556/27 103.61 GB 0.0 1.3 0.4 0.9 2.2 1.3 0.2 2.5 94.4 155.8 14.35 12.32 23 0.624 900K 754 0.0 0.0 Int 0/0 0.00 KB 0.0 1.3 0.4 0.9 2.2 1.3 0.2 2.5 94.4 155.8 14.35 12.32 23 0.624 900K 754 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.3 0.4 0.9 1.3 0.4 0.0 0.0 133.2 133.0 10.17 9.19 9 1.130 900K 754 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 211.1 4.18 3.13 14 0.298 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.1 total, 7.9 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 2.18 GB write, 275.39 MB/s write, 1.32 GB read, 166.94 MB/s read, 14.3 seconds Interval compaction: 2.18 GB write, 282.33 MB/s write, 1.32 GB read, 171.15 MB/s read, 14.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 0, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 284368 Average: 29.0893 StdDev: 132.05 Min: 1 Median: 2.5460 Max: 14939 Percentiles: P50: 2.55 P75: 3.06 P99: 417.13 P99.9: 1035.70 P99.99: 1928.95 ------------------------------------------------------ [ 0, 1 ] 54 0.019% 0.019% ( 1, 2 ] 58467 20.560% 20.579% #### ( 2, 3 ] 153236 53.887% 74.466% ########### ( 3, 4 ] 24667 8.674% 83.140% ## ( 4, 6 ] 14617 5.140% 88.280% # ( 6, 10 ] 4126 1.451% 89.731% ( 10, 15 ] 1995 0.702% 90.433% ( 15, 22 ] 584 0.205% 90.638% ( 22, 34 ] 67 0.024% 90.662% ( 34, 51 ] 10 0.004% 90.665% ( 51, 76 ] 3 0.001% 90.666% ( 76, 110 ] 37 0.013% 90.679% ( 110, 170 ] 3582 1.260% 91.939% ( 170, 250 ] 13671 4.808% 96.746% # ( 250, 380 ] 5978 2.102% 98.849% ( 380, 580 ] 2318 0.815% 99.664% ( 580, 870 ] 583 0.205% 99.869% ( 870, 1300 ] 230 0.081% 99.950% ( 1300, 1900 ] 113 0.040% 99.989% ( 1900, 2900 ] 54 0.019% 100.008% ( 2900, 4400 ] 14 0.005% 100.013% ( 4400, 6600 ] 3 0.001% 100.014% ( 6600, 9900 ] 7 0.002% 100.017% ( 9900, 14000 ] 10 0.004% 100.020% ( 14000, 22000 ] 2 0.001% 100.021% ** Level 1 read latency histogram (micros): Count: 23887 Average: 28.9748 StdDev: 192.69 Min: 2 Median: 3.1022 Max: 11918 Percentiles: P50: 3.10 P75: 4.42 P99: 472.53 P99.9: 1737.10 P99.99: 10735.44 ------------------------------------------------------ ( 1, 2 ] 867 3.630% 3.630% # ( 2, 3 ] 10474 43.848% 47.478% ######### ( 3, 4 ] 5894 24.675% 72.152% ##### ( 4, 6 ] 3233 13.535% 85.687% ### ( 6, 10 ] 1091 4.567% 90.254% # ( 10, 15 ] 493 2.064% 92.318% ( 15, 22 ] 120 0.502% 92.820% ( 22, 34 ] 20 0.084% 92.904% ( 34, 51 ] 1 0.004% 92.908% ( 76, 110 ] 3 0.013% 92.921% ( 110, 170 ] 205 0.858% 93.779% ( 170, 250 ] 797 3.337% 97.116% # ( 250, 380 ] 366 1.532% 98.648% ( 380, 580 ] 184 0.770% 99.418% ( 580, 870 ] 70 0.293% 99.711% ( 870, 1300 ] 33 0.138% 99.849% ( 1300, 1900 ] 18 0.075% 99.925% ( 1900, 2900 ] 9 0.038% 99.962% ( 2900, 4400 ] 1 0.004% 99.967% ( 4400, 6600 ] 4 0.017% 99.983% ( 6600, 9900 ] 2 0.008% 99.992% ( 9900, 14000 ] 3 0.013% 100.004% ** Level 3 read latency histogram (micros): Count: 87089 Average: 8.5081 StdDev: 58.24 Min: 1 Median: 2.8181 Max: 3541 Percentiles: P50: 2.82 P75: 3.68 P99: 168.70 P99.9: 546.10 P99.99: 783.35 ------------------------------------------------------ [ 0, 1 ] 3 0.003% 0.003% ( 1, 2 ] 1775 2.038% 2.042% ( 2, 3 ] 51051 58.619% 60.661% ############ ( 3, 4 ] 18297 21.010% 81.670% #### ( 4, 6 ] 10592 12.162% 93.833% ## ( 6, 10 ] 2642 3.034% 96.866% # ( 10, 15 ] 1298 1.490% 98.357% ( 15, 22 ] 326 0.374% 98.731% ( 22, 34 ] 46 0.053% 98.784% ( 34, 51 ] 16 0.018% 98.802% ( 51, 76 ] 30 0.034% 98.837% ( 76, 110 ] 12 0.014% 98.851% ( 110, 170 ] 133 0.153% 99.003% ( 170, 250 ] 424 0.487% 99.490% ( 250, 380 ] 234 0.269% 99.759% ( 380, 580 ] 148 0.170% 99.929% ( 580, 870 ] 76 0.087% 100.016% ( 870, 1300 ] 33 0.038% 100.054% ( 1300, 1900 ] 23 0.026% 100.080% ( 1900, 2900 ] 9 0.010% 100.091% ( 2900, 4400 ] 4 0.005% 100.095% ** Level 4 read latency histogram (micros): Count: 9739 Average: 274.3643 StdDev: 361.95 Min: 1 Median: 210.9679 Max: 4734 Percentiles: P50: 210.97 P75: 311.32 P99: 2117.89 P99.9: 3978.81 P99.99: 4734.00 ------------------------------------------------------ [ 0, 1 ] 5 0.051% 0.051% ( 1, 2 ] 56 0.575% 0.626% ( 2, 3 ] 960 9.857% 10.484% ## ( 3, 4 ] 477 4.898% 15.381% # ( 4, 6 ] 449 4.610% 19.992% # ( 6, 10 ] 96 0.986% 20.978% ( 10, 15 ] 37 0.380% 21.357% ( 15, 22 ] 13 0.133% 21.491% ( 22, 34 ] 2 0.021% 21.511% ( 34, 51 ] 1 0.010% 21.522% ( 76, 110 ] 12 0.123% 21.645% ( 110, 170 ] 1005 10.319% 31.964% ## ( 170, 250 ] 3430 35.219% 67.183% ####### ( 250, 380 ] 1614 16.573% 83.756% ### ( 380, 580 ] 803 8.245% 92.001% ## ( 580, 870 ] 345 3.542% 95.544% # ( 870, 1300 ] 196 2.013% 97.556% ( 1300, 1900 ] 121 1.242% 98.799% ( 1900, 2900 ] 90 0.924% 99.723% ( 2900, 4400 ] 24 0.246% 99.969% ( 4400, 6600 ] 3 0.031% 100.000% ** Level 5 read latency histogram (micros): Count: 60271 Average: 341.2577 StdDev: 395.22 Min: 95 Median: 232.3594 Max: 8206 Percentiles: P50: 232.36 P75: 338.99 P99: 2471.95 P99.9: 4178.97 P99.99: 6066.91 ------------------------------------------------------ ( 76, 110 ] 77 0.128% 0.128% ( 110, 170 ] 8115 13.464% 13.592% ### ( 170, 250 ] 28151 46.707% 60.299% ######### ( 250, 380 ] 12944 21.476% 81.776% #### ( 380, 580 ] 5785 9.598% 91.374% ## ( 580, 870 ] 2044 3.391% 94.765% # ( 870, 1300 ] 1180 1.958% 96.723% ( 1300, 1900 ] 897 1.488% 98.211% ( 1900, 2900 ] 831 1.379% 99.590% ( 2900, 4400 ] 219 0.363% 99.954% ( 4400, 6600 ] 29 0.048% 100.002% ( 6600, 9900 ] 3 0.005% 100.007% ** DB Stats ** Uptime(secs): 8.1 total, 7.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 121.26 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.842 H:M:S, 10.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 124.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.842 H:M:S, 10.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/19-09:37:47 ... thread 0: (1000000,2000000) ops and (72935.6,92481.2) ops/second in (13.710734,21.626021) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/16 3.81 GB 106.5 2.8 0.0 2.8 4.6 1.8 0.0 2.5 110.7 184.3 25.60 23.33 38 0.674 2877K 6332 0.0 0.0 L1 15/15 1.10 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 20/0 997.71 MB 1.0 0.3 0.1 0.1 0.3 0.1 0.0 2.0 114.5 114.2 2.29 2.08 1 2.287 0 0 0.0 0.0 L4 196/0 9.70 GB 1.0 0.3 0.3 0.0 0.3 0.3 0.0 1.0 104.1 104.0 3.24 2.62 5 0.647 132K 0 0.0 0.0 L5 1308/0 89.01 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1556/31 104.59 GB 0.0 3.4 0.4 2.9 5.2 2.3 0.2 2.8 110.3 170.8 31.13 28.02 44 0.707 3010K 6332 0.0 0.0 Int 0/0 0.00 KB 0.0 3.4 0.4 2.9 5.2 2.3 0.2 2.8 110.3 170.8 31.13 28.02 44 0.707 3010K 6332 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.4 0.4 2.9 3.3 0.4 0.0 0.0 151.7 151.4 22.62 21.43 14 1.616 3010K 6332 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 222.3 8.50 6.59 30 0.283 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.8 total, 21.6 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.19 GB write, 243.53 MB/s write, 3.35 GB read, 157.28 MB/s read, 31.1 seconds Interval compaction: 5.19 GB write, 245.77 MB/s write, 3.35 GB read, 158.73 MB/s read, 31.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 0, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 907100 Average: 30.9093 StdDev: 102.62 Min: 1 Median: 2.4864 Max: 14939 Percentiles: P50: 2.49 P75: 2.96 P99: 376.11 P99.9: 670.26 P99.99: 1058.19 ------------------------------------------------------ [ 0, 1 ] 265 0.029% 0.029% ( 1, 2 ] 218606 24.099% 24.129% ##### ( 2, 3 ] 482490 53.190% 77.319% ########### ( 3, 4 ] 59996 6.614% 83.933% # ( 4, 6 ] 28583 3.151% 87.084% # ( 6, 10 ] 9325 1.028% 88.112% ( 10, 15 ] 3823 0.421% 88.534% ( 15, 22 ] 1312 0.145% 88.678% ( 22, 34 ] 106 0.012% 88.690% ( 34, 51 ] 13 0.001% 88.691% ( 51, 76 ] 4 0.000% 88.692% ( 76, 110 ] 153 0.017% 88.709% ( 110, 170 ] 15110 1.666% 90.374% ( 170, 250 ] 57311 6.318% 96.692% # ( 250, 380 ] 21577 2.379% 99.071% ( 380, 580 ] 7203 0.794% 99.865% ( 580, 870 ] 1015 0.112% 99.977% ( 870, 1300 ] 268 0.030% 100.007% ( 1300, 1900 ] 136 0.015% 100.022% ( 1900, 2900 ] 90 0.010% 100.032% ( 2900, 4400 ] 25 0.003% 100.034% ( 4400, 6600 ] 3 0.000% 100.035% ( 6600, 9900 ] 7 0.001% 100.035% ( 9900, 14000 ] 10 0.001% 100.036% ( 14000, 22000 ] 2 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 40851 Average: 40.0449 StdDev: 162.24 Min: 2 Median: 3.4938 Max: 11918 Percentiles: P50: 3.49 P75: 5.18 P99: 460.99 P99.9: 1264.97 P99.99: 8109.58 ------------------------------------------------------ ( 1, 2 ] 915 2.240% 2.240% ( 2, 3 ] 12757 31.228% 33.468% ###### ( 3, 4 ] 13676 33.478% 66.946% ####### ( 4, 6 ] 5557 13.603% 80.549% ### ( 6, 10 ] 1501 3.674% 84.223% # ( 10, 15 ] 736 1.802% 86.025% ( 15, 22 ] 182 0.446% 86.470% ( 22, 34 ] 29 0.071% 86.541% ( 34, 51 ] 1 0.002% 86.544% ( 76, 110 ] 10 0.024% 86.568% ( 110, 170 ] 832 2.037% 88.605% ( 170, 250 ] 2991 7.322% 95.927% # ( 250, 380 ] 1085 2.656% 98.583% # ( 380, 580 ] 421 1.031% 99.613% ( 580, 870 ] 85 0.208% 99.821% ( 870, 1300 ] 35 0.086% 99.907% ( 1300, 1900 ] 19 0.047% 99.953% ( 1900, 2900 ] 9 0.022% 99.976% ( 2900, 4400 ] 1 0.002% 99.978% ( 4400, 6600 ] 4 0.010% 99.988% ( 6600, 9900 ] 2 0.005% 99.993% ( 9900, 14000 ] 3 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 89398 Average: 13.6168 StdDev: 67.87 Min: 1 Median: 2.8407 Max: 3541 Percentiles: P50: 2.84 P75: 3.77 P99: 269.33 P99.9: 569.49 P99.99: 796.87 ------------------------------------------------------ [ 0, 1 ] 3 0.003% 0.003% ( 1, 2 ] 1776 1.987% 1.990% ( 2, 3 ] 51053 57.108% 59.098% ########### ( 3, 4 ] 18363 20.541% 79.638% #### ( 4, 6 ] 10804 12.085% 91.724% ## ( 6, 10 ] 2645 2.959% 94.682% # ( 10, 15 ] 1298 1.452% 96.134% ( 15, 22 ] 326 0.365% 96.499% ( 22, 34 ] 47 0.053% 96.551% ( 34, 51 ] 16 0.018% 96.569% ( 51, 76 ] 30 0.034% 96.603% ( 76, 110 ] 15 0.017% 96.620% ( 110, 170 ] 483 0.540% 97.160% ( 170, 250 ] 1553 1.737% 98.897% ( 250, 380 ] 619 0.692% 99.589% ( 380, 580 ] 293 0.328% 99.917% ( 580, 870 ] 87 0.097% 100.015% ( 870, 1300 ] 34 0.038% 100.053% ( 1300, 1900 ] 23 0.026% 100.078% ( 1900, 2900 ] 9 0.010% 100.088% ( 2900, 4400 ] 4 0.004% 100.093% ** Level 4 read latency histogram (micros): Count: 27851 Average: 242.5402 StdDev: 228.80 Min: 1 Median: 213.2999 Max: 4734 Percentiles: P50: 213.30 P75: 271.64 P99: 1221.70 P99.9: 2890.65 P99.99: 4557.59 ------------------------------------------------------ [ 0, 1 ] 5 0.018% 0.018% ( 1, 2 ] 57 0.205% 0.223% ( 2, 3 ] 977 3.508% 3.731% # ( 3, 4 ] 639 2.294% 6.025% ( 4, 6 ] 904 3.246% 9.271% # ( 6, 10 ] 121 0.434% 9.705% ( 10, 15 ] 41 0.147% 9.852% ( 15, 22 ] 16 0.057% 9.910% ( 22, 34 ] 2 0.007% 9.917% ( 34, 51 ] 1 0.004% 9.921% ( 76, 110 ] 34 0.122% 10.043% ( 110, 170 ] 3905 14.021% 24.064% ### ( 170, 250 ] 13346 47.919% 71.983% ########## ( 250, 380 ] 5047 18.121% 90.104% #### ( 380, 580 ] 1861 6.682% 96.786% # ( 580, 870 ] 448 1.609% 98.395% ( 870, 1300 ] 206 0.740% 99.135% ( 1300, 1900 ] 123 0.442% 99.576% ( 1900, 2900 ] 91 0.327% 99.903% ( 2900, 4400 ] 24 0.086% 99.989% ( 4400, 6600 ] 3 0.011% 100.000% ** Level 5 read latency histogram (micros): Count: 208140 Average: 265.1141 StdDev: 231.56 Min: 95 Median: 220.5223 Max: 8206 Percentiles: P50: 220.52 P75: 283.08 P99: 1281.80 P99.9: 3122.02 P99.99: 4387.74 ------------------------------------------------------ ( 76, 110 ] 280 0.135% 0.135% ( 110, 170 ] 32726 15.723% 15.858% ### ( 170, 250 ] 112527 54.063% 69.921% ########### ( 250, 380 ] 41548 19.962% 89.882% #### ( 380, 580 ] 14912 7.164% 97.047% # ( 580, 870 ] 2858 1.373% 98.420% ( 870, 1300 ] 1262 0.606% 99.026% ( 1300, 1900 ] 928 0.446% 99.472% ( 1900, 2900 ] 859 0.413% 99.885% ( 2900, 4400 ] 222 0.107% 99.991% ( 4400, 6600 ] 29 0.014% 100.005% ( 6600, 9900 ] 3 0.001% 100.007% ** DB Stats ** Uptime(secs): 21.8 total, 13.7 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 90.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.663 H:M:S, 35.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 71.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.821 H:M:S, 49.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-09:38:25 ... thread 0: (1000000,3000000) ops and (26441.8,50466.9) ops/second in (37.818896,59.444917) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 4.79 GB 288.6 5.1 0.0 5.1 7.9 2.8 0.0 2.8 117.5 182.4 44.47 41.15 59 0.754 5306K 11K 0.0 0.0 L1 15/15 1.10 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 20/0 997.71 MB 1.0 0.3 0.1 0.1 0.3 0.1 0.0 2.0 114.5 114.2 2.29 2.08 1 2.287 0 0 0.0 0.0 L4 196/0 9.70 GB 1.0 0.3 0.3 0.0 0.3 0.3 0.0 1.0 104.1 104.0 3.24 2.62 5 0.647 132K 0 0.0 0.0 L5 1308/0 89.01 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1557/27 105.57 GB 0.0 5.7 0.4 5.2 8.5 3.3 0.2 3.0 116.5 174.2 49.99 45.84 65 0.769 5439K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 0.4 5.2 8.5 3.3 0.2 3.0 116.5 174.2 49.99 45.84 65 0.769 5439K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 0.4 5.2 5.7 0.4 0.0 0.0 157.5 157.2 36.98 35.58 19 1.946 5439K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 222.7 13.01 10.26 46 0.283 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.6 total, 59.4 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.51 GB write, 146.04 MB/s write, 5.69 GB read, 97.67 MB/s read, 50.0 seconds Interval compaction: 8.51 GB write, 146.53 MB/s write, 5.69 GB read, 97.99 MB/s read, 50.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 0, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1773478 Average: 45.0750 StdDev: 104.21 Min: 1 Median: 2.5612 Max: 14939 Percentiles: P50: 2.56 P75: 3.67 P99: 375.31 P99.9: 579.02 P99.99: 866.37 ------------------------------------------------------ [ 0, 1 ] 498 0.028% 0.028% ( 1, 2 ] 410659 23.156% 23.184% ##### ( 2, 3 ] 847428 47.783% 70.967% ########## ( 3, 4 ] 107249 6.047% 77.014% # ( 4, 6 ] 48380 2.728% 79.742% # ( 6, 10 ] 15881 0.895% 80.638% ( 10, 15 ] 5746 0.324% 80.962% ( 15, 22 ] 2279 0.129% 81.090% ( 22, 34 ] 155 0.009% 81.099% ( 34, 51 ] 14 0.001% 81.100% ( 51, 76 ] 8 0.000% 81.100% ( 76, 110 ] 665 0.037% 81.138% ( 110, 170 ] 61413 3.463% 84.601% # ( 170, 250 ] 207657 11.709% 96.310% ## ( 250, 380 ] 49496 2.791% 99.101% # ( 380, 580 ] 14247 0.803% 99.904% ( 580, 870 ] 1546 0.087% 99.991% ( 870, 1300 ] 349 0.020% 100.011% ( 1300, 1900 ] 164 0.009% 100.020% ( 1900, 2900 ] 189 0.011% 100.031% ( 2900, 4400 ] 35 0.002% 100.033% ( 4400, 6600 ] 4 0.000% 100.033% ( 6600, 9900 ] 7 0.000% 100.033% ( 9900, 14000 ] 10 0.001% 100.034% ( 14000, 22000 ] 2 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 93441 Average: 45.3113 StdDev: 128.37 Min: 2 Median: 3.5852 Max: 11918 Percentiles: P50: 3.59 P75: 5.56 P99: 386.14 P99.9: 832.27 P99.99: 4141.92 ------------------------------------------------------ ( 1, 2 ] 1133 1.213% 1.213% ( 2, 3 ] 22840 24.443% 25.656% ##### ( 3, 4 ] 38873 41.602% 67.257% ######## ( 4, 6 ] 9285 9.937% 77.194% ## ( 6, 10 ] 2586 2.768% 79.962% # ( 10, 15 ] 1539 1.647% 81.609% ( 15, 22 ] 320 0.342% 81.951% ( 22, 34 ] 47 0.050% 82.001% ( 34, 51 ] 2 0.002% 82.004% ( 51, 76 ] 1 0.001% 82.005% ( 76, 110 ] 43 0.046% 82.051% ( 110, 170 ] 3031 3.244% 85.294% # ( 170, 250 ] 10387 11.116% 96.411% ## ( 250, 380 ] 2396 2.564% 98.975% # ( 380, 580 ] 768 0.822% 99.797% ( 580, 870 ] 111 0.119% 99.915% ( 870, 1300 ] 36 0.039% 99.954% ( 1300, 1900 ] 22 0.024% 99.978% ( 1900, 2900 ] 10 0.011% 99.988% ( 2900, 4400 ] 2 0.002% 99.990% ( 4400, 6600 ] 4 0.004% 99.995% ( 6600, 9900 ] 2 0.002% 99.997% ( 9900, 14000 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 96208 Average: 27.4627 StdDev: 84.52 Min: 1 Median: 2.9073 Max: 3541 Percentiles: P50: 2.91 P75: 4.17 P99: 342.85 P99.9: 577.43 P99.99: 813.10 ------------------------------------------------------ [ 0, 1 ] 3 0.003% 0.003% ( 1, 2 ] 1777 1.847% 1.850% ( 2, 3 ] 51056 53.068% 54.919% ########### ( 3, 4 ] 18374 19.098% 74.017% #### ( 4, 6 ] 10858 11.286% 85.303% ## ( 6, 10 ] 2647 2.751% 88.054% # ( 10, 15 ] 1299 1.350% 89.404% ( 15, 22 ] 327 0.340% 89.744% ( 22, 34 ] 47 0.049% 89.793% ( 34, 51 ] 16 0.017% 89.810% ( 51, 76 ] 30 0.031% 89.841% ( 76, 110 ] 24 0.025% 89.866% ( 110, 170 ] 1909 1.984% 91.850% ( 170, 250 ] 5909 6.142% 97.992% # ( 250, 380 ] 1358 1.412% 99.403% ( 380, 580 ] 484 0.503% 99.906% ( 580, 870 ] 100 0.104% 100.010% ( 870, 1300 ] 36 0.037% 100.048% ( 1300, 1900 ] 23 0.024% 100.072% ( 1900, 2900 ] 10 0.010% 100.082% ( 2900, 4400 ] 4 0.004% 100.086% ** Level 4 read latency histogram (micros): Count: 82691 Average: 221.8578 StdDev: 145.20 Min: 1 Median: 207.8493 Max: 4734 Percentiles: P50: 207.85 P75: 242.09 P99: 691.00 P99.9: 2307.54 P99.99: 4070.68 ------------------------------------------------------ [ 0, 1 ] 5 0.006% 0.006% ( 1, 2 ] 60 0.073% 0.079% ( 2, 3 ] 984 1.190% 1.269% ( 3, 4 ] 718 0.868% 2.137% ( 4, 6 ] 1127 1.363% 3.500% ( 6, 10 ] 131 0.158% 3.658% ( 10, 15 ] 43 0.052% 3.710% ( 15, 22 ] 18 0.022% 3.732% ( 22, 34 ] 2 0.002% 3.734% ( 34, 51 ] 1 0.001% 3.736% ( 76, 110 ] 137 0.166% 3.901% ( 110, 170 ] 15268 18.464% 22.365% #### ( 170, 250 ] 48300 58.410% 80.775% ############ ( 250, 380 ] 11420 13.810% 94.586% ### ( 380, 580 ] 3430 4.148% 98.734% # ( 580, 870 ] 575 0.695% 99.429% ( 870, 1300 ] 224 0.271% 99.700% ( 1300, 1900 ] 127 0.154% 99.854% ( 1900, 2900 ] 94 0.114% 99.967% ( 2900, 4400 ] 24 0.029% 99.996% ( 4400, 6600 ] 3 0.004% 100.000% ** Level 5 read latency histogram (micros): Count: 656849 Average: 228.9177 StdDev: 145.06 Min: 95 Median: 209.9087 Max: 8206 Percentiles: P50: 209.91 P75: 242.62 P99: 634.88 P99.9: 2430.80 P99.99: 3972.57 ------------------------------------------------------ ( 76, 110 ] 1169 0.178% 0.178% ( 110, 170 ] 126918 19.322% 19.500% #### ( 170, 250 ] 401592 61.139% 80.639% ############ ( 250, 380 ] 91985 14.004% 94.643% ### ( 380, 580 ] 27907 4.249% 98.892% # ( 580, 870 ] 3749 0.571% 99.463% ( 870, 1300 ] 1402 0.213% 99.676% ( 1300, 1900 ] 985 0.150% 99.826% ( 1900, 2900 ] 914 0.139% 99.965% ( 2900, 4400 ] 227 0.035% 100.000% ( 4400, 6600 ] 29 0.004% 100.004% ( 6600, 9900 ] 3 0.000% 100.005% ** DB Stats ** Uptime(secs): 59.6 total, 37.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 49.50 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:38.069 H:M:S, 63.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 26.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:30.406 H:M:S, 80.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 306.996 micros/op 13010 ops/sec 60.183 seconds 782996 operations; 12.6 MB/s (195999 of 195999 found) Microseconds per read: Count: 782996 Average: 306.9986 StdDev: 383.73 Min: 4 Median: 250.6226 Max: 27642 Percentiles: P50: 250.62 P75: 355.06 P99: 860.90 P99.9: 6976.29 P99.99: 15649.42 ------------------------------------------------------ ( 3, 4 ] 1 0.000% 0.000% ( 4, 6 ] 106 0.014% 0.014% ( 6, 10 ] 215 0.027% 0.041% ( 10, 15 ] 37 0.005% 0.046% ( 15, 22 ] 1320 0.169% 0.214% ( 22, 34 ] 10106 1.291% 1.505% ( 34, 51 ] 1929 0.246% 1.751% ( 51, 76 ] 125 0.016% 1.767% ( 76, 110 ] 11 0.001% 1.769% ( 110, 170 ] 20757 2.651% 4.420% # ( 170, 250 ] 355724 45.431% 49.851% ######### ( 250, 380 ] 243655 31.118% 80.969% ###### ( 380, 580 ] 115408 14.739% 95.709% ### ( 580, 870 ] 26607 3.398% 99.107% # ( 870, 1300 ] 4588 0.586% 99.693% ( 1300, 1900 ] 531 0.068% 99.760% ( 1900, 2900 ] 243 0.031% 99.791% ( 2900, 4400 ] 193 0.025% 99.816% ( 4400, 6600 ] 583 0.074% 99.891% ( 6600, 9900 ] 649 0.083% 99.973% ( 9900, 14000 ] 113 0.014% 99.988% ( 14000, 22000 ] 81 0.010% 99.998% ( 22000, 33000 ] 14 0.002% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 15538136 rocksdb.bloom.filter.full.positive COUNT : 933541 rocksdb.bloom.filter.full.true.positive COUNT : 782634 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 362 rocksdb.memtable.miss COUNT : 782634 rocksdb.l0.hit COUNT : 33199 rocksdb.l1.hit COUNT : 8640 rocksdb.l2andup.hit COUNT : 740795 rocksdb.compaction.key.drop.new COUNT : 29251 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3003068 rocksdb.number.keys.read COUNT : 782996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3099166176 rocksdb.bytes.read COUNT : 782996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1623 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 38772899 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 7574636714 rocksdb.compact.write.bytes COUNT : 7548852103 rocksdb.flush.write.bytes COUNT : 3038874364 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 24 rocksdb.number.superversion_acquires COUNT : 469 rocksdb.number.superversion_releases COUNT : 438 rocksdb.number.superversion_cleanups COUNT : 112 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3014110208 rocksdb.memtable.garbage.bytes.at.flush COUNT : 940032 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 11854377655 rocksdb.non.last.level.read.count COUNT : 2719815 rocksdb.block.checksum.compute.count COUNT : 2780369 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 248.581243 P95 : 569.811456 P99 : 860.351377 P100 : 27640.000000 COUNT : 782996 SUM : 239295275 rocksdb.db.write.micros P50 : 3.059257 P95 : 9.358485 P99 : 872.384874 P100 : 3380.000000 COUNT : 3003068 SUM : 52529662 rocksdb.compaction.times.micros P50 : 1515000.000000 P95 : 5803333.333333 P99 : 6360666.666667 P100 : 6409125.000000 COUNT : 19 SUM : 36977245 rocksdb.compaction.times.cpu_micros P50 : 1515000.000000 P95 : 5803333.333333 P99 : 6306809.000000 P100 : 6306809.000000 COUNT : 19 SUM : 35580917 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1492.000000 P95 : 2640.000000 P99 : 3112.000000 P100 : 3112.000000 COUNT : 46 SUM : 69292 rocksdb.compaction.outfile.sync.micros P50 : 1550.000000 P95 : 3925.000000 P99 : 4067.000000 P100 : 4067.000000 COUNT : 38 SUM : 70907 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 355.857143 P95 : 1154.875000 P99 : 3203.000000 P100 : 3203.000000 COUNT : 67 SUM : 30883 rocksdb.table.open.io.micros P50 : 5089.349776 P95 : 8942.801205 P99 : 16014.545455 P100 : 25619.000000 COUNT : 1623 SUM : 8371850 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 5.984742 P95 : 224.724948 P99 : 357.857473 P100 : 18842.000000 COUNT : 1835395 SUM : 61664786 rocksdb.read.block.get.micros P50 : 210.607779 P95 : 384.027583 P99 : 576.059340 P100 : 20303.000000 COUNT : 943332 SUM : 209414233 rocksdb.write.raw.block.micros P50 : 0.727671 P95 : 1.960921 P99 : 4.848088 P100 : 8254.000000 COUNT : 2564055 SUM : 8693242 rocksdb.numfiles.in.singlecompaction P50 : 3.346154 P95 : 5.900000 P99 : 27.000000 P100 : 27.000000 COUNT : 21 SUM : 97 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.567849 P95 : 1182.664246 P99 : 2210.000000 P100 : 2210.000000 COUNT : 253565 SUM : 38803141 rocksdb.sst.read.micros P50 : 3.137965 P95 : 315.628611 P99 : 511.194629 P100 : 14939.000000 COUNT : 2719823 SUM : 258429335 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 782996 SUM : 782996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3003068 SUM : 3099166176 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 315000.000000 P95 : 376159.090909 P99 : 482600.000000 P100 : 488839.000000 COUNT : 46 SUM : 13013108 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 71 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0