[2024-11-18 14:26:18.922843] Starting SPDK v25.01-pre git sha1 d47eb51c9 / DPDK 23.11.0 initialization... [2024-11-18 14:26:18.923119] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid440874 ] Set seed to 1731936378916211 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-18 14:26:19.048482] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-18 14:26:19.070034] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-18 14:26:19.070076] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 440874' to capture a snapshot of events at runtime. [2024-11-18 14:26:19.070086] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-18 14:26:19.070095] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-18 14:26:19.070103] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid440874 for offline analysis/debug. [2024-11-18 14:26:19.070649] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Nov 18 14:26:23 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/18-14:26:31 ... thread 0: (1000000,1000000) ops and (127423.5,127423.5) ops/second in (7.847848,7.847848) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/7 1.80 GB 50.4 0.3 0.0 0.3 1.2 0.9 0.0 1.4 33.3 126.6 9.45 3.83 11 0.859 319K 374 0.0 0.0 L1 8/8 860.68 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 99.15 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/5 1.43 GB 0.9 1.6 1.0 0.7 1.6 0.9 0.0 1.7 104.8 103.6 15.79 7.80 7 2.255 869K 0 0.0 0.0 L4 181/19 10.28 GB 1.0 4.4 2.9 1.5 4.3 2.9 0.0 1.5 105.7 104.5 42.59 21.12 32 1.331 1694K 1018 0.0 0.0 L5 1112/0 91.29 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1330/39 105.73 GB 0.0 6.3 3.9 2.4 7.1 4.7 2.3 8.3 95.4 107.3 67.83 32.74 50 1.357 2883K 1392 0.0 0.0 Int 0/0 0.00 KB 0.0 6.3 3.9 2.4 7.1 4.7 2.3 8.3 95.4 107.3 67.83 32.74 50 1.357 2883K 1392 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.3 3.9 2.4 6.2 3.8 0.0 0.0 106.8 105.6 60.59 30.18 40 1.515 2883K 1392 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 121.7 7.24 2.56 10 0.724 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.0 total, 7.8 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.11 GB write, 904.61 MB/s write, 6.32 GB read, 803.89 MB/s read, 67.8 seconds Interval compaction: 7.11 GB write, 927.56 MB/s write, 6.32 GB read, 824.29 MB/s read, 67.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 40, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 40, interval: 40 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 330619 Average: 12.3969 StdDev: 161.46 Min: 1 Median: 1.9116 Max: 8027 Percentiles: P50: 1.91 P75: 2.92 P99: 10.40 P99.9: 2352.76 P99.99: 3940.03 ------------------------------------------------------ [ 0, 1 ] 10320 3.121% 3.121% # ( 1, 2 ] 170018 51.424% 54.546% ########## ( 2, 3 ] 73758 22.309% 76.855% #### ( 3, 4 ] 33282 10.067% 86.921% ## ( 4, 6 ] 32517 9.835% 96.756% ## ( 6, 10 ] 7308 2.210% 98.967% ( 10, 15 ] 1405 0.425% 99.392% ( 15, 22 ] 151 0.046% 99.437% ( 22, 34 ] 18 0.005% 99.443% ( 34, 51 ] 22 0.007% 99.450% ( 51, 76 ] 17 0.005% 99.455% ( 76, 110 ] 19 0.006% 99.460% ( 110, 170 ] 28 0.008% 99.469% ( 170, 250 ] 46 0.014% 99.483% ( 250, 380 ] 97 0.029% 99.512% ( 380, 580 ] 195 0.059% 99.571% ( 580, 870 ] 349 0.106% 99.677% ( 870, 1300 ] 355 0.107% 99.784% ( 1300, 1900 ] 274 0.083% 99.867% ( 1900, 2900 ] 246 0.074% 99.941% ( 2900, 4400 ] 235 0.071% 100.012% ( 4400, 6600 ] 84 0.025% 100.038% ( 6600, 9900 ] 12 0.004% 100.041% ** Level 1 read latency histogram (micros): Count: 50828 Average: 15.5361 StdDev: 205.02 Min: 1 Median: 1.9868 Max: 23356 Percentiles: P50: 1.99 P75: 3.04 P99: 14.01 P99.9: 3022.00 P99.99: 6383.44 ------------------------------------------------------ [ 0, 1 ] 1050 2.066% 2.066% ( 1, 2 ] 24689 48.574% 50.639% ########## ( 2, 3 ] 12163 23.930% 74.569% ##### ( 3, 4 ] 5352 10.530% 85.099% ## ( 4, 6 ] 5386 10.597% 95.695% ## ( 6, 10 ] 1480 2.912% 98.607% # ( 10, 15 ] 249 0.490% 99.097% ( 15, 22 ] 39 0.077% 99.174% ( 22, 34 ] 3 0.006% 99.180% ( 34, 51 ] 7 0.014% 99.193% ( 51, 76 ] 4 0.008% 99.201% ( 110, 170 ] 4 0.008% 99.209% ( 170, 250 ] 10 0.020% 99.229% ( 250, 380 ] 20 0.039% 99.268% ( 380, 580 ] 52 0.102% 99.370% ( 580, 870 ] 68 0.134% 99.504% ( 870, 1300 ] 79 0.155% 99.660% ( 1300, 1900 ] 69 0.136% 99.795% ( 1900, 2900 ] 50 0.098% 99.894% ( 2900, 4400 ] 39 0.077% 99.970% ( 4400, 6600 ] 11 0.022% 99.992% ( 6600, 9900 ] 3 0.006% 99.998% ( 22000, 33000 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 184742 Average: 11.3189 StdDev: 146.00 Min: 1 Median: 1.9467 Max: 8212 Percentiles: P50: 1.95 P75: 2.98 P99: 11.39 P99.9: 2318.06 P99.99: 4130.60 ------------------------------------------------------ [ 0, 1 ] 5459 2.955% 2.955% # ( 1, 2 ] 91810 49.696% 52.651% ########## ( 2, 3 ] 42008 22.739% 75.390% ##### ( 3, 4 ] 18929 10.246% 85.636% ## ( 4, 6 ] 19242 10.416% 96.052% ## ( 6, 10 ] 5195 2.812% 98.864% # ( 10, 15 ] 903 0.489% 99.353% ( 15, 22 ] 132 0.071% 99.424% ( 22, 34 ] 32 0.017% 99.441% ( 34, 51 ] 11 0.006% 99.447% ( 51, 76 ] 11 0.006% 99.453% ( 76, 110 ] 9 0.005% 99.458% ( 110, 170 ] 15 0.008% 99.466% ( 170, 250 ] 33 0.018% 99.484% ( 250, 380 ] 78 0.042% 99.526% ( 380, 580 ] 143 0.077% 99.604% ( 580, 870 ] 169 0.091% 99.695% ( 870, 1300 ] 174 0.094% 99.789% ( 1300, 1900 ] 152 0.082% 99.872% ( 1900, 2900 ] 125 0.068% 99.939% ( 2900, 4400 ] 114 0.062% 100.001% ( 4400, 6600 ] 29 0.016% 100.017% ( 6600, 9900 ] 5 0.003% 100.019% ** Level 3 read latency histogram (micros): Count: 774979 Average: 10.4268 StdDev: 151.48 Min: 1 Median: 1.9334 Max: 25992 Percentiles: P50: 1.93 P75: 2.93 P99: 9.42 P99.9: 552.71 P99.99: 881.40 ------------------------------------------------------ [ 0, 1 ] 16758 2.162% 2.162% ( 1, 2 ] 397206 51.254% 53.416% ########## ( 2, 3 ] 179379 23.146% 76.562% ##### ( 3, 4 ] 79457 10.253% 86.815% ## ( 4, 6 ] 78890 10.180% 96.995% ## ( 6, 10 ] 18190 2.347% 99.342% ( 10, 15 ] 3142 0.405% 99.747% ( 15, 22 ] 385 0.050% 99.797% ( 22, 34 ] 41 0.005% 99.802% ( 34, 51 ] 42 0.005% 99.808% ( 51, 76 ] 56 0.007% 99.815% ( 76, 110 ] 29 0.004% 99.819% ( 110, 170 ] 28 0.004% 99.822% ( 170, 250 ] 83 0.011% 99.833% ( 250, 380 ] 191 0.025% 99.858% ( 380, 580 ] 381 0.049% 99.907% ( 580, 870 ] 627 0.081% 99.988% ( 870, 1300 ] 698 0.090% 100.078% ( 1300, 1900 ] 449 0.058% 100.136% ( 1900, 2900 ] 494 0.064% 100.200% ( 2900, 4400 ] 424 0.055% 100.254% ( 4400, 6600 ] 145 0.019% 100.273% ( 6600, 9900 ] 23 0.003% 100.276% ( 9900, 14000 ] 2 0.000% 100.276% ( 14000, 22000 ] 2 0.000% 100.277% ( 22000, 33000 ] 2 0.000% 100.277% ** Level 4 read latency histogram (micros): Count: 470636 Average: 23.5463 StdDev: 233.95 Min: 0 Median: 1.9553 Max: 25499 Percentiles: P50: 1.96 P75: 3.00 P99: 469.97 P99.9: 2572.63 P99.99: 3288.60 ------------------------------------------------------ [ 0, 1 ] 10577 2.247% 2.247% ( 1, 2 ] 235256 49.987% 52.234% ########## ( 2, 3 ] 107396 22.819% 75.054% ##### ( 3, 4 ] 49972 10.618% 85.672% ## ( 4, 6 ] 47761 10.148% 95.820% ## ( 6, 10 ] 11805 2.508% 98.328% # ( 10, 15 ] 1977 0.420% 98.748% ( 15, 22 ] 241 0.051% 98.799% ( 22, 34 ] 19 0.004% 98.803% ( 34, 51 ] 22 0.005% 98.808% ( 51, 76 ] 40 0.008% 98.816% ( 76, 110 ] 25 0.005% 98.822% ( 110, 170 ] 50 0.011% 98.832% ( 170, 250 ] 180 0.038% 98.871% ( 250, 380 ] 305 0.065% 98.935% ( 380, 580 ] 675 0.143% 99.079% ( 580, 870 ] 1130 0.240% 99.319% ( 870, 1300 ] 1336 0.284% 99.603% ( 1300, 1900 ] 906 0.193% 99.795% ( 1900, 2900 ] 732 0.156% 99.951% ( 2900, 4400 ] 710 0.151% 100.102% ( 4400, 6600 ] 215 0.046% 100.147% ( 6600, 9900 ] 35 0.007% 100.155% ( 14000, 22000 ] 1 0.000% 100.155% ( 22000, 33000 ] 1 0.000% 100.155% ** Level 5 read latency histogram (micros): Count: 12848 Average: 1764.0678 StdDev: 1545.49 Min: 92 Median: 1206.7620 Max: 29802 Percentiles: P50: 1206.76 P75: 2501.43 P99: 6952.32 P99.9: 9758.10 P99.99: 28289.07 ------------------------------------------------------ ( 76, 110 ] 9 0.070% 0.070% ( 110, 170 ] 56 0.436% 0.506% ( 170, 250 ] 207 1.611% 2.117% ( 250, 380 ] 591 4.600% 6.717% # ( 380, 580 ] 1477 11.496% 18.213% ## ( 580, 870 ] 2195 17.084% 35.297% ### ( 870, 1300 ] 2412 18.773% 54.071% #### ( 1300, 1900 ] 1764 13.730% 67.800% ### ( 1900, 2900 ] 1538 11.971% 79.771% ## ( 2900, 4400 ] 1715 13.348% 93.120% ### ( 4400, 6600 ] 741 5.767% 98.887% # ( 6600, 9900 ] 136 1.059% 99.946% ( 9900, 14000 ] 3 0.023% 99.969% ( 14000, 22000 ] 1 0.008% 99.977% ( 22000, 33000 ] 3 0.023% 100.000% ** DB Stats ** Uptime(secs): 8.0 total, 7.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 122.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.836 H:M:S, 47.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 125.36 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.836 H:M:S, 48.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/11/18-14:26:34 ... thread 0: (1000000,2000000) ops and (280521.9,175244.4) ops/second in (3.564784,11.412632) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/7 2.72 GB 157.3 1.5 0.0 1.5 3.3 1.8 0.0 1.8 83.6 184.5 18.09 11.39 30 0.603 1535K 1784 0.0 0.0 L1 8/8 860.68 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 99.15 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 871.59 MB 0.9 1.6 1.0 0.7 1.6 0.9 0.0 1.7 104.8 103.6 15.79 7.80 7 2.255 869K 0 0.0 0.0 L4 167/0 9.54 GB 1.0 5.6 3.5 2.1 5.5 3.4 0.0 1.6 110.1 108.8 51.64 26.61 37 1.396 2231K 1018 0.0 0.0 L5 1128/0 92.58 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1330/15 106.63 GB 0.0 8.6 4.5 4.2 10.3 6.2 3.6 5.8 103.5 123.8 85.52 45.80 74 1.156 4636K 2802 0.0 0.0 Int 0/0 0.00 KB 0.0 8.6 4.5 4.2 10.3 6.2 3.6 5.8 103.5 123.8 85.52 45.80 74 1.156 4636K 2802 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.6 4.5 4.2 8.6 4.4 0.0 0.0 118.4 117.2 74.77 40.33 49 1.526 4636K 2802 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 170.0 10.75 5.47 25 0.430 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.6 total, 11.4 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.34 GB write, 911.89 MB/s write, 8.65 GB read, 762.44 MB/s read, 85.5 seconds Interval compaction: 10.34 GB write, 927.80 MB/s write, 8.65 GB read, 775.74 MB/s read, 85.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 40, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 40, interval: 40 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 639143 Average: 10.1709 StdDev: 121.59 Min: 1 Median: 1.7428 Max: 9438 Percentiles: P50: 1.74 P75: 2.59 P99: 141.99 P99.9: 1208.83 P99.99: 2649.36 ------------------------------------------------------ [ 0, 1 ] 58716 9.187% 9.187% ## ( 1, 2 ] 351164 54.943% 64.130% ########### ( 2, 3 ] 117918 18.449% 82.579% #### ( 3, 4 ] 47538 7.438% 90.017% # ( 4, 6 ] 43075 6.739% 96.756% # ( 6, 10 ] 10045 1.572% 98.328% ( 10, 15 ] 1943 0.304% 98.632% ( 15, 22 ] 251 0.039% 98.671% ( 22, 34 ] 27 0.004% 98.675% ( 34, 51 ] 28 0.004% 98.680% ( 51, 76 ] 32 0.005% 98.685% ( 76, 110 ] 631 0.099% 98.784% ( 110, 170 ] 2597 0.406% 99.190% ( 170, 250 ] 1665 0.261% 99.450% ( 250, 380 ] 967 0.151% 99.602% ( 380, 580 ] 904 0.141% 99.743% ( 580, 870 ] 654 0.102% 99.845% ( 870, 1300 ] 444 0.069% 99.915% ( 1300, 1900 ] 290 0.045% 99.960% ( 1900, 2900 ] 255 0.040% 100.000% ( 2900, 4400 ] 241 0.038% 100.038% ( 4400, 6600 ] 84 0.013% 100.051% ( 6600, 9900 ] 13 0.002% 100.053% ** Level 1 read latency histogram (micros): Count: 106878 Average: 10.5138 StdDev: 143.11 Min: 1 Median: 2.3314 Max: 23356 Percentiles: P50: 2.33 P75: 3.72 P99: 20.39 P99.9: 1866.76 P99.99: 5062.44 ------------------------------------------------------ [ 0, 1 ] 2775 2.596% 2.596% # ( 1, 2 ] 42731 39.981% 42.578% ######## ( 2, 3 ] 23939 22.398% 64.976% #### ( 3, 4 ] 14933 13.972% 78.948% ### ( 4, 6 ] 15987 14.958% 93.906% ### ( 6, 10 ] 4411 4.127% 98.033% # ( 10, 15 ] 799 0.748% 98.781% ( 15, 22 ] 304 0.284% 99.065% ( 22, 34 ] 24 0.022% 99.088% ( 34, 51 ] 8 0.007% 99.095% ( 51, 76 ] 5 0.005% 99.100% ( 76, 110 ] 66 0.062% 99.162% ( 110, 170 ] 238 0.223% 99.384% ( 170, 250 ] 126 0.118% 99.502% ( 250, 380 ] 73 0.068% 99.571% ( 380, 580 ] 104 0.097% 99.668% ( 580, 870 ] 94 0.088% 99.756% ( 870, 1300 ] 88 0.082% 99.838% ( 1300, 1900 ] 70 0.065% 99.904% ( 1900, 2900 ] 50 0.047% 99.950% ( 2900, 4400 ] 39 0.036% 99.987% ( 4400, 6600 ] 11 0.010% 99.997% ( 6600, 9900 ] 3 0.003% 100.000% ( 22000, 33000 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 184814 Average: 11.4119 StdDev: 146.12 Min: 1 Median: 1.9470 Max: 8212 Percentiles: P50: 1.95 P75: 2.98 P99: 11.79 P99.9: 2317.49 P99.99: 4130.51 ------------------------------------------------------ [ 0, 1 ] 5459 2.954% 2.954% # ( 1, 2 ] 91810 49.677% 52.631% ########## ( 2, 3 ] 42008 22.730% 75.361% ##### ( 3, 4 ] 18929 10.242% 85.603% ## ( 4, 6 ] 19242 10.412% 96.014% ## ( 6, 10 ] 5195 2.811% 98.825% # ( 10, 15 ] 903 0.489% 99.314% ( 15, 22 ] 132 0.071% 99.385% ( 22, 34 ] 32 0.017% 99.403% ( 34, 51 ] 11 0.006% 99.409% ( 51, 76 ] 11 0.006% 99.415% ( 76, 110 ] 17 0.009% 99.424% ( 110, 170 ] 43 0.023% 99.447% ( 170, 250 ] 49 0.027% 99.474% ( 250, 380 ] 85 0.046% 99.520% ( 380, 580 ] 153 0.083% 99.602% ( 580, 870 ] 170 0.092% 99.694% ( 870, 1300 ] 175 0.095% 99.789% ( 1300, 1900 ] 153 0.083% 99.872% ( 1900, 2900 ] 125 0.068% 99.939% ( 2900, 4400 ] 114 0.062% 100.001% ( 4400, 6600 ] 29 0.016% 100.017% ( 6600, 9900 ] 5 0.003% 100.019% ** Level 3 read latency histogram (micros): Count: 827092 Average: 10.1550 StdDev: 148.01 Min: 1 Median: 1.9203 Max: 25992 Percentiles: P50: 1.92 P75: 2.91 P99: 9.49 P99.9: 547.00 P99.99: 875.60 ------------------------------------------------------ [ 0, 1 ] 18972 2.294% 2.294% ( 1, 2 ] 428731 51.836% 54.130% ########## ( 2, 3 ] 189545 22.917% 77.047% ##### ( 3, 4 ] 82904 10.024% 87.070% ## ( 4, 6 ] 81822 9.893% 96.963% ## ( 6, 10 ] 19334 2.338% 99.301% ( 10, 15 ] 3261 0.394% 99.695% ( 15, 22 ] 403 0.049% 99.744% ( 22, 34 ] 43 0.005% 99.749% ( 34, 51 ] 43 0.005% 99.754% ( 51, 76 ] 57 0.007% 99.761% ( 76, 110 ] 83 0.010% 99.771% ( 110, 170 ] 248 0.030% 99.801% ( 170, 250 ] 197 0.024% 99.825% ( 250, 380 ] 252 0.030% 99.855% ( 380, 580 ] 443 0.054% 99.909% ( 580, 870 ] 662 0.080% 99.989% ( 870, 1300 ] 714 0.086% 100.075% ( 1300, 1900 ] 453 0.055% 100.130% ( 1900, 2900 ] 495 0.060% 100.190% ( 2900, 4400 ] 425 0.051% 100.241% ( 4400, 6600 ] 145 0.018% 100.259% ( 6600, 9900 ] 23 0.003% 100.262% ( 9900, 14000 ] 4 0.000% 100.262% ( 14000, 22000 ] 2 0.000% 100.262% ( 22000, 33000 ] 2 0.000% 100.262% ** Level 4 read latency histogram (micros): Count: 524677 Average: 24.2547 StdDev: 225.01 Min: 0 Median: 1.9428 Max: 25499 Percentiles: P50: 1.94 P75: 2.99 P99: 506.41 P99.9: 2495.06 P99.99: 3257.26 ------------------------------------------------------ [ 0, 1 ] 12653 2.412% 2.412% ( 1, 2 ] 264844 50.478% 52.889% ########## ( 2, 3 ] 116977 22.295% 75.184% #### ( 3, 4 ] 53173 10.134% 85.319% ## ( 4, 6 ] 50605 9.645% 94.964% ## ( 6, 10 ] 12829 2.445% 97.409% ( 10, 15 ] 2093 0.399% 97.808% ( 15, 22 ] 264 0.050% 97.858% ( 22, 34 ] 22 0.004% 97.862% ( 34, 51 ] 23 0.004% 97.866% ( 51, 76 ] 40 0.008% 97.874% ( 76, 110 ] 553 0.105% 97.980% ( 110, 170 ] 2150 0.410% 98.389% ( 170, 250 ] 1421 0.271% 98.660% ( 250, 380 ] 966 0.184% 98.844% ( 380, 580 ] 1293 0.246% 99.091% ( 580, 870 ] 1424 0.271% 99.362% ( 870, 1300 ] 1445 0.275% 99.637% ( 1300, 1900 ] 934 0.178% 99.816% ( 1900, 2900 ] 745 0.142% 99.957% ( 2900, 4400 ] 716 0.136% 100.094% ( 4400, 6600 ] 216 0.041% 100.135% ( 6600, 9900 ] 36 0.007% 100.142% ( 14000, 22000 ] 1 0.000% 100.142% ( 22000, 33000 ] 1 0.000% 100.142% ** Level 5 read latency histogram (micros): Count: 50289 Average: 639.1150 StdDev: 1044.18 Min: 75 Median: 233.9876 Max: 29802 Percentiles: P50: 233.99 P75: 611.42 P99: 5545.97 P99.9: 8881.36 P99.99: 12336.30 ------------------------------------------------------ ( 51, 76 ] 1 0.002% 0.002% ( 76, 110 ] 3836 7.628% 7.630% ## ( 110, 170 ] 14624 29.080% 36.710% ###### ( 170, 250 ] 8356 16.616% 53.326% ### ( 250, 380 ] 5140 10.221% 63.547% ## ( 380, 580 ] 5331 10.601% 74.147% ## ( 580, 870 ] 3967 7.888% 82.036% ## ( 870, 1300 ] 2927 5.820% 87.856% # ( 1300, 1900 ] 1893 3.764% 91.620% # ( 1900, 2900 ] 1585 3.152% 94.772% # ( 2900, 4400 ] 1738 3.456% 98.228% # ( 4400, 6600 ] 747 1.485% 99.714% ( 6600, 9900 ] 137 0.272% 99.986% ( 9900, 14000 ] 5 0.010% 99.996% ( 14000, 22000 ] 1 0.002% 99.998% ( 22000, 33000 ] 3 0.006% 100.004% ** DB Stats ** Uptime(secs): 11.6 total, 3.6 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 169.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.836 H:M:S, 33.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 276.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-14:26:38 ... thread 0: (1000000,3000000) ops and (280334.9,200269.8) ops/second in (3.567162,14.979794) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/7 3.70 GB 258.0 2.5 0.0 2.5 5.2 2.8 0.0 1.9 98.9 210.1 25.48 18.28 50 0.510 2558K 2730 0.0 0.0 L1 8/8 860.68 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 99.15 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 871.59 MB 0.9 1.6 1.0 0.7 1.6 0.9 0.0 1.7 104.8 103.6 15.79 7.80 7 2.255 869K 0 0.0 0.0 L4 167/0 9.54 GB 1.0 5.6 3.5 2.1 5.5 3.4 0.0 1.6 110.1 108.8 51.64 26.61 37 1.396 2231K 1018 0.0 0.0 L5 1128/0 92.58 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1334/15 107.62 GB 0.0 9.6 4.5 5.2 12.3 7.1 3.6 4.4 106.2 135.7 92.91 52.69 94 0.988 5660K 3748 0.0 0.0 Int 0/0 0.00 KB 0.0 9.6 4.5 5.2 12.3 7.1 3.6 4.4 106.2 135.7 92.91 52.69 94 0.988 5660K 3748 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.6 4.5 5.2 9.5 4.4 0.0 0.0 125.3 124.1 78.70 44.18 53 1.485 5660K 3748 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 199.5 14.21 8.51 41 0.347 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.2 total, 15.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.31 GB write, 830.34 MB/s write, 9.63 GB read, 649.68 MB/s read, 92.9 seconds Interval compaction: 12.31 GB write, 841.38 MB/s write, 9.63 GB read, 658.31 MB/s read, 92.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 40, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 40, interval: 40 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 918928 Average: 9.8968 StdDev: 105.00 Min: 0 Median: 1.6591 Max: 9438 Percentiles: P50: 1.66 P75: 2.37 P99: 174.93 P99.9: 868.51 P99.99: 2063.28 ------------------------------------------------------ [ 0, 1 ] 121484 13.220% 13.220% ### ( 1, 2 ] 512812 55.805% 69.026% ########### ( 2, 3 ] 147343 16.034% 85.060% ### ( 3, 4 ] 56499 6.148% 91.208% # ( 4, 6 ] 49690 5.407% 96.616% # ( 6, 10 ] 11072 1.205% 97.821% ( 10, 15 ] 2193 0.239% 98.059% ( 15, 22 ] 291 0.032% 98.091% ( 22, 34 ] 32 0.003% 98.094% ( 34, 51 ] 30 0.003% 98.098% ( 51, 76 ] 33 0.004% 98.101% ( 76, 110 ] 1557 0.169% 98.271% ( 110, 170 ] 6468 0.704% 98.974% ( 170, 250 ] 3843 0.418% 99.393% ( 250, 380 ] 2057 0.224% 99.617% ( 380, 580 ] 1656 0.180% 99.797% ( 580, 870 ] 956 0.104% 99.901% ( 870, 1300 ] 486 0.053% 99.954% ( 1300, 1900 ] 293 0.032% 99.986% ( 1900, 2900 ] 264 0.029% 100.014% ( 2900, 4400 ] 242 0.026% 100.041% ( 4400, 6600 ] 84 0.009% 100.050% ( 6600, 9900 ] 13 0.001% 100.051% ** Level 1 read latency histogram (micros): Count: 193244 Average: 8.1311 StdDev: 107.61 Min: 1 Median: 2.4334 Max: 23356 Percentiles: P50: 2.43 P75: 3.82 P99: 19.66 P99.9: 1197.15 P99.99: 4118.29 ------------------------------------------------------ [ 0, 1 ] 5328 2.757% 2.757% # ( 1, 2 ] 72663 37.602% 40.359% ######## ( 2, 3 ] 42988 22.245% 62.604% #### ( 3, 4 ] 29211 15.116% 77.720% ### ( 4, 6 ] 30727 15.901% 93.621% ### ( 6, 10 ] 8403 4.348% 97.969% # ( 10, 15 ] 1557 0.806% 98.775% ( 15, 22 ] 654 0.338% 99.114% ( 22, 34 ] 60 0.031% 99.145% ( 34, 51 ] 9 0.005% 99.149% ( 51, 76 ] 6 0.003% 99.152% ( 76, 110 ] 177 0.092% 99.244% ( 110, 170 ] 543 0.281% 99.525% ( 170, 250 ] 237 0.123% 99.648% ( 250, 380 ] 133 0.069% 99.716% ( 380, 580 ] 169 0.087% 99.804% ( 580, 870 ] 116 0.060% 99.864% ( 870, 1300 ] 93 0.048% 99.912% ( 1300, 1900 ] 70 0.036% 99.948% ( 1900, 2900 ] 50 0.026% 99.974% ( 2900, 4400 ] 39 0.020% 99.994% ( 4400, 6600 ] 11 0.006% 100.000% ( 6600, 9900 ] 3 0.002% 100.002% ( 22000, 33000 ] 1 0.001% 100.002% ** Level 2 read latency histogram (micros): Count: 184882 Average: 11.4895 StdDev: 146.18 Min: 1 Median: 1.9474 Max: 8212 Percentiles: P50: 1.95 P75: 2.99 P99: 12.16 P99.9: 2316.94 P99.99: 4130.42 ------------------------------------------------------ [ 0, 1 ] 5459 2.953% 2.953% # ( 1, 2 ] 91810 49.659% 52.611% ########## ( 2, 3 ] 42008 22.722% 75.333% ##### ( 3, 4 ] 18929 10.238% 85.571% ## ( 4, 6 ] 19242 10.408% 95.979% ## ( 6, 10 ] 5195 2.810% 98.789% # ( 10, 15 ] 903 0.488% 99.277% ( 15, 22 ] 132 0.071% 99.349% ( 22, 34 ] 32 0.017% 99.366% ( 34, 51 ] 11 0.006% 99.372% ( 51, 76 ] 11 0.006% 99.378% ( 76, 110 ] 22 0.012% 99.390% ( 110, 170 ] 74 0.040% 99.430% ( 170, 250 ] 65 0.035% 99.465% ( 250, 380 ] 93 0.050% 99.515% ( 380, 580 ] 159 0.086% 99.601% ( 580, 870 ] 171 0.092% 99.694% ( 870, 1300 ] 176 0.095% 99.789% ( 1300, 1900 ] 153 0.083% 99.872% ( 1900, 2900 ] 125 0.068% 99.939% ( 2900, 4400 ] 114 0.062% 100.001% ( 4400, 6600 ] 29 0.016% 100.017% ( 6600, 9900 ] 5 0.003% 100.019% ** Level 3 read latency histogram (micros): Count: 827685 Average: 10.2998 StdDev: 148.09 Min: 1 Median: 1.9210 Max: 25992 Percentiles: P50: 1.92 P75: 2.91 P99: 9.61 P99.9: 555.88 P99.99: 875.56 ------------------------------------------------------ [ 0, 1 ] 18972 2.292% 2.292% ( 1, 2 ] 428731 51.799% 54.091% ########## ( 2, 3 ] 189545 22.901% 76.992% ##### ( 3, 4 ] 82904 10.016% 87.008% ## ( 4, 6 ] 81822 9.886% 96.894% ## ( 6, 10 ] 19334 2.336% 99.230% ( 10, 15 ] 3261 0.394% 99.624% ( 15, 22 ] 403 0.049% 99.672% ( 22, 34 ] 43 0.005% 99.677% ( 34, 51 ] 43 0.005% 99.683% ( 51, 76 ] 57 0.007% 99.689% ( 76, 110 ] 132 0.016% 99.705% ( 110, 170 ] 507 0.061% 99.767% ( 170, 250 ] 347 0.042% 99.809% ( 250, 380 ] 321 0.039% 99.847% ( 380, 580 ] 495 0.060% 99.907% ( 580, 870 ] 676 0.082% 99.989% ( 870, 1300 ] 714 0.086% 100.075% ( 1300, 1900 ] 453 0.055% 100.130% ( 1900, 2900 ] 495 0.060% 100.190% ( 2900, 4400 ] 425 0.051% 100.241% ( 4400, 6600 ] 145 0.018% 100.259% ( 6600, 9900 ] 23 0.003% 100.261% ( 9900, 14000 ] 4 0.000% 100.262% ( 14000, 22000 ] 2 0.000% 100.262% ( 22000, 33000 ] 2 0.000% 100.262% ** Level 4 read latency histogram (micros): Count: 531550 Average: 26.4701 StdDev: 225.05 Min: 0 Median: 1.9556 Max: 25499 Percentiles: P50: 1.96 P75: 3.08 P99: 540.41 P99.9: 2488.29 P99.99: 3257.42 ------------------------------------------------------ [ 0, 1 ] 12653 2.380% 2.380% ( 1, 2 ] 264869 49.830% 52.210% ########## ( 2, 3 ] 117057 22.022% 74.232% #### ( 3, 4 ] 53321 10.031% 84.263% ## ( 4, 6 ] 50792 9.555% 93.818% ## ( 6, 10 ] 12860 2.419% 96.238% ( 10, 15 ] 2098 0.395% 96.632% ( 15, 22 ] 266 0.050% 96.683% ( 22, 34 ] 22 0.004% 96.687% ( 34, 51 ] 23 0.004% 96.691% ( 51, 76 ] 40 0.008% 96.699% ( 76, 110 ] 1326 0.249% 96.948% ( 110, 170 ] 5051 0.950% 97.898% ( 170, 250 ] 2794 0.526% 98.424% ( 250, 380 ] 1606 0.302% 98.726% ( 380, 580 ] 1816 0.342% 99.068% ( 580, 870 ] 1581 0.297% 99.365% ( 870, 1300 ] 1469 0.276% 99.641% ( 1300, 1900 ] 935 0.176% 99.817% ( 1900, 2900 ] 747 0.141% 99.958% ( 2900, 4400 ] 717 0.135% 100.093% ( 4400, 6600 ] 216 0.041% 100.133% ( 6600, 9900 ] 36 0.007% 100.140% ( 14000, 22000 ] 1 0.000% 100.140% ( 22000, 33000 ] 1 0.000% 100.141% ** Level 5 read latency histogram (micros): Count: 92665 Average: 443.1141 StdDev: 804.67 Min: 75 Median: 186.4237 Max: 29802 Percentiles: P50: 186.42 P75: 377.47 P99: 4368.42 P99.9: 7812.45 P99.99: 9821.32 ------------------------------------------------------ ( 51, 76 ] 3 0.003% 0.003% ( 76, 110 ] 8989 9.701% 9.704% ## ( 110, 170 ] 33732 36.402% 46.106% ####### ( 170, 250 ] 17577 18.968% 65.074% #### ( 250, 380 ] 9380 10.122% 75.197% ## ( 380, 580 ] 8662 9.348% 84.544% ## ( 580, 870 ] 5064 5.465% 90.009% # ( 870, 1300 ] 3113 3.359% 93.369% # ( 1300, 1900 ] 1911 2.062% 95.431% ( 1900, 2900 ] 1604 1.731% 97.162% ( 2900, 4400 ] 1741 1.879% 99.041% ( 4400, 6600 ] 747 0.806% 99.847% ( 6600, 9900 ] 137 0.148% 99.995% ( 9900, 14000 ] 5 0.005% 100.000% ( 14000, 22000 ] 1 0.001% 100.001% ( 22000, 33000 ] 3 0.003% 100.004% ** DB Stats ** Uptime(secs): 15.2 total, 3.6 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 194.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.836 H:M:S, 25.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 275.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 229.302 micros/op 17431 ops/sec 60.121 seconds 1047996 operations; 16.9 MB/s (261999 of 261999 found) Microseconds per read: Count: 1047996 Average: 229.3045 StdDev: 652.91 Min: 3 Median: 180.9855 Max: 69688 Percentiles: P50: 180.99 P75: 230.21 P99: 837.90 P99.9: 10742.21 P99.99: 28955.58 ------------------------------------------------------ ( 2, 3 ] 4 0.000% 0.000% ( 3, 4 ] 2 0.000% 0.001% ( 4, 6 ] 87 0.008% 0.009% ( 6, 10 ] 216 0.021% 0.029% ( 10, 15 ] 81 0.008% 0.037% ( 15, 22 ] 506 0.048% 0.085% ( 22, 34 ] 15969 1.524% 1.609% ( 34, 51 ] 5540 0.529% 2.138% ( 51, 76 ] 655 0.063% 2.200% ( 76, 110 ] 467 0.045% 2.245% ( 110, 170 ] 441999 42.176% 44.421% ######## ( 170, 250 ] 425813 40.631% 85.052% ######## ( 250, 380 ] 102197 9.752% 94.803% ## ( 380, 580 ] 34073 3.251% 98.055% # ( 580, 870 ] 11140 1.063% 99.118% ( 870, 1300 ] 3975 0.379% 99.497% ( 1300, 1900 ] 1598 0.152% 99.649% ( 1900, 2900 ] 1058 0.101% 99.750% ( 2900, 4400 ] 954 0.091% 99.841% ( 4400, 6600 ] 352 0.034% 99.875% ( 6600, 9900 ] 186 0.018% 99.893% ( 9900, 14000 ] 370 0.035% 99.928% ( 14000, 22000 ] 524 0.050% 99.978% ( 22000, 33000 ] 198 0.019% 99.997% ( 33000, 50000 ] 29 0.003% 100.000% ( 50000, 75000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 18131284 rocksdb.bloom.filter.full.positive COUNT : 1224677 rocksdb.bloom.filter.full.true.positive COUNT : 1047579 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 417 rocksdb.memtable.miss COUNT : 1047579 rocksdb.l0.hit COUNT : 36042 rocksdb.l1.hit COUNT : 17432 rocksdb.l2andup.hit COUNT : 994105 rocksdb.compaction.key.drop.new COUNT : 143699 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3669648 rocksdb.number.keys.read COUNT : 1047996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3787076736 rocksdb.bytes.read COUNT : 1047996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1548 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 45289717 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 15078308237 rocksdb.compact.write.bytes COUNT : 14931321647 rocksdb.flush.write.bytes COUNT : 3765417504 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 40 rocksdb.number.superversion_acquires COUNT : 722 rocksdb.number.superversion_releases COUNT : 691 rocksdb.number.superversion_cleanups COUNT : 179 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 203 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3734971392 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1379328 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 19464033635 rocksdb.non.last.level.read.count COUNT : 4560648 rocksdb.block.checksum.compute.count COUNT : 4889779 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 179.498282 P95 : 389.691040 P99 : 837.139264 P100 : 69687.000000 COUNT : 1047996 SUM : 239157129 rocksdb.db.write.micros P50 : 1.613916 P95 : 5.306860 P99 : 14.717113 P100 : 926467.000000 COUNT : 3669648 SUM : 55261780 rocksdb.compaction.times.micros P50 : 1325000.000000 P95 : 2843333.333333 P99 : 16515727.000000 P100 : 16515727.000000 COUNT : 57 SUM : 98225872 rocksdb.compaction.times.cpu_micros P50 : 911739.130435 P95 : 1815000.000000 P99 : 10442120.000000 P100 : 10442120.000000 COUNT : 57 SUM : 57549580 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 813.035714 P95 : 81125.000000 P99 : 311100.000000 P100 : 361079.000000 COUNT : 53 SUM : 752471 rocksdb.compaction.outfile.sync.micros P50 : 32541.666667 P95 : 265166.666667 P99 : 368588.888889 P100 : 693187.000000 COUNT : 179 SUM : 11904114 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 236.666667 P95 : 4131.250000 P99 : 5325.000000 P100 : 5325.000000 COUNT : 123 SUM : 141875 rocksdb.table.open.io.micros P50 : 9478.082192 P95 : 20247.328244 P99 : 24616.842105 P100 : 38568.000000 COUNT : 1548 SUM : 15058479 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.449368 P95 : 83.326438 P99 : 193.825552 P100 : 25996.000000 COUNT : 3652213 SUM : 66742374 rocksdb.read.block.get.micros P50 : 137.766632 P95 : 249.535536 P99 : 785.173798 P100 : 29879.000000 COUNT : 1236011 SUM : 195262683 rocksdb.write.raw.block.micros P50 : 0.586494 P95 : 1.833055 P99 : 4.734954 P100 : 29996.000000 COUNT : 4528753 SUM : 14446107 rocksdb.numfiles.in.singlecompaction P50 : 3.181818 P95 : 5.500000 P99 : 25.600000 P100 : 33.000000 COUNT : 70 SUM : 281 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.604462 P95 : 2154.374886 P99 : 2751.533956 P100 : 926295.000000 COUNT : 163114 SUM : 45310759 rocksdb.sst.read.micros P50 : 2.911911 P95 : 168.238923 P99 : 431.295916 P100 : 29802.000000 COUNT : 4560700 SUM : 243899146 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1047996 SUM : 1047996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3669648 SUM : 3787076736 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 221707.317073 P95 : 974750.000000 P99 : 1154950.000000 P100 : 1166018.000000 COUNT : 53 SUM : 16827693 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 210 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0