[2024-11-15 11:26:17.275740] Starting SPDK v25.01-pre git sha1 4b2d483c6 / DPDK 24.03.0 initialization... [2024-11-15 11:26:17.276059] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1565587 ] Set seed to 1731666377268439 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-15 11:26:17.428751] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-15 11:26:17.533708] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-15 11:26:17.533762] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1565587' to capture a snapshot of events at runtime. [2024-11-15 11:26:17.533776] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-15 11:26:17.533789] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-15 11:26:17.533799] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1565587 for offline analysis/debug. [2024-11-15 11:26:17.535044] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Nov 15 11:26:20 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/15-11:26:23 ... thread 0: (1000000,1000000) ops and (326483.2,326483.2) ops/second in (3.062945,3.062945) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 629.15 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 340.4 2.59 2.40 13 0.199 0 0 0.0 0.0 L1 3/3 188.12 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 235.3 234.8 0.80 0.79 1 0.801 191K 393 0.0 0.0 L2 1/0 99.92 MB 1.0 0.2 0.1 0.1 0.2 0.1 0.0 2.6 249.5 249.1 0.64 0.62 1 0.645 163K 309 0.0 0.0 L3 15/0 690.54 MB 0.7 0.1 0.1 0.0 0.1 0.1 0.0 1.0 206.1 206.2 0.29 0.28 1 0.294 61K 0 0.0 0.0 L4 120/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 116/0 8.98 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 265/11 20.09 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 94.8 298.1 4.33 4.08 16 0.270 416K 702 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 94.8 298.1 4.33 4.08 16 0.270 416K 702 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 235.6 235.2 1.74 1.69 3 0.580 416K 702 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 340.4 2.59 2.40 13 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.1 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.26 GB write, 411.67 MB/s write, 0.40 GB read, 130.84 MB/s read, 4.3 seconds Interval compaction: 1.26 GB write, 420.95 MB/s write, 0.40 GB read, 133.80 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 129817 Average: 2.0216 StdDev: 5.70 Min: 1 Median: 1.3834 Max: 1286 Percentiles: P50: 1.38 P75: 1.79 P99: 5.53 P99.9: 12.19 P99.99: 223.45 ------------------------------------------------------ [ 0, 1 ] 34022 26.208% 26.208% ##### ( 1, 2 ] 80561 62.057% 88.265% ############ ( 2, 3 ] 9227 7.108% 95.373% # ( 3, 4 ] 3213 2.475% 97.848% ( 4, 6 ] 1956 1.507% 99.354% ( 6, 10 ] 652 0.502% 99.857% ( 10, 15 ] 133 0.102% 99.959% ( 15, 22 ] 24 0.018% 99.978% ( 22, 34 ] 4 0.003% 99.981% ( 34, 51 ] 2 0.002% 99.982% ( 51, 76 ] 3 0.002% 99.985% ( 76, 110 ] 1 0.001% 99.985% ( 170, 250 ] 12 0.009% 99.995% ( 250, 380 ] 6 0.005% 99.999% ( 380, 580 ] 7 0.005% 100.005% ( 870, 1300 ] 1 0.001% 100.005% ** Level 1 read latency histogram (micros): Count: 28238 Average: 2.0527 StdDev: 5.49 Min: 1 Median: 1.4256 Max: 675 Percentiles: P50: 1.43 P75: 1.82 P99: 5.37 P99.9: 9.47 P99.99: 272.91 ------------------------------------------------------ [ 0, 1 ] 6469 22.909% 22.909% ##### ( 1, 2 ] 17974 63.652% 86.561% ############# ( 2, 3 ] 2407 8.524% 95.085% ## ( 3, 4 ] 769 2.723% 97.808% # ( 4, 6 ] 491 1.739% 99.547% ( 6, 10 ] 115 0.407% 99.954% ( 10, 15 ] 8 0.028% 99.982% ( 15, 22 ] 1 0.004% 99.986% ( 170, 250 ] 1 0.004% 99.989% ( 250, 380 ] 1 0.004% 99.993% ( 380, 580 ] 1 0.004% 99.996% ( 580, 870 ] 1 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 40269 Average: 2.6489 StdDev: 29.65 Min: 0 Median: 1.4479 Max: 4000 Percentiles: P50: 1.45 P75: 1.86 P99: 8.77 P99.9: 111.91 P99.99: 770.73 ------------------------------------------------------ [ 0, 1 ] 9155 22.735% 22.735% ##### ( 1, 2 ] 24512 60.871% 83.605% ############ ( 2, 3 ] 3572 8.870% 92.476% ## ( 3, 4 ] 1199 2.977% 95.453% # ( 4, 6 ] 1082 2.687% 98.140% # ( 6, 10 ] 500 1.242% 99.382% ( 10, 15 ] 143 0.355% 99.737% ( 15, 22 ] 26 0.065% 99.801% ( 22, 34 ] 4 0.010% 99.811% ( 34, 51 ] 2 0.005% 99.816% ( 76, 110 ] 33 0.082% 99.898% ( 110, 170 ] 23 0.057% 99.955% ( 170, 250 ] 8 0.020% 99.975% ( 250, 380 ] 3 0.007% 99.983% ( 380, 580 ] 1 0.002% 99.985% ( 580, 870 ] 3 0.007% 99.993% ( 1300, 1900 ] 1 0.002% 99.995% ( 2900, 4400 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 75 Average: 1107.8000 StdDev: 1572.19 Min: 1 Median: 200.0000 Max: 5438 Percentiles: P50: 200.00 P75: 1578.57 P99: 5438.00 P99.9: 5438.00 P99.99: 5438.00 ------------------------------------------------------ [ 0, 1 ] 12 16.000% 16.000% ### ( 1, 2 ] 8 10.667% 26.667% ## ( 2, 3 ] 5 6.667% 33.333% # ( 3, 4 ] 1 1.333% 34.667% ( 4, 6 ] 2 2.667% 37.333% # ( 6, 10 ] 2 2.667% 40.000% # ( 10, 15 ] 3 4.000% 44.000% # ( 110, 170 ] 3 4.000% 48.000% # ( 170, 250 ] 4 5.333% 53.333% # ( 250, 380 ] 1 1.333% 54.667% ( 380, 580 ] 1 1.333% 56.000% ( 580, 870 ] 5 6.667% 62.667% # ( 870, 1300 ] 6 8.000% 70.667% ## ( 1300, 1900 ] 7 9.333% 80.000% ## ( 1900, 2900 ] 2 2.667% 82.667% # ( 2900, 4400 ] 6 8.000% 90.667% ## ( 4400, 6600 ] 7 9.333% 100.000% ## ** Level 4 read latency histogram (micros): Count: 35 Average: 3121.3714 StdDev: 1426.52 Min: 439 Median: 3188.4615 Max: 5762 Percentiles: P50: 3188.46 P75: 4198.08 P99: 5762.00 P99.9: 5762.00 P99.99: 5762.00 ------------------------------------------------------ ( 380, 580 ] 1 2.857% 2.857% # ( 580, 870 ] 1 2.857% 5.714% # ( 870, 1300 ] 3 8.571% 14.286% ## ( 1300, 1900 ] 4 11.429% 25.714% ## ( 1900, 2900 ] 6 17.143% 42.857% ### ( 2900, 4400 ] 13 37.143% 80.000% ####### ( 4400, 6600 ] 7 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 3.1 total, 3.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 314.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.193 H:M:S, 6.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.08 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.193 H:M:S, 6.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/15-11:26:26 ... thread 0: (1000000,2000000) ops and (338194.9,332235.8) ops/second in (2.956875,6.019820) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 1.29 GB 106.4 1.0 0.0 1.0 2.8 1.8 0.0 1.5 108.8 305.5 9.25 8.77 32 0.289 1022K 4940 0.0 0.0 L1 1/0 49.89 MB 5.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 239.0 237.5 2.63 2.58 2 1.315 638K 3935 0.0 0.0 L2 1/1 99.92 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 2.6 249.5 249.1 0.64 0.62 1 0.645 163K 309 0.0 0.0 L3 18/8 1.05 GB 0.4 0.5 0.4 0.1 0.5 0.4 0.0 1.2 212.7 212.2 2.62 2.54 4 0.656 567K 1287 0.0 0.0 L4 120/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 116/0 8.98 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 265/13 21.00 GB 0.0 2.3 0.9 1.4 4.1 2.7 0.4 2.3 155.4 275.1 15.15 14.52 39 0.388 2390K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 0.9 1.4 4.1 2.7 0.4 2.3 155.4 275.1 15.15 14.52 39 0.388 2390K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 0.9 1.4 2.3 0.9 0.0 0.0 237.0 236.0 9.93 9.70 11 0.903 2390K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 349.7 5.22 4.81 28 0.186 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 6.0 interval Flush(GB): cumulative 1.782, interval 1.782 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.07 GB write, 684.33 MB/s write, 2.30 GB read, 386.53 MB/s read, 15.1 seconds Interval compaction: 4.07 GB write, 692.19 MB/s write, 2.30 GB read, 390.97 MB/s read, 15.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 404216 Average: 2.3816 StdDev: 5.92 Min: 1 Median: 1.5912 Max: 1286 Percentiles: P50: 1.59 P75: 2.00 P99: 6.69 P99.9: 13.54 P99.99: 19.78 ------------------------------------------------------ [ 0, 1 ] 54974 13.600% 13.600% ### ( 1, 2 ] 248888 61.573% 75.173% ############ ( 2, 3 ] 60584 14.988% 90.161% ### ( 3, 4 ] 19424 4.805% 94.967% # ( 4, 6 ] 15690 3.882% 98.848% # ( 6, 10 ] 3571 0.883% 99.732% ( 10, 15 ] 963 0.238% 99.970% ( 15, 22 ] 121 0.030% 100.000% ( 22, 34 ] 17 0.004% 100.004% ( 34, 51 ] 4 0.001% 100.005% ( 51, 76 ] 5 0.001% 100.006% ( 76, 110 ] 2 0.000% 100.007% ( 170, 250 ] 27 0.007% 100.013% ( 250, 380 ] 13 0.003% 100.017% ( 380, 580 ] 15 0.004% 100.020% ( 580, 870 ] 4 0.001% 100.021% ( 870, 1300 ] 5 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 145837 Average: 2.7353 StdDev: 6.03 Min: 0 Median: 1.7653 Max: 721 Percentiles: P50: 1.77 P75: 2.53 P99: 8.63 P99.9: 14.97 P99.99: 189.63 ------------------------------------------------------ [ 0, 1 ] 9466 6.491% 6.491% # ( 1, 2 ] 82915 56.855% 63.345% ########### ( 2, 3 ] 32069 21.990% 85.335% #### ( 3, 4 ] 9545 6.545% 91.880% # ( 4, 6 ] 8951 6.138% 98.018% # ( 6, 10 ] 2181 1.496% 99.513% ( 10, 15 ] 568 0.389% 99.903% ( 15, 22 ] 72 0.049% 99.952% ( 22, 34 ] 5 0.003% 99.955% ( 34, 51 ] 1 0.001% 99.956% ( 76, 110 ] 5 0.003% 99.960% ( 110, 170 ] 40 0.027% 99.987% ( 170, 250 ] 18 0.012% 99.999% ( 250, 380 ] 5 0.003% 100.003% ( 380, 580 ] 5 0.003% 100.006% ( 580, 870 ] 4 0.003% 100.009% ** Level 2 read latency histogram (micros): Count: 40641 Average: 2.8051 StdDev: 30.18 Min: 0 Median: 1.4545 Max: 4000 Percentiles: P50: 1.45 P75: 1.87 P99: 9.01 P99.9: 152.96 P99.99: 767.14 ------------------------------------------------------ [ 0, 1 ] 9155 22.527% 22.527% ##### ( 1, 2 ] 24567 60.449% 82.975% ############ ( 2, 3 ] 3779 9.298% 92.274% ## ( 3, 4 ] 1239 3.049% 95.322% # ( 4, 6 ] 1109 2.729% 98.051% # ( 6, 10 ] 512 1.260% 99.311% ( 10, 15 ] 144 0.354% 99.665% ( 15, 22 ] 27 0.066% 99.732% ( 22, 34 ] 4 0.010% 99.742% ( 34, 51 ] 2 0.005% 99.747% ( 76, 110 ] 33 0.081% 99.828% ( 110, 170 ] 41 0.101% 99.929% ( 170, 250 ] 10 0.025% 99.953% ( 250, 380 ] 9 0.022% 99.975% ( 380, 580 ] 4 0.010% 99.985% ( 580, 870 ] 3 0.007% 99.993% ( 1300, 1900 ] 1 0.002% 99.995% ( 2900, 4400 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 145108 Average: 3.6746 StdDev: 44.41 Min: 1 Median: 1.8077 Max: 5438 Percentiles: P50: 1.81 P75: 2.64 P99: 9.96 P99.9: 141.83 P99.99: 429.78 ------------------------------------------------------ [ 0, 1 ] 4902 3.378% 3.378% # ( 1, 2 ] 83759 57.722% 61.100% ############ ( 2, 3 ] 31432 21.661% 82.761% #### ( 3, 4 ] 10664 7.349% 90.110% # ( 4, 6 ] 9565 6.592% 96.702% # ( 6, 10 ] 3370 2.322% 99.024% ( 10, 15 ] 814 0.561% 99.585% ( 15, 22 ] 125 0.086% 99.671% ( 22, 34 ] 14 0.010% 99.681% ( 34, 51 ] 107 0.074% 99.755% ( 51, 76 ] 86 0.059% 99.814% ( 76, 110 ] 40 0.028% 99.841% ( 110, 170 ] 160 0.110% 99.952% ( 170, 250 ] 38 0.026% 99.978% ( 250, 380 ] 15 0.010% 99.988% ( 380, 580 ] 10 0.007% 99.995% ( 580, 870 ] 6 0.004% 99.999% ( 870, 1300 ] 7 0.005% 100.004% ( 1300, 1900 ] 7 0.005% 100.009% ( 1900, 2900 ] 2 0.001% 100.010% ( 2900, 4400 ] 6 0.004% 100.014% ( 4400, 6600 ] 7 0.005% 100.019% ** Level 4 read latency histogram (micros): Count: 35 Average: 3121.3714 StdDev: 1426.52 Min: 439 Median: 3188.4615 Max: 5762 Percentiles: P50: 3188.46 P75: 4198.08 P99: 5762.00 P99.9: 5762.00 P99.99: 5762.00 ------------------------------------------------------ ( 380, 580 ] 1 2.857% 2.857% # ( 580, 870 ] 1 2.857% 5.714% # ( 870, 1300 ] 3 8.571% 14.286% ## ( 1300, 1900 ] 4 11.429% 25.714% ## ( 1900, 2900 ] 6 17.143% 42.857% ### ( 2900, 4400 ] 13 37.143% 80.000% ####### ( 4400, 6600 ] 7 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 6.1 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 323.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.193 H:M:S, 3.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/15-11:26:29 ... thread 0: (1000000,3000000) ops and (324782.2,329713.6) ops/second in (3.078986,9.098806) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 2.26 GB 6.3 2.0 0.0 2.0 4.7 2.8 0.0 1.7 126.1 302.7 15.97 15.19 51 0.313 2044K 9846 0.0 0.0 L1 1/1 49.89 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 239.0 237.5 2.63 2.58 2 1.315 638K 3935 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 2.6 249.5 249.1 0.64 0.62 1 0.645 163K 309 0.0 0.0 L3 20/0 940.82 MB 0.9 1.3 0.5 0.7 1.3 0.5 0.0 2.3 230.6 230.0 5.59 5.38 5 1.117 1308K 3322 0.0 0.0 L4 127/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 223.9 223.9 1.04 1.00 1 1.039 236K 0 0.0 0.0 L5 116/0 8.98 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 276/12 21.97 GB 0.0 4.2 1.3 3.0 7.0 4.0 0.4 2.5 167.1 275.9 25.87 24.77 60 0.431 4390K 17K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.2 1.3 3.0 7.0 4.0 0.4 2.5 167.1 275.9 25.87 24.77 60 0.431 4390K 17K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.2 1.3 3.0 4.2 1.2 0.0 0.0 242.3 241.3 17.84 17.38 17 1.050 4390K 17K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 352.9 8.02 7.40 43 0.187 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.1 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.97 GB write, 778.26 MB/s write, 4.22 GB read, 471.48 MB/s read, 25.9 seconds Interval compaction: 6.97 GB write, 784.18 MB/s write, 4.22 GB read, 475.06 MB/s read, 25.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 643776 Average: 2.4149 StdDev: 7.31 Min: 0 Median: 1.5780 Max: 1898 Percentiles: P50: 1.58 P75: 1.98 P99: 6.41 P99.9: 14.53 P99.99: 162.34 ------------------------------------------------------ [ 0, 1 ] 87920 13.657% 13.657% ### ( 1, 2 ] 404776 62.875% 76.532% ############# ( 2, 3 ] 94355 14.656% 91.189% ### ( 3, 4 ] 28580 4.439% 95.628% # ( 4, 6 ] 21180 3.290% 98.918% # ( 6, 10 ] 5132 0.797% 99.715% ( 10, 15 ] 1313 0.204% 99.919% ( 15, 22 ] 165 0.026% 99.945% ( 22, 34 ] 26 0.004% 99.949% ( 34, 51 ] 4 0.001% 99.950% ( 51, 76 ] 7 0.001% 99.951% ( 76, 110 ] 6 0.001% 99.952% ( 110, 170 ] 285 0.044% 99.996% ( 170, 250 ] 63 0.010% 100.006% ( 250, 380 ] 25 0.004% 100.009% ( 380, 580 ] 28 0.004% 100.014% ( 580, 870 ] 7 0.001% 100.015% ( 870, 1300 ] 9 0.001% 100.016% ( 1300, 1900 ] 2 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 145838 Average: 2.7363 StdDev: 6.04 Min: 0 Median: 1.7653 Max: 721 Percentiles: P50: 1.77 P75: 2.53 P99: 8.63 P99.9: 14.98 P99.99: 189.63 ------------------------------------------------------ [ 0, 1 ] 9466 6.491% 6.491% # ( 1, 2 ] 82915 56.854% 63.345% ########### ( 2, 3 ] 32069 21.989% 85.334% #### ( 3, 4 ] 9545 6.545% 91.879% # ( 4, 6 ] 8951 6.138% 98.017% # ( 6, 10 ] 2181 1.495% 99.512% ( 10, 15 ] 568 0.389% 99.902% ( 15, 22 ] 72 0.049% 99.951% ( 22, 34 ] 5 0.003% 99.955% ( 34, 51 ] 1 0.001% 99.955% ( 76, 110 ] 5 0.003% 99.959% ( 110, 170 ] 41 0.028% 99.987% ( 170, 250 ] 18 0.012% 99.999% ( 250, 380 ] 5 0.003% 100.003% ( 380, 580 ] 5 0.003% 100.006% ( 580, 870 ] 4 0.003% 100.009% ** Level 2 read latency histogram (micros): Count: 65643 Average: 2.6653 StdDev: 24.02 Min: 0 Median: 1.5107 Max: 4000 Percentiles: P50: 1.51 P75: 1.91 P99: 8.81 P99.9: 130.88 P99.99: 557.43 ------------------------------------------------------ [ 0, 1 ] 11750 17.900% 17.900% #### ( 1, 2 ] 41263 62.860% 80.760% ############# ( 2, 3 ] 7540 11.486% 92.246% ## ( 3, 4 ] 2087 3.179% 95.425% # ( 4, 6 ] 1643 2.503% 97.928% # ( 6, 10 ] 1000 1.523% 99.452% ( 10, 15 ] 206 0.314% 99.765% ( 15, 22 ] 33 0.050% 99.816% ( 22, 34 ] 4 0.006% 99.822% ( 34, 51 ] 2 0.003% 99.825% ( 76, 110 ] 33 0.050% 99.875% ( 110, 170 ] 47 0.072% 99.947% ( 170, 250 ] 11 0.017% 99.963% ( 250, 380 ] 13 0.020% 99.983% ( 380, 580 ] 5 0.008% 99.991% ( 580, 870 ] 3 0.005% 99.995% ( 1300, 1900 ] 1 0.002% 99.997% ( 2900, 4400 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 247431 Average: 3.3271 StdDev: 34.50 Min: 0 Median: 1.7492 Max: 5438 Percentiles: P50: 1.75 P75: 2.48 P99: 9.78 P99.9: 143.31 P99.99: 373.34 ------------------------------------------------------ [ 0, 1 ] 11559 4.672% 4.672% # ( 1, 2 ] 149698 60.501% 65.173% ############ ( 2, 3 ] 50583 20.443% 85.616% #### ( 3, 4 ] 15150 6.123% 91.739% # ( 4, 6 ] 12943 5.231% 96.970% # ( 6, 10 ] 5323 2.151% 99.121% ( 10, 15 ] 1233 0.498% 99.619% ( 15, 22 ] 171 0.069% 99.688% ( 22, 34 ] 22 0.009% 99.697% ( 34, 51 ] 188 0.076% 99.773% ( 51, 76 ] 123 0.050% 99.823% ( 76, 110 ] 49 0.020% 99.843% ( 110, 170 ] 255 0.103% 99.946% ( 170, 250 ] 77 0.031% 99.977% ( 250, 380 ] 34 0.014% 99.991% ( 380, 580 ] 14 0.006% 99.996% ( 580, 870 ] 7 0.003% 99.999% ( 870, 1300 ] 8 0.003% 100.002% ( 1300, 1900 ] 7 0.003% 100.005% ( 1900, 2900 ] 2 0.001% 100.006% ( 2900, 4400 ] 6 0.002% 100.008% ( 4400, 6600 ] 7 0.003% 100.011% ** Level 4 read latency histogram (micros): Count: 70 Average: 1591.3286 StdDev: 1833.72 Min: 1 Median: 250.0000 Max: 5762 Percentiles: P50: 250.00 P75: 3188.46 P99: 5762.00 P99.9: 5762.00 P99.99: 5762.00 ------------------------------------------------------ [ 0, 1 ] 10 14.286% 14.286% ### ( 1, 2 ] 12 17.143% 31.429% ### ( 6, 10 ] 1 1.429% 32.857% ( 34, 51 ] 1 1.429% 34.286% ( 110, 170 ] 6 8.571% 42.857% ## ( 170, 250 ] 5 7.143% 50.000% # ( 380, 580 ] 1 1.429% 51.429% ( 580, 870 ] 1 1.429% 52.857% ( 870, 1300 ] 3 4.286% 57.143% # ( 1300, 1900 ] 4 5.714% 62.857% # ( 1900, 2900 ] 6 8.571% 71.429% ## ( 2900, 4400 ] 13 18.571% 90.000% #### ( 4400, 6600 ] 7 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 9.2 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 322.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.367 H:M:S, 4.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.174 H:M:S, 5.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/15-11:26:32 ... thread 0: (1000000,4000000) ops and (298587.6,321339.2) ops/second in (3.349101,12.447907) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 3.24 GB 81.4 2.7 0.0 2.7 6.4 3.7 0.0 1.7 127.6 303.9 21.69 20.65 70 0.310 2810K 13K 0.0 0.0 L1 1/1 49.89 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 239.0 237.5 2.63 2.58 2 1.315 638K 3935 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 2.6 249.5 249.1 0.64 0.62 1 0.645 163K 309 0.0 0.0 L3 20/0 940.82 MB 0.9 1.3 0.5 0.7 1.3 0.5 0.0 2.3 230.6 230.0 5.59 5.38 5 1.117 1308K 3322 0.0 0.0 L4 127/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 223.9 223.9 1.04 1.00 1 1.039 236K 0 0.0 0.0 L5 116/0 8.98 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 283/16 22.95 GB 0.0 5.0 1.3 3.7 8.7 5.0 0.4 2.3 160.8 281.6 31.58 30.23 79 0.400 5157K 21K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.0 1.3 3.7 8.7 5.0 0.4 2.3 160.8 281.6 31.58 30.23 79 0.400 5157K 21K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.0 1.3 3.7 4.9 1.2 0.0 0.0 244.3 243.2 20.79 20.27 20 1.039 5157K 21K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 355.5 10.80 9.96 59 0.183 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.5 total, 12.4 interval Flush(GB): cumulative 3.747, interval 3.747 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.69 GB write, 710.47 MB/s write, 4.96 GB read, 405.65 MB/s read, 31.6 seconds Interval compaction: 8.69 GB write, 714.42 MB/s write, 4.96 GB read, 407.90 MB/s read, 31.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 2, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1055947 Average: 2.4356 StdDev: 7.39 Min: 0 Median: 1.5842 Max: 1898 Percentiles: P50: 1.58 P75: 1.97 P99: 6.72 P99.9: 14.54 P99.99: 156.31 ------------------------------------------------------ [ 0, 1 ] 131886 12.490% 12.490% ## ( 1, 2 ] 677952 64.203% 76.693% ############# ( 2, 3 ] 159491 15.104% 91.797% ### ( 3, 4 ] 43364 4.107% 95.904% # ( 4, 6 ] 31027 2.938% 98.842% # ( 6, 10 ] 9294 0.880% 99.722% ( 10, 15 ] 2071 0.196% 99.918% ( 15, 22 ] 227 0.021% 99.940% ( 22, 34 ] 36 0.003% 99.943% ( 34, 51 ] 6 0.001% 99.944% ( 51, 76 ] 10 0.001% 99.945% ( 76, 110 ] 68 0.006% 99.951% ( 110, 170 ] 533 0.050% 100.002% ( 170, 250 ] 117 0.011% 100.013% ( 250, 380 ] 67 0.006% 100.019% ( 380, 580 ] 36 0.003% 100.023% ( 580, 870 ] 17 0.002% 100.024% ( 870, 1300 ] 11 0.001% 100.025% ( 1300, 1900 ] 3 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 145838 Average: 2.7363 StdDev: 6.04 Min: 0 Median: 1.7653 Max: 721 Percentiles: P50: 1.77 P75: 2.53 P99: 8.63 P99.9: 14.98 P99.99: 189.63 ------------------------------------------------------ [ 0, 1 ] 9466 6.491% 6.491% # ( 1, 2 ] 82915 56.854% 63.345% ########### ( 2, 3 ] 32069 21.989% 85.334% #### ( 3, 4 ] 9545 6.545% 91.879% # ( 4, 6 ] 8951 6.138% 98.017% # ( 6, 10 ] 2181 1.495% 99.512% ( 10, 15 ] 568 0.389% 99.902% ( 15, 22 ] 72 0.049% 99.951% ( 22, 34 ] 5 0.003% 99.955% ( 34, 51 ] 1 0.001% 99.955% ( 76, 110 ] 5 0.003% 99.959% ( 110, 170 ] 41 0.028% 99.987% ( 170, 250 ] 18 0.012% 99.999% ( 250, 380 ] 5 0.003% 100.003% ( 380, 580 ] 5 0.003% 100.006% ( 580, 870 ] 4 0.003% 100.009% ** Level 2 read latency histogram (micros): Count: 65643 Average: 2.6653 StdDev: 24.02 Min: 0 Median: 1.5107 Max: 4000 Percentiles: P50: 1.51 P75: 1.91 P99: 8.81 P99.9: 130.88 P99.99: 557.43 ------------------------------------------------------ [ 0, 1 ] 11750 17.900% 17.900% #### ( 1, 2 ] 41263 62.860% 80.760% ############# ( 2, 3 ] 7540 11.486% 92.246% ## ( 3, 4 ] 2087 3.179% 95.425% # ( 4, 6 ] 1643 2.503% 97.928% # ( 6, 10 ] 1000 1.523% 99.452% ( 10, 15 ] 206 0.314% 99.765% ( 15, 22 ] 33 0.050% 99.816% ( 22, 34 ] 4 0.006% 99.822% ( 34, 51 ] 2 0.003% 99.825% ( 76, 110 ] 33 0.050% 99.875% ( 110, 170 ] 47 0.072% 99.947% ( 170, 250 ] 11 0.017% 99.963% ( 250, 380 ] 13 0.020% 99.983% ( 380, 580 ] 5 0.008% 99.991% ( 580, 870 ] 3 0.005% 99.995% ( 1300, 1900 ] 1 0.002% 99.997% ( 2900, 4400 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 247431 Average: 3.3271 StdDev: 34.50 Min: 0 Median: 1.7492 Max: 5438 Percentiles: P50: 1.75 P75: 2.48 P99: 9.78 P99.9: 143.31 P99.99: 373.34 ------------------------------------------------------ [ 0, 1 ] 11559 4.672% 4.672% # ( 1, 2 ] 149698 60.501% 65.173% ############ ( 2, 3 ] 50583 20.443% 85.616% #### ( 3, 4 ] 15150 6.123% 91.739% # ( 4, 6 ] 12943 5.231% 96.970% # ( 6, 10 ] 5323 2.151% 99.121% ( 10, 15 ] 1233 0.498% 99.619% ( 15, 22 ] 171 0.069% 99.688% ( 22, 34 ] 22 0.009% 99.697% ( 34, 51 ] 188 0.076% 99.773% ( 51, 76 ] 123 0.050% 99.823% ( 76, 110 ] 49 0.020% 99.843% ( 110, 170 ] 255 0.103% 99.946% ( 170, 250 ] 77 0.031% 99.977% ( 250, 380 ] 34 0.014% 99.991% ( 380, 580 ] 14 0.006% 99.996% ( 580, 870 ] 7 0.003% 99.999% ( 870, 1300 ] 8 0.003% 100.002% ( 1300, 1900 ] 7 0.003% 100.005% ( 1900, 2900 ] 2 0.001% 100.006% ( 2900, 4400 ] 6 0.002% 100.008% ( 4400, 6600 ] 7 0.003% 100.011% ** Level 4 read latency histogram (micros): Count: 70 Average: 1591.3286 StdDev: 1833.72 Min: 1 Median: 250.0000 Max: 5762 Percentiles: P50: 250.00 P75: 3188.46 P99: 5762.00 P99.9: 5762.00 P99.99: 5762.00 ------------------------------------------------------ [ 0, 1 ] 10 14.286% 14.286% ### ( 1, 2 ] 12 17.143% 31.429% ### ( 6, 10 ] 1 1.429% 32.857% ( 34, 51 ] 1 1.429% 34.286% ( 110, 170 ] 6 8.571% 42.857% ## ( 170, 250 ] 5 7.143% 50.000% # ( 380, 580 ] 1 1.429% 51.429% ( 580, 870 ] 1 1.429% 52.857% ( 870, 1300 ] 3 4.286% 57.143% # ( 1300, 1900 ] 4 5.714% 62.857% # ( 1900, 2900 ] 6 8.571% 71.429% ## ( 2900, 4400 ] 13 18.571% 90.000% #### ( 4400, 6600 ] 7 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 12.5 total, 3.3 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 314.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.799 H:M:S, 6.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 293.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.432 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 4.364 micros/op 229152 ops/sec 20.174 seconds 4622999 operations; 222.0 MB/s Microseconds per write: Count: 4622999 Average: 4.3639 StdDev: 130.56 Min: 1 Median: 1.8048 Max: 193332 Percentiles: P50: 1.80 P75: 3.11 P99: 9.07 P99.9: 185.42 P99.99: 2601.17 ------------------------------------------------------ [ 0, 1 ] 527819 11.417% 11.417% ## ( 1, 2 ] 2216248 47.940% 59.357% ########## ( 2, 3 ] 655642 14.182% 73.539% ### ( 3, 4 ] 632459 13.681% 87.220% ### ( 4, 6 ] 495985 10.729% 97.948% ## ( 6, 10 ] 63412 1.372% 99.320% ( 10, 15 ] 15932 0.345% 99.665% ( 15, 22 ] 4960 0.107% 99.772% ( 22, 34 ] 1300 0.028% 99.800% ( 34, 51 ] 255 0.006% 99.806% ( 51, 76 ] 40 0.001% 99.806% ( 76, 110 ] 3 0.000% 99.807% ( 110, 170 ] 4252 0.092% 99.899% ( 170, 250 ] 358 0.008% 99.906% ( 250, 380 ] 73 0.002% 99.908% ( 380, 580 ] 15 0.000% 99.908% ( 580, 870 ] 5 0.000% 99.908% ( 870, 1300 ] 2697 0.058% 99.967% ( 1300, 1900 ] 4 0.000% 99.967% ( 1900, 2900 ] 1537 0.033% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 170000, 250000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 171029 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4622999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4770934968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 146 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 6522804 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 9418048049 rocksdb.compact.write.bytes COUNT : 9252467557 rocksdb.flush.write.bytes COUNT : 4749395314 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 11 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 67 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4717807616 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7968768 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 9455861614 rocksdb.non.last.level.read.count COUNT : 2286245 rocksdb.block.checksum.compute.count COUNT : 2285964 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.482560 P95 : 4.906445 P99 : 7.835009 P100 : 193329.000000 COUNT : 4622999 SUM : 18062746 rocksdb.compaction.times.micros P50 : 984666.666667 P95 : 1795000.000000 P99 : 2960301.000000 P100 : 2960301.000000 COUNT : 23 SUM : 23631109 rocksdb.compaction.times.cpu_micros P50 : 984666.666667 P95 : 1795000.000000 P99 : 2670000.000000 P100 : 2833605.000000 COUNT : 23 SUM : 23064937 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 557.777778 P95 : 1227.000000 P99 : 1227.000000 P100 : 1227.000000 COUNT : 70 SUM : 47876 rocksdb.compaction.outfile.sync.micros P50 : 671.951220 P95 : 1214.000000 P99 : 1392.000000 P100 : 1392.000000 COUNT : 80 SUM : 55171 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 85.562500 P95 : 255.200000 P99 : 321.000000 P100 : 321.000000 COUNT : 96 SUM : 10270 rocksdb.table.open.io.micros P50 : 775.844156 P95 : 14700.000000 P99 : 17774.000000 P100 : 17774.000000 COUNT : 146 SUM : 339818 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.651757 P95 : 7.523652 P99 : 14.017875 P100 : 1205.000000 COUNT : 2285745 SUM : 12501783 rocksdb.read.block.get.micros P50 : 360.614035 P95 : 3636.363636 P99 : 5875.000000 P100 : 5875.000000 COUNT : 292 SUM : 216766 rocksdb.write.raw.block.micros P50 : 0.513023 P95 : 0.974743 P99 : 2.947174 P100 : 5992.000000 COUNT : 3393485 SUM : 6364727 rocksdb.numfiles.in.singlecompaction P50 : 3.392857 P95 : 9.533333 P99 : 12.000000 P100 : 12.000000 COUNT : 27 SUM : 113 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.571764 P95 : 1271.415587 P99 : 2677.677293 P100 : 193113.000000 COUNT : 34371 SUM : 6527392 rocksdb.sst.read.micros P50 : 1.602499 P95 : 4.161445 P99 : 9.737073 P100 : 5762.000000 COUNT : 2286578 SUM : 7888127 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4622999 SUM : 4770934968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 187560.975610 P95 : 249024.390244 P99 : 349666.666667 P100 : 359058.000000 COUNT : 70 SUM : 12675544 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 90 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0