[2024-11-20 07:04:17.964081] Starting SPDK v25.01-pre git sha1 6745f139b / DPDK 24.03.0 initialization... [2024-11-20 07:04:17.964206] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid959775 ] Set seed to 1732082657961424 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 07:04:18.105570] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 07:04:18.209291] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 07:04:18.209350] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 959775' to capture a snapshot of events at runtime. [2024-11-20 07:04:18.209363] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 07:04:18.209377] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 07:04:18.209386] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid959775 for offline analysis/debug. [2024-11-20 07:04:18.210616] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 07:04:21 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/20-07:04:24 ... thread 0: (1000000,1000000) ops and (328853.8,328853.8) ops/second in (3.040865,3.040865) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 692.04 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 341.3 2.58 2.41 13 0.198 0 0 0.0 0.0 L2 3/2 222.57 MB 0.4 0.3 0.2 0.1 0.3 0.2 0.0 1.7 231.9 231.4 1.38 1.33 2 0.692 325K 732 0.0 0.0 L3 11/0 881.91 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 120/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 112/0 8.74 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 257/11 20.09 GB 0.0 0.3 0.2 0.1 1.2 1.0 0.0 1.4 81.0 302.9 3.96 3.74 15 0.264 325K 732 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.1 1.2 1.0 0.0 1.4 81.0 302.9 3.96 3.74 15 0.264 325K 732 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 0.0 231.9 231.4 1.38 1.33 2 0.692 325K 732 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 341.3 2.58 2.41 13 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 382.86 MB/s write, 0.31 GB read, 102.33 MB/s read, 4.0 seconds Interval compaction: 1.17 GB write, 394.55 MB/s write, 0.31 GB read, 105.46 MB/s read, 4.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 139347 Average: 2.1161 StdDev: 5.93 Min: 1 Median: 1.4410 Max: 1507 Percentiles: P50: 1.44 P75: 1.84 P99: 5.83 P99.9: 13.17 P99.99: 70.16 ------------------------------------------------------ [ 0, 1 ] 31038 22.274% 22.274% #### ( 1, 2 ] 87612 62.873% 85.147% ############# ( 2, 3 ] 12569 9.020% 94.167% ## ( 3, 4 ] 4323 3.102% 97.269% # ( 4, 6 ] 2639 1.894% 99.163% ( 6, 10 ] 864 0.620% 99.783% ( 10, 15 ] 260 0.187% 99.970% ( 15, 22 ] 21 0.015% 99.985% ( 22, 34 ] 5 0.004% 99.989% ( 34, 51 ] 1 0.001% 99.989% ( 51, 76 ] 4 0.003% 99.992% ( 170, 250 ] 12 0.009% 100.001% ( 250, 380 ] 8 0.006% 100.006% ( 380, 580 ] 5 0.004% 100.010% ( 1300, 1900 ] 1 0.001% 100.011% ** Level 2 read latency histogram (micros): Count: 67592 Average: 2.2669 StdDev: 7.76 Min: 1 Median: 1.4513 Max: 1222 Percentiles: P50: 1.45 P75: 1.84 P99: 6.49 P99.9: 92.86 P99.99: 239.95 ------------------------------------------------------ [ 0, 1 ] 14219 21.037% 21.037% #### ( 1, 2 ] 43381 64.181% 85.217% ############# ( 2, 3 ] 5904 8.735% 93.952% ## ( 3, 4 ] 2036 3.012% 96.964% # ( 4, 6 ] 1316 1.947% 98.911% ( 6, 10 ] 512 0.757% 99.669% ( 10, 15 ] 125 0.185% 99.854% ( 15, 22 ] 17 0.025% 99.879% ( 22, 34 ] 3 0.004% 99.883% ( 51, 76 ] 2 0.003% 99.886% ( 76, 110 ] 23 0.034% 99.920% ( 110, 170 ] 37 0.055% 99.975% ( 170, 250 ] 14 0.021% 99.996% ( 250, 380 ] 1 0.001% 99.997% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 2 0.003% 100.001% ( 870, 1300 ] 1 0.001% 100.003% ** Level 3 read latency histogram (micros): Count: 55 Average: 2464.4727 StdDev: 1842.11 Min: 107 Median: 2127.2727 Max: 7057 Percentiles: P50: 2127.27 P75: 3775.00 P99: 7057.00 P99.9: 7057.00 P99.99: 7057.00 ------------------------------------------------------ ( 76, 110 ] 1 1.818% 1.818% ( 170, 250 ] 1 1.818% 3.636% ( 250, 380 ] 2 3.636% 7.273% # ( 380, 580 ] 6 10.909% 18.182% ## ( 580, 870 ] 5 9.091% 27.273% ## ( 870, 1300 ] 4 7.273% 34.545% # ( 1300, 1900 ] 6 10.909% 45.455% ## ( 1900, 2900 ] 11 20.000% 65.455% #### ( 2900, 4400 ] 9 16.364% 81.818% ### ( 4400, 6600 ] 9 16.364% 98.182% ### ( 6600, 9900 ] 1 1.818% 100.000% ** Level 4 read latency histogram (micros): Count: 20 Average: 3439.2000 StdDev: 1269.52 Min: 1521 Median: 3150.0000 Max: 6025 Percentiles: P50: 3150.00 P75: 4400.00 P99: 6025.00 P99.9: 6025.00 P99.99: 6025.00 ------------------------------------------------------ ( 1300, 1900 ] 2 10.000% 10.000% ## ( 1900, 2900 ] 7 35.000% 45.000% ####### ( 2900, 4400 ] 6 30.000% 75.000% ###### ( 4400, 6600 ] 5 25.000% 100.000% ##### ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 313.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.211 H:M:S, 6.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.211 H:M:S, 6.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/20-07:04:27 ... thread 0: (1000000,2000000) ops and (324351.3,326587.0) ops/second in (3.083077,6.123942) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.29 GB 18.9 0.7 0.0 0.7 2.5 1.8 0.0 1.4 90.1 307.2 8.38 7.95 30 0.279 766K 3738 0.0 0.0 L1 0/0 0.00 KB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 230.9 229.4 1.36 1.34 1 1.362 319K 2067 0.0 0.0 L2 2/1 142.28 MB 0.9 0.4 0.2 0.2 0.4 0.2 0.3 1.9 227.3 226.5 1.67 1.60 3 0.556 384K 1443 0.0 0.0 L3 15/7 872.80 MB 0.3 0.3 0.3 0.1 0.3 0.3 0.1 1.2 225.2 224.6 1.45 1.41 2 0.727 332K 826 0.0 0.0 L4 126/0 9.68 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 212.4 212.4 0.40 0.39 1 0.402 86K 0 0.0 0.0 L5 116/0 9.04 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 270/16 21.00 GB 0.0 1.8 0.8 1.0 3.6 2.6 1.2 2.0 140.3 277.1 13.27 12.69 37 0.359 1890K 8074 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.8 1.0 3.6 2.6 1.2 2.0 140.3 277.1 13.27 12.69 37 0.359 1890K 8074 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.8 1.0 1.8 0.8 0.0 0.0 233.7 232.6 7.96 7.76 10 0.796 1890K 8074 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 344.0 5.30 4.93 27 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.1 interval Flush(GB): cumulative 1.781, interval 1.781 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.59 GB write, 591.23 MB/s write, 1.82 GB read, 299.27 MB/s read, 13.3 seconds Interval compaction: 3.59 GB write, 600.20 MB/s write, 1.82 GB read, 303.80 MB/s read, 13.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 358507 Average: 2.3640 StdDev: 7.27 Min: 1 Median: 1.5664 Max: 1646 Percentiles: P50: 1.57 P75: 1.95 P99: 6.39 P99.9: 14.16 P99.99: 167.15 ------------------------------------------------------ [ 0, 1 ] 48233 13.454% 13.454% ### ( 1, 2 ] 231314 64.521% 77.975% ############# ( 2, 3 ] 50593 14.112% 92.087% ### ( 3, 4 ] 14691 4.098% 96.185% # ( 4, 6 ] 9823 2.740% 98.925% # ( 6, 10 ] 2764 0.771% 99.696% ( 10, 15 ] 878 0.245% 99.941% ( 15, 22 ] 91 0.025% 99.967% ( 22, 34 ] 12 0.003% 99.970% ( 34, 51 ] 4 0.001% 99.971% ( 51, 76 ] 5 0.001% 99.972% ( 76, 110 ] 6 0.002% 99.974% ( 110, 170 ] 60 0.017% 99.991% ( 170, 250 ] 44 0.012% 100.003% ( 250, 380 ] 16 0.004% 100.008% ( 380, 580 ] 17 0.005% 100.012% ( 580, 870 ] 1 0.000% 100.013% ( 870, 1300 ] 6 0.002% 100.014% ( 1300, 1900 ] 2 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 25069 Average: 2.6641 StdDev: 7.38 Min: 1 Median: 1.7032 Max: 768 Percentiles: P50: 1.70 P75: 2.36 P99: 8.73 P99.9: 15.38 P99.99: 314.70 ------------------------------------------------------ [ 0, 1 ] 1625 6.482% 6.482% # ( 1, 2 ] 15513 61.881% 68.363% ############ ( 2, 3 ] 4564 18.206% 86.569% #### ( 3, 4 ] 1620 6.462% 93.031% # ( 4, 6 ] 1246 4.970% 98.002% # ( 6, 10 ] 367 1.464% 99.465% ( 10, 15 ] 108 0.431% 99.896% ( 15, 22 ] 17 0.068% 99.964% ( 22, 34 ] 2 0.008% 99.972% ( 34, 51 ] 3 0.012% 99.984% ( 250, 380 ] 3 0.012% 99.996% ( 380, 580 ] 2 0.008% 100.004% ( 580, 870 ] 1 0.004% 100.008% ** Level 2 read latency histogram (micros): Count: 95224 Average: 2.3832 StdDev: 6.73 Min: 1 Median: 1.5355 Max: 1222 Percentiles: P50: 1.54 P75: 1.93 P99: 7.57 P99.9: 20.19 P99.99: 231.21 ------------------------------------------------------ [ 0, 1 ] 15429 16.203% 16.203% ### ( 1, 2 ] 60104 63.119% 79.321% ############# ( 2, 3 ] 11400 11.972% 91.293% ## ( 3, 4 ] 3951 4.149% 95.442% # ( 4, 6 ] 3009 3.160% 98.602% # ( 6, 10 ] 966 1.014% 99.617% ( 10, 15 ] 249 0.261% 99.878% ( 15, 22 ] 28 0.029% 99.908% ( 22, 34 ] 5 0.005% 99.913% ( 51, 76 ] 2 0.002% 99.915% ( 76, 110 ] 23 0.024% 99.939% ( 110, 170 ] 37 0.039% 99.978% ( 170, 250 ] 15 0.016% 99.994% ( 250, 380 ] 2 0.002% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 156501 Average: 3.5146 StdDev: 58.06 Min: 0 Median: 1.6072 Max: 7057 Percentiles: P50: 1.61 P75: 1.99 P99: 9.13 P99.9: 150.69 P99.99: 2840.90 ------------------------------------------------------ [ 0, 1 ] 16464 10.520% 10.520% ## ( 1, 2 ] 101758 65.021% 75.541% ############# ( 2, 3 ] 23364 14.929% 90.470% ### ( 3, 4 ] 6686 4.272% 94.742% # ( 4, 6 ] 4527 2.893% 97.635% # ( 6, 10 ] 2733 1.746% 99.381% ( 10, 15 ] 411 0.263% 99.643% ( 15, 22 ] 42 0.027% 99.670% ( 22, 34 ] 7 0.004% 99.675% ( 34, 51 ] 185 0.118% 99.793% ( 51, 76 ] 69 0.044% 99.837% ( 76, 110 ] 30 0.019% 99.856% ( 110, 170 ] 101 0.065% 99.921% ( 170, 250 ] 57 0.036% 99.957% ( 250, 380 ] 14 0.009% 99.966% ( 380, 580 ] 11 0.007% 99.973% ( 580, 870 ] 6 0.004% 99.977% ( 870, 1300 ] 4 0.003% 99.980% ( 1300, 1900 ] 6 0.004% 99.983% ( 1900, 2900 ] 11 0.007% 99.990% ( 2900, 4400 ] 9 0.006% 99.996% ( 4400, 6600 ] 9 0.006% 100.002% ( 6600, 9900 ] 1 0.001% 100.003% ** Level 4 read latency histogram (micros): Count: 50 Average: 1383.3800 StdDev: 1860.78 Min: 0 Median: 22.0000 Max: 6025 Percentiles: P50: 22.00 P75: 2685.71 P99: 6025.00 P99.9: 6025.00 P99.99: 6025.00 ------------------------------------------------------ [ 0, 1 ] 5 10.000% 10.000% ## ( 1, 2 ] 10 20.000% 30.000% #### ( 2, 3 ] 3 6.000% 36.000% # ( 4, 6 ] 2 4.000% 40.000% # ( 6, 10 ] 2 4.000% 44.000% # ( 10, 15 ] 2 4.000% 48.000% # ( 15, 22 ] 1 2.000% 50.000% ( 51, 76 ] 5 10.000% 60.000% ## ( 1300, 1900 ] 2 4.000% 64.000% # ( 1900, 2900 ] 7 14.000% 78.000% ### ( 2900, 4400 ] 6 12.000% 90.000% ## ( 4400, 6600 ] 5 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 485.2500 StdDev: 513.69 Min: 127 Median: 250.0000 Max: 2110 Percentiles: P50: 250.00 P75: 580.00 P99: 2110.00 P99.9: 2110.00 P99.99: 2110.00 ------------------------------------------------------ ( 110, 170 ] 9 45.000% 45.000% ######### ( 170, 250 ] 1 5.000% 50.000% # ( 250, 380 ] 3 15.000% 65.000% ### ( 380, 580 ] 2 10.000% 75.000% ## ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.2 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 316.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.426 H:M:S, 6.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.214 H:M:S, 6.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-07:04:30 ... thread 0: (1000000,3000000) ops and (311493.8,321396.0) ops/second in (3.210337,9.334279) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 2.33 GB 100.2 1.5 0.0 1.5 4.4 2.8 0.0 1.5 106.8 302.8 14.72 13.99 49 0.300 1596K 8069 0.0 0.0 L1 0/0 0.00 KB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 230.9 229.4 1.36 1.34 1 1.362 319K 2067 0.0 0.0 L2 1/0 85.01 MB 0.9 0.4 0.2 0.2 0.4 0.2 0.3 1.9 227.3 226.5 1.67 1.60 3 0.556 384K 1443 0.0 0.0 L3 13/0 915.69 MB 0.9 0.9 0.3 0.6 0.9 0.3 0.1 2.9 227.8 224.1 4.18 4.04 3 1.393 966K 15K 0.0 0.0 L4 126/0 9.68 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 212.4 212.4 0.40 0.39 1 0.402 86K 0 0.0 0.0 L5 116/0 9.04 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 274/12 22.03 GB 0.0 3.2 0.9 2.3 6.0 3.7 1.2 2.1 147.9 276.3 22.33 21.36 57 0.392 3354K 27K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.2 0.9 2.3 6.0 3.7 1.2 2.1 147.9 276.3 22.33 21.36 57 0.392 3354K 27K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.2 0.9 2.3 3.2 0.9 0.0 0.0 236.0 234.1 13.99 13.62 14 1.000 3354K 27K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 347.1 8.34 7.73 43 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.4 total, 9.3 interval Flush(GB): cumulative 2.825, interval 2.825 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.02 GB write, 654.26 MB/s write, 3.23 GB read, 350.29 MB/s read, 22.3 seconds Interval compaction: 6.02 GB write, 660.77 MB/s write, 3.23 GB read, 353.78 MB/s read, 22.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 4, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 777736 Average: 2.4480 StdDev: 7.10 Min: 1 Median: 1.6086 Max: 1646 Percentiles: P50: 1.61 P75: 1.99 P99: 7.04 P99.9: 14.00 P99.99: 135.31 ------------------------------------------------------ [ 0, 1 ] 81086 10.426% 10.426% ## ( 1, 2 ] 505694 65.021% 75.447% ############# ( 2, 3 ] 126133 16.218% 91.665% ### ( 3, 4 ] 32708 4.206% 95.871% # ( 4, 6 ] 22381 2.878% 98.748% # ( 6, 10 ] 7519 0.967% 99.715% ( 10, 15 ] 1798 0.231% 99.946% ( 15, 22 ] 169 0.022% 99.968% ( 22, 34 ] 25 0.003% 99.971% ( 34, 51 ] 7 0.001% 99.972% ( 51, 76 ] 10 0.001% 99.974% ( 76, 110 ] 29 0.004% 99.977% ( 110, 170 ] 240 0.031% 100.008% ( 170, 250 ] 84 0.011% 100.019% ( 250, 380 ] 42 0.005% 100.024% ( 380, 580 ] 35 0.005% 100.029% ( 580, 870 ] 7 0.001% 100.030% ( 870, 1300 ] 11 0.001% 100.031% ( 1300, 1900 ] 2 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 25069 Average: 2.6641 StdDev: 7.38 Min: 1 Median: 1.7032 Max: 768 Percentiles: P50: 1.70 P75: 2.36 P99: 8.73 P99.9: 15.38 P99.99: 314.70 ------------------------------------------------------ [ 0, 1 ] 1625 6.482% 6.482% # ( 1, 2 ] 15513 61.881% 68.363% ############ ( 2, 3 ] 4564 18.206% 86.569% #### ( 3, 4 ] 1620 6.462% 93.031% # ( 4, 6 ] 1246 4.970% 98.002% # ( 6, 10 ] 367 1.464% 99.465% ( 10, 15 ] 108 0.431% 99.896% ( 15, 22 ] 17 0.068% 99.964% ( 22, 34 ] 2 0.008% 99.972% ( 34, 51 ] 3 0.012% 99.984% ( 250, 380 ] 3 0.012% 99.996% ( 380, 580 ] 2 0.008% 100.004% ( 580, 870 ] 1 0.004% 100.008% ** Level 2 read latency histogram (micros): Count: 104726 Average: 2.4473 StdDev: 7.17 Min: 1 Median: 1.5534 Max: 1222 Percentiles: P50: 1.55 P75: 1.95 P99: 7.85 P99.9: 84.83 P99.99: 243.07 ------------------------------------------------------ [ 0, 1 ] 15733 15.023% 15.023% ### ( 1, 2 ] 66187 63.200% 78.223% ############# ( 2, 3 ] 13323 12.722% 90.945% ### ( 3, 4 ] 4514 4.310% 95.255% # ( 4, 6 ] 3375 3.223% 98.478% # ( 6, 10 ] 1180 1.127% 99.605% ( 10, 15 ] 266 0.254% 99.859% ( 15, 22 ] 28 0.027% 99.885% ( 22, 34 ] 5 0.005% 99.890% ( 51, 76 ] 3 0.003% 99.893% ( 76, 110 ] 28 0.027% 99.920% ( 110, 170 ] 58 0.055% 99.975% ( 170, 250 ] 17 0.016% 99.991% ( 250, 380 ] 3 0.003% 99.994% ( 380, 580 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 182071 Average: 3.4463 StdDev: 54.08 Min: 0 Median: 1.6231 Max: 7057 Percentiles: P50: 1.62 P75: 2.03 P99: 9.10 P99.9: 149.80 P99.99: 2608.45 ------------------------------------------------------ [ 0, 1 ] 17413 9.564% 9.564% ## ( 1, 2 ] 118149 64.892% 74.456% ############# ( 2, 3 ] 28478 15.641% 90.097% ### ( 3, 4 ] 8132 4.466% 94.563% # ( 4, 6 ] 5527 3.036% 97.599% # ( 6, 10 ] 3288 1.806% 99.405% ( 10, 15 ] 452 0.248% 99.653% ( 15, 22 ] 42 0.023% 99.676% ( 22, 34 ] 7 0.004% 99.680% ( 34, 51 ] 200 0.110% 99.790% ( 51, 76 ] 79 0.043% 99.833% ( 76, 110 ] 43 0.024% 99.857% ( 110, 170 ] 119 0.065% 99.922% ( 170, 250 ] 65 0.036% 99.958% ( 250, 380 ] 16 0.009% 99.966% ( 380, 580 ] 15 0.008% 99.975% ( 580, 870 ] 8 0.004% 99.979% ( 870, 1300 ] 6 0.003% 99.982% ( 1300, 1900 ] 6 0.003% 99.986% ( 1900, 2900 ] 11 0.006% 99.992% ( 2900, 4400 ] 9 0.005% 99.997% ( 4400, 6600 ] 9 0.005% 100.002% ( 6600, 9900 ] 1 0.001% 100.002% ** Level 4 read latency histogram (micros): Count: 50 Average: 1383.3800 StdDev: 1860.78 Min: 0 Median: 22.0000 Max: 6025 Percentiles: P50: 22.00 P75: 2685.71 P99: 6025.00 P99.9: 6025.00 P99.99: 6025.00 ------------------------------------------------------ [ 0, 1 ] 5 10.000% 10.000% ## ( 1, 2 ] 10 20.000% 30.000% #### ( 2, 3 ] 3 6.000% 36.000% # ( 4, 6 ] 2 4.000% 40.000% # ( 6, 10 ] 2 4.000% 44.000% # ( 10, 15 ] 2 4.000% 48.000% # ( 15, 22 ] 1 2.000% 50.000% ( 51, 76 ] 5 10.000% 60.000% ## ( 1300, 1900 ] 2 4.000% 64.000% # ( 1900, 2900 ] 7 14.000% 78.000% ### ( 2900, 4400 ] 6 12.000% 90.000% ## ( 4400, 6600 ] 5 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 485.2500 StdDev: 513.69 Min: 127 Median: 250.0000 Max: 2110 Percentiles: P50: 250.00 P75: 580.00 P99: 2110.00 P99.9: 2110.00 P99.99: 2110.00 ------------------------------------------------------ ( 110, 170 ] 9 45.000% 45.000% ######### ( 170, 250 ] 1 5.000% 50.000% # ( 250, 380 ] 3 15.000% 65.000% ### ( 380, 580 ] 2 10.000% 75.000% ## ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.4 total, 3.2 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 313.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.739 H:M:S, 7.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 306.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.313 H:M:S, 9.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/11/20-07:04:33 ... thread 0: (1000000,4000000) ops and (325754.7,322474.7) ops/second in (3.069795,12.404074) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.08 GB 187.8 2.5 0.0 2.5 6.2 3.7 0.0 1.7 120.7 296.7 21.37 20.37 67 0.319 2619K 12K 0.0 0.0 L1 11/0 1.08 GB 110.2 1.4 1.4 0.0 1.4 1.4 0.2 1.0 218.8 214.4 6.60 6.39 2 3.298 1465K 28K 0.0 0.0 L2 1/0 85.01 MB 0.9 0.4 0.2 0.2 0.4 0.2 0.3 1.9 227.3 226.5 1.67 1.60 3 0.556 384K 1443 0.0 0.0 L3 13/0 915.69 MB 0.9 0.9 0.3 0.6 0.9 0.3 0.1 2.9 227.8 224.1 4.18 4.04 3 1.393 966K 15K 0.0 0.0 L4 126/0 9.68 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 212.4 212.4 0.40 0.39 1 0.402 86K 0 0.0 0.0 L5 116/0 9.04 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 279/4 22.86 GB 0.0 5.3 2.0 3.3 8.9 5.6 1.2 2.4 158.9 267.5 34.21 32.78 76 0.450 5522K 58K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.3 2.0 3.3 8.9 5.6 1.2 2.4 158.9 267.5 34.21 32.78 76 0.450 5522K 58K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.3 2.0 3.3 5.3 1.9 0.0 0.0 233.1 230.6 23.33 22.68 19 1.228 5522K 58K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 346.7 10.89 10.11 57 0.191 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.5 total, 12.4 interval Flush(GB): cumulative 3.686, interval 3.686 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.94 GB write, 732.34 MB/s write, 5.31 GB read, 435.07 MB/s read, 34.2 seconds Interval compaction: 8.94 GB write, 737.82 MB/s write, 5.31 GB read, 438.33 MB/s read, 34.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 4, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1088392 Average: 2.4139 StdDev: 7.31 Min: 1 Median: 1.5860 Max: 1698 Percentiles: P50: 1.59 P75: 1.97 P99: 6.71 P99.9: 13.94 P99.99: 141.37 ------------------------------------------------------ [ 0, 1 ] 127474 11.712% 11.712% ## ( 1, 2 ] 711114 65.336% 77.048% ############# ( 2, 3 ] 165796 15.233% 92.281% ### ( 3, 4 ] 42835 3.936% 96.217% # ( 4, 6 ] 28562 2.624% 98.841% # ( 6, 10 ] 9793 0.900% 99.741% ( 10, 15 ] 2196 0.202% 99.943% ( 15, 22 ] 214 0.020% 99.963% ( 22, 34 ] 31 0.003% 99.965% ( 34, 51 ] 9 0.001% 99.966% ( 51, 76 ] 13 0.001% 99.967% ( 76, 110 ] 36 0.003% 99.971% ( 110, 170 ] 402 0.037% 100.008% ( 170, 250 ] 112 0.010% 100.018% ( 250, 380 ] 69 0.006% 100.024% ( 380, 580 ] 44 0.004% 100.028% ( 580, 870 ] 14 0.001% 100.030% ( 870, 1300 ] 14 0.001% 100.031% ( 1300, 1900 ] 3 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 25124 Average: 3.1831 StdDev: 22.89 Min: 1 Median: 1.7037 Max: 1895 Percentiles: P50: 1.70 P75: 2.37 P99: 9.03 P99.9: 136.28 P99.99: 748.57 ------------------------------------------------------ [ 0, 1 ] 1634 6.504% 6.504% # ( 1, 2 ] 15529 61.809% 68.313% ############ ( 2, 3 ] 4566 18.174% 86.487% #### ( 3, 4 ] 1620 6.448% 92.935% # ( 4, 6 ] 1246 4.959% 97.894% # ( 6, 10 ] 367 1.461% 99.355% ( 10, 15 ] 108 0.430% 99.785% ( 15, 22 ] 18 0.072% 99.857% ( 22, 34 ] 2 0.008% 99.865% ( 34, 51 ] 4 0.016% 99.881% ( 76, 110 ] 4 0.016% 99.897% ( 110, 170 ] 2 0.008% 99.904% ( 170, 250 ] 3 0.012% 99.916% ( 250, 380 ] 6 0.024% 99.940% ( 380, 580 ] 9 0.036% 99.976% ( 580, 870 ] 6 0.024% 100.000% ( 1300, 1900 ] 2 0.008% 100.008% ** Level 2 read latency histogram (micros): Count: 104726 Average: 2.4473 StdDev: 7.17 Min: 1 Median: 1.5534 Max: 1222 Percentiles: P50: 1.55 P75: 1.95 P99: 7.85 P99.9: 84.83 P99.99: 243.07 ------------------------------------------------------ [ 0, 1 ] 15733 15.023% 15.023% ### ( 1, 2 ] 66187 63.200% 78.223% ############# ( 2, 3 ] 13323 12.722% 90.945% ### ( 3, 4 ] 4514 4.310% 95.255% # ( 4, 6 ] 3375 3.223% 98.478% # ( 6, 10 ] 1180 1.127% 99.605% ( 10, 15 ] 266 0.254% 99.859% ( 15, 22 ] 28 0.027% 99.885% ( 22, 34 ] 5 0.005% 99.890% ( 51, 76 ] 3 0.003% 99.893% ( 76, 110 ] 28 0.027% 99.920% ( 110, 170 ] 58 0.055% 99.975% ( 170, 250 ] 17 0.016% 99.991% ( 250, 380 ] 3 0.003% 99.994% ( 380, 580 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 182071 Average: 3.4463 StdDev: 54.08 Min: 0 Median: 1.6231 Max: 7057 Percentiles: P50: 1.62 P75: 2.03 P99: 9.10 P99.9: 149.80 P99.99: 2608.45 ------------------------------------------------------ [ 0, 1 ] 17413 9.564% 9.564% ## ( 1, 2 ] 118149 64.892% 74.456% ############# ( 2, 3 ] 28478 15.641% 90.097% ### ( 3, 4 ] 8132 4.466% 94.563% # ( 4, 6 ] 5527 3.036% 97.599% # ( 6, 10 ] 3288 1.806% 99.405% ( 10, 15 ] 452 0.248% 99.653% ( 15, 22 ] 42 0.023% 99.676% ( 22, 34 ] 7 0.004% 99.680% ( 34, 51 ] 200 0.110% 99.790% ( 51, 76 ] 79 0.043% 99.833% ( 76, 110 ] 43 0.024% 99.857% ( 110, 170 ] 119 0.065% 99.922% ( 170, 250 ] 65 0.036% 99.958% ( 250, 380 ] 16 0.009% 99.966% ( 380, 580 ] 15 0.008% 99.975% ( 580, 870 ] 8 0.004% 99.979% ( 870, 1300 ] 6 0.003% 99.982% ( 1300, 1900 ] 6 0.003% 99.986% ( 1900, 2900 ] 11 0.006% 99.992% ( 2900, 4400 ] 9 0.005% 99.997% ( 4400, 6600 ] 9 0.005% 100.002% ( 6600, 9900 ] 1 0.001% 100.002% ** Level 4 read latency histogram (micros): Count: 50 Average: 1383.3800 StdDev: 1860.78 Min: 0 Median: 22.0000 Max: 6025 Percentiles: P50: 22.00 P75: 2685.71 P99: 6025.00 P99.9: 6025.00 P99.99: 6025.00 ------------------------------------------------------ [ 0, 1 ] 5 10.000% 10.000% ## ( 1, 2 ] 10 20.000% 30.000% #### ( 2, 3 ] 3 6.000% 36.000% # ( 4, 6 ] 2 4.000% 40.000% # ( 6, 10 ] 2 4.000% 44.000% # ( 10, 15 ] 2 4.000% 48.000% # ( 15, 22 ] 1 2.000% 50.000% ( 51, 76 ] 5 10.000% 60.000% ## ( 1300, 1900 ] 2 4.000% 64.000% # ( 1900, 2900 ] 7 14.000% 78.000% ### ( 2900, 4400 ] 6 12.000% 90.000% ## ( 4400, 6600 ] 5 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 485.2500 StdDev: 513.69 Min: 127 Median: 250.0000 Max: 2110 Percentiles: P50: 250.00 P75: 580.00 P99: 2110.00 P99.9: 2110.00 P99.99: 2110.00 ------------------------------------------------------ ( 110, 170 ] 9 45.000% 45.000% ######### ( 170, 250 ] 1 5.000% 50.000% # ( 250, 380 ] 3 15.000% 65.000% ### ( 380, 580 ] 2 10.000% 75.000% ## ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.5 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 314.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.962 H:M:S, 7.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.224 H:M:S, 7.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-07:04:36 ... thread 0: (1000000,5000000) ops and (334423.9,324795.7) ops/second in (2.990217,15.394291) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 3.06 GB 262.8 3.3 0.0 3.3 8.0 4.7 0.0 1.7 124.2 298.3 27.36 26.11 85 0.322 3449K 17K 0.0 0.0 L1 11/0 1.08 GB 110.2 1.4 1.4 0.0 1.4 1.4 0.2 1.0 218.8 214.4 6.60 6.39 2 3.298 1465K 28K 0.0 0.0 L2 1/0 85.01 MB 0.9 0.4 0.2 0.2 0.4 0.2 0.3 1.9 227.3 226.5 1.67 1.60 3 0.556 384K 1443 0.0 0.0 L3 13/0 915.69 MB 0.9 0.9 0.3 0.6 0.9 0.3 0.1 2.9 227.8 224.1 4.18 4.04 3 1.393 966K 15K 0.0 0.0 L4 126/0 9.68 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 212.4 212.4 0.40 0.39 1 0.402 86K 0 0.0 0.0 L5 116/0 9.04 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 285/8 23.83 GB 0.0 6.1 2.0 4.1 10.7 6.6 1.2 2.3 155.6 273.0 40.20 38.53 94 0.428 6353K 62K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.1 2.0 4.1 10.7 6.6 1.2 2.3 155.6 273.0 40.20 38.53 94 0.428 6353K 62K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.1 2.0 4.1 6.0 1.9 0.0 0.0 235.6 233.2 26.55 25.85 22 1.207 6353K 62K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 350.3 13.65 12.68 72 0.190 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.5 total, 15.4 interval Flush(GB): cumulative 4.668, interval 4.668 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.72 GB write, 708.44 MB/s write, 6.11 GB read, 403.87 MB/s read, 40.2 seconds Interval compaction: 10.72 GB write, 712.71 MB/s write, 6.11 GB read, 406.30 MB/s read, 40.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 6, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1334963 Average: 2.3480 StdDev: 7.10 Min: 0 Median: 1.5571 Max: 1698 Percentiles: P50: 1.56 P75: 1.94 P99: 6.34 P99.9: 13.78 P99.99: 139.18 ------------------------------------------------------ [ 0, 1 ] 180196 13.498% 13.498% ### ( 1, 2 ] 874730 65.525% 79.023% ############# ( 2, 3 ] 186376 13.961% 92.984% ### ( 3, 4 ] 48367 3.623% 96.607% # ( 4, 6 ] 31028 2.324% 98.931% ( 6, 10 ] 10925 0.818% 99.750% ( 10, 15 ] 2657 0.199% 99.949% ( 15, 22 ] 256 0.019% 99.968% ( 22, 34 ] 38 0.003% 99.971% ( 34, 51 ] 10 0.001% 99.972% ( 51, 76 ] 16 0.001% 99.973% ( 76, 110 ] 36 0.003% 99.975% ( 110, 170 ] 402 0.030% 100.006% ( 170, 250 ] 126 0.009% 100.015% ( 250, 380 ] 76 0.006% 100.021% ( 380, 580 ] 52 0.004% 100.025% ( 580, 870 ] 16 0.001% 100.026% ( 870, 1300 ] 19 0.001% 100.027% ( 1300, 1900 ] 3 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 25124 Average: 3.1831 StdDev: 22.89 Min: 1 Median: 1.7037 Max: 1895 Percentiles: P50: 1.70 P75: 2.37 P99: 9.03 P99.9: 136.28 P99.99: 748.57 ------------------------------------------------------ [ 0, 1 ] 1634 6.504% 6.504% # ( 1, 2 ] 15529 61.809% 68.313% ############ ( 2, 3 ] 4566 18.174% 86.487% #### ( 3, 4 ] 1620 6.448% 92.935% # ( 4, 6 ] 1246 4.959% 97.894% # ( 6, 10 ] 367 1.461% 99.355% ( 10, 15 ] 108 0.430% 99.785% ( 15, 22 ] 18 0.072% 99.857% ( 22, 34 ] 2 0.008% 99.865% ( 34, 51 ] 4 0.016% 99.881% ( 76, 110 ] 4 0.016% 99.897% ( 110, 170 ] 2 0.008% 99.904% ( 170, 250 ] 3 0.012% 99.916% ( 250, 380 ] 6 0.024% 99.940% ( 380, 580 ] 9 0.036% 99.976% ( 580, 870 ] 6 0.024% 100.000% ( 1300, 1900 ] 2 0.008% 100.008% ** Level 2 read latency histogram (micros): Count: 104726 Average: 2.4473 StdDev: 7.17 Min: 1 Median: 1.5534 Max: 1222 Percentiles: P50: 1.55 P75: 1.95 P99: 7.85 P99.9: 84.83 P99.99: 243.07 ------------------------------------------------------ [ 0, 1 ] 15733 15.023% 15.023% ### ( 1, 2 ] 66187 63.200% 78.223% ############# ( 2, 3 ] 13323 12.722% 90.945% ### ( 3, 4 ] 4514 4.310% 95.255% # ( 4, 6 ] 3375 3.223% 98.478% # ( 6, 10 ] 1180 1.127% 99.605% ( 10, 15 ] 266 0.254% 99.859% ( 15, 22 ] 28 0.027% 99.885% ( 22, 34 ] 5 0.005% 99.890% ( 51, 76 ] 3 0.003% 99.893% ( 76, 110 ] 28 0.027% 99.920% ( 110, 170 ] 58 0.055% 99.975% ( 170, 250 ] 17 0.016% 99.991% ( 250, 380 ] 3 0.003% 99.994% ( 380, 580 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 182071 Average: 3.4463 StdDev: 54.08 Min: 0 Median: 1.6231 Max: 7057 Percentiles: P50: 1.62 P75: 2.03 P99: 9.10 P99.9: 149.80 P99.99: 2608.45 ------------------------------------------------------ [ 0, 1 ] 17413 9.564% 9.564% ## ( 1, 2 ] 118149 64.892% 74.456% ############# ( 2, 3 ] 28478 15.641% 90.097% ### ( 3, 4 ] 8132 4.466% 94.563% # ( 4, 6 ] 5527 3.036% 97.599% # ( 6, 10 ] 3288 1.806% 99.405% ( 10, 15 ] 452 0.248% 99.653% ( 15, 22 ] 42 0.023% 99.676% ( 22, 34 ] 7 0.004% 99.680% ( 34, 51 ] 200 0.110% 99.790% ( 51, 76 ] 79 0.043% 99.833% ( 76, 110 ] 43 0.024% 99.857% ( 110, 170 ] 119 0.065% 99.922% ( 170, 250 ] 65 0.036% 99.958% ( 250, 380 ] 16 0.009% 99.966% ( 380, 580 ] 15 0.008% 99.975% ( 580, 870 ] 8 0.004% 99.979% ( 870, 1300 ] 6 0.003% 99.982% ( 1300, 1900 ] 6 0.003% 99.986% ( 1900, 2900 ] 11 0.006% 99.992% ( 2900, 4400 ] 9 0.005% 99.997% ( 4400, 6600 ] 9 0.005% 100.002% ( 6600, 9900 ] 1 0.001% 100.002% ** Level 4 read latency histogram (micros): Count: 50 Average: 1383.3800 StdDev: 1860.78 Min: 0 Median: 22.0000 Max: 6025 Percentiles: P50: 22.00 P75: 2685.71 P99: 6025.00 P99.9: 6025.00 P99.99: 6025.00 ------------------------------------------------------ [ 0, 1 ] 5 10.000% 10.000% ## ( 1, 2 ] 10 20.000% 30.000% #### ( 2, 3 ] 3 6.000% 36.000% # ( 4, 6 ] 2 4.000% 40.000% # ( 6, 10 ] 2 4.000% 44.000% # ( 10, 15 ] 2 4.000% 48.000% # ( 15, 22 ] 1 2.000% 50.000% ( 51, 76 ] 5 10.000% 60.000% ## ( 1300, 1900 ] 2 4.000% 64.000% # ( 1900, 2900 ] 7 14.000% 78.000% ### ( 2900, 4400 ] 6 12.000% 90.000% ## ( 4400, 6600 ] 5 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 485.2500 StdDev: 513.69 Min: 127 Median: 250.0000 Max: 2110 Percentiles: P50: 250.00 P75: 580.00 P99: 2110.00 P99.9: 2110.00 P99.99: 2110.00 ------------------------------------------------------ ( 110, 170 ] 9 45.000% 45.000% ######### ( 170, 250 ] 1 5.000% 50.000% # ( 250, 380 ] 3 15.000% 65.000% ### ( 380, 580 ] 2 10.000% 75.000% ## ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.5 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 317.69 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.154 H:M:S, 7.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.192 H:M:S, 6.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-07:04:40 ... thread 0: (1000000,6000000) ops and (268151.6,313749.7) ops/second in (3.729234,19.123525) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/18 4.04 GB 6.3 4.5 0.0 4.5 10.2 5.6 0.0 1.8 132.0 295.5 35.26 33.71 106 0.333 4727K 23K 0.0 0.0 L1 11/11 1.08 GB 0.0 1.4 1.4 0.0 1.4 1.4 0.2 1.0 218.8 214.4 6.60 6.39 2 3.298 1465K 28K 0.0 0.0 L2 1/0 85.01 MB 0.9 0.4 0.2 0.2 0.4 0.2 0.3 1.9 227.3 226.5 1.67 1.60 3 0.556 384K 1443 0.0 0.0 L3 13/0 915.69 MB 0.9 0.9 0.3 0.6 0.9 0.3 0.1 2.9 227.8 224.1 4.18 4.04 3 1.393 966K 15K 0.0 0.0 L4 126/0 9.68 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 212.4 212.4 0.40 0.39 1 0.402 86K 0 0.0 0.0 L5 116/0 9.04 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 286/29 24.81 GB 0.0 7.3 2.0 5.3 12.9 7.6 1.2 2.3 156.2 275.1 48.10 46.13 115 0.418 7630K 68K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.3 2.0 5.3 12.9 7.6 1.2 2.3 156.2 275.1 48.10 46.13 115 0.418 7630K 68K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.3 2.0 5.3 7.3 1.9 0.0 0.0 237.7 235.5 31.61 30.82 27 1.171 7630K 68K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 350.9 16.49 15.31 88 0.187 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.2 total, 19.1 interval Flush(GB): cumulative 5.652, interval 5.652 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.92 GB write, 688.50 MB/s write, 7.34 GB read, 390.97 MB/s read, 48.1 seconds Interval compaction: 12.92 GB write, 691.84 MB/s write, 7.34 GB read, 392.87 MB/s read, 48.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 6, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1610701 Average: 2.3512 StdDev: 7.54 Min: 0 Median: 1.5321 Max: 1698 Percentiles: P50: 1.53 P75: 1.91 P99: 6.19 P99.9: 14.65 P99.99: 159.78 ------------------------------------------------------ [ 0, 1 ] 242892 15.080% 15.080% ### ( 1, 2 ] 1057139 65.632% 80.712% ############# ( 2, 3 ] 206209 12.802% 93.515% ### ( 3, 4 ] 54277 3.370% 96.884% # ( 4, 6 ] 33492 2.079% 98.964% ( 6, 10 ] 12221 0.759% 99.722% ( 10, 15 ] 3075 0.191% 99.913% ( 15, 22 ] 297 0.018% 99.932% ( 22, 34 ] 42 0.003% 99.934% ( 34, 51 ] 11 0.001% 99.935% ( 51, 76 ] 18 0.001% 99.936% ( 76, 110 ] 121 0.008% 99.944% ( 110, 170 ] 899 0.056% 100.000% ( 170, 250 ] 189 0.012% 100.011% ( 250, 380 ] 98 0.006% 100.017% ( 380, 580 ] 58 0.004% 100.021% ( 580, 870 ] 24 0.001% 100.022% ( 870, 1300 ] 21 0.001% 100.024% ( 1300, 1900 ] 3 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 29269 Average: 3.3423 StdDev: 22.21 Min: 1 Median: 1.6680 Max: 1895 Percentiles: P50: 1.67 P75: 2.28 P99: 9.52 P99.9: 168.38 P99.99: 728.53 ------------------------------------------------------ [ 0, 1 ] 2545 8.695% 8.695% ## ( 1, 2 ] 18097 61.830% 70.525% ############ ( 2, 3 ] 4728 16.154% 86.679% ### ( 3, 4 ] 1886 6.444% 93.122% # ( 4, 6 ] 1345 4.595% 97.718% # ( 6, 10 ] 426 1.455% 99.173% ( 10, 15 ] 122 0.417% 99.590% ( 15, 22 ] 19 0.065% 99.655% ( 22, 34 ] 2 0.007% 99.662% ( 34, 51 ] 4 0.014% 99.675% ( 51, 76 ] 1 0.003% 99.679% ( 76, 110 ] 19 0.065% 99.744% ( 110, 170 ] 47 0.161% 99.904% ( 170, 250 ] 7 0.024% 99.928% ( 250, 380 ] 6 0.020% 99.949% ( 380, 580 ] 9 0.031% 99.980% ( 580, 870 ] 6 0.020% 100.000% ( 1300, 1900 ] 2 0.007% 100.007% ** Level 2 read latency histogram (micros): Count: 104726 Average: 2.4473 StdDev: 7.17 Min: 1 Median: 1.5534 Max: 1222 Percentiles: P50: 1.55 P75: 1.95 P99: 7.85 P99.9: 84.83 P99.99: 243.07 ------------------------------------------------------ [ 0, 1 ] 15733 15.023% 15.023% ### ( 1, 2 ] 66187 63.200% 78.223% ############# ( 2, 3 ] 13323 12.722% 90.945% ### ( 3, 4 ] 4514 4.310% 95.255% # ( 4, 6 ] 3375 3.223% 98.478% # ( 6, 10 ] 1180 1.127% 99.605% ( 10, 15 ] 266 0.254% 99.859% ( 15, 22 ] 28 0.027% 99.885% ( 22, 34 ] 5 0.005% 99.890% ( 51, 76 ] 3 0.003% 99.893% ( 76, 110 ] 28 0.027% 99.920% ( 110, 170 ] 58 0.055% 99.975% ( 170, 250 ] 17 0.016% 99.991% ( 250, 380 ] 3 0.003% 99.994% ( 380, 580 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 182071 Average: 3.4463 StdDev: 54.08 Min: 0 Median: 1.6231 Max: 7057 Percentiles: P50: 1.62 P75: 2.03 P99: 9.10 P99.9: 149.80 P99.99: 2608.45 ------------------------------------------------------ [ 0, 1 ] 17413 9.564% 9.564% ## ( 1, 2 ] 118149 64.892% 74.456% ############# ( 2, 3 ] 28478 15.641% 90.097% ### ( 3, 4 ] 8132 4.466% 94.563% # ( 4, 6 ] 5527 3.036% 97.599% # ( 6, 10 ] 3288 1.806% 99.405% ( 10, 15 ] 452 0.248% 99.653% ( 15, 22 ] 42 0.023% 99.676% ( 22, 34 ] 7 0.004% 99.680% ( 34, 51 ] 200 0.110% 99.790% ( 51, 76 ] 79 0.043% 99.833% ( 76, 110 ] 43 0.024% 99.857% ( 110, 170 ] 119 0.065% 99.922% ( 170, 250 ] 65 0.036% 99.958% ( 250, 380 ] 16 0.009% 99.966% ( 380, 580 ] 15 0.008% 99.975% ( 580, 870 ] 8 0.004% 99.979% ( 870, 1300 ] 6 0.003% 99.982% ( 1300, 1900 ] 6 0.003% 99.986% ( 1900, 2900 ] 11 0.006% 99.992% ( 2900, 4400 ] 9 0.005% 99.997% ( 4400, 6600 ] 9 0.005% 100.002% ( 6600, 9900 ] 1 0.001% 100.002% ** Level 4 read latency histogram (micros): Count: 50 Average: 1383.3800 StdDev: 1860.78 Min: 0 Median: 22.0000 Max: 6025 Percentiles: P50: 22.00 P75: 2685.71 P99: 6025.00 P99.9: 6025.00 P99.99: 6025.00 ------------------------------------------------------ [ 0, 1 ] 5 10.000% 10.000% ## ( 1, 2 ] 10 20.000% 30.000% #### ( 2, 3 ] 3 6.000% 36.000% # ( 4, 6 ] 2 4.000% 40.000% # ( 6, 10 ] 2 4.000% 44.000% # ( 10, 15 ] 2 4.000% 48.000% # ( 15, 22 ] 1 2.000% 50.000% ( 51, 76 ] 5 10.000% 60.000% ## ( 1300, 1900 ] 2 4.000% 64.000% # ( 1900, 2900 ] 7 14.000% 78.000% ### ( 2900, 4400 ] 6 12.000% 90.000% ## ( 4400, 6600 ] 5 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 485.2500 StdDev: 513.69 Min: 127 Median: 250.0000 Max: 2110 Percentiles: P50: 250.00 P75: 580.00 P99: 2110.00 P99.9: 2110.00 P99.99: 2110.00 ------------------------------------------------------ ( 110, 170 ] 9 45.000% 45.000% ######### ( 170, 250 ] 1 5.000% 50.000% # ( 250, 380 ] 3 15.000% 65.000% ### ( 380, 580 ] 2 10.000% 75.000% ## ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 19.2 total, 3.7 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 307.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.007 H:M:S, 10.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 263.92 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.853 H:M:S, 22.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 3.321 micros/op 301099 ops/sec 20.033 seconds 6031999 operations; 291.7 MB/s Microseconds per write: Count: 6031999 Average: 3.3211 StdDev: 170.70 Min: 1 Median: 1.7633 Max: 214487 Percentiles: P50: 1.76 P75: 3.03 P99: 8.16 P99.9: 128.75 P99.99: 1179.47 ------------------------------------------------------ [ 0, 1 ] 775313 12.853% 12.853% ### ( 1, 2 ] 2935690 48.669% 61.522% ########## ( 2, 3 ] 789016 13.081% 74.602% ### ( 3, 4 ] 840896 13.941% 88.543% ### ( 4, 6 ] 593118 9.833% 98.376% ## ( 6, 10 ] 69783 1.157% 99.533% ( 10, 15 ] 14568 0.242% 99.774% ( 15, 22 ] 4290 0.071% 99.845% ( 22, 34 ] 1331 0.022% 99.867% ( 34, 51 ] 166 0.003% 99.870% ( 51, 76 ] 24 0.000% 99.871% ( 76, 110 ] 6 0.000% 99.871% ( 110, 170 ] 5650 0.094% 99.964% ( 170, 250 ] 404 0.007% 99.971% ( 250, 380 ] 70 0.001% 99.972% ( 380, 580 ] 8 0.000% 99.972% ( 580, 870 ] 7 0.000% 99.972% ( 870, 1300 ] 1467 0.024% 99.997% ( 1300, 1900 ] 1 0.000% 99.997% ( 1900, 2900 ] 186 0.003% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 170000, 250000 ] 4 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 102701 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6031999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6225022968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 173 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 2789549 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 8189169988 rocksdb.compact.write.bytes COUNT : 8083007418 rocksdb.flush.write.bytes COUNT : 6200223246 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 12 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 109 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 6159392768 rocksdb.memtable.garbage.bytes.at.flush COUNT : 10790912 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 8236058145 rocksdb.non.last.level.read.count COUNT : 1984131 rocksdb.block.checksum.compute.count COUNT : 1983797 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.400276 P95 : 4.656899 P99 : 6.446590 P100 : 214484.000000 COUNT : 6031999 SUM : 17208858 rocksdb.compaction.times.micros P50 : 1030000.000000 P95 : 2550000.000000 P99 : 5233380.000000 P100 : 5233380.000000 COUNT : 27 SUM : 31612713 rocksdb.compaction.times.cpu_micros P50 : 1030000.000000 P95 : 2550000.000000 P99 : 5053493.000000 P100 : 5053493.000000 COUNT : 27 SUM : 30823079 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 556.744186 P95 : 1249.833333 P99 : 1360.000000 P100 : 1548.000000 COUNT : 90 SUM : 59790 rocksdb.compaction.outfile.sync.micros P50 : 650.161290 P95 : 1179.062500 P99 : 1387.000000 P100 : 1387.000000 COUNT : 65 SUM : 43590 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 74.134328 P95 : 220.666667 P99 : 323.000000 P100 : 323.000000 COUNT : 124 SUM : 11753 rocksdb.table.open.io.micros P50 : 800.058824 P95 : 13033.571429 P99 : 18490.000000 P100 : 18490.000000 COUNT : 173 SUM : 383732 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.641714 P95 : 6.473730 P99 : 10.708027 P100 : 15259.000000 COUNT : 1983382 SUM : 9059310 rocksdb.read.block.get.micros P50 : 371.459854 P95 : 3016.666667 P99 : 5923.500000 P100 : 7200.000000 COUNT : 346 SUM : 254136 rocksdb.write.raw.block.micros P50 : 0.511915 P95 : 0.972639 P99 : 3.012647 P100 : 4085.000000 COUNT : 3459456 SUM : 6805795 rocksdb.numfiles.in.singlecompaction P50 : 3.400000 P95 : 8.600000 P99 : 29.000000 P100 : 29.000000 COUNT : 34 SUM : 152 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560518 P95 : 1127.531016 P99 : 2083.440860 P100 : 214257.000000 COUNT : 15588 SUM : 2792024 rocksdb.sst.read.micros P50 : 1.537966 P95 : 3.564691 P99 : 7.021428 P100 : 7057.000000 COUNT : 1984291 SUM : 4960976 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6031999 SUM : 6225022968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 201515.151515 P95 : 266250.000000 P99 : 384586.000000 P100 : 384586.000000 COUNT : 90 SUM : 16854754 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 109 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0