[2024-11-20 07:40:08.345205] Starting SPDK v25.01-pre git sha1 f22e807f1 / DPDK 23.11.0 initialization... [2024-11-20 07:40:08.345473] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1630029 ] Set seed to 1732084808338518 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 07:40:08.468053] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 07:40:08.491537] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 07:40:08.491587] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1630029' to capture a snapshot of events at runtime. [2024-11-20 07:40:08.491600] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 07:40:08.491613] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 07:40:08.491624] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1630029 for offline analysis/debug. [2024-11-20 07:40:08.492233] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 07:40:12 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/20-07:40:15 ... thread 0: (1000000,1000000) ops and (337639.4,337639.4) ops/second in (2.961740,2.961740) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 692.97 MB 6.3 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 349.6 2.52 2.27 12 0.210 0 0 0.0 0.0 L2 3/2 237.11 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 253.1 252.9 1.38 1.32 2 0.689 353K 165 0.0 0.0 L3 9/0 818.95 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 112/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1032/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1166/11 97.00 GB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 89.4 315.5 3.90 3.59 14 0.279 353K 165 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 89.4 315.5 3.90 3.59 14 0.279 353K 165 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 253.1 252.9 1.38 1.32 2 0.689 353K 165 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 349.6 2.52 2.27 12 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.20 GB write, 392.94 MB/s write, 0.34 GB read, 111.33 MB/s read, 3.9 seconds Interval compaction: 1.20 GB write, 415.25 MB/s write, 0.34 GB read, 117.65 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 134756 Average: 2.0221 StdDev: 17.74 Min: 0 Median: 1.3291 Max: 3304 Percentiles: P50: 1.33 P75: 1.75 P99: 5.15 P99.9: 10.36 P99.99: 151.43 ------------------------------------------------------ [ 0, 1 ] 40819 30.291% 30.291% ###### ( 1, 2 ] 80703 59.888% 90.179% ############ ( 2, 3 ] 7729 5.736% 95.915% # ( 3, 4 ] 3075 2.282% 98.197% ( 4, 6 ] 1893 1.405% 99.602% ( 6, 10 ] 397 0.295% 99.896% ( 10, 15 ] 101 0.075% 99.971% ( 15, 22 ] 17 0.013% 99.984% ( 22, 34 ] 3 0.002% 99.986% ( 34, 51 ] 1 0.001% 99.987% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 8 0.006% 99.993% ( 170, 250 ] 3 0.002% 99.996% ( 250, 380 ] 2 0.001% 99.997% ( 380, 580 ] 1 0.001% 99.998% ( 580, 870 ] 4 0.003% 100.001% ( 870, 1300 ] 1 0.001% 100.001% ( 1300, 1900 ] 1 0.001% 100.002% ( 1900, 2900 ] 1 0.001% 100.003% ( 2900, 4400 ] 3 0.002% 100.005% ** Level 1 read latency histogram (micros): Count: 12277 Average: 2.7101 StdDev: 23.51 Min: 1 Median: 1.2791 Max: 2011 Percentiles: P50: 1.28 P75: 1.74 P99: 9.18 P99.9: 207.23 P99.99: 847.99 ------------------------------------------------------ [ 0, 1 ] 4280 34.862% 34.862% ####### ( 1, 2 ] 6658 54.231% 89.093% ########### ( 2, 3 ] 818 6.663% 95.756% # ( 3, 4 ] 139 1.132% 96.888% ( 4, 6 ] 160 1.303% 98.192% ( 6, 10 ] 125 1.018% 99.210% ( 10, 15 ] 18 0.147% 99.357% ( 15, 22 ] 6 0.049% 99.405% ( 22, 34 ] 1 0.008% 99.414% ( 34, 51 ] 46 0.375% 99.788% ( 51, 76 ] 5 0.041% 99.829% ( 76, 110 ] 5 0.041% 99.870% ( 170, 250 ] 8 0.065% 99.935% ( 250, 380 ] 2 0.016% 99.951% ( 380, 580 ] 2 0.016% 99.967% ( 580, 870 ] 3 0.024% 99.992% ( 1900, 2900 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 67513 Average: 1.9635 StdDev: 4.48 Min: 1 Median: 1.3515 Max: 843 Percentiles: P50: 1.35 P75: 1.76 P99: 5.58 P99.9: 9.96 P99.99: 203.30 ------------------------------------------------------ [ 0, 1 ] 19358 28.673% 28.673% ###### ( 1, 2 ] 40958 60.667% 89.340% ############ ( 2, 3 ] 3859 5.716% 95.056% # ( 3, 4 ] 1756 2.601% 97.657% # ( 4, 6 ] 1149 1.702% 99.359% ( 6, 10 ] 369 0.547% 99.905% ( 10, 15 ] 37 0.055% 99.960% ( 15, 22 ] 15 0.022% 99.982% ( 22, 34 ] 1 0.001% 99.984% ( 51, 76 ] 1 0.001% 99.985% ( 110, 170 ] 2 0.003% 99.988% ( 170, 250 ] 3 0.004% 99.993% ( 250, 380 ] 3 0.004% 99.997% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 45 Average: 1540.1111 StdDev: 1050.02 Min: 133 Median: 1246.2500 Max: 3820 Percentiles: P50: 1246.25 P75: 2331.82 P99: 3820.00 P99.9: 3820.00 P99.99: 3820.00 ------------------------------------------------------ ( 110, 170 ] 2 4.444% 4.444% # ( 170, 250 ] 3 6.667% 11.111% # ( 250, 380 ] 1 2.222% 13.333% ( 380, 580 ] 3 6.667% 20.000% # ( 580, 870 ] 3 6.667% 26.667% # ( 870, 1300 ] 12 26.667% 53.333% ##### ( 1300, 1900 ] 5 11.111% 64.444% ## ( 1900, 2900 ] 11 24.444% 88.889% ##### ( 2900, 4400 ] 5 11.111% 100.000% ## ** Level 4 read latency histogram (micros): Count: 30 Average: 1794.2333 StdDev: 1110.14 Min: 346 Median: 1400.0000 Max: 4701 Percentiles: P50: 1400.00 P75: 2525.00 P99: 4701.00 P99.9: 4701.00 P99.99: 4701.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 380, 580 ] 2 6.667% 10.000% # ( 580, 870 ] 3 10.000% 20.000% ## ( 870, 1300 ] 8 26.667% 46.667% ##### ( 1300, 1900 ] 6 20.000% 66.667% #### ( 1900, 2900 ] 4 13.333% 80.000% ### ( 2900, 4400 ] 5 16.667% 96.667% ### ( 4400, 6600 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 314.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.423 H:M:S, 13.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.423 H:M:S, 14.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/20-07:40:18 ... thread 0: (1000000,2000000) ops and (331213.9,334395.8) ops/second in (3.019197,5.980937) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.35 GB 113.3 0.9 0.0 0.9 2.7 1.8 0.0 1.5 100.6 316.0 8.77 8.12 29 0.302 895K 990 0.0 0.0 L1 1/0 2.82 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 244.0 243.7 1.29 1.26 1 1.291 319K 396 0.0 0.0 L2 2/1 147.47 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 253.1 252.9 1.38 1.32 2 0.689 353K 165 0.0 0.0 L3 18/9 1.03 GB 0.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 217.6 217.6 0.86 0.78 1 0.861 190K 0 0.0 0.0 L4 170/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 124.1 124.1 1.36 0.93 1 1.359 171K 0 0.0 0.0 L5 1032/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1233/14 97.98 GB 0.0 1.9 0.8 1.0 3.7 2.7 0.7 2.0 139.2 277.5 13.66 12.40 34 0.402 1930K 1551 0.0 0.0 Int 0/0 0.00 KB 0.0 1.9 0.8 1.0 3.7 2.7 0.7 2.0 139.2 277.5 13.66 12.40 34 0.402 1930K 1551 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.9 0.8 1.0 1.9 0.8 0.0 0.0 229.5 229.3 8.28 7.61 8 1.035 1930K 1551 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 351.8 5.37 4.79 26 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.70 GB write, 616.18 MB/s write, 1.86 GB read, 309.16 MB/s read, 13.7 seconds Interval compaction: 3.70 GB write, 633.50 MB/s write, 1.86 GB read, 317.85 MB/s read, 13.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 403762 Average: 2.2169 StdDev: 13.61 Min: 0 Median: 1.4817 Max: 3304 Percentiles: P50: 1.48 P75: 1.87 P99: 5.69 P99.9: 10.51 P99.99: 18.29 ------------------------------------------------------ [ 0, 1 ] 78183 19.364% 19.364% #### ( 1, 2 ] 256799 63.602% 82.965% ############# ( 2, 3 ] 40644 10.066% 93.032% ## ( 3, 4 ] 15432 3.822% 96.854% # ( 4, 6 ] 10275 2.545% 99.398% # ( 6, 10 ] 1987 0.492% 99.891% ( 10, 15 ] 381 0.094% 99.985% ( 15, 22 ] 46 0.011% 99.996% ( 22, 34 ] 8 0.002% 99.998% ( 34, 51 ] 5 0.001% 100.000% ( 51, 76 ] 4 0.001% 100.000% ( 110, 170 ] 14 0.003% 100.004% ( 170, 250 ] 8 0.002% 100.006% ( 250, 380 ] 7 0.002% 100.008% ( 380, 580 ] 3 0.001% 100.008% ( 580, 870 ] 8 0.002% 100.010% ( 870, 1300 ] 8 0.002% 100.012% ( 1300, 1900 ] 3 0.001% 100.013% ( 1900, 2900 ] 4 0.001% 100.014% ( 2900, 4400 ] 3 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 12297 Average: 3.2230 StdDev: 49.53 Min: 1 Median: 1.2794 Max: 4789 Percentiles: P50: 1.28 P75: 1.74 P99: 9.36 P99.9: 281.63 P99.99: 2670.30 ------------------------------------------------------ [ 0, 1 ] 4287 34.862% 34.862% ####### ( 1, 2 ] 6662 54.176% 89.038% ########### ( 2, 3 ] 820 6.668% 95.706% # ( 3, 4 ] 139 1.130% 96.837% ( 4, 6 ] 161 1.309% 98.146% ( 6, 10 ] 125 1.017% 99.162% ( 10, 15 ] 18 0.146% 99.309% ( 15, 22 ] 6 0.049% 99.358% ( 22, 34 ] 1 0.008% 99.366% ( 34, 51 ] 46 0.374% 99.740% ( 51, 76 ] 5 0.041% 99.780% ( 76, 110 ] 5 0.041% 99.821% ( 170, 250 ] 8 0.065% 99.886% ( 250, 380 ] 7 0.057% 99.943% ( 380, 580 ] 2 0.016% 99.959% ( 580, 870 ] 3 0.024% 99.984% ( 1900, 2900 ] 1 0.008% 99.992% ( 4400, 6600 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 76109 Average: 2.0204 StdDev: 4.24 Min: 1 Median: 1.3929 Max: 843 Percentiles: P50: 1.39 P75: 1.80 P99: 5.66 P99.9: 9.99 P99.99: 180.38 ------------------------------------------------------ [ 0, 1 ] 19834 26.060% 26.060% ##### ( 1, 2 ] 46372 60.928% 86.988% ############ ( 2, 3 ] 5615 7.378% 94.366% # ( 3, 4 ] 2221 2.918% 97.284% # ( 4, 6 ] 1570 2.063% 99.347% ( 6, 10 ] 422 0.554% 99.901% ( 10, 15 ] 47 0.062% 99.963% ( 15, 22 ] 15 0.020% 99.983% ( 22, 34 ] 1 0.001% 99.984% ( 34, 51 ] 1 0.001% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 3 0.004% 99.993% ( 250, 380 ] 3 0.004% 99.997% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 197244 Average: 3.4438 StdDev: 33.26 Min: 1 Median: 1.6827 Max: 3909 Percentiles: P50: 1.68 P75: 2.31 P99: 8.99 P99.9: 163.23 P99.99: 460.29 ------------------------------------------------------ [ 0, 1 ] 17289 8.765% 8.765% ## ( 1, 2 ] 119143 60.404% 69.169% ############ ( 2, 3 ] 37342 18.932% 88.101% #### ( 3, 4 ] 10029 5.085% 93.186% # ( 4, 6 ] 8936 4.530% 97.716% # ( 6, 10 ] 3387 1.717% 99.433% ( 10, 15 ] 470 0.238% 99.671% ( 15, 22 ] 116 0.059% 99.730% ( 22, 34 ] 28 0.014% 99.744% ( 34, 51 ] 3 0.002% 99.746% ( 51, 76 ] 7 0.004% 99.750% ( 76, 110 ] 115 0.058% 99.808% ( 110, 170 ] 206 0.104% 99.912% ( 170, 250 ] 77 0.039% 99.951% ( 250, 380 ] 56 0.028% 99.980% ( 380, 580 ] 53 0.027% 100.007% ( 580, 870 ] 28 0.014% 100.021% ( 870, 1300 ] 15 0.008% 100.028% ( 1300, 1900 ] 5 0.003% 100.031% ( 1900, 2900 ] 11 0.006% 100.037% ( 2900, 4400 ] 7 0.004% 100.040% ** Level 4 read latency histogram (micros): Count: 320 Average: 173.7469 StdDev: 622.51 Min: 1 Median: 2.5060 Max: 4701 Percentiles: P50: 2.51 P75: 7.04 P99: 3740.00 P99.9: 4701.00 P99.99: 4701.00 ------------------------------------------------------ [ 0, 1 ] 23 7.188% 7.188% # ( 1, 2 ] 95 29.688% 36.875% ###### ( 2, 3 ] 83 25.938% 62.812% ##### ( 3, 4 ] 23 7.188% 70.000% # ( 4, 6 ] 10 3.125% 73.125% # ( 6, 10 ] 23 7.188% 80.312% # ( 10, 15 ] 25 7.812% 88.125% ## ( 15, 22 ] 5 1.562% 89.688% ( 110, 170 ] 1 0.312% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 3 0.938% 92.500% ( 870, 1300 ] 8 2.500% 95.000% # ( 1300, 1900 ] 6 1.875% 96.875% ( 1900, 2900 ] 4 1.250% 98.125% ( 2900, 4400 ] 5 1.562% 99.688% ( 4400, 6600 ] 1 0.312% 100.000% ** DB Stats ** Uptime(secs): 6.2 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 320.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.817 H:M:S, 13.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.394 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-07:40:21 ... thread 0: (1000000,3000000) ops and (358861.7,342171.8) ops/second in (2.786589,8.767526) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/14 2.21 GB 0.0 1.7 0.0 1.7 4.4 2.7 0.0 1.6 118.9 312.5 14.31 13.33 45 0.318 1727K 1811 0.0 0.0 L1 1/1 2.82 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 244.0 243.7 1.29 1.26 1 1.291 319K 396 0.0 0.0 L2 1/0 97.61 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 253.1 252.9 1.38 1.32 2 0.689 353K 165 0.0 0.0 L3 19/0 842.49 MB 0.8 1.0 0.2 0.8 1.0 0.2 0.2 4.4 240.1 239.8 4.40 4.06 2 2.199 1072K 1559 0.0 0.0 L4 170/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 124.1 124.1 1.36 0.93 1 1.359 171K 0 0.0 0.0 L5 1036/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1241/15 98.84 GB 0.0 3.5 0.9 2.6 6.2 3.6 1.3 2.3 157.9 279.6 22.73 20.89 51 0.446 3644K 3931 0.0 0.0 Int 0/0 0.00 KB 0.0 3.5 0.9 2.6 6.2 3.6 1.3 2.3 157.9 279.6 22.73 20.89 51 0.446 3644K 3931 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.5 0.9 2.6 3.5 0.9 0.0 0.0 240.2 239.9 14.94 13.95 12 1.245 3644K 3931 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 355.9 7.79 6.94 39 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.9 total, 8.8 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.21 GB write, 711.33 MB/s write, 3.51 GB read, 401.62 MB/s read, 22.7 seconds Interval compaction: 6.21 GB write, 724.98 MB/s write, 3.51 GB read, 409.32 MB/s read, 22.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 620379 Average: 2.1624 StdDev: 12.88 Min: 0 Median: 1.4544 Max: 3338 Percentiles: P50: 1.45 P75: 1.85 P99: 5.61 P99.9: 10.38 P99.99: 21.63 ------------------------------------------------------ [ 0, 1 ] 130675 21.064% 21.064% #### ( 1, 2 ] 395067 63.682% 84.745% ############# ( 2, 3 ] 56895 9.171% 93.916% ## ( 3, 4 ] 20743 3.344% 97.260% # ( 4, 6 ] 13448 2.168% 99.428% ( 6, 10 ] 2892 0.466% 99.894% ( 10, 15 ] 525 0.085% 99.978% ( 15, 22 ] 77 0.012% 99.991% ( 22, 34 ] 12 0.002% 99.993% ( 34, 51 ] 6 0.001% 99.994% ( 51, 76 ] 5 0.001% 99.995% ( 76, 110 ] 18 0.003% 99.997% ( 110, 170 ] 24 0.004% 100.001% ( 170, 250 ] 15 0.002% 100.004% ( 250, 380 ] 18 0.003% 100.007% ( 380, 580 ] 6 0.001% 100.008% ( 580, 870 ] 13 0.002% 100.010% ( 870, 1300 ] 10 0.002% 100.011% ( 1300, 1900 ] 3 0.000% 100.012% ( 1900, 2900 ] 4 0.001% 100.012% ( 2900, 4400 ] 5 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 12298 Average: 3.2229 StdDev: 49.53 Min: 1 Median: 1.2795 Max: 4789 Percentiles: P50: 1.28 P75: 1.74 P99: 9.36 P99.9: 281.61 P99.99: 2670.20 ------------------------------------------------------ [ 0, 1 ] 4287 34.859% 34.859% ####### ( 1, 2 ] 6663 54.180% 89.039% ########### ( 2, 3 ] 820 6.668% 95.707% # ( 3, 4 ] 139 1.130% 96.837% ( 4, 6 ] 161 1.309% 98.146% ( 6, 10 ] 125 1.016% 99.162% ( 10, 15 ] 18 0.146% 99.309% ( 15, 22 ] 6 0.049% 99.358% ( 22, 34 ] 1 0.008% 99.366% ( 34, 51 ] 46 0.374% 99.740% ( 51, 76 ] 5 0.041% 99.780% ( 76, 110 ] 5 0.041% 99.821% ( 170, 250 ] 8 0.065% 99.886% ( 250, 380 ] 7 0.057% 99.943% ( 380, 580 ] 2 0.016% 99.959% ( 580, 870 ] 3 0.024% 99.984% ( 1900, 2900 ] 1 0.008% 99.992% ( 4400, 6600 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 88480 Average: 2.0424 StdDev: 3.94 Min: 1 Median: 1.4165 Max: 843 Percentiles: P50: 1.42 P75: 1.82 P99: 5.64 P99.9: 10.00 P99.99: 144.56 ------------------------------------------------------ [ 0, 1 ] 21367 24.149% 24.149% ##### ( 1, 2 ] 54916 62.066% 86.215% ############ ( 2, 3 ] 7077 7.998% 94.213% ## ( 3, 4 ] 2684 3.033% 97.247% # ( 4, 6 ] 1895 2.142% 99.389% ( 6, 10 ] 453 0.512% 99.901% ( 10, 15 ] 58 0.066% 99.966% ( 15, 22 ] 17 0.019% 99.985% ( 22, 34 ] 1 0.001% 99.986% ( 34, 51 ] 1 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.002% 99.991% ( 170, 250 ] 3 0.003% 99.994% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 250797 Average: 3.2995 StdDev: 30.38 Min: 1 Median: 1.6429 Max: 3909 Percentiles: P50: 1.64 P75: 2.17 P99: 8.86 P99.9: 166.81 P99.99: 489.42 ------------------------------------------------------ [ 0, 1 ] 25428 10.139% 10.139% ## ( 1, 2 ] 155499 62.002% 72.141% ############ ( 2, 3 ] 42889 17.101% 89.242% ### ( 3, 4 ] 11546 4.604% 93.846% # ( 4, 6 ] 9938 3.963% 97.808% # ( 6, 10 ] 4175 1.665% 99.473% ( 10, 15 ] 511 0.204% 99.677% ( 15, 22 ] 121 0.048% 99.725% ( 22, 34 ] 30 0.012% 99.737% ( 34, 51 ] 3 0.001% 99.738% ( 51, 76 ] 7 0.003% 99.741% ( 76, 110 ] 171 0.068% 99.809% ( 110, 170 ] 241 0.096% 99.905% ( 170, 250 ] 106 0.042% 99.947% ( 250, 380 ] 73 0.029% 99.976% ( 380, 580 ] 62 0.025% 100.001% ( 580, 870 ] 31 0.012% 100.014% ( 870, 1300 ] 21 0.008% 100.022% ( 1300, 1900 ] 5 0.002% 100.024% ( 1900, 2900 ] 11 0.004% 100.028% ( 2900, 4400 ] 7 0.003% 100.031% ** Level 4 read latency histogram (micros): Count: 320 Average: 173.7469 StdDev: 622.51 Min: 1 Median: 2.5060 Max: 4701 Percentiles: P50: 2.51 P75: 7.04 P99: 3740.00 P99.9: 4701.00 P99.99: 4701.00 ------------------------------------------------------ [ 0, 1 ] 23 7.188% 7.188% # ( 1, 2 ] 95 29.688% 36.875% ###### ( 2, 3 ] 83 25.938% 62.812% ##### ( 3, 4 ] 23 7.188% 70.000% # ( 4, 6 ] 10 3.125% 73.125% # ( 6, 10 ] 23 7.188% 80.312% # ( 10, 15 ] 25 7.812% 88.125% ## ( 15, 22 ] 5 1.562% 89.688% ( 110, 170 ] 1 0.312% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 3 0.938% 92.500% ( 870, 1300 ] 8 2.500% 95.000% # ( 1300, 1900 ] 6 1.875% 96.875% ( 1900, 2900 ] 4 1.250% 98.125% ( 2900, 4400 ] 5 1.562% 99.688% ( 4400, 6600 ] 1 0.312% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 950.4500 StdDev: 988.17 Min: 112 Median: 480.0000 Max: 3408 Percentiles: P50: 480.00 P75: 1300.00 P99: 3408.00 P99.9: 3408.00 P99.99: 3408.00 ------------------------------------------------------ ( 110, 170 ] 4 20.000% 20.000% #### ( 170, 250 ] 3 15.000% 35.000% ### ( 250, 380 ] 2 10.000% 45.000% ## ( 380, 580 ] 2 10.000% 55.000% ## ( 580, 870 ] 2 10.000% 65.000% ## ( 870, 1300 ] 2 10.000% 75.000% ## ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 8.9 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 330.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.040 H:M:S, 11.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 353.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.224 H:M:S, 8.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-07:40:25 ... thread 0: (1000000,4000000) ops and (280688.0,324406.7) ops/second in (3.562674,12.330200) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 3.26 GB 100.7 2.5 0.0 2.5 6.2 3.7 0.0 1.7 123.6 311.9 20.39 19.05 62 0.329 2558K 2671 0.0 0.0 L1 1/1 2.82 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 244.0 243.7 1.29 1.26 1 1.291 319K 396 0.0 0.0 L2 1/0 97.61 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 253.1 252.9 1.38 1.32 2 0.689 353K 165 0.0 0.0 L3 19/0 842.49 MB 0.8 1.0 0.2 0.8 1.0 0.2 0.2 4.4 240.1 239.8 4.40 4.06 2 2.199 1072K 1559 0.0 0.0 L4 170/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 124.1 124.1 1.36 0.93 1 1.359 171K 0 0.0 0.0 L5 1036/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1246/15 99.88 GB 0.0 4.3 0.9 3.4 8.1 4.6 1.3 2.1 153.0 286.2 28.82 26.62 68 0.424 4476K 4791 0.0 0.0 Int 0/0 0.00 KB 0.0 4.3 0.9 3.4 8.1 4.6 1.3 2.1 153.0 286.2 28.82 26.62 68 0.424 4476K 4791 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.3 0.9 3.4 4.3 0.9 0.0 0.0 245.2 244.9 17.98 16.93 15 1.198 4476K 4791 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 354.6 10.84 9.69 53 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.5 total, 12.3 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.05 GB write, 659.71 MB/s write, 4.30 GB read, 352.67 MB/s read, 28.8 seconds Interval compaction: 8.05 GB write, 668.71 MB/s write, 4.30 GB read, 357.48 MB/s read, 28.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 14, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1068960 Average: 2.1713 StdDev: 11.56 Min: 0 Median: 1.4699 Max: 3338 Percentiles: P50: 1.47 P75: 1.85 P99: 5.56 P99.9: 9.95 P99.99: 20.72 ------------------------------------------------------ [ 0, 1 ] 204545 19.135% 19.135% #### ( 1, 2 ] 702203 65.690% 84.825% ############# ( 2, 3 ] 100626 9.413% 94.239% ## ( 3, 4 ] 34488 3.226% 97.465% # ( 4, 6 ] 21028 1.967% 99.432% ( 6, 10 ] 5066 0.474% 99.906% ( 10, 15 ] 813 0.076% 99.982% ( 15, 22 ] 103 0.010% 99.992% ( 22, 34 ] 20 0.002% 99.994% ( 34, 51 ] 7 0.001% 99.994% ( 51, 76 ] 7 0.001% 99.995% ( 76, 110 ] 20 0.002% 99.997% ( 110, 170 ] 103 0.010% 100.006% ( 170, 250 ] 30 0.003% 100.009% ( 250, 380 ] 34 0.003% 100.012% ( 380, 580 ] 16 0.001% 100.014% ( 580, 870 ] 21 0.002% 100.016% ( 870, 1300 ] 15 0.001% 100.017% ( 1300, 1900 ] 6 0.001% 100.018% ( 1900, 2900 ] 5 0.000% 100.018% ( 2900, 4400 ] 6 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 12298 Average: 3.2229 StdDev: 49.53 Min: 1 Median: 1.2795 Max: 4789 Percentiles: P50: 1.28 P75: 1.74 P99: 9.36 P99.9: 281.61 P99.99: 2670.20 ------------------------------------------------------ [ 0, 1 ] 4287 34.859% 34.859% ####### ( 1, 2 ] 6663 54.180% 89.039% ########### ( 2, 3 ] 820 6.668% 95.707% # ( 3, 4 ] 139 1.130% 96.837% ( 4, 6 ] 161 1.309% 98.146% ( 6, 10 ] 125 1.016% 99.162% ( 10, 15 ] 18 0.146% 99.309% ( 15, 22 ] 6 0.049% 99.358% ( 22, 34 ] 1 0.008% 99.366% ( 34, 51 ] 46 0.374% 99.740% ( 51, 76 ] 5 0.041% 99.780% ( 76, 110 ] 5 0.041% 99.821% ( 170, 250 ] 8 0.065% 99.886% ( 250, 380 ] 7 0.057% 99.943% ( 380, 580 ] 2 0.016% 99.959% ( 580, 870 ] 3 0.024% 99.984% ( 1900, 2900 ] 1 0.008% 99.992% ( 4400, 6600 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 88480 Average: 2.0424 StdDev: 3.94 Min: 1 Median: 1.4165 Max: 843 Percentiles: P50: 1.42 P75: 1.82 P99: 5.64 P99.9: 10.00 P99.99: 144.56 ------------------------------------------------------ [ 0, 1 ] 21367 24.149% 24.149% ##### ( 1, 2 ] 54916 62.066% 86.215% ############ ( 2, 3 ] 7077 7.998% 94.213% ## ( 3, 4 ] 2684 3.033% 97.247% # ( 4, 6 ] 1895 2.142% 99.389% ( 6, 10 ] 453 0.512% 99.901% ( 10, 15 ] 58 0.066% 99.966% ( 15, 22 ] 17 0.019% 99.985% ( 22, 34 ] 1 0.001% 99.986% ( 34, 51 ] 1 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.002% 99.991% ( 170, 250 ] 3 0.003% 99.994% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 250797 Average: 3.2995 StdDev: 30.38 Min: 1 Median: 1.6429 Max: 3909 Percentiles: P50: 1.64 P75: 2.17 P99: 8.86 P99.9: 166.81 P99.99: 489.42 ------------------------------------------------------ [ 0, 1 ] 25428 10.139% 10.139% ## ( 1, 2 ] 155499 62.002% 72.141% ############ ( 2, 3 ] 42889 17.101% 89.242% ### ( 3, 4 ] 11546 4.604% 93.846% # ( 4, 6 ] 9938 3.963% 97.808% # ( 6, 10 ] 4175 1.665% 99.473% ( 10, 15 ] 511 0.204% 99.677% ( 15, 22 ] 121 0.048% 99.725% ( 22, 34 ] 30 0.012% 99.737% ( 34, 51 ] 3 0.001% 99.738% ( 51, 76 ] 7 0.003% 99.741% ( 76, 110 ] 171 0.068% 99.809% ( 110, 170 ] 241 0.096% 99.905% ( 170, 250 ] 106 0.042% 99.947% ( 250, 380 ] 73 0.029% 99.976% ( 380, 580 ] 62 0.025% 100.001% ( 580, 870 ] 31 0.012% 100.014% ( 870, 1300 ] 21 0.008% 100.022% ( 1300, 1900 ] 5 0.002% 100.024% ( 1900, 2900 ] 11 0.004% 100.028% ( 2900, 4400 ] 7 0.003% 100.031% ** Level 4 read latency histogram (micros): Count: 320 Average: 173.7469 StdDev: 622.51 Min: 1 Median: 2.5060 Max: 4701 Percentiles: P50: 2.51 P75: 7.04 P99: 3740.00 P99.9: 4701.00 P99.99: 4701.00 ------------------------------------------------------ [ 0, 1 ] 23 7.188% 7.188% # ( 1, 2 ] 95 29.688% 36.875% ###### ( 2, 3 ] 83 25.938% 62.812% ##### ( 3, 4 ] 23 7.188% 70.000% # ( 4, 6 ] 10 3.125% 73.125% # ( 6, 10 ] 23 7.188% 80.312% # ( 10, 15 ] 25 7.812% 88.125% ## ( 15, 22 ] 5 1.562% 89.688% ( 110, 170 ] 1 0.312% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 3 0.938% 92.500% ( 870, 1300 ] 8 2.500% 95.000% # ( 1300, 1900 ] 6 1.875% 96.875% ( 1900, 2900 ] 4 1.250% 98.125% ( 2900, 4400 ] 5 1.562% 99.688% ( 4400, 6600 ] 1 0.312% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 950.4500 StdDev: 988.17 Min: 112 Median: 480.0000 Max: 3408 Percentiles: P50: 480.00 P75: 1300.00 P99: 3408.00 P99.9: 3408.00 P99.99: 3408.00 ------------------------------------------------------ ( 110, 170 ] 4 20.000% 20.000% #### ( 170, 250 ] 3 15.000% 35.000% ### ( 250, 380 ] 2 10.000% 45.000% ## ( 380, 580 ] 2 10.000% 55.000% ## ( 580, 870 ] 2 10.000% 65.000% ## ( 870, 1300 ] 2 10.000% 75.000% ## ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.5 total, 3.6 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 314.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.017 H:M:S, 16.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 276.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.977 H:M:S, 27.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-07:40:30 ... thread 0: (1000000,5000000) ops and (191015.9,284651.0) ops/second in (5.235167,17.565367) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 2.21 GB 12.6 3.5 0.0 3.5 8.2 4.7 0.0 1.7 132.6 309.2 27.09 25.38 81 0.334 3645K 3759 0.0 0.0 L1 13/13 1.45 GB 0.0 2.3 2.3 0.0 2.3 2.3 0.2 1.0 233.6 231.7 9.98 9.66 2 4.991 2367K 18K 0.0 0.0 L2 4/4 515.11 MB 0.0 0.3 0.2 0.2 0.3 0.2 0.9 1.8 253.1 252.9 1.38 1.32 2 0.689 353K 165 0.0 0.0 L3 19/1 940.04 MB 0.8 1.1 0.3 0.8 1.1 0.3 0.2 3.5 228.8 228.4 5.12 4.62 3 1.708 1190K 1620 0.0 0.0 L4 170/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 124.1 124.1 1.36 0.93 1 1.359 171K 0 0.0 0.0 L5 1036/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/28 100.79 GB 0.0 7.4 3.0 4.5 12.1 7.6 1.8 2.6 169.4 275.4 44.93 41.91 89 0.505 7729K 24K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.4 3.0 4.5 12.1 7.6 1.8 2.6 169.4 275.4 44.93 41.91 89 0.505 7729K 24K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.4 3.0 4.5 7.4 2.9 0.0 0.0 242.5 241.7 31.39 29.83 21 1.495 7729K 24K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 353.7 13.53 12.08 68 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.7 total, 17.6 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.09 GB write, 697.80 MB/s write, 7.43 GB read, 429.22 MB/s read, 44.9 seconds Interval compaction: 12.09 GB write, 704.48 MB/s write, 7.43 GB read, 433.34 MB/s read, 44.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 14, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1570057 Average: 2.2276 StdDev: 12.70 Min: 0 Median: 1.4621 Max: 3353 Percentiles: P50: 1.46 P75: 1.84 P99: 5.61 P99.9: 11.92 P99.99: 166.19 ------------------------------------------------------ [ 0, 1 ] 306721 19.536% 19.536% #### ( 1, 2 ] 1035034 65.923% 85.459% ############# ( 2, 3 ] 141219 8.995% 94.454% ## ( 3, 4 ] 47805 3.045% 97.498% # ( 4, 6 ] 29320 1.867% 99.366% ( 6, 10 ] 7937 0.506% 99.871% ( 10, 15 ] 1177 0.075% 99.946% ( 15, 22 ] 227 0.014% 99.961% ( 22, 34 ] 30 0.002% 99.963% ( 34, 51 ] 9 0.001% 99.963% ( 51, 76 ] 11 0.001% 99.964% ( 76, 110 ] 131 0.008% 99.972% ( 110, 170 ] 299 0.019% 99.991% ( 170, 250 ] 112 0.007% 99.998% ( 250, 380 ] 100 0.006% 100.005% ( 380, 580 ] 86 0.005% 100.010% ( 580, 870 ] 54 0.003% 100.014% ( 870, 1300 ] 24 0.002% 100.015% ( 1300, 1900 ] 11 0.001% 100.016% ( 1900, 2900 ] 7 0.000% 100.016% ( 2900, 4400 ] 9 0.001% 100.017% ** Level 1 read latency histogram (micros): Count: 88306 Average: 3.5260 StdDev: 28.91 Min: 0 Median: 1.6254 Max: 4789 Percentiles: P50: 1.63 P75: 2.10 P99: 9.14 P99.9: 274.05 P99.99: 628.38 ------------------------------------------------------ [ 0, 1 ] 9741 11.031% 11.031% ## ( 1, 2 ] 55026 62.313% 73.344% ############ ( 2, 3 ] 14659 16.600% 89.944% ### ( 3, 4 ] 4014 4.546% 94.490% # ( 4, 6 ] 3015 3.414% 97.904% # ( 6, 10 ] 1236 1.400% 99.304% ( 10, 15 ] 196 0.222% 99.526% ( 15, 22 ] 25 0.028% 99.554% ( 22, 34 ] 5 0.006% 99.559% ( 34, 51 ] 47 0.053% 99.613% ( 51, 76 ] 8 0.009% 99.622% ( 76, 110 ] 76 0.086% 99.708% ( 110, 170 ] 112 0.127% 99.835% ( 170, 250 ] 50 0.057% 99.891% ( 250, 380 ] 47 0.053% 99.945% ( 380, 580 ] 38 0.043% 99.988% ( 580, 870 ] 19 0.022% 100.009% ( 870, 1300 ] 9 0.010% 100.019% ( 1300, 1900 ] 4 0.005% 100.024% ( 1900, 2900 ] 1 0.001% 100.025% ( 4400, 6600 ] 1 0.001% 100.026% ** Level 2 read latency histogram (micros): Count: 88480 Average: 2.0424 StdDev: 3.94 Min: 1 Median: 1.4165 Max: 843 Percentiles: P50: 1.42 P75: 1.82 P99: 5.64 P99.9: 10.00 P99.99: 144.56 ------------------------------------------------------ [ 0, 1 ] 21367 24.149% 24.149% ##### ( 1, 2 ] 54916 62.066% 86.215% ############ ( 2, 3 ] 7077 7.998% 94.213% ## ( 3, 4 ] 2684 3.033% 97.247% # ( 4, 6 ] 1895 2.142% 99.389% ( 6, 10 ] 453 0.512% 99.901% ( 10, 15 ] 58 0.066% 99.966% ( 15, 22 ] 17 0.019% 99.985% ( 22, 34 ] 1 0.001% 99.986% ( 34, 51 ] 1 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.002% 99.991% ( 170, 250 ] 3 0.003% 99.994% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 255560 Average: 3.6924 StdDev: 32.64 Min: 1 Median: 1.6472 Max: 3909 Percentiles: P50: 1.65 P75: 2.19 P99: 9.29 P99.9: 252.60 P99.99: 597.22 ------------------------------------------------------ [ 0, 1 ] 25669 10.044% 10.044% ## ( 1, 2 ] 157764 61.733% 71.777% ############ ( 2, 3 ] 44066 17.243% 89.020% ### ( 3, 4 ] 11881 4.649% 93.669% # ( 4, 6 ] 10118 3.959% 97.628% # ( 6, 10 ] 4266 1.669% 99.297% ( 10, 15 ] 529 0.207% 99.504% ( 15, 22 ] 126 0.049% 99.554% ( 22, 34 ] 31 0.012% 99.566% ( 34, 51 ] 3 0.001% 99.567% ( 51, 76 ] 7 0.003% 99.570% ( 76, 110 ] 286 0.112% 99.681% ( 110, 170 ] 372 0.146% 99.827% ( 170, 250 ] 184 0.072% 99.899% ( 250, 380 ] 122 0.048% 99.947% ( 380, 580 ] 107 0.042% 99.989% ( 580, 870 ] 58 0.023% 100.011% ( 870, 1300 ] 25 0.010% 100.021% ( 1300, 1900 ] 6 0.002% 100.023% ( 1900, 2900 ] 11 0.004% 100.028% ( 2900, 4400 ] 7 0.003% 100.031% ** Level 4 read latency histogram (micros): Count: 320 Average: 173.7469 StdDev: 622.51 Min: 1 Median: 2.5060 Max: 4701 Percentiles: P50: 2.51 P75: 7.04 P99: 3740.00 P99.9: 4701.00 P99.99: 4701.00 ------------------------------------------------------ [ 0, 1 ] 23 7.188% 7.188% # ( 1, 2 ] 95 29.688% 36.875% ###### ( 2, 3 ] 83 25.938% 62.812% ##### ( 3, 4 ] 23 7.188% 70.000% # ( 4, 6 ] 10 3.125% 73.125% # ( 6, 10 ] 23 7.188% 80.312% # ( 10, 15 ] 25 7.812% 88.125% ## ( 15, 22 ] 5 1.562% 89.688% ( 110, 170 ] 1 0.312% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 3 0.938% 92.500% ( 870, 1300 ] 8 2.500% 95.000% # ( 1300, 1900 ] 6 1.875% 96.875% ( 1900, 2900 ] 4 1.250% 98.125% ( 2900, 4400 ] 5 1.562% 99.688% ( 4400, 6600 ] 1 0.312% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 950.4500 StdDev: 988.17 Min: 112 Median: 480.0000 Max: 3408 Percentiles: P50: 480.00 P75: 1300.00 P99: 3408.00 P99.9: 3408.00 P99.99: 3408.00 ------------------------------------------------------ ( 110, 170 ] 4 20.000% 20.000% #### ( 170, 250 ] 3 15.000% 35.000% ### ( 250, 380 ] 2 10.000% 45.000% ## ( 380, 580 ] 2 10.000% 55.000% ## ( 580, 870 ] 2 10.000% 65.000% ## ( 870, 1300 ] 2 10.000% 75.000% ## ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 17.7 total, 5.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 277.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.641 H:M:S, 26.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 188.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.624 H:M:S, 50.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-07:40:33 ... thread 0: (1000000,6000000) ops and (328572.5,291137.3) ops/second in (3.043468,20.608835) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 3.13 GB 75.5 4.1 0.0 4.1 9.7 5.6 0.0 1.7 129.9 308.8 32.01 29.97 96 0.333 4221K 4349 0.0 0.0 L1 13/13 1.45 GB 0.0 2.3 2.3 0.0 2.3 2.3 0.2 1.0 233.6 231.7 9.98 9.66 2 4.991 2367K 18K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.9 1.8 253.1 252.9 1.38 1.32 2 0.689 353K 165 0.0 0.0 L3 20/0 938.32 MB 0.9 1.8 0.8 0.9 1.8 0.8 0.2 2.1 225.8 225.4 8.04 7.38 4 2.011 1844K 3309 0.0 0.0 L4 174/0 9.72 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 124.1 124.1 1.36 0.93 1 1.359 171K 0 0.0 0.0 L5 1040/0 86.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1266/27 101.71 GB 0.0 8.6 3.5 5.2 14.2 9.0 2.7 2.5 167.2 275.3 52.77 49.27 105 0.503 8959K 26K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.6 3.5 5.2 14.2 9.0 2.6 2.5 167.2 275.3 52.77 49.27 105 0.503 8959K 26K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.6 3.5 5.2 8.6 3.4 0.0 0.0 241.4 240.6 36.55 34.79 24 1.523 8959K 26K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 353.4 16.22 14.47 81 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.8 total, 20.6 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.19 GB write, 699.23 MB/s write, 8.62 GB read, 424.63 MB/s read, 52.8 seconds Interval compaction: 14.19 GB write, 704.94 MB/s write, 8.62 GB read, 428.10 MB/s read, 52.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 21, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1912775 Average: 2.2624 StdDev: 11.99 Min: 0 Median: 1.4869 Max: 3353 Percentiles: P50: 1.49 P75: 1.87 P99: 5.72 P99.9: 11.75 P99.99: 140.67 ------------------------------------------------------ [ 0, 1 ] 341777 17.868% 17.868% #### ( 1, 2 ] 1262288 65.992% 83.861% ############# ( 2, 3 ] 189335 9.898% 93.759% ## ( 3, 4 ] 64845 3.390% 97.149% # ( 4, 6 ] 41103 2.149% 99.298% ( 6, 10 ] 10938 0.572% 99.870% ( 10, 15 ] 1648 0.086% 99.956% ( 15, 22 ] 272 0.014% 99.970% ( 22, 34 ] 36 0.002% 99.972% ( 34, 51 ] 11 0.001% 99.973% ( 51, 76 ] 12 0.001% 99.973% ( 76, 110 ] 150 0.008% 99.981% ( 110, 170 ] 332 0.017% 99.999% ( 170, 250 ] 142 0.007% 100.006% ( 250, 380 ] 114 0.006% 100.012% ( 380, 580 ] 100 0.005% 100.017% ( 580, 870 ] 62 0.003% 100.020% ( 870, 1300 ] 28 0.001% 100.022% ( 1300, 1900 ] 14 0.001% 100.023% ( 1900, 2900 ] 7 0.000% 100.023% ( 2900, 4400 ] 9 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 226728 Average: 3.0384 StdDev: 20.69 Min: 0 Median: 1.6385 Max: 4789 Percentiles: P50: 1.64 P75: 2.10 P99: 8.69 P99.9: 164.05 P99.99: 574.03 ------------------------------------------------------ [ 0, 1 ] 19807 8.736% 8.736% ## ( 1, 2 ] 146529 64.628% 73.364% ############# ( 2, 3 ] 37118 16.371% 89.735% ### ( 3, 4 ] 10268 4.529% 94.264% # ( 4, 6 ] 8292 3.657% 97.921% # ( 6, 10 ] 3635 1.603% 99.524% ( 10, 15 ] 423 0.187% 99.711% ( 15, 22 ] 55 0.024% 99.735% ( 22, 34 ] 6 0.003% 99.738% ( 34, 51 ] 47 0.021% 99.758% ( 51, 76 ] 11 0.005% 99.763% ( 76, 110 ] 140 0.062% 99.825% ( 110, 170 ] 189 0.083% 99.908% ( 170, 250 ] 71 0.031% 99.940% ( 250, 380 ] 60 0.026% 99.966% ( 380, 580 ] 56 0.025% 99.991% ( 580, 870 ] 25 0.011% 100.002% ( 870, 1300 ] 10 0.004% 100.006% ( 1300, 1900 ] 5 0.002% 100.008% ( 1900, 2900 ] 1 0.000% 100.009% ( 2900, 4400 ] 1 0.000% 100.009% ( 4400, 6600 ] 1 0.000% 100.010% ** Level 2 read latency histogram (micros): Count: 88480 Average: 2.0424 StdDev: 3.94 Min: 1 Median: 1.4165 Max: 843 Percentiles: P50: 1.42 P75: 1.82 P99: 5.64 P99.9: 10.00 P99.99: 144.56 ------------------------------------------------------ [ 0, 1 ] 21367 24.149% 24.149% ##### ( 1, 2 ] 54916 62.066% 86.215% ############ ( 2, 3 ] 7077 7.998% 94.213% ## ( 3, 4 ] 2684 3.033% 97.247% # ( 4, 6 ] 1895 2.142% 99.389% ( 6, 10 ] 453 0.512% 99.901% ( 10, 15 ] 58 0.066% 99.966% ( 15, 22 ] 17 0.019% 99.985% ( 22, 34 ] 1 0.001% 99.986% ( 34, 51 ] 1 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.002% 99.991% ( 170, 250 ] 3 0.003% 99.994% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 255610 Average: 3.7174 StdDev: 32.81 Min: 1 Median: 1.6472 Max: 3909 Percentiles: P50: 1.65 P75: 2.19 P99: 9.30 P99.9: 261.75 P99.99: 618.85 ------------------------------------------------------ [ 0, 1 ] 25680 10.047% 10.047% ## ( 1, 2 ] 157783 61.728% 71.775% ############ ( 2, 3 ] 44067 17.240% 89.015% ### ( 3, 4 ] 11881 4.648% 93.663% # ( 4, 6 ] 10118 3.958% 97.621% # ( 6, 10 ] 4267 1.669% 99.290% ( 10, 15 ] 529 0.207% 99.497% ( 15, 22 ] 126 0.049% 99.547% ( 22, 34 ] 31 0.012% 99.559% ( 34, 51 ] 3 0.001% 99.560% ( 51, 76 ] 7 0.003% 99.563% ( 76, 110 ] 286 0.112% 99.675% ( 110, 170 ] 372 0.146% 99.820% ( 170, 250 ] 193 0.076% 99.896% ( 250, 380 ] 126 0.049% 99.945% ( 380, 580 ] 107 0.042% 99.987% ( 580, 870 ] 63 0.025% 100.011% ( 870, 1300 ] 25 0.010% 100.021% ( 1300, 1900 ] 6 0.002% 100.023% ( 1900, 2900 ] 11 0.004% 100.028% ( 2900, 4400 ] 7 0.003% 100.031% ** Level 4 read latency histogram (micros): Count: 320 Average: 173.7469 StdDev: 622.51 Min: 1 Median: 2.5060 Max: 4701 Percentiles: P50: 2.51 P75: 7.04 P99: 3740.00 P99.9: 4701.00 P99.99: 4701.00 ------------------------------------------------------ [ 0, 1 ] 23 7.188% 7.188% # ( 1, 2 ] 95 29.688% 36.875% ###### ( 2, 3 ] 83 25.938% 62.812% ##### ( 3, 4 ] 23 7.188% 70.000% # ( 4, 6 ] 10 3.125% 73.125% # ( 6, 10 ] 23 7.188% 80.312% # ( 10, 15 ] 25 7.812% 88.125% ## ( 15, 22 ] 5 1.562% 89.688% ( 110, 170 ] 1 0.312% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 3 0.938% 92.500% ( 870, 1300 ] 8 2.500% 95.000% # ( 1300, 1900 ] 6 1.875% 96.875% ( 1900, 2900 ] 4 1.250% 98.125% ( 2900, 4400 ] 5 1.562% 99.688% ( 4400, 6600 ] 1 0.312% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 863.9750 StdDev: 1052.05 Min: 76 Median: 354.0000 Max: 4775 Percentiles: P50: 354.00 P75: 1192.50 P99: 4775.00 P99.9: 4775.00 P99.99: 4775.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 3 7.500% 10.000% ## ( 110, 170 ] 8 20.000% 30.000% #### ( 170, 250 ] 4 10.000% 40.000% ## ( 250, 380 ] 5 12.500% 52.500% ### ( 380, 580 ] 3 7.500% 60.000% ## ( 580, 870 ] 3 7.500% 67.500% ## ( 870, 1300 ] 4 10.000% 77.500% ## ( 1300, 1900 ] 3 7.500% 85.000% ## ( 1900, 2900 ] 4 10.000% 95.000% ## ( 2900, 4400 ] 1 2.500% 97.500% # ( 4400, 6600 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 20.8 total, 3.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 284.20 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.068 H:M:S, 24.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.427 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-07:40:39 ... thread 0: (1000000,7000000) ops and (149381.3,256381.0) ops/second in (6.694279,27.303114) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 4.12 GB 182.3 5.8 0.0 5.8 12.4 6.6 0.0 1.9 142.8 305.2 41.46 38.98 116 0.357 6012K 7169 0.0 0.0 L1 13/13 1.45 GB 0.0 2.3 2.3 0.0 2.3 2.3 0.2 1.0 233.6 231.7 9.98 9.66 2 4.991 2367K 18K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.9 1.8 253.1 252.9 1.38 1.32 2 0.689 353K 165 0.0 0.0 L3 20/0 938.32 MB 0.9 1.8 0.8 0.9 1.8 0.8 0.2 2.1 225.8 225.4 8.04 7.38 4 2.011 1844K 3309 0.0 0.0 L4 174/0 9.72 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 124.1 124.1 1.36 0.93 1 1.359 171K 0 0.0 0.0 L5 1040/0 86.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1266/27 102.69 GB 0.0 10.3 3.5 6.9 16.9 10.0 2.7 2.6 170.1 278.0 62.22 58.28 125 0.498 10M 29K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.3 3.5 6.9 16.9 10.0 2.6 2.6 170.1 278.0 62.22 58.28 125 0.498 10M 29K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.3 3.5 6.9 10.3 3.4 0.0 0.0 245.6 244.9 43.10 41.23 29 1.486 10M 29K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 352.4 19.13 17.05 96 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.5 total, 27.3 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.89 GB write, 629.62 MB/s write, 10.34 GB read, 385.35 MB/s read, 62.2 seconds Interval compaction: 16.89 GB write, 633.50 MB/s write, 10.34 GB read, 387.72 MB/s read, 62.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 22, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2519677 Average: 2.2495 StdDev: 12.34 Min: 0 Median: 1.4847 Max: 6224 Percentiles: P50: 1.48 P75: 1.86 P99: 5.70 P99.9: 11.68 P99.99: 140.00 ------------------------------------------------------ [ 0, 1 ] 446684 17.728% 17.728% #### ( 1, 2 ] 1677584 66.579% 84.307% ############# ( 2, 3 ] 244948 9.721% 94.029% ## ( 3, 4 ] 82249 3.264% 97.293% # ( 4, 6 ] 50623 2.009% 99.302% ( 6, 10 ] 14344 0.569% 99.871% ( 10, 15 ] 2158 0.086% 99.957% ( 15, 22 ] 335 0.013% 99.970% ( 22, 34 ] 39 0.002% 99.972% ( 34, 51 ] 12 0.000% 99.972% ( 51, 76 ] 13 0.001% 99.973% ( 76, 110 ] 218 0.009% 99.981% ( 110, 170 ] 438 0.017% 99.999% ( 170, 250 ] 177 0.007% 100.006% ( 250, 380 ] 146 0.006% 100.012% ( 380, 580 ] 122 0.005% 100.016% ( 580, 870 ] 75 0.003% 100.019% ( 870, 1300 ] 35 0.001% 100.021% ( 1300, 1900 ] 16 0.001% 100.021% ( 1900, 2900 ] 9 0.000% 100.022% ( 2900, 4400 ] 11 0.000% 100.022% ( 4400, 6600 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 412156 Average: 2.7952 StdDev: 16.83 Min: 0 Median: 1.5762 Max: 4789 Percentiles: P50: 1.58 P75: 1.95 P99: 8.33 P99.9: 151.50 P99.99: 551.61 ------------------------------------------------------ [ 0, 1 ] 48711 11.819% 11.819% ## ( 1, 2 ] 273124 66.267% 78.086% ############# ( 2, 3 ] 55509 13.468% 91.554% ### ( 3, 4 ] 15371 3.729% 95.283% # ( 4, 6 ] 11931 2.895% 98.178% # ( 6, 10 ] 5825 1.413% 99.591% ( 10, 15 ] 618 0.150% 99.741% ( 15, 22 ] 77 0.019% 99.760% ( 22, 34 ] 7 0.002% 99.761% ( 34, 51 ] 49 0.012% 99.773% ( 51, 76 ] 25 0.006% 99.779% ( 76, 110 ] 270 0.066% 99.845% ( 110, 170 ] 328 0.080% 99.925% ( 170, 250 ] 114 0.028% 99.952% ( 250, 380 ] 88 0.021% 99.974% ( 380, 580 ] 79 0.019% 99.993% ( 580, 870 ] 31 0.008% 100.000% ( 870, 1300 ] 13 0.003% 100.003% ( 1300, 1900 ] 5 0.001% 100.005% ( 1900, 2900 ] 1 0.000% 100.005% ( 2900, 4400 ] 1 0.000% 100.005% ( 4400, 6600 ] 1 0.000% 100.005% ** Level 2 read latency histogram (micros): Count: 88480 Average: 2.0424 StdDev: 3.94 Min: 1 Median: 1.4165 Max: 843 Percentiles: P50: 1.42 P75: 1.82 P99: 5.64 P99.9: 10.00 P99.99: 144.56 ------------------------------------------------------ [ 0, 1 ] 21367 24.149% 24.149% ##### ( 1, 2 ] 54916 62.066% 86.215% ############ ( 2, 3 ] 7077 7.998% 94.213% ## ( 3, 4 ] 2684 3.033% 97.247% # ( 4, 6 ] 1895 2.142% 99.389% ( 6, 10 ] 453 0.512% 99.901% ( 10, 15 ] 58 0.066% 99.966% ( 15, 22 ] 17 0.019% 99.985% ( 22, 34 ] 1 0.001% 99.986% ( 34, 51 ] 1 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.002% 99.991% ( 170, 250 ] 3 0.003% 99.994% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 255610 Average: 3.7174 StdDev: 32.81 Min: 1 Median: 1.6472 Max: 3909 Percentiles: P50: 1.65 P75: 2.19 P99: 9.30 P99.9: 261.75 P99.99: 618.85 ------------------------------------------------------ [ 0, 1 ] 25680 10.047% 10.047% ## ( 1, 2 ] 157783 61.728% 71.775% ############ ( 2, 3 ] 44067 17.240% 89.015% ### ( 3, 4 ] 11881 4.648% 93.663% # ( 4, 6 ] 10118 3.958% 97.621% # ( 6, 10 ] 4267 1.669% 99.290% ( 10, 15 ] 529 0.207% 99.497% ( 15, 22 ] 126 0.049% 99.547% ( 22, 34 ] 31 0.012% 99.559% ( 34, 51 ] 3 0.001% 99.560% ( 51, 76 ] 7 0.003% 99.563% ( 76, 110 ] 286 0.112% 99.675% ( 110, 170 ] 372 0.146% 99.820% ( 170, 250 ] 193 0.076% 99.896% ( 250, 380 ] 126 0.049% 99.945% ( 380, 580 ] 107 0.042% 99.987% ( 580, 870 ] 63 0.025% 100.011% ( 870, 1300 ] 25 0.010% 100.021% ( 1300, 1900 ] 6 0.002% 100.023% ( 1900, 2900 ] 11 0.004% 100.028% ( 2900, 4400 ] 7 0.003% 100.031% ** Level 4 read latency histogram (micros): Count: 320 Average: 173.7469 StdDev: 622.51 Min: 1 Median: 2.5060 Max: 4701 Percentiles: P50: 2.51 P75: 7.04 P99: 3740.00 P99.9: 4701.00 P99.99: 4701.00 ------------------------------------------------------ [ 0, 1 ] 23 7.188% 7.188% # ( 1, 2 ] 95 29.688% 36.875% ###### ( 2, 3 ] 83 25.938% 62.812% ##### ( 3, 4 ] 23 7.188% 70.000% # ( 4, 6 ] 10 3.125% 73.125% # ( 6, 10 ] 23 7.188% 80.312% # ( 10, 15 ] 25 7.812% 88.125% ## ( 15, 22 ] 5 1.562% 89.688% ( 110, 170 ] 1 0.312% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 3 0.938% 92.500% ( 870, 1300 ] 8 2.500% 95.000% # ( 1300, 1900 ] 6 1.875% 96.875% ( 1900, 2900 ] 4 1.250% 98.125% ( 2900, 4400 ] 5 1.562% 99.688% ( 4400, 6600 ] 1 0.312% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 863.9750 StdDev: 1052.05 Min: 76 Median: 354.0000 Max: 4775 Percentiles: P50: 354.00 P75: 1192.50 P99: 4775.00 P99.9: 4775.00 P99.99: 4775.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 3 7.500% 10.000% ## ( 110, 170 ] 8 20.000% 30.000% #### ( 170, 250 ] 4 10.000% 40.000% ## ( 250, 380 ] 5 12.500% 52.500% ### ( 380, 580 ] 3 7.500% 60.000% ## ( 580, 870 ] 3 7.500% 67.500% ## ( 870, 1300 ] 4 10.000% 77.500% ## ( 1300, 1900 ] 3 7.500% 85.000% ## ( 1900, 2900 ] 4 10.000% 95.000% ## ( 2900, 4400 ] 1 2.500% 97.500% # ( 4400, 6600 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 27.5 total, 6.7 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 250.77 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.026 H:M:S, 32.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 147.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.957 H:M:S, 59.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-07:40:51 ... thread 0: (1000000,8000000) ops and (87403.9,206482.2) ops/second in (11.441137,38.744251) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/14 3.07 GB 37.8 6.5 0.0 6.5 14.1 7.6 0.0 1.9 139.6 302.7 47.83 44.53 135 0.354 6779K 7965 0.0 0.0 L1 17/17 1.98 GB 0.0 5.8 4.4 1.5 5.7 4.3 0.2 1.3 229.4 226.6 25.96 24.96 3 8.654 6046K 71K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 2.4 1.8 253.1 252.9 1.38 1.32 2 0.689 353K 165 0.0 0.0 L3 20/0 940.79 MB 0.9 4.4 2.3 2.1 4.4 2.3 0.2 1.9 208.5 207.6 21.65 19.38 12 1.804 4584K 19K 0.0 0.0 L4 177/0 9.48 GB 1.0 1.6 1.6 0.1 1.6 1.6 0.8 1.0 145.2 145.0 11.45 7.92 22 0.520 1676K 2205 0.0 0.0 L5 1060/0 88.22 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1290/31 103.66 GB 0.0 18.7 8.5 10.3 26.2 16.0 6.0 3.4 176.9 248.1 108.27 98.11 174 0.622 19M 101K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.7 8.5 10.3 26.2 16.0 6.0 3.4 176.9 248.1 108.27 98.11 174 0.622 19M 101K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.7 8.5 10.3 18.6 8.4 0.0 0.0 223.6 222.4 85.66 78.33 62 1.382 19M 101K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 345.5 22.61 19.78 112 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.9 total, 38.7 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.24 GB write, 690.37 MB/s write, 18.71 GB read, 492.27 MB/s read, 108.3 seconds Interval compaction: 26.24 GB write, 693.37 MB/s write, 18.71 GB read, 494.41 MB/s read, 108.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 24, pending-compaction-bytes-stops: 0, total-delays: 48, total-stops: 29, interval: 77 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3182485 Average: 2.4234 StdDev: 18.07 Min: 0 Median: 1.5068 Max: 11619 Percentiles: P50: 1.51 P75: 1.89 P99: 5.93 P99.9: 14.01 P99.99: 233.01 ------------------------------------------------------ [ 0, 1 ] 540060 16.970% 16.970% ### ( 1, 2 ] 2074011 65.170% 82.139% ############# ( 2, 3 ] 335785 10.551% 92.690% ## ( 3, 4 ] 117840 3.703% 96.393% # ( 4, 6 ] 86160 2.707% 99.100% # ( 6, 10 ] 22828 0.717% 99.818% ( 10, 15 ] 3266 0.103% 99.920% ( 15, 22 ] 476 0.015% 99.935% ( 22, 34 ] 48 0.002% 99.937% ( 34, 51 ] 13 0.000% 99.937% ( 51, 76 ] 26 0.001% 99.938% ( 76, 110 ] 552 0.017% 99.955% ( 110, 170 ] 821 0.026% 99.981% ( 170, 250 ] 359 0.011% 99.992% ( 250, 380 ] 327 0.010% 100.003% ( 380, 580 ] 286 0.009% 100.012% ( 580, 870 ] 159 0.005% 100.017% ( 870, 1300 ] 82 0.003% 100.019% ( 1300, 1900 ] 35 0.001% 100.020% ( 1900, 2900 ] 16 0.001% 100.021% ( 2900, 4400 ] 19 0.001% 100.021% ( 4400, 6600 ] 4 0.000% 100.022% ( 6600, 9900 ] 1 0.000% 100.022% ( 9900, 14000 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 991026 Average: 3.3220 StdDev: 45.22 Min: 0 Median: 1.6309 Max: 14392 Percentiles: P50: 1.63 P75: 2.16 P99: 8.49 P99.9: 132.99 P99.99: 352.72 ------------------------------------------------------ [ 0, 1 ] 112555 11.357% 11.357% ## ( 1, 2 ] 606972 61.247% 72.604% ############ ( 2, 3 ] 147837 14.918% 87.522% ### ( 3, 4 ] 55389 5.589% 93.111% # ( 4, 6 ] 48512 4.895% 98.006% # ( 6, 10 ] 15798 1.594% 99.600% ( 10, 15 ] 1892 0.191% 99.791% ( 15, 22 ] 242 0.024% 99.815% ( 22, 34 ] 15 0.002% 99.817% ( 34, 51 ] 51 0.005% 99.822% ( 51, 76 ] 47 0.005% 99.827% ( 76, 110 ] 469 0.047% 99.874% ( 110, 170 ] 668 0.067% 99.942% ( 170, 250 ] 295 0.030% 99.971% ( 250, 380 ] 234 0.024% 99.995% ( 380, 580 ] 235 0.024% 100.019% ( 580, 870 ] 152 0.015% 100.034% ( 870, 1300 ] 81 0.008% 100.042% ( 1300, 1900 ] 34 0.003% 100.046% ( 1900, 2900 ] 15 0.002% 100.047% ( 2900, 4400 ] 22 0.002% 100.049% ( 4400, 6600 ] 14 0.001% 100.051% ( 6600, 9900 ] 4 0.000% 100.051% ( 9900, 14000 ] 2 0.000% 100.051% ( 14000, 22000 ] 2 0.000% 100.052% ** Level 2 read latency histogram (micros): Count: 88480 Average: 2.0424 StdDev: 3.94 Min: 1 Median: 1.4165 Max: 843 Percentiles: P50: 1.42 P75: 1.82 P99: 5.64 P99.9: 10.00 P99.99: 144.56 ------------------------------------------------------ [ 0, 1 ] 21367 24.149% 24.149% ##### ( 1, 2 ] 54916 62.066% 86.215% ############ ( 2, 3 ] 7077 7.998% 94.213% ## ( 3, 4 ] 2684 3.033% 97.247% # ( 4, 6 ] 1895 2.142% 99.389% ( 6, 10 ] 453 0.512% 99.901% ( 10, 15 ] 58 0.066% 99.966% ( 15, 22 ] 17 0.019% 99.985% ( 22, 34 ] 1 0.001% 99.986% ( 34, 51 ] 1 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.002% 99.991% ( 170, 250 ] 3 0.003% 99.994% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 886861 Average: 3.7834 StdDev: 37.73 Min: 1 Median: 1.8579 Max: 6128 Percentiles: P50: 1.86 P75: 2.80 P99: 8.70 P99.9: 18.32 P99.99: 131.48 ------------------------------------------------------ [ 0, 1 ] 35106 3.958% 3.958% # ( 1, 2 ] 475932 53.665% 57.623% ########### ( 2, 3 ] 192121 21.663% 79.286% #### ( 3, 4 ] 82084 9.256% 88.542% ## ( 4, 6 ] 81724 9.215% 97.757% ## ( 6, 10 ] 16352 1.844% 99.601% ( 10, 15 ] 2502 0.282% 99.883% ( 15, 22 ] 323 0.036% 99.919% ( 22, 34 ] 45 0.005% 99.924% ( 34, 51 ] 11 0.001% 99.925% ( 51, 76 ] 26 0.003% 99.928% ( 76, 110 ] 353 0.040% 99.968% ( 110, 170 ] 540 0.061% 100.029% ( 170, 250 ] 397 0.045% 100.074% ( 250, 380 ] 288 0.032% 100.106% ( 380, 580 ] 248 0.028% 100.134% ( 580, 870 ] 151 0.017% 100.151% ( 870, 1300 ] 92 0.010% 100.162% ( 1300, 1900 ] 22 0.002% 100.164% ( 1900, 2900 ] 25 0.003% 100.167% ( 2900, 4400 ] 37 0.004% 100.171% ( 4400, 6600 ] 11 0.001% 100.172% ** Level 4 read latency histogram (micros): Count: 16150 Average: 75.8613 StdDev: 332.90 Min: 1 Median: 2.1653 Max: 7675 Percentiles: P50: 2.17 P75: 3.54 P99: 1597.32 P99.9: 4088.07 P99.99: 6092.43 ------------------------------------------------------ [ 0, 1 ] 315 1.950% 1.950% ( 1, 2 ] 7165 44.365% 46.316% ######### ( 2, 3 ] 3599 22.285% 68.601% #### ( 3, 4 ] 1914 11.851% 80.452% ## ( 4, 6 ] 1242 7.690% 88.142% ## ( 6, 10 ] 371 2.297% 90.440% ( 10, 15 ] 87 0.539% 90.978% ( 15, 22 ] 23 0.142% 91.121% ( 22, 34 ] 5 0.031% 91.152% ( 34, 51 ] 1 0.006% 91.158% ( 76, 110 ] 18 0.111% 91.269% ( 110, 170 ] 62 0.384% 91.653% ( 170, 250 ] 122 0.755% 92.409% ( 250, 380 ] 198 1.226% 93.635% ( 380, 580 ] 283 1.752% 95.387% ( 580, 870 ] 315 1.950% 97.337% ( 870, 1300 ] 213 1.319% 98.656% ( 1300, 1900 ] 112 0.693% 99.350% ( 1900, 2900 ] 54 0.334% 99.684% ( 2900, 4400 ] 44 0.272% 99.957% ( 4400, 6600 ] 7 0.043% 100.000% ( 6600, 9900 ] 2 0.012% 100.012% ** Level 5 read latency histogram (micros): Count: 140 Average: 900.4286 StdDev: 1053.37 Min: 76 Median: 403.5294 Max: 4775 Percentiles: P50: 403.53 P75: 1420.00 P99: 4775.00 P99.9: 4775.00 P99.99: 4775.00 ------------------------------------------------------ ( 51, 76 ] 1 0.714% 0.714% ( 76, 110 ] 12 8.571% 9.286% ## ( 110, 170 ] 26 18.571% 27.857% #### ( 170, 250 ] 13 9.286% 37.143% ## ( 250, 380 ] 16 11.429% 48.571% ## ( 380, 580 ] 17 12.143% 60.714% ## ( 580, 870 ] 8 5.714% 66.429% # ( 870, 1300 ] 9 6.429% 72.857% # ( 1300, 1900 ] 15 10.714% 83.571% ## ( 1900, 2900 ] 16 11.429% 95.000% ## ( 2900, 4400 ] 5 3.571% 98.571% # ( 4400, 6600 ] 2 1.429% 100.000% ** DB Stats ** Uptime(secs): 38.9 total, 11.4 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 202.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.372 H:M:S, 44.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 86.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:8.347 H:M:S, 73.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-07:41:07 ... thread 0: (1000000,9000000) ops and (64139.9,165638.6) ops/second in (15.590908,54.335159) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/9 1.60 GB 0.0 7.6 0.0 7.6 16.2 8.6 0.0 1.9 141.3 302.0 54.82 51.11 154 0.356 7867K 9058 0.0 0.0 L1 11/11 1.37 GB 0.0 10.2 6.8 3.4 10.1 6.7 0.2 1.5 225.0 221.7 46.65 43.92 4 11.662 9593K 71K 0.0 0.0 L2 23/18 2.52 GB 4.9 0.3 0.2 0.2 0.3 0.2 5.3 1.8 253.1 252.9 1.38 1.32 2 0.689 353K 165 0.0 0.0 L3 25/10 1.38 GB 0.8 4.4 2.3 2.1 4.4 2.3 0.7 1.9 208.5 207.6 21.65 19.38 12 1.804 4584K 19K 0.0 0.0 L4 177/0 9.48 GB 1.0 1.6 1.6 0.1 1.6 1.6 0.8 1.0 145.2 145.0 11.45 7.92 22 0.520 1676K 2205 0.0 0.0 L5 1060/0 88.22 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1305/48 104.57 GB 0.0 24.2 10.9 13.3 32.6 19.3 9.5 3.8 182.2 245.7 135.94 123.66 194 0.701 24M 102K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.2 10.9 13.3 32.6 19.3 9.4 3.8 182.2 245.7 135.94 123.66 194 0.701 24M 102K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.2 10.9 13.3 24.0 10.7 0.0 0.0 224.3 222.6 110.44 101.29 67 1.648 24M 102K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 345.9 25.50 22.36 127 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.5 total, 54.3 interval Flush(GB): cumulative 8.613, interval 8.613 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.62 GB write, 612.87 MB/s write, 24.19 GB read, 454.41 MB/s read, 135.9 seconds Interval compaction: 32.62 GB write, 614.76 MB/s write, 24.19 GB read, 455.82 MB/s read, 135.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 29, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 29, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 31, pending-compaction-bytes-stops: 0, total-delays: 60, total-stops: 31, interval: 91 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3787021 Average: 2.5882 StdDev: 21.31 Min: 0 Median: 1.4885 Max: 11619 Percentiles: P50: 1.49 P75: 1.87 P99: 5.97 P99.9: 115.17 P99.99: 368.38 ------------------------------------------------------ [ 0, 1 ] 690725 18.239% 18.239% #### ( 1, 2 ] 2462374 65.021% 83.261% ############# ( 2, 3 ] 372275 9.830% 93.091% ## ( 3, 4 ] 130161 3.437% 96.528% # ( 4, 6 ] 94909 2.506% 99.034% # ( 6, 10 ] 25503 0.673% 99.708% ( 10, 15 ] 3701 0.098% 99.805% ( 15, 22 ] 570 0.015% 99.820% ( 22, 34 ] 52 0.001% 99.822% ( 34, 51 ] 14 0.000% 99.822% ( 51, 76 ] 231 0.006% 99.828% ( 76, 110 ] 2513 0.066% 99.895% ( 110, 170 ] 2389 0.063% 99.958% ( 170, 250 ] 678 0.018% 99.976% ( 250, 380 ] 601 0.016% 99.991% ( 380, 580 ] 502 0.013% 100.005% ( 580, 870 ] 288 0.008% 100.012% ( 870, 1300 ] 136 0.004% 100.016% ( 1300, 1900 ] 57 0.002% 100.017% ( 1900, 2900 ] 25 0.001% 100.018% ( 2900, 4400 ] 36 0.001% 100.019% ( 4400, 6600 ] 7 0.000% 100.019% ( 6600, 9900 ] 1 0.000% 100.019% ( 9900, 14000 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 1581889 Average: 3.2170 StdDev: 40.63 Min: 0 Median: 1.5341 Max: 14392 Percentiles: P50: 1.53 P75: 1.96 P99: 8.37 P99.9: 141.23 P99.99: 341.00 ------------------------------------------------------ [ 0, 1 ] 290292 18.351% 18.351% #### ( 1, 2 ] 937380 59.257% 77.608% ############ ( 2, 3 ] 184328 11.652% 89.260% ## ( 3, 4 ] 72958 4.612% 93.872% # ( 4, 6 ] 68841 4.352% 98.224% # ( 6, 10 ] 20752 1.312% 99.536% ( 10, 15 ] 2730 0.173% 99.709% ( 15, 22 ] 422 0.027% 99.735% ( 22, 34 ] 30 0.002% 99.737% ( 34, 51 ] 64 0.004% 99.741% ( 51, 76 ] 233 0.015% 99.756% ( 76, 110 ] 1501 0.095% 99.851% ( 110, 170 ] 1497 0.095% 99.946% ( 170, 250 ] 430 0.027% 99.973% ( 250, 380 ] 394 0.025% 99.998% ( 380, 580 ] 388 0.025% 100.022% ( 580, 870 ] 260 0.016% 100.039% ( 870, 1300 ] 123 0.008% 100.046% ( 1300, 1900 ] 56 0.004% 100.050% ( 1900, 2900 ] 27 0.002% 100.052% ( 2900, 4400 ] 41 0.003% 100.054% ( 4400, 6600 ] 15 0.001% 100.055% ( 6600, 9900 ] 4 0.000% 100.055% ( 9900, 14000 ] 2 0.000% 100.056% ( 14000, 22000 ] 2 0.000% 100.056% ** Level 2 read latency histogram (micros): Count: 88480 Average: 2.0424 StdDev: 3.94 Min: 1 Median: 1.4165 Max: 843 Percentiles: P50: 1.42 P75: 1.82 P99: 5.64 P99.9: 10.00 P99.99: 144.56 ------------------------------------------------------ [ 0, 1 ] 21367 24.149% 24.149% ##### ( 1, 2 ] 54916 62.066% 86.215% ############ ( 2, 3 ] 7077 7.998% 94.213% ## ( 3, 4 ] 2684 3.033% 97.247% # ( 4, 6 ] 1895 2.142% 99.389% ( 6, 10 ] 453 0.512% 99.901% ( 10, 15 ] 58 0.066% 99.966% ( 15, 22 ] 17 0.019% 99.985% ( 22, 34 ] 1 0.001% 99.986% ( 34, 51 ] 1 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.002% 99.991% ( 170, 250 ] 3 0.003% 99.994% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 903711 Average: 3.9791 StdDev: 40.32 Min: 1 Median: 1.8647 Max: 6128 Percentiles: P50: 1.86 P75: 2.82 P99: 8.83 P99.9: 80.80 P99.99: 164.88 ------------------------------------------------------ [ 0, 1 ] 35183 3.893% 3.893% # ( 1, 2 ] 481882 53.323% 57.216% ########### ( 2, 3 ] 196703 21.766% 78.982% #### ( 3, 4 ] 84365 9.335% 88.317% ## ( 4, 6 ] 84459 9.346% 97.663% ## ( 6, 10 ] 17106 1.893% 99.556% ( 10, 15 ] 2633 0.291% 99.847% ( 15, 22 ] 338 0.037% 99.885% ( 22, 34 ] 46 0.005% 99.890% ( 34, 51 ] 12 0.001% 99.891% ( 51, 76 ] 30 0.003% 99.894% ( 76, 110 ] 356 0.039% 99.934% ( 110, 170 ] 555 0.061% 99.995% ( 170, 250 ] 458 0.051% 100.046% ( 250, 380 ] 371 0.041% 100.087% ( 380, 580 ] 317 0.035% 100.122% ( 580, 870 ] 212 0.023% 100.146% ( 870, 1300 ] 108 0.012% 100.157% ( 1300, 1900 ] 34 0.004% 100.161% ( 1900, 2900 ] 30 0.003% 100.165% ( 2900, 4400 ] 41 0.005% 100.169% ( 4400, 6600 ] 12 0.001% 100.170% ** Level 4 read latency histogram (micros): Count: 16150 Average: 75.8613 StdDev: 332.90 Min: 1 Median: 2.1653 Max: 7675 Percentiles: P50: 2.17 P75: 3.54 P99: 1597.32 P99.9: 4088.07 P99.99: 6092.43 ------------------------------------------------------ [ 0, 1 ] 315 1.950% 1.950% ( 1, 2 ] 7165 44.365% 46.316% ######### ( 2, 3 ] 3599 22.285% 68.601% #### ( 3, 4 ] 1914 11.851% 80.452% ## ( 4, 6 ] 1242 7.690% 88.142% ## ( 6, 10 ] 371 2.297% 90.440% ( 10, 15 ] 87 0.539% 90.978% ( 15, 22 ] 23 0.142% 91.121% ( 22, 34 ] 5 0.031% 91.152% ( 34, 51 ] 1 0.006% 91.158% ( 76, 110 ] 18 0.111% 91.269% ( 110, 170 ] 62 0.384% 91.653% ( 170, 250 ] 122 0.755% 92.409% ( 250, 380 ] 198 1.226% 93.635% ( 380, 580 ] 283 1.752% 95.387% ( 580, 870 ] 315 1.950% 97.337% ( 870, 1300 ] 213 1.319% 98.656% ( 1300, 1900 ] 112 0.693% 99.350% ( 1900, 2900 ] 54 0.334% 99.684% ( 2900, 4400 ] 44 0.272% 99.957% ( 4400, 6600 ] 7 0.043% 100.000% ( 6600, 9900 ] 2 0.012% 100.012% ** Level 5 read latency histogram (micros): Count: 140 Average: 900.4286 StdDev: 1053.37 Min: 76 Median: 403.5294 Max: 4775 Percentiles: P50: 403.53 P75: 1420.00 P99: 4775.00 P99.9: 4775.00 P99.99: 4775.00 ------------------------------------------------------ ( 51, 76 ] 1 0.714% 0.714% ( 76, 110 ] 12 8.571% 9.286% ## ( 110, 170 ] 26 18.571% 27.857% #### ( 170, 250 ] 13 9.286% 37.143% ## ( 250, 380 ] 16 11.429% 48.571% ## ( 380, 580 ] 17 12.143% 60.714% ## ( 580, 870 ] 8 5.714% 66.429% # ( 870, 1300 ] 9 6.429% 72.857% # ( 1300, 1900 ] 15 10.714% 83.571% ## ( 1900, 2900 ] 16 11.429% 95.000% ## ( 2900, 4400 ] 5 3.571% 98.571% # ( 4400, 6600 ] 2 1.429% 100.000% ** DB Stats ** Uptime(secs): 54.5 total, 15.6 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 162.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:30.140 H:M:S, 55.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 63.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:12.768 H:M:S, 81.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.176 micros/op 161919 ops/sec 60.468 seconds 9790999 operations; 156.9 MB/s Microseconds per write: Count: 9790999 Average: 6.1758 StdDev: 346.71 Min: 0 Median: 1.7259 Max: 542060 Percentiles: P50: 1.73 P75: 2.72 P99: 8.74 P99.9: 1192.98 P99.99: 2753.19 ------------------------------------------------------ [ 0, 1 ] 1405151 14.351% 14.351% ### ( 1, 2 ] 4808181 49.108% 63.460% ########## ( 2, 3 ] 1565997 15.994% 79.454% ### ( 3, 4 ] 1335043 13.635% 93.089% ### ( 4, 6 ] 510338 5.212% 98.302% # ( 6, 10 ] 99719 1.018% 99.320% ( 10, 15 ] 25573 0.261% 99.581% ( 15, 22 ] 6679 0.068% 99.649% ( 22, 34 ] 1458 0.015% 99.664% ( 34, 51 ] 200 0.002% 99.666% ( 51, 76 ] 46 0.000% 99.667% ( 76, 110 ] 6886 0.070% 99.737% ( 110, 170 ] 2706 0.028% 99.765% ( 170, 250 ] 258 0.003% 99.768% ( 250, 380 ] 99 0.001% 99.769% ( 380, 580 ] 25 0.000% 99.769% ( 580, 870 ] 26 0.000% 99.769% ( 870, 1300 ] 17072 0.174% 99.943% ( 1300, 1900 ] 134 0.001% 99.945% ( 1900, 2900 ] 5191 0.053% 99.998% ( 2900, 4400 ] 151 0.002% 99.999% ( 4400, 6600 ] 29 0.000% 100.000% ( 6600, 9900 ] 13 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 11 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 214733 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9790999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10104310968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 605 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33922093 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 33887445010 rocksdb.compact.write.bytes COUNT : 33666361343 rocksdb.flush.write.bytes COUNT : 10040774260 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 66 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 279 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9959747584 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3807232 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 33988915502 rocksdb.non.last.level.read.count COUNT : 8211253 rocksdb.block.checksum.compute.count COUNT : 8210109 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.371892 P95 : 3.879623 P99 : 7.259592 P100 : 542057.000000 COUNT : 9790999 SUM : 56035389 rocksdb.compaction.times.micros P50 : 966857.142857 P95 : 3740000.000000 P99 : 17840000.000000 P100 : 20684425.000000 COUNT : 104 SUM : 151902799 rocksdb.compaction.times.cpu_micros P50 : 818571.428571 P95 : 3273333.333333 P99 : 17840000.000000 P100 : 18960153.000000 COUNT : 104 SUM : 129384023 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 704.285714 P95 : 1340.000000 P99 : 16560.000000 P100 : 21693.000000 COUNT : 136 SUM : 148021 rocksdb.compaction.outfile.sync.micros P50 : 1113.154762 P95 : 85625.000000 P99 : 161375.000000 P100 : 200995.000000 COUNT : 415 SUM : 5302117 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 104.551282 P95 : 1396.666667 P99 : 3887.000000 P100 : 4507.000000 COUNT : 271 SUM : 86150 rocksdb.table.open.io.micros P50 : 1364.655172 P95 : 7138.043478 P99 : 12155.000000 P100 : 22053.000000 COUNT : 605 SUM : 1263275 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.695908 P95 : 8.074421 P99 : 11.041524 P100 : 27273.000000 COUNT : 8208473 SUM : 50355584 rocksdb.read.block.get.micros P50 : 455.159236 P95 : 3360.526316 P99 : 5430.526316 P100 : 8857.000000 COUNT : 1210 SUM : 1032450 rocksdb.write.raw.block.micros P50 : 0.513630 P95 : 0.975897 P99 : 2.986164 P100 : 32371.000000 COUNT : 10587741 SUM : 20999803 rocksdb.numfiles.in.singlecompaction P50 : 3.031250 P95 : 6.600000 P99 : 25.120000 P100 : 27.000000 COUNT : 148 SUM : 543 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558561 P95 : 1166.222642 P99 : 2519.479489 P100 : 541815.000000 COUNT : 215753 SUM : 33938477 rocksdb.sst.read.micros P50 : 1.632432 P95 : 4.912090 P99 : 8.564795 P100 : 27267.000000 COUNT : 8211640 SUM : 33597528 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9790999 SUM : 10104310968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214705.882353 P95 : 360842.105263 P99 : 706480.000000 P100 : 706480.000000 COUNT : 136 SUM : 28983690 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 379 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0