[2024-11-17 17:44:20.503670] Starting SPDK v25.01-pre git sha1 83e8405e4 / DPDK 22.11.4 initialization... [2024-11-17 17:44:20.503934] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid178985 ] Set seed to 1731861860496847 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-17 17:44:20.604894] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-17 17:44:20.626468] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-17 17:44:20.626524] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 178985' to capture a snapshot of events at runtime. [2024-11-17 17:44:20.626535] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-17 17:44:20.626549] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-17 17:44:20.626557] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid178985 for offline analysis/debug. [2024-11-17 17:44:20.627108] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 17 17:44:24 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/17-17:44:27 ... thread 0: (1000000,1000000) ops and (346079.6,346079.6) ops/second in (2.889509,2.889509) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/8 504.01 MB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 345.0 2.37 2.14 12 0.198 0 0 0.0 0.0 L1 3/3 188.89 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 260.5 260.4 0.73 0.69 1 0.725 191K 70 0.0 0.0 L2 2/1 125.96 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 220.1 220.0 0.57 0.55 1 0.573 127K 45 0.0 0.0 L3 12/0 993.20 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/12 96.94 GB 0.0 0.3 0.2 0.1 1.1 1.0 0.4 1.4 85.8 308.8 3.67 3.38 14 0.262 319K 115 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.1 1.1 1.0 0.4 1.4 85.8 308.8 3.67 3.38 14 0.262 319K 115 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 0.0 242.7 242.6 1.30 1.24 2 0.649 319K 115 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 345.0 2.37 2.14 12 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.11 GB write, 364.32 MB/s write, 0.31 GB read, 101.21 MB/s read, 3.7 seconds Interval compaction: 1.11 GB write, 392.18 MB/s write, 0.31 GB read, 108.95 MB/s read, 3.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 119533 Average: 1.9218 StdDev: 18.18 Min: 1 Median: 1.2147 Max: 3576 Percentiles: P50: 1.21 P75: 1.68 P99: 5.24 P99.9: 11.50 P99.99: 197.91 ------------------------------------------------------ [ 0, 1 ] 45966 38.455% 38.455% ######## ( 1, 2 ] 64267 53.765% 92.220% ########### ( 2, 3 ] 4943 4.135% 96.355% # ( 3, 4 ] 2313 1.935% 98.290% ( 4, 6 ] 1368 1.144% 99.434% ( 6, 10 ] 525 0.439% 99.874% ( 10, 15 ] 108 0.090% 99.964% ( 15, 22 ] 16 0.013% 99.977% ( 22, 34 ] 5 0.004% 99.982% ( 51, 76 ] 1 0.001% 99.982% ( 76, 110 ] 1 0.001% 99.983% ( 110, 170 ] 8 0.007% 99.990% ( 170, 250 ] 3 0.003% 99.992% ( 250, 380 ] 5 0.004% 99.997% ( 380, 580 ] 2 0.002% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ( 1300, 1900 ] 1 0.001% 100.001% ( 2900, 4400 ] 3 0.003% 100.003% ** Level 1 read latency histogram (micros): Count: 23632 Average: 2.0656 StdDev: 26.10 Min: 0 Median: 1.2214 Max: 2794 Percentiles: P50: 1.22 P75: 1.67 P99: 4.38 P99.9: 9.82 P99.99: 1143.82 ------------------------------------------------------ [ 0, 1 ] 8879 37.572% 37.572% ######## ( 1, 2 ] 13264 56.127% 93.699% ########### ( 2, 3 ] 894 3.783% 97.482% # ( 3, 4 ] 317 1.341% 98.824% ( 4, 6 ] 219 0.927% 99.750% ( 6, 10 ] 37 0.157% 99.907% ( 10, 15 ] 13 0.055% 99.962% ( 110, 170 ] 1 0.004% 99.966% ( 170, 250 ] 3 0.013% 99.979% ( 250, 380 ] 1 0.004% 99.983% ( 380, 580 ] 1 0.004% 99.987% ( 870, 1300 ] 1 0.004% 99.992% ( 1900, 2900 ] 2 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 8639 Average: 2.6500 StdDev: 9.14 Min: 1 Median: 1.6422 Max: 676 Percentiles: P50: 1.64 P75: 2.23 P99: 8.85 P99.9: 14.89 P99.99: 619.47 ------------------------------------------------------ [ 0, 1 ] 897 10.383% 10.383% ## ( 1, 2 ] 5331 61.709% 72.092% ############ ( 2, 3 ] 1085 12.559% 84.651% ### ( 3, 4 ] 663 7.674% 92.326% ## ( 4, 6 ] 459 5.313% 97.639% # ( 6, 10 ] 168 1.945% 99.583% ( 10, 15 ] 30 0.347% 99.931% ( 15, 22 ] 5 0.058% 99.988% ( 51, 76 ] 1 0.012% 100.000% ( 380, 580 ] 1 0.012% 100.012% ( 580, 870 ] 1 0.012% 100.023% ** Level 3 read latency histogram (micros): Count: 55 Average: 1388.5818 StdDev: 1119.83 Min: 86 Median: 1031.2500 Max: 4007 Percentiles: P50: 1031.25 P75: 2380.77 P99: 4007.00 P99.9: 4007.00 P99.99: 4007.00 ------------------------------------------------------ ( 76, 110 ] 1 1.818% 1.818% ( 110, 170 ] 2 3.636% 5.455% # ( 170, 250 ] 2 3.636% 9.091% # ( 250, 380 ] 8 14.545% 23.636% ### ( 380, 580 ] 7 12.727% 36.364% ### ( 580, 870 ] 6 10.909% 47.273% ## ( 870, 1300 ] 4 7.273% 54.545% # ( 1300, 1900 ] 5 9.091% 63.636% ## ( 1900, 2900 ] 13 23.636% 87.273% ##### ( 2900, 4400 ] 7 12.727% 100.000% ### ** Level 4 read latency histogram (micros): Count: 20 Average: 1405.8000 StdDev: 1114.28 Min: 143 Median: 1192.5000 Max: 3670 Percentiles: P50: 1192.50 P75: 1900.00 P99: 3670.00 P99.9: 3670.00 P99.99: 3670.00 ------------------------------------------------------ ( 110, 170 ] 2 10.000% 10.000% ## ( 170, 250 ] 2 10.000% 20.000% ## ( 250, 380 ] 1 5.000% 25.000% # ( 580, 870 ] 2 10.000% 35.000% ## ( 870, 1300 ] 4 20.000% 55.000% #### ( 1300, 1900 ] 4 20.000% 75.000% #### ( 1900, 2900 ] 2 10.000% 85.000% ## ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 316.20 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.220 H:M:S, 7.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 340.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.220 H:M:S, 7.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/17-17:44:30 ... thread 0: (1000000,2000000) ops and (335286.7,340597.7) ops/second in (2.982522,5.872031) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.23 GB 100.7 0.8 0.0 0.8 2.6 1.8 0.0 1.4 96.8 312.8 8.46 7.82 30 0.282 831K 856 0.0 0.0 L1 1/0 4.58 MB 0.5 0.6 0.4 0.2 0.6 0.4 0.1 1.4 244.9 244.6 2.57 2.49 2 1.286 639K 829 0.0 0.0 L2 2/1 50.60 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 220.1 220.0 0.57 0.55 1 0.573 127K 45 0.0 0.0 L3 18/8 1.05 GB 0.4 0.1 0.1 0.0 0.1 0.1 0.5 1.0 209.9 209.9 0.59 0.53 1 0.594 126K 0 0.0 0.0 L4 173/0 9.71 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 102.7 102.7 1.09 0.69 1 1.090 113K 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/13 97.92 GB 0.0 1.8 0.7 1.0 3.6 2.5 1.8 2.0 136.4 273.7 13.28 12.08 35 0.380 1839K 1730 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.7 1.0 3.6 2.5 1.8 2.0 136.4 273.7 13.28 12.08 35 0.380 1839K 1730 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.7 1.0 1.8 0.7 0.0 0.0 224.7 224.5 8.06 7.43 8 1.008 1839K 1730 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 349.8 5.22 4.66 27 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.55 GB write, 596.67 MB/s write, 1.77 GB read, 297.21 MB/s read, 13.3 seconds Interval compaction: 3.55 GB write, 619.13 MB/s write, 1.77 GB read, 308.39 MB/s read, 13.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 393659 Average: 2.1927 StdDev: 14.07 Min: 1 Median: 1.4669 Max: 3654 Percentiles: P50: 1.47 P75: 1.86 P99: 5.74 P99.9: 11.22 P99.99: 15.66 ------------------------------------------------------ [ 0, 1 ] 80721 20.505% 20.505% #### ( 1, 2 ] 248665 63.168% 83.673% ############# ( 2, 3 ] 37734 9.585% 93.258% ## ( 3, 4 ] 14584 3.705% 96.963% # ( 4, 6 ] 9235 2.346% 99.309% ( 6, 10 ] 2215 0.563% 99.872% ( 10, 15 ] 461 0.117% 99.989% ( 15, 22 ] 60 0.015% 100.004% ( 22, 34 ] 11 0.003% 100.007% ( 34, 51 ] 3 0.001% 100.008% ( 51, 76 ] 3 0.001% 100.008% ( 76, 110 ] 1 0.000% 100.009% ( 110, 170 ] 9 0.002% 100.011% ( 170, 250 ] 16 0.004% 100.015% ( 250, 380 ] 10 0.003% 100.018% ( 380, 580 ] 5 0.001% 100.019% ( 580, 870 ] 6 0.002% 100.020% ( 870, 1300 ] 6 0.002% 100.022% ( 1300, 1900 ] 3 0.001% 100.023% ( 2900, 4400 ] 5 0.001% 100.024% ** Level 1 read latency histogram (micros): Count: 47996 Average: 2.3193 StdDev: 22.23 Min: 0 Median: 1.4367 Max: 2794 Percentiles: P50: 1.44 P75: 1.84 P99: 5.57 P99.9: 12.00 P99.99: 1128.09 ------------------------------------------------------ [ 0, 1 ] 11035 22.991% 22.991% ##### ( 1, 2 ] 29686 61.851% 84.842% ############ ( 2, 3 ] 4372 9.109% 93.952% ## ( 3, 4 ] 1512 3.150% 97.102% # ( 4, 6 ] 1164 2.425% 99.527% ( 6, 10 ] 161 0.335% 99.862% ( 10, 15 ] 45 0.094% 99.956% ( 15, 22 ] 3 0.006% 99.962% ( 34, 51 ] 2 0.004% 99.967% ( 110, 170 ] 1 0.002% 99.969% ( 170, 250 ] 4 0.008% 99.977% ( 250, 380 ] 3 0.006% 99.983% ( 380, 580 ] 2 0.004% 99.987% ( 870, 1300 ] 2 0.004% 99.992% ( 1300, 1900 ] 2 0.004% 99.996% ( 1900, 2900 ] 2 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 31901 Average: 2.4011 StdDev: 4.84 Min: 1 Median: 1.6053 Max: 676 Percentiles: P50: 1.61 P75: 1.98 P99: 7.13 P99.9: 12.81 P99.99: 21.81 ------------------------------------------------------ [ 0, 1 ] 3233 10.134% 10.134% ## ( 1, 2 ] 21011 65.863% 75.998% ############# ( 2, 3 ] 4040 12.664% 88.662% ### ( 3, 4 ] 1864 5.843% 94.505% # ( 4, 6 ] 1332 4.175% 98.680% # ( 6, 10 ] 361 1.132% 99.812% ( 10, 15 ] 50 0.157% 99.969% ( 15, 22 ] 7 0.022% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 142154 Average: 3.5689 StdDev: 37.53 Min: 1 Median: 1.6939 Max: 4007 Percentiles: P50: 1.69 P75: 2.32 P99: 9.20 P99.9: 167.72 P99.99: 597.50 ------------------------------------------------------ [ 0, 1 ] 11141 7.837% 7.837% ## ( 1, 2 ] 86379 60.764% 68.602% ############ ( 2, 3 ] 28707 20.194% 88.796% #### ( 3, 4 ] 6651 4.679% 93.475% # ( 4, 6 ] 5771 4.060% 97.534% # ( 6, 10 ] 2605 1.833% 99.367% ( 10, 15 ] 374 0.263% 99.630% ( 15, 22 ] 77 0.054% 99.684% ( 22, 34 ] 11 0.008% 99.692% ( 34, 51 ] 3 0.002% 99.694% ( 51, 76 ] 10 0.007% 99.701% ( 76, 110 ] 103 0.072% 99.773% ( 110, 170 ] 188 0.132% 99.906% ( 170, 250 ] 50 0.035% 99.941% ( 250, 380 ] 39 0.027% 99.968% ( 380, 580 ] 31 0.022% 99.990% ( 580, 870 ] 13 0.009% 99.999% ( 870, 1300 ] 9 0.006% 100.006% ( 1300, 1900 ] 6 0.004% 100.010% ( 1900, 2900 ] 13 0.009% 100.019% ( 2900, 4400 ] 7 0.005% 100.024% ** Level 4 read latency histogram (micros): Count: 305 Average: 100.9836 StdDev: 451.80 Min: 0 Median: 2.6500 Max: 3670 Percentiles: P50: 2.65 P75: 5.01 P99: 2875.00 P99.9: 3670.00 P99.99: 3670.00 ------------------------------------------------------ [ 0, 1 ] 45 14.754% 14.754% ### ( 1, 2 ] 62 20.328% 35.082% #### ( 2, 3 ] 70 22.951% 58.033% ##### ( 3, 4 ] 30 9.836% 67.869% ## ( 4, 6 ] 43 14.098% 81.967% ### ( 6, 10 ] 21 6.885% 88.852% # ( 10, 15 ] 5 1.639% 90.492% ( 15, 22 ] 4 1.311% 91.803% ( 22, 34 ] 1 0.328% 92.131% ( 110, 170 ] 2 0.656% 92.787% ( 170, 250 ] 4 1.311% 94.098% ( 250, 380 ] 2 0.656% 94.754% ( 580, 870 ] 2 0.656% 95.410% ( 870, 1300 ] 5 1.639% 97.049% ( 1300, 1900 ] 4 1.311% 98.361% ( 1900, 2900 ] 2 0.656% 99.016% ( 2900, 4400 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 809.1000 StdDev: 1081.66 Min: 85 Median: 480.0000 Max: 4975 Percentiles: P50: 480.00 P75: 1013.33 P99: 4975.00 P99.9: 4975.00 P99.99: 4975.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 3 15.000% 30.000% ### ( 170, 250 ] 1 5.000% 35.000% # ( 250, 380 ] 1 5.000% 40.000% # ( 380, 580 ] 4 20.000% 60.000% #### ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 3 15.000% 85.000% ### ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 1 5.000% 95.000% # ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 322.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.461 H:M:S, 7.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.241 H:M:S, 8.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-17:44:33 ... thread 0: (1000000,3000000) ops and (326268.2,335683.3) ops/second in (3.064963,8.936994) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 2.21 GB 6.3 1.8 0.0 1.8 4.6 2.8 0.0 1.7 123.7 309.0 15.28 14.28 48 0.318 1918K 1942 0.0 0.0 L1 1/1 4.58 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 244.9 244.6 2.57 2.49 2 1.286 639K 829 0.0 0.0 L2 1/0 49.23 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 220.1 220.0 0.57 0.55 1 0.573 127K 45 0.0 0.0 L3 12/0 562.44 MB 0.6 0.8 0.1 0.7 0.8 0.1 0.5 6.4 224.3 224.1 3.59 3.36 2 1.793 816K 982 0.0 0.0 L4 169/0 9.53 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.8 1.0 102.7 102.7 1.09 0.69 1 1.090 113K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1247/12 98.90 GB 0.0 3.5 0.7 2.8 6.2 3.5 3.0 2.3 154.2 276.7 23.10 21.37 54 0.428 3617K 3798 0.0 0.0 Int 0/0 0.00 KB 0.0 3.5 0.7 2.8 6.2 3.5 3.0 2.3 154.2 276.7 23.10 21.37 54 0.428 3617K 3798 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.5 0.7 2.8 3.5 0.7 0.0 0.0 236.3 236.1 15.07 14.20 13 1.159 3617K 3798 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 353.0 8.03 7.17 41 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.24 GB write, 697.95 MB/s write, 3.48 GB read, 388.88 MB/s read, 23.1 seconds Interval compaction: 6.24 GB write, 715.21 MB/s write, 3.48 GB read, 398.50 MB/s read, 23.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 637938 Average: 2.1186 StdDev: 12.90 Min: 1 Median: 1.4318 Max: 3654 Percentiles: P50: 1.43 P75: 1.82 P99: 5.51 P99.9: 10.73 P99.99: 17.27 ------------------------------------------------------ [ 0, 1 ] 143433 22.484% 22.484% #### ( 1, 2 ] 406523 63.725% 86.208% ############# ( 2, 3 ] 52727 8.265% 94.474% ## ( 3, 4 ] 20156 3.160% 97.633% # ( 4, 6 ] 11537 1.808% 99.442% ( 6, 10 ] 2831 0.444% 99.885% ( 10, 15 ] 640 0.100% 99.986% ( 15, 22 ] 87 0.014% 99.999% ( 22, 34 ] 12 0.002% 100.001% ( 34, 51 ] 5 0.001% 100.002% ( 51, 76 ] 5 0.001% 100.003% ( 76, 110 ] 1 0.000% 100.003% ( 110, 170 ] 16 0.003% 100.005% ( 170, 250 ] 23 0.004% 100.009% ( 250, 380 ] 15 0.002% 100.011% ( 380, 580 ] 8 0.001% 100.013% ( 580, 870 ] 12 0.002% 100.015% ( 870, 1300 ] 10 0.002% 100.016% ( 1300, 1900 ] 3 0.000% 100.017% ( 1900, 2900 ] 4 0.001% 100.017% ( 2900, 4400 ] 5 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 76265 Average: 2.4273 StdDev: 18.68 Min: 0 Median: 1.4834 Max: 2794 Percentiles: P50: 1.48 P75: 1.87 P99: 6.08 P99.9: 114.31 P99.99: 548.67 ------------------------------------------------------ [ 0, 1 ] 14151 18.555% 18.555% #### ( 1, 2 ] 49611 65.051% 83.606% ############# ( 2, 3 ] 7591 9.953% 93.559% ## ( 3, 4 ] 2473 3.243% 96.802% # ( 4, 6 ] 1664 2.182% 98.984% ( 6, 10 ] 627 0.822% 99.806% ( 10, 15 ] 63 0.083% 99.889% ( 15, 22 ] 3 0.004% 99.892% ( 34, 51 ] 2 0.003% 99.895% ( 110, 170 ] 52 0.068% 99.963% ( 170, 250 ] 12 0.016% 99.979% ( 250, 380 ] 5 0.007% 99.986% ( 380, 580 ] 4 0.005% 99.991% ( 870, 1300 ] 3 0.004% 99.995% ( 1300, 1900 ] 2 0.003% 99.997% ( 1900, 2900 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 31987 Average: 2.4018 StdDev: 4.84 Min: 1 Median: 1.6061 Max: 676 Percentiles: P50: 1.61 P75: 1.99 P99: 7.13 P99.9: 12.80 P99.99: 21.80 ------------------------------------------------------ [ 0, 1 ] 3233 10.107% 10.107% ## ( 1, 2 ] 21055 65.824% 75.931% ############# ( 2, 3 ] 4076 12.743% 88.674% ### ( 3, 4 ] 1867 5.837% 94.510% # ( 4, 6 ] 1334 4.170% 98.681% # ( 6, 10 ] 362 1.132% 99.812% ( 10, 15 ] 50 0.156% 99.969% ( 15, 22 ] 7 0.022% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 172469 Average: 3.4473 StdDev: 35.02 Min: 1 Median: 1.6669 Max: 4007 Percentiles: P50: 1.67 P75: 2.22 P99: 9.05 P99.9: 167.71 P99.99: 652.56 ------------------------------------------------------ [ 0, 1 ] 14364 8.328% 8.328% ## ( 1, 2 ] 107767 62.485% 70.813% ############ ( 2, 3 ] 32327 18.744% 89.557% #### ( 3, 4 ] 7650 4.436% 93.993% # ( 4, 6 ] 6278 3.640% 97.633% # ( 6, 10 ] 3092 1.793% 99.425% ( 10, 15 ] 385 0.223% 99.649% ( 15, 22 ] 79 0.046% 99.694% ( 22, 34 ] 12 0.007% 99.701% ( 34, 51 ] 4 0.002% 99.704% ( 51, 76 ] 14 0.008% 99.712% ( 76, 110 ] 111 0.064% 99.776% ( 110, 170 ] 222 0.129% 99.905% ( 170, 250 ] 60 0.035% 99.940% ( 250, 380 ] 40 0.023% 99.963% ( 380, 580 ] 43 0.025% 99.988% ( 580, 870 ] 15 0.009% 99.997% ( 870, 1300 ] 12 0.007% 100.003% ( 1300, 1900 ] 7 0.004% 100.008% ( 1900, 2900 ] 13 0.008% 100.015% ( 2900, 4400 ] 7 0.004% 100.019% ** Level 4 read latency histogram (micros): Count: 305 Average: 100.9836 StdDev: 451.80 Min: 0 Median: 2.6500 Max: 3670 Percentiles: P50: 2.65 P75: 5.01 P99: 2875.00 P99.9: 3670.00 P99.99: 3670.00 ------------------------------------------------------ [ 0, 1 ] 45 14.754% 14.754% ### ( 1, 2 ] 62 20.328% 35.082% #### ( 2, 3 ] 70 22.951% 58.033% ##### ( 3, 4 ] 30 9.836% 67.869% ## ( 4, 6 ] 43 14.098% 81.967% ### ( 6, 10 ] 21 6.885% 88.852% # ( 10, 15 ] 5 1.639% 90.492% ( 15, 22 ] 4 1.311% 91.803% ( 22, 34 ] 1 0.328% 92.131% ( 110, 170 ] 2 0.656% 92.787% ( 170, 250 ] 4 1.311% 94.098% ( 250, 380 ] 2 0.656% 94.754% ( 580, 870 ] 2 0.656% 95.410% ( 870, 1300 ] 5 1.639% 97.049% ( 1300, 1900 ] 4 1.311% 98.361% ( 1900, 2900 ] 2 0.656% 99.016% ( 2900, 4400 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 886.3667 StdDev: 1122.97 Min: 85 Median: 408.5714 Max: 4975 Percentiles: P50: 408.57 P75: 1300.00 P99: 4975.00 P99.9: 4975.00 P99.99: 4975.00 ------------------------------------------------------ ( 76, 110 ] 6 10.000% 10.000% ## ( 110, 170 ] 17 28.333% 38.333% ###### ( 170, 250 ] 4 6.667% 45.000% # ( 250, 380 ] 2 3.333% 48.333% # ( 380, 580 ] 7 11.667% 60.000% ## ( 580, 870 ] 6 10.000% 70.000% ## ( 870, 1300 ] 3 5.000% 75.000% # ( 1300, 1900 ] 6 10.000% 85.000% ## ( 1900, 2900 ] 4 6.667% 91.667% # ( 2900, 4400 ] 4 6.667% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 9.2 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 322.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.833 H:M:S, 9.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.373 H:M:S, 12.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-17:44:37 ... thread 0: (1000000,4000000) ops and (301999.4,326577.0) ops/second in (3.311265,12.248259) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/11 3.20 GB 107.0 2.6 0.0 2.6 6.4 3.7 0.0 1.7 127.3 307.6 21.29 19.92 65 0.327 2750K 2819 0.0 0.0 L1 1/1 4.58 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 244.9 244.6 2.57 2.49 2 1.286 639K 829 0.0 0.0 L2 1/0 49.23 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 220.1 220.0 0.57 0.55 1 0.573 127K 45 0.0 0.0 L3 12/0 562.44 MB 0.6 0.8 0.1 0.7 0.8 0.1 0.5 6.4 224.3 224.1 3.59 3.36 2 1.793 816K 982 0.0 0.0 L4 169/0 9.53 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.8 1.0 102.7 102.7 1.09 0.69 1 1.090 113K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1252/12 99.88 GB 0.0 4.3 0.7 3.6 8.0 4.5 3.0 2.1 150.5 282.4 29.11 27.01 71 0.410 4448K 4675 0.0 0.0 Int 0/0 0.00 KB 0.0 4.3 0.7 3.6 8.0 4.5 3.0 2.1 150.5 282.4 29.11 27.01 71 0.410 4448K 4675 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.3 0.7 3.6 4.3 0.7 0.0 0.0 240.7 240.4 18.20 17.27 16 1.138 4448K 4675 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 352.5 10.90 9.74 55 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.5 total, 12.2 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.03 GB write, 659.05 MB/s write, 4.28 GB read, 351.30 MB/s read, 29.1 seconds Interval compaction: 8.03 GB write, 670.94 MB/s write, 4.28 GB read, 357.64 MB/s read, 29.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 13, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1042892 Average: 2.1406 StdDev: 11.98 Min: 0 Median: 1.4574 Max: 3654 Percentiles: P50: 1.46 P75: 1.84 P99: 5.49 P99.9: 10.00 P99.99: 14.81 ------------------------------------------------------ [ 0, 1 ] 208002 19.945% 19.945% #### ( 1, 2 ] 685287 65.710% 85.655% ############# ( 2, 3 ] 92333 8.854% 94.509% ## ( 3, 4 ] 33104 3.174% 97.683% # ( 4, 6 ] 18414 1.766% 99.448% ( 6, 10 ] 4712 0.452% 99.900% ( 10, 15 ] 973 0.093% 99.994% ( 15, 22 ] 121 0.012% 100.005% ( 22, 34 ] 13 0.001% 100.006% ( 34, 51 ] 7 0.001% 100.007% ( 51, 76 ] 7 0.001% 100.008% ( 76, 110 ] 6 0.001% 100.008% ( 110, 170 ] 44 0.004% 100.013% ( 170, 250 ] 38 0.004% 100.016% ( 250, 380 ] 25 0.002% 100.019% ( 380, 580 ] 13 0.001% 100.020% ( 580, 870 ] 17 0.002% 100.021% ( 870, 1300 ] 16 0.002% 100.023% ( 1300, 1900 ] 5 0.000% 100.023% ( 1900, 2900 ] 5 0.000% 100.024% ( 2900, 4400 ] 7 0.001% 100.025% ** Level 1 read latency histogram (micros): Count: 76265 Average: 2.4273 StdDev: 18.68 Min: 0 Median: 1.4834 Max: 2794 Percentiles: P50: 1.48 P75: 1.87 P99: 6.08 P99.9: 114.31 P99.99: 548.67 ------------------------------------------------------ [ 0, 1 ] 14151 18.555% 18.555% #### ( 1, 2 ] 49611 65.051% 83.606% ############# ( 2, 3 ] 7591 9.953% 93.559% ## ( 3, 4 ] 2473 3.243% 96.802% # ( 4, 6 ] 1664 2.182% 98.984% ( 6, 10 ] 627 0.822% 99.806% ( 10, 15 ] 63 0.083% 99.889% ( 15, 22 ] 3 0.004% 99.892% ( 34, 51 ] 2 0.003% 99.895% ( 110, 170 ] 52 0.068% 99.963% ( 170, 250 ] 12 0.016% 99.979% ( 250, 380 ] 5 0.007% 99.986% ( 380, 580 ] 4 0.005% 99.991% ( 870, 1300 ] 3 0.004% 99.995% ( 1300, 1900 ] 2 0.003% 99.997% ( 1900, 2900 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 31987 Average: 2.4018 StdDev: 4.84 Min: 1 Median: 1.6061 Max: 676 Percentiles: P50: 1.61 P75: 1.99 P99: 7.13 P99.9: 12.80 P99.99: 21.80 ------------------------------------------------------ [ 0, 1 ] 3233 10.107% 10.107% ## ( 1, 2 ] 21055 65.824% 75.931% ############# ( 2, 3 ] 4076 12.743% 88.674% ### ( 3, 4 ] 1867 5.837% 94.510% # ( 4, 6 ] 1334 4.170% 98.681% # ( 6, 10 ] 362 1.132% 99.812% ( 10, 15 ] 50 0.156% 99.969% ( 15, 22 ] 7 0.022% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 172469 Average: 3.4473 StdDev: 35.02 Min: 1 Median: 1.6669 Max: 4007 Percentiles: P50: 1.67 P75: 2.22 P99: 9.05 P99.9: 167.71 P99.99: 652.56 ------------------------------------------------------ [ 0, 1 ] 14364 8.328% 8.328% ## ( 1, 2 ] 107767 62.485% 70.813% ############ ( 2, 3 ] 32327 18.744% 89.557% #### ( 3, 4 ] 7650 4.436% 93.993% # ( 4, 6 ] 6278 3.640% 97.633% # ( 6, 10 ] 3092 1.793% 99.425% ( 10, 15 ] 385 0.223% 99.649% ( 15, 22 ] 79 0.046% 99.694% ( 22, 34 ] 12 0.007% 99.701% ( 34, 51 ] 4 0.002% 99.704% ( 51, 76 ] 14 0.008% 99.712% ( 76, 110 ] 111 0.064% 99.776% ( 110, 170 ] 222 0.129% 99.905% ( 170, 250 ] 60 0.035% 99.940% ( 250, 380 ] 40 0.023% 99.963% ( 380, 580 ] 43 0.025% 99.988% ( 580, 870 ] 15 0.009% 99.997% ( 870, 1300 ] 12 0.007% 100.003% ( 1300, 1900 ] 7 0.004% 100.008% ( 1900, 2900 ] 13 0.008% 100.015% ( 2900, 4400 ] 7 0.004% 100.019% ** Level 4 read latency histogram (micros): Count: 305 Average: 100.9836 StdDev: 451.80 Min: 0 Median: 2.6500 Max: 3670 Percentiles: P50: 2.65 P75: 5.01 P99: 2875.00 P99.9: 3670.00 P99.99: 3670.00 ------------------------------------------------------ [ 0, 1 ] 45 14.754% 14.754% ### ( 1, 2 ] 62 20.328% 35.082% #### ( 2, 3 ] 70 22.951% 58.033% ##### ( 3, 4 ] 30 9.836% 67.869% ## ( 4, 6 ] 43 14.098% 81.967% ### ( 6, 10 ] 21 6.885% 88.852% # ( 10, 15 ] 5 1.639% 90.492% ( 15, 22 ] 4 1.311% 91.803% ( 22, 34 ] 1 0.328% 92.131% ( 110, 170 ] 2 0.656% 92.787% ( 170, 250 ] 4 1.311% 94.098% ( 250, 380 ] 2 0.656% 94.754% ( 580, 870 ] 2 0.656% 95.410% ( 870, 1300 ] 5 1.639% 97.049% ( 1300, 1900 ] 4 1.311% 98.361% ( 1900, 2900 ] 2 0.656% 99.016% ( 2900, 4400 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 886.3667 StdDev: 1122.97 Min: 85 Median: 408.5714 Max: 4975 Percentiles: P50: 408.57 P75: 1300.00 P99: 4975.00 P99.9: 4975.00 P99.99: 4975.00 ------------------------------------------------------ ( 76, 110 ] 6 10.000% 10.000% ## ( 110, 170 ] 17 28.333% 38.333% ###### ( 170, 250 ] 4 6.667% 45.000% # ( 250, 380 ] 2 3.333% 48.333% # ( 380, 580 ] 7 11.667% 60.000% ## ( 580, 870 ] 6 10.000% 70.000% ## ( 870, 1300 ] 3 5.000% 75.000% # ( 1300, 1900 ] 6 10.000% 85.000% ## ( 1900, 2900 ] 4 6.667% 91.667% # ( 2900, 4400 ] 4 6.667% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 12.5 total, 3.3 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 315.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.421 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 297.22 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.587 H:M:S, 17.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-17:44:43 ... thread 0: (1000000,5000000) ops and (151718.8,265401.2) ops/second in (6.591141,18.839400) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 1.97 GB 176.1 4.1 0.0 4.1 8.7 4.7 0.0 1.9 140.9 302.9 29.51 27.76 84 0.351 4221K 5197 0.0 0.0 L1 10/0 1.13 GB 115.5 2.8 2.6 0.2 2.7 2.6 0.1 1.1 236.9 235.0 11.98 11.60 3 3.992 2881K 23K 0.0 0.0 L2 8/7 1.01 GB 1.3 0.1 0.1 0.1 0.1 0.1 1.6 2.0 220.1 220.0 0.57 0.55 1 0.573 127K 45 0.0 0.0 L3 11/2 611.60 MB 0.4 0.8 0.2 0.7 0.8 0.2 0.5 4.9 211.0 210.7 4.11 3.69 3 1.368 879K 1049 0.0 0.0 L4 169/0 9.53 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.8 1.0 102.7 102.7 1.09 0.69 1 1.090 113K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1259/13 100.78 GB 0.0 7.9 2.9 5.0 12.6 7.6 4.0 2.7 171.4 272.1 47.25 44.30 92 0.514 8223K 29K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.9 2.9 5.0 12.6 7.6 4.0 2.7 171.4 272.1 47.25 44.30 92 0.514 8223K 29K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.9 2.9 5.0 7.9 2.9 0.0 0.0 241.0 240.1 33.61 32.12 22 1.528 8223K 29K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 350.8 13.65 12.18 70 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.1 total, 18.8 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.56 GB write, 674.45 MB/s write, 7.91 GB read, 424.86 MB/s read, 47.3 seconds Interval compaction: 12.56 GB write, 682.37 MB/s write, 7.91 GB read, 429.84 MB/s read, 47.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 13, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1766720 Average: 2.1584 StdDev: 10.97 Min: 0 Median: 1.4624 Max: 3654 Percentiles: P50: 1.46 P75: 1.84 P99: 5.55 P99.9: 10.23 P99.99: 20.96 ------------------------------------------------------ [ 0, 1 ] 339222 19.201% 19.201% #### ( 1, 2 ] 1176716 66.605% 85.805% ############# ( 2, 3 ] 154280 8.733% 94.538% ## ( 3, 4 ] 54940 3.110% 97.648% # ( 4, 6 ] 30796 1.743% 99.391% ( 6, 10 ] 8930 0.505% 99.896% ( 10, 15 ] 1496 0.085% 99.981% ( 15, 22 ] 193 0.011% 99.992% ( 22, 34 ] 14 0.001% 99.992% ( 34, 51 ] 8 0.000% 99.993% ( 51, 76 ] 8 0.000% 99.993% ( 76, 110 ] 114 0.006% 100.000% ( 110, 170 ] 152 0.009% 100.008% ( 170, 250 ] 94 0.005% 100.014% ( 250, 380 ] 60 0.003% 100.017% ( 380, 580 ] 34 0.002% 100.019% ( 580, 870 ] 34 0.002% 100.021% ( 870, 1300 ] 23 0.001% 100.022% ( 1300, 1900 ] 6 0.000% 100.023% ( 1900, 2900 ] 9 0.001% 100.023% ( 2900, 4400 ] 8 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 157567 Average: 3.3547 StdDev: 25.88 Min: 0 Median: 1.6413 Max: 2794 Percentiles: P50: 1.64 P75: 2.18 P99: 8.51 P99.9: 165.83 P99.99: 396.65 ------------------------------------------------------ [ 0, 1 ] 16730 10.618% 10.618% ## ( 1, 2 ] 96764 61.411% 72.029% ############ ( 2, 3 ] 25388 16.113% 88.142% ### ( 3, 4 ] 8631 5.478% 93.619% # ( 4, 6 ] 7088 4.498% 98.118% # ( 6, 10 ] 2220 1.409% 99.527% ( 10, 15 ] 354 0.225% 99.751% ( 15, 22 ] 47 0.030% 99.781% ( 22, 34 ] 4 0.003% 99.784% ( 34, 51 ] 3 0.002% 99.785% ( 76, 110 ] 41 0.026% 99.812% ( 110, 170 ] 152 0.096% 99.908% ( 170, 250 ] 73 0.046% 99.954% ( 250, 380 ] 53 0.034% 99.988% ( 380, 580 ] 63 0.040% 100.028% ( 580, 870 ] 30 0.019% 100.047% ( 870, 1300 ] 11 0.007% 100.054% ( 1300, 1900 ] 15 0.010% 100.063% ( 1900, 2900 ] 2 0.001% 100.065% ** Level 2 read latency histogram (micros): Count: 31987 Average: 2.4018 StdDev: 4.84 Min: 1 Median: 1.6061 Max: 676 Percentiles: P50: 1.61 P75: 1.99 P99: 7.13 P99.9: 12.80 P99.99: 21.80 ------------------------------------------------------ [ 0, 1 ] 3233 10.107% 10.107% ## ( 1, 2 ] 21055 65.824% 75.931% ############# ( 2, 3 ] 4076 12.743% 88.674% ### ( 3, 4 ] 1867 5.837% 94.510% # ( 4, 6 ] 1334 4.170% 98.681% # ( 6, 10 ] 362 1.132% 99.812% ( 10, 15 ] 50 0.156% 99.969% ( 15, 22 ] 7 0.022% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 175709 Average: 4.1488 StdDev: 38.91 Min: 1 Median: 1.6724 Max: 4007 Percentiles: P50: 1.67 P75: 2.25 P99: 9.62 P99.9: 376.86 P99.99: 853.43 ------------------------------------------------------ [ 0, 1 ] 14457 8.228% 8.228% ## ( 1, 2 ] 109153 62.121% 70.349% ############ ( 2, 3 ] 33166 18.876% 89.225% #### ( 3, 4 ] 7857 4.472% 93.696% # ( 4, 6 ] 6455 3.674% 97.370% # ( 6, 10 ] 3164 1.801% 99.171% ( 10, 15 ] 394 0.224% 99.395% ( 15, 22 ] 80 0.046% 99.441% ( 22, 34 ] 16 0.009% 99.450% ( 34, 51 ] 4 0.002% 99.452% ( 51, 76 ] 15 0.009% 99.460% ( 76, 110 ] 175 0.100% 99.560% ( 110, 170 ] 347 0.197% 99.758% ( 170, 250 ] 141 0.080% 99.838% ( 250, 380 ] 112 0.064% 99.902% ( 380, 580 ] 113 0.064% 99.966% ( 580, 870 ] 45 0.026% 99.991% ( 870, 1300 ] 19 0.011% 100.002% ( 1300, 1900 ] 9 0.005% 100.007% ( 1900, 2900 ] 13 0.007% 100.015% ( 2900, 4400 ] 7 0.004% 100.019% ** Level 4 read latency histogram (micros): Count: 305 Average: 100.9836 StdDev: 451.80 Min: 0 Median: 2.6500 Max: 3670 Percentiles: P50: 2.65 P75: 5.01 P99: 2875.00 P99.9: 3670.00 P99.99: 3670.00 ------------------------------------------------------ [ 0, 1 ] 45 14.754% 14.754% ### ( 1, 2 ] 62 20.328% 35.082% #### ( 2, 3 ] 70 22.951% 58.033% ##### ( 3, 4 ] 30 9.836% 67.869% ## ( 4, 6 ] 43 14.098% 81.967% ### ( 6, 10 ] 21 6.885% 88.852% # ( 10, 15 ] 5 1.639% 90.492% ( 15, 22 ] 4 1.311% 91.803% ( 22, 34 ] 1 0.328% 92.131% ( 110, 170 ] 2 0.656% 92.787% ( 170, 250 ] 4 1.311% 94.098% ( 250, 380 ] 2 0.656% 94.754% ( 580, 870 ] 2 0.656% 95.410% ( 870, 1300 ] 5 1.639% 97.049% ( 1300, 1900 ] 4 1.311% 98.361% ( 1900, 2900 ] 2 0.656% 99.016% ( 2900, 4400 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 886.3667 StdDev: 1122.97 Min: 85 Median: 408.5714 Max: 4975 Percentiles: P50: 408.57 P75: 1300.00 P99: 4975.00 P99.9: 4975.00 P99.99: 4975.00 ------------------------------------------------------ ( 76, 110 ] 6 10.000% 10.000% ## ( 110, 170 ] 17 28.333% 38.333% ###### ( 170, 250 ] 4 6.667% 45.000% # ( 250, 380 ] 2 3.333% 48.333% # ( 380, 580 ] 7 11.667% 60.000% ## ( 580, 870 ] 6 10.000% 70.000% ## ( 870, 1300 ] 3 5.000% 75.000% # ( 1300, 1900 ] 6 10.000% 85.000% ## ( 1900, 2900 ] 4 6.667% 91.667% # ( 2900, 4400 ] 4 6.667% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 19.1 total, 6.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 258.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.086 H:M:S, 26.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 149.32 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.665 H:M:S, 55.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/17-17:44:47 ... thread 0: (1000000,6000000) ops and (289378.5,269117.6) ops/second in (3.455682,22.295082) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 2.95 GB 50.4 4.8 0.0 4.8 10.5 5.7 0.0 1.8 137.3 299.0 35.79 33.32 101 0.354 4988K 5931 0.0 0.0 L1 10/10 1.13 GB 0.0 2.8 2.6 0.2 2.7 2.6 0.1 1.1 236.9 235.0 11.98 11.60 3 3.992 2881K 23K 0.0 0.0 L2 1/1 128.78 MB 0.0 0.1 0.1 0.1 0.1 0.1 1.6 2.0 220.1 220.0 0.57 0.55 1 0.573 127K 45 0.0 0.0 L3 26/2 1.04 GB 1.0 2.0 1.1 0.9 2.0 1.0 0.5 1.9 212.0 211.5 9.55 8.74 5 1.910 2056K 5204 0.0 0.0 L4 175/0 9.59 GB 1.0 0.5 0.5 0.0 0.5 0.5 0.8 1.0 111.5 111.4 4.83 2.75 11 0.439 538K 305 0.0 0.0 L5 1056/0 86.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1282/23 101.76 GB 0.0 10.2 4.2 6.0 15.8 9.8 4.4 2.8 166.5 258.3 62.72 56.97 121 0.518 10M 34K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.2 4.2 6.0 15.8 9.8 4.4 2.8 166.5 258.3 62.72 56.97 121 0.518 10M 34K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.2 4.2 6.0 10.2 4.2 0.0 0.0 227.3 226.5 45.93 42.22 37 1.241 10M 34K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 345.2 16.79 14.75 84 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.5 total, 22.3 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.82 GB write, 719.45 MB/s write, 10.20 GB read, 463.63 MB/s read, 62.7 seconds Interval compaction: 15.82 GB write, 726.58 MB/s write, 10.20 GB read, 468.23 MB/s read, 62.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 22, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2041107 Average: 2.2535 StdDev: 13.69 Min: 0 Median: 1.4887 Max: 6016 Percentiles: P50: 1.49 P75: 1.87 P99: 5.71 P99.9: 11.22 P99.99: 102.95 ------------------------------------------------------ [ 0, 1 ] 359919 17.634% 17.634% #### ( 1, 2 ] 1351776 66.228% 83.861% ############# ( 2, 3 ] 198424 9.721% 93.583% ## ( 3, 4 ] 72173 3.536% 97.118% # ( 4, 6 ] 44829 2.196% 99.315% ( 6, 10 ] 11485 0.563% 99.877% ( 10, 15 ] 1887 0.092% 99.970% ( 15, 22 ] 251 0.012% 99.982% ( 22, 34 ] 18 0.001% 99.983% ( 34, 51 ] 10 0.000% 99.984% ( 51, 76 ] 12 0.001% 99.984% ( 76, 110 ] 150 0.007% 99.992% ( 110, 170 ] 230 0.011% 100.003% ( 170, 250 ] 161 0.008% 100.011% ( 250, 380 ] 99 0.005% 100.016% ( 380, 580 ] 66 0.003% 100.019% ( 580, 870 ] 55 0.003% 100.021% ( 870, 1300 ] 34 0.002% 100.023% ( 1300, 1900 ] 8 0.000% 100.024% ( 1900, 2900 ] 12 0.001% 100.024% ( 2900, 4400 ] 11 0.001% 100.025% ( 4400, 6600 ] 2 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 416592 Average: 3.3250 StdDev: 37.86 Min: 0 Median: 1.6750 Max: 8050 Percentiles: P50: 1.67 P75: 2.25 P99: 8.46 P99.9: 146.81 P99.99: 442.66 ------------------------------------------------------ [ 0, 1 ] 29406 7.059% 7.059% # ( 1, 2 ] 265037 63.620% 70.679% ############# ( 2, 3 ] 72945 17.510% 88.189% #### ( 3, 4 ] 22602 5.425% 93.614% # ( 4, 6 ] 18289 4.390% 98.005% # ( 6, 10 ] 6751 1.621% 99.625% ( 10, 15 ] 775 0.186% 99.811% ( 15, 22 ] 83 0.020% 99.831% ( 22, 34 ] 7 0.002% 99.833% ( 34, 51 ] 6 0.001% 99.834% ( 51, 76 ] 4 0.001% 99.835% ( 76, 110 ] 98 0.024% 99.859% ( 110, 170 ] 281 0.067% 99.926% ( 170, 250 ] 133 0.032% 99.958% ( 250, 380 ] 97 0.023% 99.981% ( 380, 580 ] 116 0.028% 100.009% ( 580, 870 ] 67 0.016% 100.025% ( 870, 1300 ] 30 0.007% 100.032% ( 1300, 1900 ] 19 0.005% 100.037% ( 1900, 2900 ] 9 0.002% 100.039% ( 2900, 4400 ] 7 0.002% 100.041% ( 4400, 6600 ] 2 0.000% 100.041% ( 6600, 9900 ] 4 0.001% 100.042% ** Level 2 read latency histogram (micros): Count: 31987 Average: 2.4018 StdDev: 4.84 Min: 1 Median: 1.6061 Max: 676 Percentiles: P50: 1.61 P75: 1.99 P99: 7.13 P99.9: 12.80 P99.99: 21.80 ------------------------------------------------------ [ 0, 1 ] 3233 10.107% 10.107% ## ( 1, 2 ] 21055 65.824% 75.931% ############# ( 2, 3 ] 4076 12.743% 88.674% ### ( 3, 4 ] 1867 5.837% 94.510% # ( 4, 6 ] 1334 4.170% 98.681% # ( 6, 10 ] 362 1.132% 99.812% ( 10, 15 ] 50 0.156% 99.969% ( 15, 22 ] 7 0.022% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 294036 Average: 3.9639 StdDev: 41.46 Min: 0 Median: 1.8000 Max: 6698 Percentiles: P50: 1.80 P75: 2.64 P99: 9.15 P99.9: 151.54 P99.99: 253.77 ------------------------------------------------------ [ 0, 1 ] 16100 5.476% 5.476% # ( 1, 2 ] 163639 55.653% 61.128% ########### ( 2, 3 ] 63931 21.743% 82.871% #### ( 3, 4 ] 22254 7.568% 90.439% ## ( 4, 6 ] 20855 7.093% 97.532% # ( 6, 10 ] 5483 1.865% 99.397% ( 10, 15 ] 868 0.295% 99.692% ( 15, 22 ] 137 0.047% 99.738% ( 22, 34 ] 17 0.006% 99.744% ( 34, 51 ] 6 0.002% 99.746% ( 51, 76 ] 18 0.006% 99.752% ( 76, 110 ] 176 0.060% 99.812% ( 110, 170 ] 374 0.127% 99.939% ( 170, 250 ] 146 0.050% 99.989% ( 250, 380 ] 124 0.042% 100.031% ( 380, 580 ] 121 0.041% 100.072% ( 580, 870 ] 50 0.017% 100.089% ( 870, 1300 ] 24 0.008% 100.098% ( 1300, 1900 ] 9 0.003% 100.101% ( 1900, 2900 ] 14 0.005% 100.105% ( 2900, 4400 ] 19 0.006% 100.112% ( 6600, 9900 ] 1 0.000% 100.112% ** Level 4 read latency histogram (micros): Count: 5303 Average: 114.3853 StdDev: 422.43 Min: 0 Median: 2.2977 Max: 8159 Percentiles: P50: 2.30 P75: 3.88 P99: 2202.12 P99.9: 4381.82 P99.99: 6366.67 ------------------------------------------------------ [ 0, 1 ] 138 2.602% 2.602% # ( 1, 2 ] 2170 40.920% 43.523% ######## ( 2, 3 ] 1154 21.761% 65.284% #### ( 3, 4 ] 587 11.069% 76.353% ## ( 4, 6 ] 401 7.562% 83.915% ## ( 6, 10 ] 132 2.489% 86.404% ( 10, 15 ] 31 0.585% 86.988% ( 15, 22 ] 5 0.094% 87.083% ( 22, 34 ] 1 0.019% 87.102% ( 76, 110 ] 11 0.207% 87.309% ( 110, 170 ] 51 0.962% 88.271% ( 170, 250 ] 38 0.717% 88.987% ( 250, 380 ] 85 1.603% 90.590% ( 380, 580 ] 139 2.621% 93.211% # ( 580, 870 ] 138 2.602% 95.814% # ( 870, 1300 ] 111 2.093% 97.907% ( 1300, 1900 ] 48 0.905% 98.812% ( 1900, 2900 ] 33 0.622% 99.434% ( 2900, 4400 ] 25 0.471% 99.906% ( 4400, 6600 ] 5 0.094% 100.000% ( 6600, 9900 ] 1 0.019% 100.019% ** Level 5 read latency histogram (micros): Count: 80 Average: 1005.2750 StdDev: 1181.78 Min: 85 Median: 520.0000 Max: 4975 Percentiles: P50: 520.00 P75: 1385.71 P99: 4975.00 P99.9: 4975.00 P99.99: 4975.00 ------------------------------------------------------ ( 76, 110 ] 6 7.500% 7.500% ## ( 110, 170 ] 17 21.250% 28.750% #### ( 170, 250 ] 5 6.250% 35.000% # ( 250, 380 ] 5 6.250% 41.250% # ( 380, 580 ] 10 12.500% 53.750% ### ( 580, 870 ] 9 11.250% 65.000% ## ( 870, 1300 ] 7 8.750% 73.750% ## ( 1300, 1900 ] 7 8.750% 82.500% ## ( 1900, 2900 ] 7 8.750% 91.250% ## ( 2900, 4400 ] 5 6.250% 97.500% # ( 4400, 6600 ] 2 2.500% 100.000% # ** DB Stats ** Uptime(secs): 22.5 total, 3.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 262.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.740 H:M:S, 25.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 284.80 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.654 H:M:S, 18.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-17:44:50 ... thread 0: (1000000,7000000) ops and (284049.8,271154.0) ops/second in (3.520510,25.815592) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 3.87 GB 119.6 5.7 0.0 5.7 12.2 6.6 0.0 1.9 138.0 298.4 41.99 39.03 118 0.356 5884K 6957 0.0 0.0 L1 10/10 1.13 GB 0.0 2.8 2.6 0.2 2.7 2.6 0.1 1.1 236.9 235.0 11.98 11.60 3 3.992 2881K 23K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 1.6 2.0 220.1 220.0 0.57 0.55 1 0.573 127K 45 0.0 0.0 L3 24/0 986.86 MB 1.0 2.2 1.2 1.0 2.2 1.2 0.5 1.8 207.9 207.3 10.73 9.67 6 1.789 2266K 5797 0.0 0.0 L4 176/0 9.49 GB 1.0 0.7 0.7 0.0 0.7 0.7 0.8 1.0 116.0 115.9 6.52 3.81 16 0.408 760K 578 0.0 0.0 L5 1060/0 87.23 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1289/24 102.68 GB 0.0 11.5 4.5 6.9 18.0 11.1 4.7 2.7 163.6 257.0 71.79 64.65 144 0.499 11M 36K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.5 4.5 6.9 18.0 11.1 4.7 2.7 163.6 257.0 71.79 64.65 144 0.499 11M 36K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.5 4.5 6.9 11.4 4.5 0.0 0.0 225.1 224.3 52.19 47.53 46 1.135 11M 36K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 343.9 19.60 17.13 98 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.0 total, 25.8 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.02 GB write, 708.56 MB/s write, 11.47 GB read, 451.12 MB/s read, 71.8 seconds Interval compaction: 18.02 GB write, 714.63 MB/s write, 11.47 GB read, 454.98 MB/s read, 71.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 24, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2490082 Average: 2.3006 StdDev: 14.86 Min: 0 Median: 1.5003 Max: 6016 Percentiles: P50: 1.50 P75: 1.88 P99: 5.75 P99.9: 11.33 P99.99: 112.71 ------------------------------------------------------ [ 0, 1 ] 417709 16.775% 16.775% ### ( 1, 2 ] 1653647 66.409% 83.184% ############# ( 2, 3 ] 254830 10.234% 93.418% ## ( 3, 4 ] 90241 3.624% 97.042% # ( 4, 6 ] 55662 2.235% 99.277% ( 6, 10 ] 14925 0.599% 99.877% ( 10, 15 ] 2174 0.087% 99.964% ( 15, 22 ] 287 0.012% 99.976% ( 22, 34 ] 23 0.001% 99.977% ( 34, 51 ] 15 0.001% 99.977% ( 51, 76 ] 14 0.001% 99.978% ( 76, 110 ] 292 0.012% 99.989% ( 110, 170 ] 332 0.013% 100.003% ( 170, 250 ] 210 0.008% 100.011% ( 250, 380 ] 134 0.005% 100.017% ( 380, 580 ] 111 0.004% 100.021% ( 580, 870 ] 76 0.003% 100.024% ( 870, 1300 ] 45 0.002% 100.026% ( 1300, 1900 ] 14 0.001% 100.026% ( 1900, 2900 ] 19 0.001% 100.027% ( 2900, 4400 ] 16 0.001% 100.028% ( 4400, 6600 ] 2 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 416592 Average: 3.3250 StdDev: 37.86 Min: 0 Median: 1.6750 Max: 8050 Percentiles: P50: 1.67 P75: 2.25 P99: 8.46 P99.9: 146.81 P99.99: 442.66 ------------------------------------------------------ [ 0, 1 ] 29406 7.059% 7.059% # ( 1, 2 ] 265037 63.620% 70.679% ############# ( 2, 3 ] 72945 17.510% 88.189% #### ( 3, 4 ] 22602 5.425% 93.614% # ( 4, 6 ] 18289 4.390% 98.005% # ( 6, 10 ] 6751 1.621% 99.625% ( 10, 15 ] 775 0.186% 99.811% ( 15, 22 ] 83 0.020% 99.831% ( 22, 34 ] 7 0.002% 99.833% ( 34, 51 ] 6 0.001% 99.834% ( 51, 76 ] 4 0.001% 99.835% ( 76, 110 ] 98 0.024% 99.859% ( 110, 170 ] 281 0.067% 99.926% ( 170, 250 ] 133 0.032% 99.958% ( 250, 380 ] 97 0.023% 99.981% ( 380, 580 ] 116 0.028% 100.009% ( 580, 870 ] 67 0.016% 100.025% ( 870, 1300 ] 30 0.007% 100.032% ( 1300, 1900 ] 19 0.005% 100.037% ( 1900, 2900 ] 9 0.002% 100.039% ( 2900, 4400 ] 7 0.002% 100.041% ( 4400, 6600 ] 2 0.000% 100.041% ( 6600, 9900 ] 4 0.001% 100.042% ** Level 2 read latency histogram (micros): Count: 31987 Average: 2.4018 StdDev: 4.84 Min: 1 Median: 1.6061 Max: 676 Percentiles: P50: 1.61 P75: 1.99 P99: 7.13 P99.9: 12.80 P99.99: 21.80 ------------------------------------------------------ [ 0, 1 ] 3233 10.107% 10.107% ## ( 1, 2 ] 21055 65.824% 75.931% ############# ( 2, 3 ] 4076 12.743% 88.674% ### ( 3, 4 ] 1867 5.837% 94.510% # ( 4, 6 ] 1334 4.170% 98.681% # ( 6, 10 ] 362 1.132% 99.812% ( 10, 15 ] 50 0.156% 99.969% ( 15, 22 ] 7 0.022% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 350840 Average: 3.8674 StdDev: 40.22 Min: 0 Median: 1.8254 Max: 6698 Percentiles: P50: 1.83 P75: 2.69 P99: 8.98 P99.9: 129.04 P99.99: 198.60 ------------------------------------------------------ [ 0, 1 ] 16945 4.830% 4.830% # ( 1, 2 ] 192003 54.727% 59.556% ########### ( 2, 3 ] 77960 22.221% 81.777% #### ( 3, 4 ] 28769 8.200% 89.977% ## ( 4, 6 ] 26926 7.675% 97.652% ## ( 6, 10 ] 6353 1.811% 99.463% ( 10, 15 ] 1034 0.295% 99.758% ( 15, 22 ] 153 0.044% 99.801% ( 22, 34 ] 20 0.006% 99.807% ( 34, 51 ] 8 0.002% 99.809% ( 51, 76 ] 19 0.005% 99.815% ( 76, 110 ] 177 0.050% 99.865% ( 110, 170 ] 385 0.110% 99.975% ( 170, 250 ] 148 0.042% 100.017% ( 250, 380 ] 127 0.036% 100.053% ( 380, 580 ] 123 0.035% 100.088% ( 580, 870 ] 52 0.015% 100.103% ( 870, 1300 ] 24 0.007% 100.110% ( 1300, 1900 ] 10 0.003% 100.113% ( 1900, 2900 ] 18 0.005% 100.118% ( 2900, 4400 ] 21 0.006% 100.124% ( 6600, 9900 ] 1 0.000% 100.124% ** Level 4 read latency histogram (micros): Count: 7872 Average: 101.6415 StdDev: 382.67 Min: 0 Median: 2.2593 Max: 8159 Percentiles: P50: 2.26 P75: 3.84 P99: 1851.17 P99.9: 4251.45 P99.99: 5944.69 ------------------------------------------------------ [ 0, 1 ] 206 2.617% 2.617% # ( 1, 2 ] 3293 41.832% 44.449% ######## ( 2, 3 ] 1685 21.405% 65.854% #### ( 3, 4 ] 859 10.912% 76.766% ## ( 4, 6 ] 573 7.279% 84.045% # ( 6, 10 ] 192 2.439% 86.484% ( 10, 15 ] 40 0.508% 86.992% ( 15, 22 ] 8 0.102% 87.093% ( 22, 34 ] 2 0.025% 87.119% ( 76, 110 ] 20 0.254% 87.373% ( 110, 170 ] 88 1.118% 88.491% ( 170, 250 ] 85 1.080% 89.571% ( 250, 380 ] 144 1.829% 91.400% ( 380, 580 ] 217 2.757% 94.157% # ( 580, 870 ] 190 2.414% 96.570% ( 870, 1300 ] 138 1.753% 98.323% ( 1300, 1900 ] 58 0.737% 99.060% ( 1900, 2900 ] 40 0.508% 99.568% ( 2900, 4400 ] 29 0.368% 99.936% ( 4400, 6600 ] 6 0.076% 100.013% ( 6600, 9900 ] 1 0.013% 100.025% ** Level 5 read latency histogram (micros): Count: 100 Average: 948.6500 StdDev: 1116.89 Min: 85 Median: 480.0000 Max: 4975 Percentiles: P50: 480.00 P75: 1360.00 P99: 4975.00 P99.9: 4975.00 P99.99: 4975.00 ------------------------------------------------------ ( 76, 110 ] 6 6.000% 6.000% # ( 110, 170 ] 24 24.000% 30.000% ##### ( 170, 250 ] 6 6.000% 36.000% # ( 250, 380 ] 8 8.000% 44.000% ## ( 380, 580 ] 12 12.000% 56.000% ## ( 580, 870 ] 10 10.000% 66.000% ## ( 870, 1300 ] 8 8.000% 74.000% ## ( 1300, 1900 ] 10 10.000% 84.000% ## ( 1900, 2900 ] 9 9.000% 93.000% ## ( 2900, 4400 ] 5 5.000% 98.000% # ( 4400, 6600 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 26.0 total, 3.5 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 264.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.449 H:M:S, 24.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 279.56 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.709 H:M:S, 20.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-17:45:04 ... thread 0: (1000000,8000000) ops and (71057.0,200557.5) ops/second in (14.073212,39.888804) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/7 2.45 GB 0.0 7.9 0.0 7.9 15.6 7.6 0.0 2.0 150.2 294.4 54.10 50.53 141 0.384 8250K 12K 0.0 0.0 L1 18/18 2.25 GB 0.0 6.4 5.0 1.3 6.3 5.0 0.1 1.2 229.1 226.2 28.41 27.13 4 7.102 6608K 80K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 2.9 2.0 220.1 220.0 0.57 0.55 1 0.573 127K 45 0.0 0.0 L3 27/8 1.61 GB 0.9 4.0 2.3 1.8 4.0 2.3 0.7 1.8 183.7 182.9 22.42 18.43 15 1.495 4183K 17K 0.0 0.0 L4 180/35 9.74 GB 1.0 1.4 1.3 0.1 1.4 1.3 0.8 1.0 127.3 127.1 11.15 6.95 26 0.429 1420K 966 0.0 0.0 L5 1064/0 87.60 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1296/68 103.65 GB 0.0 19.8 8.7 11.1 27.3 16.2 6.5 3.6 174.0 240.0 116.64 103.59 187 0.624 20M 112K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.8 8.7 11.1 27.3 16.2 6.5 3.6 174.0 240.0 116.64 103.59 187 0.624 20M 112K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.8 8.7 11.1 19.7 8.6 0.0 0.0 216.0 214.8 93.98 83.75 72 1.305 20M 112K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 344.7 22.66 19.84 115 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 40.1 total, 39.9 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.34 GB write, 697.92 MB/s write, 19.82 GB read, 506.00 MB/s read, 116.6 seconds Interval compaction: 27.34 GB write, 701.78 MB/s write, 19.82 GB read, 508.81 MB/s read, 116.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 26, pending-compaction-bytes-stops: 0, total-delays: 50, total-stops: 24, interval: 74 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3535131 Average: 2.4237 StdDev: 16.74 Min: 0 Median: 1.5061 Max: 6016 Percentiles: P50: 1.51 P75: 1.88 P99: 5.90 P99.9: 14.57 P99.99: 203.87 ------------------------------------------------------ [ 0, 1 ] 582514 16.478% 16.478% ### ( 1, 2 ] 2341655 66.240% 82.717% ############# ( 2, 3 ] 366212 10.359% 93.077% ## ( 3, 4 ] 129573 3.665% 96.742% # ( 4, 6 ] 84222 2.382% 99.124% ( 6, 10 ] 24530 0.694% 99.818% ( 10, 15 ] 3164 0.090% 99.908% ( 15, 22 ] 442 0.013% 99.920% ( 22, 34 ] 32 0.001% 99.921% ( 34, 51 ] 15 0.000% 99.922% ( 51, 76 ] 34 0.001% 99.923% ( 76, 110 ] 1044 0.030% 99.952% ( 110, 170 ] 1170 0.033% 99.985% ( 170, 250 ] 405 0.011% 99.997% ( 250, 380 ] 318 0.009% 100.006% ( 380, 580 ] 270 0.008% 100.013% ( 580, 870 ] 179 0.005% 100.018% ( 870, 1300 ] 89 0.003% 100.021% ( 1300, 1900 ] 27 0.001% 100.022% ( 1900, 2900 ] 29 0.001% 100.022% ( 2900, 4400 ] 29 0.001% 100.023% ( 4400, 6600 ] 2 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1011640 Average: 3.6322 StdDev: 40.12 Min: 0 Median: 1.6924 Max: 8050 Percentiles: P50: 1.69 P75: 2.40 P99: 8.89 P99.9: 115.89 P99.99: 295.39 ------------------------------------------------------ [ 0, 1 ] 88487 8.747% 8.747% ## ( 1, 2 ] 602723 59.579% 68.326% ############ ( 2, 3 ] 168827 16.688% 85.014% ### ( 3, 4 ] 66997 6.623% 91.637% # ( 4, 6 ] 59987 5.930% 97.566% # ( 6, 10 ] 20104 1.987% 99.554% ( 10, 15 ] 2557 0.253% 99.806% ( 15, 22 ] 368 0.036% 99.843% ( 22, 34 ] 29 0.003% 99.846% ( 34, 51 ] 10 0.001% 99.847% ( 51, 76 ] 55 0.005% 99.852% ( 76, 110 ] 426 0.042% 99.894% ( 110, 170 ] 594 0.059% 99.953% ( 170, 250 ] 283 0.028% 99.981% ( 250, 380 ] 263 0.026% 100.007% ( 380, 580 ] 297 0.029% 100.036% ( 580, 870 ] 240 0.024% 100.060% ( 870, 1300 ] 150 0.015% 100.075% ( 1300, 1900 ] 61 0.006% 100.081% ( 1900, 2900 ] 41 0.004% 100.085% ( 2900, 4400 ] 33 0.003% 100.088% ( 4400, 6600 ] 6 0.001% 100.089% ( 6600, 9900 ] 5 0.000% 100.089% ** Level 2 read latency histogram (micros): Count: 31987 Average: 2.4018 StdDev: 4.84 Min: 1 Median: 1.6061 Max: 676 Percentiles: P50: 1.61 P75: 1.99 P99: 7.13 P99.9: 12.80 P99.99: 21.80 ------------------------------------------------------ [ 0, 1 ] 3233 10.107% 10.107% ## ( 1, 2 ] 21055 65.824% 75.931% ############# ( 2, 3 ] 4076 12.743% 88.674% ### ( 3, 4 ] 1867 5.837% 94.510% # ( 4, 6 ] 1334 4.170% 98.681% # ( 6, 10 ] 362 1.132% 99.812% ( 10, 15 ] 50 0.156% 99.969% ( 15, 22 ] 7 0.022% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 737473 Average: 4.7234 StdDev: 52.04 Min: 0 Median: 1.9196 Max: 6698 Percentiles: P50: 1.92 P75: 2.91 P99: 9.14 P99.9: 107.83 P99.99: 226.54 ------------------------------------------------------ [ 0, 1 ] 21886 2.968% 2.968% # ( 1, 2 ] 377163 51.143% 54.110% ########## ( 2, 3 ] 169334 22.961% 77.072% ##### ( 3, 4 ] 75319 10.213% 87.285% ## ( 4, 6 ] 73977 10.031% 97.316% ## ( 6, 10 ] 15836 2.147% 99.463% ( 10, 15 ] 2534 0.344% 99.807% ( 15, 22 ] 391 0.053% 99.860% ( 22, 34 ] 47 0.006% 99.866% ( 34, 51 ] 23 0.003% 99.869% ( 51, 76 ] 44 0.006% 99.875% ( 76, 110 ] 195 0.026% 99.902% ( 110, 170 ] 459 0.062% 99.964% ( 170, 250 ] 272 0.037% 100.001% ( 250, 380 ] 300 0.041% 100.042% ( 380, 580 ] 364 0.049% 100.091% ( 580, 870 ] 331 0.045% 100.136% ( 870, 1300 ] 196 0.027% 100.162% ( 1300, 1900 ] 87 0.012% 100.174% ( 1900, 2900 ] 56 0.008% 100.182% ( 2900, 4400 ] 52 0.007% 100.189% ( 4400, 6600 ] 9 0.001% 100.190% ( 6600, 9900 ] 1 0.000% 100.190% ** Level 4 read latency histogram (micros): Count: 37006 Average: 55.4453 StdDev: 274.94 Min: 0 Median: 2.1894 Max: 8159 Percentiles: P50: 2.19 P75: 3.62 P99: 1168.22 P99.9: 3834.93 P99.99: 4991.15 ------------------------------------------------------ [ 0, 1 ] 771 2.083% 2.083% ( 1, 2 ] 16205 43.790% 45.874% ######### ( 2, 3 ] 8063 21.788% 67.662% #### ( 3, 4 ] 4400 11.890% 79.552% ## ( 4, 6 ] 3258 8.804% 88.356% ## ( 6, 10 ] 1083 2.927% 91.282% # ( 10, 15 ] 152 0.411% 91.693% ( 15, 22 ] 31 0.084% 91.777% ( 22, 34 ] 3 0.008% 91.785% ( 51, 76 ] 3 0.008% 91.793% ( 76, 110 ] 148 0.400% 92.193% ( 110, 170 ] 416 1.124% 93.317% ( 170, 250 ] 384 1.038% 94.355% ( 250, 380 ] 428 1.157% 95.512% ( 380, 580 ] 582 1.573% 97.084% ( 580, 870 ] 488 1.319% 98.403% ( 870, 1300 ] 320 0.865% 99.268% ( 1300, 1900 ] 116 0.313% 99.581% ( 1900, 2900 ] 71 0.192% 99.773% ( 2900, 4400 ] 77 0.208% 99.981% ( 4400, 6600 ] 16 0.043% 100.024% ( 6600, 9900 ] 1 0.003% 100.027% ** Level 5 read latency histogram (micros): Count: 120 Average: 1090.0417 StdDev: 1302.01 Min: 85 Median: 522.8571 Max: 6742 Percentiles: P50: 522.86 P75: 1576.92 P99: 6453.33 P99.9: 6742.00 P99.99: 6742.00 ------------------------------------------------------ ( 76, 110 ] 6 5.000% 5.000% # ( 110, 170 ] 24 20.000% 25.000% #### ( 170, 250 ] 7 5.833% 30.833% # ( 250, 380 ] 13 10.833% 41.667% ## ( 380, 580 ] 14 11.667% 53.333% ## ( 580, 870 ] 12 10.000% 63.333% ## ( 870, 1300 ] 8 6.667% 70.000% # ( 1300, 1900 ] 13 10.833% 80.833% ## ( 1900, 2900 ] 11 9.167% 90.000% ## ( 2900, 4400 ] 8 6.667% 96.667% # ( 4400, 6600 ] 3 2.500% 99.167% # ( 6600, 9900 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 40.1 total, 14.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 196.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.218 H:M:S, 42.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 69.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:10.769 H:M:S, 76.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/11/17-17:45:08 ... thread 0: (1000000,9000000) ops and (311666.7,208829.5) ops/second in (3.208556,43.097360) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 3.38 GB 62.9 8.5 0.0 8.5 17.0 8.5 0.0 2.0 146.9 294.7 59.17 55.10 156 0.379 8825K 13K 0.0 0.0 L1 18/18 2.25 GB 0.0 6.4 5.0 1.3 6.3 5.0 0.1 1.2 229.1 226.2 28.41 27.13 4 7.102 6608K 80K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 2.9 2.0 220.1 220.0 0.57 0.55 1 0.573 127K 45 0.0 0.0 L3 19/0 884.34 MB 0.9 4.0 2.3 1.8 4.0 2.3 0.7 1.8 183.7 182.9 22.42 18.43 15 1.495 4183K 17K 0.0 0.0 L4 168/0 9.49 GB 1.0 2.4 2.1 0.3 2.3 2.1 0.8 1.1 137.4 137.0 17.52 11.66 33 0.531 2385K 4939 0.0 0.0 L5 1076/0 88.58 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1295/29 104.57 GB 0.0 21.3 9.4 11.9 29.8 17.9 7.5 3.5 170.6 238.0 128.09 112.87 209 0.613 22M 117K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.3 9.4 11.9 29.8 17.9 7.5 3.5 170.6 238.0 128.09 112.87 209 0.613 22M 117K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.3 9.4 11.9 21.2 9.3 0.0 0.0 213.1 211.9 102.54 90.60 81 1.266 22M 117K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 342.7 25.55 22.27 128 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.3 total, 43.1 interval Flush(GB): cumulative 8.552, interval 8.552 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.77 GB write, 703.82 MB/s write, 21.34 GB read, 504.44 MB/s read, 128.1 seconds Interval compaction: 29.77 GB write, 707.43 MB/s write, 21.34 GB read, 507.03 MB/s read, 128.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 26, pending-compaction-bytes-stops: 0, total-delays: 50, total-stops: 32, interval: 82 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3875362 Average: 2.4378 StdDev: 16.68 Min: 0 Median: 1.5132 Max: 6016 Percentiles: P50: 1.51 P75: 1.89 P99: 5.93 P99.9: 14.48 P99.99: 198.07 ------------------------------------------------------ [ 0, 1 ] 621531 16.038% 16.038% ### ( 1, 2 ] 2564713 66.180% 82.218% ############# ( 2, 3 ] 414351 10.692% 92.910% ## ( 3, 4 ] 144227 3.722% 96.632% # ( 4, 6 ] 95214 2.457% 99.088% ( 6, 10 ] 28235 0.729% 99.817% ( 10, 15 ] 3587 0.093% 99.910% ( 15, 22 ] 492 0.013% 99.922% ( 22, 34 ] 35 0.001% 99.923% ( 34, 51 ] 17 0.000% 99.924% ( 51, 76 ] 35 0.001% 99.925% ( 76, 110 ] 1090 0.028% 99.953% ( 110, 170 ] 1292 0.033% 99.986% ( 170, 250 ] 446 0.012% 99.997% ( 250, 380 ] 351 0.009% 100.007% ( 380, 580 ] 300 0.008% 100.014% ( 580, 870 ] 192 0.005% 100.019% ( 870, 1300 ] 99 0.003% 100.022% ( 1300, 1900 ] 29 0.001% 100.023% ( 1900, 2900 ] 37 0.001% 100.024% ( 2900, 4400 ] 30 0.001% 100.024% ( 4400, 6600 ] 2 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1025902 Average: 3.6457 StdDev: 40.48 Min: 0 Median: 1.6975 Max: 8050 Percentiles: P50: 1.70 P75: 2.42 P99: 8.92 P99.9: 115.36 P99.99: 298.46 ------------------------------------------------------ [ 0, 1 ] 88618 8.638% 8.638% ## ( 1, 2 ] 608346 59.299% 67.937% ############ ( 2, 3 ] 172650 16.829% 84.766% ### ( 3, 4 ] 69099 6.735% 91.501% # ( 4, 6 ] 61767 6.021% 97.522% # ( 6, 10 ] 20766 2.024% 99.546% ( 10, 15 ] 2675 0.261% 99.807% ( 15, 22 ] 381 0.037% 99.844% ( 22, 34 ] 30 0.003% 99.847% ( 34, 51 ] 10 0.001% 99.848% ( 51, 76 ] 55 0.005% 99.853% ( 76, 110 ] 426 0.042% 99.895% ( 110, 170 ] 594 0.058% 99.953% ( 170, 250 ] 284 0.028% 99.980% ( 250, 380 ] 264 0.026% 100.006% ( 380, 580 ] 297 0.029% 100.035% ( 580, 870 ] 240 0.023% 100.058% ( 870, 1300 ] 150 0.015% 100.073% ( 1300, 1900 ] 63 0.006% 100.079% ( 1900, 2900 ] 45 0.004% 100.084% ( 2900, 4400 ] 33 0.003% 100.087% ( 4400, 6600 ] 7 0.001% 100.088% ( 6600, 9900 ] 5 0.000% 100.088% ** Level 2 read latency histogram (micros): Count: 31987 Average: 2.4018 StdDev: 4.84 Min: 1 Median: 1.6061 Max: 676 Percentiles: P50: 1.61 P75: 1.99 P99: 7.13 P99.9: 12.80 P99.99: 21.80 ------------------------------------------------------ [ 0, 1 ] 3233 10.107% 10.107% ## ( 1, 2 ] 21055 65.824% 75.931% ############# ( 2, 3 ] 4076 12.743% 88.674% ### ( 3, 4 ] 1867 5.837% 94.510% # ( 4, 6 ] 1334 4.170% 98.681% # ( 6, 10 ] 362 1.132% 99.812% ( 10, 15 ] 50 0.156% 99.969% ( 15, 22 ] 7 0.022% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 864683 Average: 4.4538 StdDev: 48.72 Min: 0 Median: 1.9100 Max: 6698 Percentiles: P50: 1.91 P75: 2.88 P99: 8.95 P99.9: 24.12 P99.99: 172.50 ------------------------------------------------------ [ 0, 1 ] 24316 2.812% 2.812% # ( 1, 2 ] 448359 51.852% 54.665% ########## ( 2, 3 ] 198855 22.997% 77.662% ##### ( 3, 4 ] 86956 10.056% 87.718% ## ( 4, 6 ] 84902 9.819% 97.537% ## ( 6, 10 ] 17152 1.984% 99.521% ( 10, 15 ] 2848 0.329% 99.850% ( 15, 22 ] 422 0.049% 99.899% ( 22, 34 ] 47 0.005% 99.904% ( 34, 51 ] 24 0.003% 99.907% ( 51, 76 ] 50 0.006% 99.913% ( 76, 110 ] 196 0.023% 99.936% ( 110, 170 ] 461 0.053% 99.989% ( 170, 250 ] 273 0.032% 100.021% ( 250, 380 ] 300 0.035% 100.055% ( 380, 580 ] 365 0.042% 100.097% ( 580, 870 ] 332 0.038% 100.136% ( 870, 1300 ] 196 0.023% 100.159% ( 1300, 1900 ] 87 0.010% 100.169% ( 1900, 2900 ] 57 0.007% 100.175% ( 2900, 4400 ] 55 0.006% 100.182% ( 4400, 6600 ] 9 0.001% 100.183% ( 6600, 9900 ] 1 0.000% 100.183% ** Level 4 read latency histogram (micros): Count: 72879 Average: 37.5645 StdDev: 225.47 Min: 0 Median: 2.0268 Max: 8159 Percentiles: P50: 2.03 P75: 3.32 P99: 861.11 P99.9: 3169.12 P99.99: 4143.25 ------------------------------------------------------ [ 0, 1 ] 1549 2.125% 2.125% ( 1, 2 ] 34459 47.282% 49.408% ######### ( 2, 3 ] 16073 22.054% 71.462% #### ( 3, 4 ] 8040 11.032% 82.494% ## ( 4, 6 ] 6352 8.716% 91.210% ## ( 6, 10 ] 2002 2.747% 93.957% # ( 10, 15 ] 270 0.370% 94.328% ( 15, 22 ] 49 0.067% 94.395% ( 22, 34 ] 20 0.027% 94.422% ( 34, 51 ] 1 0.001% 94.424% ( 51, 76 ] 4 0.005% 94.429% ( 76, 110 ] 220 0.302% 94.731% ( 110, 170 ] 612 0.840% 95.571% ( 170, 250 ] 546 0.749% 96.320% ( 250, 380 ] 600 0.823% 97.143% ( 380, 580 ] 759 1.041% 98.185% ( 580, 870 ] 613 0.841% 99.026% ( 870, 1300 ] 368 0.505% 99.531% ( 1300, 1900 ] 144 0.198% 99.728% ( 1900, 2900 ] 107 0.147% 99.875% ( 2900, 4400 ] 101 0.139% 100.014% ( 4400, 6600 ] 21 0.029% 100.043% ( 6600, 9900 ] 1 0.001% 100.044% ** Level 5 read latency histogram (micros): Count: 180 Average: 1011.6944 StdDev: 1199.29 Min: 85 Median: 490.0000 Max: 6742 Percentiles: P50: 490.00 P75: 1510.00 P99: 6013.33 P99.9: 6742.00 P99.99: 6742.00 ------------------------------------------------------ ( 76, 110 ] 11 6.111% 6.111% # ( 110, 170 ] 38 21.111% 27.222% #### ( 170, 250 ] 14 7.778% 35.000% ## ( 250, 380 ] 16 8.889% 43.889% ## ( 380, 580 ] 20 11.111% 55.000% ## ( 580, 870 ] 14 7.778% 62.778% ## ( 870, 1300 ] 15 8.333% 71.111% ## ( 1300, 1900 ] 20 11.111% 82.222% ## ( 1900, 2900 ] 17 9.444% 91.667% ## ( 2900, 4400 ] 11 6.111% 97.778% # ( 4400, 6600 ] 3 1.667% 99.444% ( 6600, 9900 ] 1 0.556% 100.000% ** DB Stats ** Uptime(secs): 43.3 total, 3.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 204.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.641 H:M:S, 40.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 306.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.422 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.320 micros/op 158224 ops/sec 60.123 seconds 9512999 operations; 153.3 MB/s Microseconds per write: Count: 9512999 Average: 6.3201 StdDev: 246.94 Min: 1 Median: 1.7990 Max: 336088 Percentiles: P50: 1.80 P75: 2.88 P99: 11.03 P99.9: 1178.21 P99.99: 2651.28 ------------------------------------------------------ [ 0, 1 ] 933331 9.811% 9.811% ## ( 1, 2 ] 4785068 50.300% 60.111% ########## ( 2, 3 ] 1612734 16.953% 77.064% ### ( 3, 4 ] 1341452 14.101% 91.166% ### ( 4, 6 ] 567453 5.965% 97.131% # ( 6, 10 ] 165849 1.743% 98.874% ( 10, 15 ] 57998 0.610% 99.484% ( 15, 22 ] 12350 0.130% 99.614% ( 22, 34 ] 2080 0.022% 99.635% ( 34, 51 ] 254 0.003% 99.638% ( 51, 76 ] 30 0.000% 99.638% ( 76, 110 ] 6395 0.067% 99.706% ( 110, 170 ] 2760 0.029% 99.735% ( 170, 250 ] 269 0.003% 99.737% ( 250, 380 ] 244 0.003% 99.740% ( 380, 580 ] 36 0.000% 99.740% ( 580, 870 ] 17 0.000% 99.741% ( 870, 1300 ] 21159 0.222% 99.963% ( 1300, 1900 ] 97 0.001% 99.964% ( 1900, 2900 ] 3290 0.035% 99.999% ( 2900, 4400 ] 85 0.001% 99.999% ( 4400, 6600 ] 23 0.000% 100.000% ( 6600, 9900 ] 11 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 10 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 223688 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9512999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9817414968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 539 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32546470 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31564090412 rocksdb.compact.write.bytes COUNT : 31326401457 rocksdb.flush.write.bytes COUNT : 9776682344 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 44 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 260 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9697695744 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3638272 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31655758526 rocksdb.non.last.level.read.count COUNT : 7648104 rocksdb.block.checksum.compute.count COUNT : 7647070 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.470945 P95 : 4.225680 P99 : 9.244092 P100 : 336083.000000 COUNT : 9512999 SUM : 55406354 rocksdb.compaction.times.micros P50 : 973333.333333 P95 : 4160000.000000 P99 : 22018878.000000 P100 : 22018878.000000 COUNT : 86 SUM : 133812987 rocksdb.compaction.times.cpu_micros P50 : 889142.857143 P95 : 3880000.000000 P99 : 18560000.000000 P100 : 20254530.000000 COUNT : 86 SUM : 119713325 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 705.308642 P95 : 1233.111111 P99 : 12524.000000 P100 : 42786.000000 COUNT : 136 SUM : 150662 rocksdb.compaction.outfile.sync.micros P50 : 1043.737374 P95 : 87055.555556 P99 : 178400.000000 P100 : 226385.000000 COUNT : 358 SUM : 4008422 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 101.311111 P95 : 725.000000 P99 : 1800.000000 P100 : 4323.000000 COUNT : 250 SUM : 51234 rocksdb.table.open.io.micros P50 : 1346.478873 P95 : 6347.647059 P99 : 9296.375000 P100 : 15560.000000 COUNT : 539 SUM : 990276 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.667383 P95 : 7.597992 P99 : 10.562713 P100 : 10351.000000 COUNT : 7645857 SUM : 42608403 rocksdb.read.block.get.micros P50 : 403.913043 P95 : 2761.403509 P99 : 4290.263158 P100 : 6815.000000 COUNT : 1078 SUM : 814658 rocksdb.write.raw.block.micros P50 : 0.513055 P95 : 0.974805 P99 : 3.081675 P100 : 11805.000000 COUNT : 9958753 SUM : 18195560 rocksdb.numfiles.in.singlecompaction P50 : 3.139344 P95 : 7.800000 P99 : 20.845000 P100 : 25.000000 COUNT : 133 SUM : 509 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562234 P95 : 1142.907114 P99 : 2253.837492 P100 : 335872.000000 COUNT : 224329 SUM : 32572517 rocksdb.sst.read.micros P50 : 1.579601 P95 : 4.375010 P99 : 8.222263 P100 : 8159.000000 COUNT : 7648797 SUM : 26515259 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9512999 SUM : 9817414968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 209611.650485 P95 : 329733.333333 P99 : 376880.000000 P100 : 542074.000000 COUNT : 136 SUM : 27198463 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 354 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0