[2024-11-17 23:14:38.424286] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-11-17 23:14:38.424426] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1983516 ] Set seed to 1731881678420760 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-17 23:14:38.533475] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-17 23:14:38.738387] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-17 23:14:38.738434] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1983516' to capture a snapshot of events at runtime. [2024-11-17 23:14:38.738443] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1983516 for offline analysis/debug. [2024-11-17 23:14:38.738482] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 17 23:14:47 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/17-23:14:50 ... thread 0: (1000000,1000000) ops and (365966.0,365966.0) ops/second in (2.732494,2.732494) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 629.97 MB 6.3 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 359.4 2.28 2.04 12 0.190 0 0 0.0 0.0 L1 1/1 63.00 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 1.01 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.1 2.0 250.6 250.6 0.50 0.49 1 0.503 127K 30 0.0 0.0 L3 18/0 929.30 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 228.0 228.0 0.55 0.49 1 0.548 126K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1189/9 96.94 GB 0.0 0.2 0.2 0.1 1.0 1.0 0.4 1.3 75.4 321.3 3.33 3.02 14 0.238 254K 30 0.0 0.0 Int 0/0 0.00 KB 0.0 0.2 0.2 0.1 1.0 1.0 0.2 1.3 75.4 321.3 3.33 3.02 14 0.238 254K 30 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.2 0.2 0.1 0.2 0.2 0.0 0.0 238.8 238.8 1.05 0.98 2 0.525 254K 30 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 359.4 2.28 2.04 12 0.190 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.7 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.04 GB write, 358.04 MB/s write, 0.25 GB read, 83.99 MB/s read, 3.3 seconds Interval compaction: 1.04 GB write, 391.30 MB/s write, 0.25 GB read, 91.79 MB/s read, 3.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 116952 Average: 1.9772 StdDev: 20.67 Min: 0 Median: 1.2808 Max: 3803 Percentiles: P50: 1.28 P75: 1.70 P99: 4.60 P99.9: 9.28 P99.99: 70.21 ------------------------------------------------------ [ 0, 1 ] 38736 33.121% 33.121% ####### ( 1, 2 ] 70290 60.102% 93.223% ############ ( 2, 3 ] 4456 3.810% 97.033% # ( 3, 4 ] 1967 1.682% 98.715% ( 4, 6 ] 1117 0.955% 99.670% ( 6, 10 ] 331 0.283% 99.953% ( 10, 15 ] 34 0.029% 99.982% ( 15, 22 ] 7 0.006% 99.988% ( 22, 34 ] 2 0.002% 99.990% ( 51, 76 ] 3 0.003% 99.992% ( 110, 170 ] 9 0.008% 100.000% ( 170, 250 ] 2 0.002% 100.002% ( 250, 380 ] 2 0.002% 100.003% ( 380, 580 ] 4 0.003% 100.007% ( 870, 1300 ] 2 0.002% 100.009% ( 1900, 2900 ] 1 0.001% 100.009% ( 2900, 4400 ] 4 0.003% 100.013% ** Level 2 read latency histogram (micros): Count: 31744 Average: 2.2609 StdDev: 46.02 Min: 0 Median: 1.2133 Max: 7218 Percentiles: P50: 1.21 P75: 1.64 P99: 3.47 P99.9: 9.66 P99.99: 1547.68 ------------------------------------------------------ [ 0, 1 ] 11895 37.472% 37.472% ####### ( 1, 2 ] 18645 58.736% 96.207% ############ ( 2, 3 ] 772 2.432% 98.639% ( 3, 4 ] 245 0.772% 99.411% ( 4, 6 ] 82 0.258% 99.669% ( 6, 10 ] 80 0.252% 99.921% ( 10, 15 ] 10 0.032% 99.953% ( 15, 22 ] 2 0.006% 99.959% ( 110, 170 ] 1 0.003% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 2 0.006% 99.972% ( 380, 580 ] 1 0.003% 99.975% ( 580, 870 ] 2 0.006% 99.981% ( 870, 1300 ] 2 0.006% 99.987% ( 1300, 1900 ] 2 0.006% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 1773.5250 StdDev: 2876.05 Min: 1 Median: 380.0000 Max: 10613 Percentiles: P50: 380.00 P75: 1900.00 P99: 10613.00 P99.9: 10613.00 P99.99: 10613.00 ------------------------------------------------------ [ 0, 1 ] 21 26.250% 26.250% ##### ( 1, 2 ] 10 12.500% 38.750% ### ( 2, 3 ] 3 3.750% 42.500% # ( 3, 4 ] 2 2.500% 45.000% # ( 4, 6 ] 1 1.250% 46.250% ( 6, 10 ] 1 1.250% 47.500% ( 110, 170 ] 1 1.250% 48.750% ( 250, 380 ] 1 1.250% 50.000% ( 380, 580 ] 5 6.250% 56.250% # ( 580, 870 ] 4 5.000% 61.250% # ( 870, 1300 ] 8 10.000% 71.250% ## ( 1300, 1900 ] 3 3.750% 75.000% # ( 1900, 2900 ] 3 3.750% 78.750% # ( 2900, 4400 ] 2 2.500% 81.250% # ( 4400, 6600 ] 7 8.750% 90.000% ## ( 6600, 9900 ] 6 7.500% 97.500% ## ( 9900, 14000 ] 2 2.500% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 3555.9333 StdDev: 3159.69 Min: 245 Median: 2900.0000 Max: 10769 Percentiles: P50: 2900.00 P75: 5814.29 P99: 10769.00 P99.9: 10769.00 P99.99: 10769.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 2 6.667% 10.000% # ( 380, 580 ] 4 13.333% 23.333% ### ( 580, 870 ] 2 6.667% 30.000% # ( 870, 1300 ] 4 13.333% 43.333% ### ( 1900, 2900 ] 2 6.667% 50.000% # ( 2900, 4400 ] 3 10.000% 60.000% ## ( 4400, 6600 ] 7 23.333% 83.333% ##### ( 6600, 9900 ] 4 13.333% 96.667% ### ( 9900, 14000 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 329.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.183 H:M:S, 6.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 359.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.183 H:M:S, 6.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-23:14:53 ... thread 0: (1000000,2000000) ops and (334608.1,349585.3) ops/second in (2.988571,5.721065) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/10 1.35 GB 0.0 0.9 0.0 0.9 2.6 1.8 0.0 1.5 105.6 324.1 8.35 7.75 29 0.288 895K 991 0.0 0.0 L1 1/1 2.56 MB 0.0 0.3 0.2 0.1 0.3 0.2 0.2 1.2 253.1 252.8 1.24 1.20 1 1.244 319K 353 0.0 0.0 L2 2/0 55.50 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.4 2.0 250.6 250.6 0.50 0.49 1 0.503 127K 30 0.0 0.0 L3 47/0 995.44 MB 1.0 0.5 0.4 0.1 0.5 0.4 0.1 1.3 188.3 188.2 2.63 2.18 2 1.314 502K 335 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/11 97.92 GB 0.0 1.8 0.7 1.1 3.6 2.5 0.8 2.0 142.8 286.2 12.73 11.62 33 0.386 1845K 1709 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.7 1.1 3.6 2.5 0.7 2.0 142.8 286.2 12.73 11.62 33 0.386 1845K 1709 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.7 1.1 1.8 0.7 0.0 0.0 237.4 237.2 7.66 7.09 7 1.094 1845K 1709 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 360.1 5.07 4.53 26 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.7 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.56 GB write, 609.51 MB/s write, 1.78 GB read, 304.14 MB/s read, 12.7 seconds Interval compaction: 3.56 GB write, 636.56 MB/s write, 1.78 GB read, 317.64 MB/s read, 12.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 378241 Average: 2.0935 StdDev: 14.01 Min: 0 Median: 1.4061 Max: 3803 Percentiles: P50: 1.41 P75: 1.80 P99: 5.53 P99.9: 9.97 P99.99: 20.44 ------------------------------------------------------ [ 0, 1 ] 91128 24.093% 24.093% ##### ( 1, 2 ] 241309 63.798% 87.890% ############# ( 2, 3 ] 26456 6.994% 94.885% # ( 3, 4 ] 10260 2.713% 97.597% # ( 4, 6 ] 6958 1.840% 99.437% ( 6, 10 ] 1768 0.467% 99.904% ( 10, 15 ] 298 0.079% 99.983% ( 15, 22 ] 35 0.009% 99.992% ( 22, 34 ] 6 0.002% 99.994% ( 34, 51 ] 3 0.001% 99.995% ( 51, 76 ] 6 0.002% 99.996% ( 110, 170 ] 15 0.004% 100.000% ( 170, 250 ] 9 0.002% 100.003% ( 250, 380 ] 6 0.002% 100.004% ( 380, 580 ] 9 0.002% 100.007% ( 580, 870 ] 3 0.001% 100.007% ( 870, 1300 ] 7 0.002% 100.009% ( 1300, 1900 ] 3 0.001% 100.010% ( 1900, 2900 ] 3 0.001% 100.011% ( 2900, 4400 ] 4 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 65399 Average: 2.3721 StdDev: 6.50 Min: 1 Median: 1.6146 Max: 1109 Percentiles: P50: 1.61 P75: 2.00 P99: 5.89 P99.9: 12.65 P99.99: 62.50 ------------------------------------------------------ [ 0, 1 ] 6337 9.690% 9.690% ## ( 1, 2 ] 42895 65.590% 75.279% ############# ( 2, 3 ] 10770 16.468% 91.748% ### ( 3, 4 ] 2292 3.505% 95.252% # ( 4, 6 ] 2589 3.959% 99.211% # ( 6, 10 ] 397 0.607% 99.818% ( 10, 15 ] 101 0.154% 99.972% ( 15, 22 ] 9 0.014% 99.986% ( 22, 34 ] 1 0.002% 99.988% ( 34, 51 ] 1 0.002% 99.989% ( 51, 76 ] 1 0.002% 99.991% ( 110, 170 ] 1 0.002% 99.992% ( 250, 380 ] 3 0.005% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 31744 Average: 2.2609 StdDev: 46.02 Min: 0 Median: 1.2133 Max: 7218 Percentiles: P50: 1.21 P75: 1.64 P99: 3.47 P99.9: 9.66 P99.99: 1547.68 ------------------------------------------------------ [ 0, 1 ] 11895 37.472% 37.472% ####### ( 1, 2 ] 18645 58.736% 96.207% ############ ( 2, 3 ] 772 2.432% 98.639% ( 3, 4 ] 245 0.772% 99.411% ( 4, 6 ] 82 0.258% 99.669% ( 6, 10 ] 80 0.252% 99.921% ( 10, 15 ] 10 0.032% 99.953% ( 15, 22 ] 2 0.006% 99.959% ( 110, 170 ] 1 0.003% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 2 0.006% 99.972% ( 380, 580 ] 1 0.003% 99.975% ( 580, 870 ] 2 0.006% 99.981% ( 870, 1300 ] 2 0.006% 99.987% ( 1300, 1900 ] 2 0.006% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28878 Average: 7.3084 StdDev: 177.79 Min: 0 Median: 1.5996 Max: 10613 Percentiles: P50: 1.60 P75: 1.98 P99: 7.56 P99.9: 984.06 P99.99: 9411.71 ------------------------------------------------------ [ 0, 1 ] 3121 10.808% 10.808% ## ( 1, 2 ] 18875 65.361% 76.169% ############# ( 2, 3 ] 4358 15.091% 91.260% ### ( 3, 4 ] 1051 3.639% 94.899% # ( 4, 6 ] 1090 3.774% 98.674% # ( 6, 10 ] 241 0.835% 99.508% ( 10, 15 ] 73 0.253% 99.761% ( 15, 22 ] 13 0.045% 99.806% ( 22, 34 ] 6 0.021% 99.827% ( 34, 51 ] 1 0.003% 99.830% ( 110, 170 ] 2 0.007% 99.837% ( 170, 250 ] 4 0.014% 99.851% ( 250, 380 ] 1 0.003% 99.855% ( 380, 580 ] 6 0.021% 99.875% ( 580, 870 ] 5 0.017% 99.893% ( 870, 1300 ] 8 0.028% 99.920% ( 1300, 1900 ] 3 0.010% 99.931% ( 1900, 2900 ] 3 0.010% 99.941% ( 2900, 4400 ] 2 0.007% 99.948% ( 4400, 6600 ] 7 0.024% 99.972% ( 6600, 9900 ] 6 0.021% 99.993% ( 9900, 14000 ] 2 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 3555.9333 StdDev: 3159.69 Min: 245 Median: 2900.0000 Max: 10769 Percentiles: P50: 2900.00 P75: 5814.29 P99: 10769.00 P99.9: 10769.00 P99.99: 10769.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 2 6.667% 10.000% # ( 380, 580 ] 4 13.333% 23.333% ### ( 580, 870 ] 2 6.667% 30.000% # ( 870, 1300 ] 4 13.333% 43.333% ### ( 1900, 2900 ] 2 6.667% 50.000% # ( 2900, 4400 ] 3 10.000% 60.000% ## ( 4400, 6600 ] 7 23.333% 83.333% ##### ( 6600, 9900 ] 4 13.333% 96.667% ### ( 9900, 14000 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 6.0 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 329.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.587 H:M:S, 9.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.32 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.403 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-23:14:55 ... thread 0: (1000000,3000000) ops and (335814.8,344871.3) ops/second in (2.977832,8.698897) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 2.27 GB 94.4 1.7 0.0 1.7 4.4 2.8 0.0 1.6 119.2 317.6 14.27 13.32 46 0.310 1727K 1851 0.0 0.0 L1 1/1 2.56 MB 0.0 0.3 0.2 0.1 0.3 0.2 0.2 1.2 253.1 252.8 1.24 1.20 1 1.244 319K 353 0.0 0.0 L2 2/0 55.50 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.4 2.0 250.6 250.6 0.50 0.49 1 0.503 127K 30 0.0 0.0 L3 47/0 995.44 MB 1.0 0.5 0.4 0.1 0.5 0.4 0.1 1.3 188.3 188.2 2.63 2.18 2 1.314 502K 335 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1252/11 98.84 GB 0.0 2.6 0.7 1.9 5.3 3.4 0.8 1.9 141.4 293.3 18.65 17.19 50 0.373 2677K 2569 0.0 0.0 Int 0/0 0.00 KB 0.0 2.6 0.7 1.9 5.3 3.4 0.7 1.9 141.4 293.3 18.65 17.19 50 0.373 2677K 2569 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.6 0.7 1.9 2.6 0.7 0.0 0.0 244.9 244.7 10.77 10.14 10 1.077 2677K 2569 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 359.6 7.88 7.04 40 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.7 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.34 GB write, 610.72 MB/s write, 2.57 GB read, 294.45 MB/s read, 18.6 seconds Interval compaction: 5.34 GB write, 628.55 MB/s write, 2.57 GB read, 303.05 MB/s read, 18.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 775969 Average: 2.1586 StdDev: 11.86 Min: 0 Median: 1.4722 Max: 3803 Percentiles: P50: 1.47 P75: 1.85 P99: 5.60 P99.9: 9.89 P99.99: 14.37 ------------------------------------------------------ [ 0, 1 ] 146750 18.912% 18.912% #### ( 1, 2 ] 510875 65.837% 84.749% ############# ( 2, 3 ] 73340 9.451% 94.200% ## ( 3, 4 ] 23095 2.976% 97.177% # ( 4, 6 ] 17695 2.280% 99.457% ( 6, 10 ] 3537 0.456% 99.913% ( 10, 15 ] 686 0.088% 100.001% ( 15, 22 ] 52 0.007% 100.008% ( 22, 34 ] 8 0.001% 100.009% ( 34, 51 ] 6 0.001% 100.010% ( 51, 76 ] 8 0.001% 100.011% ( 110, 170 ] 25 0.003% 100.014% ( 170, 250 ] 13 0.002% 100.016% ( 250, 380 ] 9 0.001% 100.017% ( 380, 580 ] 15 0.002% 100.019% ( 580, 870 ] 9 0.001% 100.020% ( 870, 1300 ] 12 0.002% 100.021% ( 1300, 1900 ] 4 0.001% 100.022% ( 1900, 2900 ] 3 0.000% 100.022% ( 2900, 4400 ] 6 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 65399 Average: 2.3721 StdDev: 6.50 Min: 1 Median: 1.6146 Max: 1109 Percentiles: P50: 1.61 P75: 2.00 P99: 5.89 P99.9: 12.65 P99.99: 62.50 ------------------------------------------------------ [ 0, 1 ] 6337 9.690% 9.690% ## ( 1, 2 ] 42895 65.590% 75.279% ############# ( 2, 3 ] 10770 16.468% 91.748% ### ( 3, 4 ] 2292 3.505% 95.252% # ( 4, 6 ] 2589 3.959% 99.211% # ( 6, 10 ] 397 0.607% 99.818% ( 10, 15 ] 101 0.154% 99.972% ( 15, 22 ] 9 0.014% 99.986% ( 22, 34 ] 1 0.002% 99.988% ( 34, 51 ] 1 0.002% 99.989% ( 51, 76 ] 1 0.002% 99.991% ( 110, 170 ] 1 0.002% 99.992% ( 250, 380 ] 3 0.005% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 31744 Average: 2.2609 StdDev: 46.02 Min: 0 Median: 1.2133 Max: 7218 Percentiles: P50: 1.21 P75: 1.64 P99: 3.47 P99.9: 9.66 P99.99: 1547.68 ------------------------------------------------------ [ 0, 1 ] 11895 37.472% 37.472% ####### ( 1, 2 ] 18645 58.736% 96.207% ############ ( 2, 3 ] 772 2.432% 98.639% ( 3, 4 ] 245 0.772% 99.411% ( 4, 6 ] 82 0.258% 99.669% ( 6, 10 ] 80 0.252% 99.921% ( 10, 15 ] 10 0.032% 99.953% ( 15, 22 ] 2 0.006% 99.959% ( 110, 170 ] 1 0.003% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 2 0.006% 99.972% ( 380, 580 ] 1 0.003% 99.975% ( 580, 870 ] 2 0.006% 99.981% ( 870, 1300 ] 2 0.006% 99.987% ( 1300, 1900 ] 2 0.006% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28878 Average: 7.3084 StdDev: 177.79 Min: 0 Median: 1.5996 Max: 10613 Percentiles: P50: 1.60 P75: 1.98 P99: 7.56 P99.9: 984.06 P99.99: 9411.71 ------------------------------------------------------ [ 0, 1 ] 3121 10.808% 10.808% ## ( 1, 2 ] 18875 65.361% 76.169% ############# ( 2, 3 ] 4358 15.091% 91.260% ### ( 3, 4 ] 1051 3.639% 94.899% # ( 4, 6 ] 1090 3.774% 98.674% # ( 6, 10 ] 241 0.835% 99.508% ( 10, 15 ] 73 0.253% 99.761% ( 15, 22 ] 13 0.045% 99.806% ( 22, 34 ] 6 0.021% 99.827% ( 34, 51 ] 1 0.003% 99.830% ( 110, 170 ] 2 0.007% 99.837% ( 170, 250 ] 4 0.014% 99.851% ( 250, 380 ] 1 0.003% 99.855% ( 380, 580 ] 6 0.021% 99.875% ( 580, 870 ] 5 0.017% 99.893% ( 870, 1300 ] 8 0.028% 99.920% ( 1300, 1900 ] 3 0.010% 99.931% ( 1900, 2900 ] 3 0.010% 99.941% ( 2900, 4400 ] 2 0.007% 99.948% ( 4400, 6600 ] 7 0.024% 99.972% ( 6600, 9900 ] 6 0.021% 99.993% ( 9900, 14000 ] 2 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 3555.9333 StdDev: 3159.69 Min: 245 Median: 2900.0000 Max: 10769 Percentiles: P50: 2900.00 P75: 5814.29 P99: 10769.00 P99.9: 10769.00 P99.99: 10769.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 2 6.667% 10.000% # ( 380, 580 ] 4 13.333% 23.333% ### ( 580, 870 ] 2 6.667% 30.000% # ( 870, 1300 ] 4 13.333% 43.333% ### ( 1900, 2900 ] 2 6.667% 50.000% # ( 2900, 4400 ] 3 10.000% 60.000% ## ( 4400, 6600 ] 7 23.333% 83.333% ##### ( 6600, 9900 ] 4 13.333% 96.667% ### ( 9900, 14000 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 329.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.971 H:M:S, 10.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.385 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-23:14:58 ... thread 0: (1000000,4000000) ops and (332751.7,341759.4) ops/second in (3.005244,11.704141) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.15 GB 188.8 2.5 0.0 2.5 6.1 3.7 0.0 1.7 125.9 314.6 20.01 18.68 62 0.323 2558K 2687 0.0 0.0 L1 11/0 1.10 GB 113.0 1.4 1.4 0.1 1.4 1.3 0.2 1.0 241.2 240.3 6.01 5.86 2 3.006 1472K 5591 0.0 0.0 L2 2/0 55.50 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.4 2.0 250.6 250.6 0.50 0.49 1 0.503 127K 30 0.0 0.0 L3 47/0 995.44 MB 1.0 0.5 0.4 0.1 0.5 0.4 0.1 1.3 188.3 188.2 2.63 2.18 2 1.314 502K 335 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1261/4 99.82 GB 0.0 4.5 1.8 2.7 8.2 5.5 0.8 2.2 157.5 286.8 29.16 27.21 67 0.435 4661K 8643 0.0 0.0 Int 0/0 0.00 KB 0.0 4.5 1.8 2.7 8.2 5.5 0.7 2.2 157.5 286.8 29.16 27.21 67 0.435 4661K 8643 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.5 1.8 2.7 4.5 1.8 0.0 0.0 246.4 245.9 18.63 17.83 14 1.331 4661K 8643 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 359.2 10.52 9.38 53 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.7 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.17 GB write, 699.17 MB/s write, 4.48 GB read, 383.89 MB/s read, 29.2 seconds Interval compaction: 8.17 GB write, 714.35 MB/s write, 4.48 GB read, 392.22 MB/s read, 29.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1072820 Average: 2.1315 StdDev: 12.11 Min: 0 Median: 1.4588 Max: 3803 Percentiles: P50: 1.46 P75: 1.84 P99: 5.49 P99.9: 9.81 P99.99: 14.45 ------------------------------------------------------ [ 0, 1 ] 210208 19.594% 19.594% #### ( 1, 2 ] 711010 66.275% 85.869% ############# ( 2, 3 ] 94599 8.818% 94.687% ## ( 3, 4 ] 30166 2.812% 97.498% # ( 4, 6 ] 21576 2.011% 99.510% ( 6, 10 ] 4393 0.409% 99.919% ( 10, 15 ] 856 0.080% 99.999% ( 15, 22 ] 65 0.006% 100.005% ( 22, 34 ] 10 0.001% 100.006% ( 34, 51 ] 8 0.001% 100.007% ( 51, 76 ] 12 0.001% 100.008% ( 110, 170 ] 30 0.003% 100.011% ( 170, 250 ] 18 0.002% 100.012% ( 250, 380 ] 11 0.001% 100.013% ( 380, 580 ] 19 0.002% 100.015% ( 580, 870 ] 14 0.001% 100.016% ( 870, 1300 ] 18 0.002% 100.018% ( 1300, 1900 ] 5 0.000% 100.018% ( 1900, 2900 ] 5 0.000% 100.019% ( 2900, 4400 ] 8 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 66103 Average: 2.5998 StdDev: 17.04 Min: 1 Median: 1.6126 Max: 1543 Percentiles: P50: 1.61 P75: 1.99 P99: 5.91 P99.9: 13.71 P99.99: 1234.39 ------------------------------------------------------ [ 0, 1 ] 6494 9.824% 9.824% ## ( 1, 2 ] 43349 65.578% 75.402% ############# ( 2, 3 ] 10810 16.353% 91.755% ### ( 3, 4 ] 2315 3.502% 95.257% # ( 4, 6 ] 2594 3.924% 99.182% # ( 6, 10 ] 400 0.605% 99.787% ( 10, 15 ] 101 0.153% 99.939% ( 15, 22 ] 10 0.015% 99.955% ( 22, 34 ] 1 0.002% 99.956% ( 34, 51 ] 1 0.002% 99.958% ( 51, 76 ] 1 0.002% 99.959% ( 110, 170 ] 1 0.002% 99.961% ( 170, 250 ] 3 0.005% 99.965% ( 250, 380 ] 10 0.015% 99.980% ( 380, 580 ] 2 0.003% 99.983% ( 580, 870 ] 1 0.002% 99.985% ( 870, 1300 ] 4 0.006% 99.991% ( 1300, 1900 ] 6 0.009% 100.000% ** Level 2 read latency histogram (micros): Count: 31744 Average: 2.2609 StdDev: 46.02 Min: 0 Median: 1.2133 Max: 7218 Percentiles: P50: 1.21 P75: 1.64 P99: 3.47 P99.9: 9.66 P99.99: 1547.68 ------------------------------------------------------ [ 0, 1 ] 11895 37.472% 37.472% ####### ( 1, 2 ] 18645 58.736% 96.207% ############ ( 2, 3 ] 772 2.432% 98.639% ( 3, 4 ] 245 0.772% 99.411% ( 4, 6 ] 82 0.258% 99.669% ( 6, 10 ] 80 0.252% 99.921% ( 10, 15 ] 10 0.032% 99.953% ( 15, 22 ] 2 0.006% 99.959% ( 110, 170 ] 1 0.003% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 2 0.006% 99.972% ( 380, 580 ] 1 0.003% 99.975% ( 580, 870 ] 2 0.006% 99.981% ( 870, 1300 ] 2 0.006% 99.987% ( 1300, 1900 ] 2 0.006% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28878 Average: 7.3084 StdDev: 177.79 Min: 0 Median: 1.5996 Max: 10613 Percentiles: P50: 1.60 P75: 1.98 P99: 7.56 P99.9: 984.06 P99.99: 9411.71 ------------------------------------------------------ [ 0, 1 ] 3121 10.808% 10.808% ## ( 1, 2 ] 18875 65.361% 76.169% ############# ( 2, 3 ] 4358 15.091% 91.260% ### ( 3, 4 ] 1051 3.639% 94.899% # ( 4, 6 ] 1090 3.774% 98.674% # ( 6, 10 ] 241 0.835% 99.508% ( 10, 15 ] 73 0.253% 99.761% ( 15, 22 ] 13 0.045% 99.806% ( 22, 34 ] 6 0.021% 99.827% ( 34, 51 ] 1 0.003% 99.830% ( 110, 170 ] 2 0.007% 99.837% ( 170, 250 ] 4 0.014% 99.851% ( 250, 380 ] 1 0.003% 99.855% ( 380, 580 ] 6 0.021% 99.875% ( 580, 870 ] 5 0.017% 99.893% ( 870, 1300 ] 8 0.028% 99.920% ( 1300, 1900 ] 3 0.010% 99.931% ( 1900, 2900 ] 3 0.010% 99.941% ( 2900, 4400 ] 2 0.007% 99.948% ( 4400, 6600 ] 7 0.024% 99.972% ( 6600, 9900 ] 6 0.021% 99.993% ( 9900, 14000 ] 2 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 3555.9333 StdDev: 3159.69 Min: 245 Median: 2900.0000 Max: 10769 Percentiles: P50: 2900.00 P75: 5814.29 P99: 10769.00 P99.9: 10769.00 P99.99: 10769.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 2 6.667% 10.000% # ( 380, 580 ] 4 13.333% 23.333% ### ( 580, 870 ] 2 6.667% 30.000% # ( 870, 1300 ] 4 13.333% 43.333% ### ( 1900, 2900 ] 2 6.667% 50.000% # ( 2900, 4400 ] 3 10.000% 60.000% ## ( 4400, 6600 ] 7 23.333% 83.333% ##### ( 6600, 9900 ] 4 13.333% 96.667% ### ( 9900, 14000 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 329.16 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.424 H:M:S, 11.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.51 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.452 H:M:S, 15.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-23:15:01 ... thread 0: (1000000,5000000) ops and (338643.5,341131.6) ops/second in (2.952958,14.657099) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 3.13 GB 37.8 3.3 0.0 3.3 7.9 4.7 0.0 1.7 129.2 314.4 25.84 24.14 79 0.327 3390K 3576 0.0 0.0 L1 11/11 1.10 GB 0.0 1.4 1.4 0.1 1.4 1.3 0.2 1.0 241.2 240.3 6.01 5.86 2 3.006 1472K 5591 0.0 0.0 L2 2/0 55.50 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.4 2.0 250.6 250.6 0.50 0.49 1 0.503 127K 30 0.0 0.0 L3 47/0 995.44 MB 1.0 0.5 0.4 0.1 0.5 0.4 0.1 1.3 188.3 188.2 2.63 2.18 2 1.314 502K 335 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1266/27 100.80 GB 0.0 5.3 1.8 3.5 9.9 6.5 0.8 2.1 154.7 291.2 34.98 32.67 84 0.416 5493K 9532 0.0 0.0 Int 0/0 0.00 KB 0.0 5.3 1.8 3.5 9.9 6.5 0.7 2.1 154.7 291.2 34.98 32.67 84 0.416 5493K 9532 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.3 1.8 3.5 5.3 1.8 0.0 0.0 249.7 249.3 21.66 20.81 17 1.274 5493K 9532 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 359.5 13.32 11.86 67 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.9 total, 14.7 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.95 GB write, 683.17 MB/s write, 5.28 GB read, 362.79 MB/s read, 35.0 seconds Interval compaction: 9.95 GB write, 695.01 MB/s write, 5.28 GB read, 369.07 MB/s read, 35.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 20, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1321127 Average: 2.1367 StdDev: 12.40 Min: 0 Median: 1.4547 Max: 3803 Percentiles: P50: 1.45 P75: 1.83 P99: 5.45 P99.9: 9.83 P99.99: 15.31 ------------------------------------------------------ [ 0, 1 ] 260894 19.748% 19.748% #### ( 1, 2 ] 878996 66.534% 86.282% ############# ( 2, 3 ] 113689 8.605% 94.887% ## ( 3, 4 ] 36116 2.734% 97.621% # ( 4, 6 ] 25099 1.900% 99.521% ( 6, 10 ] 5231 0.396% 99.917% ( 10, 15 ] 966 0.073% 99.990% ( 15, 22 ] 88 0.007% 99.996% ( 22, 34 ] 11 0.001% 99.997% ( 34, 51 ] 9 0.001% 99.998% ( 51, 76 ] 20 0.002% 99.999% ( 76, 110 ] 32 0.002% 100.002% ( 110, 170 ] 71 0.005% 100.007% ( 170, 250 ] 39 0.003% 100.010% ( 250, 380 ] 20 0.002% 100.012% ( 380, 580 ] 27 0.002% 100.014% ( 580, 870 ] 20 0.002% 100.015% ( 870, 1300 ] 23 0.002% 100.017% ( 1300, 1900 ] 6 0.000% 100.017% ( 1900, 2900 ] 7 0.001% 100.018% ( 2900, 4400 ] 10 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 97806 Average: 2.5027 StdDev: 14.71 Min: 1 Median: 1.5531 Max: 1543 Percentiles: P50: 1.55 P75: 1.93 P99: 6.76 P99.9: 19.58 P99.99: 974.87 ------------------------------------------------------ [ 0, 1 ] 13204 13.500% 13.500% ### ( 1, 2 ] 64545 65.993% 79.493% ############# ( 2, 3 ] 12895 13.184% 92.677% ### ( 3, 4 ] 3041 3.109% 95.787% # ( 4, 6 ] 2969 3.036% 98.822% # ( 6, 10 ] 919 0.940% 99.762% ( 10, 15 ] 128 0.131% 99.893% ( 15, 22 ] 11 0.011% 99.904% ( 22, 34 ] 1 0.001% 99.905% ( 34, 51 ] 1 0.001% 99.906% ( 51, 76 ] 1 0.001% 99.907% ( 76, 110 ] 44 0.045% 99.952% ( 110, 170 ] 17 0.017% 99.969% ( 170, 250 ] 3 0.003% 99.972% ( 250, 380 ] 12 0.012% 99.985% ( 380, 580 ] 3 0.003% 99.988% ( 580, 870 ] 1 0.001% 99.989% ( 870, 1300 ] 5 0.005% 99.994% ( 1300, 1900 ] 6 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 31744 Average: 2.2609 StdDev: 46.02 Min: 0 Median: 1.2133 Max: 7218 Percentiles: P50: 1.21 P75: 1.64 P99: 3.47 P99.9: 9.66 P99.99: 1547.68 ------------------------------------------------------ [ 0, 1 ] 11895 37.472% 37.472% ####### ( 1, 2 ] 18645 58.736% 96.207% ############ ( 2, 3 ] 772 2.432% 98.639% ( 3, 4 ] 245 0.772% 99.411% ( 4, 6 ] 82 0.258% 99.669% ( 6, 10 ] 80 0.252% 99.921% ( 10, 15 ] 10 0.032% 99.953% ( 15, 22 ] 2 0.006% 99.959% ( 110, 170 ] 1 0.003% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 2 0.006% 99.972% ( 380, 580 ] 1 0.003% 99.975% ( 580, 870 ] 2 0.006% 99.981% ( 870, 1300 ] 2 0.006% 99.987% ( 1300, 1900 ] 2 0.006% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28878 Average: 7.3084 StdDev: 177.79 Min: 0 Median: 1.5996 Max: 10613 Percentiles: P50: 1.60 P75: 1.98 P99: 7.56 P99.9: 984.06 P99.99: 9411.71 ------------------------------------------------------ [ 0, 1 ] 3121 10.808% 10.808% ## ( 1, 2 ] 18875 65.361% 76.169% ############# ( 2, 3 ] 4358 15.091% 91.260% ### ( 3, 4 ] 1051 3.639% 94.899% # ( 4, 6 ] 1090 3.774% 98.674% # ( 6, 10 ] 241 0.835% 99.508% ( 10, 15 ] 73 0.253% 99.761% ( 15, 22 ] 13 0.045% 99.806% ( 22, 34 ] 6 0.021% 99.827% ( 34, 51 ] 1 0.003% 99.830% ( 110, 170 ] 2 0.007% 99.837% ( 170, 250 ] 4 0.014% 99.851% ( 250, 380 ] 1 0.003% 99.855% ( 380, 580 ] 6 0.021% 99.875% ( 580, 870 ] 5 0.017% 99.893% ( 870, 1300 ] 8 0.028% 99.920% ( 1300, 1900 ] 3 0.010% 99.931% ( 1900, 2900 ] 3 0.010% 99.941% ( 2900, 4400 ] 2 0.007% 99.948% ( 4400, 6600 ] 7 0.024% 99.972% ( 6600, 9900 ] 6 0.021% 99.993% ( 9900, 14000 ] 2 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 3555.9333 StdDev: 3159.69 Min: 245 Median: 2900.0000 Max: 10769 Percentiles: P50: 2900.00 P75: 5814.29 P99: 10769.00 P99.9: 10769.00 P99.99: 10769.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 2 6.667% 10.000% # ( 380, 580 ] 4 13.333% 23.333% ### ( 580, 870 ] 2 6.667% 30.000% # ( 870, 1300 ] 4 13.333% 43.333% ### ( 1900, 2900 ] 2 6.667% 50.000% # ( 2900, 4400 ] 3 10.000% 60.000% ## ( 4400, 6600 ] 7 23.333% 83.333% ##### ( 6600, 9900 ] 4 13.333% 96.667% ### ( 9900, 14000 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 14.9 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 329.97 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.812 H:M:S, 12.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 333.29 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.389 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-23:15:11 ... thread 0: (1000000,6000000) ops and (105530.9,248622.2) ops/second in (9.475902,24.133001) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 4.11 GB 137.8 5.3 0.0 5.3 10.9 5.6 0.0 1.9 147.9 305.8 36.63 34.35 98 0.374 5500K 10K 0.0 0.0 L1 11/11 1.10 GB 0.0 1.4 1.4 0.1 1.4 1.3 0.2 1.0 241.2 240.3 6.01 5.86 2 3.006 1472K 5591 0.0 0.0 L2 2/0 55.50 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.4 2.0 250.6 250.6 0.50 0.49 1 0.503 127K 30 0.0 0.0 L3 47/0 995.44 MB 1.0 0.5 0.4 0.1 0.5 0.4 0.1 1.3 188.3 188.2 2.63 2.18 2 1.314 502K 335 0.0 0.0 L4 144/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1267/27 101.78 GB 0.0 7.3 1.8 5.5 13.0 7.4 0.8 2.3 163.6 289.8 45.77 42.88 103 0.444 7603K 16K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.3 1.8 5.5 13.0 7.4 0.7 2.3 163.6 289.8 45.77 42.88 103 0.444 7603K 16K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.3 1.8 5.5 7.3 1.8 0.0 0.0 253.2 252.6 29.57 28.46 21 1.408 7603K 16K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 357.7 16.20 14.41 82 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.4 total, 24.1 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.96 GB write, 543.95 MB/s write, 7.31 GB read, 307.02 MB/s read, 45.8 seconds Interval compaction: 12.96 GB write, 549.68 MB/s write, 7.31 GB read, 310.25 MB/s read, 45.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 22, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2248948 Average: 2.3767 StdDev: 14.04 Min: 0 Median: 1.4695 Max: 3803 Percentiles: P50: 1.47 P75: 1.84 P99: 5.77 P99.9: 101.58 P99.99: 214.36 ------------------------------------------------------ [ 0, 1 ] 412934 18.361% 18.361% #### ( 1, 2 ] 1515515 67.388% 85.749% ############# ( 2, 3 ] 198995 8.848% 94.597% ## ( 3, 4 ] 62033 2.758% 97.356% # ( 4, 6 ] 41829 1.860% 99.216% ( 6, 10 ] 12719 0.566% 99.781% ( 10, 15 ] 1620 0.072% 99.853% ( 15, 22 ] 233 0.010% 99.863% ( 22, 34 ] 20 0.001% 99.864% ( 34, 51 ] 9 0.000% 99.865% ( 51, 76 ] 23 0.001% 99.866% ( 76, 110 ] 1025 0.046% 99.911% ( 110, 170 ] 1586 0.071% 99.982% ( 170, 250 ] 332 0.015% 99.997% ( 250, 380 ] 169 0.008% 100.004% ( 380, 580 ] 185 0.008% 100.012% ( 580, 870 ] 74 0.003% 100.016% ( 870, 1300 ] 46 0.002% 100.018% ( 1300, 1900 ] 14 0.001% 100.018% ( 1900, 2900 ] 10 0.000% 100.019% ( 2900, 4400 ] 15 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 260123 Average: 2.5686 StdDev: 12.02 Min: 1 Median: 1.5206 Max: 1543 Percentiles: P50: 1.52 P75: 1.89 P99: 8.04 P99.9: 126.16 P99.99: 503.69 ------------------------------------------------------ [ 0, 1 ] 38391 14.759% 14.759% ### ( 1, 2 ] 176074 67.689% 82.448% ############## ( 2, 3 ] 27821 10.695% 93.143% ## ( 3, 4 ] 7331 2.818% 95.961% # ( 4, 6 ] 6115 2.351% 98.312% ( 6, 10 ] 3502 1.346% 99.658% ( 10, 15 ] 257 0.099% 99.757% ( 15, 22 ] 36 0.014% 99.771% ( 22, 34 ] 2 0.001% 99.772% ( 34, 51 ] 1 0.000% 99.772% ( 51, 76 ] 1 0.000% 99.772% ( 76, 110 ] 278 0.107% 99.879% ( 110, 170 ] 200 0.077% 99.956% ( 170, 250 ] 37 0.014% 99.970% ( 250, 380 ] 38 0.015% 99.985% ( 380, 580 ] 21 0.008% 99.993% ( 580, 870 ] 5 0.002% 99.995% ( 870, 1300 ] 7 0.003% 99.998% ( 1300, 1900 ] 6 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 31744 Average: 2.2609 StdDev: 46.02 Min: 0 Median: 1.2133 Max: 7218 Percentiles: P50: 1.21 P75: 1.64 P99: 3.47 P99.9: 9.66 P99.99: 1547.68 ------------------------------------------------------ [ 0, 1 ] 11895 37.472% 37.472% ####### ( 1, 2 ] 18645 58.736% 96.207% ############ ( 2, 3 ] 772 2.432% 98.639% ( 3, 4 ] 245 0.772% 99.411% ( 4, 6 ] 82 0.258% 99.669% ( 6, 10 ] 80 0.252% 99.921% ( 10, 15 ] 10 0.032% 99.953% ( 15, 22 ] 2 0.006% 99.959% ( 110, 170 ] 1 0.003% 99.962% ( 170, 250 ] 1 0.003% 99.965% ( 250, 380 ] 2 0.006% 99.972% ( 380, 580 ] 1 0.003% 99.975% ( 580, 870 ] 2 0.006% 99.981% ( 870, 1300 ] 2 0.006% 99.987% ( 1300, 1900 ] 2 0.006% 99.994% ( 1900, 2900 ] 1 0.003% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28878 Average: 7.3084 StdDev: 177.79 Min: 0 Median: 1.5996 Max: 10613 Percentiles: P50: 1.60 P75: 1.98 P99: 7.56 P99.9: 984.06 P99.99: 9411.71 ------------------------------------------------------ [ 0, 1 ] 3121 10.808% 10.808% ## ( 1, 2 ] 18875 65.361% 76.169% ############# ( 2, 3 ] 4358 15.091% 91.260% ### ( 3, 4 ] 1051 3.639% 94.899% # ( 4, 6 ] 1090 3.774% 98.674% # ( 6, 10 ] 241 0.835% 99.508% ( 10, 15 ] 73 0.253% 99.761% ( 15, 22 ] 13 0.045% 99.806% ( 22, 34 ] 6 0.021% 99.827% ( 34, 51 ] 1 0.003% 99.830% ( 110, 170 ] 2 0.007% 99.837% ( 170, 250 ] 4 0.014% 99.851% ( 250, 380 ] 1 0.003% 99.855% ( 380, 580 ] 6 0.021% 99.875% ( 580, 870 ] 5 0.017% 99.893% ( 870, 1300 ] 8 0.028% 99.920% ( 1300, 1900 ] 3 0.010% 99.931% ( 1900, 2900 ] 3 0.010% 99.941% ( 2900, 4400 ] 2 0.007% 99.948% ( 4400, 6600 ] 7 0.024% 99.972% ( 6600, 9900 ] 6 0.021% 99.993% ( 9900, 14000 ] 2 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 3555.9333 StdDev: 3159.69 Min: 245 Median: 2900.0000 Max: 10769 Percentiles: P50: 2900.00 P75: 5814.29 P99: 10769.00 P99.9: 10769.00 P99.99: 10769.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 2 6.667% 10.000% # ( 380, 580 ] 4 13.333% 23.333% ### ( 580, 870 ] 2 6.667% 30.000% # ( 870, 1300 ] 4 13.333% 43.333% ### ( 1900, 2900 ] 2 6.667% 50.000% # ( 2900, 4400 ] 3 10.000% 60.000% ## ( 4400, 6600 ] 7 23.333% 83.333% ##### ( 6600, 9900 ] 4 13.333% 96.667% ### ( 9900, 14000 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 24.4 total, 9.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 242.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.502 H:M:S, 34.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 103.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.690 H:M:S, 70.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-23:15:20 ... thread 0: (1000000,7000000) ops and (107466.7,209341.3) ops/second in (9.305209,33.438210) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/7 2.58 GB 62.9 6.1 0.0 6.1 12.7 6.6 0.0 1.9 142.3 297.2 43.83 40.10 114 0.384 6331K 11K 0.0 0.0 L1 13/13 1.55 GB 0.0 5.0 3.9 1.2 5.0 3.8 0.2 1.3 230.7 227.7 22.37 21.37 3 7.457 5240K 66K 0.0 0.0 L2 1/1 1.01 MB 0.0 0.1 0.1 0.1 0.1 0.1 2.4 2.0 250.6 250.6 0.50 0.49 1 0.503 127K 30 0.0 0.0 L3 25/10 1.72 GB 1.0 1.3 0.9 0.3 1.3 0.9 1.6 1.3 150.7 150.5 8.54 5.81 7 1.220 1259K 458 0.0 0.0 L4 163/0 9.74 GB 1.0 1.3 1.1 0.2 1.3 1.1 0.4 1.2 129.5 129.1 10.12 6.15 11 0.920 1331K 4246 0.0 0.0 L5 1060/0 87.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1273/31 102.70 GB 0.0 13.8 6.0 7.8 20.4 12.5 5.9 3.1 165.4 244.1 85.36 73.91 136 0.628 14M 82K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.8 6.0 7.8 20.4 12.5 5.8 3.1 165.4 244.1 85.36 73.91 136 0.628 14M 82K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.8 6.0 7.8 13.7 5.9 0.0 0.0 216.7 215.4 65.15 56.83 41 1.589 14M 82K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 336.7 20.21 17.08 95 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 33.7 total, 33.4 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.35 GB write, 618.50 MB/s write, 13.79 GB read, 419.08 MB/s read, 85.4 seconds Interval compaction: 20.35 GB write, 623.20 MB/s write, 13.79 GB read, 422.26 MB/s read, 85.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 37, interval: 53 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2868906 Average: 2.5383 StdDev: 22.08 Min: 0 Median: 1.4938 Max: 8003 Percentiles: P50: 1.49 P75: 1.87 P99: 6.20 P99.9: 105.48 P99.99: 271.55 ------------------------------------------------------ [ 0, 1 ] 501848 17.493% 17.493% ### ( 1, 2 ] 1888547 65.828% 83.321% ############# ( 2, 3 ] 283655 9.887% 93.208% ## ( 3, 4 ] 91455 3.188% 96.396% # ( 4, 6 ] 73588 2.565% 98.961% # ( 6, 10 ] 22218 0.774% 99.735% ( 10, 15 ] 3073 0.107% 99.842% ( 15, 22 ] 424 0.015% 99.857% ( 22, 34 ] 23 0.001% 99.858% ( 34, 51 ] 10 0.000% 99.858% ( 51, 76 ] 28 0.001% 99.859% ( 76, 110 ] 1347 0.047% 99.906% ( 110, 170 ] 1930 0.067% 99.974% ( 170, 250 ] 430 0.015% 99.988% ( 250, 380 ] 260 0.009% 99.998% ( 380, 580 ] 291 0.010% 100.008% ( 580, 870 ] 128 0.004% 100.012% ( 870, 1300 ] 69 0.002% 100.015% ( 1300, 1900 ] 24 0.001% 100.015% ( 1900, 2900 ] 35 0.001% 100.017% ( 2900, 4400 ] 46 0.002% 100.018% ( 4400, 6600 ] 3 0.000% 100.018% ( 6600, 9900 ] 4 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 692364 Average: 4.3792 StdDev: 65.89 Min: 0 Median: 1.6962 Max: 8059 Percentiles: P50: 1.70 P75: 2.47 P99: 9.10 P99.9: 106.82 P99.99: 360.38 ------------------------------------------------------ [ 0, 1 ] 72837 10.520% 10.520% ## ( 1, 2 ] 392611 56.706% 67.226% ########### ( 2, 3 ] 115709 16.712% 83.938% ### ( 3, 4 ] 45100 6.514% 90.452% # ( 4, 6 ] 48652 7.027% 97.479% # ( 6, 10 ] 13578 1.961% 99.440% ( 10, 15 ] 2436 0.352% 99.792% ( 15, 22 ] 325 0.047% 99.839% ( 22, 34 ] 26 0.004% 99.843% ( 34, 51 ] 9 0.001% 99.844% ( 51, 76 ] 7 0.001% 99.845% ( 76, 110 ] 421 0.061% 99.906% ( 110, 170 ] 327 0.047% 99.953% ( 170, 250 ] 126 0.018% 99.971% ( 250, 380 ] 154 0.022% 99.993% ( 380, 580 ] 177 0.026% 100.019% ( 580, 870 ] 156 0.023% 100.041% ( 870, 1300 ] 115 0.017% 100.058% ( 1300, 1900 ] 75 0.011% 100.069% ( 1900, 2900 ] 85 0.012% 100.081% ( 2900, 4400 ] 83 0.012% 100.093% ( 4400, 6600 ] 17 0.002% 100.096% ( 6600, 9900 ] 10 0.001% 100.097% ** Level 2 read latency histogram (micros): Count: 47310 Average: 4.6245 StdDev: 83.50 Min: 0 Median: 1.3661 Max: 7254 Percentiles: P50: 1.37 P75: 1.78 P99: 7.00 P99.9: 689.99 P99.99: 3944.82 ------------------------------------------------------ [ 0, 1 ] 13270 28.049% 28.049% ###### ( 1, 2 ] 28372 59.970% 88.019% ############ ( 2, 3 ] 3093 6.538% 94.557% # ( 3, 4 ] 1290 2.727% 97.284% # ( 4, 6 ] 722 1.526% 98.810% ( 6, 10 ] 362 0.765% 99.575% ( 10, 15 ] 54 0.114% 99.689% ( 15, 22 ] 5 0.011% 99.700% ( 76, 110 ] 10 0.021% 99.721% ( 110, 170 ] 27 0.057% 99.778% ( 170, 250 ] 16 0.034% 99.812% ( 250, 380 ] 19 0.040% 99.852% ( 380, 580 ] 18 0.038% 99.890% ( 580, 870 ] 15 0.032% 99.922% ( 870, 1300 ] 10 0.021% 99.943% ( 1300, 1900 ] 6 0.013% 99.956% ( 1900, 2900 ] 11 0.023% 99.979% ( 2900, 4400 ] 9 0.019% 99.998% ( 6600, 9900 ] 2 0.004% 100.002% ** Level 3 read latency histogram (micros): Count: 386107 Average: 11.0333 StdDev: 134.61 Min: 0 Median: 1.8890 Max: 11000 Percentiles: P50: 1.89 P75: 2.90 P99: 13.09 P99.9: 1053.89 P99.99: 1585.60 ------------------------------------------------------ [ 0, 1 ] 15992 4.142% 4.142% # ( 1, 2 ] 199171 51.584% 55.726% ########## ( 2, 3 ] 82761 21.435% 77.161% #### ( 3, 4 ] 36246 9.388% 86.549% ## ( 4, 6 ] 38665 10.014% 96.563% ## ( 6, 10 ] 8347 2.162% 98.724% ( 10, 15 ] 1722 0.446% 99.170% ( 15, 22 ] 224 0.058% 99.228% ( 22, 34 ] 22 0.006% 99.234% ( 34, 51 ] 18 0.005% 99.239% ( 51, 76 ] 7 0.002% 99.241% ( 76, 110 ] 53 0.014% 99.254% ( 110, 170 ] 259 0.067% 99.321% ( 170, 250 ] 294 0.076% 99.398% ( 250, 380 ] 453 0.117% 99.515% ( 380, 580 ] 667 0.173% 99.688% ( 580, 870 ] 636 0.165% 99.852% ( 870, 1300 ] 430 0.111% 99.964% ( 1300, 1900 ] 213 0.055% 100.019% ( 1900, 2900 ] 168 0.044% 100.062% ( 2900, 4400 ] 177 0.046% 100.108% ( 4400, 6600 ] 39 0.010% 100.118% ( 6600, 9900 ] 14 0.004% 100.122% ( 9900, 14000 ] 3 0.001% 100.123% ** Level 4 read latency histogram (micros): Count: 11039 Average: 16.4045 StdDev: 261.31 Min: 1 Median: 1.9756 Max: 10769 Percentiles: P50: 1.98 P75: 2.89 P99: 11.76 P99.9: 4702.03 P99.99: 9814.28 ------------------------------------------------------ [ 0, 1 ] 173 1.567% 1.567% ( 1, 2 ] 5480 49.642% 51.209% ########## ( 2, 3 ] 2961 26.823% 78.032% ##### ( 3, 4 ] 934 8.461% 86.493% ## ( 4, 6 ] 1178 10.671% 97.165% ## ( 6, 10 ] 191 1.730% 98.895% ( 10, 15 ] 33 0.299% 99.194% ( 15, 22 ] 10 0.091% 99.284% ( 22, 34 ] 1 0.009% 99.293% ( 34, 51 ] 1 0.009% 99.302% ( 76, 110 ] 1 0.009% 99.312% ( 110, 170 ] 5 0.045% 99.357% ( 170, 250 ] 12 0.109% 99.466% ( 250, 380 ] 9 0.082% 99.547% ( 380, 580 ] 4 0.036% 99.583% ( 580, 870 ] 5 0.045% 99.629% ( 870, 1300 ] 13 0.118% 99.746% ( 1300, 1900 ] 4 0.036% 99.783% ( 1900, 2900 ] 6 0.054% 99.837% ( 2900, 4400 ] 6 0.054% 99.891% ( 4400, 6600 ] 7 0.063% 99.955% ( 6600, 9900 ] 4 0.036% 99.991% ( 9900, 14000 ] 1 0.009% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 1643.3250 StdDev: 1447.92 Min: 113 Median: 965.5556 Max: 5670 Percentiles: P50: 965.56 P75: 2900.00 P99: 5670.00 P99.9: 5670.00 P99.99: 5670.00 ------------------------------------------------------ ( 110, 170 ] 5 6.250% 6.250% # ( 170, 250 ] 2 2.500% 8.750% # ( 250, 380 ] 7 8.750% 17.500% ## ( 380, 580 ] 8 10.000% 27.500% ## ( 580, 870 ] 16 20.000% 47.500% #### ( 870, 1300 ] 9 11.250% 58.750% ## ( 1300, 1900 ] 5 6.250% 65.000% # ( 1900, 2900 ] 8 10.000% 75.000% ## ( 2900, 4400 ] 16 20.000% 95.000% #### ( 4400, 6600 ] 4 5.000% 100.000% # ** DB Stats ** Uptime(secs): 33.7 total, 9.3 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 204.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.808 H:M:S, 43.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 105.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.306 H:M:S, 67.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/17-23:15:23 ... thread 0: (1000000,8000000) ops and (326773.5,219187.5) ops/second in (3.060224,36.498434) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/7 3.50 GB 151.1 6.9 0.0 6.9 14.4 7.6 0.0 1.9 142.0 297.7 49.68 45.57 130 0.382 7163K 12K 0.0 0.0 L1 13/13 1.55 GB 0.0 5.0 3.9 1.2 5.0 3.8 0.2 1.3 230.7 227.7 22.37 21.37 3 7.457 5240K 66K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 2.4 2.0 250.6 250.6 0.50 0.49 1 0.503 127K 30 0.0 0.0 L3 16/0 989.24 MB 1.0 2.0 0.9 1.1 2.0 0.9 1.6 2.2 162.5 162.3 12.87 9.01 8 1.609 2077K 1478 0.0 0.0 L4 163/0 9.51 GB 1.0 1.3 1.1 0.2 1.3 1.1 1.2 1.2 129.5 129.1 10.12 6.15 11 0.920 1331K 4246 0.0 0.0 L5 1072/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1279/20 103.62 GB 0.0 15.4 6.0 9.4 22.9 13.4 7.6 3.0 164.8 245.0 95.54 82.59 153 0.624 15M 84K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.4 6.0 9.4 22.9 13.4 7.5 3.0 164.8 245.0 95.54 82.59 153 0.624 15M 84K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.4 6.0 9.4 15.3 5.9 0.0 0.0 216.8 215.6 72.62 63.10 45 1.614 15M 84K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 338.1 22.92 19.48 108 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 36.8 total, 36.5 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.86 GB write, 636.86 MB/s write, 15.38 GB read, 428.38 MB/s read, 95.5 seconds Interval compaction: 22.86 GB write, 641.29 MB/s write, 15.38 GB read, 431.36 MB/s read, 95.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 40, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 40, interval: 56 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3167876 Average: 2.5123 StdDev: 21.33 Min: 0 Median: 1.4978 Max: 8003 Percentiles: P50: 1.50 P75: 1.88 P99: 6.10 P99.9: 97.51 P99.99: 247.49 ------------------------------------------------------ [ 0, 1 ] 540330 17.057% 17.057% ### ( 1, 2 ] 2096396 66.177% 83.233% ############# ( 2, 3 ] 317361 10.018% 93.251% ## ( 3, 4 ] 101600 3.207% 96.459% # ( 4, 6 ] 79914 2.523% 98.981% # ( 6, 10 ] 24483 0.773% 99.754% ( 10, 15 ] 3268 0.103% 99.857% ( 15, 22 ] 438 0.014% 99.871% ( 22, 34 ] 26 0.001% 99.872% ( 34, 51 ] 11 0.000% 99.872% ( 51, 76 ] 31 0.001% 99.873% ( 76, 110 ] 1347 0.043% 99.916% ( 110, 170 ] 1931 0.061% 99.977% ( 170, 250 ] 439 0.014% 99.990% ( 250, 380 ] 262 0.008% 99.999% ( 380, 580 ] 299 0.009% 100.008% ( 580, 870 ] 133 0.004% 100.012% ( 870, 1300 ] 72 0.002% 100.015% ( 1300, 1900 ] 26 0.001% 100.015% ( 1900, 2900 ] 38 0.001% 100.017% ( 2900, 4400 ] 47 0.001% 100.018% ( 4400, 6600 ] 3 0.000% 100.018% ( 6600, 9900 ] 4 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 770486 Average: 4.2173 StdDev: 62.62 Min: 0 Median: 1.6789 Max: 8059 Percentiles: P50: 1.68 P75: 2.39 P99: 9.04 P99.9: 113.24 P99.99: 376.99 ------------------------------------------------------ [ 0, 1 ] 81174 10.535% 10.535% ## ( 1, 2 ] 447915 58.134% 68.670% ############ ( 2, 3 ] 124471 16.155% 84.824% ### ( 3, 4 ] 47454 6.159% 90.983% # ( 4, 6 ] 50432 6.545% 97.529% # ( 6, 10 ] 14894 1.933% 99.462% ( 10, 15 ] 2503 0.325% 99.787% ( 15, 22 ] 335 0.043% 99.830% ( 22, 34 ] 27 0.004% 99.834% ( 34, 51 ] 9 0.001% 99.835% ( 51, 76 ] 8 0.001% 99.836% ( 76, 110 ] 474 0.062% 99.897% ( 110, 170 ] 380 0.049% 99.947% ( 170, 250 ] 163 0.021% 99.968% ( 250, 380 ] 175 0.023% 99.991% ( 380, 580 ] 196 0.025% 100.016% ( 580, 870 ] 162 0.021% 100.037% ( 870, 1300 ] 117 0.015% 100.052% ( 1300, 1900 ] 75 0.010% 100.062% ( 1900, 2900 ] 85 0.011% 100.073% ( 2900, 4400 ] 83 0.011% 100.084% ( 4400, 6600 ] 17 0.002% 100.086% ( 6600, 9900 ] 10 0.001% 100.087% ** Level 2 read latency histogram (micros): Count: 60283 Average: 4.3848 StdDev: 74.49 Min: 0 Median: 1.4272 Max: 7254 Percentiles: P50: 1.43 P75: 1.84 P99: 7.92 P99.9: 545.74 P99.99: 3728.62 ------------------------------------------------------ [ 0, 1 ] 14434 23.944% 23.944% ##### ( 1, 2 ] 36766 60.989% 84.933% ############ ( 2, 3 ] 5018 8.324% 93.257% ## ( 3, 4 ] 2005 3.326% 96.583% # ( 4, 6 ] 1176 1.951% 98.534% ( 6, 10 ] 586 0.972% 99.506% ( 10, 15 ] 77 0.128% 99.633% ( 15, 22 ] 5 0.008% 99.642% ( 76, 110 ] 42 0.070% 99.711% ( 110, 170 ] 45 0.075% 99.786% ( 170, 250 ] 20 0.033% 99.819% ( 250, 380 ] 28 0.046% 99.866% ( 380, 580 ] 25 0.041% 99.907% ( 580, 870 ] 18 0.030% 99.937% ( 870, 1300 ] 10 0.017% 99.954% ( 1300, 1900 ] 6 0.010% 99.964% ( 1900, 2900 ] 11 0.018% 99.982% ( 2900, 4400 ] 9 0.015% 99.997% ( 6600, 9900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 386172 Average: 11.0760 StdDev: 134.76 Min: 0 Median: 1.8890 Max: 11000 Percentiles: P50: 1.89 P75: 2.90 P99: 13.18 P99.9: 1058.08 P99.99: 1589.86 ------------------------------------------------------ [ 0, 1 ] 16002 4.144% 4.144% # ( 1, 2 ] 199187 51.580% 55.724% ########## ( 2, 3 ] 82766 21.432% 77.156% #### ( 3, 4 ] 36248 9.386% 86.543% ## ( 4, 6 ] 38665 10.012% 96.555% ## ( 6, 10 ] 8347 2.161% 98.716% ( 10, 15 ] 1722 0.446% 99.162% ( 15, 22 ] 224 0.058% 99.220% ( 22, 34 ] 22 0.006% 99.226% ( 34, 51 ] 18 0.005% 99.231% ( 51, 76 ] 7 0.002% 99.232% ( 76, 110 ] 54 0.014% 99.246% ( 110, 170 ] 264 0.068% 99.315% ( 170, 250 ] 302 0.078% 99.393% ( 250, 380 ] 456 0.118% 99.511% ( 380, 580 ] 671 0.174% 99.685% ( 580, 870 ] 641 0.166% 99.851% ( 870, 1300 ] 434 0.112% 99.963% ( 1300, 1900 ] 214 0.055% 100.019% ( 1900, 2900 ] 169 0.044% 100.062% ( 2900, 4400 ] 177 0.046% 100.108% ( 4400, 6600 ] 39 0.010% 100.118% ( 6600, 9900 ] 14 0.004% 100.122% ( 9900, 14000 ] 3 0.001% 100.123% ** Level 4 read latency histogram (micros): Count: 11039 Average: 16.4045 StdDev: 261.31 Min: 1 Median: 1.9756 Max: 10769 Percentiles: P50: 1.98 P75: 2.89 P99: 11.76 P99.9: 4702.03 P99.99: 9814.28 ------------------------------------------------------ [ 0, 1 ] 173 1.567% 1.567% ( 1, 2 ] 5480 49.642% 51.209% ########## ( 2, 3 ] 2961 26.823% 78.032% ##### ( 3, 4 ] 934 8.461% 86.493% ## ( 4, 6 ] 1178 10.671% 97.165% ## ( 6, 10 ] 191 1.730% 98.895% ( 10, 15 ] 33 0.299% 99.194% ( 15, 22 ] 10 0.091% 99.284% ( 22, 34 ] 1 0.009% 99.293% ( 34, 51 ] 1 0.009% 99.302% ( 76, 110 ] 1 0.009% 99.312% ( 110, 170 ] 5 0.045% 99.357% ( 170, 250 ] 12 0.109% 99.466% ( 250, 380 ] 9 0.082% 99.547% ( 380, 580 ] 4 0.036% 99.583% ( 580, 870 ] 5 0.045% 99.629% ( 870, 1300 ] 13 0.118% 99.746% ( 1300, 1900 ] 4 0.036% 99.783% ( 1900, 2900 ] 6 0.054% 99.837% ( 2900, 4400 ] 6 0.054% 99.891% ( 4400, 6600 ] 7 0.063% 99.955% ( 6600, 9900 ] 4 0.036% 99.991% ( 9900, 14000 ] 1 0.009% 100.000% ** Level 5 read latency histogram (micros): Count: 140 Average: 1328.5500 StdDev: 1334.59 Min: 84 Median: 763.1579 Max: 5670 Percentiles: P50: 763.16 P75: 2252.94 P99: 5670.00 P99.9: 5670.00 P99.99: 5670.00 ------------------------------------------------------ ( 76, 110 ] 6 4.286% 4.286% # ( 110, 170 ] 21 15.000% 19.286% ### ( 170, 250 ] 8 5.714% 25.000% # ( 250, 380 ] 11 7.857% 32.857% ## ( 380, 580 ] 12 8.571% 41.429% ## ( 580, 870 ] 19 13.571% 55.000% ### ( 870, 1300 ] 13 9.286% 64.286% ## ( 1300, 1900 ] 9 6.429% 70.714% # ( 1900, 2900 ] 17 12.143% 82.857% ## ( 2900, 4400 ] 20 14.286% 97.143% ### ( 4400, 6600 ] 4 2.857% 100.000% # ** DB Stats ** Uptime(secs): 36.8 total, 3.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 214.22 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.235 H:M:S, 41.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.427 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-23:15:34 ... thread 0: (1000000,9000000) ops and (91275.7,189656.4) ops/second in (10.955816,47.454250) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/5 2.77 GB 138.5 8.3 0.0 8.3 16.8 8.5 0.0 2.0 146.6 297.3 58.00 53.48 149 0.389 8634K 14K 0.0 0.0 L1 11/0 1.26 GB 129.2 8.3 5.6 2.7 8.2 5.5 0.2 1.5 225.9 223.2 37.66 35.40 4 9.414 7546K 66K 0.0 0.0 L2 2/0 122.99 MB 1.2 0.1 0.1 0.1 0.1 0.1 4.3 2.0 250.6 250.6 0.50 0.49 1 0.503 127K 30 0.0 0.0 L3 28/7 1.72 GB 0.9 3.0 1.3 1.7 3.0 1.3 3.1 2.3 152.5 151.8 20.23 13.59 14 1.445 3086K 12K 0.0 0.0 L4 176/23 10.22 GB 1.0 2.7 2.3 0.4 2.7 2.3 1.2 1.2 133.0 132.6 20.69 13.01 24 0.862 2795K 9573 0.0 0.0 L5 1076/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1304/35 104.55 GB 0.0 22.4 9.2 13.2 30.8 17.6 11.5 3.6 167.6 230.5 137.07 115.97 192 0.714 22M 102K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.4 9.2 13.2 30.8 17.6 11.4 3.6 167.6 230.5 137.07 115.97 192 0.714 22M 102K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.4 9.2 13.2 22.3 9.1 0.0 0.0 206.5 205.2 111.26 93.91 70 1.589 22M 102K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 339.2 25.82 22.06 122 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.7 total, 47.5 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.85 GB write, 662.11 MB/s write, 22.43 GB read, 481.51 MB/s read, 137.1 seconds Interval compaction: 30.85 GB write, 665.66 MB/s write, 22.43 GB read, 484.09 MB/s read, 137.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 37, pending-compaction-bytes-stops: 0, total-delays: 47, total-stops: 44, interval: 91 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3952955 Average: 2.5581 StdDev: 20.85 Min: 0 Median: 1.5131 Max: 8003 Percentiles: P50: 1.51 P75: 1.89 P99: 6.69 P99.9: 101.27 P99.99: 277.08 ------------------------------------------------------ [ 0, 1 ] 639843 16.186% 16.186% ### ( 1, 2 ] 2605244 65.906% 82.093% ############# ( 2, 3 ] 409412 10.357% 92.450% ## ( 3, 4 ] 138258 3.498% 95.947% # ( 4, 6 ] 114665 2.901% 98.848% # ( 6, 10 ] 34884 0.882% 99.731% ( 10, 15 ] 4799 0.121% 99.852% ( 15, 22 ] 586 0.015% 99.867% ( 22, 34 ] 32 0.001% 99.868% ( 34, 51 ] 13 0.000% 99.868% ( 51, 76 ] 36 0.001% 99.869% ( 76, 110 ] 1655 0.042% 99.911% ( 110, 170 ] 2487 0.063% 99.974% ( 170, 250 ] 573 0.014% 99.988% ( 250, 380 ] 349 0.009% 99.997% ( 380, 580 ] 371 0.009% 100.006% ( 580, 870 ] 182 0.005% 100.011% ( 870, 1300 ] 108 0.003% 100.014% ( 1300, 1900 ] 36 0.001% 100.015% ( 1900, 2900 ] 43 0.001% 100.016% ( 2900, 4400 ] 53 0.001% 100.017% ( 4400, 6600 ] 5 0.000% 100.017% ( 6600, 9900 ] 4 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 1535092 Average: 4.6020 StdDev: 63.89 Min: 0 Median: 1.7253 Max: 9345 Percentiles: P50: 1.73 P75: 2.57 P99: 9.30 P99.9: 114.32 P99.99: 350.78 ------------------------------------------------------ [ 0, 1 ] 143283 9.334% 9.334% ## ( 1, 2 ] 860701 56.068% 65.402% ########### ( 2, 3 ] 258309 16.827% 82.229% ### ( 3, 4 ] 108385 7.060% 89.290% # ( 4, 6 ] 119983 7.816% 97.106% ## ( 6, 10 ] 35260 2.297% 99.403% ( 10, 15 ] 5972 0.389% 99.792% ( 15, 22 ] 703 0.046% 99.837% ( 22, 34 ] 51 0.003% 99.841% ( 34, 51 ] 18 0.001% 99.842% ( 51, 76 ] 45 0.003% 99.845% ( 76, 110 ] 793 0.052% 99.896% ( 110, 170 ] 748 0.049% 99.945% ( 170, 250 ] 334 0.022% 99.967% ( 250, 380 ] 456 0.030% 99.997% ( 380, 580 ] 550 0.036% 100.033% ( 580, 870 ] 503 0.033% 100.065% ( 870, 1300 ] 355 0.023% 100.088% ( 1300, 1900 ] 209 0.014% 100.102% ( 1900, 2900 ] 168 0.011% 100.113% ( 2900, 4400 ] 169 0.011% 100.124% ( 4400, 6600 ] 38 0.002% 100.126% ( 6600, 9900 ] 15 0.001% 100.127% ** Level 2 read latency histogram (micros): Count: 60283 Average: 4.3848 StdDev: 74.49 Min: 0 Median: 1.4272 Max: 7254 Percentiles: P50: 1.43 P75: 1.84 P99: 7.92 P99.9: 545.74 P99.99: 3728.62 ------------------------------------------------------ [ 0, 1 ] 14434 23.944% 23.944% ##### ( 1, 2 ] 36766 60.989% 84.933% ############ ( 2, 3 ] 5018 8.324% 93.257% ## ( 3, 4 ] 2005 3.326% 96.583% # ( 4, 6 ] 1176 1.951% 98.534% ( 6, 10 ] 586 0.972% 99.506% ( 10, 15 ] 77 0.128% 99.633% ( 15, 22 ] 5 0.008% 99.642% ( 76, 110 ] 42 0.070% 99.711% ( 110, 170 ] 45 0.075% 99.786% ( 170, 250 ] 20 0.033% 99.819% ( 250, 380 ] 28 0.046% 99.866% ( 380, 580 ] 25 0.041% 99.907% ( 580, 870 ] 18 0.030% 99.937% ( 870, 1300 ] 10 0.017% 99.954% ( 1300, 1900 ] 6 0.010% 99.964% ( 1900, 2900 ] 11 0.018% 99.982% ( 2900, 4400 ] 9 0.015% 99.997% ( 6600, 9900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 609770 Average: 10.4968 StdDev: 124.08 Min: 0 Median: 1.9784 Max: 11000 Percentiles: P50: 1.98 P75: 3.10 P99: 12.67 P99.9: 951.72 P99.99: 1288.36 ------------------------------------------------------ [ 0, 1 ] 18680 3.063% 3.063% # ( 1, 2 ] 292513 47.971% 51.034% ########## ( 2, 3 ] 139534 22.883% 73.918% ##### ( 3, 4 ] 64253 10.537% 84.455% ## ( 4, 6 ] 72043 11.815% 96.270% ## ( 6, 10 ] 15027 2.464% 98.734% ( 10, 15 ] 3035 0.498% 99.232% ( 15, 22 ] 379 0.062% 99.294% ( 22, 34 ] 37 0.006% 99.300% ( 34, 51 ] 20 0.003% 99.303% ( 51, 76 ] 23 0.004% 99.307% ( 76, 110 ] 62 0.010% 99.317% ( 110, 170 ] 297 0.049% 99.366% ( 170, 250 ] 401 0.066% 99.432% ( 250, 380 ] 676 0.111% 99.542% ( 380, 580 ] 1025 0.168% 99.711% ( 580, 870 ] 1022 0.168% 99.878% ( 870, 1300 ] 701 0.115% 99.993% ( 1300, 1900 ] 322 0.053% 100.046% ( 1900, 2900 ] 219 0.036% 100.082% ( 2900, 4400 ] 245 0.040% 100.122% ( 4400, 6600 ] 50 0.008% 100.130% ( 6600, 9900 ] 16 0.003% 100.133% ( 9900, 14000 ] 3 0.000% 100.133% ** Level 4 read latency histogram (micros): Count: 90924 Average: 16.0974 StdDev: 181.11 Min: 1 Median: 2.2598 Max: 10769 Percentiles: P50: 2.26 P75: 3.51 P99: 43.38 P99.9: 1865.15 P99.99: 3352.45 ------------------------------------------------------ [ 0, 1 ] 890 0.979% 0.979% ( 1, 2 ] 38589 42.441% 43.420% ######## ( 2, 3 ] 23029 25.328% 68.748% ##### ( 3, 4 ] 11188 12.305% 81.052% ## ( 4, 6 ] 13089 14.396% 95.448% ### ( 6, 10 ] 2574 2.831% 98.279% # ( 10, 15 ] 583 0.641% 98.920% ( 15, 22 ] 64 0.070% 98.990% ( 22, 34 ] 6 0.007% 98.997% ( 34, 51 ] 5 0.005% 99.002% ( 51, 76 ] 9 0.010% 99.012% ( 76, 110 ] 13 0.014% 99.027% ( 110, 170 ] 16 0.018% 99.044% ( 170, 250 ] 50 0.055% 99.099% ( 250, 380 ] 70 0.077% 99.176% ( 380, 580 ] 157 0.173% 99.349% ( 580, 870 ] 222 0.244% 99.593% ( 870, 1300 ] 183 0.201% 99.794% ( 1300, 1900 ] 102 0.112% 99.907% ( 1900, 2900 ] 56 0.062% 99.968% ( 2900, 4400 ] 66 0.073% 100.041% ( 4400, 6600 ] 18 0.020% 100.060% ( 6600, 9900 ] 9 0.010% 100.070% ( 9900, 14000 ] 1 0.001% 100.071% ** Level 5 read latency histogram (micros): Count: 160 Average: 1424.5812 StdDev: 1413.44 Min: 84 Median: 790.9091 Max: 5670 Percentiles: P50: 790.91 P75: 2455.56 P99: 5670.00 P99.9: 5670.00 P99.99: 5670.00 ------------------------------------------------------ ( 76, 110 ] 6 3.750% 3.750% # ( 110, 170 ] 21 13.125% 16.875% ### ( 170, 250 ] 8 5.000% 21.875% # ( 250, 380 ] 12 7.500% 29.375% ## ( 380, 580 ] 17 10.625% 40.000% ## ( 580, 870 ] 22 13.750% 53.750% ### ( 870, 1300 ] 15 9.375% 63.125% ## ( 1300, 1900 ] 9 5.625% 68.750% # ( 1900, 2900 ] 18 11.250% 80.000% ## ( 2900, 4400 ] 25 15.625% 95.625% ### ( 4400, 6600 ] 7 4.375% 100.000% # ** DB Stats ** Uptime(secs): 47.7 total, 11.0 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 185.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.236 H:M:S, 48.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 89.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:8.000 H:M:S, 73.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/11/17-23:15:38 ... thread 0: (1000000,10000000) ops and (297690.7,196798.3) ops/second in (3.359191,50.813441) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/14 3.68 GB 44.1 10.0 0.0 10.0 19.5 9.5 0.0 2.1 150.4 292.2 68.25 62.81 163 0.419 10M 23K 0.0 0.0 L1 11/11 1.26 GB 0.0 8.3 5.6 2.7 8.2 5.5 0.2 1.5 225.9 223.2 37.66 35.40 4 9.414 7546K 66K 0.0 0.0 L2 1/0 61.51 MB 0.6 0.1 0.1 0.1 0.1 0.1 4.3 2.0 250.6 250.6 0.50 0.49 1 0.503 127K 30 0.0 0.0 L3 22/0 966.14 MB 1.0 3.0 1.3 1.7 3.0 1.3 3.2 2.3 152.5 151.8 20.23 13.59 14 1.445 3086K 12K 0.0 0.0 L4 163/0 9.76 GB 1.0 3.8 3.0 0.8 3.8 3.0 1.2 1.3 136.7 136.3 28.56 18.33 30 0.952 3966K 13K 0.0 0.0 L5 1092/0 89.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1305/25 105.46 GB 0.0 25.3 9.9 15.3 34.6 19.3 12.8 3.7 166.8 228.3 155.20 130.61 212 0.732 25M 115K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.3 9.9 15.3 34.6 19.3 12.7 3.7 166.8 228.3 155.20 130.61 212 0.732 25M 115K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.3 9.9 15.3 25.1 9.8 0.0 0.0 204.8 203.6 126.41 106.15 78 1.621 25M 115K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 337.1 28.78 24.47 134 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 51.1 total, 50.8 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.61 GB write, 693.91 MB/s write, 25.28 GB read, 506.92 MB/s read, 155.2 seconds Interval compaction: 34.61 GB write, 697.38 MB/s write, 25.28 GB read, 509.45 MB/s read, 155.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 50, pending-compaction-bytes-delays: 37, pending-compaction-bytes-stops: 0, total-delays: 47, total-stops: 50, interval: 97 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4260855 Average: 2.5823 StdDev: 21.00 Min: 0 Median: 1.5179 Max: 8003 Percentiles: P50: 1.52 P75: 1.90 P99: 6.81 P99.9: 102.46 P99.99: 294.37 ------------------------------------------------------ [ 0, 1 ] 677375 15.898% 15.898% ### ( 1, 2 ] 2805644 65.847% 81.745% ############# ( 2, 3 ] 450171 10.565% 92.310% ## ( 3, 4 ] 150808 3.539% 95.849% # ( 4, 6 ] 126413 2.967% 98.816% # ( 6, 10 ] 38781 0.910% 99.726% ( 10, 15 ] 5356 0.126% 99.852% ( 15, 22 ] 629 0.015% 99.867% ( 22, 34 ] 36 0.001% 99.868% ( 34, 51 ] 14 0.000% 99.868% ( 51, 76 ] 38 0.001% 99.869% ( 76, 110 ] 1709 0.040% 99.909% ( 110, 170 ] 2627 0.062% 99.971% ( 170, 250 ] 690 0.016% 99.987% ( 250, 380 ] 407 0.010% 99.996% ( 380, 580 ] 435 0.010% 100.007% ( 580, 870 ] 238 0.006% 100.012% ( 870, 1300 ] 125 0.003% 100.015% ( 1300, 1900 ] 40 0.001% 100.016% ( 1900, 2900 ] 43 0.001% 100.017% ( 2900, 4400 ] 58 0.001% 100.018% ( 4400, 6600 ] 5 0.000% 100.018% ( 6600, 9900 ] 4 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 1612439 Average: 4.6795 StdDev: 65.60 Min: 0 Median: 1.7377 Max: 9345 Percentiles: P50: 1.74 P75: 2.60 P99: 9.33 P99.9: 110.44 P99.99: 350.55 ------------------------------------------------------ [ 0, 1 ] 144152 8.940% 8.940% ## ( 1, 2 ] 897416 55.656% 64.596% ########### ( 2, 3 ] 278938 17.299% 81.895% ### ( 3, 4 ] 115703 7.176% 89.071% # ( 4, 6 ] 128933 7.996% 97.067% ## ( 6, 10 ] 37446 2.322% 99.389% ( 10, 15 ] 6552 0.406% 99.795% ( 15, 22 ] 768 0.048% 99.843% ( 22, 34 ] 54 0.003% 99.846% ( 34, 51 ] 19 0.001% 99.848% ( 51, 76 ] 46 0.003% 99.850% ( 76, 110 ] 794 0.049% 99.900% ( 110, 170 ] 753 0.047% 99.946% ( 170, 250 ] 341 0.021% 99.968% ( 250, 380 ] 469 0.029% 99.997% ( 380, 580 ] 564 0.035% 100.032% ( 580, 870 ] 519 0.032% 100.064% ( 870, 1300 ] 369 0.023% 100.087% ( 1300, 1900 ] 226 0.014% 100.101% ( 1900, 2900 ] 190 0.012% 100.112% ( 2900, 4400 ] 199 0.012% 100.125% ( 4400, 6600 ] 41 0.003% 100.127% ( 6600, 9900 ] 15 0.001% 100.128% ** Level 2 read latency histogram (micros): Count: 60283 Average: 4.3848 StdDev: 74.49 Min: 0 Median: 1.4272 Max: 7254 Percentiles: P50: 1.43 P75: 1.84 P99: 7.92 P99.9: 545.74 P99.99: 3728.62 ------------------------------------------------------ [ 0, 1 ] 14434 23.944% 23.944% ##### ( 1, 2 ] 36766 60.989% 84.933% ############ ( 2, 3 ] 5018 8.324% 93.257% ## ( 3, 4 ] 2005 3.326% 96.583% # ( 4, 6 ] 1176 1.951% 98.534% ( 6, 10 ] 586 0.972% 99.506% ( 10, 15 ] 77 0.128% 99.633% ( 15, 22 ] 5 0.008% 99.642% ( 76, 110 ] 42 0.070% 99.711% ( 110, 170 ] 45 0.075% 99.786% ( 170, 250 ] 20 0.033% 99.819% ( 250, 380 ] 28 0.046% 99.866% ( 380, 580 ] 25 0.041% 99.907% ( 580, 870 ] 18 0.030% 99.937% ( 870, 1300 ] 10 0.017% 99.954% ( 1300, 1900 ] 6 0.010% 99.964% ( 1900, 2900 ] 11 0.018% 99.982% ( 2900, 4400 ] 9 0.015% 99.997% ( 6600, 9900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 654491 Average: 10.2786 StdDev: 121.94 Min: 0 Median: 1.9753 Max: 11000 Percentiles: P50: 1.98 P75: 3.08 P99: 12.30 P99.9: 957.21 P99.99: 1294.03 ------------------------------------------------------ [ 0, 1 ] 19527 2.984% 2.984% # ( 1, 2 ] 315521 48.209% 51.192% ########## ( 2, 3 ] 150196 22.949% 74.141% ##### ( 3, 4 ] 68867 10.522% 84.663% ## ( 4, 6 ] 76622 11.707% 96.370% ## ( 6, 10 ] 15759 2.408% 98.778% ( 10, 15 ] 3160 0.483% 99.261% ( 15, 22 ] 389 0.059% 99.320% ( 22, 34 ] 37 0.006% 99.326% ( 34, 51 ] 20 0.003% 99.329% ( 51, 76 ] 23 0.004% 99.332% ( 76, 110 ] 62 0.009% 99.342% ( 110, 170 ] 298 0.046% 99.387% ( 170, 250 ] 403 0.062% 99.449% ( 250, 380 ] 689 0.105% 99.554% ( 380, 580 ] 1051 0.161% 99.715% ( 580, 870 ] 1060 0.162% 99.877% ( 870, 1300 ] 752 0.115% 99.992% ( 1300, 1900 ] 346 0.053% 100.044% ( 1900, 2900 ] 230 0.035% 100.080% ( 2900, 4400 ] 252 0.039% 100.118% ( 4400, 6600 ] 52 0.008% 100.126% ( 6600, 9900 ] 16 0.002% 100.128% ( 9900, 14000 ] 3 0.000% 100.129% ** Level 4 read latency histogram (micros): Count: 133405 Average: 12.3569 StdDev: 151.68 Min: 1 Median: 2.0534 Max: 10769 Percentiles: P50: 2.05 P75: 3.13 P99: 13.25 P99.9: 1518.46 P99.99: 2807.92 ------------------------------------------------------ [ 0, 1 ] 1549 1.161% 1.161% ( 1, 2 ] 63374 47.505% 48.666% ########## ( 2, 3 ] 33345 24.995% 73.661% ##### ( 3, 4 ] 14066 10.544% 84.205% ## ( 4, 6 ] 16119 12.083% 96.288% ## ( 6, 10 ] 3164 2.372% 98.660% ( 10, 15 ] 699 0.524% 99.184% ( 15, 22 ] 76 0.057% 99.241% ( 22, 34 ] 9 0.007% 99.247% ( 34, 51 ] 5 0.004% 99.251% ( 51, 76 ] 9 0.007% 99.258% ( 76, 110 ] 13 0.010% 99.268% ( 110, 170 ] 26 0.019% 99.287% ( 170, 250 ] 73 0.055% 99.342% ( 250, 380 ] 89 0.067% 99.409% ( 380, 580 ] 176 0.132% 99.540% ( 580, 870 ] 243 0.182% 99.723% ( 870, 1300 ] 198 0.148% 99.871% ( 1300, 1900 ] 106 0.079% 99.951% ( 1900, 2900 ] 58 0.043% 99.994% ( 2900, 4400 ] 68 0.051% 100.045% ( 4400, 6600 ] 18 0.013% 100.058% ( 6600, 9900 ] 9 0.007% 100.065% ( 9900, 14000 ] 1 0.001% 100.066% ** Level 5 read latency histogram (micros): Count: 240 Average: 1463.9750 StdDev: 1466.93 Min: 84 Median: 827.5610 Max: 8022 Percentiles: P50: 827.56 P75: 2460.00 P99: 6502.22 P99.9: 8022.00 P99.99: 8022.00 ------------------------------------------------------ ( 76, 110 ] 6 2.500% 2.500% # ( 110, 170 ] 32 13.333% 15.833% ### ( 170, 250 ] 10 4.167% 20.000% # ( 250, 380 ] 14 5.833% 25.833% # ( 380, 580 ] 23 9.583% 35.417% ## ( 580, 870 ] 41 17.083% 52.500% ### ( 870, 1300 ] 25 10.417% 62.917% ## ( 1300, 1900 ] 15 6.250% 69.167% # ( 1900, 2900 ] 25 10.417% 79.583% ## ( 2900, 4400 ] 38 15.833% 95.417% ### ( 4400, 6600 ] 9 3.750% 99.167% # ( 6600, 9900 ] 2 0.833% 100.000% ** DB Stats ** Uptime(secs): 51.1 total, 3.4 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 192.72 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.966 H:M:S, 46.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 293.05 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.730 H:M:S, 21.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.937 micros/op 168447 ops/sec 60.155 seconds 10132999 operations; 163.2 MB/s Microseconds per write: Count: 10132999 Average: 5.9366 StdDev: 383.61 Min: 0 Median: 1.7175 Max: 641328 Percentiles: P50: 1.72 P75: 2.70 P99: 8.75 P99.9: 1176.08 P99.99: 2752.30 ------------------------------------------------------ [ 0, 1 ] 1455063 14.360% 14.360% ### ( 1, 2 ] 5033649 49.676% 64.035% ########## ( 2, 3 ] 1597253 15.763% 79.798% ### ( 3, 4 ] 1370493 13.525% 93.323% ### ( 4, 6 ] 508110 5.014% 98.338% # ( 6, 10 ] 97602 0.963% 99.301% ( 10, 15 ] 31056 0.306% 99.607% ( 15, 22 ] 7752 0.077% 99.684% ( 22, 34 ] 1283 0.013% 99.697% ( 34, 51 ] 172 0.002% 99.698% ( 51, 76 ] 25 0.000% 99.699% ( 76, 110 ] 7351 0.073% 99.771% ( 110, 170 ] 2537 0.025% 99.796% ( 170, 250 ] 277 0.003% 99.799% ( 250, 380 ] 114 0.001% 99.800% ( 380, 580 ] 14 0.000% 99.800% ( 580, 870 ] 18 0.000% 99.800% ( 870, 1300 ] 14185 0.140% 99.940% ( 1300, 1900 ] 73 0.001% 99.941% ( 1900, 2900 ] 5818 0.057% 99.998% ( 2900, 4400 ] 92 0.001% 99.999% ( 4400, 6600 ] 32 0.000% 100.000% ( 6600, 9900 ] 5 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 190506 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10132999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10457254968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 522 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32905705 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31412230667 rocksdb.compact.write.bytes COUNT : 31226751180 rocksdb.flush.write.bytes COUNT : 10437051423 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 58 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 314 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10352972800 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4083712 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31507945623 rocksdb.non.last.level.read.count COUNT : 7613578 rocksdb.block.checksum.compute.count COUNT : 7612592 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.362033 P95 : 3.858310 P99 : 7.119792 P100 : 641327.000000 COUNT : 10132999 SUM : 55576943 rocksdb.compaction.times.micros P50 : 1080540.540541 P95 : 5400000.000000 P99 : 16358494.000000 P100 : 16358494.000000 COUNT : 80 SUM : 128276882 rocksdb.compaction.times.cpu_micros P50 : 915135.135135 P95 : 5033333.333333 P99 : 15509496.000000 P100 : 15509496.000000 COUNT : 80 SUM : 107977609 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 681.325301 P95 : 1186.636364 P99 : 8646.000000 P100 : 107549.000000 COUNT : 138 SUM : 211730 rocksdb.compaction.outfile.sync.micros P50 : 1119.400000 P95 : 92281.250000 P99 : 162309.090909 P100 : 246344.000000 COUNT : 341 SUM : 4956421 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 109.819149 P95 : 1502.500000 P99 : 3135.000000 P100 : 4020.000000 COUNT : 253 SUM : 78073 rocksdb.table.open.io.micros P50 : 1626.086957 P95 : 10456.428571 P99 : 19403.076923 P100 : 22678.000000 COUNT : 522 SUM : 1355122 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.627442 P95 : 7.745451 P99 : 11.281398 P100 : 11007.000000 COUNT : 7611322 SUM : 44845119 rocksdb.read.block.get.micros P50 : 496.778523 P95 : 4114.062500 P99 : 8382.000000 P100 : 10920.000000 COUNT : 1044 SUM : 1108931 rocksdb.write.raw.block.micros P50 : 0.512068 P95 : 0.972929 P99 : 2.806925 P100 : 9842.000000 COUNT : 10092315 SUM : 19548689 rocksdb.numfiles.in.singlecompaction P50 : 3.304878 P95 : 5.714286 P99 : 20.600000 P100 : 23.000000 COUNT : 140 SUM : 539 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559035 P95 : 1190.877387 P99 : 2593.350533 P100 : 641141.000000 COUNT : 192186 SUM : 32921579 rocksdb.sst.read.micros P50 : 1.587973 P95 : 4.701301 P99 : 8.563417 P100 : 11000.000000 COUNT : 7614039 SUM : 29746049 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10132999 SUM : 10457254968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 210869.565217 P95 : 367000.000000 P99 : 659900.000000 P100 : 817813.000000 COUNT : 138 SUM : 29508900 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 326 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0