[2024-11-17 18:32:14.024569] Starting SPDK v25.01-pre git sha1 83e8405e4 / DPDK 23.11.0 initialization... [2024-11-17 18:32:14.024835] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid426991 ] Set seed to 1731864734017873 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-17 18:32:14.153567] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-17 18:32:14.176749] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-17 18:32:14.176797] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 426991' to capture a snapshot of events at runtime. [2024-11-17 18:32:14.176807] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-17 18:32:14.176817] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-17 18:32:14.176825] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid426991 for offline analysis/debug. [2024-11-17 18:32:14.177369] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 17 18:32:18 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/17-18:32:21 ... thread 0: (1000000,1000000) ops and (356139.8,356139.8) ops/second in (2.807886,2.807886) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 630.05 MB 6.3 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 351.5 2.33 2.09 12 0.194 0 0 0.0 0.0 L2 3/2 237.24 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 242.3 242.2 1.44 1.38 2 0.720 354K 170 0.0 0.0 L3 9/0 818.90 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/11 96.94 GB 0.0 0.3 0.2 0.2 1.1 1.0 0.0 1.4 92.5 309.7 3.77 3.47 14 0.269 354K 170 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.1 1.0 0.0 1.4 92.5 309.7 3.77 3.47 14 0.269 354K 170 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 242.3 242.2 1.44 1.38 2 0.720 354K 170 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 351.5 2.33 2.09 12 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.14 GB write, 383.60 MB/s write, 0.34 GB read, 114.61 MB/s read, 3.8 seconds Interval compaction: 1.14 GB write, 415.63 MB/s write, 0.34 GB read, 124.18 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 121246 Average: 1.9720 StdDev: 8.11 Min: 1 Median: 1.3296 Max: 1354 Percentiles: P50: 1.33 P75: 1.76 P99: 5.33 P99.9: 9.92 P99.99: 168.50 ------------------------------------------------------ [ 0, 1 ] 37247 30.720% 30.720% ###### ( 1, 2 ] 70913 58.487% 89.207% ############ ( 2, 3 ] 7645 6.305% 95.512% # ( 3, 4 ] 3006 2.479% 97.992% ( 4, 6 ] 1841 1.518% 99.510% ( 6, 10 ] 483 0.398% 99.908% ( 10, 15 ] 84 0.069% 99.978% ( 15, 22 ] 6 0.005% 99.983% ( 22, 34 ] 1 0.001% 99.984% ( 34, 51 ] 1 0.001% 99.984% ( 51, 76 ] 3 0.002% 99.987% ( 110, 170 ] 5 0.004% 99.991% ( 170, 250 ] 6 0.005% 99.996% ( 250, 380 ] 6 0.005% 100.001% ( 380, 580 ] 1 0.001% 100.002% ( 580, 870 ] 3 0.002% 100.004% ( 870, 1300 ] 2 0.002% 100.006% ( 1300, 1900 ] 1 0.001% 100.007% ** Level 2 read latency histogram (micros): Count: 70151 Average: 2.1837 StdDev: 19.79 Min: 1 Median: 1.3408 Max: 4616 Percentiles: P50: 1.34 P75: 1.77 P99: 5.73 P99.9: 41.28 P99.99: 499.39 ------------------------------------------------------ [ 0, 1 ] 21149 30.148% 30.148% ###### ( 1, 2 ] 40863 58.250% 88.398% ############ ( 2, 3 ] 4664 6.649% 95.046% # ( 3, 4 ] 1681 2.396% 97.443% ( 4, 6 ] 1261 1.798% 99.240% ( 6, 10 ] 367 0.523% 99.763% ( 10, 15 ] 68 0.097% 99.860% ( 15, 22 ] 10 0.014% 99.875% ( 22, 34 ] 6 0.009% 99.883% ( 34, 51 ] 30 0.043% 99.926% ( 51, 76 ] 20 0.029% 99.954% ( 76, 110 ] 1 0.001% 99.956% ( 110, 170 ] 3 0.004% 99.960% ( 170, 250 ] 8 0.011% 99.971% ( 250, 380 ] 11 0.016% 99.987% ( 380, 580 ] 5 0.007% 99.994% ( 580, 870 ] 3 0.004% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ( 4400, 6600 ] 1 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 45 Average: 1545.8000 StdDev: 1471.22 Min: 92 Median: 977.5000 Max: 5198 Percentiles: P50: 977.50 P75: 2250.00 P99: 5198.00 P99.9: 5198.00 P99.99: 5198.00 ------------------------------------------------------ ( 76, 110 ] 3 6.667% 6.667% # ( 170, 250 ] 1 2.222% 8.889% ( 250, 380 ] 8 17.778% 26.667% #### ( 380, 580 ] 5 11.111% 37.778% ## ( 580, 870 ] 4 8.889% 46.667% ## ( 870, 1300 ] 6 13.333% 60.000% ### ( 1300, 1900 ] 5 11.111% 71.111% ## ( 1900, 2900 ] 5 11.111% 82.222% ## ( 2900, 4400 ] 5 11.111% 93.333% ## ( 4400, 6600 ] 3 6.667% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1591.2000 StdDev: 1230.17 Min: 297 Median: 1138.7500 Max: 4821 Percentiles: P50: 1138.75 P75: 2066.67 P99: 4821.00 P99.9: 4821.00 P99.99: 4821.00 ------------------------------------------------------ ( 250, 380 ] 2 6.667% 6.667% # ( 380, 580 ] 2 6.667% 13.333% # ( 580, 870 ] 6 20.000% 33.333% #### ( 870, 1300 ] 8 26.667% 60.000% ##### ( 1300, 1900 ] 4 13.333% 73.333% ### ( 1900, 2900 ] 3 10.000% 83.333% ## ( 2900, 4400 ] 3 10.000% 93.333% ## ( 4400, 6600 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 323.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.195 H:M:S, 6.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 350.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.195 H:M:S, 6.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/17-18:32:24 ... thread 0: (1000000,2000000) ops and (325628.3,340201.3) ops/second in (3.070986,5.878872) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.29 GB 100.7 0.8 0.0 0.8 2.6 1.8 0.0 1.4 98.1 316.8 8.35 7.73 29 0.288 831K 873 0.0 0.0 L1 1/0 2.85 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 241.9 241.5 1.30 1.27 1 1.302 319K 446 0.0 0.0 L2 2/1 147.75 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.3 1.8 242.3 242.2 1.44 1.38 2 0.720 354K 170 0.0 0.0 L3 18/9 1.03 GB 0.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 218.6 218.6 0.86 0.78 1 0.856 190K 0 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 132.6 132.6 1.27 0.90 1 1.272 171K 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/14 97.92 GB 0.0 1.8 0.8 1.0 3.6 2.6 0.7 2.0 139.1 277.2 13.22 12.07 34 0.389 1866K 1489 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.8 1.0 3.6 2.6 0.7 2.0 139.1 277.2 13.22 12.07 34 0.389 1866K 1489 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.8 1.0 1.8 0.8 0.0 0.0 228.3 228.2 8.05 7.45 8 1.006 1866K 1489 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.5 5.17 4.61 26 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.58 GB write, 599.19 MB/s write, 1.80 GB read, 300.68 MB/s read, 13.2 seconds Interval compaction: 3.58 GB write, 623.09 MB/s write, 1.80 GB read, 312.67 MB/s read, 13.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 382705 Average: 2.1765 StdDev: 9.93 Min: 1 Median: 1.4789 Max: 3716 Percentiles: P50: 1.48 P75: 1.87 P99: 5.63 P99.9: 9.99 P99.99: 16.79 ------------------------------------------------------ [ 0, 1 ] 73204 19.128% 19.128% #### ( 1, 2 ] 246696 64.461% 83.589% ############# ( 2, 3 ] 37644 9.836% 93.425% ## ( 3, 4 ] 14179 3.705% 97.130% # ( 4, 6 ] 8787 2.296% 99.426% ( 6, 10 ] 1820 0.476% 99.902% ( 10, 15 ] 328 0.086% 99.988% ( 15, 22 ] 38 0.010% 99.998% ( 22, 34 ] 6 0.002% 99.999% ( 34, 51 ] 4 0.001% 100.000% ( 51, 76 ] 4 0.001% 100.001% ( 110, 170 ] 9 0.002% 100.004% ( 170, 250 ] 16 0.004% 100.008% ( 250, 380 ] 10 0.003% 100.010% ( 380, 580 ] 3 0.001% 100.011% ( 580, 870 ] 10 0.003% 100.014% ( 870, 1300 ] 6 0.002% 100.015% ( 1300, 1900 ] 3 0.001% 100.016% ( 2900, 4400 ] 1 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 20 Average: 166.3000 StdDev: 325.92 Min: 1 Median: 1.5000 Max: 1366 Percentiles: P50: 1.50 P75: 293.33 P99: 1366.00 P99.9: 1366.00 P99.99: 1366.00 ------------------------------------------------------ [ 0, 1 ] 7 35.000% 35.000% ####### ( 1, 2 ] 6 30.000% 65.000% ###### ( 6, 10 ] 1 5.000% 70.000% # ( 250, 380 ] 3 15.000% 85.000% ### ( 380, 580 ] 1 5.000% 90.000% # ( 580, 870 ] 1 5.000% 95.000% # ( 1300, 1900 ] 1 5.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 88447 Average: 2.2176 StdDev: 17.63 Min: 1 Median: 1.4080 Max: 4616 Percentiles: P50: 1.41 P75: 1.82 P99: 5.78 P99.9: 24.66 P99.99: 426.21 ------------------------------------------------------ [ 0, 1 ] 22518 25.459% 25.459% ##### ( 1, 2 ] 53197 60.146% 85.605% ############ ( 2, 3 ] 7578 8.568% 94.173% ## ( 3, 4 ] 2543 2.875% 97.048% # ( 4, 6 ] 1942 2.196% 99.244% ( 6, 10 ] 480 0.543% 99.786% ( 10, 15 ] 88 0.099% 99.886% ( 15, 22 ] 11 0.012% 99.898% ( 22, 34 ] 7 0.008% 99.906% ( 34, 51 ] 30 0.034% 99.940% ( 51, 76 ] 20 0.023% 99.963% ( 76, 110 ] 1 0.001% 99.964% ( 110, 170 ] 3 0.003% 99.967% ( 170, 250 ] 8 0.009% 99.976% ( 250, 380 ] 11 0.012% 99.989% ( 380, 580 ] 5 0.006% 99.994% ( 580, 870 ] 3 0.003% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 192924 Average: 3.3010 StdDev: 36.65 Min: 1 Median: 1.6163 Max: 5198 Percentiles: P50: 1.62 P75: 2.07 P99: 8.71 P99.9: 175.93 P99.99: 538.54 ------------------------------------------------------ [ 0, 1 ] 22320 11.569% 11.569% ## ( 1, 2 ] 120299 62.356% 73.925% ############ ( 2, 3 ] 30488 15.803% 89.728% ### ( 3, 4 ] 8780 4.551% 94.279% # ( 4, 6 ] 7096 3.678% 97.957% # ( 6, 10 ] 2973 1.541% 99.498% ( 10, 15 ] 389 0.202% 99.700% ( 15, 22 ] 87 0.045% 99.745% ( 22, 34 ] 18 0.009% 99.754% ( 34, 51 ] 4 0.002% 99.756% ( 51, 76 ] 2 0.001% 99.757% ( 76, 110 ] 101 0.052% 99.810% ( 110, 170 ] 168 0.087% 99.897% ( 170, 250 ] 82 0.043% 99.939% ( 250, 380 ] 66 0.034% 99.974% ( 380, 580 ] 40 0.021% 99.994% ( 580, 870 ] 26 0.013% 100.008% ( 870, 1300 ] 12 0.006% 100.014% ( 1300, 1900 ] 6 0.003% 100.017% ( 1900, 2900 ] 6 0.003% 100.020% ( 2900, 4400 ] 6 0.003% 100.023% ( 4400, 6600 ] 3 0.002% 100.025% ** Level 4 read latency histogram (micros): Count: 320 Average: 155.8313 StdDev: 597.48 Min: 0 Median: 2.1875 Max: 4821 Percentiles: P50: 2.19 P75: 7.03 P99: 3800.00 P99.9: 4821.00 P99.99: 4821.00 ------------------------------------------------------ [ 0, 1 ] 41 12.812% 12.812% ### ( 1, 2 ] 110 34.375% 47.188% ####### ( 2, 3 ] 48 15.000% 62.188% ### ( 3, 4 ] 15 4.688% 66.875% # ( 4, 6 ] 16 5.000% 71.875% # ( 6, 10 ] 39 12.188% 84.062% ## ( 10, 15 ] 14 4.375% 88.438% # ( 15, 22 ] 5 1.562% 90.000% ( 170, 250 ] 1 0.312% 90.312% ( 250, 380 ] 2 0.625% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 7 2.188% 93.750% ( 870, 1300 ] 8 2.500% 96.250% # ( 1300, 1900 ] 4 1.250% 97.500% ( 1900, 2900 ] 3 0.938% 98.438% ( 2900, 4400 ] 3 0.938% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 321.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.584 H:M:S, 9.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.389 H:M:S, 12.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-18:32:27 ... thread 0: (1000000,3000000) ops and (334254.4,338195.6) ops/second in (2.991733,8.870605) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.27 GB 201.4 1.9 0.0 1.9 4.7 2.8 0.0 1.7 126.5 310.0 15.44 14.42 47 0.328 1982K 2049 0.0 0.0 L1 1/0 2.85 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 241.9 241.5 1.30 1.27 1 1.302 319K 446 0.0 0.0 L2 1/0 97.65 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.3 1.8 242.3 242.2 1.44 1.38 2 0.720 354K 170 0.0 0.0 L3 19/0 842.38 MB 0.8 1.0 0.2 0.8 1.0 0.2 0.2 4.4 242.3 242.0 4.36 4.03 2 2.179 1072K 1655 0.0 0.0 L4 174/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 132.6 132.6 1.27 0.90 1 1.272 171K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/4 98.90 GB 0.0 3.8 0.9 2.9 6.5 3.7 1.3 2.4 161.4 280.2 23.81 22.00 53 0.449 3901K 4320 0.0 0.0 Int 0/0 0.00 KB 0.0 3.8 0.9 2.9 6.5 3.7 1.3 2.4 161.4 280.2 23.81 22.00 53 0.449 3901K 4320 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.8 0.9 2.9 3.7 0.9 0.0 0.0 242.3 242.0 15.85 14.91 13 1.220 3901K 4320 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 356.4 7.95 7.09 40 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.52 GB write, 732.66 MB/s write, 3.75 GB read, 421.84 MB/s read, 23.8 seconds Interval compaction: 6.52 GB write, 752.02 MB/s write, 3.75 GB read, 433.00 MB/s read, 23.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 640740 Average: 2.1343 StdDev: 11.41 Min: 0 Median: 1.4501 Max: 3816 Percentiles: P50: 1.45 P75: 1.84 P99: 5.52 P99.9: 10.28 P99.99: 17.77 ------------------------------------------------------ [ 0, 1 ] 135854 21.203% 21.203% #### ( 1, 2 ] 409907 63.974% 85.177% ############# ( 2, 3 ] 57667 9.000% 94.177% ## ( 3, 4 ] 21373 3.336% 97.512% # ( 4, 6 ] 12581 1.964% 99.476% ( 6, 10 ] 2685 0.419% 99.895% ( 10, 15 ] 582 0.091% 99.986% ( 15, 22 ] 68 0.011% 99.996% ( 22, 34 ] 10 0.002% 99.998% ( 34, 51 ] 6 0.001% 99.999% ( 51, 76 ] 8 0.001% 100.000% ( 110, 170 ] 12 0.002% 100.002% ( 170, 250 ] 26 0.004% 100.006% ( 250, 380 ] 15 0.002% 100.008% ( 380, 580 ] 4 0.001% 100.009% ( 580, 870 ] 18 0.003% 100.012% ( 870, 1300 ] 11 0.002% 100.014% ( 1300, 1900 ] 4 0.001% 100.014% ( 1900, 2900 ] 1 0.000% 100.014% ( 2900, 4400 ] 3 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 20 Average: 166.3000 StdDev: 325.92 Min: 1 Median: 1.5000 Max: 1366 Percentiles: P50: 1.50 P75: 293.33 P99: 1366.00 P99.9: 1366.00 P99.99: 1366.00 ------------------------------------------------------ [ 0, 1 ] 7 35.000% 35.000% ####### ( 1, 2 ] 6 30.000% 65.000% ###### ( 6, 10 ] 1 5.000% 70.000% # ( 250, 380 ] 3 15.000% 85.000% ### ( 380, 580 ] 1 5.000% 90.000% # ( 580, 870 ] 1 5.000% 95.000% # ( 1300, 1900 ] 1 5.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 100869 Average: 2.1862 StdDev: 16.51 Min: 1 Median: 1.4101 Max: 4616 Percentiles: P50: 1.41 P75: 1.82 P99: 5.71 P99.9: 15.08 P99.99: 378.97 ------------------------------------------------------ [ 0, 1 ] 25206 24.989% 24.989% ##### ( 1, 2 ] 61512 60.982% 85.971% ############ ( 2, 3 ] 8494 8.421% 94.392% ## ( 3, 4 ] 2867 2.842% 97.234% # ( 4, 6 ] 2086 2.068% 99.302% ( 6, 10 ] 515 0.511% 99.813% ( 10, 15 ] 88 0.087% 99.900% ( 15, 22 ] 11 0.011% 99.911% ( 22, 34 ] 7 0.007% 99.918% ( 34, 51 ] 30 0.030% 99.947% ( 51, 76 ] 20 0.020% 99.967% ( 76, 110 ] 1 0.001% 99.968% ( 110, 170 ] 3 0.003% 99.971% ( 170, 250 ] 8 0.008% 99.979% ( 250, 380 ] 11 0.011% 99.990% ( 380, 580 ] 5 0.005% 99.995% ( 580, 870 ] 3 0.003% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 250833 Average: 3.2306 StdDev: 33.62 Min: 0 Median: 1.5985 Max: 5198 Percentiles: P50: 1.60 P75: 1.99 P99: 8.64 P99.9: 194.05 P99.99: 568.99 ------------------------------------------------------ [ 0, 1 ] 30138 12.015% 12.015% ## ( 1, 2 ] 159193 63.466% 75.481% ############# ( 2, 3 ] 36759 14.655% 90.136% ### ( 3, 4 ] 11068 4.412% 94.548% # ( 4, 6 ] 8572 3.417% 97.966% # ( 6, 10 ] 3924 1.564% 99.530% ( 10, 15 ] 423 0.169% 99.699% ( 15, 22 ] 93 0.037% 99.736% ( 22, 34 ] 18 0.007% 99.743% ( 34, 51 ] 4 0.002% 99.744% ( 51, 76 ] 2 0.001% 99.745% ( 76, 110 ] 124 0.049% 99.795% ( 110, 170 ] 229 0.091% 99.886% ( 170, 250 ] 117 0.047% 99.933% ( 250, 380 ] 91 0.036% 99.969% ( 380, 580 ] 56 0.022% 99.991% ( 580, 870 ] 32 0.013% 100.004% ( 870, 1300 ] 16 0.006% 100.010% ( 1300, 1900 ] 6 0.002% 100.013% ( 1900, 2900 ] 6 0.002% 100.015% ( 2900, 4400 ] 7 0.003% 100.018% ( 4400, 6600 ] 3 0.001% 100.019% ** Level 4 read latency histogram (micros): Count: 320 Average: 155.8313 StdDev: 597.48 Min: 0 Median: 2.1875 Max: 4821 Percentiles: P50: 2.19 P75: 7.03 P99: 3800.00 P99.9: 4821.00 P99.99: 4821.00 ------------------------------------------------------ [ 0, 1 ] 41 12.812% 12.812% ### ( 1, 2 ] 110 34.375% 47.188% ####### ( 2, 3 ] 48 15.000% 62.188% ### ( 3, 4 ] 15 4.688% 66.875% # ( 4, 6 ] 16 5.000% 71.875% # ( 6, 10 ] 39 12.188% 84.062% ## ( 10, 15 ] 14 4.375% 88.438% # ( 15, 22 ] 5 1.562% 90.000% ( 170, 250 ] 1 0.312% 90.312% ( 250, 380 ] 2 0.625% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 7 2.188% 93.750% ( 870, 1300 ] 8 2.500% 96.250% # ( 1300, 1900 ] 4 1.250% 97.500% ( 1900, 2900 ] 3 0.938% 98.438% ( 2900, 4400 ] 3 0.938% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 932.5000 StdDev: 1167.74 Min: 98 Median: 293.3333 Max: 4440 Percentiles: P50: 293.33 P75: 1600.00 P99: 4440.00 P99.9: 4440.00 P99.99: 4440.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 4 20.000% 35.000% #### ( 170, 250 ] 2 10.000% 45.000% ## ( 250, 380 ] 3 15.000% 60.000% ### ( 380, 580 ] 1 5.000% 65.000% # ( 1300, 1900 ] 4 20.000% 85.000% #### ( 1900, 2900 ] 1 5.000% 90.000% # ( 2900, 4400 ] 1 5.000% 95.000% # ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 324.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.956 H:M:S, 10.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.372 H:M:S, 12.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-18:32:30 ... thread 0: (1000000,4000000) ops and (332137.1,336660.4) ops/second in (3.010805,11.881410) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/4 3.20 GB 295.8 2.8 0.0 2.8 6.5 3.7 0.0 1.7 132.3 308.6 21.42 20.06 63 0.340 2878K 3002 0.0 0.0 L1 1/0 2.85 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 241.9 241.5 1.30 1.27 1 1.302 319K 446 0.0 0.0 L2 1/0 97.65 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.3 1.8 242.3 242.2 1.44 1.38 2 0.720 354K 170 0.0 0.0 L3 19/0 842.38 MB 0.8 1.0 0.2 0.8 1.0 0.2 0.2 4.4 242.3 242.0 4.36 4.03 2 2.179 1072K 1655 0.0 0.0 L4 174/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 132.6 132.6 1.27 0.90 1 1.272 171K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1259/4 99.82 GB 0.0 4.6 0.9 3.7 8.3 4.6 1.3 2.2 158.5 285.2 29.80 27.64 69 0.432 4796K 5273 0.0 0.0 Int 0/0 0.00 KB 0.0 4.6 0.9 3.7 8.3 4.6 1.3 2.2 158.5 285.2 29.80 27.64 69 0.432 4796K 5273 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.6 0.9 3.7 4.6 0.9 0.0 0.0 246.1 245.8 19.20 18.17 16 1.200 4796K 5273 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 356.6 10.60 9.47 53 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.30 GB write, 701.30 MB/s write, 4.61 GB read, 389.81 MB/s read, 29.8 seconds Interval compaction: 8.30 GB write, 715.14 MB/s write, 4.61 GB read, 397.51 MB/s read, 29.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 888279 Average: 2.0707 StdDev: 12.18 Min: 0 Median: 1.4082 Max: 3816 Percentiles: P50: 1.41 P75: 1.81 P99: 5.33 P99.9: 9.92 P99.99: 17.68 ------------------------------------------------------ [ 0, 1 ] 216174 24.336% 24.336% ##### ( 1, 2 ] 558424 62.866% 87.202% ############# ( 2, 3 ] 69241 7.795% 94.997% ## ( 3, 4 ] 25994 2.926% 97.923% # ( 4, 6 ] 14391 1.620% 99.543% ( 6, 10 ] 3232 0.364% 99.907% ( 10, 15 ] 699 0.079% 99.986% ( 15, 22 ] 92 0.010% 99.996% ( 22, 34 ] 13 0.001% 99.998% ( 34, 51 ] 9 0.001% 99.999% ( 51, 76 ] 8 0.001% 100.000% ( 110, 170 ] 17 0.002% 100.002% ( 170, 250 ] 31 0.003% 100.005% ( 250, 380 ] 22 0.002% 100.008% ( 380, 580 ] 6 0.001% 100.008% ( 580, 870 ] 23 0.003% 100.011% ( 870, 1300 ] 13 0.001% 100.012% ( 1300, 1900 ] 7 0.001% 100.013% ( 1900, 2900 ] 1 0.000% 100.013% ( 2900, 4400 ] 6 0.001% 100.014% ** Level 1 read latency histogram (micros): Count: 20 Average: 166.3000 StdDev: 325.92 Min: 1 Median: 1.5000 Max: 1366 Percentiles: P50: 1.50 P75: 293.33 P99: 1366.00 P99.9: 1366.00 P99.99: 1366.00 ------------------------------------------------------ [ 0, 1 ] 7 35.000% 35.000% ####### ( 1, 2 ] 6 30.000% 65.000% ###### ( 6, 10 ] 1 5.000% 70.000% # ( 250, 380 ] 3 15.000% 85.000% ### ( 380, 580 ] 1 5.000% 90.000% # ( 580, 870 ] 1 5.000% 95.000% # ( 1300, 1900 ] 1 5.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 100869 Average: 2.1862 StdDev: 16.51 Min: 1 Median: 1.4101 Max: 4616 Percentiles: P50: 1.41 P75: 1.82 P99: 5.71 P99.9: 15.08 P99.99: 378.97 ------------------------------------------------------ [ 0, 1 ] 25206 24.989% 24.989% ##### ( 1, 2 ] 61512 60.982% 85.971% ############ ( 2, 3 ] 8494 8.421% 94.392% ## ( 3, 4 ] 2867 2.842% 97.234% # ( 4, 6 ] 2086 2.068% 99.302% ( 6, 10 ] 515 0.511% 99.813% ( 10, 15 ] 88 0.087% 99.900% ( 15, 22 ] 11 0.011% 99.911% ( 22, 34 ] 7 0.007% 99.918% ( 34, 51 ] 30 0.030% 99.947% ( 51, 76 ] 20 0.020% 99.967% ( 76, 110 ] 1 0.001% 99.968% ( 110, 170 ] 3 0.003% 99.971% ( 170, 250 ] 8 0.008% 99.979% ( 250, 380 ] 11 0.011% 99.990% ( 380, 580 ] 5 0.005% 99.995% ( 580, 870 ] 3 0.003% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 250833 Average: 3.2306 StdDev: 33.62 Min: 0 Median: 1.5985 Max: 5198 Percentiles: P50: 1.60 P75: 1.99 P99: 8.64 P99.9: 194.05 P99.99: 568.99 ------------------------------------------------------ [ 0, 1 ] 30138 12.015% 12.015% ## ( 1, 2 ] 159193 63.466% 75.481% ############# ( 2, 3 ] 36759 14.655% 90.136% ### ( 3, 4 ] 11068 4.412% 94.548% # ( 4, 6 ] 8572 3.417% 97.966% # ( 6, 10 ] 3924 1.564% 99.530% ( 10, 15 ] 423 0.169% 99.699% ( 15, 22 ] 93 0.037% 99.736% ( 22, 34 ] 18 0.007% 99.743% ( 34, 51 ] 4 0.002% 99.744% ( 51, 76 ] 2 0.001% 99.745% ( 76, 110 ] 124 0.049% 99.795% ( 110, 170 ] 229 0.091% 99.886% ( 170, 250 ] 117 0.047% 99.933% ( 250, 380 ] 91 0.036% 99.969% ( 380, 580 ] 56 0.022% 99.991% ( 580, 870 ] 32 0.013% 100.004% ( 870, 1300 ] 16 0.006% 100.010% ( 1300, 1900 ] 6 0.002% 100.013% ( 1900, 2900 ] 6 0.002% 100.015% ( 2900, 4400 ] 7 0.003% 100.018% ( 4400, 6600 ] 3 0.001% 100.019% ** Level 4 read latency histogram (micros): Count: 320 Average: 155.8313 StdDev: 597.48 Min: 0 Median: 2.1875 Max: 4821 Percentiles: P50: 2.19 P75: 7.03 P99: 3800.00 P99.9: 4821.00 P99.99: 4821.00 ------------------------------------------------------ [ 0, 1 ] 41 12.812% 12.812% ### ( 1, 2 ] 110 34.375% 47.188% ####### ( 2, 3 ] 48 15.000% 62.188% ### ( 3, 4 ] 15 4.688% 66.875% # ( 4, 6 ] 16 5.000% 71.875% # ( 6, 10 ] 39 12.188% 84.062% ## ( 10, 15 ] 14 4.375% 88.438% # ( 15, 22 ] 5 1.562% 90.000% ( 170, 250 ] 1 0.312% 90.312% ( 250, 380 ] 2 0.625% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 7 2.188% 93.750% ( 870, 1300 ] 8 2.500% 96.250% # ( 1300, 1900 ] 4 1.250% 97.500% ( 1900, 2900 ] 3 0.938% 98.438% ( 2900, 4400 ] 3 0.938% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 932.5000 StdDev: 1167.74 Min: 98 Median: 293.3333 Max: 4440 Percentiles: P50: 293.33 P75: 1600.00 P99: 4440.00 P99.9: 4440.00 P99.99: 4440.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 4 20.000% 35.000% #### ( 170, 250 ] 2 10.000% 45.000% ## ( 250, 380 ] 3 15.000% 60.000% ### ( 380, 580 ] 1 5.000% 65.000% # ( 1300, 1900 ] 4 20.000% 85.000% #### ( 1900, 2900 ] 1 5.000% 90.000% # ( 2900, 4400 ] 1 5.000% 95.000% # ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 324.87 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.342 H:M:S, 11.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.386 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-18:32:34 ... thread 0: (1000000,5000000) ops and (222875.6,305470.0) ops/second in (4.486808,16.368218) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 4.18 GB 62.9 3.8 0.0 3.8 8.5 4.7 0.0 1.8 138.4 308.0 28.21 26.48 82 0.344 3965K 4115 0.0 0.0 L1 1/1 2.85 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 241.9 241.5 1.30 1.27 1 1.302 319K 446 0.0 0.0 L2 1/0 97.65 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.3 1.8 242.3 242.2 1.44 1.38 2 0.720 354K 170 0.0 0.0 L3 19/0 842.38 MB 0.8 1.0 0.2 0.8 1.0 0.2 0.2 4.4 242.3 242.0 4.36 4.03 2 2.179 1072K 1655 0.0 0.0 L4 174/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 132.6 132.6 1.27 0.90 1 1.272 171K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1262/16 100.81 GB 0.0 5.7 0.9 4.8 10.3 5.6 1.3 2.2 158.4 289.1 36.59 34.06 88 0.416 5883K 6386 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 0.9 4.8 10.3 5.6 1.3 2.2 158.4 289.1 36.59 34.06 88 0.416 5883K 6386 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 0.9 4.8 5.7 0.9 0.0 0.0 250.2 250.0 23.16 22.06 20 1.158 5883K 6386 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 356.5 13.43 12.00 68 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.6 total, 16.4 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.33 GB write, 636.92 MB/s write, 5.66 GB read, 348.98 MB/s read, 36.6 seconds Interval compaction: 10.33 GB write, 646.05 MB/s write, 5.66 GB read, 353.98 MB/s read, 36.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 15, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1314716 Average: 2.0871 StdDev: 11.92 Min: 0 Median: 1.4069 Max: 3816 Percentiles: P50: 1.41 P75: 1.80 P99: 5.31 P99.9: 11.46 P99.99: 128.08 ------------------------------------------------------ [ 0, 1 ] 317570 24.155% 24.155% ##### ( 1, 2 ] 835044 63.515% 87.670% ############# ( 2, 3 ] 100280 7.628% 95.298% ## ( 3, 4 ] 36341 2.764% 98.062% # ( 4, 6 ] 18820 1.431% 99.493% ( 6, 10 ] 5007 0.381% 99.874% ( 10, 15 ] 1168 0.089% 99.963% ( 15, 22 ] 170 0.013% 99.976% ( 22, 34 ] 20 0.002% 99.977% ( 34, 51 ] 9 0.001% 99.978% ( 51, 76 ] 9 0.001% 99.979% ( 76, 110 ] 97 0.007% 99.986% ( 110, 170 ] 171 0.013% 99.999% ( 170, 250 ] 64 0.005% 100.004% ( 250, 380 ] 37 0.003% 100.007% ( 380, 580 ] 16 0.001% 100.008% ( 580, 870 ] 35 0.003% 100.011% ( 870, 1300 ] 16 0.001% 100.012% ( 1300, 1900 ] 9 0.001% 100.013% ( 1900, 2900 ] 1 0.000% 100.013% ( 2900, 4400 ] 9 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 21 Average: 165.7143 StdDev: 318.08 Min: 1 Median: 1.5833 Max: 1366 Percentiles: P50: 1.58 P75: 282.50 P99: 1366.00 P99.9: 1366.00 P99.99: 1366.00 ------------------------------------------------------ [ 0, 1 ] 7 33.333% 33.333% ####### ( 1, 2 ] 6 28.571% 61.905% ###### ( 6, 10 ] 1 4.762% 66.667% # ( 110, 170 ] 1 4.762% 71.429% # ( 250, 380 ] 3 14.286% 85.714% ### ( 380, 580 ] 1 4.762% 90.476% # ( 580, 870 ] 1 4.762% 95.238% # ( 1300, 1900 ] 1 4.762% 100.000% # ** Level 2 read latency histogram (micros): Count: 100869 Average: 2.1862 StdDev: 16.51 Min: 1 Median: 1.4101 Max: 4616 Percentiles: P50: 1.41 P75: 1.82 P99: 5.71 P99.9: 15.08 P99.99: 378.97 ------------------------------------------------------ [ 0, 1 ] 25206 24.989% 24.989% ##### ( 1, 2 ] 61512 60.982% 85.971% ############ ( 2, 3 ] 8494 8.421% 94.392% ## ( 3, 4 ] 2867 2.842% 97.234% # ( 4, 6 ] 2086 2.068% 99.302% ( 6, 10 ] 515 0.511% 99.813% ( 10, 15 ] 88 0.087% 99.900% ( 15, 22 ] 11 0.011% 99.911% ( 22, 34 ] 7 0.007% 99.918% ( 34, 51 ] 30 0.030% 99.947% ( 51, 76 ] 20 0.020% 99.967% ( 76, 110 ] 1 0.001% 99.968% ( 110, 170 ] 3 0.003% 99.971% ( 170, 250 ] 8 0.008% 99.979% ( 250, 380 ] 11 0.011% 99.990% ( 380, 580 ] 5 0.005% 99.995% ( 580, 870 ] 3 0.003% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 250833 Average: 3.2306 StdDev: 33.62 Min: 0 Median: 1.5985 Max: 5198 Percentiles: P50: 1.60 P75: 1.99 P99: 8.64 P99.9: 194.05 P99.99: 568.99 ------------------------------------------------------ [ 0, 1 ] 30138 12.015% 12.015% ## ( 1, 2 ] 159193 63.466% 75.481% ############# ( 2, 3 ] 36759 14.655% 90.136% ### ( 3, 4 ] 11068 4.412% 94.548% # ( 4, 6 ] 8572 3.417% 97.966% # ( 6, 10 ] 3924 1.564% 99.530% ( 10, 15 ] 423 0.169% 99.699% ( 15, 22 ] 93 0.037% 99.736% ( 22, 34 ] 18 0.007% 99.743% ( 34, 51 ] 4 0.002% 99.744% ( 51, 76 ] 2 0.001% 99.745% ( 76, 110 ] 124 0.049% 99.795% ( 110, 170 ] 229 0.091% 99.886% ( 170, 250 ] 117 0.047% 99.933% ( 250, 380 ] 91 0.036% 99.969% ( 380, 580 ] 56 0.022% 99.991% ( 580, 870 ] 32 0.013% 100.004% ( 870, 1300 ] 16 0.006% 100.010% ( 1300, 1900 ] 6 0.002% 100.013% ( 1900, 2900 ] 6 0.002% 100.015% ( 2900, 4400 ] 7 0.003% 100.018% ( 4400, 6600 ] 3 0.001% 100.019% ** Level 4 read latency histogram (micros): Count: 320 Average: 155.8313 StdDev: 597.48 Min: 0 Median: 2.1875 Max: 4821 Percentiles: P50: 2.19 P75: 7.03 P99: 3800.00 P99.9: 4821.00 P99.99: 4821.00 ------------------------------------------------------ [ 0, 1 ] 41 12.812% 12.812% ### ( 1, 2 ] 110 34.375% 47.188% ####### ( 2, 3 ] 48 15.000% 62.188% ### ( 3, 4 ] 15 4.688% 66.875% # ( 4, 6 ] 16 5.000% 71.875% # ( 6, 10 ] 39 12.188% 84.062% ## ( 10, 15 ] 14 4.375% 88.438% # ( 15, 22 ] 5 1.562% 90.000% ( 170, 250 ] 1 0.312% 90.312% ( 250, 380 ] 2 0.625% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 7 2.188% 93.750% ( 870, 1300 ] 8 2.500% 96.250% # ( 1300, 1900 ] 4 1.250% 97.500% ( 1900, 2900 ] 3 0.938% 98.438% ( 2900, 4400 ] 3 0.938% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 932.5000 StdDev: 1167.74 Min: 98 Median: 293.3333 Max: 4440 Percentiles: P50: 293.33 P75: 1600.00 P99: 4440.00 P99.9: 4440.00 P99.99: 4440.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 4 20.000% 35.000% #### ( 170, 250 ] 2 10.000% 45.000% ## ( 250, 380 ] 3 15.000% 60.000% ### ( 380, 580 ] 1 5.000% 65.000% # ( 1300, 1900 ] 4 20.000% 85.000% #### ( 1900, 2900 ] 1 5.000% 90.000% # ( 2900, 4400 ] 1 5.000% 95.000% # ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 16.6 total, 4.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 296.36 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.124 H:M:S, 18.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 219.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.783 H:M:S, 39.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-18:32:48 ... thread 0: (1000000,6000000) ops and (74411.1,201294.6) ops/second in (13.438848,29.807066) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 1.60 GB 12.6 5.4 0.0 5.4 11.0 5.7 0.0 1.9 148.4 305.2 36.92 34.80 102 0.362 5564K 7288 0.0 0.0 L1 10/10 1.12 GB 0.0 3.9 3.9 0.0 3.8 3.8 0.2 1.0 226.4 222.8 17.52 16.60 2 8.762 4029K 63K 0.0 0.0 L2 20/11 2.48 GB 11.5 0.3 0.2 0.2 0.3 0.2 2.7 1.8 242.3 242.2 1.44 1.38 2 0.720 354K 170 0.0 0.0 L3 19/9 842.38 MB 0.6 1.0 0.2 0.8 1.0 0.2 0.2 4.4 242.3 242.0 4.36 4.03 2 2.179 1072K 1655 0.0 0.0 L4 174/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 132.6 132.6 1.27 0.90 1 1.272 171K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1279/36 101.73 GB 0.0 10.8 4.5 6.3 16.4 10.0 3.7 2.9 179.2 272.2 61.52 57.71 109 0.564 11M 72K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.8 4.5 6.3 16.4 10.0 3.7 2.9 179.2 272.2 61.52 57.71 109 0.564 11M 72K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.8 4.5 6.3 10.7 4.4 0.0 0.0 243.9 242.3 45.19 43.13 25 1.807 11M 72K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 354.9 16.33 14.58 84 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 30.0 total, 29.8 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.35 GB write, 557.34 MB/s write, 10.76 GB read, 366.86 MB/s read, 61.5 seconds Interval compaction: 16.35 GB write, 561.73 MB/s write, 10.76 GB read, 369.74 MB/s read, 61.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 15, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2458978 Average: 2.3471 StdDev: 14.09 Min: 0 Median: 1.4066 Max: 3968 Percentiles: P50: 1.41 P75: 1.80 P99: 5.70 P99.9: 108.63 P99.99: 297.03 ------------------------------------------------------ [ 0, 1 ] 587708 23.900% 23.900% ##### ( 1, 2 ] 1578265 64.184% 88.084% ############# ( 2, 3 ] 174112 7.081% 95.165% # ( 3, 4 ] 64270 2.614% 97.779% # ( 4, 6 ] 35436 1.441% 99.220% ( 6, 10 ] 11378 0.463% 99.682% ( 10, 15 ] 2312 0.094% 99.776% ( 15, 22 ] 554 0.023% 99.799% ( 22, 34 ] 34 0.001% 99.800% ( 34, 51 ] 12 0.000% 99.801% ( 51, 76 ] 42 0.002% 99.803% ( 76, 110 ] 2497 0.102% 99.904% ( 110, 170 ] 1690 0.069% 99.973% ( 170, 250 ] 336 0.014% 99.986% ( 250, 380 ] 238 0.010% 99.996% ( 380, 580 ] 221 0.009% 100.005% ( 580, 870 ] 109 0.004% 100.010% ( 870, 1300 ] 45 0.002% 100.011% ( 1300, 1900 ] 20 0.001% 100.012% ( 1900, 2900 ] 11 0.000% 100.013% ( 2900, 4400 ] 12 0.000% 100.013% ** Level 1 read latency histogram (micros): Count: 70902 Average: 4.5722 StdDev: 35.89 Min: 1 Median: 1.7611 Max: 2825 Percentiles: P50: 1.76 P75: 2.54 P99: 9.21 P99.9: 248.83 P99.99: 456.21 ------------------------------------------------------ [ 0, 1 ] 2784 3.927% 3.927% # ( 1, 2 ] 42919 60.533% 64.459% ############ ( 2, 3 ] 13765 19.414% 83.874% #### ( 3, 4 ] 5282 7.450% 91.323% # ( 4, 6 ] 4481 6.320% 97.643% # ( 6, 10 ] 1201 1.694% 99.337% ( 10, 15 ] 129 0.182% 99.519% ( 15, 22 ] 37 0.052% 99.571% ( 22, 34 ] 7 0.010% 99.581% ( 51, 76 ] 3 0.004% 99.585% ( 76, 110 ] 73 0.103% 99.688% ( 110, 170 ] 90 0.127% 99.815% ( 170, 250 ] 62 0.087% 99.903% ( 250, 380 ] 45 0.063% 99.966% ( 380, 580 ] 47 0.066% 100.032% ( 580, 870 ] 48 0.068% 100.100% ( 870, 1300 ] 23 0.032% 100.133% ( 1300, 1900 ] 6 0.008% 100.141% ( 1900, 2900 ] 1 0.001% 100.142% ** Level 2 read latency histogram (micros): Count: 100869 Average: 2.1862 StdDev: 16.51 Min: 1 Median: 1.4101 Max: 4616 Percentiles: P50: 1.41 P75: 1.82 P99: 5.71 P99.9: 15.08 P99.99: 378.97 ------------------------------------------------------ [ 0, 1 ] 25206 24.989% 24.989% ##### ( 1, 2 ] 61512 60.982% 85.971% ############ ( 2, 3 ] 8494 8.421% 94.392% ## ( 3, 4 ] 2867 2.842% 97.234% # ( 4, 6 ] 2086 2.068% 99.302% ( 6, 10 ] 515 0.511% 99.813% ( 10, 15 ] 88 0.087% 99.900% ( 15, 22 ] 11 0.011% 99.911% ( 22, 34 ] 7 0.007% 99.918% ( 34, 51 ] 30 0.030% 99.947% ( 51, 76 ] 20 0.020% 99.967% ( 76, 110 ] 1 0.001% 99.968% ( 110, 170 ] 3 0.003% 99.971% ( 170, 250 ] 8 0.008% 99.979% ( 250, 380 ] 11 0.011% 99.990% ( 380, 580 ] 5 0.005% 99.995% ( 580, 870 ] 3 0.003% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 252461 Average: 3.4508 StdDev: 35.20 Min: 0 Median: 1.6008 Max: 5198 Percentiles: P50: 1.60 P75: 2.00 P99: 8.84 P99.9: 249.76 P99.99: 673.01 ------------------------------------------------------ [ 0, 1 ] 30178 11.954% 11.954% ## ( 1, 2 ] 159878 63.328% 75.281% ############# ( 2, 3 ] 37194 14.733% 90.014% ### ( 3, 4 ] 11201 4.437% 94.451% # ( 4, 6 ] 8672 3.435% 97.886% # ( 6, 10 ] 3960 1.569% 99.454% ( 10, 15 ] 428 0.170% 99.624% ( 15, 22 ] 95 0.038% 99.661% ( 22, 34 ] 18 0.007% 99.668% ( 34, 51 ] 4 0.002% 99.670% ( 51, 76 ] 2 0.001% 99.671% ( 76, 110 ] 142 0.056% 99.727% ( 110, 170 ] 281 0.111% 99.838% ( 170, 250 ] 156 0.062% 99.900% ( 250, 380 ] 127 0.050% 99.950% ( 380, 580 ] 85 0.034% 99.984% ( 580, 870 ] 46 0.018% 100.002% ( 870, 1300 ] 19 0.008% 100.010% ( 1300, 1900 ] 6 0.002% 100.012% ( 1900, 2900 ] 7 0.003% 100.015% ( 2900, 4400 ] 7 0.003% 100.018% ( 4400, 6600 ] 3 0.001% 100.019% ** Level 4 read latency histogram (micros): Count: 320 Average: 155.8313 StdDev: 597.48 Min: 0 Median: 2.1875 Max: 4821 Percentiles: P50: 2.19 P75: 7.03 P99: 3800.00 P99.9: 4821.00 P99.99: 4821.00 ------------------------------------------------------ [ 0, 1 ] 41 12.812% 12.812% ### ( 1, 2 ] 110 34.375% 47.188% ####### ( 2, 3 ] 48 15.000% 62.188% ### ( 3, 4 ] 15 4.688% 66.875% # ( 4, 6 ] 16 5.000% 71.875% # ( 6, 10 ] 39 12.188% 84.062% ## ( 10, 15 ] 14 4.375% 88.438% # ( 15, 22 ] 5 1.562% 90.000% ( 170, 250 ] 1 0.312% 90.312% ( 250, 380 ] 2 0.625% 90.938% ( 380, 580 ] 2 0.625% 91.562% ( 580, 870 ] 7 2.188% 93.750% ( 870, 1300 ] 8 2.500% 96.250% # ( 1300, 1900 ] 4 1.250% 97.500% ( 1900, 2900 ] 3 0.938% 98.438% ( 2900, 4400 ] 3 0.938% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 932.5000 StdDev: 1167.74 Min: 98 Median: 293.3333 Max: 4440 Percentiles: P50: 293.33 P75: 1600.00 P99: 4440.00 P99.9: 4440.00 P99.99: 4440.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 4 20.000% 35.000% #### ( 170, 250 ] 2 10.000% 45.000% ## ( 250, 380 ] 3 15.000% 60.000% ### ( 380, 580 ] 1 5.000% 65.000% # ( 1300, 1900 ] 4 20.000% 85.000% #### ( 1900, 2900 ] 1 5.000% 90.000% # ( 2900, 4400 ] 1 5.000% 95.000% # ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 30.0 total, 13.4 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 196.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:13.415 H:M:S, 44.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 73.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:10.291 H:M:S, 76.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/17-18:32:52 ... thread 0: (1000000,7000000) ops and (212565.7,202831.0) ops/second in (4.704427,34.511493) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/10 2.58 GB 81.8 5.9 0.0 5.9 12.5 6.6 0.0 1.9 141.2 299.8 42.84 39.62 117 0.366 6139K 7870 0.0 0.0 L1 10/10 1.12 GB 0.0 3.9 3.9 0.0 3.8 3.8 0.2 1.0 226.4 222.8 17.52 16.60 2 8.762 4029K 63K 0.0 0.0 L2 7/6 895.25 MB 1.3 0.3 0.2 0.2 0.3 0.2 2.7 1.8 242.3 242.2 1.44 1.38 2 0.720 354K 170 0.0 0.0 L3 32/10 1.53 GB 1.0 2.9 1.8 1.1 2.9 1.8 0.2 1.6 213.1 212.6 13.93 12.54 6 2.321 3014K 6804 0.0 0.0 L4 177/5 9.49 GB 1.0 0.5 0.5 0.0 0.5 0.5 0.8 1.0 112.1 112.0 4.34 2.39 6 0.723 488K 334 0.0 0.0 L5 1060/0 87.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1301/41 102.70 GB 0.0 13.5 6.4 7.1 20.1 12.9 5.3 3.0 172.6 256.6 80.07 72.55 133 0.602 14M 78K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.5 6.4 7.1 20.1 12.9 5.3 3.0 172.6 256.6 80.07 72.55 133 0.602 14M 78K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.5 6.4 7.1 13.4 6.3 0.0 0.0 229.9 228.6 60.09 55.37 36 1.669 14M 78K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 340.6 19.98 17.18 97 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.7 total, 34.5 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.06 GB write, 591.18 MB/s write, 13.49 GB read, 397.66 MB/s read, 80.1 seconds Interval compaction: 20.06 GB write, 595.20 MB/s write, 13.49 GB read, 400.36 MB/s read, 80.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 27, interval: 45 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2916258 Average: 2.4641 StdDev: 17.15 Min: 0 Median: 1.4598 Max: 5237 Percentiles: P50: 1.46 P75: 1.85 P99: 5.95 P99.9: 104.24 P99.99: 280.89 ------------------------------------------------------ [ 0, 1 ] 607437 20.829% 20.829% #### ( 1, 2 ] 1850227 63.445% 84.275% ############# ( 2, 3 ] 261593 8.970% 93.245% ## ( 3, 4 ] 101738 3.489% 96.733% # ( 4, 6 ] 67653 2.320% 99.053% ( 6, 10 ] 18608 0.638% 99.691% ( 10, 15 ] 3213 0.110% 99.801% ( 15, 22 ] 680 0.023% 99.825% ( 22, 34 ] 46 0.002% 99.826% ( 34, 51 ] 13 0.000% 99.827% ( 51, 76 ] 44 0.002% 99.828% ( 76, 110 ] 2516 0.086% 99.915% ( 110, 170 ] 1739 0.060% 99.974% ( 170, 250 ] 390 0.013% 99.988% ( 250, 380 ] 292 0.010% 99.998% ( 380, 580 ] 267 0.009% 100.007% ( 580, 870 ] 152 0.005% 100.012% ( 870, 1300 ] 61 0.002% 100.014% ( 1300, 1900 ] 27 0.001% 100.015% ( 1900, 2900 ] 22 0.001% 100.016% ( 2900, 4400 ] 25 0.001% 100.017% ( 4400, 6600 ] 2 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 582824 Average: 4.7479 StdDev: 68.67 Min: 1 Median: 1.8167 Max: 8297 Percentiles: P50: 1.82 P75: 2.66 P99: 8.94 P99.9: 175.78 P99.99: 494.29 ------------------------------------------------------ [ 0, 1 ] 13486 2.314% 2.314% ( 1, 2 ] 340291 58.387% 60.700% ############ ( 2, 3 ] 126963 21.784% 82.485% #### ( 3, 4 ] 47347 8.124% 90.608% ## ( 4, 6 ] 40296 6.914% 97.522% # ( 6, 10 ] 11724 2.012% 99.534% ( 10, 15 ] 1360 0.233% 99.767% ( 15, 22 ] 192 0.033% 99.800% ( 22, 34 ] 17 0.003% 99.803% ( 34, 51 ] 4 0.001% 99.804% ( 51, 76 ] 5 0.001% 99.805% ( 76, 110 ] 213 0.037% 99.841% ( 110, 170 ] 330 0.057% 99.898% ( 170, 250 ] 210 0.036% 99.934% ( 250, 380 ] 216 0.037% 99.971% ( 380, 580 ] 199 0.034% 100.005% ( 580, 870 ] 167 0.029% 100.034% ( 870, 1300 ] 102 0.018% 100.051% ( 1300, 1900 ] 47 0.008% 100.059% ( 1900, 2900 ] 65 0.011% 100.070% ( 2900, 4400 ] 88 0.015% 100.085% ( 4400, 6600 ] 22 0.004% 100.089% ( 6600, 9900 ] 5 0.001% 100.090% ** Level 2 read latency histogram (micros): Count: 100869 Average: 2.1862 StdDev: 16.51 Min: 1 Median: 1.4101 Max: 4616 Percentiles: P50: 1.41 P75: 1.82 P99: 5.71 P99.9: 15.08 P99.99: 378.97 ------------------------------------------------------ [ 0, 1 ] 25206 24.989% 24.989% ##### ( 1, 2 ] 61512 60.982% 85.971% ############ ( 2, 3 ] 8494 8.421% 94.392% ## ( 3, 4 ] 2867 2.842% 97.234% # ( 4, 6 ] 2086 2.068% 99.302% ( 6, 10 ] 515 0.511% 99.813% ( 10, 15 ] 88 0.087% 99.900% ( 15, 22 ] 11 0.011% 99.911% ( 22, 34 ] 7 0.007% 99.918% ( 34, 51 ] 30 0.030% 99.947% ( 51, 76 ] 20 0.020% 99.967% ( 76, 110 ] 1 0.001% 99.968% ( 110, 170 ] 3 0.003% 99.971% ( 170, 250 ] 8 0.008% 99.979% ( 250, 380 ] 11 0.011% 99.990% ( 380, 580 ] 5 0.005% 99.995% ( 580, 870 ] 3 0.003% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 435498 Average: 5.6071 StdDev: 78.70 Min: 0 Median: 1.7575 Max: 7710 Percentiles: P50: 1.76 P75: 2.59 P99: 9.23 P99.9: 336.75 P99.99: 713.60 ------------------------------------------------------ [ 0, 1 ] 32113 7.374% 7.374% # ( 1, 2 ] 245051 56.269% 63.643% ########### ( 2, 3 ] 84066 19.303% 82.946% #### ( 3, 4 ] 33365 7.661% 90.608% ## ( 4, 6 ] 30180 6.930% 97.538% # ( 6, 10 ] 7880 1.809% 99.347% ( 10, 15 ] 1208 0.277% 99.625% ( 15, 22 ] 201 0.046% 99.671% ( 22, 34 ] 31 0.007% 99.678% ( 34, 51 ] 10 0.002% 99.680% ( 51, 76 ] 4 0.001% 99.681% ( 76, 110 ] 167 0.038% 99.719% ( 110, 170 ] 364 0.084% 99.803% ( 170, 250 ] 252 0.058% 99.861% ( 250, 380 ] 257 0.059% 99.920% ( 380, 580 ] 218 0.050% 99.970% ( 580, 870 ] 192 0.044% 100.014% ( 870, 1300 ] 145 0.033% 100.047% ( 1300, 1900 ] 61 0.014% 100.061% ( 1900, 2900 ] 85 0.020% 100.081% ( 2900, 4400 ] 81 0.019% 100.099% ( 4400, 6600 ] 20 0.005% 100.104% ( 6600, 9900 ] 2 0.000% 100.104% ** Level 4 read latency histogram (micros): Count: 7138 Average: 133.1157 StdDev: 543.63 Min: 0 Median: 2.1860 Max: 7807 Percentiles: P50: 2.19 P75: 3.54 P99: 3182.54 P99.9: 5676.26 P99.99: 6507.63 ------------------------------------------------------ [ 0, 1 ] 133 1.863% 1.863% ( 1, 2 ] 3135 43.920% 45.783% ######### ( 2, 3 ] 1618 22.667% 68.451% ##### ( 3, 4 ] 860 12.048% 80.499% ## ( 4, 6 ] 469 6.570% 87.069% # ( 6, 10 ] 192 2.690% 89.759% # ( 10, 15 ] 40 0.560% 90.319% ( 15, 22 ] 10 0.140% 90.460% ( 76, 110 ] 1 0.014% 90.474% ( 110, 170 ] 7 0.098% 90.572% ( 170, 250 ] 24 0.336% 90.908% ( 250, 380 ] 49 0.686% 91.594% ( 380, 580 ] 89 1.247% 92.841% ( 580, 870 ] 136 1.905% 94.746% ( 870, 1300 ] 148 2.073% 96.820% ( 1300, 1900 ] 79 1.107% 97.927% ( 1900, 2900 ] 64 0.897% 98.823% ( 2900, 4400 ] 67 0.939% 99.762% ( 4400, 6600 ] 17 0.238% 100.000% ( 6600, 9900 ] 2 0.028% 100.028% ** Level 5 read latency histogram (micros): Count: 80 Average: 1147.5875 StdDev: 1361.84 Min: 88 Median: 555.0000 Max: 7082 Percentiles: P50: 555.00 P75: 1600.00 P99: 7082.00 P99.9: 7082.00 P99.99: 7082.00 ------------------------------------------------------ ( 76, 110 ] 10 12.500% 12.500% ### ( 110, 170 ] 8 10.000% 22.500% ## ( 170, 250 ] 6 7.500% 30.000% ## ( 250, 380 ] 9 11.250% 41.250% ## ( 380, 580 ] 8 10.000% 51.250% ## ( 580, 870 ] 9 11.250% 62.500% ## ( 870, 1300 ] 7 8.750% 71.250% ## ( 1300, 1900 ] 6 7.500% 78.750% ## ( 1900, 2900 ] 6 7.500% 86.250% ## ( 2900, 4400 ] 9 11.250% 97.500% ## ( 4400, 6600 ] 1 1.250% 98.750% ( 6600, 9900 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 34.7 total, 4.7 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 198.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.315 H:M:S, 44.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 209.21 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.901 H:M:S, 40.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/17-18:32:56 ... thread 0: (1000000,8000000) ops and (248836.4,207629.4) ops/second in (4.018705,38.530198) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/6 3.50 GB 207.7 7.1 0.0 7.1 14.7 7.6 0.0 1.9 140.4 289.1 52.04 47.01 133 0.391 7419K 9391 0.0 0.0 L1 10/10 1.12 GB 0.0 3.9 3.9 0.0 3.8 3.8 0.2 1.0 226.4 222.8 17.52 16.60 2 8.762 4029K 63K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 2.7 1.8 242.3 242.2 1.44 1.38 2 0.720 354K 170 0.0 0.0 L3 21/0 956.09 MB 1.0 4.1 2.7 1.4 4.1 2.7 0.2 1.5 198.7 198.3 21.14 18.03 10 2.114 4267K 9724 0.0 0.0 L4 186/0 9.66 GB 1.0 2.0 1.9 0.1 2.0 1.9 0.8 1.0 124.2 124.0 16.61 9.80 31 0.536 2047K 1585 0.0 0.0 L5 1076/0 88.40 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1308/16 103.62 GB 0.0 17.5 8.7 8.8 25.0 16.2 6.6 3.3 164.5 234.9 108.75 92.83 178 0.611 18M 84K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.5 8.7 8.8 25.0 16.2 6.6 3.3 164.5 234.9 108.75 92.83 178 0.611 18M 84K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.5 8.7 8.8 17.4 8.6 0.0 0.0 210.1 209.1 85.15 73.15 69 1.234 18M 84K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 328.3 23.60 19.68 109 0.217 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.8 total, 38.5 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.95 GB write, 659.06 MB/s write, 17.47 GB read, 461.42 MB/s read, 108.7 seconds Interval compaction: 24.95 GB write, 663.07 MB/s write, 17.47 GB read, 464.22 MB/s read, 108.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 44, interval: 62 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3219294 Average: 2.5678 StdDev: 21.76 Min: 0 Median: 1.4820 Max: 6307 Percentiles: P50: 1.48 P75: 1.88 P99: 5.99 P99.9: 105.04 P99.99: 325.31 ------------------------------------------------------ [ 0, 1 ] 629240 19.546% 19.546% #### ( 1, 2 ] 2034185 63.187% 82.733% ############# ( 2, 3 ] 313315 9.732% 92.466% ## ( 3, 4 ] 124074 3.854% 96.320% # ( 4, 6 ] 86616 2.691% 99.010% # ( 6, 10 ] 21906 0.680% 99.691% ( 10, 15 ] 3724 0.116% 99.806% ( 15, 22 ] 720 0.022% 99.829% ( 22, 34 ] 50 0.002% 99.830% ( 34, 51 ] 15 0.000% 99.831% ( 51, 76 ] 45 0.001% 99.832% ( 76, 110 ] 2558 0.079% 99.912% ( 110, 170 ] 1854 0.058% 99.969% ( 170, 250 ] 465 0.014% 99.984% ( 250, 380 ] 354 0.011% 99.995% ( 380, 580 ] 336 0.010% 100.005% ( 580, 870 ] 184 0.006% 100.011% ( 870, 1300 ] 94 0.003% 100.014% ( 1300, 1900 ] 50 0.002% 100.015% ( 1900, 2900 ] 37 0.001% 100.016% ( 2900, 4400 ] 42 0.001% 100.018% ( 4400, 6600 ] 9 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 818275 Average: 4.7724 StdDev: 68.30 Min: 1 Median: 1.8129 Max: 10512 Percentiles: P50: 1.81 P75: 2.66 P99: 9.00 P99.9: 208.68 P99.99: 622.82 ------------------------------------------------------ [ 0, 1 ] 21017 2.568% 2.568% # ( 1, 2 ] 477450 58.348% 60.917% ############ ( 2, 3 ] 175582 21.458% 82.374% #### ( 3, 4 ] 66310 8.104% 90.478% ## ( 4, 6 ] 57040 6.971% 97.449% # ( 6, 10 ] 16921 2.068% 99.517% ( 10, 15 ] 2069 0.253% 99.770% ( 15, 22 ] 280 0.034% 99.804% ( 22, 34 ] 22 0.003% 99.806% ( 34, 51 ] 9 0.001% 99.808% ( 51, 76 ] 7 0.001% 99.808% ( 76, 110 ] 255 0.031% 99.840% ( 110, 170 ] 369 0.045% 99.885% ( 170, 250 ] 260 0.032% 99.916% ( 250, 380 ] 281 0.034% 99.951% ( 380, 580 ] 285 0.035% 99.986% ( 580, 870 ] 245 0.030% 100.016% ( 870, 1300 ] 164 0.020% 100.036% ( 1300, 1900 ] 77 0.009% 100.045% ( 1900, 2900 ] 105 0.013% 100.058% ( 2900, 4400 ] 124 0.015% 100.073% ( 4400, 6600 ] 25 0.003% 100.076% ( 6600, 9900 ] 5 0.001% 100.077% ( 9900, 14000 ] 1 0.000% 100.077% ** Level 2 read latency histogram (micros): Count: 100869 Average: 2.1862 StdDev: 16.51 Min: 1 Median: 1.4101 Max: 4616 Percentiles: P50: 1.41 P75: 1.82 P99: 5.71 P99.9: 15.08 P99.99: 378.97 ------------------------------------------------------ [ 0, 1 ] 25206 24.989% 24.989% ##### ( 1, 2 ] 61512 60.982% 85.971% ############ ( 2, 3 ] 8494 8.421% 94.392% ## ( 3, 4 ] 2867 2.842% 97.234% # ( 4, 6 ] 2086 2.068% 99.302% ( 6, 10 ] 515 0.511% 99.813% ( 10, 15 ] 88 0.087% 99.900% ( 15, 22 ] 11 0.011% 99.911% ( 22, 34 ] 7 0.007% 99.918% ( 34, 51 ] 30 0.030% 99.947% ( 51, 76 ] 20 0.020% 99.967% ( 76, 110 ] 1 0.001% 99.968% ( 110, 170 ] 3 0.003% 99.971% ( 170, 250 ] 8 0.008% 99.979% ( 250, 380 ] 11 0.011% 99.990% ( 380, 580 ] 5 0.005% 99.995% ( 580, 870 ] 3 0.003% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 806845 Average: 5.6603 StdDev: 77.22 Min: 0 Median: 1.8492 Max: 7710 Percentiles: P50: 1.85 P75: 2.78 P99: 9.08 P99.9: 220.16 P99.99: 476.47 ------------------------------------------------------ [ 0, 1 ] 36157 4.481% 4.481% # ( 1, 2 ] 432471 53.600% 58.082% ########### ( 2, 3 ] 176136 21.830% 79.912% #### ( 3, 4 ] 74533 9.238% 89.149% ## ( 4, 6 ] 67649 8.384% 97.534% ## ( 6, 10 ] 15343 1.902% 99.435% ( 10, 15 ] 2457 0.305% 99.740% ( 15, 22 ] 343 0.043% 99.782% ( 22, 34 ] 43 0.005% 99.788% ( 34, 51 ] 11 0.001% 99.789% ( 51, 76 ] 9 0.001% 99.790% ( 76, 110 ] 192 0.024% 99.814% ( 110, 170 ] 454 0.056% 99.870% ( 170, 250 ] 383 0.047% 99.918% ( 250, 380 ] 387 0.048% 99.966% ( 380, 580 ] 407 0.050% 100.016% ( 580, 870 ] 386 0.048% 100.064% ( 870, 1300 ] 264 0.033% 100.097% ( 1300, 1900 ] 131 0.016% 100.113% ( 1900, 2900 ] 170 0.021% 100.134% ( 2900, 4400 ] 143 0.018% 100.152% ( 4400, 6600 ] 35 0.004% 100.156% ( 6600, 9900 ] 3 0.000% 100.156% ** Level 4 read latency histogram (micros): Count: 22771 Average: 95.5140 StdDev: 433.29 Min: 0 Median: 2.0756 Max: 7807 Percentiles: P50: 2.08 P75: 3.38 P99: 2444.93 P99.9: 4872.54 P99.99: 6427.25 ------------------------------------------------------ [ 0, 1 ] 477 2.095% 2.095% ( 1, 2 ] 10524 46.217% 48.311% ######### ( 2, 3 ] 5088 22.344% 70.656% #### ( 3, 4 ] 2601 11.422% 82.078% ## ( 4, 6 ] 1456 6.394% 88.472% # ( 6, 10 ] 511 2.244% 90.716% ( 10, 15 ] 83 0.364% 91.081% ( 15, 22 ] 19 0.083% 91.164% ( 76, 110 ] 30 0.132% 91.296% ( 110, 170 ] 102 0.448% 91.744% ( 170, 250 ] 167 0.733% 92.477% ( 250, 380 ] 209 0.918% 93.395% ( 380, 580 ] 352 1.546% 94.941% ( 580, 870 ] 366 1.607% 96.548% ( 870, 1300 ] 310 1.361% 97.910% ( 1300, 1900 ] 172 0.755% 98.665% ( 1900, 2900 ] 140 0.615% 99.280% ( 2900, 4400 ] 135 0.593% 99.873% ( 4400, 6600 ] 29 0.127% 100.000% ( 6600, 9900 ] 3 0.013% 100.013% ** Level 5 read latency histogram (micros): Count: 160 Average: 1336.4062 StdDev: 1402.77 Min: 88 Median: 708.8889 Max: 7082 Percentiles: P50: 708.89 P75: 2177.78 P99: 6380.00 P99.9: 7082.00 P99.99: 7082.00 ------------------------------------------------------ ( 76, 110 ] 10 6.250% 6.250% # ( 110, 170 ] 11 6.875% 13.125% # ( 170, 250 ] 12 7.500% 20.625% ## ( 250, 380 ] 20 12.500% 33.125% ### ( 380, 580 ] 19 11.875% 45.000% ## ( 580, 870 ] 18 11.250% 56.250% ## ( 870, 1300 ] 15 9.375% 65.625% ## ( 1300, 1900 ] 10 6.250% 71.875% # ( 1900, 2900 ] 18 11.250% 83.125% ## ( 2900, 4400 ] 20 12.500% 95.625% ### ( 4400, 6600 ] 6 3.750% 99.375% # ( 6600, 9900 ] 1 0.625% 100.000% ** DB Stats ** Uptime(secs): 38.8 total, 4.0 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 203.10 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.392 H:M:S, 42.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 244.90 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.077 H:M:S, 26.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-18:33:01 ... thread 0: (1000000,9000000) ops and (223226.7,209253.9) ops/second in (4.479750,43.009948) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/12 3.01 GB 0.0 8.2 0.0 8.2 16.8 8.5 0.0 2.0 142.5 290.1 59.24 53.82 152 0.390 8570K 10K 0.0 0.0 L1 32/32 2.57 GB 0.0 6.5 5.3 1.1 6.4 5.3 0.2 1.2 213.6 210.7 31.02 28.43 3 10.339 5691K 63K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 2.7 1.8 242.3 242.2 1.44 1.38 2 0.720 354K 170 0.0 0.0 L3 21/0 956.09 MB 1.0 4.1 2.7 1.4 4.1 2.7 0.2 1.5 198.7 198.3 21.14 18.03 10 2.114 4267K 9724 0.0 0.0 L4 186/0 9.66 GB 1.0 2.0 1.9 0.1 2.0 1.9 0.8 1.0 124.2 124.0 16.61 9.80 31 0.536 2047K 1585 0.0 0.0 L5 1076/0 88.40 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1327/44 104.58 GB 0.0 21.2 10.2 11.0 29.6 18.6 6.6 3.5 167.5 234.2 129.44 111.46 198 0.654 20M 85K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.2 10.2 11.0 29.6 18.6 6.6 3.5 167.5 234.2 129.44 111.46 198 0.654 20M 85K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.2 10.2 11.0 21.1 10.1 0.0 0.0 210.6 209.5 102.94 89.19 74 1.391 20M 85K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 330.4 26.50 22.27 124 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.2 total, 43.0 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.61 GB write, 701.16 MB/s write, 21.17 GB read, 501.29 MB/s read, 129.4 seconds Interval compaction: 29.61 GB write, 704.98 MB/s write, 21.17 GB read, 504.02 MB/s read, 129.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 46, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 25, total-stops: 46, interval: 71 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3579366 Average: 2.5533 StdDev: 21.23 Min: 0 Median: 1.4837 Max: 6307 Percentiles: P50: 1.48 P75: 1.88 P99: 5.97 P99.9: 103.37 P99.99: 321.77 ------------------------------------------------------ [ 0, 1 ] 687644 19.211% 19.211% #### ( 1, 2 ] 2278485 63.656% 82.867% ############# ( 2, 3 ] 349534 9.765% 92.633% ## ( 3, 4 ] 136373 3.810% 96.443% # ( 4, 6 ] 92971 2.597% 99.040% # ( 6, 10 ] 23786 0.665% 99.705% ( 10, 15 ] 3997 0.112% 99.816% ( 15, 22 ] 754 0.021% 99.837% ( 22, 34 ] 54 0.002% 99.839% ( 34, 51 ] 22 0.001% 99.839% ( 51, 76 ] 48 0.001% 99.841% ( 76, 110 ] 2632 0.074% 99.914% ( 110, 170 ] 1950 0.054% 99.969% ( 170, 250 ] 540 0.015% 99.984% ( 250, 380 ] 395 0.011% 99.995% ( 380, 580 ] 371 0.010% 100.005% ( 580, 870 ] 208 0.006% 100.011% ( 870, 1300 ] 103 0.003% 100.014% ( 1300, 1900 ] 57 0.002% 100.016% ( 1900, 2900 ] 42 0.001% 100.017% ( 2900, 4400 ] 43 0.001% 100.018% ( 4400, 6600 ] 9 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 990507 Average: 4.4660 StdDev: 62.84 Min: 1 Median: 1.7585 Max: 10512 Percentiles: P50: 1.76 P75: 2.53 P99: 8.91 P99.9: 207.91 P99.99: 659.64 ------------------------------------------------------ [ 0, 1 ] 42929 4.334% 4.334% # ( 1, 2 ] 596319 60.203% 64.537% ############ ( 2, 3 ] 194788 19.665% 84.203% #### ( 3, 4 ] 71696 7.238% 91.441% # ( 4, 6 ] 60703 6.128% 97.570% # ( 6, 10 ] 19453 1.964% 99.534% ( 10, 15 ] 2174 0.219% 99.753% ( 15, 22 ] 290 0.029% 99.782% ( 22, 34 ] 23 0.002% 99.785% ( 34, 51 ] 9 0.001% 99.786% ( 51, 76 ] 17 0.002% 99.787% ( 76, 110 ] 395 0.040% 99.827% ( 110, 170 ] 575 0.058% 99.885% ( 170, 250 ] 307 0.031% 99.916% ( 250, 380 ] 344 0.035% 99.951% ( 380, 580 ] 314 0.032% 99.983% ( 580, 870 ] 262 0.026% 100.009% ( 870, 1300 ] 193 0.019% 100.029% ( 1300, 1900 ] 81 0.008% 100.037% ( 1900, 2900 ] 106 0.011% 100.048% ( 2900, 4400 ] 126 0.013% 100.060% ( 4400, 6600 ] 25 0.003% 100.063% ( 6600, 9900 ] 5 0.001% 100.063% ( 9900, 14000 ] 1 0.000% 100.063% ** Level 2 read latency histogram (micros): Count: 100869 Average: 2.1862 StdDev: 16.51 Min: 1 Median: 1.4101 Max: 4616 Percentiles: P50: 1.41 P75: 1.82 P99: 5.71 P99.9: 15.08 P99.99: 378.97 ------------------------------------------------------ [ 0, 1 ] 25206 24.989% 24.989% ##### ( 1, 2 ] 61512 60.982% 85.971% ############ ( 2, 3 ] 8494 8.421% 94.392% ## ( 3, 4 ] 2867 2.842% 97.234% # ( 4, 6 ] 2086 2.068% 99.302% ( 6, 10 ] 515 0.511% 99.813% ( 10, 15 ] 88 0.087% 99.900% ( 15, 22 ] 11 0.011% 99.911% ( 22, 34 ] 7 0.007% 99.918% ( 34, 51 ] 30 0.030% 99.947% ( 51, 76 ] 20 0.020% 99.967% ( 76, 110 ] 1 0.001% 99.968% ( 110, 170 ] 3 0.003% 99.971% ( 170, 250 ] 8 0.008% 99.979% ( 250, 380 ] 11 0.011% 99.990% ( 380, 580 ] 5 0.005% 99.995% ( 580, 870 ] 3 0.003% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 806845 Average: 5.6603 StdDev: 77.22 Min: 0 Median: 1.8492 Max: 7710 Percentiles: P50: 1.85 P75: 2.78 P99: 9.08 P99.9: 220.16 P99.99: 476.47 ------------------------------------------------------ [ 0, 1 ] 36157 4.481% 4.481% # ( 1, 2 ] 432471 53.600% 58.082% ########### ( 2, 3 ] 176136 21.830% 79.912% #### ( 3, 4 ] 74533 9.238% 89.149% ## ( 4, 6 ] 67649 8.384% 97.534% ## ( 6, 10 ] 15343 1.902% 99.435% ( 10, 15 ] 2457 0.305% 99.740% ( 15, 22 ] 343 0.043% 99.782% ( 22, 34 ] 43 0.005% 99.788% ( 34, 51 ] 11 0.001% 99.789% ( 51, 76 ] 9 0.001% 99.790% ( 76, 110 ] 192 0.024% 99.814% ( 110, 170 ] 454 0.056% 99.870% ( 170, 250 ] 383 0.047% 99.918% ( 250, 380 ] 387 0.048% 99.966% ( 380, 580 ] 407 0.050% 100.016% ( 580, 870 ] 386 0.048% 100.064% ( 870, 1300 ] 264 0.033% 100.097% ( 1300, 1900 ] 131 0.016% 100.113% ( 1900, 2900 ] 170 0.021% 100.134% ( 2900, 4400 ] 143 0.018% 100.152% ( 4400, 6600 ] 35 0.004% 100.156% ( 6600, 9900 ] 3 0.000% 100.156% ** Level 4 read latency histogram (micros): Count: 22771 Average: 95.5140 StdDev: 433.29 Min: 0 Median: 2.0756 Max: 7807 Percentiles: P50: 2.08 P75: 3.38 P99: 2444.93 P99.9: 4872.54 P99.99: 6427.25 ------------------------------------------------------ [ 0, 1 ] 477 2.095% 2.095% ( 1, 2 ] 10524 46.217% 48.311% ######### ( 2, 3 ] 5088 22.344% 70.656% #### ( 3, 4 ] 2601 11.422% 82.078% ## ( 4, 6 ] 1456 6.394% 88.472% # ( 6, 10 ] 511 2.244% 90.716% ( 10, 15 ] 83 0.364% 91.081% ( 15, 22 ] 19 0.083% 91.164% ( 76, 110 ] 30 0.132% 91.296% ( 110, 170 ] 102 0.448% 91.744% ( 170, 250 ] 167 0.733% 92.477% ( 250, 380 ] 209 0.918% 93.395% ( 380, 580 ] 352 1.546% 94.941% ( 580, 870 ] 366 1.607% 96.548% ( 870, 1300 ] 310 1.361% 97.910% ( 1300, 1900 ] 172 0.755% 98.665% ( 1900, 2900 ] 140 0.615% 99.280% ( 2900, 4400 ] 135 0.593% 99.873% ( 4400, 6600 ] 29 0.127% 100.000% ( 6600, 9900 ] 3 0.013% 100.013% ** Level 5 read latency histogram (micros): Count: 160 Average: 1336.4062 StdDev: 1402.77 Min: 88 Median: 708.8889 Max: 7082 Percentiles: P50: 708.89 P75: 2177.78 P99: 6380.00 P99.9: 7082.00 P99.99: 7082.00 ------------------------------------------------------ ( 76, 110 ] 10 6.250% 6.250% # ( 110, 170 ] 11 6.875% 13.125% # ( 170, 250 ] 12 7.500% 20.625% ## ( 250, 380 ] 20 12.500% 33.125% ### ( 380, 580 ] 19 11.875% 45.000% ## ( 580, 870 ] 18 11.250% 56.250% ## ( 870, 1300 ] 15 9.375% 65.625% ## ( 1300, 1900 ] 10 6.250% 71.875% # ( 1900, 2900 ] 18 11.250% 83.125% ## ( 2900, 4400 ] 20 12.500% 95.625% ### ( 4400, 6600 ] 6 3.750% 99.375% # ( 6600, 9900 ] 1 0.625% 100.000% ** DB Stats ** Uptime(secs): 43.2 total, 4.5 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 204.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.125 H:M:S, 41.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 219.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.733 H:M:S, 38.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.444 micros/op 155173 ops/sec 60.281 seconds 9353999 operations; 150.4 MB/s Microseconds per write: Count: 9353999 Average: 6.4440 StdDev: 361.60 Min: 1 Median: 1.7470 Max: 744862 Percentiles: P50: 1.75 P75: 2.80 P99: 10.33 P99.9: 1208.16 P99.99: 2742.80 ------------------------------------------------------ [ 0, 1 ] 1209032 12.925% 12.925% ### ( 1, 2 ] 4642221 49.628% 62.553% ########## ( 2, 3 ] 1453767 15.542% 78.095% ### ( 3, 4 ] 1288870 13.779% 91.874% ### ( 4, 6 ] 521901 5.579% 97.453% # ( 6, 10 ] 141270 1.510% 98.964% ( 10, 15 ] 51003 0.545% 99.509% ( 15, 22 ] 11429 0.122% 99.631% ( 22, 34 ] 1962 0.021% 99.652% ( 34, 51 ] 271 0.003% 99.655% ( 51, 76 ] 22 0.000% 99.655% ( 76, 110 ] 6321 0.068% 99.723% ( 110, 170 ] 2673 0.029% 99.751% ( 170, 250 ] 258 0.003% 99.754% ( 250, 380 ] 218 0.002% 99.756% ( 380, 580 ] 41 0.000% 99.757% ( 580, 870 ] 24 0.000% 99.757% ( 870, 1300 ] 16991 0.182% 99.939% ( 1300, 1900 ] 32 0.000% 99.939% ( 1900, 2900 ] 5645 0.060% 99.999% ( 2900, 4400 ] 23 0.000% 100.000% ( 4400, 6600 ] 1 0.000% 100.000% ( 6600, 9900 ] 3 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 13 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 194544 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9353999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9653326968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 478 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33903717 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 27067370573 rocksdb.compact.write.bytes COUNT : 26885538972 rocksdb.flush.write.bytes COUNT : 9644541770 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 42 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 265 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9566723072 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3668992 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 27150198438 rocksdb.non.last.level.read.count COUNT : 6561823 rocksdb.block.checksum.compute.count COUNT : 6560909 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.405245 P95 : 3.989098 P99 : 8.962625 P100 : 744856.000000 COUNT : 9353999 SUM : 55828357 rocksdb.compaction.times.micros P50 : 936500.000000 P95 : 3810000.000000 P99 : 16000000.000000 P100 : 16221131.000000 COUNT : 75 SUM : 103897439 rocksdb.compaction.times.cpu_micros P50 : 904074.074074 P95 : 3483333.333333 P99 : 15333187.000000 P100 : 15333187.000000 COUNT : 75 SUM : 90132184 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 707.364865 P95 : 2350.000000 P99 : 67250.000000 P100 : 95900.000000 COUNT : 131 SUM : 313671 rocksdb.compaction.outfile.sync.micros P50 : 1020.291262 P95 : 33485.714286 P99 : 94133.333333 P100 : 351680.000000 COUNT : 336 SUM : 2088941 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 98.368421 P95 : 1282.083333 P99 : 3275.000000 P100 : 4258.000000 COUNT : 225 SUM : 61398 rocksdb.table.open.io.micros P50 : 1255.324675 P95 : 7351.666667 P99 : 12278.000000 P100 : 17243.000000 COUNT : 478 SUM : 953630 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.581343 P95 : 7.166872 P99 : 10.053887 P100 : 11193.000000 COUNT : 6559515 SUM : 36979370 rocksdb.read.block.get.micros P50 : 382.197802 P95 : 3476.000000 P99 : 5491.200000 P100 : 7237.000000 COUNT : 956 SUM : 771779 rocksdb.write.raw.block.micros P50 : 0.513635 P95 : 0.975907 P99 : 2.935019 P100 : 14212.000000 COUNT : 8847555 SUM : 17299249 rocksdb.numfiles.in.singlecompaction P50 : 3.102273 P95 : 7.533333 P99 : 34.510000 P100 : 44.000000 COUNT : 97 SUM : 385 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.570276 P95 : 1209.131169 P99 : 2575.357016 P100 : 744672.000000 COUNT : 185074 SUM : 33925982 rocksdb.sst.read.micros P50 : 1.529351 P95 : 4.063529 P99 : 7.862921 P100 : 10512.000000 COUNT : 6561950 SUM : 23490064 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9353999 SUM : 9653326968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211684.210526 P95 : 366566.666667 P99 : 555275.000000 P100 : 887014.000000 COUNT : 131 SUM : 27800386 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 291 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0