[2024-11-20 00:24:59.909528] Starting SPDK v25.01-pre git sha1 f22e807f1 / DPDK 23.11.0 initialization... [2024-11-20 00:24:59.909671] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2955481 ] Set seed to 1732058699906038 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 00:25:00.022711] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 00:25:00.047226] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 00:25:00.047274] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2955481' to capture a snapshot of events at runtime. [2024-11-20 00:25:00.047284] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 00:25:00.047295] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 00:25:00.047304] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2955481 for offline analysis/debug. [2024-11-20 00:25:00.047846] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 00:25:04 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/20-00:25:07 ... thread 0: (1000000,1000000) ops and (335668.6,335668.6) ops/second in (2.979129,2.979129) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 566.97 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 351.7 2.51 2.27 12 0.209 0 0 0.0 0.0 L1 3/3 251.75 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 256.4 256.1 0.98 0.95 1 0.983 255K 206 0.0 0.0 L2 1/0 48.95 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 233.3 233.2 0.48 0.45 1 0.477 113K 30 0.0 0.0 L3 18/0 881.31 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.0 1.0 201.3 201.3 0.31 0.25 1 0.310 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1190/8 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.2 1.5 99.5 305.6 4.28 3.92 15 0.285 432K 236 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 99.5 305.6 4.28 3.92 15 0.285 432K 236 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 240.5 240.3 1.77 1.65 3 0.590 432K 236 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 351.7 2.51 2.27 12 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 413.97 MB/s write, 0.42 GB read, 134.80 MB/s read, 4.3 seconds Interval compaction: 1.28 GB write, 438.67 MB/s write, 0.42 GB read, 142.85 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 104310 Average: 1.8073 StdDev: 18.49 Min: 1 Median: 1.1339 Max: 3313 Percentiles: P50: 1.13 P75: 1.60 P99: 3.39 P99.9: 9.61 P99.99: 283.99 ------------------------------------------------------ [ 0, 1 ] 44599 42.756% 42.756% ######### ( 1, 2 ] 56447 54.115% 96.871% ########### ( 2, 3 ] 1922 1.843% 98.713% ( 3, 4 ] 778 0.746% 99.459% ( 4, 6 ] 320 0.307% 99.766% ( 6, 10 ] 156 0.150% 99.916% ( 10, 15 ] 47 0.045% 99.961% ( 15, 22 ] 12 0.012% 99.972% ( 22, 34 ] 2 0.002% 99.974% ( 34, 51 ] 1 0.001% 99.975% ( 51, 76 ] 2 0.002% 99.977% ( 76, 110 ] 1 0.001% 99.978% ( 110, 170 ] 8 0.008% 99.986% ( 170, 250 ] 4 0.004% 99.989% ( 250, 380 ] 6 0.006% 99.995% ( 580, 870 ] 2 0.002% 99.997% ( 1900, 2900 ] 4 0.004% 100.001% ( 2900, 4400 ] 1 0.001% 100.002% ** Level 1 read latency histogram (micros): Count: 31625 Average: 2.5018 StdDev: 26.95 Min: 0 Median: 1.1887 Max: 2074 Percentiles: P50: 1.19 P75: 1.64 P99: 5.50 P99.9: 219.50 P99.99: 1467.50 ------------------------------------------------------ [ 0, 1 ] 12519 39.586% 39.586% ######## ( 1, 2 ] 17453 55.187% 94.773% ########### ( 2, 3 ] 917 2.900% 97.673% # ( 3, 4 ] 287 0.908% 98.580% ( 4, 6 ] 177 0.560% 99.140% ( 6, 10 ] 144 0.455% 99.595% ( 10, 15 ] 35 0.111% 99.706% ( 15, 22 ] 5 0.016% 99.722% ( 22, 34 ] 1 0.003% 99.725% ( 34, 51 ] 21 0.066% 99.791% ( 51, 76 ] 10 0.032% 99.823% ( 76, 110 ] 8 0.025% 99.848% ( 110, 170 ] 4 0.013% 99.861% ( 170, 250 ] 20 0.063% 99.924% ( 250, 380 ] 10 0.032% 99.956% ( 380, 580 ] 4 0.013% 99.968% ( 580, 870 ] 4 0.013% 99.981% ( 870, 1300 ] 2 0.006% 99.987% ( 1300, 1900 ] 3 0.009% 99.997% ( 1900, 2900 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 15849 Average: 1.7153 StdDev: 4.59 Min: 1 Median: 1.1543 Max: 430 Percentiles: P50: 1.15 P75: 1.61 P99: 3.45 P99.9: 9.75 P99.99: 303.96 ------------------------------------------------------ [ 0, 1 ] 6576 41.492% 41.492% ######## ( 1, 2 ] 8740 55.145% 96.637% ########### ( 2, 3 ] 313 1.975% 98.612% ( 3, 4 ] 136 0.858% 99.470% ( 4, 6 ] 40 0.252% 99.722% ( 6, 10 ] 30 0.189% 99.912% ( 10, 15 ] 6 0.038% 99.950% ( 15, 22 ] 4 0.025% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 250, 380 ] 1 0.006% 99.994% ( 380, 580 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 895.2000 StdDev: 1108.19 Min: 0 Median: 420.0000 Max: 4483 Percentiles: P50: 420.00 P75: 1600.00 P99: 4483.00 P99.9: 4483.00 P99.99: 4483.00 ------------------------------------------------------ [ 0, 1 ] 35 38.889% 38.889% ######## ( 1, 2 ] 2 2.222% 41.111% ( 2, 3 ] 1 1.111% 42.222% ( 110, 170 ] 2 2.222% 44.444% ( 170, 250 ] 2 2.222% 46.667% ( 250, 380 ] 2 2.222% 48.889% ( 380, 580 ] 5 5.556% 54.444% # ( 580, 870 ] 9 10.000% 64.444% ## ( 870, 1300 ] 7 7.778% 72.222% ## ( 1300, 1900 ] 5 5.556% 77.778% # ( 1900, 2900 ] 15 16.667% 94.444% ### ( 2900, 4400 ] 4 4.444% 98.889% # ( 4400, 6600 ] 1 1.111% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 2038.2400 StdDev: 1599.93 Min: 492 Median: 1246.2500 Max: 6333 Percentiles: P50: 1246.25 P75: 3125.00 P99: 6325.00 P99.9: 6333.00 P99.99: 6333.00 ------------------------------------------------------ ( 380, 580 ] 2 8.000% 8.000% ## ( 580, 870 ] 7 28.000% 36.000% ###### ( 870, 1300 ] 4 16.000% 52.000% ### ( 1300, 1900 ] 2 8.000% 60.000% ## ( 1900, 2900 ] 3 12.000% 72.000% ## ( 2900, 4400 ] 5 20.000% 92.000% #### ( 4400, 6600 ] 2 8.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 311.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.363 H:M:S, 11.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.10 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.363 H:M:S, 12.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-00:25:10 ... thread 0: (1000000,2000000) ops and (343456.1,339517.7) ops/second in (2.911580,5.890709) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 1.17 GB 12.6 0.6 0.0 0.6 2.3 1.8 0.0 1.3 77.4 326.9 7.32 6.76 28 0.261 575K 580 0.0 0.0 L1 6/6 565.46 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 241.5 241.1 3.39 3.29 2 1.695 831K 1428 0.0 0.0 L2 1/0 48.95 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 233.3 233.2 0.48 0.45 1 0.477 113K 30 0.0 0.0 L3 18/0 881.31 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.0 1.0 201.3 201.3 0.31 0.25 1 0.310 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1196/15 97.92 GB 0.0 1.5 0.6 0.9 3.3 2.4 0.2 1.9 135.6 294.3 11.50 10.75 32 0.359 1583K 2038 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.6 0.9 3.3 2.4 0.1 1.9 135.6 294.3 11.50 10.75 32 0.359 1583K 2038 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.6 0.9 1.5 0.6 0.0 0.0 248.5 248.2 6.28 6.04 6 1.046 1583K 2038 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 349.7 5.22 4.70 26 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.30 GB write, 557.56 MB/s write, 1.52 GB read, 256.93 MB/s read, 11.5 seconds Interval compaction: 3.30 GB write, 574.38 MB/s write, 1.52 GB read, 264.68 MB/s read, 11.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 370167 Average: 2.0450 StdDev: 12.70 Min: 0 Median: 1.3948 Max: 3313 Percentiles: P50: 1.39 P75: 1.79 P99: 5.07 P99.9: 9.86 P99.99: 14.49 ------------------------------------------------------ [ 0, 1 ] 93463 25.249% 25.249% ##### ( 1, 2 ] 232059 62.690% 87.939% ############# ( 2, 3 ] 29310 7.918% 95.857% ## ( 3, 4 ] 9217 2.490% 98.347% ( 4, 6 ] 4535 1.225% 99.572% ( 6, 10 ] 1257 0.340% 99.912% ( 10, 15 ] 323 0.087% 99.999% ( 15, 22 ] 31 0.008% 100.008% ( 22, 34 ] 7 0.002% 100.009% ( 34, 51 ] 4 0.001% 100.011% ( 51, 76 ] 3 0.001% 100.011% ( 76, 110 ] 1 0.000% 100.012% ( 110, 170 ] 15 0.004% 100.016% ( 170, 250 ] 11 0.003% 100.019% ( 250, 380 ] 13 0.004% 100.022% ( 380, 580 ] 1 0.000% 100.022% ( 580, 870 ] 5 0.001% 100.024% ( 870, 1300 ] 3 0.001% 100.025% ( 1300, 1900 ] 1 0.000% 100.025% ( 1900, 2900 ] 7 0.002% 100.027% ( 2900, 4400 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 102057 Average: 2.2494 StdDev: 16.63 Min: 0 Median: 1.3990 Max: 2074 Percentiles: P50: 1.40 P75: 1.79 P99: 5.18 P99.9: 21.96 P99.99: 763.39 ------------------------------------------------------ [ 0, 1 ] 25241 24.732% 24.732% ##### ( 1, 2 ] 64628 63.325% 88.058% ############# ( 2, 3 ] 8217 8.051% 96.109% ## ( 3, 4 ] 2253 2.208% 98.317% ( 4, 6 ] 1185 1.161% 99.478% ( 6, 10 ] 346 0.339% 99.817% ( 10, 15 ] 75 0.073% 99.890% ( 15, 22 ] 10 0.010% 99.900% ( 22, 34 ] 3 0.003% 99.903% ( 34, 51 ] 23 0.023% 99.926% ( 51, 76 ] 10 0.010% 99.935% ( 76, 110 ] 8 0.008% 99.943% ( 110, 170 ] 5 0.005% 99.948% ( 170, 250 ] 20 0.020% 99.968% ( 250, 380 ] 13 0.013% 99.980% ( 380, 580 ] 6 0.006% 99.986% ( 580, 870 ] 6 0.006% 99.992% ( 870, 1300 ] 3 0.003% 99.995% ( 1300, 1900 ] 4 0.004% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 15849 Average: 1.7153 StdDev: 4.59 Min: 1 Median: 1.1543 Max: 430 Percentiles: P50: 1.15 P75: 1.61 P99: 3.45 P99.9: 9.75 P99.99: 303.96 ------------------------------------------------------ [ 0, 1 ] 6576 41.492% 41.492% ######## ( 1, 2 ] 8740 55.145% 96.637% ########### ( 2, 3 ] 313 1.975% 98.612% ( 3, 4 ] 136 0.858% 99.470% ( 4, 6 ] 40 0.252% 99.722% ( 6, 10 ] 30 0.189% 99.912% ( 10, 15 ] 6 0.038% 99.950% ( 15, 22 ] 4 0.025% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 250, 380 ] 1 0.006% 99.994% ( 380, 580 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 895.2000 StdDev: 1108.19 Min: 0 Median: 420.0000 Max: 4483 Percentiles: P50: 420.00 P75: 1600.00 P99: 4483.00 P99.9: 4483.00 P99.99: 4483.00 ------------------------------------------------------ [ 0, 1 ] 35 38.889% 38.889% ######## ( 1, 2 ] 2 2.222% 41.111% ( 2, 3 ] 1 1.111% 42.222% ( 110, 170 ] 2 2.222% 44.444% ( 170, 250 ] 2 2.222% 46.667% ( 250, 380 ] 2 2.222% 48.889% ( 380, 580 ] 5 5.556% 54.444% # ( 580, 870 ] 9 10.000% 64.444% ## ( 870, 1300 ] 7 7.778% 72.222% ## ( 1300, 1900 ] 5 5.556% 77.778% # ( 1900, 2900 ] 15 16.667% 94.444% ### ( 2900, 4400 ] 4 4.444% 98.889% # ( 4400, 6600 ] 1 1.111% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 2038.2400 StdDev: 1599.93 Min: 492 Median: 1246.2500 Max: 6333 Percentiles: P50: 1246.25 P75: 3125.00 P99: 6325.00 P99.9: 6333.00 P99.99: 6333.00 ------------------------------------------------------ ( 380, 580 ] 2 8.000% 8.000% ## ( 580, 870 ] 7 28.000% 36.000% ###### ( 870, 1300 ] 4 16.000% 52.000% ### ( 1300, 1900 ] 2 8.000% 60.000% ## ( 1900, 2900 ] 3 12.000% 72.000% ## ( 2900, 4400 ] 5 20.000% 92.000% #### ( 4400, 6600 ] 2 8.000% 100.000% ## ** DB Stats ** Uptime(secs): 6.1 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 324.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.611 H:M:S, 10.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 338.03 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.248 H:M:S, 8.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-00:25:13 ... thread 0: (1000000,3000000) ops and (332220.1,337049.8) ops/second in (3.010053,8.900762) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/9 2.09 GB 107.0 1.4 0.0 1.4 4.1 2.7 0.0 1.5 105.8 317.3 13.10 12.19 44 0.298 1407K 1393 0.0 0.0 L1 6/6 565.46 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 241.5 241.1 3.39 3.29 2 1.695 831K 1428 0.0 0.0 L2 1/0 48.95 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 233.3 233.2 0.48 0.45 1 0.477 113K 30 0.0 0.0 L3 18/0 881.31 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.0 1.0 201.3 201.3 0.31 0.25 1 0.310 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1200/15 98.84 GB 0.0 2.3 0.6 1.7 5.0 3.3 0.2 1.9 137.7 297.9 17.28 16.18 48 0.360 2415K 2851 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 0.6 1.7 5.0 3.3 0.1 1.9 137.7 297.9 17.28 16.18 48 0.360 2415K 2851 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 0.6 1.7 2.3 0.6 0.0 0.0 254.0 253.6 9.37 9.06 9 1.041 2415K 2851 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 350.3 7.91 7.12 39 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.03 GB write, 566.88 MB/s write, 2.32 GB read, 261.95 MB/s read, 17.3 seconds Interval compaction: 5.03 GB write, 578.21 MB/s write, 2.32 GB read, 267.18 MB/s read, 17.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 690536 Average: 2.0966 StdDev: 10.68 Min: 0 Median: 1.4486 Max: 3313 Percentiles: P50: 1.45 P75: 1.83 P99: 5.17 P99.9: 9.67 P99.99: 14.03 ------------------------------------------------------ [ 0, 1 ] 143352 20.760% 20.760% #### ( 1, 2 ] 450097 65.181% 85.940% ############# ( 2, 3 ] 64398 9.326% 95.266% ## ( 3, 4 ] 20118 2.913% 98.180% # ( 4, 6 ] 9663 1.399% 99.579% ( 6, 10 ] 2417 0.350% 99.929% ( 10, 15 ] 525 0.076% 100.005% ( 15, 22 ] 44 0.006% 100.011% ( 22, 34 ] 8 0.001% 100.012% ( 34, 51 ] 7 0.001% 100.013% ( 51, 76 ] 4 0.001% 100.014% ( 76, 110 ] 2 0.000% 100.014% ( 110, 170 ] 19 0.003% 100.017% ( 170, 250 ] 19 0.003% 100.020% ( 250, 380 ] 19 0.003% 100.023% ( 380, 580 ] 4 0.001% 100.023% ( 580, 870 ] 10 0.001% 100.025% ( 870, 1300 ] 7 0.001% 100.026% ( 1300, 1900 ] 1 0.000% 100.026% ( 1900, 2900 ] 9 0.001% 100.027% ( 2900, 4400 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 175323 Average: 2.1937 StdDev: 12.70 Min: 0 Median: 1.4526 Max: 2074 Percentiles: P50: 1.45 P75: 1.83 P99: 5.17 P99.9: 12.62 P99.99: 462.26 ------------------------------------------------------ [ 0, 1 ] 35455 20.223% 20.223% #### ( 1, 2 ] 115357 65.797% 86.020% ############# ( 2, 3 ] 16754 9.556% 95.576% ## ( 3, 4 ] 4624 2.637% 98.213% # ( 4, 6 ] 2352 1.342% 99.555% ( 6, 10 ] 546 0.311% 99.866% ( 10, 15 ] 114 0.065% 99.931% ( 15, 22 ] 16 0.009% 99.940% ( 22, 34 ] 4 0.002% 99.942% ( 34, 51 ] 23 0.013% 99.956% ( 51, 76 ] 12 0.007% 99.962% ( 76, 110 ] 8 0.005% 99.967% ( 110, 170 ] 5 0.003% 99.970% ( 170, 250 ] 20 0.011% 99.981% ( 250, 380 ] 13 0.007% 99.989% ( 380, 580 ] 6 0.003% 99.992% ( 580, 870 ] 6 0.003% 99.995% ( 870, 1300 ] 3 0.002% 99.997% ( 1300, 1900 ] 4 0.002% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 15849 Average: 1.7153 StdDev: 4.59 Min: 1 Median: 1.1543 Max: 430 Percentiles: P50: 1.15 P75: 1.61 P99: 3.45 P99.9: 9.75 P99.99: 303.96 ------------------------------------------------------ [ 0, 1 ] 6576 41.492% 41.492% ######## ( 1, 2 ] 8740 55.145% 96.637% ########### ( 2, 3 ] 313 1.975% 98.612% ( 3, 4 ] 136 0.858% 99.470% ( 4, 6 ] 40 0.252% 99.722% ( 6, 10 ] 30 0.189% 99.912% ( 10, 15 ] 6 0.038% 99.950% ( 15, 22 ] 4 0.025% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 250, 380 ] 1 0.006% 99.994% ( 380, 580 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 895.2000 StdDev: 1108.19 Min: 0 Median: 420.0000 Max: 4483 Percentiles: P50: 420.00 P75: 1600.00 P99: 4483.00 P99.9: 4483.00 P99.99: 4483.00 ------------------------------------------------------ [ 0, 1 ] 35 38.889% 38.889% ######## ( 1, 2 ] 2 2.222% 41.111% ( 2, 3 ] 1 1.111% 42.222% ( 110, 170 ] 2 2.222% 44.444% ( 170, 250 ] 2 2.222% 46.667% ( 250, 380 ] 2 2.222% 48.889% ( 380, 580 ] 5 5.556% 54.444% # ( 580, 870 ] 9 10.000% 64.444% ## ( 870, 1300 ] 7 7.778% 72.222% ## ( 1300, 1900 ] 5 5.556% 77.778% # ( 1900, 2900 ] 15 16.667% 94.444% ### ( 2900, 4400 ] 4 4.444% 98.889% # ( 4400, 6600 ] 1 1.111% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 2038.2400 StdDev: 1599.93 Min: 492 Median: 1246.2500 Max: 6333 Percentiles: P50: 1246.25 P75: 3125.00 P99: 6325.00 P99.9: 6333.00 P99.99: 6333.00 ------------------------------------------------------ ( 380, 580 ] 2 8.000% 8.000% ## ( 580, 870 ] 7 28.000% 36.000% ###### ( 870, 1300 ] 4 16.000% 52.000% ### ( 1300, 1900 ] 2 8.000% 60.000% ## ( 1900, 2900 ] 3 12.000% 72.000% ## ( 2900, 4400 ] 5 20.000% 92.000% #### ( 4400, 6600 ] 2 8.000% 100.000% ## ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 325.17 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.991 H:M:S, 10.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.380 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-00:25:16 ... thread 0: (1000000,4000000) ops and (307797.4,329227.5) ops/second in (3.248890,12.149652) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/14 2.34 GB 12.6 2.2 0.0 2.2 5.9 3.8 0.0 1.6 114.6 314.1 19.24 17.96 61 0.315 2238K 2239 0.0 0.0 L1 12/12 1.34 GB 0.0 2.2 1.3 0.9 2.1 1.3 0.1 1.7 234.6 233.7 9.39 9.08 3 3.129 2236K 8686 0.0 0.0 L2 1/0 48.95 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 233.3 233.2 0.48 0.45 1 0.477 113K 30 0.0 0.0 L3 18/0 881.31 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.0 1.0 201.3 201.3 0.31 0.25 1 0.310 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1206/26 99.88 GB 0.0 4.5 1.4 3.1 8.2 5.2 0.2 2.2 155.7 286.0 29.42 27.73 66 0.446 4651K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.5 1.4 3.1 8.2 5.2 0.1 2.2 155.7 286.0 29.42 27.73 66 0.446 4651K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.5 1.4 3.1 4.5 1.4 0.0 0.0 248.0 247.4 18.47 17.89 13 1.421 4651K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 351.1 10.95 9.84 53 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.2 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.22 GB write, 682.35 MB/s write, 4.47 GB read, 371.59 MB/s read, 29.4 seconds Interval compaction: 8.22 GB write, 692.33 MB/s write, 4.47 GB read, 377.02 MB/s read, 29.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 993223 Average: 2.1599 StdDev: 11.95 Min: 0 Median: 1.4617 Max: 3919 Percentiles: P50: 1.46 P75: 1.84 P99: 5.36 P99.9: 10.30 P99.99: 17.37 ------------------------------------------------------ [ 0, 1 ] 195605 19.694% 19.694% #### ( 1, 2 ] 651967 65.642% 85.336% ############# ( 2, 3 ] 95745 9.640% 94.975% ## ( 3, 4 ] 29652 2.985% 97.961% # ( 4, 6 ] 15194 1.530% 99.491% ( 6, 10 ] 4013 0.404% 99.895% ( 10, 15 ] 924 0.093% 99.988% ( 15, 22 ] 73 0.007% 99.995% ( 22, 34 ] 8 0.001% 99.996% ( 34, 51 ] 8 0.001% 99.997% ( 51, 76 ] 8 0.001% 99.997% ( 76, 110 ] 76 0.008% 100.005% ( 110, 170 ] 56 0.006% 100.011% ( 170, 250 ] 51 0.005% 100.016% ( 250, 380 ] 41 0.004% 100.020% ( 380, 580 ] 21 0.002% 100.022% ( 580, 870 ] 23 0.002% 100.024% ( 870, 1300 ] 13 0.001% 100.026% ( 1300, 1900 ] 3 0.000% 100.026% ( 1900, 2900 ] 9 0.001% 100.027% ( 2900, 4400 ] 4 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 245295 Average: 2.3252 StdDev: 15.06 Min: 0 Median: 1.4662 Max: 2074 Percentiles: P50: 1.47 P75: 1.84 P99: 5.44 P99.9: 15.27 P99.99: 688.04 ------------------------------------------------------ [ 0, 1 ] 47098 19.201% 19.201% #### ( 1, 2 ] 162071 66.072% 85.272% ############# ( 2, 3 ] 24389 9.943% 95.215% ## ( 3, 4 ] 6718 2.739% 97.954% # ( 4, 6 ] 3566 1.454% 99.408% ( 6, 10 ] 1017 0.415% 99.822% ( 10, 15 ] 190 0.077% 99.900% ( 15, 22 ] 18 0.007% 99.907% ( 22, 34 ] 4 0.002% 99.909% ( 34, 51 ] 24 0.010% 99.918% ( 51, 76 ] 12 0.005% 99.923% ( 76, 110 ] 36 0.015% 99.938% ( 110, 170 ] 36 0.015% 99.953% ( 170, 250 ] 42 0.017% 99.970% ( 250, 380 ] 26 0.011% 99.980% ( 380, 580 ] 19 0.008% 99.988% ( 580, 870 ] 12 0.005% 99.993% ( 870, 1300 ] 6 0.002% 99.996% ( 1300, 1900 ] 10 0.004% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 15849 Average: 1.7153 StdDev: 4.59 Min: 1 Median: 1.1543 Max: 430 Percentiles: P50: 1.15 P75: 1.61 P99: 3.45 P99.9: 9.75 P99.99: 303.96 ------------------------------------------------------ [ 0, 1 ] 6576 41.492% 41.492% ######## ( 1, 2 ] 8740 55.145% 96.637% ########### ( 2, 3 ] 313 1.975% 98.612% ( 3, 4 ] 136 0.858% 99.470% ( 4, 6 ] 40 0.252% 99.722% ( 6, 10 ] 30 0.189% 99.912% ( 10, 15 ] 6 0.038% 99.950% ( 15, 22 ] 4 0.025% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 250, 380 ] 1 0.006% 99.994% ( 380, 580 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 895.2000 StdDev: 1108.19 Min: 0 Median: 420.0000 Max: 4483 Percentiles: P50: 420.00 P75: 1600.00 P99: 4483.00 P99.9: 4483.00 P99.99: 4483.00 ------------------------------------------------------ [ 0, 1 ] 35 38.889% 38.889% ######## ( 1, 2 ] 2 2.222% 41.111% ( 2, 3 ] 1 1.111% 42.222% ( 110, 170 ] 2 2.222% 44.444% ( 170, 250 ] 2 2.222% 46.667% ( 250, 380 ] 2 2.222% 48.889% ( 380, 580 ] 5 5.556% 54.444% # ( 580, 870 ] 9 10.000% 64.444% ## ( 870, 1300 ] 7 7.778% 72.222% ## ( 1300, 1900 ] 5 5.556% 77.778% # ( 1900, 2900 ] 15 16.667% 94.444% ### ( 2900, 4400 ] 4 4.444% 98.889% # ( 4400, 6600 ] 1 1.111% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 2038.2400 StdDev: 1599.93 Min: 492 Median: 1246.2500 Max: 6333 Percentiles: P50: 1246.25 P75: 3125.00 P99: 6325.00 P99.9: 6333.00 P99.99: 6333.00 ------------------------------------------------------ ( 380, 580 ] 2 8.000% 8.000% ## ( 580, 870 ] 7 28.000% 36.000% ###### ( 870, 1300 ] 4 16.000% 52.000% ### ( 1300, 1900 ] 2 8.000% 60.000% ## ( 1900, 2900 ] 3 12.000% 72.000% ## ( 2900, 4400 ] 5 20.000% 92.000% #### ( 4400, 6600 ] 2 8.000% 100.000% ## ** DB Stats ** Uptime(secs): 12.3 total, 3.2 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 319.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.581 H:M:S, 12.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 302.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.590 H:M:S, 18.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-00:25:19 ... thread 0: (1000000,5000000) ops and (292614.3,321189.8) ops/second in (3.417468,15.567120) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 3.26 GB 100.7 3.0 0.0 3.0 7.6 4.7 0.0 1.6 120.9 312.1 25.02 23.38 77 0.325 3070K 3081 0.0 0.0 L1 12/12 1.34 GB 0.0 2.2 1.3 0.9 2.1 1.3 0.1 1.7 234.6 233.7 9.39 9.08 3 3.129 2236K 8686 0.0 0.0 L2 1/0 48.95 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 233.3 233.2 0.48 0.45 1 0.477 113K 30 0.0 0.0 L3 18/0 881.31 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.0 1.0 201.3 201.3 0.31 0.25 1 0.310 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1210/26 100.80 GB 0.0 5.3 1.4 3.9 9.9 6.1 0.2 2.1 153.5 289.2 35.19 33.16 82 0.429 5483K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.3 1.4 3.9 9.9 6.1 0.1 2.1 153.5 289.2 35.19 33.16 82 0.429 5483K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.3 1.4 3.9 5.3 1.4 0.0 0.0 250.7 250.1 21.54 20.91 16 1.346 5483K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 350.7 13.65 12.25 66 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.7 total, 15.6 interval Flush(GB): cumulative 4.675, interval 4.675 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.94 GB write, 646.22 MB/s write, 5.27 GB read, 342.95 MB/s read, 35.2 seconds Interval compaction: 9.94 GB write, 653.60 MB/s write, 5.27 GB read, 346.87 MB/s read, 35.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 20, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1338129 Average: 2.1885 StdDev: 12.40 Min: 0 Median: 1.4715 Max: 3919 Percentiles: P50: 1.47 P75: 1.85 P99: 5.37 P99.9: 10.34 P99.99: 80.74 ------------------------------------------------------ [ 0, 1 ] 251621 18.804% 18.804% #### ( 1, 2 ] 885292 66.159% 84.963% ############# ( 2, 3 ] 133444 9.972% 94.935% ## ( 3, 4 ] 40454 3.023% 97.958% # ( 4, 6 ] 20325 1.519% 99.477% ( 6, 10 ] 5580 0.417% 99.894% ( 10, 15 ] 1127 0.084% 99.979% ( 15, 22 ] 106 0.008% 99.987% ( 22, 34 ] 10 0.001% 99.987% ( 34, 51 ] 10 0.001% 99.988% ( 51, 76 ] 11 0.001% 99.989% ( 76, 110 ] 116 0.009% 99.998% ( 110, 170 ] 114 0.009% 100.006% ( 170, 250 ] 85 0.006% 100.012% ( 250, 380 ] 60 0.004% 100.017% ( 380, 580 ] 42 0.003% 100.020% ( 580, 870 ] 38 0.003% 100.023% ( 870, 1300 ] 16 0.001% 100.024% ( 1300, 1900 ] 4 0.000% 100.024% ( 1900, 2900 ] 10 0.001% 100.025% ( 2900, 4400 ] 7 0.001% 100.026% ** Level 1 read latency histogram (micros): Count: 323942 Average: 2.3932 StdDev: 14.07 Min: 0 Median: 1.4858 Max: 2074 Percentiles: P50: 1.49 P75: 1.86 P99: 5.85 P99.9: 92.00 P99.99: 591.71 ------------------------------------------------------ [ 0, 1 ] 57362 17.707% 17.707% #### ( 1, 2 ] 215330 66.472% 84.179% ############# ( 2, 3 ] 34143 10.540% 94.719% ## ( 3, 4 ] 9143 2.822% 97.542% # ( 4, 6 ] 5108 1.577% 99.118% ( 6, 10 ] 2188 0.675% 99.794% ( 10, 15 ] 228 0.070% 99.864% ( 15, 22 ] 20 0.006% 99.870% ( 22, 34 ] 4 0.001% 99.872% ( 34, 51 ] 24 0.007% 99.879% ( 51, 76 ] 13 0.004% 99.883% ( 76, 110 ] 117 0.036% 99.919% ( 110, 170 ] 101 0.031% 99.950% ( 170, 250 ] 61 0.019% 99.969% ( 250, 380 ] 35 0.011% 99.980% ( 380, 580 ] 32 0.010% 99.990% ( 580, 870 ] 15 0.005% 99.994% ( 870, 1300 ] 7 0.002% 99.997% ( 1300, 1900 ] 10 0.003% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 15849 Average: 1.7153 StdDev: 4.59 Min: 1 Median: 1.1543 Max: 430 Percentiles: P50: 1.15 P75: 1.61 P99: 3.45 P99.9: 9.75 P99.99: 303.96 ------------------------------------------------------ [ 0, 1 ] 6576 41.492% 41.492% ######## ( 1, 2 ] 8740 55.145% 96.637% ########### ( 2, 3 ] 313 1.975% 98.612% ( 3, 4 ] 136 0.858% 99.470% ( 4, 6 ] 40 0.252% 99.722% ( 6, 10 ] 30 0.189% 99.912% ( 10, 15 ] 6 0.038% 99.950% ( 15, 22 ] 4 0.025% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 250, 380 ] 1 0.006% 99.994% ( 380, 580 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 895.2000 StdDev: 1108.19 Min: 0 Median: 420.0000 Max: 4483 Percentiles: P50: 420.00 P75: 1600.00 P99: 4483.00 P99.9: 4483.00 P99.99: 4483.00 ------------------------------------------------------ [ 0, 1 ] 35 38.889% 38.889% ######## ( 1, 2 ] 2 2.222% 41.111% ( 2, 3 ] 1 1.111% 42.222% ( 110, 170 ] 2 2.222% 44.444% ( 170, 250 ] 2 2.222% 46.667% ( 250, 380 ] 2 2.222% 48.889% ( 380, 580 ] 5 5.556% 54.444% # ( 580, 870 ] 9 10.000% 64.444% ## ( 870, 1300 ] 7 7.778% 72.222% ## ( 1300, 1900 ] 5 5.556% 77.778% # ( 1900, 2900 ] 15 16.667% 94.444% ### ( 2900, 4400 ] 4 4.444% 98.889% # ( 4400, 6600 ] 1 1.111% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 2038.2400 StdDev: 1599.93 Min: 492 Median: 1246.2500 Max: 6333 Percentiles: P50: 1246.25 P75: 3125.00 P99: 6325.00 P99.9: 6333.00 P99.99: 6333.00 ------------------------------------------------------ ( 380, 580 ] 2 8.000% 8.000% ## ( 580, 870 ] 7 28.000% 36.000% ###### ( 870, 1300 ] 4 16.000% 52.000% ### ( 1300, 1900 ] 2 8.000% 60.000% ## ( 1900, 2900 ] 3 12.000% 72.000% ## ( 2900, 4400 ] 5 20.000% 92.000% #### ( 4400, 6600 ] 2 8.000% 100.000% ## ** DB Stats ** Uptime(secs): 15.7 total, 3.4 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 312.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.378 H:M:S, 15.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 287.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.797 H:M:S, 23.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-00:25:31 ... thread 0: (1000000,6000000) ops and (87786.5,222565.2) ops/second in (11.391276,26.958396) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/5 2.27 GB 6.3 5.6 0.0 5.6 11.2 5.6 0.0 2.0 148.8 298.9 38.52 36.15 99 0.389 5819K 12K 0.0 0.0 L1 15/15 1.76 GB 0.0 5.5 3.3 2.2 5.4 3.2 0.1 1.7 226.3 224.0 24.72 23.51 4 6.180 5679K 55K 0.0 0.0 L2 13/5 1.56 GB 10.3 0.1 0.1 0.0 0.1 0.1 1.6 1.8 233.3 233.2 0.48 0.45 1 0.477 113K 30 0.0 0.0 L3 18/11 881.31 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 201.3 201.3 0.31 0.25 1 0.310 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1212/36 101.73 GB 0.0 11.2 3.4 7.8 16.8 9.0 1.7 3.0 179.6 269.0 64.02 60.35 105 0.610 11M 67K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.2 3.4 7.8 16.8 9.0 1.6 3.0 179.6 269.0 64.02 60.35 105 0.610 11M 67K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.2 3.4 7.8 11.2 3.3 0.0 0.0 242.5 241.1 47.41 45.49 23 2.061 11M 67K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 348.9 16.61 14.86 82 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.1 total, 27.0 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.82 GB write, 634.75 MB/s write, 11.23 GB read, 423.69 MB/s read, 64.0 seconds Interval compaction: 16.82 GB write, 638.93 MB/s write, 11.23 GB read, 426.48 MB/s read, 64.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 20, interval: 38 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2351864 Average: 2.4896 StdDev: 14.72 Min: 0 Median: 1.4810 Max: 4394 Percentiles: P50: 1.48 P75: 1.86 P99: 5.87 P99.9: 113.55 P99.99: 247.75 ------------------------------------------------------ [ 0, 1 ] 428290 18.211% 18.211% #### ( 1, 2 ] 1554436 66.094% 84.304% ############# ( 2, 3 ] 235602 10.018% 94.322% ## ( 3, 4 ] 73191 3.112% 97.434% # ( 4, 6 ] 39420 1.676% 99.110% ( 6, 10 ] 14669 0.624% 99.734% ( 10, 15 ] 1788 0.076% 99.810% ( 15, 22 ] 386 0.016% 99.826% ( 22, 34 ] 21 0.001% 99.827% ( 34, 51 ] 26 0.001% 99.828% ( 51, 76 ] 51 0.002% 99.831% ( 76, 110 ] 1533 0.065% 99.896% ( 110, 170 ] 1693 0.072% 99.968% ( 170, 250 ] 539 0.023% 99.991% ( 250, 380 ] 345 0.015% 100.005% ( 380, 580 ] 318 0.014% 100.019% ( 580, 870 ] 148 0.006% 100.025% ( 870, 1300 ] 42 0.002% 100.027% ( 1300, 1900 ] 13 0.001% 100.028% ( 1900, 2900 ] 14 0.001% 100.028% ( 2900, 4400 ] 9 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 591577 Average: 2.5741 StdDev: 15.61 Min: 0 Median: 1.4921 Max: 2074 Percentiles: P50: 1.49 P75: 1.87 P99: 6.87 P99.9: 140.89 P99.99: 745.58 ------------------------------------------------------ [ 0, 1 ] 103363 17.472% 17.472% ### ( 1, 2 ] 391042 66.102% 83.574% ############# ( 2, 3 ] 62356 10.541% 94.115% ## ( 3, 4 ] 17011 2.876% 96.990% # ( 4, 6 ] 10744 1.816% 98.806% ( 6, 10 ] 5252 0.888% 99.694% ( 10, 15 ] 398 0.067% 99.761% ( 15, 22 ] 86 0.015% 99.776% ( 22, 34 ] 8 0.001% 99.777% ( 34, 51 ] 24 0.004% 99.781% ( 51, 76 ] 35 0.006% 99.787% ( 76, 110 ] 443 0.075% 99.862% ( 110, 170 ] 434 0.073% 99.936% ( 170, 250 ] 128 0.022% 99.957% ( 250, 380 ] 84 0.014% 99.971% ( 380, 580 ] 91 0.015% 99.987% ( 580, 870 ] 33 0.006% 99.992% ( 870, 1300 ] 24 0.004% 99.996% ( 1300, 1900 ] 20 0.003% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 15869 Average: 2.0113 StdDev: 10.22 Min: 1 Median: 1.1554 Max: 525 Percentiles: P50: 1.16 P75: 1.61 P99: 3.60 P99.9: 171.75 P99.99: 421.31 ------------------------------------------------------ [ 0, 1 ] 6576 41.439% 41.439% ######## ( 1, 2 ] 8740 55.076% 96.515% ########### ( 2, 3 ] 313 1.972% 98.488% ( 3, 4 ] 136 0.857% 99.345% ( 4, 6 ] 40 0.252% 99.597% ( 6, 10 ] 30 0.189% 99.786% ( 10, 15 ] 6 0.038% 99.824% ( 15, 22 ] 4 0.025% 99.849% ( 76, 110 ] 1 0.006% 99.855% ( 110, 170 ] 7 0.044% 99.899% ( 170, 250 ] 6 0.038% 99.937% ( 250, 380 ] 8 0.050% 99.987% ( 380, 580 ] 2 0.013% 100.000% ** Level 3 read latency histogram (micros): Count: 24267 Average: 8.6173 StdDev: 94.85 Min: 0 Median: 1.6742 Max: 4483 Percentiles: P50: 1.67 P75: 2.32 P99: 100.61 P99.9: 1504.98 P99.99: 3489.99 ------------------------------------------------------ [ 0, 1 ] 2187 9.012% 9.012% ## ( 1, 2 ] 14753 60.794% 69.807% ############ ( 2, 3 ] 3923 16.166% 85.973% ### ( 3, 4 ] 1590 6.552% 92.525% # ( 4, 6 ] 1028 4.236% 96.761% # ( 6, 10 ] 455 1.875% 98.636% ( 10, 15 ] 51 0.210% 98.846% ( 15, 22 ] 9 0.037% 98.883% ( 22, 34 ] 3 0.012% 98.896% ( 76, 110 ] 35 0.144% 99.040% ( 110, 170 ] 40 0.165% 99.205% ( 170, 250 ] 51 0.210% 99.415% ( 250, 380 ] 38 0.157% 99.571% ( 380, 580 ] 33 0.136% 99.707% ( 580, 870 ] 28 0.115% 99.823% ( 870, 1300 ] 16 0.066% 99.889% ( 1300, 1900 ] 8 0.033% 99.922% ( 1900, 2900 ] 15 0.062% 99.984% ( 2900, 4400 ] 4 0.016% 100.000% ( 4400, 6600 ] 1 0.004% 100.004% ** Level 4 read latency histogram (micros): Count: 25 Average: 2038.2400 StdDev: 1599.93 Min: 492 Median: 1246.2500 Max: 6333 Percentiles: P50: 1246.25 P75: 3125.00 P99: 6325.00 P99.9: 6333.00 P99.99: 6333.00 ------------------------------------------------------ ( 380, 580 ] 2 8.000% 8.000% ## ( 580, 870 ] 7 28.000% 36.000% ###### ( 870, 1300 ] 4 16.000% 52.000% ### ( 1300, 1900 ] 2 8.000% 60.000% ## ( 1900, 2900 ] 3 12.000% 72.000% ## ( 2900, 4400 ] 5 20.000% 92.000% #### ( 4400, 6600 ] 2 8.000% 100.000% ## ** DB Stats ** Uptime(secs): 27.1 total, 11.4 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 217.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.962 H:M:S, 40.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 86.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:8.584 H:M:S, 75.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/20-00:25:37 ... thread 0: (1000000,7000000) ops and (159538.2,210675.3) ops/second in (6.268093,33.226489) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/9 3.25 GB 81.8 6.2 0.0 6.2 12.8 6.6 0.0 1.9 144.0 299.3 43.73 40.89 115 0.380 6394K 12K 0.0 0.0 L1 15/15 1.76 GB 0.0 5.5 3.3 2.2 5.4 3.2 0.1 1.7 226.3 224.0 24.72 23.51 4 6.180 5679K 55K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.6 1.8 233.3 233.2 0.48 0.45 1 0.477 113K 30 0.0 0.0 L3 22/0 977.35 MB 1.0 2.3 1.4 0.9 2.3 1.4 0.3 1.7 203.0 202.9 11.57 10.05 9 1.285 2376K 1103 0.0 0.0 L4 164/0 9.71 GB 1.0 0.1 0.1 0.0 0.1 0.1 1.4 1.0 235.5 235.5 0.22 0.21 1 0.222 53K 0 0.0 0.0 L5 1060/0 87.05 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1275/24 102.71 GB 0.0 14.1 4.7 9.3 20.6 11.3 4.6 3.1 178.4 261.9 80.72 75.11 130 0.621 14M 69K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.1 4.7 9.3 20.6 11.3 4.6 3.1 178.4 261.9 80.72 75.11 130 0.621 14M 69K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.1 4.7 9.3 14.0 4.7 0.0 0.0 235.7 234.6 61.11 57.63 34 1.797 14M 69K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 346.9 19.61 17.48 96 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 33.4 total, 33.2 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.64 GB write, 632.74 MB/s write, 14.07 GB read, 431.17 MB/s read, 80.7 seconds Interval compaction: 20.64 GB write, 636.12 MB/s write, 14.07 GB read, 433.47 MB/s read, 80.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 23, interval: 46 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2838561 Average: 2.5228 StdDev: 14.53 Min: 0 Median: 1.5104 Max: 4394 Percentiles: P50: 1.51 P75: 1.89 P99: 6.05 P99.9: 105.25 P99.99: 246.93 ------------------------------------------------------ [ 0, 1 ] 467770 16.479% 16.479% ### ( 1, 2 ] 1864116 65.671% 82.150% ############# ( 2, 3 ] 320069 11.276% 93.426% ## ( 3, 4 ] 98008 3.453% 96.879% # ( 4, 6 ] 59951 2.112% 98.991% ( 6, 10 ] 21345 0.752% 99.743% ( 10, 15 ] 2549 0.090% 99.833% ( 15, 22 ] 472 0.017% 99.849% ( 22, 34 ] 28 0.001% 99.850% ( 34, 51 ] 26 0.001% 99.851% ( 51, 76 ] 55 0.002% 99.853% ( 76, 110 ] 1551 0.055% 99.908% ( 110, 170 ] 1766 0.062% 99.970% ( 170, 250 ] 595 0.021% 99.991% ( 250, 380 ] 404 0.014% 100.005% ( 380, 580 ] 375 0.013% 100.018% ( 580, 870 ] 189 0.007% 100.025% ( 870, 1300 ] 53 0.002% 100.027% ( 1300, 1900 ] 18 0.001% 100.027% ( 1900, 2900 ] 16 0.001% 100.028% ( 2900, 4400 ] 10 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 960334 Average: 2.9223 StdDev: 18.59 Min: 0 Median: 1.5982 Max: 2889 Percentiles: P50: 1.60 P75: 1.99 P99: 8.18 P99.9: 130.81 P99.99: 350.08 ------------------------------------------------------ [ 0, 1 ] 115370 12.014% 12.014% ## ( 1, 2 ] 609853 63.504% 75.518% ############# ( 2, 3 ] 139627 14.539% 90.057% ### ( 3, 4 ] 45140 4.700% 94.758% # ( 4, 6 ] 33644 3.503% 98.261% # ( 6, 10 ] 13051 1.359% 99.620% ( 10, 15 ] 1506 0.157% 99.777% ( 15, 22 ] 238 0.025% 99.802% ( 22, 34 ] 20 0.002% 99.804% ( 34, 51 ] 25 0.003% 99.806% ( 51, 76 ] 41 0.004% 99.811% ( 76, 110 ] 620 0.065% 99.875% ( 110, 170 ] 688 0.072% 99.947% ( 170, 250 ] 261 0.027% 99.974% ( 250, 380 ] 200 0.021% 99.995% ( 380, 580 ] 220 0.023% 100.018% ( 580, 870 ] 106 0.011% 100.029% ( 870, 1300 ] 57 0.006% 100.035% ( 1300, 1900 ] 33 0.003% 100.038% ( 1900, 2900 ] 6 0.001% 100.039% ** Level 2 read latency histogram (micros): Count: 28280 Average: 3.6980 StdDev: 37.80 Min: 1 Median: 1.4873 Max: 4303 Percentiles: P50: 1.49 P75: 1.96 P99: 8.67 P99.9: 522.93 P99.99: 1228.79 ------------------------------------------------------ [ 0, 1 ] 6860 24.257% 24.257% ##### ( 1, 2 ] 14938 52.822% 77.079% ########### ( 2, 3 ] 3199 11.312% 88.391% ## ( 3, 4 ] 1496 5.290% 93.681% # ( 4, 6 ] 1273 4.501% 98.182% # ( 6, 10 ] 346 1.223% 99.406% ( 10, 15 ] 65 0.230% 99.636% ( 15, 22 ] 9 0.032% 99.668% ( 22, 34 ] 1 0.004% 99.671% ( 76, 110 ] 1 0.004% 99.675% ( 110, 170 ] 16 0.057% 99.731% ( 170, 250 ] 17 0.060% 99.791% ( 250, 380 ] 20 0.071% 99.862% ( 380, 580 ] 15 0.053% 99.915% ( 580, 870 ] 17 0.060% 99.975% ( 870, 1300 ] 5 0.018% 99.993% ( 1300, 1900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 254856 Average: 3.7814 StdDev: 37.29 Min: 0 Median: 1.6696 Max: 4483 Percentiles: P50: 1.67 P75: 2.24 P99: 8.95 P99.9: 267.85 P99.99: 867.73 ------------------------------------------------------ [ 0, 1 ] 20467 8.031% 8.031% ## ( 1, 2 ] 159736 62.677% 70.708% ############# ( 2, 3 ] 45141 17.712% 88.420% #### ( 3, 4 ] 14249 5.591% 94.011% # ( 4, 6 ] 9566 3.753% 97.765% # ( 6, 10 ] 4270 1.675% 99.440% ( 10, 15 ] 409 0.160% 99.601% ( 15, 22 ] 64 0.025% 99.626% ( 22, 34 ] 9 0.004% 99.629% ( 34, 51 ] 1 0.000% 99.630% ( 51, 76 ] 7 0.003% 99.632% ( 76, 110 ] 177 0.069% 99.702% ( 110, 170 ] 318 0.125% 99.827% ( 170, 250 ] 173 0.068% 99.894% ( 250, 380 ] 103 0.040% 99.935% ( 380, 580 ] 79 0.031% 99.966% ( 580, 870 ] 62 0.024% 99.990% ( 870, 1300 ] 30 0.012% 100.002% ( 1300, 1900 ] 20 0.008% 100.010% ( 1900, 2900 ] 18 0.007% 100.017% ( 2900, 4400 ] 7 0.003% 100.020% ( 4400, 6600 ] 1 0.000% 100.020% ** Level 4 read latency histogram (micros): Count: 35 Average: 1468.3429 StdDev: 1625.58 Min: 1 Median: 807.8571 Max: 6333 Percentiles: P50: 807.86 P75: 2316.67 P99: 6215.00 P99.9: 6333.00 P99.99: 6333.00 ------------------------------------------------------ [ 0, 1 ] 5 14.286% 14.286% ### ( 1, 2 ] 2 5.714% 20.000% # ( 2, 3 ] 1 2.857% 22.857% # ( 110, 170 ] 1 2.857% 25.714% # ( 250, 380 ] 1 2.857% 28.571% # ( 380, 580 ] 2 5.714% 34.286% # ( 580, 870 ] 7 20.000% 54.286% #### ( 870, 1300 ] 4 11.429% 65.714% ## ( 1300, 1900 ] 2 5.714% 71.429% # ( 1900, 2900 ] 3 8.571% 80.000% ## ( 2900, 4400 ] 5 14.286% 94.286% ### ( 4400, 6600 ] 2 5.714% 100.000% # ** Level 5 read latency histogram (micros): Count: 80 Average: 941.8750 StdDev: 1084.68 Min: 90 Median: 405.0000 Max: 4600 Percentiles: P50: 405.00 P75: 1366.67 P99: 4600.00 P99.9: 4600.00 P99.99: 4600.00 ------------------------------------------------------ ( 76, 110 ] 1 1.250% 1.250% ( 110, 170 ] 10 12.500% 13.750% ### ( 170, 250 ] 15 18.750% 32.500% #### ( 250, 380 ] 13 16.250% 48.750% ### ( 380, 580 ] 8 10.000% 58.750% ## ( 580, 870 ] 6 7.500% 66.250% ## ( 870, 1300 ] 6 7.500% 73.750% ## ( 1300, 1900 ] 9 11.250% 85.000% ## ( 1900, 2900 ] 6 7.500% 92.500% ## ( 2900, 4400 ] 4 5.000% 97.500% # ( 4400, 6600 ] 2 2.500% 100.000% # ** DB Stats ** Uptime(secs): 33.4 total, 6.3 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 206.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.409 H:M:S, 43.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 157.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.447 H:M:S, 55.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-00:25:49 ... thread 0: (1000000,8000000) ops and (86690.1,178723.7) ops/second in (11.535343,44.761832) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 2.03 GB 56.6 7.5 0.0 7.5 15.1 7.6 0.0 2.0 148.2 298.6 51.84 48.61 134 0.387 7802K 14K 0.0 0.0 L1 4/0 388.01 MB 38.8 9.4 5.5 4.0 9.3 5.4 0.1 1.7 226.5 223.8 42.61 40.58 5 8.521 9018K 55K 0.0 0.0 L2 5/3 516.10 MB 2.1 0.1 0.1 0.0 0.1 0.1 5.1 1.8 233.3 233.2 0.48 0.45 1 0.477 113K 30 0.0 0.0 L3 39/11 3.38 GB 2.5 2.3 1.4 0.9 2.3 1.4 3.3 1.7 203.0 202.9 11.57 10.05 9 1.285 2376K 1103 0.0 0.0 L4 174/12 10.30 GB 1.1 0.1 0.1 0.0 0.1 0.1 2.0 1.0 235.5 235.5 0.22 0.21 1 0.222 53K 0 0.0 0.0 L5 1060/0 87.05 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1290/32 103.64 GB 0.0 19.4 6.9 12.4 26.9 14.4 11.8 3.5 186.0 258.0 106.71 99.89 150 0.711 19M 70K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.4 6.9 12.4 26.9 14.4 11.7 3.5 186.0 258.0 106.71 99.89 150 0.711 19M 70K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.4 6.9 12.4 19.3 6.8 0.0 0.0 235.7 234.2 84.20 79.81 40 2.105 19M 70K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 347.0 22.51 20.08 110 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 44.9 total, 44.8 interval Flush(GB): cumulative 7.628, interval 7.628 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.88 GB write, 612.56 MB/s write, 19.38 GB read, 441.59 MB/s read, 106.7 seconds Interval compaction: 26.88 GB write, 614.99 MB/s write, 19.38 GB read, 443.35 MB/s read, 106.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 21, pending-compaction-bytes-stops: 0, total-delays: 35, total-stops: 27, interval: 62 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3528503 Average: 2.5521 StdDev: 14.85 Min: 0 Median: 1.5047 Max: 4394 Percentiles: P50: 1.50 P75: 1.89 P99: 6.15 P99.9: 118.47 P99.99: 252.30 ------------------------------------------------------ [ 0, 1 ] 594038 16.835% 16.835% ### ( 1, 2 ] 2318518 65.708% 82.544% ############# ( 2, 3 ] 385992 10.939% 93.483% ## ( 3, 4 ] 119838 3.396% 96.879% # ( 4, 6 ] 73860 2.093% 98.972% ( 6, 10 ] 25785 0.731% 99.703% ( 10, 15 ] 3296 0.093% 99.797% ( 15, 22 ] 611 0.017% 99.814% ( 22, 34 ] 36 0.001% 99.815% ( 34, 51 ] 27 0.001% 99.816% ( 51, 76 ] 103 0.003% 99.819% ( 76, 110 ] 2484 0.070% 99.889% ( 110, 170 ] 2744 0.078% 99.967% ( 170, 250 ] 810 0.023% 99.990% ( 250, 380 ] 518 0.015% 100.004% ( 380, 580 ] 458 0.013% 100.017% ( 580, 870 ] 225 0.006% 100.024% ( 870, 1300 ] 62 0.002% 100.026% ( 1300, 1900 ] 21 0.001% 100.026% ( 1900, 2900 ] 18 0.001% 100.027% ( 2900, 4400 ] 15 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 1396806 Average: 2.9153 StdDev: 21.97 Min: 0 Median: 1.5497 Max: 5578 Percentiles: P50: 1.55 P75: 1.95 P99: 8.04 P99.9: 130.09 P99.99: 366.73 ------------------------------------------------------ [ 0, 1 ] 220200 15.765% 15.765% ### ( 1, 2 ] 869956 62.282% 78.046% ############ ( 2, 3 ] 177567 12.712% 90.759% ### ( 3, 4 ] 59710 4.275% 95.033% # ( 4, 6 ] 46639 3.339% 98.372% # ( 6, 10 ] 17230 1.234% 99.606% ( 10, 15 ] 1970 0.141% 99.747% ( 15, 22 ] 399 0.029% 99.776% ( 22, 34 ] 29 0.002% 99.778% ( 34, 51 ] 28 0.002% 99.780% ( 51, 76 ] 130 0.009% 99.789% ( 76, 110 ] 1227 0.088% 99.877% ( 110, 170 ] 983 0.070% 99.947% ( 170, 250 ] 351 0.025% 99.972% ( 250, 380 ] 281 0.020% 99.992% ( 380, 580 ] 297 0.021% 100.014% ( 580, 870 ] 181 0.013% 100.027% ( 870, 1300 ] 104 0.007% 100.034% ( 1300, 1900 ] 56 0.004% 100.038% ( 1900, 2900 ] 10 0.001% 100.039% ( 2900, 4400 ] 8 0.001% 100.039% ( 4400, 6600 ] 1 0.000% 100.039% ** Level 2 read latency histogram (micros): Count: 28280 Average: 3.6980 StdDev: 37.80 Min: 1 Median: 1.4873 Max: 4303 Percentiles: P50: 1.49 P75: 1.96 P99: 8.67 P99.9: 522.93 P99.99: 1228.79 ------------------------------------------------------ [ 0, 1 ] 6860 24.257% 24.257% ##### ( 1, 2 ] 14938 52.822% 77.079% ########### ( 2, 3 ] 3199 11.312% 88.391% ## ( 3, 4 ] 1496 5.290% 93.681% # ( 4, 6 ] 1273 4.501% 98.182% # ( 6, 10 ] 346 1.223% 99.406% ( 10, 15 ] 65 0.230% 99.636% ( 15, 22 ] 9 0.032% 99.668% ( 22, 34 ] 1 0.004% 99.671% ( 76, 110 ] 1 0.004% 99.675% ( 110, 170 ] 16 0.057% 99.731% ( 170, 250 ] 17 0.060% 99.791% ( 250, 380 ] 20 0.071% 99.862% ( 380, 580 ] 15 0.053% 99.915% ( 580, 870 ] 17 0.060% 99.975% ( 870, 1300 ] 5 0.018% 99.993% ( 1300, 1900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 255727 Average: 5.2345 StdDev: 64.02 Min: 0 Median: 1.6716 Max: 7788 Percentiles: P50: 1.67 P75: 2.25 P99: 9.35 P99.9: 679.03 P99.99: 1734.68 ------------------------------------------------------ [ 0, 1 ] 20468 8.004% 8.004% ## ( 1, 2 ] 159906 62.530% 70.534% ############# ( 2, 3 ] 45257 17.697% 88.231% #### ( 3, 4 ] 14317 5.599% 93.830% # ( 4, 6 ] 9629 3.765% 97.595% # ( 6, 10 ] 4284 1.675% 99.270% ( 10, 15 ] 411 0.161% 99.431% ( 15, 22 ] 64 0.025% 99.456% ( 22, 34 ] 9 0.004% 99.460% ( 34, 51 ] 1 0.000% 99.460% ( 51, 76 ] 7 0.003% 99.463% ( 76, 110 ] 179 0.070% 99.533% ( 110, 170 ] 337 0.132% 99.664% ( 170, 250 ] 217 0.085% 99.749% ( 250, 380 ] 165 0.065% 99.814% ( 380, 580 ] 167 0.065% 99.879% ( 580, 870 ] 156 0.061% 99.940% ( 870, 1300 ] 97 0.038% 99.978% ( 1300, 1900 ] 42 0.016% 99.995% ( 1900, 2900 ] 37 0.014% 100.009% ( 2900, 4400 ] 22 0.009% 100.018% ( 4400, 6600 ] 4 0.002% 100.019% ( 6600, 9900 ] 2 0.001% 100.020% ** Level 4 read latency histogram (micros): Count: 35 Average: 1468.3429 StdDev: 1625.58 Min: 1 Median: 807.8571 Max: 6333 Percentiles: P50: 807.86 P75: 2316.67 P99: 6215.00 P99.9: 6333.00 P99.99: 6333.00 ------------------------------------------------------ [ 0, 1 ] 5 14.286% 14.286% ### ( 1, 2 ] 2 5.714% 20.000% # ( 2, 3 ] 1 2.857% 22.857% # ( 110, 170 ] 1 2.857% 25.714% # ( 250, 380 ] 1 2.857% 28.571% # ( 380, 580 ] 2 5.714% 34.286% # ( 580, 870 ] 7 20.000% 54.286% #### ( 870, 1300 ] 4 11.429% 65.714% ## ( 1300, 1900 ] 2 5.714% 71.429% # ( 1900, 2900 ] 3 8.571% 80.000% ## ( 2900, 4400 ] 5 14.286% 94.286% ### ( 4400, 6600 ] 2 5.714% 100.000% # ** Level 5 read latency histogram (micros): Count: 80 Average: 941.8750 StdDev: 1084.68 Min: 90 Median: 405.0000 Max: 4600 Percentiles: P50: 405.00 P75: 1366.67 P99: 4600.00 P99.9: 4600.00 P99.99: 4600.00 ------------------------------------------------------ ( 76, 110 ] 1 1.250% 1.250% ( 110, 170 ] 10 12.500% 13.750% ### ( 170, 250 ] 15 18.750% 32.500% #### ( 250, 380 ] 13 16.250% 48.750% ### ( 380, 580 ] 8 10.000% 58.750% ## ( 580, 870 ] 6 7.500% 66.250% ## ( 870, 1300 ] 6 7.500% 73.750% ## ( 1300, 1900 ] 9 11.250% 85.000% ## ( 1900, 2900 ] 6 7.500% 92.500% ## ( 2900, 4400 ] 4 5.000% 97.500% # ( 4400, 6600 ] 2 2.500% 100.000% # ** DB Stats ** Uptime(secs): 44.9 total, 11.5 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 175.20 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.901 H:M:S, 51.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 85.32 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:8.491 H:M:S, 73.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/20-00:25:54 ... thread 0: (1000000,9000000) ops and (177952.4,178637.7) ops/second in (5.619480,50.381312) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 2.94 GB 269.6 9.3 0.0 9.3 17.9 8.5 0.0 2.1 146.4 280.0 65.38 58.64 147 0.445 9719K 24K 0.0 0.0 L1 4/0 388.01 MB 38.8 9.4 5.5 4.0 9.3 5.4 0.1 1.7 226.5 223.8 42.61 40.58 5 8.521 9018K 55K 0.0 0.0 L2 1/0 86.15 MB 0.9 0.1 0.1 0.0 0.1 0.1 5.1 1.8 233.3 233.2 0.48 0.45 1 0.477 113K 30 0.0 0.0 L3 18/0 987.51 MB 1.0 2.9 1.8 1.2 2.9 1.8 3.3 1.6 176.4 176.0 17.12 13.15 13 1.317 2796K 6630 0.0 0.0 L4 152/0 9.50 GB 1.0 3.5 2.8 0.7 3.5 2.7 2.1 1.3 118.7 118.6 29.91 16.72 24 1.246 3605K 2340 0.0 0.0 L5 1104/0 90.68 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1290/4 104.54 GB 0.0 25.3 10.1 15.2 33.7 18.5 15.5 3.9 166.6 221.9 155.49 129.53 190 0.818 25M 88K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.3 10.1 15.2 33.7 18.5 15.5 3.9 166.6 221.9 155.49 129.53 190 0.818 25M 88K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.3 10.1 15.2 25.2 9.9 0.0 0.0 202.5 201.4 127.88 106.90 69 1.853 25M 88K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 317.1 27.61 22.63 121 0.228 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.6 total, 50.4 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.70 GB write, 682.58 MB/s write, 25.29 GB read, 512.28 MB/s read, 155.5 seconds Interval compaction: 33.70 GB write, 684.98 MB/s write, 25.29 GB read, 514.09 MB/s read, 155.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 21, pending-compaction-bytes-stops: 0, total-delays: 35, total-stops: 60, interval: 95 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3939832 Average: 2.6896 StdDev: 23.46 Min: 0 Median: 1.5223 Max: 12230 Percentiles: P50: 1.52 P75: 1.91 P99: 6.72 P99.9: 116.81 P99.99: 315.82 ------------------------------------------------------ [ 0, 1 ] 637634 16.184% 16.184% ### ( 1, 2 ] 2550612 64.739% 80.923% ############# ( 2, 3 ] 453187 11.503% 92.426% ## ( 3, 4 ] 150425 3.818% 96.244% # ( 4, 6 ] 102612 2.604% 98.849% # ( 6, 10 ] 33282 0.845% 99.693% ( 10, 15 ] 4439 0.113% 99.806% ( 15, 22 ] 727 0.018% 99.825% ( 22, 34 ] 43 0.001% 99.826% ( 34, 51 ] 30 0.001% 99.826% ( 51, 76 ] 106 0.003% 99.829% ( 76, 110 ] 2484 0.063% 99.892% ( 110, 170 ] 2751 0.070% 99.962% ( 170, 250 ] 826 0.021% 99.983% ( 250, 380 ] 555 0.014% 99.997% ( 380, 580 ] 512 0.013% 100.010% ( 580, 870 ] 318 0.008% 100.018% ( 870, 1300 ] 132 0.003% 100.021% ( 1300, 1900 ] 65 0.002% 100.023% ( 1900, 2900 ] 53 0.001% 100.024% ( 2900, 4400 ] 49 0.001% 100.026% ( 4400, 6600 ] 10 0.000% 100.026% ( 6600, 9900 ] 1 0.000% 100.026% ( 9900, 14000 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 2078602 Average: 4.9123 StdDev: 81.89 Min: 0 Median: 1.6949 Max: 12082 Percentiles: P50: 1.69 P75: 2.44 P99: 8.74 P99.9: 108.20 P99.99: 384.77 ------------------------------------------------------ [ 0, 1 ] 223628 10.759% 10.759% ## ( 1, 2 ] 1173842 56.473% 67.231% ########### ( 2, 3 ] 364885 17.554% 84.786% #### ( 3, 4 ] 142048 6.834% 91.619% # ( 4, 6 ] 129952 6.252% 97.871% # ( 6, 10 ] 34204 1.646% 99.517% ( 10, 15 ] 5717 0.275% 99.792% ( 15, 22 ] 838 0.040% 99.832% ( 22, 34 ] 59 0.003% 99.835% ( 34, 51 ] 43 0.002% 99.837% ( 51, 76 ] 137 0.007% 99.844% ( 76, 110 ] 1236 0.059% 99.903% ( 110, 170 ] 997 0.048% 99.951% ( 170, 250 ] 390 0.019% 99.970% ( 250, 380 ] 405 0.019% 99.989% ( 380, 580 ] 551 0.027% 100.016% ( 580, 870 ] 480 0.023% 100.039% ( 870, 1300 ] 389 0.019% 100.058% ( 1300, 1900 ] 304 0.015% 100.072% ( 1900, 2900 ] 369 0.018% 100.090% ( 2900, 4400 ] 371 0.018% 100.108% ( 4400, 6600 ] 96 0.005% 100.113% ( 6600, 9900 ] 38 0.002% 100.114% ( 9900, 14000 ] 8 0.000% 100.115% ** Level 2 read latency histogram (micros): Count: 28280 Average: 3.6980 StdDev: 37.80 Min: 1 Median: 1.4873 Max: 4303 Percentiles: P50: 1.49 P75: 1.96 P99: 8.67 P99.9: 522.93 P99.99: 1228.79 ------------------------------------------------------ [ 0, 1 ] 6860 24.257% 24.257% ##### ( 1, 2 ] 14938 52.822% 77.079% ########### ( 2, 3 ] 3199 11.312% 88.391% ## ( 3, 4 ] 1496 5.290% 93.681% # ( 4, 6 ] 1273 4.501% 98.182% # ( 6, 10 ] 346 1.223% 99.406% ( 10, 15 ] 65 0.230% 99.636% ( 15, 22 ] 9 0.032% 99.668% ( 22, 34 ] 1 0.004% 99.671% ( 76, 110 ] 1 0.004% 99.675% ( 110, 170 ] 16 0.057% 99.731% ( 170, 250 ] 17 0.060% 99.791% ( 250, 380 ] 20 0.071% 99.862% ( 380, 580 ] 15 0.053% 99.915% ( 580, 870 ] 17 0.060% 99.975% ( 870, 1300 ] 5 0.018% 99.993% ( 1300, 1900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 413109 Average: 12.4433 StdDev: 158.96 Min: 0 Median: 1.7975 Max: 12339 Percentiles: P50: 1.80 P75: 2.65 P99: 13.05 P99.9: 2237.60 P99.99: 3990.13 ------------------------------------------------------ [ 0, 1 ] 21818 5.281% 5.281% # ( 1, 2 ] 231640 56.072% 61.354% ########### ( 2, 3 ] 86633 20.971% 82.325% #### ( 3, 4 ] 32969 7.981% 90.305% ## ( 4, 6 ] 28062 6.793% 97.098% # ( 6, 10 ] 7223 1.748% 98.847% ( 10, 15 ] 1039 0.252% 99.098% ( 15, 22 ] 150 0.036% 99.135% ( 22, 34 ] 12 0.003% 99.138% ( 34, 51 ] 5 0.001% 99.139% ( 51, 76 ] 7 0.002% 99.140% ( 76, 110 ] 180 0.044% 99.184% ( 110, 170 ] 351 0.085% 99.269% ( 170, 250 ] 288 0.070% 99.339% ( 250, 380 ] 320 0.077% 99.416% ( 380, 580 ] 499 0.121% 99.537% ( 580, 870 ] 577 0.140% 99.677% ( 870, 1300 ] 500 0.121% 99.798% ( 1300, 1900 ] 326 0.079% 99.877% ( 1900, 2900 ] 287 0.069% 99.946% ( 2900, 4400 ] 250 0.061% 100.007% ( 4400, 6600 ] 60 0.015% 100.021% ( 6600, 9900 ] 26 0.006% 100.027% ( 9900, 14000 ] 5 0.001% 100.029% ** Level 4 read latency histogram (micros): Count: 169343 Average: 8.1364 StdDev: 114.19 Min: 1 Median: 2.0645 Max: 9250 Percentiles: P50: 2.06 P75: 3.02 P99: 9.49 P99.9: 774.07 P99.99: 1515.51 ------------------------------------------------------ [ 0, 1 ] 1159 0.684% 0.684% ( 1, 2 ] 80626 47.611% 48.295% ########## ( 2, 3 ] 44750 26.426% 74.721% ##### ( 3, 4 ] 19850 11.722% 86.443% ## ( 4, 6 ] 18351 10.837% 97.279% ## ( 6, 10 ] 3340 1.972% 99.252% ( 10, 15 ] 717 0.423% 99.675% ( 15, 22 ] 93 0.055% 99.730% ( 22, 34 ] 14 0.008% 99.738% ( 34, 51 ] 4 0.002% 99.741% ( 51, 76 ] 2 0.001% 99.742% ( 76, 110 ] 4 0.002% 99.744% ( 110, 170 ] 6 0.004% 99.748% ( 170, 250 ] 57 0.034% 99.782% ( 250, 380 ] 45 0.027% 99.808% ( 380, 580 ] 70 0.041% 99.849% ( 580, 870 ] 128 0.076% 99.925% ( 870, 1300 ] 86 0.051% 99.976% ( 1300, 1900 ] 67 0.040% 100.015% ( 1900, 2900 ] 75 0.044% 100.060% ( 2900, 4400 ] 71 0.042% 100.102% ( 4400, 6600 ] 16 0.009% 100.111% ( 6600, 9900 ] 1 0.001% 100.112% ** Level 5 read latency histogram (micros): Count: 300 Average: 1595.3500 StdDev: 1564.27 Min: 90 Median: 913.0000 Max: 7418 Percentiles: P50: 913.00 P75: 2557.14 P99: 6477.78 P99.9: 7418.00 P99.99: 7418.00 ------------------------------------------------------ ( 76, 110 ] 3 1.000% 1.000% ( 110, 170 ] 17 5.667% 6.667% # ( 170, 250 ] 21 7.000% 13.667% # ( 250, 380 ] 25 8.333% 22.000% ## ( 380, 580 ] 44 14.667% 36.667% ### ( 580, 870 ] 37 12.333% 49.000% ## ( 870, 1300 ] 30 10.000% 59.000% ## ( 1300, 1900 ] 25 8.333% 67.333% ## ( 1900, 2900 ] 35 11.667% 79.000% ## ( 2900, 4400 ] 43 14.333% 93.333% ### ( 4400, 6600 ] 18 6.000% 99.333% # ( 6600, 9900 ] 2 0.667% 100.000% ** DB Stats ** Uptime(secs): 50.6 total, 5.6 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 175.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.637 H:M:S, 50.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 175.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.736 H:M:S, 48.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-00:25:57 ... thread 0: (1000000,10000000) ops and (331866.4,187285.0) ops/second in (3.013261,53.394573) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/15 3.92 GB 6.3 10.2 0.0 10.2 19.7 9.5 0.0 2.1 146.0 282.1 71.59 64.48 164 0.437 10M 25K 0.0 0.0 L1 4/4 388.01 MB 0.0 9.4 5.5 4.0 9.3 5.4 0.1 1.7 226.5 223.8 42.61 40.58 5 8.521 9018K 55K 0.0 0.0 L2 1/0 86.15 MB 0.9 0.1 0.1 0.0 0.1 0.1 5.1 1.8 233.3 233.2 0.48 0.45 1 0.477 113K 30 0.0 0.0 L3 18/0 987.51 MB 1.0 2.9 1.8 1.2 2.9 1.8 3.3 1.6 176.4 176.0 17.12 13.15 13 1.317 2796K 6630 0.0 0.0 L4 152/0 9.50 GB 1.0 3.5 2.8 0.7 3.5 2.7 2.1 1.3 118.7 118.6 29.91 16.72 24 1.246 3605K 2340 0.0 0.0 L5 1104/0 90.68 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1295/19 105.53 GB 0.0 26.2 10.1 16.1 35.5 19.5 15.5 3.7 165.6 225.1 161.70 135.37 207 0.781 26M 89K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.2 10.1 16.1 35.5 19.5 15.5 3.7 165.6 225.1 161.70 135.37 207 0.781 26M 89K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.2 10.1 16.1 26.0 9.9 0.0 0.0 204.0 202.9 131.26 110.22 72 1.823 26M 89K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 320.7 30.44 25.15 135 0.226 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.6 total, 53.4 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.55 GB write, 679.44 MB/s write, 26.16 GB read, 499.93 MB/s read, 161.7 seconds Interval compaction: 35.55 GB write, 681.70 MB/s write, 26.16 GB read, 501.60 MB/s read, 161.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 63, pending-compaction-bytes-delays: 21, pending-compaction-bytes-stops: 0, total-delays: 35, total-stops: 63, interval: 98 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4185553 Average: 2.6580 StdDev: 23.04 Min: 0 Median: 1.5138 Max: 12230 Percentiles: P50: 1.51 P75: 1.90 P99: 6.56 P99.9: 114.87 P99.99: 315.78 ------------------------------------------------------ [ 0, 1 ] 701520 16.761% 16.761% ### ( 1, 2 ] 2707714 64.692% 81.452% ############# ( 2, 3 ] 468400 11.191% 92.643% ## ( 3, 4 ] 155923 3.725% 96.369% # ( 4, 6 ] 105321 2.516% 98.885% # ( 6, 10 ] 34196 0.817% 99.702% ( 10, 15 ] 4598 0.110% 99.812% ( 15, 22 ] 746 0.018% 99.830% ( 22, 34 ] 45 0.001% 99.831% ( 34, 51 ] 32 0.001% 99.831% ( 51, 76 ] 110 0.003% 99.834% ( 76, 110 ] 2531 0.060% 99.894% ( 110, 170 ] 2851 0.068% 99.963% ( 170, 250 ] 857 0.020% 99.983% ( 250, 380 ] 574 0.014% 99.997% ( 380, 580 ] 523 0.012% 100.009% ( 580, 870 ] 327 0.008% 100.017% ( 870, 1300 ] 136 0.003% 100.020% ( 1300, 1900 ] 66 0.002% 100.022% ( 1900, 2900 ] 55 0.001% 100.023% ( 2900, 4400 ] 51 0.001% 100.024% ( 4400, 6600 ] 10 0.000% 100.025% ( 6600, 9900 ] 1 0.000% 100.025% ( 9900, 14000 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 2078603 Average: 4.9124 StdDev: 81.89 Min: 0 Median: 1.6949 Max: 12082 Percentiles: P50: 1.69 P75: 2.44 P99: 8.74 P99.9: 108.22 P99.99: 384.77 ------------------------------------------------------ [ 0, 1 ] 223628 10.759% 10.759% ## ( 1, 2 ] 1173842 56.473% 67.231% ########### ( 2, 3 ] 364885 17.554% 84.786% #### ( 3, 4 ] 142048 6.834% 91.619% # ( 4, 6 ] 129952 6.252% 97.871% # ( 6, 10 ] 34204 1.646% 99.517% ( 10, 15 ] 5717 0.275% 99.792% ( 15, 22 ] 838 0.040% 99.832% ( 22, 34 ] 59 0.003% 99.835% ( 34, 51 ] 43 0.002% 99.837% ( 51, 76 ] 137 0.007% 99.844% ( 76, 110 ] 1236 0.059% 99.903% ( 110, 170 ] 997 0.048% 99.951% ( 170, 250 ] 390 0.019% 99.970% ( 250, 380 ] 406 0.020% 99.989% ( 380, 580 ] 551 0.027% 100.016% ( 580, 870 ] 480 0.023% 100.039% ( 870, 1300 ] 389 0.019% 100.058% ( 1300, 1900 ] 304 0.015% 100.072% ( 1900, 2900 ] 369 0.018% 100.090% ( 2900, 4400 ] 371 0.018% 100.108% ( 4400, 6600 ] 96 0.005% 100.113% ( 6600, 9900 ] 38 0.002% 100.114% ( 9900, 14000 ] 8 0.000% 100.115% ** Level 2 read latency histogram (micros): Count: 28280 Average: 3.6980 StdDev: 37.80 Min: 1 Median: 1.4873 Max: 4303 Percentiles: P50: 1.49 P75: 1.96 P99: 8.67 P99.9: 522.93 P99.99: 1228.79 ------------------------------------------------------ [ 0, 1 ] 6860 24.257% 24.257% ##### ( 1, 2 ] 14938 52.822% 77.079% ########### ( 2, 3 ] 3199 11.312% 88.391% ## ( 3, 4 ] 1496 5.290% 93.681% # ( 4, 6 ] 1273 4.501% 98.182% # ( 6, 10 ] 346 1.223% 99.406% ( 10, 15 ] 65 0.230% 99.636% ( 15, 22 ] 9 0.032% 99.668% ( 22, 34 ] 1 0.004% 99.671% ( 76, 110 ] 1 0.004% 99.675% ( 110, 170 ] 16 0.057% 99.731% ( 170, 250 ] 17 0.060% 99.791% ( 250, 380 ] 20 0.071% 99.862% ( 380, 580 ] 15 0.053% 99.915% ( 580, 870 ] 17 0.060% 99.975% ( 870, 1300 ] 5 0.018% 99.993% ( 1300, 1900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 413109 Average: 12.4433 StdDev: 158.96 Min: 0 Median: 1.7975 Max: 12339 Percentiles: P50: 1.80 P75: 2.65 P99: 13.05 P99.9: 2237.60 P99.99: 3990.13 ------------------------------------------------------ [ 0, 1 ] 21818 5.281% 5.281% # ( 1, 2 ] 231640 56.072% 61.354% ########### ( 2, 3 ] 86633 20.971% 82.325% #### ( 3, 4 ] 32969 7.981% 90.305% ## ( 4, 6 ] 28062 6.793% 97.098% # ( 6, 10 ] 7223 1.748% 98.847% ( 10, 15 ] 1039 0.252% 99.098% ( 15, 22 ] 150 0.036% 99.135% ( 22, 34 ] 12 0.003% 99.138% ( 34, 51 ] 5 0.001% 99.139% ( 51, 76 ] 7 0.002% 99.140% ( 76, 110 ] 180 0.044% 99.184% ( 110, 170 ] 351 0.085% 99.269% ( 170, 250 ] 288 0.070% 99.339% ( 250, 380 ] 320 0.077% 99.416% ( 380, 580 ] 499 0.121% 99.537% ( 580, 870 ] 577 0.140% 99.677% ( 870, 1300 ] 500 0.121% 99.798% ( 1300, 1900 ] 326 0.079% 99.877% ( 1900, 2900 ] 287 0.069% 99.946% ( 2900, 4400 ] 250 0.061% 100.007% ( 4400, 6600 ] 60 0.015% 100.021% ( 6600, 9900 ] 26 0.006% 100.027% ( 9900, 14000 ] 5 0.001% 100.029% ** Level 4 read latency histogram (micros): Count: 169343 Average: 8.1364 StdDev: 114.19 Min: 1 Median: 2.0645 Max: 9250 Percentiles: P50: 2.06 P75: 3.02 P99: 9.49 P99.9: 774.07 P99.99: 1515.51 ------------------------------------------------------ [ 0, 1 ] 1159 0.684% 0.684% ( 1, 2 ] 80626 47.611% 48.295% ########## ( 2, 3 ] 44750 26.426% 74.721% ##### ( 3, 4 ] 19850 11.722% 86.443% ## ( 4, 6 ] 18351 10.837% 97.279% ## ( 6, 10 ] 3340 1.972% 99.252% ( 10, 15 ] 717 0.423% 99.675% ( 15, 22 ] 93 0.055% 99.730% ( 22, 34 ] 14 0.008% 99.738% ( 34, 51 ] 4 0.002% 99.741% ( 51, 76 ] 2 0.001% 99.742% ( 76, 110 ] 4 0.002% 99.744% ( 110, 170 ] 6 0.004% 99.748% ( 170, 250 ] 57 0.034% 99.782% ( 250, 380 ] 45 0.027% 99.808% ( 380, 580 ] 70 0.041% 99.849% ( 580, 870 ] 128 0.076% 99.925% ( 870, 1300 ] 86 0.051% 99.976% ( 1300, 1900 ] 67 0.040% 100.015% ( 1900, 2900 ] 75 0.044% 100.060% ( 2900, 4400 ] 71 0.042% 100.102% ( 4400, 6600 ] 16 0.009% 100.111% ( 6600, 9900 ] 1 0.001% 100.112% ** Level 5 read latency histogram (micros): Count: 300 Average: 1595.3500 StdDev: 1564.27 Min: 90 Median: 913.0000 Max: 7418 Percentiles: P50: 913.00 P75: 2557.14 P99: 6477.78 P99.9: 7418.00 P99.99: 7418.00 ------------------------------------------------------ ( 76, 110 ] 3 1.000% 1.000% ( 110, 170 ] 17 5.667% 6.667% # ( 170, 250 ] 21 7.000% 13.667% # ( 250, 380 ] 25 8.333% 22.000% ## ( 380, 580 ] 44 14.667% 36.667% ### ( 580, 870 ] 37 12.333% 49.000% ## ( 870, 1300 ] 30 10.000% 59.000% ## ( 1300, 1900 ] 25 8.333% 67.333% ## ( 1900, 2900 ] 35 11.667% 79.000% ## ( 2900, 4400 ] 43 14.333% 93.333% ### ( 4400, 6600 ] 18 6.000% 99.333% # ( 6600, 9900 ] 2 0.667% 100.000% ** DB Stats ** Uptime(secs): 53.6 total, 3.0 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 183.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.052 H:M:S, 48.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.63 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.415 H:M:S, 13.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.560 micros/op 179844 ops/sec 60.002 seconds 10790999 operations; 174.3 MB/s Microseconds per write: Count: 10790999 Average: 5.5604 StdDev: 452.47 Min: 0 Median: 1.7407 Max: 806746 Percentiles: P50: 1.74 P75: 2.74 P99: 8.64 P99.9: 1116.56 P99.99: 2719.47 ------------------------------------------------------ [ 0, 1 ] 1386770 12.851% 12.851% ### ( 1, 2 ] 5411797 50.151% 63.002% ########## ( 2, 3 ] 1753781 16.252% 79.254% ### ( 3, 4 ] 1495273 13.857% 93.111% ### ( 4, 6 ] 565510 5.241% 98.352% # ( 6, 10 ] 106131 0.984% 99.335% ( 10, 15 ] 32390 0.300% 99.635% ( 15, 22 ] 8808 0.082% 99.717% ( 22, 34 ] 1684 0.016% 99.733% ( 34, 51 ] 254 0.002% 99.735% ( 51, 76 ] 45 0.000% 99.735% ( 76, 110 ] 7569 0.070% 99.806% ( 110, 170 ] 2927 0.027% 99.833% ( 170, 250 ] 309 0.003% 99.836% ( 250, 380 ] 130 0.001% 99.837% ( 380, 580 ] 20 0.000% 99.837% ( 580, 870 ] 21 0.000% 99.837% ( 870, 1300 ] 11840 0.110% 99.947% ( 1300, 1900 ] 35 0.000% 99.947% ( 1900, 2900 ] 5645 0.052% 99.999% ( 2900, 4400 ] 21 0.000% 100.000% ( 4400, 6600 ] 5 0.000% 100.000% ( 6600, 9900 ] 5 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 17 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 177349 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10790999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11136310968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 532 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30510107 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 32066468048 rocksdb.compact.write.bytes COUNT : 31889431454 rocksdb.flush.write.bytes COUNT : 11097453273 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 69 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 315 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11008107520 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4395008 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 32172218773 rocksdb.non.last.level.read.count COUNT : 7769232 rocksdb.block.checksum.compute.count COUNT : 7768237 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.398144 P95 : 3.876705 P99 : 6.944184 P100 : 806743.000000 COUNT : 10790999 SUM : 55061953 rocksdb.compaction.times.micros P50 : 1125000.000000 P95 : 5565000.000000 P99 : 17887412.000000 P100 : 17887412.000000 COUNT : 77 SUM : 138797927 rocksdb.compaction.times.cpu_micros P50 : 971951.219512 P95 : 5143333.333333 P99 : 17065080.000000 P100 : 17065080.000000 COUNT : 77 SUM : 117637028 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 664.740260 P95 : 1287.458333 P99 : 63250.000000 P100 : 85989.000000 COUNT : 147 SUM : 289865 rocksdb.compaction.outfile.sync.micros P50 : 1000.211268 P95 : 80950.000000 P99 : 206933.333333 P100 : 240029.000000 COUNT : 323 SUM : 4355122 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 92.000000 P95 : 1660.000000 P99 : 3200.000000 P100 : 5163.000000 COUNT : 260 SUM : 79613 rocksdb.table.open.io.micros P50 : 1600.000000 P95 : 9277.714286 P99 : 13912.533333 P100 : 18558.000000 COUNT : 532 SUM : 1351450 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.627279 P95 : 7.223956 P99 : 9.968773 P100 : 12345.000000 COUNT : 7766632 SUM : 46035516 rocksdb.read.block.get.micros P50 : 552.277228 P95 : 3844.117647 P99 : 5927.680000 P100 : 8932.000000 COUNT : 1064 SUM : 1071937 rocksdb.write.raw.block.micros P50 : 0.512390 P95 : 0.973541 P99 : 2.847260 P100 : 16773.000000 COUNT : 10410694 SUM : 20949254 rocksdb.numfiles.in.singlecompaction P50 : 3.363158 P95 : 5.475000 P99 : 17.065000 P100 : 22.000000 COUNT : 141 SUM : 560 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.561377 P95 : 1213.785708 P99 : 2619.804549 P100 : 806555.000000 COUNT : 160994 SUM : 30523691 rocksdb.sst.read.micros P50 : 1.582694 P95 : 4.216909 P99 : 7.954204 P100 : 12339.000000 COUNT : 7769332 SUM : 30511812 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10790999 SUM : 11136310968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214727.272727 P95 : 370763.157895 P99 : 950100.000000 P100 : 967689.000000 COUNT : 147 SUM : 32785847 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 335 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0