[2024-10-17 17:16:25.024754] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... [2024-10-17 17:16:25.024864] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2759316 ] Set seed to 1729178185022361 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-10-17 17:16:25.119401] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-10-17 17:16:25.159214] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-10-17 17:16:25.159262] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2759316' to capture a snapshot of events at runtime. [2024-10-17 17:16:25.159274] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2759316 for offline analysis/debug. [2024-10-17 17:16:25.159320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Oct 17 17:16:29 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/10/17-17:16:32 ... thread 0: (1000000,1000000) ops and (336623.9,336623.9) ops/second in (2.970674,2.970674) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 629.97 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 347.9 2.53 2.28 12 0.211 0 0 0.0 0.0 L2 3/2 251.74 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.2 2.0 250.0 249.8 1.51 1.47 2 0.756 383K 210 0.0 0.0 L3 10/0 867.30 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.66 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1178/8 97.00 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.3 1.4 93.4 311.3 4.05 3.75 14 0.289 383K 210 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.4 93.4 311.3 4.05 3.75 14 0.289 383K 210 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 250.0 249.8 1.51 1.47 2 0.756 383K 210 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 347.9 2.53 2.28 12 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 393.27 MB/s write, 0.37 GB read, 117.99 MB/s read, 4.0 seconds Interval compaction: 1.23 GB write, 423.76 MB/s write, 0.37 GB read, 127.14 MB/s read, 4.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 111571 Average: 1.8775 StdDev: 18.96 Min: 1 Median: 1.1975 Max: 4210 Percentiles: P50: 1.20 P75: 1.65 P99: 3.87 P99.9: 9.35 P99.99: 354.93 ------------------------------------------------------ [ 0, 1 ] 43556 39.039% 39.039% ######## ( 1, 2 ] 61932 55.509% 94.548% ########### ( 2, 3 ] 3795 3.401% 97.949% # ( 3, 4 ] 1348 1.208% 99.157% ( 4, 6 ] 641 0.575% 99.732% ( 6, 10 ] 224 0.201% 99.933% ( 10, 15 ] 45 0.040% 99.973% ( 15, 22 ] 6 0.005% 99.978% ( 110, 170 ] 6 0.005% 99.984% ( 170, 250 ] 2 0.002% 99.986% ( 250, 380 ] 6 0.005% 99.991% ( 380, 580 ] 2 0.002% 99.993% ( 580, 870 ] 1 0.001% 99.994% ( 870, 1300 ] 2 0.002% 99.996% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 1 read latency histogram (micros): Count: 5 Average: 1621.2000 StdDev: 1524.20 Min: 293 Median: 480.0000 Max: 3635 Percentiles: P50: 480.00 P75: 3462.50 P99: 3635.00 P99.9: 3635.00 P99.99: 3635.00 ------------------------------------------------------ ( 250, 380 ] 2 40.000% 40.000% ######## ( 380, 580 ] 1 20.000% 60.000% #### ( 2900, 4400 ] 2 40.000% 100.000% ######## ** Level 2 read latency histogram (micros): Count: 61069 Average: 1.7953 StdDev: 6.16 Min: 1 Median: 1.2207 Max: 916 Percentiles: P50: 1.22 P75: 1.67 P99: 4.36 P99.9: 9.31 P99.99: 49.18 ------------------------------------------------------ [ 0, 1 ] 22955 37.589% 37.589% ######## ( 1, 2 ] 34350 56.248% 93.836% ########### ( 2, 3 ] 2000 3.275% 97.111% # ( 3, 4 ] 1063 1.741% 98.852% ( 4, 6 ] 496 0.812% 99.664% ( 6, 10 ] 174 0.285% 99.949% ( 10, 15 ] 20 0.033% 99.982% ( 15, 22 ] 4 0.007% 99.989% ( 34, 51 ] 1 0.002% 99.990% ( 250, 380 ] 3 0.005% 99.995% ( 580, 870 ] 2 0.003% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 45 Average: 1566.3556 StdDev: 1336.64 Min: 62 Median: 1138.7500 Max: 4311 Percentiles: P50: 1138.75 P75: 2618.75 P99: 4311.00 P99.9: 4311.00 P99.99: 4311.00 ------------------------------------------------------ ( 51, 76 ] 1 2.222% 2.222% ( 110, 170 ] 3 6.667% 8.889% # ( 170, 250 ] 3 6.667% 15.556% # ( 250, 380 ] 5 11.111% 26.667% ## ( 380, 580 ] 5 11.111% 37.778% ## ( 580, 870 ] 3 6.667% 44.444% # ( 870, 1300 ] 4 8.889% 53.333% ## ( 1300, 1900 ] 4 8.889% 62.222% ## ( 1900, 2900 ] 8 17.778% 80.000% #### ( 2900, 4400 ] 9 20.000% 100.000% #### ** Level 4 read latency histogram (micros): Count: 30 Average: 1544.5667 StdDev: 1354.45 Min: 88 Median: 1054.2857 Max: 4536 Percentiles: P50: 1054.29 P75: 2650.00 P99: 4536.00 P99.9: 4536.00 P99.99: 4536.00 ------------------------------------------------------ ( 76, 110 ] 2 6.667% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 2 6.667% 16.667% # ( 380, 580 ] 4 13.333% 30.000% ### ( 580, 870 ] 3 10.000% 40.000% ## ( 870, 1300 ] 7 23.333% 63.333% ##### ( 1300, 1900 ] 2 6.667% 70.000% # ( 1900, 2900 ] 2 6.667% 76.667% # ( 2900, 4400 ] 6 20.000% 96.667% #### ( 4400, 6600 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 307.26 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.386 H:M:S, 12.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.386 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/17-17:16:35 ... thread 0: (1000000,2000000) ops and (328603.7,332565.5) ops/second in (3.043179,6.013853) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 1.23 GB 6.3 0.6 0.0 0.6 2.4 1.8 0.0 1.3 75.0 324.7 7.56 6.96 28 0.270 575K 661 0.0 0.0 L1 1/1 3.30 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 235.1 234.7 1.61 1.55 1 1.608 383K 619 0.0 0.0 L2 2/1 54.31 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 250.0 249.8 1.51 1.47 2 0.756 383K 210 0.0 0.0 L3 20/10 1.19 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 238.5 238.5 1.05 0.99 1 1.046 253K 0 0.0 0.0 L4 170/0 9.57 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 150.6 150.6 1.49 1.11 1 1.489 227K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/22 97.98 GB 0.0 1.8 1.0 0.7 3.6 2.9 1.5 1.9 135.9 278.8 13.22 12.08 33 0.401 1824K 1490 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 1.0 0.7 3.6 2.9 1.4 1.9 135.9 278.8 13.22 12.08 33 0.401 1824K 1490 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 1.0 0.7 1.8 1.0 0.0 0.0 229.0 228.8 7.85 7.27 7 1.121 1824K 1490 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 351.8 5.37 4.81 26 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.60 GB write, 589.98 MB/s write, 1.75 GB read, 287.66 MB/s read, 13.2 seconds Interval compaction: 3.60 GB write, 612.58 MB/s write, 1.75 GB read, 298.68 MB/s read, 13.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 385622 Average: 2.1526 StdDev: 11.50 Min: 1 Median: 1.4463 Max: 4210 Percentiles: P50: 1.45 P75: 1.85 P99: 5.69 P99.9: 9.97 P99.99: 14.80 ------------------------------------------------------ [ 0, 1 ] 85812 22.253% 22.253% #### ( 1, 2 ] 239764 62.176% 84.429% ############ ( 2, 3 ] 32048 8.311% 92.740% ## ( 3, 4 ] 15362 3.984% 96.723% # ( 4, 6 ] 10416 2.701% 99.424% # ( 6, 10 ] 1848 0.479% 99.904% ( 10, 15 ] 347 0.090% 99.994% ( 15, 22 ] 32 0.008% 100.002% ( 22, 34 ] 1 0.000% 100.002% ( 34, 51 ] 3 0.001% 100.003% ( 51, 76 ] 3 0.001% 100.004% ( 110, 170 ] 10 0.003% 100.006% ( 170, 250 ] 10 0.003% 100.009% ( 250, 380 ] 14 0.004% 100.012% ( 380, 580 ] 6 0.002% 100.014% ( 580, 870 ] 4 0.001% 100.015% ( 870, 1300 ] 6 0.002% 100.017% ( 1300, 1900 ] 3 0.001% 100.017% ( 1900, 2900 ] 1 0.000% 100.018% ( 2900, 4400 ] 2 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 31 Average: 404.3548 StdDev: 871.38 Min: 1 Median: 1.9286 Max: 3635 Percentiles: P50: 1.93 P75: 334.50 P99: 3635.00 P99.9: 3635.00 P99.99: 3635.00 ------------------------------------------------------ [ 0, 1 ] 9 29.032% 29.032% ###### ( 1, 2 ] 7 22.581% 51.613% ##### ( 2, 3 ] 1 3.226% 54.839% # ( 6, 10 ] 1 3.226% 58.065% # ( 110, 170 ] 1 3.226% 61.290% # ( 170, 250 ] 1 3.226% 64.516% # ( 250, 380 ] 5 16.129% 80.645% ### ( 380, 580 ] 1 3.226% 83.871% # ( 580, 870 ] 2 6.452% 90.323% # ( 1300, 1900 ] 1 3.226% 93.548% # ( 2900, 4400 ] 2 6.452% 100.000% # ** Level 2 read latency histogram (micros): Count: 95684 Average: 1.9137 StdDev: 4.97 Min: 1 Median: 1.3242 Max: 916 Percentiles: P50: 1.32 P75: 1.75 P99: 5.28 P99.9: 9.50 P99.99: 21.43 ------------------------------------------------------ [ 0, 1 ] 29424 30.751% 30.751% ###### ( 1, 2 ] 56807 59.369% 90.121% ############ ( 2, 3 ] 4794 5.010% 95.131% # ( 3, 4 ] 2724 2.847% 97.978% # ( 4, 6 ] 1527 1.596% 99.574% ( 6, 10 ] 357 0.373% 99.947% ( 10, 15 ] 35 0.037% 99.983% ( 15, 22 ] 7 0.007% 99.991% ( 22, 34 ] 1 0.001% 99.992% ( 34, 51 ] 2 0.002% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 186411 Average: 3.2715 StdDev: 34.66 Min: 0 Median: 1.5907 Max: 4311 Percentiles: P50: 1.59 P75: 2.02 P99: 8.95 P99.9: 158.60 P99.99: 453.64 ------------------------------------------------------ [ 0, 1 ] 26653 14.298% 14.298% ### ( 1, 2 ] 112666 60.440% 74.738% ############ ( 2, 3 ] 24990 13.406% 88.143% ### ( 3, 4 ] 9958 5.342% 93.485% # ( 4, 6 ] 8120 4.356% 97.841% # ( 6, 10 ] 2928 1.571% 99.412% ( 10, 15 ] 502 0.269% 99.681% ( 15, 22 ] 90 0.048% 99.730% ( 22, 34 ] 24 0.013% 99.743% ( 34, 51 ] 5 0.003% 99.745% ( 51, 76 ] 5 0.003% 99.748% ( 76, 110 ] 91 0.049% 99.797% ( 110, 170 ] 239 0.128% 99.925% ( 170, 250 ] 60 0.032% 99.957% ( 250, 380 ] 48 0.026% 99.983% ( 380, 580 ] 39 0.021% 100.004% ( 580, 870 ] 18 0.010% 100.013% ( 870, 1300 ] 10 0.005% 100.019% ( 1300, 1900 ] 4 0.002% 100.021% ( 1900, 2900 ] 8 0.004% 100.025% ( 2900, 4400 ] 9 0.005% 100.030% ** Level 4 read latency histogram (micros): Count: 320 Average: 149.9000 StdDev: 611.20 Min: 1 Median: 1.8099 Max: 4536 Percentiles: P50: 1.81 P75: 10.11 P99: 3850.00 P99.9: 4536.00 P99.99: 4536.00 ------------------------------------------------------ [ 0, 1 ] 62 19.375% 19.375% #### ( 1, 2 ] 121 37.812% 57.188% ######## ( 2, 3 ] 39 12.188% 69.375% ## ( 3, 4 ] 4 1.250% 70.625% ( 4, 6 ] 7 2.188% 72.812% ( 6, 10 ] 6 1.875% 74.688% ( 10, 15 ] 45 14.062% 88.750% ### ( 15, 22 ] 4 1.250% 90.000% ( 76, 110 ] 2 0.625% 90.625% ( 110, 170 ] 1 0.312% 90.938% ( 170, 250 ] 1 0.312% 91.250% ( 250, 380 ] 3 0.938% 92.188% ( 380, 580 ] 4 1.250% 93.438% ( 580, 870 ] 3 0.938% 94.375% ( 870, 1300 ] 7 2.188% 96.562% ( 1300, 1900 ] 2 0.625% 97.188% ( 1900, 2900 ] 2 0.625% 97.812% ( 2900, 4400 ] 6 1.875% 99.688% ( 4400, 6600 ] 1 0.312% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1000.2000 StdDev: 1148.71 Min: 132 Median: 580.0000 Max: 4361 Percentiles: P50: 580.00 P75: 1156.67 P99: 4250.00 P99.9: 4361.00 P99.99: 4361.00 ------------------------------------------------------ ( 110, 170 ] 4 20.000% 20.000% #### ( 170, 250 ] 3 15.000% 35.000% ### ( 250, 380 ] 2 10.000% 45.000% ## ( 380, 580 ] 1 5.000% 50.000% # ( 580, 870 ] 3 15.000% 65.000% ### ( 870, 1300 ] 3 15.000% 80.000% ### ( 1900, 2900 ] 2 10.000% 90.000% ## ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 6.2 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 315.12 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.801 H:M:S, 12.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.416 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/10/17-17:16:38 ... thread 0: (1000000,3000000) ops and (335501.9,333538.6) ops/second in (2.980609,8.994462) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 1.29 GB 107.0 1.4 0.0 1.4 4.2 2.8 0.0 1.5 106.4 314.4 13.62 12.65 44 0.310 1471K 1650 0.0 0.0 L1 9/0 881.37 MB 88.1 1.2 1.2 0.0 1.2 1.2 0.2 1.0 230.1 229.4 5.49 5.33 2 2.744 1281K 3660 0.0 0.0 L2 1/0 52.10 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 250.0 249.8 1.51 1.47 2 0.756 383K 210 0.0 0.0 L3 20/0 956.88 MB 1.0 1.1 0.2 0.8 1.1 0.2 0.4 4.4 240.4 239.9 4.65 4.33 2 2.327 1136K 2241 0.0 0.0 L4 170/0 9.51 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 150.6 150.6 1.49 1.11 1 1.489 227K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/4 98.90 GB 0.0 4.3 1.9 2.4 7.1 4.6 2.1 2.6 165.6 271.2 26.76 24.90 51 0.525 4501K 7761 0.0 0.0 Int 0/0 0.00 KB 0.0 4.3 1.9 2.4 7.1 4.6 2.0 2.6 165.6 271.2 26.76 24.90 51 0.525 4501K 7761 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.3 1.9 2.4 4.3 1.9 0.0 0.0 236.8 236.4 18.72 17.72 12 1.560 4501K 7761 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 352.3 8.05 7.18 39 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.09 GB write, 786.79 MB/s write, 4.33 GB read, 480.42 MB/s read, 26.8 seconds Interval compaction: 7.09 GB write, 806.95 MB/s write, 4.33 GB read, 492.73 MB/s read, 26.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 794484 Average: 2.2206 StdDev: 11.97 Min: 1 Median: 1.4951 Max: 4622 Percentiles: P50: 1.50 P75: 1.89 P99: 5.71 P99.9: 9.63 P99.99: 13.12 ------------------------------------------------------ [ 0, 1 ] 146021 18.379% 18.379% #### ( 1, 2 ] 507373 63.862% 82.241% ############# ( 2, 3 ] 74864 9.423% 91.664% ## ( 3, 4 ] 36376 4.579% 96.243% # ( 4, 6 ] 25673 3.231% 99.474% # ( 6, 10 ] 3724 0.469% 99.943% ( 10, 15 ] 598 0.075% 100.018% ( 15, 22 ] 58 0.007% 100.026% ( 22, 34 ] 1 0.000% 100.026% ( 34, 51 ] 3 0.000% 100.026% ( 51, 76 ] 5 0.001% 100.027% ( 76, 110 ] 1 0.000% 100.027% ( 110, 170 ] 13 0.002% 100.028% ( 170, 250 ] 18 0.002% 100.031% ( 250, 380 ] 21 0.003% 100.033% ( 380, 580 ] 9 0.001% 100.034% ( 580, 870 ] 7 0.001% 100.035% ( 870, 1300 ] 9 0.001% 100.037% ( 1300, 1900 ] 7 0.001% 100.037% ( 1900, 2900 ] 2 0.000% 100.038% ( 2900, 4400 ] 4 0.001% 100.038% ( 4400, 6600 ] 1 0.000% 100.038% ** Level 1 read latency histogram (micros): Count: 29190 Average: 3.4721 StdDev: 37.41 Min: 0 Median: 1.5422 Max: 3635 Percentiles: P50: 1.54 P75: 1.93 P99: 8.89 P99.9: 317.37 P99.99: 1716.20 ------------------------------------------------------ [ 0, 1 ] 4332 14.841% 14.841% ### ( 1, 2 ] 18927 64.841% 79.681% ############# ( 2, 3 ] 2661 9.116% 88.798% ## ( 3, 4 ] 1557 5.334% 94.132% # ( 4, 6 ] 1050 3.597% 97.729% # ( 6, 10 ] 514 1.761% 99.490% ( 10, 15 ] 44 0.151% 99.640% ( 15, 22 ] 1 0.003% 99.644% ( 22, 34 ] 1 0.003% 99.647% ( 34, 51 ] 2 0.007% 99.654% ( 76, 110 ] 37 0.127% 99.781% ( 110, 170 ] 16 0.055% 99.836% ( 170, 250 ] 10 0.034% 99.870% ( 250, 380 ] 17 0.058% 99.928% ( 380, 580 ] 10 0.034% 99.962% ( 580, 870 ] 3 0.010% 99.973% ( 870, 1300 ] 3 0.010% 99.983% ( 1300, 1900 ] 3 0.010% 99.993% ( 2900, 4400 ] 2 0.007% 100.000% ** Level 2 read latency histogram (micros): Count: 95906 Average: 1.9157 StdDev: 4.96 Min: 1 Median: 1.3256 Max: 916 Percentiles: P50: 1.33 P75: 1.75 P99: 5.29 P99.9: 9.50 P99.99: 21.41 ------------------------------------------------------ [ 0, 1 ] 29425 30.681% 30.681% ###### ( 1, 2 ] 56903 59.332% 90.013% ############ ( 2, 3 ] 4890 5.099% 95.112% # ( 3, 4 ] 2742 2.859% 97.971% # ( 4, 6 ] 1536 1.602% 99.572% ( 6, 10 ] 359 0.374% 99.947% ( 10, 15 ] 35 0.036% 99.983% ( 15, 22 ] 7 0.007% 99.991% ( 22, 34 ] 1 0.001% 99.992% ( 34, 51 ] 2 0.002% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 248987 Average: 3.2339 StdDev: 31.45 Min: 0 Median: 1.5911 Max: 4311 Percentiles: P50: 1.59 P75: 2.01 P99: 8.93 P99.9: 166.65 P99.99: 522.72 ------------------------------------------------------ [ 0, 1 ] 34866 14.003% 14.003% ### ( 1, 2 ] 151634 60.900% 74.904% ############ ( 2, 3 ] 31817 12.779% 87.682% ### ( 3, 4 ] 14089 5.659% 93.341% # ( 4, 6 ] 11088 4.453% 97.794% # ( 6, 10 ] 4097 1.645% 99.439% ( 10, 15 ] 626 0.251% 99.691% ( 15, 22 ] 100 0.040% 99.731% ( 22, 34 ] 25 0.010% 99.741% ( 34, 51 ] 6 0.002% 99.743% ( 51, 76 ] 6 0.002% 99.746% ( 76, 110 ] 114 0.046% 99.792% ( 110, 170 ] 286 0.115% 99.906% ( 170, 250 ] 92 0.037% 99.943% ( 250, 380 ] 74 0.030% 99.973% ( 380, 580 ] 59 0.024% 99.997% ( 580, 870 ] 26 0.010% 100.007% ( 870, 1300 ] 15 0.006% 100.013% ( 1300, 1900 ] 5 0.002% 100.015% ( 1900, 2900 ] 8 0.003% 100.018% ( 2900, 4400 ] 9 0.004% 100.022% ** Level 4 read latency histogram (micros): Count: 320 Average: 149.9000 StdDev: 611.20 Min: 1 Median: 1.8099 Max: 4536 Percentiles: P50: 1.81 P75: 10.11 P99: 3850.00 P99.9: 4536.00 P99.99: 4536.00 ------------------------------------------------------ [ 0, 1 ] 62 19.375% 19.375% #### ( 1, 2 ] 121 37.812% 57.188% ######## ( 2, 3 ] 39 12.188% 69.375% ## ( 3, 4 ] 4 1.250% 70.625% ( 4, 6 ] 7 2.188% 72.812% ( 6, 10 ] 6 1.875% 74.688% ( 10, 15 ] 45 14.062% 88.750% ### ( 15, 22 ] 4 1.250% 90.000% ( 76, 110 ] 2 0.625% 90.625% ( 110, 170 ] 1 0.312% 90.938% ( 170, 250 ] 1 0.312% 91.250% ( 250, 380 ] 3 0.938% 92.188% ( 380, 580 ] 4 1.250% 93.438% ( 580, 870 ] 3 0.938% 94.375% ( 870, 1300 ] 7 2.188% 96.562% ( 1300, 1900 ] 2 0.625% 97.188% ( 1900, 2900 ] 2 0.625% 97.812% ( 2900, 4400 ] 6 1.875% 99.688% ( 4400, 6600 ] 1 0.312% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 802.2500 StdDev: 980.98 Min: 98 Median: 315.0000 Max: 4361 Percentiles: P50: 315.00 P75: 1085.00 P99: 4100.00 P99.9: 4361.00 P99.99: 4361.00 ------------------------------------------------------ ( 76, 110 ] 6 15.000% 15.000% ### ( 110, 170 ] 10 25.000% 40.000% ##### ( 170, 250 ] 3 7.500% 47.500% ## ( 250, 380 ] 2 5.000% 52.500% # ( 380, 580 ] 3 7.500% 60.000% ## ( 580, 870 ] 4 10.000% 70.000% ## ( 870, 1300 ] 4 10.000% 80.000% ## ( 1300, 1900 ] 2 5.000% 85.000% # ( 1900, 2900 ] 4 10.000% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.2 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 319.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.169 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.368 H:M:S, 12.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/10/17-17:16:41 ... thread 0: (1000000,4000000) ops and (330466.5,332765.2) ops/second in (3.026025,12.020487) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 2.27 GB 56.6 2.2 0.0 2.2 6.0 3.8 0.0 1.6 115.7 311.7 19.60 18.26 61 0.321 2302K 2487 0.0 0.0 L1 9/9 881.37 MB 0.0 1.2 1.2 0.0 1.2 1.2 0.2 1.0 230.1 229.4 5.49 5.33 2 2.744 1281K 3660 0.0 0.0 L2 1/0 52.10 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 250.0 249.8 1.51 1.47 2 0.756 383K 210 0.0 0.0 L3 20/0 956.88 MB 1.0 1.1 0.2 0.8 1.1 0.2 0.4 4.4 240.4 239.9 4.65 4.33 2 2.327 1136K 2241 0.0 0.0 L4 170/0 9.51 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 150.6 150.6 1.49 1.11 1 1.489 227K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1262/21 99.88 GB 0.0 5.1 1.9 3.2 8.9 5.6 2.1 2.4 160.4 277.5 32.74 30.50 68 0.481 5332K 8598 0.0 0.0 Int 0/0 0.00 KB 0.0 5.1 1.9 3.2 8.9 5.6 2.0 2.4 160.4 277.5 32.74 30.50 68 0.481 5332K 8598 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.1 1.9 3.2 5.1 1.9 0.0 0.0 240.4 240.0 21.85 20.78 15 1.457 5332K 8598 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 352.8 10.89 9.72 53 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.87 GB write, 741.51 MB/s write, 5.13 GB read, 428.61 MB/s read, 32.7 seconds Interval compaction: 8.87 GB write, 755.72 MB/s write, 5.13 GB read, 436.83 MB/s read, 32.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1057617 Average: 2.2032 StdDev: 12.94 Min: 0 Median: 1.4779 Max: 4622 Percentiles: P50: 1.48 P75: 1.87 P99: 5.67 P99.9: 9.71 P99.99: 13.57 ------------------------------------------------------ [ 0, 1 ] 205026 19.386% 19.386% #### ( 1, 2 ] 677581 64.067% 83.452% ############# ( 2, 3 ] 94035 8.891% 92.344% ## ( 3, 4 ] 44783 4.234% 96.578% # ( 4, 6 ] 30624 2.896% 99.474% # ( 6, 10 ] 4872 0.461% 99.934% ( 10, 15 ] 831 0.079% 100.013% ( 15, 22 ] 73 0.007% 100.020% ( 22, 34 ] 3 0.000% 100.020% ( 34, 51 ] 4 0.000% 100.020% ( 51, 76 ] 7 0.001% 100.021% ( 76, 110 ] 16 0.002% 100.023% ( 110, 170 ] 26 0.002% 100.025% ( 170, 250 ] 30 0.003% 100.028% ( 250, 380 ] 32 0.003% 100.031% ( 380, 580 ] 13 0.001% 100.032% ( 580, 870 ] 12 0.001% 100.033% ( 870, 1300 ] 15 0.001% 100.035% ( 1300, 1900 ] 8 0.001% 100.035% ( 1900, 2900 ] 3 0.000% 100.036% ( 2900, 4400 ] 8 0.001% 100.036% ( 4400, 6600 ] 1 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 89052 Average: 2.6551 StdDev: 22.44 Min: 0 Median: 1.4543 Max: 3635 Percentiles: P50: 1.45 P75: 1.85 P99: 8.21 P99.9: 149.94 P99.99: 880.19 ------------------------------------------------------ [ 0, 1 ] 18674 20.970% 20.970% #### ( 1, 2 ] 56906 63.902% 84.872% ############# ( 2, 3 ] 6654 7.472% 92.344% # ( 3, 4 ] 3226 3.623% 95.966% # ( 4, 6 ] 2032 2.282% 98.248% ( 6, 10 ] 1214 1.363% 99.611% ( 10, 15 ] 157 0.176% 99.788% ( 15, 22 ] 11 0.012% 99.800% ( 22, 34 ] 1 0.001% 99.801% ( 34, 51 ] 2 0.002% 99.803% ( 76, 110 ] 54 0.061% 99.864% ( 110, 170 ] 48 0.054% 99.918% ( 170, 250 ] 22 0.025% 99.943% ( 250, 380 ] 25 0.028% 99.971% ( 380, 580 ] 14 0.016% 99.987% ( 580, 870 ] 3 0.003% 99.990% ( 870, 1300 ] 4 0.004% 99.994% ( 1300, 1900 ] 3 0.003% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 95906 Average: 1.9157 StdDev: 4.96 Min: 1 Median: 1.3256 Max: 916 Percentiles: P50: 1.33 P75: 1.75 P99: 5.29 P99.9: 9.50 P99.99: 21.41 ------------------------------------------------------ [ 0, 1 ] 29425 30.681% 30.681% ###### ( 1, 2 ] 56903 59.332% 90.013% ############ ( 2, 3 ] 4890 5.099% 95.112% # ( 3, 4 ] 2742 2.859% 97.971% # ( 4, 6 ] 1536 1.602% 99.572% ( 6, 10 ] 359 0.374% 99.947% ( 10, 15 ] 35 0.036% 99.983% ( 15, 22 ] 7 0.007% 99.991% ( 22, 34 ] 1 0.001% 99.992% ( 34, 51 ] 2 0.002% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 248987 Average: 3.2339 StdDev: 31.45 Min: 0 Median: 1.5911 Max: 4311 Percentiles: P50: 1.59 P75: 2.01 P99: 8.93 P99.9: 166.65 P99.99: 522.72 ------------------------------------------------------ [ 0, 1 ] 34866 14.003% 14.003% ### ( 1, 2 ] 151634 60.900% 74.904% ############ ( 2, 3 ] 31817 12.779% 87.682% ### ( 3, 4 ] 14089 5.659% 93.341% # ( 4, 6 ] 11088 4.453% 97.794% # ( 6, 10 ] 4097 1.645% 99.439% ( 10, 15 ] 626 0.251% 99.691% ( 15, 22 ] 100 0.040% 99.731% ( 22, 34 ] 25 0.010% 99.741% ( 34, 51 ] 6 0.002% 99.743% ( 51, 76 ] 6 0.002% 99.746% ( 76, 110 ] 114 0.046% 99.792% ( 110, 170 ] 286 0.115% 99.906% ( 170, 250 ] 92 0.037% 99.943% ( 250, 380 ] 74 0.030% 99.973% ( 380, 580 ] 59 0.024% 99.997% ( 580, 870 ] 26 0.010% 100.007% ( 870, 1300 ] 15 0.006% 100.013% ( 1300, 1900 ] 5 0.002% 100.015% ( 1900, 2900 ] 8 0.003% 100.018% ( 2900, 4400 ] 9 0.004% 100.022% ** Level 4 read latency histogram (micros): Count: 320 Average: 149.9000 StdDev: 611.20 Min: 1 Median: 1.8099 Max: 4536 Percentiles: P50: 1.81 P75: 10.11 P99: 3850.00 P99.9: 4536.00 P99.99: 4536.00 ------------------------------------------------------ [ 0, 1 ] 62 19.375% 19.375% #### ( 1, 2 ] 121 37.812% 57.188% ######## ( 2, 3 ] 39 12.188% 69.375% ## ( 3, 4 ] 4 1.250% 70.625% ( 4, 6 ] 7 2.188% 72.812% ( 6, 10 ] 6 1.875% 74.688% ( 10, 15 ] 45 14.062% 88.750% ### ( 15, 22 ] 4 1.250% 90.000% ( 76, 110 ] 2 0.625% 90.625% ( 110, 170 ] 1 0.312% 90.938% ( 170, 250 ] 1 0.312% 91.250% ( 250, 380 ] 3 0.938% 92.188% ( 380, 580 ] 4 1.250% 93.438% ( 580, 870 ] 3 0.938% 94.375% ( 870, 1300 ] 7 2.188% 96.562% ( 1300, 1900 ] 2 0.625% 97.188% ( 1900, 2900 ] 2 0.625% 97.812% ( 2900, 4400 ] 6 1.875% 99.688% ( 4400, 6600 ] 1 0.312% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 802.2500 StdDev: 980.98 Min: 98 Median: 315.0000 Max: 4361 Percentiles: P50: 315.00 P75: 1085.00 P99: 4100.00 P99.9: 4361.00 P99.99: 4361.00 ------------------------------------------------------ ( 76, 110 ] 6 15.000% 15.000% ### ( 110, 170 ] 10 25.000% 40.000% ##### ( 170, 250 ] 3 7.500% 47.500% ## ( 250, 380 ] 2 5.000% 52.500% # ( 380, 580 ] 3 7.500% 60.000% ## ( 580, 870 ] 4 10.000% 70.000% ## ( 870, 1300 ] 4 10.000% 80.000% ## ( 1300, 1900 ] 2 5.000% 85.000% # ( 1900, 2900 ] 4 10.000% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.3 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 321.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.568 H:M:S, 12.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.399 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/17-17:16:44 ... thread 0: (1000000,5000000) ops and (312695.6,328547.8) ops/second in (3.197998,15.218485) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 3.26 GB 157.3 3.0 0.0 3.0 7.7 4.7 0.0 1.6 121.1 311.2 25.49 23.83 78 0.327 3134K 3396 0.0 0.0 L1 9/9 881.37 MB 0.0 1.2 1.2 0.0 1.2 1.2 0.2 1.0 230.1 229.4 5.49 5.33 2 2.744 1281K 3660 0.0 0.0 L2 1/0 52.10 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 250.0 249.8 1.51 1.47 2 0.756 383K 210 0.0 0.0 L3 20/0 956.88 MB 1.0 1.1 0.2 0.8 1.1 0.2 0.4 4.4 240.4 239.9 4.65 4.33 2 2.327 1136K 2241 0.0 0.0 L4 170/0 9.51 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 150.6 150.6 1.49 1.11 1 1.489 227K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1267/21 100.86 GB 0.0 5.9 1.9 4.0 10.7 6.6 2.1 2.2 157.1 282.4 38.64 36.07 85 0.455 6164K 9507 0.0 0.0 Int 0/0 0.00 KB 0.0 5.9 1.9 4.0 10.7 6.6 2.0 2.2 157.1 282.4 38.64 36.07 85 0.455 6164K 9507 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.9 1.9 4.0 5.9 1.9 0.0 0.0 243.2 242.9 24.96 23.84 18 1.386 6164K 9507 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 354.6 13.68 12.23 67 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.5 total, 15.2 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.66 GB write, 706.21 MB/s write, 5.93 GB read, 392.91 MB/s read, 38.6 seconds Interval compaction: 10.66 GB write, 716.90 MB/s write, 5.93 GB read, 398.85 MB/s read, 38.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 19, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1400190 Average: 2.2196 StdDev: 13.14 Min: 0 Median: 1.4737 Max: 4622 Percentiles: P50: 1.47 P75: 1.86 P99: 5.65 P99.9: 9.78 P99.99: 14.35 ------------------------------------------------------ [ 0, 1 ] 270327 19.306% 19.306% #### ( 1, 2 ] 907210 64.792% 84.098% ############# ( 2, 3 ] 121121 8.650% 92.749% ## ( 3, 4 ] 56688 4.049% 96.797% # ( 4, 6 ] 37330 2.666% 99.463% # ( 6, 10 ] 6468 0.462% 99.925% ( 10, 15 ] 1044 0.075% 100.000% ( 15, 22 ] 88 0.006% 100.006% ( 22, 34 ] 5 0.000% 100.006% ( 34, 51 ] 4 0.000% 100.007% ( 51, 76 ] 8 0.001% 100.007% ( 76, 110 ] 50 0.004% 100.011% ( 110, 170 ] 116 0.008% 100.019% ( 170, 250 ] 64 0.005% 100.024% ( 250, 380 ] 62 0.004% 100.028% ( 380, 580 ] 32 0.002% 100.030% ( 580, 870 ] 27 0.002% 100.032% ( 870, 1300 ] 21 0.001% 100.034% ( 1300, 1900 ] 12 0.001% 100.035% ( 1900, 2900 ] 7 0.000% 100.035% ( 2900, 4400 ] 9 0.001% 100.036% ( 4400, 6600 ] 1 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 157212 Average: 2.6322 StdDev: 18.12 Min: 0 Median: 1.4743 Max: 3635 Percentiles: P50: 1.47 P75: 1.85 P99: 8.36 P99.9: 147.80 P99.99: 558.23 ------------------------------------------------------ [ 0, 1 ] 29490 18.758% 18.758% #### ( 1, 2 ] 103555 65.870% 84.628% ############# ( 2, 3 ] 12276 7.809% 92.436% ## ( 3, 4 ] 5447 3.465% 95.901% # ( 4, 6 ] 3522 2.240% 98.141% ( 6, 10 ] 2284 1.453% 99.594% ( 10, 15 ] 244 0.155% 99.749% ( 15, 22 ] 22 0.014% 99.763% ( 22, 34 ] 3 0.002% 99.765% ( 34, 51 ] 2 0.001% 99.767% ( 51, 76 ] 2 0.001% 99.768% ( 76, 110 ] 124 0.079% 99.847% ( 110, 170 ] 133 0.085% 99.931% ( 170, 250 ] 40 0.025% 99.957% ( 250, 380 ] 30 0.019% 99.976% ( 380, 580 ] 25 0.016% 99.992% ( 580, 870 ] 4 0.003% 99.994% ( 870, 1300 ] 4 0.003% 99.997% ( 1300, 1900 ] 3 0.002% 99.999% ( 2900, 4400 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 95906 Average: 1.9157 StdDev: 4.96 Min: 1 Median: 1.3256 Max: 916 Percentiles: P50: 1.33 P75: 1.75 P99: 5.29 P99.9: 9.50 P99.99: 21.41 ------------------------------------------------------ [ 0, 1 ] 29425 30.681% 30.681% ###### ( 1, 2 ] 56903 59.332% 90.013% ############ ( 2, 3 ] 4890 5.099% 95.112% # ( 3, 4 ] 2742 2.859% 97.971% # ( 4, 6 ] 1536 1.602% 99.572% ( 6, 10 ] 359 0.374% 99.947% ( 10, 15 ] 35 0.036% 99.983% ( 15, 22 ] 7 0.007% 99.991% ( 22, 34 ] 1 0.001% 99.992% ( 34, 51 ] 2 0.002% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 248987 Average: 3.2339 StdDev: 31.45 Min: 0 Median: 1.5911 Max: 4311 Percentiles: P50: 1.59 P75: 2.01 P99: 8.93 P99.9: 166.65 P99.99: 522.72 ------------------------------------------------------ [ 0, 1 ] 34866 14.003% 14.003% ### ( 1, 2 ] 151634 60.900% 74.904% ############ ( 2, 3 ] 31817 12.779% 87.682% ### ( 3, 4 ] 14089 5.659% 93.341% # ( 4, 6 ] 11088 4.453% 97.794% # ( 6, 10 ] 4097 1.645% 99.439% ( 10, 15 ] 626 0.251% 99.691% ( 15, 22 ] 100 0.040% 99.731% ( 22, 34 ] 25 0.010% 99.741% ( 34, 51 ] 6 0.002% 99.743% ( 51, 76 ] 6 0.002% 99.746% ( 76, 110 ] 114 0.046% 99.792% ( 110, 170 ] 286 0.115% 99.906% ( 170, 250 ] 92 0.037% 99.943% ( 250, 380 ] 74 0.030% 99.973% ( 380, 580 ] 59 0.024% 99.997% ( 580, 870 ] 26 0.010% 100.007% ( 870, 1300 ] 15 0.006% 100.013% ( 1300, 1900 ] 5 0.002% 100.015% ( 1900, 2900 ] 8 0.003% 100.018% ( 2900, 4400 ] 9 0.004% 100.022% ** Level 4 read latency histogram (micros): Count: 320 Average: 149.9000 StdDev: 611.20 Min: 1 Median: 1.8099 Max: 4536 Percentiles: P50: 1.81 P75: 10.11 P99: 3850.00 P99.9: 4536.00 P99.99: 4536.00 ------------------------------------------------------ [ 0, 1 ] 62 19.375% 19.375% #### ( 1, 2 ] 121 37.812% 57.188% ######## ( 2, 3 ] 39 12.188% 69.375% ## ( 3, 4 ] 4 1.250% 70.625% ( 4, 6 ] 7 2.188% 72.812% ( 6, 10 ] 6 1.875% 74.688% ( 10, 15 ] 45 14.062% 88.750% ### ( 15, 22 ] 4 1.250% 90.000% ( 76, 110 ] 2 0.625% 90.625% ( 110, 170 ] 1 0.312% 90.938% ( 170, 250 ] 1 0.312% 91.250% ( 250, 380 ] 3 0.938% 92.188% ( 380, 580 ] 4 1.250% 93.438% ( 580, 870 ] 3 0.938% 94.375% ( 870, 1300 ] 7 2.188% 96.562% ( 1300, 1900 ] 2 0.625% 97.188% ( 1900, 2900 ] 2 0.625% 97.812% ( 2900, 4400 ] 6 1.875% 99.688% ( 4400, 6600 ] 1 0.312% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 802.2500 StdDev: 980.98 Min: 98 Median: 315.0000 Max: 4361 Percentiles: P50: 315.00 P75: 1085.00 P99: 4100.00 P99.9: 4361.00 P99.99: 4361.00 ------------------------------------------------------ ( 76, 110 ] 6 15.000% 15.000% ### ( 110, 170 ] 10 25.000% 40.000% ##### ( 170, 250 ] 3 7.500% 47.500% ## ( 250, 380 ] 2 5.000% 52.500% # ( 380, 580 ] 3 7.500% 60.000% ## ( 580, 870 ] 4 10.000% 70.000% ## ( 870, 1300 ] 4 10.000% 80.000% ## ( 1300, 1900 ] 2 5.000% 85.000% # ( 1900, 2900 ] 4 10.000% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.5 total, 3.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 318.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.144 H:M:S, 13.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 307.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.576 H:M:S, 18.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/17-17:16:49 ... thread 0: (1000000,6000000) ops and (190210.1,293028.4) ops/second in (5.257343,20.475828) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 2.77 GB 6.3 4.1 0.0 4.1 9.7 5.7 0.0 1.7 129.3 309.3 32.17 30.15 97 0.332 4221K 4540 0.0 0.0 L1 19/19 2.25 GB 0.0 3.5 2.6 0.9 3.5 2.6 0.2 1.3 228.7 227.1 15.70 15.17 3 5.234 3646K 25K 0.0 0.0 L2 1/0 52.10 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 250.0 249.8 1.51 1.47 2 0.756 383K 210 0.0 0.0 L3 20/0 956.88 MB 1.0 1.1 0.2 0.8 1.1 0.2 0.4 4.4 240.4 239.9 4.65 4.33 2 2.327 1136K 2241 0.0 0.0 L4 170/0 9.51 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 150.6 150.6 1.49 1.11 1 1.489 227K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1272/32 101.76 GB 0.0 9.2 3.3 6.0 14.9 8.9 2.1 2.6 170.6 274.3 55.53 52.23 105 0.529 9616K 32K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.2 3.3 6.0 14.9 8.9 2.0 2.6 170.6 274.3 55.53 52.23 105 0.529 9616K 32K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.2 3.3 6.0 9.2 3.3 0.0 0.0 241.5 240.6 39.22 37.65 23 1.705 9616K 32K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 355.5 16.30 14.58 82 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.7 total, 20.5 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.88 GB write, 735.60 MB/s write, 9.25 GB read, 457.34 MB/s read, 55.5 seconds Interval compaction: 14.88 GB write, 743.88 MB/s write, 9.25 GB read, 462.48 MB/s read, 55.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 19, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1805710 Average: 2.1930 StdDev: 12.71 Min: 0 Median: 1.4505 Max: 4622 Percentiles: P50: 1.45 P75: 1.84 P99: 5.66 P99.9: 9.90 P99.99: 20.92 ------------------------------------------------------ [ 0, 1 ] 377943 20.930% 20.930% #### ( 1, 2 ] 1165216 64.530% 85.460% ############# ( 2, 3 ] 142556 7.895% 93.355% ## ( 3, 4 ] 66871 3.703% 97.058% # ( 4, 6 ] 42326 2.344% 99.402% ( 6, 10 ] 9231 0.511% 99.913% ( 10, 15 ] 1279 0.071% 99.984% ( 15, 22 ] 127 0.007% 99.991% ( 22, 34 ] 9 0.000% 99.992% ( 34, 51 ] 6 0.000% 99.992% ( 51, 76 ] 22 0.001% 99.993% ( 76, 110 ] 128 0.007% 100.000% ( 110, 170 ] 212 0.012% 100.012% ( 170, 250 ] 108 0.006% 100.018% ( 250, 380 ] 73 0.004% 100.022% ( 380, 580 ] 58 0.003% 100.025% ( 580, 870 ] 41 0.002% 100.027% ( 870, 1300 ] 24 0.001% 100.029% ( 1300, 1900 ] 14 0.001% 100.030% ( 1900, 2900 ] 11 0.001% 100.030% ( 2900, 4400 ] 9 0.000% 100.031% ( 4400, 6600 ] 1 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 253317 Average: 2.7272 StdDev: 19.52 Min: 0 Median: 1.4430 Max: 3635 Percentiles: P50: 1.44 P75: 1.83 P99: 8.40 P99.9: 165.50 P99.99: 842.95 ------------------------------------------------------ [ 0, 1 ] 53496 21.118% 21.118% #### ( 1, 2 ] 165141 65.191% 86.310% ############# ( 2, 3 ] 17349 6.849% 93.158% # ( 3, 4 ] 7804 3.081% 96.239% # ( 4, 6 ] 4875 1.924% 98.164% ( 6, 10 ] 3525 1.392% 99.555% ( 10, 15 ] 355 0.140% 99.695% ( 15, 22 ] 36 0.014% 99.709% ( 22, 34 ] 5 0.002% 99.711% ( 34, 51 ] 3 0.001% 99.713% ( 51, 76 ] 7 0.003% 99.715% ( 76, 110 ] 254 0.100% 99.816% ( 110, 170 ] 231 0.091% 99.907% ( 170, 250 ] 79 0.031% 99.938% ( 250, 380 ] 58 0.023% 99.961% ( 380, 580 ] 51 0.020% 99.981% ( 580, 870 ] 25 0.010% 99.991% ( 870, 1300 ] 13 0.005% 99.996% ( 1300, 1900 ] 8 0.003% 99.999% ( 2900, 4400 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 95906 Average: 1.9157 StdDev: 4.96 Min: 1 Median: 1.3256 Max: 916 Percentiles: P50: 1.33 P75: 1.75 P99: 5.29 P99.9: 9.50 P99.99: 21.41 ------------------------------------------------------ [ 0, 1 ] 29425 30.681% 30.681% ###### ( 1, 2 ] 56903 59.332% 90.013% ############ ( 2, 3 ] 4890 5.099% 95.112% # ( 3, 4 ] 2742 2.859% 97.971% # ( 4, 6 ] 1536 1.602% 99.572% ( 6, 10 ] 359 0.374% 99.947% ( 10, 15 ] 35 0.036% 99.983% ( 15, 22 ] 7 0.007% 99.991% ( 22, 34 ] 1 0.001% 99.992% ( 34, 51 ] 2 0.002% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 580, 870 ] 2 0.002% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 248987 Average: 3.2339 StdDev: 31.45 Min: 0 Median: 1.5911 Max: 4311 Percentiles: P50: 1.59 P75: 2.01 P99: 8.93 P99.9: 166.65 P99.99: 522.72 ------------------------------------------------------ [ 0, 1 ] 34866 14.003% 14.003% ### ( 1, 2 ] 151634 60.900% 74.904% ############ ( 2, 3 ] 31817 12.779% 87.682% ### ( 3, 4 ] 14089 5.659% 93.341% # ( 4, 6 ] 11088 4.453% 97.794% # ( 6, 10 ] 4097 1.645% 99.439% ( 10, 15 ] 626 0.251% 99.691% ( 15, 22 ] 100 0.040% 99.731% ( 22, 34 ] 25 0.010% 99.741% ( 34, 51 ] 6 0.002% 99.743% ( 51, 76 ] 6 0.002% 99.746% ( 76, 110 ] 114 0.046% 99.792% ( 110, 170 ] 286 0.115% 99.906% ( 170, 250 ] 92 0.037% 99.943% ( 250, 380 ] 74 0.030% 99.973% ( 380, 580 ] 59 0.024% 99.997% ( 580, 870 ] 26 0.010% 100.007% ( 870, 1300 ] 15 0.006% 100.013% ( 1300, 1900 ] 5 0.002% 100.015% ( 1900, 2900 ] 8 0.003% 100.018% ( 2900, 4400 ] 9 0.004% 100.022% ** Level 4 read latency histogram (micros): Count: 320 Average: 149.9000 StdDev: 611.20 Min: 1 Median: 1.8099 Max: 4536 Percentiles: P50: 1.81 P75: 10.11 P99: 3850.00 P99.9: 4536.00 P99.99: 4536.00 ------------------------------------------------------ [ 0, 1 ] 62 19.375% 19.375% #### ( 1, 2 ] 121 37.812% 57.188% ######## ( 2, 3 ] 39 12.188% 69.375% ## ( 3, 4 ] 4 1.250% 70.625% ( 4, 6 ] 7 2.188% 72.812% ( 6, 10 ] 6 1.875% 74.688% ( 10, 15 ] 45 14.062% 88.750% ### ( 15, 22 ] 4 1.250% 90.000% ( 76, 110 ] 2 0.625% 90.625% ( 110, 170 ] 1 0.312% 90.938% ( 170, 250 ] 1 0.312% 91.250% ( 250, 380 ] 3 0.938% 92.188% ( 380, 580 ] 4 1.250% 93.438% ( 580, 870 ] 3 0.938% 94.375% ( 870, 1300 ] 7 2.188% 96.562% ( 1300, 1900 ] 2 0.625% 97.188% ( 1900, 2900 ] 2 0.625% 97.812% ( 2900, 4400 ] 6 1.875% 99.688% ( 4400, 6600 ] 1 0.312% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 802.2500 StdDev: 980.98 Min: 98 Median: 315.0000 Max: 4361 Percentiles: P50: 315.00 P75: 1085.00 P99: 4100.00 P99.9: 4361.00 P99.99: 4361.00 ------------------------------------------------------ ( 76, 110 ] 6 15.000% 15.000% ### ( 110, 170 ] 10 25.000% 40.000% ##### ( 170, 250 ] 3 7.500% 47.500% ## ( 250, 380 ] 2 5.000% 52.500% # ( 380, 580 ] 3 7.500% 60.000% ## ( 580, 870 ] 4 10.000% 70.000% ## ( 870, 1300 ] 4 10.000% 80.000% ## ( 1300, 1900 ] 2 5.000% 85.000% # ( 1900, 2900 ] 4 10.000% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 20.7 total, 5.3 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 285.16 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.688 H:M:S, 22.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 187.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.544 H:M:S, 48.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/10/17-17:17:17 ... thread 0: (1000000,7000000) ops and (36114.3,145331.6) ops/second in (27.689895,48.165723) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 5/5 1007.06 MB 0.0 4.9 0.0 4.9 11.4 6.6 0.0 1.7 129.4 304.4 38.47 35.77 113 0.340 5053K 5398 0.0 0.0 L1 0/0 0.00 KB 0.0 8.5 5.3 3.1 8.3 5.2 0.2 1.6 219.3 216.1 39.51 36.58 4 9.879 8801K 126K 0.0 0.0 L2 35/33 4.04 GB 2.6 1.1 0.9 0.2 1.1 0.9 4.7 1.3 223.3 222.7 5.00 4.75 3 1.666 436K 210 0.0 0.0 L3 21/9 1.29 GB 0.9 2.4 0.9 1.5 2.4 0.9 0.6 2.6 219.3 216.0 11.33 10.33 4 2.833 2524K 37K 0.0 0.0 L4 170/0 9.63 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.7 1.0 150.6 150.6 1.49 1.11 1 1.489 227K 0 0.0 0.0 L5 1052/0 86.62 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1283/47 102.55 GB 0.0 17.1 7.3 9.7 23.5 13.8 7.3 3.6 182.3 250.9 95.80 88.54 125 0.766 17M 170K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.1 7.3 9.7 23.5 13.8 7.2 3.6 182.3 250.9 95.80 88.54 125 0.766 17M 170K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.1 7.3 9.7 16.9 7.2 0.0 0.0 228.4 226.1 76.50 71.47 30 2.550 17M 170K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 349.1 19.31 17.08 95 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.4 total, 48.2 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.47 GB write, 496.67 MB/s write, 17.06 GB read, 360.96 MB/s read, 95.8 seconds Interval compaction: 23.47 GB write, 499.04 MB/s write, 17.06 GB read, 362.68 MB/s read, 95.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 22, interval: 45 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2717795 Average: 2.8614 StdDev: 21.94 Min: 0 Median: 1.4084 Max: 6306 Percentiles: P50: 1.41 P75: 1.81 P99: 7.22 P99.9: 159.50 P99.99: 417.32 ------------------------------------------------------ [ 0, 1 ] 665655 24.492% 24.492% ##### ( 1, 2 ] 1697598 62.462% 86.955% ############ ( 2, 3 ] 177758 6.541% 93.495% # ( 3, 4 ] 86887 3.197% 96.692% # ( 4, 6 ] 57760 2.125% 98.818% ( 6, 10 ] 16210 0.596% 99.414% ( 10, 15 ] 2271 0.084% 99.498% ( 15, 22 ] 437 0.016% 99.514% ( 22, 34 ] 21 0.001% 99.514% ( 34, 51 ] 57 0.002% 99.516% ( 51, 76 ] 151 0.006% 99.522% ( 76, 110 ] 6374 0.235% 99.757% ( 110, 170 ] 4725 0.174% 99.930% ( 170, 250 ] 930 0.034% 99.965% ( 250, 380 ] 581 0.021% 99.986% ( 380, 580 ] 580 0.021% 100.007% ( 580, 870 ] 226 0.008% 100.016% ( 870, 1300 ] 70 0.003% 100.018% ( 1300, 1900 ] 28 0.001% 100.019% ( 1900, 2900 ] 23 0.001% 100.020% ( 2900, 4400 ] 40 0.001% 100.022% ( 4400, 6600 ] 3 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1590730 Average: 3.2514 StdDev: 32.94 Min: 0 Median: 1.5376 Max: 11518 Percentiles: P50: 1.54 P75: 1.98 P99: 8.90 P99.9: 130.42 P99.99: 183.17 ------------------------------------------------------ [ 0, 1 ] 308998 19.425% 19.425% #### ( 1, 2 ] 904701 56.873% 76.298% ########### ( 2, 3 ] 169690 10.667% 86.966% ## ( 3, 4 ] 93525 5.879% 92.845% # ( 4, 6 ] 80138 5.038% 97.883% # ( 6, 10 ] 24548 1.543% 99.426% ( 10, 15 ] 4086 0.257% 99.683% ( 15, 22 ] 626 0.039% 99.722% ( 22, 34 ] 31 0.002% 99.724% ( 34, 51 ] 6 0.000% 99.725% ( 51, 76 ] 113 0.007% 99.732% ( 76, 110 ] 1982 0.125% 99.856% ( 110, 170 ] 2043 0.128% 99.985% ( 170, 250 ] 510 0.032% 100.017% ( 250, 380 ] 460 0.029% 100.046% ( 380, 580 ] 375 0.024% 100.069% ( 580, 870 ] 288 0.018% 100.087% ( 870, 1300 ] 96 0.006% 100.093% ( 1300, 1900 ] 60 0.004% 100.097% ( 1900, 2900 ] 19 0.001% 100.098% ( 2900, 4400 ] 16 0.001% 100.099% ( 4400, 6600 ] 7 0.000% 100.100% ( 6600, 9900 ] 7 0.000% 100.100% ( 9900, 14000 ] 2 0.000% 100.100% ** Level 2 read latency histogram (micros): Count: 168739 Average: 2.8001 StdDev: 38.25 Min: 1 Median: 1.5696 Max: 4015 Percentiles: P50: 1.57 P75: 2.09 P99: 5.99 P99.9: 11.22 P99.99: 13.42 ------------------------------------------------------ [ 0, 1 ] 30877 18.299% 18.299% #### ( 1, 2 ] 93915 55.657% 73.956% ########### ( 2, 3 ] 20463 12.127% 86.083% ## ( 3, 4 ] 11532 6.834% 92.917% # ( 4, 6 ] 10296 6.102% 99.019% # ( 6, 10 ] 1404 0.832% 99.851% ( 10, 15 ] 345 0.204% 100.055% ( 15, 22 ] 22 0.013% 100.068% ( 22, 34 ] 1 0.001% 100.069% ( 34, 51 ] 3 0.002% 100.071% ( 51, 76 ] 1 0.001% 100.071% ( 110, 170 ] 4 0.002% 100.073% ( 170, 250 ] 2 0.001% 100.075% ( 250, 380 ] 10 0.006% 100.081% ( 380, 580 ] 5 0.003% 100.084% ( 580, 870 ] 5 0.003% 100.087% ( 870, 1300 ] 3 0.002% 100.088% ( 1900, 2900 ] 4 0.002% 100.091% ( 2900, 4400 ] 14 0.008% 100.099% ** Level 3 read latency histogram (micros): Count: 407828 Average: 4.5085 StdDev: 44.68 Min: 0 Median: 1.6878 Max: 4311 Percentiles: P50: 1.69 P75: 2.45 P99: 9.73 P99.9: 506.29 P99.99: 1131.74 ------------------------------------------------------ [ 0, 1 ] 39989 9.805% 9.805% ## ( 1, 2 ] 238321 58.437% 68.242% ############ ( 2, 3 ] 61895 15.177% 83.419% ### ( 3, 4 ] 30567 7.495% 90.914% # ( 4, 6 ] 25686 6.298% 97.212% # ( 6, 10 ] 7824 1.918% 99.131% ( 10, 15 ] 1387 0.340% 99.471% ( 15, 22 ] 176 0.043% 99.514% ( 22, 34 ] 28 0.007% 99.521% ( 34, 51 ] 7 0.002% 99.522% ( 51, 76 ] 10 0.002% 99.525% ( 76, 110 ] 217 0.053% 99.578% ( 110, 170 ] 507 0.124% 99.702% ( 170, 250 ] 310 0.076% 99.778% ( 250, 380 ] 308 0.076% 99.854% ( 380, 580 ] 298 0.073% 99.927% ( 580, 870 ] 214 0.052% 99.979% ( 870, 1300 ] 71 0.017% 99.997% ( 1300, 1900 ] 18 0.004% 100.001% ( 1900, 2900 ] 25 0.006% 100.007% ( 2900, 4400 ] 25 0.006% 100.013% ** Level 4 read latency histogram (micros): Count: 320 Average: 149.9000 StdDev: 611.20 Min: 1 Median: 1.8099 Max: 4536 Percentiles: P50: 1.81 P75: 10.11 P99: 3850.00 P99.9: 4536.00 P99.99: 4536.00 ------------------------------------------------------ [ 0, 1 ] 62 19.375% 19.375% #### ( 1, 2 ] 121 37.812% 57.188% ######## ( 2, 3 ] 39 12.188% 69.375% ## ( 3, 4 ] 4 1.250% 70.625% ( 4, 6 ] 7 2.188% 72.812% ( 6, 10 ] 6 1.875% 74.688% ( 10, 15 ] 45 14.062% 88.750% ### ( 15, 22 ] 4 1.250% 90.000% ( 76, 110 ] 2 0.625% 90.625% ( 110, 170 ] 1 0.312% 90.938% ( 170, 250 ] 1 0.312% 91.250% ( 250, 380 ] 3 0.938% 92.188% ( 380, 580 ] 4 1.250% 93.438% ( 580, 870 ] 3 0.938% 94.375% ( 870, 1300 ] 7 2.188% 96.562% ( 1300, 1900 ] 2 0.625% 97.188% ( 1900, 2900 ] 2 0.625% 97.812% ( 2900, 4400 ] 6 1.875% 99.688% ( 4400, 6600 ] 1 0.312% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 908.2833 StdDev: 1103.80 Min: 78 Median: 336.6667 Max: 4361 Percentiles: P50: 336.67 P75: 1238.57 P99: 4250.00 P99.9: 4361.00 P99.99: 4361.00 ------------------------------------------------------ ( 76, 110 ] 9 15.000% 15.000% ### ( 110, 170 ] 13 21.667% 36.667% #### ( 170, 250 ] 4 6.667% 43.333% # ( 250, 380 ] 6 10.000% 53.333% ## ( 380, 580 ] 3 5.000% 58.333% # ( 580, 870 ] 4 6.667% 65.000% # ( 870, 1300 ] 7 11.667% 76.667% ## ( 1300, 1900 ] 4 6.667% 83.333% # ( 1900, 2900 ] 4 6.667% 90.000% # ( 2900, 4400 ] 6 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 48.4 total, 27.7 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 142.35 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.897 H:M:S, 59.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 35.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:24.210 H:M:S, 87.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/10/17-17:17:23 ... thread 0: (1000000,8000000) ops and (183487.2,149210.0) ops/second in (5.449971,53.615694) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 5/5 1.04 GB 0.0 5.8 0.0 5.8 13.4 7.6 0.0 1.8 127.9 296.5 46.29 42.33 130 0.356 6012K 6513 0.0 0.0 L1 18/18 1003.05 MB 0.0 9.4 6.3 3.1 9.3 6.2 0.2 1.5 215.6 212.7 44.87 41.09 5 8.974 9824K 130K 0.0 0.0 L2 2/1 257.56 MB 1.3 1.1 0.9 0.2 1.1 0.9 4.7 1.3 223.3 222.7 5.00 4.75 3 1.666 436K 210 0.0 0.0 L3 60/10 4.38 GB 3.8 6.6 4.7 1.9 6.6 4.7 0.6 1.4 195.1 193.6 34.71 29.61 13 2.670 5708K 45K 0.0 0.0 L4 172/7 9.63 GB 1.0 0.8 0.8 0.0 0.8 0.8 0.9 1.0 134.6 134.4 6.12 3.88 8 0.765 809K 0 0.0 0.0 L5 1060/0 87.29 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1317/41 103.58 GB 0.0 23.7 12.7 11.1 31.2 20.1 8.1 4.1 177.4 233.1 136.98 121.66 159 0.862 22M 183K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.7 12.7 11.1 31.2 20.1 8.0 4.1 177.4 233.1 136.98 121.66 159 0.862 22M 183K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.7 12.7 11.1 23.5 12.5 0.0 0.0 213.7 212.0 113.74 101.77 50 2.275 22M 183K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 336.2 23.23 19.89 109 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.8 total, 53.6 interval Flush(GB): cumulative 7.628, interval 7.628 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.18 GB write, 592.87 MB/s write, 23.74 GB read, 451.40 MB/s read, 137.0 seconds Interval compaction: 31.18 GB write, 595.42 MB/s write, 23.74 GB read, 453.34 MB/s read, 137.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 18, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 31, interval: 58 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3218928 Average: 2.9019 StdDev: 21.70 Min: 0 Median: 1.4528 Max: 6306 Percentiles: P50: 1.45 P75: 1.86 P99: 7.64 P99.9: 157.45 P99.99: 392.04 ------------------------------------------------------ [ 0, 1 ] 703789 21.864% 21.864% #### ( 1, 2 ] 2000197 62.139% 84.003% ############ ( 2, 3 ] 252336 7.839% 91.842% ## ( 3, 4 ] 127301 3.955% 95.797% # ( 4, 6 ] 93167 2.894% 98.691% # ( 6, 10 ] 24257 0.754% 99.445% ( 10, 15 ] 3441 0.107% 99.551% ( 15, 22 ] 546 0.017% 99.568% ( 22, 34 ] 23 0.001% 99.569% ( 34, 51 ] 62 0.002% 99.571% ( 51, 76 ] 156 0.005% 99.576% ( 76, 110 ] 6491 0.202% 99.778% ( 110, 170 ] 4987 0.155% 99.932% ( 170, 250 ] 1103 0.034% 99.967% ( 250, 380 ] 710 0.022% 99.989% ( 380, 580 ] 683 0.021% 100.010% ( 580, 870 ] 273 0.008% 100.018% ( 870, 1300 ] 95 0.003% 100.021% ( 1300, 1900 ] 38 0.001% 100.023% ( 1900, 2900 ] 26 0.001% 100.023% ( 2900, 4400 ] 43 0.001% 100.025% ( 4400, 6600 ] 4 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 2134654 Average: 3.5147 StdDev: 41.55 Min: 0 Median: 1.5944 Max: 11566 Percentiles: P50: 1.59 P75: 2.12 P99: 8.99 P99.9: 138.18 P99.99: 247.35 ------------------------------------------------------ [ 0, 1 ] 331972 15.552% 15.552% ### ( 1, 2 ] 1237231 57.959% 73.511% ############ ( 2, 3 ] 262281 12.287% 85.798% ## ( 3, 4 ] 136335 6.387% 92.184% # ( 4, 6 ] 118556 5.554% 97.738% # ( 6, 10 ] 36041 1.688% 99.427% ( 10, 15 ] 5925 0.278% 99.704% ( 15, 22 ] 787 0.037% 99.741% ( 22, 34 ] 44 0.002% 99.743% ( 34, 51 ] 8 0.000% 99.744% ( 51, 76 ] 117 0.005% 99.749% ( 76, 110 ] 2102 0.098% 99.848% ( 110, 170 ] 2385 0.112% 99.959% ( 170, 250 ] 679 0.032% 99.991% ( 250, 380 ] 628 0.029% 100.020% ( 380, 580 ] 564 0.026% 100.047% ( 580, 870 ] 425 0.020% 100.067% ( 870, 1300 ] 173 0.008% 100.075% ( 1300, 1900 ] 100 0.005% 100.080% ( 1900, 2900 ] 62 0.003% 100.082% ( 2900, 4400 ] 69 0.003% 100.086% ( 4400, 6600 ] 20 0.001% 100.087% ( 6600, 9900 ] 11 0.001% 100.087% ( 9900, 14000 ] 3 0.000% 100.087% ** Level 2 read latency histogram (micros): Count: 230970 Average: 3.0085 StdDev: 40.54 Min: 1 Median: 1.6657 Max: 4023 Percentiles: P50: 1.67 P75: 2.48 P99: 6.77 P99.9: 11.40 P99.99: 13.28 ------------------------------------------------------ [ 0, 1 ] 32203 13.943% 13.943% ### ( 1, 2 ] 125103 54.164% 68.107% ########### ( 2, 3 ] 33442 14.479% 82.586% ### ( 3, 4 ] 19232 8.327% 90.912% ## ( 4, 6 ] 18220 7.888% 98.801% ## ( 6, 10 ] 2385 1.033% 99.833% ( 10, 15 ] 552 0.239% 100.072% ( 15, 22 ] 48 0.021% 100.093% ( 22, 34 ] 7 0.003% 100.096% ( 34, 51 ] 3 0.001% 100.097% ( 51, 76 ] 1 0.000% 100.098% ( 110, 170 ] 4 0.002% 100.100% ( 170, 250 ] 2 0.001% 100.100% ( 250, 380 ] 10 0.004% 100.105% ( 380, 580 ] 5 0.002% 100.107% ( 580, 870 ] 5 0.002% 100.109% ( 870, 1300 ] 3 0.001% 100.110% ( 1300, 1900 ] 1 0.000% 100.111% ( 1900, 2900 ] 6 0.003% 100.113% ( 2900, 4400 ] 22 0.010% 100.123% ** Level 3 read latency histogram (micros): Count: 594554 Average: 5.8502 StdDev: 70.69 Min: 0 Median: 1.7529 Max: 7703 Percentiles: P50: 1.75 P75: 2.65 P99: 9.90 P99.9: 531.85 P99.99: 856.76 ------------------------------------------------------ [ 0, 1 ] 44197 7.434% 7.434% # ( 1, 2 ] 336124 56.534% 63.967% ########### ( 2, 3 ] 100293 16.869% 80.836% ### ( 3, 4 ] 50574 8.506% 89.342% ## ( 4, 6 ] 45448 7.644% 96.986% ## ( 6, 10 ] 12289 2.067% 99.053% ( 10, 15 ] 2435 0.410% 99.463% ( 15, 22 ] 316 0.053% 99.516% ( 22, 34 ] 33 0.006% 99.521% ( 34, 51 ] 13 0.002% 99.524% ( 51, 76 ] 13 0.002% 99.526% ( 76, 110 ] 240 0.040% 99.566% ( 110, 170 ] 637 0.107% 99.673% ( 170, 250 ] 458 0.077% 99.750% ( 250, 380 ] 485 0.082% 99.832% ( 380, 580 ] 534 0.090% 99.922% ( 580, 870 ] 426 0.072% 99.993% ( 870, 1300 ] 223 0.038% 100.031% ( 1300, 1900 ] 80 0.013% 100.044% ( 1900, 2900 ] 106 0.018% 100.062% ( 2900, 4400 ] 81 0.014% 100.076% ( 4400, 6600 ] 13 0.002% 100.078% ( 6600, 9900 ] 3 0.001% 100.079% ** Level 4 read latency histogram (micros): Count: 7446 Average: 95.4601 StdDev: 397.54 Min: 1 Median: 1.9255 Max: 6295 Percentiles: P50: 1.93 P75: 3.40 P99: 1884.07 P99.9: 4535.42 P99.99: 6173.54 ------------------------------------------------------ [ 0, 1 ] 408 5.479% 5.479% # ( 1, 2 ] 3582 48.106% 53.586% ########## ( 2, 3 ] 1317 17.687% 71.273% #### ( 3, 4 ] 700 9.401% 80.674% ## ( 4, 6 ] 472 6.339% 87.013% # ( 6, 10 ] 154 2.068% 89.081% ( 10, 15 ] 64 0.860% 89.941% ( 15, 22 ] 8 0.107% 90.048% ( 22, 34 ] 2 0.027% 90.075% ( 34, 51 ] 1 0.013% 90.089% ( 51, 76 ] 2 0.027% 90.115% ( 76, 110 ] 7 0.094% 90.210% ( 110, 170 ] 28 0.376% 90.586% ( 170, 250 ] 54 0.725% 91.311% ( 250, 380 ] 68 0.913% 92.224% ( 380, 580 ] 142 1.907% 94.131% ( 580, 870 ] 182 2.444% 96.575% ( 870, 1300 ] 127 1.706% 98.281% ( 1300, 1900 ] 55 0.739% 99.020% ( 1900, 2900 ] 36 0.483% 99.503% ( 2900, 4400 ] 29 0.389% 99.893% ( 4400, 6600 ] 9 0.121% 100.013% ** Level 5 read latency histogram (micros): Count: 100 Average: 1276.5600 StdDev: 1362.24 Min: 78 Median: 790.9091 Max: 7640 Percentiles: P50: 790.91 P75: 1900.00 P99: 6600.00 P99.9: 7640.00 P99.99: 7640.00 ------------------------------------------------------ ( 76, 110 ] 9 9.000% 9.000% ## ( 110, 170 ] 15 15.000% 24.000% ### ( 170, 250 ] 5 5.000% 29.000% # ( 250, 380 ] 7 7.000% 36.000% # ( 380, 580 ] 6 6.000% 42.000% # ( 580, 870 ] 11 11.000% 53.000% ## ( 870, 1300 ] 12 12.000% 65.000% ## ( 1300, 1900 ] 10 10.000% 75.000% ## ( 1900, 2900 ] 11 11.000% 86.000% ## ( 2900, 4400 ] 12 12.000% 98.000% ## ( 4400, 6600 ] 1 1.000% 99.000% ( 6600, 9900 ] 1 1.000% 100.000% ** DB Stats ** Uptime(secs): 53.8 total, 5.4 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 146.22 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:31.560 H:M:S, 58.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 180.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.663 H:M:S, 48.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/10/17-17:17:28 ... thread 0: (1000000,9000000) ops and (184138.3,152422.5) ops/second in (5.430700,59.046394) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 1.97 GB 62.9 6.2 0.0 6.2 14.7 8.5 0.0 1.7 119.4 285.2 52.76 46.41 142 0.372 6396K 7051 0.0 0.0 L1 18/18 1003.05 MB 0.0 9.4 6.3 3.1 9.3 6.2 0.2 1.5 215.6 212.7 44.87 41.09 5 8.974 9824K 130K 0.0 0.0 L2 0/0 0.00 KB 0.0 1.1 0.9 0.2 1.1 0.9 4.7 1.3 223.3 222.7 5.00 4.75 3 1.666 436K 210 0.0 0.0 L3 16/2 1.14 GB 1.0 7.1 5.0 2.2 7.1 4.9 0.6 1.4 191.4 190.0 38.04 31.91 15 2.536 6163K 46K 0.0 0.0 L4 173/2 9.42 GB 1.0 4.3 4.1 0.2 4.3 4.1 1.0 1.0 118.3 118.0 37.10 20.75 49 0.757 4176K 4342 0.0 0.0 L5 1104/0 90.98 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1324/31 104.49 GB 0.0 28.1 16.2 11.8 36.4 24.6 12.0 4.3 161.8 209.9 177.76 144.91 214 0.831 26M 188K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.1 16.2 11.8 36.4 24.6 11.9 4.3 161.8 209.9 177.76 144.91 214 0.831 26M 188K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.1 16.2 11.8 27.9 16.0 0.0 0.0 192.1 190.7 149.72 122.43 94 1.593 26M 188K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 312.4 28.03 22.48 120 0.234 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.3 total, 59.0 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 36.44 GB write, 629.40 MB/s write, 28.08 GB read, 485.13 MB/s read, 177.8 seconds Interval compaction: 36.44 GB write, 631.86 MB/s write, 28.08 GB read, 487.02 MB/s read, 177.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 57, pending-compaction-bytes-delays: 18, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 57, interval: 84 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3485353 Average: 2.9644 StdDev: 24.54 Min: 0 Median: 1.4717 Max: 6306 Percentiles: P50: 1.47 P75: 1.88 P99: 7.83 P99.9: 156.76 P99.99: 429.16 ------------------------------------------------------ [ 0, 1 ] 725168 20.806% 20.806% #### ( 1, 2 ] 2156893 61.884% 82.691% ############ ( 2, 3 ] 292987 8.406% 91.097% ## ( 3, 4 ] 148519 4.261% 95.358% # ( 4, 6 ] 113722 3.263% 98.621% # ( 6, 10 ] 28952 0.831% 99.452% ( 10, 15 ] 4343 0.125% 99.576% ( 15, 22 ] 654 0.019% 99.595% ( 22, 34 ] 23 0.001% 99.596% ( 34, 51 ] 66 0.002% 99.598% ( 51, 76 ] 156 0.004% 99.602% ( 76, 110 ] 6493 0.186% 99.788% ( 110, 170 ] 4996 0.143% 99.932% ( 170, 250 ] 1115 0.032% 99.964% ( 250, 380 ] 741 0.021% 99.985% ( 380, 580 ] 726 0.021% 100.006% ( 580, 870 ] 332 0.010% 100.015% ( 870, 1300 ] 143 0.004% 100.019% ( 1300, 1900 ] 58 0.002% 100.021% ( 1900, 2900 ] 47 0.001% 100.022% ( 2900, 4400 ] 62 0.002% 100.024% ( 4400, 6600 ] 7 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 2305016 Average: 3.8682 StdDev: 51.94 Min: 0 Median: 1.6086 Max: 11566 Percentiles: P50: 1.61 P75: 2.18 P99: 9.08 P99.9: 149.92 P99.99: 351.08 ------------------------------------------------------ [ 0, 1 ] 339946 14.748% 14.748% ### ( 1, 2 ] 1335076 57.920% 72.669% ############ ( 2, 3 ] 292075 12.671% 85.340% ### ( 3, 4 ] 150864 6.545% 91.885% # ( 4, 6 ] 133125 5.775% 97.660% # ( 6, 10 ] 40051 1.738% 99.398% ( 10, 15 ] 6759 0.293% 99.691% ( 15, 22 ] 871 0.038% 99.729% ( 22, 34 ] 58 0.003% 99.731% ( 34, 51 ] 12 0.001% 99.732% ( 51, 76 ] 118 0.005% 99.737% ( 76, 110 ] 2132 0.092% 99.830% ( 110, 170 ] 2441 0.106% 99.935% ( 170, 250 ] 728 0.032% 99.967% ( 250, 380 ] 681 0.030% 99.997% ( 380, 580 ] 669 0.029% 100.026% ( 580, 870 ] 519 0.023% 100.048% ( 870, 1300 ] 267 0.012% 100.060% ( 1300, 1900 ] 151 0.007% 100.066% ( 1900, 2900 ] 136 0.006% 100.072% ( 2900, 4400 ] 157 0.007% 100.079% ( 4400, 6600 ] 37 0.002% 100.081% ( 6600, 9900 ] 16 0.001% 100.081% ( 9900, 14000 ] 3 0.000% 100.081% ** Level 2 read latency histogram (micros): Count: 230970 Average: 3.0085 StdDev: 40.54 Min: 1 Median: 1.6657 Max: 4023 Percentiles: P50: 1.67 P75: 2.48 P99: 6.77 P99.9: 11.40 P99.99: 13.28 ------------------------------------------------------ [ 0, 1 ] 32203 13.943% 13.943% ### ( 1, 2 ] 125103 54.164% 68.107% ########### ( 2, 3 ] 33442 14.479% 82.586% ### ( 3, 4 ] 19232 8.327% 90.912% ## ( 4, 6 ] 18220 7.888% 98.801% ## ( 6, 10 ] 2385 1.033% 99.833% ( 10, 15 ] 552 0.239% 100.072% ( 15, 22 ] 48 0.021% 100.093% ( 22, 34 ] 7 0.003% 100.096% ( 34, 51 ] 3 0.001% 100.097% ( 51, 76 ] 1 0.000% 100.098% ( 110, 170 ] 4 0.002% 100.100% ( 170, 250 ] 2 0.001% 100.100% ( 250, 380 ] 10 0.004% 100.105% ( 380, 580 ] 5 0.002% 100.107% ( 580, 870 ] 5 0.002% 100.109% ( 870, 1300 ] 3 0.001% 100.110% ( 1300, 1900 ] 1 0.000% 100.111% ( 1900, 2900 ] 6 0.003% 100.113% ( 2900, 4400 ] 22 0.010% 100.123% ** Level 3 read latency histogram (micros): Count: 1548398 Average: 8.5934 StdDev: 120.82 Min: 0 Median: 1.8602 Max: 9737 Percentiles: P50: 1.86 P75: 2.90 P99: 9.83 P99.9: 443.46 P99.99: 738.72 ------------------------------------------------------ [ 0, 1 ] 63985 4.132% 4.132% # ( 1, 2 ] 825647 53.323% 57.455% ########### ( 2, 3 ] 301658 19.482% 76.937% #### ( 3, 4 ] 156660 10.118% 87.054% ## ( 4, 6 ] 152689 9.861% 96.916% ## ( 6, 10 ] 33727 2.178% 99.094% ( 10, 15 ] 8466 0.547% 99.641% ( 15, 22 ] 991 0.064% 99.705% ( 22, 34 ] 63 0.004% 99.709% ( 34, 51 ] 25 0.002% 99.710% ( 51, 76 ] 14 0.001% 99.711% ( 76, 110 ] 260 0.017% 99.728% ( 110, 170 ] 737 0.048% 99.776% ( 170, 250 ] 659 0.043% 99.818% ( 250, 380 ] 905 0.058% 99.877% ( 380, 580 ] 1149 0.074% 99.951% ( 580, 870 ] 1113 0.072% 100.023% ( 870, 1300 ] 771 0.050% 100.072% ( 1300, 1900 ] 485 0.031% 100.104% ( 1900, 2900 ] 717 0.046% 100.150% ( 2900, 4400 ] 766 0.049% 100.199% ( 4400, 6600 ] 167 0.011% 100.210% ( 6600, 9900 ] 34 0.002% 100.212% ** Level 4 read latency histogram (micros): Count: 50255 Average: 76.8519 StdDev: 377.97 Min: 1 Median: 1.9466 Max: 9075 Percentiles: P50: 1.95 P75: 3.27 P99: 1887.28 P99.9: 4309.89 P99.99: 6260.10 ------------------------------------------------------ [ 0, 1 ] 2202 4.382% 4.382% # ( 1, 2 ] 24220 48.194% 52.576% ########## ( 2, 3 ] 9791 19.483% 72.059% #### ( 3, 4 ] 5576 11.095% 83.154% ## ( 4, 6 ] 3669 7.301% 90.455% # ( 6, 10 ] 1062 2.113% 92.568% ( 10, 15 ] 291 0.579% 93.147% ( 15, 22 ] 40 0.080% 93.227% ( 22, 34 ] 21 0.042% 93.268% ( 34, 51 ] 12 0.024% 93.292% ( 51, 76 ] 3 0.006% 93.298% ( 76, 110 ] 33 0.066% 93.364% ( 110, 170 ] 104 0.207% 93.571% ( 170, 250 ] 202 0.402% 93.973% ( 250, 380 ] 280 0.557% 94.530% ( 380, 580 ] 512 1.019% 95.549% ( 580, 870 ] 748 1.488% 97.037% ( 870, 1300 ] 638 1.270% 98.307% ( 1300, 1900 ] 356 0.708% 99.015% ( 1900, 2900 ] 253 0.503% 99.518% ( 2900, 4400 ] 204 0.406% 99.924% ( 4400, 6600 ] 39 0.078% 100.002% ( 6600, 9900 ] 5 0.010% 100.012% ** Level 5 read latency histogram (micros): Count: 320 Average: 1181.6656 StdDev: 1260.41 Min: 78 Median: 638.0000 Max: 7640 Percentiles: P50: 638.00 P75: 1871.43 P99: 5720.00 P99.9: 7640.00 P99.99: 7640.00 ------------------------------------------------------ ( 76, 110 ] 14 4.375% 4.375% # ( 110, 170 ] 41 12.812% 17.188% ### ( 170, 250 ] 27 8.438% 25.625% ## ( 250, 380 ] 38 11.875% 37.500% ## ( 380, 580 ] 33 10.312% 47.812% ## ( 580, 870 ] 35 10.938% 58.750% ## ( 870, 1300 ] 32 10.000% 68.750% ## ( 1300, 1900 ] 21 6.562% 75.312% # ( 1900, 2900 ] 39 12.188% 87.500% ## ( 2900, 4400 ] 35 10.938% 98.438% ## ( 4400, 6600 ] 3 0.938% 99.375% ( 6600, 9900 ] 2 0.625% 100.000% ** DB Stats ** Uptime(secs): 59.3 total, 5.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 149.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:34.198 H:M:S, 57.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 181.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.638 H:M:S, 48.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.404 micros/op 156161 ops/sec 60.002 seconds 9369999 operations; 151.3 MB/s Microseconds per write: Count: 9369999 Average: 6.4036 StdDev: 530.11 Min: 0 Median: 1.7394 Max: 817437 Percentiles: P50: 1.74 P75: 2.76 P99: 9.36 P99.9: 1198.99 P99.99: 2753.80 ------------------------------------------------------ [ 0, 1 ] 1289198 13.759% 13.759% ### ( 1, 2 ] 4592616 49.014% 62.773% ########## ( 2, 3 ] 1509545 16.110% 78.883% ### ( 3, 4 ] 1284896 13.713% 92.596% ### ( 4, 6 ] 507489 5.416% 98.012% # ( 6, 10 ] 110047 1.174% 99.187% ( 10, 15 ] 35586 0.380% 99.566% ( 15, 22 ] 8710 0.093% 99.659% ( 22, 34 ] 1672 0.018% 99.677% ( 34, 51 ] 225 0.002% 99.680% ( 51, 76 ] 32 0.000% 99.680% ( 76, 110 ] 6224 0.066% 99.746% ( 110, 170 ] 2828 0.030% 99.777% ( 170, 250 ] 272 0.003% 99.780% ( 250, 380 ] 156 0.002% 99.781% ( 380, 580 ] 28 0.000% 99.781% ( 580, 870 ] 25 0.000% 99.782% ( 870, 1300 ] 14482 0.155% 99.936% ( 1300, 1900 ] 32 0.000% 99.937% ( 1900, 2900 ] 5855 0.062% 99.999% ( 2900, 4400 ] 42 0.000% 100.000% ( 4400, 6600 ] 6 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 213842 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9369999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9669838968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 593 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 34198096 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 32094258296 rocksdb.compact.write.bytes COUNT : 31875489261 rocksdb.flush.write.bytes COUNT : 9512022769 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 74 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 263 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9435592704 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3913728 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 32194967472 rocksdb.non.last.level.read.count COUNT : 7776531 rocksdb.block.checksum.compute.count COUNT : 7775419 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.393076 P95 : 3.923942 P99 : 7.957403 P100 : 817434.000000 COUNT : 9369999 SUM : 55692183 rocksdb.compaction.times.micros P50 : 836931.818182 P95 : 4630000.000000 P99 : 22330000.000000 P100 : 23812167.000000 COUNT : 97 SUM : 151890698 rocksdb.compaction.times.cpu_micros P50 : 541666.666667 P95 : 4630000.000000 P99 : 14240000.000000 P100 : 21403604.000000 COUNT : 97 SUM : 124495121 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 725.000000 P95 : 8525.000000 P99 : 30250.000000 P100 : 56706.000000 COUNT : 125 SUM : 232488 rocksdb.compaction.outfile.sync.micros P50 : 1071.969697 P95 : 53125.000000 P99 : 94750.000000 P100 : 197319.000000 COUNT : 405 SUM : 3787882 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 113.157895 P95 : 1625.714286 P99 : 5632.000000 P100 : 7588.000000 COUNT : 244 SUM : 96036 rocksdb.table.open.io.micros P50 : 1565.714286 P95 : 7770.468750 P99 : 11698.142857 P100 : 16073.000000 COUNT : 593 SUM : 1321414 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.632294 P95 : 8.190636 P99 : 12.862621 P100 : 12031.000000 COUNT : 7773771 SUM : 53741137 rocksdb.read.block.get.micros P50 : 525.299145 P95 : 3438.636364 P99 : 5153.866667 P100 : 7705.000000 COUNT : 1186 SUM : 1073908 rocksdb.write.raw.block.micros P50 : 0.514196 P95 : 0.976973 P99 : 2.923521 P100 : 12837.000000 COUNT : 10029706 SUM : 21003516 rocksdb.numfiles.in.singlecompaction P50 : 1.943548 P95 : 9.700000 P99 : 25.420000 P100 : 32.000000 COUNT : 143 SUM : 512 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.567152 P95 : 1218.872660 P99 : 2615.256761 P100 : 817263.000000 COUNT : 173047 SUM : 34214750 rocksdb.sst.read.micros P50 : 1.592916 P95 : 4.966506 P99 : 9.277073 P100 : 11566.000000 COUNT : 7776846 SUM : 38045777 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9369999 SUM : 9669838968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 217032.967033 P95 : 427500.000000 P99 : 835833.333333 P100 : 882549.000000 COUNT : 125 SUM : 28917370 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 361 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0