[2024-11-02 20:01:08.429463] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... [2024-11-02 20:01:08.429610] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3489162 ] Set seed to 1730574068426028 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-02 20:01:08.532288] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-02 20:01:08.568460] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-02 20:01:08.568509] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3489162' to capture a snapshot of events at runtime. [2024-11-02 20:01:08.568522] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3489162 for offline analysis/debug. [2024-11-02 20:01:08.568545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Nov 2 20:01:12 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/02-20:01:15 ... thread 0: (1000000,1000000) ops and (329022.2,329022.2) ops/second in (3.039309,3.039309) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 693.02 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 343.8 2.57 2.30 12 0.214 0 0 0.0 0.0 L2 3/2 237.25 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 252.5 252.4 1.38 1.32 2 0.691 354K 170 0.0 0.0 L3 9/0 755.92 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/11 97.00 GB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 88.4 311.8 3.95 3.62 14 0.282 354K 170 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 88.4 311.8 3.95 3.62 14 0.282 354K 170 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 252.5 252.4 1.38 1.32 2 0.691 354K 170 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 343.8 2.57 2.30 12 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.3 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.20 GB write, 376.07 MB/s write, 0.34 GB read, 106.61 MB/s read, 3.9 seconds Interval compaction: 1.20 GB write, 404.69 MB/s write, 0.34 GB read, 114.73 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 149756 Average: 2.0357 StdDev: 15.90 Min: 1 Median: 1.3415 Max: 3210 Percentiles: P50: 1.34 P75: 1.76 P99: 5.39 P99.9: 9.83 P99.99: 21.32 ------------------------------------------------------ [ 0, 1 ] 44338 29.607% 29.607% ###### ( 1, 2 ] 89441 59.724% 89.331% ############ ( 2, 3 ] 8334 5.565% 94.896% # ( 3, 4 ] 4282 2.859% 97.756% # ( 4, 6 ] 2689 1.796% 99.551% ( 6, 10 ] 549 0.367% 99.918% ( 10, 15 ] 102 0.068% 99.986% ( 15, 22 ] 10 0.007% 99.993% ( 22, 34 ] 3 0.002% 99.995% ( 34, 51 ] 1 0.001% 99.995% ( 51, 76 ] 1 0.001% 99.996% ( 110, 170 ] 8 0.005% 100.001% ( 170, 250 ] 2 0.001% 100.003% ( 250, 380 ] 4 0.003% 100.005% ( 580, 870 ] 4 0.003% 100.008% ( 870, 1300 ] 1 0.001% 100.009% ( 1300, 1900 ] 1 0.001% 100.009% ( 1900, 2900 ] 2 0.001% 100.011% ( 2900, 4400 ] 2 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 12315 Average: 2.8581 StdDev: 34.19 Min: 1 Median: 1.2478 Max: 2638 Percentiles: P50: 1.25 P75: 1.72 P99: 9.90 P99.9: 179.13 P99.99: 2284.25 ------------------------------------------------------ [ 0, 1 ] 4528 36.768% 36.768% ####### ( 1, 2 ] 6577 53.406% 90.175% ########### ( 2, 3 ] 728 5.911% 96.086% # ( 3, 4 ] 117 0.950% 97.036% ( 4, 6 ] 81 0.658% 97.694% ( 6, 10 ] 165 1.340% 99.034% ( 10, 15 ] 40 0.325% 99.359% ( 15, 22 ] 7 0.057% 99.415% ( 22, 34 ] 3 0.024% 99.440% ( 34, 51 ] 34 0.276% 99.716% ( 51, 76 ] 21 0.171% 99.886% ( 76, 110 ] 1 0.008% 99.894% ( 170, 250 ] 6 0.049% 99.943% ( 380, 580 ] 2 0.016% 99.959% ( 580, 870 ] 2 0.016% 99.976% ( 870, 1300 ] 1 0.008% 99.984% ( 1900, 2900 ] 2 0.016% 100.000% ** Level 2 read latency histogram (micros): Count: 70116 Average: 1.9573 StdDev: 4.50 Min: 0 Median: 1.3458 Max: 715 Percentiles: P50: 1.35 P75: 1.76 P99: 5.47 P99.9: 9.66 P99.99: 189.77 ------------------------------------------------------ [ 0, 1 ] 20544 29.300% 29.300% ###### ( 1, 2 ] 41973 59.862% 89.162% ############ ( 2, 3 ] 3793 5.410% 94.572% # ( 3, 4 ] 2129 3.036% 97.608% # ( 4, 6 ] 1327 1.893% 99.501% ( 6, 10 ] 308 0.439% 99.940% ( 10, 15 ] 31 0.044% 99.984% ( 15, 22 ] 2 0.003% 99.987% ( 22, 34 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.003% 99.991% ( 170, 250 ] 4 0.006% 99.997% ( 250, 380 ] 2 0.003% 100.000% ( 580, 870 ] 2 0.003% 100.003% ** Level 3 read latency histogram (micros): Count: 45 Average: 1714.6444 StdDev: 1489.89 Min: 47 Median: 1063.5000 Max: 5682 Percentiles: P50: 1063.50 P75: 3275.00 P99: 5682.00 P99.9: 5682.00 P99.99: 5682.00 ------------------------------------------------------ ( 34, 51 ] 1 2.222% 2.222% ( 170, 250 ] 2 4.444% 6.667% # ( 250, 380 ] 5 11.111% 17.778% ## ( 380, 580 ] 3 6.667% 24.444% # ( 580, 870 ] 7 15.556% 40.000% ### ( 870, 1300 ] 10 22.222% 62.222% #### ( 1900, 2900 ] 3 6.667% 68.889% # ( 2900, 4400 ] 11 24.444% 93.333% ##### ( 4400, 6600 ] 3 6.667% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1933.3000 StdDev: 1823.63 Min: 285 Median: 1156.6667 Max: 6174 Percentiles: P50: 1156.67 P75: 2400.00 P99: 6174.00 P99.9: 6174.00 P99.99: 6174.00 ------------------------------------------------------ ( 250, 380 ] 3 10.000% 10.000% ## ( 380, 580 ] 2 6.667% 16.667% # ( 580, 870 ] 6 20.000% 36.667% #### ( 870, 1300 ] 6 20.000% 56.667% #### ( 1300, 1900 ] 5 16.667% 73.333% ### ( 1900, 2900 ] 1 3.333% 76.667% # ( 2900, 4400 ] 1 3.333% 80.000% # ( 4400, 6600 ] 6 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 3.3 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 300.73 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.440 H:M:S, 13.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.440 H:M:S, 14.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/02-20:01:18 ... thread 0: (1000000,2000000) ops and (333233.9,331114.6) ops/second in (3.000895,6.040204) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 1.35 GB 56.7 0.5 0.0 0.5 2.3 1.8 0.0 1.3 69.1 328.0 7.30 6.69 28 0.261 511K 453 0.0 0.0 L1 4/4 314.57 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 240.5 240.2 1.31 1.27 1 1.310 319K 418 0.0 0.0 L2 1/0 49.93 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 252.5 252.4 1.38 1.32 2 0.691 354K 170 0.0 0.0 L3 18/0 943.25 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.0 1.0 222.2 222.2 0.84 0.77 1 0.843 190K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1196/13 97.98 GB 0.0 1.3 0.7 0.6 3.2 2.5 0.2 1.7 125.1 299.5 10.83 10.06 32 0.338 1376K 1041 0.0 0.0 Int 0/0 0.00 KB 0.0 1.3 0.7 0.6 3.2 2.5 0.2 1.7 125.1 299.5 10.83 10.06 32 0.338 1376K 1041 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.3 0.7 0.6 1.3 0.7 0.0 0.0 249.7 249.5 5.43 5.21 6 0.904 1376K 1041 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 349.7 5.40 4.84 26 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.3 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.17 GB write, 517.13 MB/s write, 1.32 GB read, 216.04 MB/s read, 10.8 seconds Interval compaction: 3.17 GB write, 536.94 MB/s write, 1.32 GB read, 224.31 MB/s read, 10.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 395868 Average: 2.0296 StdDev: 13.48 Min: 1 Median: 1.3749 Max: 3722 Percentiles: P50: 1.37 P75: 1.77 P99: 5.21 P99.9: 9.64 P99.99: 15.77 ------------------------------------------------------ [ 0, 1 ] 104547 26.410% 26.410% ##### ( 1, 2 ] 249088 62.922% 89.332% ############# ( 2, 3 ] 23950 6.050% 95.382% # ( 3, 4 ] 10731 2.711% 98.092% # ( 4, 6 ] 5920 1.495% 99.588% ( 6, 10 ] 1358 0.343% 99.931% ( 10, 15 ] 233 0.059% 99.990% ( 15, 22 ] 22 0.006% 99.995% ( 22, 34 ] 7 0.002% 99.997% ( 34, 51 ] 2 0.001% 99.997% ( 51, 76 ] 4 0.001% 99.998% ( 110, 170 ] 15 0.004% 100.002% ( 170, 250 ] 7 0.002% 100.004% ( 250, 380 ] 11 0.003% 100.007% ( 380, 580 ] 2 0.001% 100.007% ( 580, 870 ] 7 0.002% 100.009% ( 870, 1300 ] 3 0.001% 100.010% ( 1300, 1900 ] 5 0.001% 100.011% ( 1900, 2900 ] 3 0.001% 100.012% ( 2900, 4400 ] 3 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 66531 Average: 2.1294 StdDev: 16.44 Min: 1 Median: 1.3572 Max: 2638 Percentiles: P50: 1.36 P75: 1.75 P99: 5.24 P99.9: 38.60 P99.99: 613.53 ------------------------------------------------------ [ 0, 1 ] 18305 27.513% 27.513% ###### ( 1, 2 ] 41884 62.954% 90.468% ############# ( 2, 3 ] 3968 5.964% 96.432% # ( 3, 4 ] 1349 2.028% 98.459% ( 4, 6 ] 581 0.873% 99.333% ( 6, 10 ] 301 0.452% 99.785% ( 10, 15 ] 54 0.081% 99.866% ( 15, 22 ] 9 0.014% 99.880% ( 22, 34 ] 4 0.006% 99.886% ( 34, 51 ] 35 0.053% 99.938% ( 51, 76 ] 21 0.032% 99.970% ( 76, 110 ] 1 0.002% 99.971% ( 170, 250 ] 7 0.011% 99.982% ( 250, 380 ] 3 0.005% 99.986% ( 380, 580 ] 2 0.003% 99.989% ( 580, 870 ] 3 0.005% 99.994% ( 870, 1300 ] 1 0.002% 99.995% ( 1300, 1900 ] 1 0.002% 99.997% ( 1900, 2900 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 75877 Average: 1.9921 StdDev: 4.34 Min: 0 Median: 1.3712 Max: 715 Percentiles: P50: 1.37 P75: 1.79 P99: 5.55 P99.9: 9.74 P99.99: 178.25 ------------------------------------------------------ [ 0, 1 ] 20975 27.643% 27.643% ###### ( 1, 2 ] 45698 60.226% 87.870% ############ ( 2, 3 ] 4773 6.290% 94.160% # ( 3, 4 ] 2415 3.183% 97.343% # ( 4, 6 ] 1623 2.139% 99.482% ( 6, 10 ] 339 0.447% 99.929% ( 10, 15 ] 37 0.049% 99.978% ( 15, 22 ] 5 0.007% 99.984% ( 22, 34 ] 1 0.001% 99.986% ( 34, 51 ] 1 0.001% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 4 0.005% 99.995% ( 250, 380 ] 2 0.003% 99.997% ( 580, 870 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 880.7111 StdDev: 1348.39 Min: 1 Median: 250.0000 Max: 5682 Percentiles: P50: 250.00 P75: 1063.50 P99: 5682.00 P99.9: 5682.00 P99.99: 5682.00 ------------------------------------------------------ [ 0, 1 ] 12 13.333% 13.333% ### ( 1, 2 ] 21 23.333% 36.667% ##### ( 3, 4 ] 2 2.222% 38.889% ( 4, 6 ] 2 2.222% 41.111% ( 6, 10 ] 4 4.444% 45.556% # ( 34, 51 ] 1 1.111% 46.667% ( 110, 170 ] 1 1.111% 47.778% ( 170, 250 ] 2 2.222% 50.000% ( 250, 380 ] 5 5.556% 55.556% # ( 380, 580 ] 4 4.444% 60.000% # ( 580, 870 ] 9 10.000% 70.000% ## ( 870, 1300 ] 10 11.111% 81.111% ## ( 1900, 2900 ] 3 3.333% 84.444% # ( 2900, 4400 ] 11 12.222% 96.667% ## ( 4400, 6600 ] 3 3.333% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1933.3000 StdDev: 1823.63 Min: 285 Median: 1156.6667 Max: 6174 Percentiles: P50: 1156.67 P75: 2400.00 P99: 6174.00 P99.9: 6174.00 P99.99: 6174.00 ------------------------------------------------------ ( 250, 380 ] 3 10.000% 10.000% ## ( 380, 580 ] 2 6.667% 16.667% # ( 580, 870 ] 6 20.000% 36.667% #### ( 870, 1300 ] 6 20.000% 56.667% #### ( 1300, 1900 ] 5 16.667% 73.333% ### ( 1900, 2900 ] 1 3.333% 76.667% # ( 2900, 4400 ] 1 3.333% 80.000% # ( 4400, 6600 ] 6 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 6.3 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 313.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.845 H:M:S, 13.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.405 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/02-20:01:21 ... thread 0: (1000000,3000000) ops and (350066.4,337199.7) ops/second in (2.856601,8.896805) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 1.66 GB 144.8 1.4 0.0 1.4 4.1 2.7 0.0 1.5 105.6 316.8 13.12 12.19 44 0.298 1407K 1486 0.0 0.0 L1 4/0 363.14 MB 36.3 1.2 0.9 0.3 1.2 0.9 0.2 1.4 239.5 238.8 4.99 4.85 2 2.497 1214K 3421 0.0 0.0 L2 5/4 565.01 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.6 1.8 252.5 252.4 1.38 1.32 2 0.691 354K 170 0.0 0.0 L3 18/1 943.25 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.0 1.0 222.2 222.2 0.84 0.77 1 0.843 190K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1199/9 98.84 GB 0.0 3.0 1.2 1.8 5.7 3.9 0.7 2.1 153.3 289.3 20.34 19.13 49 0.415 3166K 5077 0.0 0.0 Int 0/0 0.00 KB 0.0 3.0 1.2 1.8 5.7 3.9 0.7 2.1 153.3 289.3 20.34 19.13 49 0.415 3166K 5077 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.0 1.2 1.8 3.0 1.2 0.0 0.0 251.3 250.9 12.41 12.04 10 1.241 3166K 5077 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 349.5 7.93 7.09 39 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.75 GB write, 644.60 MB/s write, 3.05 GB read, 341.57 MB/s read, 20.3 seconds Interval compaction: 5.75 GB write, 661.36 MB/s write, 3.05 GB read, 350.46 MB/s read, 20.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 671464 Average: 2.0750 StdDev: 12.74 Min: 1 Median: 1.4128 Max: 3722 Percentiles: P50: 1.41 P75: 1.80 P99: 5.37 P99.9: 9.65 P99.99: 14.76 ------------------------------------------------------ [ 0, 1 ] 156658 23.331% 23.331% ##### ( 1, 2 ] 433757 64.599% 87.930% ############# ( 2, 3 ] 45597 6.791% 94.720% # ( 3, 4 ] 20934 3.118% 97.838% # ( 4, 6 ] 11433 1.703% 99.541% ( 6, 10 ] 2645 0.394% 99.934% ( 10, 15 ] 393 0.059% 99.993% ( 15, 22 ] 41 0.006% 99.999% ( 22, 34 ] 9 0.001% 100.000% ( 34, 51 ] 6 0.001% 100.001% ( 51, 76 ] 6 0.001% 100.002% ( 110, 170 ] 20 0.003% 100.005% ( 170, 250 ] 16 0.002% 100.008% ( 250, 380 ] 15 0.002% 100.010% ( 380, 580 ] 3 0.000% 100.010% ( 580, 870 ] 11 0.002% 100.012% ( 870, 1300 ] 8 0.001% 100.013% ( 1300, 1900 ] 6 0.001% 100.014% ( 1900, 2900 ] 4 0.001% 100.015% ( 2900, 4400 ] 5 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 167861 Average: 2.2114 StdDev: 13.19 Min: 1 Median: 1.4620 Max: 2638 Percentiles: P50: 1.46 P75: 1.83 P99: 5.59 P99.9: 13.94 P99.99: 428.56 ------------------------------------------------------ [ 0, 1 ] 31741 18.909% 18.909% #### ( 1, 2 ] 112954 67.290% 86.199% ############# ( 2, 3 ] 13856 8.254% 94.454% ## ( 3, 4 ] 5155 3.071% 97.525% # ( 4, 6 ] 3124 1.861% 99.386% ( 6, 10 ] 715 0.426% 99.812% ( 10, 15 ] 188 0.112% 99.924% ( 15, 22 ] 31 0.018% 99.942% ( 22, 34 ] 5 0.003% 99.945% ( 34, 51 ] 35 0.021% 99.966% ( 51, 76 ] 22 0.013% 99.979% ( 76, 110 ] 1 0.001% 99.980% ( 110, 170 ] 1 0.001% 99.980% ( 170, 250 ] 7 0.004% 99.985% ( 250, 380 ] 8 0.005% 99.989% ( 380, 580 ] 5 0.003% 99.992% ( 580, 870 ] 4 0.002% 99.995% ( 870, 1300 ] 3 0.002% 99.996% ( 1300, 1900 ] 4 0.002% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 75877 Average: 1.9921 StdDev: 4.34 Min: 0 Median: 1.3712 Max: 715 Percentiles: P50: 1.37 P75: 1.79 P99: 5.55 P99.9: 9.74 P99.99: 178.25 ------------------------------------------------------ [ 0, 1 ] 20975 27.643% 27.643% ###### ( 1, 2 ] 45698 60.226% 87.870% ############ ( 2, 3 ] 4773 6.290% 94.160% # ( 3, 4 ] 2415 3.183% 97.343% # ( 4, 6 ] 1623 2.139% 99.482% ( 6, 10 ] 339 0.447% 99.929% ( 10, 15 ] 37 0.049% 99.978% ( 15, 22 ] 5 0.007% 99.984% ( 22, 34 ] 1 0.001% 99.986% ( 34, 51 ] 1 0.001% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 4 0.005% 99.995% ( 250, 380 ] 2 0.003% 99.997% ( 580, 870 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 16380 Average: 6.9826 StdDev: 119.20 Min: 1 Median: 1.5224 Max: 5682 Percentiles: P50: 1.52 P75: 1.89 P99: 5.90 P99.9: 2106.67 P99.99: 5398.80 ------------------------------------------------------ [ 0, 1 ] 2366 14.444% 14.444% ### ( 1, 2 ] 11149 68.065% 82.509% ############## ( 2, 3 ] 1639 10.006% 92.515% ## ( 3, 4 ] 681 4.158% 96.673% # ( 4, 6 ] 402 2.454% 99.127% ( 6, 10 ] 75 0.458% 99.585% ( 10, 15 ] 19 0.116% 99.701% ( 15, 22 ] 1 0.006% 99.707% ( 34, 51 ] 1 0.006% 99.713% ( 110, 170 ] 1 0.006% 99.719% ( 170, 250 ] 2 0.012% 99.731% ( 250, 380 ] 5 0.031% 99.762% ( 380, 580 ] 4 0.024% 99.786% ( 580, 870 ] 9 0.055% 99.841% ( 870, 1300 ] 10 0.061% 99.902% ( 1900, 2900 ] 3 0.018% 99.921% ( 2900, 4400 ] 11 0.067% 99.988% ( 4400, 6600 ] 3 0.018% 100.006% ** Level 4 read latency histogram (micros): Count: 30 Average: 1933.3000 StdDev: 1823.63 Min: 285 Median: 1156.6667 Max: 6174 Percentiles: P50: 1156.67 P75: 2400.00 P99: 6174.00 P99.9: 6174.00 P99.99: 6174.00 ------------------------------------------------------ ( 250, 380 ] 3 10.000% 10.000% ## ( 380, 580 ] 2 6.667% 16.667% # ( 580, 870 ] 6 20.000% 36.667% #### ( 870, 1300 ] 6 20.000% 56.667% #### ( 1300, 1900 ] 5 16.667% 73.333% ### ( 1900, 2900 ] 1 3.333% 76.667% # ( 2900, 4400 ] 1 3.333% 80.000% # ( 4400, 6600 ] 6 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 9.1 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 323.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.063 H:M:S, 11.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 344.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.218 H:M:S, 7.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/02-20:01:25 ... thread 0: (1000000,4000000) ops and (301665.1,327553.7) ops/second in (3.314934,12.211739) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 2.70 GB 81.8 2.2 0.0 2.2 5.9 3.8 0.0 1.6 114.0 312.6 19.34 18.00 62 0.312 2238K 2337 0.0 0.0 L1 4/4 363.14 MB 0.0 1.2 0.9 0.3 1.2 0.9 0.2 1.4 239.5 238.8 4.99 4.85 2 2.497 1214K 3421 0.0 0.0 L2 1/0 49.93 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.6 1.8 252.5 252.4 1.38 1.32 2 0.691 354K 170 0.0 0.0 L3 33/0 993.51 MB 1.0 0.8 0.7 0.1 0.8 0.7 0.0 1.2 217.3 217.1 3.82 3.44 2 1.912 844K 991 0.0 0.0 L4 140/0 9.68 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1244/17 99.88 GB 0.0 4.5 1.7 2.7 8.2 5.5 1.5 2.2 155.1 284.9 29.54 27.62 68 0.434 4651K 6919 0.0 0.0 Int 0/0 0.00 KB 0.0 4.5 1.7 2.7 8.2 5.5 1.4 2.2 155.1 284.9 29.54 27.62 68 0.434 4651K 6919 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.5 1.7 2.7 4.5 1.7 0.0 0.0 247.3 246.9 18.53 17.78 14 1.323 4651K 6919 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 349.0 11.01 9.84 54 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.2 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.22 GB write, 676.34 MB/s write, 4.47 GB read, 368.13 MB/s read, 29.5 seconds Interval compaction: 8.22 GB write, 689.15 MB/s write, 4.47 GB read, 375.10 MB/s read, 29.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 15, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1042739 Average: 2.1236 StdDev: 11.54 Min: 1 Median: 1.4435 Max: 3722 Percentiles: P50: 1.44 P75: 1.82 P99: 5.49 P99.9: 9.84 P99.99: 14.92 ------------------------------------------------------ [ 0, 1 ] 217409 20.850% 20.850% #### ( 1, 2 ] 685359 65.727% 86.577% ############# ( 2, 3 ] 80462 7.716% 94.293% ## ( 3, 4 ] 34225 3.282% 97.575% # ( 4, 6 ] 19943 1.913% 99.488% ( 6, 10 ] 4484 0.430% 99.918% ( 10, 15 ] 766 0.073% 99.991% ( 15, 22 ] 82 0.008% 99.999% ( 22, 34 ] 13 0.001% 100.000% ( 34, 51 ] 14 0.001% 100.002% ( 51, 76 ] 9 0.001% 100.003% ( 76, 110 ] 28 0.003% 100.005% ( 110, 170 ] 53 0.005% 100.010% ( 170, 250 ] 34 0.003% 100.014% ( 250, 380 ] 23 0.002% 100.016% ( 380, 580 ] 15 0.001% 100.017% ( 580, 870 ] 22 0.002% 100.019% ( 870, 1300 ] 10 0.001% 100.020% ( 1300, 1900 ] 7 0.001% 100.021% ( 1900, 2900 ] 6 0.001% 100.022% ( 2900, 4400 ] 5 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 223021 Average: 2.1843 StdDev: 11.45 Min: 1 Median: 1.4711 Max: 2638 Percentiles: P50: 1.47 P75: 1.84 P99: 5.56 P99.9: 13.12 P99.99: 310.09 ------------------------------------------------------ [ 0, 1 ] 40219 18.034% 18.034% #### ( 1, 2 ] 151329 67.854% 85.888% ############## ( 2, 3 ] 18994 8.517% 94.405% ## ( 3, 4 ] 6892 3.090% 97.495% # ( 4, 6 ] 4298 1.927% 99.422% ( 6, 10 ] 918 0.412% 99.834% ( 10, 15 ] 237 0.106% 99.940% ( 15, 22 ] 36 0.016% 99.956% ( 22, 34 ] 6 0.003% 99.959% ( 34, 51 ] 35 0.016% 99.974% ( 51, 76 ] 22 0.010% 99.984% ( 76, 110 ] 1 0.000% 99.985% ( 110, 170 ] 1 0.000% 99.985% ( 170, 250 ] 7 0.003% 99.988% ( 250, 380 ] 8 0.004% 99.992% ( 380, 580 ] 5 0.002% 99.994% ( 580, 870 ] 4 0.002% 99.996% ( 870, 1300 ] 3 0.001% 99.997% ( 1300, 1900 ] 4 0.002% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 75877 Average: 1.9921 StdDev: 4.34 Min: 0 Median: 1.3712 Max: 715 Percentiles: P50: 1.37 P75: 1.79 P99: 5.55 P99.9: 9.74 P99.99: 178.25 ------------------------------------------------------ [ 0, 1 ] 20975 27.643% 27.643% ###### ( 1, 2 ] 45698 60.226% 87.870% ############ ( 2, 3 ] 4773 6.290% 94.160% # ( 3, 4 ] 2415 3.183% 97.343% # ( 4, 6 ] 1623 2.139% 99.482% ( 6, 10 ] 339 0.447% 99.929% ( 10, 15 ] 37 0.049% 99.978% ( 15, 22 ] 5 0.007% 99.984% ( 22, 34 ] 1 0.001% 99.986% ( 34, 51 ] 1 0.001% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 4 0.005% 99.995% ( 250, 380 ] 2 0.003% 99.997% ( 580, 870 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 32997 Average: 4.7611 StdDev: 84.50 Min: 1 Median: 1.5210 Max: 5682 Percentiles: P50: 1.52 P75: 1.89 P99: 5.92 P99.9: 725.07 P99.99: 4359.13 ------------------------------------------------------ [ 0, 1 ] 4820 14.607% 14.607% ### ( 1, 2 ] 22415 67.930% 82.538% ############## ( 2, 3 ] 3328 10.086% 92.624% ## ( 3, 4 ] 1286 3.897% 96.521% # ( 4, 6 ] 854 2.588% 99.109% # ( 6, 10 ] 141 0.427% 99.536% ( 10, 15 ] 53 0.161% 99.697% ( 15, 22 ] 2 0.006% 99.703% ( 22, 34 ] 2 0.006% 99.709% ( 34, 51 ] 17 0.052% 99.761% ( 51, 76 ] 17 0.052% 99.812% ( 76, 110 ] 2 0.006% 99.818% ( 110, 170 ] 2 0.006% 99.824% ( 170, 250 ] 4 0.012% 99.836% ( 250, 380 ] 8 0.024% 99.861% ( 380, 580 ] 7 0.021% 99.882% ( 580, 870 ] 12 0.036% 99.918% ( 870, 1300 ] 10 0.030% 99.948% ( 1900, 2900 ] 3 0.009% 99.958% ( 2900, 4400 ] 11 0.033% 99.991% ( 4400, 6600 ] 3 0.009% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1933.3000 StdDev: 1823.63 Min: 285 Median: 1156.6667 Max: 6174 Percentiles: P50: 1156.67 P75: 2400.00 P99: 6174.00 P99.9: 6174.00 P99.99: 6174.00 ------------------------------------------------------ ( 250, 380 ] 3 10.000% 10.000% ## ( 380, 580 ] 2 6.667% 16.667% # ( 580, 870 ] 6 20.000% 36.667% #### ( 870, 1300 ] 6 20.000% 56.667% #### ( 1300, 1900 ] 5 16.667% 73.333% ### ( 1900, 2900 ] 1 3.333% 76.667% # ( 2900, 4400 ] 1 3.333% 80.000% # ( 4400, 6600 ] 6 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 738.0000 StdDev: 985.29 Min: 78 Median: 170.0000 Max: 3456 Percentiles: P50: 170.00 P75: 1085.00 P99: 3456.00 P99.9: 3456.00 P99.99: 3456.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 5 25.000% 50.000% ##### ( 170, 250 ] 2 10.000% 60.000% ## ( 380, 580 ] 2 10.000% 70.000% ## ( 870, 1300 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.4 total, 3.3 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 316.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.696 H:M:S, 13.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 296.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.633 H:M:S, 19.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/02-20:01:30 ... thread 0: (1000000,5000000) ops and (198308.3,289781.3) ops/second in (5.042653,17.254392) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 3.63 GB 69.2 3.4 0.0 3.4 8.1 4.7 0.0 1.7 129.6 308.6 26.73 25.02 82 0.326 3518K 3568 0.0 0.0 L1 4/4 363.14 MB 0.0 1.2 0.9 0.3 1.2 0.9 0.2 1.4 239.5 238.8 4.99 4.85 2 2.497 1214K 3421 0.0 0.0 L2 1/0 49.93 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.6 1.8 252.5 252.4 1.38 1.32 2 0.691 354K 170 0.0 0.0 L3 33/0 993.51 MB 1.0 0.8 0.7 0.1 0.8 0.7 0.0 1.2 217.3 217.1 3.82 3.44 2 1.912 844K 991 0.0 0.0 L4 140/0 9.68 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1244/19 100.80 GB 0.0 5.7 1.7 4.0 10.4 6.4 1.5 2.2 158.2 287.6 36.93 34.64 88 0.420 5931K 8150 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 1.7 4.0 10.4 6.4 1.4 2.2 158.2 287.6 36.93 34.64 88 0.420 5931K 8150 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 1.7 4.0 5.7 1.7 0.0 0.0 252.1 251.8 23.17 22.35 19 1.219 5931K 8150 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 347.8 13.77 12.29 69 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.5 total, 17.3 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.37 GB write, 607.33 MB/s write, 5.70 GB read, 334.03 MB/s read, 36.9 seconds Interval compaction: 10.37 GB write, 615.47 MB/s write, 5.70 GB read, 338.51 MB/s read, 36.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 15, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1566977 Average: 2.1536 StdDev: 11.09 Min: 1 Median: 1.4456 Max: 3722 Percentiles: P50: 1.45 P75: 1.82 P99: 5.59 P99.9: 9.97 P99.99: 87.70 ------------------------------------------------------ [ 0, 1 ] 321042 20.488% 20.488% #### ( 1, 2 ] 1037920 66.237% 86.725% ############# ( 2, 3 ] 119547 7.629% 94.354% ## ( 3, 4 ] 49525 3.161% 97.515% # ( 4, 6 ] 29360 1.874% 99.388% ( 6, 10 ] 8081 0.516% 99.904% ( 10, 15 ] 1118 0.071% 99.975% ( 15, 22 ] 120 0.008% 99.983% ( 22, 34 ] 15 0.001% 99.984% ( 34, 51 ] 16 0.001% 99.985% ( 51, 76 ] 15 0.001% 99.986% ( 76, 110 ] 181 0.012% 99.998% ( 110, 170 ] 161 0.010% 100.008% ( 170, 250 ] 75 0.005% 100.013% ( 250, 380 ] 63 0.004% 100.017% ( 380, 580 ] 43 0.003% 100.019% ( 580, 870 ] 43 0.003% 100.022% ( 870, 1300 ] 16 0.001% 100.023% ( 1300, 1900 ] 7 0.000% 100.024% ( 1900, 2900 ] 8 0.001% 100.024% ( 2900, 4400 ] 6 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 297530 Average: 2.2392 StdDev: 10.77 Min: 1 Median: 1.4633 Max: 2638 Percentiles: P50: 1.46 P75: 1.83 P99: 5.87 P99.9: 20.81 P99.99: 336.11 ------------------------------------------------------ [ 0, 1 ] 55691 18.718% 18.718% #### ( 1, 2 ] 200875 67.514% 86.232% ############## ( 2, 3 ] 23995 8.065% 94.297% ## ( 3, 4 ] 8748 2.940% 97.237% # ( 4, 6 ] 5602 1.883% 99.120% ( 6, 10 ] 1992 0.670% 99.789% ( 10, 15 ] 288 0.097% 99.886% ( 15, 22 ] 50 0.017% 99.903% ( 22, 34 ] 6 0.002% 99.905% ( 34, 51 ] 35 0.012% 99.917% ( 51, 76 ] 30 0.010% 99.927% ( 76, 110 ] 99 0.033% 99.960% ( 110, 170 ] 52 0.017% 99.977% ( 170, 250 ] 24 0.008% 99.986% ( 250, 380 ] 20 0.007% 99.992% ( 380, 580 ] 7 0.002% 99.995% ( 580, 870 ] 7 0.002% 99.997% ( 870, 1300 ] 3 0.001% 99.998% ( 1300, 1900 ] 4 0.001% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 75877 Average: 1.9921 StdDev: 4.34 Min: 0 Median: 1.3712 Max: 715 Percentiles: P50: 1.37 P75: 1.79 P99: 5.55 P99.9: 9.74 P99.99: 178.25 ------------------------------------------------------ [ 0, 1 ] 20975 27.643% 27.643% ###### ( 1, 2 ] 45698 60.226% 87.870% ############ ( 2, 3 ] 4773 6.290% 94.160% # ( 3, 4 ] 2415 3.183% 97.343% # ( 4, 6 ] 1623 2.139% 99.482% ( 6, 10 ] 339 0.447% 99.929% ( 10, 15 ] 37 0.049% 99.978% ( 15, 22 ] 5 0.007% 99.984% ( 22, 34 ] 1 0.001% 99.986% ( 34, 51 ] 1 0.001% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 4 0.005% 99.995% ( 250, 380 ] 2 0.003% 99.997% ( 580, 870 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 32997 Average: 4.7611 StdDev: 84.50 Min: 1 Median: 1.5210 Max: 5682 Percentiles: P50: 1.52 P75: 1.89 P99: 5.92 P99.9: 725.07 P99.99: 4359.13 ------------------------------------------------------ [ 0, 1 ] 4820 14.607% 14.607% ### ( 1, 2 ] 22415 67.930% 82.538% ############## ( 2, 3 ] 3328 10.086% 92.624% ## ( 3, 4 ] 1286 3.897% 96.521% # ( 4, 6 ] 854 2.588% 99.109% # ( 6, 10 ] 141 0.427% 99.536% ( 10, 15 ] 53 0.161% 99.697% ( 15, 22 ] 2 0.006% 99.703% ( 22, 34 ] 2 0.006% 99.709% ( 34, 51 ] 17 0.052% 99.761% ( 51, 76 ] 17 0.052% 99.812% ( 76, 110 ] 2 0.006% 99.818% ( 110, 170 ] 2 0.006% 99.824% ( 170, 250 ] 4 0.012% 99.836% ( 250, 380 ] 8 0.024% 99.861% ( 380, 580 ] 7 0.021% 99.882% ( 580, 870 ] 12 0.036% 99.918% ( 870, 1300 ] 10 0.030% 99.948% ( 1900, 2900 ] 3 0.009% 99.958% ( 2900, 4400 ] 11 0.033% 99.991% ( 4400, 6600 ] 3 0.009% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1933.3000 StdDev: 1823.63 Min: 285 Median: 1156.6667 Max: 6174 Percentiles: P50: 1156.67 P75: 2400.00 P99: 6174.00 P99.9: 6174.00 P99.99: 6174.00 ------------------------------------------------------ ( 250, 380 ] 3 10.000% 10.000% ## ( 380, 580 ] 2 6.667% 16.667% # ( 580, 870 ] 6 20.000% 36.667% #### ( 870, 1300 ] 6 20.000% 56.667% #### ( 1300, 1900 ] 5 16.667% 73.333% ### ( 1900, 2900 ] 1 3.333% 76.667% # ( 2900, 4400 ] 1 3.333% 80.000% # ( 4400, 6600 ] 6 20.000% 100.000% #### ** Level 5 read latency histogram (micros): Count: 20 Average: 738.0000 StdDev: 985.29 Min: 78 Median: 170.0000 Max: 3456 Percentiles: P50: 170.00 P75: 1085.00 P99: 3456.00 P99.9: 3456.00 P99.99: 3456.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 5 25.000% 50.000% ##### ( 170, 250 ] 2 10.000% 60.000% ## ( 380, 580 ] 2 10.000% 70.000% ## ( 870, 1300 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 17.5 total, 5.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 281.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.961 H:M:S, 22.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 195.17 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.265 H:M:S, 44.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/02-20:01:34 ... thread 0: (1000000,6000000) ops and (229369.6,277595.7) ops/second in (4.359776,21.614168) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/10 2.95 GB 138.5 3.9 0.0 3.9 9.6 5.7 0.0 1.7 124.0 302.1 32.52 29.91 97 0.335 4093K 4183 0.0 0.0 L1 5/0 540.78 MB 54.1 3.2 2.5 0.7 3.2 2.5 0.2 1.3 232.7 231.1 14.00 13.53 3 4.667 3309K 22K 0.0 0.0 L2 1/1 49.93 MB 0.0 0.3 0.2 0.2 0.3 0.2 2.0 1.8 252.5 252.4 1.38 1.32 2 0.691 354K 170 0.0 0.0 L3 35/9 1.70 GB 1.0 2.0 1.5 0.4 1.9 1.5 0.6 1.3 193.5 193.1 10.33 8.83 8 1.291 1898K 1758 0.0 0.0 L4 153/0 9.74 GB 1.0 0.1 0.1 0.0 0.1 0.1 1.1 1.0 158.3 158.3 0.79 0.61 2 0.397 76K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1266/20 101.77 GB 0.0 9.5 4.4 5.2 15.2 10.0 4.9 2.7 165.4 263.1 59.03 54.21 112 0.527 9732K 28K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.5 4.4 5.2 15.2 10.0 4.8 2.7 165.4 263.1 59.03 54.21 112 0.527 9732K 28K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.5 4.4 5.2 9.5 4.3 0.0 0.0 233.4 232.6 41.83 39.29 30 1.394 9732K 28K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 337.1 17.19 14.92 82 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.8 total, 21.6 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.16 GB write, 710.75 MB/s write, 9.53 GB read, 446.90 MB/s read, 59.0 seconds Interval compaction: 15.16 GB write, 718.36 MB/s write, 9.53 GB read, 451.69 MB/s read, 59.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 25, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2051253 Average: 2.3120 StdDev: 13.12 Min: 1 Median: 1.4942 Max: 3917 Percentiles: P50: 1.49 P75: 1.88 P99: 5.90 P99.9: 11.67 P99.99: 96.75 ------------------------------------------------------ [ 0, 1 ] 368401 17.960% 17.960% #### ( 1, 2 ] 1329832 64.830% 82.790% ############# ( 2, 3 ] 187745 9.153% 91.943% ## ( 3, 4 ] 84903 4.139% 96.082% # ( 4, 6 ] 62926 3.068% 99.149% # ( 6, 10 ] 14673 0.715% 99.865% ( 10, 15 ] 2159 0.105% 99.970% ( 15, 22 ] 221 0.011% 99.981% ( 22, 34 ] 19 0.001% 99.982% ( 34, 51 ] 19 0.001% 99.983% ( 51, 76 ] 15 0.001% 99.983% ( 76, 110 ] 221 0.011% 99.994% ( 110, 170 ] 224 0.011% 100.005% ( 170, 250 ] 117 0.006% 100.011% ( 250, 380 ] 100 0.005% 100.016% ( 380, 580 ] 97 0.005% 100.020% ( 580, 870 ] 83 0.004% 100.024% ( 870, 1300 ] 42 0.002% 100.027% ( 1300, 1900 ] 12 0.001% 100.027% ( 1900, 2900 ] 13 0.001% 100.028% ( 2900, 4400 ] 10 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 538435 Average: 2.8455 StdDev: 22.90 Min: 1 Median: 1.6171 Max: 4013 Percentiles: P50: 1.62 P75: 2.11 P99: 8.03 P99.9: 20.28 P99.99: 361.46 ------------------------------------------------------ [ 0, 1 ] 64671 12.011% 12.011% ## ( 1, 2 ] 331472 61.562% 73.573% ############ ( 2, 3 ] 72484 13.462% 87.035% ### ( 3, 4 ] 31363 5.825% 92.860% # ( 4, 6 ] 29579 5.494% 98.353% # ( 6, 10 ] 6871 1.276% 99.629% ( 10, 15 ] 1311 0.243% 99.873% ( 15, 22 ] 193 0.036% 99.909% ( 22, 34 ] 19 0.004% 99.912% ( 34, 51 ] 42 0.008% 99.920% ( 51, 76 ] 37 0.007% 99.927% ( 76, 110 ] 114 0.021% 99.948% ( 110, 170 ] 107 0.020% 99.968% ( 170, 250 ] 65 0.012% 99.980% ( 250, 380 ] 62 0.012% 99.992% ( 380, 580 ] 71 0.013% 100.005% ( 580, 870 ] 49 0.009% 100.014% ( 870, 1300 ] 25 0.005% 100.019% ( 1300, 1900 ] 13 0.002% 100.021% ( 1900, 2900 ] 12 0.002% 100.023% ( 2900, 4400 ] 7 0.001% 100.025% ** Level 2 read latency histogram (micros): Count: 76212 Average: 2.6676 StdDev: 34.08 Min: 0 Median: 1.3746 Max: 3824 Percentiles: P50: 1.37 P75: 1.79 P99: 5.64 P99.9: 21.70 P99.99: 1656.82 ------------------------------------------------------ [ 0, 1 ] 20975 27.522% 27.522% ###### ( 1, 2 ] 45734 60.009% 87.531% ############ ( 2, 3 ] 4913 6.446% 93.977% # ( 3, 4 ] 2466 3.236% 97.213% # ( 4, 6 ] 1659 2.177% 99.390% ( 6, 10 ] 346 0.454% 99.844% ( 10, 15 ] 38 0.050% 99.894% ( 15, 22 ] 5 0.007% 99.900% ( 22, 34 ] 1 0.001% 99.902% ( 34, 51 ] 1 0.001% 99.903% ( 76, 110 ] 1 0.001% 99.904% ( 110, 170 ] 7 0.009% 99.913% ( 170, 250 ] 9 0.012% 99.925% ( 250, 380 ] 16 0.021% 99.946% ( 380, 580 ] 14 0.018% 99.965% ( 580, 870 ] 10 0.013% 99.978% ( 870, 1300 ] 7 0.009% 99.987% ( 1300, 1900 ] 4 0.005% 99.992% ( 1900, 2900 ] 2 0.003% 99.995% ( 2900, 4400 ] 4 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 311533 Average: 6.0489 StdDev: 63.58 Min: 0 Median: 1.7769 Max: 5682 Percentiles: P50: 1.78 P75: 2.73 P99: 11.49 P99.9: 580.58 P99.99: 1052.54 ------------------------------------------------------ [ 0, 1 ] 20115 6.457% 6.457% # ( 1, 2 ] 174614 56.050% 62.507% ########### ( 2, 3 ] 53050 17.029% 79.535% ### ( 3, 4 ] 27243 8.745% 88.280% ## ( 4, 6 ] 26418 8.480% 96.760% ## ( 6, 10 ] 6535 2.098% 98.858% ( 10, 15 ] 1490 0.478% 99.336% ( 15, 22 ] 188 0.060% 99.397% ( 22, 34 ] 20 0.006% 99.403% ( 34, 51 ] 23 0.007% 99.410% ( 51, 76 ] 18 0.006% 99.416% ( 76, 110 ] 107 0.034% 99.450% ( 110, 170 ] 312 0.100% 99.551% ( 170, 250 ] 339 0.109% 99.659% ( 250, 380 ] 382 0.123% 99.782% ( 380, 580 ] 368 0.118% 99.900% ( 580, 870 ] 235 0.075% 99.976% ( 870, 1300 ] 108 0.035% 100.010% ( 1300, 1900 ] 45 0.014% 100.025% ( 1900, 2900 ] 65 0.021% 100.046% ( 2900, 4400 ] 30 0.010% 100.055% ( 4400, 6600 ] 4 0.001% 100.056% ** Level 4 read latency histogram (micros): Count: 60 Average: 991.0667 StdDev: 1600.24 Min: 1 Median: 315.0000 Max: 6174 Percentiles: P50: 315.00 P75: 1156.67 P99: 6174.00 P99.9: 6174.00 P99.99: 6174.00 ------------------------------------------------------ [ 0, 1 ] 6 10.000% 10.000% ## ( 1, 2 ] 11 18.333% 28.333% #### ( 3, 4 ] 1 1.667% 30.000% ( 4, 6 ] 3 5.000% 35.000% # ( 6, 10 ] 2 3.333% 38.333% # ( 15, 22 ] 2 3.333% 41.667% # ( 22, 34 ] 1 1.667% 43.333% ( 76, 110 ] 1 1.667% 45.000% ( 110, 170 ] 1 1.667% 46.667% ( 250, 380 ] 4 6.667% 53.333% # ( 380, 580 ] 2 3.333% 56.667% # ( 580, 870 ] 7 11.667% 68.333% ## ( 870, 1300 ] 6 10.000% 78.333% ## ( 1300, 1900 ] 5 8.333% 86.667% ## ( 1900, 2900 ] 1 1.667% 88.333% ( 2900, 4400 ] 1 1.667% 90.000% ( 4400, 6600 ] 6 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 60 Average: 1056.4667 StdDev: 1151.83 Min: 78 Median: 494.2857 Max: 3946 Percentiles: P50: 494.29 P75: 2000.00 P99: 3946.00 P99.9: 3946.00 P99.99: 3946.00 ------------------------------------------------------ ( 76, 110 ] 8 13.333% 13.333% ### ( 110, 170 ] 8 13.333% 26.667% ### ( 170, 250 ] 7 11.667% 38.333% ## ( 250, 380 ] 3 5.000% 43.333% # ( 380, 580 ] 7 11.667% 55.000% ## ( 580, 870 ] 4 6.667% 61.667% # ( 870, 1300 ] 4 6.667% 68.333% # ( 1300, 1900 ] 3 5.000% 73.333% # ( 1900, 2900 ] 10 16.667% 90.000% ### ( 2900, 4400 ] 6 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 21.8 total, 4.4 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 270.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.470 H:M:S, 25.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 225.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.510 H:M:S, 34.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/02-20:01:37 ... thread 0: (1000000,7000000) ops and (352246.1,286262.4) ops/second in (2.838924,24.453092) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/4 3.87 GB 370.6 6.1 0.0 6.1 12.7 6.6 0.0 1.9 142.4 296.1 43.79 40.62 115 0.381 6331K 12K 0.0 0.0 L1 5/0 540.78 MB 54.1 3.2 2.5 0.7 3.2 2.5 0.2 1.3 232.7 231.1 14.00 13.53 3 4.667 3309K 22K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 2.0 1.8 252.5 252.4 1.38 1.32 2 0.691 354K 170 0.0 0.0 L3 17/0 879.26 MB 0.9 2.7 1.6 1.1 2.7 1.6 0.6 1.7 196.9 196.6 14.24 12.10 9 1.582 2717K 3240 0.0 0.0 L4 163/0 9.64 GB 1.0 0.1 0.1 0.0 0.1 0.1 2.0 1.0 158.3 158.3 0.79 0.61 2 0.397 76K 0 0.0 0.0 L5 1068/0 87.78 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/4 102.68 GB 0.0 12.5 4.4 8.1 19.0 11.0 6.7 2.9 172.1 262.4 74.21 68.19 131 0.566 12M 38K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.5 4.4 8.1 19.0 11.0 6.7 2.9 172.1 262.4 74.21 68.19 131 0.566 12M 38K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.5 4.4 8.1 12.4 4.4 0.0 0.0 234.9 234.2 54.37 50.90 35 1.553 12M 38K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 339.8 19.84 17.29 96 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.7 total, 24.5 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.02 GB write, 788.81 MB/s write, 12.47 GB read, 517.42 MB/s read, 74.2 seconds Interval compaction: 19.02 GB write, 796.27 MB/s write, 12.47 GB read, 522.31 MB/s read, 74.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 28, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2314247 Average: 2.2817 StdDev: 13.34 Min: 0 Median: 1.4815 Max: 4773 Percentiles: P50: 1.48 P75: 1.87 P99: 5.87 P99.9: 11.49 P99.99: 91.63 ------------------------------------------------------ [ 0, 1 ] 437333 18.897% 18.897% #### ( 1, 2 ] 1495046 64.602% 83.499% ############# ( 2, 3 ] 203628 8.799% 92.298% ## ( 3, 4 ] 92110 3.980% 96.278% # ( 4, 6 ] 67228 2.905% 99.183% # ( 6, 10 ] 15870 0.686% 99.869% ( 10, 15 ] 2402 0.104% 99.973% ( 15, 22 ] 241 0.010% 99.983% ( 22, 34 ] 19 0.001% 99.984% ( 34, 51 ] 21 0.001% 99.985% ( 51, 76 ] 16 0.001% 99.986% ( 76, 110 ] 221 0.010% 99.995% ( 110, 170 ] 229 0.010% 100.005% ( 170, 250 ] 126 0.005% 100.011% ( 250, 380 ] 110 0.005% 100.015% ( 380, 580 ] 99 0.004% 100.020% ( 580, 870 ] 84 0.004% 100.023% ( 870, 1300 ] 45 0.002% 100.025% ( 1300, 1900 ] 13 0.001% 100.026% ( 1900, 2900 ] 15 0.001% 100.026% ( 2900, 4400 ] 12 0.001% 100.027% ( 4400, 6600 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 538435 Average: 2.8455 StdDev: 22.90 Min: 1 Median: 1.6171 Max: 4013 Percentiles: P50: 1.62 P75: 2.11 P99: 8.03 P99.9: 20.28 P99.99: 361.46 ------------------------------------------------------ [ 0, 1 ] 64671 12.011% 12.011% ## ( 1, 2 ] 331472 61.562% 73.573% ############ ( 2, 3 ] 72484 13.462% 87.035% ### ( 3, 4 ] 31363 5.825% 92.860% # ( 4, 6 ] 29579 5.494% 98.353% # ( 6, 10 ] 6871 1.276% 99.629% ( 10, 15 ] 1311 0.243% 99.873% ( 15, 22 ] 193 0.036% 99.909% ( 22, 34 ] 19 0.004% 99.912% ( 34, 51 ] 42 0.008% 99.920% ( 51, 76 ] 37 0.007% 99.927% ( 76, 110 ] 114 0.021% 99.948% ( 110, 170 ] 107 0.020% 99.968% ( 170, 250 ] 65 0.012% 99.980% ( 250, 380 ] 62 0.012% 99.992% ( 380, 580 ] 71 0.013% 100.005% ( 580, 870 ] 49 0.009% 100.014% ( 870, 1300 ] 25 0.005% 100.019% ( 1300, 1900 ] 13 0.002% 100.021% ( 1900, 2900 ] 12 0.002% 100.023% ( 2900, 4400 ] 7 0.001% 100.025% ** Level 2 read latency histogram (micros): Count: 88557 Average: 2.6320 StdDev: 31.62 Min: 0 Median: 1.4081 Max: 3824 Percentiles: P50: 1.41 P75: 1.82 P99: 5.87 P99.9: 14.67 P99.99: 1471.64 ------------------------------------------------------ [ 0, 1 ] 22379 25.271% 25.271% ##### ( 1, 2 ] 53666 60.601% 85.871% ############ ( 2, 3 ] 6444 7.277% 93.148% # ( 3, 4 ] 3134 3.539% 96.687% # ( 4, 6 ] 2196 2.480% 99.167% ( 6, 10 ] 585 0.661% 99.827% ( 10, 15 ] 69 0.078% 99.905% ( 15, 22 ] 8 0.009% 99.914% ( 22, 34 ] 1 0.001% 99.915% ( 34, 51 ] 1 0.001% 99.916% ( 76, 110 ] 1 0.001% 99.918% ( 110, 170 ] 7 0.008% 99.925% ( 170, 250 ] 9 0.010% 99.936% ( 250, 380 ] 16 0.018% 99.954% ( 380, 580 ] 14 0.016% 99.970% ( 580, 870 ] 10 0.011% 99.981% ( 870, 1300 ] 7 0.008% 99.989% ( 1300, 1900 ] 4 0.005% 99.993% ( 1900, 2900 ] 2 0.002% 99.995% ( 2900, 4400 ] 4 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 329600 Average: 5.8883 StdDev: 62.03 Min: 0 Median: 1.7669 Max: 5682 Percentiles: P50: 1.77 P75: 2.70 P99: 11.14 P99.9: 574.30 P99.99: 1051.63 ------------------------------------------------------ [ 0, 1 ] 22055 6.691% 6.691% # ( 1, 2 ] 186138 56.474% 63.165% ########### ( 2, 3 ] 55386 16.804% 79.969% ### ( 3, 4 ] 28348 8.601% 88.570% ## ( 4, 6 ] 27166 8.242% 96.812% ## ( 6, 10 ] 6858 2.081% 98.893% ( 10, 15 ] 1545 0.469% 99.362% ( 15, 22 ] 192 0.058% 99.420% ( 22, 34 ] 20 0.006% 99.426% ( 34, 51 ] 24 0.007% 99.433% ( 51, 76 ] 18 0.005% 99.439% ( 76, 110 ] 109 0.033% 99.472% ( 110, 170 ] 314 0.095% 99.567% ( 170, 250 ] 349 0.106% 99.673% ( 250, 380 ] 387 0.117% 99.790% ( 380, 580 ] 372 0.113% 99.903% ( 580, 870 ] 240 0.073% 99.976% ( 870, 1300 ] 109 0.033% 100.009% ( 1300, 1900 ] 46 0.014% 100.023% ( 1900, 2900 ] 65 0.020% 100.043% ( 2900, 4400 ] 30 0.009% 100.052% ( 4400, 6600 ] 4 0.001% 100.053% ** Level 4 read latency histogram (micros): Count: 60 Average: 991.0667 StdDev: 1600.24 Min: 1 Median: 315.0000 Max: 6174 Percentiles: P50: 315.00 P75: 1156.67 P99: 6174.00 P99.9: 6174.00 P99.99: 6174.00 ------------------------------------------------------ [ 0, 1 ] 6 10.000% 10.000% ## ( 1, 2 ] 11 18.333% 28.333% #### ( 3, 4 ] 1 1.667% 30.000% ( 4, 6 ] 3 5.000% 35.000% # ( 6, 10 ] 2 3.333% 38.333% # ( 15, 22 ] 2 3.333% 41.667% # ( 22, 34 ] 1 1.667% 43.333% ( 76, 110 ] 1 1.667% 45.000% ( 110, 170 ] 1 1.667% 46.667% ( 250, 380 ] 4 6.667% 53.333% # ( 380, 580 ] 2 3.333% 56.667% # ( 580, 870 ] 7 11.667% 68.333% ## ( 870, 1300 ] 6 10.000% 78.333% ## ( 1300, 1900 ] 5 8.333% 86.667% ## ( 1900, 2900 ] 1 1.667% 88.333% ( 2900, 4400 ] 1 1.667% 90.000% ( 4400, 6600 ] 6 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 120 Average: 941.2250 StdDev: 1067.79 Min: 78 Median: 470.0000 Max: 4427 Percentiles: P50: 470.00 P75: 1450.00 P99: 4362.50 P99.9: 4427.00 P99.99: 4427.00 ------------------------------------------------------ ( 76, 110 ] 10 8.333% 8.333% ## ( 110, 170 ] 15 12.500% 20.833% ### ( 170, 250 ] 15 12.500% 33.333% ### ( 250, 380 ] 11 9.167% 42.500% ## ( 380, 580 ] 20 16.667% 59.167% ### ( 580, 870 ] 10 8.333% 67.500% ## ( 870, 1300 ] 7 5.833% 73.333% # ( 1300, 1900 ] 8 6.667% 80.000% # ( 1900, 2900 ] 15 12.500% 92.500% ### ( 2900, 4400 ] 8 6.667% 99.167% # ( 4400, 6600 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 24.7 total, 2.8 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 279.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.686 H:M:S, 23.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 346.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.215 H:M:S, 7.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/02-20:01:42 ... thread 0: (1000000,8000000) ops and (187453.5,268566.8) ops/second in (5.334656,29.787748) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/18 4.85 GB 0.0 7.1 0.0 7.1 14.7 7.6 0.0 1.9 144.1 296.6 50.72 47.17 133 0.381 7418K 13K 0.0 0.0 L1 5/5 540.78 MB 0.0 3.2 2.5 0.7 3.2 2.5 0.2 1.3 232.7 231.1 14.00 13.53 3 4.667 3309K 22K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 2.0 1.8 252.5 252.4 1.38 1.32 2 0.691 354K 170 0.0 0.0 L3 17/0 879.26 MB 0.9 2.7 1.6 1.1 2.7 1.6 0.6 1.7 196.9 196.6 14.24 12.10 9 1.582 2717K 3240 0.0 0.0 L4 163/0 9.64 GB 1.0 0.1 0.1 0.0 0.1 0.1 2.0 1.0 158.3 158.3 0.79 0.61 2 0.397 76K 0 0.0 0.0 L5 1068/0 87.78 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/23 103.66 GB 0.0 13.5 4.4 9.1 21.0 11.9 6.7 2.8 170.6 265.6 81.14 74.74 149 0.545 13M 39K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.5 4.4 9.1 21.0 11.9 6.7 2.8 170.6 265.6 81.14 74.74 149 0.545 13M 39K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.5 4.4 9.1 13.5 4.4 0.0 0.0 236.9 236.2 58.43 54.87 39 1.498 13M 39K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 341.2 22.71 19.87 110 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 30.0 total, 29.8 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.05 GB write, 717.84 MB/s write, 13.52 GB read, 461.15 MB/s read, 81.1 seconds Interval compaction: 21.05 GB write, 723.42 MB/s write, 13.52 GB read, 464.73 MB/s read, 81.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 31, interval: 50 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2855712 Average: 2.2601 StdDev: 12.44 Min: 0 Median: 1.4728 Max: 4773 Percentiles: P50: 1.47 P75: 1.86 P99: 5.86 P99.9: 11.93 P99.99: 109.66 ------------------------------------------------------ [ 0, 1 ] 548629 19.212% 19.212% #### ( 1, 2 ] 1859515 65.116% 84.327% ############# ( 2, 3 ] 242787 8.502% 92.829% ## ( 3, 4 ] 107264 3.756% 96.585% # ( 4, 6 ] 74175 2.597% 99.183% # ( 6, 10 ] 19386 0.679% 99.861% ( 10, 15 ] 2854 0.100% 99.961% ( 15, 22 ] 307 0.011% 99.972% ( 22, 34 ] 21 0.001% 99.973% ( 34, 51 ] 22 0.001% 99.974% ( 51, 76 ] 22 0.001% 99.974% ( 76, 110 ] 452 0.016% 99.990% ( 110, 170 ] 384 0.013% 100.004% ( 170, 250 ] 164 0.006% 100.009% ( 250, 380 ] 135 0.005% 100.014% ( 380, 580 ] 125 0.004% 100.019% ( 580, 870 ] 96 0.003% 100.022% ( 870, 1300 ] 48 0.002% 100.024% ( 1300, 1900 ] 15 0.001% 100.024% ( 1900, 2900 ] 15 0.001% 100.025% ( 2900, 4400 ] 12 0.000% 100.025% ( 4400, 6600 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 538436 Average: 2.8458 StdDev: 22.90 Min: 1 Median: 1.6171 Max: 4013 Percentiles: P50: 1.62 P75: 2.11 P99: 8.03 P99.9: 20.32 P99.99: 361.46 ------------------------------------------------------ [ 0, 1 ] 64671 12.011% 12.011% ## ( 1, 2 ] 331472 61.562% 73.573% ############ ( 2, 3 ] 72484 13.462% 87.035% ### ( 3, 4 ] 31363 5.825% 92.860% # ( 4, 6 ] 29579 5.494% 98.353% # ( 6, 10 ] 6871 1.276% 99.629% ( 10, 15 ] 1311 0.243% 99.873% ( 15, 22 ] 193 0.036% 99.909% ( 22, 34 ] 19 0.004% 99.912% ( 34, 51 ] 42 0.008% 99.920% ( 51, 76 ] 37 0.007% 99.927% ( 76, 110 ] 114 0.021% 99.948% ( 110, 170 ] 108 0.020% 99.968% ( 170, 250 ] 65 0.012% 99.980% ( 250, 380 ] 62 0.012% 99.992% ( 380, 580 ] 71 0.013% 100.005% ( 580, 870 ] 49 0.009% 100.014% ( 870, 1300 ] 25 0.005% 100.019% ( 1300, 1900 ] 13 0.002% 100.021% ( 1900, 2900 ] 12 0.002% 100.023% ( 2900, 4400 ] 7 0.001% 100.025% ** Level 2 read latency histogram (micros): Count: 88557 Average: 2.6320 StdDev: 31.62 Min: 0 Median: 1.4081 Max: 3824 Percentiles: P50: 1.41 P75: 1.82 P99: 5.87 P99.9: 14.67 P99.99: 1471.64 ------------------------------------------------------ [ 0, 1 ] 22379 25.271% 25.271% ##### ( 1, 2 ] 53666 60.601% 85.871% ############ ( 2, 3 ] 6444 7.277% 93.148% # ( 3, 4 ] 3134 3.539% 96.687% # ( 4, 6 ] 2196 2.480% 99.167% ( 6, 10 ] 585 0.661% 99.827% ( 10, 15 ] 69 0.078% 99.905% ( 15, 22 ] 8 0.009% 99.914% ( 22, 34 ] 1 0.001% 99.915% ( 34, 51 ] 1 0.001% 99.916% ( 76, 110 ] 1 0.001% 99.918% ( 110, 170 ] 7 0.008% 99.925% ( 170, 250 ] 9 0.010% 99.936% ( 250, 380 ] 16 0.018% 99.954% ( 380, 580 ] 14 0.016% 99.970% ( 580, 870 ] 10 0.011% 99.981% ( 870, 1300 ] 7 0.008% 99.989% ( 1300, 1900 ] 4 0.005% 99.993% ( 1900, 2900 ] 2 0.002% 99.995% ( 2900, 4400 ] 4 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 329600 Average: 5.8883 StdDev: 62.03 Min: 0 Median: 1.7669 Max: 5682 Percentiles: P50: 1.77 P75: 2.70 P99: 11.14 P99.9: 574.30 P99.99: 1051.63 ------------------------------------------------------ [ 0, 1 ] 22055 6.691% 6.691% # ( 1, 2 ] 186138 56.474% 63.165% ########### ( 2, 3 ] 55386 16.804% 79.969% ### ( 3, 4 ] 28348 8.601% 88.570% ## ( 4, 6 ] 27166 8.242% 96.812% ## ( 6, 10 ] 6858 2.081% 98.893% ( 10, 15 ] 1545 0.469% 99.362% ( 15, 22 ] 192 0.058% 99.420% ( 22, 34 ] 20 0.006% 99.426% ( 34, 51 ] 24 0.007% 99.433% ( 51, 76 ] 18 0.005% 99.439% ( 76, 110 ] 109 0.033% 99.472% ( 110, 170 ] 314 0.095% 99.567% ( 170, 250 ] 349 0.106% 99.673% ( 250, 380 ] 387 0.117% 99.790% ( 380, 580 ] 372 0.113% 99.903% ( 580, 870 ] 240 0.073% 99.976% ( 870, 1300 ] 109 0.033% 100.009% ( 1300, 1900 ] 46 0.014% 100.023% ( 1900, 2900 ] 65 0.020% 100.043% ( 2900, 4400 ] 30 0.009% 100.052% ( 4400, 6600 ] 4 0.001% 100.053% ** Level 4 read latency histogram (micros): Count: 60 Average: 991.0667 StdDev: 1600.24 Min: 1 Median: 315.0000 Max: 6174 Percentiles: P50: 315.00 P75: 1156.67 P99: 6174.00 P99.9: 6174.00 P99.99: 6174.00 ------------------------------------------------------ [ 0, 1 ] 6 10.000% 10.000% ## ( 1, 2 ] 11 18.333% 28.333% #### ( 3, 4 ] 1 1.667% 30.000% ( 4, 6 ] 3 5.000% 35.000% # ( 6, 10 ] 2 3.333% 38.333% # ( 15, 22 ] 2 3.333% 41.667% # ( 22, 34 ] 1 1.667% 43.333% ( 76, 110 ] 1 1.667% 45.000% ( 110, 170 ] 1 1.667% 46.667% ( 250, 380 ] 4 6.667% 53.333% # ( 380, 580 ] 2 3.333% 56.667% # ( 580, 870 ] 7 11.667% 68.333% ## ( 870, 1300 ] 6 10.000% 78.333% ## ( 1300, 1900 ] 5 8.333% 86.667% ## ( 1900, 2900 ] 1 1.667% 88.333% ( 2900, 4400 ] 1 1.667% 90.000% ( 4400, 6600 ] 6 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 120 Average: 941.2250 StdDev: 1067.79 Min: 78 Median: 470.0000 Max: 4427 Percentiles: P50: 470.00 P75: 1450.00 P99: 4362.50 P99.9: 4427.00 P99.99: 4427.00 ------------------------------------------------------ ( 76, 110 ] 10 8.333% 8.333% ## ( 110, 170 ] 15 12.500% 20.833% ### ( 170, 250 ] 15 12.500% 33.333% ### ( 250, 380 ] 11 9.167% 42.500% ## ( 380, 580 ] 20 16.667% 59.167% ### ( 580, 870 ] 10 8.333% 67.500% ## ( 870, 1300 ] 7 5.833% 73.333% # ( 1300, 1900 ] 8 6.667% 80.000% # ( 1900, 2900 ] 15 12.500% 92.500% ### ( 2900, 4400 ] 8 6.667% 99.167% # ( 4400, 6600 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 30.0 total, 5.3 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 262.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.283 H:M:S, 27.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 184.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.597 H:M:S, 48.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/02-20:02:05 ... thread 0: (1000000,9000000) ops and (43969.2,171327.6) ops/second in (22.743188,52.530936) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/9 1.84 GB 0.0 8.5 0.0 8.5 17.0 8.5 0.0 2.0 144.1 288.9 60.33 54.88 150 0.402 8825K 16K 0.0 0.0 L1 12/12 1.12 GB 0.0 7.7 6.5 1.2 7.6 6.4 0.2 1.2 219.7 216.4 35.88 33.17 4 8.971 8005K 117K 0.0 0.0 L2 1/0 128.78 MB 1.3 0.3 0.2 0.2 0.3 0.2 5.3 1.8 252.5 252.4 1.38 1.32 2 0.691 354K 170 0.0 0.0 L3 27/10 1.82 GB 1.2 5.9 3.5 2.4 5.8 3.5 1.9 1.7 156.4 155.5 38.48 26.90 21 1.832 5982K 35K 0.0 0.0 L4 189/10 11.80 GB 1.2 2.7 2.3 0.5 2.7 2.2 2.0 1.2 126.0 125.0 22.17 12.86 26 0.853 2717K 18K 0.0 0.0 L5 1068/0 87.78 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1306/41 104.50 GB 0.0 25.1 12.5 12.7 33.5 20.8 11.3 3.9 162.6 216.7 158.25 129.14 203 0.780 25M 188K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.1 12.5 12.7 33.5 20.8 11.3 3.9 162.6 216.7 158.25 129.14 203 0.780 25M 188K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.1 12.5 12.7 24.9 12.3 0.0 0.0 196.4 194.9 131.04 106.60 79 1.659 25M 188K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 321.8 27.22 22.54 124 0.219 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 52.8 total, 52.5 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.49 GB write, 650.03 MB/s write, 25.13 GB read, 487.75 MB/s read, 158.3 seconds Interval compaction: 33.49 GB write, 652.90 MB/s write, 25.13 GB read, 489.90 MB/s read, 158.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 25, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 25, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 53, pending-compaction-bytes-delays: 16, pending-compaction-bytes-stops: 0, total-delays: 41, total-stops: 53, interval: 94 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4123546 Average: 2.8553 StdDev: 29.87 Min: 0 Median: 1.4703 Max: 9712 Percentiles: P50: 1.47 P75: 1.86 P99: 7.41 P99.9: 141.82 P99.99: 404.92 ------------------------------------------------------ [ 0, 1 ] 810968 19.667% 19.667% #### ( 1, 2 ] 2659727 64.501% 84.168% ############# ( 2, 3 ] 337368 8.182% 92.349% ## ( 3, 4 ] 151340 3.670% 96.019% # ( 4, 6 ] 110775 2.686% 98.706% # ( 6, 10 ] 34330 0.833% 99.538% ( 10, 15 ] 5158 0.125% 99.663% ( 15, 22 ] 687 0.017% 99.680% ( 22, 34 ] 53 0.001% 99.681% ( 34, 51 ] 28 0.001% 99.682% ( 51, 76 ] 161 0.004% 99.686% ( 76, 110 ] 6470 0.157% 99.843% ( 110, 170 ] 4447 0.108% 99.951% ( 170, 250 ] 849 0.021% 99.971% ( 250, 380 ] 698 0.017% 99.988% ( 380, 580 ] 607 0.015% 100.003% ( 580, 870 ] 329 0.008% 100.011% ( 870, 1300 ] 136 0.003% 100.014% ( 1300, 1900 ] 79 0.002% 100.016% ( 1900, 2900 ] 84 0.002% 100.018% ( 2900, 4400 ] 92 0.002% 100.020% ( 4400, 6600 ] 24 0.001% 100.021% ( 6600, 9900 ] 8 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1394183 Average: 5.7113 StdDev: 94.66 Min: 1 Median: 1.7496 Max: 10517 Percentiles: P50: 1.75 P75: 2.72 P99: 9.57 P99.9: 124.99 P99.99: 338.58 ------------------------------------------------------ [ 0, 1 ] 134220 9.627% 9.627% ## ( 1, 2 ] 750881 53.858% 63.485% ########### ( 2, 3 ] 223021 15.997% 79.482% ### ( 3, 4 ] 117068 8.397% 87.879% ## ( 4, 6 ] 127869 9.172% 97.050% ## ( 6, 10 ] 30443 2.184% 99.234% ( 10, 15 ] 6576 0.472% 99.706% ( 15, 22 ] 900 0.065% 99.770% ( 22, 34 ] 64 0.005% 99.775% ( 34, 51 ] 61 0.004% 99.779% ( 51, 76 ] 106 0.008% 99.787% ( 76, 110 ] 1339 0.096% 99.883% ( 110, 170 ] 964 0.069% 99.952% ( 170, 250 ] 289 0.021% 99.973% ( 250, 380 ] 356 0.026% 99.998% ( 380, 580 ] 465 0.033% 100.031% ( 580, 870 ] 467 0.033% 100.065% ( 870, 1300 ] 332 0.024% 100.089% ( 1300, 1900 ] 182 0.013% 100.102% ( 1900, 2900 ] 189 0.014% 100.115% ( 2900, 4400 ] 328 0.024% 100.139% ( 4400, 6600 ] 110 0.008% 100.147% ( 6600, 9900 ] 41 0.003% 100.150% ( 9900, 14000 ] 4 0.000% 100.150% ** Level 2 read latency histogram (micros): Count: 88557 Average: 2.6320 StdDev: 31.62 Min: 0 Median: 1.4081 Max: 3824 Percentiles: P50: 1.41 P75: 1.82 P99: 5.87 P99.9: 14.67 P99.99: 1471.64 ------------------------------------------------------ [ 0, 1 ] 22379 25.271% 25.271% ##### ( 1, 2 ] 53666 60.601% 85.871% ############ ( 2, 3 ] 6444 7.277% 93.148% # ( 3, 4 ] 3134 3.539% 96.687% # ( 4, 6 ] 2196 2.480% 99.167% ( 6, 10 ] 585 0.661% 99.827% ( 10, 15 ] 69 0.078% 99.905% ( 15, 22 ] 8 0.009% 99.914% ( 22, 34 ] 1 0.001% 99.915% ( 34, 51 ] 1 0.001% 99.916% ( 76, 110 ] 1 0.001% 99.918% ( 110, 170 ] 7 0.008% 99.925% ( 170, 250 ] 9 0.010% 99.936% ( 250, 380 ] 16 0.018% 99.954% ( 380, 580 ] 14 0.016% 99.970% ( 580, 870 ] 10 0.011% 99.981% ( 870, 1300 ] 7 0.008% 99.989% ( 1300, 1900 ] 4 0.005% 99.993% ( 1900, 2900 ] 2 0.002% 99.995% ( 2900, 4400 ] 4 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 1154557 Average: 7.5229 StdDev: 104.93 Min: 0 Median: 1.9006 Max: 12100 Percentiles: P50: 1.90 P75: 3.02 P99: 9.65 P99.9: 419.17 P99.99: 666.79 ------------------------------------------------------ [ 0, 1 ] 42612 3.691% 3.691% # ( 1, 2 ] 593707 51.423% 55.114% ########## ( 2, 3 ] 227424 19.698% 74.812% #### ( 3, 4 ] 122653 10.623% 85.435% ## ( 4, 6 ] 133525 11.565% 97.000% ## ( 6, 10 ] 25301 2.191% 99.191% ( 10, 15 ] 5372 0.465% 99.657% ( 15, 22 ] 617 0.053% 99.710% ( 22, 34 ] 59 0.005% 99.715% ( 34, 51 ] 44 0.004% 99.719% ( 51, 76 ] 37 0.003% 99.722% ( 76, 110 ] 142 0.012% 99.735% ( 110, 170 ] 433 0.038% 99.772% ( 170, 250 ] 529 0.046% 99.818% ( 250, 380 ] 762 0.066% 99.884% ( 380, 580 ] 952 0.082% 99.966% ( 580, 870 ] 914 0.079% 100.046% ( 870, 1300 ] 643 0.056% 100.101% ( 1300, 1900 ] 322 0.028% 100.129% ( 1900, 2900 ] 310 0.027% 100.156% ( 2900, 4400 ] 347 0.030% 100.186% ( 4400, 6600 ] 83 0.007% 100.193% ( 6600, 9900 ] 24 0.002% 100.195% ( 9900, 14000 ] 5 0.000% 100.196% ** Level 4 read latency histogram (micros): Count: 23451 Average: 17.9379 StdDev: 177.25 Min: 1 Median: 1.9795 Max: 6174 Percentiles: P50: 1.98 P75: 3.34 P99: 434.97 P99.9: 3296.36 P99.99: 5955.10 ------------------------------------------------------ [ 0, 1 ] 675 2.878% 2.878% # ( 1, 2 ] 11282 48.109% 50.987% ########## ( 2, 3 ] 4751 20.259% 71.246% #### ( 3, 4 ] 2568 10.950% 82.197% ## ( 4, 6 ] 3033 12.933% 95.130% ### ( 6, 10 ] 611 2.605% 97.736% # ( 10, 15 ] 151 0.644% 98.380% ( 15, 22 ] 13 0.055% 98.435% ( 22, 34 ] 5 0.021% 98.456% ( 34, 51 ] 1 0.004% 98.461% ( 51, 76 ] 2 0.009% 98.469% ( 76, 110 ] 3 0.013% 98.482% ( 110, 170 ] 25 0.107% 98.589% ( 170, 250 ] 47 0.200% 98.789% ( 250, 380 ] 33 0.141% 98.930% ( 380, 580 ] 60 0.256% 99.186% ( 580, 870 ] 65 0.277% 99.463% ( 870, 1300 ] 52 0.222% 99.684% ( 1300, 1900 ] 29 0.124% 99.808% ( 1900, 2900 ] 16 0.068% 99.876% ( 2900, 4400 ] 21 0.090% 99.966% ( 4400, 6600 ] 8 0.034% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 941.2250 StdDev: 1067.79 Min: 78 Median: 470.0000 Max: 4427 Percentiles: P50: 470.00 P75: 1450.00 P99: 4362.50 P99.9: 4427.00 P99.99: 4427.00 ------------------------------------------------------ ( 76, 110 ] 10 8.333% 8.333% ## ( 110, 170 ] 15 12.500% 20.833% ### ( 170, 250 ] 15 12.500% 33.333% ### ( 250, 380 ] 11 9.167% 42.500% ## ( 380, 580 ] 20 16.667% 59.167% ### ( 580, 870 ] 10 8.333% 67.500% ## ( 870, 1300 ] 7 5.833% 73.333% # ( 1300, 1900 ] 8 6.667% 80.000% # ( 1900, 2900 ] 15 12.500% 92.500% ### ( 2900, 4400 ] 8 6.667% 99.167% # ( 4400, 6600 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 52.8 total, 22.7 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 167.87 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.367 H:M:S, 51.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 43.27 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:19.084 H:M:S, 83.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/02-20:02:09 ... thread 0: (1000000,10000000) ops and (265331.5,177620.5) ops/second in (3.768870,56.299806) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/13 2.82 GB 81.8 9.5 0.0 9.5 19.0 9.5 0.0 2.0 142.6 285.8 68.03 61.45 166 0.410 9848K 18K 0.0 0.0 L1 12/12 1.12 GB 0.0 7.7 6.5 1.2 7.6 6.4 0.2 1.2 219.7 216.4 35.88 33.17 4 8.971 8005K 117K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 5.3 1.8 252.5 252.4 1.38 1.32 2 0.691 354K 170 0.0 0.0 L3 12/0 910.37 MB 0.9 5.9 3.5 2.4 5.8 3.5 2.0 1.7 156.4 155.5 38.48 26.90 21 1.832 5982K 35K 0.0 0.0 L4 164/0 9.58 GB 1.0 4.3 3.3 1.0 4.3 3.3 2.0 1.3 133.7 132.4 33.03 20.24 38 0.869 4363K 37K 0.0 0.0 L5 1108/0 91.04 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1312/25 105.46 GB 0.0 27.7 13.5 14.2 37.0 22.9 14.7 3.9 160.4 214.4 176.81 143.09 231 0.765 28M 208K 0.0 0.0 Int 0/0 0.00 KB 0.0 27.7 13.5 14.2 37.0 22.9 14.7 3.9 160.4 214.4 176.81 143.09 231 0.765 28M 208K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 27.7 13.5 14.2 27.5 13.3 0.0 0.0 194.2 192.7 146.08 117.91 94 1.554 28M 208K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 317.8 30.72 25.18 137 0.224 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.5 total, 56.3 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 37.03 GB write, 670.69 MB/s write, 27.70 GB read, 501.74 MB/s read, 176.8 seconds Interval compaction: 37.03 GB write, 673.44 MB/s write, 27.70 GB read, 503.80 MB/s read, 176.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 25, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 25, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 69, pending-compaction-bytes-delays: 16, pending-compaction-bytes-stops: 0, total-delays: 41, total-stops: 69, interval: 110 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4551694 Average: 2.8824 StdDev: 30.79 Min: 0 Median: 1.4864 Max: 9712 Percentiles: P50: 1.49 P75: 1.88 P99: 7.58 P99.9: 137.40 P99.99: 388.37 ------------------------------------------------------ [ 0, 1 ] 852822 18.736% 18.736% #### ( 1, 2 ] 2925614 64.275% 83.012% ############# ( 2, 3 ] 396093 8.702% 91.714% ## ( 3, 4 ] 179265 3.938% 95.652% # ( 4, 6 ] 136265 2.994% 98.646% # ( 6, 10 ] 40872 0.898% 99.544% ( 10, 15 ] 6624 0.146% 99.689% ( 15, 22 ] 813 0.018% 99.707% ( 22, 34 ] 64 0.001% 99.709% ( 34, 51 ] 30 0.001% 99.709% ( 51, 76 ] 161 0.004% 99.713% ( 76, 110 ] 6476 0.142% 99.855% ( 110, 170 ] 4474 0.098% 99.953% ( 170, 250 ] 891 0.020% 99.973% ( 250, 380 ] 747 0.016% 99.989% ( 380, 580 ] 665 0.015% 100.004% ( 580, 870 ] 395 0.009% 100.013% ( 870, 1300 ] 183 0.004% 100.017% ( 1300, 1900 ] 95 0.002% 100.019% ( 1900, 2900 ] 95 0.002% 100.021% ( 2900, 4400 ] 101 0.002% 100.023% ( 4400, 6600 ] 28 0.001% 100.024% ( 6600, 9900 ] 10 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1497518 Average: 5.5634 StdDev: 91.63 Min: 1 Median: 1.7475 Max: 10517 Percentiles: P50: 1.75 P75: 2.70 P99: 9.57 P99.9: 130.22 P99.99: 362.84 ------------------------------------------------------ [ 0, 1 ] 139849 9.339% 9.339% ## ( 1, 2 ] 814570 54.395% 63.733% ########### ( 2, 3 ] 240323 16.048% 79.781% ### ( 3, 4 ] 123810 8.268% 88.049% ## ( 4, 6 ] 134775 9.000% 97.049% ## ( 6, 10 ] 32765 2.188% 99.237% ( 10, 15 ] 7002 0.468% 99.705% ( 15, 22 ] 961 0.064% 99.769% ( 22, 34 ] 66 0.004% 99.773% ( 34, 51 ] 61 0.004% 99.777% ( 51, 76 ] 107 0.007% 99.784% ( 76, 110 ] 1387 0.093% 99.877% ( 110, 170 ] 1022 0.068% 99.945% ( 170, 250 ] 330 0.022% 99.967% ( 250, 380 ] 392 0.026% 99.993% ( 380, 580 ] 502 0.034% 100.027% ( 580, 870 ] 492 0.033% 100.060% ( 870, 1300 ] 344 0.023% 100.083% ( 1300, 1900 ] 185 0.012% 100.095% ( 1900, 2900 ] 192 0.013% 100.108% ( 2900, 4400 ] 329 0.022% 100.130% ( 4400, 6600 ] 110 0.007% 100.137% ( 6600, 9900 ] 41 0.003% 100.140% ( 9900, 14000 ] 4 0.000% 100.140% ** Level 2 read latency histogram (micros): Count: 88557 Average: 2.6320 StdDev: 31.62 Min: 0 Median: 1.4081 Max: 3824 Percentiles: P50: 1.41 P75: 1.82 P99: 5.87 P99.9: 14.67 P99.99: 1471.64 ------------------------------------------------------ [ 0, 1 ] 22379 25.271% 25.271% ##### ( 1, 2 ] 53666 60.601% 85.871% ############ ( 2, 3 ] 6444 7.277% 93.148% # ( 3, 4 ] 3134 3.539% 96.687% # ( 4, 6 ] 2196 2.480% 99.167% ( 6, 10 ] 585 0.661% 99.827% ( 10, 15 ] 69 0.078% 99.905% ( 15, 22 ] 8 0.009% 99.914% ( 22, 34 ] 1 0.001% 99.915% ( 34, 51 ] 1 0.001% 99.916% ( 76, 110 ] 1 0.001% 99.918% ( 110, 170 ] 7 0.008% 99.925% ( 170, 250 ] 9 0.010% 99.936% ( 250, 380 ] 16 0.018% 99.954% ( 380, 580 ] 14 0.016% 99.970% ( 580, 870 ] 10 0.011% 99.981% ( 870, 1300 ] 7 0.008% 99.989% ( 1300, 1900 ] 4 0.005% 99.993% ( 1900, 2900 ] 2 0.002% 99.995% ( 2900, 4400 ] 4 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 1388109 Average: 7.3875 StdDev: 104.20 Min: 0 Median: 1.8993 Max: 12100 Percentiles: P50: 1.90 P75: 3.00 P99: 9.67 P99.9: 405.19 P99.99: 660.93 ------------------------------------------------------ [ 0, 1 ] 49387 3.558% 3.558% # ( 1, 2 ] 716820 51.640% 55.198% ########## ( 2, 3 ] 274465 19.773% 74.970% #### ( 3, 4 ] 145413 10.476% 85.446% ## ( 4, 6 ] 159399 11.483% 96.929% ## ( 6, 10 ] 31305 2.255% 99.185% ( 10, 15 ] 6732 0.485% 99.669% ( 15, 22 ] 763 0.055% 99.724% ( 22, 34 ] 74 0.005% 99.730% ( 34, 51 ] 51 0.004% 99.733% ( 51, 76 ] 38 0.003% 99.736% ( 76, 110 ] 162 0.012% 99.748% ( 110, 170 ] 500 0.036% 99.784% ( 170, 250 ] 602 0.043% 99.827% ( 250, 380 ] 872 0.063% 99.890% ( 380, 580 ] 1095 0.079% 99.969% ( 580, 870 ] 1047 0.075% 100.044% ( 870, 1300 ] 741 0.053% 100.098% ( 1300, 1900 ] 369 0.027% 100.124% ( 1900, 2900 ] 361 0.026% 100.150% ( 2900, 4400 ] 403 0.029% 100.179% ( 4400, 6600 ] 102 0.007% 100.187% ( 6600, 9900 ] 33 0.002% 100.189% ( 9900, 14000 ] 5 0.000% 100.189% ** Level 4 read latency histogram (micros): Count: 53555 Average: 14.2416 StdDev: 155.81 Min: 1 Median: 1.9403 Max: 7211 Percentiles: P50: 1.94 P75: 3.13 P99: 201.12 P99.9: 2509.07 P99.99: 5601.28 ------------------------------------------------------ [ 0, 1 ] 1402 2.618% 2.618% # ( 1, 2 ] 26987 50.391% 53.009% ########## ( 2, 3 ] 11085 20.698% 73.707% #### ( 3, 4 ] 5468 10.210% 83.917% ## ( 4, 6 ] 6274 11.715% 95.633% ## ( 6, 10 ] 1350 2.521% 98.153% # ( 10, 15 ] 340 0.635% 98.788% ( 15, 22 ] 32 0.060% 98.848% ( 22, 34 ] 6 0.011% 98.859% ( 34, 51 ] 4 0.007% 98.867% ( 51, 76 ] 4 0.007% 98.874% ( 76, 110 ] 4 0.007% 98.882% ( 110, 170 ] 37 0.069% 98.951% ( 170, 250 ] 68 0.127% 99.078% ( 250, 380 ] 47 0.088% 99.165% ( 380, 580 ] 107 0.200% 99.365% ( 580, 870 ] 123 0.230% 99.595% ( 870, 1300 ] 101 0.189% 99.783% ( 1300, 1900 ] 46 0.086% 99.869% ( 1900, 2900 ] 27 0.050% 99.920% ( 2900, 4400 ] 30 0.056% 99.976% ( 4400, 6600 ] 14 0.026% 100.002% ( 6600, 9900 ] 1 0.002% 100.004% ** Level 5 read latency histogram (micros): Count: 320 Average: 1306.5563 StdDev: 1425.64 Min: 78 Median: 631.7857 Max: 10591 Percentiles: P50: 631.79 P75: 2090.48 P99: 6160.00 P99.9: 10591.00 P99.99: 10591.00 ------------------------------------------------------ ( 76, 110 ] 13 4.062% 4.062% # ( 110, 170 ] 30 9.375% 13.438% ## ( 170, 250 ] 24 7.500% 20.938% ## ( 250, 380 ] 35 10.938% 31.875% ## ( 380, 580 ] 53 16.562% 48.438% ### ( 580, 870 ] 28 8.750% 57.188% ## ( 870, 1300 ] 24 7.500% 64.688% ## ( 1300, 1900 ] 25 7.812% 72.500% ## ( 1900, 2900 ] 42 13.125% 85.625% ### ( 2900, 4400 ] 34 10.625% 96.250% ## ( 4400, 6600 ] 11 3.438% 99.688% # ( 9900, 14000 ] 1 0.312% 100.000% ** DB Stats ** Uptime(secs): 56.5 total, 3.8 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 174.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.360 H:M:S, 50.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 261.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.993 H:M:S, 26.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/02-20:02:12 ... thread 0: (1000000,11000000) ops and (334205.4,185522.6) ops/second in (2.992172,59.291978) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/9 3.75 GB 201.4 10.2 0.0 10.2 20.6 10.4 0.0 2.0 142.1 287.5 73.56 66.64 182 0.404 10M 18K 0.0 0.0 L1 12/12 1.12 GB 0.0 7.7 6.5 1.2 7.6 6.4 0.2 1.2 219.7 216.4 35.88 33.17 4 8.971 8005K 117K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 5.3 1.8 252.5 252.4 1.38 1.32 2 0.691 354K 170 0.0 0.0 L3 12/0 910.37 MB 0.9 5.9 3.5 2.4 5.8 3.5 2.0 1.7 156.4 155.5 38.48 26.90 21 1.832 5982K 35K 0.0 0.0 L4 164/0 9.58 GB 1.0 4.3 3.3 1.0 4.3 3.3 2.0 1.3 133.7 132.4 33.03 20.24 38 0.869 4363K 37K 0.0 0.0 L5 1108/0 91.04 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1313/21 106.39 GB 0.0 28.4 13.5 14.9 38.7 23.8 14.7 3.7 159.7 217.3 182.33 148.29 247 0.738 29M 208K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.4 13.5 14.9 38.7 23.8 14.7 3.7 159.7 217.3 182.33 148.29 247 0.738 29M 208K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.4 13.5 14.9 28.2 13.3 0.0 0.0 195.5 194.1 148.92 120.70 97 1.535 29M 208K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 320.6 33.41 27.59 150 0.223 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.5 total, 59.3 interval Flush(GB): cumulative 10.458, interval 10.458 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 38.69 GB write, 665.53 MB/s write, 28.44 GB read, 489.22 MB/s read, 182.3 seconds Interval compaction: 38.69 GB write, 668.13 MB/s write, 28.44 GB read, 491.13 MB/s read, 182.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 25, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 25, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 71, pending-compaction-bytes-delays: 16, pending-compaction-bytes-stops: 0, total-delays: 41, total-stops: 71, interval: 112 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4750511 Average: 2.8579 StdDev: 30.31 Min: 0 Median: 1.4852 Max: 9712 Percentiles: P50: 1.49 P75: 1.87 P99: 7.48 P99.9: 136.11 P99.99: 388.54 ------------------------------------------------------ [ 0, 1 ] 890147 18.738% 18.738% #### ( 1, 2 ] 3060886 64.433% 83.171% ############# ( 2, 3 ] 411740 8.667% 91.838% ## ( 3, 4 ] 185623 3.907% 95.745% # ( 4, 6 ] 139137 2.929% 98.674% # ( 6, 10 ] 41870 0.881% 99.556% ( 10, 15 ] 6803 0.143% 99.699% ( 15, 22 ] 830 0.017% 99.716% ( 22, 34 ] 66 0.001% 99.718% ( 34, 51 ] 30 0.001% 99.718% ( 51, 76 ] 164 0.003% 99.722% ( 76, 110 ] 6497 0.137% 99.859% ( 110, 170 ] 4526 0.095% 99.954% ( 170, 250 ] 922 0.019% 99.973% ( 250, 380 ] 768 0.016% 99.989% ( 380, 580 ] 678 0.014% 100.004% ( 580, 870 ] 408 0.009% 100.012% ( 870, 1300 ] 186 0.004% 100.016% ( 1300, 1900 ] 96 0.002% 100.018% ( 1900, 2900 ] 97 0.002% 100.020% ( 2900, 4400 ] 102 0.002% 100.022% ( 4400, 6600 ] 28 0.001% 100.023% ( 6600, 9900 ] 10 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1637050 Average: 5.3114 StdDev: 87.71 Min: 1 Median: 1.7206 Max: 10517 Percentiles: P50: 1.72 P75: 2.61 P99: 9.50 P99.9: 134.35 P99.99: 371.09 ------------------------------------------------------ [ 0, 1 ] 162457 9.924% 9.924% ## ( 1, 2 ] 910440 55.615% 65.538% ########### ( 2, 3 ] 252348 15.415% 80.953% ### ( 3, 4 ] 127682 7.800% 88.753% ## ( 4, 6 ] 137044 8.371% 97.124% ## ( 6, 10 ] 35123 2.146% 99.270% ( 10, 15 ] 7188 0.439% 99.709% ( 15, 22 ] 974 0.059% 99.768% ( 22, 34 ] 68 0.004% 99.772% ( 34, 51 ] 61 0.004% 99.776% ( 51, 76 ] 109 0.007% 99.783% ( 76, 110 ] 1425 0.087% 99.870% ( 110, 170 ] 1217 0.074% 99.944% ( 170, 250 ] 360 0.022% 99.966% ( 250, 380 ] 419 0.026% 99.992% ( 380, 580 ] 528 0.032% 100.024% ( 580, 870 ] 501 0.031% 100.055% ( 870, 1300 ] 346 0.021% 100.076% ( 1300, 1900 ] 185 0.011% 100.087% ( 1900, 2900 ] 192 0.012% 100.099% ( 2900, 4400 ] 329 0.020% 100.119% ( 4400, 6600 ] 110 0.007% 100.126% ( 6600, 9900 ] 41 0.003% 100.128% ( 9900, 14000 ] 4 0.000% 100.128% ** Level 2 read latency histogram (micros): Count: 88557 Average: 2.6320 StdDev: 31.62 Min: 0 Median: 1.4081 Max: 3824 Percentiles: P50: 1.41 P75: 1.82 P99: 5.87 P99.9: 14.67 P99.99: 1471.64 ------------------------------------------------------ [ 0, 1 ] 22379 25.271% 25.271% ##### ( 1, 2 ] 53666 60.601% 85.871% ############ ( 2, 3 ] 6444 7.277% 93.148% # ( 3, 4 ] 3134 3.539% 96.687% # ( 4, 6 ] 2196 2.480% 99.167% ( 6, 10 ] 585 0.661% 99.827% ( 10, 15 ] 69 0.078% 99.905% ( 15, 22 ] 8 0.009% 99.914% ( 22, 34 ] 1 0.001% 99.915% ( 34, 51 ] 1 0.001% 99.916% ( 76, 110 ] 1 0.001% 99.918% ( 110, 170 ] 7 0.008% 99.925% ( 170, 250 ] 9 0.010% 99.936% ( 250, 380 ] 16 0.018% 99.954% ( 380, 580 ] 14 0.016% 99.970% ( 580, 870 ] 10 0.011% 99.981% ( 870, 1300 ] 7 0.008% 99.989% ( 1300, 1900 ] 4 0.005% 99.993% ( 1900, 2900 ] 2 0.002% 99.995% ( 2900, 4400 ] 4 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 1388109 Average: 7.3875 StdDev: 104.20 Min: 0 Median: 1.8993 Max: 12100 Percentiles: P50: 1.90 P75: 3.00 P99: 9.67 P99.9: 405.19 P99.99: 660.93 ------------------------------------------------------ [ 0, 1 ] 49387 3.558% 3.558% # ( 1, 2 ] 716820 51.640% 55.198% ########## ( 2, 3 ] 274465 19.773% 74.970% #### ( 3, 4 ] 145413 10.476% 85.446% ## ( 4, 6 ] 159399 11.483% 96.929% ## ( 6, 10 ] 31305 2.255% 99.185% ( 10, 15 ] 6732 0.485% 99.669% ( 15, 22 ] 763 0.055% 99.724% ( 22, 34 ] 74 0.005% 99.730% ( 34, 51 ] 51 0.004% 99.733% ( 51, 76 ] 38 0.003% 99.736% ( 76, 110 ] 162 0.012% 99.748% ( 110, 170 ] 500 0.036% 99.784% ( 170, 250 ] 602 0.043% 99.827% ( 250, 380 ] 872 0.063% 99.890% ( 380, 580 ] 1095 0.079% 99.969% ( 580, 870 ] 1047 0.075% 100.044% ( 870, 1300 ] 741 0.053% 100.098% ( 1300, 1900 ] 369 0.027% 100.124% ( 1900, 2900 ] 361 0.026% 100.150% ( 2900, 4400 ] 403 0.029% 100.179% ( 4400, 6600 ] 102 0.007% 100.187% ( 6600, 9900 ] 33 0.002% 100.189% ( 9900, 14000 ] 5 0.000% 100.189% ** Level 4 read latency histogram (micros): Count: 53555 Average: 14.2416 StdDev: 155.81 Min: 1 Median: 1.9403 Max: 7211 Percentiles: P50: 1.94 P75: 3.13 P99: 201.12 P99.9: 2509.07 P99.99: 5601.28 ------------------------------------------------------ [ 0, 1 ] 1402 2.618% 2.618% # ( 1, 2 ] 26987 50.391% 53.009% ########## ( 2, 3 ] 11085 20.698% 73.707% #### ( 3, 4 ] 5468 10.210% 83.917% ## ( 4, 6 ] 6274 11.715% 95.633% ## ( 6, 10 ] 1350 2.521% 98.153% # ( 10, 15 ] 340 0.635% 98.788% ( 15, 22 ] 32 0.060% 98.848% ( 22, 34 ] 6 0.011% 98.859% ( 34, 51 ] 4 0.007% 98.867% ( 51, 76 ] 4 0.007% 98.874% ( 76, 110 ] 4 0.007% 98.882% ( 110, 170 ] 37 0.069% 98.951% ( 170, 250 ] 68 0.127% 99.078% ( 250, 380 ] 47 0.088% 99.165% ( 380, 580 ] 107 0.200% 99.365% ( 580, 870 ] 123 0.230% 99.595% ( 870, 1300 ] 101 0.189% 99.783% ( 1300, 1900 ] 46 0.086% 99.869% ( 1900, 2900 ] 27 0.050% 99.920% ( 2900, 4400 ] 30 0.056% 99.976% ( 4400, 6600 ] 14 0.026% 100.002% ( 6600, 9900 ] 1 0.002% 100.004% ** Level 5 read latency histogram (micros): Count: 320 Average: 1306.5563 StdDev: 1425.64 Min: 78 Median: 631.7857 Max: 10591 Percentiles: P50: 631.79 P75: 2090.48 P99: 6160.00 P99.9: 10591.00 P99.99: 10591.00 ------------------------------------------------------ ( 76, 110 ] 13 4.062% 4.062% # ( 110, 170 ] 30 9.375% 13.438% ## ( 170, 250 ] 24 7.500% 20.938% ## ( 250, 380 ] 35 10.938% 31.875% ## ( 380, 580 ] 53 16.562% 48.438% ### ( 580, 870 ] 28 8.750% 57.188% ## ( 870, 1300 ] 24 7.500% 64.688% ## ( 1300, 1900 ] 25 7.812% 72.500% ## ( 1900, 2900 ] 42 13.125% 85.625% ### ( 2900, 4400 ] 34 10.625% 96.250% ## ( 4400, 6600 ] 11 3.438% 99.688% # ( 9900, 14000 ] 1 0.312% 100.000% ** DB Stats ** Uptime(secs): 59.5 total, 3.0 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 181.87 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.760 H:M:S, 48.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.92 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.400 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.363 micros/op 186468 ops/sec 60.064 seconds 11199999 operations; 180.7 MB/s Microseconds per write: Count: 11199999 Average: 5.3628 StdDev: 431.14 Min: 0 Median: 1.7369 Max: 752345 Percentiles: P50: 1.74 P75: 2.78 P99: 9.26 P99.9: 1073.72 P99.99: 2594.03 ------------------------------------------------------ [ 0, 1 ] 1536750 13.721% 13.721% ### ( 1, 2 ] 5514272 49.235% 62.956% ########## ( 2, 3 ] 1740318 15.539% 78.494% ### ( 3, 4 ] 1541992 13.768% 92.262% ### ( 4, 6 ] 647806 5.784% 98.046% # ( 6, 10 ] 131319 1.172% 99.218% ( 10, 15 ] 44276 0.395% 99.614% ( 15, 22 ] 10875 0.097% 99.711% ( 22, 34 ] 2427 0.022% 99.732% ( 34, 51 ] 234 0.002% 99.735% ( 51, 76 ] 39 0.000% 99.735% ( 76, 110 ] 7171 0.064% 99.799% ( 110, 170 ] 3628 0.032% 99.831% ( 170, 250 ] 354 0.003% 99.834% ( 250, 380 ] 202 0.002% 99.836% ( 380, 580 ] 19 0.000% 99.836% ( 580, 870 ] 28 0.000% 99.837% ( 870, 1300 ] 14963 0.134% 99.970% ( 1300, 1900 ] 67 0.001% 99.971% ( 1900, 2900 ] 3082 0.028% 99.998% ( 2900, 4400 ] 110 0.001% 99.999% ( 4400, 6600 ] 21 0.000% 100.000% ( 6600, 9900 ] 13 0.000% 100.000% ( 9900, 14000 ] 5 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 15 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 234936 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11199999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11558398968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 573 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 29008497 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 33150149884 rocksdb.compact.write.bytes COUNT : 32915978226 rocksdb.flush.write.bytes COUNT : 11427839129 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 74 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 207 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11335752704 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4455424 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 33260401009 rocksdb.non.last.level.read.count COUNT : 8033309 rocksdb.block.checksum.compute.count COUNT : 8032237 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.384039 P95 : 3.933188 P99 : 7.692368 P100 : 752343.000000 COUNT : 11199999 SUM : 54802726 rocksdb.compaction.times.micros P50 : 1048378.378378 P95 : 3782000.000000 P99 : 14240000.000000 P100 : 21880194.000000 COUNT : 97 SUM : 148920749 rocksdb.compaction.times.cpu_micros P50 : 895000.000000 P95 : 3436666.666667 P99 : 14240000.000000 P100 : 19640652.000000 COUNT : 97 SUM : 120698517 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 686.220930 P95 : 5390.000000 P99 : 61750.000000 P100 : 286376.000000 COUNT : 153 SUM : 530411 rocksdb.compaction.outfile.sync.micros P50 : 1206.833333 P95 : 153500.000000 P99 : 237636.363636 P100 : 280598.000000 COUNT : 370 SUM : 9645514 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 106.033333 P95 : 1455.000000 P99 : 4133.000000 P100 : 6077.000000 COUNT : 289 SUM : 96682 rocksdb.table.open.io.micros P50 : 1546.534653 P95 : 8801.718750 P99 : 13044.187500 P100 : 21062.000000 COUNT : 573 SUM : 1371317 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.649327 P95 : 8.174618 P99 : 12.380856 P100 : 15436.000000 COUNT : 8030909 SUM : 50695661 rocksdb.read.block.get.micros P50 : 522.148760 P95 : 3855.769231 P99 : 5943.520000 P100 : 11737.000000 COUNT : 1146 SUM : 1130105 rocksdb.write.raw.block.micros P50 : 0.513738 P95 : 0.976102 P99 : 2.926407 P100 : 14804.000000 COUNT : 10762139 SUM : 22009386 rocksdb.numfiles.in.singlecompaction P50 : 3.182927 P95 : 5.366667 P99 : 16.470000 P100 : 19.000000 COUNT : 158 SUM : 564 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562658 P95 : 1157.222883 P99 : 2408.254072 P100 : 752162.000000 COUNT : 164366 SUM : 29026501 rocksdb.sst.read.micros P50 : 1.593979 P95 : 4.943267 P99 : 8.980248 P100 : 12100.000000 COUNT : 8034090 SUM : 34312070 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11199999 SUM : 11558398968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212285.714286 P95 : 422750.000000 P99 : 783150.000000 P100 : 921157.000000 COUNT : 153 SUM : 33952159 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 354 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0