[2024-11-18 07:44:55.225820] Starting SPDK v25.01-pre git sha1 83e8405e4 / DPDK 23.11.0 initialization... [2024-11-18 07:44:55.226098] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid429056 ] Set seed to 1731912295219084 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-18 07:44:55.361019] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-18 07:44:55.384563] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-18 07:44:55.384614] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 429056' to capture a snapshot of events at runtime. [2024-11-18 07:44:55.384625] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-18 07:44:55.384635] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-18 07:44:55.384643] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid429056 for offline analysis/debug. [2024-11-18 07:44:55.385207] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Nov 18 07:44:59 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/18-07:45:02 ... thread 0: (1000000,1000000) ops and (327525.0,327525.0) ops/second in (3.053202,3.053202) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 440.98 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 344.1 2.56 2.31 12 0.214 0 0 0.0 0.0 L1 3/0 249.79 MB 25.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 248.8 248.5 1.01 0.98 1 1.013 255K 248 0.0 0.0 L2 3/2 190.80 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 228.6 228.5 0.84 0.80 2 0.421 195K 94 0.0 0.0 L3 9/0 741.23 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/6 97.00 GB 0.0 0.4 0.4 0.1 1.3 1.2 0.5 1.5 100.6 300.2 4.42 4.10 15 0.294 451K 342 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.3 1.2 0.4 1.5 100.6 300.2 4.42 4.10 15 0.294 451K 342 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 239.6 239.4 1.85 1.79 3 0.618 451K 342 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 344.1 2.56 2.31 12 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.3 total, 3.1 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.29 GB write, 404.06 MB/s write, 0.43 GB read, 135.40 MB/s read, 4.4 seconds Interval compaction: 1.29 GB write, 434.02 MB/s write, 0.43 GB read, 145.44 MB/s read, 4.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 159671 Average: 2.0174 StdDev: 15.38 Min: 0 Median: 1.3508 Max: 4020 Percentiles: P50: 1.35 P75: 1.77 P99: 5.32 P99.9: 9.74 P99.99: 16.78 ------------------------------------------------------ [ 0, 1 ] 46399 29.059% 29.059% ###### ( 1, 2 ] 95306 59.689% 88.748% ############ ( 2, 3 ] 9996 6.260% 95.008% # ( 3, 4 ] 4622 2.895% 97.903% # ( 4, 6 ] 2659 1.665% 99.568% ( 6, 10 ] 568 0.356% 99.924% ( 10, 15 ] 105 0.066% 99.990% ( 15, 22 ] 8 0.005% 99.995% ( 22, 34 ] 2 0.001% 99.996% ( 34, 51 ] 3 0.002% 99.998% ( 110, 170 ] 6 0.004% 100.002% ( 170, 250 ] 5 0.003% 100.005% ( 250, 380 ] 6 0.004% 100.009% ( 380, 580 ] 1 0.001% 100.009% ( 580, 870 ] 1 0.001% 100.010% ( 870, 1300 ] 2 0.001% 100.011% ( 2900, 4400 ] 3 0.002% 100.013% ** Level 1 read latency histogram (micros): Count: 515 Average: 17.4777 StdDev: 142.88 Min: 1 Median: 2.8062 Max: 2795 Percentiles: P50: 2.81 P75: 4.03 P99: 370.25 P99.9: 2385.00 P99.99: 2795.00 ------------------------------------------------------ [ 0, 1 ] 6 1.165% 1.165% ( 1, 2 ] 108 20.971% 22.136% #### ( 2, 3 ] 178 34.563% 56.699% ####### ( 3, 4 ] 93 18.058% 74.757% #### ( 4, 6 ] 85 16.505% 91.262% ### ( 6, 10 ] 27 5.243% 96.505% # ( 10, 15 ] 4 0.777% 97.282% ( 15, 22 ] 1 0.194% 97.476% ( 22, 34 ] 1 0.194% 97.670% ( 34, 51 ] 1 0.194% 97.864% ( 76, 110 ] 1 0.194% 98.058% ( 110, 170 ] 1 0.194% 98.252% ( 170, 250 ] 2 0.388% 98.641% ( 250, 380 ] 2 0.388% 99.029% ( 380, 580 ] 1 0.194% 99.223% ( 580, 870 ] 2 0.388% 99.612% ( 870, 1300 ] 1 0.194% 99.806% ( 1900, 2900 ] 1 0.194% 100.000% ** Level 2 read latency histogram (micros): Count: 42037 Average: 2.2777 StdDev: 4.69 Min: 1 Median: 1.5488 Max: 780 Percentiles: P50: 1.55 P75: 1.92 P99: 5.88 P99.9: 10.31 P99.99: 157.78 ------------------------------------------------------ [ 0, 1 ] 5377 12.791% 12.791% ### ( 1, 2 ] 28504 67.807% 80.598% ############## ( 2, 3 ] 4393 10.450% 91.048% ## ( 3, 4 ] 1930 4.591% 95.640% # ( 4, 6 ] 1506 3.583% 99.222% # ( 6, 10 ] 285 0.678% 99.900% ( 10, 15 ] 32 0.076% 99.976% ( 15, 22 ] 4 0.010% 99.986% ( 22, 34 ] 1 0.002% 99.988% ( 34, 51 ] 1 0.002% 99.990% ( 51, 76 ] 1 0.002% 99.993% ( 110, 170 ] 1 0.002% 99.995% ( 170, 250 ] 1 0.002% 99.998% ( 250, 380 ] 2 0.005% 100.002% ( 580, 870 ] 1 0.002% 100.005% ** Level 3 read latency histogram (micros): Count: 40 Average: 1641.1250 StdDev: 1315.99 Min: 145 Median: 1300.0000 Max: 4498 Percentiles: P50: 1300.00 P75: 2677.78 P99: 4498.00 P99.9: 4498.00 P99.99: 4498.00 ------------------------------------------------------ ( 110, 170 ] 1 2.500% 2.500% # ( 170, 250 ] 3 7.500% 10.000% ## ( 250, 380 ] 7 17.500% 27.500% #### ( 380, 580 ] 3 7.500% 35.000% ## ( 580, 870 ] 3 7.500% 42.500% ## ( 870, 1300 ] 3 7.500% 50.000% ## ( 1300, 1900 ] 3 7.500% 57.500% ## ( 1900, 2900 ] 9 22.500% 80.000% ##### ( 2900, 4400 ] 7 17.500% 97.500% #### ( 4400, 6600 ] 1 2.500% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 1761.1143 StdDev: 1285.98 Min: 250 Median: 1675.0000 Max: 4709 Percentiles: P50: 1675.00 P75: 2806.25 P99: 4709.00 P99.9: 4709.00 P99.99: 4709.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 4 11.429% 14.286% ## ( 380, 580 ] 5 14.286% 28.571% ### ( 580, 870 ] 3 8.571% 37.143% ## ( 870, 1300 ] 2 5.714% 42.857% # ( 1300, 1900 ] 4 11.429% 54.286% ## ( 1900, 2900 ] 8 22.857% 77.143% ##### ( 2900, 4400 ] 6 17.143% 94.286% ### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 3.3 total, 3.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 299.91 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.443 H:M:S, 13.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.07 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.443 H:M:S, 14.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-07:45:05 ... thread 0: (1000000,2000000) ops and (352750.6,339670.1) ops/second in (2.834864,5.888066) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 1.35 GB 31.5 0.5 0.0 0.5 2.3 1.8 0.0 1.3 71.2 329.1 7.08 6.51 28 0.253 511K 476 0.0 0.0 L1 3/3 249.79 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 248.8 248.5 1.01 0.98 1 1.013 255K 248 0.0 0.0 L2 1/0 3.32 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 228.6 228.5 0.84 0.80 2 0.421 195K 94 0.0 0.0 L3 18/0 928.72 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 220.2 220.2 0.85 0.79 1 0.852 190K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1196/15 97.92 GB 0.0 1.1 0.6 0.6 2.9 2.3 0.5 1.6 116.1 302.6 9.79 9.08 32 0.306 1153K 818 0.0 0.0 Int 0/0 0.00 KB 0.0 1.1 0.6 0.6 2.9 2.3 0.4 1.6 116.1 302.6 9.79 9.08 32 0.306 1153K 818 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.1 0.6 0.6 1.1 0.6 0.0 0.0 248.9 248.7 4.56 4.40 6 0.760 1153K 818 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 349.7 5.22 4.68 26 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 2.89 GB write, 484.26 MB/s write, 1.11 GB read, 185.70 MB/s read, 9.8 seconds Interval compaction: 2.89 GB write, 502.89 MB/s write, 1.11 GB read, 192.85 MB/s read, 9.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 428701 Average: 2.0973 StdDev: 12.57 Min: 0 Median: 1.4336 Max: 4020 Percentiles: P50: 1.43 P75: 1.82 P99: 5.45 P99.9: 10.20 P99.99: 14.71 ------------------------------------------------------ [ 0, 1 ] 94413 22.023% 22.023% #### ( 1, 2 ] 276616 64.524% 86.547% ############# ( 2, 3 ] 35370 8.251% 94.798% ## ( 3, 4 ] 12686 2.959% 97.757% # ( 4, 6 ] 7329 1.710% 99.467% ( 6, 10 ] 1842 0.430% 99.896% ( 10, 15 ] 428 0.100% 99.996% ( 15, 22 ] 36 0.008% 100.004% ( 22, 34 ] 6 0.001% 100.006% ( 34, 51 ] 6 0.001% 100.007% ( 51, 76 ] 2 0.000% 100.008% ( 110, 170 ] 11 0.003% 100.010% ( 170, 250 ] 12 0.003% 100.013% ( 250, 380 ] 9 0.002% 100.015% ( 380, 580 ] 7 0.002% 100.017% ( 580, 870 ] 9 0.002% 100.019% ( 870, 1300 ] 2 0.000% 100.019% ( 1300, 1900 ] 1 0.000% 100.020% ( 1900, 2900 ] 1 0.000% 100.020% ( 2900, 4400 ] 4 0.001% 100.021% ** Level 1 read latency histogram (micros): Count: 52669 Average: 2.1836 StdDev: 14.24 Min: 1 Median: 1.4716 Max: 2795 Percentiles: P50: 1.47 P75: 1.84 P99: 5.29 P99.9: 11.47 P99.99: 362.65 ------------------------------------------------------ [ 0, 1 ] 9578 18.185% 18.185% #### ( 1, 2 ] 35534 67.467% 85.652% ############# ( 2, 3 ] 5009 9.510% 95.162% ## ( 3, 4 ] 1494 2.837% 97.999% # ( 4, 6 ] 818 1.553% 99.552% ( 6, 10 ] 168 0.319% 99.871% ( 10, 15 ] 52 0.099% 99.970% ( 15, 22 ] 3 0.006% 99.975% ( 22, 34 ] 1 0.002% 99.977% ( 34, 51 ] 1 0.002% 99.979% ( 76, 110 ] 1 0.002% 99.981% ( 110, 170 ] 1 0.002% 99.983% ( 170, 250 ] 2 0.004% 99.987% ( 250, 380 ] 2 0.004% 99.991% ( 380, 580 ] 1 0.002% 99.992% ( 580, 870 ] 2 0.004% 99.996% ( 870, 1300 ] 1 0.002% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 47969 Average: 2.2711 StdDev: 4.41 Min: 1 Median: 1.5533 Max: 780 Percentiles: P50: 1.55 P75: 1.92 P99: 5.85 P99.9: 10.14 P99.99: 122.19 ------------------------------------------------------ [ 0, 1 ] 5921 12.343% 12.343% ## ( 1, 2 ] 32649 68.063% 80.406% ############## ( 2, 3 ] 5309 11.068% 91.474% ## ( 3, 4 ] 2101 4.380% 95.854% # ( 4, 6 ] 1628 3.394% 99.247% # ( 6, 10 ] 312 0.650% 99.898% ( 10, 15 ] 36 0.075% 99.973% ( 15, 22 ] 4 0.008% 99.981% ( 22, 34 ] 2 0.004% 99.985% ( 34, 51 ] 1 0.002% 99.987% ( 51, 76 ] 1 0.002% 99.990% ( 110, 170 ] 1 0.002% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 793.9647 StdDev: 1211.48 Min: 0 Median: 155.0000 Max: 4498 Percentiles: P50: 155.00 P75: 1165.62 P99: 4498.00 P99.9: 4498.00 P99.99: 4498.00 ------------------------------------------------------ [ 0, 1 ] 22 25.882% 25.882% ##### ( 1, 2 ] 12 14.118% 40.000% ### ( 2, 3 ] 1 1.176% 41.176% ( 3, 4 ] 4 4.706% 45.882% # ( 4, 6 ] 2 2.353% 48.235% ( 110, 170 ] 2 2.353% 50.588% ( 170, 250 ] 4 4.706% 55.294% # ( 250, 380 ] 7 8.235% 63.529% ## ( 380, 580 ] 4 4.706% 68.235% # ( 580, 870 ] 3 3.529% 71.765% # ( 870, 1300 ] 4 4.706% 76.471% # ( 1300, 1900 ] 3 3.529% 80.000% # ( 1900, 2900 ] 9 10.588% 90.588% ## ( 2900, 4400 ] 7 8.235% 98.824% ## ( 4400, 6600 ] 1 1.176% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 1761.1143 StdDev: 1285.98 Min: 250 Median: 1675.0000 Max: 4709 Percentiles: P50: 1675.00 P75: 2806.25 P99: 4709.00 P99.9: 4709.00 P99.99: 4709.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 4 11.429% 14.286% ## ( 380, 580 ] 5 14.286% 28.571% ### ( 580, 870 ] 3 8.571% 37.143% ## ( 870, 1300 ] 2 5.714% 42.857% # ( 1300, 1900 ] 4 11.429% 54.286% ## ( 1900, 2900 ] 8 22.857% 77.143% ##### ( 2900, 4400 ] 6 17.143% 94.286% ### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 2.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 321.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.650 H:M:S, 10.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 347.18 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.207 H:M:S, 7.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/18-07:45:08 ... thread 0: (1000000,3000000) ops and (328866.6,335990.9) ops/second in (3.040747,8.928813) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/14 1.84 GB 25.2 1.3 0.0 1.3 4.1 2.8 0.0 1.5 101.3 318.4 13.06 12.12 45 0.290 1343K 1345 0.0 0.0 L1 7/7 751.30 MB 0.0 1.0 0.7 0.2 1.0 0.7 0.2 1.3 238.6 238.0 4.21 4.10 2 2.107 1020K 2371 0.0 0.0 L2 1/0 3.32 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 228.6 228.5 0.84 0.80 2 0.421 195K 94 0.0 0.0 L3 18/0 928.72 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 220.2 220.2 0.85 0.79 1 0.852 190K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1201/21 98.90 GB 0.0 2.6 1.0 1.6 5.4 3.8 0.5 2.0 142.8 292.1 18.96 17.81 50 0.379 2749K 3810 0.0 0.0 Int 0/0 0.00 KB 0.0 2.6 1.0 1.6 5.4 3.8 0.4 2.0 142.8 292.1 18.96 17.81 50 0.379 2749K 3810 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.6 1.0 1.6 2.6 1.0 0.0 0.0 248.8 248.4 10.89 10.56 10 1.089 2749K 3810 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 351.0 8.08 7.25 40 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.41 GB write, 604.91 MB/s write, 2.64 GB read, 295.77 MB/s read, 19.0 seconds Interval compaction: 5.41 GB write, 620.26 MB/s write, 2.64 GB read, 303.27 MB/s read, 19.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 712244 Average: 2.1074 StdDev: 10.42 Min: 0 Median: 1.4541 Max: 4020 Percentiles: P50: 1.45 P75: 1.83 P99: 5.43 P99.9: 10.39 P99.99: 14.82 ------------------------------------------------------ [ 0, 1 ] 142353 19.987% 19.987% #### ( 1, 2 ] 470777 66.098% 86.084% ############# ( 2, 3 ] 62716 8.805% 94.890% ## ( 3, 4 ] 21014 2.950% 97.840% # ( 4, 6 ] 11589 1.627% 99.467% ( 6, 10 ] 3028 0.425% 99.892% ( 10, 15 ] 723 0.102% 99.994% ( 15, 22 ] 75 0.011% 100.004% ( 22, 34 ] 9 0.001% 100.006% ( 34, 51 ] 6 0.001% 100.006% ( 51, 76 ] 6 0.001% 100.007% ( 110, 170 ] 14 0.002% 100.009% ( 170, 250 ] 24 0.003% 100.013% ( 250, 380 ] 15 0.002% 100.015% ( 380, 580 ] 10 0.001% 100.016% ( 580, 870 ] 15 0.002% 100.018% ( 870, 1300 ] 6 0.001% 100.019% ( 1300, 1900 ] 1 0.000% 100.019% ( 1900, 2900 ] 1 0.000% 100.019% ( 2900, 4400 ] 4 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 122345 Average: 2.1855 StdDev: 13.52 Min: 1 Median: 1.4723 Max: 2795 Percentiles: P50: 1.47 P75: 1.84 P99: 5.23 P99.9: 10.40 P99.99: 468.27 ------------------------------------------------------ [ 0, 1 ] 21805 17.823% 17.823% #### ( 1, 2 ] 83348 68.125% 85.948% ############## ( 2, 3 ] 11445 9.355% 95.303% ## ( 3, 4 ] 3399 2.778% 98.081% # ( 4, 6 ] 1835 1.500% 99.581% ( 6, 10 ] 384 0.314% 99.895% ( 10, 15 ] 96 0.078% 99.973% ( 15, 22 ] 9 0.007% 99.980% ( 22, 34 ] 1 0.001% 99.981% ( 34, 51 ] 1 0.001% 99.982% ( 76, 110 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 170, 250 ] 2 0.002% 99.985% ( 250, 380 ] 5 0.004% 99.989% ( 380, 580 ] 4 0.003% 99.993% ( 580, 870 ] 3 0.002% 99.995% ( 870, 1300 ] 3 0.002% 99.998% ( 1300, 1900 ] 3 0.002% 100.000% ( 1900, 2900 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 47969 Average: 2.2711 StdDev: 4.41 Min: 1 Median: 1.5533 Max: 780 Percentiles: P50: 1.55 P75: 1.92 P99: 5.85 P99.9: 10.14 P99.99: 122.19 ------------------------------------------------------ [ 0, 1 ] 5921 12.343% 12.343% ## ( 1, 2 ] 32649 68.063% 80.406% ############## ( 2, 3 ] 5309 11.068% 91.474% ## ( 3, 4 ] 2101 4.380% 95.854% # ( 4, 6 ] 1628 3.394% 99.247% # ( 6, 10 ] 312 0.650% 99.898% ( 10, 15 ] 36 0.075% 99.973% ( 15, 22 ] 4 0.008% 99.981% ( 22, 34 ] 2 0.004% 99.985% ( 34, 51 ] 1 0.002% 99.987% ( 51, 76 ] 1 0.002% 99.990% ( 110, 170 ] 1 0.002% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 793.9647 StdDev: 1211.48 Min: 0 Median: 155.0000 Max: 4498 Percentiles: P50: 155.00 P75: 1165.62 P99: 4498.00 P99.9: 4498.00 P99.99: 4498.00 ------------------------------------------------------ [ 0, 1 ] 22 25.882% 25.882% ##### ( 1, 2 ] 12 14.118% 40.000% ### ( 2, 3 ] 1 1.176% 41.176% ( 3, 4 ] 4 4.706% 45.882% # ( 4, 6 ] 2 2.353% 48.235% ( 110, 170 ] 2 2.353% 50.588% ( 170, 250 ] 4 4.706% 55.294% # ( 250, 380 ] 7 8.235% 63.529% ## ( 380, 580 ] 4 4.706% 68.235% # ( 580, 870 ] 3 3.529% 71.765% # ( 870, 1300 ] 4 4.706% 76.471% # ( 1300, 1900 ] 3 3.529% 80.000% # ( 1900, 2900 ] 9 10.588% 90.588% ## ( 2900, 4400 ] 7 8.235% 98.824% ## ( 4400, 6600 ] 1 1.176% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 1761.1143 StdDev: 1285.98 Min: 250 Median: 1675.0000 Max: 4709 Percentiles: P50: 1675.00 P75: 2806.25 P99: 4709.00 P99.9: 4709.00 P99.99: 4709.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 4 11.429% 14.286% ## ( 380, 580 ] 5 14.286% 28.571% ### ( 580, 870 ] 3 8.571% 37.143% ## ( 870, 1300 ] 2 5.714% 42.857% # ( 1300, 1900 ] 4 11.429% 54.286% ## ( 1900, 2900 ] 8 22.857% 77.143% ##### ( 2900, 4400 ] 6 17.143% 94.286% ### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 9.2 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 322.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.048 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.398 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/18-07:45:11 ... thread 0: (1000000,4000000) ops and (323805.5,332859.4) ops/second in (3.088274,12.017087) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/10 2.77 GB 144.7 2.4 0.0 2.4 6.1 3.7 0.0 1.6 121.4 311.1 20.24 18.91 63 0.321 2494K 2641 0.0 0.0 L1 7/7 751.30 MB 0.0 1.0 0.7 0.2 1.0 0.7 0.2 1.3 238.6 238.0 4.21 4.10 2 2.107 1020K 2371 0.0 0.0 L2 1/0 3.32 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 228.6 228.5 0.84 0.80 2 0.421 195K 94 0.0 0.0 L3 18/0 928.72 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 220.2 220.2 0.85 0.79 1 0.852 190K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1202/17 99.82 GB 0.0 3.8 1.0 2.7 7.5 4.8 0.5 2.0 147.0 293.7 26.15 24.60 68 0.384 3901K 5106 0.0 0.0 Int 0/0 0.00 KB 0.0 3.8 1.0 2.7 7.5 4.8 0.4 2.0 147.0 293.7 26.15 24.60 68 0.384 3901K 5106 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.8 1.0 2.7 3.7 1.0 0.0 0.0 252.2 251.8 15.24 14.83 14 1.088 3901K 5106 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 352.2 10.91 9.77 54 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.50 GB write, 627.16 MB/s write, 3.75 GB read, 313.78 MB/s read, 26.1 seconds Interval compaction: 7.50 GB write, 638.98 MB/s write, 3.75 GB read, 319.69 MB/s read, 26.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1077648 Average: 2.1941 StdDev: 11.06 Min: 0 Median: 1.4846 Max: 4020 Percentiles: P50: 1.48 P75: 1.86 P99: 5.51 P99.9: 10.44 P99.99: 18.02 ------------------------------------------------------ [ 0, 1 ] 189989 17.630% 17.630% #### ( 1, 2 ] 719779 66.792% 84.422% ############# ( 2, 3 ] 106652 9.897% 94.318% ## ( 3, 4 ] 35451 3.290% 97.608% # ( 4, 6 ] 19900 1.847% 99.455% ( 6, 10 ] 4710 0.437% 99.892% ( 10, 15 ] 1013 0.094% 99.986% ( 15, 22 ] 107 0.010% 99.996% ( 22, 34 ] 13 0.001% 99.997% ( 34, 51 ] 7 0.001% 99.997% ( 51, 76 ] 15 0.001% 99.999% ( 76, 110 ] 24 0.002% 100.001% ( 110, 170 ] 119 0.011% 100.012% ( 170, 250 ] 51 0.005% 100.017% ( 250, 380 ] 35 0.003% 100.020% ( 380, 580 ] 33 0.003% 100.023% ( 580, 870 ] 32 0.003% 100.026% ( 870, 1300 ] 14 0.001% 100.027% ( 1300, 1900 ] 2 0.000% 100.028% ( 1900, 2900 ] 2 0.000% 100.028% ( 2900, 4400 ] 6 0.001% 100.028% ** Level 1 read latency histogram (micros): Count: 197274 Average: 2.2603 StdDev: 11.61 Min: 1 Median: 1.5071 Max: 2795 Percentiles: P50: 1.51 P75: 1.87 P99: 5.46 P99.9: 11.92 P99.99: 408.28 ------------------------------------------------------ [ 0, 1 ] 30001 15.208% 15.208% ### ( 1, 2 ] 135351 68.611% 83.818% ############## ( 2, 3 ] 21111 10.701% 94.520% ## ( 3, 4 ] 6268 3.177% 97.697% # ( 4, 6 ] 3522 1.785% 99.482% ( 6, 10 ] 777 0.394% 99.876% ( 10, 15 ] 124 0.063% 99.939% ( 15, 22 ] 19 0.010% 99.949% ( 22, 34 ] 1 0.001% 99.949% ( 34, 51 ] 1 0.001% 99.950% ( 76, 110 ] 43 0.022% 99.972% ( 110, 170 ] 15 0.008% 99.979% ( 170, 250 ] 12 0.006% 99.985% ( 250, 380 ] 9 0.005% 99.990% ( 380, 580 ] 9 0.005% 99.994% ( 580, 870 ] 4 0.002% 99.996% ( 870, 1300 ] 4 0.002% 99.998% ( 1300, 1900 ] 3 0.002% 100.000% ( 1900, 2900 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 47969 Average: 2.2711 StdDev: 4.41 Min: 1 Median: 1.5533 Max: 780 Percentiles: P50: 1.55 P75: 1.92 P99: 5.85 P99.9: 10.14 P99.99: 122.19 ------------------------------------------------------ [ 0, 1 ] 5921 12.343% 12.343% ## ( 1, 2 ] 32649 68.063% 80.406% ############## ( 2, 3 ] 5309 11.068% 91.474% ## ( 3, 4 ] 2101 4.380% 95.854% # ( 4, 6 ] 1628 3.394% 99.247% # ( 6, 10 ] 312 0.650% 99.898% ( 10, 15 ] 36 0.075% 99.973% ( 15, 22 ] 4 0.008% 99.981% ( 22, 34 ] 2 0.004% 99.985% ( 34, 51 ] 1 0.002% 99.987% ( 51, 76 ] 1 0.002% 99.990% ( 110, 170 ] 1 0.002% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 793.9647 StdDev: 1211.48 Min: 0 Median: 155.0000 Max: 4498 Percentiles: P50: 155.00 P75: 1165.62 P99: 4498.00 P99.9: 4498.00 P99.99: 4498.00 ------------------------------------------------------ [ 0, 1 ] 22 25.882% 25.882% ##### ( 1, 2 ] 12 14.118% 40.000% ### ( 2, 3 ] 1 1.176% 41.176% ( 3, 4 ] 4 4.706% 45.882% # ( 4, 6 ] 2 2.353% 48.235% ( 110, 170 ] 2 2.353% 50.588% ( 170, 250 ] 4 4.706% 55.294% # ( 250, 380 ] 7 8.235% 63.529% ## ( 380, 580 ] 4 4.706% 68.235% # ( 580, 870 ] 3 3.529% 71.765% # ( 870, 1300 ] 4 4.706% 76.471% # ( 1300, 1900 ] 3 3.529% 80.000% # ( 1900, 2900 ] 9 10.588% 90.588% ## ( 2900, 4400 ] 7 8.235% 98.824% ## ( 4400, 6600 ] 1 1.176% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 1761.1143 StdDev: 1285.98 Min: 250 Median: 1675.0000 Max: 4709 Percentiles: P50: 1675.00 P75: 2806.25 P99: 4709.00 P99.9: 4709.00 P99.99: 4709.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 4 11.429% 14.286% ## ( 380, 580 ] 5 14.286% 28.571% ### ( 580, 870 ] 3 8.571% 37.143% ## ( 870, 1300 ] 2 5.714% 42.857% # ( 1300, 1900 ] 4 11.429% 54.286% ## ( 1900, 2900 ] 8 22.857% 77.143% ##### ( 2900, 4400 ] 6 17.143% 94.286% ### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 12.2 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 321.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.462 H:M:S, 11.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 318.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.414 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-07:45:14 ... thread 0: (1000000,5000000) ops and (307535.1,327466.3) ops/second in (3.251661,15.268748) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/4 2.70 GB 251.7 3.4 0.0 3.4 8.1 4.7 0.0 1.7 130.8 308.1 26.98 25.26 82 0.329 3582K 3762 0.0 0.0 L1 15/0 1.77 GB 180.9 2.8 1.8 1.0 2.7 1.8 0.2 1.5 233.3 232.0 12.12 11.71 3 4.039 2870K 14K 0.0 0.0 L2 1/0 3.32 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 228.6 228.5 0.84 0.80 2 0.421 195K 94 0.0 0.0 L3 18/0 928.72 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 220.2 220.2 0.85 0.79 1 0.852 190K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1208/4 100.79 GB 0.0 6.6 2.1 4.5 11.2 6.7 0.5 2.4 165.1 282.0 40.79 38.57 88 0.463 6838K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.6 2.1 4.5 11.2 6.7 0.4 2.4 165.1 282.0 40.79 38.57 88 0.463 6838K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.6 2.1 4.5 6.6 2.1 0.0 0.0 247.8 247.0 27.18 26.41 19 1.431 6838K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 351.9 13.60 12.16 69 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.5 total, 15.3 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.23 GB write, 742.28 MB/s write, 6.58 GB read, 434.57 MB/s read, 40.8 seconds Interval compaction: 11.23 GB write, 753.29 MB/s write, 6.58 GB read, 441.02 MB/s read, 40.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 13, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1423468 Average: 2.2047 StdDev: 11.03 Min: 0 Median: 1.4864 Max: 4020 Percentiles: P50: 1.49 P75: 1.86 P99: 5.54 P99.9: 10.32 P99.99: 17.94 ------------------------------------------------------ [ 0, 1 ] 249990 17.562% 17.562% #### ( 1, 2 ] 949350 66.693% 84.255% ############# ( 2, 3 ] 142023 9.977% 94.232% ## ( 3, 4 ] 47249 3.319% 97.551% # ( 4, 6 ] 26720 1.877% 99.428% ( 6, 10 ] 6631 0.466% 99.894% ( 10, 15 ] 1307 0.092% 99.986% ( 15, 22 ] 135 0.009% 99.996% ( 22, 34 ] 14 0.001% 99.997% ( 34, 51 ] 8 0.001% 99.997% ( 51, 76 ] 19 0.001% 99.998% ( 76, 110 ] 56 0.004% 100.002% ( 110, 170 ] 153 0.011% 100.013% ( 170, 250 ] 71 0.005% 100.018% ( 250, 380 ] 58 0.004% 100.022% ( 380, 580 ] 46 0.003% 100.025% ( 580, 870 ] 40 0.003% 100.028% ( 870, 1300 ] 21 0.001% 100.030% ( 1300, 1900 ] 5 0.000% 100.030% ( 1900, 2900 ] 4 0.000% 100.030% ( 2900, 4400 ] 6 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 254797 Average: 2.4570 StdDev: 15.75 Min: 0 Median: 1.5206 Max: 3202 Percentiles: P50: 1.52 P75: 1.88 P99: 5.80 P99.9: 77.04 P99.99: 783.39 ------------------------------------------------------ [ 0, 1 ] 36381 14.278% 14.278% ### ( 1, 2 ] 174848 68.622% 82.901% ############## ( 2, 3 ] 28127 11.039% 93.940% ## ( 3, 4 ] 8453 3.318% 97.257% # ( 4, 6 ] 4927 1.934% 99.191% ( 6, 10 ] 1617 0.635% 99.826% ( 10, 15 ] 161 0.063% 99.889% ( 15, 22 ] 22 0.009% 99.898% ( 22, 34 ] 3 0.001% 99.899% ( 34, 51 ] 1 0.000% 99.899% ( 76, 110 ] 72 0.028% 99.927% ( 110, 170 ] 66 0.026% 99.953% ( 170, 250 ] 35 0.014% 99.967% ( 250, 380 ] 18 0.007% 99.974% ( 380, 580 ] 30 0.012% 99.986% ( 580, 870 ] 15 0.006% 99.992% ( 870, 1300 ] 15 0.006% 99.998% ( 1300, 1900 ] 4 0.002% 99.999% ( 1900, 2900 ] 1 0.000% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 47969 Average: 2.2711 StdDev: 4.41 Min: 1 Median: 1.5533 Max: 780 Percentiles: P50: 1.55 P75: 1.92 P99: 5.85 P99.9: 10.14 P99.99: 122.19 ------------------------------------------------------ [ 0, 1 ] 5921 12.343% 12.343% ## ( 1, 2 ] 32649 68.063% 80.406% ############## ( 2, 3 ] 5309 11.068% 91.474% ## ( 3, 4 ] 2101 4.380% 95.854% # ( 4, 6 ] 1628 3.394% 99.247% # ( 6, 10 ] 312 0.650% 99.898% ( 10, 15 ] 36 0.075% 99.973% ( 15, 22 ] 4 0.008% 99.981% ( 22, 34 ] 2 0.004% 99.985% ( 34, 51 ] 1 0.002% 99.987% ( 51, 76 ] 1 0.002% 99.990% ( 110, 170 ] 1 0.002% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 793.9647 StdDev: 1211.48 Min: 0 Median: 155.0000 Max: 4498 Percentiles: P50: 155.00 P75: 1165.62 P99: 4498.00 P99.9: 4498.00 P99.99: 4498.00 ------------------------------------------------------ [ 0, 1 ] 22 25.882% 25.882% ##### ( 1, 2 ] 12 14.118% 40.000% ### ( 2, 3 ] 1 1.176% 41.176% ( 3, 4 ] 4 4.706% 45.882% # ( 4, 6 ] 2 2.353% 48.235% ( 110, 170 ] 2 2.353% 50.588% ( 170, 250 ] 4 4.706% 55.294% # ( 250, 380 ] 7 8.235% 63.529% ## ( 380, 580 ] 4 4.706% 68.235% # ( 580, 870 ] 3 3.529% 71.765% # ( 870, 1300 ] 4 4.706% 76.471% # ( 1300, 1900 ] 3 3.529% 80.000% # ( 1900, 2900 ] 9 10.588% 90.588% ## ( 2900, 4400 ] 7 8.235% 98.824% ## ( 4400, 6600 ] 1 1.176% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 1761.1143 StdDev: 1285.98 Min: 250 Median: 1675.0000 Max: 4709 Percentiles: P50: 1675.00 P75: 2806.25 P99: 4709.00 P99.9: 4709.00 P99.99: 4709.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 4 11.429% 14.286% ## ( 380, 580 ] 5 14.286% 28.571% ### ( 580, 870 ] 3 8.571% 37.143% ## ( 870, 1300 ] 2 5.714% 42.857% # ( 1300, 1900 ] 4 11.429% 54.286% ## ( 1900, 2900 ] 8 22.857% 77.143% ##### ( 2900, 4400 ] 6 17.143% 94.286% ### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 15.5 total, 3.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 317.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.039 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 302.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.577 H:M:S, 17.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/18-07:45:37 ... thread 0: (1000000,6000000) ops and (43455.2,156736.0) ops/second in (23.012184,38.280932) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 1/1 878.31 MB 0.0 5.4 0.0 5.4 11.1 5.7 0.0 1.9 144.8 299.3 37.85 35.34 102 0.371 5564K 7658 0.0 0.0 L1 5/5 550.50 MB 0.0 7.4 4.7 2.7 7.3 4.6 0.2 1.6 222.0 218.8 34.21 31.80 4 8.552 7710K 110K 0.0 0.0 L2 33/12 4.03 GB 27.0 0.2 0.1 0.1 0.2 0.1 4.2 1.5 228.6 228.5 0.84 0.80 2 0.421 195K 94 0.0 0.0 L3 18/11 928.72 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 220.2 220.2 0.85 0.79 1 0.852 190K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1217/29 101.74 GB 0.0 13.1 5.0 8.2 18.7 10.6 4.5 3.3 182.4 260.2 73.75 68.73 109 0.677 13M 117K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.1 5.0 8.2 18.7 10.6 4.4 3.3 182.4 260.2 73.75 68.73 109 0.677 13M 117K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.1 5.0 8.2 13.0 4.9 0.0 0.0 235.7 233.6 57.08 53.84 25 2.283 13M 117K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 351.5 16.67 14.89 84 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.5 total, 38.3 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.74 GB write, 498.41 MB/s write, 13.14 GB read, 349.34 MB/s read, 73.8 seconds Interval compaction: 18.74 GB write, 501.36 MB/s write, 13.14 GB read, 351.41 MB/s read, 73.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 16, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2654642 Average: 2.8217 StdDev: 18.07 Min: 0 Median: 1.4395 Max: 4722 Percentiles: P50: 1.44 P75: 1.83 P99: 6.65 P99.9: 162.60 P99.99: 389.15 ------------------------------------------------------ [ 0, 1 ] 572126 21.552% 21.552% #### ( 1, 2 ] 1718410 64.732% 86.284% ############# ( 2, 3 ] 212234 7.995% 94.279% ## ( 3, 4 ] 75927 2.860% 97.139% # ( 4, 6 ] 47182 1.777% 98.917% ( 6, 10 ] 13553 0.511% 99.427% ( 10, 15 ] 2774 0.104% 99.532% ( 15, 22 ] 500 0.019% 99.550% ( 22, 34 ] 28 0.001% 99.551% ( 34, 51 ] 28 0.001% 99.552% ( 51, 76 ] 155 0.006% 99.558% ( 76, 110 ] 4971 0.187% 99.746% ( 110, 170 ] 4677 0.176% 99.922% ( 170, 250 ] 1107 0.042% 99.963% ( 250, 380 ] 679 0.026% 99.989% ( 380, 580 ] 580 0.022% 100.011% ( 580, 870 ] 195 0.007% 100.018% ( 870, 1300 ] 50 0.002% 100.020% ( 1300, 1900 ] 10 0.000% 100.020% ( 1900, 2900 ] 27 0.001% 100.022% ( 2900, 4400 ] 13 0.000% 100.022% ( 4400, 6600 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 717513 Average: 2.6365 StdDev: 20.02 Min: 0 Median: 1.3982 Max: 4490 Percentiles: P50: 1.40 P75: 1.80 P99: 6.85 P99.9: 154.39 P99.99: 823.17 ------------------------------------------------------ [ 0, 1 ] 180994 25.225% 25.225% ##### ( 1, 2 ] 446421 62.218% 87.443% ############ ( 2, 3 ] 47244 6.584% 94.027% # ( 3, 4 ] 19762 2.754% 96.782% # ( 4, 6 ] 14938 2.082% 98.864% ( 6, 10 ] 4605 0.642% 99.505% ( 10, 15 ] 844 0.118% 99.623% ( 15, 22 ] 219 0.031% 99.654% ( 22, 34 ] 9 0.001% 99.655% ( 34, 51 ] 1 0.000% 99.655% ( 51, 76 ] 67 0.009% 99.664% ( 76, 110 ] 930 0.130% 99.794% ( 110, 170 ] 1032 0.144% 99.938% ( 170, 250 ] 158 0.022% 99.960% ( 250, 380 ] 91 0.013% 99.972% ( 380, 580 ] 88 0.012% 99.985% ( 580, 870 ] 48 0.007% 99.991% ( 870, 1300 ] 40 0.006% 99.997% ( 1300, 1900 ] 15 0.002% 99.999% ( 1900, 2900 ] 6 0.001% 100.000% ( 2900, 4400 ] 6 0.001% 100.001% ( 4400, 6600 ] 1 0.000% 100.001% ** Level 2 read latency histogram (micros): Count: 47976 Average: 2.3316 StdDev: 7.43 Min: 1 Median: 1.5534 Max: 1005 Percentiles: P50: 1.55 P75: 1.92 P99: 5.86 P99.9: 11.11 P99.99: 354.08 ------------------------------------------------------ [ 0, 1 ] 5921 12.342% 12.342% ## ( 1, 2 ] 32649 68.053% 80.394% ############## ( 2, 3 ] 5309 11.066% 91.460% ## ( 3, 4 ] 2101 4.379% 95.840% # ( 4, 6 ] 1628 3.393% 99.233% # ( 6, 10 ] 312 0.650% 99.883% ( 10, 15 ] 36 0.075% 99.958% ( 15, 22 ] 4 0.008% 99.967% ( 22, 34 ] 2 0.004% 99.971% ( 34, 51 ] 1 0.002% 99.973% ( 51, 76 ] 1 0.002% 99.975% ( 110, 170 ] 2 0.004% 99.979% ( 170, 250 ] 2 0.004% 99.983% ( 250, 380 ] 4 0.008% 99.992% ( 380, 580 ] 2 0.004% 99.996% ( 580, 870 ] 1 0.002% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 2476 Average: 55.1910 StdDev: 286.05 Min: 0 Median: 2.7959 Max: 4498 Percentiles: P50: 2.80 P75: 5.13 P99: 1152.63 P99.9: 4083.50 P99.99: 4498.00 ------------------------------------------------------ [ 0, 1 ] 69 2.787% 2.787% # ( 1, 2 ] 805 32.512% 35.299% ####### ( 2, 3 ] 458 18.498% 53.796% #### ( 3, 4 ] 284 11.470% 65.267% ## ( 4, 6 ] 429 17.326% 82.593% ### ( 6, 10 ] 137 5.533% 88.126% # ( 10, 15 ] 44 1.777% 89.903% ( 15, 22 ] 14 0.565% 90.468% ( 22, 34 ] 3 0.121% 90.590% ( 34, 51 ] 1 0.040% 90.630% ( 76, 110 ] 23 0.929% 91.559% ( 110, 170 ] 60 2.423% 93.982% ( 170, 250 ] 27 1.090% 95.073% ( 250, 380 ] 32 1.292% 96.365% ( 380, 580 ] 34 1.373% 97.738% ( 580, 870 ] 25 1.010% 98.748% ( 870, 1300 ] 11 0.444% 99.192% ( 1300, 1900 ] 4 0.162% 99.354% ( 1900, 2900 ] 9 0.363% 99.717% ( 2900, 4400 ] 7 0.283% 100.000% ( 4400, 6600 ] 1 0.040% 100.040% ** Level 4 read latency histogram (micros): Count: 35 Average: 1761.1143 StdDev: 1285.98 Min: 250 Median: 1675.0000 Max: 4709 Percentiles: P50: 1675.00 P75: 2806.25 P99: 4709.00 P99.9: 4709.00 P99.99: 4709.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 4 11.429% 14.286% ## ( 380, 580 ] 5 14.286% 28.571% ### ( 580, 870 ] 3 8.571% 37.143% ## ( 870, 1300 ] 2 5.714% 42.857% # ( 1300, 1900 ] 4 11.429% 54.286% ## ( 1900, 2900 ] 8 22.857% 77.143% ##### ( 2900, 4400 ] 6 17.143% 94.286% ### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 38.5 total, 23.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 153.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.548 H:M:S, 56.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 42.77 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:19.509 H:M:S, 84.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 0 2024/11/18-07:45:45 ... thread 0: (1000000,7000000) ops and (129946.0,152251.9) ops/second in (7.695502,45.976434) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 1.72 GB 56.6 5.7 0.0 5.7 12.3 6.6 0.0 1.9 135.3 290.7 43.31 39.25 114 0.380 5947K 8250 0.0 0.0 L1 5/5 550.50 MB 0.0 7.4 4.7 2.7 7.3 4.6 0.2 1.6 222.0 218.8 34.21 31.80 4 8.552 7710K 110K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 4.2 1.5 228.6 228.5 0.84 0.80 2 0.421 195K 94 0.0 0.0 L3 19/2 1020.89 MB 0.8 5.7 4.1 1.6 5.7 4.1 0.2 1.4 150.7 150.4 38.55 26.37 24 1.606 4787K 5702 0.0 0.0 L4 149/0 9.53 GB 1.0 0.2 0.2 0.0 0.2 0.2 3.8 1.0 212.6 212.6 0.81 0.77 2 0.404 174K 0 0.0 0.0 L5 1092/0 89.81 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1273/12 102.59 GB 0.0 19.2 9.0 10.1 25.6 15.5 12.4 3.9 166.7 222.9 117.71 98.99 146 0.806 18M 124K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.2 9.0 10.1 25.6 15.5 12.3 3.9 166.7 222.9 117.71 98.99 146 0.806 18M 124K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.2 9.0 10.1 19.0 8.9 0.0 0.0 202.1 200.8 97.09 81.67 51 1.904 18M 124K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 327.0 20.62 17.33 95 0.217 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 46.2 total, 46.0 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.62 GB write, 567.81 MB/s write, 19.16 GB read, 424.71 MB/s read, 117.7 seconds Interval compaction: 25.62 GB write, 570.60 MB/s write, 19.16 GB read, 426.80 MB/s read, 117.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 42, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 42, interval: 65 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3026231 Average: 2.8827 StdDev: 19.85 Min: 0 Median: 1.4817 Max: 4722 Percentiles: P50: 1.48 P75: 1.87 P99: 7.27 P99.9: 159.81 P99.99: 395.26 ------------------------------------------------------ [ 0, 1 ] 581529 19.216% 19.216% #### ( 1, 2 ] 1933905 63.905% 83.121% ############# ( 2, 3 ] 291120 9.620% 92.741% ## ( 3, 4 ] 107702 3.559% 96.300% # ( 4, 6 ] 75270 2.487% 98.787% ( 6, 10 ] 20239 0.669% 99.456% ( 10, 15 ] 3707 0.122% 99.578% ( 15, 22 ] 593 0.020% 99.598% ( 22, 34 ] 36 0.001% 99.599% ( 34, 51 ] 28 0.001% 99.600% ( 51, 76 ] 158 0.005% 99.605% ( 76, 110 ] 4993 0.165% 99.770% ( 110, 170 ] 4728 0.156% 99.927% ( 170, 250 ] 1159 0.038% 99.965% ( 250, 380 ] 713 0.024% 99.988% ( 380, 580 ] 634 0.021% 100.009% ( 580, 870 ] 240 0.008% 100.017% ( 870, 1300 ] 81 0.003% 100.020% ( 1300, 1900 ] 27 0.001% 100.021% ( 1900, 2900 ] 43 0.001% 100.022% ( 2900, 4400 ] 20 0.001% 100.023% ( 4400, 6600 ] 2 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1879039 Average: 6.2068 StdDev: 98.60 Min: 0 Median: 1.7186 Max: 16577 Percentiles: P50: 1.72 P75: 2.54 P99: 9.15 P99.9: 151.58 P99.99: 432.94 ------------------------------------------------------ [ 0, 1 ] 195046 10.380% 10.380% ## ( 1, 2 ] 1035940 55.131% 65.511% ########### ( 2, 3 ] 330245 17.575% 83.087% #### ( 3, 4 ] 138299 7.360% 90.447% # ( 4, 6 ] 133458 7.102% 97.549% # ( 6, 10 ] 34601 1.841% 99.391% ( 10, 15 ] 6518 0.347% 99.738% ( 15, 22 ] 955 0.051% 99.788% ( 22, 34 ] 43 0.002% 99.791% ( 34, 51 ] 20 0.001% 99.792% ( 51, 76 ] 85 0.005% 99.796% ( 76, 110 ] 1021 0.054% 99.851% ( 110, 170 ] 1342 0.071% 99.922% ( 170, 250 ] 513 0.027% 99.949% ( 250, 380 ] 575 0.031% 99.980% ( 380, 580 ] 722 0.038% 100.018% ( 580, 870 ] 730 0.039% 100.057% ( 870, 1300 ] 571 0.030% 100.088% ( 1300, 1900 ] 426 0.023% 100.110% ( 1900, 2900 ] 523 0.028% 100.138% ( 2900, 4400 ] 538 0.029% 100.167% ( 4400, 6600 ] 135 0.007% 100.174% ( 6600, 9900 ] 31 0.002% 100.176% ( 9900, 14000 ] 1 0.000% 100.176% ( 14000, 22000 ] 2 0.000% 100.176% ** Level 2 read latency histogram (micros): Count: 48811 Average: 2.7780 StdDev: 16.82 Min: 1 Median: 1.5601 Max: 1067 Percentiles: P50: 1.56 P75: 1.93 P99: 5.95 P99.9: 208.34 P99.99: 880.23 ------------------------------------------------------ [ 0, 1 ] 5928 12.145% 12.145% ## ( 1, 2 ] 32991 67.589% 79.734% ############## ( 2, 3 ] 5581 11.434% 91.168% ## ( 3, 4 ] 2192 4.491% 95.659% # ( 4, 6 ] 1676 3.434% 99.092% # ( 6, 10 ] 329 0.674% 99.766% ( 10, 15 ] 37 0.076% 99.842% ( 15, 22 ] 4 0.008% 99.850% ( 22, 34 ] 2 0.004% 99.855% ( 34, 51 ] 1 0.002% 99.857% ( 51, 76 ] 1 0.002% 99.859% ( 76, 110 ] 1 0.002% 99.861% ( 110, 170 ] 12 0.025% 99.885% ( 170, 250 ] 15 0.031% 99.916% ( 250, 380 ] 13 0.027% 99.943% ( 380, 580 ] 16 0.033% 99.975% ( 580, 870 ] 7 0.014% 99.990% ( 870, 1300 ] 5 0.010% 100.000% ** Level 3 read latency histogram (micros): Count: 469081 Average: 5.6168 StdDev: 70.68 Min: 0 Median: 1.9171 Max: 7932 Percentiles: P50: 1.92 P75: 2.88 P99: 9.39 P99.9: 431.17 P99.99: 846.06 ------------------------------------------------------ [ 0, 1 ] 9267 1.976% 1.976% ( 1, 2 ] 245633 52.365% 54.340% ########## ( 2, 3 ] 110564 23.570% 77.911% ##### ( 3, 4 ] 45761 9.755% 87.666% ## ( 4, 6 ] 44950 9.583% 97.249% ## ( 6, 10 ] 9683 2.064% 99.313% ( 10, 15 ] 1645 0.351% 99.664% ( 15, 22 ] 211 0.045% 99.709% ( 22, 34 ] 19 0.004% 99.713% ( 34, 51 ] 4 0.001% 99.713% ( 51, 76 ] 12 0.003% 99.716% ( 76, 110 ] 74 0.016% 99.732% ( 110, 170 ] 237 0.051% 99.782% ( 170, 250 ] 255 0.054% 99.837% ( 250, 380 ] 225 0.048% 99.885% ( 380, 580 ] 285 0.061% 99.945% ( 580, 870 ] 229 0.049% 99.994% ( 870, 1300 ] 170 0.036% 100.030% ( 1300, 1900 ] 98 0.021% 100.051% ( 1900, 2900 ] 75 0.016% 100.067% ( 2900, 4400 ] 71 0.015% 100.083% ( 4400, 6600 ] 9 0.002% 100.084% ( 6600, 9900 ] 2 0.000% 100.085% ** Level 4 read latency histogram (micros): Count: 55 Average: 1160.5091 StdDev: 1310.21 Min: 1 Median: 520.0000 Max: 4709 Percentiles: P50: 520.00 P75: 2181.25 P99: 4709.00 P99.9: 4709.00 P99.99: 4709.00 ------------------------------------------------------ [ 0, 1 ] 3 5.455% 5.455% # ( 1, 2 ] 6 10.909% 16.364% ## ( 2, 3 ] 2 3.636% 20.000% # ( 3, 4 ] 1 1.818% 21.818% ( 4, 6 ] 1 1.818% 23.636% ( 15, 22 ] 2 3.636% 27.273% # ( 110, 170 ] 1 1.818% 29.091% ( 170, 250 ] 4 7.273% 36.364% # ( 250, 380 ] 4 7.273% 43.636% # ( 380, 580 ] 5 9.091% 52.727% ## ( 580, 870 ] 3 5.455% 58.182% # ( 870, 1300 ] 2 3.636% 61.818% # ( 1300, 1900 ] 5 9.091% 70.909% ## ( 1900, 2900 ] 8 14.545% 85.455% ### ( 2900, 4400 ] 6 10.909% 96.364% ## ( 4400, 6600 ] 2 3.636% 100.000% # ** Level 5 read latency histogram (micros): Count: 240 Average: 1840.8167 StdDev: 1953.31 Min: 88 Median: 977.5000 Max: 12643 Percentiles: P50: 977.50 P75: 2788.89 P99: 8976.00 P99.9: 12643.00 P99.99: 12643.00 ------------------------------------------------------ ( 76, 110 ] 3 1.250% 1.250% ( 110, 170 ] 16 6.667% 7.917% # ( 170, 250 ] 14 5.833% 13.750% # ( 250, 380 ] 17 7.083% 20.833% # ( 380, 580 ] 35 14.583% 35.417% ### ( 580, 870 ] 30 12.500% 47.917% ### ( 870, 1300 ] 20 8.333% 56.250% ## ( 1300, 1900 ] 21 8.750% 65.000% ## ( 1900, 2900 ] 27 11.250% 76.250% ## ( 2900, 4400 ] 29 12.083% 88.333% ## ( 4400, 6600 ] 22 9.167% 97.500% ## ( 6600, 9900 ] 5 2.083% 99.583% ( 9900, 14000 ] 1 0.417% 100.000% ** DB Stats ** Uptime(secs): 46.2 total, 7.7 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 149.10 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.247 H:M:S, 56.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 127.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.698 H:M:S, 61.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/18-07:45:49 ... thread 0: (1000000,8000000) ops and (232738.3,159130.8) ops/second in (4.296671,50.273105) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 1.84 GB 37.8 6.6 0.0 6.6 14.2 7.6 0.0 1.9 132.7 283.6 51.27 45.67 130 0.394 6907K 9351 0.0 0.0 L1 3/3 134.25 MB 0.0 8.8 5.5 3.3 8.7 5.4 0.2 1.6 213.7 211.0 42.21 38.18 5 8.442 8602K 110K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 5.5 1.5 228.6 228.5 0.84 0.80 2 0.421 195K 94 0.0 0.0 L3 21/0 878.61 MB 0.9 7.0 4.7 2.2 7.0 4.7 0.8 1.5 150.7 150.4 47.44 32.50 33 1.438 6148K 11K 0.0 0.0 L4 152/0 9.62 GB 1.0 1.8 1.3 0.6 1.8 1.3 4.1 1.5 174.1 173.7 10.87 8.62 13 0.836 1922K 4961 0.0 0.0 L5 1108/0 91.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1295/12 103.56 GB 0.0 24.5 11.7 12.8 31.9 19.1 15.8 4.2 164.2 214.0 152.63 125.77 183 0.834 23M 136K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.5 11.7 12.8 31.9 19.1 15.7 4.2 164.2 214.0 152.63 125.77 183 0.834 23M 136K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.5 11.7 12.8 24.3 11.5 0.0 0.0 195.7 194.6 128.02 105.72 75 1.707 23M 136K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 314.8 24.61 20.05 108 0.228 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.5 total, 50.3 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.90 GB write, 646.74 MB/s write, 24.47 GB read, 496.19 MB/s read, 152.6 seconds Interval compaction: 31.90 GB write, 649.65 MB/s write, 24.47 GB read, 498.43 MB/s read, 152.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 60, interval: 83 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3371479 Average: 2.9069 StdDev: 22.11 Min: 0 Median: 1.5044 Max: 4901 Percentiles: P50: 1.50 P75: 1.90 P99: 7.31 P99.9: 156.31 P99.99: 389.13 ------------------------------------------------------ [ 0, 1 ] 604965 17.944% 17.944% #### ( 1, 2 ] 2142682 63.553% 81.497% ############# ( 2, 3 ] 352493 10.455% 91.952% ## ( 3, 4 ] 132155 3.920% 95.872% # ( 4, 6 ] 97566 2.894% 98.766% # ( 6, 10 ] 24220 0.718% 99.484% ( 10, 15 ] 4447 0.132% 99.616% ( 15, 22 ] 655 0.019% 99.635% ( 22, 34 ] 42 0.001% 99.637% ( 34, 51 ] 30 0.001% 99.637% ( 51, 76 ] 159 0.005% 99.642% ( 76, 110 ] 5018 0.149% 99.791% ( 110, 170 ] 4763 0.141% 99.932% ( 170, 250 ] 1180 0.035% 99.967% ( 250, 380 ] 738 0.022% 99.989% ( 380, 580 ] 654 0.019% 100.009% ( 580, 870 ] 262 0.008% 100.016% ( 870, 1300 ] 101 0.003% 100.019% ( 1300, 1900 ] 40 0.001% 100.020% ( 1900, 2900 ] 54 0.002% 100.022% ( 2900, 4400 ] 41 0.001% 100.023% ( 4400, 6600 ] 4 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 2125518 Average: 6.2928 StdDev: 100.36 Min: 0 Median: 1.7496 Max: 16577 Percentiles: P50: 1.75 P75: 2.62 P99: 9.15 P99.9: 156.18 P99.99: 468.55 ------------------------------------------------------ [ 0, 1 ] 197593 9.296% 9.296% ## ( 1, 2 ] 1154126 54.299% 63.595% ########### ( 2, 3 ] 391111 18.401% 81.996% #### ( 3, 4 ] 166683 7.842% 89.838% ## ( 4, 6 ] 163067 7.672% 97.509% ## ( 6, 10 ] 40257 1.894% 99.403% ( 10, 15 ] 7196 0.339% 99.742% ( 15, 22 ] 1038 0.049% 99.791% ( 22, 34 ] 51 0.002% 99.793% ( 34, 51 ] 25 0.001% 99.794% ( 51, 76 ] 89 0.004% 99.799% ( 76, 110 ] 1085 0.051% 99.850% ( 110, 170 ] 1392 0.065% 99.915% ( 170, 250 ] 562 0.026% 99.942% ( 250, 380 ] 659 0.031% 99.973% ( 380, 580 ] 839 0.039% 100.012% ( 580, 870 ] 830 0.039% 100.051% ( 870, 1300 ] 651 0.031% 100.082% ( 1300, 1900 ] 482 0.023% 100.104% ( 1900, 2900 ] 584 0.027% 100.132% ( 2900, 4400 ] 607 0.029% 100.160% ( 4400, 6600 ] 152 0.007% 100.168% ( 6600, 9900 ] 49 0.002% 100.170% ( 9900, 14000 ] 1 0.000% 100.170% ( 14000, 22000 ] 2 0.000% 100.170% ** Level 2 read latency histogram (micros): Count: 48811 Average: 2.7780 StdDev: 16.82 Min: 1 Median: 1.5601 Max: 1067 Percentiles: P50: 1.56 P75: 1.93 P99: 5.95 P99.9: 208.34 P99.99: 880.23 ------------------------------------------------------ [ 0, 1 ] 5928 12.145% 12.145% ## ( 1, 2 ] 32991 67.589% 79.734% ############## ( 2, 3 ] 5581 11.434% 91.168% ## ( 3, 4 ] 2192 4.491% 95.659% # ( 4, 6 ] 1676 3.434% 99.092% # ( 6, 10 ] 329 0.674% 99.766% ( 10, 15 ] 37 0.076% 99.842% ( 15, 22 ] 4 0.008% 99.850% ( 22, 34 ] 2 0.004% 99.855% ( 34, 51 ] 1 0.002% 99.857% ( 51, 76 ] 1 0.002% 99.859% ( 76, 110 ] 1 0.002% 99.861% ( 110, 170 ] 12 0.025% 99.885% ( 170, 250 ] 15 0.031% 99.916% ( 250, 380 ] 13 0.027% 99.943% ( 380, 580 ] 16 0.033% 99.975% ( 580, 870 ] 7 0.014% 99.990% ( 870, 1300 ] 5 0.010% 100.000% ** Level 3 read latency histogram (micros): Count: 909896 Average: 6.0527 StdDev: 84.04 Min: 0 Median: 1.9506 Max: 8645 Percentiles: P50: 1.95 P75: 2.93 P99: 9.11 P99.9: 302.85 P99.99: 608.43 ------------------------------------------------------ [ 0, 1 ] 14068 1.546% 1.546% ( 1, 2 ] 463777 50.970% 52.516% ########## ( 2, 3 ] 219346 24.107% 76.623% ##### ( 3, 4 ] 95369 10.481% 87.104% ## ( 4, 6 ] 94827 10.422% 97.526% ## ( 6, 10 ] 17245 1.895% 99.421% ( 10, 15 ] 2823 0.310% 99.732% ( 15, 22 ] 361 0.040% 99.771% ( 22, 34 ] 31 0.003% 99.775% ( 34, 51 ] 6 0.001% 99.775% ( 51, 76 ] 19 0.002% 99.778% ( 76, 110 ] 122 0.013% 99.791% ( 110, 170 ] 386 0.042% 99.833% ( 170, 250 ] 426 0.047% 99.880% ( 250, 380 ] 443 0.049% 99.929% ( 380, 580 ] 512 0.056% 99.985% ( 580, 870 ] 449 0.049% 100.035% ( 870, 1300 ] 295 0.032% 100.067% ( 1300, 1900 ] 199 0.022% 100.089% ( 1900, 2900 ] 189 0.021% 100.110% ( 2900, 4400 ] 166 0.018% 100.128% ( 4400, 6600 ] 49 0.005% 100.133% ( 6600, 9900 ] 13 0.001% 100.135% ** Level 4 read latency histogram (micros): Count: 56553 Average: 4.5741 StdDev: 63.84 Min: 1 Median: 1.8825 Max: 4709 Percentiles: P50: 1.88 P75: 2.80 P99: 7.70 P99.9: 359.81 P99.99: 3790.78 ------------------------------------------------------ [ 0, 1 ] 846 1.496% 1.496% ( 1, 2 ] 31083 54.963% 56.459% ########### ( 2, 3 ] 13172 23.291% 79.750% ##### ( 3, 4 ] 5465 9.664% 89.413% ## ( 4, 6 ] 5173 9.147% 98.561% ## ( 6, 10 ] 585 1.034% 99.595% ( 10, 15 ] 115 0.203% 99.798% ( 15, 22 ] 8 0.014% 99.813% ( 22, 34 ] 5 0.009% 99.821% ( 34, 51 ] 2 0.004% 99.825% ( 76, 110 ] 2 0.004% 99.828% ( 110, 170 ] 2 0.004% 99.832% ( 170, 250 ] 30 0.053% 99.885% ( 250, 380 ] 10 0.018% 99.903% ( 380, 580 ] 14 0.025% 99.928% ( 580, 870 ] 8 0.014% 99.942% ( 870, 1300 ] 5 0.009% 99.950% ( 1300, 1900 ] 7 0.012% 99.963% ( 1900, 2900 ] 10 0.018% 99.981% ( 2900, 4400 ] 9 0.016% 99.996% ( 4400, 6600 ] 2 0.004% 100.000% ** Level 5 read latency histogram (micros): Count: 320 Average: 1637.1875 StdDev: 1840.14 Min: 88 Median: 816.5789 Max: 12643 Percentiles: P50: 816.58 P75: 2455.56 P99: 8690.00 P99.9: 12643.00 P99.99: 12643.00 ------------------------------------------------------ ( 76, 110 ] 8 2.500% 2.500% # ( 110, 170 ] 29 9.062% 11.562% ## ( 170, 250 ] 20 6.250% 17.812% # ( 250, 380 ] 31 9.688% 27.500% ## ( 380, 580 ] 41 12.812% 40.312% ### ( 580, 870 ] 38 11.875% 52.188% ## ( 870, 1300 ] 28 8.750% 60.938% ## ( 1300, 1900 ] 25 7.812% 68.750% ## ( 1900, 2900 ] 36 11.250% 80.000% ## ( 2900, 4400 ] 33 10.312% 90.312% ## ( 4400, 6600 ] 24 7.500% 97.812% ## ( 6600, 9900 ] 6 1.875% 99.688% ( 9900, 14000 ] 1 0.312% 100.000% ** DB Stats ** Uptime(secs): 50.5 total, 4.3 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 155.91 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.680 H:M:S, 54.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 229.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.433 H:M:S, 33.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-07:45:53 ... thread 0: (1000000,9000000) ops and (321466.3,168590.3) ops/second in (3.110746,53.383851) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/9 2.83 GB 138.4 7.5 0.0 7.5 16.0 8.5 0.0 1.9 133.3 284.9 57.66 51.65 147 0.392 7802K 10K 0.0 0.0 L1 3/3 134.25 MB 0.0 8.8 5.5 3.3 8.7 5.4 0.2 1.6 213.7 211.0 42.21 38.18 5 8.442 8602K 110K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 5.5 1.5 228.6 228.5 0.84 0.80 2 0.421 195K 94 0.0 0.0 L3 21/0 878.61 MB 0.9 7.0 4.7 2.2 7.0 4.7 0.8 1.5 150.7 150.4 47.44 32.50 33 1.438 6148K 11K 0.0 0.0 L4 152/0 9.62 GB 1.0 1.8 1.3 0.6 1.8 1.3 4.1 1.5 174.1 173.7 10.87 8.62 13 0.836 1922K 4961 0.0 0.0 L5 1108/0 91.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1300/12 104.54 GB 0.0 25.3 11.7 13.7 33.7 20.1 15.8 3.9 163.1 217.3 159.02 131.75 200 0.795 24M 137K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.3 11.7 13.7 33.7 20.1 15.7 3.9 163.1 217.3 159.02 131.75 200 0.795 24M 137K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.3 11.7 13.7 25.2 11.5 0.0 0.0 197.3 196.2 131.45 109.06 78 1.685 24M 137K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 317.6 27.57 22.69 122 0.226 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.6 total, 53.4 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.74 GB write, 644.44 MB/s write, 25.33 GB read, 483.85 MB/s read, 159.0 seconds Interval compaction: 33.74 GB write, 647.17 MB/s write, 25.33 GB read, 485.90 MB/s read, 159.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 63, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 63, interval: 86 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3774273 Average: 2.8411 StdDev: 21.15 Min: 0 Median: 1.5095 Max: 4901 Percentiles: P50: 1.51 P75: 1.90 P99: 7.13 P99.9: 149.44 P99.99: 347.56 ------------------------------------------------------ [ 0, 1 ] 654648 17.345% 17.345% ### ( 1, 2 ] 2419141 64.096% 81.441% ############# ( 2, 3 ] 402007 10.651% 92.092% ## ( 3, 4 ] 146201 3.874% 95.965% # ( 4, 6 ] 106703 2.827% 98.793% # ( 6, 10 ] 27632 0.732% 99.525% ( 10, 15 ] 5037 0.133% 99.658% ( 15, 22 ] 704 0.019% 99.677% ( 22, 34 ] 47 0.001% 99.678% ( 34, 51 ] 30 0.001% 99.679% ( 51, 76 ] 161 0.004% 99.683% ( 76, 110 ] 5046 0.134% 99.817% ( 110, 170 ] 4783 0.127% 99.943% ( 170, 250 ] 1197 0.032% 99.975% ( 250, 380 ] 747 0.020% 99.995% ( 380, 580 ] 661 0.018% 100.013% ( 580, 870 ] 267 0.007% 100.020% ( 870, 1300 ] 105 0.003% 100.022% ( 1300, 1900 ] 41 0.001% 100.023% ( 1900, 2900 ] 56 0.001% 100.025% ( 2900, 4400 ] 43 0.001% 100.026% ( 4400, 6600 ] 4 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 2143058 Average: 6.2658 StdDev: 99.96 Min: 0 Median: 1.7481 Max: 16577 Percentiles: P50: 1.75 P75: 2.61 P99: 9.15 P99.9: 156.69 P99.99: 468.87 ------------------------------------------------------ [ 0, 1 ] 199097 9.290% 9.290% ## ( 1, 2 ] 1166253 54.420% 63.710% ########### ( 2, 3 ] 393755 18.374% 82.084% #### ( 3, 4 ] 167241 7.804% 89.888% ## ( 4, 6 ] 163399 7.625% 97.512% ## ( 6, 10 ] 40548 1.892% 99.404% ( 10, 15 ] 7217 0.337% 99.741% ( 15, 22 ] 1038 0.048% 99.790% ( 22, 34 ] 51 0.002% 99.792% ( 34, 51 ] 25 0.001% 99.793% ( 51, 76 ] 89 0.004% 99.797% ( 76, 110 ] 1100 0.051% 99.849% ( 110, 170 ] 1416 0.066% 99.915% ( 170, 250 ] 574 0.027% 99.941% ( 250, 380 ] 667 0.031% 99.973% ( 380, 580 ] 841 0.039% 100.012% ( 580, 870 ] 831 0.039% 100.051% ( 870, 1300 ] 651 0.030% 100.081% ( 1300, 1900 ] 483 0.023% 100.103% ( 1900, 2900 ] 584 0.027% 100.131% ( 2900, 4400 ] 607 0.028% 100.159% ( 4400, 6600 ] 152 0.007% 100.166% ( 6600, 9900 ] 49 0.002% 100.168% ( 9900, 14000 ] 1 0.000% 100.168% ( 14000, 22000 ] 2 0.000% 100.169% ** Level 2 read latency histogram (micros): Count: 48811 Average: 2.7780 StdDev: 16.82 Min: 1 Median: 1.5601 Max: 1067 Percentiles: P50: 1.56 P75: 1.93 P99: 5.95 P99.9: 208.34 P99.99: 880.23 ------------------------------------------------------ [ 0, 1 ] 5928 12.145% 12.145% ## ( 1, 2 ] 32991 67.589% 79.734% ############## ( 2, 3 ] 5581 11.434% 91.168% ## ( 3, 4 ] 2192 4.491% 95.659% # ( 4, 6 ] 1676 3.434% 99.092% # ( 6, 10 ] 329 0.674% 99.766% ( 10, 15 ] 37 0.076% 99.842% ( 15, 22 ] 4 0.008% 99.850% ( 22, 34 ] 2 0.004% 99.855% ( 34, 51 ] 1 0.002% 99.857% ( 51, 76 ] 1 0.002% 99.859% ( 76, 110 ] 1 0.002% 99.861% ( 110, 170 ] 12 0.025% 99.885% ( 170, 250 ] 15 0.031% 99.916% ( 250, 380 ] 13 0.027% 99.943% ( 380, 580 ] 16 0.033% 99.975% ( 580, 870 ] 7 0.014% 99.990% ( 870, 1300 ] 5 0.010% 100.000% ** Level 3 read latency histogram (micros): Count: 909896 Average: 6.0527 StdDev: 84.04 Min: 0 Median: 1.9506 Max: 8645 Percentiles: P50: 1.95 P75: 2.93 P99: 9.11 P99.9: 302.85 P99.99: 608.43 ------------------------------------------------------ [ 0, 1 ] 14068 1.546% 1.546% ( 1, 2 ] 463777 50.970% 52.516% ########## ( 2, 3 ] 219346 24.107% 76.623% ##### ( 3, 4 ] 95369 10.481% 87.104% ## ( 4, 6 ] 94827 10.422% 97.526% ## ( 6, 10 ] 17245 1.895% 99.421% ( 10, 15 ] 2823 0.310% 99.732% ( 15, 22 ] 361 0.040% 99.771% ( 22, 34 ] 31 0.003% 99.775% ( 34, 51 ] 6 0.001% 99.775% ( 51, 76 ] 19 0.002% 99.778% ( 76, 110 ] 122 0.013% 99.791% ( 110, 170 ] 386 0.042% 99.833% ( 170, 250 ] 426 0.047% 99.880% ( 250, 380 ] 443 0.049% 99.929% ( 380, 580 ] 512 0.056% 99.985% ( 580, 870 ] 449 0.049% 100.035% ( 870, 1300 ] 295 0.032% 100.067% ( 1300, 1900 ] 199 0.022% 100.089% ( 1900, 2900 ] 189 0.021% 100.110% ( 2900, 4400 ] 166 0.018% 100.128% ( 4400, 6600 ] 49 0.005% 100.133% ( 6600, 9900 ] 13 0.001% 100.135% ** Level 4 read latency histogram (micros): Count: 56553 Average: 4.5741 StdDev: 63.84 Min: 1 Median: 1.8825 Max: 4709 Percentiles: P50: 1.88 P75: 2.80 P99: 7.70 P99.9: 359.81 P99.99: 3790.78 ------------------------------------------------------ [ 0, 1 ] 846 1.496% 1.496% ( 1, 2 ] 31083 54.963% 56.459% ########### ( 2, 3 ] 13172 23.291% 79.750% ##### ( 3, 4 ] 5465 9.664% 89.413% ## ( 4, 6 ] 5173 9.147% 98.561% ## ( 6, 10 ] 585 1.034% 99.595% ( 10, 15 ] 115 0.203% 99.798% ( 15, 22 ] 8 0.014% 99.813% ( 22, 34 ] 5 0.009% 99.821% ( 34, 51 ] 2 0.004% 99.825% ( 76, 110 ] 2 0.004% 99.828% ( 110, 170 ] 2 0.004% 99.832% ( 170, 250 ] 30 0.053% 99.885% ( 250, 380 ] 10 0.018% 99.903% ( 380, 580 ] 14 0.025% 99.928% ( 580, 870 ] 8 0.014% 99.942% ( 870, 1300 ] 5 0.009% 99.950% ( 1300, 1900 ] 7 0.012% 99.963% ( 1900, 2900 ] 10 0.018% 99.981% ( 2900, 4400 ] 9 0.016% 99.996% ( 4400, 6600 ] 2 0.004% 100.000% ** Level 5 read latency histogram (micros): Count: 320 Average: 1637.1875 StdDev: 1840.14 Min: 88 Median: 816.5789 Max: 12643 Percentiles: P50: 816.58 P75: 2455.56 P99: 8690.00 P99.9: 12643.00 P99.99: 12643.00 ------------------------------------------------------ ( 76, 110 ] 8 2.500% 2.500% # ( 110, 170 ] 29 9.062% 11.562% ## ( 170, 250 ] 20 6.250% 17.812% # ( 250, 380 ] 31 9.688% 27.500% ## ( 380, 580 ] 41 12.812% 40.312% ### ( 580, 870 ] 38 11.875% 52.188% ## ( 870, 1300 ] 28 8.750% 60.938% ## ( 1300, 1900 ] 25 7.812% 68.750% ## ( 1900, 2900 ] 36 11.250% 80.000% ## ( 2900, 4400 ] 33 10.312% 90.312% ## ( 4400, 6600 ] 24 7.500% 97.812% ## ( 6600, 9900 ] 6 1.875% 99.688% ( 9900, 14000 ] 1 0.312% 100.000% ** DB Stats ** Uptime(secs): 53.6 total, 3.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 165.22 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.116 H:M:S, 52.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 316.39 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.437 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-07:45:56 ... thread 0: (1000000,10000000) ops and (319723.2,176955.0) ops/second in (3.127705,56.511556) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 2.58 GB 6.3 8.6 0.0 8.6 18.1 9.5 0.0 1.9 135.8 284.9 64.96 58.49 164 0.396 8954K 11K 0.0 0.0 L1 8/8 931.21 MB 0.0 10.1 6.7 3.4 10.0 6.6 0.2 1.5 214.1 211.5 48.36 43.91 6 8.060 9816K 110K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 5.8 1.5 228.6 228.5 0.84 0.80 2 0.421 195K 94 0.0 0.0 L3 24/0 999.29 MB 1.0 7.6 5.1 2.5 7.5 5.0 0.9 1.5 154.0 153.7 50.22 35.08 36 1.395 6744K 14K 0.0 0.0 L4 153/0 9.50 GB 1.0 2.5 1.5 1.1 2.5 1.5 4.1 1.7 179.1 178.1 14.49 11.90 17 0.852 2636K 15K 0.0 0.0 L5 1112/0 91.48 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1309/19 105.45 GB 0.0 29.0 13.4 15.6 38.3 22.7 16.7 4.0 166.0 219.3 178.87 150.18 225 0.795 28M 151K 0.0 0.0 Int 0/0 0.00 KB 0.0 29.0 13.4 15.6 38.3 22.7 16.6 4.0 166.0 219.3 178.87 150.18 225 0.795 28M 151K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 29.0 13.4 15.6 28.8 13.2 0.0 0.0 199.9 198.8 148.55 125.09 90 1.651 28M 151K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 320.0 30.32 25.09 135 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.7 total, 56.5 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 38.31 GB write, 691.35 MB/s write, 29.00 GB read, 523.33 MB/s read, 178.9 seconds Interval compaction: 38.31 GB write, 694.12 MB/s write, 29.00 GB read, 525.42 MB/s read, 178.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 66, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 66, interval: 89 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4026191 Average: 2.8325 StdDev: 20.77 Min: 0 Median: 1.5184 Max: 4901 Percentiles: P50: 1.52 P75: 1.91 P99: 7.06 P99.9: 147.54 P99.99: 341.13 ------------------------------------------------------ [ 0, 1 ] 676202 16.795% 16.795% ### ( 1, 2 ] 2578909 64.053% 80.848% ############# ( 2, 3 ] 441658 10.970% 91.818% ## ( 3, 4 ] 161351 4.008% 95.826% # ( 4, 6 ] 119999 2.980% 98.806% # ( 6, 10 ] 29531 0.733% 99.539% ( 10, 15 ] 5399 0.134% 99.674% ( 15, 22 ] 741 0.018% 99.692% ( 22, 34 ] 53 0.001% 99.693% ( 34, 51 ] 31 0.001% 99.694% ( 51, 76 ] 163 0.004% 99.698% ( 76, 110 ] 5058 0.126% 99.824% ( 110, 170 ] 4906 0.122% 99.946% ( 170, 250 ] 1242 0.031% 99.976% ( 250, 380 ] 778 0.019% 99.996% ( 380, 580 ] 676 0.017% 100.013% ( 580, 870 ] 282 0.007% 100.020% ( 870, 1300 ] 112 0.003% 100.022% ( 1300, 1900 ] 45 0.001% 100.023% ( 1900, 2900 ] 56 0.001% 100.025% ( 2900, 4400 ] 44 0.001% 100.026% ( 4400, 6600 ] 4 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 2291478 Average: 6.0754 StdDev: 96.85 Min: 0 Median: 1.7431 Max: 16577 Percentiles: P50: 1.74 P75: 2.59 P99: 9.11 P99.9: 157.63 P99.99: 473.40 ------------------------------------------------------ [ 0, 1 ] 206991 9.033% 9.033% ## ( 1, 2 ] 1263237 55.128% 64.161% ########### ( 2, 3 ] 420028 18.330% 82.491% #### ( 3, 4 ] 174779 7.627% 90.118% ## ( 4, 6 ] 170238 7.429% 97.547% # ( 6, 10 ] 42812 1.868% 99.416% ( 10, 15 ] 7433 0.324% 99.740% ( 15, 22 ] 1079 0.047% 99.787% ( 22, 34 ] 53 0.002% 99.789% ( 34, 51 ] 26 0.001% 99.790% ( 51, 76 ] 104 0.005% 99.795% ( 76, 110 ] 1219 0.053% 99.848% ( 110, 170 ] 1496 0.065% 99.913% ( 170, 250 ] 620 0.027% 99.941% ( 250, 380 ] 714 0.031% 99.972% ( 380, 580 ] 899 0.039% 100.011% ( 580, 870 ] 866 0.038% 100.049% ( 870, 1300 ] 666 0.029% 100.078% ( 1300, 1900 ] 487 0.021% 100.099% ( 1900, 2900 ] 586 0.026% 100.125% ( 2900, 4400 ] 607 0.026% 100.151% ( 4400, 6600 ] 152 0.007% 100.158% ( 6600, 9900 ] 49 0.002% 100.160% ( 9900, 14000 ] 1 0.000% 100.160% ( 14000, 22000 ] 2 0.000% 100.160% ** Level 2 read latency histogram (micros): Count: 48811 Average: 2.7780 StdDev: 16.82 Min: 1 Median: 1.5601 Max: 1067 Percentiles: P50: 1.56 P75: 1.93 P99: 5.95 P99.9: 208.34 P99.99: 880.23 ------------------------------------------------------ [ 0, 1 ] 5928 12.145% 12.145% ## ( 1, 2 ] 32991 67.589% 79.734% ############## ( 2, 3 ] 5581 11.434% 91.168% ## ( 3, 4 ] 2192 4.491% 95.659% # ( 4, 6 ] 1676 3.434% 99.092% # ( 6, 10 ] 329 0.674% 99.766% ( 10, 15 ] 37 0.076% 99.842% ( 15, 22 ] 4 0.008% 99.850% ( 22, 34 ] 2 0.004% 99.855% ( 34, 51 ] 1 0.002% 99.857% ( 51, 76 ] 1 0.002% 99.859% ( 76, 110 ] 1 0.002% 99.861% ( 110, 170 ] 12 0.025% 99.885% ( 170, 250 ] 15 0.031% 99.916% ( 250, 380 ] 13 0.027% 99.943% ( 380, 580 ] 16 0.033% 99.975% ( 580, 870 ] 7 0.014% 99.990% ( 870, 1300 ] 5 0.010% 100.000% ** Level 3 read latency histogram (micros): Count: 1104396 Average: 5.6424 StdDev: 76.81 Min: 0 Median: 1.9483 Max: 8645 Percentiles: P50: 1.95 P75: 2.93 P99: 9.10 P99.9: 206.83 P99.99: 440.67 ------------------------------------------------------ [ 0, 1 ] 18005 1.630% 1.630% ( 1, 2 ] 563322 51.007% 52.638% ########## ( 2, 3 ] 266039 24.089% 76.727% ##### ( 3, 4 ] 114043 10.326% 87.053% ## ( 4, 6 ] 114786 10.394% 97.446% ## ( 6, 10 ] 22156 2.006% 99.453% ( 10, 15 ] 3482 0.315% 99.768% ( 15, 22 ] 412 0.037% 99.805% ( 22, 34 ] 35 0.003% 99.808% ( 34, 51 ] 7 0.001% 99.809% ( 51, 76 ] 21 0.002% 99.811% ( 76, 110 ] 194 0.018% 99.829% ( 110, 170 ] 541 0.049% 99.877% ( 170, 250 ] 540 0.049% 99.926% ( 250, 380 ] 526 0.048% 99.974% ( 380, 580 ] 582 0.053% 100.027% ( 580, 870 ] 480 0.043% 100.070% ( 870, 1300 ] 303 0.027% 100.098% ( 1300, 1900 ] 202 0.018% 100.116% ( 1900, 2900 ] 191 0.017% 100.133% ( 2900, 4400 ] 167 0.015% 100.148% ( 4400, 6600 ] 49 0.004% 100.153% ( 6600, 9900 ] 13 0.001% 100.154% ** Level 4 read latency histogram (micros): Count: 56613 Average: 4.7389 StdDev: 64.56 Min: 1 Median: 1.8826 Max: 4709 Percentiles: P50: 1.88 P75: 2.80 P99: 7.86 P99.9: 478.67 P99.99: 3789.78 ------------------------------------------------------ [ 0, 1 ] 860 1.519% 1.519% ( 1, 2 ] 31099 54.933% 56.452% ########### ( 2, 3 ] 13178 23.277% 79.729% ##### ( 3, 4 ] 5465 9.653% 89.382% ## ( 4, 6 ] 5173 9.137% 98.520% ## ( 6, 10 ] 585 1.033% 99.553% ( 10, 15 ] 115 0.203% 99.756% ( 15, 22 ] 8 0.014% 99.770% ( 22, 34 ] 5 0.009% 99.779% ( 34, 51 ] 2 0.004% 99.783% ( 76, 110 ] 2 0.004% 99.786% ( 110, 170 ] 5 0.009% 99.795% ( 170, 250 ] 39 0.069% 99.864% ( 250, 380 ] 12 0.021% 99.885% ( 380, 580 ] 17 0.030% 99.915% ( 580, 870 ] 14 0.025% 99.940% ( 870, 1300 ] 6 0.011% 99.951% ( 1300, 1900 ] 7 0.012% 99.963% ( 1900, 2900 ] 10 0.018% 99.981% ( 2900, 4400 ] 9 0.016% 99.996% ( 4400, 6600 ] 2 0.004% 100.000% ** Level 5 read latency histogram (micros): Count: 340 Average: 1584.9382 StdDev: 1810.60 Min: 83 Median: 795.6410 Max: 12643 Percentiles: P50: 795.64 P75: 2359.46 P99: 8580.00 P99.9: 12606.00 P99.99: 12643.00 ------------------------------------------------------ ( 76, 110 ] 11 3.235% 3.235% # ( 110, 170 ] 31 9.118% 12.353% ## ( 170, 250 ] 22 6.471% 18.824% # ( 250, 380 ] 36 10.588% 29.412% ## ( 380, 580 ] 41 12.059% 41.471% ## ( 580, 870 ] 39 11.471% 52.941% ## ( 870, 1300 ] 32 9.412% 62.353% ## ( 1300, 1900 ] 26 7.647% 70.000% ## ( 1900, 2900 ] 37 10.882% 80.882% ## ( 2900, 4400 ] 34 10.000% 90.882% ## ( 4400, 6600 ] 24 7.059% 97.941% # ( 6600, 9900 ] 6 1.765% 99.706% ( 9900, 14000 ] 1 0.294% 100.000% ** DB Stats ** Uptime(secs): 56.7 total, 3.1 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 173.46 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.550 H:M:S, 50.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 314.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.433 H:M:S, 13.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.471 micros/op 182778 ops/sec 60.012 seconds 10968999 operations; 177.1 MB/s Microseconds per write: Count: 10968999 Average: 5.4711 StdDev: 438.26 Min: 1 Median: 1.7515 Max: 803306 Percentiles: P50: 1.75 P75: 2.78 P99: 9.28 P99.9: 1085.41 P99.99: 2676.56 ------------------------------------------------------ [ 0, 1 ] 1406388 12.821% 12.821% ### ( 1, 2 ] 5426740 49.473% 62.295% ########## ( 2, 3 ] 1796518 16.378% 78.673% ### ( 3, 4 ] 1508608 13.753% 92.426% ### ( 4, 6 ] 614949 5.606% 98.033% # ( 6, 10 ] 129201 1.178% 99.211% ( 10, 15 ] 44114 0.402% 99.613% ( 15, 22 ] 10857 0.099% 99.712% ( 22, 34 ] 2480 0.023% 99.734% ( 34, 51 ] 354 0.003% 99.738% ( 51, 76 ] 67 0.001% 99.738% ( 76, 110 ] 7324 0.067% 99.805% ( 110, 170 ] 3204 0.029% 99.834% ( 170, 250 ] 373 0.003% 99.838% ( 250, 380 ] 221 0.002% 99.840% ( 380, 580 ] 27 0.000% 99.840% ( 580, 870 ] 31 0.000% 99.840% ( 870, 1300 ] 13123 0.120% 99.960% ( 1300, 1900 ] 53 0.000% 99.960% ( 1900, 2900 ] 4211 0.038% 99.999% ( 2900, 4400 ] 91 0.001% 99.999% ( 4400, 6600 ] 24 0.000% 100.000% ( 6600, 9900 ] 10 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 50000, 75000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 17 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 178186 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10968999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11320006968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 603 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 29480736 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 32888084942 rocksdb.compact.write.bytes COUNT : 32703207415 rocksdb.flush.write.bytes COUNT : 11229513527 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 79 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 363 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11139102720 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4447232 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 33000984627 rocksdb.non.last.level.read.count COUNT : 7967671 rocksdb.block.checksum.compute.count COUNT : 7966544 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.396192 P95 : 3.922582 P99 : 7.768722 P100 : 803304.000000 COUNT : 10968999 SUM : 54762923 rocksdb.compaction.times.micros P50 : 1078571.428571 P95 : 4685000.000000 P99 : 22089793.000000 P100 : 22089793.000000 COUNT : 93 SUM : 151858515 rocksdb.compaction.times.cpu_micros P50 : 896060.606061 P95 : 4118000.000000 P99 : 14560000.000000 P100 : 20085299.000000 COUNT : 93 SUM : 128332303 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 711.024096 P95 : 4175.000000 P99 : 37335.000000 P100 : 43165.000000 COUNT : 149 SUM : 256714 rocksdb.compaction.outfile.sync.micros P50 : 1124.728261 P95 : 80618.421053 P99 : 108544.736842 P100 : 167131.000000 COUNT : 379 SUM : 4443683 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 105.342466 P95 : 2175.000000 P99 : 4032.500000 P100 : 5266.000000 COUNT : 296 SUM : 113505 rocksdb.table.open.io.micros P50 : 1453.125000 P95 : 9655.344828 P99 : 17176.000000 P100 : 20010.000000 COUNT : 603 SUM : 1479553 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.720372 P95 : 8.100573 P99 : 11.616372 P100 : 16580.000000 COUNT : 7964880 SUM : 50007644 rocksdb.read.block.get.micros P50 : 494.893617 P95 : 3865.492958 P99 : 6202.428571 P100 : 11794.000000 COUNT : 1206 SUM : 1178700 rocksdb.write.raw.block.micros P50 : 0.514409 P95 : 0.977378 P99 : 2.959760 P100 : 13130.000000 COUNT : 10651183 SUM : 21634307 rocksdb.numfiles.in.singlecompaction P50 : 3.241758 P95 : 5.628571 P99 : 17.380000 P100 : 28.000000 COUNT : 166 SUM : 618 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562190 P95 : 1181.996496 P99 : 2549.217557 P100 : 803064.000000 COUNT : 158948 SUM : 29500212 rocksdb.sst.read.micros P50 : 1.633159 P95 : 4.806224 P99 : 8.617058 P100 : 16577.000000 COUNT : 7968023 SUM : 33610352 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10968999 SUM : 11320006968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214814.814815 P95 : 400900.000000 P99 : 788950.000000 P100 : 968354.000000 COUNT : 149 SUM : 33203085 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 374 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0