Invalid opts->opts_size 0 too small, please set opts_size correctly [2024-08-10 15:07:56.168617] Starting SPDK v24.09-pre git sha1 227b8322c / DPDK 22.11.4 initialization... [2024-08-10 15:07:56.168746] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3700913 ] Set seed to 1723295276165073 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-08-10 15:07:56.255845] app.c: 910:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-08-10 15:07:56.295763] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-08-10 15:07:56.295807] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3700913' to capture a snapshot of events at runtime. [2024-08-10 15:07:56.295817] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-08-10 15:07:56.295832] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-08-10 15:07:56.295839] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3700913 for offline analysis/debug. [2024-08-10 15:07:56.295929] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Aug 10 15:08:00 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/08/10-15:08:03 ... thread 0: (1000000,1000000) ops and (357503.0,357503.0) ops/second in (2.797179,2.797179) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.04 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 348.1 2.35 2.13 12 0.196 0 0 0.0 0.0 L2 3/2 251.70 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 255.1 255.0 1.48 1.43 2 0.741 383K 225 0.0 0.0 L3 12/0 993.25 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1180/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 98.6 312.1 3.83 3.55 14 0.274 383K 225 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.1 1.5 98.6 312.1 3.83 3.55 14 0.274 383K 225 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 255.1 255.0 1.48 1.43 2 0.741 383K 225 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 348.1 2.35 2.13 12 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 395.59 MB/s write, 0.37 GB read, 124.93 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 427.56 MB/s write, 0.37 GB read, 135.02 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 104762 Average: 1.8211 StdDev: 14.69 Min: 0 Median: 1.1837 Max: 2951 Percentiles: P50: 1.18 P75: 1.63 P99: 3.74 P99.9: 9.51 P99.99: 326.35 ------------------------------------------------------ [ 0, 1 ] 41655 39.762% 39.762% ######## ( 1, 2 ] 58406 55.751% 95.513% ########### ( 2, 3 ] 2857 2.727% 98.240% # ( 3, 4 ] 1083 1.034% 99.274% ( 4, 6 ] 467 0.446% 99.719% ( 6, 10 ] 218 0.208% 99.927% ( 10, 15 ] 42 0.040% 99.968% ( 15, 22 ] 10 0.010% 99.977% ( 22, 34 ] 1 0.001% 99.978% ( 34, 51 ] 1 0.001% 99.979% ( 110, 170 ] 8 0.008% 99.987% ( 170, 250 ] 2 0.002% 99.989% ( 250, 380 ] 6 0.006% 99.994% ( 380, 580 ] 3 0.003% 99.997% ( 580, 870 ] 1 0.001% 99.998% ( 1300, 1900 ] 2 0.002% 100.000% ( 1900, 2900 ] 1 0.001% 100.001% ( 2900, 4400 ] 1 0.001% 100.002% ** Level 2 read latency histogram (micros): Count: 50064 Average: 2.0481 StdDev: 22.70 Min: 1 Median: 1.2448 Max: 2876 Percentiles: P50: 1.24 P75: 1.67 P99: 4.43 P99.9: 9.69 P99.99: 1083.62 ------------------------------------------------------ [ 0, 1 ] 17898 35.750% 35.750% ####### ( 1, 2 ] 29148 58.221% 93.972% ############ ( 2, 3 ] 1708 3.412% 97.383% # ( 3, 4 ] 724 1.446% 98.829% ( 4, 6 ] 403 0.805% 99.634% ( 6, 10 ] 145 0.290% 99.924% ( 10, 15 ] 20 0.040% 99.964% ( 22, 34 ] 3 0.006% 99.970% ( 51, 76 ] 1 0.002% 99.972% ( 76, 110 ] 1 0.002% 99.974% ( 110, 170 ] 1 0.002% 99.976% ( 170, 250 ] 1 0.002% 99.978% ( 250, 380 ] 3 0.006% 99.984% ( 580, 870 ] 3 0.006% 99.990% ( 870, 1300 ] 2 0.004% 99.994% ( 1300, 1900 ] 1 0.002% 99.996% ( 1900, 2900 ] 3 0.006% 100.002% ** Level 3 read latency histogram (micros): Count: 50 Average: 1400.0800 StdDev: 987.85 Min: 98 Median: 1177.1429 Max: 4046 Percentiles: P50: 1177.14 P75: 2066.67 P99: 4046.00 P99.9: 4046.00 P99.99: 4046.00 ------------------------------------------------------ ( 76, 110 ] 1 2.000% 2.000% ( 110, 170 ] 3 6.000% 8.000% # ( 170, 250 ] 1 2.000% 10.000% ( 250, 380 ] 4 8.000% 18.000% ## ( 380, 580 ] 1 2.000% 20.000% ( 580, 870 ] 10 20.000% 40.000% #### ( 870, 1300 ] 7 14.000% 54.000% ### ( 1300, 1900 ] 9 18.000% 72.000% #### ( 1900, 2900 ] 9 18.000% 90.000% #### ( 2900, 4400 ] 5 10.000% 100.000% ## ** Level 4 read latency histogram (micros): Count: 20 Average: 1602.7000 StdDev: 1095.05 Min: 389 Median: 1420.0000 Max: 4205 Percentiles: P50: 1420.00 P75: 2233.33 P99: 4205.00 P99.9: 4205.00 P99.99: 4205.00 ------------------------------------------------------ ( 380, 580 ] 3 15.000% 15.000% ### ( 580, 870 ] 4 20.000% 35.000% #### ( 870, 1300 ] 2 10.000% 45.000% ## ( 1300, 1900 ] 5 25.000% 70.000% ##### ( 1900, 2900 ] 3 15.000% 85.000% ### ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 325.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.229 H:M:S, 7.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 351.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.229 H:M:S, 8.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/10-15:08:06 ... thread 0: (1000000,2000000) ops and (322822.0,339278.6) ops/second in (3.097682,5.894861) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/7 1.17 GB 6.3 0.8 0.0 0.8 2.6 1.8 0.0 1.4 98.0 316.5 8.36 7.73 29 0.288 831K 873 0.0 0.0 L1 1/1 3.72 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 241.1 240.8 1.57 1.53 1 1.568 383K 554 0.0 0.0 L2 2/1 54.34 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 255.1 255.0 1.48 1.43 2 0.741 383K 225 0.0 0.0 L3 18/8 962.34 MB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 226.8 226.8 1.10 1.03 1 1.099 252K 0 0.0 0.0 L4 170/0 9.45 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 141.5 141.5 1.58 1.17 1 1.583 227K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1247/17 97.92 GB 0.0 2.0 1.0 1.0 3.8 2.8 2.1 2.1 145.4 274.9 14.09 12.88 34 0.414 2079K 1652 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 1.0 1.0 3.8 2.8 2.0 2.1 145.4 274.9 14.09 12.88 34 0.414 2079K 1652 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 1.0 1.0 2.0 1.0 0.0 0.0 230.9 230.8 8.87 8.24 8 1.108 2079K 1652 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 350.0 5.22 4.65 26 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.78 GB write, 632.61 MB/s write, 2.00 GB read, 334.51 MB/s read, 14.1 seconds Interval compaction: 3.78 GB write, 656.88 MB/s write, 2.00 GB read, 347.34 MB/s read, 14.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 384044 Average: 2.1914 StdDev: 11.66 Min: 0 Median: 1.4731 Max: 2951 Percentiles: P50: 1.47 P75: 1.87 P99: 5.68 P99.9: 10.66 P99.99: 17.42 ------------------------------------------------------ [ 0, 1 ] 76434 19.902% 19.902% #### ( 1, 2 ] 244344 63.624% 83.526% ############# ( 2, 3 ] 37042 9.645% 93.172% ## ( 3, 4 ] 14645 3.813% 96.985% # ( 4, 6 ] 9217 2.400% 99.385% ( 6, 10 ] 1929 0.502% 99.887% ( 10, 15 ] 378 0.098% 99.986% ( 15, 22 ] 51 0.013% 99.999% ( 22, 34 ] 5 0.001% 100.000% ( 34, 51 ] 3 0.001% 100.001% ( 51, 76 ] 1 0.000% 100.001% ( 110, 170 ] 10 0.003% 100.004% ( 170, 250 ] 10 0.003% 100.007% ( 250, 380 ] 10 0.003% 100.009% ( 380, 580 ] 8 0.002% 100.011% ( 580, 870 ] 5 0.001% 100.012% ( 870, 1300 ] 5 0.001% 100.014% ( 1300, 1900 ] 5 0.001% 100.015% ( 1900, 2900 ] 4 0.001% 100.016% ( 2900, 4400 ] 1 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 26 Average: 195.8846 StdDev: 389.32 Min: 1 Median: 1.7778 Max: 1579 Percentiles: P50: 1.78 P75: 210.00 P99: 1579.00 P99.9: 1579.00 P99.99: 1579.00 ------------------------------------------------------ [ 0, 1 ] 6 23.077% 23.077% ##### ( 1, 2 ] 9 34.615% 57.692% ####### ( 2, 3 ] 2 7.692% 65.385% ## ( 4, 6 ] 1 3.846% 69.231% # ( 110, 170 ] 1 3.846% 73.077% # ( 170, 250 ] 1 3.846% 76.923% # ( 250, 380 ] 2 7.692% 84.615% ## ( 380, 580 ] 1 3.846% 88.462% # ( 580, 870 ] 1 3.846% 92.308% # ( 870, 1300 ] 1 3.846% 96.154% # ( 1300, 1900 ] 1 3.846% 100.000% # ** Level 2 read latency histogram (micros): Count: 95802 Average: 2.1500 StdDev: 16.43 Min: 1 Median: 1.4124 Max: 2876 Percentiles: P50: 1.41 P75: 1.81 P99: 5.58 P99.9: 9.98 P99.99: 354.86 ------------------------------------------------------ [ 0, 1 ] 23312 24.334% 24.334% ##### ( 1, 2 ] 59629 62.242% 86.575% ############ ( 2, 3 ] 7538 7.868% 94.444% ## ( 3, 4 ] 2857 2.982% 97.426% # ( 4, 6 ] 1907 1.991% 99.417% ( 6, 10 ] 466 0.486% 99.903% ( 10, 15 ] 65 0.068% 99.971% ( 15, 22 ] 8 0.008% 99.979% ( 22, 34 ] 3 0.003% 99.982% ( 34, 51 ] 1 0.001% 99.983% ( 51, 76 ] 1 0.001% 99.984% ( 76, 110 ] 1 0.001% 99.985% ( 110, 170 ] 1 0.001% 99.986% ( 170, 250 ] 1 0.001% 99.987% ( 250, 380 ] 3 0.003% 99.991% ( 580, 870 ] 3 0.003% 99.994% ( 870, 1300 ] 2 0.002% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 170526 Average: 3.5421 StdDev: 33.33 Min: 1 Median: 1.7372 Max: 4046 Percentiles: P50: 1.74 P75: 2.43 P99: 8.88 P99.9: 160.35 P99.99: 458.47 ------------------------------------------------------ [ 0, 1 ] 9944 5.831% 5.831% # ( 1, 2 ] 102167 59.913% 65.744% ############ ( 2, 3 ] 36480 21.393% 87.137% #### ( 3, 4 ] 9861 5.783% 92.920% # ( 4, 6 ] 8380 4.914% 97.834% # ( 6, 10 ] 2760 1.619% 99.452% ( 10, 15 ] 422 0.247% 99.700% ( 15, 22 ] 76 0.045% 99.744% ( 22, 34 ] 24 0.014% 99.758% ( 34, 51 ] 6 0.004% 99.762% ( 51, 76 ] 3 0.002% 99.764% ( 76, 110 ] 47 0.028% 99.791% ( 110, 170 ] 221 0.130% 99.921% ( 170, 250 ] 56 0.033% 99.954% ( 250, 380 ] 49 0.029% 99.982% ( 380, 580 ] 33 0.019% 100.002% ( 580, 870 ] 29 0.017% 100.019% ( 870, 1300 ] 12 0.007% 100.026% ( 1300, 1900 ] 11 0.006% 100.032% ( 1900, 2900 ] 10 0.006% 100.038% ( 2900, 4400 ] 5 0.003% 100.041% ** Level 4 read latency histogram (micros): Count: 310 Average: 108.0677 StdDev: 481.10 Min: 1 Median: 2.3095 Max: 4205 Percentiles: P50: 2.31 P75: 5.80 P99: 2866.67 P99.9: 4205.00 P99.99: 4205.00 ------------------------------------------------------ [ 0, 1 ] 31 10.000% 10.000% ## ( 1, 2 ] 98 31.613% 41.613% ###### ( 2, 3 ] 84 27.097% 68.710% ##### ( 3, 4 ] 15 4.839% 73.548% # ( 4, 6 ] 5 1.613% 75.161% ( 6, 10 ] 5 1.613% 76.774% ( 10, 15 ] 31 10.000% 86.774% ## ( 15, 22 ] 17 5.484% 92.258% # ( 22, 34 ] 4 1.290% 93.548% ( 380, 580 ] 3 0.968% 94.516% ( 580, 870 ] 4 1.290% 95.806% ( 870, 1300 ] 2 0.645% 96.452% ( 1300, 1900 ] 5 1.613% 98.065% ( 1900, 2900 ] 3 0.968% 99.032% ( 2900, 4400 ] 3 0.968% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 785.5250 StdDev: 886.41 Min: 84 Median: 336.6667 Max: 3566 Percentiles: P50: 336.67 P75: 1300.00 P99: 3566.00 P99.9: 3566.00 P99.99: 3566.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 12 30.000% 35.000% ###### ( 170, 250 ] 4 10.000% 45.000% ## ( 250, 380 ] 3 7.500% 52.500% ## ( 380, 580 ] 5 12.500% 65.000% ### ( 580, 870 ] 2 5.000% 70.000% # ( 870, 1300 ] 2 5.000% 75.000% # ( 1300, 1900 ] 3 7.500% 82.500% ## ( 1900, 2900 ] 6 15.000% 97.500% ### ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 321.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.620 H:M:S, 10.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.72 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.392 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/10-15:08:09 ... thread 0: (1000000,3000000) ops and (324772.2,334301.2) ops/second in (3.079081,8.973942) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 2.15 GB 81.8 1.4 0.0 1.4 4.1 2.8 0.0 1.5 104.1 316.8 13.32 12.34 45 0.296 1407K 1499 0.0 0.0 L1 1/1 3.72 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 241.1 240.8 1.57 1.53 1 1.568 383K 554 0.0 0.0 L2 1/0 51.78 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 255.1 255.0 1.48 1.43 2 0.741 383K 225 0.0 0.0 L3 15/0 963.34 MB 1.0 0.8 0.2 0.6 0.8 0.2 0.4 3.4 223.3 222.9 3.88 3.64 2 1.941 880K 1598 0.0 0.0 L4 170/0 9.45 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 141.5 141.5 1.58 1.17 1 1.583 227K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1251/12 98.90 GB 0.0 3.2 1.0 2.1 5.9 3.8 2.1 2.1 148.1 277.7 21.83 20.10 51 0.428 3282K 3876 0.0 0.0 Int 0/0 0.00 KB 0.0 3.2 1.0 2.1 5.9 3.8 2.0 2.1 148.1 277.7 21.83 20.10 51 0.428 3282K 3876 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.2 1.0 2.1 3.2 1.0 0.0 0.0 234.0 233.7 13.82 12.97 11 1.256 3282K 3876 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 353.7 8.01 7.13 40 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.92 GB write, 658.98 MB/s write, 3.16 GB read, 351.33 MB/s read, 21.8 seconds Interval compaction: 5.92 GB write, 675.58 MB/s write, 3.16 GB read, 360.19 MB/s read, 21.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 772635 Average: 2.1887 StdDev: 10.68 Min: 0 Median: 1.4986 Max: 4385 Percentiles: P50: 1.50 P75: 1.87 P99: 5.53 P99.9: 9.75 P99.99: 13.86 ------------------------------------------------------ [ 0, 1 ] 130224 16.855% 16.855% ### ( 1, 2 ] 513627 66.477% 83.332% ############# ( 2, 3 ] 79172 10.247% 93.579% ## ( 3, 4 ] 29405 3.806% 97.385% # ( 4, 6 ] 16263 2.105% 99.490% ( 6, 10 ] 3380 0.437% 99.927% ( 10, 15 ] 632 0.082% 100.009% ( 15, 22 ] 72 0.009% 100.018% ( 22, 34 ] 7 0.001% 100.019% ( 34, 51 ] 9 0.001% 100.020% ( 51, 76 ] 4 0.001% 100.021% ( 110, 170 ] 13 0.002% 100.022% ( 170, 250 ] 20 0.003% 100.025% ( 250, 380 ] 15 0.002% 100.027% ( 380, 580 ] 10 0.001% 100.028% ( 580, 870 ] 11 0.001% 100.030% ( 870, 1300 ] 7 0.001% 100.031% ( 1300, 1900 ] 6 0.001% 100.031% ( 1900, 2900 ] 6 0.001% 100.032% ( 2900, 4400 ] 2 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 26 Average: 195.8846 StdDev: 389.32 Min: 1 Median: 1.7778 Max: 1579 Percentiles: P50: 1.78 P75: 210.00 P99: 1579.00 P99.9: 1579.00 P99.99: 1579.00 ------------------------------------------------------ [ 0, 1 ] 6 23.077% 23.077% ##### ( 1, 2 ] 9 34.615% 57.692% ####### ( 2, 3 ] 2 7.692% 65.385% ## ( 4, 6 ] 1 3.846% 69.231% # ( 110, 170 ] 1 3.846% 73.077% # ( 170, 250 ] 1 3.846% 76.923% # ( 250, 380 ] 2 7.692% 84.615% ## ( 380, 580 ] 1 3.846% 88.462% # ( 580, 870 ] 1 3.846% 92.308% # ( 870, 1300 ] 1 3.846% 96.154% # ( 1300, 1900 ] 1 3.846% 100.000% # ** Level 2 read latency histogram (micros): Count: 124185 Average: 2.3443 StdDev: 16.13 Min: 1 Median: 1.4448 Max: 2876 Percentiles: P50: 1.44 P75: 1.84 P99: 5.95 P99.9: 101.59 P99.99: 571.63 ------------------------------------------------------ [ 0, 1 ] 26976 21.722% 21.722% #### ( 1, 2 ] 78942 63.568% 85.290% ############# ( 2, 3 ] 11001 8.859% 94.149% ## ( 3, 4 ] 3702 2.981% 97.130% # ( 4, 6 ] 2383 1.919% 99.049% ( 6, 10 ] 924 0.744% 99.793% ( 10, 15 ] 96 0.077% 99.870% ( 15, 22 ] 12 0.010% 99.880% ( 22, 34 ] 3 0.002% 99.882% ( 34, 51 ] 1 0.001% 99.883% ( 51, 76 ] 2 0.002% 99.885% ( 76, 110 ] 25 0.020% 99.905% ( 110, 170 ] 77 0.062% 99.967% ( 170, 250 ] 13 0.010% 99.977% ( 250, 380 ] 6 0.005% 99.982% ( 380, 580 ] 10 0.008% 99.990% ( 580, 870 ] 5 0.004% 99.994% ( 870, 1300 ] 3 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 184839 Average: 3.4746 StdDev: 32.66 Min: 1 Median: 1.7164 Max: 4046 Percentiles: P50: 1.72 P75: 2.38 P99: 8.80 P99.9: 159.18 P99.99: 487.98 ------------------------------------------------------ [ 0, 1 ] 12027 6.507% 6.507% # ( 1, 2 ] 112212 60.708% 67.215% ############ ( 2, 3 ] 37767 20.432% 87.647% #### ( 3, 4 ] 10302 5.573% 93.221% # ( 4, 6 ] 8602 4.654% 97.874% # ( 6, 10 ] 2973 1.608% 99.483% ( 10, 15 ] 431 0.233% 99.716% ( 15, 22 ] 79 0.043% 99.759% ( 22, 34 ] 24 0.013% 99.772% ( 34, 51 ] 6 0.003% 99.775% ( 51, 76 ] 3 0.002% 99.777% ( 76, 110 ] 47 0.025% 99.802% ( 110, 170 ] 221 0.120% 99.922% ( 170, 250 ] 56 0.030% 99.952% ( 250, 380 ] 50 0.027% 99.979% ( 380, 580 ] 38 0.021% 99.999% ( 580, 870 ] 29 0.016% 100.015% ( 870, 1300 ] 14 0.008% 100.023% ( 1300, 1900 ] 13 0.007% 100.030% ( 1900, 2900 ] 10 0.005% 100.035% ( 2900, 4400 ] 5 0.003% 100.038% ** Level 4 read latency histogram (micros): Count: 310 Average: 108.0677 StdDev: 481.10 Min: 1 Median: 2.3095 Max: 4205 Percentiles: P50: 2.31 P75: 5.80 P99: 2866.67 P99.9: 4205.00 P99.99: 4205.00 ------------------------------------------------------ [ 0, 1 ] 31 10.000% 10.000% ## ( 1, 2 ] 98 31.613% 41.613% ###### ( 2, 3 ] 84 27.097% 68.710% ##### ( 3, 4 ] 15 4.839% 73.548% # ( 4, 6 ] 5 1.613% 75.161% ( 6, 10 ] 5 1.613% 76.774% ( 10, 15 ] 31 10.000% 86.774% ## ( 15, 22 ] 17 5.484% 92.258% # ( 22, 34 ] 4 1.290% 93.548% ( 380, 580 ] 3 0.968% 94.516% ( 580, 870 ] 4 1.290% 95.806% ( 870, 1300 ] 2 0.645% 96.452% ( 1300, 1900 ] 5 1.613% 98.065% ( 1900, 2900 ] 3 0.968% 99.032% ( 2900, 4400 ] 3 0.968% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 785.5250 StdDev: 886.41 Min: 84 Median: 336.6667 Max: 3566 Percentiles: P50: 336.67 P75: 1300.00 P99: 3566.00 P99.9: 3566.00 P99.99: 3566.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 12 30.000% 35.000% ###### ( 170, 250 ] 4 10.000% 45.000% ## ( 250, 380 ] 3 7.500% 52.500% ## ( 380, 580 ] 5 12.500% 65.000% ### ( 580, 870 ] 2 5.000% 70.000% # ( 870, 1300 ] 2 5.000% 75.000% # ( 1300, 1900 ] 3 7.500% 82.500% ## ( 1900, 2900 ] 6 15.000% 97.500% ### ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 9.2 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 320.87 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.061 H:M:S, 11.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.440 H:M:S, 14.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/10-15:08:12 ... thread 0: (1000000,4000000) ops and (330888.7,333441.5) ops/second in (3.022164,11.996106) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 2.03 GB 6.3 2.2 0.0 2.2 5.9 3.8 0.0 1.6 114.5 314.0 19.25 17.91 62 0.311 2238K 2378 0.0 0.0 L1 11/11 1.10 GB 0.0 1.5 1.5 0.0 1.5 1.5 0.2 1.0 234.6 233.6 6.46 6.24 2 3.228 1538K 5930 0.0 0.0 L2 1/0 51.78 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 255.1 255.0 1.48 1.43 2 0.741 383K 225 0.0 0.0 L3 15/0 963.34 MB 1.0 0.8 0.2 0.6 0.8 0.2 0.4 3.4 223.3 222.9 3.88 3.64 2 1.941 880K 1598 0.0 0.0 L4 170/0 9.45 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 141.5 141.5 1.58 1.17 1 1.583 227K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1259/24 99.88 GB 0.0 5.1 2.1 2.9 8.8 5.9 2.1 2.3 158.9 276.2 32.66 30.38 69 0.473 5268K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.1 2.1 2.9 8.8 5.9 2.0 2.3 158.9 276.2 32.66 30.38 69 0.473 5268K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.1 2.1 2.9 5.1 2.1 0.0 0.0 237.7 237.2 21.83 20.75 15 1.455 5268K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 354.9 10.83 9.63 54 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.81 GB write, 737.98 MB/s write, 5.07 GB read, 424.47 MB/s read, 32.7 seconds Interval compaction: 8.81 GB write, 751.89 MB/s write, 5.07 GB read, 432.47 MB/s read, 32.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1062413 Average: 2.1905 StdDev: 10.04 Min: 0 Median: 1.4915 Max: 4385 Percentiles: P50: 1.49 P75: 1.87 P99: 5.53 P99.9: 9.82 P99.99: 14.35 ------------------------------------------------------ [ 0, 1 ] 184161 17.334% 17.334% ### ( 1, 2 ] 706034 66.456% 83.790% ############# ( 2, 3 ] 106381 10.013% 93.803% ## ( 3, 4 ] 39060 3.677% 97.480% # ( 4, 6 ] 21161 1.992% 99.471% ( 6, 10 ] 4770 0.449% 99.920% ( 10, 15 ] 853 0.080% 100.001% ( 15, 22 ] 100 0.009% 100.010% ( 22, 34 ] 9 0.001% 100.011% ( 34, 51 ] 12 0.001% 100.012% ( 51, 76 ] 6 0.001% 100.013% ( 76, 110 ] 40 0.004% 100.016% ( 110, 170 ] 61 0.006% 100.022% ( 170, 250 ] 44 0.004% 100.026% ( 250, 380 ] 31 0.003% 100.029% ( 380, 580 ] 23 0.002% 100.031% ( 580, 870 ] 20 0.002% 100.033% ( 870, 1300 ] 10 0.001% 100.034% ( 1300, 1900 ] 6 0.001% 100.035% ( 1900, 2900 ] 7 0.001% 100.035% ( 2900, 4400 ] 2 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 28216 Average: 3.0711 StdDev: 31.91 Min: 0 Median: 1.2974 Max: 2138 Percentiles: P50: 1.30 P75: 1.71 P99: 5.45 P99.9: 337.84 P99.99: 1717.84 ------------------------------------------------------ [ 0, 1 ] 9027 31.992% 31.992% ###### ( 1, 2 ] 17085 60.551% 92.543% ############ ( 2, 3 ] 1193 4.228% 96.771% # ( 3, 4 ] 492 1.744% 98.515% ( 4, 6 ] 189 0.670% 99.185% ( 6, 10 ] 106 0.376% 99.561% ( 10, 15 ] 18 0.064% 99.624% ( 15, 22 ] 2 0.007% 99.631% ( 51, 76 ] 1 0.004% 99.635% ( 76, 110 ] 13 0.046% 99.681% ( 110, 170 ] 40 0.142% 99.823% ( 170, 250 ] 13 0.046% 99.869% ( 250, 380 ] 13 0.046% 99.915% ( 380, 580 ] 8 0.028% 99.943% ( 580, 870 ] 6 0.021% 99.965% ( 870, 1300 ] 3 0.011% 99.975% ( 1300, 1900 ] 6 0.021% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 124185 Average: 2.3443 StdDev: 16.13 Min: 1 Median: 1.4448 Max: 2876 Percentiles: P50: 1.44 P75: 1.84 P99: 5.95 P99.9: 101.59 P99.99: 571.63 ------------------------------------------------------ [ 0, 1 ] 26976 21.722% 21.722% #### ( 1, 2 ] 78942 63.568% 85.290% ############# ( 2, 3 ] 11001 8.859% 94.149% ## ( 3, 4 ] 3702 2.981% 97.130% # ( 4, 6 ] 2383 1.919% 99.049% ( 6, 10 ] 924 0.744% 99.793% ( 10, 15 ] 96 0.077% 99.870% ( 15, 22 ] 12 0.010% 99.880% ( 22, 34 ] 3 0.002% 99.882% ( 34, 51 ] 1 0.001% 99.883% ( 51, 76 ] 2 0.002% 99.885% ( 76, 110 ] 25 0.020% 99.905% ( 110, 170 ] 77 0.062% 99.967% ( 170, 250 ] 13 0.010% 99.977% ( 250, 380 ] 6 0.005% 99.982% ( 380, 580 ] 10 0.008% 99.990% ( 580, 870 ] 5 0.004% 99.994% ( 870, 1300 ] 3 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 184839 Average: 3.4746 StdDev: 32.66 Min: 1 Median: 1.7164 Max: 4046 Percentiles: P50: 1.72 P75: 2.38 P99: 8.80 P99.9: 159.18 P99.99: 487.98 ------------------------------------------------------ [ 0, 1 ] 12027 6.507% 6.507% # ( 1, 2 ] 112212 60.708% 67.215% ############ ( 2, 3 ] 37767 20.432% 87.647% #### ( 3, 4 ] 10302 5.573% 93.221% # ( 4, 6 ] 8602 4.654% 97.874% # ( 6, 10 ] 2973 1.608% 99.483% ( 10, 15 ] 431 0.233% 99.716% ( 15, 22 ] 79 0.043% 99.759% ( 22, 34 ] 24 0.013% 99.772% ( 34, 51 ] 6 0.003% 99.775% ( 51, 76 ] 3 0.002% 99.777% ( 76, 110 ] 47 0.025% 99.802% ( 110, 170 ] 221 0.120% 99.922% ( 170, 250 ] 56 0.030% 99.952% ( 250, 380 ] 50 0.027% 99.979% ( 380, 580 ] 38 0.021% 99.999% ( 580, 870 ] 29 0.016% 100.015% ( 870, 1300 ] 14 0.008% 100.023% ( 1300, 1900 ] 13 0.007% 100.030% ( 1900, 2900 ] 10 0.005% 100.035% ( 2900, 4400 ] 5 0.003% 100.038% ** Level 4 read latency histogram (micros): Count: 310 Average: 108.0677 StdDev: 481.10 Min: 1 Median: 2.3095 Max: 4205 Percentiles: P50: 2.31 P75: 5.80 P99: 2866.67 P99.9: 4205.00 P99.99: 4205.00 ------------------------------------------------------ [ 0, 1 ] 31 10.000% 10.000% ## ( 1, 2 ] 98 31.613% 41.613% ###### ( 2, 3 ] 84 27.097% 68.710% ##### ( 3, 4 ] 15 4.839% 73.548% # ( 4, 6 ] 5 1.613% 75.161% ( 6, 10 ] 5 1.613% 76.774% ( 10, 15 ] 31 10.000% 86.774% ## ( 15, 22 ] 17 5.484% 92.258% # ( 22, 34 ] 4 1.290% 93.548% ( 380, 580 ] 3 0.968% 94.516% ( 580, 870 ] 4 1.290% 95.806% ( 870, 1300 ] 2 0.645% 96.452% ( 1300, 1900 ] 5 1.613% 98.065% ( 1900, 2900 ] 3 0.968% 99.032% ( 2900, 4400 ] 3 0.968% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 785.5250 StdDev: 886.41 Min: 84 Median: 336.6667 Max: 3566 Percentiles: P50: 336.67 P75: 1300.00 P99: 3566.00 P99.9: 3566.00 P99.99: 3566.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 12 30.000% 35.000% ###### ( 170, 250 ] 4 10.000% 45.000% ## ( 250, 380 ] 3 7.500% 52.500% ## ( 380, 580 ] 5 12.500% 65.000% ### ( 580, 870 ] 2 5.000% 70.000% # ( 870, 1300 ] 2 5.000% 75.000% # ( 1300, 1900 ] 3 7.500% 82.500% ## ( 1900, 2900 ] 6 15.000% 97.500% ### ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 12.2 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 322.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.470 H:M:S, 12.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.66 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.409 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/10-15:08:15 ... thread 0: (1000000,5000000) ops and (327971.0,332332.9) ops/second in (3.049050,15.045156) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 2.95 GB 100.7 3.0 0.0 3.0 7.6 4.7 0.0 1.6 121.0 312.4 24.99 23.31 78 0.320 3070K 3274 0.0 0.0 L1 11/11 1.10 GB 0.0 1.5 1.5 0.0 1.5 1.5 0.2 1.0 234.6 233.6 6.46 6.24 2 3.228 1538K 5930 0.0 0.0 L2 1/0 51.78 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 255.1 255.0 1.48 1.43 2 0.741 383K 225 0.0 0.0 L3 15/0 963.34 MB 1.0 0.8 0.2 0.6 0.8 0.2 0.4 3.4 223.3 222.9 3.88 3.64 2 1.941 880K 1598 0.0 0.0 L4 170/0 9.45 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 141.5 141.5 1.58 1.17 1 1.583 227K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1263/24 100.80 GB 0.0 5.9 2.1 3.7 10.5 6.8 2.1 2.3 156.5 280.8 38.40 35.78 85 0.452 6100K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.9 2.1 3.7 10.5 6.8 2.0 2.3 156.5 280.8 38.40 35.78 85 0.452 6100K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.9 2.1 3.7 5.9 2.1 0.0 0.0 241.5 241.1 24.87 23.74 18 1.382 6100K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 354.0 13.52 12.03 67 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.3 total, 15.0 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.53 GB write, 706.08 MB/s write, 5.87 GB read, 393.35 MB/s read, 38.4 seconds Interval compaction: 10.53 GB write, 716.69 MB/s write, 5.87 GB read, 399.26 MB/s read, 38.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1383968 Average: 2.2017 StdDev: 10.28 Min: 0 Median: 1.4951 Max: 4385 Percentiles: P50: 1.50 P75: 1.87 P99: 5.51 P99.9: 9.88 P99.99: 14.73 ------------------------------------------------------ [ 0, 1 ] 233745 16.889% 16.889% ### ( 1, 2 ] 925567 66.878% 83.767% ############# ( 2, 3 ] 140948 10.184% 93.952% ## ( 3, 4 ] 49742 3.594% 97.546% # ( 4, 6 ] 26714 1.930% 99.476% ( 6, 10 ] 6045 0.437% 99.913% ( 10, 15 ] 1131 0.082% 99.995% ( 15, 22 ] 124 0.009% 100.003% ( 22, 34 ] 9 0.001% 100.004% ( 34, 51 ] 15 0.001% 100.005% ( 51, 76 ] 8 0.001% 100.006% ( 76, 110 ] 73 0.005% 100.011% ( 110, 170 ] 107 0.008% 100.019% ( 170, 250 ] 55 0.004% 100.023% ( 250, 380 ] 47 0.003% 100.026% ( 380, 580 ] 40 0.003% 100.029% ( 580, 870 ] 26 0.002% 100.031% ( 870, 1300 ] 15 0.001% 100.032% ( 1300, 1900 ] 8 0.001% 100.033% ( 1900, 2900 ] 8 0.001% 100.033% ( 2900, 4400 ] 3 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 98748 Average: 2.6774 StdDev: 19.04 Min: 0 Median: 1.4787 Max: 2138 Percentiles: P50: 1.48 P75: 1.86 P99: 7.78 P99.9: 159.78 P99.99: 1052.77 ------------------------------------------------------ [ 0, 1 ] 18224 18.455% 18.455% #### ( 1, 2 ] 65073 65.898% 84.353% ############# ( 2, 3 ] 9562 9.683% 94.036% ## ( 3, 4 ] 2747 2.782% 96.818% # ( 4, 6 ] 1620 1.641% 98.459% ( 6, 10 ] 1202 1.217% 99.676% ( 10, 15 ] 79 0.080% 99.756% ( 15, 22 ] 8 0.008% 99.764% ( 22, 34 ] 1 0.001% 99.765% ( 51, 76 ] 7 0.007% 99.772% ( 76, 110 ] 69 0.070% 99.842% ( 110, 170 ] 69 0.070% 99.912% ( 170, 250 ] 29 0.029% 99.941% ( 250, 380 ] 25 0.025% 99.967% ( 380, 580 ] 13 0.013% 99.980% ( 580, 870 ] 8 0.008% 99.988% ( 870, 1300 ] 5 0.005% 99.993% ( 1300, 1900 ] 6 0.006% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 124185 Average: 2.3443 StdDev: 16.13 Min: 1 Median: 1.4448 Max: 2876 Percentiles: P50: 1.44 P75: 1.84 P99: 5.95 P99.9: 101.59 P99.99: 571.63 ------------------------------------------------------ [ 0, 1 ] 26976 21.722% 21.722% #### ( 1, 2 ] 78942 63.568% 85.290% ############# ( 2, 3 ] 11001 8.859% 94.149% ## ( 3, 4 ] 3702 2.981% 97.130% # ( 4, 6 ] 2383 1.919% 99.049% ( 6, 10 ] 924 0.744% 99.793% ( 10, 15 ] 96 0.077% 99.870% ( 15, 22 ] 12 0.010% 99.880% ( 22, 34 ] 3 0.002% 99.882% ( 34, 51 ] 1 0.001% 99.883% ( 51, 76 ] 2 0.002% 99.885% ( 76, 110 ] 25 0.020% 99.905% ( 110, 170 ] 77 0.062% 99.967% ( 170, 250 ] 13 0.010% 99.977% ( 250, 380 ] 6 0.005% 99.982% ( 380, 580 ] 10 0.008% 99.990% ( 580, 870 ] 5 0.004% 99.994% ( 870, 1300 ] 3 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 184839 Average: 3.4746 StdDev: 32.66 Min: 1 Median: 1.7164 Max: 4046 Percentiles: P50: 1.72 P75: 2.38 P99: 8.80 P99.9: 159.18 P99.99: 487.98 ------------------------------------------------------ [ 0, 1 ] 12027 6.507% 6.507% # ( 1, 2 ] 112212 60.708% 67.215% ############ ( 2, 3 ] 37767 20.432% 87.647% #### ( 3, 4 ] 10302 5.573% 93.221% # ( 4, 6 ] 8602 4.654% 97.874% # ( 6, 10 ] 2973 1.608% 99.483% ( 10, 15 ] 431 0.233% 99.716% ( 15, 22 ] 79 0.043% 99.759% ( 22, 34 ] 24 0.013% 99.772% ( 34, 51 ] 6 0.003% 99.775% ( 51, 76 ] 3 0.002% 99.777% ( 76, 110 ] 47 0.025% 99.802% ( 110, 170 ] 221 0.120% 99.922% ( 170, 250 ] 56 0.030% 99.952% ( 250, 380 ] 50 0.027% 99.979% ( 380, 580 ] 38 0.021% 99.999% ( 580, 870 ] 29 0.016% 100.015% ( 870, 1300 ] 14 0.008% 100.023% ( 1300, 1900 ] 13 0.007% 100.030% ( 1900, 2900 ] 10 0.005% 100.035% ( 2900, 4400 ] 5 0.003% 100.038% ** Level 4 read latency histogram (micros): Count: 310 Average: 108.0677 StdDev: 481.10 Min: 1 Median: 2.3095 Max: 4205 Percentiles: P50: 2.31 P75: 5.80 P99: 2866.67 P99.9: 4205.00 P99.99: 4205.00 ------------------------------------------------------ [ 0, 1 ] 31 10.000% 10.000% ## ( 1, 2 ] 98 31.613% 41.613% ###### ( 2, 3 ] 84 27.097% 68.710% ##### ( 3, 4 ] 15 4.839% 73.548% # ( 4, 6 ] 5 1.613% 75.161% ( 6, 10 ] 5 1.613% 76.774% ( 10, 15 ] 31 10.000% 86.774% ## ( 15, 22 ] 17 5.484% 92.258% # ( 22, 34 ] 4 1.290% 93.548% ( 380, 580 ] 3 0.968% 94.516% ( 580, 870 ] 4 1.290% 95.806% ( 870, 1300 ] 2 0.645% 96.452% ( 1300, 1900 ] 5 1.613% 98.065% ( 1900, 2900 ] 3 0.968% 99.032% ( 2900, 4400 ] 3 0.968% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 785.5250 StdDev: 886.41 Min: 84 Median: 336.6667 Max: 3566 Percentiles: P50: 336.67 P75: 1300.00 P99: 3566.00 P99.9: 3566.00 P99.99: 3566.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 12 30.000% 35.000% ###### ( 170, 250 ] 4 10.000% 45.000% ## ( 250, 380 ] 3 7.500% 52.500% ## ( 380, 580 ] 5 12.500% 65.000% ### ( 580, 870 ] 2 5.000% 70.000% # ( 870, 1300 ] 2 5.000% 75.000% # ( 1300, 1900 ] 3 7.500% 82.500% ## ( 1900, 2900 ] 6 15.000% 97.500% ### ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 15.3 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 322.20 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.885 H:M:S, 12.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.415 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/10-15:08:22 ... thread 0: (1000000,6000000) ops and (135328.2,267444.1) ops/second in (7.389442,22.434598) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 3.93 GB 207.4 4.8 0.0 4.8 10.5 5.7 0.0 1.8 141.0 307.1 34.85 32.72 99 0.352 4988K 6866 0.0 0.0 L1 11/11 1.10 GB 0.0 1.5 1.5 0.0 1.5 1.5 0.2 1.0 234.6 233.6 6.46 6.24 2 3.228 1538K 5930 0.0 0.0 L2 1/0 51.78 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 255.1 255.0 1.48 1.43 2 0.741 383K 225 0.0 0.0 L3 15/0 963.34 MB 1.0 0.8 0.2 0.6 0.8 0.2 0.4 3.4 223.3 222.9 3.88 3.64 2 1.941 880K 1598 0.0 0.0 L4 170/0 9.45 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 141.5 141.5 1.58 1.17 1 1.583 227K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1264/24 101.78 GB 0.0 7.7 2.1 5.6 13.4 7.8 2.1 2.4 163.6 283.4 48.26 45.19 106 0.455 8018K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.7 2.1 5.6 13.4 7.8 2.0 2.4 163.6 283.4 48.26 45.19 106 0.455 8018K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.7 2.1 5.6 7.7 2.1 0.0 0.0 248.2 247.7 31.82 30.58 23 1.383 8018K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 352.5 16.44 14.61 83 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.7 total, 22.4 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.36 GB write, 603.53 MB/s write, 7.71 GB read, 348.45 MB/s read, 48.3 seconds Interval compaction: 13.36 GB write, 609.61 MB/s write, 7.71 GB read, 351.97 MB/s read, 48.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 16, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2105468 Average: 2.1823 StdDev: 9.99 Min: 0 Median: 1.4858 Max: 4385 Percentiles: P50: 1.49 P75: 1.86 P99: 5.51 P99.9: 9.98 P99.99: 17.76 ------------------------------------------------------ [ 0, 1 ] 364269 17.301% 17.301% ### ( 1, 2 ] 1417094 67.305% 84.607% ############# ( 2, 3 ] 203300 9.656% 94.262% ## ( 3, 4 ] 71335 3.388% 97.650% # ( 4, 6 ] 37531 1.783% 99.433% ( 6, 10 ] 9893 0.470% 99.903% ( 10, 15 ] 1725 0.082% 99.985% ( 15, 22 ] 283 0.013% 99.998% ( 22, 34 ] 18 0.001% 99.999% ( 34, 51 ] 19 0.001% 100.000% ( 51, 76 ] 10 0.000% 100.000% ( 76, 110 ] 150 0.007% 100.008% ( 110, 170 ] 160 0.008% 100.015% ( 170, 250 ] 83 0.004% 100.019% ( 250, 380 ] 66 0.003% 100.022% ( 380, 580 ] 56 0.003% 100.025% ( 580, 870 ] 46 0.002% 100.027% ( 870, 1300 ] 18 0.001% 100.028% ( 1300, 1900 ] 8 0.000% 100.028% ( 1900, 2900 ] 12 0.001% 100.029% ( 2900, 4400 ] 4 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 271259 Average: 2.5700 StdDev: 14.20 Min: 0 Median: 1.4890 Max: 2138 Percentiles: P50: 1.49 P75: 1.86 P99: 7.77 P99.9: 146.04 P99.99: 565.11 ------------------------------------------------------ [ 0, 1 ] 46305 17.070% 17.070% ### ( 1, 2 ] 182679 67.345% 84.415% ############# ( 2, 3 ] 25478 9.392% 93.808% ## ( 3, 4 ] 7694 2.836% 96.644% # ( 4, 6 ] 4970 1.832% 98.476% ( 6, 10 ] 3211 1.184% 99.660% ( 10, 15 ] 248 0.091% 99.752% ( 15, 22 ] 55 0.020% 99.772% ( 22, 34 ] 3 0.001% 99.773% ( 51, 76 ] 16 0.006% 99.779% ( 76, 110 ] 202 0.074% 99.853% ( 110, 170 ] 211 0.078% 99.931% ( 170, 250 ] 67 0.025% 99.956% ( 250, 380 ] 54 0.020% 99.976% ( 380, 580 ] 42 0.015% 99.991% ( 580, 870 ] 9 0.003% 99.994% ( 870, 1300 ] 7 0.003% 99.997% ( 1300, 1900 ] 7 0.003% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 124185 Average: 2.3443 StdDev: 16.13 Min: 1 Median: 1.4448 Max: 2876 Percentiles: P50: 1.44 P75: 1.84 P99: 5.95 P99.9: 101.59 P99.99: 571.63 ------------------------------------------------------ [ 0, 1 ] 26976 21.722% 21.722% #### ( 1, 2 ] 78942 63.568% 85.290% ############# ( 2, 3 ] 11001 8.859% 94.149% ## ( 3, 4 ] 3702 2.981% 97.130% # ( 4, 6 ] 2383 1.919% 99.049% ( 6, 10 ] 924 0.744% 99.793% ( 10, 15 ] 96 0.077% 99.870% ( 15, 22 ] 12 0.010% 99.880% ( 22, 34 ] 3 0.002% 99.882% ( 34, 51 ] 1 0.001% 99.883% ( 51, 76 ] 2 0.002% 99.885% ( 76, 110 ] 25 0.020% 99.905% ( 110, 170 ] 77 0.062% 99.967% ( 170, 250 ] 13 0.010% 99.977% ( 250, 380 ] 6 0.005% 99.982% ( 380, 580 ] 10 0.008% 99.990% ( 580, 870 ] 5 0.004% 99.994% ( 870, 1300 ] 3 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 184839 Average: 3.4746 StdDev: 32.66 Min: 1 Median: 1.7164 Max: 4046 Percentiles: P50: 1.72 P75: 2.38 P99: 8.80 P99.9: 159.18 P99.99: 487.98 ------------------------------------------------------ [ 0, 1 ] 12027 6.507% 6.507% # ( 1, 2 ] 112212 60.708% 67.215% ############ ( 2, 3 ] 37767 20.432% 87.647% #### ( 3, 4 ] 10302 5.573% 93.221% # ( 4, 6 ] 8602 4.654% 97.874% # ( 6, 10 ] 2973 1.608% 99.483% ( 10, 15 ] 431 0.233% 99.716% ( 15, 22 ] 79 0.043% 99.759% ( 22, 34 ] 24 0.013% 99.772% ( 34, 51 ] 6 0.003% 99.775% ( 51, 76 ] 3 0.002% 99.777% ( 76, 110 ] 47 0.025% 99.802% ( 110, 170 ] 221 0.120% 99.922% ( 170, 250 ] 56 0.030% 99.952% ( 250, 380 ] 50 0.027% 99.979% ( 380, 580 ] 38 0.021% 99.999% ( 580, 870 ] 29 0.016% 100.015% ( 870, 1300 ] 14 0.008% 100.023% ( 1300, 1900 ] 13 0.007% 100.030% ( 1900, 2900 ] 10 0.005% 100.035% ( 2900, 4400 ] 5 0.003% 100.038% ** Level 4 read latency histogram (micros): Count: 310 Average: 108.0677 StdDev: 481.10 Min: 1 Median: 2.3095 Max: 4205 Percentiles: P50: 2.31 P75: 5.80 P99: 2866.67 P99.9: 4205.00 P99.99: 4205.00 ------------------------------------------------------ [ 0, 1 ] 31 10.000% 10.000% ## ( 1, 2 ] 98 31.613% 41.613% ###### ( 2, 3 ] 84 27.097% 68.710% ##### ( 3, 4 ] 15 4.839% 73.548% # ( 4, 6 ] 5 1.613% 75.161% ( 6, 10 ] 5 1.613% 76.774% ( 10, 15 ] 31 10.000% 86.774% ## ( 15, 22 ] 17 5.484% 92.258% # ( 22, 34 ] 4 1.290% 93.548% ( 380, 580 ] 3 0.968% 94.516% ( 580, 870 ] 4 1.290% 95.806% ( 870, 1300 ] 2 0.645% 96.452% ( 1300, 1900 ] 5 1.613% 98.065% ( 1900, 2900 ] 3 0.968% 99.032% ( 2900, 4400 ] 3 0.968% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 785.5250 StdDev: 886.41 Min: 84 Median: 336.6667 Max: 3566 Percentiles: P50: 336.67 P75: 1300.00 P99: 3566.00 P99.9: 3566.00 P99.99: 3566.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 12 30.000% 35.000% ###### ( 170, 250 ] 4 10.000% 45.000% ## ( 250, 380 ] 3 7.500% 52.500% ## ( 380, 580 ] 5 12.500% 65.000% ### ( 580, 870 ] 2 5.000% 70.000% # ( 870, 1300 ] 2 5.000% 75.000% # ( 1300, 1900 ] 3 7.500% 82.500% ## ( 1900, 2900 ] 6 15.000% 97.500% ### ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 22.7 total, 7.4 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 260.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.613 H:M:S, 29.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 133.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.727 H:M:S, 64.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/10-15:08:28 ... thread 0: (1000000,7000000) ops and (192541.1,253363.5) ops/second in (5.193695,27.628293) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/13 3.19 GB 56.6 5.5 0.0 5.5 12.1 6.6 0.0 1.8 140.3 306.8 40.42 37.92 117 0.345 5756K 7606 0.0 0.0 L1 19/19 2.23 GB 0.0 4.2 3.1 1.1 4.2 3.1 0.2 1.3 230.7 228.7 18.83 18.18 3 6.278 4412K 38K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.9 2.0 255.1 255.0 1.48 1.43 2 0.741 383K 225 0.0 0.0 L3 21/0 991.93 MB 1.0 1.6 0.8 0.8 1.5 0.8 0.4 1.9 215.1 214.6 7.38 6.76 4 1.845 1612K 3710 0.0 0.0 L4 171/0 9.66 GB 1.0 0.3 0.3 0.0 0.3 0.3 0.8 1.0 150.5 150.5 1.84 1.39 2 0.918 280K 116 0.0 0.0 L5 1052/0 86.62 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1279/32 102.67 GB 0.0 12.0 4.4 7.6 18.5 10.9 3.4 2.8 175.2 270.8 69.96 65.68 128 0.547 12M 49K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.0 4.4 7.6 18.5 10.9 3.3 2.8 175.2 270.8 69.96 65.68 128 0.547 12M 49K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.0 4.4 7.6 11.9 4.3 0.0 0.0 241.2 240.2 50.81 48.68 30 1.694 12M 49K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 352.0 19.15 16.99 98 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.9 total, 27.6 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.50 GB write, 680.16 MB/s write, 11.97 GB read, 440.00 MB/s read, 70.0 seconds Interval compaction: 18.50 GB write, 685.73 MB/s write, 11.97 GB read, 443.60 MB/s read, 70.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 17, interval: 33 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2508980 Average: 2.2606 StdDev: 11.44 Min: 0 Median: 1.4947 Max: 4385 Percentiles: P50: 1.49 P75: 1.87 P99: 5.61 P99.9: 11.24 P99.99: 119.21 ------------------------------------------------------ [ 0, 1 ] 418546 16.682% 16.682% ### ( 1, 2 ] 1689865 67.353% 84.035% ############# ( 2, 3 ] 251347 10.018% 94.052% ## ( 3, 4 ] 86658 3.454% 97.506% # ( 4, 6 ] 46524 1.854% 99.361% ( 6, 10 ] 13019 0.519% 99.880% ( 10, 15 ] 2072 0.083% 99.962% ( 15, 22 ] 319 0.013% 99.975% ( 22, 34 ] 19 0.001% 99.976% ( 34, 51 ] 26 0.001% 99.977% ( 51, 76 ] 11 0.000% 99.977% ( 76, 110 ] 271 0.011% 99.988% ( 110, 170 ] 346 0.014% 100.002% ( 170, 250 ] 217 0.009% 100.010% ( 250, 380 ] 150 0.006% 100.016% ( 380, 580 ] 127 0.005% 100.021% ( 580, 870 ] 89 0.004% 100.025% ( 870, 1300 ] 36 0.001% 100.026% ( 1300, 1900 ] 17 0.001% 100.027% ( 1900, 2900 ] 16 0.001% 100.028% ( 2900, 4400 ] 4 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 534720 Average: 2.7752 StdDev: 16.77 Min: 0 Median: 1.5393 Max: 3334 Percentiles: P50: 1.54 P75: 1.91 P99: 8.22 P99.9: 160.60 P99.99: 572.61 ------------------------------------------------------ [ 0, 1 ] 73324 13.713% 13.713% ### ( 1, 2 ] 359803 67.288% 81.001% ############# ( 2, 3 ] 62517 11.692% 92.692% ## ( 3, 4 ] 17917 3.351% 96.043% # ( 4, 6 ] 11719 2.192% 98.235% ( 6, 10 ] 7390 1.382% 99.617% ( 10, 15 ] 621 0.116% 99.733% ( 15, 22 ] 110 0.021% 99.753% ( 22, 34 ] 9 0.002% 99.755% ( 34, 51 ] 5 0.001% 99.756% ( 51, 76 ] 23 0.004% 99.760% ( 76, 110 ] 372 0.070% 99.830% ( 110, 170 ] 445 0.083% 99.913% ( 170, 250 ] 200 0.037% 99.950% ( 250, 380 ] 121 0.023% 99.973% ( 380, 580 ] 94 0.018% 99.991% ( 580, 870 ] 50 0.009% 100.000% ( 870, 1300 ] 24 0.004% 100.004% ( 1300, 1900 ] 14 0.003% 100.007% ( 1900, 2900 ] 1 0.000% 100.007% ( 2900, 4400 ] 1 0.000% 100.007% ** Level 2 read latency histogram (micros): Count: 124185 Average: 2.3443 StdDev: 16.13 Min: 1 Median: 1.4448 Max: 2876 Percentiles: P50: 1.44 P75: 1.84 P99: 5.95 P99.9: 101.59 P99.99: 571.63 ------------------------------------------------------ [ 0, 1 ] 26976 21.722% 21.722% #### ( 1, 2 ] 78942 63.568% 85.290% ############# ( 2, 3 ] 11001 8.859% 94.149% ## ( 3, 4 ] 3702 2.981% 97.130% # ( 4, 6 ] 2383 1.919% 99.049% ( 6, 10 ] 924 0.744% 99.793% ( 10, 15 ] 96 0.077% 99.870% ( 15, 22 ] 12 0.010% 99.880% ( 22, 34 ] 3 0.002% 99.882% ( 34, 51 ] 1 0.001% 99.883% ( 51, 76 ] 2 0.002% 99.885% ( 76, 110 ] 25 0.020% 99.905% ( 110, 170 ] 77 0.062% 99.967% ( 170, 250 ] 13 0.010% 99.977% ( 250, 380 ] 6 0.005% 99.982% ( 380, 580 ] 10 0.008% 99.990% ( 580, 870 ] 5 0.004% 99.994% ( 870, 1300 ] 3 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 203680 Average: 4.0171 StdDev: 35.55 Min: 0 Median: 1.7121 Max: 4046 Percentiles: P50: 1.71 P75: 2.37 P99: 9.32 P99.9: 316.45 P99.99: 708.16 ------------------------------------------------------ [ 0, 1 ] 13919 6.834% 6.834% # ( 1, 2 ] 123472 60.621% 67.454% ############ ( 2, 3 ] 41153 20.205% 87.659% #### ( 3, 4 ] 11267 5.532% 93.191% # ( 4, 6 ] 9198 4.516% 97.707% # ( 6, 10 ] 3177 1.560% 99.266% ( 10, 15 ] 478 0.235% 99.501% ( 15, 22 ] 89 0.044% 99.545% ( 22, 34 ] 28 0.014% 99.559% ( 34, 51 ] 7 0.003% 99.562% ( 51, 76 ] 5 0.002% 99.565% ( 76, 110 ] 133 0.065% 99.630% ( 110, 170 ] 341 0.167% 99.797% ( 170, 250 ] 149 0.073% 99.870% ( 250, 380 ] 118 0.058% 99.928% ( 380, 580 ] 100 0.049% 99.977% ( 580, 870 ] 58 0.028% 100.006% ( 870, 1300 ] 27 0.013% 100.019% ( 1300, 1900 ] 16 0.008% 100.027% ( 1900, 2900 ] 10 0.005% 100.032% ( 2900, 4400 ] 5 0.002% 100.034% ** Level 4 read latency histogram (micros): Count: 1279 Average: 37.6145 StdDev: 245.95 Min: 1 Median: 1.6014 Max: 4205 Percentiles: P50: 1.60 P75: 2.35 P99: 915.15 P99.9: 3760.50 P99.99: 4205.00 ------------------------------------------------------ [ 0, 1 ] 248 19.390% 19.390% #### ( 1, 2 ] 651 50.899% 70.289% ########## ( 2, 3 ] 171 13.370% 83.659% ### ( 3, 4 ] 34 2.658% 86.317% # ( 4, 6 ] 13 1.016% 87.334% ( 6, 10 ] 22 1.720% 89.054% ( 10, 15 ] 32 2.502% 91.556% # ( 15, 22 ] 18 1.407% 92.963% ( 22, 34 ] 4 0.313% 93.276% ( 76, 110 ] 19 1.486% 94.762% ( 110, 170 ] 28 2.189% 96.951% ( 170, 250 ] 8 0.625% 97.576% ( 250, 380 ] 5 0.391% 97.967% ( 380, 580 ] 5 0.391% 98.358% ( 580, 870 ] 8 0.625% 98.984% ( 870, 1300 ] 2 0.156% 99.140% ( 1300, 1900 ] 5 0.391% 99.531% ( 1900, 2900 ] 3 0.235% 99.765% ( 2900, 4400 ] 3 0.235% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 766.0000 StdDev: 899.79 Min: 84 Median: 328.0000 Max: 3566 Percentiles: P50: 328.00 P75: 1085.00 P99: 3500.00 P99.9: 3566.00 P99.99: 3566.00 ------------------------------------------------------ ( 76, 110 ] 5 8.333% 8.333% ## ( 110, 170 ] 16 26.667% 35.000% ##### ( 170, 250 ] 6 10.000% 45.000% ## ( 250, 380 ] 5 8.333% 53.333% ## ( 380, 580 ] 7 11.667% 65.000% ## ( 580, 870 ] 5 8.333% 73.333% ## ( 870, 1300 ] 2 3.333% 76.667% # ( 1300, 1900 ] 4 6.667% 83.333% # ( 1900, 2900 ] 9 15.000% 98.333% ### ( 2900, 4400 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 27.9 total, 5.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 247.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.174 H:M:S, 32.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 189.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.561 H:M:S, 49.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/10-15:08:51 ... thread 0: (1000000,8000000) ops and (42517.0,156407.9) ops/second in (23.520029,51.148322) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/6 1.77 GB 0.0 7.7 0.0 7.7 15.3 7.5 0.0 2.0 149.9 295.9 52.95 48.86 134 0.395 8057K 17K 0.0 0.0 L1 10/10 1.09 GB 0.0 8.9 5.5 3.3 8.7 5.4 0.2 1.6 226.3 223.3 40.13 37.74 4 10.032 8927K 38K 0.0 0.0 L2 12/11 1.51 GB 1.3 0.4 0.2 0.2 0.4 0.2 4.4 2.0 255.1 255.0 1.48 1.43 2 0.741 383K 225 0.0 0.0 L3 22/5 1.38 GB 1.0 4.4 2.7 1.6 4.4 2.7 0.4 1.6 187.7 186.8 23.96 20.06 11 2.178 4568K 23K 0.0 0.0 L4 173/6 9.82 GB 1.0 1.9 1.8 0.1 1.8 1.8 0.8 1.0 121.4 121.1 15.61 9.11 20 0.781 1896K 2484 0.0 0.0 L5 1068/0 87.97 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1291/38 103.54 GB 0.0 23.2 10.2 13.0 30.6 17.6 8.2 4.0 177.3 233.9 134.13 117.20 171 0.784 23M 81K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.2 10.2 13.0 30.6 17.6 8.1 4.0 177.3 233.9 134.13 117.20 171 0.784 23M 81K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.2 10.2 13.0 23.1 10.1 0.0 0.0 213.8 212.3 111.28 97.62 60 1.855 23M 81K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 339.0 22.85 19.58 111 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 51.4 total, 51.1 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.63 GB write, 610.59 MB/s write, 23.23 GB read, 462.99 MB/s read, 134.1 seconds Interval compaction: 30.63 GB write, 613.29 MB/s write, 23.23 GB read, 465.04 MB/s read, 134.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 30, pending-compaction-bytes-delays: 27, pending-compaction-bytes-stops: 0, total-delays: 40, total-stops: 30, interval: 70 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3796825 Average: 2.7951 StdDev: 25.48 Min: 0 Median: 1.5078 Max: 8553 Percentiles: P50: 1.51 P75: 1.89 P99: 6.79 P99.9: 139.53 P99.99: 385.13 ------------------------------------------------------ [ 0, 1 ] 643740 16.955% 16.955% ### ( 1, 2 ] 2470705 65.073% 82.028% ############# ( 2, 3 ] 402174 10.592% 92.620% ## ( 3, 4 ] 140324 3.696% 96.316% # ( 4, 6 ] 96310 2.537% 98.852% # ( 6, 10 ] 28468 0.750% 99.602% ( 10, 15 ] 4313 0.114% 99.716% ( 15, 22 ] 847 0.022% 99.738% ( 22, 34 ] 45 0.001% 99.739% ( 34, 51 ] 30 0.001% 99.740% ( 51, 76 ] 296 0.008% 99.748% ( 76, 110 ] 4104 0.108% 99.856% ( 110, 170 ] 3398 0.089% 99.945% ( 170, 250 ] 983 0.026% 99.971% ( 250, 380 ] 693 0.018% 99.990% ( 380, 580 ] 597 0.016% 100.005% ( 580, 870 ] 331 0.009% 100.014% ( 870, 1300 ] 112 0.003% 100.017% ( 1300, 1900 ] 60 0.002% 100.019% ( 1900, 2900 ] 72 0.002% 100.020% ( 2900, 4400 ] 59 0.002% 100.022% ( 4400, 6600 ] 12 0.000% 100.022% ( 6600, 9900 ] 4 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1881138 Average: 3.9327 StdDev: 49.40 Min: 0 Median: 1.6491 Max: 11867 Percentiles: P50: 1.65 P75: 2.28 P99: 8.91 P99.9: 149.81 P99.99: 351.43 ------------------------------------------------------ [ 0, 1 ] 222546 11.830% 11.830% ## ( 1, 2 ] 1106221 58.806% 70.636% ############ ( 2, 3 ] 288159 15.318% 85.955% ### ( 3, 4 ] 120190 6.389% 92.344% # ( 4, 6 ] 101068 5.373% 97.717% # ( 6, 10 ] 33149 1.762% 99.479% ( 10, 15 ] 4257 0.226% 99.705% ( 15, 22 ] 718 0.038% 99.743% ( 22, 34 ] 38 0.002% 99.745% ( 34, 51 ] 20 0.001% 99.746% ( 51, 76 ] 242 0.013% 99.759% ( 76, 110 ] 1520 0.081% 99.840% ( 110, 170 ] 1703 0.091% 99.931% ( 170, 250 ] 633 0.034% 99.964% ( 250, 380 ] 624 0.033% 99.997% ( 380, 580 ] 594 0.032% 100.029% ( 580, 870 ] 518 0.028% 100.056% ( 870, 1300 ] 273 0.015% 100.071% ( 1300, 1900 ] 163 0.009% 100.080% ( 1900, 2900 ] 128 0.007% 100.086% ( 2900, 4400 ] 104 0.006% 100.092% ( 4400, 6600 ] 23 0.001% 100.093% ( 6600, 9900 ] 11 0.001% 100.094% ( 9900, 14000 ] 1 0.000% 100.094% ** Level 2 read latency histogram (micros): Count: 124185 Average: 2.3443 StdDev: 16.13 Min: 1 Median: 1.4448 Max: 2876 Percentiles: P50: 1.44 P75: 1.84 P99: 5.95 P99.9: 101.59 P99.99: 571.63 ------------------------------------------------------ [ 0, 1 ] 26976 21.722% 21.722% #### ( 1, 2 ] 78942 63.568% 85.290% ############# ( 2, 3 ] 11001 8.859% 94.149% ## ( 3, 4 ] 3702 2.981% 97.130% # ( 4, 6 ] 2383 1.919% 99.049% ( 6, 10 ] 924 0.744% 99.793% ( 10, 15 ] 96 0.077% 99.870% ( 15, 22 ] 12 0.010% 99.880% ( 22, 34 ] 3 0.002% 99.882% ( 34, 51 ] 1 0.001% 99.883% ( 51, 76 ] 2 0.002% 99.885% ( 76, 110 ] 25 0.020% 99.905% ( 110, 170 ] 77 0.062% 99.967% ( 170, 250 ] 13 0.010% 99.977% ( 250, 380 ] 6 0.005% 99.982% ( 380, 580 ] 10 0.008% 99.990% ( 580, 870 ] 5 0.004% 99.994% ( 870, 1300 ] 3 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 879138 Average: 7.2550 StdDev: 105.24 Min: 0 Median: 1.9455 Max: 22979 Percentiles: P50: 1.95 P75: 2.93 P99: 9.72 P99.9: 491.14 P99.99: 811.03 ------------------------------------------------------ [ 0, 1 ] 21146 2.405% 2.405% ( 1, 2 ] 442551 50.339% 52.745% ########## ( 2, 3 ] 210491 23.943% 76.687% ##### ( 3, 4 ] 90100 10.249% 86.936% ## ( 4, 6 ] 85911 9.772% 96.708% ## ( 6, 10 ] 21668 2.465% 99.173% ( 10, 15 ] 3752 0.427% 99.600% ( 15, 22 ] 557 0.063% 99.663% ( 22, 34 ] 66 0.008% 99.671% ( 34, 51 ] 21 0.002% 99.673% ( 51, 76 ] 19 0.002% 99.675% ( 76, 110 ] 180 0.020% 99.696% ( 110, 170 ] 519 0.059% 99.755% ( 170, 250 ] 380 0.043% 99.798% ( 250, 380 ] 538 0.061% 99.859% ( 380, 580 ] 653 0.074% 99.933% ( 580, 870 ] 629 0.072% 100.005% ( 870, 1300 ] 391 0.044% 100.049% ( 1300, 1900 ] 232 0.026% 100.076% ( 1900, 2900 ] 227 0.026% 100.102% ( 2900, 4400 ] 249 0.028% 100.130% ( 4400, 6600 ] 61 0.007% 100.137% ( 6600, 9900 ] 20 0.002% 100.139% ( 9900, 14000 ] 2 0.000% 100.139% ( 14000, 22000 ] 1 0.000% 100.139% ( 22000, 33000 ] 1 0.000% 100.140% ** Level 4 read latency histogram (micros): Count: 21065 Average: 69.0450 StdDev: 358.70 Min: 1 Median: 2.0026 Max: 7861 Percentiles: P50: 2.00 P75: 3.22 P99: 1689.47 P99.9: 4379.25 P99.99: 6586.98 ------------------------------------------------------ [ 0, 1 ] 661 3.138% 3.138% # ( 1, 2 ] 9859 46.803% 49.941% ######### ( 2, 3 ] 4770 22.644% 72.585% ##### ( 3, 4 ] 2333 11.075% 83.660% ## ( 4, 6 ] 1394 6.618% 90.278% # ( 6, 10 ] 474 2.250% 92.528% ( 10, 15 ] 113 0.536% 93.064% ( 15, 22 ] 23 0.109% 93.174% ( 22, 34 ] 9 0.043% 93.216% ( 76, 110 ] 41 0.195% 93.411% ( 110, 170 ] 72 0.342% 93.753% ( 170, 250 ] 109 0.517% 94.270% ( 250, 380 ] 148 0.703% 94.973% ( 380, 580 ] 235 1.116% 96.088% ( 580, 870 ] 315 1.495% 97.584% ( 870, 1300 ] 225 1.068% 98.652% ( 1300, 1900 ] 113 0.536% 99.188% ( 1900, 2900 ] 74 0.351% 99.540% ( 2900, 4400 ] 77 0.366% 99.905% ( 4400, 6600 ] 18 0.085% 99.991% ( 6600, 9900 ] 3 0.014% 100.005% ** Level 5 read latency histogram (micros): Count: 149 Average: 1158.3960 StdDev: 1217.53 Min: 84 Median: 628.3333 Max: 5875 Percentiles: P50: 628.33 P75: 1803.57 P99: 5507.33 P99.9: 5875.00 P99.99: 5875.00 ------------------------------------------------------ ( 76, 110 ] 7 4.698% 4.698% # ( 110, 170 ] 17 11.409% 16.107% ## ( 170, 250 ] 13 8.725% 24.832% ## ( 250, 380 ] 13 8.725% 33.557% ## ( 380, 580 ] 22 14.765% 48.322% ### ( 580, 870 ] 15 10.067% 58.389% ## ( 870, 1300 ] 13 8.725% 67.114% ## ( 1300, 1900 ] 14 9.396% 76.510% ## ( 1900, 2900 ] 18 12.081% 88.591% ## ( 2900, 4400 ] 14 9.396% 97.987% ## ( 4400, 6600 ] 3 2.013% 100.000% ** DB Stats ** Uptime(secs): 51.4 total, 23.5 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 153.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.619 H:M:S, 57.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 41.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:20.445 H:M:S, 86.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/08/10-15:08:56 ... thread 0: (1000000,9000000) ops and (228090.0,162067.1) ops/second in (4.384235,55.532557) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 2.70 GB 69.2 8.4 0.0 8.4 16.8 8.5 0.0 2.0 142.5 286.9 60.09 53.77 149 0.403 8697K 17K 0.0 0.0 L1 10/10 1.09 GB 0.0 8.9 5.5 3.3 8.7 5.4 0.2 1.6 226.3 223.3 40.13 37.74 4 10.032 8927K 38K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 4.4 2.0 255.1 255.0 1.48 1.43 2 0.741 383K 225 0.0 0.0 L3 17/1 1.05 GB 1.0 6.3 4.3 2.0 6.2 4.2 0.4 1.5 182.5 181.7 35.21 28.81 14 2.515 6005K 24K 0.0 0.0 L4 172/1 9.68 GB 1.0 3.8 3.6 0.2 3.8 3.6 0.9 1.0 122.4 122.1 31.51 18.37 42 0.750 3825K 3834 0.0 0.0 L5 1092/0 89.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1304/22 104.45 GB 0.0 27.6 13.6 14.1 36.0 21.9 10.2 4.2 168.1 218.6 168.42 140.11 211 0.798 27M 84K 0.0 0.0 Int 0/0 0.00 KB 0.0 27.6 13.6 14.1 36.0 21.9 10.1 4.2 168.1 218.6 168.42 140.11 211 0.798 27M 84K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 27.6 13.6 14.1 27.5 13.4 0.0 0.0 199.9 198.6 141.61 118.10 87 1.628 27M 84K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 324.3 26.81 22.01 124 0.216 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 55.8 total, 55.5 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.96 GB write, 660.37 MB/s write, 27.64 GB read, 507.63 MB/s read, 168.4 seconds Interval compaction: 35.96 GB write, 663.06 MB/s write, 27.64 GB read, 509.70 MB/s read, 168.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 43, pending-compaction-bytes-delays: 27, pending-compaction-bytes-stops: 0, total-delays: 40, total-stops: 43, interval: 83 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4125718 Average: 2.8384 StdDev: 26.24 Min: 0 Median: 1.5269 Max: 10023 Percentiles: P50: 1.53 P75: 1.91 P99: 6.99 P99.9: 136.98 P99.99: 395.77 ------------------------------------------------------ [ 0, 1 ] 660684 16.014% 16.014% ### ( 1, 2 ] 2660971 64.497% 80.511% ############# ( 2, 3 ] 466541 11.308% 91.819% ## ( 3, 4 ] 167214 4.053% 95.872% # ( 4, 6 ] 120830 2.929% 98.801% # ( 6, 10 ] 33224 0.805% 99.606% ( 10, 15 ] 5150 0.125% 99.731% ( 15, 22 ] 934 0.023% 99.753% ( 22, 34 ] 47 0.001% 99.755% ( 34, 51 ] 32 0.001% 99.755% ( 51, 76 ] 302 0.007% 99.763% ( 76, 110 ] 4124 0.100% 99.863% ( 110, 170 ] 3426 0.083% 99.946% ( 170, 250 ] 1023 0.025% 99.971% ( 250, 380 ] 752 0.018% 99.989% ( 380, 580 ] 665 0.016% 100.005% ( 580, 870 ] 381 0.009% 100.014% ( 870, 1300 ] 153 0.004% 100.018% ( 1300, 1900 ] 73 0.002% 100.020% ( 1900, 2900 ] 82 0.002% 100.022% ( 2900, 4400 ] 66 0.002% 100.023% ( 4400, 6600 ] 12 0.000% 100.023% ( 6600, 9900 ] 4 0.000% 100.024% ( 9900, 14000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 2139101 Average: 4.0399 StdDev: 51.22 Min: 0 Median: 1.6702 Max: 11867 Percentiles: P50: 1.67 P75: 2.35 P99: 8.97 P99.9: 156.98 P99.99: 423.13 ------------------------------------------------------ [ 0, 1 ] 228816 10.697% 10.697% ## ( 1, 2 ] 1254507 58.646% 69.343% ############ ( 2, 3 ] 345077 16.132% 85.475% ### ( 3, 4 ] 140721 6.579% 92.054% # ( 4, 6 ] 119423 5.583% 97.637% # ( 6, 10 ] 39250 1.835% 99.471% ( 10, 15 ] 5103 0.239% 99.710% ( 15, 22 ] 812 0.038% 99.748% ( 22, 34 ] 51 0.002% 99.750% ( 34, 51 ] 24 0.001% 99.751% ( 51, 76 ] 243 0.011% 99.763% ( 76, 110 ] 1552 0.073% 99.835% ( 110, 170 ] 1766 0.083% 99.918% ( 170, 250 ] 686 0.032% 99.950% ( 250, 380 ] 709 0.033% 99.983% ( 380, 580 ] 682 0.032% 100.015% ( 580, 870 ] 617 0.029% 100.044% ( 870, 1300 ] 337 0.016% 100.060% ( 1300, 1900 ] 191 0.009% 100.069% ( 1900, 2900 ] 186 0.009% 100.077% ( 2900, 4400 ] 132 0.006% 100.083% ( 4400, 6600 ] 27 0.001% 100.085% ( 6600, 9900 ] 12 0.001% 100.085% ( 9900, 14000 ] 1 0.000% 100.085% ** Level 2 read latency histogram (micros): Count: 124185 Average: 2.3443 StdDev: 16.13 Min: 1 Median: 1.4448 Max: 2876 Percentiles: P50: 1.44 P75: 1.84 P99: 5.95 P99.9: 101.59 P99.99: 571.63 ------------------------------------------------------ [ 0, 1 ] 26976 21.722% 21.722% #### ( 1, 2 ] 78942 63.568% 85.290% ############# ( 2, 3 ] 11001 8.859% 94.149% ## ( 3, 4 ] 3702 2.981% 97.130% # ( 4, 6 ] 2383 1.919% 99.049% ( 6, 10 ] 924 0.744% 99.793% ( 10, 15 ] 96 0.077% 99.870% ( 15, 22 ] 12 0.010% 99.880% ( 22, 34 ] 3 0.002% 99.882% ( 34, 51 ] 1 0.001% 99.883% ( 51, 76 ] 2 0.002% 99.885% ( 76, 110 ] 25 0.020% 99.905% ( 110, 170 ] 77 0.062% 99.967% ( 170, 250 ] 13 0.010% 99.977% ( 250, 380 ] 6 0.005% 99.982% ( 380, 580 ] 10 0.008% 99.990% ( 580, 870 ] 5 0.004% 99.994% ( 870, 1300 ] 3 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1370874 Average: 7.4331 StdDev: 106.61 Min: 0 Median: 1.9875 Max: 22979 Percentiles: P50: 1.99 P75: 2.97 P99: 9.68 P99.9: 408.07 P99.99: 679.92 ------------------------------------------------------ [ 0, 1 ] 24365 1.777% 1.777% ( 1, 2 ] 669454 48.834% 50.611% ########## ( 2, 3 ] 344299 25.115% 75.727% ##### ( 3, 4 ] 146129 10.660% 86.386% ## ( 4, 6 ] 141505 10.322% 96.709% ## ( 6, 10 ] 34144 2.491% 99.199% ( 10, 15 ] 6369 0.465% 99.664% ( 15, 22 ] 852 0.062% 99.726% ( 22, 34 ] 81 0.006% 99.732% ( 34, 51 ] 27 0.002% 99.734% ( 51, 76 ] 24 0.002% 99.736% ( 76, 110 ] 202 0.015% 99.750% ( 110, 170 ] 614 0.045% 99.795% ( 170, 250 ] 530 0.039% 99.834% ( 250, 380 ] 763 0.056% 99.889% ( 380, 580 ] 1034 0.075% 99.965% ( 580, 870 ] 1001 0.073% 100.038% ( 870, 1300 ] 608 0.044% 100.082% ( 1300, 1900 ] 367 0.027% 100.109% ( 1900, 2900 ] 380 0.028% 100.137% ( 2900, 4400 ] 430 0.031% 100.168% ( 4400, 6600 ] 109 0.008% 100.176% ( 6600, 9900 ] 30 0.002% 100.178% ( 9900, 14000 ] 3 0.000% 100.178% ( 14000, 22000 ] 1 0.000% 100.178% ( 22000, 33000 ] 1 0.000% 100.179% ** Level 4 read latency histogram (micros): Count: 42144 Average: 62.1294 StdDev: 322.45 Min: 0 Median: 2.0500 Max: 7861 Percentiles: P50: 2.05 P75: 3.26 P99: 1482.96 P99.9: 4207.49 P99.99: 6488.68 ------------------------------------------------------ [ 0, 1 ] 1043 2.475% 2.475% ( 1, 2 ] 19539 46.362% 48.837% ######### ( 2, 3 ] 9795 23.242% 72.079% ##### ( 3, 4 ] 4771 11.321% 83.400% ## ( 4, 6 ] 2936 6.967% 90.366% # ( 6, 10 ] 959 2.276% 92.642% ( 10, 15 ] 204 0.484% 93.126% ( 15, 22 ] 31 0.074% 93.200% ( 22, 34 ] 17 0.040% 93.240% ( 76, 110 ] 93 0.221% 93.461% ( 110, 170 ] 173 0.410% 93.871% ( 170, 250 ] 248 0.588% 94.459% ( 250, 380 ] 313 0.743% 95.202% ( 380, 580 ] 518 1.229% 96.431% ( 580, 870 ] 605 1.436% 97.867% ( 870, 1300 ] 412 0.978% 98.844% ( 1300, 1900 ] 215 0.510% 99.355% ( 1900, 2900 ] 127 0.301% 99.656% ( 2900, 4400 ] 118 0.280% 99.936% ( 4400, 6600 ] 24 0.057% 99.993% ( 6600, 9900 ] 4 0.009% 100.002% ** Level 5 read latency histogram (micros): Count: 260 Average: 1224.8731 StdDev: 1264.66 Min: 84 Median: 684.4000 Max: 5875 Percentiles: P50: 684.40 P75: 1852.00 P99: 5782.86 P99.9: 5875.00 P99.99: 5875.00 ------------------------------------------------------ ( 76, 110 ] 8 3.077% 3.077% # ( 110, 170 ] 26 10.000% 13.077% ## ( 170, 250 ] 23 8.846% 21.923% ## ( 250, 380 ] 28 10.769% 32.692% ## ( 380, 580 ] 36 13.846% 46.538% ### ( 580, 870 ] 25 9.615% 56.154% ## ( 870, 1300 ] 26 10.000% 66.154% ## ( 1300, 1900 ] 25 9.615% 75.769% ## ( 1900, 2900 ] 28 10.769% 86.538% ## ( 2900, 4400 ] 28 10.769% 97.308% ## ( 4400, 6600 ] 7 2.692% 100.000% # ** DB Stats ** Uptime(secs): 55.8 total, 4.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 158.85 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:31.212 H:M:S, 56.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 224.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.593 H:M:S, 36.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/08/10-15:08:59 ... thread 0: (1000000,10000000) ops and (323281.2,170573.3) ops/second in (3.093282,58.625839) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.21 GB 201.4 9.5 0.0 9.5 18.9 9.5 0.0 2.0 144.0 287.7 67.36 60.58 167 0.403 9848K 19K 0.0 0.0 L1 17/0 1.72 GB 175.9 11.4 7.0 4.4 11.3 6.9 0.2 1.6 217.0 214.4 53.91 49.23 5 10.781 10M 38K 0.0 0.0 L2 6/5 437.68 MB 0.7 0.4 0.2 0.2 0.4 0.2 5.2 2.0 255.1 255.0 1.48 1.43 2 0.741 383K 225 0.0 0.0 L3 22/6 1.36 GB 0.9 6.3 4.3 2.0 6.2 4.2 0.8 1.5 182.5 181.7 35.21 28.81 14 2.515 6005K 24K 0.0 0.0 L4 169/1 9.46 GB 1.0 3.9 3.7 0.2 3.8 3.7 0.9 1.0 123.2 122.9 32.00 18.79 43 0.744 3911K 3834 0.0 0.0 L5 1096/0 90.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1323/16 105.42 GB 0.0 31.4 15.1 16.3 40.7 24.4 11.7 4.3 169.2 219.2 189.97 158.83 231 0.822 30M 85K 0.0 0.0 Int 0/0 0.00 KB 0.0 31.4 15.1 16.3 40.7 24.4 11.6 4.3 169.2 219.2 189.97 158.83 231 0.822 30M 85K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 31.4 15.1 16.3 31.2 14.9 0.0 0.0 200.5 199.3 160.30 134.30 93 1.724 30M 85K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 327.0 29.67 24.53 138 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 58.9 total, 58.6 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 40.67 GB write, 707.68 MB/s write, 31.39 GB read, 546.18 MB/s read, 190.0 seconds Interval compaction: 40.67 GB write, 710.41 MB/s write, 31.39 GB read, 548.29 MB/s read, 190.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 48, pending-compaction-bytes-delays: 27, pending-compaction-bytes-stops: 0, total-delays: 40, total-stops: 48, interval: 88 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4371262 Average: 2.8096 StdDev: 25.79 Min: 0 Median: 1.5263 Max: 10023 Percentiles: P50: 1.53 P75: 1.91 P99: 6.84 P99.9: 133.45 P99.99: 386.77 ------------------------------------------------------ [ 0, 1 ] 697160 15.949% 15.949% ### ( 1, 2 ] 2828084 64.697% 80.646% ############# ( 2, 3 ] 493438 11.288% 91.934% ## ( 3, 4 ] 176279 4.033% 95.967% # ( 4, 6 ] 125329 2.867% 98.834% # ( 6, 10 ] 34415 0.787% 99.621% ( 10, 15 ] 5353 0.122% 99.744% ( 15, 22 ] 949 0.022% 99.765% ( 22, 34 ] 48 0.001% 99.766% ( 34, 51 ] 37 0.001% 99.767% ( 51, 76 ] 305 0.007% 99.774% ( 76, 110 ] 4144 0.095% 99.869% ( 110, 170 ] 3454 0.079% 99.948% ( 170, 250 ] 1045 0.024% 99.972% ( 250, 380 ] 762 0.017% 99.989% ( 380, 580 ] 676 0.015% 100.005% ( 580, 870 ] 389 0.009% 100.014% ( 870, 1300 ] 161 0.004% 100.018% ( 1300, 1900 ] 73 0.002% 100.019% ( 1900, 2900 ] 83 0.002% 100.021% ( 2900, 4400 ] 70 0.002% 100.023% ( 4400, 6600 ] 12 0.000% 100.023% ( 6600, 9900 ] 4 0.000% 100.023% ( 9900, 14000 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 2275168 Average: 4.0155 StdDev: 50.20 Min: 0 Median: 1.6620 Max: 11867 Percentiles: P50: 1.66 P75: 2.31 P99: 8.96 P99.9: 163.93 P99.99: 455.33 ------------------------------------------------------ [ 0, 1 ] 245902 10.808% 10.808% ## ( 1, 2 ] 1347024 59.205% 70.014% ############ ( 2, 3 ] 361399 15.884% 85.898% ### ( 3, 4 ] 145197 6.382% 92.280% # ( 4, 6 ] 122214 5.372% 97.652% # ( 6, 10 ] 41397 1.820% 99.471% ( 10, 15 ] 5190 0.228% 99.699% ( 15, 22 ] 829 0.036% 99.736% ( 22, 34 ] 51 0.002% 99.738% ( 34, 51 ] 24 0.001% 99.739% ( 51, 76 ] 262 0.012% 99.750% ( 76, 110 ] 1660 0.073% 99.823% ( 110, 170 ] 1940 0.085% 99.909% ( 170, 250 ] 772 0.034% 99.943% ( 250, 380 ] 794 0.035% 99.977% ( 380, 580 ] 758 0.033% 100.011% ( 580, 870 ] 671 0.029% 100.040% ( 870, 1300 ] 356 0.016% 100.056% ( 1300, 1900 ] 198 0.009% 100.065% ( 1900, 2900 ] 188 0.008% 100.073% ( 2900, 4400 ] 133 0.006% 100.079% ( 4400, 6600 ] 27 0.001% 100.080% ( 6600, 9900 ] 12 0.001% 100.080% ( 9900, 14000 ] 1 0.000% 100.080% ** Level 2 read latency histogram (micros): Count: 124185 Average: 2.3443 StdDev: 16.13 Min: 1 Median: 1.4448 Max: 2876 Percentiles: P50: 1.44 P75: 1.84 P99: 5.95 P99.9: 101.59 P99.99: 571.63 ------------------------------------------------------ [ 0, 1 ] 26976 21.722% 21.722% #### ( 1, 2 ] 78942 63.568% 85.290% ############# ( 2, 3 ] 11001 8.859% 94.149% ## ( 3, 4 ] 3702 2.981% 97.130% # ( 4, 6 ] 2383 1.919% 99.049% ( 6, 10 ] 924 0.744% 99.793% ( 10, 15 ] 96 0.077% 99.870% ( 15, 22 ] 12 0.010% 99.880% ( 22, 34 ] 3 0.002% 99.882% ( 34, 51 ] 1 0.001% 99.883% ( 51, 76 ] 2 0.002% 99.885% ( 76, 110 ] 25 0.020% 99.905% ( 110, 170 ] 77 0.062% 99.967% ( 170, 250 ] 13 0.010% 99.977% ( 250, 380 ] 6 0.005% 99.982% ( 380, 580 ] 10 0.008% 99.990% ( 580, 870 ] 5 0.004% 99.994% ( 870, 1300 ] 3 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 3 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1372054 Average: 7.4809 StdDev: 106.85 Min: 0 Median: 1.9875 Max: 22979 Percentiles: P50: 1.99 P75: 2.97 P99: 9.70 P99.9: 418.68 P99.99: 687.16 ------------------------------------------------------ [ 0, 1 ] 24370 1.776% 1.776% ( 1, 2 ] 670062 48.836% 50.613% ########## ( 2, 3 ] 344529 25.110% 75.723% ##### ( 3, 4 ] 146210 10.656% 86.379% ## ( 4, 6 ] 141592 10.320% 96.699% ## ( 6, 10 ] 34169 2.490% 99.189% ( 10, 15 ] 6373 0.464% 99.654% ( 15, 22 ] 853 0.062% 99.716% ( 22, 34 ] 81 0.006% 99.722% ( 34, 51 ] 27 0.002% 99.724% ( 51, 76 ] 24 0.002% 99.726% ( 76, 110 ] 207 0.015% 99.741% ( 110, 170 ] 635 0.046% 99.787% ( 170, 250 ] 548 0.040% 99.827% ( 250, 380 ] 797 0.058% 99.885% ( 380, 580 ] 1065 0.078% 99.963% ( 580, 870 ] 1017 0.074% 100.037% ( 870, 1300 ] 615 0.045% 100.082% ( 1300, 1900 ] 370 0.027% 100.109% ( 1900, 2900 ] 381 0.028% 100.136% ( 2900, 4400 ] 434 0.032% 100.168% ( 4400, 6600 ] 109 0.008% 100.176% ( 6600, 9900 ] 30 0.002% 100.178% ( 9900, 14000 ] 3 0.000% 100.178% ( 14000, 22000 ] 1 0.000% 100.178% ( 22000, 33000 ] 1 0.000% 100.178% ** Level 4 read latency histogram (micros): Count: 42151 Average: 62.1444 StdDev: 322.44 Min: 0 Median: 2.0501 Max: 7861 Percentiles: P50: 2.05 P75: 3.26 P99: 1482.76 P99.9: 4207.40 P99.99: 6488.62 ------------------------------------------------------ [ 0, 1 ] 1044 2.477% 2.477% ( 1, 2 ] 19541 46.360% 48.836% ######### ( 2, 3 ] 9795 23.238% 72.074% ##### ( 3, 4 ] 4771 11.319% 83.393% ## ( 4, 6 ] 2936 6.965% 90.358% # ( 6, 10 ] 959 2.275% 92.634% ( 10, 15 ] 204 0.484% 93.118% ( 15, 22 ] 31 0.074% 93.191% ( 22, 34 ] 17 0.040% 93.231% ( 76, 110 ] 94 0.223% 93.454% ( 110, 170 ] 174 0.413% 93.867% ( 170, 250 ] 249 0.591% 94.458% ( 250, 380 ] 313 0.743% 95.201% ( 380, 580 ] 519 1.231% 96.432% ( 580, 870 ] 605 1.435% 97.867% ( 870, 1300 ] 412 0.977% 98.845% ( 1300, 1900 ] 215 0.510% 99.355% ( 1900, 2900 ] 127 0.301% 99.656% ( 2900, 4400 ] 118 0.280% 99.936% ( 4400, 6600 ] 24 0.057% 99.993% ( 6600, 9900 ] 4 0.009% 100.002% ** Level 5 read latency histogram (micros): Count: 280 Average: 1190.5893 StdDev: 1248.08 Min: 78 Median: 646.9231 Max: 5875 Percentiles: P50: 646.92 P75: 1830.77 P99: 5720.00 P99.9: 5875.00 P99.99: 5875.00 ------------------------------------------------------ ( 76, 110 ] 10 3.571% 3.571% # ( 110, 170 ] 33 11.786% 15.357% ## ( 170, 250 ] 26 9.286% 24.643% ## ( 250, 380 ] 28 10.000% 34.643% ## ( 380, 580 ] 37 13.214% 47.857% ### ( 580, 870 ] 26 9.286% 57.143% ## ( 870, 1300 ] 27 9.643% 66.786% ## ( 1300, 1900 ] 26 9.286% 76.071% ## ( 1900, 2900 ] 32 11.429% 87.500% ## ( 2900, 4400 ] 28 10.000% 97.500% ## ( 4400, 6600 ] 7 2.500% 100.000% # ** DB Stats ** Uptime(secs): 58.9 total, 3.1 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 167.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:31.644 H:M:S, 53.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 318.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.432 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.859 micros/op 170678 ops/sec 60.002 seconds 10240999 operations; 165.4 MB/s Microseconds per write: Count: 10240999 Average: 5.8590 StdDev: 454.36 Min: 1 Median: 1.7477 Max: 709809 Percentiles: P50: 1.75 P75: 2.74 P99: 7.09 P99.9: 1164.55 P99.99: 2749.19 ------------------------------------------------------ [ 0, 1 ] 1262926 12.332% 12.332% ## ( 1, 2 ] 5159336 50.379% 62.711% ########## ( 2, 3 ] 1696641 16.567% 79.278% ### ( 3, 4 ] 1444842 14.108% 93.387% ### ( 4, 6 ] 556550 5.435% 98.821% # ( 6, 10 ] 67357 0.658% 99.479% ( 10, 15 ] 15747 0.154% 99.633% ( 15, 22 ] 6197 0.061% 99.693% ( 22, 34 ] 1447 0.014% 99.707% ( 34, 51 ] 200 0.002% 99.709% ( 51, 76 ] 45 0.000% 99.710% ( 76, 110 ] 7071 0.069% 99.779% ( 110, 170 ] 2991 0.029% 99.808% ( 170, 250 ] 263 0.003% 99.811% ( 250, 380 ] 48 0.000% 99.811% ( 380, 580 ] 21 0.000% 99.811% ( 580, 870 ] 25 0.000% 99.812% ( 870, 1300 ] 13213 0.129% 99.941% ( 1300, 1900 ] 54 0.001% 99.941% ( 1900, 2900 ] 5889 0.058% 99.999% ( 2900, 4400 ] 87 0.001% 100.000% ( 4400, 6600 ] 19 0.000% 100.000% ( 6600, 9900 ] 3 0.000% 100.000% ( 14000, 22000 ] 4 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 12 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 2 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 203929 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10240999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10568710968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 602 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32325189 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 35348037683 rocksdb.compact.write.bytes COUNT : 35129394776 rocksdb.flush.write.bytes COUNT : 10436935334 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 64 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 349 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10352839680 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4084736 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 35453438102 rocksdb.non.last.level.read.count COUNT : 8564017 rocksdb.block.checksum.compute.count COUNT : 8562877 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.395429 P95 : 3.833101 P99 : 5.907422 P100 : 709804.000000 COUNT : 10240999 SUM : 55294912 rocksdb.compaction.times.micros P50 : 985263.157895 P95 : 5766666.666667 P99 : 14000000.000000 P100 : 21293305.000000 COUNT : 100 SUM : 166723849 rocksdb.compaction.times.cpu_micros P50 : 870303.030303 P95 : 5033333.333333 P99 : 14000000.000000 P100 : 19563919.000000 COUNT : 100 SUM : 139160521 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 710.316456 P95 : 4325.000000 P99 : 217200.000000 P100 : 291503.000000 COUNT : 141 SUM : 834995 rocksdb.compaction.outfile.sync.micros P50 : 1115.053763 P95 : 98264.705882 P99 : 160300.000000 P100 : 495091.000000 COUNT : 394 SUM : 6918243 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 106.076923 P95 : 1416.250000 P99 : 2762.000000 P100 : 4623.000000 COUNT : 269 SUM : 78122 rocksdb.table.open.io.micros P50 : 1425.000000 P95 : 7321.111111 P99 : 10861.000000 P100 : 10861.000000 COUNT : 602 SUM : 1231939 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.691594 P95 : 7.951543 P99 : 11.938391 P100 : 22984.000000 COUNT : 8561196 SUM : 55230442 rocksdb.read.block.get.micros P50 : 496.770186 P95 : 3064.150943 P99 : 4576.000000 P100 : 10087.000000 COUNT : 1204 SUM : 1006130 rocksdb.write.raw.block.micros P50 : 0.512949 P95 : 0.974603 P99 : 2.952360 P100 : 13237.000000 COUNT : 11039575 SUM : 21756802 rocksdb.numfiles.in.singlecompaction P50 : 3.017241 P95 : 7.600000 P99 : 25.120000 P100 : 28.000000 COUNT : 148 SUM : 552 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.556305 P95 : 1186.655466 P99 : 2595.012753 P100 : 709590.000000 COUNT : 190363 SUM : 32334345 rocksdb.sst.read.micros P50 : 1.639827 P95 : 4.827569 P99 : 8.900228 P100 : 22979.000000 COUNT : 8564319 SUM : 37792830 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10240999 SUM : 10568710968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 213106.796117 P95 : 425125.000000 P99 : 757775.000000 P100 : 847537.000000 COUNT : 141 SUM : 30979662 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 376 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0