[2024-11-17 11:05:53.093025] Starting SPDK v25.01-pre git sha1 83e8405e4 / DPDK 22.11.4 initialization... [2024-11-17 11:05:53.093312] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid177915 ] Set seed to 1731837953086219 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-17 11:05:53.212154] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-17 11:05:53.235388] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-17 11:05:53.235431] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 177915' to capture a snapshot of events at runtime. [2024-11-17 11:05:53.235442] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-17 11:05:53.235452] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-17 11:05:53.235460] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid177915 for offline analysis/debug. [2024-11-17 11:05:53.236012] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 17 11:05:57 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/17-11:06:00 ... thread 0: (1000000,1000000) ops and (323180.4,323180.4) ops/second in (3.094247,3.094247) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 440.96 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 340.9 2.59 2.33 12 0.216 0 0 0.0 0.0 L1 3/0 249.57 MB 25.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 251.6 251.3 1.00 0.97 1 1.002 255K 231 0.0 0.0 L2 3/2 191.03 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 237.0 236.9 0.81 0.78 2 0.407 195K 88 0.0 0.0 L3 10/0 867.23 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/6 97.00 GB 0.0 0.4 0.4 0.1 1.3 1.2 0.5 1.5 101.0 301.3 4.40 4.07 15 0.293 451K 319 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.3 1.2 0.4 1.5 101.0 301.3 4.40 4.07 15 0.293 451K 319 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 245.0 244.9 1.82 1.74 3 0.605 451K 319 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 340.9 2.59 2.33 12 0.216 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.3 total, 3.1 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.30 GB write, 396.81 MB/s write, 0.43 GB read, 133.07 MB/s read, 4.4 seconds Interval compaction: 1.30 GB write, 428.54 MB/s write, 0.43 GB read, 143.71 MB/s read, 4.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 158489 Average: 1.9639 StdDev: 15.16 Min: 1 Median: 1.2994 Max: 3486 Percentiles: P50: 1.30 P75: 1.73 P99: 5.27 P99.9: 10.86 P99.99: 22.91 ------------------------------------------------------ [ 0, 1 ] 51996 32.807% 32.807% ####### ( 1, 2 ] 91004 57.420% 90.227% ########### ( 2, 3 ] 8887 5.607% 95.834% # ( 3, 4 ] 3688 2.327% 98.161% ( 4, 6 ] 2100 1.325% 99.486% ( 6, 10 ] 631 0.398% 99.885% ( 10, 15 ] 149 0.094% 99.979% ( 15, 22 ] 19 0.012% 99.991% ( 22, 34 ] 2 0.001% 99.992% ( 34, 51 ] 1 0.001% 99.992% ( 51, 76 ] 1 0.001% 99.993% ( 110, 170 ] 8 0.005% 99.998% ( 170, 250 ] 2 0.001% 99.999% ( 250, 380 ] 7 0.004% 100.004% ( 380, 580 ] 1 0.001% 100.004% ( 870, 1300 ] 1 0.001% 100.005% ( 1300, 1900 ] 2 0.001% 100.006% ( 1900, 2900 ] 1 0.001% 100.007% ( 2900, 4400 ] 2 0.001% 100.008% ** Level 1 read latency histogram (micros): Count: 577 Average: 13.8614 StdDev: 102.08 Min: 1 Median: 2.9217 Max: 1462 Percentiles: P50: 2.92 P75: 3.82 P99: 264.95 P99.9: 1462.00 P99.99: 1462.00 ------------------------------------------------------ [ 0, 1 ] 6 1.040% 1.040% ( 1, 2 ] 100 17.331% 18.371% ### ( 2, 3 ] 198 34.315% 52.686% ####### ( 3, 4 ] 157 27.210% 79.896% ##### ( 4, 6 ] 78 13.518% 93.414% ### ( 6, 10 ] 18 3.120% 96.534% # ( 10, 15 ] 6 1.040% 97.574% ( 15, 22 ] 3 0.520% 98.094% ( 34, 51 ] 1 0.173% 98.267% ( 51, 76 ] 1 0.173% 98.440% ( 110, 170 ] 1 0.173% 98.614% ( 170, 250 ] 2 0.347% 98.960% ( 250, 380 ] 2 0.347% 99.307% ( 380, 580 ] 1 0.173% 99.480% ( 870, 1300 ] 1 0.173% 99.653% ( 1300, 1900 ] 2 0.347% 100.000% ** Level 2 read latency histogram (micros): Count: 42059 Average: 2.2838 StdDev: 4.83 Min: 1 Median: 1.5318 Max: 634 Percentiles: P50: 1.53 P75: 1.91 P99: 7.19 P99.9: 13.15 P99.99: 31.53 ------------------------------------------------------ [ 0, 1 ] 6300 14.979% 14.979% ### ( 1, 2 ] 27697 65.853% 80.832% ############# ( 2, 3 ] 4006 9.525% 90.356% ## ( 3, 4 ] 2104 5.002% 95.359% # ( 4, 6 ] 1386 3.295% 98.654% # ( 6, 10 ] 488 1.160% 99.815% ( 10, 15 ] 57 0.136% 99.950% ( 15, 22 ] 16 0.038% 99.988% ( 22, 34 ] 1 0.002% 99.990% ( 34, 51 ] 1 0.002% 99.993% ( 51, 76 ] 1 0.002% 99.995% ( 170, 250 ] 1 0.002% 99.998% ( 380, 580 ] 2 0.005% 100.002% ( 580, 870 ] 1 0.002% 100.005% ** Level 3 read latency histogram (micros): Count: 45 Average: 1658.1333 StdDev: 1426.31 Min: 121 Median: 1120.8333 Max: 4975 Percentiles: P50: 1120.83 P75: 2087.50 P99: 4975.00 P99.9: 4975.00 P99.99: 4975.00 ------------------------------------------------------ ( 110, 170 ] 2 4.444% 4.444% # ( 170, 250 ] 1 2.222% 6.667% ( 250, 380 ] 1 2.222% 8.889% ( 380, 580 ] 7 15.556% 24.444% ### ( 580, 870 ] 8 17.778% 42.222% #### ( 870, 1300 ] 6 13.333% 55.556% ### ( 1300, 1900 ] 8 17.778% 73.333% #### ( 1900, 2900 ] 4 8.889% 82.222% ## ( 2900, 4400 ] 3 6.667% 88.889% # ( 4400, 6600 ] 5 11.111% 100.000% ## ** Level 4 read latency histogram (micros): Count: 30 Average: 1655.1667 StdDev: 1359.92 Min: 109 Median: 1085.0000 Max: 5030 Percentiles: P50: 1085.00 P75: 2275.00 P99: 5030.00 P99.9: 5030.00 P99.99: 5030.00 ------------------------------------------------------ ( 76, 110 ] 1 3.333% 3.333% # ( 250, 380 ] 2 6.667% 10.000% # ( 380, 580 ] 2 6.667% 16.667% # ( 580, 870 ] 8 26.667% 43.333% ##### ( 870, 1300 ] 4 13.333% 56.667% ### ( 1300, 1900 ] 4 13.333% 70.000% ### ( 1900, 2900 ] 4 13.333% 83.333% ### ( 2900, 4400 ] 2 6.667% 90.000% # ( 4400, 6600 ] 3 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.3 total, 3.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 294.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.436 H:M:S, 13.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.436 H:M:S, 14.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-11:06:03 ... thread 0: (1000000,2000000) ops and (346296.2,334339.2) ops/second in (2.887701,5.981948) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.35 GB 81.8 0.8 0.0 0.8 2.6 1.8 0.0 1.4 97.7 315.5 8.38 7.74 29 0.289 831K 864 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 251.6 251.3 1.00 0.97 1 1.002 255K 231 0.0 0.0 L2 2/1 82.26 MB 0.8 0.2 0.1 0.1 0.2 0.1 0.4 1.5 237.0 236.9 0.81 0.78 2 0.407 195K 88 0.0 0.0 L3 19/10 1.03 GB 0.2 0.2 0.2 0.0 0.2 0.2 0.3 1.0 213.5 213.5 0.88 0.80 1 0.877 190K 0 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 128.7 128.7 1.31 0.90 1 1.310 171K 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/19 97.92 GB 0.0 1.6 0.7 0.9 3.4 2.5 0.9 1.9 130.8 278.1 12.39 11.18 34 0.364 1644K 1183 0.0 0.0 Int 0/0 0.00 KB 0.0 1.6 0.7 0.9 3.4 2.5 0.8 1.9 130.8 278.1 12.39 11.18 34 0.364 1644K 1183 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.6 0.7 0.9 1.6 0.7 0.0 0.0 227.1 227.0 7.13 6.51 8 0.891 1644K 1183 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 347.6 5.26 4.67 26 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.36 GB write, 552.98 MB/s write, 1.58 GB read, 259.95 MB/s read, 12.4 seconds Interval compaction: 3.36 GB write, 575.85 MB/s write, 1.58 GB read, 270.70 MB/s read, 12.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 385656 Average: 2.1488 StdDev: 14.86 Min: 1 Median: 1.4350 Max: 4082 Percentiles: P50: 1.44 P75: 1.84 P99: 5.68 P99.9: 11.77 P99.99: 19.79 ------------------------------------------------------ [ 0, 1 ] 88057 22.833% 22.833% ##### ( 1, 2 ] 240837 62.449% 85.282% ############ ( 2, 3 ] 32594 8.452% 93.733% ## ( 3, 4 ] 13491 3.498% 97.231% # ( 4, 6 ] 8108 2.102% 99.334% ( 6, 10 ] 2011 0.521% 99.855% ( 10, 15 ] 491 0.127% 99.983% ( 15, 22 ] 43 0.011% 99.994% ( 22, 34 ] 5 0.001% 99.995% ( 34, 51 ] 3 0.001% 99.996% ( 51, 76 ] 2 0.001% 99.996% ( 110, 170 ] 12 0.003% 99.999% ( 170, 250 ] 11 0.003% 100.002% ( 250, 380 ] 14 0.004% 100.006% ( 380, 580 ] 4 0.001% 100.007% ( 580, 870 ] 4 0.001% 100.008% ( 870, 1300 ] 3 0.001% 100.009% ( 1300, 1900 ] 4 0.001% 100.010% ( 1900, 2900 ] 2 0.001% 100.010% ( 2900, 4400 ] 4 0.001% 100.011% ** Level 1 read latency histogram (micros): Count: 577 Average: 13.8614 StdDev: 102.08 Min: 1 Median: 2.9217 Max: 1462 Percentiles: P50: 2.92 P75: 3.82 P99: 264.95 P99.9: 1462.00 P99.99: 1462.00 ------------------------------------------------------ [ 0, 1 ] 6 1.040% 1.040% ( 1, 2 ] 100 17.331% 18.371% ### ( 2, 3 ] 198 34.315% 52.686% ####### ( 3, 4 ] 157 27.210% 79.896% ##### ( 4, 6 ] 78 13.518% 93.414% ### ( 6, 10 ] 18 3.120% 96.534% # ( 10, 15 ] 6 1.040% 97.574% ( 15, 22 ] 3 0.520% 98.094% ( 34, 51 ] 1 0.173% 98.267% ( 51, 76 ] 1 0.173% 98.440% ( 110, 170 ] 1 0.173% 98.614% ( 170, 250 ] 2 0.347% 98.960% ( 250, 380 ] 2 0.347% 99.307% ( 380, 580 ] 1 0.173% 99.480% ( 870, 1300 ] 1 0.173% 99.653% ( 1300, 1900 ] 2 0.347% 100.000% ** Level 2 read latency histogram (micros): Count: 48675 Average: 2.2796 StdDev: 4.51 Min: 1 Median: 1.5403 Max: 634 Percentiles: P50: 1.54 P75: 1.92 P99: 6.97 P99.9: 12.98 P99.99: 28.79 ------------------------------------------------------ [ 0, 1 ] 6956 14.291% 14.291% ### ( 1, 2 ] 32168 66.087% 80.378% ############# ( 2, 3 ] 5085 10.447% 90.825% ## ( 3, 4 ] 2320 4.766% 95.591% # ( 4, 6 ] 1532 3.147% 98.739% # ( 6, 10 ] 526 1.081% 99.819% ( 10, 15 ] 66 0.136% 99.955% ( 15, 22 ] 16 0.033% 99.988% ( 22, 34 ] 2 0.004% 99.992% ( 34, 51 ] 1 0.002% 99.994% ( 51, 76 ] 1 0.002% 99.996% ( 170, 250 ] 1 0.002% 99.998% ( 380, 580 ] 2 0.004% 100.002% ( 580, 870 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 205004 Average: 3.4592 StdDev: 36.96 Min: 1 Median: 1.6389 Max: 4975 Percentiles: P50: 1.64 P75: 2.17 P99: 8.95 P99.9: 200.91 P99.99: 558.69 ------------------------------------------------------ [ 0, 1 ] 22322 10.889% 10.889% ## ( 1, 2 ] 125495 61.216% 72.104% ############ ( 2, 3 ] 34363 16.762% 88.867% ### ( 3, 4 ] 9831 4.796% 93.662% # ( 4, 6 ] 8375 4.085% 97.747% # ( 6, 10 ] 3483 1.699% 99.446% ( 10, 15 ] 431 0.210% 99.657% ( 15, 22 ] 108 0.053% 99.709% ( 22, 34 ] 32 0.016% 99.725% ( 34, 51 ] 7 0.003% 99.728% ( 51, 76 ] 4 0.002% 99.730% ( 76, 110 ] 95 0.046% 99.777% ( 110, 170 ] 220 0.107% 99.884% ( 170, 250 ] 88 0.043% 99.927% ( 250, 380 ] 76 0.037% 99.964% ( 380, 580 ] 61 0.030% 99.994% ( 580, 870 ] 34 0.017% 100.010% ( 870, 1300 ] 15 0.007% 100.018% ( 1300, 1900 ] 11 0.005% 100.023% ( 1900, 2900 ] 5 0.002% 100.025% ( 2900, 4400 ] 3 0.001% 100.027% ( 4400, 6600 ] 5 0.002% 100.029% ** Level 4 read latency histogram (micros): Count: 320 Average: 160.1406 StdDev: 636.44 Min: 0 Median: 2.0000 Max: 5030 Percentiles: P50: 2.00 P75: 5.82 P99: 4250.00 P99.9: 5030.00 P99.99: 5030.00 ------------------------------------------------------ [ 0, 1 ] 47 14.688% 14.688% ### ( 1, 2 ] 113 35.312% 50.000% ####### ( 2, 3 ] 58 18.125% 68.125% #### ( 3, 4 ] 12 3.750% 71.875% # ( 4, 6 ] 11 3.438% 75.312% # ( 6, 10 ] 26 8.125% 83.438% ## ( 10, 15 ] 16 5.000% 88.438% # ( 15, 22 ] 3 0.938% 89.375% ( 22, 34 ] 2 0.625% 90.000% ( 76, 110 ] 1 0.312% 90.312% ( 110, 170 ] 1 0.312% 90.625% ( 250, 380 ] 3 0.938% 91.562% ( 380, 580 ] 2 0.625% 92.188% ( 580, 870 ] 8 2.500% 94.688% # ( 870, 1300 ] 4 1.250% 95.938% ( 1300, 1900 ] 4 1.250% 97.188% ( 1900, 2900 ] 4 1.250% 98.438% ( 2900, 4400 ] 2 0.625% 99.062% ( 4400, 6600 ] 3 0.938% 100.000% ** DB Stats ** Uptime(secs): 6.2 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 315.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.629 H:M:S, 10.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 340.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.193 H:M:S, 6.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/17-11:06:06 ... thread 0: (1000000,3000000) ops and (329443.6,332691.3) ops/second in (3.035421,9.017369) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.34 GB 214.0 1.9 0.0 1.9 4.7 2.8 0.0 1.7 126.1 309.0 15.49 14.46 47 0.330 1982K 2081 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 251.6 251.3 1.00 0.97 1 1.002 255K 231 0.0 0.0 L2 1/0 78.40 MB 0.8 0.2 0.1 0.1 0.2 0.1 0.4 1.5 237.0 236.9 0.81 0.78 2 0.407 195K 88 0.0 0.0 L3 19/0 799.40 MB 0.8 1.0 0.2 0.8 1.0 0.2 0.3 5.5 240.6 239.8 4.40 4.04 2 2.199 1074K 3917 0.0 0.0 L4 174/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 128.7 128.7 1.31 0.90 1 1.310 171K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/4 98.90 GB 0.0 3.5 0.7 2.8 6.3 3.5 1.5 2.3 157.5 280.4 23.01 21.14 53 0.434 3680K 6317 0.0 0.0 Int 0/0 0.00 KB 0.0 3.5 0.7 2.8 6.3 3.5 1.4 2.3 157.5 280.4 23.01 21.14 53 0.434 3680K 6317 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.5 0.7 2.8 3.5 0.7 0.0 0.0 242.1 241.6 14.97 13.99 13 1.152 3680K 6317 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 352.8 8.04 7.15 40 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.3 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.30 GB write, 696.44 MB/s write, 3.54 GB read, 391.18 MB/s read, 23.0 seconds Interval compaction: 6.30 GB write, 715.55 MB/s write, 3.54 GB read, 401.92 MB/s read, 23.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 654504 Average: 2.0840 StdDev: 12.61 Min: 1 Median: 1.4089 Max: 4082 Percentiles: P50: 1.41 P75: 1.81 P99: 5.50 P99.9: 10.71 P99.99: 17.25 ------------------------------------------------------ [ 0, 1 ] 160666 24.548% 24.548% ##### ( 1, 2 ] 407374 62.242% 86.789% ############ ( 2, 3 ] 50451 7.708% 94.498% ## ( 3, 4 ] 20584 3.145% 97.643% # ( 4, 6 ] 11809 1.804% 99.447% ( 6, 10 ] 2872 0.439% 99.886% ( 10, 15 ] 662 0.101% 99.987% ( 15, 22 ] 64 0.010% 99.997% ( 22, 34 ] 9 0.001% 99.998% ( 34, 51 ] 5 0.001% 99.999% ( 51, 76 ] 3 0.000% 99.999% ( 110, 170 ] 16 0.002% 100.002% ( 170, 250 ] 21 0.003% 100.005% ( 250, 380 ] 22 0.003% 100.008% ( 380, 580 ] 6 0.001% 100.009% ( 580, 870 ] 9 0.001% 100.011% ( 870, 1300 ] 7 0.001% 100.012% ( 1300, 1900 ] 6 0.001% 100.013% ( 1900, 2900 ] 3 0.000% 100.013% ( 2900, 4400 ] 4 0.001% 100.014% ** Level 1 read latency histogram (micros): Count: 28843 Average: 2.7084 StdDev: 17.03 Min: 1 Median: 1.4849 Max: 1462 Percentiles: P50: 1.48 P75: 1.86 P99: 8.37 P99.9: 157.96 P99.99: 919.75 ------------------------------------------------------ [ 0, 1 ] 5009 17.366% 17.366% ### ( 1, 2 ] 19412 67.302% 84.669% ############# ( 2, 3 ] 2463 8.539% 93.208% ## ( 3, 4 ] 993 3.443% 96.651% # ( 4, 6 ] 413 1.432% 98.083% ( 6, 10 ] 447 1.550% 99.632% ( 10, 15 ] 21 0.073% 99.705% ( 15, 22 ] 3 0.010% 99.716% ( 34, 51 ] 1 0.003% 99.719% ( 51, 76 ] 1 0.003% 99.723% ( 110, 170 ] 64 0.222% 99.945% ( 170, 250 ] 5 0.017% 99.962% ( 250, 380 ] 5 0.017% 99.979% ( 380, 580 ] 2 0.007% 99.986% ( 580, 870 ] 1 0.003% 99.990% ( 870, 1300 ] 1 0.003% 99.993% ( 1300, 1900 ] 2 0.007% 100.000% ** Level 2 read latency histogram (micros): Count: 48940 Average: 2.2794 StdDev: 4.50 Min: 1 Median: 1.5407 Max: 634 Percentiles: P50: 1.54 P75: 1.92 P99: 6.97 P99.9: 12.96 P99.99: 28.64 ------------------------------------------------------ [ 0, 1 ] 6978 14.258% 14.258% ### ( 1, 2 ] 32351 66.103% 80.362% ############# ( 2, 3 ] 5131 10.484% 90.846% ## ( 3, 4 ] 2329 4.759% 95.605% # ( 4, 6 ] 1533 3.132% 98.737% # ( 6, 10 ] 530 1.083% 99.820% ( 10, 15 ] 66 0.135% 99.955% ( 15, 22 ] 16 0.033% 99.988% ( 22, 34 ] 2 0.004% 99.992% ( 34, 51 ] 1 0.002% 99.994% ( 51, 76 ] 1 0.002% 99.996% ( 170, 250 ] 1 0.002% 99.998% ( 380, 580 ] 2 0.004% 100.002% ( 580, 870 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 234799 Average: 3.4129 StdDev: 35.23 Min: 0 Median: 1.6275 Max: 4975 Percentiles: P50: 1.63 P75: 2.12 P99: 8.92 P99.9: 207.66 P99.99: 597.00 ------------------------------------------------------ [ 0, 1 ] 25878 11.021% 11.021% ## ( 1, 2 ] 145859 62.121% 73.142% ############ ( 2, 3 ] 37483 15.964% 89.106% ### ( 3, 4 ] 11127 4.739% 93.845% # ( 4, 6 ] 9183 3.911% 97.756% # ( 6, 10 ] 4003 1.705% 99.461% ( 10, 15 ] 455 0.194% 99.655% ( 15, 22 ] 113 0.048% 99.703% ( 22, 34 ] 33 0.014% 99.717% ( 34, 51 ] 7 0.003% 99.720% ( 51, 76 ] 5 0.002% 99.722% ( 76, 110 ] 115 0.049% 99.771% ( 110, 170 ] 250 0.106% 99.877% ( 170, 250 ] 113 0.048% 99.925% ( 250, 380 ] 83 0.035% 99.961% ( 380, 580 ] 66 0.028% 99.989% ( 580, 870 ] 43 0.018% 100.007% ( 870, 1300 ] 18 0.008% 100.015% ( 1300, 1900 ] 11 0.005% 100.020% ( 1900, 2900 ] 5 0.002% 100.022% ( 2900, 4400 ] 3 0.001% 100.023% ( 4400, 6600 ] 5 0.002% 100.025% ** Level 4 read latency histogram (micros): Count: 320 Average: 160.1406 StdDev: 636.44 Min: 0 Median: 2.0000 Max: 5030 Percentiles: P50: 2.00 P75: 5.82 P99: 4250.00 P99.9: 5030.00 P99.99: 5030.00 ------------------------------------------------------ [ 0, 1 ] 47 14.688% 14.688% ### ( 1, 2 ] 113 35.312% 50.000% ####### ( 2, 3 ] 58 18.125% 68.125% #### ( 3, 4 ] 12 3.750% 71.875% # ( 4, 6 ] 11 3.438% 75.312% # ( 6, 10 ] 26 8.125% 83.438% ## ( 10, 15 ] 16 5.000% 88.438% # ( 15, 22 ] 3 0.938% 89.375% ( 22, 34 ] 2 0.625% 90.000% ( 76, 110 ] 1 0.312% 90.312% ( 110, 170 ] 1 0.312% 90.625% ( 250, 380 ] 3 0.938% 91.562% ( 380, 580 ] 2 0.625% 92.188% ( 580, 870 ] 8 2.500% 94.688% # ( 870, 1300 ] 4 1.250% 95.938% ( 1300, 1900 ] 4 1.250% 97.188% ( 1900, 2900 ] 4 1.250% 98.438% ( 2900, 4400 ] 2 0.625% 99.062% ( 4400, 6600 ] 3 0.938% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 817.9000 StdDev: 937.21 Min: 94 Median: 236.6667 Max: 3282 Percentiles: P50: 236.67 P75: 1192.50 P99: 3282.00 P99.9: 3282.00 P99.99: 3282.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 3 15.000% 25.000% ### ( 170, 250 ] 6 30.000% 55.000% ###### ( 250, 380 ] 1 5.000% 60.000% # ( 870, 1300 ] 4 20.000% 80.000% #### ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.3 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 318.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.972 H:M:S, 10.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.344 H:M:S, 11.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-11:06:09 ... thread 0: (1000000,4000000) ops and (349373.5,336710.7) ops/second in (2.862266,11.879635) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 3.26 GB 276.9 2.7 0.0 2.7 6.4 3.7 0.0 1.7 130.7 308.8 21.21 19.84 64 0.331 2814K 2929 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 251.6 251.3 1.00 0.97 1 1.002 255K 231 0.0 0.0 L2 1/0 78.40 MB 0.8 0.2 0.1 0.1 0.2 0.1 0.4 1.5 237.0 236.9 0.81 0.78 2 0.407 195K 88 0.0 0.0 L3 19/0 799.40 MB 0.8 1.0 0.2 0.8 1.0 0.2 0.3 5.5 240.6 239.8 4.40 4.04 2 2.199 1074K 3917 0.0 0.0 L4 174/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 128.7 128.7 1.31 0.90 1 1.310 171K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1260/8 99.82 GB 0.0 4.3 0.7 3.6 8.0 4.4 1.5 2.2 154.7 286.0 28.73 26.52 70 0.410 4512K 7165 0.0 0.0 Int 0/0 0.00 KB 0.0 4.3 0.7 3.6 8.0 4.4 1.4 2.2 154.7 286.0 28.73 26.52 70 0.410 4512K 7165 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.3 0.7 3.6 4.3 0.7 0.0 0.0 245.8 245.4 18.08 17.02 16 1.130 4512K 7165 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 354.9 10.65 9.50 54 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.02 GB write, 677.45 MB/s write, 4.34 GB read, 366.39 MB/s read, 28.7 seconds Interval compaction: 8.02 GB write, 691.56 MB/s write, 4.34 GB read, 374.02 MB/s read, 28.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 890824 Average: 2.0317 StdDev: 12.72 Min: 0 Median: 1.3758 Max: 4395 Percentiles: P50: 1.38 P75: 1.78 P99: 5.34 P99.9: 10.44 P99.99: 17.25 ------------------------------------------------------ [ 0, 1 ] 239784 26.917% 26.917% ##### ( 1, 2 ] 547131 61.419% 88.336% ############ ( 2, 3 ] 61271 6.878% 95.214% # ( 3, 4 ] 24678 2.770% 97.984% # ( 4, 6 ] 13489 1.514% 99.498% ( 6, 10 ] 3507 0.394% 99.892% ( 10, 15 ] 848 0.095% 99.987% ( 15, 22 ] 87 0.010% 99.997% ( 22, 34 ] 11 0.001% 99.998% ( 34, 51 ] 5 0.001% 99.999% ( 51, 76 ] 7 0.001% 99.999% ( 110, 170 ] 26 0.003% 100.002% ( 170, 250 ] 25 0.003% 100.005% ( 250, 380 ] 28 0.003% 100.008% ( 380, 580 ] 9 0.001% 100.009% ( 580, 870 ] 13 0.001% 100.011% ( 870, 1300 ] 10 0.001% 100.012% ( 1300, 1900 ] 8 0.001% 100.013% ( 1900, 2900 ] 3 0.000% 100.013% ( 2900, 4400 ] 6 0.001% 100.014% ** Level 1 read latency histogram (micros): Count: 28843 Average: 2.7084 StdDev: 17.03 Min: 1 Median: 1.4849 Max: 1462 Percentiles: P50: 1.48 P75: 1.86 P99: 8.37 P99.9: 157.96 P99.99: 919.75 ------------------------------------------------------ [ 0, 1 ] 5009 17.366% 17.366% ### ( 1, 2 ] 19412 67.302% 84.669% ############# ( 2, 3 ] 2463 8.539% 93.208% ## ( 3, 4 ] 993 3.443% 96.651% # ( 4, 6 ] 413 1.432% 98.083% ( 6, 10 ] 447 1.550% 99.632% ( 10, 15 ] 21 0.073% 99.705% ( 15, 22 ] 3 0.010% 99.716% ( 34, 51 ] 1 0.003% 99.719% ( 51, 76 ] 1 0.003% 99.723% ( 110, 170 ] 64 0.222% 99.945% ( 170, 250 ] 5 0.017% 99.962% ( 250, 380 ] 5 0.017% 99.979% ( 380, 580 ] 2 0.007% 99.986% ( 580, 870 ] 1 0.003% 99.990% ( 870, 1300 ] 1 0.003% 99.993% ( 1300, 1900 ] 2 0.007% 100.000% ** Level 2 read latency histogram (micros): Count: 48940 Average: 2.2794 StdDev: 4.50 Min: 1 Median: 1.5407 Max: 634 Percentiles: P50: 1.54 P75: 1.92 P99: 6.97 P99.9: 12.96 P99.99: 28.64 ------------------------------------------------------ [ 0, 1 ] 6978 14.258% 14.258% ### ( 1, 2 ] 32351 66.103% 80.362% ############# ( 2, 3 ] 5131 10.484% 90.846% ## ( 3, 4 ] 2329 4.759% 95.605% # ( 4, 6 ] 1533 3.132% 98.737% # ( 6, 10 ] 530 1.083% 99.820% ( 10, 15 ] 66 0.135% 99.955% ( 15, 22 ] 16 0.033% 99.988% ( 22, 34 ] 2 0.004% 99.992% ( 34, 51 ] 1 0.002% 99.994% ( 51, 76 ] 1 0.002% 99.996% ( 170, 250 ] 1 0.002% 99.998% ( 380, 580 ] 2 0.004% 100.002% ( 580, 870 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 234799 Average: 3.4129 StdDev: 35.23 Min: 0 Median: 1.6275 Max: 4975 Percentiles: P50: 1.63 P75: 2.12 P99: 8.92 P99.9: 207.66 P99.99: 597.00 ------------------------------------------------------ [ 0, 1 ] 25878 11.021% 11.021% ## ( 1, 2 ] 145859 62.121% 73.142% ############ ( 2, 3 ] 37483 15.964% 89.106% ### ( 3, 4 ] 11127 4.739% 93.845% # ( 4, 6 ] 9183 3.911% 97.756% # ( 6, 10 ] 4003 1.705% 99.461% ( 10, 15 ] 455 0.194% 99.655% ( 15, 22 ] 113 0.048% 99.703% ( 22, 34 ] 33 0.014% 99.717% ( 34, 51 ] 7 0.003% 99.720% ( 51, 76 ] 5 0.002% 99.722% ( 76, 110 ] 115 0.049% 99.771% ( 110, 170 ] 250 0.106% 99.877% ( 170, 250 ] 113 0.048% 99.925% ( 250, 380 ] 83 0.035% 99.961% ( 380, 580 ] 66 0.028% 99.989% ( 580, 870 ] 43 0.018% 100.007% ( 870, 1300 ] 18 0.008% 100.015% ( 1300, 1900 ] 11 0.005% 100.020% ( 1900, 2900 ] 5 0.002% 100.022% ( 2900, 4400 ] 3 0.001% 100.023% ( 4400, 6600 ] 5 0.002% 100.025% ** Level 4 read latency histogram (micros): Count: 320 Average: 160.1406 StdDev: 636.44 Min: 0 Median: 2.0000 Max: 5030 Percentiles: P50: 2.00 P75: 5.82 P99: 4250.00 P99.9: 5030.00 P99.99: 5030.00 ------------------------------------------------------ [ 0, 1 ] 47 14.688% 14.688% ### ( 1, 2 ] 113 35.312% 50.000% ####### ( 2, 3 ] 58 18.125% 68.125% #### ( 3, 4 ] 12 3.750% 71.875% # ( 4, 6 ] 11 3.438% 75.312% # ( 6, 10 ] 26 8.125% 83.438% ## ( 10, 15 ] 16 5.000% 88.438% # ( 15, 22 ] 3 0.938% 89.375% ( 22, 34 ] 2 0.625% 90.000% ( 76, 110 ] 1 0.312% 90.312% ( 110, 170 ] 1 0.312% 90.625% ( 250, 380 ] 3 0.938% 91.562% ( 380, 580 ] 2 0.625% 92.188% ( 580, 870 ] 8 2.500% 94.688% # ( 870, 1300 ] 4 1.250% 95.938% ( 1300, 1900 ] 4 1.250% 97.188% ( 1900, 2900 ] 4 1.250% 98.438% ( 2900, 4400 ] 2 0.625% 99.062% ( 4400, 6600 ] 3 0.938% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 817.9000 StdDev: 937.21 Min: 94 Median: 236.6667 Max: 3282 Percentiles: P50: 236.67 P75: 1192.50 P99: 3282.00 P99.9: 3282.00 P99.99: 3282.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 3 15.000% 25.000% ### ( 170, 250 ] 6 30.000% 55.000% ###### ( 250, 380 ] 1 5.000% 60.000% # ( 870, 1300 ] 4 20.000% 80.000% #### ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 2.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 324.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.182 H:M:S, 9.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 343.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.209 H:M:S, 7.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-11:06:20 ... thread 0: (1000000,5000000) ops and (88884.3,216167.4) ops/second in (11.250584,23.130219) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/18 4.30 GB 25.2 4.0 0.0 4.0 8.7 4.7 0.0 1.8 140.9 307.6 29.07 27.30 85 0.342 4157K 4297 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 251.6 251.3 1.00 0.97 1 1.002 255K 231 0.0 0.0 L2 1/0 78.40 MB 0.8 0.2 0.1 0.1 0.2 0.1 0.4 1.5 237.0 236.9 0.81 0.78 2 0.407 195K 88 0.0 0.0 L3 19/0 799.40 MB 0.8 1.0 0.2 0.8 1.0 0.2 0.3 5.5 240.6 239.8 4.40 4.04 2 2.199 1074K 3917 0.0 0.0 L4 174/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 128.7 128.7 1.31 0.90 1 1.310 171K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1261/18 100.87 GB 0.0 5.6 0.7 4.9 10.4 5.5 1.5 2.2 157.6 289.9 36.59 33.98 91 0.402 5855K 8533 0.0 0.0 Int 0/0 0.00 KB 0.0 5.6 0.7 4.9 10.4 5.5 1.4 2.2 157.6 289.9 36.59 33.98 91 0.402 5855K 8533 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.6 0.7 4.9 5.6 0.7 0.0 0.0 250.8 250.4 22.99 21.84 21 1.095 5855K 8533 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 356.7 13.60 12.14 70 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.4 total, 23.1 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.36 GB write, 453.77 MB/s write, 5.63 GB read, 246.66 MB/s read, 36.6 seconds Interval compaction: 10.36 GB write, 458.63 MB/s write, 5.63 GB read, 249.30 MB/s read, 36.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 9, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1707586 Average: 1.9448 StdDev: 10.59 Min: 0 Median: 1.3167 Max: 4395 Percentiles: P50: 1.32 P75: 1.73 P99: 5.05 P99.9: 11.74 P99.99: 109.61 ------------------------------------------------------ [ 0, 1 ] 526970 30.861% 30.861% ###### ( 1, 2 ] 1031954 60.434% 91.294% ############ ( 2, 3 ] 85219 4.991% 96.285% # ( 3, 4 ] 35981 2.107% 98.392% ( 4, 6 ] 19716 1.155% 99.546% ( 6, 10 ] 5494 0.322% 99.868% ( 10, 15 ] 1568 0.092% 99.960% ( 15, 22 ] 317 0.019% 99.979% ( 22, 34 ] 18 0.001% 99.980% ( 34, 51 ] 5 0.000% 99.980% ( 51, 76 ] 20 0.001% 99.981% ( 76, 110 ] 155 0.009% 99.990% ( 110, 170 ] 159 0.009% 99.999% ( 170, 250 ] 54 0.003% 100.003% ( 250, 380 ] 41 0.002% 100.005% ( 380, 580 ] 20 0.001% 100.006% ( 580, 870 ] 22 0.001% 100.007% ( 870, 1300 ] 17 0.001% 100.008% ( 1300, 1900 ] 12 0.001% 100.009% ( 1900, 2900 ] 5 0.000% 100.009% ( 2900, 4400 ] 7 0.000% 100.010% ** Level 1 read latency histogram (micros): Count: 28843 Average: 2.7084 StdDev: 17.03 Min: 1 Median: 1.4849 Max: 1462 Percentiles: P50: 1.48 P75: 1.86 P99: 8.37 P99.9: 157.96 P99.99: 919.75 ------------------------------------------------------ [ 0, 1 ] 5009 17.366% 17.366% ### ( 1, 2 ] 19412 67.302% 84.669% ############# ( 2, 3 ] 2463 8.539% 93.208% ## ( 3, 4 ] 993 3.443% 96.651% # ( 4, 6 ] 413 1.432% 98.083% ( 6, 10 ] 447 1.550% 99.632% ( 10, 15 ] 21 0.073% 99.705% ( 15, 22 ] 3 0.010% 99.716% ( 34, 51 ] 1 0.003% 99.719% ( 51, 76 ] 1 0.003% 99.723% ( 110, 170 ] 64 0.222% 99.945% ( 170, 250 ] 5 0.017% 99.962% ( 250, 380 ] 5 0.017% 99.979% ( 380, 580 ] 2 0.007% 99.986% ( 580, 870 ] 1 0.003% 99.990% ( 870, 1300 ] 1 0.003% 99.993% ( 1300, 1900 ] 2 0.007% 100.000% ** Level 2 read latency histogram (micros): Count: 48940 Average: 2.2794 StdDev: 4.50 Min: 1 Median: 1.5407 Max: 634 Percentiles: P50: 1.54 P75: 1.92 P99: 6.97 P99.9: 12.96 P99.99: 28.64 ------------------------------------------------------ [ 0, 1 ] 6978 14.258% 14.258% ### ( 1, 2 ] 32351 66.103% 80.362% ############# ( 2, 3 ] 5131 10.484% 90.846% ## ( 3, 4 ] 2329 4.759% 95.605% # ( 4, 6 ] 1533 3.132% 98.737% # ( 6, 10 ] 530 1.083% 99.820% ( 10, 15 ] 66 0.135% 99.955% ( 15, 22 ] 16 0.033% 99.988% ( 22, 34 ] 2 0.004% 99.992% ( 34, 51 ] 1 0.002% 99.994% ( 51, 76 ] 1 0.002% 99.996% ( 170, 250 ] 1 0.002% 99.998% ( 380, 580 ] 2 0.004% 100.002% ( 580, 870 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 234799 Average: 3.4129 StdDev: 35.23 Min: 0 Median: 1.6275 Max: 4975 Percentiles: P50: 1.63 P75: 2.12 P99: 8.92 P99.9: 207.66 P99.99: 597.00 ------------------------------------------------------ [ 0, 1 ] 25878 11.021% 11.021% ## ( 1, 2 ] 145859 62.121% 73.142% ############ ( 2, 3 ] 37483 15.964% 89.106% ### ( 3, 4 ] 11127 4.739% 93.845% # ( 4, 6 ] 9183 3.911% 97.756% # ( 6, 10 ] 4003 1.705% 99.461% ( 10, 15 ] 455 0.194% 99.655% ( 15, 22 ] 113 0.048% 99.703% ( 22, 34 ] 33 0.014% 99.717% ( 34, 51 ] 7 0.003% 99.720% ( 51, 76 ] 5 0.002% 99.722% ( 76, 110 ] 115 0.049% 99.771% ( 110, 170 ] 250 0.106% 99.877% ( 170, 250 ] 113 0.048% 99.925% ( 250, 380 ] 83 0.035% 99.961% ( 380, 580 ] 66 0.028% 99.989% ( 580, 870 ] 43 0.018% 100.007% ( 870, 1300 ] 18 0.008% 100.015% ( 1300, 1900 ] 11 0.005% 100.020% ( 1900, 2900 ] 5 0.002% 100.022% ( 2900, 4400 ] 3 0.001% 100.023% ( 4400, 6600 ] 5 0.002% 100.025% ** Level 4 read latency histogram (micros): Count: 320 Average: 160.1406 StdDev: 636.44 Min: 0 Median: 2.0000 Max: 5030 Percentiles: P50: 2.00 P75: 5.82 P99: 4250.00 P99.9: 5030.00 P99.99: 5030.00 ------------------------------------------------------ [ 0, 1 ] 47 14.688% 14.688% ### ( 1, 2 ] 113 35.312% 50.000% ####### ( 2, 3 ] 58 18.125% 68.125% #### ( 3, 4 ] 12 3.750% 71.875% # ( 4, 6 ] 11 3.438% 75.312% # ( 6, 10 ] 26 8.125% 83.438% ## ( 10, 15 ] 16 5.000% 88.438% # ( 15, 22 ] 3 0.938% 89.375% ( 22, 34 ] 2 0.625% 90.000% ( 76, 110 ] 1 0.312% 90.312% ( 110, 170 ] 1 0.312% 90.625% ( 250, 380 ] 3 0.938% 91.562% ( 380, 580 ] 2 0.625% 92.188% ( 580, 870 ] 8 2.500% 94.688% # ( 870, 1300 ] 4 1.250% 95.938% ( 1300, 1900 ] 4 1.250% 97.188% ( 1900, 2900 ] 4 1.250% 98.438% ( 2900, 4400 ] 2 0.625% 99.062% ( 4400, 6600 ] 3 0.938% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 817.9000 StdDev: 937.21 Min: 94 Median: 236.6667 Max: 3282 Percentiles: P50: 236.67 P75: 1192.50 P99: 3282.00 P99.9: 3282.00 P99.99: 3282.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 3 15.000% 25.000% ### ( 170, 250 ] 6 30.000% 55.000% ###### ( 250, 380 ] 1 5.000% 60.000% # ( 870, 1300 ] 4 20.000% 80.000% #### ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 23.4 total, 11.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 210.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.370 H:M:S, 40.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 87.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:8.188 H:M:S, 72.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-11:06:33 ... thread 0: (1000000,6000000) ops and (77050.2,166164.6) ops/second in (12.978560,36.108779) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 1.17 GB 56.6 4.3 0.0 4.3 10.0 5.7 0.0 1.8 131.8 304.8 33.46 31.02 99 0.338 4477K 4671 0.0 0.0 L1 10/10 1.24 GB 0.0 4.3 4.3 0.0 4.2 4.2 0.2 1.0 223.5 219.3 19.72 18.11 2 9.858 4473K 82K 0.0 0.0 L2 20/7 2.31 GB 16.7 0.2 0.1 0.1 0.2 0.1 3.2 1.5 237.0 236.9 0.81 0.78 2 0.407 195K 88 0.0 0.0 L3 27/14 1.28 GB 0.5 1.6 0.7 0.9 1.6 0.7 0.3 2.3 227.5 226.8 7.10 6.55 3 2.368 1641K 5205 0.0 0.0 L4 174/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 128.7 128.7 1.31 0.90 1 1.310 171K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1289/39 101.71 GB 0.0 10.5 5.3 5.3 16.1 10.9 4.2 2.8 172.9 264.3 62.40 57.36 107 0.583 10M 92K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.5 5.3 5.3 16.1 10.9 4.1 2.8 172.9 264.3 62.40 57.36 107 0.583 10M 92K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.5 5.3 5.3 10.4 5.2 0.0 0.0 236.0 233.9 45.74 42.76 24 1.906 10M 92K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 347.7 16.67 14.60 83 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 36.4 total, 36.1 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.11 GB write, 453.70 MB/s write, 10.54 GB read, 296.85 MB/s read, 62.4 seconds Interval compaction: 16.11 GB write, 456.81 MB/s write, 10.54 GB read, 298.88 MB/s read, 62.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 14, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2371620 Average: 2.5504 StdDev: 15.83 Min: 0 Median: 1.3312 Max: 4737 Percentiles: P50: 1.33 P75: 1.75 P99: 5.94 P99.9: 149.85 P99.99: 427.70 ------------------------------------------------------ [ 0, 1 ] 721888 30.439% 30.439% ###### ( 1, 2 ] 1400572 59.055% 89.494% ############ ( 2, 3 ] 126899 5.351% 94.845% # ( 3, 4 ] 58912 2.484% 97.329% ( 4, 6 ] 40904 1.725% 99.054% ( 6, 10 ] 8728 0.368% 99.422% ( 10, 15 ] 2739 0.115% 99.537% ( 15, 22 ] 610 0.026% 99.563% ( 22, 34 ] 25 0.001% 99.564% ( 34, 51 ] 8 0.000% 99.564% ( 51, 76 ] 81 0.003% 99.568% ( 76, 110 ] 5436 0.229% 99.797% ( 110, 170 ] 3686 0.155% 99.952% ( 170, 250 ] 475 0.020% 99.972% ( 250, 380 ] 346 0.015% 99.987% ( 380, 580 ] 318 0.013% 100.000% ( 580, 870 ] 106 0.004% 100.005% ( 870, 1300 ] 20 0.001% 100.006% ( 1300, 1900 ] 16 0.001% 100.006% ( 1900, 2900 ] 17 0.001% 100.007% ( 2900, 4400 ] 11 0.000% 100.007% ( 4400, 6600 ] 1 0.000% 100.008% ** Level 1 read latency histogram (micros): Count: 507241 Average: 3.6343 StdDev: 26.47 Min: 1 Median: 1.8356 Max: 4968 Percentiles: P50: 1.84 P75: 2.73 P99: 8.60 P99.9: 18.42 P99.99: 204.28 ------------------------------------------------------ [ 0, 1 ] 12985 2.560% 2.560% # ( 1, 2 ] 287971 56.772% 59.332% ########### ( 2, 3 ] 108674 21.425% 80.756% #### ( 3, 4 ] 48132 9.489% 90.245% ## ( 4, 6 ] 38502 7.590% 97.836% ## ( 6, 10 ] 9084 1.791% 99.627% ( 10, 15 ] 1309 0.258% 99.885% ( 15, 22 ] 161 0.032% 99.917% ( 22, 34 ] 6 0.001% 99.918% ( 34, 51 ] 3 0.001% 99.918% ( 51, 76 ] 9 0.002% 99.920% ( 76, 110 ] 48 0.009% 99.930% ( 110, 170 ] 238 0.047% 99.977% ( 170, 250 ] 164 0.032% 100.009% ( 250, 380 ] 173 0.034% 100.043% ( 380, 580 ] 193 0.038% 100.081% ( 580, 870 ] 156 0.031% 100.112% ( 870, 1300 ] 55 0.011% 100.123% ( 1300, 1900 ] 23 0.005% 100.127% ( 1900, 2900 ] 3 0.001% 100.128% ( 2900, 4400 ] 4 0.001% 100.129% ( 4400, 6600 ] 1 0.000% 100.129% ** Level 2 read latency histogram (micros): Count: 48940 Average: 2.2794 StdDev: 4.50 Min: 1 Median: 1.5407 Max: 634 Percentiles: P50: 1.54 P75: 1.92 P99: 6.97 P99.9: 12.96 P99.99: 28.64 ------------------------------------------------------ [ 0, 1 ] 6978 14.258% 14.258% ### ( 1, 2 ] 32351 66.103% 80.362% ############# ( 2, 3 ] 5131 10.484% 90.846% ## ( 3, 4 ] 2329 4.759% 95.605% # ( 4, 6 ] 1533 3.132% 98.737% # ( 6, 10 ] 530 1.083% 99.820% ( 10, 15 ] 66 0.135% 99.955% ( 15, 22 ] 16 0.033% 99.988% ( 22, 34 ] 2 0.004% 99.992% ( 34, 51 ] 1 0.002% 99.994% ( 51, 76 ] 1 0.002% 99.996% ( 170, 250 ] 1 0.002% 99.998% ( 380, 580 ] 2 0.004% 100.002% ( 580, 870 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 400761 Average: 3.9136 StdDev: 34.98 Min: 0 Median: 1.7376 Max: 4975 Percentiles: P50: 1.74 P75: 2.50 P99: 9.41 P99.9: 327.07 P99.99: 777.11 ------------------------------------------------------ [ 0, 1 ] 27887 6.959% 6.959% # ( 1, 2 ] 233872 58.357% 65.315% ############ ( 2, 3 ] 77241 19.274% 84.589% #### ( 3, 4 ] 27370 6.830% 91.419% # ( 4, 6 ] 23619 5.894% 97.312% # ( 6, 10 ] 7944 1.982% 99.294% ( 10, 15 ] 1126 0.281% 99.575% ( 15, 22 ] 209 0.052% 99.627% ( 22, 34 ] 40 0.010% 99.637% ( 34, 51 ] 8 0.002% 99.639% ( 51, 76 ] 5 0.001% 99.641% ( 76, 110 ] 220 0.055% 99.696% ( 110, 170 ] 432 0.108% 99.803% ( 170, 250 ] 258 0.064% 99.868% ( 250, 380 ] 218 0.054% 99.922% ( 380, 580 ] 189 0.047% 99.969% ( 580, 870 ] 122 0.030% 100.000% ( 870, 1300 ] 55 0.014% 100.013% ( 1300, 1900 ] 17 0.004% 100.018% ( 1900, 2900 ] 9 0.002% 100.020% ( 2900, 4400 ] 6 0.001% 100.021% ( 4400, 6600 ] 5 0.001% 100.023% ** Level 4 read latency histogram (micros): Count: 320 Average: 160.1406 StdDev: 636.44 Min: 0 Median: 2.0000 Max: 5030 Percentiles: P50: 2.00 P75: 5.82 P99: 4250.00 P99.9: 5030.00 P99.99: 5030.00 ------------------------------------------------------ [ 0, 1 ] 47 14.688% 14.688% ### ( 1, 2 ] 113 35.312% 50.000% ####### ( 2, 3 ] 58 18.125% 68.125% #### ( 3, 4 ] 12 3.750% 71.875% # ( 4, 6 ] 11 3.438% 75.312% # ( 6, 10 ] 26 8.125% 83.438% ## ( 10, 15 ] 16 5.000% 88.438% # ( 15, 22 ] 3 0.938% 89.375% ( 22, 34 ] 2 0.625% 90.000% ( 76, 110 ] 1 0.312% 90.312% ( 110, 170 ] 1 0.312% 90.625% ( 250, 380 ] 3 0.938% 91.562% ( 380, 580 ] 2 0.625% 92.188% ( 580, 870 ] 8 2.500% 94.688% # ( 870, 1300 ] 4 1.250% 95.938% ( 1300, 1900 ] 4 1.250% 97.188% ( 1900, 2900 ] 4 1.250% 98.438% ( 2900, 4400 ] 2 0.625% 99.062% ( 4400, 6600 ] 3 0.938% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 817.9000 StdDev: 937.21 Min: 94 Median: 236.6667 Max: 3282 Percentiles: P50: 236.67 P75: 1192.50 P99: 3282.00 P99.9: 3282.00 P99.99: 3282.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 3 15.000% 25.000% ### ( 170, 250 ] 6 30.000% 55.000% ###### ( 250, 380 ] 1 5.000% 60.000% # ( 870, 1300 ] 4 20.000% 80.000% #### ( 1900, 2900 ] 3 15.000% 95.000% ### ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 36.4 total, 13.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 162.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.110 H:M:S, 52.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 75.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:9.740 H:M:S, 75.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/11/17-11:06:37 ... thread 0: (1000000,7000000) ops and (276677.4,176219.9) ops/second in (3.614318,39.723097) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 2.09 GB 6.3 5.5 0.0 5.5 12.1 6.6 0.0 1.8 134.7 296.6 41.61 38.27 116 0.359 5692K 6059 0.0 0.0 L1 0/0 0.00 KB 0.0 4.3 4.3 0.0 4.2 4.2 0.2 1.0 223.5 219.3 19.72 18.11 2 9.858 4473K 82K 0.0 0.0 L2 20/18 2.06 GB 2.6 1.5 1.4 0.1 1.5 1.4 3.2 1.1 209.2 208.7 7.35 6.73 3 2.449 275K 88 0.0 0.0 L3 28/9 1.93 GB 1.7 3.0 1.3 1.7 2.9 1.3 1.2 2.3 214.1 211.9 14.19 12.84 6 2.365 3085K 32K 0.0 0.0 L4 171/0 9.40 GB 1.0 0.5 0.5 0.0 0.5 0.5 0.7 1.0 139.9 139.7 3.68 2.50 6 0.613 522K 645 0.0 0.0 L5 1060/0 87.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1290/37 102.60 GB 0.0 14.7 7.4 7.3 21.2 13.9 6.6 3.2 174.5 251.0 86.54 78.45 133 0.651 14M 121K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.7 7.4 7.3 21.2 13.9 6.5 3.2 174.5 251.0 86.54 78.45 133 0.651 14M 121K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.7 7.4 7.3 14.6 7.3 0.0 0.0 226.7 224.8 66.62 61.38 37 1.801 14M 121K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 338.5 19.91 17.08 96 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 40.0 total, 39.7 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.21 GB write, 543.30 MB/s write, 14.75 GB read, 377.78 MB/s read, 86.5 seconds Interval compaction: 21.21 GB write, 546.69 MB/s write, 14.75 GB read, 380.14 MB/s read, 86.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 24, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2589957 Average: 2.6213 StdDev: 18.14 Min: 0 Median: 1.3673 Max: 4737 Percentiles: P50: 1.37 P75: 1.79 P99: 5.98 P99.9: 149.10 P99.99: 474.59 ------------------------------------------------------ [ 0, 1 ] 732307 28.275% 28.275% ###### ( 1, 2 ] 1531795 59.144% 87.419% ############ ( 2, 3 ] 167106 6.452% 93.871% # ( 3, 4 ] 77113 2.977% 96.848% # ( 4, 6 ] 56441 2.179% 99.027% ( 6, 10 ] 10628 0.410% 99.438% ( 10, 15 ] 3340 0.129% 99.567% ( 15, 22 ] 673 0.026% 99.593% ( 22, 34 ] 25 0.001% 99.593% ( 34, 51 ] 10 0.000% 99.594% ( 51, 76 ] 82 0.003% 99.597% ( 76, 110 ] 5440 0.210% 99.807% ( 110, 170 ] 3694 0.143% 99.950% ( 170, 250 ] 509 0.020% 99.969% ( 250, 380 ] 369 0.014% 99.984% ( 380, 580 ] 351 0.014% 99.997% ( 580, 870 ] 150 0.006% 100.003% ( 870, 1300 ] 50 0.002% 100.005% ( 1300, 1900 ] 39 0.002% 100.006% ( 1900, 2900 ] 21 0.001% 100.007% ( 2900, 4400 ] 19 0.001% 100.008% ( 4400, 6600 ] 1 0.000% 100.008% ** Level 1 read latency histogram (micros): Count: 1024676 Average: 3.9420 StdDev: 41.56 Min: 1 Median: 1.8249 Max: 8798 Percentiles: P50: 1.82 P75: 2.70 P99: 8.87 P99.9: 72.23 P99.99: 220.89 ------------------------------------------------------ [ 0, 1 ] 22119 2.159% 2.159% ( 1, 2 ] 594253 57.994% 60.153% ############ ( 2, 3 ] 217834 21.259% 81.412% #### ( 3, 4 ] 91012 8.882% 90.294% ## ( 4, 6 ] 74124 7.234% 97.528% # ( 6, 10 ] 21041 2.053% 99.581% ( 10, 15 ] 2867 0.280% 99.861% ( 15, 22 ] 356 0.035% 99.896% ( 22, 34 ] 13 0.001% 99.897% ( 34, 51 ] 7 0.001% 99.898% ( 51, 76 ] 31 0.003% 99.901% ( 76, 110 ] 191 0.019% 99.919% ( 110, 170 ] 488 0.048% 99.967% ( 170, 250 ] 375 0.037% 100.003% ( 250, 380 ] 390 0.038% 100.041% ( 380, 580 ] 376 0.037% 100.078% ( 580, 870 ] 288 0.028% 100.106% ( 870, 1300 ] 126 0.012% 100.119% ( 1300, 1900 ] 62 0.006% 100.125% ( 1900, 2900 ] 40 0.004% 100.129% ( 2900, 4400 ] 49 0.005% 100.133% ( 4400, 6600 ] 9 0.001% 100.134% ( 6600, 9900 ] 1 0.000% 100.134% ** Level 2 read latency histogram (micros): Count: 77087 Average: 2.9633 StdDev: 24.12 Min: 1 Median: 1.6772 Max: 2463 Percentiles: P50: 1.68 P75: 2.35 P99: 7.96 P99.9: 13.79 P99.99: 18.35 ------------------------------------------------------ [ 0, 1 ] 7226 9.374% 9.374% ## ( 1, 2 ] 46249 59.996% 69.370% ############ ( 2, 3 ] 12257 15.900% 85.270% ### ( 3, 4 ] 5633 7.307% 92.577% # ( 4, 6 ] 4447 5.769% 98.346% # ( 6, 10 ] 1034 1.341% 99.687% ( 10, 15 ] 219 0.284% 99.971% ( 15, 22 ] 34 0.044% 100.016% ( 22, 34 ] 4 0.005% 100.021% ( 34, 51 ] 3 0.004% 100.025% ( 51, 76 ] 2 0.003% 100.027% ( 76, 110 ] 4 0.005% 100.032% ( 110, 170 ] 5 0.006% 100.039% ( 170, 250 ] 6 0.008% 100.047% ( 250, 380 ] 9 0.012% 100.058% ( 380, 580 ] 10 0.013% 100.071% ( 580, 870 ] 5 0.006% 100.078% ( 870, 1300 ] 4 0.005% 100.083% ( 1300, 1900 ] 4 0.005% 100.088% ( 1900, 2900 ] 5 0.006% 100.095% ** Level 3 read latency histogram (micros): Count: 517212 Average: 4.6485 StdDev: 50.58 Min: 0 Median: 1.7776 Max: 5392 Percentiles: P50: 1.78 P75: 2.61 P99: 9.44 P99.9: 427.76 P99.99: 864.17 ------------------------------------------------------ [ 0, 1 ] 29443 5.693% 5.693% # ( 1, 2 ] 294695 56.978% 62.670% ########### ( 2, 3 ] 104089 20.125% 82.795% #### ( 3, 4 ] 39945 7.723% 90.518% ## ( 4, 6 ] 35409 6.846% 97.365% # ( 6, 10 ] 9844 1.903% 99.268% ( 10, 15 ] 1582 0.306% 99.574% ( 15, 22 ] 241 0.047% 99.620% ( 22, 34 ] 44 0.009% 99.629% ( 34, 51 ] 9 0.002% 99.631% ( 51, 76 ] 6 0.001% 99.632% ( 76, 110 ] 227 0.044% 99.676% ( 110, 170 ] 462 0.089% 99.765% ( 170, 250 ] 317 0.061% 99.826% ( 250, 380 ] 308 0.060% 99.886% ( 380, 580 ] 309 0.060% 99.945% ( 580, 870 ] 235 0.045% 99.991% ( 870, 1300 ] 137 0.026% 100.017% ( 1300, 1900 ] 48 0.009% 100.027% ( 1900, 2900 ] 44 0.009% 100.035% ( 2900, 4400 ] 30 0.006% 100.041% ( 4400, 6600 ] 7 0.001% 100.042% ** Level 4 read latency histogram (micros): Count: 4014 Average: 113.3979 StdDev: 509.70 Min: 0 Median: 1.9852 Max: 7997 Percentiles: P50: 1.99 P75: 3.43 P99: 2993.00 P99.9: 6156.92 P99.99: 7997.00 ------------------------------------------------------ [ 0, 1 ] 149 3.712% 3.712% # ( 1, 2 ] 1886 46.986% 50.698% ######### ( 2, 3 ] 799 19.905% 70.603% #### ( 3, 4 ] 414 10.314% 80.917% ## ( 4, 6 ] 244 6.079% 86.996% # ( 6, 10 ] 123 3.064% 90.060% # ( 10, 15 ] 31 0.772% 90.832% ( 15, 22 ] 4 0.100% 90.932% ( 22, 34 ] 2 0.050% 90.982% ( 76, 110 ] 3 0.075% 91.056% ( 110, 170 ] 13 0.324% 91.380% ( 170, 250 ] 24 0.598% 91.978% ( 250, 380 ] 32 0.797% 92.775% ( 380, 580 ] 63 1.570% 94.345% ( 580, 870 ] 71 1.769% 96.114% ( 870, 1300 ] 46 1.146% 97.260% ( 1300, 1900 ] 45 1.121% 98.381% ( 1900, 2900 ] 23 0.573% 98.954% ( 2900, 4400 ] 30 0.747% 99.701% ( 4400, 6600 ] 10 0.249% 99.950% ( 6600, 9900 ] 2 0.050% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 1184.5625 StdDev: 1179.96 Min: 94 Median: 787.1429 Max: 5483 Percentiles: P50: 787.14 P75: 1728.57 P99: 4840.00 P99.9: 5483.00 P99.99: 5483.00 ------------------------------------------------------ ( 76, 110 ] 2 2.500% 2.500% # ( 110, 170 ] 8 10.000% 12.500% ## ( 170, 250 ] 12 15.000% 27.500% ### ( 250, 380 ] 6 7.500% 35.000% ## ( 380, 580 ] 7 8.750% 43.750% ## ( 580, 870 ] 7 8.750% 52.500% ## ( 870, 1300 ] 13 16.250% 68.750% ### ( 1300, 1900 ] 7 8.750% 77.500% ## ( 1900, 2900 ] 8 10.000% 87.500% ## ( 2900, 4400 ] 9 11.250% 98.750% ## ( 4400, 6600 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 40.0 total, 3.6 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 172.36 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.877 H:M:S, 49.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 272.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.767 H:M:S, 21.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/17-11:06:43 ... thread 0: (1000000,8000000) ops and (171972.6,175677.5) ops/second in (5.814881,45.537978) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 3.13 GB 81.8 6.2 0.0 6.2 13.8 7.6 0.0 1.8 125.8 281.7 50.07 43.99 131 0.382 6396K 6954 0.0 0.0 L1 0/0 0.00 KB 0.0 4.3 4.3 0.0 4.2 4.2 0.2 1.0 223.5 219.3 19.72 18.11 2 9.858 4473K 82K 0.0 0.0 L2 0/0 0.00 KB 0.0 1.5 1.4 0.1 1.5 1.4 3.2 1.1 209.2 208.7 7.35 6.73 3 2.449 275K 88 0.0 0.0 L3 13/0 888.92 MB 0.9 5.4 3.4 2.1 5.4 3.3 1.2 1.6 188.6 187.4 29.55 24.37 17 1.738 5662K 37K 0.0 0.0 L4 180/0 9.57 GB 1.0 3.7 3.5 0.2 3.7 3.5 0.8 1.1 124.1 123.9 30.59 18.00 49 0.624 3759K 2559 0.0 0.0 L5 1096/0 90.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1307/14 103.63 GB 0.0 21.1 12.5 8.6 28.6 20.0 9.6 3.7 157.4 213.4 137.27 111.20 202 0.680 20M 129K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.1 12.5 8.6 28.6 20.0 9.5 3.7 157.4 213.4 137.27 111.20 202 0.680 20M 129K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.1 12.5 8.6 21.0 12.4 0.0 0.0 192.8 191.6 112.09 91.16 93 1.205 20M 129K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 310.2 25.18 20.04 109 0.231 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 45.8 total, 45.5 interval Flush(GB): cumulative 7.628, interval 7.628 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.60 GB write, 639.65 MB/s write, 21.11 GB read, 472.02 MB/s read, 137.3 seconds Interval compaction: 28.60 GB write, 643.12 MB/s write, 21.11 GB read, 474.59 MB/s read, 137.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 69, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 69, interval: 84 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3070471 Average: 2.8753 StdDev: 31.38 Min: 0 Median: 1.4302 Max: 14662 Percentiles: P50: 1.43 P75: 1.85 P99: 6.84 P99.9: 147.17 P99.99: 540.87 ------------------------------------------------------ [ 0, 1 ] 755886 24.618% 24.618% ##### ( 1, 2 ] 1811743 59.005% 83.623% ############ ( 2, 3 ] 257716 8.393% 92.017% ## ( 3, 4 ] 117900 3.840% 95.856% # ( 4, 6 ] 92687 3.019% 98.875% # ( 6, 10 ] 18321 0.597% 99.472% ( 10, 15 ] 4463 0.145% 99.617% ( 15, 22 ] 796 0.026% 99.643% ( 22, 34 ] 34 0.001% 99.644% ( 34, 51 ] 14 0.000% 99.645% ( 51, 76 ] 83 0.003% 99.647% ( 76, 110 ] 5445 0.177% 99.825% ( 110, 170 ] 3735 0.122% 99.946% ( 170, 250 ] 543 0.018% 99.964% ( 250, 380 ] 437 0.014% 99.978% ( 380, 580 ] 450 0.015% 99.993% ( 580, 870 ] 250 0.008% 100.001% ( 870, 1300 ] 155 0.005% 100.006% ( 1300, 1900 ] 93 0.003% 100.009% ( 1900, 2900 ] 57 0.002% 100.011% ( 2900, 4400 ] 70 0.002% 100.013% ( 4400, 6600 ] 20 0.001% 100.014% ( 6600, 9900 ] 3 0.000% 100.014% ( 9900, 14000 ] 1 0.000% 100.014% ( 14000, 22000 ] 1 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 1122956 Average: 4.5286 StdDev: 66.80 Min: 1 Median: 1.8376 Max: 15141 Percentiles: P50: 1.84 P75: 2.73 P99: 8.99 P99.9: 116.24 P99.99: 308.56 ------------------------------------------------------ [ 0, 1 ] 23115 2.058% 2.058% ( 1, 2 ] 642709 57.234% 59.292% ########### ( 2, 3 ] 241537 21.509% 80.801% #### ( 3, 4 ] 101742 9.060% 89.861% ## ( 4, 6 ] 84864 7.557% 97.419% ## ( 6, 10 ] 23766 2.116% 99.535% ( 10, 15 ] 3376 0.301% 99.836% ( 15, 22 ] 414 0.037% 99.872% ( 22, 34 ] 24 0.002% 99.875% ( 34, 51 ] 13 0.001% 99.876% ( 51, 76 ] 31 0.003% 99.878% ( 76, 110 ] 191 0.017% 99.895% ( 110, 170 ] 491 0.044% 99.939% ( 170, 250 ] 386 0.034% 99.974% ( 250, 380 ] 410 0.037% 100.010% ( 380, 580 ] 416 0.037% 100.047% ( 580, 870 ] 339 0.030% 100.077% ( 870, 1300 ] 171 0.015% 100.093% ( 1300, 1900 ] 99 0.009% 100.101% ( 1900, 2900 ] 85 0.008% 100.109% ( 2900, 4400 ] 102 0.009% 100.118% ( 4400, 6600 ] 35 0.003% 100.121% ( 6600, 9900 ] 10 0.001% 100.122% ( 9900, 14000 ] 5 0.000% 100.122% ( 14000, 22000 ] 1 0.000% 100.123% ** Level 2 read latency histogram (micros): Count: 290394 Average: 4.8484 StdDev: 73.00 Min: 1 Median: 1.8754 Max: 11964 Percentiles: P50: 1.88 P75: 2.84 P99: 8.88 P99.9: 14.69 P99.99: 159.34 ------------------------------------------------------ [ 0, 1 ] 9568 3.295% 3.295% # ( 1, 2 ] 154926 53.350% 56.645% ########### ( 2, 3 ] 63542 21.881% 78.526% #### ( 3, 4 ] 29083 10.015% 88.541% ## ( 4, 6 ] 26326 9.066% 97.607% ## ( 6, 10 ] 5621 1.936% 99.543% ( 10, 15 ] 1106 0.381% 99.924% ( 15, 22 ] 135 0.046% 99.970% ( 22, 34 ] 7 0.002% 99.972% ( 34, 51 ] 5 0.002% 99.974% ( 51, 76 ] 7 0.002% 99.977% ( 76, 110 ] 11 0.004% 99.980% ( 110, 170 ] 34 0.012% 99.992% ( 170, 250 ] 34 0.012% 100.004% ( 250, 380 ] 56 0.019% 100.023% ( 380, 580 ] 54 0.019% 100.042% ( 580, 870 ] 79 0.027% 100.069% ( 870, 1300 ] 66 0.023% 100.092% ( 1300, 1900 ] 42 0.014% 100.106% ( 1900, 2900 ] 47 0.016% 100.122% ( 2900, 4400 ] 43 0.015% 100.137% ( 4400, 6600 ] 11 0.004% 100.141% ( 6600, 9900 ] 1 0.000% 100.141% ( 9900, 14000 ] 1 0.000% 100.142% ** Level 3 read latency histogram (micros): Count: 1250784 Average: 7.1180 StdDev: 108.03 Min: 0 Median: 1.8904 Max: 11965 Percentiles: P50: 1.89 P75: 2.85 P99: 9.34 P99.9: 288.90 P99.99: 607.44 ------------------------------------------------------ [ 0, 1 ] 36624 2.928% 2.928% # ( 1, 2 ] 661211 52.864% 55.792% ########### ( 2, 3 ] 283290 22.649% 78.441% ##### ( 3, 4 ] 122654 9.806% 88.247% ## ( 4, 6 ] 113062 9.039% 97.286% ## ( 6, 10 ] 25659 2.051% 99.338% ( 10, 15 ] 4953 0.396% 99.734% ( 15, 22 ] 650 0.052% 99.786% ( 22, 34 ] 77 0.006% 99.792% ( 34, 51 ] 26 0.002% 99.794% ( 51, 76 ] 9 0.001% 99.795% ( 76, 110 ] 233 0.019% 99.813% ( 110, 170 ] 496 0.040% 99.853% ( 170, 250 ] 439 0.035% 99.888% ( 250, 380 ] 502 0.040% 99.928% ( 380, 580 ] 702 0.056% 99.984% ( 580, 870 ] 760 0.061% 100.045% ( 870, 1300 ] 596 0.048% 100.093% ( 1300, 1900 ] 305 0.024% 100.117% ( 1900, 2900 ] 352 0.028% 100.145% ( 2900, 4400 ] 390 0.031% 100.176% ( 4400, 6600 ] 87 0.007% 100.183% ( 6600, 9900 ] 33 0.003% 100.186% ( 9900, 14000 ] 10 0.001% 100.187% ** Level 4 read latency histogram (micros): Count: 49857 Average: 77.5833 StdDev: 381.71 Min: 0 Median: 1.9257 Max: 13976 Percentiles: P50: 1.93 P75: 3.05 P99: 1842.78 P99.9: 4371.50 P99.99: 6548.37 ------------------------------------------------------ [ 0, 1 ] 1423 2.854% 2.854% # ( 1, 2 ] 25393 50.932% 53.786% ########## ( 2, 3 ] 10306 20.671% 74.457% #### ( 3, 4 ] 4972 9.973% 84.429% ## ( 4, 6 ] 3021 6.059% 90.489% # ( 6, 10 ] 959 1.924% 92.412% ( 10, 15 ] 190 0.381% 92.793% ( 15, 22 ] 40 0.080% 92.874% ( 22, 34 ] 6 0.012% 92.886% ( 34, 51 ] 2 0.004% 92.890% ( 51, 76 ] 1 0.002% 92.892% ( 76, 110 ] 38 0.076% 92.968% ( 110, 170 ] 120 0.241% 93.209% ( 170, 250 ] 204 0.409% 93.618% ( 250, 380 ] 329 0.660% 94.278% ( 380, 580 ] 611 1.226% 95.503% ( 580, 870 ] 795 1.595% 97.098% ( 870, 1300 ] 630 1.264% 98.361% ( 1300, 1900 ] 352 0.706% 99.067% ( 1900, 2900 ] 216 0.433% 99.501% ( 2900, 4400 ] 203 0.407% 99.908% ( 4400, 6600 ] 42 0.084% 99.992% ( 6600, 9900 ] 5 0.010% 100.002% ( 9900, 14000 ] 2 0.004% 100.006% ** Level 5 read latency histogram (micros): Count: 260 Average: 1380.3654 StdDev: 1314.40 Min: 89 Median: 893.8889 Max: 8766 Percentiles: P50: 893.89 P75: 2136.84 P99: 6097.14 P99.9: 8766.00 P99.99: 8766.00 ------------------------------------------------------ ( 76, 110 ] 6 2.308% 2.308% ( 110, 170 ] 14 5.385% 7.692% # ( 170, 250 ] 21 8.077% 15.769% ## ( 250, 380 ] 24 9.231% 25.000% ## ( 380, 580 ] 33 12.692% 37.692% ### ( 580, 870 ] 30 11.538% 49.231% ## ( 870, 1300 ] 36 13.846% 63.077% ### ( 1300, 1900 ] 22 8.462% 71.538% ## ( 1900, 2900 ] 38 14.615% 86.154% ### ( 2900, 4400 ] 28 10.769% 96.923% ## ( 4400, 6600 ] 7 2.692% 99.615% # ( 6600, 9900 ] 1 0.385% 100.000% ** DB Stats ** Uptime(secs): 45.8 total, 5.8 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 171.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.660 H:M:S, 49.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 169.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.783 H:M:S, 47.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-11:06:48 ... thread 0: (1000000,9000000) ops and (200511.3,178128.8) ops/second in (4.987250,50.525228) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/8 2.03 GB 0.0 7.4 0.0 7.4 16.0 8.5 0.0 1.9 131.8 283.1 57.82 51.34 151 0.383 7739K 8347 0.0 0.0 L1 25/25 1.63 GB 0.0 6.3 6.3 0.0 6.2 6.2 0.2 1.0 213.5 210.1 30.37 27.26 3 10.122 6582K 101K 0.0 0.0 L2 0/0 0.00 KB 0.0 1.5 1.4 0.1 1.5 1.4 3.5 1.1 209.2 208.7 7.35 6.73 3 2.449 275K 88 0.0 0.0 L3 16/3 1.19 GB 0.9 5.4 3.4 2.1 5.4 3.3 1.5 1.6 188.6 187.4 29.55 24.37 17 1.738 5662K 37K 0.0 0.0 L4 181/10 9.63 GB 1.0 3.7 3.5 0.2 3.7 3.5 0.9 1.1 124.1 123.9 30.59 18.00 49 0.624 3759K 2559 0.0 0.0 L5 1096/0 90.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1326/46 104.53 GB 0.0 24.4 14.6 9.9 32.8 23.0 10.4 3.8 160.7 215.9 155.67 127.70 223 0.698 24M 150K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.4 14.6 9.9 32.8 23.0 10.3 3.8 160.7 215.9 155.67 127.70 223 0.698 24M 150K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.4 14.6 9.9 24.3 14.4 0.0 0.0 195.8 194.6 127.74 105.22 99 1.290 24M 150K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 313.6 27.92 22.48 124 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.8 total, 50.5 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.82 GB write, 661.97 MB/s write, 24.43 GB read, 492.62 MB/s read, 155.7 seconds Interval compaction: 32.82 GB write, 665.22 MB/s write, 24.43 GB read, 495.03 MB/s read, 155.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 69, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 69, interval: 93 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3627955 Average: 2.7887 StdDev: 29.33 Min: 0 Median: 1.4376 Max: 14662 Percentiles: P50: 1.44 P75: 1.85 P99: 6.62 P99.9: 138.97 P99.99: 464.64 ------------------------------------------------------ [ 0, 1 ] 856728 23.615% 23.615% ##### ( 1, 2 ] 2187514 60.296% 83.911% ############ ( 2, 3 ] 307284 8.470% 92.381% ## ( 3, 4 ] 134656 3.712% 96.092% # ( 4, 6 ] 102037 2.813% 98.905% # ( 6, 10 ] 22471 0.619% 99.524% ( 10, 15 ] 5208 0.144% 99.668% ( 15, 22 ] 895 0.025% 99.692% ( 22, 34 ] 37 0.001% 99.693% ( 34, 51 ] 16 0.000% 99.694% ( 51, 76 ] 88 0.002% 99.696% ( 76, 110 ] 5546 0.153% 99.849% ( 110, 170 ] 3826 0.105% 99.955% ( 170, 250 ] 592 0.016% 99.971% ( 250, 380 ] 486 0.013% 99.984% ( 380, 580 ] 492 0.014% 99.998% ( 580, 870 ] 280 0.008% 100.006% ( 870, 1300 ] 169 0.005% 100.010% ( 1300, 1900 ] 104 0.003% 100.013% ( 1900, 2900 ] 62 0.002% 100.015% ( 2900, 4400 ] 70 0.002% 100.017% ( 4400, 6600 ] 20 0.001% 100.017% ( 6600, 9900 ] 3 0.000% 100.017% ( 9900, 14000 ] 1 0.000% 100.017% ( 14000, 22000 ] 1 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 1123102 Average: 4.5583 StdDev: 66.94 Min: 1 Median: 1.8377 Max: 15141 Percentiles: P50: 1.84 P75: 2.73 P99: 9.00 P99.9: 124.45 P99.99: 322.97 ------------------------------------------------------ [ 0, 1 ] 23117 2.058% 2.058% ( 1, 2 ] 642733 57.228% 59.287% ########### ( 2, 3 ] 241568 21.509% 80.796% #### ( 3, 4 ] 101748 9.060% 89.855% ## ( 4, 6 ] 84865 7.556% 97.412% ## ( 6, 10 ] 23768 2.116% 99.528% ( 10, 15 ] 3376 0.301% 99.828% ( 15, 22 ] 415 0.037% 99.865% ( 22, 34 ] 24 0.002% 99.868% ( 34, 51 ] 13 0.001% 99.869% ( 51, 76 ] 31 0.003% 99.871% ( 76, 110 ] 201 0.018% 99.889% ( 110, 170 ] 498 0.044% 99.934% ( 170, 250 ] 393 0.035% 99.969% ( 250, 380 ] 427 0.038% 100.007% ( 380, 580 ] 437 0.039% 100.046% ( 580, 870 ] 347 0.031% 100.076% ( 870, 1300 ] 180 0.016% 100.093% ( 1300, 1900 ] 99 0.009% 100.101% ( 1900, 2900 ] 85 0.008% 100.109% ( 2900, 4400 ] 102 0.009% 100.118% ( 4400, 6600 ] 35 0.003% 100.121% ( 6600, 9900 ] 10 0.001% 100.122% ( 9900, 14000 ] 5 0.000% 100.122% ( 14000, 22000 ] 1 0.000% 100.123% ** Level 2 read latency histogram (micros): Count: 297214 Average: 4.9625 StdDev: 72.98 Min: 1 Median: 1.8729 Max: 11964 Percentiles: P50: 1.87 P75: 2.83 P99: 8.97 P99.9: 16.39 P99.99: 300.75 ------------------------------------------------------ [ 0, 1 ] 9786 3.293% 3.293% # ( 1, 2 ] 159030 53.507% 56.799% ########### ( 2, 3 ] 64788 21.798% 78.598% #### ( 3, 4 ] 29521 9.933% 88.530% ## ( 4, 6 ] 26788 9.013% 97.544% ## ( 6, 10 ] 5834 1.963% 99.506% ( 10, 15 ] 1141 0.384% 99.890% ( 15, 22 ] 145 0.049% 99.939% ( 22, 34 ] 7 0.002% 99.941% ( 34, 51 ] 5 0.002% 99.943% ( 51, 76 ] 7 0.002% 99.945% ( 76, 110 ] 13 0.004% 99.950% ( 110, 170 ] 46 0.015% 99.965% ( 170, 250 ] 44 0.015% 99.980% ( 250, 380 ] 75 0.025% 100.005% ( 380, 580 ] 70 0.024% 100.029% ( 580, 870 ] 103 0.035% 100.064% ( 870, 1300 ] 75 0.025% 100.089% ( 1300, 1900 ] 44 0.015% 100.104% ( 1900, 2900 ] 47 0.016% 100.119% ( 2900, 4400 ] 43 0.014% 100.134% ( 4400, 6600 ] 11 0.004% 100.138% ( 6600, 9900 ] 1 0.000% 100.138% ( 9900, 14000 ] 1 0.000% 100.138% ** Level 3 read latency histogram (micros): Count: 1250785 Average: 7.1181 StdDev: 108.03 Min: 0 Median: 1.8904 Max: 11965 Percentiles: P50: 1.89 P75: 2.85 P99: 9.34 P99.9: 288.90 P99.99: 607.44 ------------------------------------------------------ [ 0, 1 ] 36624 2.928% 2.928% # ( 1, 2 ] 661211 52.864% 55.792% ########### ( 2, 3 ] 283290 22.649% 78.441% ##### ( 3, 4 ] 122654 9.806% 88.247% ## ( 4, 6 ] 113062 9.039% 97.286% ## ( 6, 10 ] 25659 2.051% 99.338% ( 10, 15 ] 4953 0.396% 99.734% ( 15, 22 ] 650 0.052% 99.786% ( 22, 34 ] 77 0.006% 99.792% ( 34, 51 ] 26 0.002% 99.794% ( 51, 76 ] 9 0.001% 99.795% ( 76, 110 ] 233 0.019% 99.813% ( 110, 170 ] 496 0.040% 99.853% ( 170, 250 ] 440 0.035% 99.888% ( 250, 380 ] 502 0.040% 99.928% ( 380, 580 ] 702 0.056% 99.984% ( 580, 870 ] 760 0.061% 100.045% ( 870, 1300 ] 596 0.048% 100.093% ( 1300, 1900 ] 305 0.024% 100.117% ( 1900, 2900 ] 352 0.028% 100.145% ( 2900, 4400 ] 390 0.031% 100.176% ( 4400, 6600 ] 87 0.007% 100.183% ( 6600, 9900 ] 33 0.003% 100.186% ( 9900, 14000 ] 10 0.001% 100.187% ** Level 4 read latency histogram (micros): Count: 70555 Average: 56.6403 StdDev: 323.66 Min: 0 Median: 1.8744 Max: 13976 Percentiles: P50: 1.87 P75: 2.93 P99: 1469.04 P99.9: 4109.15 P99.99: 5654.24 ------------------------------------------------------ [ 0, 1 ] 2081 2.949% 2.949% # ( 1, 2 ] 37966 53.811% 56.760% ########### ( 2, 3 ] 13885 19.680% 76.440% #### ( 3, 4 ] 6563 9.302% 85.742% ## ( 4, 6 ] 4480 6.350% 92.091% # ( 6, 10 ] 1478 2.095% 94.186% ( 10, 15 ] 276 0.391% 94.577% ( 15, 22 ] 68 0.096% 94.674% ( 22, 34 ] 8 0.011% 94.685% ( 34, 51 ] 2 0.003% 94.688% ( 51, 76 ] 1 0.001% 94.689% ( 76, 110 ] 52 0.074% 94.763% ( 110, 170 ] 172 0.244% 95.007% ( 170, 250 ] 262 0.371% 95.378% ( 250, 380 ] 373 0.529% 95.907% ( 380, 580 ] 632 0.896% 96.802% ( 580, 870 ] 816 1.157% 97.959% ( 870, 1300 ] 635 0.900% 98.859% ( 1300, 1900 ] 353 0.500% 99.359% ( 1900, 2900 ] 217 0.308% 99.667% ( 2900, 4400 ] 204 0.289% 99.956% ( 4400, 6600 ] 42 0.060% 100.016% ( 6600, 9900 ] 5 0.007% 100.023% ( 9900, 14000 ] 2 0.003% 100.026% ** Level 5 read latency histogram (micros): Count: 260 Average: 1380.3654 StdDev: 1314.40 Min: 89 Median: 893.8889 Max: 8766 Percentiles: P50: 893.89 P75: 2136.84 P99: 6097.14 P99.9: 8766.00 P99.99: 8766.00 ------------------------------------------------------ ( 76, 110 ] 6 2.308% 2.308% ( 110, 170 ] 14 5.385% 7.692% # ( 170, 250 ] 21 8.077% 15.769% ## ( 250, 380 ] 24 9.231% 25.000% ## ( 380, 580 ] 33 12.692% 37.692% ### ( 580, 870 ] 30 11.538% 49.231% ## ( 870, 1300 ] 36 13.846% 63.077% ### ( 1300, 1900 ] 22 8.462% 71.538% ## ( 1900, 2900 ] 38 14.615% 86.154% ### ( 2900, 4400 ] 28 10.769% 96.923% ## ( 4400, 6600 ] 7 2.692% 99.615% # ( 6600, 9900 ] 1 0.385% 100.000% ** DB Stats ** Uptime(secs): 50.8 total, 5.0 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 174.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.817 H:M:S, 48.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 197.34 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.157 H:M:S, 43.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/11/17-11:06:51 ... thread 0: (1000000,10000000) ops and (314890.0,186216.5) ops/second in (3.175712,53.700940) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/12 3.01 GB 69.2 7.9 0.0 7.9 17.5 9.5 0.0 1.8 129.6 285.2 62.70 55.85 167 0.375 8251K 8873 0.0 0.0 L1 25/25 1.63 GB 0.0 6.3 6.3 0.0 6.2 6.2 0.2 1.0 213.5 210.1 30.37 27.26 3 10.122 6582K 101K 0.0 0.0 L2 0/0 0.00 KB 0.0 1.5 1.4 0.1 1.5 1.4 3.5 1.1 209.2 208.7 7.35 6.73 3 2.449 275K 88 0.0 0.0 L3 13/0 871.64 MB 0.9 5.4 3.4 2.1 5.4 3.3 1.5 1.6 188.6 187.4 29.55 24.37 17 1.738 5662K 37K 0.0 0.0 L4 178/0 9.66 GB 1.0 4.2 3.9 0.4 4.2 3.9 0.9 1.1 128.7 128.5 33.60 20.52 52 0.646 4284K 2559 0.0 0.0 L5 1100/0 90.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1332/37 105.52 GB 0.0 25.4 14.9 10.5 34.8 24.3 10.8 3.7 159.2 218.0 163.57 134.72 242 0.676 25M 150K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.4 14.9 10.5 34.8 24.3 10.6 3.7 159.2 218.0 163.57 134.72 242 0.676 25M 150K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.4 14.9 10.5 25.3 14.7 0.0 0.0 196.3 195.1 132.68 109.62 104 1.276 25M 150K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 316.1 30.89 25.10 138 0.224 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.9 total, 53.7 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.81 GB write, 660.81 MB/s write, 25.43 GB read, 482.76 MB/s read, 163.6 seconds Interval compaction: 34.81 GB write, 663.85 MB/s write, 25.43 GB read, 484.99 MB/s read, 163.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 76, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 76, interval: 100 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3906461 Average: 2.7648 StdDev: 28.59 Min: 0 Median: 1.4444 Max: 14662 Percentiles: P50: 1.44 P75: 1.86 P99: 6.57 P99.9: 136.23 P99.99: 452.65 ------------------------------------------------------ [ 0, 1 ] 897843 22.984% 22.984% ##### ( 1, 2 ] 2374979 60.796% 83.780% ############ ( 2, 3 ] 337411 8.637% 92.417% ## ( 3, 4 ] 145057 3.713% 96.130% # ( 4, 6 ] 108611 2.780% 98.911% # ( 6, 10 ] 24663 0.631% 99.542% ( 10, 15 ] 5653 0.145% 99.687% ( 15, 22 ] 928 0.024% 99.710% ( 22, 34 ] 41 0.001% 99.711% ( 34, 51 ] 17 0.000% 99.712% ( 51, 76 ] 91 0.002% 99.714% ( 76, 110 ] 5562 0.142% 99.857% ( 110, 170 ] 3886 0.099% 99.956% ( 170, 250 ] 634 0.016% 99.972% ( 250, 380 ] 508 0.013% 99.985% ( 380, 580 ] 513 0.013% 99.998% ( 580, 870 ] 305 0.008% 100.006% ( 870, 1300 ] 177 0.005% 100.011% ( 1300, 1900 ] 110 0.003% 100.014% ( 1900, 2900 ] 62 0.002% 100.015% ( 2900, 4400 ] 72 0.002% 100.017% ( 4400, 6600 ] 20 0.001% 100.017% ( 6600, 9900 ] 3 0.000% 100.018% ( 9900, 14000 ] 1 0.000% 100.018% ( 14000, 22000 ] 1 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 1159816 Average: 4.5098 StdDev: 65.93 Min: 1 Median: 1.8261 Max: 15141 Percentiles: P50: 1.83 P75: 2.71 P99: 9.00 P99.9: 128.54 P99.99: 328.54 ------------------------------------------------------ [ 0, 1 ] 28337 2.443% 2.443% ( 1, 2 ] 667683 57.568% 60.011% ############ ( 2, 3 ] 245536 21.170% 81.181% #### ( 3, 4 ] 102813 8.865% 90.046% ## ( 4, 6 ] 85592 7.380% 97.426% # ( 6, 10 ] 24320 2.097% 99.523% ( 10, 15 ] 3412 0.294% 99.817% ( 15, 22 ] 418 0.036% 99.853% ( 22, 34 ] 25 0.002% 99.855% ( 34, 51 ] 13 0.001% 99.856% ( 51, 76 ] 40 0.003% 99.860% ( 76, 110 ] 300 0.026% 99.886% ( 110, 170 ] 541 0.047% 99.932% ( 170, 250 ] 406 0.035% 99.967% ( 250, 380 ] 437 0.038% 100.005% ( 380, 580 ] 450 0.039% 100.044% ( 580, 870 ] 350 0.030% 100.074% ( 870, 1300 ] 182 0.016% 100.090% ( 1300, 1900 ] 99 0.009% 100.098% ( 1900, 2900 ] 85 0.007% 100.105% ( 2900, 4400 ] 102 0.009% 100.114% ( 4400, 6600 ] 35 0.003% 100.117% ( 6600, 9900 ] 10 0.001% 100.118% ( 9900, 14000 ] 5 0.000% 100.119% ( 14000, 22000 ] 1 0.000% 100.119% ** Level 2 read latency histogram (micros): Count: 355749 Average: 4.6639 StdDev: 66.97 Min: 1 Median: 1.8671 Max: 11964 Percentiles: P50: 1.87 P75: 2.81 P99: 9.02 P99.9: 16.50 P99.99: 286.08 ------------------------------------------------------ [ 0, 1 ] 11143 3.132% 3.132% # ( 1, 2 ] 192284 54.050% 57.183% ########### ( 2, 3 ] 78517 22.071% 79.254% #### ( 3, 4 ] 33966 9.548% 88.801% ## ( 4, 6 ] 30698 8.629% 97.430% ## ( 6, 10 ] 7405 2.082% 99.512% ( 10, 15 ] 1342 0.377% 99.889% ( 15, 22 ] 178 0.050% 99.939% ( 22, 34 ] 13 0.004% 99.943% ( 34, 51 ] 6 0.002% 99.945% ( 51, 76 ] 7 0.002% 99.947% ( 76, 110 ] 23 0.006% 99.953% ( 110, 170 ] 57 0.016% 99.969% ( 170, 250 ] 50 0.014% 99.983% ( 250, 380 ] 88 0.025% 100.008% ( 380, 580 ] 78 0.022% 100.030% ( 580, 870 ] 112 0.031% 100.061% ( 870, 1300 ] 77 0.022% 100.083% ( 1300, 1900 ] 45 0.013% 100.096% ( 1900, 2900 ] 47 0.013% 100.109% ( 2900, 4400 ] 43 0.012% 100.121% ( 4400, 6600 ] 11 0.003% 100.124% ( 6600, 9900 ] 1 0.000% 100.124% ( 9900, 14000 ] 1 0.000% 100.125% ** Level 3 read latency histogram (micros): Count: 1273515 Average: 7.0638 StdDev: 107.13 Min: 0 Median: 1.8896 Max: 11965 Percentiles: P50: 1.89 P75: 2.85 P99: 9.35 P99.9: 292.20 P99.99: 612.59 ------------------------------------------------------ [ 0, 1 ] 37031 2.908% 2.908% # ( 1, 2 ] 674121 52.934% 55.842% ########### ( 2, 3 ] 288448 22.650% 78.491% ##### ( 3, 4 ] 124456 9.773% 88.264% ## ( 4, 6 ] 114737 9.009% 97.274% ## ( 6, 10 ] 26254 2.062% 99.335% ( 10, 15 ] 5040 0.396% 99.731% ( 15, 22 ] 666 0.052% 99.783% ( 22, 34 ] 79 0.006% 99.789% ( 34, 51 ] 26 0.002% 99.791% ( 51, 76 ] 9 0.001% 99.792% ( 76, 110 ] 246 0.019% 99.811% ( 110, 170 ] 507 0.040% 99.851% ( 170, 250 ] 454 0.036% 99.887% ( 250, 380 ] 516 0.041% 99.927% ( 380, 580 ] 711 0.056% 99.983% ( 580, 870 ] 771 0.061% 100.044% ( 870, 1300 ] 601 0.047% 100.091% ( 1300, 1900 ] 306 0.024% 100.115% ( 1900, 2900 ] 352 0.028% 100.143% ( 2900, 4400 ] 390 0.031% 100.173% ( 4400, 6600 ] 87 0.007% 100.180% ( 6600, 9900 ] 33 0.003% 100.183% ( 9900, 14000 ] 10 0.001% 100.183% ** Level 4 read latency histogram (micros): Count: 95959 Average: 43.9809 StdDev: 279.93 Min: 0 Median: 1.8120 Max: 13976 Percentiles: P50: 1.81 P75: 2.76 P99: 1200.99 P99.9: 3915.01 P99.99: 5468.79 ------------------------------------------------------ [ 0, 1 ] 3372 3.514% 3.514% # ( 1, 2 ] 54932 57.245% 60.759% ########### ( 2, 3 ] 17938 18.693% 79.453% #### ( 3, 4 ] 7856 8.187% 87.640% ## ( 4, 6 ] 5299 5.522% 93.162% # ( 6, 10 ] 1949 2.031% 95.193% ( 10, 15 ] 312 0.325% 95.518% ( 15, 22 ] 78 0.081% 95.599% ( 22, 34 ] 8 0.008% 95.607% ( 34, 51 ] 2 0.002% 95.610% ( 51, 76 ] 2 0.002% 95.612% ( 76, 110 ] 86 0.090% 95.701% ( 110, 170 ] 256 0.267% 95.968% ( 170, 250 ] 356 0.371% 96.339% ( 250, 380 ] 472 0.492% 96.831% ( 380, 580 ] 715 0.745% 97.576% ( 580, 870 ] 863 0.899% 98.475% ( 870, 1300 ] 654 0.682% 99.157% ( 1300, 1900 ] 358 0.373% 99.530% ( 1900, 2900 ] 217 0.226% 99.756% ( 2900, 4400 ] 204 0.213% 99.969% ( 4400, 6600 ] 42 0.044% 100.013% ( 6600, 9900 ] 5 0.005% 100.018% ( 9900, 14000 ] 2 0.002% 100.020% ** Level 5 read latency histogram (micros): Count: 280 Average: 1340.9821 StdDev: 1298.95 Min: 89 Median: 843.6364 Max: 8766 Percentiles: P50: 843.64 P75: 2075.00 P99: 6034.29 P99.9: 8766.00 P99.99: 8766.00 ------------------------------------------------------ ( 76, 110 ] 6 2.143% 2.143% ( 110, 170 ] 20 7.143% 9.286% # ( 170, 250 ] 25 8.929% 18.214% ## ( 250, 380 ] 24 8.571% 26.786% ## ( 380, 580 ] 35 12.500% 39.286% ### ( 580, 870 ] 33 11.786% 51.071% ## ( 870, 1300 ] 36 12.857% 63.929% ### ( 1300, 1900 ] 24 8.571% 72.500% ## ( 1900, 2900 ] 40 14.286% 86.786% ### ( 2900, 4400 ] 29 10.357% 97.143% ## ( 4400, 6600 ] 7 2.500% 99.643% # ( 6600, 9900 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 53.9 total, 3.2 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 182.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.243 H:M:S, 46.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 309.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.427 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-11:06:54 ... thread 0: (1000000,11000000) ops and (273674.8,191788.3) ops/second in (3.653972,57.354912) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 3.93 GB 169.9 9.0 0.0 9.0 19.4 10.4 0.0 1.9 132.3 286.2 69.53 62.28 186 0.374 9338K 9963 0.0 0.0 L1 25/25 1.63 GB 0.0 6.3 6.3 0.0 6.2 6.2 0.2 1.0 213.5 210.1 30.37 27.26 3 10.122 6582K 101K 0.0 0.0 L2 0/0 0.00 KB 0.0 1.5 1.4 0.1 1.5 1.4 3.5 1.1 209.2 208.7 7.35 6.73 3 2.449 275K 88 0.0 0.0 L3 13/0 871.64 MB 0.9 5.4 3.4 2.1 5.4 3.3 1.5 1.6 188.6 187.4 29.55 24.37 17 1.738 5662K 37K 0.0 0.0 L4 178/0 9.66 GB 1.0 4.2 3.9 0.4 4.2 3.9 0.9 1.1 128.7 128.5 33.60 20.52 52 0.646 4284K 2559 0.0 0.0 L5 1100/0 90.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1335/37 106.44 GB 0.0 26.5 14.9 11.6 36.8 25.2 10.8 3.5 159.1 221.0 170.39 141.16 261 0.653 26M 151K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.5 14.9 11.6 36.8 25.2 10.6 3.5 159.1 221.0 170.39 141.16 261 0.653 26M 151K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.5 14.9 11.6 26.3 14.7 0.0 0.0 198.3 197.1 136.76 113.62 108 1.266 26M 151K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 318.4 33.63 27.54 153 0.220 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.6 total, 57.4 interval Flush(GB): cumulative 10.458, interval 10.458 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 36.78 GB write, 653.87 MB/s write, 26.48 GB read, 470.73 MB/s read, 170.4 seconds Interval compaction: 36.78 GB write, 656.69 MB/s write, 26.48 GB read, 472.76 MB/s read, 170.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 30, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 30, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 76, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 30, total-stops: 76, interval: 106 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4274193 Average: 2.7262 StdDev: 27.62 Min: 0 Median: 1.4489 Max: 14662 Percentiles: P50: 1.45 P75: 1.86 P99: 6.41 P99.9: 130.84 P99.99: 401.41 ------------------------------------------------------ [ 0, 1 ] 959719 22.454% 22.454% #### ( 1, 2 ] 2622669 61.361% 83.814% ############ ( 2, 3 ] 372610 8.718% 92.532% ## ( 3, 4 ] 157907 3.694% 96.226% # ( 4, 6 ] 115787 2.709% 98.935% # ( 6, 10 ] 27011 0.632% 99.567% ( 10, 15 ] 6073 0.142% 99.709% ( 15, 22 ] 959 0.022% 99.732% ( 22, 34 ] 42 0.001% 99.733% ( 34, 51 ] 19 0.000% 99.733% ( 51, 76 ] 96 0.002% 99.736% ( 76, 110 ] 5651 0.132% 99.868% ( 110, 170 ] 3963 0.093% 99.961% ( 170, 250 ] 659 0.015% 99.976% ( 250, 380 ] 544 0.013% 99.989% ( 380, 580 ] 538 0.013% 100.001% ( 580, 870 ] 317 0.007% 100.009% ( 870, 1300 ] 184 0.004% 100.013% ( 1300, 1900 ] 111 0.003% 100.016% ( 1900, 2900 ] 63 0.001% 100.017% ( 2900, 4400 ] 75 0.002% 100.019% ( 4400, 6600 ] 20 0.000% 100.019% ( 6600, 9900 ] 3 0.000% 100.019% ( 9900, 14000 ] 1 0.000% 100.019% ( 14000, 22000 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 1262786 Average: 4.3691 StdDev: 63.28 Min: 1 Median: 1.7987 Max: 15141 Percentiles: P50: 1.80 P75: 2.65 P99: 8.98 P99.9: 134.26 P99.99: 335.54 ------------------------------------------------------ [ 0, 1 ] 42083 3.333% 3.333% # ( 1, 2 ] 737838 58.429% 61.762% ############ ( 2, 3 ] 256785 20.335% 82.097% #### ( 3, 4 ] 106136 8.405% 90.502% ## ( 4, 6 ] 88054 6.973% 97.475% # ( 6, 10 ] 25853 2.047% 99.522% ( 10, 15 ] 3523 0.279% 99.801% ( 15, 22 ] 423 0.033% 99.834% ( 22, 34 ] 27 0.002% 99.837% ( 34, 51 ] 13 0.001% 99.838% ( 51, 76 ] 58 0.005% 99.842% ( 76, 110 ] 463 0.037% 99.879% ( 110, 170 ] 661 0.052% 99.931% ( 170, 250 ] 442 0.035% 99.966% ( 250, 380 ] 457 0.036% 100.002% ( 380, 580 ] 471 0.037% 100.040% ( 580, 870 ] 356 0.028% 100.068% ( 870, 1300 ] 182 0.014% 100.082% ( 1300, 1900 ] 99 0.008% 100.090% ( 1900, 2900 ] 85 0.007% 100.097% ( 2900, 4400 ] 102 0.008% 100.105% ( 4400, 6600 ] 35 0.003% 100.108% ( 6600, 9900 ] 10 0.001% 100.108% ( 9900, 14000 ] 5 0.000% 100.109% ( 14000, 22000 ] 1 0.000% 100.109% ** Level 2 read latency histogram (micros): Count: 355749 Average: 4.6639 StdDev: 66.97 Min: 1 Median: 1.8671 Max: 11964 Percentiles: P50: 1.87 P75: 2.81 P99: 9.02 P99.9: 16.50 P99.99: 286.08 ------------------------------------------------------ [ 0, 1 ] 11143 3.132% 3.132% # ( 1, 2 ] 192284 54.050% 57.183% ########### ( 2, 3 ] 78517 22.071% 79.254% #### ( 3, 4 ] 33966 9.548% 88.801% ## ( 4, 6 ] 30698 8.629% 97.430% ## ( 6, 10 ] 7405 2.082% 99.512% ( 10, 15 ] 1342 0.377% 99.889% ( 15, 22 ] 178 0.050% 99.939% ( 22, 34 ] 13 0.004% 99.943% ( 34, 51 ] 6 0.002% 99.945% ( 51, 76 ] 7 0.002% 99.947% ( 76, 110 ] 23 0.006% 99.953% ( 110, 170 ] 57 0.016% 99.969% ( 170, 250 ] 50 0.014% 99.983% ( 250, 380 ] 88 0.025% 100.008% ( 380, 580 ] 78 0.022% 100.030% ( 580, 870 ] 112 0.031% 100.061% ( 870, 1300 ] 77 0.022% 100.083% ( 1300, 1900 ] 45 0.013% 100.096% ( 1900, 2900 ] 47 0.013% 100.109% ( 2900, 4400 ] 43 0.012% 100.121% ( 4400, 6600 ] 11 0.003% 100.124% ( 6600, 9900 ] 1 0.000% 100.124% ( 9900, 14000 ] 1 0.000% 100.125% ** Level 3 read latency histogram (micros): Count: 1273515 Average: 7.0638 StdDev: 107.13 Min: 0 Median: 1.8896 Max: 11965 Percentiles: P50: 1.89 P75: 2.85 P99: 9.35 P99.9: 292.20 P99.99: 612.59 ------------------------------------------------------ [ 0, 1 ] 37031 2.908% 2.908% # ( 1, 2 ] 674121 52.934% 55.842% ########### ( 2, 3 ] 288448 22.650% 78.491% ##### ( 3, 4 ] 124456 9.773% 88.264% ## ( 4, 6 ] 114737 9.009% 97.274% ## ( 6, 10 ] 26254 2.062% 99.335% ( 10, 15 ] 5040 0.396% 99.731% ( 15, 22 ] 666 0.052% 99.783% ( 22, 34 ] 79 0.006% 99.789% ( 34, 51 ] 26 0.002% 99.791% ( 51, 76 ] 9 0.001% 99.792% ( 76, 110 ] 246 0.019% 99.811% ( 110, 170 ] 507 0.040% 99.851% ( 170, 250 ] 454 0.036% 99.887% ( 250, 380 ] 516 0.041% 99.927% ( 380, 580 ] 711 0.056% 99.983% ( 580, 870 ] 771 0.061% 100.044% ( 870, 1300 ] 601 0.047% 100.091% ( 1300, 1900 ] 306 0.024% 100.115% ( 1900, 2900 ] 352 0.028% 100.143% ( 2900, 4400 ] 390 0.031% 100.173% ( 4400, 6600 ] 87 0.007% 100.180% ( 6600, 9900 ] 33 0.003% 100.183% ( 9900, 14000 ] 10 0.001% 100.183% ** Level 4 read latency histogram (micros): Count: 95959 Average: 43.9809 StdDev: 279.93 Min: 0 Median: 1.8120 Max: 13976 Percentiles: P50: 1.81 P75: 2.76 P99: 1200.99 P99.9: 3915.01 P99.99: 5468.79 ------------------------------------------------------ [ 0, 1 ] 3372 3.514% 3.514% # ( 1, 2 ] 54932 57.245% 60.759% ########### ( 2, 3 ] 17938 18.693% 79.453% #### ( 3, 4 ] 7856 8.187% 87.640% ## ( 4, 6 ] 5299 5.522% 93.162% # ( 6, 10 ] 1949 2.031% 95.193% ( 10, 15 ] 312 0.325% 95.518% ( 15, 22 ] 78 0.081% 95.599% ( 22, 34 ] 8 0.008% 95.607% ( 34, 51 ] 2 0.002% 95.610% ( 51, 76 ] 2 0.002% 95.612% ( 76, 110 ] 86 0.090% 95.701% ( 110, 170 ] 256 0.267% 95.968% ( 170, 250 ] 356 0.371% 96.339% ( 250, 380 ] 472 0.492% 96.831% ( 380, 580 ] 715 0.745% 97.576% ( 580, 870 ] 863 0.899% 98.475% ( 870, 1300 ] 654 0.682% 99.157% ( 1300, 1900 ] 358 0.373% 99.530% ( 1900, 2900 ] 217 0.226% 99.756% ( 2900, 4400 ] 204 0.213% 99.969% ( 4400, 6600 ] 42 0.044% 100.013% ( 6600, 9900 ] 5 0.005% 100.018% ( 9900, 14000 ] 2 0.002% 100.020% ** Level 5 read latency histogram (micros): Count: 280 Average: 1340.9821 StdDev: 1298.95 Min: 89 Median: 843.6364 Max: 8766 Percentiles: P50: 843.64 P75: 2075.00 P99: 6034.29 P99.9: 8766.00 P99.99: 8766.00 ------------------------------------------------------ ( 76, 110 ] 6 2.143% 2.143% ( 110, 170 ] 20 7.143% 9.286% # ( 170, 250 ] 25 8.929% 18.214% ## ( 250, 380 ] 24 8.571% 26.786% ## ( 380, 580 ] 35 12.500% 39.286% ### ( 580, 870 ] 33 11.786% 51.071% ## ( 870, 1300 ] 36 12.857% 63.929% ### ( 1300, 1900 ] 24 8.571% 72.500% ## ( 1900, 2900 ] 40 14.286% 86.786% ### ( 2900, 4400 ] 29 10.357% 97.143% ## ( 4400, 6600 ] 7 2.500% 99.643% # ( 6600, 9900 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 57.6 total, 3.7 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 187.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.129 H:M:S, 45.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 269.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.886 H:M:S, 24.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.351 micros/op 186880 ops/sec 60.102 seconds 11231999 operations; 181.1 MB/s Microseconds per write: Count: 11231999 Average: 5.3510 StdDev: 432.69 Min: 1 Median: 1.7956 Max: 763747 Percentiles: P50: 1.80 P75: 2.84 P99: 9.34 P99.9: 1068.72 P99.99: 2694.07 ------------------------------------------------------ [ 0, 1 ] 1143899 10.184% 10.184% ## ( 1, 2 ] 5621308 50.047% 60.232% ########## ( 2, 3 ] 1985079 17.673% 77.905% #### ( 3, 4 ] 1591994 14.174% 92.079% ### ( 4, 6 ] 657774 5.856% 97.935% # ( 6, 10 ] 143381 1.277% 99.212% ( 10, 15 ] 46965 0.418% 99.630% ( 15, 22 ] 11216 0.100% 99.729% ( 22, 34 ] 2245 0.020% 99.749% ( 34, 51 ] 288 0.003% 99.752% ( 51, 76 ] 30 0.000% 99.752% ( 76, 110 ] 7666 0.068% 99.821% ( 110, 170 ] 3175 0.028% 99.849% ( 170, 250 ] 336 0.003% 99.852% ( 250, 380 ] 183 0.002% 99.853% ( 380, 580 ] 43 0.000% 99.854% ( 580, 870 ] 23 0.000% 99.854% ( 870, 1300 ] 11170 0.099% 99.953% ( 1300, 1900 ] 28 0.000% 99.954% ( 1900, 2900 ] 5129 0.046% 99.999% ( 2900, 4400 ] 32 0.000% 100.000% ( 4400, 6600 ] 6 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 10 0.000% 100.000% ( 250000, 380000 ] 3 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 190626 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11231999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11591422968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 613 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 28152868 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31293916377 rocksdb.compact.write.bytes COUNT : 31105003100 rocksdb.flush.write.bytes COUNT : 11560029600 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 66 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 333 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11466757120 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4405248 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31401744891 rocksdb.non.last.level.read.count COUNT : 7583753 rocksdb.block.checksum.compute.count COUNT : 7582593 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.433464 P95 : 3.936463 P99 : 7.823379 P100 : 763745.000000 COUNT : 11231999 SUM : 54365586 rocksdb.compaction.times.micros P50 : 860000.000000 P95 : 3775000.000000 P99 : 13580000.000000 P100 : 18713484.000000 COUNT : 110 SUM : 138663452 rocksdb.compaction.times.cpu_micros P50 : 686000.000000 P95 : 3133333.333333 P99 : 9470000.000000 P100 : 17146870.000000 COUNT : 110 SUM : 115488927 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 719.882353 P95 : 3450.000000 P99 : 17360.000000 P100 : 54114.000000 COUNT : 158 SUM : 217205 rocksdb.compaction.outfile.sync.micros P50 : 1177.142857 P95 : 42272.727273 P99 : 105000.000000 P100 : 176812.000000 COUNT : 400 SUM : 3057433 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 119.782609 P95 : 1703.333333 P99 : 3278.750000 P100 : 3844.000000 COUNT : 299 SUM : 105211 rocksdb.table.open.io.micros P50 : 1391.011236 P95 : 8058.243243 P99 : 11663.000000 P100 : 14422.000000 COUNT : 613 SUM : 1337816 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.634061 P95 : 7.822647 P99 : 11.701587 P100 : 16069.000000 COUNT : 7581140 SUM : 48486814 rocksdb.read.block.get.micros P50 : 407.450980 P95 : 3511.904762 P99 : 5476.166667 P100 : 5656.000000 COUNT : 1226 SUM : 1074705 rocksdb.write.raw.block.micros P50 : 0.514837 P95 : 0.978190 P99 : 2.990337 P100 : 20753.000000 COUNT : 10334307 SUM : 21699618 rocksdb.numfiles.in.singlecompaction P50 : 3.053846 P95 : 5.850000 P99 : 18.570000 P100 : 33.000000 COUNT : 149 SUM : 533 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.565276 P95 : 1225.025394 P99 : 2627.748681 P100 : 763555.000000 COUNT : 142011 SUM : 28168974 rocksdb.sst.read.micros P50 : 1.596258 P95 : 4.661163 P99 : 8.666787 P100 : 15141.000000 COUNT : 7584527 SUM : 33244575 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11231999 SUM : 11591422968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212352.941176 P95 : 453625.000000 P99 : 775900.000000 P100 : 913037.000000 COUNT : 158 SUM : 34553668 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 389 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0