[2024-07-13 03:09:07.909925] Starting SPDK v24.05.1-pre git sha1 5fa2f5086 / DPDK 22.11.4 initialization... [2024-07-13 03:09:07.910065] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3888466 ] Set seed to 1720832947906538 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-13 03:09:07.997855] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-13 03:09:08.040011] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-13 03:09:08.040053] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3888466' to capture a snapshot of events at runtime. [2024-07-13 03:09:08.040063] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-13 03:09:08.040073] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-13 03:09:08.040081] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3888466 for offline analysis/debug. [2024-07-13 03:09:08.040160] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Jul 13 03:09:12 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/13-03:09:15 ... thread 0: (1000000,1000000) ops and (341005.4,341005.4) ops/second in (2.932505,2.932505) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/8 566.96 MB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 357.2 2.47 2.24 12 0.206 0 0 0.0 0.0 L1 3/3 188.88 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 253.5 253.4 0.75 0.72 1 0.745 191K 89 0.0 0.0 L2 2/1 125.97 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 233.4 233.3 0.54 0.51 1 0.540 127K 31 0.0 0.0 L3 10/0 867.26 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1179/12 97.00 GB 0.0 0.3 0.2 0.1 1.2 1.1 0.4 1.4 83.9 318.8 3.75 3.47 14 0.268 319K 120 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.1 1.2 1.1 0.4 1.4 83.9 318.8 3.75 3.47 14 0.268 319K 120 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 0.0 245.1 245.0 1.29 1.23 2 0.643 319K 120 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 357.2 2.47 2.24 12 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 384.62 MB/s write, 0.31 GB read, 101.23 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 407.91 MB/s write, 0.31 GB read, 107.36 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 123201 Average: 1.9242 StdDev: 20.95 Min: 0 Median: 1.1948 Max: 3394 Percentiles: P50: 1.19 P75: 1.66 P99: 4.73 P99.9: 11.79 P99.99: 161.20 ------------------------------------------------------ [ 0, 1 ] 48625 39.468% 39.468% ######## ( 1, 2 ] 66610 54.066% 93.534% ########### ( 2, 3 ] 4699 3.814% 97.348% # ( 3, 4 ] 1678 1.362% 98.710% ( 4, 6 ] 981 0.796% 99.506% ( 6, 10 ] 443 0.360% 99.866% ( 10, 15 ] 128 0.104% 99.970% ( 15, 22 ] 13 0.011% 99.981% ( 22, 34 ] 5 0.004% 99.985% ( 34, 51 ] 2 0.002% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 9 0.007% 99.994% ( 170, 250 ] 2 0.002% 99.996% ( 250, 380 ] 4 0.003% 99.999% ( 580, 870 ] 1 0.001% 100.000% ( 870, 1300 ] 1 0.001% 100.001% ( 1900, 2900 ] 5 0.004% 100.005% ( 2900, 4400 ] 2 0.002% 100.006% ** Level 1 read latency histogram (micros): Count: 27322 Average: 2.1358 StdDev: 27.66 Min: 1 Median: 1.2725 Max: 3697 Percentiles: P50: 1.27 P75: 1.70 P99: 4.23 P99.9: 10.70 P99.99: 985.15 ------------------------------------------------------ [ 0, 1 ] 9275 33.947% 33.947% ####### ( 1, 2 ] 16093 58.901% 92.848% ############ ( 2, 3 ] 1185 4.337% 97.185% # ( 3, 4 ] 470 1.720% 98.906% ( 4, 6 ] 225 0.824% 99.729% ( 6, 10 ] 44 0.161% 99.890% ( 10, 15 ] 19 0.070% 99.960% ( 15, 22 ] 1 0.004% 99.963% ( 51, 76 ] 1 0.004% 99.967% ( 110, 170 ] 1 0.004% 99.971% ( 170, 250 ] 1 0.004% 99.974% ( 380, 580 ] 2 0.007% 99.982% ( 580, 870 ] 2 0.007% 99.989% ( 870, 1300 ] 1 0.004% 99.993% ( 1900, 2900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 19793 Average: 2.3100 StdDev: 5.44 Min: 1 Median: 1.5376 Max: 617 Percentiles: P50: 1.54 P75: 1.93 P99: 6.85 P99.9: 14.21 P99.99: 384.14 ------------------------------------------------------ [ 0, 1 ] 3044 15.379% 15.379% ### ( 1, 2 ] 12747 64.402% 79.781% ############# ( 2, 3 ] 2107 10.645% 90.426% ## ( 3, 4 ] 848 4.284% 94.710% # ( 4, 6 ] 812 4.102% 98.813% # ( 6, 10 ] 180 0.909% 99.722% ( 10, 15 ] 43 0.217% 99.939% ( 15, 22 ] 6 0.030% 99.970% ( 22, 34 ] 3 0.015% 99.985% ( 34, 51 ] 1 0.005% 99.990% ( 51, 76 ] 1 0.005% 99.995% ( 380, 580 ] 1 0.005% 100.000% ( 580, 870 ] 1 0.005% 100.005% ** Level 3 read latency histogram (micros): Count: 45 Average: 1369.5111 StdDev: 1046.84 Min: 130 Median: 913.0000 Max: 4282 Percentiles: P50: 913.00 P75: 2007.14 P99: 4265.00 P99.9: 4282.00 P99.99: 4282.00 ------------------------------------------------------ ( 110, 170 ] 1 2.222% 2.222% ( 250, 380 ] 3 6.667% 8.889% # ( 380, 580 ] 7 15.556% 24.444% ### ( 580, 870 ] 11 24.444% 48.889% ##### ( 870, 1300 ] 5 11.111% 60.000% ## ( 1300, 1900 ] 6 13.333% 73.333% ### ( 1900, 2900 ] 7 15.556% 88.889% ### ( 2900, 4400 ] 5 11.111% 100.000% ## ** Level 4 read latency histogram (micros): Count: 30 Average: 1587.0333 StdDev: 1272.33 Min: 202 Median: 1300.0000 Max: 5803 Percentiles: P50: 1300.00 P75: 2316.67 P99: 5803.00 P99.9: 5803.00 P99.99: 5803.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 1 3.333% 6.667% # ( 380, 580 ] 4 13.333% 20.000% ### ( 580, 870 ] 6 20.000% 40.000% #### ( 870, 1300 ] 3 10.000% 50.000% ## ( 1300, 1900 ] 5 16.667% 66.667% ### ( 1900, 2900 ] 6 20.000% 86.667% #### ( 2900, 4400 ] 3 10.000% 96.667% ## ( 4400, 6600 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 316.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.430 H:M:S, 13.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 335.34 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.430 H:M:S, 14.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/13-03:09:17 ... thread 0: (1000000,2000000) ops and (363026.2,351671.4) ops/second in (2.754622,5.687127) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/7 1.23 GB 12.6 0.8 0.0 0.8 2.6 1.8 0.0 1.4 100.4 324.3 8.16 7.58 29 0.281 831K 885 0.0 0.0 L1 1/1 3.91 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 245.3 245.0 2.57 2.49 2 1.284 639K 809 0.0 0.0 L2 5/3 437.32 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 233.4 233.3 0.54 0.51 1 0.540 127K 31 0.0 0.0 L3 18/1 992.11 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 216.7 216.7 0.58 0.53 1 0.576 126K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1189/12 97.92 GB 0.0 1.7 0.6 1.0 3.4 2.4 0.8 1.9 143.6 297.7 11.84 11.12 33 0.359 1725K 1725 0.0 0.0 Int 0/0 0.00 KB 0.0 1.7 0.6 1.0 3.4 2.4 0.8 1.9 143.6 297.7 11.84 11.12 33 0.359 1725K 1725 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.7 0.6 1.0 1.7 0.6 0.0 0.0 250.4 250.1 6.79 6.57 7 0.970 1725K 1725 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 361.6 5.05 4.54 26 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.9 total, 5.7 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.44 GB write, 600.86 MB/s write, 1.66 GB read, 289.74 MB/s read, 11.8 seconds Interval compaction: 3.44 GB write, 619.63 MB/s write, 1.66 GB read, 298.79 MB/s read, 11.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 376558 Average: 2.1076 StdDev: 14.63 Min: 0 Median: 1.4107 Max: 3394 Percentiles: P50: 1.41 P75: 1.81 P99: 5.50 P99.9: 9.85 P99.99: 14.75 ------------------------------------------------------ [ 0, 1 ] 92530 24.573% 24.573% ##### ( 1, 2 ] 233151 61.916% 86.489% ############ ( 2, 3 ] 30666 8.144% 94.633% ## ( 3, 4 ] 11158 2.963% 97.596% # ( 4, 6 ] 7047 1.871% 99.467% ( 6, 10 ] 1693 0.450% 99.917% ( 10, 15 ] 291 0.077% 99.994% ( 15, 22 ] 32 0.008% 100.003% ( 22, 34 ] 11 0.003% 100.006% ( 34, 51 ] 3 0.001% 100.006% ( 51, 76 ] 2 0.001% 100.007% ( 110, 170 ] 15 0.004% 100.011% ( 170, 250 ] 12 0.003% 100.014% ( 250, 380 ] 7 0.002% 100.016% ( 380, 580 ] 2 0.001% 100.016% ( 580, 870 ] 7 0.002% 100.018% ( 870, 1300 ] 4 0.001% 100.019% ( 1300, 1900 ] 1 0.000% 100.020% ( 1900, 2900 ] 7 0.002% 100.022% ( 2900, 4400 ] 3 0.001% 100.022% ** Level 1 read latency histogram (micros): Count: 121383 Average: 2.2468 StdDev: 14.26 Min: 1 Median: 1.5092 Max: 3697 Percentiles: P50: 1.51 P75: 1.89 P99: 5.62 P99.9: 12.01 P99.99: 362.01 ------------------------------------------------------ [ 0, 1 ] 20461 16.857% 16.857% ### ( 1, 2 ] 79014 65.095% 81.951% ############# ( 2, 3 ] 14331 11.806% 93.758% ## ( 3, 4 ] 4053 3.339% 97.097% # ( 4, 6 ] 2850 2.348% 99.445% ( 6, 10 ] 495 0.408% 99.853% ( 10, 15 ] 146 0.120% 99.973% ( 15, 22 ] 14 0.012% 99.984% ( 22, 34 ] 2 0.002% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 2 0.002% 99.988% ( 170, 250 ] 2 0.002% 99.990% ( 250, 380 ] 1 0.001% 99.991% ( 380, 580 ] 4 0.003% 99.994% ( 580, 870 ] 3 0.002% 99.997% ( 870, 1300 ] 3 0.002% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 31702 Average: 2.3419 StdDev: 4.35 Min: 1 Median: 1.5820 Max: 617 Percentiles: P50: 1.58 P75: 1.97 P99: 6.35 P99.9: 13.30 P99.99: 48.11 ------------------------------------------------------ [ 0, 1 ] 4003 12.627% 12.627% ### ( 1, 2 ] 20359 64.220% 76.847% ############# ( 2, 3 ] 4241 13.378% 90.225% ### ( 3, 4 ] 1388 4.378% 94.603% # ( 4, 6 ] 1370 4.321% 98.924% # ( 6, 10 ] 273 0.861% 99.786% ( 10, 15 ] 55 0.173% 99.959% ( 15, 22 ] 6 0.019% 99.978% ( 22, 34 ] 3 0.009% 99.987% ( 34, 51 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 21034 Average: 5.2071 StdDev: 80.30 Min: 1 Median: 1.5527 Max: 4282 Percentiles: P50: 1.55 P75: 1.93 P99: 5.88 P99.9: 1125.08 P99.99: 3768.98 ------------------------------------------------------ [ 0, 1 ] 2870 13.645% 13.645% ### ( 1, 2 ] 13835 65.774% 79.419% ############# ( 2, 3 ] 2860 13.597% 93.016% ### ( 3, 4 ] 772 3.670% 96.686% # ( 4, 6 ] 518 2.463% 99.149% ( 6, 10 ] 103 0.490% 99.639% ( 10, 15 ] 27 0.128% 99.767% ( 15, 22 ] 2 0.010% 99.777% ( 110, 170 ] 1 0.005% 99.781% ( 250, 380 ] 4 0.019% 99.800% ( 380, 580 ] 7 0.033% 99.834% ( 580, 870 ] 11 0.052% 99.886% ( 870, 1300 ] 5 0.024% 99.910% ( 1300, 1900 ] 7 0.033% 99.943% ( 1900, 2900 ] 7 0.033% 99.976% ( 2900, 4400 ] 5 0.024% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1587.0333 StdDev: 1272.33 Min: 202 Median: 1300.0000 Max: 5803 Percentiles: P50: 1300.00 P75: 2316.67 P99: 5803.00 P99.9: 5803.00 P99.99: 5803.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 1 3.333% 6.667% # ( 380, 580 ] 4 13.333% 20.000% ### ( 580, 870 ] 6 20.000% 40.000% #### ( 870, 1300 ] 3 10.000% 50.000% ## ( 1300, 1900 ] 5 16.667% 66.667% ### ( 1900, 2900 ] 6 20.000% 86.667% #### ( 2900, 4400 ] 3 10.000% 96.667% ## ( 4400, 6600 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 5.9 total, 2.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 335.53 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.622 H:M:S, 10.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 357.29 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.192 H:M:S, 7.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/13-03:09:20 ... thread 0: (1000000,3000000) ops and (329358.1,343905.1) ops/second in (3.036209,8.723336) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/15 2.21 GB 56.6 1.4 0.0 1.4 4.1 2.8 0.0 1.5 105.6 321.6 13.12 12.22 45 0.292 1407K 1501 0.0 0.0 L1 1/1 3.91 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 245.3 245.0 2.57 2.49 2 1.284 639K 809 0.0 0.0 L2 2/0 51.03 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 233.4 233.3 0.54 0.51 1 0.540 127K 31 0.0 0.0 L3 31/0 990.45 MB 1.0 0.6 0.5 0.1 0.6 0.5 0.1 1.2 196.9 196.7 3.17 2.73 2 1.583 633K 509 0.0 0.0 L4 156/0 9.67 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1251/16 98.90 GB 0.0 2.7 1.0 1.7 5.5 3.8 1.5 2.0 142.6 288.6 19.39 17.95 50 0.388 2807K 2850 0.0 0.0 Int 0/0 0.00 KB 0.0 2.7 1.0 1.7 5.5 3.8 1.5 2.0 142.6 288.6 19.39 17.95 50 0.388 2807K 2850 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.7 1.0 1.7 2.7 1.0 0.0 0.0 240.2 239.9 11.51 10.87 10 1.151 2807K 2850 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 359.8 7.88 7.08 40 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.9 total, 8.7 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.47 GB write, 628.72 MB/s write, 2.70 GB read, 310.61 MB/s read, 19.4 seconds Interval compaction: 5.47 GB write, 641.52 MB/s write, 2.70 GB read, 316.94 MB/s read, 19.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 759065 Average: 2.1585 StdDev: 12.91 Min: 0 Median: 1.4666 Max: 3394 Percentiles: P50: 1.47 P75: 1.85 P99: 5.55 P99.9: 9.95 P99.99: 14.18 ------------------------------------------------------ [ 0, 1 ] 150042 19.767% 19.767% #### ( 1, 2 ] 491880 64.801% 84.567% ############# ( 2, 3 ] 73080 9.628% 94.195% ## ( 3, 4 ] 24781 3.265% 97.460% # ( 4, 6 ] 15070 1.985% 99.445% ( 6, 10 ] 3504 0.462% 99.907% ( 10, 15 ] 760 0.100% 100.007% ( 15, 22 ] 81 0.011% 100.018% ( 22, 34 ] 19 0.003% 100.020% ( 34, 51 ] 9 0.001% 100.021% ( 51, 76 ] 5 0.001% 100.022% ( 76, 110 ] 1 0.000% 100.022% ( 110, 170 ] 24 0.003% 100.025% ( 170, 250 ] 15 0.002% 100.027% ( 250, 380 ] 13 0.002% 100.029% ( 380, 580 ] 4 0.001% 100.029% ( 580, 870 ] 10 0.001% 100.031% ( 870, 1300 ] 4 0.001% 100.031% ( 1300, 1900 ] 5 0.001% 100.032% ( 1900, 2900 ] 11 0.001% 100.033% ( 2900, 4400 ] 4 0.001% 100.034% ** Level 1 read latency histogram (micros): Count: 146068 Average: 2.2571 StdDev: 13.89 Min: 1 Median: 1.5215 Max: 3697 Percentiles: P50: 1.52 P75: 1.90 P99: 5.63 P99.9: 12.16 P99.99: 225.73 ------------------------------------------------------ [ 0, 1 ] 23176 15.867% 15.867% ### ( 1, 2 ] 95601 65.450% 81.316% ############# ( 2, 3 ] 18157 12.431% 93.747% ## ( 3, 4 ] 4821 3.301% 97.047% # ( 4, 6 ] 3490 2.389% 99.437% ( 6, 10 ] 595 0.407% 99.844% ( 10, 15 ] 190 0.130% 99.974% ( 15, 22 ] 17 0.012% 99.986% ( 22, 34 ] 2 0.001% 99.987% ( 51, 76 ] 1 0.001% 99.988% ( 110, 170 ] 2 0.001% 99.989% ( 170, 250 ] 2 0.001% 99.990% ( 250, 380 ] 1 0.001% 99.991% ( 380, 580 ] 4 0.003% 99.994% ( 580, 870 ] 3 0.002% 99.996% ( 870, 1300 ] 3 0.002% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31702 Average: 2.3419 StdDev: 4.35 Min: 1 Median: 1.5820 Max: 617 Percentiles: P50: 1.58 P75: 1.97 P99: 6.35 P99.9: 13.30 P99.99: 48.11 ------------------------------------------------------ [ 0, 1 ] 4003 12.627% 12.627% ### ( 1, 2 ] 20359 64.220% 76.847% ############# ( 2, 3 ] 4241 13.378% 90.225% ### ( 3, 4 ] 1388 4.378% 94.603% # ( 4, 6 ] 1370 4.321% 98.924% # ( 6, 10 ] 273 0.861% 99.786% ( 10, 15 ] 55 0.173% 99.959% ( 15, 22 ] 6 0.019% 99.978% ( 22, 34 ] 3 0.009% 99.987% ( 34, 51 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28873 Average: 4.5328 StdDev: 68.64 Min: 1 Median: 1.5591 Max: 4282 Percentiles: P50: 1.56 P75: 1.94 P99: 6.89 P99.9: 741.53 P99.99: 3533.81 ------------------------------------------------------ [ 0, 1 ] 3901 13.511% 13.511% ### ( 1, 2 ] 18843 65.262% 78.773% ############# ( 2, 3 ] 4055 14.044% 92.817% ### ( 3, 4 ] 1022 3.540% 96.356% # ( 4, 6 ] 726 2.514% 98.871% # ( 6, 10 ] 167 0.578% 99.449% ( 10, 15 ] 42 0.145% 99.595% ( 15, 22 ] 7 0.024% 99.619% ( 22, 34 ] 14 0.048% 99.668% ( 34, 51 ] 30 0.104% 99.771% ( 51, 76 ] 7 0.024% 99.796% ( 76, 110 ] 5 0.017% 99.813% ( 110, 170 ] 5 0.017% 99.830% ( 170, 250 ] 2 0.007% 99.837% ( 250, 380 ] 5 0.017% 99.855% ( 380, 580 ] 7 0.024% 99.879% ( 580, 870 ] 11 0.038% 99.917% ( 870, 1300 ] 5 0.017% 99.934% ( 1300, 1900 ] 7 0.024% 99.958% ( 1900, 2900 ] 7 0.024% 99.983% ( 2900, 4400 ] 5 0.017% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1587.0333 StdDev: 1272.33 Min: 202 Median: 1300.0000 Max: 5803 Percentiles: P50: 1300.00 P75: 2316.67 P99: 5803.00 P99.9: 5803.00 P99.99: 5803.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 1 3.333% 6.667% # ( 380, 580 ] 4 13.333% 20.000% ### ( 580, 870 ] 6 20.000% 40.000% #### ( 870, 1300 ] 3 10.000% 50.000% ## ( 1300, 1900 ] 5 16.667% 66.667% ### ( 1900, 2900 ] 6 20.000% 86.667% #### ( 2900, 4400 ] 3 10.000% 96.667% ## ( 4400, 6600 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 791.7500 StdDev: 1003.17 Min: 103 Median: 210.0000 Max: 3960 Percentiles: P50: 210.00 P75: 1450.00 P99: 3960.00 P99.9: 3960.00 P99.99: 3960.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 7 35.000% 45.000% ####### ( 170, 250 ] 2 10.000% 55.000% ## ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 4 20.000% 90.000% #### ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 8.9 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 331.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.077 H:M:S, 12.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.455 H:M:S, 15.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/13-03:09:23 ... thread 0: (1000000,4000000) ops and (337894.3,342382.5) ops/second in (2.959505,11.682841) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 2.03 GB 176.2 2.5 0.0 2.5 6.1 3.7 0.0 1.7 125.7 314.2 20.04 18.77 62 0.323 2558K 2737 0.0 0.0 L1 11/0 1.10 GB 113.1 1.7 1.5 0.2 1.7 1.5 0.1 1.1 240.1 239.3 7.36 7.16 3 2.452 1793K 6121 0.0 0.0 L2 2/0 51.03 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 233.4 233.3 0.54 0.51 1 0.540 127K 31 0.0 0.0 L3 31/0 990.45 MB 1.0 0.6 0.5 0.1 0.6 0.5 0.1 1.2 196.9 196.7 3.17 2.73 2 1.583 633K 509 0.0 0.0 L4 156/0 9.67 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/4 99.82 GB 0.0 4.9 2.1 2.8 8.6 5.8 1.5 2.3 161.9 283.1 31.11 29.17 68 0.457 5113K 9398 0.0 0.0 Int 0/0 0.00 KB 0.0 4.9 2.1 2.8 8.6 5.8 1.5 2.3 161.9 283.1 31.11 29.17 68 0.457 5113K 9398 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.9 2.1 2.8 4.9 2.1 0.0 0.0 244.5 244.0 20.60 19.74 15 1.373 5113K 9398 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 359.6 10.51 9.43 53 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.9 total, 11.7 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.60 GB write, 742.38 MB/s write, 4.92 GB read, 424.56 MB/s read, 31.1 seconds Interval compaction: 8.60 GB write, 753.67 MB/s write, 4.92 GB read, 431.01 MB/s read, 31.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1093992 Average: 2.1429 StdDev: 11.69 Min: 0 Median: 1.4621 Max: 3394 Percentiles: P50: 1.46 P75: 1.85 P99: 5.50 P99.9: 9.91 P99.99: 14.20 ------------------------------------------------------ [ 0, 1 ] 219571 20.071% 20.071% #### ( 1, 2 ] 708599 64.772% 84.842% ############# ( 2, 3 ] 104124 9.518% 94.360% ## ( 3, 4 ] 34903 3.190% 97.551% # ( 4, 6 ] 21079 1.927% 99.478% ( 6, 10 ] 4725 0.432% 99.909% ( 10, 15 ] 1053 0.096% 100.006% ( 15, 22 ] 108 0.010% 100.016% ( 22, 34 ] 23 0.002% 100.018% ( 34, 51 ] 12 0.001% 100.019% ( 51, 76 ] 6 0.001% 100.019% ( 76, 110 ] 1 0.000% 100.019% ( 110, 170 ] 58 0.005% 100.025% ( 170, 250 ] 20 0.002% 100.027% ( 250, 380 ] 25 0.002% 100.029% ( 380, 580 ] 6 0.001% 100.029% ( 580, 870 ] 17 0.002% 100.031% ( 870, 1300 ] 7 0.001% 100.032% ( 1300, 1900 ] 7 0.001% 100.032% ( 1900, 2900 ] 12 0.001% 100.033% ( 2900, 4400 ] 4 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 147116 Average: 2.3380 StdDev: 16.07 Min: 1 Median: 1.5214 Max: 3697 Percentiles: P50: 1.52 P75: 1.90 P99: 5.65 P99.9: 12.68 P99.99: 712.73 ------------------------------------------------------ [ 0, 1 ] 23355 15.875% 15.875% ### ( 1, 2 ] 96279 65.444% 81.320% ############# ( 2, 3 ] 18286 12.430% 93.749% ## ( 3, 4 ] 4842 3.291% 97.040% # ( 4, 6 ] 3504 2.382% 99.422% ( 6, 10 ] 601 0.409% 99.831% ( 10, 15 ] 190 0.129% 99.960% ( 15, 22 ] 18 0.012% 99.972% ( 22, 34 ] 2 0.001% 99.973% ( 51, 76 ] 1 0.001% 99.974% ( 110, 170 ] 2 0.001% 99.976% ( 170, 250 ] 5 0.003% 99.979% ( 250, 380 ] 6 0.004% 99.983% ( 380, 580 ] 8 0.005% 99.988% ( 580, 870 ] 5 0.003% 99.992% ( 870, 1300 ] 9 0.006% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31702 Average: 2.3419 StdDev: 4.35 Min: 1 Median: 1.5820 Max: 617 Percentiles: P50: 1.58 P75: 1.97 P99: 6.35 P99.9: 13.30 P99.99: 48.11 ------------------------------------------------------ [ 0, 1 ] 4003 12.627% 12.627% ### ( 1, 2 ] 20359 64.220% 76.847% ############# ( 2, 3 ] 4241 13.378% 90.225% ### ( 3, 4 ] 1388 4.378% 94.603% # ( 4, 6 ] 1370 4.321% 98.924% # ( 6, 10 ] 273 0.861% 99.786% ( 10, 15 ] 55 0.173% 99.959% ( 15, 22 ] 6 0.019% 99.978% ( 22, 34 ] 3 0.009% 99.987% ( 34, 51 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28873 Average: 4.5328 StdDev: 68.64 Min: 1 Median: 1.5591 Max: 4282 Percentiles: P50: 1.56 P75: 1.94 P99: 6.89 P99.9: 741.53 P99.99: 3533.81 ------------------------------------------------------ [ 0, 1 ] 3901 13.511% 13.511% ### ( 1, 2 ] 18843 65.262% 78.773% ############# ( 2, 3 ] 4055 14.044% 92.817% ### ( 3, 4 ] 1022 3.540% 96.356% # ( 4, 6 ] 726 2.514% 98.871% # ( 6, 10 ] 167 0.578% 99.449% ( 10, 15 ] 42 0.145% 99.595% ( 15, 22 ] 7 0.024% 99.619% ( 22, 34 ] 14 0.048% 99.668% ( 34, 51 ] 30 0.104% 99.771% ( 51, 76 ] 7 0.024% 99.796% ( 76, 110 ] 5 0.017% 99.813% ( 110, 170 ] 5 0.017% 99.830% ( 170, 250 ] 2 0.007% 99.837% ( 250, 380 ] 5 0.017% 99.855% ( 380, 580 ] 7 0.024% 99.879% ( 580, 870 ] 11 0.038% 99.917% ( 870, 1300 ] 5 0.017% 99.934% ( 1300, 1900 ] 7 0.024% 99.958% ( 1900, 2900 ] 7 0.024% 99.983% ( 2900, 4400 ] 5 0.017% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1587.0333 StdDev: 1272.33 Min: 202 Median: 1300.0000 Max: 5803 Percentiles: P50: 1300.00 P75: 2316.67 P99: 5803.00 P99.9: 5803.00 P99.99: 5803.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 1 3.333% 6.667% # ( 380, 580 ] 4 13.333% 20.000% ### ( 580, 870 ] 6 20.000% 40.000% #### ( 870, 1300 ] 3 10.000% 50.000% ## ( 1300, 1900 ] 5 16.667% 66.667% ### ( 1900, 2900 ] 6 20.000% 86.667% #### ( 2900, 4400 ] 3 10.000% 96.667% ## ( 4400, 6600 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 791.7500 StdDev: 1003.17 Min: 103 Median: 210.0000 Max: 3960 Percentiles: P50: 210.00 P75: 1450.00 P99: 3960.00 P99.9: 3960.00 P99.99: 3960.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 7 35.000% 45.000% ####### ( 170, 250 ] 2 10.000% 55.000% ## ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 4 20.000% 90.000% #### ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 11.9 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 331.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.488 H:M:S, 12.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.411 H:M:S, 13.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/13-03:09:26 ... thread 0: (1000000,5000000) ops and (342445.0,342395.0) ops/second in (2.920177,14.603018) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 3.01 GB 25.2 3.0 0.0 3.0 7.7 4.7 0.0 1.6 124.2 316.7 24.85 23.26 78 0.319 3134K 3331 0.0 0.0 L1 11/11 1.10 GB 0.0 1.7 1.5 0.2 1.7 1.5 0.1 1.1 240.1 239.3 7.36 7.16 3 2.452 1793K 6121 0.0 0.0 L2 2/0 51.03 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 233.4 233.3 0.54 0.51 1 0.540 127K 31 0.0 0.0 L3 31/0 990.45 MB 1.0 0.6 0.5 0.1 0.6 0.5 0.1 1.2 196.9 196.7 3.17 2.73 2 1.583 633K 509 0.0 0.0 L4 156/0 9.67 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1263/27 100.80 GB 0.0 5.5 2.1 3.4 10.1 6.8 1.5 2.2 156.0 289.0 35.92 33.66 84 0.428 5689K 9992 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 2.1 3.4 10.1 6.8 1.5 2.2 156.0 289.0 35.92 33.66 84 0.428 5689K 9992 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 2.1 3.4 5.5 2.1 0.0 0.0 247.0 246.5 22.69 21.80 17 1.335 5689K 9992 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 361.8 13.23 11.86 67 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.8 total, 14.6 interval Flush(GB): cumulative 4.675, interval 4.675 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.14 GB write, 702.22 MB/s write, 5.47 GB read, 379.04 MB/s read, 35.9 seconds Interval compaction: 10.14 GB write, 710.76 MB/s write, 5.47 GB read, 383.65 MB/s read, 35.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1336988 Average: 2.1317 StdDev: 11.79 Min: 0 Median: 1.4487 Max: 3394 Percentiles: P50: 1.45 P75: 1.84 P99: 5.44 P99.9: 9.96 P99.99: 14.63 ------------------------------------------------------ [ 0, 1 ] 281048 21.021% 21.021% #### ( 1, 2 ] 863397 64.578% 85.599% ############# ( 2, 3 ] 121765 9.107% 94.706% ## ( 3, 4 ] 40246 3.010% 97.716% # ( 4, 6 ] 23874 1.786% 99.502% ( 6, 10 ] 5380 0.402% 99.904% ( 10, 15 ] 1236 0.092% 99.997% ( 15, 22 ] 130 0.010% 100.007% ( 22, 34 ] 26 0.002% 100.009% ( 34, 51 ] 14 0.001% 100.010% ( 51, 76 ] 10 0.001% 100.010% ( 76, 110 ] 28 0.002% 100.012% ( 110, 170 ] 99 0.007% 100.020% ( 170, 250 ] 33 0.002% 100.022% ( 250, 380 ] 41 0.003% 100.025% ( 380, 580 ] 13 0.001% 100.026% ( 580, 870 ] 27 0.002% 100.028% ( 870, 1300 ] 9 0.001% 100.029% ( 1300, 1900 ] 7 0.001% 100.030% ( 1900, 2900 ] 15 0.001% 100.031% ( 2900, 4400 ] 5 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 174842 Average: 2.3528 StdDev: 15.31 Min: 1 Median: 1.5051 Max: 3697 Percentiles: P50: 1.51 P75: 1.89 P99: 5.82 P99.9: 14.06 P99.99: 642.80 ------------------------------------------------------ [ 0, 1 ] 29815 17.053% 17.053% ### ( 1, 2 ] 114053 65.232% 82.285% ############# ( 2, 3 ] 20301 11.611% 93.896% ## ( 3, 4 ] 5414 3.097% 96.992% # ( 4, 6 ] 3849 2.201% 99.194% ( 6, 10 ] 1024 0.586% 99.779% ( 10, 15 ] 260 0.149% 99.928% ( 15, 22 ] 20 0.011% 99.939% ( 22, 34 ] 2 0.001% 99.941% ( 51, 76 ] 2 0.001% 99.942% ( 76, 110 ] 31 0.018% 99.959% ( 110, 170 ] 19 0.011% 99.970% ( 170, 250 ] 12 0.007% 99.977% ( 250, 380 ] 11 0.006% 99.983% ( 380, 580 ] 10 0.006% 99.989% ( 580, 870 ] 7 0.004% 99.993% ( 870, 1300 ] 9 0.005% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31702 Average: 2.3419 StdDev: 4.35 Min: 1 Median: 1.5820 Max: 617 Percentiles: P50: 1.58 P75: 1.97 P99: 6.35 P99.9: 13.30 P99.99: 48.11 ------------------------------------------------------ [ 0, 1 ] 4003 12.627% 12.627% ### ( 1, 2 ] 20359 64.220% 76.847% ############# ( 2, 3 ] 4241 13.378% 90.225% ### ( 3, 4 ] 1388 4.378% 94.603% # ( 4, 6 ] 1370 4.321% 98.924% # ( 6, 10 ] 273 0.861% 99.786% ( 10, 15 ] 55 0.173% 99.959% ( 15, 22 ] 6 0.019% 99.978% ( 22, 34 ] 3 0.009% 99.987% ( 34, 51 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28873 Average: 4.5328 StdDev: 68.64 Min: 1 Median: 1.5591 Max: 4282 Percentiles: P50: 1.56 P75: 1.94 P99: 6.89 P99.9: 741.53 P99.99: 3533.81 ------------------------------------------------------ [ 0, 1 ] 3901 13.511% 13.511% ### ( 1, 2 ] 18843 65.262% 78.773% ############# ( 2, 3 ] 4055 14.044% 92.817% ### ( 3, 4 ] 1022 3.540% 96.356% # ( 4, 6 ] 726 2.514% 98.871% # ( 6, 10 ] 167 0.578% 99.449% ( 10, 15 ] 42 0.145% 99.595% ( 15, 22 ] 7 0.024% 99.619% ( 22, 34 ] 14 0.048% 99.668% ( 34, 51 ] 30 0.104% 99.771% ( 51, 76 ] 7 0.024% 99.796% ( 76, 110 ] 5 0.017% 99.813% ( 110, 170 ] 5 0.017% 99.830% ( 170, 250 ] 2 0.007% 99.837% ( 250, 380 ] 5 0.017% 99.855% ( 380, 580 ] 7 0.024% 99.879% ( 580, 870 ] 11 0.038% 99.917% ( 870, 1300 ] 5 0.017% 99.934% ( 1300, 1900 ] 7 0.024% 99.958% ( 1900, 2900 ] 7 0.024% 99.983% ( 2900, 4400 ] 5 0.017% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1587.0333 StdDev: 1272.33 Min: 202 Median: 1300.0000 Max: 5803 Percentiles: P50: 1300.00 P75: 2316.67 P99: 5803.00 P99.9: 5803.00 P99.99: 5803.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 1 3.333% 6.667% # ( 380, 580 ] 4 13.333% 20.000% ### ( 580, 870 ] 6 20.000% 40.000% #### ( 870, 1300 ] 3 10.000% 50.000% ## ( 1300, 1900 ] 5 16.667% 66.667% ### ( 1900, 2900 ] 6 20.000% 86.667% #### ( 2900, 4400 ] 3 10.000% 96.667% ## ( 4400, 6600 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 791.7500 StdDev: 1003.17 Min: 103 Median: 210.0000 Max: 3960 Percentiles: P50: 210.00 P75: 1450.00 P99: 3960.00 P99.9: 3960.00 P99.99: 3960.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 7 35.000% 45.000% ####### ( 170, 250 ] 2 10.000% 55.000% ## ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 4 20.000% 90.000% #### ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 14.8 total, 2.9 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 332.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.881 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 337.03 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.393 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/13-03:09:34 ... thread 0: (1000000,6000000) ops and (123436.2,264266.3) ops/second in (8.101349,22.704367) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 3.99 GB 125.5 5.0 0.0 5.0 10.7 5.7 0.0 1.9 146.4 310.4 35.28 33.25 98 0.360 5244K 8503 0.0 0.0 L1 11/11 1.10 GB 0.0 1.7 1.5 0.2 1.7 1.5 0.1 1.1 240.1 239.3 7.36 7.16 3 2.452 1793K 6121 0.0 0.0 L2 2/0 51.03 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 233.4 233.3 0.54 0.51 1 0.540 127K 31 0.0 0.0 L3 31/0 990.45 MB 1.0 0.6 0.5 0.1 0.6 0.5 0.1 1.2 196.9 196.7 3.17 2.73 2 1.583 633K 509 0.0 0.0 L4 156/0 9.67 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1262/27 101.78 GB 0.0 7.5 2.1 5.4 13.1 7.7 1.5 2.3 165.7 290.5 46.34 43.65 104 0.446 7799K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.5 2.1 5.4 13.1 7.7 1.5 2.3 165.7 290.5 46.34 43.65 104 0.446 7799K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.5 2.1 5.4 7.5 2.1 0.0 0.0 253.2 252.7 30.34 29.32 22 1.379 7799K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 362.2 16.00 14.34 82 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.9 total, 22.7 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.15 GB write, 588.24 MB/s write, 7.50 GB read, 335.65 MB/s read, 46.3 seconds Interval compaction: 13.15 GB write, 592.84 MB/s write, 7.50 GB read, 338.28 MB/s read, 46.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 16, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2137556 Average: 2.1540 StdDev: 11.29 Min: 0 Median: 1.4481 Max: 3394 Percentiles: P50: 1.45 P75: 1.83 P99: 5.48 P99.9: 10.98 P99.99: 95.31 ------------------------------------------------------ [ 0, 1 ] 438920 20.534% 20.534% #### ( 1, 2 ] 1405667 65.760% 86.294% ############# ( 2, 3 ] 184008 8.608% 94.903% ## ( 3, 4 ] 62759 2.936% 97.839% # ( 4, 6 ] 33619 1.573% 99.411% ( 6, 10 ] 10086 0.472% 99.883% ( 10, 15 ] 1833 0.086% 99.969% ( 15, 22 ] 238 0.011% 99.980% ( 22, 34 ] 32 0.001% 99.982% ( 34, 51 ] 17 0.001% 99.982% ( 51, 76 ] 12 0.001% 99.983% ( 76, 110 ] 268 0.013% 99.995% ( 110, 170 ] 325 0.015% 100.011% ( 170, 250 ] 94 0.004% 100.015% ( 250, 380 ] 90 0.004% 100.019% ( 380, 580 ] 50 0.002% 100.022% ( 580, 870 ] 46 0.002% 100.024% ( 870, 1300 ] 18 0.001% 100.025% ( 1300, 1900 ] 9 0.000% 100.025% ( 1900, 2900 ] 21 0.001% 100.026% ( 2900, 4400 ] 5 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 319195 Average: 2.4205 StdDev: 13.10 Min: 1 Median: 1.4875 Max: 3697 Percentiles: P50: 1.49 P75: 1.86 P99: 7.17 P99.9: 110.25 P99.99: 536.15 ------------------------------------------------------ [ 0, 1 ] 56189 17.603% 17.603% #### ( 1, 2 ] 212110 66.452% 84.055% ############# ( 2, 3 ] 31768 9.953% 94.007% ## ( 3, 4 ] 9217 2.888% 96.895% # ( 4, 6 ] 5801 1.817% 98.712% ( 6, 10 ] 3134 0.982% 99.694% ( 10, 15 ] 433 0.136% 99.830% ( 15, 22 ] 48 0.015% 99.845% ( 22, 34 ] 5 0.002% 99.846% ( 34, 51 ] 2 0.001% 99.847% ( 51, 76 ] 4 0.001% 99.848% ( 76, 110 ] 164 0.051% 99.900% ( 110, 170 ] 196 0.061% 99.961% ( 170, 250 ] 47 0.015% 99.976% ( 250, 380 ] 24 0.008% 99.983% ( 380, 580 ] 27 0.008% 99.992% ( 580, 870 ] 14 0.004% 99.996% ( 870, 1300 ] 9 0.003% 99.999% ( 1300, 1900 ] 1 0.000% 99.999% ( 1900, 2900 ] 1 0.000% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 31702 Average: 2.3419 StdDev: 4.35 Min: 1 Median: 1.5820 Max: 617 Percentiles: P50: 1.58 P75: 1.97 P99: 6.35 P99.9: 13.30 P99.99: 48.11 ------------------------------------------------------ [ 0, 1 ] 4003 12.627% 12.627% ### ( 1, 2 ] 20359 64.220% 76.847% ############# ( 2, 3 ] 4241 13.378% 90.225% ### ( 3, 4 ] 1388 4.378% 94.603% # ( 4, 6 ] 1370 4.321% 98.924% # ( 6, 10 ] 273 0.861% 99.786% ( 10, 15 ] 55 0.173% 99.959% ( 15, 22 ] 6 0.019% 99.978% ( 22, 34 ] 3 0.009% 99.987% ( 34, 51 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28873 Average: 4.5328 StdDev: 68.64 Min: 1 Median: 1.5591 Max: 4282 Percentiles: P50: 1.56 P75: 1.94 P99: 6.89 P99.9: 741.53 P99.99: 3533.81 ------------------------------------------------------ [ 0, 1 ] 3901 13.511% 13.511% ### ( 1, 2 ] 18843 65.262% 78.773% ############# ( 2, 3 ] 4055 14.044% 92.817% ### ( 3, 4 ] 1022 3.540% 96.356% # ( 4, 6 ] 726 2.514% 98.871% # ( 6, 10 ] 167 0.578% 99.449% ( 10, 15 ] 42 0.145% 99.595% ( 15, 22 ] 7 0.024% 99.619% ( 22, 34 ] 14 0.048% 99.668% ( 34, 51 ] 30 0.104% 99.771% ( 51, 76 ] 7 0.024% 99.796% ( 76, 110 ] 5 0.017% 99.813% ( 110, 170 ] 5 0.017% 99.830% ( 170, 250 ] 2 0.007% 99.837% ( 250, 380 ] 5 0.017% 99.855% ( 380, 580 ] 7 0.024% 99.879% ( 580, 870 ] 11 0.038% 99.917% ( 870, 1300 ] 5 0.017% 99.934% ( 1300, 1900 ] 7 0.024% 99.958% ( 1900, 2900 ] 7 0.024% 99.983% ( 2900, 4400 ] 5 0.017% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1587.0333 StdDev: 1272.33 Min: 202 Median: 1300.0000 Max: 5803 Percentiles: P50: 1300.00 P75: 2316.67 P99: 5803.00 P99.9: 5803.00 P99.99: 5803.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 1 3.333% 6.667% # ( 380, 580 ] 4 13.333% 20.000% ### ( 580, 870 ] 6 20.000% 40.000% #### ( 870, 1300 ] 3 10.000% 50.000% ## ( 1300, 1900 ] 5 16.667% 66.667% ### ( 1900, 2900 ] 6 20.000% 86.667% #### ( 2900, 4400 ] 3 10.000% 96.667% ## ( 4400, 6600 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 791.7500 StdDev: 1003.17 Min: 103 Median: 210.0000 Max: 3960 Percentiles: P50: 210.00 P75: 1450.00 P99: 3960.00 P99.9: 3960.00 P99.99: 3960.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 7 35.000% 45.000% ####### ( 170, 250 ] 2 10.000% 55.000% ## ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 1 5.000% 65.000% # ( 870, 1300 ] 1 5.000% 70.000% # ( 1300, 1900 ] 4 20.000% 90.000% #### ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 22.9 total, 8.1 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 258.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.386 H:M:S, 32.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 121.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.506 H:M:S, 68.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/13-03:09:45 ... thread 0: (1000000,7000000) ops and (97712.4,212517.4) ops/second in (10.234119,32.938486) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 2.39 GB 37.8 5.8 0.0 5.8 12.4 6.6 0.0 1.9 141.6 301.0 42.24 38.83 114 0.371 6075K 9308 0.0 0.0 L1 14/14 1.55 GB 0.0 5.3 4.1 1.3 5.3 4.0 0.1 1.3 230.9 228.1 23.73 22.57 4 5.932 5563K 66K 0.0 0.0 L2 2/0 51.03 MB 0.5 0.1 0.1 0.1 0.1 0.1 2.6 2.0 233.4 233.3 0.54 0.51 1 0.540 127K 31 0.0 0.0 L3 14/3 914.05 MB 0.9 0.6 0.5 0.1 0.6 0.5 2.1 1.2 196.9 196.7 3.17 2.73 2 1.583 633K 509 0.0 0.0 L4 185/47 11.44 GB 0.8 1.4 1.1 0.3 1.4 1.1 1.3 1.2 120.4 119.8 11.84 6.62 9 1.316 1420K 5886 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1273/72 102.64 GB 0.0 13.3 5.7 7.6 19.8 12.3 6.8 3.0 167.3 248.9 81.52 71.26 130 0.627 13M 82K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.3 5.7 7.6 19.8 12.3 6.8 3.0 167.3 248.9 81.52 71.26 130 0.627 13M 82K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.3 5.7 7.6 13.2 5.7 0.0 0.0 220.9 219.6 61.73 54.44 35 1.764 13M 82K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 340.6 19.79 16.83 95 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 33.1 total, 32.9 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.82 GB write, 612.79 MB/s write, 13.32 GB read, 411.78 MB/s read, 81.5 seconds Interval compaction: 19.82 GB write, 616.10 MB/s write, 13.32 GB read, 414.00 MB/s read, 81.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 29, interval: 46 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2776562 Average: 2.4470 StdDev: 18.60 Min: 0 Median: 1.4674 Max: 7351 Percentiles: P50: 1.47 P75: 1.86 P99: 5.95 P99.9: 96.25 P99.99: 185.15 ------------------------------------------------------ [ 0, 1 ] 555298 19.999% 19.999% #### ( 1, 2 ] 1782176 64.186% 84.186% ############# ( 2, 3 ] 258135 9.297% 93.483% ## ( 3, 4 ] 93884 3.381% 96.864% # ( 4, 6 ] 60679 2.185% 99.050% ( 6, 10 ] 18305 0.659% 99.709% ( 10, 15 ] 3403 0.123% 99.831% ( 15, 22 ] 482 0.017% 99.849% ( 22, 34 ] 43 0.002% 99.850% ( 34, 51 ] 21 0.001% 99.851% ( 51, 76 ] 86 0.003% 99.854% ( 76, 110 ] 2141 0.077% 99.931% ( 110, 170 ] 1565 0.056% 99.988% ( 170, 250 ] 361 0.013% 100.001% ( 250, 380 ] 280 0.010% 100.011% ( 380, 580 ] 199 0.007% 100.018% ( 580, 870 ] 115 0.004% 100.022% ( 870, 1300 ] 37 0.001% 100.023% ( 1300, 1900 ] 22 0.001% 100.024% ( 1900, 2900 ] 41 0.001% 100.026% ( 2900, 4400 ] 16 0.001% 100.026% ( 4400, 6600 ] 4 0.000% 100.026% ( 6600, 9900 ] 3 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 727226 Average: 3.9191 StdDev: 63.62 Min: 1 Median: 1.6183 Max: 10298 Percentiles: P50: 1.62 P75: 2.19 P99: 8.71 P99.9: 91.03 P99.99: 161.91 ------------------------------------------------------ [ 0, 1 ] 100930 13.879% 13.879% ### ( 1, 2 ] 424816 58.416% 72.295% ############ ( 2, 3 ] 105008 14.440% 86.734% ### ( 3, 4 ] 43074 5.923% 92.657% # ( 4, 6 ] 38743 5.328% 97.985% # ( 6, 10 ] 10916 1.501% 99.486% ( 10, 15 ] 2285 0.314% 99.800% ( 15, 22 ] 334 0.046% 99.846% ( 22, 34 ] 27 0.004% 99.850% ( 34, 51 ] 13 0.002% 99.851% ( 51, 76 ] 77 0.011% 99.862% ( 76, 110 ] 624 0.086% 99.948% ( 110, 170 ] 354 0.049% 99.997% ( 170, 250 ] 114 0.016% 100.012% ( 250, 380 ] 132 0.018% 100.030% ( 380, 580 ] 146 0.020% 100.050% ( 580, 870 ] 125 0.017% 100.068% ( 870, 1300 ] 87 0.012% 100.080% ( 1300, 1900 ] 42 0.006% 100.085% ( 1900, 2900 ] 46 0.006% 100.092% ( 2900, 4400 ] 83 0.011% 100.103% ( 4400, 6600 ] 24 0.003% 100.106% ( 6600, 9900 ] 9 0.001% 100.108% ( 9900, 14000 ] 1 0.000% 100.108% ** Level 2 read latency histogram (micros): Count: 31702 Average: 2.3419 StdDev: 4.35 Min: 1 Median: 1.5820 Max: 617 Percentiles: P50: 1.58 P75: 1.97 P99: 6.35 P99.9: 13.30 P99.99: 48.11 ------------------------------------------------------ [ 0, 1 ] 4003 12.627% 12.627% ### ( 1, 2 ] 20359 64.220% 76.847% ############# ( 2, 3 ] 4241 13.378% 90.225% ### ( 3, 4 ] 1388 4.378% 94.603% # ( 4, 6 ] 1370 4.321% 98.924% # ( 6, 10 ] 273 0.861% 99.786% ( 10, 15 ] 55 0.173% 99.959% ( 15, 22 ] 6 0.019% 99.978% ( 22, 34 ] 3 0.009% 99.987% ( 34, 51 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 87721 Average: 19.9634 StdDev: 173.15 Min: 1 Median: 1.7712 Max: 7977 Percentiles: P50: 1.77 P75: 2.66 P99: 536.87 P99.9: 1843.57 P99.99: 2822.00 ------------------------------------------------------ [ 0, 1 ] 6214 7.084% 7.084% # ( 1, 2 ] 48817 55.650% 62.734% ########### ( 2, 3 ] 16232 18.504% 81.238% #### ( 3, 4 ] 7741 8.825% 90.063% ## ( 4, 6 ] 4645 5.295% 95.358% # ( 6, 10 ] 1634 1.863% 97.221% ( 10, 15 ] 405 0.462% 97.682% ( 15, 22 ] 76 0.087% 97.769% ( 22, 34 ] 22 0.025% 97.794% ( 34, 51 ] 33 0.038% 97.832% ( 51, 76 ] 8 0.009% 97.841% ( 76, 110 ] 30 0.034% 97.875% ( 110, 170 ] 139 0.158% 98.034% ( 170, 250 ] 226 0.258% 98.291% ( 250, 380 ] 290 0.331% 98.622% ( 380, 580 ] 423 0.482% 99.104% ( 580, 870 ] 384 0.438% 99.542% ( 870, 1300 ] 211 0.241% 99.782% ( 1300, 1900 ] 114 0.130% 99.912% ( 1900, 2900 ] 74 0.084% 99.997% ( 2900, 4400 ] 58 0.066% 100.063% ( 4400, 6600 ] 14 0.016% 100.079% ( 6600, 9900 ] 5 0.006% 100.084% ** Level 4 read latency histogram (micros): Count: 9551 Average: 11.8162 StdDev: 135.37 Min: 1 Median: 1.9721 Max: 5803 Percentiles: P50: 1.97 P75: 3.00 P99: 14.51 P99.9: 2437.42 P99.99: 4498.78 ------------------------------------------------------ [ 0, 1 ] 156 1.633% 1.633% ( 1, 2 ] 4752 49.754% 51.387% ########## ( 2, 3 ] 2256 23.621% 75.008% ##### ( 3, 4 ] 1075 11.255% 86.263% ## ( 4, 6 ] 1016 10.638% 96.901% ## ( 6, 10 ] 159 1.665% 98.566% ( 10, 15 ] 46 0.482% 99.047% ( 15, 22 ] 3 0.031% 99.079% ( 22, 34 ] 2 0.021% 99.100% ( 34, 51 ] 3 0.031% 99.131% ( 76, 110 ] 3 0.031% 99.162% ( 110, 170 ] 4 0.042% 99.204% ( 170, 250 ] 14 0.147% 99.351% ( 250, 380 ] 7 0.073% 99.424% ( 380, 580 ] 11 0.115% 99.539% ( 580, 870 ] 13 0.136% 99.675% ( 870, 1300 ] 6 0.063% 99.738% ( 1300, 1900 ] 9 0.094% 99.832% ( 1900, 2900 ] 12 0.126% 99.958% ( 2900, 4400 ] 3 0.031% 99.990% ( 4400, 6600 ] 1 0.010% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 1221.7750 StdDev: 1568.31 Min: 103 Median: 354.0000 Max: 6011 Percentiles: P50: 354.00 P75: 1700.00 P99: 6011.00 P99.9: 6011.00 P99.99: 6011.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 8 20.000% 25.000% #### ( 170, 250 ] 6 15.000% 40.000% ### ( 250, 380 ] 5 12.500% 52.500% ### ( 380, 580 ] 2 5.000% 57.500% # ( 580, 870 ] 2 5.000% 62.500% # ( 870, 1300 ] 1 2.500% 65.000% # ( 1300, 1900 ] 6 15.000% 80.000% ### ( 1900, 2900 ] 1 2.500% 82.500% # ( 2900, 4400 ] 5 12.500% 95.000% ### ( 4400, 6600 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 33.1 total, 10.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 208.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.835 H:M:S, 44.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 96.17 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.449 H:M:S, 72.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/07/13-03:09:52 ... thread 0: (1000000,8000000) ops and (139715.4,199521.7) ops/second in (7.157407,40.095893) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 3.37 GB 138.1 7.7 0.0 7.7 15.2 7.6 0.0 2.0 148.7 294.7 52.96 48.63 132 0.401 7993K 13K 0.0 0.0 L1 14/14 1.55 GB 0.0 5.3 4.1 1.3 5.3 4.0 0.1 1.3 230.9 228.1 23.73 22.57 4 5.932 5563K 66K 0.0 0.0 L2 2/0 51.03 MB 0.5 0.1 0.1 0.1 0.1 0.1 2.6 2.0 233.4 233.3 0.54 0.51 1 0.540 127K 31 0.0 0.0 L3 11/0 907.93 MB 0.9 0.6 0.5 0.1 0.6 0.5 2.1 1.2 196.9 196.7 3.17 2.73 2 1.583 633K 509 0.0 0.0 L4 171/0 9.57 GB 1.0 5.3 1.1 4.2 5.3 1.1 1.3 4.7 173.5 173.2 31.48 22.85 12 2.624 1618K 5886 0.0 0.0 L5 1072/0 88.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1282/22 103.61 GB 0.0 19.1 5.8 13.3 26.6 13.2 8.7 3.5 174.9 243.3 111.88 97.29 151 0.741 15M 86K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.1 5.8 13.3 26.6 13.2 8.7 3.5 174.9 243.3 111.88 97.29 151 0.741 15M 86K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.1 5.8 13.3 19.0 5.7 0.0 0.0 219.4 218.4 89.16 77.93 42 2.123 15M 86K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 341.1 22.71 19.35 109 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 40.3 total, 40.1 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.58 GB write, 675.82 MB/s write, 19.11 GB read, 485.75 MB/s read, 111.9 seconds Interval compaction: 26.58 GB write, 678.82 MB/s write, 19.11 GB read, 487.90 MB/s read, 111.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 25, total-stops: 32, interval: 57 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3450760 Average: 2.7399 StdDev: 20.67 Min: 0 Median: 1.5085 Max: 7351 Percentiles: P50: 1.51 P75: 1.90 P99: 7.07 P99.9: 136.14 P99.99: 356.26 ------------------------------------------------------ [ 0, 1 ] 607603 17.608% 17.608% #### ( 1, 2 ] 2197982 63.696% 81.303% ############# ( 2, 3 ] 364331 10.558% 91.861% ## ( 3, 4 ] 141972 4.114% 95.976% # ( 4, 6 ] 96557 2.798% 98.774% # ( 6, 10 ] 29165 0.845% 99.619% ( 10, 15 ] 5255 0.152% 99.771% ( 15, 22 ] 698 0.020% 99.791% ( 22, 34 ] 54 0.002% 99.793% ( 34, 51 ] 28 0.001% 99.794% ( 51, 76 ] 88 0.003% 99.796% ( 76, 110 ] 2491 0.072% 99.869% ( 110, 170 ] 2493 0.072% 99.941% ( 170, 250 ] 1036 0.030% 99.971% ( 250, 380 ] 811 0.024% 99.994% ( 380, 580 ] 610 0.018% 100.012% ( 580, 870 ] 350 0.010% 100.022% ( 870, 1300 ] 113 0.003% 100.025% ( 1300, 1900 ] 44 0.001% 100.027% ( 1900, 2900 ] 47 0.001% 100.028% ( 2900, 4400 ] 20 0.001% 100.029% ( 4400, 6600 ] 4 0.000% 100.029% ( 6600, 9900 ] 3 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 901098 Average: 3.8488 StdDev: 57.87 Min: 1 Median: 1.6344 Max: 10298 Percentiles: P50: 1.63 P75: 2.23 P99: 8.97 P99.9: 111.63 P99.99: 256.21 ------------------------------------------------------ [ 0, 1 ] 112202 12.452% 12.452% ## ( 1, 2 ] 533369 59.191% 71.643% ############ ( 2, 3 ] 131368 14.579% 86.221% ### ( 3, 4 ] 55892 6.203% 92.424% # ( 4, 6 ] 47957 5.322% 97.746% # ( 6, 10 ] 15203 1.687% 99.433% ( 10, 15 ] 2811 0.312% 99.745% ( 15, 22 ] 462 0.051% 99.796% ( 22, 34 ] 37 0.004% 99.801% ( 34, 51 ] 15 0.002% 99.802% ( 51, 76 ] 80 0.009% 99.811% ( 76, 110 ] 786 0.087% 99.898% ( 110, 170 ] 587 0.065% 99.963% ( 170, 250 ] 230 0.026% 99.989% ( 250, 380 ] 207 0.023% 100.012% ( 380, 580 ] 211 0.023% 100.035% ( 580, 870 ] 155 0.017% 100.053% ( 870, 1300 ] 102 0.011% 100.064% ( 1300, 1900 ] 45 0.005% 100.069% ( 1900, 2900 ] 47 0.005% 100.074% ( 2900, 4400 ] 83 0.009% 100.083% ( 4400, 6600 ] 24 0.003% 100.086% ( 6600, 9900 ] 9 0.001% 100.087% ( 9900, 14000 ] 1 0.000% 100.087% ** Level 2 read latency histogram (micros): Count: 31702 Average: 2.3419 StdDev: 4.35 Min: 1 Median: 1.5820 Max: 617 Percentiles: P50: 1.58 P75: 1.97 P99: 6.35 P99.9: 13.30 P99.99: 48.11 ------------------------------------------------------ [ 0, 1 ] 4003 12.627% 12.627% ### ( 1, 2 ] 20359 64.220% 76.847% ############# ( 2, 3 ] 4241 13.378% 90.225% ### ( 3, 4 ] 1388 4.378% 94.603% # ( 4, 6 ] 1370 4.321% 98.924% # ( 6, 10 ] 273 0.861% 99.786% ( 10, 15 ] 55 0.173% 99.959% ( 15, 22 ] 6 0.019% 99.978% ( 22, 34 ] 3 0.009% 99.987% ( 34, 51 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 88650 Average: 21.3496 StdDev: 175.05 Min: 1 Median: 1.7787 Max: 7977 Percentiles: P50: 1.78 P75: 2.69 P99: 568.96 P99.9: 1851.34 P99.99: 2835.13 ------------------------------------------------------ [ 0, 1 ] 6214 7.010% 7.010% # ( 1, 2 ] 48941 55.207% 62.217% ########### ( 2, 3 ] 16539 18.657% 80.873% #### ( 3, 4 ] 7816 8.817% 89.690% ## ( 4, 6 ] 4690 5.290% 94.980% # ( 6, 10 ] 1653 1.865% 96.845% ( 10, 15 ] 406 0.458% 97.303% ( 15, 22 ] 78 0.088% 97.391% ( 22, 34 ] 22 0.025% 97.416% ( 34, 51 ] 33 0.037% 97.453% ( 51, 76 ] 8 0.009% 97.462% ( 76, 110 ] 53 0.060% 97.522% ( 110, 170 ] 202 0.228% 97.750% ( 170, 250 ] 294 0.332% 98.081% ( 250, 380 ] 361 0.407% 98.488% ( 380, 580 ] 480 0.541% 99.030% ( 580, 870 ] 436 0.492% 99.522% ( 870, 1300 ] 226 0.255% 99.777% ( 1300, 1900 ] 119 0.134% 99.911% ( 1900, 2900 ] 75 0.085% 99.995% ( 2900, 4400 ] 59 0.067% 100.062% ( 4400, 6600 ] 14 0.016% 100.078% ( 6600, 9900 ] 5 0.006% 100.083% ** Level 4 read latency histogram (micros): Count: 9836 Average: 21.0852 StdDev: 165.35 Min: 1 Median: 1.9919 Max: 5803 Percentiles: P50: 1.99 P75: 3.12 P99: 609.32 P99.9: 2577.60 P99.99: 4436.08 ------------------------------------------------------ [ 0, 1 ] 162 1.647% 1.647% ( 1, 2 ] 4795 48.749% 50.397% ########## ( 2, 3 ] 2291 23.292% 73.688% ##### ( 3, 4 ] 1096 11.143% 84.831% ## ( 4, 6 ] 1021 10.380% 95.211% ## ( 6, 10 ] 160 1.627% 96.838% ( 10, 15 ] 46 0.468% 97.306% ( 15, 22 ] 4 0.041% 97.346% ( 22, 34 ] 2 0.020% 97.367% ( 34, 51 ] 3 0.031% 97.397% ( 76, 110 ] 16 0.163% 97.560% ( 110, 170 ] 28 0.285% 97.845% ( 170, 250 ] 44 0.447% 98.292% ( 250, 380 ] 20 0.203% 98.495% ( 380, 580 ] 46 0.468% 98.963% ( 580, 870 ] 36 0.366% 99.329% ( 870, 1300 ] 29 0.295% 99.624% ( 1300, 1900 ] 17 0.173% 99.797% ( 1900, 2900 ] 15 0.153% 99.949% ( 2900, 4400 ] 4 0.041% 99.990% ( 4400, 6600 ] 1 0.010% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 1221.7750 StdDev: 1568.31 Min: 103 Median: 354.0000 Max: 6011 Percentiles: P50: 354.00 P75: 1700.00 P99: 6011.00 P99.9: 6011.00 P99.99: 6011.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 8 20.000% 25.000% #### ( 170, 250 ] 6 15.000% 40.000% ### ( 250, 380 ] 5 12.500% 52.500% ### ( 380, 580 ] 2 5.000% 57.500% # ( 580, 870 ] 2 5.000% 62.500% # ( 870, 1300 ] 1 2.500% 65.000% # ( 1300, 1900 ] 6 15.000% 80.000% ### ( 1900, 2900 ] 1 2.500% 82.500% # ( 2900, 4400 ] 5 12.500% 95.000% ### ( 4400, 6600 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 40.3 total, 7.2 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 195.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.339 H:M:S, 48.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 137.51 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.504 H:M:S, 62.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/13-03:10:01 ... thread 0: (1000000,9000000) ops and (107959.2,182338.9) ops/second in (9.262758,49.358651) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 2.58 GB 18.9 8.2 0.0 8.2 16.7 8.5 0.0 2.0 142.2 288.4 59.36 53.27 146 0.407 8569K 14K 0.0 0.0 L1 16/16 1.77 GB 0.0 8.6 5.8 2.8 8.5 5.7 0.1 1.5 221.2 218.5 39.92 37.07 5 7.983 7871K 66K 0.0 0.0 L2 1/0 61.50 MB 0.6 0.1 0.1 0.1 0.1 0.1 4.1 2.0 233.4 233.3 0.54 0.51 1 0.540 127K 31 0.0 0.0 L3 23/0 964.47 MB 1.0 1.8 0.9 0.9 1.8 0.9 3.2 1.9 137.6 136.5 13.26 8.55 9 1.473 1853K 14K 0.0 0.0 L4 163/4 9.81 GB 1.0 7.1 2.5 4.5 7.0 2.5 1.3 2.8 162.6 162.2 44.45 31.08 27 1.646 3402K 13K 0.0 0.0 L5 1088/0 89.32 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1305/31 104.48 GB 0.0 25.8 9.3 16.6 34.2 17.6 12.3 4.0 167.9 222.1 157.53 130.47 188 0.838 21M 109K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.8 9.3 16.6 34.2 17.6 12.3 4.0 167.9 222.1 157.53 130.47 188 0.838 21M 109K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.8 9.3 16.6 25.7 9.1 0.0 0.0 202.5 201.3 130.60 108.60 67 1.949 21M 109K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 322.8 26.93 21.88 121 0.223 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.5 total, 49.4 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.16 GB write, 706.21 MB/s write, 25.83 GB read, 533.84 MB/s read, 157.5 seconds Interval compaction: 34.16 GB write, 708.75 MB/s write, 25.83 GB read, 535.76 MB/s read, 157.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 49, pending-compaction-bytes-delays: 18, pending-compaction-bytes-stops: 0, total-delays: 29, total-stops: 49, interval: 78 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3867849 Average: 2.8286 StdDev: 30.70 Min: 0 Median: 1.5153 Max: 16936 Percentiles: P50: 1.52 P75: 1.91 P99: 7.19 P99.9: 134.98 P99.99: 384.53 ------------------------------------------------------ [ 0, 1 ] 669997 17.322% 17.322% ### ( 1, 2 ] 2452894 63.418% 80.740% ############# ( 2, 3 ] 417035 10.782% 91.522% ## ( 3, 4 ] 164361 4.249% 95.771% # ( 4, 6 ] 114708 2.966% 98.737% # ( 6, 10 ] 34251 0.886% 99.622% ( 10, 15 ] 6138 0.159% 99.781% ( 15, 22 ] 810 0.021% 99.802% ( 22, 34 ] 64 0.002% 99.804% ( 34, 51 ] 32 0.001% 99.805% ( 51, 76 ] 96 0.002% 99.807% ( 76, 110 ] 2525 0.065% 99.872% ( 110, 170 ] 2575 0.067% 99.939% ( 170, 250 ] 1077 0.028% 99.967% ( 250, 380 ] 886 0.023% 99.990% ( 380, 580 ] 672 0.017% 100.007% ( 580, 870 ] 416 0.011% 100.018% ( 870, 1300 ] 171 0.004% 100.022% ( 1300, 1900 ] 71 0.002% 100.024% ( 1900, 2900 ] 71 0.002% 100.026% ( 2900, 4400 ] 40 0.001% 100.027% ( 4400, 6600 ] 17 0.000% 100.027% ( 6600, 9900 ] 4 0.000% 100.027% ( 9900, 14000 ] 3 0.000% 100.028% ( 14000, 22000 ] 3 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 1562902 Average: 4.8867 StdDev: 91.28 Min: 1 Median: 1.6539 Max: 17985 Percentiles: P50: 1.65 P75: 2.35 P99: 9.20 P99.9: 111.62 P99.99: 276.67 ------------------------------------------------------ [ 0, 1 ] 202758 12.973% 12.973% ### ( 1, 2 ] 885017 56.627% 69.600% ########### ( 2, 3 ] 238646 15.269% 84.869% ### ( 3, 4 ] 103563 6.626% 91.495% # ( 4, 6 ] 93679 5.994% 97.489% # ( 6, 10 ] 29545 1.890% 99.380% ( 10, 15 ] 6047 0.387% 99.767% ( 15, 22 ] 912 0.058% 99.825% ( 22, 34 ] 69 0.004% 99.829% ( 34, 51 ] 22 0.001% 99.831% ( 51, 76 ] 145 0.009% 99.840% ( 76, 110 ] 911 0.058% 99.898% ( 110, 170 ] 931 0.060% 99.958% ( 170, 250 ] 409 0.026% 99.984% ( 250, 380 ] 447 0.029% 100.013% ( 380, 580 ] 490 0.031% 100.044% ( 580, 870 ] 414 0.026% 100.071% ( 870, 1300 ] 275 0.018% 100.088% ( 1300, 1900 ] 146 0.009% 100.098% ( 1900, 2900 ] 175 0.011% 100.109% ( 2900, 4400 ] 263 0.017% 100.126% ( 4400, 6600 ] 89 0.006% 100.131% ( 6600, 9900 ] 23 0.001% 100.133% ( 9900, 14000 ] 7 0.000% 100.133% ( 14000, 22000 ] 10 0.001% 100.134% ** Level 2 read latency histogram (micros): Count: 31702 Average: 2.3419 StdDev: 4.35 Min: 1 Median: 1.5820 Max: 617 Percentiles: P50: 1.58 P75: 1.97 P99: 6.35 P99.9: 13.30 P99.99: 48.11 ------------------------------------------------------ [ 0, 1 ] 4003 12.627% 12.627% ### ( 1, 2 ] 20359 64.220% 76.847% ############# ( 2, 3 ] 4241 13.378% 90.225% ### ( 3, 4 ] 1388 4.378% 94.603% # ( 4, 6 ] 1370 4.321% 98.924% # ( 6, 10 ] 273 0.861% 99.786% ( 10, 15 ] 55 0.173% 99.959% ( 15, 22 ] 6 0.019% 99.978% ( 22, 34 ] 3 0.009% 99.987% ( 34, 51 ] 1 0.003% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 351594 Average: 11.6185 StdDev: 141.46 Min: 1 Median: 1.9045 Max: 22558 Percentiles: P50: 1.90 P75: 2.91 P99: 12.23 P99.9: 649.31 P99.99: 778.01 ------------------------------------------------------ [ 0, 1 ] 10297 2.929% 2.929% # ( 1, 2 ] 182975 52.042% 54.970% ########## ( 2, 3 ] 77571 22.063% 77.033% #### ( 3, 4 ] 38285 10.889% 87.922% ## ( 4, 6 ] 32436 9.225% 97.147% ## ( 6, 10 ] 5912 1.681% 98.829% ( 10, 15 ] 1347 0.383% 99.212% ( 15, 22 ] 189 0.054% 99.266% ( 22, 34 ] 53 0.015% 99.281% ( 34, 51 ] 49 0.014% 99.295% ( 51, 76 ] 16 0.005% 99.299% ( 76, 110 ] 63 0.018% 99.317% ( 110, 170 ] 257 0.073% 99.390% ( 170, 250 ] 387 0.110% 99.500% ( 250, 380 ] 522 0.148% 99.649% ( 380, 580 ] 713 0.203% 99.852% ( 580, 870 ] 713 0.203% 100.054% ( 870, 1300 ] 405 0.115% 100.170% ( 1300, 1900 ] 209 0.059% 100.229% ( 1900, 2900 ] 141 0.040% 100.269% ( 2900, 4400 ] 161 0.046% 100.315% ( 4400, 6600 ] 35 0.010% 100.325% ( 6600, 9900 ] 10 0.003% 100.328% ( 9900, 14000 ] 1 0.000% 100.328% ( 14000, 22000 ] 1 0.000% 100.328% ( 22000, 33000 ] 1 0.000% 100.329% ** Level 4 read latency histogram (micros): Count: 63739 Average: 21.3180 StdDev: 244.83 Min: 1 Median: 1.9402 Max: 18373 Percentiles: P50: 1.94 P75: 2.96 P99: 522.26 P99.9: 2980.19 P99.99: 4390.81 ------------------------------------------------------ [ 0, 1 ] 1398 2.193% 2.193% ( 1, 2 ] 32408 50.845% 53.038% ########## ( 2, 3 ] 14538 22.809% 75.847% ##### ( 3, 4 ] 6555 10.284% 86.131% ## ( 4, 6 ] 5922 9.291% 95.422% ## ( 6, 10 ] 1407 2.207% 97.629% ( 10, 15 ] 332 0.521% 98.150% ( 15, 22 ] 37 0.058% 98.208% ( 22, 34 ] 6 0.009% 98.218% ( 34, 51 ] 4 0.006% 98.224% ( 51, 76 ] 2 0.003% 98.227% ( 76, 110 ] 31 0.049% 98.276% ( 110, 170 ] 88 0.138% 98.414% ( 170, 250 ] 128 0.201% 98.615% ( 250, 380 ] 119 0.187% 98.801% ( 380, 580 ] 178 0.279% 99.081% ( 580, 870 ] 204 0.320% 99.401% ( 870, 1300 ] 153 0.240% 99.641% ( 1300, 1900 ] 90 0.141% 99.782% ( 1900, 2900 ] 72 0.113% 99.895% ( 2900, 4400 ] 61 0.096% 99.991% ( 4400, 6600 ] 16 0.025% 100.016% ( 6600, 9900 ] 1 0.002% 100.017% ( 9900, 14000 ] 1 0.002% 100.019% ( 14000, 22000 ] 5 0.008% 100.027% ** Level 5 read latency histogram (micros): Count: 98 Average: 1278.1531 StdDev: 1544.83 Min: 103 Median: 513.3333 Max: 7469 Percentiles: P50: 513.33 P75: 2025.00 P99: 6666.00 P99.9: 7469.00 P99.99: 7469.00 ------------------------------------------------------ ( 76, 110 ] 4 4.082% 4.082% # ( 110, 170 ] 15 15.306% 19.388% ### ( 170, 250 ] 12 12.245% 31.633% ## ( 250, 380 ] 14 14.286% 45.918% ### ( 380, 580 ] 6 6.122% 52.041% # ( 580, 870 ] 9 9.184% 61.224% ## ( 870, 1300 ] 2 2.041% 63.265% ( 1300, 1900 ] 10 10.204% 73.469% ## ( 1900, 2900 ] 12 12.245% 85.714% ## ( 2900, 4400 ] 9 9.184% 94.898% ## ( 4400, 6600 ] 4 4.082% 98.980% # ( 6600, 9900 ] 1 1.020% 100.000% ** DB Stats ** Uptime(secs): 49.5 total, 9.3 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 178.81 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.639 H:M:S, 51.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 106.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.300 H:M:S, 68.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.058 micros/op 165078 ops/sec 60.080 seconds 9917999 operations; 160.0 MB/s Microseconds per write: Count: 9917999 Average: 6.0577 StdDev: 477.19 Min: 0 Median: 1.7156 Max: 776346 Percentiles: P50: 1.72 P75: 2.62 P99: 6.83 P99.9: 1180.97 P99.99: 2735.86 ------------------------------------------------------ [ 0, 1 ] 1429005 14.408% 14.408% ### ( 1, 2 ] 4933119 49.739% 64.147% ########## ( 2, 3 ] 1723615 17.379% 81.526% ### ( 3, 4 ] 1295544 13.063% 94.588% ### ( 4, 6 ] 425689 4.292% 98.881% # ( 6, 10 ] 57385 0.579% 99.459% ( 10, 15 ] 15079 0.152% 99.611% ( 15, 22 ] 5839 0.059% 99.670% ( 22, 34 ] 1526 0.015% 99.685% ( 34, 51 ] 173 0.002% 99.687% ( 51, 76 ] 19 0.000% 99.687% ( 76, 110 ] 7223 0.073% 99.760% ( 110, 170 ] 2512 0.025% 99.786% ( 170, 250 ] 259 0.003% 99.788% ( 250, 380 ] 41 0.000% 99.789% ( 380, 580 ] 14 0.000% 99.789% ( 580, 870 ] 25 0.000% 99.789% ( 870, 1300 ] 15230 0.154% 99.943% ( 1300, 1900 ] 16 0.000% 99.943% ( 1900, 2900 ] 5616 0.057% 99.999% ( 2900, 4400 ] 29 0.000% 100.000% ( 4400, 6600 ] 6 0.000% 100.000% ( 6600, 9900 ] 5 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 4 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 2 0.000% 100.000% ( 170000, 250000 ] 17 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 197152 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9917999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10235374968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 552 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33956016 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 32224251562 rocksdb.compact.write.bytes COUNT : 32009962202 rocksdb.flush.write.bytes COUNT : 10172575889 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 78 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 252 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10090819584 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4169728 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 28076610595 rocksdb.non.last.level.read.count COUNT : 6779634 rocksdb.block.checksum.compute.count COUNT : 7802691 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.356422 P95 : 3.725776 P99 : 5.860176 P100 : 776343.000000 COUNT : 9917999 SUM : 55685641 rocksdb.compaction.times.micros P50 : 1177826.086957 P95 : 7242500.000000 P99 : 16372261.000000 P100 : 16372261.000000 COUNT : 71 SUM : 134871094 rocksdb.compaction.times.cpu_micros P50 : 964193.548387 P95 : 5363333.333333 P99 : 15409310.000000 P100 : 15409310.000000 COUNT : 71 SUM : 112778357 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 714.390244 P95 : 2200.000000 P99 : 19280.000000 P100 : 37012.000000 COUNT : 134 SUM : 170668 rocksdb.compaction.outfile.sync.micros P50 : 917.467532 P95 : 116600.000000 P99 : 191280.000000 P100 : 227355.000000 COUNT : 367 SUM : 5715524 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 108.200000 P95 : 1034.833333 P99 : 3372.500000 P100 : 4929.000000 COUNT : 237 SUM : 62864 rocksdb.table.open.io.micros P50 : 1678.260870 P95 : 6856.666667 P99 : 12708.500000 P100 : 43650.000000 COUNT : 552 SUM : 1284425 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.599179 P95 : 7.610831 P99 : 11.984373 P100 : 18376.000000 COUNT : 7801062 SUM : 46769541 rocksdb.read.block.get.micros P50 : 563.606557 P95 : 3240.384615 P99 : 5271.200000 P100 : 22622.000000 COUNT : 1104 SUM : 1049334 rocksdb.write.raw.block.micros P50 : 0.512724 P95 : 0.974176 P99 : 2.810601 P100 : 40947.000000 COUNT : 10216442 SUM : 20777647 rocksdb.numfiles.in.singlecompaction P50 : 3.345238 P95 : 8.800000 P99 : 23.000000 P100 : 23.000000 COUNT : 132 SUM : 546 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.554228 P95 : 1157.817250 P99 : 2524.719743 P100 : 776158.000000 COUNT : 213532 SUM : 33965680 rocksdb.sst.read.micros P50 : 1.543378 P95 : 4.293094 P99 : 8.424376 P100 : 22558.000000 COUNT : 6779805 SUM : 26208472 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9917999 SUM : 10235374968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 208048.780488 P95 : 429400.000000 P99 : 810700.000000 P100 : 939511.000000 COUNT : 134 SUM : 29843088 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 337 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0