[2024-11-05 11:34:48.464141] Starting SPDK v25.01-pre git sha1 f220d590c / DPDK 22.11.4 initialization... [2024-11-05 11:34:48.464462] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3557096 ] Set seed to 1730802888457011 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-05 11:34:48.593305] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-05 11:34:48.618448] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-05 11:34:48.618502] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3557096' to capture a snapshot of events at runtime. [2024-11-05 11:34:48.618515] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-05 11:34:48.618528] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-05 11:34:48.618538] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3557096 for offline analysis/debug. [2024-11-05 11:34:48.619129] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Nov 5 11:34:50 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/05-11:34:53 ... thread 0: (1000000,1000000) ops and (328309.0,328309.0) ops/second in (3.045911,3.045911) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 693.00 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 353.2 2.50 2.34 13 0.192 0 0 0.0 0.0 L2 3/2 237.09 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 257.1 256.9 1.36 1.32 2 0.678 353K 184 0.0 0.0 L3 10/0 818.92 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1192/11 97.00 GB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 90.5 319.3 3.85 3.66 15 0.257 353K 184 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 90.5 319.3 3.85 3.66 15 0.257 353K 184 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 257.1 256.9 1.36 1.32 2 0.678 353K 184 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 353.2 2.50 2.34 13 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.20 GB write, 381.50 MB/s write, 0.34 GB read, 108.08 MB/s read, 3.9 seconds Interval compaction: 1.20 GB write, 403.71 MB/s write, 0.34 GB read, 114.37 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 147247 Average: 2.0275 StdDev: 6.04 Min: 0 Median: 1.3851 Max: 1503 Percentiles: P50: 1.39 P75: 1.80 P99: 5.61 P99.9: 11.39 P99.99: 47.92 ------------------------------------------------------ [ 0, 1 ] 39473 26.807% 26.807% ##### ( 1, 2 ] 88686 60.229% 87.037% ############ ( 2, 3 ] 11126 7.556% 94.593% ## ( 3, 4 ] 4390 2.981% 97.574% # ( 4, 6 ] 2614 1.775% 99.349% ( 6, 10 ] 771 0.524% 99.873% ( 10, 15 ] 150 0.102% 99.975% ( 15, 22 ] 15 0.010% 99.985% ( 22, 34 ] 6 0.004% 99.989% ( 34, 51 ] 4 0.003% 99.992% ( 51, 76 ] 4 0.003% 99.995% ( 76, 110 ] 1 0.001% 99.995% ( 170, 250 ] 21 0.014% 100.010% ( 250, 380 ] 2 0.001% 100.011% ( 380, 580 ] 1 0.001% 100.012% ( 870, 1300 ] 1 0.001% 100.012% ( 1300, 1900 ] 1 0.001% 100.013% ** Level 2 read latency histogram (micros): Count: 81159 Average: 2.1596 StdDev: 7.14 Min: 1 Median: 1.4013 Max: 1197 Percentiles: P50: 1.40 P75: 1.82 P99: 6.02 P99.9: 46.07 P99.99: 225.07 ------------------------------------------------------ [ 0, 1 ] 20986 25.858% 25.858% ##### ( 1, 2 ] 48826 60.161% 86.019% ############ ( 2, 3 ] 6611 8.146% 94.165% ## ( 3, 4 ] 2382 2.935% 97.100% # ( 4, 6 ] 1540 1.898% 98.997% ( 6, 10 ] 567 0.699% 99.696% ( 10, 15 ] 139 0.171% 99.867% ( 15, 22 ] 20 0.025% 99.892% ( 22, 34 ] 4 0.005% 99.896% ( 34, 51 ] 4 0.005% 99.901% ( 76, 110 ] 55 0.068% 99.969% ( 110, 170 ] 10 0.012% 99.982% ( 170, 250 ] 10 0.012% 99.994% ( 250, 380 ] 1 0.001% 99.995% ( 380, 580 ] 2 0.002% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 50 Average: 1070.9800 StdDev: 533.81 Min: 213 Median: 1028.4211 Max: 2521 Percentiles: P50: 1028.42 P75: 1330.00 P99: 2521.00 P99.9: 2521.00 P99.99: 2521.00 ------------------------------------------------------ ( 170, 250 ] 2 4.000% 4.000% # ( 250, 380 ] 3 6.000% 10.000% # ( 380, 580 ] 7 14.000% 24.000% ### ( 580, 870 ] 6 12.000% 36.000% ## ( 870, 1300 ] 19 38.000% 74.000% ######## ( 1300, 1900 ] 10 20.000% 94.000% #### ( 1900, 2900 ] 3 6.000% 100.000% # ** Level 4 read latency histogram (micros): Count: 25 Average: 1441.3200 StdDev: 535.86 Min: 420 Median: 1280.4545 Max: 2750 Percentiles: P50: 1280.45 P75: 1731.25 P99: 2750.00 P99.9: 2750.00 P99.99: 2750.00 ------------------------------------------------------ ( 380, 580 ] 1 4.000% 4.000% # ( 580, 870 ] 1 4.000% 8.000% # ( 870, 1300 ] 11 44.000% 52.000% ######### ( 1300, 1900 ] 8 32.000% 84.000% ###### ( 1900, 2900 ] 4 16.000% 100.000% ### ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 305.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.194 H:M:S, 6.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.194 H:M:S, 6.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/05-11:34:56 ... thread 0: (1000000,2000000) ops and (340477.5,334282.5) ops/second in (2.937052,5.982963) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 1.29 GB 107.0 1.0 0.0 1.0 2.8 1.8 0.0 1.6 110.1 309.4 9.16 8.69 32 0.286 1023K 994 0.0 0.0 L1 1/0 2.72 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 238.7 238.4 1.32 1.29 1 1.320 319K 407 0.0 0.0 L2 2/1 146.53 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.3 1.8 257.1 256.9 1.36 1.32 2 0.678 353K 184 0.0 0.0 L3 19/10 1.03 GB 0.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 230.0 230.0 0.81 0.78 1 0.814 190K 0 0.0 0.0 L4 173/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 171.0 171.0 0.99 0.86 1 0.985 171K 0 0.0 0.0 L5 1052/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/15 97.92 GB 0.0 2.0 0.8 1.1 3.8 2.6 0.7 2.1 148.7 282.6 13.63 12.95 37 0.368 2058K 1585 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 0.8 1.1 3.8 2.6 0.7 2.1 148.7 282.6 13.63 12.95 37 0.368 2058K 1585 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 0.8 1.1 2.0 0.8 0.0 0.0 238.4 238.2 8.50 8.20 9 0.945 2058K 1585 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 356.2 5.13 4.75 28 0.183 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.76 GB write, 625.21 MB/s write, 1.98 GB read, 329.00 MB/s read, 13.6 seconds Interval compaction: 3.76 GB write, 643.75 MB/s write, 1.98 GB read, 338.75 MB/s read, 13.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 405724 Average: 2.2522 StdDev: 5.82 Min: 0 Median: 1.5302 Max: 1503 Percentiles: P50: 1.53 P75: 1.92 P99: 5.91 P99.9: 12.66 P99.99: 20.58 ------------------------------------------------------ [ 0, 1 ] 65310 16.097% 16.097% ### ( 1, 2 ] 259430 63.942% 80.040% ############# ( 2, 3 ] 48126 11.862% 91.901% ## ( 3, 4 ] 18162 4.476% 96.378% # ( 4, 6 ] 11157 2.750% 99.128% # ( 6, 10 ] 2764 0.681% 99.809% ( 10, 15 ] 693 0.171% 99.980% ( 15, 22 ] 52 0.013% 99.993% ( 22, 34 ] 15 0.004% 99.996% ( 34, 51 ] 7 0.002% 99.998% ( 51, 76 ] 7 0.002% 100.000% ( 76, 110 ] 1 0.000% 100.000% ( 170, 250 ] 46 0.011% 100.011% ( 250, 380 ] 6 0.001% 100.013% ( 380, 580 ] 4 0.001% 100.014% ( 870, 1300 ] 6 0.001% 100.015% ( 1300, 1900 ] 2 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 20 Average: 111.6000 StdDev: 174.69 Min: 1 Median: 1.5000 Max: 494 Percentiles: P50: 1.50 P75: 250.00 P99: 494.00 P99.9: 494.00 P99.99: 494.00 ------------------------------------------------------ [ 0, 1 ] 7 35.000% 35.000% ####### ( 1, 2 ] 6 30.000% 65.000% ###### ( 10, 15 ] 1 5.000% 70.000% # ( 170, 250 ] 1 5.000% 75.000% # ( 250, 380 ] 3 15.000% 90.000% ### ( 380, 580 ] 2 10.000% 100.000% ## ** Level 2 read latency histogram (micros): Count: 88394 Average: 2.1822 StdDev: 6.85 Min: 1 Median: 1.4247 Max: 1197 Percentiles: P50: 1.42 P75: 1.84 P99: 6.01 P99.9: 23.45 P99.99: 219.28 ------------------------------------------------------ [ 0, 1 ] 21485 24.306% 24.306% ##### ( 1, 2 ] 53474 60.495% 84.801% ############ ( 2, 3 ] 7882 8.917% 93.718% ## ( 3, 4 ] 2820 3.190% 96.908% # ( 4, 6 ] 1847 2.090% 98.998% ( 6, 10 ] 620 0.701% 99.699% ( 10, 15 ] 155 0.175% 99.874% ( 15, 22 ] 22 0.025% 99.899% ( 22, 34 ] 5 0.006% 99.905% ( 34, 51 ] 4 0.005% 99.909% ( 76, 110 ] 55 0.062% 99.972% ( 110, 170 ] 10 0.011% 99.983% ( 170, 250 ] 10 0.011% 99.994% ( 250, 380 ] 1 0.001% 99.995% ( 380, 580 ] 2 0.002% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 210194 Average: 2.9285 StdDev: 19.36 Min: 0 Median: 1.6357 Max: 2521 Percentiles: P50: 1.64 P75: 2.13 P99: 9.12 P99.9: 100.38 P99.99: 472.01 ------------------------------------------------------ [ 0, 1 ] 20556 9.780% 9.780% ## ( 1, 2 ] 132986 63.268% 73.048% ############# ( 2, 3 ] 30544 14.531% 87.579% ### ( 3, 4 ] 13175 6.268% 93.847% # ( 4, 6 ] 7814 3.718% 97.565% # ( 6, 10 ] 3864 1.838% 99.403% ( 10, 15 ] 538 0.256% 99.659% ( 15, 22 ] 75 0.036% 99.695% ( 22, 34 ] 87 0.041% 99.736% ( 34, 51 ] 221 0.105% 99.841% ( 51, 76 ] 65 0.031% 99.872% ( 76, 110 ] 82 0.039% 99.911% ( 110, 170 ] 94 0.045% 99.956% ( 170, 250 ] 53 0.025% 99.981% ( 250, 380 ] 13 0.006% 99.987% ( 380, 580 ] 13 0.006% 99.993% ( 580, 870 ] 6 0.003% 99.996% ( 870, 1300 ] 19 0.009% 100.005% ( 1300, 1900 ] 10 0.005% 100.010% ( 1900, 2900 ] 3 0.001% 100.011% ** Level 4 read latency histogram (micros): Count: 310 Average: 122.4419 StdDev: 419.78 Min: 1 Median: 1.7903 Max: 2750 Percentiles: P50: 1.79 P75: 6.36 P99: 2125.00 P99.9: 2750.00 P99.99: 2750.00 ------------------------------------------------------ [ 0, 1 ] 57 18.387% 18.387% #### ( 1, 2 ] 124 40.000% 58.387% ######## ( 2, 3 ] 39 12.581% 70.968% ### ( 3, 4 ] 2 0.645% 71.613% ( 4, 6 ] 8 2.581% 74.194% # ( 6, 10 ] 28 9.032% 83.226% ## ( 10, 15 ] 21 6.774% 90.000% # ( 110, 170 ] 4 1.290% 91.290% ( 170, 250 ] 2 0.645% 91.935% ( 380, 580 ] 1 0.323% 92.258% ( 580, 870 ] 1 0.323% 92.581% ( 870, 1300 ] 11 3.548% 96.129% # ( 1300, 1900 ] 8 2.581% 98.710% # ( 1900, 2900 ] 4 1.290% 100.000% ** DB Stats ** Uptime(secs): 6.2 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 319.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.194 H:M:S, 3.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 335.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/05-11:34:59 ... thread 0: (1000000,3000000) ops and (348919.9,339023.3) ops/second in (2.865987,8.848950) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/8 2.27 GB 182.5 1.7 0.0 1.7 4.5 2.8 0.0 1.6 118.8 309.7 14.84 14.12 51 0.291 1791K 1778 0.0 0.0 L1 1/0 2.72 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 238.7 238.4 1.32 1.29 1 1.320 319K 407 0.0 0.0 L2 1/0 96.63 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.3 1.8 257.1 256.9 1.36 1.32 2 0.678 353K 184 0.0 0.0 L3 19/0 843.57 MB 0.8 1.0 0.2 0.8 1.0 0.2 0.2 4.4 246.8 246.4 4.28 4.12 2 2.140 1072K 1608 0.0 0.0 L4 173/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 171.0 171.0 0.99 0.86 1 0.985 171K 0 0.0 0.0 L5 1056/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1266/8 98.90 GB 0.0 3.6 0.9 2.7 6.3 3.7 1.3 2.3 160.3 284.5 22.79 21.72 57 0.400 3708K 3977 0.0 0.0 Int 0/0 0.00 KB 0.0 3.6 0.9 2.7 6.3 3.7 1.3 2.3 160.3 284.5 22.79 21.72 57 0.400 3708K 3977 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.6 0.9 2.7 3.6 0.9 0.0 0.0 244.9 244.6 14.91 14.43 13 1.147 3708K 3977 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 360.2 7.87 7.29 44 0.179 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.9 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.33 GB write, 718.09 MB/s write, 3.57 GB read, 404.53 MB/s read, 22.8 seconds Interval compaction: 6.33 GB write, 732.49 MB/s write, 3.57 GB read, 412.64 MB/s read, 22.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 651489 Average: 2.1755 StdDev: 5.92 Min: 0 Median: 1.4856 Max: 1503 Percentiles: P50: 1.49 P75: 1.88 P99: 5.85 P99.9: 12.69 P99.99: 20.50 ------------------------------------------------------ [ 0, 1 ] 124304 19.080% 19.080% #### ( 1, 2 ] 414805 63.670% 82.750% ############# ( 2, 3 ] 67647 10.383% 93.134% ## ( 3, 4 ] 25016 3.840% 96.974% # ( 4, 6 ] 14311 2.197% 99.170% ( 6, 10 ] 4162 0.639% 99.809% ( 10, 15 ] 1101 0.169% 99.978% ( 15, 22 ] 99 0.015% 99.993% ( 22, 34 ] 28 0.004% 99.998% ( 34, 51 ] 10 0.002% 99.999% ( 51, 76 ] 9 0.001% 100.000% ( 76, 110 ] 2 0.000% 100.001% ( 170, 250 ] 72 0.011% 100.012% ( 250, 380 ] 10 0.002% 100.013% ( 380, 580 ] 6 0.001% 100.014% ( 580, 870 ] 2 0.000% 100.015% ( 870, 1300 ] 8 0.001% 100.016% ( 1300, 1900 ] 4 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 20 Average: 111.6000 StdDev: 174.69 Min: 1 Median: 1.5000 Max: 494 Percentiles: P50: 1.50 P75: 250.00 P99: 494.00 P99.9: 494.00 P99.99: 494.00 ------------------------------------------------------ [ 0, 1 ] 7 35.000% 35.000% ####### ( 1, 2 ] 6 30.000% 65.000% ###### ( 10, 15 ] 1 5.000% 70.000% # ( 170, 250 ] 1 5.000% 75.000% # ( 250, 380 ] 3 15.000% 90.000% ### ( 380, 580 ] 2 10.000% 100.000% ## ** Level 2 read latency histogram (micros): Count: 100747 Average: 2.1699 StdDev: 6.42 Min: 1 Median: 1.4341 Max: 1197 Percentiles: P50: 1.43 P75: 1.84 P99: 5.95 P99.9: 18.26 P99.99: 209.40 ------------------------------------------------------ [ 0, 1 ] 23426 23.252% 23.252% ##### ( 1, 2 ] 62070 61.610% 84.862% ############ ( 2, 3 ] 9062 8.995% 93.857% ## ( 3, 4 ] 3213 3.189% 97.046% # ( 4, 6 ] 2018 2.003% 99.049% ( 6, 10 ] 687 0.682% 99.731% ( 10, 15 ] 160 0.159% 99.890% ( 15, 22 ] 22 0.022% 99.912% ( 22, 34 ] 5 0.005% 99.917% ( 34, 51 ] 4 0.004% 99.921% ( 76, 110 ] 55 0.055% 99.975% ( 110, 170 ] 10 0.010% 99.985% ( 170, 250 ] 10 0.010% 99.995% ( 250, 380 ] 1 0.001% 99.996% ( 380, 580 ] 2 0.002% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 250842 Average: 2.8891 StdDev: 18.08 Min: 0 Median: 1.6209 Max: 2521 Percentiles: P50: 1.62 P75: 2.06 P99: 9.09 P99.9: 107.80 P99.99: 435.94 ------------------------------------------------------ [ 0, 1 ] 25871 10.314% 10.314% ## ( 1, 2 ] 160336 63.919% 74.233% ############# ( 2, 3 ] 34977 13.944% 88.177% ### ( 3, 4 ] 14897 5.939% 94.115% # ( 4, 6 ] 8679 3.460% 97.575% # ( 6, 10 ] 4623 1.843% 99.418% ( 10, 15 ] 581 0.232% 99.650% ( 15, 22 ] 80 0.032% 99.682% ( 22, 34 ] 90 0.036% 99.718% ( 34, 51 ] 276 0.110% 99.828% ( 51, 76 ] 68 0.027% 99.855% ( 76, 110 ] 121 0.048% 99.903% ( 110, 170 ] 113 0.045% 99.948% ( 170, 250 ] 83 0.033% 99.981% ( 250, 380 ] 18 0.007% 99.988% ( 380, 580 ] 14 0.006% 99.994% ( 580, 870 ] 7 0.003% 99.997% ( 870, 1300 ] 19 0.008% 100.004% ( 1300, 1900 ] 10 0.004% 100.008% ( 1900, 2900 ] 3 0.001% 100.010% ** Level 4 read latency histogram (micros): Count: 310 Average: 122.4419 StdDev: 419.78 Min: 1 Median: 1.7903 Max: 2750 Percentiles: P50: 1.79 P75: 6.36 P99: 2125.00 P99.9: 2750.00 P99.99: 2750.00 ------------------------------------------------------ [ 0, 1 ] 57 18.387% 18.387% #### ( 1, 2 ] 124 40.000% 58.387% ######## ( 2, 3 ] 39 12.581% 70.968% ### ( 3, 4 ] 2 0.645% 71.613% ( 4, 6 ] 8 2.581% 74.194% # ( 6, 10 ] 28 9.032% 83.226% ## ( 10, 15 ] 21 6.774% 90.000% # ( 110, 170 ] 4 1.290% 91.290% ( 170, 250 ] 2 0.645% 91.935% ( 380, 580 ] 1 0.323% 92.258% ( 580, 870 ] 1 0.323% 92.581% ( 870, 1300 ] 11 3.548% 96.129% # ( 1300, 1900 ] 8 2.581% 98.710% # ( 1900, 2900 ] 4 1.290% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 285.9500 StdDev: 215.87 Min: 109 Median: 170.0000 Max: 813 Percentiles: P50: 170.00 P75: 380.00 P99: 813.00 P99.9: 813.00 P99.99: 813.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 8 40.000% 50.000% ######## ( 170, 250 ] 4 20.000% 70.000% #### ( 250, 380 ] 1 5.000% 75.000% # ( 380, 580 ] 2 10.000% 85.000% ## ( 580, 870 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 9.0 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 327.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.194 H:M:S, 2.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 343.39 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/05-11:35:02 ... thread 0: (1000000,4000000) ops and (334429.1,337862.9) ops/second in (2.990170,11.839120) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/8 3.26 GB 276.9 2.7 0.0 2.7 6.5 3.8 0.0 1.7 129.4 308.7 21.42 20.44 70 0.306 2814K 2793 0.0 0.0 L1 1/0 2.72 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 238.7 238.4 1.32 1.29 1 1.320 319K 407 0.0 0.0 L2 1/0 96.63 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.3 1.8 257.1 256.9 1.36 1.32 2 0.678 353K 184 0.0 0.0 L3 19/0 843.57 MB 0.8 1.0 0.2 0.8 1.0 0.2 0.2 4.4 246.8 246.4 4.28 4.12 2 2.140 1072K 1608 0.0 0.0 L4 173/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 171.0 171.0 0.99 0.86 1 0.985 171K 0 0.0 0.0 L5 1056/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/8 99.88 GB 0.0 4.6 0.9 3.7 8.3 4.6 1.3 2.2 158.7 289.4 29.36 28.04 76 0.386 4732K 4992 0.0 0.0 Int 0/0 0.00 KB 0.0 4.6 0.9 3.7 8.3 4.6 1.3 2.2 158.7 289.4 29.36 28.04 76 0.386 4732K 4992 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.6 0.9 3.7 4.5 0.9 0.0 0.0 247.6 247.3 18.82 18.26 17 1.107 4732K 4992 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 364.7 10.54 9.77 59 0.179 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.8 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.30 GB write, 707.09 MB/s write, 4.55 GB read, 387.76 MB/s read, 29.4 seconds Interval compaction: 8.30 GB write, 717.69 MB/s write, 4.55 GB read, 393.57 MB/s read, 29.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 889119 Average: 2.1010 StdDev: 6.05 Min: 0 Median: 1.4407 Max: 1567 Percentiles: P50: 1.44 P75: 1.84 P99: 5.71 P99.9: 12.52 P99.99: 21.14 ------------------------------------------------------ [ 0, 1 ] 198586 22.335% 22.335% #### ( 1, 2 ] 558129 62.773% 85.108% ############# ( 2, 3 ] 80609 9.066% 94.175% ## ( 3, 4 ] 29471 3.315% 97.489% # ( 4, 6 ] 15708 1.767% 99.256% ( 6, 10 ] 5025 0.565% 99.821% ( 10, 15 ] 1396 0.157% 99.978% ( 15, 22 ] 122 0.014% 99.992% ( 22, 34 ] 38 0.004% 99.996% ( 34, 51 ] 16 0.002% 99.998% ( 51, 76 ] 10 0.001% 99.999% ( 76, 110 ] 2 0.000% 99.999% ( 170, 250 ] 95 0.011% 100.010% ( 250, 380 ] 16 0.002% 100.012% ( 380, 580 ] 9 0.001% 100.013% ( 580, 870 ] 3 0.000% 100.013% ( 870, 1300 ] 11 0.001% 100.014% ( 1300, 1900 ] 6 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 20 Average: 111.6000 StdDev: 174.69 Min: 1 Median: 1.5000 Max: 494 Percentiles: P50: 1.50 P75: 250.00 P99: 494.00 P99.9: 494.00 P99.99: 494.00 ------------------------------------------------------ [ 0, 1 ] 7 35.000% 35.000% ####### ( 1, 2 ] 6 30.000% 65.000% ###### ( 10, 15 ] 1 5.000% 70.000% # ( 170, 250 ] 1 5.000% 75.000% # ( 250, 380 ] 3 15.000% 90.000% ### ( 380, 580 ] 2 10.000% 100.000% ## ** Level 2 read latency histogram (micros): Count: 100747 Average: 2.1699 StdDev: 6.42 Min: 1 Median: 1.4341 Max: 1197 Percentiles: P50: 1.43 P75: 1.84 P99: 5.95 P99.9: 18.26 P99.99: 209.40 ------------------------------------------------------ [ 0, 1 ] 23426 23.252% 23.252% ##### ( 1, 2 ] 62070 61.610% 84.862% ############ ( 2, 3 ] 9062 8.995% 93.857% ## ( 3, 4 ] 3213 3.189% 97.046% # ( 4, 6 ] 2018 2.003% 99.049% ( 6, 10 ] 687 0.682% 99.731% ( 10, 15 ] 160 0.159% 99.890% ( 15, 22 ] 22 0.022% 99.912% ( 22, 34 ] 5 0.005% 99.917% ( 34, 51 ] 4 0.004% 99.921% ( 76, 110 ] 55 0.055% 99.975% ( 110, 170 ] 10 0.010% 99.985% ( 170, 250 ] 10 0.010% 99.995% ( 250, 380 ] 1 0.001% 99.996% ( 380, 580 ] 2 0.002% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 250842 Average: 2.8891 StdDev: 18.08 Min: 0 Median: 1.6209 Max: 2521 Percentiles: P50: 1.62 P75: 2.06 P99: 9.09 P99.9: 107.80 P99.99: 435.94 ------------------------------------------------------ [ 0, 1 ] 25871 10.314% 10.314% ## ( 1, 2 ] 160336 63.919% 74.233% ############# ( 2, 3 ] 34977 13.944% 88.177% ### ( 3, 4 ] 14897 5.939% 94.115% # ( 4, 6 ] 8679 3.460% 97.575% # ( 6, 10 ] 4623 1.843% 99.418% ( 10, 15 ] 581 0.232% 99.650% ( 15, 22 ] 80 0.032% 99.682% ( 22, 34 ] 90 0.036% 99.718% ( 34, 51 ] 276 0.110% 99.828% ( 51, 76 ] 68 0.027% 99.855% ( 76, 110 ] 121 0.048% 99.903% ( 110, 170 ] 113 0.045% 99.948% ( 170, 250 ] 83 0.033% 99.981% ( 250, 380 ] 18 0.007% 99.988% ( 380, 580 ] 14 0.006% 99.994% ( 580, 870 ] 7 0.003% 99.997% ( 870, 1300 ] 19 0.008% 100.004% ( 1300, 1900 ] 10 0.004% 100.008% ( 1900, 2900 ] 3 0.001% 100.010% ** Level 4 read latency histogram (micros): Count: 310 Average: 122.4419 StdDev: 419.78 Min: 1 Median: 1.7903 Max: 2750 Percentiles: P50: 1.79 P75: 6.36 P99: 2125.00 P99.9: 2750.00 P99.99: 2750.00 ------------------------------------------------------ [ 0, 1 ] 57 18.387% 18.387% #### ( 1, 2 ] 124 40.000% 58.387% ######## ( 2, 3 ] 39 12.581% 70.968% ### ( 3, 4 ] 2 0.645% 71.613% ( 4, 6 ] 8 2.581% 74.194% # ( 6, 10 ] 28 9.032% 83.226% ## ( 10, 15 ] 21 6.774% 90.000% # ( 110, 170 ] 4 1.290% 91.290% ( 170, 250 ] 2 0.645% 91.935% ( 380, 580 ] 1 0.323% 92.258% ( 580, 870 ] 1 0.323% 92.581% ( 870, 1300 ] 11 3.548% 96.129% # ( 1300, 1900 ] 8 2.581% 98.710% # ( 1900, 2900 ] 4 1.290% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 285.9500 StdDev: 215.87 Min: 109 Median: 170.0000 Max: 813 Percentiles: P50: 170.00 P75: 380.00 P99: 813.00 P99.9: 813.00 P99.99: 813.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 8 40.000% 50.000% ######## ( 170, 250 ] 4 20.000% 70.000% #### ( 250, 380 ] 1 5.000% 75.000% # ( 380, 580 ] 2 10.000% 85.000% ## ( 580, 870 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 327.56 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.342 H:M:S, 2.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.148 H:M:S, 4.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/05-11:35:18 ... thread 0: (1000000,5000000) ops and (59887.9,175211.3) ops/second in (16.697860,28.536980) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 818.50 MB 56.6 3.8 0.0 3.8 8.5 4.7 0.0 1.8 136.4 308.5 28.17 26.94 90 0.313 3902K 3931 0.0 0.0 L1 9/9 1.07 GB 0.0 3.8 3.7 0.0 3.7 3.7 0.2 1.0 230.5 227.0 16.67 16.06 2 8.333 3901K 59K 0.0 0.0 L2 20/11 2.41 GB 10.8 0.3 0.2 0.2 0.3 0.2 2.6 1.8 257.1 256.9 1.36 1.32 2 0.678 353K 184 0.0 0.0 L3 19/2 843.57 MB 0.6 1.0 0.2 0.8 1.0 0.2 0.2 4.4 246.8 246.4 4.28 4.12 2 2.140 1072K 1608 0.0 0.0 L4 173/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 171.0 171.0 0.99 0.86 1 0.985 171K 0 0.0 0.0 L5 1056/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1284/26 100.81 GB 0.0 9.0 4.3 4.7 13.7 9.0 3.6 2.9 179.9 272.9 51.45 49.30 97 0.530 9401K 65K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.0 4.3 4.7 13.7 9.0 3.6 2.9 179.9 272.9 51.45 49.30 97 0.530 9401K 65K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.0 4.3 4.7 9.0 4.3 0.0 0.0 242.8 241.1 38.13 36.94 22 1.733 9401K 65K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 364.2 13.32 12.36 75 0.178 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.7 total, 28.5 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.71 GB write, 489.05 MB/s write, 9.04 GB read, 322.41 MB/s read, 51.5 seconds Interval compaction: 13.71 GB write, 492.10 MB/s write, 9.04 GB read, 324.41 MB/s read, 51.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 2, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2008393 Average: 2.2034 StdDev: 7.83 Min: 0 Median: 1.3652 Max: 1567 Percentiles: P50: 1.37 P75: 1.77 P99: 5.66 P99.9: 127.46 P99.99: 206.05 ------------------------------------------------------ [ 0, 1 ] 548502 27.310% 27.310% ##### ( 1, 2 ] 1247871 62.133% 89.443% ############ ( 2, 3 ] 120628 6.006% 95.449% # ( 3, 4 ] 48205 2.400% 97.850% ( 4, 6 ] 27788 1.384% 99.233% ( 6, 10 ] 9187 0.457% 99.691% ( 10, 15 ] 2176 0.108% 99.799% ( 15, 22 ] 447 0.022% 99.821% ( 22, 34 ] 52 0.003% 99.824% ( 34, 51 ] 20 0.001% 99.825% ( 51, 76 ] 12 0.001% 99.825% ( 76, 110 ] 817 0.041% 99.866% ( 110, 170 ] 2339 0.116% 99.983% ( 170, 250 ] 331 0.016% 99.999% ( 250, 380 ] 154 0.008% 100.007% ( 380, 580 ] 27 0.001% 100.008% ( 580, 870 ] 11 0.001% 100.009% ( 870, 1300 ] 17 0.001% 100.010% ( 1300, 1900 ] 6 0.000% 100.010% ** Level 1 read latency histogram (micros): Count: 63301 Average: 3.9540 StdDev: 19.58 Min: 0 Median: 1.8066 Max: 962 Percentiles: P50: 1.81 P75: 2.63 P99: 10.26 P99.9: 169.58 P99.99: 315.82 ------------------------------------------------------ [ 0, 1 ] 1882 2.973% 2.973% # ( 1, 2 ] 36905 58.301% 61.274% ############ ( 2, 3 ] 13688 21.624% 82.898% #### ( 3, 4 ] 5372 8.486% 91.384% ## ( 4, 6 ] 3781 5.973% 97.357% # ( 6, 10 ] 1027 1.622% 98.979% ( 10, 15 ] 272 0.430% 99.409% ( 15, 22 ] 51 0.081% 99.490% ( 22, 34 ] 5 0.008% 99.498% ( 51, 76 ] 2 0.003% 99.501% ( 76, 110 ] 68 0.107% 99.608% ( 110, 170 ] 187 0.295% 99.904% ( 170, 250 ] 42 0.066% 99.970% ( 250, 380 ] 27 0.043% 100.013% ( 380, 580 ] 53 0.084% 100.096% ( 580, 870 ] 10 0.016% 100.112% ( 870, 1300 ] 1 0.002% 100.114% ** Level 2 read latency histogram (micros): Count: 100747 Average: 2.1699 StdDev: 6.42 Min: 1 Median: 1.4341 Max: 1197 Percentiles: P50: 1.43 P75: 1.84 P99: 5.95 P99.9: 18.26 P99.99: 209.40 ------------------------------------------------------ [ 0, 1 ] 23426 23.252% 23.252% ##### ( 1, 2 ] 62070 61.610% 84.862% ############ ( 2, 3 ] 9062 8.995% 93.857% ## ( 3, 4 ] 3213 3.189% 97.046% # ( 4, 6 ] 2018 2.003% 99.049% ( 6, 10 ] 687 0.682% 99.731% ( 10, 15 ] 160 0.159% 99.890% ( 15, 22 ] 22 0.022% 99.912% ( 22, 34 ] 5 0.005% 99.917% ( 34, 51 ] 4 0.004% 99.921% ( 76, 110 ] 55 0.055% 99.975% ( 110, 170 ] 10 0.010% 99.985% ( 170, 250 ] 10 0.010% 99.995% ( 250, 380 ] 1 0.001% 99.996% ( 380, 580 ] 2 0.002% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 250842 Average: 2.8891 StdDev: 18.08 Min: 0 Median: 1.6209 Max: 2521 Percentiles: P50: 1.62 P75: 2.06 P99: 9.09 P99.9: 107.80 P99.99: 435.94 ------------------------------------------------------ [ 0, 1 ] 25871 10.314% 10.314% ## ( 1, 2 ] 160336 63.919% 74.233% ############# ( 2, 3 ] 34977 13.944% 88.177% ### ( 3, 4 ] 14897 5.939% 94.115% # ( 4, 6 ] 8679 3.460% 97.575% # ( 6, 10 ] 4623 1.843% 99.418% ( 10, 15 ] 581 0.232% 99.650% ( 15, 22 ] 80 0.032% 99.682% ( 22, 34 ] 90 0.036% 99.718% ( 34, 51 ] 276 0.110% 99.828% ( 51, 76 ] 68 0.027% 99.855% ( 76, 110 ] 121 0.048% 99.903% ( 110, 170 ] 113 0.045% 99.948% ( 170, 250 ] 83 0.033% 99.981% ( 250, 380 ] 18 0.007% 99.988% ( 380, 580 ] 14 0.006% 99.994% ( 580, 870 ] 7 0.003% 99.997% ( 870, 1300 ] 19 0.008% 100.004% ( 1300, 1900 ] 10 0.004% 100.008% ( 1900, 2900 ] 3 0.001% 100.010% ** Level 4 read latency histogram (micros): Count: 310 Average: 122.4419 StdDev: 419.78 Min: 1 Median: 1.7903 Max: 2750 Percentiles: P50: 1.79 P75: 6.36 P99: 2125.00 P99.9: 2750.00 P99.99: 2750.00 ------------------------------------------------------ [ 0, 1 ] 57 18.387% 18.387% #### ( 1, 2 ] 124 40.000% 58.387% ######## ( 2, 3 ] 39 12.581% 70.968% ### ( 3, 4 ] 2 0.645% 71.613% ( 4, 6 ] 8 2.581% 74.194% # ( 6, 10 ] 28 9.032% 83.226% ## ( 10, 15 ] 21 6.774% 90.000% # ( 110, 170 ] 4 1.290% 91.290% ( 170, 250 ] 2 0.645% 91.935% ( 380, 580 ] 1 0.323% 92.258% ( 580, 870 ] 1 0.323% 92.581% ( 870, 1300 ] 11 3.548% 96.129% # ( 1300, 1900 ] 8 2.581% 98.710% # ( 1900, 2900 ] 4 1.290% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 285.9500 StdDev: 215.87 Min: 109 Median: 170.0000 Max: 813 Percentiles: P50: 170.00 P75: 380.00 P99: 813.00 P99.9: 813.00 P99.99: 813.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 8 40.000% 50.000% ######## ( 170, 250 ] 4 20.000% 70.000% #### ( 250, 380 ] 1 5.000% 75.000% # ( 380, 580 ] 2 10.000% 85.000% ## ( 580, 870 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 28.7 total, 16.7 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 171.36 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.009 H:M:S, 48.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 58.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:13.667 H:M:S, 81.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/05-11:35:22 ... thread 0: (1000000,6000000) ops and (321433.2,189585.2) ops/second in (3.111066,31.648046) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/8 1.72 GB 125.9 4.5 0.0 4.5 10.1 5.7 0.0 1.8 135.0 305.1 34.06 32.50 108 0.315 4669K 4692 0.0 0.0 L1 9/9 1.07 GB 0.0 3.8 3.7 0.0 3.7 3.7 0.2 1.0 230.5 227.0 16.67 16.06 2 8.333 3901K 59K 0.0 0.0 L2 16/13 1.91 GB 3.1 0.3 0.2 0.2 0.3 0.2 2.6 1.8 257.1 256.9 1.36 1.32 2 0.678 353K 184 0.0 0.0 L3 25/3 1.07 GB 0.9 1.7 0.7 0.9 1.7 0.7 0.2 2.3 231.6 231.2 7.34 7.05 3 2.447 1726K 3252 0.0 0.0 L4 173/0 9.59 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 171.0 171.0 0.99 0.86 1 0.985 171K 0 0.0 0.0 L5 1060/0 86.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1296/33 101.73 GB 0.0 10.4 4.8 5.6 16.0 10.4 4.1 2.8 176.4 271.3 60.40 57.80 116 0.521 10M 67K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.4 4.8 5.6 16.0 10.4 4.1 2.8 176.4 271.3 60.40 57.80 116 0.521 10M 67K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.4 4.8 5.6 10.3 4.8 0.0 0.0 240.1 238.6 44.39 42.98 26 1.707 10M 67K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 362.0 16.01 14.81 90 0.178 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.8 total, 31.6 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.00 GB write, 514.85 MB/s write, 10.41 GB read, 334.88 MB/s read, 60.4 seconds Interval compaction: 16.00 GB write, 517.74 MB/s write, 10.41 GB read, 336.76 MB/s read, 60.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 2, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2258339 Average: 2.2622 StdDev: 7.56 Min: 0 Median: 1.4089 Max: 1567 Percentiles: P50: 1.41 P75: 1.81 P99: 5.87 P99.9: 120.30 P99.99: 191.63 ------------------------------------------------------ [ 0, 1 ] 558791 24.743% 24.743% ##### ( 1, 2 ] 1394857 61.765% 86.508% ############ ( 2, 3 ] 168185 7.447% 93.955% # ( 3, 4 ] 70811 3.136% 97.091% # ( 4, 6 ] 46160 2.044% 99.135% ( 6, 10 ] 12349 0.547% 99.682% ( 10, 15 ] 3056 0.135% 99.817% ( 15, 22 ] 549 0.024% 99.841% ( 22, 34 ] 65 0.003% 99.844% ( 34, 51 ] 24 0.001% 99.845% ( 51, 76 ] 15 0.001% 99.846% ( 76, 110 ] 818 0.036% 99.882% ( 110, 170 ] 2339 0.104% 99.986% ( 170, 250 ] 352 0.016% 100.001% ( 250, 380 ] 162 0.007% 100.009% ( 380, 580 ] 29 0.001% 100.010% ( 580, 870 ] 13 0.001% 100.010% ( 870, 1300 ] 20 0.001% 100.011% ( 1300, 1900 ] 6 0.000% 100.012% ** Level 1 read latency histogram (micros): Count: 576162 Average: 3.2014 StdDev: 12.72 Min: 0 Median: 1.8748 Max: 3618 Percentiles: P50: 1.87 P75: 2.76 P99: 8.94 P99.9: 14.86 P99.99: 111.15 ------------------------------------------------------ [ 0, 1 ] 8514 1.478% 1.478% ( 1, 2 ] 319570 55.465% 56.943% ########### ( 2, 3 ] 137352 23.839% 80.782% ##### ( 3, 4 ] 52424 9.099% 89.881% ## ( 4, 6 ] 44386 7.704% 97.585% ## ( 6, 10 ] 11087 1.924% 99.509% ( 10, 15 ] 2321 0.403% 99.912% ( 15, 22 ] 276 0.048% 99.960% ( 22, 34 ] 25 0.004% 99.964% ( 34, 51 ] 4 0.001% 99.965% ( 51, 76 ] 3 0.001% 99.965% ( 76, 110 ] 137 0.024% 99.989% ( 110, 170 ] 436 0.076% 100.065% ( 170, 250 ] 243 0.042% 100.107% ( 250, 380 ] 107 0.019% 100.125% ( 380, 580 ] 89 0.015% 100.141% ( 580, 870 ] 17 0.003% 100.144% ( 870, 1300 ] 6 0.001% 100.145% ( 1300, 1900 ] 1 0.000% 100.145% ( 1900, 2900 ] 3 0.001% 100.146% ( 2900, 4400 ] 1 0.000% 100.146% ** Level 2 read latency histogram (micros): Count: 100747 Average: 2.1699 StdDev: 6.42 Min: 1 Median: 1.4341 Max: 1197 Percentiles: P50: 1.43 P75: 1.84 P99: 5.95 P99.9: 18.26 P99.99: 209.40 ------------------------------------------------------ [ 0, 1 ] 23426 23.252% 23.252% ##### ( 1, 2 ] 62070 61.610% 84.862% ############ ( 2, 3 ] 9062 8.995% 93.857% ## ( 3, 4 ] 3213 3.189% 97.046% # ( 4, 6 ] 2018 2.003% 99.049% ( 6, 10 ] 687 0.682% 99.731% ( 10, 15 ] 160 0.159% 99.890% ( 15, 22 ] 22 0.022% 99.912% ( 22, 34 ] 5 0.005% 99.917% ( 34, 51 ] 4 0.004% 99.921% ( 76, 110 ] 55 0.055% 99.975% ( 110, 170 ] 10 0.010% 99.985% ( 170, 250 ] 10 0.010% 99.995% ( 250, 380 ] 1 0.001% 99.996% ( 380, 580 ] 2 0.002% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 262690 Average: 2.9137 StdDev: 17.87 Min: 0 Median: 1.6337 Max: 2521 Percentiles: P50: 1.63 P75: 2.13 P99: 9.10 P99.9: 110.69 P99.99: 439.14 ------------------------------------------------------ [ 0, 1 ] 26001 9.898% 9.898% ## ( 1, 2 ] 166235 63.282% 73.180% ############# ( 2, 3 ] 37953 14.448% 87.628% ### ( 3, 4 ] 16234 6.180% 93.808% # ( 4, 6 ] 9883 3.762% 97.570% # ( 6, 10 ] 4855 1.848% 99.418% ( 10, 15 ] 625 0.238% 99.656% ( 15, 22 ] 85 0.032% 99.688% ( 22, 34 ] 90 0.034% 99.722% ( 34, 51 ] 276 0.105% 99.828% ( 51, 76 ] 68 0.026% 99.853% ( 76, 110 ] 121 0.046% 99.900% ( 110, 170 ] 114 0.043% 99.943% ( 170, 250 ] 99 0.038% 99.981% ( 250, 380 ] 20 0.008% 99.988% ( 380, 580 ] 16 0.006% 99.994% ( 580, 870 ] 8 0.003% 99.997% ( 870, 1300 ] 19 0.007% 100.005% ( 1300, 1900 ] 10 0.004% 100.008% ( 1900, 2900 ] 3 0.001% 100.010% ** Level 4 read latency histogram (micros): Count: 310 Average: 122.4419 StdDev: 419.78 Min: 1 Median: 1.7903 Max: 2750 Percentiles: P50: 1.79 P75: 6.36 P99: 2125.00 P99.9: 2750.00 P99.99: 2750.00 ------------------------------------------------------ [ 0, 1 ] 57 18.387% 18.387% #### ( 1, 2 ] 124 40.000% 58.387% ######## ( 2, 3 ] 39 12.581% 70.968% ### ( 3, 4 ] 2 0.645% 71.613% ( 4, 6 ] 8 2.581% 74.194% # ( 6, 10 ] 28 9.032% 83.226% ## ( 10, 15 ] 21 6.774% 90.000% # ( 110, 170 ] 4 1.290% 91.290% ( 170, 250 ] 2 0.645% 91.935% ( 380, 580 ] 1 0.323% 92.258% ( 580, 870 ] 1 0.323% 92.581% ( 870, 1300 ] 11 3.548% 96.129% # ( 1300, 1900 ] 8 2.581% 98.710% # ( 1900, 2900 ] 4 1.290% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 559.8000 StdDev: 812.07 Min: 109 Median: 241.1111 Max: 4407 Percentiles: P50: 241.11 P75: 580.00 P99: 4407.00 P99.9: 4407.00 P99.99: 4407.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 10 25.000% 30.000% ##### ( 170, 250 ] 9 22.500% 52.500% ##### ( 250, 380 ] 6 15.000% 67.500% ### ( 380, 580 ] 3 7.500% 75.000% ## ( 580, 870 ] 4 10.000% 85.000% ## ( 870, 1300 ] 2 5.000% 90.000% # ( 1300, 1900 ] 1 2.500% 92.500% # ( 1900, 2900 ] 2 5.000% 97.500% # ( 4400, 6600 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 31.8 total, 3.1 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 185.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.009 H:M:S, 44.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 316.36 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/11/05-11:35:27 ... thread 0: (1000000,7000000) ops and (194159.6,190225.4) ops/second in (5.150402,36.798448) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/16 2.70 GB 6.3 5.2 0.0 5.2 11.9 6.6 0.0 1.8 127.5 289.4 41.99 38.38 124 0.339 5437K 5457 0.0 0.0 L1 0/0 0.00 KB 0.0 3.8 3.7 0.0 3.7 3.7 0.2 1.0 230.5 227.0 16.67 16.06 2 8.333 3901K 59K 0.0 0.0 L2 1/0 60.61 MB 0.6 1.5 1.3 0.3 1.5 1.3 2.6 1.2 203.6 203.1 7.58 6.81 3 2.527 582K 184 0.0 0.0 L3 15/0 996.37 MB 1.0 4.2 2.8 1.3 4.1 2.8 1.0 1.5 196.2 195.8 21.68 18.88 14 1.548 4319K 9664 0.0 0.0 L4 189/0 9.58 GB 1.0 2.9 2.8 0.1 2.9 2.8 0.9 1.0 128.2 128.0 23.15 14.22 45 0.514 2937K 2352 0.0 0.0 L5 1096/0 89.38 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1318/16 102.70 GB 0.0 17.5 10.6 6.9 24.1 17.2 8.4 3.6 161.7 222.2 111.07 94.36 188 0.591 17M 77K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.5 10.6 6.9 24.1 17.2 8.4 3.6 161.7 222.2 111.07 94.36 188 0.591 17M 77K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.5 10.6 6.9 17.5 10.5 0.0 0.0 198.8 197.9 90.35 76.74 85 1.063 17M 77K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 328.5 20.71 17.62 103 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 37.0 total, 36.8 interval Flush(GB): cumulative 6.645, interval 6.645 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.10 GB write, 667.48 MB/s write, 17.54 GB read, 485.75 MB/s read, 111.1 seconds Interval compaction: 24.10 GB write, 670.70 MB/s write, 17.54 GB read, 488.09 MB/s read, 111.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 30, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 30, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2498261 Average: 2.4958 StdDev: 20.97 Min: 0 Median: 1.4473 Max: 12200 Percentiles: P50: 1.45 P75: 1.86 P99: 6.00 P99.9: 127.64 P99.99: 318.02 ------------------------------------------------------ [ 0, 1 ] 567180 22.703% 22.703% ##### ( 1, 2 ] 1524571 61.025% 83.728% ############ ( 2, 3 ] 220541 8.828% 92.556% ## ( 3, 4 ] 93385 3.738% 96.294% # ( 4, 6 ] 67744 2.712% 99.006% # ( 6, 10 ] 16272 0.651% 99.657% ( 10, 15 ] 3801 0.152% 99.809% ( 15, 22 ] 621 0.025% 99.834% ( 22, 34 ] 80 0.003% 99.837% ( 34, 51 ] 24 0.001% 99.838% ( 51, 76 ] 23 0.001% 99.839% ( 76, 110 ] 823 0.033% 99.872% ( 110, 170 ] 2373 0.095% 99.967% ( 170, 250 ] 434 0.017% 99.984% ( 250, 380 ] 266 0.011% 99.995% ( 380, 580 ] 155 0.006% 100.001% ( 580, 870 ] 88 0.004% 100.005% ( 870, 1300 ] 58 0.002% 100.007% ( 1300, 1900 ] 26 0.001% 100.008% ( 1900, 2900 ] 35 0.001% 100.010% ( 2900, 4400 ] 30 0.001% 100.011% ( 4400, 6600 ] 4 0.000% 100.011% ( 9900, 14000 ] 1 0.000% 100.011% ** Level 1 read latency histogram (micros): Count: 957482 Average: 4.1480 StdDev: 55.73 Min: 0 Median: 1.9282 Max: 8393 Percentiles: P50: 1.93 P75: 2.86 P99: 9.21 P99.9: 18.64 P99.99: 148.69 ------------------------------------------------------ [ 0, 1 ] 11476 1.199% 1.199% ( 1, 2 ] 503423 52.578% 53.776% ########### ( 2, 3 ] 237036 24.756% 78.533% ##### ( 3, 4 ] 95012 9.923% 88.456% ## ( 4, 6 ] 83924 8.765% 97.221% ## ( 6, 10 ] 21259 2.220% 99.441% ( 10, 15 ] 4126 0.431% 99.872% ( 15, 22 ] 516 0.054% 99.926% ( 22, 34 ] 48 0.005% 99.931% ( 34, 51 ] 8 0.001% 99.932% ( 51, 76 ] 9 0.001% 99.933% ( 76, 110 ] 163 0.017% 99.950% ( 110, 170 ] 599 0.063% 100.012% ( 170, 250 ] 405 0.042% 100.055% ( 250, 380 ] 227 0.024% 100.078% ( 380, 580 ] 177 0.018% 100.097% ( 580, 870 ] 90 0.009% 100.106% ( 870, 1300 ] 59 0.006% 100.112% ( 1300, 1900 ] 58 0.006% 100.118% ( 1900, 2900 ] 54 0.006% 100.124% ( 2900, 4400 ] 95 0.010% 100.134% ( 4400, 6600 ] 23 0.002% 100.136% ( 6600, 9900 ] 7 0.001% 100.137% ** Level 2 read latency histogram (micros): Count: 205987 Average: 3.3998 StdDev: 44.78 Min: 0 Median: 1.6786 Max: 8105 Percentiles: P50: 1.68 P75: 2.41 P99: 7.84 P99.9: 21.58 P99.99: 493.34 ------------------------------------------------------ [ 0, 1 ] 25011 12.142% 12.142% ## ( 1, 2 ] 114910 55.785% 67.927% ########### ( 2, 3 ] 35642 17.303% 85.230% ### ( 3, 4 ] 14475 7.027% 92.257% # ( 4, 6 ] 12808 6.218% 98.475% # ( 6, 10 ] 2354 1.143% 99.618% ( 10, 15 ] 518 0.251% 99.869% ( 15, 22 ] 67 0.033% 99.902% ( 22, 34 ] 8 0.004% 99.906% ( 34, 51 ] 7 0.003% 99.909% ( 51, 76 ] 2 0.001% 99.910% ( 76, 110 ] 55 0.027% 99.937% ( 110, 170 ] 19 0.009% 99.946% ( 170, 250 ] 46 0.022% 99.968% ( 250, 380 ] 24 0.012% 99.980% ( 380, 580 ] 36 0.017% 99.998% ( 580, 870 ] 39 0.019% 100.017% ( 870, 1300 ] 16 0.008% 100.024% ( 1300, 1900 ] 12 0.006% 100.030% ( 1900, 2900 ] 10 0.005% 100.035% ( 2900, 4400 ] 9 0.004% 100.039% ( 4400, 6600 ] 3 0.001% 100.041% ( 6600, 9900 ] 1 0.000% 100.041% ** Level 3 read latency histogram (micros): Count: 973672 Average: 5.6776 StdDev: 86.53 Min: 0 Median: 1.9371 Max: 12011 Percentiles: P50: 1.94 P75: 2.91 P99: 9.32 P99.9: 204.93 P99.99: 485.16 ------------------------------------------------------ [ 0, 1 ] 30556 3.138% 3.138% # ( 1, 2 ] 486894 50.006% 53.144% ########## ( 2, 3 ] 232891 23.919% 77.063% ##### ( 3, 4 ] 102437 10.521% 87.584% ## ( 4, 6 ] 94706 9.727% 97.310% ## ( 6, 10 ] 19827 2.036% 99.347% ( 10, 15 ] 3813 0.392% 99.738% ( 15, 22 ] 462 0.047% 99.786% ( 22, 34 ] 133 0.014% 99.799% ( 34, 51 ] 298 0.031% 99.830% ( 51, 76 ] 72 0.007% 99.837% ( 76, 110 ] 133 0.014% 99.851% ( 110, 170 ] 279 0.029% 99.880% ( 170, 250 ] 452 0.046% 99.926% ( 250, 380 ] 415 0.043% 99.969% ( 380, 580 ] 393 0.040% 100.009% ( 580, 870 ] 256 0.026% 100.035% ( 870, 1300 ] 199 0.020% 100.056% ( 1300, 1900 ] 149 0.015% 100.071% ( 1900, 2900 ] 183 0.019% 100.090% ( 2900, 4400 ] 228 0.023% 100.113% ( 4400, 6600 ] 41 0.004% 100.118% ( 6600, 9900 ] 17 0.002% 100.119% ( 9900, 14000 ] 3 0.000% 100.120% ** Level 4 read latency histogram (micros): Count: 35143 Average: 98.0300 StdDev: 470.93 Min: 1 Median: 2.1708 Max: 9766 Percentiles: P50: 2.17 P75: 3.43 P99: 2922.70 P99.9: 5246.64 P99.99: 7212.85 ------------------------------------------------------ [ 0, 1 ] 701 1.995% 1.995% ( 1, 2 ] 15416 43.866% 45.861% ######### ( 2, 3 ] 8518 24.238% 70.099% ##### ( 3, 4 ] 4013 11.419% 81.518% ## ( 4, 6 ] 2433 6.923% 88.442% # ( 6, 10 ] 777 2.211% 90.652% ( 10, 15 ] 174 0.495% 91.148% ( 15, 22 ] 28 0.080% 91.227% ( 22, 34 ] 1 0.003% 91.230% ( 34, 51 ] 1 0.003% 91.233% ( 76, 110 ] 52 0.148% 91.381% ( 110, 170 ] 254 0.723% 92.104% ( 170, 250 ] 307 0.874% 92.977% ( 250, 380 ] 431 1.226% 94.204% ( 380, 580 ] 512 1.457% 95.661% ( 580, 870 ] 428 1.218% 96.878% ( 870, 1300 ] 325 0.925% 97.803% ( 1300, 1900 ] 190 0.541% 98.344% ( 1900, 2900 ] 226 0.643% 98.987% ( 2900, 4400 ] 302 0.859% 99.846% ( 4400, 6600 ] 49 0.139% 99.986% ( 6600, 9900 ] 8 0.023% 100.009% ** Level 5 read latency histogram (micros): Count: 220 Average: 858.2682 StdDev: 1220.46 Min: 96 Median: 372.9730 Max: 7603 Percentiles: P50: 372.97 P75: 870.00 P99: 7480.00 P99.9: 7603.00 P99.99: 7603.00 ------------------------------------------------------ ( 76, 110 ] 5 2.273% 2.273% ( 110, 170 ] 31 14.091% 16.364% ### ( 170, 250 ] 39 17.727% 34.091% #### ( 250, 380 ] 37 16.818% 50.909% ### ( 380, 580 ] 23 10.455% 61.364% ## ( 580, 870 ] 30 13.636% 75.000% ### ( 870, 1300 ] 20 9.091% 84.091% ## ( 1300, 1900 ] 9 4.091% 88.182% # ( 1900, 2900 ] 9 4.091% 92.273% # ( 2900, 4400 ] 10 4.545% 96.818% # ( 4400, 6600 ] 4 1.818% 98.636% ( 6600, 9900 ] 3 1.364% 100.000% ** DB Stats ** Uptime(secs): 37.0 total, 5.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 186.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.457 H:M:S, 41.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 191.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.448 H:M:S, 28.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/05-11:35:33 ... thread 0: (1000000,8000000) ops and (172096.8,187753.2) ops/second in (5.810683,42.609131) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/17 3.69 GB 37.7 6.6 0.0 6.6 14.2 7.6 0.0 1.9 134.3 289.7 50.21 46.32 145 0.346 6844K 6975 0.0 0.0 L1 0/0 0.00 KB 0.0 3.8 3.7 0.0 3.7 3.7 0.2 1.0 230.5 227.0 16.67 16.06 2 8.333 3901K 59K 0.0 0.0 L2 1/0 60.61 MB 0.6 1.5 1.3 0.3 1.5 1.3 2.6 1.2 203.6 203.1 7.58 6.81 3 2.527 582K 184 0.0 0.0 L3 15/0 996.37 MB 1.0 4.2 2.8 1.3 4.1 2.8 1.0 1.5 196.2 195.8 21.68 18.88 14 1.548 4319K 9664 0.0 0.0 L4 189/0 9.58 GB 1.0 2.9 2.8 0.1 2.9 2.8 0.9 1.0 128.2 128.0 23.15 14.22 45 0.514 2937K 2352 0.0 0.0 L5 1096/0 89.38 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1319/17 103.68 GB 0.0 18.9 10.6 8.3 26.4 18.1 8.4 3.5 162.2 227.0 119.28 102.30 209 0.571 18M 78K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.9 10.6 8.3 26.4 18.1 8.4 3.5 162.2 227.0 119.28 102.30 209 0.571 18M 78K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.9 10.6 8.3 18.8 10.5 0.0 0.0 202.1 201.2 95.73 82.04 90 1.064 18M 78K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 331.7 23.55 20.26 119 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 42.8 total, 42.6 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.44 GB write, 632.75 MB/s write, 18.89 GB read, 452.17 MB/s read, 119.3 seconds Interval compaction: 26.44 GB write, 635.38 MB/s write, 18.89 GB read, 454.06 MB/s read, 119.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 30, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 30, interval: 47 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3181518 Average: 2.4359 StdDev: 18.79 Min: 0 Median: 1.4614 Max: 12200 Percentiles: P50: 1.46 P75: 1.86 P99: 5.98 P99.9: 110.75 P99.99: 233.74 ------------------------------------------------------ [ 0, 1 ] 673077 21.156% 21.156% #### ( 1, 2 ] 1988913 62.515% 83.670% ############# ( 2, 3 ] 291493 9.162% 92.833% ## ( 3, 4 ] 116588 3.665% 96.497% # ( 4, 6 ] 80321 2.525% 99.022% # ( 6, 10 ] 21737 0.683% 99.705% ( 10, 15 ] 4456 0.140% 99.845% ( 15, 22 ] 667 0.021% 99.866% ( 22, 34 ] 87 0.003% 99.869% ( 34, 51 ] 25 0.001% 99.869% ( 51, 76 ] 28 0.001% 99.870% ( 76, 110 ] 915 0.029% 99.899% ( 110, 170 ] 2518 0.079% 99.978% ( 170, 250 ] 473 0.015% 99.993% ( 250, 380 ] 284 0.009% 100.002% ( 380, 580 ] 162 0.005% 100.007% ( 580, 870 ] 91 0.003% 100.010% ( 870, 1300 ] 62 0.002% 100.012% ( 1300, 1900 ] 30 0.001% 100.013% ( 1900, 2900 ] 35 0.001% 100.014% ( 2900, 4400 ] 30 0.001% 100.015% ( 4400, 6600 ] 4 0.000% 100.015% ( 9900, 14000 ] 1 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 957482 Average: 4.1480 StdDev: 55.73 Min: 0 Median: 1.9282 Max: 8393 Percentiles: P50: 1.93 P75: 2.86 P99: 9.21 P99.9: 18.64 P99.99: 148.69 ------------------------------------------------------ [ 0, 1 ] 11476 1.199% 1.199% ( 1, 2 ] 503423 52.578% 53.776% ########### ( 2, 3 ] 237036 24.756% 78.533% ##### ( 3, 4 ] 95012 9.923% 88.456% ## ( 4, 6 ] 83924 8.765% 97.221% ## ( 6, 10 ] 21259 2.220% 99.441% ( 10, 15 ] 4126 0.431% 99.872% ( 15, 22 ] 516 0.054% 99.926% ( 22, 34 ] 48 0.005% 99.931% ( 34, 51 ] 8 0.001% 99.932% ( 51, 76 ] 9 0.001% 99.933% ( 76, 110 ] 163 0.017% 99.950% ( 110, 170 ] 599 0.063% 100.012% ( 170, 250 ] 405 0.042% 100.055% ( 250, 380 ] 227 0.024% 100.078% ( 380, 580 ] 177 0.018% 100.097% ( 580, 870 ] 90 0.009% 100.106% ( 870, 1300 ] 59 0.006% 100.112% ( 1300, 1900 ] 58 0.006% 100.118% ( 1900, 2900 ] 54 0.006% 100.124% ( 2900, 4400 ] 95 0.010% 100.134% ( 4400, 6600 ] 23 0.002% 100.136% ( 6600, 9900 ] 7 0.001% 100.137% ** Level 2 read latency histogram (micros): Count: 205987 Average: 3.3998 StdDev: 44.78 Min: 0 Median: 1.6786 Max: 8105 Percentiles: P50: 1.68 P75: 2.41 P99: 7.84 P99.9: 21.58 P99.99: 493.34 ------------------------------------------------------ [ 0, 1 ] 25011 12.142% 12.142% ## ( 1, 2 ] 114910 55.785% 67.927% ########### ( 2, 3 ] 35642 17.303% 85.230% ### ( 3, 4 ] 14475 7.027% 92.257% # ( 4, 6 ] 12808 6.218% 98.475% # ( 6, 10 ] 2354 1.143% 99.618% ( 10, 15 ] 518 0.251% 99.869% ( 15, 22 ] 67 0.033% 99.902% ( 22, 34 ] 8 0.004% 99.906% ( 34, 51 ] 7 0.003% 99.909% ( 51, 76 ] 2 0.001% 99.910% ( 76, 110 ] 55 0.027% 99.937% ( 110, 170 ] 19 0.009% 99.946% ( 170, 250 ] 46 0.022% 99.968% ( 250, 380 ] 24 0.012% 99.980% ( 380, 580 ] 36 0.017% 99.998% ( 580, 870 ] 39 0.019% 100.017% ( 870, 1300 ] 16 0.008% 100.024% ( 1300, 1900 ] 12 0.006% 100.030% ( 1900, 2900 ] 10 0.005% 100.035% ( 2900, 4400 ] 9 0.004% 100.039% ( 4400, 6600 ] 3 0.001% 100.041% ( 6600, 9900 ] 1 0.000% 100.041% ** Level 3 read latency histogram (micros): Count: 973672 Average: 5.6776 StdDev: 86.53 Min: 0 Median: 1.9371 Max: 12011 Percentiles: P50: 1.94 P75: 2.91 P99: 9.32 P99.9: 204.93 P99.99: 485.16 ------------------------------------------------------ [ 0, 1 ] 30556 3.138% 3.138% # ( 1, 2 ] 486894 50.006% 53.144% ########## ( 2, 3 ] 232891 23.919% 77.063% ##### ( 3, 4 ] 102437 10.521% 87.584% ## ( 4, 6 ] 94706 9.727% 97.310% ## ( 6, 10 ] 19827 2.036% 99.347% ( 10, 15 ] 3813 0.392% 99.738% ( 15, 22 ] 462 0.047% 99.786% ( 22, 34 ] 133 0.014% 99.799% ( 34, 51 ] 298 0.031% 99.830% ( 51, 76 ] 72 0.007% 99.837% ( 76, 110 ] 133 0.014% 99.851% ( 110, 170 ] 279 0.029% 99.880% ( 170, 250 ] 452 0.046% 99.926% ( 250, 380 ] 415 0.043% 99.969% ( 380, 580 ] 393 0.040% 100.009% ( 580, 870 ] 256 0.026% 100.035% ( 870, 1300 ] 199 0.020% 100.056% ( 1300, 1900 ] 149 0.015% 100.071% ( 1900, 2900 ] 183 0.019% 100.090% ( 2900, 4400 ] 228 0.023% 100.113% ( 4400, 6600 ] 41 0.004% 100.118% ( 6600, 9900 ] 17 0.002% 100.119% ( 9900, 14000 ] 3 0.000% 100.120% ** Level 4 read latency histogram (micros): Count: 35143 Average: 98.0300 StdDev: 470.93 Min: 1 Median: 2.1708 Max: 9766 Percentiles: P50: 2.17 P75: 3.43 P99: 2922.70 P99.9: 5246.64 P99.99: 7212.85 ------------------------------------------------------ [ 0, 1 ] 701 1.995% 1.995% ( 1, 2 ] 15416 43.866% 45.861% ######### ( 2, 3 ] 8518 24.238% 70.099% ##### ( 3, 4 ] 4013 11.419% 81.518% ## ( 4, 6 ] 2433 6.923% 88.442% # ( 6, 10 ] 777 2.211% 90.652% ( 10, 15 ] 174 0.495% 91.148% ( 15, 22 ] 28 0.080% 91.227% ( 22, 34 ] 1 0.003% 91.230% ( 34, 51 ] 1 0.003% 91.233% ( 76, 110 ] 52 0.148% 91.381% ( 110, 170 ] 254 0.723% 92.104% ( 170, 250 ] 307 0.874% 92.977% ( 250, 380 ] 431 1.226% 94.204% ( 380, 580 ] 512 1.457% 95.661% ( 580, 870 ] 428 1.218% 96.878% ( 870, 1300 ] 325 0.925% 97.803% ( 1300, 1900 ] 190 0.541% 98.344% ( 1900, 2900 ] 226 0.643% 98.987% ( 2900, 4400 ] 302 0.859% 99.846% ( 4400, 6600 ] 49 0.139% 99.986% ( 6600, 9900 ] 8 0.023% 100.009% ** Level 5 read latency histogram (micros): Count: 220 Average: 858.2682 StdDev: 1220.46 Min: 96 Median: 372.9730 Max: 7603 Percentiles: P50: 372.97 P75: 870.00 P99: 7480.00 P99.9: 7603.00 P99.99: 7603.00 ------------------------------------------------------ ( 76, 110 ] 5 2.273% 2.273% ( 110, 170 ] 31 14.091% 16.364% ### ( 170, 250 ] 39 17.727% 34.091% #### ( 250, 380 ] 37 16.818% 50.909% ### ( 380, 580 ] 23 10.455% 61.364% ## ( 580, 870 ] 30 13.636% 75.000% ### ( 870, 1300 ] 20 9.091% 84.091% ## ( 1300, 1900 ] 9 4.091% 88.182% # ( 1900, 2900 ] 9 4.091% 92.273% # ( 2900, 4400 ] 10 4.545% 96.818% # ( 4400, 6600 ] 4 1.818% 98.636% ( 6600, 9900 ] 3 1.364% 100.000% ** DB Stats ** Uptime(secs): 42.8 total, 5.8 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 184.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.239 H:M:S, 42.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 169.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.782 H:M:S, 47.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/05-11:35:40 ... thread 0: (1000000,9000000) ops and (128653.2,178635.3) ops/second in (7.772836,50.381967) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 2.27 GB 6.3 7.9 0.0 7.9 16.4 8.5 0.0 1.9 131.1 272.3 61.50 54.22 158 0.389 8186K 11K 0.0 0.0 L1 4/4 211.88 MB 0.0 6.0 6.0 0.0 5.9 5.9 0.2 1.0 224.8 221.7 27.45 26.07 3 9.151 6266K 84K 0.0 0.0 L2 1/0 78.59 MB 0.8 1.5 1.3 0.3 1.5 1.3 4.7 1.2 203.6 203.1 7.58 6.81 3 2.527 582K 184 0.0 0.0 L3 18/3 1.28 GB 0.9 4.6 3.0 1.6 4.6 3.0 2.8 1.5 185.7 185.1 25.40 21.18 17 1.494 4790K 15K 0.0 0.0 L4 184/32 10.64 GB 1.0 6.6 4.5 2.1 6.5 4.4 0.9 1.5 124.7 123.9 54.00 33.10 61 0.885 6730K 37K 0.0 0.0 L5 1104/0 90.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1321/48 104.47 GB 0.0 26.6 14.8 11.8 34.9 23.1 12.8 4.1 154.8 203.3 175.94 141.38 242 0.727 26M 149K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.6 14.8 11.8 34.9 23.1 12.8 4.1 154.8 203.3 175.94 141.38 242 0.727 26M 149K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.6 14.8 11.8 26.4 14.6 0.0 0.0 184.8 183.7 147.36 118.54 112 1.316 26M 149K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 304.2 28.58 22.84 130 0.220 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.6 total, 50.4 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.93 GB write, 707.38 MB/s write, 26.59 GB read, 538.54 MB/s read, 175.9 seconds Interval compaction: 34.93 GB write, 709.87 MB/s write, 26.59 GB read, 540.44 MB/s read, 175.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 20, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 20, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 49, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 49, interval: 69 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3773829 Average: 2.6745 StdDev: 33.47 Min: 0 Median: 1.4933 Max: 15866 Percentiles: P50: 1.49 P75: 1.90 P99: 6.60 P99.9: 114.66 P99.99: 350.58 ------------------------------------------------------ [ 0, 1 ] 728754 19.311% 19.311% #### ( 1, 2 ] 2347901 62.215% 81.526% ############ ( 2, 3 ] 385323 10.210% 91.736% ## ( 3, 4 ] 154482 4.094% 95.830% # ( 4, 6 ] 115057 3.049% 98.879% # ( 6, 10 ] 30598 0.811% 99.690% ( 10, 15 ] 5813 0.154% 99.844% ( 15, 22 ] 798 0.021% 99.865% ( 22, 34 ] 108 0.003% 99.868% ( 34, 51 ] 35 0.001% 99.869% ( 51, 76 ] 35 0.001% 99.869% ( 76, 110 ] 946 0.025% 99.895% ( 110, 170 ] 2654 0.070% 99.965% ( 170, 250 ] 626 0.017% 99.981% ( 250, 380 ] 417 0.011% 99.993% ( 380, 580 ] 290 0.008% 100.000% ( 580, 870 ] 182 0.005% 100.005% ( 870, 1300 ] 118 0.003% 100.008% ( 1300, 1900 ] 52 0.001% 100.010% ( 1900, 2900 ] 87 0.002% 100.012% ( 2900, 4400 ] 88 0.002% 100.014% ( 4400, 6600 ] 20 0.001% 100.015% ( 6600, 9900 ] 11 0.000% 100.015% ( 9900, 14000 ] 1 0.000% 100.015% ( 14000, 22000 ] 3 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 1279491 Average: 4.7099 StdDev: 83.32 Min: 0 Median: 1.9643 Max: 32928 Percentiles: P50: 1.96 P75: 2.92 P99: 9.31 P99.9: 28.38 P99.99: 207.41 ------------------------------------------------------ [ 0, 1 ] 15127 1.182% 1.182% ( 1, 2 ] 647767 50.627% 51.809% ########## ( 2, 3 ] 323558 25.288% 77.097% ##### ( 3, 4 ] 132024 10.318% 87.416% ## ( 4, 6 ] 123233 9.631% 97.047% ## ( 6, 10 ] 30182 2.359% 99.406% ( 10, 15 ] 5629 0.440% 99.846% ( 15, 22 ] 658 0.051% 99.897% ( 22, 34 ] 63 0.005% 99.902% ( 34, 51 ] 32 0.003% 99.905% ( 51, 76 ] 19 0.001% 99.906% ( 76, 110 ] 174 0.014% 99.920% ( 110, 170 ] 652 0.051% 99.971% ( 170, 250 ] 524 0.041% 100.012% ( 250, 380 ] 390 0.030% 100.042% ( 380, 580 ] 332 0.026% 100.068% ( 580, 870 ] 187 0.015% 100.083% ( 870, 1300 ] 118 0.009% 100.092% ( 1300, 1900 ] 84 0.007% 100.099% ( 1900, 2900 ] 95 0.007% 100.106% ( 2900, 4400 ] 172 0.013% 100.120% ( 4400, 6600 ] 34 0.003% 100.122% ( 6600, 9900 ] 25 0.002% 100.124% ( 9900, 14000 ] 4 0.000% 100.124% ( 14000, 22000 ] 4 0.000% 100.125% ( 22000, 33000 ] 2 0.000% 100.125% ** Level 2 read latency histogram (micros): Count: 402864 Average: 7.2828 StdDev: 141.56 Min: 0 Median: 1.8858 Max: 22969 Percentiles: P50: 1.89 P75: 2.85 P99: 9.43 P99.9: 496.38 P99.99: 2738.44 ------------------------------------------------------ [ 0, 1 ] 26291 6.526% 6.526% # ( 1, 2 ] 197710 49.076% 55.602% ########## ( 2, 3 ] 91714 22.765% 78.368% ##### ( 3, 4 ] 37658 9.348% 87.715% ## ( 4, 6 ] 38328 9.514% 97.229% ## ( 6, 10 ] 8326 2.067% 99.296% ( 10, 15 ] 1681 0.417% 99.713% ( 15, 22 ] 208 0.052% 99.765% ( 22, 34 ] 29 0.007% 99.772% ( 34, 51 ] 39 0.010% 99.782% ( 51, 76 ] 15 0.004% 99.785% ( 76, 110 ] 62 0.015% 99.801% ( 110, 170 ] 70 0.017% 99.818% ( 170, 250 ] 114 0.028% 99.846% ( 250, 380 ] 137 0.034% 99.880% ( 380, 580 ] 136 0.034% 99.914% ( 580, 870 ] 105 0.026% 99.940% ( 870, 1300 ] 51 0.013% 99.953% ( 1300, 1900 ] 60 0.015% 99.968% ( 1900, 2900 ] 107 0.027% 99.994% ( 2900, 4400 ] 151 0.037% 100.032% ( 4400, 6600 ] 61 0.015% 100.047% ( 6600, 9900 ] 21 0.005% 100.052% ( 9900, 14000 ] 2 0.000% 100.053% ( 14000, 22000 ] 5 0.001% 100.054% ( 22000, 33000 ] 1 0.000% 100.054% ** Level 3 read latency histogram (micros): Count: 1086061 Average: 5.8503 StdDev: 100.00 Min: 0 Median: 1.9539 Max: 27940 Percentiles: P50: 1.95 P75: 2.93 P99: 9.32 P99.9: 224.21 P99.99: 535.83 ------------------------------------------------------ [ 0, 1 ] 31685 2.917% 2.917% # ( 1, 2 ] 536072 49.359% 52.277% ########## ( 2, 3 ] 264336 24.339% 76.616% ##### ( 3, 4 ] 115941 10.675% 87.291% ## ( 4, 6 ] 108875 10.025% 97.316% ## ( 6, 10 ] 22012 2.027% 99.343% ( 10, 15 ] 4277 0.394% 99.736% ( 15, 22 ] 502 0.046% 99.783% ( 22, 34 ] 140 0.013% 99.795% ( 34, 51 ] 302 0.028% 99.823% ( 51, 76 ] 74 0.007% 99.830% ( 76, 110 ] 135 0.012% 99.843% ( 110, 170 ] 298 0.027% 99.870% ( 170, 250 ] 481 0.044% 99.914% ( 250, 380 ] 478 0.044% 99.958% ( 380, 580 ] 442 0.041% 99.999% ( 580, 870 ] 288 0.027% 100.026% ( 870, 1300 ] 212 0.020% 100.045% ( 1300, 1900 ] 157 0.014% 100.059% ( 1900, 2900 ] 205 0.019% 100.078% ( 2900, 4400 ] 265 0.024% 100.103% ( 4400, 6600 ] 53 0.005% 100.108% ( 6600, 9900 ] 19 0.002% 100.109% ( 9900, 14000 ] 4 0.000% 100.110% ( 14000, 22000 ] 3 0.000% 100.110% ( 22000, 33000 ] 2 0.000% 100.110% ** Level 4 read latency histogram (micros): Count: 681308 Average: 18.1266 StdDev: 223.91 Min: 1 Median: 2.1656 Max: 29069 Percentiles: P50: 2.17 P75: 3.24 P99: 176.58 P99.9: 1946.50 P99.99: 2875.56 ------------------------------------------------------ [ 0, 1 ] 7155 1.050% 1.050% ( 1, 2 ] 303456 44.540% 45.590% ######### ( 2, 3 ] 181372 26.621% 72.212% ##### ( 3, 4 ] 79636 11.689% 83.900% ## ( 4, 6 ] 79445 11.661% 95.561% ## ( 6, 10 ] 18685 2.743% 98.303% # ( 10, 15 ] 3355 0.492% 98.796% ( 15, 22 ] 375 0.055% 98.851% ( 22, 34 ] 66 0.010% 98.861% ( 34, 51 ] 53 0.008% 98.868% ( 51, 76 ] 30 0.004% 98.873% ( 76, 110 ] 87 0.013% 98.886% ( 110, 170 ] 677 0.099% 98.985% ( 170, 250 ] 1263 0.185% 99.170% ( 250, 380 ] 1532 0.225% 99.395% ( 380, 580 ] 1349 0.198% 99.593% ( 580, 870 ] 958 0.141% 99.734% ( 870, 1300 ] 646 0.095% 99.829% ( 1300, 1900 ] 457 0.067% 99.896% ( 1900, 2900 ] 660 0.097% 99.993% ( 2900, 4400 ] 859 0.126% 100.119% ( 4400, 6600 ] 223 0.033% 100.151% ( 6600, 9900 ] 79 0.012% 100.163% ( 9900, 14000 ] 4 0.001% 100.164% ( 14000, 22000 ] 13 0.002% 100.165% ( 22000, 33000 ] 2 0.000% 100.166% ** Level 5 read latency histogram (micros): Count: 278 Average: 792.8345 StdDev: 1121.67 Min: 96 Median: 361.0417 Max: 7603 Percentiles: P50: 361.04 P75: 832.02 P99: 6842.00 P99.9: 7603.00 P99.99: 7603.00 ------------------------------------------------------ ( 76, 110 ] 6 2.158% 2.158% ( 110, 170 ] 39 14.029% 16.187% ### ( 170, 250 ] 53 19.065% 35.252% #### ( 250, 380 ] 48 17.266% 52.518% ### ( 380, 580 ] 26 9.353% 61.871% ## ( 580, 870 ] 42 15.108% 76.978% ### ( 870, 1300 ] 26 9.353% 86.331% ## ( 1300, 1900 ] 9 3.237% 89.568% # ( 1900, 2900 ] 12 4.317% 93.885% # ( 2900, 4400 ] 10 3.597% 97.482% # ( 4400, 6600 ] 4 1.439% 98.921% ( 6600, 9900 ] 3 1.079% 100.000% ** DB Stats ** Uptime(secs): 50.6 total, 7.8 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 175.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.431 H:M:S, 44.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 126.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.192 H:M:S, 53.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/11/05-11:35:43 ... thread 0: (1000000,10000000) ops and (312368.4,186625.3) ops/second in (3.201348,53.583315) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/13 3.25 GB 94.4 8.8 0.0 8.8 18.3 9.5 0.0 1.9 132.0 274.0 68.22 60.54 176 0.388 9146K 12K 0.0 0.0 L1 4/4 211.88 MB 0.0 6.0 6.0 0.0 5.9 5.9 0.2 1.0 224.8 221.7 27.45 26.07 3 9.151 6266K 84K 0.0 0.0 L2 1/0 78.59 MB 0.8 1.5 1.3 0.3 1.5 1.3 4.7 1.2 203.6 203.1 7.58 6.81 3 2.527 582K 184 0.0 0.0 L3 15/0 919.87 MB 0.9 4.6 3.0 1.6 4.6 3.0 2.8 1.5 185.7 185.1 25.40 21.18 17 1.494 4790K 15K 0.0 0.0 L4 162/0 9.65 GB 1.0 7.8 4.9 3.0 7.8 4.8 0.9 1.6 129.6 128.7 61.85 39.14 64 0.966 8030K 53K 0.0 0.0 L5 1120/0 91.35 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1318/17 105.44 GB 0.0 28.8 15.2 13.6 38.1 24.5 14.2 4.0 154.6 204.6 190.51 153.75 263 0.724 28M 166K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.8 15.2 13.6 38.1 24.5 14.2 4.0 154.6 204.6 190.51 153.75 263 0.724 28M 166K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.8 15.2 13.6 28.6 15.0 0.0 0.0 185.2 184.1 159.01 128.27 118 1.348 28M 166K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 308.1 31.49 25.48 145 0.217 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.8 total, 53.6 interval Flush(GB): cumulative 9.475, interval 9.475 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 38.07 GB write, 725.08 MB/s write, 28.76 GB read, 547.86 MB/s read, 190.5 seconds Interval compaction: 38.07 GB write, 727.48 MB/s write, 28.76 GB read, 549.68 MB/s read, 190.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 20, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 20, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 50, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 50, interval: 70 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4222499 Average: 2.6549 StdDev: 31.69 Min: 0 Median: 1.5112 Max: 15866 Percentiles: P50: 1.51 P75: 1.91 P99: 6.72 P99.9: 96.59 P99.99: 276.77 ------------------------------------------------------ [ 0, 1 ] 763865 18.090% 18.090% #### ( 1, 2 ] 2635962 62.427% 80.517% ############ ( 2, 3 ] 458515 10.859% 91.376% ## ( 3, 4 ] 180845 4.283% 95.659% # ( 4, 6 ] 134533 3.186% 98.845% # ( 6, 10 ] 36384 0.862% 99.706% ( 10, 15 ] 6555 0.155% 99.862% ( 15, 22 ] 850 0.020% 99.882% ( 22, 34 ] 114 0.003% 99.885% ( 34, 51 ] 41 0.001% 99.885% ( 51, 76 ] 40 0.001% 99.886% ( 76, 110 ] 947 0.022% 99.909% ( 110, 170 ] 2682 0.064% 99.972% ( 170, 250 ] 656 0.016% 99.988% ( 250, 380 ] 431 0.010% 99.998% ( 380, 580 ] 295 0.007% 100.005% ( 580, 870 ] 183 0.004% 100.009% ( 870, 1300 ] 120 0.003% 100.012% ( 1300, 1900 ] 55 0.001% 100.014% ( 1900, 2900 ] 87 0.002% 100.016% ( 2900, 4400 ] 88 0.002% 100.018% ( 4400, 6600 ] 20 0.000% 100.018% ( 6600, 9900 ] 11 0.000% 100.018% ( 9900, 14000 ] 1 0.000% 100.018% ( 14000, 22000 ] 3 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 1310489 Average: 4.6673 StdDev: 82.33 Min: 0 Median: 1.9631 Max: 32928 Percentiles: P50: 1.96 P75: 2.92 P99: 9.31 P99.9: 21.92 P99.99: 205.11 ------------------------------------------------------ [ 0, 1 ] 15671 1.196% 1.196% ( 1, 2 ] 664076 50.674% 51.870% ########## ( 2, 3 ] 330979 25.256% 77.126% ##### ( 3, 4 ] 135120 10.311% 87.437% ## ( 4, 6 ] 125974 9.613% 97.049% ## ( 6, 10 ] 30928 2.360% 99.409% ( 10, 15 ] 5761 0.440% 99.849% ( 15, 22 ] 677 0.052% 99.901% ( 22, 34 ] 64 0.005% 99.905% ( 34, 51 ] 32 0.002% 99.908% ( 51, 76 ] 20 0.002% 99.909% ( 76, 110 ] 174 0.013% 99.923% ( 110, 170 ] 652 0.050% 99.972% ( 170, 250 ] 524 0.040% 100.012% ( 250, 380 ] 390 0.030% 100.042% ( 380, 580 ] 332 0.025% 100.068% ( 580, 870 ] 187 0.014% 100.082% ( 870, 1300 ] 118 0.009% 100.091% ( 1300, 1900 ] 84 0.006% 100.097% ( 1900, 2900 ] 95 0.007% 100.104% ( 2900, 4400 ] 172 0.013% 100.118% ( 4400, 6600 ] 34 0.003% 100.120% ( 6600, 9900 ] 25 0.002% 100.122% ( 9900, 14000 ] 4 0.000% 100.122% ( 14000, 22000 ] 4 0.000% 100.123% ( 22000, 33000 ] 2 0.000% 100.123% ** Level 2 read latency histogram (micros): Count: 402864 Average: 7.2828 StdDev: 141.56 Min: 0 Median: 1.8858 Max: 22969 Percentiles: P50: 1.89 P75: 2.85 P99: 9.43 P99.9: 496.38 P99.99: 2738.44 ------------------------------------------------------ [ 0, 1 ] 26291 6.526% 6.526% # ( 1, 2 ] 197710 49.076% 55.602% ########## ( 2, 3 ] 91714 22.765% 78.368% ##### ( 3, 4 ] 37658 9.348% 87.715% ## ( 4, 6 ] 38328 9.514% 97.229% ## ( 6, 10 ] 8326 2.067% 99.296% ( 10, 15 ] 1681 0.417% 99.713% ( 15, 22 ] 208 0.052% 99.765% ( 22, 34 ] 29 0.007% 99.772% ( 34, 51 ] 39 0.010% 99.782% ( 51, 76 ] 15 0.004% 99.785% ( 76, 110 ] 62 0.015% 99.801% ( 110, 170 ] 70 0.017% 99.818% ( 170, 250 ] 114 0.028% 99.846% ( 250, 380 ] 137 0.034% 99.880% ( 380, 580 ] 136 0.034% 99.914% ( 580, 870 ] 105 0.026% 99.940% ( 870, 1300 ] 51 0.013% 99.953% ( 1300, 1900 ] 60 0.015% 99.968% ( 1900, 2900 ] 107 0.027% 99.994% ( 2900, 4400 ] 151 0.037% 100.032% ( 4400, 6600 ] 61 0.015% 100.047% ( 6600, 9900 ] 21 0.005% 100.052% ( 9900, 14000 ] 2 0.000% 100.053% ( 14000, 22000 ] 5 0.001% 100.054% ( 22000, 33000 ] 1 0.000% 100.054% ** Level 3 read latency histogram (micros): Count: 1086061 Average: 5.8503 StdDev: 100.00 Min: 0 Median: 1.9539 Max: 27940 Percentiles: P50: 1.95 P75: 2.93 P99: 9.32 P99.9: 224.21 P99.99: 535.83 ------------------------------------------------------ [ 0, 1 ] 31685 2.917% 2.917% # ( 1, 2 ] 536072 49.359% 52.277% ########## ( 2, 3 ] 264336 24.339% 76.616% ##### ( 3, 4 ] 115941 10.675% 87.291% ## ( 4, 6 ] 108875 10.025% 97.316% ## ( 6, 10 ] 22012 2.027% 99.343% ( 10, 15 ] 4277 0.394% 99.736% ( 15, 22 ] 502 0.046% 99.783% ( 22, 34 ] 140 0.013% 99.795% ( 34, 51 ] 302 0.028% 99.823% ( 51, 76 ] 74 0.007% 99.830% ( 76, 110 ] 135 0.012% 99.843% ( 110, 170 ] 298 0.027% 99.870% ( 170, 250 ] 481 0.044% 99.914% ( 250, 380 ] 478 0.044% 99.958% ( 380, 580 ] 442 0.041% 99.999% ( 580, 870 ] 288 0.027% 100.026% ( 870, 1300 ] 212 0.020% 100.045% ( 1300, 1900 ] 157 0.014% 100.059% ( 1900, 2900 ] 205 0.019% 100.078% ( 2900, 4400 ] 265 0.024% 100.103% ( 4400, 6600 ] 53 0.005% 100.108% ( 6600, 9900 ] 19 0.002% 100.109% ( 9900, 14000 ] 4 0.000% 100.110% ( 14000, 22000 ] 3 0.000% 100.110% ( 22000, 33000 ] 2 0.000% 100.110% ** Level 4 read latency histogram (micros): Count: 769409 Average: 16.5828 StdDev: 210.90 Min: 1 Median: 2.1259 Max: 29069 Percentiles: P50: 2.13 P75: 3.18 P99: 142.52 P99.9: 1752.42 P99.99: 2777.55 ------------------------------------------------------ [ 0, 1 ] 8369 1.088% 1.088% ( 1, 2 ] 350837 45.598% 46.686% ######### ( 2, 3 ] 202471 26.315% 73.001% ##### ( 3, 4 ] 87863 11.420% 84.421% ## ( 4, 6 ] 86487 11.241% 95.661% ## ( 6, 10 ] 20811 2.705% 98.366% # ( 10, 15 ] 3715 0.483% 98.849% ( 15, 22 ] 418 0.054% 98.903% ( 22, 34 ] 69 0.009% 98.912% ( 34, 51 ] 54 0.007% 98.919% ( 51, 76 ] 30 0.004% 98.923% ( 76, 110 ] 128 0.017% 98.940% ( 110, 170 ] 854 0.111% 99.051% ( 170, 250 ] 1487 0.193% 99.244% ( 250, 380 ] 1672 0.217% 99.461% ( 380, 580 ] 1413 0.184% 99.645% ( 580, 870 ] 971 0.126% 99.771% ( 870, 1300 ] 646 0.084% 99.855% ( 1300, 1900 ] 457 0.059% 99.915% ( 1900, 2900 ] 661 0.086% 100.001% ( 2900, 4400 ] 859 0.112% 100.112% ( 4400, 6600 ] 223 0.029% 100.141% ( 6600, 9900 ] 79 0.010% 100.151% ( 9900, 14000 ] 4 0.001% 100.152% ( 14000, 22000 ] 13 0.002% 100.154% ( 22000, 33000 ] 2 0.000% 100.154% ** Level 5 read latency histogram (micros): Count: 340 Average: 717.7294 StdDev: 1034.90 Min: 91 Median: 345.6604 Max: 7603 Percentiles: P50: 345.66 P75: 782.45 P99: 6380.00 P99.9: 7603.00 P99.99: 7603.00 ------------------------------------------------------ ( 76, 110 ] 15 4.412% 4.412% # ( 110, 170 ] 51 15.000% 19.412% ### ( 170, 250 ] 65 19.118% 38.529% #### ( 250, 380 ] 53 15.588% 54.118% ### ( 380, 580 ] 34 10.000% 64.118% ## ( 580, 870 ] 53 15.588% 79.706% ### ( 870, 1300 ] 31 9.118% 88.824% ## ( 1300, 1900 ] 9 2.647% 91.471% # ( 1900, 2900 ] 12 3.529% 95.000% # ( 2900, 4400 ] 10 2.941% 97.941% # ( 4400, 6600 ] 4 1.176% 99.118% ( 6600, 9900 ] 3 0.882% 100.000% ** DB Stats ** Uptime(secs): 53.8 total, 3.2 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 183.06 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.640 H:M:S, 42.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 307.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.209 H:M:S, 6.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/05-11:35:47 ... thread 0: (1000000,11000000) ops and (311973.9,193700.5) ops/second in (3.205396,56.788711) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/9 4.24 GB 220.2 9.8 0.0 9.8 20.3 10.4 0.0 1.9 133.8 275.8 75.31 67.35 195 0.386 10M 13K 0.0 0.0 L1 4/4 211.88 MB 0.0 6.0 6.0 0.0 5.9 5.9 0.2 1.0 224.8 221.7 27.45 26.07 3 9.151 6266K 84K 0.0 0.0 L2 1/0 78.59 MB 0.8 1.5 1.3 0.3 1.5 1.3 4.7 1.2 203.6 203.1 7.58 6.81 3 2.527 582K 184 0.0 0.0 L3 15/0 919.87 MB 0.9 4.6 3.0 1.6 4.6 3.0 2.8 1.5 185.7 185.1 25.40 21.18 17 1.494 4790K 15K 0.0 0.0 L4 162/0 9.65 GB 1.0 7.8 4.9 3.0 7.8 4.8 0.9 1.6 129.6 128.7 61.85 39.14 64 0.966 8030K 53K 0.0 0.0 L5 1120/0 91.35 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1321/13 106.42 GB 0.0 29.8 15.2 14.6 40.1 25.5 14.2 3.8 154.5 207.8 197.59 160.55 282 0.701 29M 167K 0.0 0.0 Int 0/0 0.00 KB 0.0 29.8 15.2 14.6 40.1 25.5 14.2 3.8 154.5 207.8 197.59 160.55 282 0.701 29M 167K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 29.8 15.2 14.6 29.6 15.0 0.0 0.0 187.0 185.9 163.28 132.45 122 1.338 29M 167K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 312.1 34.32 28.10 160 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.0 total, 56.8 interval Flush(GB): cumulative 10.459, interval 10.459 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 40.10 GB write, 720.75 MB/s write, 29.81 GB read, 535.83 MB/s read, 197.6 seconds Interval compaction: 40.10 GB write, 723.01 MB/s write, 29.81 GB read, 537.51 MB/s read, 197.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 51, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 51, interval: 72 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4658351 Average: 2.6244 StdDev: 30.24 Min: 0 Median: 1.5173 Max: 15866 Percentiles: P50: 1.52 P75: 1.91 P99: 6.68 P99.9: 80.35 P99.99: 240.05 ------------------------------------------------------ [ 0, 1 ] 812547 17.443% 17.443% ### ( 1, 2 ] 2931541 62.931% 80.374% ############# ( 2, 3 ] 515925 11.075% 91.449% ## ( 3, 4 ] 199789 4.289% 95.738% # ( 4, 6 ] 145089 3.115% 98.852% # ( 6, 10 ] 40581 0.871% 99.724% ( 10, 15 ] 7013 0.151% 99.874% ( 15, 22 ] 878 0.019% 99.893% ( 22, 34 ] 118 0.003% 99.895% ( 34, 51 ] 45 0.001% 99.896% ( 51, 76 ] 43 0.001% 99.897% ( 76, 110 ] 982 0.021% 99.918% ( 110, 170 ] 2732 0.059% 99.977% ( 170, 250 ] 690 0.015% 99.992% ( 250, 380 ] 446 0.010% 100.001% ( 380, 580 ] 297 0.006% 100.008% ( 580, 870 ] 187 0.004% 100.012% ( 870, 1300 ] 124 0.003% 100.015% ( 1300, 1900 ] 58 0.001% 100.016% ( 1900, 2900 ] 87 0.002% 100.018% ( 2900, 4400 ] 88 0.002% 100.020% ( 4400, 6600 ] 20 0.000% 100.020% ( 6600, 9900 ] 11 0.000% 100.020% ( 9900, 14000 ] 1 0.000% 100.020% ( 14000, 22000 ] 3 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1317800 Average: 4.6604 StdDev: 82.10 Min: 0 Median: 1.9601 Max: 32928 Percentiles: P50: 1.96 P75: 2.91 P99: 9.31 P99.9: 31.04 P99.99: 206.34 ------------------------------------------------------ [ 0, 1 ] 16471 1.250% 1.250% ( 1, 2 ] 669147 50.778% 52.027% ########## ( 2, 3 ] 331862 25.183% 77.211% ##### ( 3, 4 ] 135357 10.271% 87.482% ## ( 4, 6 ] 126105 9.569% 97.051% ## ( 6, 10 ] 31044 2.356% 99.407% ( 10, 15 ] 5769 0.438% 99.845% ( 15, 22 ] 679 0.052% 99.896% ( 22, 34 ] 64 0.005% 99.901% ( 34, 51 ] 32 0.002% 99.904% ( 51, 76 ] 20 0.002% 99.905% ( 76, 110 ] 205 0.016% 99.921% ( 110, 170 ] 672 0.051% 99.972% ( 170, 250 ] 531 0.040% 100.012% ( 250, 380 ] 394 0.030% 100.042% ( 380, 580 ] 333 0.025% 100.067% ( 580, 870 ] 187 0.014% 100.081% ( 870, 1300 ] 118 0.009% 100.090% ( 1300, 1900 ] 84 0.006% 100.097% ( 1900, 2900 ] 95 0.007% 100.104% ( 2900, 4400 ] 172 0.013% 100.117% ( 4400, 6600 ] 34 0.003% 100.120% ( 6600, 9900 ] 25 0.002% 100.121% ( 9900, 14000 ] 4 0.000% 100.122% ( 14000, 22000 ] 4 0.000% 100.122% ( 22000, 33000 ] 2 0.000% 100.122% ** Level 2 read latency histogram (micros): Count: 402864 Average: 7.2828 StdDev: 141.56 Min: 0 Median: 1.8858 Max: 22969 Percentiles: P50: 1.89 P75: 2.85 P99: 9.43 P99.9: 496.38 P99.99: 2738.44 ------------------------------------------------------ [ 0, 1 ] 26291 6.526% 6.526% # ( 1, 2 ] 197710 49.076% 55.602% ########## ( 2, 3 ] 91714 22.765% 78.368% ##### ( 3, 4 ] 37658 9.348% 87.715% ## ( 4, 6 ] 38328 9.514% 97.229% ## ( 6, 10 ] 8326 2.067% 99.296% ( 10, 15 ] 1681 0.417% 99.713% ( 15, 22 ] 208 0.052% 99.765% ( 22, 34 ] 29 0.007% 99.772% ( 34, 51 ] 39 0.010% 99.782% ( 51, 76 ] 15 0.004% 99.785% ( 76, 110 ] 62 0.015% 99.801% ( 110, 170 ] 70 0.017% 99.818% ( 170, 250 ] 114 0.028% 99.846% ( 250, 380 ] 137 0.034% 99.880% ( 380, 580 ] 136 0.034% 99.914% ( 580, 870 ] 105 0.026% 99.940% ( 870, 1300 ] 51 0.013% 99.953% ( 1300, 1900 ] 60 0.015% 99.968% ( 1900, 2900 ] 107 0.027% 99.994% ( 2900, 4400 ] 151 0.037% 100.032% ( 4400, 6600 ] 61 0.015% 100.047% ( 6600, 9900 ] 21 0.005% 100.052% ( 9900, 14000 ] 2 0.000% 100.053% ( 14000, 22000 ] 5 0.001% 100.054% ( 22000, 33000 ] 1 0.000% 100.054% ** Level 3 read latency histogram (micros): Count: 1086061 Average: 5.8503 StdDev: 100.00 Min: 0 Median: 1.9539 Max: 27940 Percentiles: P50: 1.95 P75: 2.93 P99: 9.32 P99.9: 224.21 P99.99: 535.83 ------------------------------------------------------ [ 0, 1 ] 31685 2.917% 2.917% # ( 1, 2 ] 536072 49.359% 52.277% ########## ( 2, 3 ] 264336 24.339% 76.616% ##### ( 3, 4 ] 115941 10.675% 87.291% ## ( 4, 6 ] 108875 10.025% 97.316% ## ( 6, 10 ] 22012 2.027% 99.343% ( 10, 15 ] 4277 0.394% 99.736% ( 15, 22 ] 502 0.046% 99.783% ( 22, 34 ] 140 0.013% 99.795% ( 34, 51 ] 302 0.028% 99.823% ( 51, 76 ] 74 0.007% 99.830% ( 76, 110 ] 135 0.012% 99.843% ( 110, 170 ] 298 0.027% 99.870% ( 170, 250 ] 481 0.044% 99.914% ( 250, 380 ] 478 0.044% 99.958% ( 380, 580 ] 442 0.041% 99.999% ( 580, 870 ] 288 0.027% 100.026% ( 870, 1300 ] 212 0.020% 100.045% ( 1300, 1900 ] 157 0.014% 100.059% ( 1900, 2900 ] 205 0.019% 100.078% ( 2900, 4400 ] 265 0.024% 100.103% ( 4400, 6600 ] 53 0.005% 100.108% ( 6600, 9900 ] 19 0.002% 100.109% ( 9900, 14000 ] 4 0.000% 100.110% ( 14000, 22000 ] 3 0.000% 100.110% ( 22000, 33000 ] 2 0.000% 100.110% ** Level 4 read latency histogram (micros): Count: 769409 Average: 16.5828 StdDev: 210.90 Min: 1 Median: 2.1259 Max: 29069 Percentiles: P50: 2.13 P75: 3.18 P99: 142.52 P99.9: 1752.42 P99.99: 2777.55 ------------------------------------------------------ [ 0, 1 ] 8369 1.088% 1.088% ( 1, 2 ] 350837 45.598% 46.686% ######### ( 2, 3 ] 202471 26.315% 73.001% ##### ( 3, 4 ] 87863 11.420% 84.421% ## ( 4, 6 ] 86487 11.241% 95.661% ## ( 6, 10 ] 20811 2.705% 98.366% # ( 10, 15 ] 3715 0.483% 98.849% ( 15, 22 ] 418 0.054% 98.903% ( 22, 34 ] 69 0.009% 98.912% ( 34, 51 ] 54 0.007% 98.919% ( 51, 76 ] 30 0.004% 98.923% ( 76, 110 ] 128 0.017% 98.940% ( 110, 170 ] 854 0.111% 99.051% ( 170, 250 ] 1487 0.193% 99.244% ( 250, 380 ] 1672 0.217% 99.461% ( 380, 580 ] 1413 0.184% 99.645% ( 580, 870 ] 971 0.126% 99.771% ( 870, 1300 ] 646 0.084% 99.855% ( 1300, 1900 ] 457 0.059% 99.915% ( 1900, 2900 ] 661 0.086% 100.001% ( 2900, 4400 ] 859 0.112% 100.112% ( 4400, 6600 ] 223 0.029% 100.141% ( 6600, 9900 ] 79 0.010% 100.151% ( 9900, 14000 ] 4 0.001% 100.152% ( 14000, 22000 ] 13 0.002% 100.154% ( 22000, 33000 ] 2 0.000% 100.154% ** Level 5 read latency histogram (micros): Count: 340 Average: 717.7294 StdDev: 1034.90 Min: 91 Median: 345.6604 Max: 7603 Percentiles: P50: 345.66 P75: 782.45 P99: 6380.00 P99.9: 7603.00 P99.99: 7603.00 ------------------------------------------------------ ( 76, 110 ] 15 4.412% 4.412% # ( 110, 170 ] 51 15.000% 19.412% ### ( 170, 250 ] 65 19.118% 38.529% #### ( 250, 380 ] 53 15.588% 54.118% ### ( 380, 580 ] 34 10.000% 64.118% ## ( 580, 870 ] 53 15.588% 79.706% ### ( 870, 1300 ] 31 9.118% 88.824% ## ( 1300, 1900 ] 9 2.647% 91.471% # ( 1900, 2900 ] 12 3.529% 95.000% # ( 2900, 4400 ] 10 2.941% 97.941% # ( 4400, 6600 ] 4 1.176% 99.118% ( 6600, 9900 ] 3 0.882% 100.000% ** DB Stats ** Uptime(secs): 57.0 total, 3.2 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 190.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.902 H:M:S, 40.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 307.04 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.262 H:M:S, 8.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.168 micros/op 193480 ops/sec 60.037 seconds 11615999 operations; 187.5 MB/s Microseconds per write: Count: 11615999 Average: 5.1685 StdDev: 391.59 Min: 1 Median: 1.8501 Max: 806454 Percentiles: P50: 1.85 P75: 3.14 P99: 8.80 P99.9: 990.95 P99.99: 2723.74 ------------------------------------------------------ [ 0, 1 ] 1143775 9.847% 9.847% ## ( 1, 2 ] 5486994 47.237% 57.083% ######### ( 2, 3 ] 1863783 16.045% 73.128% ### ( 3, 4 ] 1578334 13.588% 86.716% ### ( 4, 6 ] 1312147 11.296% 98.012% ## ( 6, 10 ] 163880 1.411% 99.422% ( 10, 15 ] 29178 0.251% 99.674% ( 15, 22 ] 8424 0.073% 99.746% ( 22, 34 ] 3012 0.026% 99.772% ( 34, 51 ] 510 0.004% 99.776% ( 51, 76 ] 99 0.001% 99.777% ( 76, 110 ] 27 0.000% 99.778% ( 110, 170 ] 10672 0.092% 99.869% ( 170, 250 ] 876 0.008% 99.877% ( 250, 380 ] 226 0.002% 99.879% ( 380, 580 ] 77 0.001% 99.880% ( 580, 870 ] 58 0.000% 99.880% ( 870, 1300 ] 8216 0.071% 99.951% ( 1300, 1900 ] 32 0.000% 99.951% ( 1900, 2900 ] 5484 0.047% 99.998% ( 2900, 4400 ] 152 0.001% 100.000% ( 4400, 6600 ] 15 0.000% 100.000% ( 6600, 9900 ] 9 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 75000, 110000 ] 3 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 3 0.000% 100.000% ( 250000, 380000 ] 3 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 196901 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11615999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11987710968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 715 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 24327387 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 35299745574 rocksdb.compact.write.bytes COUNT : 35093374369 rocksdb.flush.write.bytes COUNT : 11956862461 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 77 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 479 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11860023296 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4237312 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 35415174984 rocksdb.non.last.level.read.count COUNT : 8551118 rocksdb.block.checksum.compute.count COUNT : 8549765 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.508046 P95 : 4.917152 P99 : 7.490017 P100 : 806452.000000 COUNT : 11615999 SUM : 54382453 rocksdb.compaction.times.micros P50 : 942702.702703 P95 : 4040000.000000 P99 : 13454000.000000 P100 : 15345619.000000 COUNT : 126 SUM : 176195860 rocksdb.compaction.times.cpu_micros P50 : 886153.846154 P95 : 3495000.000000 P99 : 12908000.000000 P100 : 14770333.000000 COUNT : 126 SUM : 144672781 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 561.914894 P95 : 1273.722222 P99 : 6079.333333 P100 : 7017.000000 COUNT : 171 SUM : 133621 rocksdb.compaction.outfile.sync.micros P50 : 1006.635514 P95 : 6455.625000 P99 : 9603.000000 P100 : 16129.000000 COUNT : 462 SUM : 896597 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 108.033058 P95 : 999.000000 P99 : 4108.571429 P100 : 6790.000000 COUNT : 336 SUM : 101574 rocksdb.table.open.io.micros P50 : 833.440171 P95 : 5571.739130 P99 : 12428.333333 P100 : 28205.000000 COUNT : 715 SUM : 1140157 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.804584 P95 : 8.423524 P99 : 12.459596 P100 : 32935.000000 COUNT : 8547691 SUM : 60901603 rocksdb.read.block.get.micros P50 : 328.629032 P95 : 2025.000000 P99 : 5793.333333 P100 : 19961.000000 COUNT : 1430 SUM : 886171 rocksdb.write.raw.block.micros P50 : 0.519021 P95 : 0.986139 P99 : 3.251118 P100 : 87194.000000 COUNT : 11395550 SUM : 27399465 rocksdb.numfiles.in.singlecompaction P50 : 3.168831 P95 : 8.355556 P99 : 16.820000 P100 : 30.000000 COUNT : 174 SUM : 664 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.563511 P95 : 1266.590004 P99 : 2678.843952 P100 : 806252.000000 COUNT : 121556 SUM : 24335824 rocksdb.sst.read.micros P50 : 1.679611 P95 : 5.018603 P99 : 8.861335 P100 : 32928.000000 COUNT : 8551346 SUM : 41548774 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11615999 SUM : 11987710968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 200679.611650 P95 : 483550.000000 P99 : 791366.666667 P100 : 1001921.000000 COUNT : 171 SUM : 36258465 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 479 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0